[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:08:14.884052 12515 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.12.56.254:44149
I20260709 12:08:14.886262 12515 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:08:14.887393 12515 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:14.906064 12521 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:14.906095 12522 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:14.906107 12524 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:14.907469 12515 server_base.cc:1061] running on GCE node
I20260709 12:08:16.181720 12515 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:16.182132 12515 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:16.182441 12515 hybrid_clock.cc:648] HybridClock initialized: now 1783598896182405 us; error 0 us; skew 500 ppm
I20260709 12:08:16.183553 12515 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:16.189453 12515 webserver.cc:533] Webserver started at http://127.12.56.254:32815/ using document root <none> and password file <none>
I20260709 12:08:16.190521 12515 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:16.190805 12515 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:16.191301 12515 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:16.198238 12515 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894707649-12515-0/minicluster-data/master-0-root/instance:
uuid: "8f1b96eeb4054e82beab9d1faded0ec4"
format_stamp: "Formatted at 2026-07-09 12:08:16 on dist-test-slave-705g"
I20260709 12:08:16.207180 12515 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:08:16.213163 12530 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:16.215246 12515 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.002s	sys 0.001s
I20260709 12:08:16.215840 12515 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894707649-12515-0/minicluster-data/master-0-root
uuid: "8f1b96eeb4054e82beab9d1faded0ec4"
format_stamp: "Formatted at 2026-07-09 12:08:16 on dist-test-slave-705g"
I20260709 12:08:16.216295 12515 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894707649-12515-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894707649-12515-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894707649-12515-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:16.284760 12515 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:16.286592 12515 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:08:16.287139 12515 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:16.363926 12515 rpc_server.cc:307] RPC server started. Bound to: 127.12.56.254:44149
I20260709 12:08:16.364058 12581 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.56.254:44149 every 8 connection(s)
I20260709 12:08:16.373184 12582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:16.396567 12582 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8f1b96eeb4054e82beab9d1faded0ec4: Bootstrap starting.
I20260709 12:08:16.403475 12582 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8f1b96eeb4054e82beab9d1faded0ec4: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:16.405607 12582 log.cc:826] T 00000000000000000000000000000000 P 8f1b96eeb4054e82beab9d1faded0ec4: Log is configured to *not* fsync() on all Append() calls
I20260709 12:08:16.410663 12582 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8f1b96eeb4054e82beab9d1faded0ec4: No bootstrap required, opened a new log
I20260709 12:08:16.435325 12582 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8f1b96eeb4054e82beab9d1faded0ec4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f1b96eeb4054e82beab9d1faded0ec4" member_type: VOTER }
I20260709 12:08:16.435918 12582 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8f1b96eeb4054e82beab9d1faded0ec4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:16.436213 12582 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8f1b96eeb4054e82beab9d1faded0ec4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f1b96eeb4054e82beab9d1faded0ec4, State: Initialized, Role: FOLLOWER
I20260709 12:08:16.437322 12582 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8f1b96eeb4054e82beab9d1faded0ec4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f1b96eeb4054e82beab9d1faded0ec4" member_type: VOTER }
I20260709 12:08:16.437909 12582 raft_consensus.cc:399] T 00000000000000000000000000000000 P 8f1b96eeb4054e82beab9d1faded0ec4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:08:16.438179 12582 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8f1b96eeb4054e82beab9d1faded0ec4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:08:16.438490 12582 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8f1b96eeb4054e82beab9d1faded0ec4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:16.443480 12582 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8f1b96eeb4054e82beab9d1faded0ec4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f1b96eeb4054e82beab9d1faded0ec4" member_type: VOTER }
I20260709 12:08:16.444305 12582 leader_election.cc:304] T 00000000000000000000000000000000 P 8f1b96eeb4054e82beab9d1faded0ec4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8f1b96eeb4054e82beab9d1faded0ec4; no voters: 
I20260709 12:08:16.446205 12582 leader_election.cc:290] T 00000000000000000000000000000000 P 8f1b96eeb4054e82beab9d1faded0ec4 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:08:16.446554 12585 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8f1b96eeb4054e82beab9d1faded0ec4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:16.450052 12585 raft_consensus.cc:697] T 00000000000000000000000000000000 P 8f1b96eeb4054e82beab9d1faded0ec4 [term 1 LEADER]: Becoming Leader. State: Replica: 8f1b96eeb4054e82beab9d1faded0ec4, State: Running, Role: LEADER
I20260709 12:08:16.450994 12585 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8f1b96eeb4054e82beab9d1faded0ec4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f1b96eeb4054e82beab9d1faded0ec4" member_type: VOTER }
I20260709 12:08:16.451838 12582 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8f1b96eeb4054e82beab9d1faded0ec4 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:08:16.463789 12587 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f1b96eeb4054e82beab9d1faded0ec4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8f1b96eeb4054e82beab9d1faded0ec4. Latest consensus state: current_term: 1 leader_uuid: "8f1b96eeb4054e82beab9d1faded0ec4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f1b96eeb4054e82beab9d1faded0ec4" member_type: VOTER } }
I20260709 12:08:16.464825 12587 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f1b96eeb4054e82beab9d1faded0ec4 [sys.catalog]: This master's current role is: LEADER
I20260709 12:08:16.466728 12586 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f1b96eeb4054e82beab9d1faded0ec4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8f1b96eeb4054e82beab9d1faded0ec4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f1b96eeb4054e82beab9d1faded0ec4" member_type: VOTER } }
I20260709 12:08:16.467694 12586 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f1b96eeb4054e82beab9d1faded0ec4 [sys.catalog]: This master's current role is: LEADER
I20260709 12:08:16.470772 12594 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:08:16.483098 12594 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:08:16.490654 12515 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:08:16.502811 12594 catalog_manager.cc:1383] Generated new cluster ID: 4c2357b240d44dd8b51d3f9d207b2e58
I20260709 12:08:16.503147 12594 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:08:16.532683 12594 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:08:16.534348 12594 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:08:16.548168 12594 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 8f1b96eeb4054e82beab9d1faded0ec4: Generated new TSK 0
I20260709 12:08:16.549408 12594 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:08:16.558665 12515 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:16.567646 12604 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:16.569344 12605 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:16.573221 12515 server_base.cc:1061] running on GCE node
W20260709 12:08:16.573242 12607 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:16.574477 12515 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:16.574733 12515 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:16.574926 12515 hybrid_clock.cc:648] HybridClock initialized: now 1783598896574903 us; error 0 us; skew 500 ppm
I20260709 12:08:16.575510 12515 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:16.580331 12515 webserver.cc:533] Webserver started at http://127.12.56.193:39401/ using document root <none> and password file <none>
I20260709 12:08:16.580924 12515 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:16.581151 12515 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:16.581450 12515 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:16.582675 12515 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894707649-12515-0/minicluster-data/ts-0-root/instance:
uuid: "e9591e45f9b241f09c8367c42be07b4f"
format_stamp: "Formatted at 2026-07-09 12:08:16 on dist-test-slave-705g"
I20260709 12:08:16.589130 12515 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:08:16.593979 12612 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:16.594870 12515 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:08:16.595180 12515 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894707649-12515-0/minicluster-data/ts-0-root
uuid: "e9591e45f9b241f09c8367c42be07b4f"
format_stamp: "Formatted at 2026-07-09 12:08:16 on dist-test-slave-705g"
I20260709 12:08:16.595496 12515 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894707649-12515-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894707649-12515-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894707649-12515-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:16.621071 12515 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:16.622584 12515 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:16.625556 12515 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:16.630537 12515 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:16.630824 12515 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:16.631150 12515 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:16.631330 12515 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:16.744504 12515 rpc_server.cc:307] RPC server started. Bound to: 127.12.56.193:35963
I20260709 12:08:16.744607 12674 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.56.193:35963 every 8 connection(s)
I20260709 12:08:16.752628 12515 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:16.764926 12680 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:16.764144 12679 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:16.777925 12515 server_base.cc:1061] running on GCE node
W20260709 12:08:16.778597 12682 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:16.778820 12675 heartbeater.cc:344] Connected to a master server at 127.12.56.254:44149
I20260709 12:08:16.779374 12675 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:16.779791 12515 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:16.780208 12515 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:16.780450 12515 hybrid_clock.cc:648] HybridClock initialized: now 1783598896780431 us; error 0 us; skew 500 ppm
I20260709 12:08:16.780669 12675 heartbeater.cc:507] Master 127.12.56.254:44149 requested a full tablet report, sending...
I20260709 12:08:16.781324 12515 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:16.784747 12547 ts_manager.cc:194] Registered new tserver with Master: e9591e45f9b241f09c8367c42be07b4f (127.12.56.193:35963)
I20260709 12:08:16.788057 12547 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37774
I20260709 12:08:16.789218 12515 webserver.cc:533] Webserver started at http://127.12.56.194:41091/ using document root <none> and password file <none>
I20260709 12:08:16.789973 12515 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:16.790277 12515 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:16.790637 12515 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:16.792254 12515 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894707649-12515-0/minicluster-data/ts-1-root/instance:
uuid: "6a2c895eab0c40d6b22be18ca84fed16"
format_stamp: "Formatted at 2026-07-09 12:08:16 on dist-test-slave-705g"
I20260709 12:08:16.798169 12515 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.006s
I20260709 12:08:16.802453 12687 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:16.803370 12515 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.002s
I20260709 12:08:16.803691 12515 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894707649-12515-0/minicluster-data/ts-1-root
uuid: "6a2c895eab0c40d6b22be18ca84fed16"
format_stamp: "Formatted at 2026-07-09 12:08:16 on dist-test-slave-705g"
I20260709 12:08:16.804021 12515 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894707649-12515-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894707649-12515-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894707649-12515-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:16.832206 12515 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:16.833700 12515 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:16.836086 12515 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:16.839092 12515 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:16.839361 12515 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:16.839608 12515 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:16.839783 12515 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:16.941865 12515 rpc_server.cc:307] RPC server started. Bound to: 127.12.56.194:46297
I20260709 12:08:16.942179 12749 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.56.194:46297 every 8 connection(s)
I20260709 12:08:16.951617 12515 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:16.960587 12753 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:16.966436 12750 heartbeater.cc:344] Connected to a master server at 127.12.56.254:44149
I20260709 12:08:16.966933 12750 heartbeater.cc:461] Registering TS with master...
W20260709 12:08:16.967962 12754 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:16.967983 12750 heartbeater.cc:507] Master 127.12.56.254:44149 requested a full tablet report, sending...
I20260709 12:08:16.969296 12515 server_base.cc:1061] running on GCE node
W20260709 12:08:16.970093 12756 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:16.971087 12547 ts_manager.cc:194] Registered new tserver with Master: 6a2c895eab0c40d6b22be18ca84fed16 (127.12.56.194:46297)
I20260709 12:08:16.971244 12515 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:16.971537 12515 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:16.971733 12515 hybrid_clock.cc:648] HybridClock initialized: now 1783598896971717 us; error 0 us; skew 500 ppm
I20260709 12:08:16.972488 12515 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:16.972638 12547 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37778
I20260709 12:08:16.976219 12515 webserver.cc:533] Webserver started at http://127.12.56.195:42355/ using document root <none> and password file <none>
I20260709 12:08:16.976907 12515 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:16.977167 12515 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:16.977516 12515 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:16.979117 12515 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894707649-12515-0/minicluster-data/ts-2-root/instance:
uuid: "034d7c10edb342ab936e590793980fc0"
format_stamp: "Formatted at 2026-07-09 12:08:16 on dist-test-slave-705g"
I20260709 12:08:16.985277 12515 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.005s
I20260709 12:08:16.989707 12761 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:16.990739 12515 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.003s
I20260709 12:08:16.991240 12515 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894707649-12515-0/minicluster-data/ts-2-root
uuid: "034d7c10edb342ab936e590793980fc0"
format_stamp: "Formatted at 2026-07-09 12:08:16 on dist-test-slave-705g"
I20260709 12:08:16.991622 12515 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894707649-12515-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894707649-12515-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894707649-12515-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:17.013592 12515 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:17.015295 12515 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:17.017400 12515 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:17.020761 12515 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:17.020984 12515 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:17.021333 12515 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:17.021525 12515 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:17.128293 12515 rpc_server.cc:307] RPC server started. Bound to: 127.12.56.195:34109
I20260709 12:08:17.128412 12823 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.56.195:34109 every 8 connection(s)
I20260709 12:08:17.149972 12824 heartbeater.cc:344] Connected to a master server at 127.12.56.254:44149
I20260709 12:08:17.150420 12824 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:17.151254 12824 heartbeater.cc:507] Master 127.12.56.254:44149 requested a full tablet report, sending...
I20260709 12:08:17.153337 12547 ts_manager.cc:194] Registered new tserver with Master: 034d7c10edb342ab936e590793980fc0 (127.12.56.195:34109)
I20260709 12:08:17.153484 12515 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014942189s
I20260709 12:08:17.154918 12547 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37782
I20260709 12:08:17.213670 12547 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37784:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:08:17.217592 12547 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:08:17.336831 12788 tablet_service.cc:1511] Processing CreateTablet for tablet efe4e5e9a1b54e3987e81561775a89d6 (DEFAULT_TABLE table=test-workload [id=a1148101b36e4e71b22eb122b2b935cd]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:08:17.338670 12788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efe4e5e9a1b54e3987e81561775a89d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.342744 12787 tablet_service.cc:1511] Processing CreateTablet for tablet 4077af80765d460586125b4f312f5cfb (DEFAULT_TABLE table=test-workload [id=a1148101b36e4e71b22eb122b2b935cd]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:08:17.345372 12637 tablet_service.cc:1511] Processing CreateTablet for tablet 5957ce50d01e4214bc908e402a78a32e (DEFAULT_TABLE table=test-workload [id=a1148101b36e4e71b22eb122b2b935cd]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:08:17.345729 12639 tablet_service.cc:1511] Processing CreateTablet for tablet efe4e5e9a1b54e3987e81561775a89d6 (DEFAULT_TABLE table=test-workload [id=a1148101b36e4e71b22eb122b2b935cd]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:08:17.346889 12637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5957ce50d01e4214bc908e402a78a32e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.347576 12639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efe4e5e9a1b54e3987e81561775a89d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.349223 12640 tablet_service.cc:1511] Processing CreateTablet for tablet d8698d4730834dc582e8564c0a98eb86 (DEFAULT_TABLE table=test-workload [id=a1148101b36e4e71b22eb122b2b935cd]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:08:17.350677 12640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8698d4730834dc582e8564c0a98eb86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.354553 12638 tablet_service.cc:1511] Processing CreateTablet for tablet 4077af80765d460586125b4f312f5cfb (DEFAULT_TABLE table=test-workload [id=a1148101b36e4e71b22eb122b2b935cd]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:08:17.356001 12638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4077af80765d460586125b4f312f5cfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.357821 12636 tablet_service.cc:1511] Processing CreateTablet for tablet 155e9b7aa7aa40a587d743d6a30ccf7e (DEFAULT_TABLE table=test-workload [id=a1148101b36e4e71b22eb122b2b935cd]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:08:17.359251 12636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 155e9b7aa7aa40a587d743d6a30ccf7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.360868 12635 tablet_service.cc:1511] Processing CreateTablet for tablet 41a081ffb7f74fe598b4689f85e3f19d (DEFAULT_TABLE table=test-workload [id=a1148101b36e4e71b22eb122b2b935cd]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:08:17.363358 12634 tablet_service.cc:1511] Processing CreateTablet for tablet 6a014226736c4b259b23ca9932bbef77 (DEFAULT_TABLE table=test-workload [id=a1148101b36e4e71b22eb122b2b935cd]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:08:17.365890 12633 tablet_service.cc:1511] Processing CreateTablet for tablet b4669889b41c4e0f8e3e35cd4fde8736 (DEFAULT_TABLE table=test-workload [id=a1148101b36e4e71b22eb122b2b935cd]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:08:17.369904 12632 tablet_service.cc:1511] Processing CreateTablet for tablet d6f93f92c31a40318d4b51b090c5209b (DEFAULT_TABLE table=test-workload [id=a1148101b36e4e71b22eb122b2b935cd]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:08:17.371341 12632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6f93f92c31a40318d4b51b090c5209b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.375394 12842 tablet_bootstrap.cc:492] T efe4e5e9a1b54e3987e81561775a89d6 P e9591e45f9b241f09c8367c42be07b4f: Bootstrap starting.
I20260709 12:08:17.379160 12787 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4077af80765d460586125b4f312f5cfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.380393 12634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a014226736c4b259b23ca9932bbef77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.383028 12633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4669889b41c4e0f8e3e35cd4fde8736. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.382943 12789 tablet_service.cc:1511] Processing CreateTablet for tablet d8698d4730834dc582e8564c0a98eb86 (DEFAULT_TABLE table=test-workload [id=a1148101b36e4e71b22eb122b2b935cd]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:08:17.392789 12635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41a081ffb7f74fe598b4689f85e3f19d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.393224 12789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8698d4730834dc582e8564c0a98eb86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.406893 12785 tablet_service.cc:1511] Processing CreateTablet for tablet 155e9b7aa7aa40a587d743d6a30ccf7e (DEFAULT_TABLE table=test-workload [id=a1148101b36e4e71b22eb122b2b935cd]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:08:17.393076 12783 tablet_service.cc:1511] Processing CreateTablet for tablet 6a014226736c4b259b23ca9932bbef77 (DEFAULT_TABLE table=test-workload [id=a1148101b36e4e71b22eb122b2b935cd]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:08:17.387501 12786 tablet_service.cc:1511] Processing CreateTablet for tablet 5957ce50d01e4214bc908e402a78a32e (DEFAULT_TABLE table=test-workload [id=a1148101b36e4e71b22eb122b2b935cd]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:08:17.399871 12784 tablet_service.cc:1511] Processing CreateTablet for tablet 41a081ffb7f74fe598b4689f85e3f19d (DEFAULT_TABLE table=test-workload [id=a1148101b36e4e71b22eb122b2b935cd]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:08:17.420631 12785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 155e9b7aa7aa40a587d743d6a30ccf7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.424041 12782 tablet_service.cc:1511] Processing CreateTablet for tablet b4669889b41c4e0f8e3e35cd4fde8736 (DEFAULT_TABLE table=test-workload [id=a1148101b36e4e71b22eb122b2b935cd]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:08:17.427572 12781 tablet_service.cc:1511] Processing CreateTablet for tablet d6f93f92c31a40318d4b51b090c5209b (DEFAULT_TABLE table=test-workload [id=a1148101b36e4e71b22eb122b2b935cd]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:08:17.437590 12786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5957ce50d01e4214bc908e402a78a32e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.455087 12781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6f93f92c31a40318d4b51b090c5209b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.460253 12784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41a081ffb7f74fe598b4689f85e3f19d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.462229 12783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a014226736c4b259b23ca9932bbef77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.465828 12782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4669889b41c4e0f8e3e35cd4fde8736. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:08:17.483587 12595 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:08:17.503407 12714 tablet_service.cc:1511] Processing CreateTablet for tablet efe4e5e9a1b54e3987e81561775a89d6 (DEFAULT_TABLE table=test-workload [id=a1148101b36e4e71b22eb122b2b935cd]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:08:17.507496 12714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efe4e5e9a1b54e3987e81561775a89d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.510632 12715 tablet_service.cc:1511] Processing CreateTablet for tablet d8698d4730834dc582e8564c0a98eb86 (DEFAULT_TABLE table=test-workload [id=a1148101b36e4e71b22eb122b2b935cd]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:08:17.513867 12715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8698d4730834dc582e8564c0a98eb86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.518482 12842 tablet_bootstrap.cc:654] T efe4e5e9a1b54e3987e81561775a89d6 P e9591e45f9b241f09c8367c42be07b4f: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.509479 12710 tablet_service.cc:1511] Processing CreateTablet for tablet 41a081ffb7f74fe598b4689f85e3f19d (DEFAULT_TABLE table=test-workload [id=a1148101b36e4e71b22eb122b2b935cd]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:08:17.531023 12710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41a081ffb7f74fe598b4689f85e3f19d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.533449 12713 tablet_service.cc:1511] Processing CreateTablet for tablet 4077af80765d460586125b4f312f5cfb (DEFAULT_TABLE table=test-workload [id=a1148101b36e4e71b22eb122b2b935cd]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:08:17.535080 12713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4077af80765d460586125b4f312f5cfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.522245 12712 tablet_service.cc:1511] Processing CreateTablet for tablet 5957ce50d01e4214bc908e402a78a32e (DEFAULT_TABLE table=test-workload [id=a1148101b36e4e71b22eb122b2b935cd]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:08:17.526589 12711 tablet_service.cc:1511] Processing CreateTablet for tablet 155e9b7aa7aa40a587d743d6a30ccf7e (DEFAULT_TABLE table=test-workload [id=a1148101b36e4e71b22eb122b2b935cd]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:08:17.539201 12709 tablet_service.cc:1511] Processing CreateTablet for tablet 6a014226736c4b259b23ca9932bbef77 (DEFAULT_TABLE table=test-workload [id=a1148101b36e4e71b22eb122b2b935cd]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:08:17.546236 12712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5957ce50d01e4214bc908e402a78a32e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.546258 12708 tablet_service.cc:1511] Processing CreateTablet for tablet b4669889b41c4e0f8e3e35cd4fde8736 (DEFAULT_TABLE table=test-workload [id=a1148101b36e4e71b22eb122b2b935cd]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:08:17.553593 12711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 155e9b7aa7aa40a587d743d6a30ccf7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.554325 12707 tablet_service.cc:1511] Processing CreateTablet for tablet d6f93f92c31a40318d4b51b090c5209b (DEFAULT_TABLE table=test-workload [id=a1148101b36e4e71b22eb122b2b935cd]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:08:17.560843 12708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4669889b41c4e0f8e3e35cd4fde8736. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.564980 12707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6f93f92c31a40318d4b51b090c5209b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.586470 12709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a014226736c4b259b23ca9932bbef77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.643337 12842 tablet_bootstrap.cc:492] T efe4e5e9a1b54e3987e81561775a89d6 P e9591e45f9b241f09c8367c42be07b4f: No bootstrap required, opened a new log
I20260709 12:08:17.644044 12842 ts_tablet_manager.cc:1403] T efe4e5e9a1b54e3987e81561775a89d6 P e9591e45f9b241f09c8367c42be07b4f: Time spent bootstrapping tablet: real 0.269s	user 0.014s	sys 0.032s
I20260709 12:08:17.667654 12842 raft_consensus.cc:359] T efe4e5e9a1b54e3987e81561775a89d6 P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:17.681449 12842 raft_consensus.cc:385] T efe4e5e9a1b54e3987e81561775a89d6 P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.681586 12844 tablet_bootstrap.cc:492] T d8698d4730834dc582e8564c0a98eb86 P 034d7c10edb342ab936e590793980fc0: Bootstrap starting.
I20260709 12:08:17.681900 12842 raft_consensus.cc:740] T efe4e5e9a1b54e3987e81561775a89d6 P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9591e45f9b241f09c8367c42be07b4f, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.684305 12842 consensus_queue.cc:260] T efe4e5e9a1b54e3987e81561775a89d6 P e9591e45f9b241f09c8367c42be07b4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:17.690711 12845 tablet_bootstrap.cc:492] T b4669889b41c4e0f8e3e35cd4fde8736 P 6a2c895eab0c40d6b22be18ca84fed16: Bootstrap starting.
I20260709 12:08:17.695812 12844 tablet_bootstrap.cc:654] T d8698d4730834dc582e8564c0a98eb86 P 034d7c10edb342ab936e590793980fc0: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.702039 12845 tablet_bootstrap.cc:654] T b4669889b41c4e0f8e3e35cd4fde8736 P 6a2c895eab0c40d6b22be18ca84fed16: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.707644 12846 raft_consensus.cc:493] T efe4e5e9a1b54e3987e81561775a89d6 P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:17.707772 12675 heartbeater.cc:499] Master 127.12.56.254:44149 was elected leader, sending a full tablet report...
I20260709 12:08:17.708146 12842 ts_tablet_manager.cc:1434] T efe4e5e9a1b54e3987e81561775a89d6 P e9591e45f9b241f09c8367c42be07b4f: Time spent starting tablet: real 0.064s	user 0.011s	sys 0.015s
I20260709 12:08:17.708214 12846 raft_consensus.cc:515] T efe4e5e9a1b54e3987e81561775a89d6 P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:17.709293 12842 tablet_bootstrap.cc:492] T 5957ce50d01e4214bc908e402a78a32e P e9591e45f9b241f09c8367c42be07b4f: Bootstrap starting.
I20260709 12:08:17.711498 12846 leader_election.cc:290] T efe4e5e9a1b54e3987e81561775a89d6 P e9591e45f9b241f09c8367c42be07b4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a2c895eab0c40d6b22be18ca84fed16 (127.12.56.194:46297), 034d7c10edb342ab936e590793980fc0 (127.12.56.195:34109)
I20260709 12:08:17.716099 12842 tablet_bootstrap.cc:654] T 5957ce50d01e4214bc908e402a78a32e P e9591e45f9b241f09c8367c42be07b4f: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.724869 12844 tablet_bootstrap.cc:492] T d8698d4730834dc582e8564c0a98eb86 P 034d7c10edb342ab936e590793980fc0: No bootstrap required, opened a new log
I20260709 12:08:17.725363 12844 ts_tablet_manager.cc:1403] T d8698d4730834dc582e8564c0a98eb86 P 034d7c10edb342ab936e590793980fc0: Time spent bootstrapping tablet: real 0.073s	user 0.008s	sys 0.006s
I20260709 12:08:17.728708 12842 tablet_bootstrap.cc:492] T 5957ce50d01e4214bc908e402a78a32e P e9591e45f9b241f09c8367c42be07b4f: No bootstrap required, opened a new log
I20260709 12:08:17.728461 12844 raft_consensus.cc:359] T d8698d4730834dc582e8564c0a98eb86 P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } }
I20260709 12:08:17.729203 12842 ts_tablet_manager.cc:1403] T 5957ce50d01e4214bc908e402a78a32e P e9591e45f9b241f09c8367c42be07b4f: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.010s
I20260709 12:08:17.729271 12844 raft_consensus.cc:385] T d8698d4730834dc582e8564c0a98eb86 P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.729674 12844 raft_consensus.cc:740] T d8698d4730834dc582e8564c0a98eb86 P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 034d7c10edb342ab936e590793980fc0, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.730772 12844 consensus_queue.cc:260] T d8698d4730834dc582e8564c0a98eb86 P 034d7c10edb342ab936e590793980fc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } }
I20260709 12:08:17.732311 12842 raft_consensus.cc:359] T 5957ce50d01e4214bc908e402a78a32e P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:17.733047 12842 raft_consensus.cc:385] T 5957ce50d01e4214bc908e402a78a32e P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.733366 12842 raft_consensus.cc:740] T 5957ce50d01e4214bc908e402a78a32e P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9591e45f9b241f09c8367c42be07b4f, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.734151 12842 consensus_queue.cc:260] T 5957ce50d01e4214bc908e402a78a32e P e9591e45f9b241f09c8367c42be07b4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:17.735101 12824 heartbeater.cc:499] Master 127.12.56.254:44149 was elected leader, sending a full tablet report...
I20260709 12:08:17.736263 12842 ts_tablet_manager.cc:1434] T 5957ce50d01e4214bc908e402a78a32e P e9591e45f9b241f09c8367c42be07b4f: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 12:08:17.737198 12842 tablet_bootstrap.cc:492] T 4077af80765d460586125b4f312f5cfb P e9591e45f9b241f09c8367c42be07b4f: Bootstrap starting.
I20260709 12:08:17.744704 12842 tablet_bootstrap.cc:654] T 4077af80765d460586125b4f312f5cfb P e9591e45f9b241f09c8367c42be07b4f: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.746032 12844 ts_tablet_manager.cc:1434] T d8698d4730834dc582e8564c0a98eb86 P 034d7c10edb342ab936e590793980fc0: Time spent starting tablet: real 0.020s	user 0.010s	sys 0.001s
I20260709 12:08:17.747978 12844 tablet_bootstrap.cc:492] T 41a081ffb7f74fe598b4689f85e3f19d P 034d7c10edb342ab936e590793980fc0: Bootstrap starting.
I20260709 12:08:17.750051 12845 tablet_bootstrap.cc:492] T b4669889b41c4e0f8e3e35cd4fde8736 P 6a2c895eab0c40d6b22be18ca84fed16: No bootstrap required, opened a new log
W20260709 12:08:17.754068 12676 tablet.cc:2406] T 5957ce50d01e4214bc908e402a78a32e P e9591e45f9b241f09c8367c42be07b4f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:08:17.755838 12844 tablet_bootstrap.cc:654] T 41a081ffb7f74fe598b4689f85e3f19d P 034d7c10edb342ab936e590793980fc0: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.754293 12845 ts_tablet_manager.cc:1403] T b4669889b41c4e0f8e3e35cd4fde8736 P 6a2c895eab0c40d6b22be18ca84fed16: Time spent bootstrapping tablet: real 0.071s	user 0.007s	sys 0.008s
I20260709 12:08:17.758841 12842 tablet_bootstrap.cc:492] T 4077af80765d460586125b4f312f5cfb P e9591e45f9b241f09c8367c42be07b4f: No bootstrap required, opened a new log
I20260709 12:08:17.759382 12842 ts_tablet_manager.cc:1403] T 4077af80765d460586125b4f312f5cfb P e9591e45f9b241f09c8367c42be07b4f: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.004s
I20260709 12:08:17.762554 12842 raft_consensus.cc:359] T 4077af80765d460586125b4f312f5cfb P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:17.772085 12842 raft_consensus.cc:385] T 4077af80765d460586125b4f312f5cfb P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.769085 12844 tablet_bootstrap.cc:492] T 41a081ffb7f74fe598b4689f85e3f19d P 034d7c10edb342ab936e590793980fc0: No bootstrap required, opened a new log
I20260709 12:08:17.772541 12842 raft_consensus.cc:740] T 4077af80765d460586125b4f312f5cfb P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9591e45f9b241f09c8367c42be07b4f, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.772964 12844 ts_tablet_manager.cc:1403] T 41a081ffb7f74fe598b4689f85e3f19d P 034d7c10edb342ab936e590793980fc0: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.005s
I20260709 12:08:17.773557 12842 consensus_queue.cc:260] T 4077af80765d460586125b4f312f5cfb P e9591e45f9b241f09c8367c42be07b4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:17.775991 12842 ts_tablet_manager.cc:1434] T 4077af80765d460586125b4f312f5cfb P e9591e45f9b241f09c8367c42be07b4f: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.003s
I20260709 12:08:17.777117 12842 tablet_bootstrap.cc:492] T d8698d4730834dc582e8564c0a98eb86 P e9591e45f9b241f09c8367c42be07b4f: Bootstrap starting.
I20260709 12:08:17.761693 12845 raft_consensus.cc:359] T b4669889b41c4e0f8e3e35cd4fde8736 P 6a2c895eab0c40d6b22be18ca84fed16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:17.778928 12845 raft_consensus.cc:385] T b4669889b41c4e0f8e3e35cd4fde8736 P 6a2c895eab0c40d6b22be18ca84fed16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.779275 12845 raft_consensus.cc:740] T b4669889b41c4e0f8e3e35cd4fde8736 P 6a2c895eab0c40d6b22be18ca84fed16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a2c895eab0c40d6b22be18ca84fed16, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.779844 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe4e5e9a1b54e3987e81561775a89d6" candidate_uuid: "e9591e45f9b241f09c8367c42be07b4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a2c895eab0c40d6b22be18ca84fed16" is_pre_election: true
I20260709 12:08:17.780102 12845 consensus_queue.cc:260] T b4669889b41c4e0f8e3e35cd4fde8736 P 6a2c895eab0c40d6b22be18ca84fed16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:17.781195 12844 raft_consensus.cc:359] T 41a081ffb7f74fe598b4689f85e3f19d P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:17.781978 12844 raft_consensus.cc:385] T 41a081ffb7f74fe598b4689f85e3f19d P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:08:17.782224 12615 leader_election.cc:343] T efe4e5e9a1b54e3987e81561775a89d6 P e9591e45f9b241f09c8367c42be07b4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a2c895eab0c40d6b22be18ca84fed16 (127.12.56.194:46297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:17.782336 12844 raft_consensus.cc:740] T 41a081ffb7f74fe598b4689f85e3f19d P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 034d7c10edb342ab936e590793980fc0, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.783473 12844 consensus_queue.cc:260] T 41a081ffb7f74fe598b4689f85e3f19d P 034d7c10edb342ab936e590793980fc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:17.784255 12750 heartbeater.cc:499] Master 127.12.56.254:44149 was elected leader, sending a full tablet report...
I20260709 12:08:17.785181 12842 tablet_bootstrap.cc:654] T d8698d4730834dc582e8564c0a98eb86 P e9591e45f9b241f09c8367c42be07b4f: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.791309 12844 ts_tablet_manager.cc:1434] T 41a081ffb7f74fe598b4689f85e3f19d P 034d7c10edb342ab936e590793980fc0: Time spent starting tablet: real 0.018s	user 0.000s	sys 0.007s
I20260709 12:08:17.792407 12844 tablet_bootstrap.cc:492] T d6f93f92c31a40318d4b51b090c5209b P 034d7c10edb342ab936e590793980fc0: Bootstrap starting.
I20260709 12:08:17.796250 12845 ts_tablet_manager.cc:1434] T b4669889b41c4e0f8e3e35cd4fde8736 P 6a2c895eab0c40d6b22be18ca84fed16: Time spent starting tablet: real 0.038s	user 0.003s	sys 0.004s
I20260709 12:08:17.796671 12842 tablet_bootstrap.cc:492] T d8698d4730834dc582e8564c0a98eb86 P e9591e45f9b241f09c8367c42be07b4f: No bootstrap required, opened a new log
I20260709 12:08:17.797118 12842 ts_tablet_manager.cc:1403] T d8698d4730834dc582e8564c0a98eb86 P e9591e45f9b241f09c8367c42be07b4f: Time spent bootstrapping tablet: real 0.020s	user 0.006s	sys 0.010s
I20260709 12:08:17.797199 12845 tablet_bootstrap.cc:492] T d8698d4730834dc582e8564c0a98eb86 P 6a2c895eab0c40d6b22be18ca84fed16: Bootstrap starting.
I20260709 12:08:17.798791 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe4e5e9a1b54e3987e81561775a89d6" candidate_uuid: "e9591e45f9b241f09c8367c42be07b4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "034d7c10edb342ab936e590793980fc0" is_pre_election: true
I20260709 12:08:17.799388 12844 tablet_bootstrap.cc:654] T d6f93f92c31a40318d4b51b090c5209b P 034d7c10edb342ab936e590793980fc0: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.800846 12842 raft_consensus.cc:359] T d8698d4730834dc582e8564c0a98eb86 P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } }
I20260709 12:08:17.801620 12842 raft_consensus.cc:385] T d8698d4730834dc582e8564c0a98eb86 P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.801952 12842 raft_consensus.cc:740] T d8698d4730834dc582e8564c0a98eb86 P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9591e45f9b241f09c8367c42be07b4f, State: Initialized, Role: FOLLOWER
W20260709 12:08:17.802887 12616 leader_election.cc:343] T efe4e5e9a1b54e3987e81561775a89d6 P e9591e45f9b241f09c8367c42be07b4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 034d7c10edb342ab936e590793980fc0 (127.12.56.195:34109): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:17.802699 12842 consensus_queue.cc:260] T d8698d4730834dc582e8564c0a98eb86 P e9591e45f9b241f09c8367c42be07b4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } }
I20260709 12:08:17.803539 12616 leader_election.cc:304] T efe4e5e9a1b54e3987e81561775a89d6 P e9591e45f9b241f09c8367c42be07b4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9591e45f9b241f09c8367c42be07b4f; no voters: 034d7c10edb342ab936e590793980fc0, 6a2c895eab0c40d6b22be18ca84fed16
I20260709 12:08:17.805124 12842 ts_tablet_manager.cc:1434] T d8698d4730834dc582e8564c0a98eb86 P e9591e45f9b241f09c8367c42be07b4f: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:08:17.806169 12842 tablet_bootstrap.cc:492] T 6a014226736c4b259b23ca9932bbef77 P e9591e45f9b241f09c8367c42be07b4f: Bootstrap starting.
I20260709 12:08:17.805939 12848 raft_consensus.cc:2749] T efe4e5e9a1b54e3987e81561775a89d6 P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:17.813028 12842 tablet_bootstrap.cc:654] T 6a014226736c4b259b23ca9932bbef77 P e9591e45f9b241f09c8367c42be07b4f: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.819768 12845 tablet_bootstrap.cc:654] T d8698d4730834dc582e8564c0a98eb86 P 6a2c895eab0c40d6b22be18ca84fed16: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.825470 12842 tablet_bootstrap.cc:492] T 6a014226736c4b259b23ca9932bbef77 P e9591e45f9b241f09c8367c42be07b4f: No bootstrap required, opened a new log
I20260709 12:08:17.826161 12842 ts_tablet_manager.cc:1403] T 6a014226736c4b259b23ca9932bbef77 P e9591e45f9b241f09c8367c42be07b4f: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.010s
I20260709 12:08:17.829027 12842 raft_consensus.cc:359] T 6a014226736c4b259b23ca9932bbef77 P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:17.829768 12842 raft_consensus.cc:385] T 6a014226736c4b259b23ca9932bbef77 P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.830190 12842 raft_consensus.cc:740] T 6a014226736c4b259b23ca9932bbef77 P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9591e45f9b241f09c8367c42be07b4f, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.830871 12842 consensus_queue.cc:260] T 6a014226736c4b259b23ca9932bbef77 P e9591e45f9b241f09c8367c42be07b4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:17.833043 12842 ts_tablet_manager.cc:1434] T 6a014226736c4b259b23ca9932bbef77 P e9591e45f9b241f09c8367c42be07b4f: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 12:08:17.836397 12842 tablet_bootstrap.cc:492] T 155e9b7aa7aa40a587d743d6a30ccf7e P e9591e45f9b241f09c8367c42be07b4f: Bootstrap starting.
I20260709 12:08:17.845719 12842 tablet_bootstrap.cc:654] T 155e9b7aa7aa40a587d743d6a30ccf7e P e9591e45f9b241f09c8367c42be07b4f: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.851629 12844 tablet_bootstrap.cc:492] T d6f93f92c31a40318d4b51b090c5209b P 034d7c10edb342ab936e590793980fc0: No bootstrap required, opened a new log
I20260709 12:08:17.852123 12844 ts_tablet_manager.cc:1403] T d6f93f92c31a40318d4b51b090c5209b P 034d7c10edb342ab936e590793980fc0: Time spent bootstrapping tablet: real 0.060s	user 0.016s	sys 0.024s
I20260709 12:08:17.854984 12844 raft_consensus.cc:359] T d6f93f92c31a40318d4b51b090c5209b P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:17.855736 12844 raft_consensus.cc:385] T d6f93f92c31a40318d4b51b090c5209b P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.856045 12844 raft_consensus.cc:740] T d6f93f92c31a40318d4b51b090c5209b P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 034d7c10edb342ab936e590793980fc0, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.858286 12845 tablet_bootstrap.cc:492] T d8698d4730834dc582e8564c0a98eb86 P 6a2c895eab0c40d6b22be18ca84fed16: No bootstrap required, opened a new log
I20260709 12:08:17.858769 12845 ts_tablet_manager.cc:1403] T d8698d4730834dc582e8564c0a98eb86 P 6a2c895eab0c40d6b22be18ca84fed16: Time spent bootstrapping tablet: real 0.062s	user 0.021s	sys 0.010s
I20260709 12:08:17.860086 12848 raft_consensus.cc:493] T 4077af80765d460586125b4f312f5cfb P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:17.860764 12848 raft_consensus.cc:515] T 4077af80765d460586125b4f312f5cfb P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:17.862102 12845 raft_consensus.cc:359] T d8698d4730834dc582e8564c0a98eb86 P 6a2c895eab0c40d6b22be18ca84fed16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } }
I20260709 12:08:17.862920 12845 raft_consensus.cc:385] T d8698d4730834dc582e8564c0a98eb86 P 6a2c895eab0c40d6b22be18ca84fed16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.863224 12845 raft_consensus.cc:740] T d8698d4730834dc582e8564c0a98eb86 P 6a2c895eab0c40d6b22be18ca84fed16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a2c895eab0c40d6b22be18ca84fed16, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.865213 12845 consensus_queue.cc:260] T d8698d4730834dc582e8564c0a98eb86 P 6a2c895eab0c40d6b22be18ca84fed16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } }
I20260709 12:08:17.866808 12842 tablet_bootstrap.cc:492] T 155e9b7aa7aa40a587d743d6a30ccf7e P e9591e45f9b241f09c8367c42be07b4f: No bootstrap required, opened a new log
I20260709 12:08:17.867398 12842 ts_tablet_manager.cc:1403] T 155e9b7aa7aa40a587d743d6a30ccf7e P e9591e45f9b241f09c8367c42be07b4f: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.013s
I20260709 12:08:17.868041 12844 consensus_queue.cc:260] T d6f93f92c31a40318d4b51b090c5209b P 034d7c10edb342ab936e590793980fc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:17.870581 12844 ts_tablet_manager.cc:1434] T d6f93f92c31a40318d4b51b090c5209b P 034d7c10edb342ab936e590793980fc0: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 12:08:17.870903 12842 raft_consensus.cc:359] T 155e9b7aa7aa40a587d743d6a30ccf7e P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:17.871490 12844 tablet_bootstrap.cc:492] T efe4e5e9a1b54e3987e81561775a89d6 P 034d7c10edb342ab936e590793980fc0: Bootstrap starting.
I20260709 12:08:17.871754 12842 raft_consensus.cc:385] T 155e9b7aa7aa40a587d743d6a30ccf7e P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.872130 12842 raft_consensus.cc:740] T 155e9b7aa7aa40a587d743d6a30ccf7e P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9591e45f9b241f09c8367c42be07b4f, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.872592 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4077af80765d460586125b4f312f5cfb" candidate_uuid: "e9591e45f9b241f09c8367c42be07b4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a2c895eab0c40d6b22be18ca84fed16" is_pre_election: true
I20260709 12:08:17.872943 12842 consensus_queue.cc:260] T 155e9b7aa7aa40a587d743d6a30ccf7e P e9591e45f9b241f09c8367c42be07b4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:17.867445 12845 ts_tablet_manager.cc:1434] T d8698d4730834dc582e8564c0a98eb86 P 6a2c895eab0c40d6b22be18ca84fed16: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
W20260709 12:08:17.874117 12615 leader_election.cc:343] T 4077af80765d460586125b4f312f5cfb P e9591e45f9b241f09c8367c42be07b4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a2c895eab0c40d6b22be18ca84fed16 (127.12.56.194:46297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:17.874742 12845 tablet_bootstrap.cc:492] T efe4e5e9a1b54e3987e81561775a89d6 P 6a2c895eab0c40d6b22be18ca84fed16: Bootstrap starting.
I20260709 12:08:17.878332 12842 ts_tablet_manager.cc:1434] T 155e9b7aa7aa40a587d743d6a30ccf7e P e9591e45f9b241f09c8367c42be07b4f: Time spent starting tablet: real 0.010s	user 0.012s	sys 0.000s
I20260709 12:08:17.879576 12842 tablet_bootstrap.cc:492] T 41a081ffb7f74fe598b4689f85e3f19d P e9591e45f9b241f09c8367c42be07b4f: Bootstrap starting.
I20260709 12:08:17.882113 12844 tablet_bootstrap.cc:654] T efe4e5e9a1b54e3987e81561775a89d6 P 034d7c10edb342ab936e590793980fc0: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.887120 12842 tablet_bootstrap.cc:654] T 41a081ffb7f74fe598b4689f85e3f19d P e9591e45f9b241f09c8367c42be07b4f: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.887179 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4077af80765d460586125b4f312f5cfb" candidate_uuid: "e9591e45f9b241f09c8367c42be07b4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "034d7c10edb342ab936e590793980fc0" is_pre_election: true
W20260709 12:08:17.888970 12616 leader_election.cc:343] T 4077af80765d460586125b4f312f5cfb P e9591e45f9b241f09c8367c42be07b4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 034d7c10edb342ab936e590793980fc0 (127.12.56.195:34109): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:17.889222 12845 tablet_bootstrap.cc:654] T efe4e5e9a1b54e3987e81561775a89d6 P 6a2c895eab0c40d6b22be18ca84fed16: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.889487 12616 leader_election.cc:304] T 4077af80765d460586125b4f312f5cfb P e9591e45f9b241f09c8367c42be07b4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9591e45f9b241f09c8367c42be07b4f; no voters: 034d7c10edb342ab936e590793980fc0, 6a2c895eab0c40d6b22be18ca84fed16
I20260709 12:08:17.890466 12846 raft_consensus.cc:2749] T 4077af80765d460586125b4f312f5cfb P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:17.891240 12848 leader_election.cc:290] T 4077af80765d460586125b4f312f5cfb P e9591e45f9b241f09c8367c42be07b4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a2c895eab0c40d6b22be18ca84fed16 (127.12.56.194:46297), 034d7c10edb342ab936e590793980fc0 (127.12.56.195:34109)
I20260709 12:08:17.894521 12844 tablet_bootstrap.cc:492] T efe4e5e9a1b54e3987e81561775a89d6 P 034d7c10edb342ab936e590793980fc0: No bootstrap required, opened a new log
I20260709 12:08:17.895044 12844 ts_tablet_manager.cc:1403] T efe4e5e9a1b54e3987e81561775a89d6 P 034d7c10edb342ab936e590793980fc0: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.004s
I20260709 12:08:17.896289 12853 raft_consensus.cc:493] T d8698d4730834dc582e8564c0a98eb86 P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:17.896885 12853 raft_consensus.cc:515] T d8698d4730834dc582e8564c0a98eb86 P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } }
I20260709 12:08:17.898463 12844 raft_consensus.cc:359] T efe4e5e9a1b54e3987e81561775a89d6 P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:17.899246 12844 raft_consensus.cc:385] T efe4e5e9a1b54e3987e81561775a89d6 P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.899590 12844 raft_consensus.cc:740] T efe4e5e9a1b54e3987e81561775a89d6 P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 034d7c10edb342ab936e590793980fc0, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.899842 12853 leader_election.cc:290] T d8698d4730834dc582e8564c0a98eb86 P 034d7c10edb342ab936e590793980fc0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9591e45f9b241f09c8367c42be07b4f (127.12.56.193:35963), 6a2c895eab0c40d6b22be18ca84fed16 (127.12.56.194:46297)
I20260709 12:08:17.900473 12844 consensus_queue.cc:260] T efe4e5e9a1b54e3987e81561775a89d6 P 034d7c10edb342ab936e590793980fc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:17.908370 12844 ts_tablet_manager.cc:1434] T efe4e5e9a1b54e3987e81561775a89d6 P 034d7c10edb342ab936e590793980fc0: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.002s
I20260709 12:08:17.912946 12844 tablet_bootstrap.cc:492] T 155e9b7aa7aa40a587d743d6a30ccf7e P 034d7c10edb342ab936e590793980fc0: Bootstrap starting.
I20260709 12:08:17.925279 12844 tablet_bootstrap.cc:654] T 155e9b7aa7aa40a587d743d6a30ccf7e P 034d7c10edb342ab936e590793980fc0: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.926319 12845 tablet_bootstrap.cc:492] T efe4e5e9a1b54e3987e81561775a89d6 P 6a2c895eab0c40d6b22be18ca84fed16: No bootstrap required, opened a new log
I20260709 12:08:17.928668 12842 tablet_bootstrap.cc:492] T 41a081ffb7f74fe598b4689f85e3f19d P e9591e45f9b241f09c8367c42be07b4f: No bootstrap required, opened a new log
I20260709 12:08:17.931181 12842 ts_tablet_manager.cc:1403] T 41a081ffb7f74fe598b4689f85e3f19d P e9591e45f9b241f09c8367c42be07b4f: Time spent bootstrapping tablet: real 0.052s	user 0.013s	sys 0.003s
I20260709 12:08:17.937160 12845 ts_tablet_manager.cc:1403] T efe4e5e9a1b54e3987e81561775a89d6 P 6a2c895eab0c40d6b22be18ca84fed16: Time spent bootstrapping tablet: real 0.063s	user 0.014s	sys 0.012s
I20260709 12:08:17.938313 12853 raft_consensus.cc:493] T efe4e5e9a1b54e3987e81561775a89d6 P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:17.938915 12853 raft_consensus.cc:515] T efe4e5e9a1b54e3987e81561775a89d6 P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:17.939074 12842 raft_consensus.cc:359] T 41a081ffb7f74fe598b4689f85e3f19d P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:17.939881 12842 raft_consensus.cc:385] T 41a081ffb7f74fe598b4689f85e3f19d P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.940241 12842 raft_consensus.cc:740] T 41a081ffb7f74fe598b4689f85e3f19d P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9591e45f9b241f09c8367c42be07b4f, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.940939 12845 raft_consensus.cc:359] T efe4e5e9a1b54e3987e81561775a89d6 P 6a2c895eab0c40d6b22be18ca84fed16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:17.941417 12853 leader_election.cc:290] T efe4e5e9a1b54e3987e81561775a89d6 P 034d7c10edb342ab936e590793980fc0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9591e45f9b241f09c8367c42be07b4f (127.12.56.193:35963), 6a2c895eab0c40d6b22be18ca84fed16 (127.12.56.194:46297)
I20260709 12:08:17.941797 12845 raft_consensus.cc:385] T efe4e5e9a1b54e3987e81561775a89d6 P 6a2c895eab0c40d6b22be18ca84fed16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.942431 12845 raft_consensus.cc:740] T efe4e5e9a1b54e3987e81561775a89d6 P 6a2c895eab0c40d6b22be18ca84fed16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a2c895eab0c40d6b22be18ca84fed16, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.942546 12842 consensus_queue.cc:260] T 41a081ffb7f74fe598b4689f85e3f19d P e9591e45f9b241f09c8367c42be07b4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:17.943327 12845 consensus_queue.cc:260] T efe4e5e9a1b54e3987e81561775a89d6 P 6a2c895eab0c40d6b22be18ca84fed16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:17.946157 12842 ts_tablet_manager.cc:1434] T 41a081ffb7f74fe598b4689f85e3f19d P e9591e45f9b241f09c8367c42be07b4f: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.002s
I20260709 12:08:17.946355 12845 ts_tablet_manager.cc:1434] T efe4e5e9a1b54e3987e81561775a89d6 P 6a2c895eab0c40d6b22be18ca84fed16: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:08:17.947472 12842 tablet_bootstrap.cc:492] T b4669889b41c4e0f8e3e35cd4fde8736 P e9591e45f9b241f09c8367c42be07b4f: Bootstrap starting.
I20260709 12:08:17.947492 12845 tablet_bootstrap.cc:492] T 41a081ffb7f74fe598b4689f85e3f19d P 6a2c895eab0c40d6b22be18ca84fed16: Bootstrap starting.
I20260709 12:08:17.957041 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8698d4730834dc582e8564c0a98eb86" candidate_uuid: "034d7c10edb342ab936e590793980fc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a2c895eab0c40d6b22be18ca84fed16" is_pre_election: true
I20260709 12:08:17.958081 12725 raft_consensus.cc:2468] T d8698d4730834dc582e8564c0a98eb86 P 6a2c895eab0c40d6b22be18ca84fed16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 034d7c10edb342ab936e590793980fc0 in term 0.
I20260709 12:08:17.960248 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe4e5e9a1b54e3987e81561775a89d6" candidate_uuid: "034d7c10edb342ab936e590793980fc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a2c895eab0c40d6b22be18ca84fed16" is_pre_election: true
I20260709 12:08:17.961258 12724 raft_consensus.cc:2468] T efe4e5e9a1b54e3987e81561775a89d6 P 6a2c895eab0c40d6b22be18ca84fed16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 034d7c10edb342ab936e590793980fc0 in term 0.
I20260709 12:08:17.963548 12764 leader_election.cc:304] T d8698d4730834dc582e8564c0a98eb86 P 034d7c10edb342ab936e590793980fc0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 034d7c10edb342ab936e590793980fc0, 6a2c895eab0c40d6b22be18ca84fed16; no voters: 
I20260709 12:08:17.964434 12845 tablet_bootstrap.cc:654] T 41a081ffb7f74fe598b4689f85e3f19d P 6a2c895eab0c40d6b22be18ca84fed16: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.964939 12764 leader_election.cc:304] T efe4e5e9a1b54e3987e81561775a89d6 P 034d7c10edb342ab936e590793980fc0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 034d7c10edb342ab936e590793980fc0, 6a2c895eab0c40d6b22be18ca84fed16; no voters: 
I20260709 12:08:17.966850 12842 tablet_bootstrap.cc:654] T b4669889b41c4e0f8e3e35cd4fde8736 P e9591e45f9b241f09c8367c42be07b4f: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.967919 12853 raft_consensus.cc:2804] T d8698d4730834dc582e8564c0a98eb86 P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:17.970945 12853 raft_consensus.cc:493] T d8698d4730834dc582e8564c0a98eb86 P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:17.974602 12853 raft_consensus.cc:3060] T d8698d4730834dc582e8564c0a98eb86 P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:17.985380 12848 raft_consensus.cc:493] T d8698d4730834dc582e8564c0a98eb86 P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:17.986007 12848 raft_consensus.cc:515] T d8698d4730834dc582e8564c0a98eb86 P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } }
I20260709 12:08:17.989452 12848 leader_election.cc:290] T d8698d4730834dc582e8564c0a98eb86 P e9591e45f9b241f09c8367c42be07b4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 034d7c10edb342ab936e590793980fc0 (127.12.56.195:34109), 6a2c895eab0c40d6b22be18ca84fed16 (127.12.56.194:46297)
I20260709 12:08:17.991303 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8698d4730834dc582e8564c0a98eb86" candidate_uuid: "e9591e45f9b241f09c8367c42be07b4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a2c895eab0c40d6b22be18ca84fed16" is_pre_election: true
I20260709 12:08:17.992182 12724 raft_consensus.cc:2468] T d8698d4730834dc582e8564c0a98eb86 P 6a2c895eab0c40d6b22be18ca84fed16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9591e45f9b241f09c8367c42be07b4f in term 0.
I20260709 12:08:17.993633 12615 leader_election.cc:304] T d8698d4730834dc582e8564c0a98eb86 P e9591e45f9b241f09c8367c42be07b4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a2c895eab0c40d6b22be18ca84fed16, e9591e45f9b241f09c8367c42be07b4f; no voters: 
I20260709 12:08:17.994843 12848 raft_consensus.cc:2804] T d8698d4730834dc582e8564c0a98eb86 P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:17.995296 12848 raft_consensus.cc:493] T d8698d4730834dc582e8564c0a98eb86 P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:17.995704 12848 raft_consensus.cc:3060] T d8698d4730834dc582e8564c0a98eb86 P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:17.999765 12844 tablet_bootstrap.cc:492] T 155e9b7aa7aa40a587d743d6a30ccf7e P 034d7c10edb342ab936e590793980fc0: No bootstrap required, opened a new log
I20260709 12:08:18.000345 12844 ts_tablet_manager.cc:1403] T 155e9b7aa7aa40a587d743d6a30ccf7e P 034d7c10edb342ab936e590793980fc0: Time spent bootstrapping tablet: real 0.088s	user 0.014s	sys 0.016s
I20260709 12:08:18.006614 12853 raft_consensus.cc:515] T d8698d4730834dc582e8564c0a98eb86 P 034d7c10edb342ab936e590793980fc0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } }
I20260709 12:08:18.004289 12844 raft_consensus.cc:359] T 155e9b7aa7aa40a587d743d6a30ccf7e P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:18.009289 12844 raft_consensus.cc:385] T 155e9b7aa7aa40a587d743d6a30ccf7e P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.009747 12844 raft_consensus.cc:740] T 155e9b7aa7aa40a587d743d6a30ccf7e P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 034d7c10edb342ab936e590793980fc0, State: Initialized, Role: FOLLOWER
W20260709 12:08:18.010583 12764 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:46297, user_credentials={real_user=slave}} blocked reactor thread for 45750.1us
I20260709 12:08:18.012220 12870 raft_consensus.cc:2804] T efe4e5e9a1b54e3987e81561775a89d6 P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:18.012051 12844 consensus_queue.cc:260] T 155e9b7aa7aa40a587d743d6a30ccf7e P 034d7c10edb342ab936e590793980fc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:18.013111 12870 raft_consensus.cc:493] T efe4e5e9a1b54e3987e81561775a89d6 P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:18.014370 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8698d4730834dc582e8564c0a98eb86" candidate_uuid: "e9591e45f9b241f09c8367c42be07b4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "034d7c10edb342ab936e590793980fc0" is_pre_election: true
I20260709 12:08:18.013500 12870 raft_consensus.cc:3060] T efe4e5e9a1b54e3987e81561775a89d6 P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.016877 12799 raft_consensus.cc:2393] T d8698d4730834dc582e8564c0a98eb86 P 034d7c10edb342ab936e590793980fc0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9591e45f9b241f09c8367c42be07b4f in current term 1: Already voted for candidate 034d7c10edb342ab936e590793980fc0 in this term.
I20260709 12:08:18.015430 12650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8698d4730834dc582e8564c0a98eb86" candidate_uuid: "034d7c10edb342ab936e590793980fc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9591e45f9b241f09c8367c42be07b4f" is_pre_election: true
I20260709 12:08:18.017102 12649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe4e5e9a1b54e3987e81561775a89d6" candidate_uuid: "034d7c10edb342ab936e590793980fc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9591e45f9b241f09c8367c42be07b4f" is_pre_election: true
I20260709 12:08:18.019240 12848 raft_consensus.cc:515] T d8698d4730834dc582e8564c0a98eb86 P e9591e45f9b241f09c8367c42be07b4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } }
I20260709 12:08:18.022073 12649 raft_consensus.cc:2468] T efe4e5e9a1b54e3987e81561775a89d6 P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 034d7c10edb342ab936e590793980fc0 in term 0.
I20260709 12:08:18.025470 12650 raft_consensus.cc:2393] T d8698d4730834dc582e8564c0a98eb86 P e9591e45f9b241f09c8367c42be07b4f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 034d7c10edb342ab936e590793980fc0 in current term 1: Already voted for candidate e9591e45f9b241f09c8367c42be07b4f in this term.
I20260709 12:08:18.026202 12853 leader_election.cc:290] T d8698d4730834dc582e8564c0a98eb86 P 034d7c10edb342ab936e590793980fc0 [CANDIDATE]: Term 1 election: Requested vote from peers e9591e45f9b241f09c8367c42be07b4f (127.12.56.193:35963), 6a2c895eab0c40d6b22be18ca84fed16 (127.12.56.194:46297)
I20260709 12:08:18.028483 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8698d4730834dc582e8564c0a98eb86" candidate_uuid: "e9591e45f9b241f09c8367c42be07b4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a2c895eab0c40d6b22be18ca84fed16"
I20260709 12:08:18.034826 12724 raft_consensus.cc:3060] T d8698d4730834dc582e8564c0a98eb86 P 6a2c895eab0c40d6b22be18ca84fed16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.037168 12844 ts_tablet_manager.cc:1434] T 155e9b7aa7aa40a587d743d6a30ccf7e P 034d7c10edb342ab936e590793980fc0: Time spent starting tablet: real 0.036s	user 0.004s	sys 0.023s
I20260709 12:08:18.038216 12844 tablet_bootstrap.cc:492] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0: Bootstrap starting.
I20260709 12:08:18.040133 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8698d4730834dc582e8564c0a98eb86" candidate_uuid: "e9591e45f9b241f09c8367c42be07b4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "034d7c10edb342ab936e590793980fc0"
I20260709 12:08:18.041021 12799 raft_consensus.cc:2393] T d8698d4730834dc582e8564c0a98eb86 P 034d7c10edb342ab936e590793980fc0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e9591e45f9b241f09c8367c42be07b4f in current term 1: Already voted for candidate 034d7c10edb342ab936e590793980fc0 in this term.
I20260709 12:08:18.042550 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8698d4730834dc582e8564c0a98eb86" candidate_uuid: "034d7c10edb342ab936e590793980fc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a2c895eab0c40d6b22be18ca84fed16"
I20260709 12:08:18.041505 12870 raft_consensus.cc:515] T efe4e5e9a1b54e3987e81561775a89d6 P 034d7c10edb342ab936e590793980fc0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:18.044593 12844 tablet_bootstrap.cc:654] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.045879 12870 leader_election.cc:290] T efe4e5e9a1b54e3987e81561775a89d6 P 034d7c10edb342ab936e590793980fc0 [CANDIDATE]: Term 1 election: Requested vote from peers e9591e45f9b241f09c8367c42be07b4f (127.12.56.193:35963), 6a2c895eab0c40d6b22be18ca84fed16 (127.12.56.194:46297)
I20260709 12:08:18.049350 12724 raft_consensus.cc:2468] T d8698d4730834dc582e8564c0a98eb86 P 6a2c895eab0c40d6b22be18ca84fed16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9591e45f9b241f09c8367c42be07b4f in term 1.
I20260709 12:08:18.054332 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe4e5e9a1b54e3987e81561775a89d6" candidate_uuid: "034d7c10edb342ab936e590793980fc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a2c895eab0c40d6b22be18ca84fed16"
I20260709 12:08:18.054616 12615 leader_election.cc:304] T d8698d4730834dc582e8564c0a98eb86 P e9591e45f9b241f09c8367c42be07b4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a2c895eab0c40d6b22be18ca84fed16, e9591e45f9b241f09c8367c42be07b4f; no voters: 034d7c10edb342ab936e590793980fc0
I20260709 12:08:18.055014 12725 raft_consensus.cc:3060] T efe4e5e9a1b54e3987e81561775a89d6 P 6a2c895eab0c40d6b22be18ca84fed16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.055634 12846 raft_consensus.cc:2804] T d8698d4730834dc582e8564c0a98eb86 P e9591e45f9b241f09c8367c42be07b4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:18.029390 12649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8698d4730834dc582e8564c0a98eb86" candidate_uuid: "034d7c10edb342ab936e590793980fc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9591e45f9b241f09c8367c42be07b4f"
I20260709 12:08:18.034116 12845 tablet_bootstrap.cc:492] T 41a081ffb7f74fe598b4689f85e3f19d P 6a2c895eab0c40d6b22be18ca84fed16: No bootstrap required, opened a new log
I20260709 12:08:18.051280 12844 tablet_bootstrap.cc:492] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0: No bootstrap required, opened a new log
I20260709 12:08:18.053351 12650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe4e5e9a1b54e3987e81561775a89d6" candidate_uuid: "034d7c10edb342ab936e590793980fc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9591e45f9b241f09c8367c42be07b4f"
I20260709 12:08:18.053406 12842 tablet_bootstrap.cc:492] T b4669889b41c4e0f8e3e35cd4fde8736 P e9591e45f9b241f09c8367c42be07b4f: No bootstrap required, opened a new log
I20260709 12:08:18.028997 12848 leader_election.cc:290] T d8698d4730834dc582e8564c0a98eb86 P e9591e45f9b241f09c8367c42be07b4f [CANDIDATE]: Term 1 election: Requested vote from peers 034d7c10edb342ab936e590793980fc0 (127.12.56.195:34109), 6a2c895eab0c40d6b22be18ca84fed16 (127.12.56.194:46297)
I20260709 12:08:18.058792 12842 ts_tablet_manager.cc:1403] T b4669889b41c4e0f8e3e35cd4fde8736 P e9591e45f9b241f09c8367c42be07b4f: Time spent bootstrapping tablet: real 0.112s	user 0.019s	sys 0.005s
I20260709 12:08:18.058715 12650 raft_consensus.cc:3060] T efe4e5e9a1b54e3987e81561775a89d6 P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.058257 12845 ts_tablet_manager.cc:1403] T 41a081ffb7f74fe598b4689f85e3f19d P 6a2c895eab0c40d6b22be18ca84fed16: Time spent bootstrapping tablet: real 0.111s	user 0.025s	sys 0.022s
I20260709 12:08:18.064145 12848 raft_consensus.cc:493] T 155e9b7aa7aa40a587d743d6a30ccf7e P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.064697 12848 raft_consensus.cc:515] T 155e9b7aa7aa40a587d743d6a30ccf7e P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:18.064960 12845 raft_consensus.cc:359] T 41a081ffb7f74fe598b4689f85e3f19d P 6a2c895eab0c40d6b22be18ca84fed16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:18.058248 12844 ts_tablet_manager.cc:1403] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.003s
I20260709 12:08:18.067963 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155e9b7aa7aa40a587d743d6a30ccf7e" candidate_uuid: "e9591e45f9b241f09c8367c42be07b4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a2c895eab0c40d6b22be18ca84fed16" is_pre_election: true
I20260709 12:08:18.068602 12725 raft_consensus.cc:2468] T efe4e5e9a1b54e3987e81561775a89d6 P 6a2c895eab0c40d6b22be18ca84fed16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 034d7c10edb342ab936e590793980fc0 in term 1.
W20260709 12:08:18.069576 12615 leader_election.cc:343] T 155e9b7aa7aa40a587d743d6a30ccf7e P e9591e45f9b241f09c8367c42be07b4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a2c895eab0c40d6b22be18ca84fed16 (127.12.56.194:46297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:18.065707 12845 raft_consensus.cc:385] T 41a081ffb7f74fe598b4689f85e3f19d P 6a2c895eab0c40d6b22be18ca84fed16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.071069 12845 raft_consensus.cc:740] T 41a081ffb7f74fe598b4689f85e3f19d P 6a2c895eab0c40d6b22be18ca84fed16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a2c895eab0c40d6b22be18ca84fed16, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.071975 12845 consensus_queue.cc:260] T 41a081ffb7f74fe598b4689f85e3f19d P 6a2c895eab0c40d6b22be18ca84fed16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:18.072786 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155e9b7aa7aa40a587d743d6a30ccf7e" candidate_uuid: "e9591e45f9b241f09c8367c42be07b4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "034d7c10edb342ab936e590793980fc0" is_pre_election: true
I20260709 12:08:18.068768 12844 raft_consensus.cc:359] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:18.073529 12844 raft_consensus.cc:385] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.073550 12799 raft_consensus.cc:2468] T 155e9b7aa7aa40a587d743d6a30ccf7e P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9591e45f9b241f09c8367c42be07b4f in term 0.
I20260709 12:08:18.074045 12844 raft_consensus.cc:740] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 034d7c10edb342ab936e590793980fc0, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.075322 12844 consensus_queue.cc:260] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:18.075865 12616 leader_election.cc:304] T 155e9b7aa7aa40a587d743d6a30ccf7e P e9591e45f9b241f09c8367c42be07b4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 034d7c10edb342ab936e590793980fc0, e9591e45f9b241f09c8367c42be07b4f; no voters: 6a2c895eab0c40d6b22be18ca84fed16
I20260709 12:08:18.061553 12842 raft_consensus.cc:359] T b4669889b41c4e0f8e3e35cd4fde8736 P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:18.077682 12650 raft_consensus.cc:2468] T efe4e5e9a1b54e3987e81561775a89d6 P e9591e45f9b241f09c8367c42be07b4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 034d7c10edb342ab936e590793980fc0 in term 1.
I20260709 12:08:18.076967 12848 leader_election.cc:290] T 155e9b7aa7aa40a587d743d6a30ccf7e P e9591e45f9b241f09c8367c42be07b4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a2c895eab0c40d6b22be18ca84fed16 (127.12.56.194:46297), 034d7c10edb342ab936e590793980fc0 (127.12.56.195:34109)
I20260709 12:08:18.078047 12842 raft_consensus.cc:385] T b4669889b41c4e0f8e3e35cd4fde8736 P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.078589 12842 raft_consensus.cc:740] T b4669889b41c4e0f8e3e35cd4fde8736 P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9591e45f9b241f09c8367c42be07b4f, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.078773 12848 raft_consensus.cc:2804] T 155e9b7aa7aa40a587d743d6a30ccf7e P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:18.079397 12842 consensus_queue.cc:260] T b4669889b41c4e0f8e3e35cd4fde8736 P e9591e45f9b241f09c8367c42be07b4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:18.079892 12764 leader_election.cc:304] T efe4e5e9a1b54e3987e81561775a89d6 P 034d7c10edb342ab936e590793980fc0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 034d7c10edb342ab936e590793980fc0, 6a2c895eab0c40d6b22be18ca84fed16; no voters: 
I20260709 12:08:18.080785 12870 raft_consensus.cc:2804] T efe4e5e9a1b54e3987e81561775a89d6 P 034d7c10edb342ab936e590793980fc0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:18.081435 12842 ts_tablet_manager.cc:1434] T b4669889b41c4e0f8e3e35cd4fde8736 P e9591e45f9b241f09c8367c42be07b4f: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 12:08:18.082373 12842 tablet_bootstrap.cc:492] T d6f93f92c31a40318d4b51b090c5209b P e9591e45f9b241f09c8367c42be07b4f: Bootstrap starting.
I20260709 12:08:18.079250 12848 raft_consensus.cc:493] T 155e9b7aa7aa40a587d743d6a30ccf7e P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:18.081326 12870 raft_consensus.cc:697] T efe4e5e9a1b54e3987e81561775a89d6 P 034d7c10edb342ab936e590793980fc0 [term 1 LEADER]: Becoming Leader. State: Replica: 034d7c10edb342ab936e590793980fc0, State: Running, Role: LEADER
I20260709 12:08:18.084170 12870 consensus_queue.cc:237] T efe4e5e9a1b54e3987e81561775a89d6 P 034d7c10edb342ab936e590793980fc0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:18.085034 12848 raft_consensus.cc:3060] T 155e9b7aa7aa40a587d743d6a30ccf7e P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.077706 12845 ts_tablet_manager.cc:1434] T 41a081ffb7f74fe598b4689f85e3f19d P 6a2c895eab0c40d6b22be18ca84fed16: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 12:08:18.086244 12846 raft_consensus.cc:697] T d8698d4730834dc582e8564c0a98eb86 P e9591e45f9b241f09c8367c42be07b4f [term 1 LEADER]: Becoming Leader. State: Replica: e9591e45f9b241f09c8367c42be07b4f, State: Running, Role: LEADER
I20260709 12:08:18.088071 12844 ts_tablet_manager.cc:1434] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.003s
I20260709 12:08:18.088088 12846 consensus_queue.cc:237] T d8698d4730834dc582e8564c0a98eb86 P e9591e45f9b241f09c8367c42be07b4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } }
I20260709 12:08:18.089186 12844 tablet_bootstrap.cc:492] T 6a014226736c4b259b23ca9932bbef77 P 034d7c10edb342ab936e590793980fc0: Bootstrap starting.
I20260709 12:08:18.098820 12845 tablet_bootstrap.cc:492] T d6f93f92c31a40318d4b51b090c5209b P 6a2c895eab0c40d6b22be18ca84fed16: Bootstrap starting.
I20260709 12:08:18.113315 12874 raft_consensus.cc:493] T 6a014226736c4b259b23ca9932bbef77 P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.114012 12874 raft_consensus.cc:515] T 6a014226736c4b259b23ca9932bbef77 P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:18.120007 12764 leader_election.cc:304] T d8698d4730834dc582e8564c0a98eb86 P 034d7c10edb342ab936e590793980fc0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 034d7c10edb342ab936e590793980fc0; no voters: 6a2c895eab0c40d6b22be18ca84fed16, e9591e45f9b241f09c8367c42be07b4f
I20260709 12:08:18.122247 12872 raft_consensus.cc:2749] T d8698d4730834dc582e8564c0a98eb86 P 034d7c10edb342ab936e590793980fc0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:08:18.123684 12874 leader_election.cc:290] T 6a014226736c4b259b23ca9932bbef77 P e9591e45f9b241f09c8367c42be07b4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a2c895eab0c40d6b22be18ca84fed16 (127.12.56.194:46297), 034d7c10edb342ab936e590793980fc0 (127.12.56.195:34109)
I20260709 12:08:18.125105 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a014226736c4b259b23ca9932bbef77" candidate_uuid: "e9591e45f9b241f09c8367c42be07b4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a2c895eab0c40d6b22be18ca84fed16" is_pre_election: true
W20260709 12:08:18.140178 12615 leader_election.cc:343] T 6a014226736c4b259b23ca9932bbef77 P e9591e45f9b241f09c8367c42be07b4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a2c895eab0c40d6b22be18ca84fed16 (127.12.56.194:46297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:18.138922 12874 raft_consensus.cc:493] T 5957ce50d01e4214bc908e402a78a32e P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.143127 12842 tablet_bootstrap.cc:654] T d6f93f92c31a40318d4b51b090c5209b P e9591e45f9b241f09c8367c42be07b4f: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.142829 12874 raft_consensus.cc:515] T 5957ce50d01e4214bc908e402a78a32e P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:18.143918 12848 raft_consensus.cc:515] T 155e9b7aa7aa40a587d743d6a30ccf7e P e9591e45f9b241f09c8367c42be07b4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:18.145548 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a014226736c4b259b23ca9932bbef77" candidate_uuid: "e9591e45f9b241f09c8367c42be07b4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "034d7c10edb342ab936e590793980fc0" is_pre_election: true
I20260709 12:08:18.154233 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5957ce50d01e4214bc908e402a78a32e" candidate_uuid: "e9591e45f9b241f09c8367c42be07b4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a2c895eab0c40d6b22be18ca84fed16" is_pre_election: true
I20260709 12:08:18.145721 12545 catalog_manager.cc:5697] T d8698d4730834dc582e8564c0a98eb86 P e9591e45f9b241f09c8367c42be07b4f reported cstate change: term changed from 0 to 1, leader changed from <none> to e9591e45f9b241f09c8367c42be07b4f (127.12.56.193). New cstate: current_term: 1 leader_uuid: "e9591e45f9b241f09c8367c42be07b4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:18.153388 12848 leader_election.cc:290] T 155e9b7aa7aa40a587d743d6a30ccf7e P e9591e45f9b241f09c8367c42be07b4f [CANDIDATE]: Term 1 election: Requested vote from peers 6a2c895eab0c40d6b22be18ca84fed16 (127.12.56.194:46297), 034d7c10edb342ab936e590793980fc0 (127.12.56.195:34109)
I20260709 12:08:18.146344 12874 leader_election.cc:290] T 5957ce50d01e4214bc908e402a78a32e P e9591e45f9b241f09c8367c42be07b4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a2c895eab0c40d6b22be18ca84fed16 (127.12.56.194:46297), 034d7c10edb342ab936e590793980fc0 (127.12.56.195:34109)
I20260709 12:08:18.156232 12547 catalog_manager.cc:5697] T efe4e5e9a1b54e3987e81561775a89d6 P 034d7c10edb342ab936e590793980fc0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 034d7c10edb342ab936e590793980fc0 (127.12.56.195). New cstate: current_term: 1 leader_uuid: "034d7c10edb342ab936e590793980fc0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:18.160492 12845 tablet_bootstrap.cc:654] T d6f93f92c31a40318d4b51b090c5209b P 6a2c895eab0c40d6b22be18ca84fed16: Neither blocks nor log segments found. Creating new log.
W20260709 12:08:18.159130 12616 leader_election.cc:343] T 6a014226736c4b259b23ca9932bbef77 P e9591e45f9b241f09c8367c42be07b4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 034d7c10edb342ab936e590793980fc0 (127.12.56.195:34109): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:18.167001 12616 leader_election.cc:304] T 6a014226736c4b259b23ca9932bbef77 P e9591e45f9b241f09c8367c42be07b4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9591e45f9b241f09c8367c42be07b4f; no voters: 034d7c10edb342ab936e590793980fc0, 6a2c895eab0c40d6b22be18ca84fed16
I20260709 12:08:18.168759 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5957ce50d01e4214bc908e402a78a32e" candidate_uuid: "e9591e45f9b241f09c8367c42be07b4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "034d7c10edb342ab936e590793980fc0" is_pre_election: true
I20260709 12:08:18.167071 12798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155e9b7aa7aa40a587d743d6a30ccf7e" candidate_uuid: "e9591e45f9b241f09c8367c42be07b4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "034d7c10edb342ab936e590793980fc0"
I20260709 12:08:18.173959 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155e9b7aa7aa40a587d743d6a30ccf7e" candidate_uuid: "e9591e45f9b241f09c8367c42be07b4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a2c895eab0c40d6b22be18ca84fed16"
I20260709 12:08:18.171525 12874 raft_consensus.cc:2749] T 6a014226736c4b259b23ca9932bbef77 P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:08:18.173069 12615 leader_election.cc:343] T 5957ce50d01e4214bc908e402a78a32e P e9591e45f9b241f09c8367c42be07b4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a2c895eab0c40d6b22be18ca84fed16 (127.12.56.194:46297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:18.182089 12870 raft_consensus.cc:493] T 41a081ffb7f74fe598b4689f85e3f19d P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.182773 12870 raft_consensus.cc:515] T 41a081ffb7f74fe598b4689f85e3f19d P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:18.185138 12870 leader_election.cc:290] T 41a081ffb7f74fe598b4689f85e3f19d P 034d7c10edb342ab936e590793980fc0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9591e45f9b241f09c8367c42be07b4f (127.12.56.193:35963), 6a2c895eab0c40d6b22be18ca84fed16 (127.12.56.194:46297)
I20260709 12:08:18.187376 12649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a081ffb7f74fe598b4689f85e3f19d" candidate_uuid: "034d7c10edb342ab936e590793980fc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9591e45f9b241f09c8367c42be07b4f" is_pre_election: true
I20260709 12:08:18.187592 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a081ffb7f74fe598b4689f85e3f19d" candidate_uuid: "034d7c10edb342ab936e590793980fc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a2c895eab0c40d6b22be18ca84fed16" is_pre_election: true
I20260709 12:08:18.188099 12649 raft_consensus.cc:2468] T 41a081ffb7f74fe598b4689f85e3f19d P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 034d7c10edb342ab936e590793980fc0 in term 0.
I20260709 12:08:18.188537 12725 raft_consensus.cc:2468] T 41a081ffb7f74fe598b4689f85e3f19d P 6a2c895eab0c40d6b22be18ca84fed16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 034d7c10edb342ab936e590793980fc0 in term 0.
I20260709 12:08:18.189671 12764 leader_election.cc:304] T 41a081ffb7f74fe598b4689f85e3f19d P 034d7c10edb342ab936e590793980fc0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 034d7c10edb342ab936e590793980fc0, e9591e45f9b241f09c8367c42be07b4f; no voters: 
I20260709 12:08:18.191170 12870 raft_consensus.cc:2804] T 41a081ffb7f74fe598b4689f85e3f19d P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:18.191601 12870 raft_consensus.cc:493] T 41a081ffb7f74fe598b4689f85e3f19d P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:18.192004 12870 raft_consensus.cc:3060] T 41a081ffb7f74fe598b4689f85e3f19d P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.197625 12798 raft_consensus.cc:3060] T 155e9b7aa7aa40a587d743d6a30ccf7e P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:08:18.199038 12616 leader_election.cc:343] T 5957ce50d01e4214bc908e402a78a32e P e9591e45f9b241f09c8367c42be07b4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 034d7c10edb342ab936e590793980fc0 (127.12.56.195:34109): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:18.200839 12844 tablet_bootstrap.cc:654] T 6a014226736c4b259b23ca9932bbef77 P 034d7c10edb342ab936e590793980fc0: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.201704 12842 tablet_bootstrap.cc:492] T d6f93f92c31a40318d4b51b090c5209b P e9591e45f9b241f09c8367c42be07b4f: No bootstrap required, opened a new log
I20260709 12:08:18.233552 12842 ts_tablet_manager.cc:1403] T d6f93f92c31a40318d4b51b090c5209b P e9591e45f9b241f09c8367c42be07b4f: Time spent bootstrapping tablet: real 0.151s	user 0.017s	sys 0.014s
I20260709 12:08:18.214272 12616 leader_election.cc:304] T 5957ce50d01e4214bc908e402a78a32e P e9591e45f9b241f09c8367c42be07b4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9591e45f9b241f09c8367c42be07b4f; no voters: 034d7c10edb342ab936e590793980fc0, 6a2c895eab0c40d6b22be18ca84fed16
I20260709 12:08:18.228981 12798 raft_consensus.cc:2468] T 155e9b7aa7aa40a587d743d6a30ccf7e P 034d7c10edb342ab936e590793980fc0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9591e45f9b241f09c8367c42be07b4f in term 1.
I20260709 12:08:18.235313 12874 raft_consensus.cc:2749] T 5957ce50d01e4214bc908e402a78a32e P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:18.232200 12870 raft_consensus.cc:515] T 41a081ffb7f74fe598b4689f85e3f19d P 034d7c10edb342ab936e590793980fc0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
W20260709 12:08:18.235543 12616 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:34109, user_credentials={real_user=slave}} blocked reactor thread for 61266.1us
I20260709 12:08:18.226240 12845 tablet_bootstrap.cc:492] T d6f93f92c31a40318d4b51b090c5209b P 6a2c895eab0c40d6b22be18ca84fed16: No bootstrap required, opened a new log
W20260709 12:08:18.201351 12615 leader_election.cc:343] T 155e9b7aa7aa40a587d743d6a30ccf7e P e9591e45f9b241f09c8367c42be07b4f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6a2c895eab0c40d6b22be18ca84fed16 (127.12.56.194:46297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:18.243139 12845 ts_tablet_manager.cc:1403] T d6f93f92c31a40318d4b51b090c5209b P 6a2c895eab0c40d6b22be18ca84fed16: Time spent bootstrapping tablet: real 0.145s	user 0.017s	sys 0.039s
I20260709 12:08:18.243747 12649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a081ffb7f74fe598b4689f85e3f19d" candidate_uuid: "034d7c10edb342ab936e590793980fc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9591e45f9b241f09c8367c42be07b4f"
I20260709 12:08:18.244345 12649 raft_consensus.cc:3060] T 41a081ffb7f74fe598b4689f85e3f19d P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.246136 12872 raft_consensus.cc:493] T d6f93f92c31a40318d4b51b090c5209b P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.253451 12616 leader_election.cc:304] T 155e9b7aa7aa40a587d743d6a30ccf7e P e9591e45f9b241f09c8367c42be07b4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 034d7c10edb342ab936e590793980fc0, e9591e45f9b241f09c8367c42be07b4f; no voters: 6a2c895eab0c40d6b22be18ca84fed16
I20260709 12:08:18.253322 12872 raft_consensus.cc:515] T d6f93f92c31a40318d4b51b090c5209b P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:18.255196 12848 raft_consensus.cc:2804] T 155e9b7aa7aa40a587d743d6a30ccf7e P e9591e45f9b241f09c8367c42be07b4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:18.255489 12842 raft_consensus.cc:359] T d6f93f92c31a40318d4b51b090c5209b P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:18.255703 12848 raft_consensus.cc:697] T 155e9b7aa7aa40a587d743d6a30ccf7e P e9591e45f9b241f09c8367c42be07b4f [term 1 LEADER]: Becoming Leader. State: Replica: e9591e45f9b241f09c8367c42be07b4f, State: Running, Role: LEADER
I20260709 12:08:18.256349 12842 raft_consensus.cc:385] T d6f93f92c31a40318d4b51b090c5209b P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.256856 12842 raft_consensus.cc:740] T d6f93f92c31a40318d4b51b090c5209b P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9591e45f9b241f09c8367c42be07b4f, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.264030 12842 consensus_queue.cc:260] T d6f93f92c31a40318d4b51b090c5209b P e9591e45f9b241f09c8367c42be07b4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:18.256958 12848 consensus_queue.cc:237] T 155e9b7aa7aa40a587d743d6a30ccf7e P e9591e45f9b241f09c8367c42be07b4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:18.265858 12842 ts_tablet_manager.cc:1434] T d6f93f92c31a40318d4b51b090c5209b P e9591e45f9b241f09c8367c42be07b4f: Time spent starting tablet: real 0.032s	user 0.011s	sys 0.002s
I20260709 12:08:18.246430 12725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a081ffb7f74fe598b4689f85e3f19d" candidate_uuid: "034d7c10edb342ab936e590793980fc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a2c895eab0c40d6b22be18ca84fed16"
I20260709 12:08:18.266774 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f93f92c31a40318d4b51b090c5209b" candidate_uuid: "034d7c10edb342ab936e590793980fc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a2c895eab0c40d6b22be18ca84fed16" is_pre_election: true
I20260709 12:08:18.267026 12725 raft_consensus.cc:3060] T 41a081ffb7f74fe598b4689f85e3f19d P 6a2c895eab0c40d6b22be18ca84fed16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.266774 12650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f93f92c31a40318d4b51b090c5209b" candidate_uuid: "034d7c10edb342ab936e590793980fc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9591e45f9b241f09c8367c42be07b4f" is_pre_election: true
I20260709 12:08:18.268199 12650 raft_consensus.cc:2468] T d6f93f92c31a40318d4b51b090c5209b P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 034d7c10edb342ab936e590793980fc0 in term 0.
I20260709 12:08:18.253943 12874 raft_consensus.cc:493] T b4669889b41c4e0f8e3e35cd4fde8736 P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.270653 12874 raft_consensus.cc:515] T b4669889b41c4e0f8e3e35cd4fde8736 P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:18.246640 12870 leader_election.cc:290] T 41a081ffb7f74fe598b4689f85e3f19d P 034d7c10edb342ab936e590793980fc0 [CANDIDATE]: Term 1 election: Requested vote from peers e9591e45f9b241f09c8367c42be07b4f (127.12.56.193:35963), 6a2c895eab0c40d6b22be18ca84fed16 (127.12.56.194:46297)
I20260709 12:08:18.273343 12874 leader_election.cc:290] T b4669889b41c4e0f8e3e35cd4fde8736 P e9591e45f9b241f09c8367c42be07b4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a2c895eab0c40d6b22be18ca84fed16 (127.12.56.194:46297), 034d7c10edb342ab936e590793980fc0 (127.12.56.195:34109)
I20260709 12:08:18.256928 12872 leader_election.cc:290] T d6f93f92c31a40318d4b51b090c5209b P 034d7c10edb342ab936e590793980fc0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9591e45f9b241f09c8367c42be07b4f (127.12.56.193:35963), 6a2c895eab0c40d6b22be18ca84fed16 (127.12.56.194:46297)
I20260709 12:08:18.260623 12845 raft_consensus.cc:359] T d6f93f92c31a40318d4b51b090c5209b P 6a2c895eab0c40d6b22be18ca84fed16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:18.274953 12764 leader_election.cc:304] T d6f93f92c31a40318d4b51b090c5209b P 034d7c10edb342ab936e590793980fc0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 034d7c10edb342ab936e590793980fc0, e9591e45f9b241f09c8367c42be07b4f; no voters: 
I20260709 12:08:18.277326 12872 raft_consensus.cc:2804] T d6f93f92c31a40318d4b51b090c5209b P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:18.277735 12872 raft_consensus.cc:493] T d6f93f92c31a40318d4b51b090c5209b P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:18.278211 12856 raft_consensus.cc:493] T b4669889b41c4e0f8e3e35cd4fde8736 P 6a2c895eab0c40d6b22be18ca84fed16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.277858 12798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4669889b41c4e0f8e3e35cd4fde8736" candidate_uuid: "e9591e45f9b241f09c8367c42be07b4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "034d7c10edb342ab936e590793980fc0" is_pre_election: true
I20260709 12:08:18.278527 12872 raft_consensus.cc:3060] T d6f93f92c31a40318d4b51b090c5209b P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.278823 12856 raft_consensus.cc:515] T b4669889b41c4e0f8e3e35cd4fde8736 P 6a2c895eab0c40d6b22be18ca84fed16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
W20260709 12:08:18.279983 12616 leader_election.cc:343] T b4669889b41c4e0f8e3e35cd4fde8736 P e9591e45f9b241f09c8367c42be07b4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 034d7c10edb342ab936e590793980fc0 (127.12.56.195:34109): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:18.277806 12725 raft_consensus.cc:2468] T 41a081ffb7f74fe598b4689f85e3f19d P 6a2c895eab0c40d6b22be18ca84fed16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 034d7c10edb342ab936e590793980fc0 in term 1.
I20260709 12:08:18.276152 12845 raft_consensus.cc:385] T d6f93f92c31a40318d4b51b090c5209b P 6a2c895eab0c40d6b22be18ca84fed16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.286096 12856 leader_election.cc:290] T b4669889b41c4e0f8e3e35cd4fde8736 P 6a2c895eab0c40d6b22be18ca84fed16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9591e45f9b241f09c8367c42be07b4f (127.12.56.193:35963), 034d7c10edb342ab936e590793980fc0 (127.12.56.195:34109)
I20260709 12:08:18.281591 12649 raft_consensus.cc:2468] T 41a081ffb7f74fe598b4689f85e3f19d P e9591e45f9b241f09c8367c42be07b4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 034d7c10edb342ab936e590793980fc0 in term 1.
I20260709 12:08:18.281658 12764 leader_election.cc:304] T 41a081ffb7f74fe598b4689f85e3f19d P 034d7c10edb342ab936e590793980fc0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 034d7c10edb342ab936e590793980fc0, 6a2c895eab0c40d6b22be18ca84fed16; no voters: 
I20260709 12:08:18.275897 12723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4669889b41c4e0f8e3e35cd4fde8736" candidate_uuid: "e9591e45f9b241f09c8367c42be07b4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a2c895eab0c40d6b22be18ca84fed16" is_pre_election: true
I20260709 12:08:18.288493 12845 raft_consensus.cc:740] T d6f93f92c31a40318d4b51b090c5209b P 6a2c895eab0c40d6b22be18ca84fed16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a2c895eab0c40d6b22be18ca84fed16, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.299971 12844 tablet_bootstrap.cc:492] T 6a014226736c4b259b23ca9932bbef77 P 034d7c10edb342ab936e590793980fc0: No bootstrap required, opened a new log
I20260709 12:08:18.304606 12723 raft_consensus.cc:2468] T b4669889b41c4e0f8e3e35cd4fde8736 P 6a2c895eab0c40d6b22be18ca84fed16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9591e45f9b241f09c8367c42be07b4f in term 0.
I20260709 12:08:18.323817 12844 ts_tablet_manager.cc:1403] T 6a014226736c4b259b23ca9932bbef77 P 034d7c10edb342ab936e590793980fc0: Time spent bootstrapping tablet: real 0.235s	user 0.032s	sys 0.043s
I20260709 12:08:18.322280 12870 raft_consensus.cc:2804] T 41a081ffb7f74fe598b4689f85e3f19d P 034d7c10edb342ab936e590793980fc0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:18.330967 12870 raft_consensus.cc:697] T 41a081ffb7f74fe598b4689f85e3f19d P 034d7c10edb342ab936e590793980fc0 [term 1 LEADER]: Becoming Leader. State: Replica: 034d7c10edb342ab936e590793980fc0, State: Running, Role: LEADER
I20260709 12:08:18.332286 12870 consensus_queue.cc:237] T 41a081ffb7f74fe598b4689f85e3f19d P 034d7c10edb342ab936e590793980fc0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:18.338270 12845 consensus_queue.cc:260] T d6f93f92c31a40318d4b51b090c5209b P 6a2c895eab0c40d6b22be18ca84fed16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:18.340500 12724 raft_consensus.cc:2468] T d6f93f92c31a40318d4b51b090c5209b P 6a2c895eab0c40d6b22be18ca84fed16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 034d7c10edb342ab936e590793980fc0 in term 0.
I20260709 12:08:18.342473 12845 ts_tablet_manager.cc:1434] T d6f93f92c31a40318d4b51b090c5209b P 6a2c895eab0c40d6b22be18ca84fed16: Time spent starting tablet: real 0.097s	user 0.010s	sys 0.000s
I20260709 12:08:18.354472 12845 tablet_bootstrap.cc:492] T 4077af80765d460586125b4f312f5cfb P 6a2c895eab0c40d6b22be18ca84fed16: Bootstrap starting.
I20260709 12:08:18.329174 12844 raft_consensus.cc:359] T 6a014226736c4b259b23ca9932bbef77 P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:18.357788 12844 raft_consensus.cc:385] T 6a014226736c4b259b23ca9932bbef77 P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.358294 12844 raft_consensus.cc:740] T 6a014226736c4b259b23ca9932bbef77 P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 034d7c10edb342ab936e590793980fc0, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.348600 12872 raft_consensus.cc:515] T d6f93f92c31a40318d4b51b090c5209b P 034d7c10edb342ab936e590793980fc0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:18.361006 12615 leader_election.cc:304] T b4669889b41c4e0f8e3e35cd4fde8736 P e9591e45f9b241f09c8367c42be07b4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a2c895eab0c40d6b22be18ca84fed16, e9591e45f9b241f09c8367c42be07b4f; no voters: 034d7c10edb342ab936e590793980fc0
I20260709 12:08:18.361881 12848 raft_consensus.cc:2804] T b4669889b41c4e0f8e3e35cd4fde8736 P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:18.362254 12848 raft_consensus.cc:493] T b4669889b41c4e0f8e3e35cd4fde8736 P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:18.362372 12872 leader_election.cc:290] T d6f93f92c31a40318d4b51b090c5209b P 034d7c10edb342ab936e590793980fc0 [CANDIDATE]: Term 1 election: Requested vote from peers e9591e45f9b241f09c8367c42be07b4f (127.12.56.193:35963), 6a2c895eab0c40d6b22be18ca84fed16 (127.12.56.194:46297)
I20260709 12:08:18.362636 12848 raft_consensus.cc:3060] T b4669889b41c4e0f8e3e35cd4fde8736 P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.359388 12844 consensus_queue.cc:260] T 6a014226736c4b259b23ca9932bbef77 P 034d7c10edb342ab936e590793980fc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:18.364038 12649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f93f92c31a40318d4b51b090c5209b" candidate_uuid: "034d7c10edb342ab936e590793980fc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9591e45f9b241f09c8367c42be07b4f"
I20260709 12:08:18.364629 12649 raft_consensus.cc:3060] T d6f93f92c31a40318d4b51b090c5209b P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.364682 12844 ts_tablet_manager.cc:1434] T 6a014226736c4b259b23ca9932bbef77 P 034d7c10edb342ab936e590793980fc0: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.000s
I20260709 12:08:18.366243 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f93f92c31a40318d4b51b090c5209b" candidate_uuid: "034d7c10edb342ab936e590793980fc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a2c895eab0c40d6b22be18ca84fed16"
I20260709 12:08:18.366858 12724 raft_consensus.cc:3060] T d6f93f92c31a40318d4b51b090c5209b P 6a2c895eab0c40d6b22be18ca84fed16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.372416 12845 tablet_bootstrap.cc:654] T 4077af80765d460586125b4f312f5cfb P 6a2c895eab0c40d6b22be18ca84fed16: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.376051 12844 tablet_bootstrap.cc:492] T 5957ce50d01e4214bc908e402a78a32e P 034d7c10edb342ab936e590793980fc0: Bootstrap starting.
I20260709 12:08:18.373363 12848 raft_consensus.cc:515] T b4669889b41c4e0f8e3e35cd4fde8736 P e9591e45f9b241f09c8367c42be07b4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:18.381510 12723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4669889b41c4e0f8e3e35cd4fde8736" candidate_uuid: "e9591e45f9b241f09c8367c42be07b4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a2c895eab0c40d6b22be18ca84fed16"
I20260709 12:08:18.382540 12723 raft_consensus.cc:3060] T b4669889b41c4e0f8e3e35cd4fde8736 P 6a2c895eab0c40d6b22be18ca84fed16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.383425 12798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4669889b41c4e0f8e3e35cd4fde8736" candidate_uuid: "e9591e45f9b241f09c8367c42be07b4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "034d7c10edb342ab936e590793980fc0"
W20260709 12:08:18.385308 12616 leader_election.cc:343] T b4669889b41c4e0f8e3e35cd4fde8736 P e9591e45f9b241f09c8367c42be07b4f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 034d7c10edb342ab936e590793980fc0 (127.12.56.195:34109): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:18.383273 12848 leader_election.cc:290] T b4669889b41c4e0f8e3e35cd4fde8736 P e9591e45f9b241f09c8367c42be07b4f [CANDIDATE]: Term 1 election: Requested vote from peers 6a2c895eab0c40d6b22be18ca84fed16 (127.12.56.194:46297), 034d7c10edb342ab936e590793980fc0 (127.12.56.195:34109)
I20260709 12:08:18.391566 12650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4669889b41c4e0f8e3e35cd4fde8736" candidate_uuid: "6a2c895eab0c40d6b22be18ca84fed16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9591e45f9b241f09c8367c42be07b4f" is_pre_election: true
I20260709 12:08:18.392525 12650 raft_consensus.cc:2393] T b4669889b41c4e0f8e3e35cd4fde8736 P e9591e45f9b241f09c8367c42be07b4f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6a2c895eab0c40d6b22be18ca84fed16 in current term 1: Already voted for candidate e9591e45f9b241f09c8367c42be07b4f in this term.
I20260709 12:08:18.394047 12649 raft_consensus.cc:2468] T d6f93f92c31a40318d4b51b090c5209b P e9591e45f9b241f09c8367c42be07b4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 034d7c10edb342ab936e590793980fc0 in term 1.
I20260709 12:08:18.400583 12764 leader_election.cc:304] T d6f93f92c31a40318d4b51b090c5209b P 034d7c10edb342ab936e590793980fc0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 034d7c10edb342ab936e590793980fc0, e9591e45f9b241f09c8367c42be07b4f; no voters: 
I20260709 12:08:18.402501 12872 raft_consensus.cc:2804] T d6f93f92c31a40318d4b51b090c5209b P 034d7c10edb342ab936e590793980fc0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:18.403053 12872 raft_consensus.cc:697] T d6f93f92c31a40318d4b51b090c5209b P 034d7c10edb342ab936e590793980fc0 [term 1 LEADER]: Becoming Leader. State: Replica: 034d7c10edb342ab936e590793980fc0, State: Running, Role: LEADER
I20260709 12:08:18.403959 12872 consensus_queue.cc:237] T d6f93f92c31a40318d4b51b090c5209b P 034d7c10edb342ab936e590793980fc0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:18.414961 12724 raft_consensus.cc:2468] T d6f93f92c31a40318d4b51b090c5209b P 6a2c895eab0c40d6b22be18ca84fed16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 034d7c10edb342ab936e590793980fc0 in term 1.
I20260709 12:08:18.421340 12723 raft_consensus.cc:2468] T b4669889b41c4e0f8e3e35cd4fde8736 P 6a2c895eab0c40d6b22be18ca84fed16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9591e45f9b241f09c8367c42be07b4f in term 1.
I20260709 12:08:18.423977 12615 leader_election.cc:304] T b4669889b41c4e0f8e3e35cd4fde8736 P e9591e45f9b241f09c8367c42be07b4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a2c895eab0c40d6b22be18ca84fed16, e9591e45f9b241f09c8367c42be07b4f; no voters: 034d7c10edb342ab936e590793980fc0
I20260709 12:08:18.425500 12848 raft_consensus.cc:2804] T b4669889b41c4e0f8e3e35cd4fde8736 P e9591e45f9b241f09c8367c42be07b4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:18.426116 12848 raft_consensus.cc:697] T b4669889b41c4e0f8e3e35cd4fde8736 P e9591e45f9b241f09c8367c42be07b4f [term 1 LEADER]: Becoming Leader. State: Replica: e9591e45f9b241f09c8367c42be07b4f, State: Running, Role: LEADER
I20260709 12:08:18.427292 12848 consensus_queue.cc:237] T b4669889b41c4e0f8e3e35cd4fde8736 P e9591e45f9b241f09c8367c42be07b4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:18.431134 12870 raft_consensus.cc:493] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.431726 12870 raft_consensus.cc:515] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:18.434695 12870 leader_election.cc:290] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9591e45f9b241f09c8367c42be07b4f (127.12.56.193:35963), 6a2c895eab0c40d6b22be18ca84fed16 (127.12.56.194:46297)
I20260709 12:08:18.435310 12649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4077af80765d460586125b4f312f5cfb" candidate_uuid: "034d7c10edb342ab936e590793980fc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9591e45f9b241f09c8367c42be07b4f" is_pre_election: true
I20260709 12:08:18.436031 12649 raft_consensus.cc:2468] T 4077af80765d460586125b4f312f5cfb P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 034d7c10edb342ab936e590793980fc0 in term 0.
I20260709 12:08:18.440550 12844 tablet_bootstrap.cc:654] T 5957ce50d01e4214bc908e402a78a32e P 034d7c10edb342ab936e590793980fc0: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.444036 12764 leader_election.cc:304] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 034d7c10edb342ab936e590793980fc0, e9591e45f9b241f09c8367c42be07b4f; no voters: 
I20260709 12:08:18.443995 12845 tablet_bootstrap.cc:492] T 4077af80765d460586125b4f312f5cfb P 6a2c895eab0c40d6b22be18ca84fed16: No bootstrap required, opened a new log
I20260709 12:08:18.445758 12845 ts_tablet_manager.cc:1403] T 4077af80765d460586125b4f312f5cfb P 6a2c895eab0c40d6b22be18ca84fed16: Time spent bootstrapping tablet: real 0.092s	user 0.015s	sys 0.009s
I20260709 12:08:18.446452 12872 raft_consensus.cc:2804] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:18.447119 12872 raft_consensus.cc:493] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:18.447636 12872 raft_consensus.cc:3060] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.447937 12798 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4669889b41c4e0f8e3e35cd4fde8736" candidate_uuid: "6a2c895eab0c40d6b22be18ca84fed16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "034d7c10edb342ab936e590793980fc0" is_pre_election: true
I20260709 12:08:18.450001 12845 raft_consensus.cc:359] T 4077af80765d460586125b4f312f5cfb P 6a2c895eab0c40d6b22be18ca84fed16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
W20260709 12:08:18.450695 12691 leader_election.cc:343] T b4669889b41c4e0f8e3e35cd4fde8736 P 6a2c895eab0c40d6b22be18ca84fed16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 034d7c10edb342ab936e590793980fc0 (127.12.56.195:34109): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:18.452102 12691 leader_election.cc:304] T b4669889b41c4e0f8e3e35cd4fde8736 P 6a2c895eab0c40d6b22be18ca84fed16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a2c895eab0c40d6b22be18ca84fed16; no voters: 034d7c10edb342ab936e590793980fc0, e9591e45f9b241f09c8367c42be07b4f
I20260709 12:08:18.451527 12845 raft_consensus.cc:385] T 4077af80765d460586125b4f312f5cfb P 6a2c895eab0c40d6b22be18ca84fed16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.453377 12845 raft_consensus.cc:740] T 4077af80765d460586125b4f312f5cfb P 6a2c895eab0c40d6b22be18ca84fed16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a2c895eab0c40d6b22be18ca84fed16, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.454030 12856 raft_consensus.cc:2749] T b4669889b41c4e0f8e3e35cd4fde8736 P 6a2c895eab0c40d6b22be18ca84fed16 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:18.446481 12723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4077af80765d460586125b4f312f5cfb" candidate_uuid: "034d7c10edb342ab936e590793980fc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a2c895eab0c40d6b22be18ca84fed16" is_pre_election: true
I20260709 12:08:18.454169 12845 consensus_queue.cc:260] T 4077af80765d460586125b4f312f5cfb P 6a2c895eab0c40d6b22be18ca84fed16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:18.459033 12845 ts_tablet_manager.cc:1434] T 4077af80765d460586125b4f312f5cfb P 6a2c895eab0c40d6b22be18ca84fed16: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:08:18.460673 12845 tablet_bootstrap.cc:492] T 5957ce50d01e4214bc908e402a78a32e P 6a2c895eab0c40d6b22be18ca84fed16: Bootstrap starting.
I20260709 12:08:18.463744 12872 raft_consensus.cc:515] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:18.465221 12844 tablet_bootstrap.cc:492] T 5957ce50d01e4214bc908e402a78a32e P 034d7c10edb342ab936e590793980fc0: No bootstrap required, opened a new log
I20260709 12:08:18.468690 12844 ts_tablet_manager.cc:1403] T 5957ce50d01e4214bc908e402a78a32e P 034d7c10edb342ab936e590793980fc0: Time spent bootstrapping tablet: real 0.093s	user 0.014s	sys 0.006s
I20260709 12:08:18.470961 12649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4077af80765d460586125b4f312f5cfb" candidate_uuid: "034d7c10edb342ab936e590793980fc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9591e45f9b241f09c8367c42be07b4f"
I20260709 12:08:18.471549 12649 raft_consensus.cc:3060] T 4077af80765d460586125b4f312f5cfb P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.470465 12723 raft_consensus.cc:2468] T 4077af80765d460586125b4f312f5cfb P 6a2c895eab0c40d6b22be18ca84fed16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 034d7c10edb342ab936e590793980fc0 in term 0.
I20260709 12:08:18.473929 12872 leader_election.cc:290] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0 [CANDIDATE]: Term 1 election: Requested vote from peers e9591e45f9b241f09c8367c42be07b4f (127.12.56.193:35963), 6a2c895eab0c40d6b22be18ca84fed16 (127.12.56.194:46297)
I20260709 12:08:18.477015 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4077af80765d460586125b4f312f5cfb" candidate_uuid: "034d7c10edb342ab936e590793980fc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a2c895eab0c40d6b22be18ca84fed16"
I20260709 12:08:18.468734 12546 catalog_manager.cc:5697] T d6f93f92c31a40318d4b51b090c5209b P 034d7c10edb342ab936e590793980fc0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 034d7c10edb342ab936e590793980fc0 (127.12.56.195). New cstate: current_term: 1 leader_uuid: "034d7c10edb342ab936e590793980fc0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:18.477937 12724 raft_consensus.cc:3060] T 4077af80765d460586125b4f312f5cfb P 6a2c895eab0c40d6b22be18ca84fed16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.478595 12546 catalog_manager.cc:5697] T 41a081ffb7f74fe598b4689f85e3f19d P 034d7c10edb342ab936e590793980fc0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 034d7c10edb342ab936e590793980fc0 (127.12.56.195). New cstate: current_term: 1 leader_uuid: "034d7c10edb342ab936e590793980fc0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:18.482414 12649 raft_consensus.cc:2468] T 4077af80765d460586125b4f312f5cfb P e9591e45f9b241f09c8367c42be07b4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 034d7c10edb342ab936e590793980fc0 in term 1.
I20260709 12:08:18.482661 12724 raft_consensus.cc:2468] T 4077af80765d460586125b4f312f5cfb P 6a2c895eab0c40d6b22be18ca84fed16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 034d7c10edb342ab936e590793980fc0 in term 1.
I20260709 12:08:18.484052 12764 leader_election.cc:304] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 034d7c10edb342ab936e590793980fc0, 6a2c895eab0c40d6b22be18ca84fed16; no voters: 
I20260709 12:08:18.486938 12845 tablet_bootstrap.cc:654] T 5957ce50d01e4214bc908e402a78a32e P 6a2c895eab0c40d6b22be18ca84fed16: Neither blocks nor log segments found. Creating new log.
W20260709 12:08:18.488780 12595 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:08:18.490881 12844 raft_consensus.cc:359] T 5957ce50d01e4214bc908e402a78a32e P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:18.491591 12844 raft_consensus.cc:385] T 5957ce50d01e4214bc908e402a78a32e P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.491861 12844 raft_consensus.cc:740] T 5957ce50d01e4214bc908e402a78a32e P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 034d7c10edb342ab936e590793980fc0, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.492642 12844 consensus_queue.cc:260] T 5957ce50d01e4214bc908e402a78a32e P 034d7c10edb342ab936e590793980fc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:18.493610 12870 raft_consensus.cc:2804] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:18.494102 12870 raft_consensus.cc:697] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0 [term 1 LEADER]: Becoming Leader. State: Replica: 034d7c10edb342ab936e590793980fc0, State: Running, Role: LEADER
I20260709 12:08:18.494598 12848 consensus_queue.cc:1048] T d8698d4730834dc582e8564c0a98eb86 P e9591e45f9b241f09c8367c42be07b4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:18.494990 12870 consensus_queue.cc:237] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:18.500877 12848 consensus_queue.cc:1048] T d8698d4730834dc582e8564c0a98eb86 P e9591e45f9b241f09c8367c42be07b4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:18.503633 12545 catalog_manager.cc:5697] T b4669889b41c4e0f8e3e35cd4fde8736 P e9591e45f9b241f09c8367c42be07b4f reported cstate change: term changed from 0 to 1, leader changed from <none> to e9591e45f9b241f09c8367c42be07b4f (127.12.56.193). New cstate: current_term: 1 leader_uuid: "e9591e45f9b241f09c8367c42be07b4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:18.505687 12545 catalog_manager.cc:5697] T 155e9b7aa7aa40a587d743d6a30ccf7e P e9591e45f9b241f09c8367c42be07b4f reported cstate change: term changed from 0 to 1, leader changed from <none> to e9591e45f9b241f09c8367c42be07b4f (127.12.56.193). New cstate: current_term: 1 leader_uuid: "e9591e45f9b241f09c8367c42be07b4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:18.514768 12844 ts_tablet_manager.cc:1434] T 5957ce50d01e4214bc908e402a78a32e P 034d7c10edb342ab936e590793980fc0: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.001s
I20260709 12:08:18.516108 12844 tablet_bootstrap.cc:492] T b4669889b41c4e0f8e3e35cd4fde8736 P 034d7c10edb342ab936e590793980fc0: Bootstrap starting.
I20260709 12:08:18.520682 12845 tablet_bootstrap.cc:492] T 5957ce50d01e4214bc908e402a78a32e P 6a2c895eab0c40d6b22be18ca84fed16: No bootstrap required, opened a new log
I20260709 12:08:18.521365 12845 ts_tablet_manager.cc:1403] T 5957ce50d01e4214bc908e402a78a32e P 6a2c895eab0c40d6b22be18ca84fed16: Time spent bootstrapping tablet: real 0.061s	user 0.012s	sys 0.000s
I20260709 12:08:18.525303 12845 raft_consensus.cc:359] T 5957ce50d01e4214bc908e402a78a32e P 6a2c895eab0c40d6b22be18ca84fed16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:18.548956 12845 raft_consensus.cc:385] T 5957ce50d01e4214bc908e402a78a32e P 6a2c895eab0c40d6b22be18ca84fed16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.549384 12845 raft_consensus.cc:740] T 5957ce50d01e4214bc908e402a78a32e P 6a2c895eab0c40d6b22be18ca84fed16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a2c895eab0c40d6b22be18ca84fed16, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.550308 12845 consensus_queue.cc:260] T 5957ce50d01e4214bc908e402a78a32e P 6a2c895eab0c40d6b22be18ca84fed16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:18.551976 12844 tablet_bootstrap.cc:654] T b4669889b41c4e0f8e3e35cd4fde8736 P 034d7c10edb342ab936e590793980fc0: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.555891 12845 ts_tablet_manager.cc:1434] T 5957ce50d01e4214bc908e402a78a32e P 6a2c895eab0c40d6b22be18ca84fed16: Time spent starting tablet: real 0.034s	user 0.003s	sys 0.006s
I20260709 12:08:18.556910 12845 tablet_bootstrap.cc:492] T 6a014226736c4b259b23ca9932bbef77 P 6a2c895eab0c40d6b22be18ca84fed16: Bootstrap starting.
I20260709 12:08:18.552953 12545 catalog_manager.cc:5697] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 034d7c10edb342ab936e590793980fc0 (127.12.56.195). New cstate: current_term: 1 leader_uuid: "034d7c10edb342ab936e590793980fc0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:18.566185 12870 raft_consensus.cc:493] T 5957ce50d01e4214bc908e402a78a32e P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.566509 12844 tablet_bootstrap.cc:492] T b4669889b41c4e0f8e3e35cd4fde8736 P 034d7c10edb342ab936e590793980fc0: No bootstrap required, opened a new log
I20260709 12:08:18.566697 12870 raft_consensus.cc:515] T 5957ce50d01e4214bc908e402a78a32e P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:18.567335 12844 ts_tablet_manager.cc:1403] T b4669889b41c4e0f8e3e35cd4fde8736 P 034d7c10edb342ab936e590793980fc0: Time spent bootstrapping tablet: real 0.052s	user 0.011s	sys 0.002s
I20260709 12:08:18.569149 12870 leader_election.cc:290] T 5957ce50d01e4214bc908e402a78a32e P 034d7c10edb342ab936e590793980fc0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9591e45f9b241f09c8367c42be07b4f (127.12.56.193:35963), 6a2c895eab0c40d6b22be18ca84fed16 (127.12.56.194:46297)
I20260709 12:08:18.570768 12649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5957ce50d01e4214bc908e402a78a32e" candidate_uuid: "034d7c10edb342ab936e590793980fc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9591e45f9b241f09c8367c42be07b4f" is_pre_election: true
I20260709 12:08:18.571431 12649 raft_consensus.cc:2468] T 5957ce50d01e4214bc908e402a78a32e P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 034d7c10edb342ab936e590793980fc0 in term 0.
I20260709 12:08:18.572834 12764 leader_election.cc:304] T 5957ce50d01e4214bc908e402a78a32e P 034d7c10edb342ab936e590793980fc0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 034d7c10edb342ab936e590793980fc0, e9591e45f9b241f09c8367c42be07b4f; no voters: 
I20260709 12:08:18.577009 12845 tablet_bootstrap.cc:654] T 6a014226736c4b259b23ca9932bbef77 P 6a2c895eab0c40d6b22be18ca84fed16: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.581990 12870 raft_consensus.cc:2804] T 5957ce50d01e4214bc908e402a78a32e P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:18.582511 12870 raft_consensus.cc:493] T 5957ce50d01e4214bc908e402a78a32e P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:18.582914 12870 raft_consensus.cc:3060] T 5957ce50d01e4214bc908e402a78a32e P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.583408 12723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5957ce50d01e4214bc908e402a78a32e" candidate_uuid: "034d7c10edb342ab936e590793980fc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a2c895eab0c40d6b22be18ca84fed16" is_pre_election: true
I20260709 12:08:18.584226 12723 raft_consensus.cc:2468] T 5957ce50d01e4214bc908e402a78a32e P 6a2c895eab0c40d6b22be18ca84fed16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 034d7c10edb342ab936e590793980fc0 in term 0.
I20260709 12:08:18.586782 12872 consensus_queue.cc:1048] T efe4e5e9a1b54e3987e81561775a89d6 P 034d7c10edb342ab936e590793980fc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:18.589507 12844 raft_consensus.cc:359] T b4669889b41c4e0f8e3e35cd4fde8736 P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:18.605150 12844 raft_consensus.cc:385] T b4669889b41c4e0f8e3e35cd4fde8736 P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.605490 12844 raft_consensus.cc:740] T b4669889b41c4e0f8e3e35cd4fde8736 P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 034d7c10edb342ab936e590793980fc0, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.606079 12845 tablet_bootstrap.cc:492] T 6a014226736c4b259b23ca9932bbef77 P 6a2c895eab0c40d6b22be18ca84fed16: No bootstrap required, opened a new log
I20260709 12:08:18.606621 12845 ts_tablet_manager.cc:1403] T 6a014226736c4b259b23ca9932bbef77 P 6a2c895eab0c40d6b22be18ca84fed16: Time spent bootstrapping tablet: real 0.050s	user 0.017s	sys 0.016s
I20260709 12:08:18.607976 12844 consensus_queue.cc:260] T b4669889b41c4e0f8e3e35cd4fde8736 P 034d7c10edb342ab936e590793980fc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:18.609566 12845 raft_consensus.cc:359] T 6a014226736c4b259b23ca9932bbef77 P 6a2c895eab0c40d6b22be18ca84fed16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:18.610296 12845 raft_consensus.cc:385] T 6a014226736c4b259b23ca9932bbef77 P 6a2c895eab0c40d6b22be18ca84fed16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.610602 12845 raft_consensus.cc:740] T 6a014226736c4b259b23ca9932bbef77 P 6a2c895eab0c40d6b22be18ca84fed16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a2c895eab0c40d6b22be18ca84fed16, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.611689 12845 consensus_queue.cc:260] T 6a014226736c4b259b23ca9932bbef77 P 6a2c895eab0c40d6b22be18ca84fed16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:18.612970 12870 raft_consensus.cc:515] T 5957ce50d01e4214bc908e402a78a32e P 034d7c10edb342ab936e590793980fc0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:18.613852 12845 ts_tablet_manager.cc:1434] T 6a014226736c4b259b23ca9932bbef77 P 6a2c895eab0c40d6b22be18ca84fed16: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:08:18.614779 12845 tablet_bootstrap.cc:492] T 155e9b7aa7aa40a587d743d6a30ccf7e P 6a2c895eab0c40d6b22be18ca84fed16: Bootstrap starting.
I20260709 12:08:18.615170 12870 leader_election.cc:290] T 5957ce50d01e4214bc908e402a78a32e P 034d7c10edb342ab936e590793980fc0 [CANDIDATE]: Term 1 election: Requested vote from peers e9591e45f9b241f09c8367c42be07b4f (127.12.56.193:35963), 6a2c895eab0c40d6b22be18ca84fed16 (127.12.56.194:46297)
I20260709 12:08:18.616406 12649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5957ce50d01e4214bc908e402a78a32e" candidate_uuid: "034d7c10edb342ab936e590793980fc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9591e45f9b241f09c8367c42be07b4f"
I20260709 12:08:18.616976 12649 raft_consensus.cc:3060] T 5957ce50d01e4214bc908e402a78a32e P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.621150 12845 tablet_bootstrap.cc:654] T 155e9b7aa7aa40a587d743d6a30ccf7e P 6a2c895eab0c40d6b22be18ca84fed16: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.610107 12844 ts_tablet_manager.cc:1434] T b4669889b41c4e0f8e3e35cd4fde8736 P 034d7c10edb342ab936e590793980fc0: Time spent starting tablet: real 0.042s	user 0.005s	sys 0.001s
I20260709 12:08:18.624183 12723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5957ce50d01e4214bc908e402a78a32e" candidate_uuid: "034d7c10edb342ab936e590793980fc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a2c895eab0c40d6b22be18ca84fed16"
I20260709 12:08:18.625236 12723 raft_consensus.cc:3060] T 5957ce50d01e4214bc908e402a78a32e P 6a2c895eab0c40d6b22be18ca84fed16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.627504 12649 raft_consensus.cc:2468] T 5957ce50d01e4214bc908e402a78a32e P e9591e45f9b241f09c8367c42be07b4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 034d7c10edb342ab936e590793980fc0 in term 1.
I20260709 12:08:18.629033 12764 leader_election.cc:304] T 5957ce50d01e4214bc908e402a78a32e P 034d7c10edb342ab936e590793980fc0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 034d7c10edb342ab936e590793980fc0, e9591e45f9b241f09c8367c42be07b4f; no voters: 
I20260709 12:08:18.630332 12870 raft_consensus.cc:2804] T 5957ce50d01e4214bc908e402a78a32e P 034d7c10edb342ab936e590793980fc0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:18.631198 12870 raft_consensus.cc:697] T 5957ce50d01e4214bc908e402a78a32e P 034d7c10edb342ab936e590793980fc0 [term 1 LEADER]: Becoming Leader. State: Replica: 034d7c10edb342ab936e590793980fc0, State: Running, Role: LEADER
I20260709 12:08:18.632194 12870 consensus_queue.cc:237] T 5957ce50d01e4214bc908e402a78a32e P 034d7c10edb342ab936e590793980fc0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:18.660969 12723 raft_consensus.cc:2468] T 5957ce50d01e4214bc908e402a78a32e P 6a2c895eab0c40d6b22be18ca84fed16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 034d7c10edb342ab936e590793980fc0 in term 1.
I20260709 12:08:18.661008 12872 consensus_queue.cc:1048] T efe4e5e9a1b54e3987e81561775a89d6 P 034d7c10edb342ab936e590793980fc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:18.674176 12544 catalog_manager.cc:5697] T 5957ce50d01e4214bc908e402a78a32e P 034d7c10edb342ab936e590793980fc0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 034d7c10edb342ab936e590793980fc0 (127.12.56.195). New cstate: current_term: 1 leader_uuid: "034d7c10edb342ab936e590793980fc0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:18.682797 12845 tablet_bootstrap.cc:492] T 155e9b7aa7aa40a587d743d6a30ccf7e P 6a2c895eab0c40d6b22be18ca84fed16: No bootstrap required, opened a new log
I20260709 12:08:18.683463 12845 ts_tablet_manager.cc:1403] T 155e9b7aa7aa40a587d743d6a30ccf7e P 6a2c895eab0c40d6b22be18ca84fed16: Time spent bootstrapping tablet: real 0.069s	user 0.011s	sys 0.007s
I20260709 12:08:18.687803 12845 raft_consensus.cc:359] T 155e9b7aa7aa40a587d743d6a30ccf7e P 6a2c895eab0c40d6b22be18ca84fed16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:18.691237 12845 raft_consensus.cc:385] T 155e9b7aa7aa40a587d743d6a30ccf7e P 6a2c895eab0c40d6b22be18ca84fed16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.691738 12845 raft_consensus.cc:740] T 155e9b7aa7aa40a587d743d6a30ccf7e P 6a2c895eab0c40d6b22be18ca84fed16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a2c895eab0c40d6b22be18ca84fed16, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.692904 12845 consensus_queue.cc:260] T 155e9b7aa7aa40a587d743d6a30ccf7e P 6a2c895eab0c40d6b22be18ca84fed16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:18.710578 12845 ts_tablet_manager.cc:1434] T 155e9b7aa7aa40a587d743d6a30ccf7e P 6a2c895eab0c40d6b22be18ca84fed16: Time spent starting tablet: real 0.027s	user 0.009s	sys 0.001s
I20260709 12:08:18.740820 12724 raft_consensus.cc:3060] T 155e9b7aa7aa40a587d743d6a30ccf7e P 6a2c895eab0c40d6b22be18ca84fed16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.750615 12848 consensus_queue.cc:1048] T 155e9b7aa7aa40a587d743d6a30ccf7e P e9591e45f9b241f09c8367c42be07b4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:18.751546 12874 consensus_queue.cc:1048] T 155e9b7aa7aa40a587d743d6a30ccf7e P e9591e45f9b241f09c8367c42be07b4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:18.777053 12906 raft_consensus.cc:493] T 6a014226736c4b259b23ca9932bbef77 P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.777618 12906 raft_consensus.cc:515] T 6a014226736c4b259b23ca9932bbef77 P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:18.780112 12906 leader_election.cc:290] T 6a014226736c4b259b23ca9932bbef77 P 034d7c10edb342ab936e590793980fc0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9591e45f9b241f09c8367c42be07b4f (127.12.56.193:35963), 6a2c895eab0c40d6b22be18ca84fed16 (127.12.56.194:46297)
I20260709 12:08:18.780810 12649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a014226736c4b259b23ca9932bbef77" candidate_uuid: "034d7c10edb342ab936e590793980fc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9591e45f9b241f09c8367c42be07b4f" is_pre_election: true
I20260709 12:08:18.781541 12649 raft_consensus.cc:2468] T 6a014226736c4b259b23ca9932bbef77 P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 034d7c10edb342ab936e590793980fc0 in term 0.
I20260709 12:08:18.781673 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a014226736c4b259b23ca9932bbef77" candidate_uuid: "034d7c10edb342ab936e590793980fc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a2c895eab0c40d6b22be18ca84fed16" is_pre_election: true
I20260709 12:08:18.782356 12724 raft_consensus.cc:2468] T 6a014226736c4b259b23ca9932bbef77 P 6a2c895eab0c40d6b22be18ca84fed16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 034d7c10edb342ab936e590793980fc0 in term 0.
I20260709 12:08:18.782804 12856 raft_consensus.cc:493] T 6a014226736c4b259b23ca9932bbef77 P 6a2c895eab0c40d6b22be18ca84fed16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.782850 12764 leader_election.cc:304] T 6a014226736c4b259b23ca9932bbef77 P 034d7c10edb342ab936e590793980fc0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 034d7c10edb342ab936e590793980fc0, e9591e45f9b241f09c8367c42be07b4f; no voters: 
I20260709 12:08:18.783336 12856 raft_consensus.cc:515] T 6a014226736c4b259b23ca9932bbef77 P 6a2c895eab0c40d6b22be18ca84fed16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:18.784276 12906 raft_consensus.cc:2804] T 6a014226736c4b259b23ca9932bbef77 P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:18.784667 12906 raft_consensus.cc:493] T 6a014226736c4b259b23ca9932bbef77 P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:18.784999 12906 raft_consensus.cc:3060] T 6a014226736c4b259b23ca9932bbef77 P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.785532 12856 leader_election.cc:290] T 6a014226736c4b259b23ca9932bbef77 P 6a2c895eab0c40d6b22be18ca84fed16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9591e45f9b241f09c8367c42be07b4f (127.12.56.193:35963), 034d7c10edb342ab936e590793980fc0 (127.12.56.195:34109)
I20260709 12:08:18.786652 12649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a014226736c4b259b23ca9932bbef77" candidate_uuid: "6a2c895eab0c40d6b22be18ca84fed16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9591e45f9b241f09c8367c42be07b4f" is_pre_election: true
I20260709 12:08:18.787298 12649 raft_consensus.cc:2468] T 6a014226736c4b259b23ca9932bbef77 P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a2c895eab0c40d6b22be18ca84fed16 in term 0.
I20260709 12:08:18.787320 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a014226736c4b259b23ca9932bbef77" candidate_uuid: "6a2c895eab0c40d6b22be18ca84fed16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "034d7c10edb342ab936e590793980fc0" is_pre_election: true
I20260709 12:08:18.788905 12690 leader_election.cc:304] T 6a014226736c4b259b23ca9932bbef77 P 6a2c895eab0c40d6b22be18ca84fed16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a2c895eab0c40d6b22be18ca84fed16, e9591e45f9b241f09c8367c42be07b4f; no voters: 
I20260709 12:08:18.789636 12856 raft_consensus.cc:2804] T 6a014226736c4b259b23ca9932bbef77 P 6a2c895eab0c40d6b22be18ca84fed16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:18.790019 12856 raft_consensus.cc:493] T 6a014226736c4b259b23ca9932bbef77 P 6a2c895eab0c40d6b22be18ca84fed16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:18.790326 12856 raft_consensus.cc:3060] T 6a014226736c4b259b23ca9932bbef77 P 6a2c895eab0c40d6b22be18ca84fed16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.794071 12906 raft_consensus.cc:515] T 6a014226736c4b259b23ca9932bbef77 P 034d7c10edb342ab936e590793980fc0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:18.795457 12799 raft_consensus.cc:2393] T 6a014226736c4b259b23ca9932bbef77 P 034d7c10edb342ab936e590793980fc0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6a2c895eab0c40d6b22be18ca84fed16 in current term 1: Already voted for candidate 034d7c10edb342ab936e590793980fc0 in this term.
I20260709 12:08:18.796113 12856 raft_consensus.cc:515] T 6a014226736c4b259b23ca9932bbef77 P 6a2c895eab0c40d6b22be18ca84fed16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:18.797351 12649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a014226736c4b259b23ca9932bbef77" candidate_uuid: "034d7c10edb342ab936e590793980fc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9591e45f9b241f09c8367c42be07b4f"
I20260709 12:08:18.797938 12649 raft_consensus.cc:3060] T 6a014226736c4b259b23ca9932bbef77 P e9591e45f9b241f09c8367c42be07b4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.799542 12650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a014226736c4b259b23ca9932bbef77" candidate_uuid: "6a2c895eab0c40d6b22be18ca84fed16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9591e45f9b241f09c8367c42be07b4f"
I20260709 12:08:18.801661 12856 leader_election.cc:290] T 6a014226736c4b259b23ca9932bbef77 P 6a2c895eab0c40d6b22be18ca84fed16 [CANDIDATE]: Term 1 election: Requested vote from peers e9591e45f9b241f09c8367c42be07b4f (127.12.56.193:35963), 034d7c10edb342ab936e590793980fc0 (127.12.56.195:34109)
I20260709 12:08:18.802883 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a014226736c4b259b23ca9932bbef77" candidate_uuid: "6a2c895eab0c40d6b22be18ca84fed16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "034d7c10edb342ab936e590793980fc0"
I20260709 12:08:18.803725 12799 raft_consensus.cc:2393] T 6a014226736c4b259b23ca9932bbef77 P 034d7c10edb342ab936e590793980fc0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6a2c895eab0c40d6b22be18ca84fed16 in current term 1: Already voted for candidate 034d7c10edb342ab936e590793980fc0 in this term.
I20260709 12:08:18.803894 12853 raft_consensus.cc:493] T b4669889b41c4e0f8e3e35cd4fde8736 P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.804667 12649 raft_consensus.cc:2468] T 6a014226736c4b259b23ca9932bbef77 P e9591e45f9b241f09c8367c42be07b4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 034d7c10edb342ab936e590793980fc0 in term 1.
I20260709 12:08:18.804425 12853 raft_consensus.cc:515] T b4669889b41c4e0f8e3e35cd4fde8736 P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:18.805068 12691 leader_election.cc:304] T 6a014226736c4b259b23ca9932bbef77 P 6a2c895eab0c40d6b22be18ca84fed16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a2c895eab0c40d6b22be18ca84fed16; no voters: 034d7c10edb342ab936e590793980fc0, e9591e45f9b241f09c8367c42be07b4f
I20260709 12:08:18.806260 12856 raft_consensus.cc:2749] T 6a014226736c4b259b23ca9932bbef77 P 6a2c895eab0c40d6b22be18ca84fed16 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:08:18.806926 12853 leader_election.cc:290] T b4669889b41c4e0f8e3e35cd4fde8736 P 034d7c10edb342ab936e590793980fc0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9591e45f9b241f09c8367c42be07b4f (127.12.56.193:35963), 6a2c895eab0c40d6b22be18ca84fed16 (127.12.56.194:46297)
I20260709 12:08:18.808017 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4669889b41c4e0f8e3e35cd4fde8736" candidate_uuid: "034d7c10edb342ab936e590793980fc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a2c895eab0c40d6b22be18ca84fed16" is_pre_election: true
I20260709 12:08:18.808182 12906 leader_election.cc:290] T 6a014226736c4b259b23ca9932bbef77 P 034d7c10edb342ab936e590793980fc0 [CANDIDATE]: Term 1 election: Requested vote from peers e9591e45f9b241f09c8367c42be07b4f (127.12.56.193:35963), 6a2c895eab0c40d6b22be18ca84fed16 (127.12.56.194:46297)
I20260709 12:08:18.808892 12724 raft_consensus.cc:2393] T b4669889b41c4e0f8e3e35cd4fde8736 P 6a2c895eab0c40d6b22be18ca84fed16 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 034d7c10edb342ab936e590793980fc0 in current term 1: Already voted for candidate e9591e45f9b241f09c8367c42be07b4f in this term.
I20260709 12:08:18.809219 12764 leader_election.cc:304] T 6a014226736c4b259b23ca9932bbef77 P 034d7c10edb342ab936e590793980fc0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 034d7c10edb342ab936e590793980fc0, e9591e45f9b241f09c8367c42be07b4f; no voters: 
I20260709 12:08:18.809901 12906 raft_consensus.cc:2804] T 6a014226736c4b259b23ca9932bbef77 P 034d7c10edb342ab936e590793980fc0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:18.808283 12650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4669889b41c4e0f8e3e35cd4fde8736" candidate_uuid: "034d7c10edb342ab936e590793980fc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9591e45f9b241f09c8367c42be07b4f" is_pre_election: true
I20260709 12:08:18.810329 12906 raft_consensus.cc:697] T 6a014226736c4b259b23ca9932bbef77 P 034d7c10edb342ab936e590793980fc0 [term 1 LEADER]: Becoming Leader. State: Replica: 034d7c10edb342ab936e590793980fc0, State: Running, Role: LEADER
I20260709 12:08:18.811110 12906 consensus_queue.cc:237] T 6a014226736c4b259b23ca9932bbef77 P 034d7c10edb342ab936e590793980fc0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:18.811760 12764 leader_election.cc:304] T b4669889b41c4e0f8e3e35cd4fde8736 P 034d7c10edb342ab936e590793980fc0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 034d7c10edb342ab936e590793980fc0; no voters: 6a2c895eab0c40d6b22be18ca84fed16, e9591e45f9b241f09c8367c42be07b4f
I20260709 12:08:18.812079 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a014226736c4b259b23ca9932bbef77" candidate_uuid: "034d7c10edb342ab936e590793980fc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a2c895eab0c40d6b22be18ca84fed16"
I20260709 12:08:18.812753 12853 raft_consensus.cc:3060] T b4669889b41c4e0f8e3e35cd4fde8736 P 034d7c10edb342ab936e590793980fc0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.813192 12724 raft_consensus.cc:2393] T 6a014226736c4b259b23ca9932bbef77 P 6a2c895eab0c40d6b22be18ca84fed16 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 034d7c10edb342ab936e590793980fc0 in current term 1: Already voted for candidate 6a2c895eab0c40d6b22be18ca84fed16 in this term.
I20260709 12:08:18.819446 12853 raft_consensus.cc:2749] T b4669889b41c4e0f8e3e35cd4fde8736 P 034d7c10edb342ab936e590793980fc0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:18.821238 12547 catalog_manager.cc:5697] T 6a014226736c4b259b23ca9932bbef77 P 034d7c10edb342ab936e590793980fc0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 034d7c10edb342ab936e590793980fc0 (127.12.56.195). New cstate: current_term: 1 leader_uuid: "034d7c10edb342ab936e590793980fc0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:18.840488 12853 consensus_queue.cc:1048] T d6f93f92c31a40318d4b51b090c5209b P 034d7c10edb342ab936e590793980fc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:18.851715 12870 consensus_queue.cc:1048] T d6f93f92c31a40318d4b51b090c5209b P 034d7c10edb342ab936e590793980fc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:18.879930 12870 consensus_queue.cc:1048] T 41a081ffb7f74fe598b4689f85e3f19d P 034d7c10edb342ab936e590793980fc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:18.896585 12870 consensus_queue.cc:1048] T 41a081ffb7f74fe598b4689f85e3f19d P 034d7c10edb342ab936e590793980fc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:18.904031 12848 consensus_queue.cc:1048] T b4669889b41c4e0f8e3e35cd4fde8736 P e9591e45f9b241f09c8367c42be07b4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:18.907389 12799 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "efe4e5e9a1b54e3987e81561775a89d6"
dest_uuid: "034d7c10edb342ab936e590793980fc0"
mode: GRACEFUL
new_leader_uuid: "e9591e45f9b241f09c8367c42be07b4f"
 from {username='slave'} at 127.0.0.1:48418
I20260709 12:08:18.908150 12799 raft_consensus.cc:606] T efe4e5e9a1b54e3987e81561775a89d6 P 034d7c10edb342ab936e590793980fc0 [term 1 LEADER]: Received request to transfer leadership to TS e9591e45f9b241f09c8367c42be07b4f
I20260709 12:08:18.918090 12799 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4077af80765d460586125b4f312f5cfb"
dest_uuid: "034d7c10edb342ab936e590793980fc0"
mode: GRACEFUL
new_leader_uuid: "e9591e45f9b241f09c8367c42be07b4f"
 from {username='slave'} at 127.0.0.1:48418
I20260709 12:08:18.919086 12799 raft_consensus.cc:606] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0 [term 1 LEADER]: Received request to transfer leadership to TS e9591e45f9b241f09c8367c42be07b4f
I20260709 12:08:18.936441 12875 consensus_queue.cc:1048] T b4669889b41c4e0f8e3e35cd4fde8736 P e9591e45f9b241f09c8367c42be07b4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:18.941742 12798 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5957ce50d01e4214bc908e402a78a32e"
dest_uuid: "034d7c10edb342ab936e590793980fc0"
mode: GRACEFUL
new_leader_uuid: "e9591e45f9b241f09c8367c42be07b4f"
 from {username='slave'} at 127.0.0.1:48418
I20260709 12:08:18.942587 12798 raft_consensus.cc:606] T 5957ce50d01e4214bc908e402a78a32e P 034d7c10edb342ab936e590793980fc0 [term 1 LEADER]: Received request to transfer leadership to TS e9591e45f9b241f09c8367c42be07b4f
I20260709 12:08:18.965402 12650 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "155e9b7aa7aa40a587d743d6a30ccf7e"
dest_uuid: "e9591e45f9b241f09c8367c42be07b4f"
mode: GRACEFUL
new_leader_uuid: "6a2c895eab0c40d6b22be18ca84fed16"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:08:18.966143 12650 raft_consensus.cc:606] T 155e9b7aa7aa40a587d743d6a30ccf7e P e9591e45f9b241f09c8367c42be07b4f [term 1 LEADER]: Received request to transfer leadership to TS 6a2c895eab0c40d6b22be18ca84fed16
I20260709 12:08:18.972597 12799 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41a081ffb7f74fe598b4689f85e3f19d"
dest_uuid: "034d7c10edb342ab936e590793980fc0"
mode: GRACEFUL
new_leader_uuid: "6a2c895eab0c40d6b22be18ca84fed16"
 from {username='slave'} at 127.0.0.1:48418
I20260709 12:08:18.973269 12799 raft_consensus.cc:606] T 41a081ffb7f74fe598b4689f85e3f19d P 034d7c10edb342ab936e590793980fc0 [term 1 LEADER]: Received request to transfer leadership to TS 6a2c895eab0c40d6b22be18ca84fed16
I20260709 12:08:18.979941 12799 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a014226736c4b259b23ca9932bbef77"
dest_uuid: "034d7c10edb342ab936e590793980fc0"
mode: GRACEFUL
new_leader_uuid: "6a2c895eab0c40d6b22be18ca84fed16"
 from {username='slave'} at 127.0.0.1:48418
I20260709 12:08:18.980548 12799 raft_consensus.cc:606] T 6a014226736c4b259b23ca9932bbef77 P 034d7c10edb342ab936e590793980fc0 [term 1 LEADER]: Received request to transfer leadership to TS 6a2c895eab0c40d6b22be18ca84fed16
I20260709 12:08:18.987008 12650 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4669889b41c4e0f8e3e35cd4fde8736"
dest_uuid: "e9591e45f9b241f09c8367c42be07b4f"
mode: GRACEFUL
new_leader_uuid: "6a2c895eab0c40d6b22be18ca84fed16"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:08:18.987614 12650 raft_consensus.cc:606] T b4669889b41c4e0f8e3e35cd4fde8736 P e9591e45f9b241f09c8367c42be07b4f [term 1 LEADER]: Received request to transfer leadership to TS 6a2c895eab0c40d6b22be18ca84fed16
I20260709 12:08:19.058454 12853 raft_consensus.cc:993] T efe4e5e9a1b54e3987e81561775a89d6 P 034d7c10edb342ab936e590793980fc0: : Instructing follower e9591e45f9b241f09c8367c42be07b4f to start an election
I20260709 12:08:19.059022 12853 raft_consensus.cc:1081] T efe4e5e9a1b54e3987e81561775a89d6 P 034d7c10edb342ab936e590793980fc0 [term 1 LEADER]: Signalling peer e9591e45f9b241f09c8367c42be07b4f to start an election
I20260709 12:08:19.061187 12650 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "efe4e5e9a1b54e3987e81561775a89d6"
dest_uuid: "e9591e45f9b241f09c8367c42be07b4f"
 from {username='slave'} at 127.0.0.1:50106
I20260709 12:08:19.061870 12650 raft_consensus.cc:493] T efe4e5e9a1b54e3987e81561775a89d6 P e9591e45f9b241f09c8367c42be07b4f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:19.062193 12650 raft_consensus.cc:3060] T efe4e5e9a1b54e3987e81561775a89d6 P e9591e45f9b241f09c8367c42be07b4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.066847 12650 raft_consensus.cc:515] T efe4e5e9a1b54e3987e81561775a89d6 P e9591e45f9b241f09c8367c42be07b4f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:19.068789 12650 leader_election.cc:290] T efe4e5e9a1b54e3987e81561775a89d6 P e9591e45f9b241f09c8367c42be07b4f [CANDIDATE]: Term 2 election: Requested vote from peers 6a2c895eab0c40d6b22be18ca84fed16 (127.12.56.194:46297), 034d7c10edb342ab936e590793980fc0 (127.12.56.195:34109)
I20260709 12:08:19.069754 12723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe4e5e9a1b54e3987e81561775a89d6" candidate_uuid: "e9591e45f9b241f09c8367c42be07b4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6a2c895eab0c40d6b22be18ca84fed16"
I20260709 12:08:19.070062 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe4e5e9a1b54e3987e81561775a89d6" candidate_uuid: "e9591e45f9b241f09c8367c42be07b4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "034d7c10edb342ab936e590793980fc0"
I20260709 12:08:19.070405 12723 raft_consensus.cc:3060] T efe4e5e9a1b54e3987e81561775a89d6 P 6a2c895eab0c40d6b22be18ca84fed16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.070708 12799 raft_consensus.cc:3055] T efe4e5e9a1b54e3987e81561775a89d6 P 034d7c10edb342ab936e590793980fc0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:19.071034 12799 raft_consensus.cc:740] T efe4e5e9a1b54e3987e81561775a89d6 P 034d7c10edb342ab936e590793980fc0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 034d7c10edb342ab936e590793980fc0, State: Running, Role: LEADER
I20260709 12:08:19.071919 12799 consensus_queue.cc:260] T efe4e5e9a1b54e3987e81561775a89d6 P 034d7c10edb342ab936e590793980fc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:19.073336 12799 raft_consensus.cc:3060] T efe4e5e9a1b54e3987e81561775a89d6 P 034d7c10edb342ab936e590793980fc0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.077703 12723 raft_consensus.cc:2468] T efe4e5e9a1b54e3987e81561775a89d6 P 6a2c895eab0c40d6b22be18ca84fed16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9591e45f9b241f09c8367c42be07b4f in term 2.
I20260709 12:08:19.079084 12615 leader_election.cc:304] T efe4e5e9a1b54e3987e81561775a89d6 P e9591e45f9b241f09c8367c42be07b4f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a2c895eab0c40d6b22be18ca84fed16, e9591e45f9b241f09c8367c42be07b4f; no voters: 
I20260709 12:08:19.079522 12870 consensus_queue.cc:1048] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:19.080060 12875 raft_consensus.cc:2804] T efe4e5e9a1b54e3987e81561775a89d6 P e9591e45f9b241f09c8367c42be07b4f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:19.080668 12875 raft_consensus.cc:697] T efe4e5e9a1b54e3987e81561775a89d6 P e9591e45f9b241f09c8367c42be07b4f [term 2 LEADER]: Becoming Leader. State: Replica: e9591e45f9b241f09c8367c42be07b4f, State: Running, Role: LEADER
I20260709 12:08:19.080998 12799 raft_consensus.cc:2468] T efe4e5e9a1b54e3987e81561775a89d6 P 034d7c10edb342ab936e590793980fc0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9591e45f9b241f09c8367c42be07b4f in term 2.
I20260709 12:08:19.081650 12875 consensus_queue.cc:237] T efe4e5e9a1b54e3987e81561775a89d6 P e9591e45f9b241f09c8367c42be07b4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:19.089684 12906 raft_consensus.cc:993] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0: : Instructing follower e9591e45f9b241f09c8367c42be07b4f to start an election
I20260709 12:08:19.090368 12906 raft_consensus.cc:1081] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0 [term 1 LEADER]: Signalling peer e9591e45f9b241f09c8367c42be07b4f to start an election
I20260709 12:08:19.098047 12870 consensus_queue.cc:1048] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:19.099961 12650 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4077af80765d460586125b4f312f5cfb"
dest_uuid: "e9591e45f9b241f09c8367c42be07b4f"
 from {username='slave'} at 127.0.0.1:50106
I20260709 12:08:19.100646 12650 raft_consensus.cc:493] T 4077af80765d460586125b4f312f5cfb P e9591e45f9b241f09c8367c42be07b4f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:19.101063 12650 raft_consensus.cc:3060] T 4077af80765d460586125b4f312f5cfb P e9591e45f9b241f09c8367c42be07b4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.100917 12872 consensus_queue.cc:1048] T 5957ce50d01e4214bc908e402a78a32e P 034d7c10edb342ab936e590793980fc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:19.112825 12650 raft_consensus.cc:515] T 4077af80765d460586125b4f312f5cfb P e9591e45f9b241f09c8367c42be07b4f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:19.116351 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4077af80765d460586125b4f312f5cfb" candidate_uuid: "e9591e45f9b241f09c8367c42be07b4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6a2c895eab0c40d6b22be18ca84fed16"
I20260709 12:08:19.116772 12853 raft_consensus.cc:993] T 5957ce50d01e4214bc908e402a78a32e P 034d7c10edb342ab936e590793980fc0: : Instructing follower e9591e45f9b241f09c8367c42be07b4f to start an election
I20260709 12:08:19.117409 12853 raft_consensus.cc:1081] T 5957ce50d01e4214bc908e402a78a32e P 034d7c10edb342ab936e590793980fc0 [term 1 LEADER]: Signalling peer e9591e45f9b241f09c8367c42be07b4f to start an election
I20260709 12:08:19.118929 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4077af80765d460586125b4f312f5cfb" candidate_uuid: "e9591e45f9b241f09c8367c42be07b4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "034d7c10edb342ab936e590793980fc0"
I20260709 12:08:19.119549 12799 raft_consensus.cc:3055] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:19.119894 12799 raft_consensus.cc:740] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 034d7c10edb342ab936e590793980fc0, State: Running, Role: LEADER
I20260709 12:08:19.120679 12799 consensus_queue.cc:260] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:19.121639 12799 raft_consensus.cc:3060] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.123545 12649 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5957ce50d01e4214bc908e402a78a32e"
dest_uuid: "e9591e45f9b241f09c8367c42be07b4f"
 from {username='slave'} at 127.0.0.1:50106
I20260709 12:08:19.124169 12649 raft_consensus.cc:493] T 5957ce50d01e4214bc908e402a78a32e P e9591e45f9b241f09c8367c42be07b4f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:19.124531 12649 raft_consensus.cc:3060] T 5957ce50d01e4214bc908e402a78a32e P e9591e45f9b241f09c8367c42be07b4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.126367 12650 leader_election.cc:290] T 4077af80765d460586125b4f312f5cfb P e9591e45f9b241f09c8367c42be07b4f [CANDIDATE]: Term 2 election: Requested vote from peers 6a2c895eab0c40d6b22be18ca84fed16 (127.12.56.194:46297), 034d7c10edb342ab936e590793980fc0 (127.12.56.195:34109)
I20260709 12:08:19.128724 12906 consensus_queue.cc:1048] T 5957ce50d01e4214bc908e402a78a32e P 034d7c10edb342ab936e590793980fc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:19.129200 12799 raft_consensus.cc:2468] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9591e45f9b241f09c8367c42be07b4f in term 2.
I20260709 12:08:19.130369 12616 leader_election.cc:304] T 4077af80765d460586125b4f312f5cfb P e9591e45f9b241f09c8367c42be07b4f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 034d7c10edb342ab936e590793980fc0, e9591e45f9b241f09c8367c42be07b4f; no voters: 6a2c895eab0c40d6b22be18ca84fed16
I20260709 12:08:19.131152 12875 raft_consensus.cc:2804] T 4077af80765d460586125b4f312f5cfb P e9591e45f9b241f09c8367c42be07b4f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:19.131771 12875 raft_consensus.cc:697] T 4077af80765d460586125b4f312f5cfb P e9591e45f9b241f09c8367c42be07b4f [term 2 LEADER]: Becoming Leader. State: Replica: e9591e45f9b241f09c8367c42be07b4f, State: Running, Role: LEADER
I20260709 12:08:19.132619 12875 consensus_queue.cc:237] T 4077af80765d460586125b4f312f5cfb P e9591e45f9b241f09c8367c42be07b4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:19.113332 12544 catalog_manager.cc:5697] T efe4e5e9a1b54e3987e81561775a89d6 P e9591e45f9b241f09c8367c42be07b4f reported cstate change: term changed from 1 to 2, leader changed from 034d7c10edb342ab936e590793980fc0 (127.12.56.195) to e9591e45f9b241f09c8367c42be07b4f (127.12.56.193). New cstate: current_term: 2 leader_uuid: "e9591e45f9b241f09c8367c42be07b4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:19.154541 12649 raft_consensus.cc:515] T 5957ce50d01e4214bc908e402a78a32e P e9591e45f9b241f09c8367c42be07b4f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:19.156002 12648 raft_consensus.cc:1240] T 5957ce50d01e4214bc908e402a78a32e P e9591e45f9b241f09c8367c42be07b4f [term 2 FOLLOWER]: Rejecting Update request from peer 034d7c10edb342ab936e590793980fc0 for earlier term 1. Current term is 2. Ops: []
I20260709 12:08:19.161314 12906 consensus_queue.cc:1059] T 5957ce50d01e4214bc908e402a78a32e P 034d7c10edb342ab936e590793980fc0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:19.161603 12723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5957ce50d01e4214bc908e402a78a32e" candidate_uuid: "e9591e45f9b241f09c8367c42be07b4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6a2c895eab0c40d6b22be18ca84fed16"
I20260709 12:08:19.162374 12906 raft_consensus.cc:3055] T 5957ce50d01e4214bc908e402a78a32e P 034d7c10edb342ab936e590793980fc0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:19.162428 12723 raft_consensus.cc:3060] T 5957ce50d01e4214bc908e402a78a32e P 6a2c895eab0c40d6b22be18ca84fed16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.162907 12906 raft_consensus.cc:740] T 5957ce50d01e4214bc908e402a78a32e P 034d7c10edb342ab936e590793980fc0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 034d7c10edb342ab936e590793980fc0, State: Running, Role: LEADER
I20260709 12:08:19.164083 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5957ce50d01e4214bc908e402a78a32e" candidate_uuid: "e9591e45f9b241f09c8367c42be07b4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "034d7c10edb342ab936e590793980fc0"
I20260709 12:08:19.163982 12906 consensus_queue.cc:260] T 5957ce50d01e4214bc908e402a78a32e P 034d7c10edb342ab936e590793980fc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:19.164902 12649 leader_election.cc:290] T 5957ce50d01e4214bc908e402a78a32e P e9591e45f9b241f09c8367c42be07b4f [CANDIDATE]: Term 2 election: Requested vote from peers 6a2c895eab0c40d6b22be18ca84fed16 (127.12.56.194:46297), 034d7c10edb342ab936e590793980fc0 (127.12.56.195:34109)
I20260709 12:08:19.165653 12906 raft_consensus.cc:3060] T 5957ce50d01e4214bc908e402a78a32e P 034d7c10edb342ab936e590793980fc0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.173321 12723 raft_consensus.cc:2468] T 5957ce50d01e4214bc908e402a78a32e P 6a2c895eab0c40d6b22be18ca84fed16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9591e45f9b241f09c8367c42be07b4f in term 2.
I20260709 12:08:19.175207 12615 leader_election.cc:304] T 5957ce50d01e4214bc908e402a78a32e P e9591e45f9b241f09c8367c42be07b4f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a2c895eab0c40d6b22be18ca84fed16, e9591e45f9b241f09c8367c42be07b4f; no voters: 
I20260709 12:08:19.176312 12875 raft_consensus.cc:2804] T 5957ce50d01e4214bc908e402a78a32e P e9591e45f9b241f09c8367c42be07b4f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:19.176892 12875 raft_consensus.cc:697] T 5957ce50d01e4214bc908e402a78a32e P e9591e45f9b241f09c8367c42be07b4f [term 2 LEADER]: Becoming Leader. State: Replica: e9591e45f9b241f09c8367c42be07b4f, State: Running, Role: LEADER
I20260709 12:08:19.177868 12875 consensus_queue.cc:237] T 5957ce50d01e4214bc908e402a78a32e P e9591e45f9b241f09c8367c42be07b4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:19.181176 12799 raft_consensus.cc:2468] T 5957ce50d01e4214bc908e402a78a32e P 034d7c10edb342ab936e590793980fc0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9591e45f9b241f09c8367c42be07b4f in term 2.
I20260709 12:08:19.186026 12546 catalog_manager.cc:5697] T 4077af80765d460586125b4f312f5cfb P e9591e45f9b241f09c8367c42be07b4f reported cstate change: term changed from 1 to 2, leader changed from 034d7c10edb342ab936e590793980fc0 (127.12.56.195) to e9591e45f9b241f09c8367c42be07b4f (127.12.56.193). New cstate: current_term: 2 leader_uuid: "e9591e45f9b241f09c8367c42be07b4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:19.201851 12547 catalog_manager.cc:5697] T 5957ce50d01e4214bc908e402a78a32e P e9591e45f9b241f09c8367c42be07b4f reported cstate change: term changed from 1 to 2, leader changed from 034d7c10edb342ab936e590793980fc0 (127.12.56.195) to e9591e45f9b241f09c8367c42be07b4f (127.12.56.193). New cstate: current_term: 2 leader_uuid: "e9591e45f9b241f09c8367c42be07b4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:19.222574 12906 consensus_queue.cc:1048] T 6a014226736c4b259b23ca9932bbef77 P 034d7c10edb342ab936e590793980fc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:19.239264 12853 consensus_queue.cc:1048] T 6a014226736c4b259b23ca9932bbef77 P 034d7c10edb342ab936e590793980fc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:19.247123 12906 raft_consensus.cc:993] T 6a014226736c4b259b23ca9932bbef77 P 034d7c10edb342ab936e590793980fc0: : Instructing follower 6a2c895eab0c40d6b22be18ca84fed16 to start an election
I20260709 12:08:19.247632 12906 raft_consensus.cc:1081] T 6a014226736c4b259b23ca9932bbef77 P 034d7c10edb342ab936e590793980fc0 [term 1 LEADER]: Signalling peer 6a2c895eab0c40d6b22be18ca84fed16 to start an election
I20260709 12:08:19.249161 12723 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a014226736c4b259b23ca9932bbef77"
dest_uuid: "6a2c895eab0c40d6b22be18ca84fed16"
 from {username='slave'} at 127.0.0.1:45060
I20260709 12:08:19.249644 12723 raft_consensus.cc:493] T 6a014226736c4b259b23ca9932bbef77 P 6a2c895eab0c40d6b22be18ca84fed16 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:19.250030 12723 raft_consensus.cc:3060] T 6a014226736c4b259b23ca9932bbef77 P 6a2c895eab0c40d6b22be18ca84fed16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.255544 12723 raft_consensus.cc:515] T 6a014226736c4b259b23ca9932bbef77 P 6a2c895eab0c40d6b22be18ca84fed16 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:19.258478 12649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a014226736c4b259b23ca9932bbef77" candidate_uuid: "6a2c895eab0c40d6b22be18ca84fed16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e9591e45f9b241f09c8367c42be07b4f"
I20260709 12:08:19.258669 12723 leader_election.cc:290] T 6a014226736c4b259b23ca9932bbef77 P 6a2c895eab0c40d6b22be18ca84fed16 [CANDIDATE]: Term 2 election: Requested vote from peers e9591e45f9b241f09c8367c42be07b4f (127.12.56.193:35963), 034d7c10edb342ab936e590793980fc0 (127.12.56.195:34109)
I20260709 12:08:19.259132 12649 raft_consensus.cc:3060] T 6a014226736c4b259b23ca9932bbef77 P e9591e45f9b241f09c8367c42be07b4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.259286 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a014226736c4b259b23ca9932bbef77" candidate_uuid: "6a2c895eab0c40d6b22be18ca84fed16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "034d7c10edb342ab936e590793980fc0"
I20260709 12:08:19.259913 12799 raft_consensus.cc:3055] T 6a014226736c4b259b23ca9932bbef77 P 034d7c10edb342ab936e590793980fc0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:19.260264 12799 raft_consensus.cc:740] T 6a014226736c4b259b23ca9932bbef77 P 034d7c10edb342ab936e590793980fc0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 034d7c10edb342ab936e590793980fc0, State: Running, Role: LEADER
I20260709 12:08:19.260952 12799 consensus_queue.cc:260] T 6a014226736c4b259b23ca9932bbef77 P 034d7c10edb342ab936e590793980fc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:19.261909 12799 raft_consensus.cc:3060] T 6a014226736c4b259b23ca9932bbef77 P 034d7c10edb342ab936e590793980fc0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.266707 12799 raft_consensus.cc:2468] T 6a014226736c4b259b23ca9932bbef77 P 034d7c10edb342ab936e590793980fc0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a2c895eab0c40d6b22be18ca84fed16 in term 2.
I20260709 12:08:19.266707 12649 raft_consensus.cc:2468] T 6a014226736c4b259b23ca9932bbef77 P e9591e45f9b241f09c8367c42be07b4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a2c895eab0c40d6b22be18ca84fed16 in term 2.
I20260709 12:08:19.268191 12691 leader_election.cc:304] T 6a014226736c4b259b23ca9932bbef77 P 6a2c895eab0c40d6b22be18ca84fed16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 034d7c10edb342ab936e590793980fc0, 6a2c895eab0c40d6b22be18ca84fed16; no voters: 
I20260709 12:08:19.269078 12856 raft_consensus.cc:2804] T 6a014226736c4b259b23ca9932bbef77 P 6a2c895eab0c40d6b22be18ca84fed16 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:19.270340 12856 raft_consensus.cc:697] T 6a014226736c4b259b23ca9932bbef77 P 6a2c895eab0c40d6b22be18ca84fed16 [term 2 LEADER]: Becoming Leader. State: Replica: 6a2c895eab0c40d6b22be18ca84fed16, State: Running, Role: LEADER
I20260709 12:08:19.271234 12856 consensus_queue.cc:237] T 6a014226736c4b259b23ca9932bbef77 P 6a2c895eab0c40d6b22be18ca84fed16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:19.278921 12546 catalog_manager.cc:5697] T 6a014226736c4b259b23ca9932bbef77 P 6a2c895eab0c40d6b22be18ca84fed16 reported cstate change: term changed from 1 to 2, leader changed from 034d7c10edb342ab936e590793980fc0 (127.12.56.195) to 6a2c895eab0c40d6b22be18ca84fed16 (127.12.56.194). New cstate: current_term: 2 leader_uuid: "6a2c895eab0c40d6b22be18ca84fed16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:19.359952 12853 raft_consensus.cc:993] T 41a081ffb7f74fe598b4689f85e3f19d P 034d7c10edb342ab936e590793980fc0: : Instructing follower 6a2c895eab0c40d6b22be18ca84fed16 to start an election
I20260709 12:08:19.360479 12906 raft_consensus.cc:1081] T 41a081ffb7f74fe598b4689f85e3f19d P 034d7c10edb342ab936e590793980fc0 [term 1 LEADER]: Signalling peer 6a2c895eab0c40d6b22be18ca84fed16 to start an election
I20260709 12:08:19.362115 12723 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "41a081ffb7f74fe598b4689f85e3f19d"
dest_uuid: "6a2c895eab0c40d6b22be18ca84fed16"
 from {username='slave'} at 127.0.0.1:45060
I20260709 12:08:19.362699 12723 raft_consensus.cc:493] T 41a081ffb7f74fe598b4689f85e3f19d P 6a2c895eab0c40d6b22be18ca84fed16 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:19.363075 12723 raft_consensus.cc:3060] T 41a081ffb7f74fe598b4689f85e3f19d P 6a2c895eab0c40d6b22be18ca84fed16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.369917 12723 raft_consensus.cc:515] T 41a081ffb7f74fe598b4689f85e3f19d P 6a2c895eab0c40d6b22be18ca84fed16 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:19.370738 12874 raft_consensus.cc:993] T 155e9b7aa7aa40a587d743d6a30ccf7e P e9591e45f9b241f09c8367c42be07b4f: : Instructing follower 6a2c895eab0c40d6b22be18ca84fed16 to start an election
I20260709 12:08:19.371271 12875 raft_consensus.cc:1081] T 155e9b7aa7aa40a587d743d6a30ccf7e P e9591e45f9b241f09c8367c42be07b4f [term 1 LEADER]: Signalling peer 6a2c895eab0c40d6b22be18ca84fed16 to start an election
I20260709 12:08:19.371981 12723 leader_election.cc:290] T 41a081ffb7f74fe598b4689f85e3f19d P 6a2c895eab0c40d6b22be18ca84fed16 [CANDIDATE]: Term 2 election: Requested vote from peers e9591e45f9b241f09c8367c42be07b4f (127.12.56.193:35963), 034d7c10edb342ab936e590793980fc0 (127.12.56.195:34109)
I20260709 12:08:19.372903 12649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a081ffb7f74fe598b4689f85e3f19d" candidate_uuid: "6a2c895eab0c40d6b22be18ca84fed16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e9591e45f9b241f09c8367c42be07b4f"
I20260709 12:08:19.373545 12649 raft_consensus.cc:3060] T 41a081ffb7f74fe598b4689f85e3f19d P e9591e45f9b241f09c8367c42be07b4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.374060 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a081ffb7f74fe598b4689f85e3f19d" candidate_uuid: "6a2c895eab0c40d6b22be18ca84fed16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "034d7c10edb342ab936e590793980fc0"
I20260709 12:08:19.374305 12723 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "155e9b7aa7aa40a587d743d6a30ccf7e"
dest_uuid: "6a2c895eab0c40d6b22be18ca84fed16"
 from {username='slave'} at 127.0.0.1:45054
I20260709 12:08:19.374720 12799 raft_consensus.cc:3055] T 41a081ffb7f74fe598b4689f85e3f19d P 034d7c10edb342ab936e590793980fc0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:19.375073 12799 raft_consensus.cc:740] T 41a081ffb7f74fe598b4689f85e3f19d P 034d7c10edb342ab936e590793980fc0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 034d7c10edb342ab936e590793980fc0, State: Running, Role: LEADER
I20260709 12:08:19.375120 12723 raft_consensus.cc:493] T 155e9b7aa7aa40a587d743d6a30ccf7e P 6a2c895eab0c40d6b22be18ca84fed16 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:19.375795 12723 raft_consensus.cc:3060] T 155e9b7aa7aa40a587d743d6a30ccf7e P 6a2c895eab0c40d6b22be18ca84fed16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.375952 12799 consensus_queue.cc:260] T 41a081ffb7f74fe598b4689f85e3f19d P 034d7c10edb342ab936e590793980fc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:19.377282 12799 raft_consensus.cc:3060] T 41a081ffb7f74fe598b4689f85e3f19d P 034d7c10edb342ab936e590793980fc0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.381042 12649 raft_consensus.cc:2468] T 41a081ffb7f74fe598b4689f85e3f19d P e9591e45f9b241f09c8367c42be07b4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a2c895eab0c40d6b22be18ca84fed16 in term 2.
I20260709 12:08:19.382377 12690 leader_election.cc:304] T 41a081ffb7f74fe598b4689f85e3f19d P 6a2c895eab0c40d6b22be18ca84fed16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a2c895eab0c40d6b22be18ca84fed16, e9591e45f9b241f09c8367c42be07b4f; no voters: 
I20260709 12:08:19.383144 12856 raft_consensus.cc:2804] T 41a081ffb7f74fe598b4689f85e3f19d P 6a2c895eab0c40d6b22be18ca84fed16 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:19.383648 12856 raft_consensus.cc:697] T 41a081ffb7f74fe598b4689f85e3f19d P 6a2c895eab0c40d6b22be18ca84fed16 [term 2 LEADER]: Becoming Leader. State: Replica: 6a2c895eab0c40d6b22be18ca84fed16, State: Running, Role: LEADER
I20260709 12:08:19.384483 12856 consensus_queue.cc:237] T 41a081ffb7f74fe598b4689f85e3f19d P 6a2c895eab0c40d6b22be18ca84fed16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:19.387310 12723 raft_consensus.cc:515] T 155e9b7aa7aa40a587d743d6a30ccf7e P 6a2c895eab0c40d6b22be18ca84fed16 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:19.392282 12797 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155e9b7aa7aa40a587d743d6a30ccf7e" candidate_uuid: "6a2c895eab0c40d6b22be18ca84fed16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "034d7c10edb342ab936e590793980fc0"
I20260709 12:08:19.394207 12723 leader_election.cc:290] T 155e9b7aa7aa40a587d743d6a30ccf7e P 6a2c895eab0c40d6b22be18ca84fed16 [CANDIDATE]: Term 2 election: Requested vote from peers e9591e45f9b241f09c8367c42be07b4f (127.12.56.193:35963), 034d7c10edb342ab936e590793980fc0 (127.12.56.195:34109)
I20260709 12:08:19.395911 12799 raft_consensus.cc:2468] T 41a081ffb7f74fe598b4689f85e3f19d P 034d7c10edb342ab936e590793980fc0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a2c895eab0c40d6b22be18ca84fed16 in term 2.
I20260709 12:08:19.398182 12649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155e9b7aa7aa40a587d743d6a30ccf7e" candidate_uuid: "6a2c895eab0c40d6b22be18ca84fed16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e9591e45f9b241f09c8367c42be07b4f"
I20260709 12:08:19.398887 12649 raft_consensus.cc:3055] T 155e9b7aa7aa40a587d743d6a30ccf7e P e9591e45f9b241f09c8367c42be07b4f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:19.399224 12649 raft_consensus.cc:740] T 155e9b7aa7aa40a587d743d6a30ccf7e P e9591e45f9b241f09c8367c42be07b4f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e9591e45f9b241f09c8367c42be07b4f, State: Running, Role: LEADER
I20260709 12:08:19.400008 12649 consensus_queue.cc:260] T 155e9b7aa7aa40a587d743d6a30ccf7e P e9591e45f9b241f09c8367c42be07b4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:19.401273 12649 raft_consensus.cc:3060] T 155e9b7aa7aa40a587d743d6a30ccf7e P e9591e45f9b241f09c8367c42be07b4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.401353 12546 catalog_manager.cc:5697] T 41a081ffb7f74fe598b4689f85e3f19d P 6a2c895eab0c40d6b22be18ca84fed16 reported cstate change: term changed from 1 to 2, leader changed from 034d7c10edb342ab936e590793980fc0 (127.12.56.195) to 6a2c895eab0c40d6b22be18ca84fed16 (127.12.56.194). New cstate: current_term: 2 leader_uuid: "6a2c895eab0c40d6b22be18ca84fed16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:19.408309 12649 raft_consensus.cc:2468] T 155e9b7aa7aa40a587d743d6a30ccf7e P e9591e45f9b241f09c8367c42be07b4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a2c895eab0c40d6b22be18ca84fed16 in term 2.
I20260709 12:08:19.409546 12690 leader_election.cc:304] T 155e9b7aa7aa40a587d743d6a30ccf7e P 6a2c895eab0c40d6b22be18ca84fed16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a2c895eab0c40d6b22be18ca84fed16, e9591e45f9b241f09c8367c42be07b4f; no voters: 034d7c10edb342ab936e590793980fc0
I20260709 12:08:19.410375 12856 raft_consensus.cc:2804] T 155e9b7aa7aa40a587d743d6a30ccf7e P 6a2c895eab0c40d6b22be18ca84fed16 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:19.411780 12856 raft_consensus.cc:697] T 155e9b7aa7aa40a587d743d6a30ccf7e P 6a2c895eab0c40d6b22be18ca84fed16 [term 2 LEADER]: Becoming Leader. State: Replica: 6a2c895eab0c40d6b22be18ca84fed16, State: Running, Role: LEADER
I20260709 12:08:19.412623 12856 consensus_queue.cc:237] T 155e9b7aa7aa40a587d743d6a30ccf7e P 6a2c895eab0c40d6b22be18ca84fed16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:19.413110 12874 raft_consensus.cc:993] T b4669889b41c4e0f8e3e35cd4fde8736 P e9591e45f9b241f09c8367c42be07b4f: : Instructing follower 6a2c895eab0c40d6b22be18ca84fed16 to start an election
I20260709 12:08:19.413638 12875 raft_consensus.cc:1081] T b4669889b41c4e0f8e3e35cd4fde8736 P e9591e45f9b241f09c8367c42be07b4f [term 1 LEADER]: Signalling peer 6a2c895eab0c40d6b22be18ca84fed16 to start an election
I20260709 12:08:19.415403 12723 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b4669889b41c4e0f8e3e35cd4fde8736"
dest_uuid: "6a2c895eab0c40d6b22be18ca84fed16"
 from {username='slave'} at 127.0.0.1:45054
I20260709 12:08:19.417701 12723 raft_consensus.cc:493] T b4669889b41c4e0f8e3e35cd4fde8736 P 6a2c895eab0c40d6b22be18ca84fed16 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:19.418179 12723 raft_consensus.cc:3060] T b4669889b41c4e0f8e3e35cd4fde8736 P 6a2c895eab0c40d6b22be18ca84fed16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.420312 12546 catalog_manager.cc:5697] T 155e9b7aa7aa40a587d743d6a30ccf7e P 6a2c895eab0c40d6b22be18ca84fed16 reported cstate change: term changed from 1 to 2, leader changed from e9591e45f9b241f09c8367c42be07b4f (127.12.56.193) to 6a2c895eab0c40d6b22be18ca84fed16 (127.12.56.194). New cstate: current_term: 2 leader_uuid: "6a2c895eab0c40d6b22be18ca84fed16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:19.424641 12723 raft_consensus.cc:515] T b4669889b41c4e0f8e3e35cd4fde8736 P 6a2c895eab0c40d6b22be18ca84fed16 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:19.427853 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4669889b41c4e0f8e3e35cd4fde8736" candidate_uuid: "6a2c895eab0c40d6b22be18ca84fed16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "034d7c10edb342ab936e590793980fc0"
I20260709 12:08:19.428478 12799 raft_consensus.cc:3060] T b4669889b41c4e0f8e3e35cd4fde8736 P 034d7c10edb342ab936e590793980fc0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.429124 12723 leader_election.cc:290] T b4669889b41c4e0f8e3e35cd4fde8736 P 6a2c895eab0c40d6b22be18ca84fed16 [CANDIDATE]: Term 2 election: Requested vote from peers e9591e45f9b241f09c8367c42be07b4f (127.12.56.193:35963), 034d7c10edb342ab936e590793980fc0 (127.12.56.195:34109)
I20260709 12:08:19.430437 12649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4669889b41c4e0f8e3e35cd4fde8736" candidate_uuid: "6a2c895eab0c40d6b22be18ca84fed16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e9591e45f9b241f09c8367c42be07b4f"
I20260709 12:08:19.431116 12649 raft_consensus.cc:3055] T b4669889b41c4e0f8e3e35cd4fde8736 P e9591e45f9b241f09c8367c42be07b4f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:19.431546 12649 raft_consensus.cc:740] T b4669889b41c4e0f8e3e35cd4fde8736 P e9591e45f9b241f09c8367c42be07b4f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e9591e45f9b241f09c8367c42be07b4f, State: Running, Role: LEADER
I20260709 12:08:19.433013 12649 consensus_queue.cc:260] T b4669889b41c4e0f8e3e35cd4fde8736 P e9591e45f9b241f09c8367c42be07b4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:19.434051 12649 raft_consensus.cc:3060] T b4669889b41c4e0f8e3e35cd4fde8736 P e9591e45f9b241f09c8367c42be07b4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.435623 12799 raft_consensus.cc:2468] T b4669889b41c4e0f8e3e35cd4fde8736 P 034d7c10edb342ab936e590793980fc0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a2c895eab0c40d6b22be18ca84fed16 in term 2.
I20260709 12:08:19.436820 12691 leader_election.cc:304] T b4669889b41c4e0f8e3e35cd4fde8736 P 6a2c895eab0c40d6b22be18ca84fed16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 034d7c10edb342ab936e590793980fc0, 6a2c895eab0c40d6b22be18ca84fed16; no voters: 
I20260709 12:08:19.437661 12856 raft_consensus.cc:2804] T b4669889b41c4e0f8e3e35cd4fde8736 P 6a2c895eab0c40d6b22be18ca84fed16 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:19.438993 12856 raft_consensus.cc:697] T b4669889b41c4e0f8e3e35cd4fde8736 P 6a2c895eab0c40d6b22be18ca84fed16 [term 2 LEADER]: Becoming Leader. State: Replica: 6a2c895eab0c40d6b22be18ca84fed16, State: Running, Role: LEADER
I20260709 12:08:19.439749 12649 raft_consensus.cc:2468] T b4669889b41c4e0f8e3e35cd4fde8736 P e9591e45f9b241f09c8367c42be07b4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a2c895eab0c40d6b22be18ca84fed16 in term 2.
I20260709 12:08:19.439955 12856 consensus_queue.cc:237] T b4669889b41c4e0f8e3e35cd4fde8736 P 6a2c895eab0c40d6b22be18ca84fed16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:19.447623 12546 catalog_manager.cc:5697] T b4669889b41c4e0f8e3e35cd4fde8736 P 6a2c895eab0c40d6b22be18ca84fed16 reported cstate change: term changed from 1 to 2, leader changed from e9591e45f9b241f09c8367c42be07b4f (127.12.56.193) to 6a2c895eab0c40d6b22be18ca84fed16 (127.12.56.194). New cstate: current_term: 2 leader_uuid: "6a2c895eab0c40d6b22be18ca84fed16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:19.542652 12799 raft_consensus.cc:1275] T efe4e5e9a1b54e3987e81561775a89d6 P 034d7c10edb342ab936e590793980fc0 [term 2 FOLLOWER]: Refusing update from remote peer e9591e45f9b241f09c8367c42be07b4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:19.544633 12875 consensus_queue.cc:1048] T efe4e5e9a1b54e3987e81561775a89d6 P e9591e45f9b241f09c8367c42be07b4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:19.545452 12723 raft_consensus.cc:1275] T efe4e5e9a1b54e3987e81561775a89d6 P 6a2c895eab0c40d6b22be18ca84fed16 [term 2 FOLLOWER]: Refusing update from remote peer e9591e45f9b241f09c8367c42be07b4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:19.547170 12875 consensus_queue.cc:1048] T efe4e5e9a1b54e3987e81561775a89d6 P e9591e45f9b241f09c8367c42be07b4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:19.578258 12799 raft_consensus.cc:1275] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0 [term 2 FOLLOWER]: Refusing update from remote peer e9591e45f9b241f09c8367c42be07b4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:19.579634 12875 consensus_queue.cc:1048] T 4077af80765d460586125b4f312f5cfb P e9591e45f9b241f09c8367c42be07b4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:19.588850 12723 raft_consensus.cc:3060] T 4077af80765d460586125b4f312f5cfb P 6a2c895eab0c40d6b22be18ca84fed16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.632337 12723 raft_consensus.cc:1275] T 4077af80765d460586125b4f312f5cfb P 6a2c895eab0c40d6b22be18ca84fed16 [term 2 FOLLOWER]: Refusing update from remote peer e9591e45f9b241f09c8367c42be07b4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:19.634065 12926 consensus_queue.cc:1048] T 4077af80765d460586125b4f312f5cfb P e9591e45f9b241f09c8367c42be07b4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:19.653573 12723 raft_consensus.cc:1275] T 5957ce50d01e4214bc908e402a78a32e P 6a2c895eab0c40d6b22be18ca84fed16 [term 2 FOLLOWER]: Refusing update from remote peer e9591e45f9b241f09c8367c42be07b4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:19.655001 12926 consensus_queue.cc:1048] T 5957ce50d01e4214bc908e402a78a32e P e9591e45f9b241f09c8367c42be07b4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:19.664053 12799 raft_consensus.cc:1275] T 5957ce50d01e4214bc908e402a78a32e P 034d7c10edb342ab936e590793980fc0 [term 2 FOLLOWER]: Refusing update from remote peer e9591e45f9b241f09c8367c42be07b4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:19.667049 12649 raft_consensus.cc:1275] T 6a014226736c4b259b23ca9932bbef77 P e9591e45f9b241f09c8367c42be07b4f [term 2 FOLLOWER]: Refusing update from remote peer 6a2c895eab0c40d6b22be18ca84fed16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:19.668274 12926 consensus_queue.cc:1048] T 5957ce50d01e4214bc908e402a78a32e P e9591e45f9b241f09c8367c42be07b4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:19.668581 12856 consensus_queue.cc:1048] T 6a014226736c4b259b23ca9932bbef77 P 6a2c895eab0c40d6b22be18ca84fed16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:19.684125 12799 raft_consensus.cc:1275] T 6a014226736c4b259b23ca9932bbef77 P 034d7c10edb342ab936e590793980fc0 [term 2 FOLLOWER]: Refusing update from remote peer 6a2c895eab0c40d6b22be18ca84fed16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:19.685861 12856 consensus_queue.cc:1048] T 6a014226736c4b259b23ca9932bbef77 P 6a2c895eab0c40d6b22be18ca84fed16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:19.804759 12799 raft_consensus.cc:1275] T 41a081ffb7f74fe598b4689f85e3f19d P 034d7c10edb342ab936e590793980fc0 [term 2 FOLLOWER]: Refusing update from remote peer 6a2c895eab0c40d6b22be18ca84fed16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:19.806177 12856 consensus_queue.cc:1048] T 41a081ffb7f74fe598b4689f85e3f19d P 6a2c895eab0c40d6b22be18ca84fed16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:19.812266 12649 raft_consensus.cc:1275] T 155e9b7aa7aa40a587d743d6a30ccf7e P e9591e45f9b241f09c8367c42be07b4f [term 2 FOLLOWER]: Refusing update from remote peer 6a2c895eab0c40d6b22be18ca84fed16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:19.814780 12925 consensus_queue.cc:1048] T 155e9b7aa7aa40a587d743d6a30ccf7e P 6a2c895eab0c40d6b22be18ca84fed16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:19.817137 12649 raft_consensus.cc:1275] T 41a081ffb7f74fe598b4689f85e3f19d P e9591e45f9b241f09c8367c42be07b4f [term 2 FOLLOWER]: Refusing update from remote peer 6a2c895eab0c40d6b22be18ca84fed16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:19.818789 12927 consensus_queue.cc:1048] T 41a081ffb7f74fe598b4689f85e3f19d P 6a2c895eab0c40d6b22be18ca84fed16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:19.828040 12799 raft_consensus.cc:3060] T 155e9b7aa7aa40a587d743d6a30ccf7e P 034d7c10edb342ab936e590793980fc0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.869762 12799 raft_consensus.cc:1275] T 155e9b7aa7aa40a587d743d6a30ccf7e P 034d7c10edb342ab936e590793980fc0 [term 2 FOLLOWER]: Refusing update from remote peer 6a2c895eab0c40d6b22be18ca84fed16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:19.871568 12929 consensus_queue.cc:1048] T 155e9b7aa7aa40a587d743d6a30ccf7e P 6a2c895eab0c40d6b22be18ca84fed16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:08:19.948976 12648 raft_consensus.cc:1275] T b4669889b41c4e0f8e3e35cd4fde8736 P e9591e45f9b241f09c8367c42be07b4f [term 2 FOLLOWER]: Refusing update from remote peer 6a2c895eab0c40d6b22be18ca84fed16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:19.950688 12929 consensus_queue.cc:1048] T b4669889b41c4e0f8e3e35cd4fde8736 P 6a2c895eab0c40d6b22be18ca84fed16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:19.961082 12799 raft_consensus.cc:1275] T b4669889b41c4e0f8e3e35cd4fde8736 P 034d7c10edb342ab936e590793980fc0 [term 2 FOLLOWER]: Refusing update from remote peer 6a2c895eab0c40d6b22be18ca84fed16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:19.962580 12925 consensus_queue.cc:1048] T b4669889b41c4e0f8e3e35cd4fde8736 P 6a2c895eab0c40d6b22be18ca84fed16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:22.027405 12515 auto_leader_rebalancer-test.cc:294] The leader distribution is 
I20260709 12:08:22.028205 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:22.052815 12723 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "155e9b7aa7aa40a587d743d6a30ccf7e"
dest_uuid: "6a2c895eab0c40d6b22be18ca84fed16"
mode: GRACEFUL
new_leader_uuid: "034d7c10edb342ab936e590793980fc0"
 from {username='slave'} at 127.0.0.1:56590
I20260709 12:08:22.053686 12723 raft_consensus.cc:606] T 155e9b7aa7aa40a587d743d6a30ccf7e P 6a2c895eab0c40d6b22be18ca84fed16 [term 2 LEADER]: Received request to transfer leadership to TS 034d7c10edb342ab936e590793980fc0
I20260709 12:08:22.066951 12649 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4077af80765d460586125b4f312f5cfb"
dest_uuid: "e9591e45f9b241f09c8367c42be07b4f"
mode: GRACEFUL
new_leader_uuid: "034d7c10edb342ab936e590793980fc0"
 from {username='slave'} at 127.0.0.1:33692
I20260709 12:08:22.067660 12649 raft_consensus.cc:606] T 4077af80765d460586125b4f312f5cfb P e9591e45f9b241f09c8367c42be07b4f [term 2 LEADER]: Received request to transfer leadership to TS 034d7c10edb342ab936e590793980fc0
I20260709 12:08:22.068940 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:08:22.069391 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:22.300046 12938 raft_consensus.cc:993] T 4077af80765d460586125b4f312f5cfb P e9591e45f9b241f09c8367c42be07b4f: : Instructing follower 034d7c10edb342ab936e590793980fc0 to start an election
I20260709 12:08:22.300493 12934 raft_consensus.cc:1081] T 4077af80765d460586125b4f312f5cfb P e9591e45f9b241f09c8367c42be07b4f [term 2 LEADER]: Signalling peer 034d7c10edb342ab936e590793980fc0 to start an election
I20260709 12:08:22.302163 12797 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4077af80765d460586125b4f312f5cfb"
dest_uuid: "034d7c10edb342ab936e590793980fc0"
 from {username='slave'} at 127.0.0.1:48400
I20260709 12:08:22.302783 12797 raft_consensus.cc:493] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:22.303123 12797 raft_consensus.cc:3060] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:22.308531 12797 raft_consensus.cc:515] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:22.310439 12797 leader_election.cc:290] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0 [CANDIDATE]: Term 3 election: Requested vote from peers e9591e45f9b241f09c8367c42be07b4f (127.12.56.193:35963), 6a2c895eab0c40d6b22be18ca84fed16 (127.12.56.194:46297)
I20260709 12:08:22.311420 12649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4077af80765d460586125b4f312f5cfb" candidate_uuid: "034d7c10edb342ab936e590793980fc0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e9591e45f9b241f09c8367c42be07b4f"
I20260709 12:08:22.311828 12723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4077af80765d460586125b4f312f5cfb" candidate_uuid: "034d7c10edb342ab936e590793980fc0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6a2c895eab0c40d6b22be18ca84fed16"
I20260709 12:08:22.312083 12649 raft_consensus.cc:3055] T 4077af80765d460586125b4f312f5cfb P e9591e45f9b241f09c8367c42be07b4f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:22.312443 12649 raft_consensus.cc:740] T 4077af80765d460586125b4f312f5cfb P e9591e45f9b241f09c8367c42be07b4f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e9591e45f9b241f09c8367c42be07b4f, State: Running, Role: LEADER
I20260709 12:08:22.312439 12723 raft_consensus.cc:3060] T 4077af80765d460586125b4f312f5cfb P 6a2c895eab0c40d6b22be18ca84fed16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:22.313274 12649 consensus_queue.cc:260] T 4077af80765d460586125b4f312f5cfb P e9591e45f9b241f09c8367c42be07b4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:22.314431 12649 raft_consensus.cc:3060] T 4077af80765d460586125b4f312f5cfb P e9591e45f9b241f09c8367c42be07b4f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:22.317656 12723 raft_consensus.cc:2468] T 4077af80765d460586125b4f312f5cfb P 6a2c895eab0c40d6b22be18ca84fed16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 034d7c10edb342ab936e590793980fc0 in term 3.
I20260709 12:08:22.318903 12764 leader_election.cc:304] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 034d7c10edb342ab936e590793980fc0, 6a2c895eab0c40d6b22be18ca84fed16; no voters: 
I20260709 12:08:22.319895 12853 raft_consensus.cc:2804] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:22.320943 12649 raft_consensus.cc:2468] T 4077af80765d460586125b4f312f5cfb P e9591e45f9b241f09c8367c42be07b4f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 034d7c10edb342ab936e590793980fc0 in term 3.
I20260709 12:08:22.321166 12853 raft_consensus.cc:697] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0 [term 3 LEADER]: Becoming Leader. State: Replica: 034d7c10edb342ab936e590793980fc0, State: Running, Role: LEADER
I20260709 12:08:22.322139 12853 consensus_queue.cc:237] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:22.331540 12546 catalog_manager.cc:5697] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0 reported cstate change: term changed from 2 to 3, leader changed from e9591e45f9b241f09c8367c42be07b4f (127.12.56.193) to 034d7c10edb342ab936e590793980fc0 (127.12.56.195). New cstate: current_term: 3 leader_uuid: "034d7c10edb342ab936e590793980fc0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:22.454444 12945 raft_consensus.cc:993] T 155e9b7aa7aa40a587d743d6a30ccf7e P 6a2c895eab0c40d6b22be18ca84fed16: : Instructing follower 034d7c10edb342ab936e590793980fc0 to start an election
I20260709 12:08:22.454969 12929 raft_consensus.cc:1081] T 155e9b7aa7aa40a587d743d6a30ccf7e P 6a2c895eab0c40d6b22be18ca84fed16 [term 2 LEADER]: Signalling peer 034d7c10edb342ab936e590793980fc0 to start an election
I20260709 12:08:22.456923 12797 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "155e9b7aa7aa40a587d743d6a30ccf7e"
dest_uuid: "034d7c10edb342ab936e590793980fc0"
 from {username='slave'} at 127.0.0.1:48416
I20260709 12:08:22.457564 12797 raft_consensus.cc:493] T 155e9b7aa7aa40a587d743d6a30ccf7e P 034d7c10edb342ab936e590793980fc0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:22.458024 12797 raft_consensus.cc:3060] T 155e9b7aa7aa40a587d743d6a30ccf7e P 034d7c10edb342ab936e590793980fc0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:22.464311 12797 raft_consensus.cc:515] T 155e9b7aa7aa40a587d743d6a30ccf7e P 034d7c10edb342ab936e590793980fc0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:22.466060 12797 leader_election.cc:290] T 155e9b7aa7aa40a587d743d6a30ccf7e P 034d7c10edb342ab936e590793980fc0 [CANDIDATE]: Term 3 election: Requested vote from peers e9591e45f9b241f09c8367c42be07b4f (127.12.56.193:35963), 6a2c895eab0c40d6b22be18ca84fed16 (127.12.56.194:46297)
I20260709 12:08:22.467155 12649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155e9b7aa7aa40a587d743d6a30ccf7e" candidate_uuid: "034d7c10edb342ab936e590793980fc0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e9591e45f9b241f09c8367c42be07b4f"
I20260709 12:08:22.467432 12723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155e9b7aa7aa40a587d743d6a30ccf7e" candidate_uuid: "034d7c10edb342ab936e590793980fc0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6a2c895eab0c40d6b22be18ca84fed16"
I20260709 12:08:22.467672 12649 raft_consensus.cc:3060] T 155e9b7aa7aa40a587d743d6a30ccf7e P e9591e45f9b241f09c8367c42be07b4f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:22.468027 12723 raft_consensus.cc:3055] T 155e9b7aa7aa40a587d743d6a30ccf7e P 6a2c895eab0c40d6b22be18ca84fed16 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:22.468317 12723 raft_consensus.cc:740] T 155e9b7aa7aa40a587d743d6a30ccf7e P 6a2c895eab0c40d6b22be18ca84fed16 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6a2c895eab0c40d6b22be18ca84fed16, State: Running, Role: LEADER
I20260709 12:08:22.468950 12723 consensus_queue.cc:260] T 155e9b7aa7aa40a587d743d6a30ccf7e P 6a2c895eab0c40d6b22be18ca84fed16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:22.469925 12723 raft_consensus.cc:3060] T 155e9b7aa7aa40a587d743d6a30ccf7e P 6a2c895eab0c40d6b22be18ca84fed16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:22.472440 12649 raft_consensus.cc:2468] T 155e9b7aa7aa40a587d743d6a30ccf7e P e9591e45f9b241f09c8367c42be07b4f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 034d7c10edb342ab936e590793980fc0 in term 3.
I20260709 12:08:22.473819 12764 leader_election.cc:304] T 155e9b7aa7aa40a587d743d6a30ccf7e P 034d7c10edb342ab936e590793980fc0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 034d7c10edb342ab936e590793980fc0, e9591e45f9b241f09c8367c42be07b4f; no voters: 
I20260709 12:08:22.474709 12853 raft_consensus.cc:2804] T 155e9b7aa7aa40a587d743d6a30ccf7e P 034d7c10edb342ab936e590793980fc0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:22.474624 12723 raft_consensus.cc:2468] T 155e9b7aa7aa40a587d743d6a30ccf7e P 6a2c895eab0c40d6b22be18ca84fed16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 034d7c10edb342ab936e590793980fc0 in term 3.
I20260709 12:08:22.475330 12853 raft_consensus.cc:697] T 155e9b7aa7aa40a587d743d6a30ccf7e P 034d7c10edb342ab936e590793980fc0 [term 3 LEADER]: Becoming Leader. State: Replica: 034d7c10edb342ab936e590793980fc0, State: Running, Role: LEADER
I20260709 12:08:22.476275 12853 consensus_queue.cc:237] T 155e9b7aa7aa40a587d743d6a30ccf7e P 034d7c10edb342ab936e590793980fc0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:22.483999 12546 catalog_manager.cc:5697] T 155e9b7aa7aa40a587d743d6a30ccf7e P 034d7c10edb342ab936e590793980fc0 reported cstate change: term changed from 2 to 3, leader changed from 6a2c895eab0c40d6b22be18ca84fed16 (127.12.56.194) to 034d7c10edb342ab936e590793980fc0 (127.12.56.195). New cstate: current_term: 3 leader_uuid: "034d7c10edb342ab936e590793980fc0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:22.724733 12649 raft_consensus.cc:1275] T 4077af80765d460586125b4f312f5cfb P e9591e45f9b241f09c8367c42be07b4f [term 3 FOLLOWER]: Refusing update from remote peer 034d7c10edb342ab936e590793980fc0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:22.726387 12853 consensus_queue.cc:1048] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:22.737037 12723 raft_consensus.cc:1275] T 4077af80765d460586125b4f312f5cfb P 6a2c895eab0c40d6b22be18ca84fed16 [term 3 FOLLOWER]: Refusing update from remote peer 034d7c10edb342ab936e590793980fc0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:22.739768 12939 consensus_queue.cc:1048] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:22.978220 12723 raft_consensus.cc:1275] T 155e9b7aa7aa40a587d743d6a30ccf7e P 6a2c895eab0c40d6b22be18ca84fed16 [term 3 FOLLOWER]: Refusing update from remote peer 034d7c10edb342ab936e590793980fc0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:22.979579 12939 consensus_queue.cc:1048] T 155e9b7aa7aa40a587d743d6a30ccf7e P 034d7c10edb342ab936e590793980fc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:22.989604 12649 raft_consensus.cc:1275] T 155e9b7aa7aa40a587d743d6a30ccf7e P e9591e45f9b241f09c8367c42be07b4f [term 3 FOLLOWER]: Refusing update from remote peer 034d7c10edb342ab936e590793980fc0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:22.991358 12953 consensus_queue.cc:1048] T 155e9b7aa7aa40a587d743d6a30ccf7e P 034d7c10edb342ab936e590793980fc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:08:23.070515 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:23.076961 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:23.077419 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:24.078640 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:24.087026 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:24.087477 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:25.088740 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:25.096131 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:25.096798 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:26.098407 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:26.103770 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:26.104291 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:27.105276 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:27.110220 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:27.110720 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:28.111748 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:28.117143 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:28.117640 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:29.119100 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:29.124939 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:29.125628 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:30.126674 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:30.132867 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:30.133368 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:31.134420 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:31.139303 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:31.139777 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:32.172284 12515 auto_leader_rebalancer-test.cc:313] The leader distribution is 
I20260709 12:08:32.177587 12649 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8698d4730834dc582e8564c0a98eb86"
dest_uuid: "e9591e45f9b241f09c8367c42be07b4f"
mode: GRACEFUL
new_leader_uuid: "6a2c895eab0c40d6b22be18ca84fed16"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:08:32.178335 12649 raft_consensus.cc:606] T d8698d4730834dc582e8564c0a98eb86 P e9591e45f9b241f09c8367c42be07b4f [term 1 LEADER]: Received request to transfer leadership to TS 6a2c895eab0c40d6b22be18ca84fed16
I20260709 12:08:32.184289 12649 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "efe4e5e9a1b54e3987e81561775a89d6"
dest_uuid: "e9591e45f9b241f09c8367c42be07b4f"
mode: GRACEFUL
new_leader_uuid: "6a2c895eab0c40d6b22be18ca84fed16"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:08:32.184882 12649 raft_consensus.cc:606] T efe4e5e9a1b54e3987e81561775a89d6 P e9591e45f9b241f09c8367c42be07b4f [term 2 LEADER]: Received request to transfer leadership to TS 6a2c895eab0c40d6b22be18ca84fed16
I20260709 12:08:32.190444 12799 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4077af80765d460586125b4f312f5cfb"
dest_uuid: "034d7c10edb342ab936e590793980fc0"
mode: GRACEFUL
new_leader_uuid: "6a2c895eab0c40d6b22be18ca84fed16"
 from {username='slave'} at 127.0.0.1:48418
I20260709 12:08:32.190905 12799 raft_consensus.cc:606] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0 [term 3 LEADER]: Received request to transfer leadership to TS 6a2c895eab0c40d6b22be18ca84fed16
I20260709 12:08:32.196488 12649 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5957ce50d01e4214bc908e402a78a32e"
dest_uuid: "e9591e45f9b241f09c8367c42be07b4f"
mode: GRACEFUL
new_leader_uuid: "6a2c895eab0c40d6b22be18ca84fed16"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:08:32.197080 12649 raft_consensus.cc:606] T 5957ce50d01e4214bc908e402a78a32e P e9591e45f9b241f09c8367c42be07b4f [term 2 LEADER]: Received request to transfer leadership to TS 6a2c895eab0c40d6b22be18ca84fed16
I20260709 12:08:32.202445 12799 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "155e9b7aa7aa40a587d743d6a30ccf7e"
dest_uuid: "034d7c10edb342ab936e590793980fc0"
mode: GRACEFUL
new_leader_uuid: "6a2c895eab0c40d6b22be18ca84fed16"
 from {username='slave'} at 127.0.0.1:48418
I20260709 12:08:32.203002 12799 raft_consensus.cc:606] T 155e9b7aa7aa40a587d743d6a30ccf7e P 034d7c10edb342ab936e590793980fc0 [term 3 LEADER]: Received request to transfer leadership to TS 6a2c895eab0c40d6b22be18ca84fed16
I20260709 12:08:32.319167 12953 raft_consensus.cc:993] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0: : Instructing follower 6a2c895eab0c40d6b22be18ca84fed16 to start an election
I20260709 12:08:32.319795 12963 raft_consensus.cc:1081] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0 [term 3 LEADER]: Signalling peer 6a2c895eab0c40d6b22be18ca84fed16 to start an election
I20260709 12:08:32.321429 12723 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4077af80765d460586125b4f312f5cfb"
dest_uuid: "6a2c895eab0c40d6b22be18ca84fed16"
 from {username='slave'} at 127.0.0.1:45060
I20260709 12:08:32.321934 12723 raft_consensus.cc:493] T 4077af80765d460586125b4f312f5cfb P 6a2c895eab0c40d6b22be18ca84fed16 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:32.322269 12723 raft_consensus.cc:3060] T 4077af80765d460586125b4f312f5cfb P 6a2c895eab0c40d6b22be18ca84fed16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:32.328783 12723 raft_consensus.cc:515] T 4077af80765d460586125b4f312f5cfb P 6a2c895eab0c40d6b22be18ca84fed16 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:32.330569 12723 leader_election.cc:290] T 4077af80765d460586125b4f312f5cfb P 6a2c895eab0c40d6b22be18ca84fed16 [CANDIDATE]: Term 4 election: Requested vote from peers e9591e45f9b241f09c8367c42be07b4f (127.12.56.193:35963), 034d7c10edb342ab936e590793980fc0 (127.12.56.195:34109)
I20260709 12:08:32.331792 12649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4077af80765d460586125b4f312f5cfb" candidate_uuid: "6a2c895eab0c40d6b22be18ca84fed16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e9591e45f9b241f09c8367c42be07b4f"
I20260709 12:08:32.331799 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4077af80765d460586125b4f312f5cfb" candidate_uuid: "6a2c895eab0c40d6b22be18ca84fed16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "034d7c10edb342ab936e590793980fc0"
I20260709 12:08:32.332763 12649 raft_consensus.cc:3060] T 4077af80765d460586125b4f312f5cfb P e9591e45f9b241f09c8367c42be07b4f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:32.332841 12799 raft_consensus.cc:3055] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:08:32.333236 12799 raft_consensus.cc:740] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 034d7c10edb342ab936e590793980fc0, State: Running, Role: LEADER
I20260709 12:08:32.334020 12934 raft_consensus.cc:993] T 5957ce50d01e4214bc908e402a78a32e P e9591e45f9b241f09c8367c42be07b4f: : Instructing follower 6a2c895eab0c40d6b22be18ca84fed16 to start an election
I20260709 12:08:32.334300 12799 consensus_queue.cc:260] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:32.334619 12964 raft_consensus.cc:1081] T 5957ce50d01e4214bc908e402a78a32e P e9591e45f9b241f09c8367c42be07b4f [term 2 LEADER]: Signalling peer 6a2c895eab0c40d6b22be18ca84fed16 to start an election
I20260709 12:08:32.335573 12799 raft_consensus.cc:3060] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:32.336714 12724 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5957ce50d01e4214bc908e402a78a32e"
dest_uuid: "6a2c895eab0c40d6b22be18ca84fed16"
 from {username='slave'} at 127.0.0.1:45054
I20260709 12:08:32.337266 12724 raft_consensus.cc:493] T 5957ce50d01e4214bc908e402a78a32e P 6a2c895eab0c40d6b22be18ca84fed16 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:32.337612 12724 raft_consensus.cc:3060] T 5957ce50d01e4214bc908e402a78a32e P 6a2c895eab0c40d6b22be18ca84fed16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:32.339629 12649 raft_consensus.cc:2468] T 4077af80765d460586125b4f312f5cfb P e9591e45f9b241f09c8367c42be07b4f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a2c895eab0c40d6b22be18ca84fed16 in term 4.
I20260709 12:08:32.340574 12799 raft_consensus.cc:2468] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a2c895eab0c40d6b22be18ca84fed16 in term 4.
I20260709 12:08:32.341151 12690 leader_election.cc:304] T 4077af80765d460586125b4f312f5cfb P 6a2c895eab0c40d6b22be18ca84fed16 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a2c895eab0c40d6b22be18ca84fed16, e9591e45f9b241f09c8367c42be07b4f; no voters: 
I20260709 12:08:32.342105 12961 raft_consensus.cc:2804] T 4077af80765d460586125b4f312f5cfb P 6a2c895eab0c40d6b22be18ca84fed16 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:08:32.343180 12961 raft_consensus.cc:697] T 4077af80765d460586125b4f312f5cfb P 6a2c895eab0c40d6b22be18ca84fed16 [term 4 LEADER]: Becoming Leader. State: Replica: 6a2c895eab0c40d6b22be18ca84fed16, State: Running, Role: LEADER
I20260709 12:08:32.344388 12724 raft_consensus.cc:515] T 5957ce50d01e4214bc908e402a78a32e P 6a2c895eab0c40d6b22be18ca84fed16 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:32.344321 12961 consensus_queue.cc:237] T 4077af80765d460586125b4f312f5cfb P 6a2c895eab0c40d6b22be18ca84fed16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:32.346892 12724 leader_election.cc:290] T 5957ce50d01e4214bc908e402a78a32e P 6a2c895eab0c40d6b22be18ca84fed16 [CANDIDATE]: Term 3 election: Requested vote from peers e9591e45f9b241f09c8367c42be07b4f (127.12.56.193:35963), 034d7c10edb342ab936e590793980fc0 (127.12.56.195:34109)
I20260709 12:08:32.347124 12649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5957ce50d01e4214bc908e402a78a32e" candidate_uuid: "6a2c895eab0c40d6b22be18ca84fed16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e9591e45f9b241f09c8367c42be07b4f"
I20260709 12:08:32.347697 12649 raft_consensus.cc:3055] T 5957ce50d01e4214bc908e402a78a32e P e9591e45f9b241f09c8367c42be07b4f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:32.348060 12649 raft_consensus.cc:740] T 5957ce50d01e4214bc908e402a78a32e P e9591e45f9b241f09c8367c42be07b4f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e9591e45f9b241f09c8367c42be07b4f, State: Running, Role: LEADER
I20260709 12:08:32.348779 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5957ce50d01e4214bc908e402a78a32e" candidate_uuid: "6a2c895eab0c40d6b22be18ca84fed16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "034d7c10edb342ab936e590793980fc0"
I20260709 12:08:32.348836 12649 consensus_queue.cc:260] T 5957ce50d01e4214bc908e402a78a32e P e9591e45f9b241f09c8367c42be07b4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:32.349458 12799 raft_consensus.cc:3060] T 5957ce50d01e4214bc908e402a78a32e P 034d7c10edb342ab936e590793980fc0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:32.350247 12649 raft_consensus.cc:3060] T 5957ce50d01e4214bc908e402a78a32e P e9591e45f9b241f09c8367c42be07b4f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:32.356226 12799 raft_consensus.cc:2468] T 5957ce50d01e4214bc908e402a78a32e P 034d7c10edb342ab936e590793980fc0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a2c895eab0c40d6b22be18ca84fed16 in term 3.
I20260709 12:08:32.356401 12649 raft_consensus.cc:2468] T 5957ce50d01e4214bc908e402a78a32e P e9591e45f9b241f09c8367c42be07b4f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a2c895eab0c40d6b22be18ca84fed16 in term 3.
I20260709 12:08:32.357806 12691 leader_election.cc:304] T 5957ce50d01e4214bc908e402a78a32e P 6a2c895eab0c40d6b22be18ca84fed16 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 034d7c10edb342ab936e590793980fc0, 6a2c895eab0c40d6b22be18ca84fed16; no voters: 
I20260709 12:08:32.358804 12961 raft_consensus.cc:2804] T 5957ce50d01e4214bc908e402a78a32e P 6a2c895eab0c40d6b22be18ca84fed16 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:32.359390 12961 raft_consensus.cc:697] T 5957ce50d01e4214bc908e402a78a32e P 6a2c895eab0c40d6b22be18ca84fed16 [term 3 LEADER]: Becoming Leader. State: Replica: 6a2c895eab0c40d6b22be18ca84fed16, State: Running, Role: LEADER
I20260709 12:08:32.359310 12544 catalog_manager.cc:5697] T 4077af80765d460586125b4f312f5cfb P 6a2c895eab0c40d6b22be18ca84fed16 reported cstate change: term changed from 3 to 4, leader changed from 034d7c10edb342ab936e590793980fc0 (127.12.56.195) to 6a2c895eab0c40d6b22be18ca84fed16 (127.12.56.194). New cstate: current_term: 4 leader_uuid: "6a2c895eab0c40d6b22be18ca84fed16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:32.360456 12961 consensus_queue.cc:237] T 5957ce50d01e4214bc908e402a78a32e P 6a2c895eab0c40d6b22be18ca84fed16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:32.377463 12544 catalog_manager.cc:5697] T 5957ce50d01e4214bc908e402a78a32e P 6a2c895eab0c40d6b22be18ca84fed16 reported cstate change: term changed from 2 to 3, leader changed from e9591e45f9b241f09c8367c42be07b4f (127.12.56.193) to 6a2c895eab0c40d6b22be18ca84fed16 (127.12.56.194). New cstate: current_term: 3 leader_uuid: "6a2c895eab0c40d6b22be18ca84fed16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:32.483022 12934 raft_consensus.cc:993] T d8698d4730834dc582e8564c0a98eb86 P e9591e45f9b241f09c8367c42be07b4f: : Instructing follower 6a2c895eab0c40d6b22be18ca84fed16 to start an election
I20260709 12:08:32.483489 12964 raft_consensus.cc:1081] T d8698d4730834dc582e8564c0a98eb86 P e9591e45f9b241f09c8367c42be07b4f [term 1 LEADER]: Signalling peer 6a2c895eab0c40d6b22be18ca84fed16 to start an election
I20260709 12:08:32.485133 12724 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d8698d4730834dc582e8564c0a98eb86"
dest_uuid: "6a2c895eab0c40d6b22be18ca84fed16"
 from {username='slave'} at 127.0.0.1:45054
I20260709 12:08:32.485637 12724 raft_consensus.cc:493] T d8698d4730834dc582e8564c0a98eb86 P 6a2c895eab0c40d6b22be18ca84fed16 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:32.485927 12724 raft_consensus.cc:3060] T d8698d4730834dc582e8564c0a98eb86 P 6a2c895eab0c40d6b22be18ca84fed16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:32.490548 12724 raft_consensus.cc:515] T d8698d4730834dc582e8564c0a98eb86 P 6a2c895eab0c40d6b22be18ca84fed16 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } }
I20260709 12:08:32.492077 12724 leader_election.cc:290] T d8698d4730834dc582e8564c0a98eb86 P 6a2c895eab0c40d6b22be18ca84fed16 [CANDIDATE]: Term 2 election: Requested vote from peers e9591e45f9b241f09c8367c42be07b4f (127.12.56.193:35963), 034d7c10edb342ab936e590793980fc0 (127.12.56.195:34109)
I20260709 12:08:32.493323 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8698d4730834dc582e8564c0a98eb86" candidate_uuid: "6a2c895eab0c40d6b22be18ca84fed16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "034d7c10edb342ab936e590793980fc0"
I20260709 12:08:32.493183 12649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8698d4730834dc582e8564c0a98eb86" candidate_uuid: "6a2c895eab0c40d6b22be18ca84fed16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e9591e45f9b241f09c8367c42be07b4f"
I20260709 12:08:32.493974 12799 raft_consensus.cc:3060] T d8698d4730834dc582e8564c0a98eb86 P 034d7c10edb342ab936e590793980fc0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:32.494078 12649 raft_consensus.cc:3055] T d8698d4730834dc582e8564c0a98eb86 P e9591e45f9b241f09c8367c42be07b4f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:32.494462 12649 raft_consensus.cc:740] T d8698d4730834dc582e8564c0a98eb86 P e9591e45f9b241f09c8367c42be07b4f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e9591e45f9b241f09c8367c42be07b4f, State: Running, Role: LEADER
I20260709 12:08:32.495234 12649 consensus_queue.cc:260] T d8698d4730834dc582e8564c0a98eb86 P e9591e45f9b241f09c8367c42be07b4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } }
I20260709 12:08:32.496482 12649 raft_consensus.cc:3060] T d8698d4730834dc582e8564c0a98eb86 P e9591e45f9b241f09c8367c42be07b4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:32.500835 12799 raft_consensus.cc:2468] T d8698d4730834dc582e8564c0a98eb86 P 034d7c10edb342ab936e590793980fc0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a2c895eab0c40d6b22be18ca84fed16 in term 2.
I20260709 12:08:32.502115 12691 leader_election.cc:304] T d8698d4730834dc582e8564c0a98eb86 P 6a2c895eab0c40d6b22be18ca84fed16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 034d7c10edb342ab936e590793980fc0, 6a2c895eab0c40d6b22be18ca84fed16; no voters: 
I20260709 12:08:32.503172 12649 raft_consensus.cc:2468] T d8698d4730834dc582e8564c0a98eb86 P e9591e45f9b241f09c8367c42be07b4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a2c895eab0c40d6b22be18ca84fed16 in term 2.
I20260709 12:08:32.503275 12961 raft_consensus.cc:2804] T d8698d4730834dc582e8564c0a98eb86 P 6a2c895eab0c40d6b22be18ca84fed16 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:32.505033 12961 raft_consensus.cc:697] T d8698d4730834dc582e8564c0a98eb86 P 6a2c895eab0c40d6b22be18ca84fed16 [term 2 LEADER]: Becoming Leader. State: Replica: 6a2c895eab0c40d6b22be18ca84fed16, State: Running, Role: LEADER
I20260709 12:08:32.506125 12961 consensus_queue.cc:237] T d8698d4730834dc582e8564c0a98eb86 P 6a2c895eab0c40d6b22be18ca84fed16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } }
I20260709 12:08:32.513283 12544 catalog_manager.cc:5697] T d8698d4730834dc582e8564c0a98eb86 P 6a2c895eab0c40d6b22be18ca84fed16 reported cstate change: term changed from 1 to 2, leader changed from e9591e45f9b241f09c8367c42be07b4f (127.12.56.193) to 6a2c895eab0c40d6b22be18ca84fed16 (127.12.56.194). New cstate: current_term: 2 leader_uuid: "6a2c895eab0c40d6b22be18ca84fed16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:32.532434 12934 raft_consensus.cc:993] T efe4e5e9a1b54e3987e81561775a89d6 P e9591e45f9b241f09c8367c42be07b4f: : Instructing follower 6a2c895eab0c40d6b22be18ca84fed16 to start an election
I20260709 12:08:32.532891 12964 raft_consensus.cc:1081] T efe4e5e9a1b54e3987e81561775a89d6 P e9591e45f9b241f09c8367c42be07b4f [term 2 LEADER]: Signalling peer 6a2c895eab0c40d6b22be18ca84fed16 to start an election
I20260709 12:08:32.534418 12724 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "efe4e5e9a1b54e3987e81561775a89d6"
dest_uuid: "6a2c895eab0c40d6b22be18ca84fed16"
 from {username='slave'} at 127.0.0.1:45054
I20260709 12:08:32.534910 12724 raft_consensus.cc:493] T efe4e5e9a1b54e3987e81561775a89d6 P 6a2c895eab0c40d6b22be18ca84fed16 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:32.535218 12724 raft_consensus.cc:3060] T efe4e5e9a1b54e3987e81561775a89d6 P 6a2c895eab0c40d6b22be18ca84fed16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:32.539803 12724 raft_consensus.cc:515] T efe4e5e9a1b54e3987e81561775a89d6 P 6a2c895eab0c40d6b22be18ca84fed16 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:32.541419 12724 leader_election.cc:290] T efe4e5e9a1b54e3987e81561775a89d6 P 6a2c895eab0c40d6b22be18ca84fed16 [CANDIDATE]: Term 3 election: Requested vote from peers e9591e45f9b241f09c8367c42be07b4f (127.12.56.193:35963), 034d7c10edb342ab936e590793980fc0 (127.12.56.195:34109)
I20260709 12:08:32.542357 12649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe4e5e9a1b54e3987e81561775a89d6" candidate_uuid: "6a2c895eab0c40d6b22be18ca84fed16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e9591e45f9b241f09c8367c42be07b4f"
I20260709 12:08:32.542613 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe4e5e9a1b54e3987e81561775a89d6" candidate_uuid: "6a2c895eab0c40d6b22be18ca84fed16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "034d7c10edb342ab936e590793980fc0"
I20260709 12:08:32.543154 12649 raft_consensus.cc:3055] T efe4e5e9a1b54e3987e81561775a89d6 P e9591e45f9b241f09c8367c42be07b4f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:32.543205 12799 raft_consensus.cc:3060] T efe4e5e9a1b54e3987e81561775a89d6 P 034d7c10edb342ab936e590793980fc0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:32.543520 12649 raft_consensus.cc:740] T efe4e5e9a1b54e3987e81561775a89d6 P e9591e45f9b241f09c8367c42be07b4f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e9591e45f9b241f09c8367c42be07b4f, State: Running, Role: LEADER
I20260709 12:08:32.544243 12649 consensus_queue.cc:260] T efe4e5e9a1b54e3987e81561775a89d6 P e9591e45f9b241f09c8367c42be07b4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:32.545153 12649 raft_consensus.cc:3060] T efe4e5e9a1b54e3987e81561775a89d6 P e9591e45f9b241f09c8367c42be07b4f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:32.548005 12799 raft_consensus.cc:2468] T efe4e5e9a1b54e3987e81561775a89d6 P 034d7c10edb342ab936e590793980fc0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a2c895eab0c40d6b22be18ca84fed16 in term 3.
I20260709 12:08:32.549328 12691 leader_election.cc:304] T efe4e5e9a1b54e3987e81561775a89d6 P 6a2c895eab0c40d6b22be18ca84fed16 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 034d7c10edb342ab936e590793980fc0, 6a2c895eab0c40d6b22be18ca84fed16; no voters: 
I20260709 12:08:32.549896 12649 raft_consensus.cc:2468] T efe4e5e9a1b54e3987e81561775a89d6 P e9591e45f9b241f09c8367c42be07b4f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a2c895eab0c40d6b22be18ca84fed16 in term 3.
I20260709 12:08:32.550099 12961 raft_consensus.cc:2804] T efe4e5e9a1b54e3987e81561775a89d6 P 6a2c895eab0c40d6b22be18ca84fed16 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:32.550694 12961 raft_consensus.cc:697] T efe4e5e9a1b54e3987e81561775a89d6 P 6a2c895eab0c40d6b22be18ca84fed16 [term 3 LEADER]: Becoming Leader. State: Replica: 6a2c895eab0c40d6b22be18ca84fed16, State: Running, Role: LEADER
I20260709 12:08:32.551792 12961 consensus_queue.cc:237] T efe4e5e9a1b54e3987e81561775a89d6 P 6a2c895eab0c40d6b22be18ca84fed16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:32.560393 12544 catalog_manager.cc:5697] T efe4e5e9a1b54e3987e81561775a89d6 P 6a2c895eab0c40d6b22be18ca84fed16 reported cstate change: term changed from 2 to 3, leader changed from e9591e45f9b241f09c8367c42be07b4f (127.12.56.193) to 6a2c895eab0c40d6b22be18ca84fed16 (127.12.56.194). New cstate: current_term: 3 leader_uuid: "6a2c895eab0c40d6b22be18ca84fed16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:32.597812 12953 raft_consensus.cc:993] T 155e9b7aa7aa40a587d743d6a30ccf7e P 034d7c10edb342ab936e590793980fc0: : Instructing follower 6a2c895eab0c40d6b22be18ca84fed16 to start an election
I20260709 12:08:32.598412 12963 raft_consensus.cc:1081] T 155e9b7aa7aa40a587d743d6a30ccf7e P 034d7c10edb342ab936e590793980fc0 [term 3 LEADER]: Signalling peer 6a2c895eab0c40d6b22be18ca84fed16 to start an election
I20260709 12:08:32.599957 12724 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "155e9b7aa7aa40a587d743d6a30ccf7e"
dest_uuid: "6a2c895eab0c40d6b22be18ca84fed16"
 from {username='slave'} at 127.0.0.1:45060
I20260709 12:08:32.600449 12724 raft_consensus.cc:493] T 155e9b7aa7aa40a587d743d6a30ccf7e P 6a2c895eab0c40d6b22be18ca84fed16 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:32.600739 12724 raft_consensus.cc:3060] T 155e9b7aa7aa40a587d743d6a30ccf7e P 6a2c895eab0c40d6b22be18ca84fed16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:32.605703 12724 raft_consensus.cc:515] T 155e9b7aa7aa40a587d743d6a30ccf7e P 6a2c895eab0c40d6b22be18ca84fed16 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:32.607896 12724 leader_election.cc:290] T 155e9b7aa7aa40a587d743d6a30ccf7e P 6a2c895eab0c40d6b22be18ca84fed16 [CANDIDATE]: Term 4 election: Requested vote from peers e9591e45f9b241f09c8367c42be07b4f (127.12.56.193:35963), 034d7c10edb342ab936e590793980fc0 (127.12.56.195:34109)
I20260709 12:08:32.608714 12649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155e9b7aa7aa40a587d743d6a30ccf7e" candidate_uuid: "6a2c895eab0c40d6b22be18ca84fed16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e9591e45f9b241f09c8367c42be07b4f"
I20260709 12:08:32.609023 12799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155e9b7aa7aa40a587d743d6a30ccf7e" candidate_uuid: "6a2c895eab0c40d6b22be18ca84fed16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "034d7c10edb342ab936e590793980fc0"
I20260709 12:08:32.609333 12649 raft_consensus.cc:3060] T 155e9b7aa7aa40a587d743d6a30ccf7e P e9591e45f9b241f09c8367c42be07b4f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:32.609534 12799 raft_consensus.cc:3055] T 155e9b7aa7aa40a587d743d6a30ccf7e P 034d7c10edb342ab936e590793980fc0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:08:32.609854 12799 raft_consensus.cc:740] T 155e9b7aa7aa40a587d743d6a30ccf7e P 034d7c10edb342ab936e590793980fc0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 034d7c10edb342ab936e590793980fc0, State: Running, Role: LEADER
I20260709 12:08:32.612429 12799 consensus_queue.cc:260] T 155e9b7aa7aa40a587d743d6a30ccf7e P 034d7c10edb342ab936e590793980fc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:32.613376 12799 raft_consensus.cc:3060] T 155e9b7aa7aa40a587d743d6a30ccf7e P 034d7c10edb342ab936e590793980fc0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:32.614614 12649 raft_consensus.cc:2468] T 155e9b7aa7aa40a587d743d6a30ccf7e P e9591e45f9b241f09c8367c42be07b4f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a2c895eab0c40d6b22be18ca84fed16 in term 4.
I20260709 12:08:32.615780 12690 leader_election.cc:304] T 155e9b7aa7aa40a587d743d6a30ccf7e P 6a2c895eab0c40d6b22be18ca84fed16 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a2c895eab0c40d6b22be18ca84fed16, e9591e45f9b241f09c8367c42be07b4f; no voters: 
I20260709 12:08:32.616493 12961 raft_consensus.cc:2804] T 155e9b7aa7aa40a587d743d6a30ccf7e P 6a2c895eab0c40d6b22be18ca84fed16 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:08:32.617015 12961 raft_consensus.cc:697] T 155e9b7aa7aa40a587d743d6a30ccf7e P 6a2c895eab0c40d6b22be18ca84fed16 [term 4 LEADER]: Becoming Leader. State: Replica: 6a2c895eab0c40d6b22be18ca84fed16, State: Running, Role: LEADER
I20260709 12:08:32.618028 12961 consensus_queue.cc:237] T 155e9b7aa7aa40a587d743d6a30ccf7e P 6a2c895eab0c40d6b22be18ca84fed16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:32.619506 12799 raft_consensus.cc:2468] T 155e9b7aa7aa40a587d743d6a30ccf7e P 034d7c10edb342ab936e590793980fc0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a2c895eab0c40d6b22be18ca84fed16 in term 4.
I20260709 12:08:32.625816 12544 catalog_manager.cc:5697] T 155e9b7aa7aa40a587d743d6a30ccf7e P 6a2c895eab0c40d6b22be18ca84fed16 reported cstate change: term changed from 3 to 4, leader changed from 034d7c10edb342ab936e590793980fc0 (127.12.56.195) to 6a2c895eab0c40d6b22be18ca84fed16 (127.12.56.194). New cstate: current_term: 4 leader_uuid: "6a2c895eab0c40d6b22be18ca84fed16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:32.801141 12799 raft_consensus.cc:1275] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0 [term 4 FOLLOWER]: Refusing update from remote peer 6a2c895eab0c40d6b22be18ca84fed16: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:32.802522 12961 consensus_queue.cc:1048] T 4077af80765d460586125b4f312f5cfb P 6a2c895eab0c40d6b22be18ca84fed16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:08:32.814546 12649 raft_consensus.cc:1275] T 4077af80765d460586125b4f312f5cfb P e9591e45f9b241f09c8367c42be07b4f [term 4 FOLLOWER]: Refusing update from remote peer 6a2c895eab0c40d6b22be18ca84fed16: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:32.816107 12961 consensus_queue.cc:1048] T 4077af80765d460586125b4f312f5cfb P 6a2c895eab0c40d6b22be18ca84fed16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:08:32.864989 12649 raft_consensus.cc:1275] T 5957ce50d01e4214bc908e402a78a32e P e9591e45f9b241f09c8367c42be07b4f [term 3 FOLLOWER]: Refusing update from remote peer 6a2c895eab0c40d6b22be18ca84fed16: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:32.866407 12961 consensus_queue.cc:1048] T 5957ce50d01e4214bc908e402a78a32e P 6a2c895eab0c40d6b22be18ca84fed16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:32.876411 12799 raft_consensus.cc:1275] T 5957ce50d01e4214bc908e402a78a32e P 034d7c10edb342ab936e590793980fc0 [term 3 FOLLOWER]: Refusing update from remote peer 6a2c895eab0c40d6b22be18ca84fed16: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:32.878026 12972 consensus_queue.cc:1048] T 5957ce50d01e4214bc908e402a78a32e P 6a2c895eab0c40d6b22be18ca84fed16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:08:32.973237 12649 raft_consensus.cc:1275] T d8698d4730834dc582e8564c0a98eb86 P e9591e45f9b241f09c8367c42be07b4f [term 2 FOLLOWER]: Refusing update from remote peer 6a2c895eab0c40d6b22be18ca84fed16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:32.974745 12972 consensus_queue.cc:1048] T d8698d4730834dc582e8564c0a98eb86 P 6a2c895eab0c40d6b22be18ca84fed16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:32.985992 12799 raft_consensus.cc:1275] T d8698d4730834dc582e8564c0a98eb86 P 034d7c10edb342ab936e590793980fc0 [term 2 FOLLOWER]: Refusing update from remote peer 6a2c895eab0c40d6b22be18ca84fed16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:32.987782 12972 consensus_queue.cc:1048] T d8698d4730834dc582e8564c0a98eb86 P 6a2c895eab0c40d6b22be18ca84fed16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:32.995934 12649 raft_consensus.cc:1275] T efe4e5e9a1b54e3987e81561775a89d6 P e9591e45f9b241f09c8367c42be07b4f [term 3 FOLLOWER]: Refusing update from remote peer 6a2c895eab0c40d6b22be18ca84fed16: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:32.997484 12972 consensus_queue.cc:1048] T efe4e5e9a1b54e3987e81561775a89d6 P 6a2c895eab0c40d6b22be18ca84fed16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:33.009351 12799 raft_consensus.cc:1275] T efe4e5e9a1b54e3987e81561775a89d6 P 034d7c10edb342ab936e590793980fc0 [term 3 FOLLOWER]: Refusing update from remote peer 6a2c895eab0c40d6b22be18ca84fed16: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:33.011359 12965 consensus_queue.cc:1048] T efe4e5e9a1b54e3987e81561775a89d6 P 6a2c895eab0c40d6b22be18ca84fed16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:08:33.088094 12799 raft_consensus.cc:1275] T 155e9b7aa7aa40a587d743d6a30ccf7e P 034d7c10edb342ab936e590793980fc0 [term 4 FOLLOWER]: Refusing update from remote peer 6a2c895eab0c40d6b22be18ca84fed16: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:33.089618 12986 consensus_queue.cc:1048] T 155e9b7aa7aa40a587d743d6a30ccf7e P 6a2c895eab0c40d6b22be18ca84fed16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:08:33.101532 12649 raft_consensus.cc:1275] T 155e9b7aa7aa40a587d743d6a30ccf7e P e9591e45f9b241f09c8367c42be07b4f [term 4 FOLLOWER]: Refusing update from remote peer 6a2c895eab0c40d6b22be18ca84fed16: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:33.102867 12965 consensus_queue.cc:1048] T 155e9b7aa7aa40a587d743d6a30ccf7e P 6a2c895eab0c40d6b22be18ca84fed16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:08:35.327534 12515 auto_leader_rebalancer-test.cc:328] The leader distribution is 
I20260709 12:08:35.328504 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:35.336901 12724 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "155e9b7aa7aa40a587d743d6a30ccf7e"
dest_uuid: "6a2c895eab0c40d6b22be18ca84fed16"
mode: GRACEFUL
new_leader_uuid: "e9591e45f9b241f09c8367c42be07b4f"
 from {username='slave'} at 127.0.0.1:56590
I20260709 12:08:35.337636 12724 raft_consensus.cc:606] T 155e9b7aa7aa40a587d743d6a30ccf7e P 6a2c895eab0c40d6b22be18ca84fed16 [term 4 LEADER]: Received request to transfer leadership to TS e9591e45f9b241f09c8367c42be07b4f
I20260709 12:08:35.342236 12724 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4077af80765d460586125b4f312f5cfb"
dest_uuid: "6a2c895eab0c40d6b22be18ca84fed16"
mode: GRACEFUL
new_leader_uuid: "034d7c10edb342ab936e590793980fc0"
 from {username='slave'} at 127.0.0.1:56590
I20260709 12:08:35.342851 12724 raft_consensus.cc:606] T 4077af80765d460586125b4f312f5cfb P 6a2c895eab0c40d6b22be18ca84fed16 [term 4 LEADER]: Received request to transfer leadership to TS 034d7c10edb342ab936e590793980fc0
I20260709 12:08:35.346786 12724 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41a081ffb7f74fe598b4689f85e3f19d"
dest_uuid: "6a2c895eab0c40d6b22be18ca84fed16"
mode: GRACEFUL
new_leader_uuid: "e9591e45f9b241f09c8367c42be07b4f"
 from {username='slave'} at 127.0.0.1:56590
I20260709 12:08:35.347498 12724 raft_consensus.cc:606] T 41a081ffb7f74fe598b4689f85e3f19d P 6a2c895eab0c40d6b22be18ca84fed16 [term 2 LEADER]: Received request to transfer leadership to TS e9591e45f9b241f09c8367c42be07b4f
I20260709 12:08:35.351370 12724 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5957ce50d01e4214bc908e402a78a32e"
dest_uuid: "6a2c895eab0c40d6b22be18ca84fed16"
mode: GRACEFUL
new_leader_uuid: "e9591e45f9b241f09c8367c42be07b4f"
 from {username='slave'} at 127.0.0.1:56590
I20260709 12:08:35.352211 12724 raft_consensus.cc:606] T 5957ce50d01e4214bc908e402a78a32e P 6a2c895eab0c40d6b22be18ca84fed16 [term 3 LEADER]: Received request to transfer leadership to TS e9591e45f9b241f09c8367c42be07b4f
I20260709 12:08:35.356009 12724 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "efe4e5e9a1b54e3987e81561775a89d6"
dest_uuid: "6a2c895eab0c40d6b22be18ca84fed16"
mode: GRACEFUL
new_leader_uuid: "034d7c10edb342ab936e590793980fc0"
 from {username='slave'} at 127.0.0.1:56590
I20260709 12:08:35.356829 12724 raft_consensus.cc:606] T efe4e5e9a1b54e3987e81561775a89d6 P 6a2c895eab0c40d6b22be18ca84fed16 [term 3 LEADER]: Received request to transfer leadership to TS 034d7c10edb342ab936e590793980fc0
I20260709 12:08:35.358476 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:08:35.359113 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:35.519886 12993 raft_consensus.cc:993] T 155e9b7aa7aa40a587d743d6a30ccf7e P 6a2c895eab0c40d6b22be18ca84fed16: : Instructing follower e9591e45f9b241f09c8367c42be07b4f to start an election
I20260709 12:08:35.520471 12994 raft_consensus.cc:1081] T 155e9b7aa7aa40a587d743d6a30ccf7e P 6a2c895eab0c40d6b22be18ca84fed16 [term 4 LEADER]: Signalling peer e9591e45f9b241f09c8367c42be07b4f to start an election
I20260709 12:08:35.522419 12647 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "155e9b7aa7aa40a587d743d6a30ccf7e"
dest_uuid: "e9591e45f9b241f09c8367c42be07b4f"
 from {username='slave'} at 127.0.0.1:50116
I20260709 12:08:35.522938 12647 raft_consensus.cc:493] T 155e9b7aa7aa40a587d743d6a30ccf7e P e9591e45f9b241f09c8367c42be07b4f [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:35.523350 12647 raft_consensus.cc:3060] T 155e9b7aa7aa40a587d743d6a30ccf7e P e9591e45f9b241f09c8367c42be07b4f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:08:35.529280 12647 raft_consensus.cc:515] T 155e9b7aa7aa40a587d743d6a30ccf7e P e9591e45f9b241f09c8367c42be07b4f [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:35.532655 12647 leader_election.cc:290] T 155e9b7aa7aa40a587d743d6a30ccf7e P e9591e45f9b241f09c8367c42be07b4f [CANDIDATE]: Term 5 election: Requested vote from peers 6a2c895eab0c40d6b22be18ca84fed16 (127.12.56.194:46297), 034d7c10edb342ab936e590793980fc0 (127.12.56.195:34109)
I20260709 12:08:35.533640 12993 raft_consensus.cc:993] T 5957ce50d01e4214bc908e402a78a32e P 6a2c895eab0c40d6b22be18ca84fed16: : Instructing follower e9591e45f9b241f09c8367c42be07b4f to start an election
I20260709 12:08:35.533459 12794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155e9b7aa7aa40a587d743d6a30ccf7e" candidate_uuid: "e9591e45f9b241f09c8367c42be07b4f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "034d7c10edb342ab936e590793980fc0"
I20260709 12:08:35.532981 12724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155e9b7aa7aa40a587d743d6a30ccf7e" candidate_uuid: "e9591e45f9b241f09c8367c42be07b4f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "6a2c895eab0c40d6b22be18ca84fed16"
I20260709 12:08:35.534185 12993 raft_consensus.cc:1081] T 5957ce50d01e4214bc908e402a78a32e P 6a2c895eab0c40d6b22be18ca84fed16 [term 3 LEADER]: Signalling peer e9591e45f9b241f09c8367c42be07b4f to start an election
I20260709 12:08:35.534210 12794 raft_consensus.cc:3060] T 155e9b7aa7aa40a587d743d6a30ccf7e P 034d7c10edb342ab936e590793980fc0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:08:35.534384 12724 raft_consensus.cc:3055] T 155e9b7aa7aa40a587d743d6a30ccf7e P 6a2c895eab0c40d6b22be18ca84fed16 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:08:35.534951 12724 raft_consensus.cc:740] T 155e9b7aa7aa40a587d743d6a30ccf7e P 6a2c895eab0c40d6b22be18ca84fed16 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6a2c895eab0c40d6b22be18ca84fed16, State: Running, Role: LEADER
I20260709 12:08:35.536194 12647 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5957ce50d01e4214bc908e402a78a32e"
dest_uuid: "e9591e45f9b241f09c8367c42be07b4f"
 from {username='slave'} at 127.0.0.1:50116
I20260709 12:08:35.535904 12724 consensus_queue.cc:260] T 155e9b7aa7aa40a587d743d6a30ccf7e P 6a2c895eab0c40d6b22be18ca84fed16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:35.536759 12647 raft_consensus.cc:493] T 5957ce50d01e4214bc908e402a78a32e P e9591e45f9b241f09c8367c42be07b4f [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:35.537151 12647 raft_consensus.cc:3060] T 5957ce50d01e4214bc908e402a78a32e P e9591e45f9b241f09c8367c42be07b4f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:35.537367 12724 raft_consensus.cc:3060] T 155e9b7aa7aa40a587d743d6a30ccf7e P 6a2c895eab0c40d6b22be18ca84fed16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:08:35.540766 12794 raft_consensus.cc:2468] T 155e9b7aa7aa40a587d743d6a30ccf7e P 034d7c10edb342ab936e590793980fc0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9591e45f9b241f09c8367c42be07b4f in term 5.
I20260709 12:08:35.542591 12616 leader_election.cc:304] T 155e9b7aa7aa40a587d743d6a30ccf7e P e9591e45f9b241f09c8367c42be07b4f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 034d7c10edb342ab936e590793980fc0, e9591e45f9b241f09c8367c42be07b4f; no voters: 
I20260709 12:08:35.544585 12997 raft_consensus.cc:2804] T 155e9b7aa7aa40a587d743d6a30ccf7e P e9591e45f9b241f09c8367c42be07b4f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:08:35.545075 12647 raft_consensus.cc:515] T 5957ce50d01e4214bc908e402a78a32e P e9591e45f9b241f09c8367c42be07b4f [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:35.547220 12724 raft_consensus.cc:2468] T 155e9b7aa7aa40a587d743d6a30ccf7e P 6a2c895eab0c40d6b22be18ca84fed16 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9591e45f9b241f09c8367c42be07b4f in term 5.
I20260709 12:08:35.548409 12723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5957ce50d01e4214bc908e402a78a32e" candidate_uuid: "e9591e45f9b241f09c8367c42be07b4f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6a2c895eab0c40d6b22be18ca84fed16"
I20260709 12:08:35.548506 12997 raft_consensus.cc:697] T 155e9b7aa7aa40a587d743d6a30ccf7e P e9591e45f9b241f09c8367c42be07b4f [term 5 LEADER]: Becoming Leader. State: Replica: e9591e45f9b241f09c8367c42be07b4f, State: Running, Role: LEADER
I20260709 12:08:35.549161 12723 raft_consensus.cc:3055] T 5957ce50d01e4214bc908e402a78a32e P 6a2c895eab0c40d6b22be18ca84fed16 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:08:35.549504 12723 raft_consensus.cc:740] T 5957ce50d01e4214bc908e402a78a32e P 6a2c895eab0c40d6b22be18ca84fed16 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6a2c895eab0c40d6b22be18ca84fed16, State: Running, Role: LEADER
I20260709 12:08:35.550014 12647 leader_election.cc:290] T 5957ce50d01e4214bc908e402a78a32e P e9591e45f9b241f09c8367c42be07b4f [CANDIDATE]: Term 4 election: Requested vote from peers 6a2c895eab0c40d6b22be18ca84fed16 (127.12.56.194:46297), 034d7c10edb342ab936e590793980fc0 (127.12.56.195:34109)
I20260709 12:08:35.549753 12997 consensus_queue.cc:237] T 155e9b7aa7aa40a587d743d6a30ccf7e P e9591e45f9b241f09c8367c42be07b4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:35.550343 12723 consensus_queue.cc:260] T 5957ce50d01e4214bc908e402a78a32e P 6a2c895eab0c40d6b22be18ca84fed16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:35.551558 12723 raft_consensus.cc:3060] T 5957ce50d01e4214bc908e402a78a32e P 6a2c895eab0c40d6b22be18ca84fed16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:35.551749 12794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5957ce50d01e4214bc908e402a78a32e" candidate_uuid: "e9591e45f9b241f09c8367c42be07b4f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "034d7c10edb342ab936e590793980fc0"
I20260709 12:08:35.552330 12794 raft_consensus.cc:3060] T 5957ce50d01e4214bc908e402a78a32e P 034d7c10edb342ab936e590793980fc0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:35.559840 12994 raft_consensus.cc:993] T efe4e5e9a1b54e3987e81561775a89d6 P 6a2c895eab0c40d6b22be18ca84fed16: : Instructing follower 034d7c10edb342ab936e590793980fc0 to start an election
I20260709 12:08:35.559854 12794 raft_consensus.cc:2468] T 5957ce50d01e4214bc908e402a78a32e P 034d7c10edb342ab936e590793980fc0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9591e45f9b241f09c8367c42be07b4f in term 4.
I20260709 12:08:35.560499 12993 raft_consensus.cc:1081] T efe4e5e9a1b54e3987e81561775a89d6 P 6a2c895eab0c40d6b22be18ca84fed16 [term 3 LEADER]: Signalling peer 034d7c10edb342ab936e590793980fc0 to start an election
I20260709 12:08:35.560635 12723 raft_consensus.cc:2468] T 5957ce50d01e4214bc908e402a78a32e P 6a2c895eab0c40d6b22be18ca84fed16 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9591e45f9b241f09c8367c42be07b4f in term 4.
I20260709 12:08:35.561896 12616 leader_election.cc:304] T 5957ce50d01e4214bc908e402a78a32e P e9591e45f9b241f09c8367c42be07b4f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 034d7c10edb342ab936e590793980fc0, e9591e45f9b241f09c8367c42be07b4f; no voters: 
I20260709 12:08:35.562259 12794 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "efe4e5e9a1b54e3987e81561775a89d6"
dest_uuid: "034d7c10edb342ab936e590793980fc0"
 from {username='slave'} at 127.0.0.1:48416
I20260709 12:08:35.562855 12794 raft_consensus.cc:493] T efe4e5e9a1b54e3987e81561775a89d6 P 034d7c10edb342ab936e590793980fc0 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:35.563318 12794 raft_consensus.cc:3060] T efe4e5e9a1b54e3987e81561775a89d6 P 034d7c10edb342ab936e590793980fc0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:35.563767 12998 raft_consensus.cc:2804] T 5957ce50d01e4214bc908e402a78a32e P e9591e45f9b241f09c8367c42be07b4f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:08:35.565296 12998 raft_consensus.cc:697] T 5957ce50d01e4214bc908e402a78a32e P e9591e45f9b241f09c8367c42be07b4f [term 4 LEADER]: Becoming Leader. State: Replica: e9591e45f9b241f09c8367c42be07b4f, State: Running, Role: LEADER
I20260709 12:08:35.566318 12998 consensus_queue.cc:237] T 5957ce50d01e4214bc908e402a78a32e P e9591e45f9b241f09c8367c42be07b4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:35.571305 12794 raft_consensus.cc:515] T efe4e5e9a1b54e3987e81561775a89d6 P 034d7c10edb342ab936e590793980fc0 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:35.571174 12544 catalog_manager.cc:5697] T 155e9b7aa7aa40a587d743d6a30ccf7e P e9591e45f9b241f09c8367c42be07b4f reported cstate change: term changed from 4 to 5, leader changed from 6a2c895eab0c40d6b22be18ca84fed16 (127.12.56.194) to e9591e45f9b241f09c8367c42be07b4f (127.12.56.193). New cstate: current_term: 5 leader_uuid: "e9591e45f9b241f09c8367c42be07b4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:35.574311 12794 leader_election.cc:290] T efe4e5e9a1b54e3987e81561775a89d6 P 034d7c10edb342ab936e590793980fc0 [CANDIDATE]: Term 4 election: Requested vote from peers e9591e45f9b241f09c8367c42be07b4f (127.12.56.193:35963), 6a2c895eab0c40d6b22be18ca84fed16 (127.12.56.194:46297)
I20260709 12:08:35.575649 12647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe4e5e9a1b54e3987e81561775a89d6" candidate_uuid: "034d7c10edb342ab936e590793980fc0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e9591e45f9b241f09c8367c42be07b4f"
I20260709 12:08:35.576308 12723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe4e5e9a1b54e3987e81561775a89d6" candidate_uuid: "034d7c10edb342ab936e590793980fc0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6a2c895eab0c40d6b22be18ca84fed16"
I20260709 12:08:35.576467 12647 raft_consensus.cc:3060] T efe4e5e9a1b54e3987e81561775a89d6 P e9591e45f9b241f09c8367c42be07b4f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:35.577059 12723 raft_consensus.cc:3055] T efe4e5e9a1b54e3987e81561775a89d6 P 6a2c895eab0c40d6b22be18ca84fed16 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:08:35.577374 12723 raft_consensus.cc:740] T efe4e5e9a1b54e3987e81561775a89d6 P 6a2c895eab0c40d6b22be18ca84fed16 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6a2c895eab0c40d6b22be18ca84fed16, State: Running, Role: LEADER
I20260709 12:08:35.578169 12723 consensus_queue.cc:260] T efe4e5e9a1b54e3987e81561775a89d6 P 6a2c895eab0c40d6b22be18ca84fed16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:35.579070 12723 raft_consensus.cc:3060] T efe4e5e9a1b54e3987e81561775a89d6 P 6a2c895eab0c40d6b22be18ca84fed16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:35.583828 12647 raft_consensus.cc:2468] T efe4e5e9a1b54e3987e81561775a89d6 P e9591e45f9b241f09c8367c42be07b4f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 034d7c10edb342ab936e590793980fc0 in term 4.
I20260709 12:08:35.585565 12764 leader_election.cc:304] T efe4e5e9a1b54e3987e81561775a89d6 P 034d7c10edb342ab936e590793980fc0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 034d7c10edb342ab936e590793980fc0, e9591e45f9b241f09c8367c42be07b4f; no voters: 
I20260709 12:08:35.585981 12723 raft_consensus.cc:2468] T efe4e5e9a1b54e3987e81561775a89d6 P 6a2c895eab0c40d6b22be18ca84fed16 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 034d7c10edb342ab936e590793980fc0 in term 4.
I20260709 12:08:35.586604 12996 raft_consensus.cc:2804] T efe4e5e9a1b54e3987e81561775a89d6 P 034d7c10edb342ab936e590793980fc0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:08:35.587189 12996 raft_consensus.cc:697] T efe4e5e9a1b54e3987e81561775a89d6 P 034d7c10edb342ab936e590793980fc0 [term 4 LEADER]: Becoming Leader. State: Replica: 034d7c10edb342ab936e590793980fc0, State: Running, Role: LEADER
I20260709 12:08:35.588163 12996 consensus_queue.cc:237] T efe4e5e9a1b54e3987e81561775a89d6 P 034d7c10edb342ab936e590793980fc0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:35.595999 12544 catalog_manager.cc:5697] T 5957ce50d01e4214bc908e402a78a32e P e9591e45f9b241f09c8367c42be07b4f reported cstate change: term changed from 3 to 4, leader changed from 6a2c895eab0c40d6b22be18ca84fed16 (127.12.56.194) to e9591e45f9b241f09c8367c42be07b4f (127.12.56.193). New cstate: current_term: 4 leader_uuid: "e9591e45f9b241f09c8367c42be07b4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:35.598114 12546 catalog_manager.cc:5697] T efe4e5e9a1b54e3987e81561775a89d6 P 034d7c10edb342ab936e590793980fc0 reported cstate change: term changed from 3 to 4, leader changed from 6a2c895eab0c40d6b22be18ca84fed16 (127.12.56.194) to 034d7c10edb342ab936e590793980fc0 (127.12.56.195). New cstate: current_term: 4 leader_uuid: "034d7c10edb342ab936e590793980fc0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:35.616883 12994 raft_consensus.cc:993] T 41a081ffb7f74fe598b4689f85e3f19d P 6a2c895eab0c40d6b22be18ca84fed16: : Instructing follower e9591e45f9b241f09c8367c42be07b4f to start an election
I20260709 12:08:35.617316 12994 raft_consensus.cc:1081] T 41a081ffb7f74fe598b4689f85e3f19d P 6a2c895eab0c40d6b22be18ca84fed16 [term 2 LEADER]: Signalling peer e9591e45f9b241f09c8367c42be07b4f to start an election
I20260709 12:08:35.618773 12647 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "41a081ffb7f74fe598b4689f85e3f19d"
dest_uuid: "e9591e45f9b241f09c8367c42be07b4f"
 from {username='slave'} at 127.0.0.1:50116
I20260709 12:08:35.619383 12647 raft_consensus.cc:493] T 41a081ffb7f74fe598b4689f85e3f19d P e9591e45f9b241f09c8367c42be07b4f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:35.619684 12647 raft_consensus.cc:3060] T 41a081ffb7f74fe598b4689f85e3f19d P e9591e45f9b241f09c8367c42be07b4f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:35.624519 12647 raft_consensus.cc:515] T 41a081ffb7f74fe598b4689f85e3f19d P e9591e45f9b241f09c8367c42be07b4f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:35.626185 12647 leader_election.cc:290] T 41a081ffb7f74fe598b4689f85e3f19d P e9591e45f9b241f09c8367c42be07b4f [CANDIDATE]: Term 3 election: Requested vote from peers 6a2c895eab0c40d6b22be18ca84fed16 (127.12.56.194:46297), 034d7c10edb342ab936e590793980fc0 (127.12.56.195:34109)
I20260709 12:08:35.627291 12794 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a081ffb7f74fe598b4689f85e3f19d" candidate_uuid: "e9591e45f9b241f09c8367c42be07b4f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "034d7c10edb342ab936e590793980fc0"
I20260709 12:08:35.627321 12723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a081ffb7f74fe598b4689f85e3f19d" candidate_uuid: "e9591e45f9b241f09c8367c42be07b4f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6a2c895eab0c40d6b22be18ca84fed16"
I20260709 12:08:35.627959 12794 raft_consensus.cc:3060] T 41a081ffb7f74fe598b4689f85e3f19d P 034d7c10edb342ab936e590793980fc0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:35.628031 12723 raft_consensus.cc:3055] T 41a081ffb7f74fe598b4689f85e3f19d P 6a2c895eab0c40d6b22be18ca84fed16 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:35.628489 12723 raft_consensus.cc:740] T 41a081ffb7f74fe598b4689f85e3f19d P 6a2c895eab0c40d6b22be18ca84fed16 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6a2c895eab0c40d6b22be18ca84fed16, State: Running, Role: LEADER
I20260709 12:08:35.629292 12723 consensus_queue.cc:260] T 41a081ffb7f74fe598b4689f85e3f19d P 6a2c895eab0c40d6b22be18ca84fed16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:35.630491 12723 raft_consensus.cc:3060] T 41a081ffb7f74fe598b4689f85e3f19d P 6a2c895eab0c40d6b22be18ca84fed16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:35.635010 12794 raft_consensus.cc:2468] T 41a081ffb7f74fe598b4689f85e3f19d P 034d7c10edb342ab936e590793980fc0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9591e45f9b241f09c8367c42be07b4f in term 3.
I20260709 12:08:35.636250 12616 leader_election.cc:304] T 41a081ffb7f74fe598b4689f85e3f19d P e9591e45f9b241f09c8367c42be07b4f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 034d7c10edb342ab936e590793980fc0, e9591e45f9b241f09c8367c42be07b4f; no voters: 
I20260709 12:08:35.636883 12723 raft_consensus.cc:2468] T 41a081ffb7f74fe598b4689f85e3f19d P 6a2c895eab0c40d6b22be18ca84fed16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9591e45f9b241f09c8367c42be07b4f in term 3.
I20260709 12:08:35.637307 12998 raft_consensus.cc:2804] T 41a081ffb7f74fe598b4689f85e3f19d P e9591e45f9b241f09c8367c42be07b4f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:35.637908 12998 raft_consensus.cc:697] T 41a081ffb7f74fe598b4689f85e3f19d P e9591e45f9b241f09c8367c42be07b4f [term 3 LEADER]: Becoming Leader. State: Replica: e9591e45f9b241f09c8367c42be07b4f, State: Running, Role: LEADER
I20260709 12:08:35.638943 12998 consensus_queue.cc:237] T 41a081ffb7f74fe598b4689f85e3f19d P e9591e45f9b241f09c8367c42be07b4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:35.646840 12546 catalog_manager.cc:5697] T 41a081ffb7f74fe598b4689f85e3f19d P e9591e45f9b241f09c8367c42be07b4f reported cstate change: term changed from 2 to 3, leader changed from 6a2c895eab0c40d6b22be18ca84fed16 (127.12.56.194) to e9591e45f9b241f09c8367c42be07b4f (127.12.56.193). New cstate: current_term: 3 leader_uuid: "e9591e45f9b241f09c8367c42be07b4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:35.674423 12993 raft_consensus.cc:993] T 4077af80765d460586125b4f312f5cfb P 6a2c895eab0c40d6b22be18ca84fed16: : Instructing follower 034d7c10edb342ab936e590793980fc0 to start an election
I20260709 12:08:35.675086 12994 raft_consensus.cc:1081] T 4077af80765d460586125b4f312f5cfb P 6a2c895eab0c40d6b22be18ca84fed16 [term 4 LEADER]: Signalling peer 034d7c10edb342ab936e590793980fc0 to start an election
I20260709 12:08:35.677143 12794 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4077af80765d460586125b4f312f5cfb"
dest_uuid: "034d7c10edb342ab936e590793980fc0"
 from {username='slave'} at 127.0.0.1:48416
I20260709 12:08:35.677636 12794 raft_consensus.cc:493] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:35.678009 12794 raft_consensus.cc:3060] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:08:35.682611 12794 raft_consensus.cc:515] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:35.684374 12794 leader_election.cc:290] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0 [CANDIDATE]: Term 5 election: Requested vote from peers e9591e45f9b241f09c8367c42be07b4f (127.12.56.193:35963), 6a2c895eab0c40d6b22be18ca84fed16 (127.12.56.194:46297)
I20260709 12:08:35.685326 12723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4077af80765d460586125b4f312f5cfb" candidate_uuid: "034d7c10edb342ab936e590793980fc0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "6a2c895eab0c40d6b22be18ca84fed16"
I20260709 12:08:35.685258 12647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4077af80765d460586125b4f312f5cfb" candidate_uuid: "034d7c10edb342ab936e590793980fc0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "e9591e45f9b241f09c8367c42be07b4f"
I20260709 12:08:35.686133 12647 raft_consensus.cc:3060] T 4077af80765d460586125b4f312f5cfb P e9591e45f9b241f09c8367c42be07b4f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:08:35.686703 12723 raft_consensus.cc:3055] T 4077af80765d460586125b4f312f5cfb P 6a2c895eab0c40d6b22be18ca84fed16 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:08:35.687019 12723 raft_consensus.cc:740] T 4077af80765d460586125b4f312f5cfb P 6a2c895eab0c40d6b22be18ca84fed16 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6a2c895eab0c40d6b22be18ca84fed16, State: Running, Role: LEADER
I20260709 12:08:35.687708 12723 consensus_queue.cc:260] T 4077af80765d460586125b4f312f5cfb P 6a2c895eab0c40d6b22be18ca84fed16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:35.688568 12723 raft_consensus.cc:3060] T 4077af80765d460586125b4f312f5cfb P 6a2c895eab0c40d6b22be18ca84fed16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:08:35.691866 12647 raft_consensus.cc:2468] T 4077af80765d460586125b4f312f5cfb P e9591e45f9b241f09c8367c42be07b4f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 034d7c10edb342ab936e590793980fc0 in term 5.
I20260709 12:08:35.693200 12764 leader_election.cc:304] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 034d7c10edb342ab936e590793980fc0, e9591e45f9b241f09c8367c42be07b4f; no voters: 
I20260709 12:08:35.693439 12723 raft_consensus.cc:2468] T 4077af80765d460586125b4f312f5cfb P 6a2c895eab0c40d6b22be18ca84fed16 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 034d7c10edb342ab936e590793980fc0 in term 5.
I20260709 12:08:35.693965 12996 raft_consensus.cc:2804] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:08:35.694505 12996 raft_consensus.cc:697] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0 [term 5 LEADER]: Becoming Leader. State: Replica: 034d7c10edb342ab936e590793980fc0, State: Running, Role: LEADER
I20260709 12:08:35.695436 12996 consensus_queue.cc:237] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } }
I20260709 12:08:35.703294 12546 catalog_manager.cc:5697] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0 reported cstate change: term changed from 4 to 5, leader changed from 6a2c895eab0c40d6b22be18ca84fed16 (127.12.56.194) to 034d7c10edb342ab936e590793980fc0 (127.12.56.195). New cstate: current_term: 5 leader_uuid: "034d7c10edb342ab936e590793980fc0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 } health_report { overall_health: HEALTHY } } }
W20260709 12:08:35.898196 12671 debug-util.cc:398] Leaking SignalData structure 0x7b08000e5060 after lost signal to thread 12518
W20260709 12:08:35.899161 12671 debug-util.cc:398] Leaking SignalData structure 0x7b08000e5740 after lost signal to thread 12581
W20260709 12:08:35.900218 12671 debug-util.cc:398] Leaking SignalData structure 0x7b08001ca180 after lost signal to thread 12674
W20260709 12:08:35.901007 12671 debug-util.cc:398] Leaking SignalData structure 0x7b08000d2a80 after lost signal to thread 12749
W20260709 12:08:35.901820 12671 debug-util.cc:398] Leaking SignalData structure 0x7b08001cdfe0 after lost signal to thread 12823
I20260709 12:08:35.963567 12794 raft_consensus.cc:1275] T 155e9b7aa7aa40a587d743d6a30ccf7e P 034d7c10edb342ab936e590793980fc0 [term 5 FOLLOWER]: Refusing update from remote peer e9591e45f9b241f09c8367c42be07b4f: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:08:35.965560 12998 consensus_queue.cc:1048] T 155e9b7aa7aa40a587d743d6a30ccf7e P e9591e45f9b241f09c8367c42be07b4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:08:35.969977 12723 raft_consensus.cc:1275] T efe4e5e9a1b54e3987e81561775a89d6 P 6a2c895eab0c40d6b22be18ca84fed16 [term 4 FOLLOWER]: Refusing update from remote peer 034d7c10edb342ab936e590793980fc0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:35.973626 12996 consensus_queue.cc:1048] T efe4e5e9a1b54e3987e81561775a89d6 P 034d7c10edb342ab936e590793980fc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:08:35.985669 12724 raft_consensus.cc:1275] T 155e9b7aa7aa40a587d743d6a30ccf7e P 6a2c895eab0c40d6b22be18ca84fed16 [term 5 FOLLOWER]: Refusing update from remote peer e9591e45f9b241f09c8367c42be07b4f: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:08:35.987782 12997 consensus_queue.cc:1048] T 155e9b7aa7aa40a587d743d6a30ccf7e P e9591e45f9b241f09c8367c42be07b4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:08:36.029227 12647 raft_consensus.cc:1275] T efe4e5e9a1b54e3987e81561775a89d6 P e9591e45f9b241f09c8367c42be07b4f [term 4 FOLLOWER]: Refusing update from remote peer 034d7c10edb342ab936e590793980fc0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:36.030803 12963 consensus_queue.cc:1048] T efe4e5e9a1b54e3987e81561775a89d6 P 034d7c10edb342ab936e590793980fc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:08:36.072499 12794 raft_consensus.cc:1275] T 5957ce50d01e4214bc908e402a78a32e P 034d7c10edb342ab936e590793980fc0 [term 4 FOLLOWER]: Refusing update from remote peer e9591e45f9b241f09c8367c42be07b4f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:36.074360 12997 consensus_queue.cc:1048] T 5957ce50d01e4214bc908e402a78a32e P e9591e45f9b241f09c8367c42be07b4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:08:36.086694 12724 raft_consensus.cc:1275] T 5957ce50d01e4214bc908e402a78a32e P 6a2c895eab0c40d6b22be18ca84fed16 [term 4 FOLLOWER]: Refusing update from remote peer e9591e45f9b241f09c8367c42be07b4f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:36.088265 12998 consensus_queue.cc:1048] T 5957ce50d01e4214bc908e402a78a32e P e9591e45f9b241f09c8367c42be07b4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:08:36.105242 12794 raft_consensus.cc:1275] T 41a081ffb7f74fe598b4689f85e3f19d P 034d7c10edb342ab936e590793980fc0 [term 3 FOLLOWER]: Refusing update from remote peer e9591e45f9b241f09c8367c42be07b4f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:36.106961 13000 consensus_queue.cc:1048] T 41a081ffb7f74fe598b4689f85e3f19d P e9591e45f9b241f09c8367c42be07b4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "034d7c10edb342ab936e590793980fc0" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:36.111358 12724 raft_consensus.cc:1275] T 41a081ffb7f74fe598b4689f85e3f19d P 6a2c895eab0c40d6b22be18ca84fed16 [term 3 FOLLOWER]: Refusing update from remote peer e9591e45f9b241f09c8367c42be07b4f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:36.114468 13000 consensus_queue.cc:1048] T 41a081ffb7f74fe598b4689f85e3f19d P e9591e45f9b241f09c8367c42be07b4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:08:36.214751 12647 raft_consensus.cc:1275] T 4077af80765d460586125b4f312f5cfb P e9591e45f9b241f09c8367c42be07b4f [term 5 FOLLOWER]: Refusing update from remote peer 034d7c10edb342ab936e590793980fc0: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:08:36.216121 12963 consensus_queue.cc:1048] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9591e45f9b241f09c8367c42be07b4f" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:08:36.223198 12724 raft_consensus.cc:1275] T 4077af80765d460586125b4f312f5cfb P 6a2c895eab0c40d6b22be18ca84fed16 [term 5 FOLLOWER]: Refusing update from remote peer 034d7c10edb342ab936e590793980fc0: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:08:36.227924 12996 consensus_queue.cc:1048] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a2c895eab0c40d6b22be18ca84fed16" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 46297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:08:36.360474 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:36.366330 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:36.366839 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:37.367925 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:37.372915 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:37.373382 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:38.374519 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:38.379580 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:38.380051 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:39.381278 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:39.386994 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:39.387465 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:40.388703 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:40.394176 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:40.394681 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:41.395998 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:41.401531 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:41.402061 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:42.403540 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:42.408834 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:42.409320 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:43.410530 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:43.415705 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:43.416159 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:44.417383 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:44.423571 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:44.424043 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:45.468210 12515 auto_leader_rebalancer-test.cc:340] The leader distribution is 
I20260709 12:08:45.468899 12515 tablet_server.cc:179] TabletServer@127.12.56.193:0 shutting down...
I20260709 12:08:45.520957 12515 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:08:45.521988 12515 tablet_replica.cc:333] T b4669889b41c4e0f8e3e35cd4fde8736 P e9591e45f9b241f09c8367c42be07b4f: stopping tablet replica
I20260709 12:08:45.523178 12515 raft_consensus.cc:2243] T b4669889b41c4e0f8e3e35cd4fde8736 P e9591e45f9b241f09c8367c42be07b4f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.523986 12515 raft_consensus.cc:2272] T b4669889b41c4e0f8e3e35cd4fde8736 P e9591e45f9b241f09c8367c42be07b4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.526393 12515 tablet_replica.cc:333] T d6f93f92c31a40318d4b51b090c5209b P e9591e45f9b241f09c8367c42be07b4f: stopping tablet replica
I20260709 12:08:45.526921 12515 raft_consensus.cc:2243] T d6f93f92c31a40318d4b51b090c5209b P e9591e45f9b241f09c8367c42be07b4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.527405 12515 raft_consensus.cc:2272] T d6f93f92c31a40318d4b51b090c5209b P e9591e45f9b241f09c8367c42be07b4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.529170 12515 tablet_replica.cc:333] T 41a081ffb7f74fe598b4689f85e3f19d P e9591e45f9b241f09c8367c42be07b4f: stopping tablet replica
I20260709 12:08:45.529698 12515 raft_consensus.cc:2243] T 41a081ffb7f74fe598b4689f85e3f19d P e9591e45f9b241f09c8367c42be07b4f [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:08:45.530589 12515 raft_consensus.cc:2272] T 41a081ffb7f74fe598b4689f85e3f19d P e9591e45f9b241f09c8367c42be07b4f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.532423 12515 tablet_replica.cc:333] T 6a014226736c4b259b23ca9932bbef77 P e9591e45f9b241f09c8367c42be07b4f: stopping tablet replica
I20260709 12:08:45.532994 12515 raft_consensus.cc:2243] T 6a014226736c4b259b23ca9932bbef77 P e9591e45f9b241f09c8367c42be07b4f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.533459 12515 raft_consensus.cc:2272] T 6a014226736c4b259b23ca9932bbef77 P e9591e45f9b241f09c8367c42be07b4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.535290 12515 tablet_replica.cc:333] T d8698d4730834dc582e8564c0a98eb86 P e9591e45f9b241f09c8367c42be07b4f: stopping tablet replica
I20260709 12:08:45.535771 12515 raft_consensus.cc:2243] T d8698d4730834dc582e8564c0a98eb86 P e9591e45f9b241f09c8367c42be07b4f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.536198 12515 raft_consensus.cc:2272] T d8698d4730834dc582e8564c0a98eb86 P e9591e45f9b241f09c8367c42be07b4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.537894 12515 tablet_replica.cc:333] T 5957ce50d01e4214bc908e402a78a32e P e9591e45f9b241f09c8367c42be07b4f: stopping tablet replica
I20260709 12:08:45.538452 12515 raft_consensus.cc:2243] T 5957ce50d01e4214bc908e402a78a32e P e9591e45f9b241f09c8367c42be07b4f [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:08:45.539295 12515 raft_consensus.cc:2272] T 5957ce50d01e4214bc908e402a78a32e P e9591e45f9b241f09c8367c42be07b4f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.541296 12515 tablet_replica.cc:333] T 4077af80765d460586125b4f312f5cfb P e9591e45f9b241f09c8367c42be07b4f: stopping tablet replica
I20260709 12:08:45.541872 12515 raft_consensus.cc:2243] T 4077af80765d460586125b4f312f5cfb P e9591e45f9b241f09c8367c42be07b4f [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.542388 12515 raft_consensus.cc:2272] T 4077af80765d460586125b4f312f5cfb P e9591e45f9b241f09c8367c42be07b4f [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.544137 12515 tablet_replica.cc:333] T 155e9b7aa7aa40a587d743d6a30ccf7e P e9591e45f9b241f09c8367c42be07b4f: stopping tablet replica
I20260709 12:08:45.544627 12515 raft_consensus.cc:2243] T 155e9b7aa7aa40a587d743d6a30ccf7e P e9591e45f9b241f09c8367c42be07b4f [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:08:45.545476 12515 raft_consensus.cc:2272] T 155e9b7aa7aa40a587d743d6a30ccf7e P e9591e45f9b241f09c8367c42be07b4f [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.547317 12515 tablet_replica.cc:333] T efe4e5e9a1b54e3987e81561775a89d6 P e9591e45f9b241f09c8367c42be07b4f: stopping tablet replica
I20260709 12:08:45.547821 12515 raft_consensus.cc:2243] T efe4e5e9a1b54e3987e81561775a89d6 P e9591e45f9b241f09c8367c42be07b4f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.548301 12515 raft_consensus.cc:2272] T efe4e5e9a1b54e3987e81561775a89d6 P e9591e45f9b241f09c8367c42be07b4f [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:08:45.559182 12764 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:08:45.563162 12764 consensus_peers.cc:597] T d6f93f92c31a40318d4b51b090c5209b P 034d7c10edb342ab936e590793980fc0 -> Peer e9591e45f9b241f09c8367c42be07b4f (127.12.56.193:35963): Couldn't send request to peer e9591e45f9b241f09c8367c42be07b4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:08:45.564833 12614 connection.cc:466] server connection from 127.0.0.1:50106 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50106 (request call id 174) could send its response
W20260709 12:08:45.650763 12764 consensus_peers.cc:597] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0 -> Peer e9591e45f9b241f09c8367c42be07b4f (127.12.56.193:35963): Couldn't send request to peer e9591e45f9b241f09c8367c42be07b4f. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:35963: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:08:45.654783 12690 consensus_peers.cc:597] T b4669889b41c4e0f8e3e35cd4fde8736 P 6a2c895eab0c40d6b22be18ca84fed16 -> Peer e9591e45f9b241f09c8367c42be07b4f (127.12.56.193:35963): Couldn't send request to peer e9591e45f9b241f09c8367c42be07b4f. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:35963: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:08:45.675096 12515 tablet_server.cc:196] TabletServer@127.12.56.193:0 shutdown complete.
W20260709 12:08:45.694754 12764 consensus_peers.cc:597] T efe4e5e9a1b54e3987e81561775a89d6 P 034d7c10edb342ab936e590793980fc0 -> Peer e9591e45f9b241f09c8367c42be07b4f (127.12.56.193:35963): Couldn't send request to peer e9591e45f9b241f09c8367c42be07b4f. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:35963: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:08:45.698966 12515 tablet_server.cc:179] TabletServer@127.12.56.194:0 shutting down...
I20260709 12:08:45.730603 12515 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:08:45.731542 12515 tablet_replica.cc:333] T 5957ce50d01e4214bc908e402a78a32e P 6a2c895eab0c40d6b22be18ca84fed16: stopping tablet replica
I20260709 12:08:45.732630 12515 raft_consensus.cc:2243] T 5957ce50d01e4214bc908e402a78a32e P 6a2c895eab0c40d6b22be18ca84fed16 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.733382 12515 raft_consensus.cc:2272] T 5957ce50d01e4214bc908e402a78a32e P 6a2c895eab0c40d6b22be18ca84fed16 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.735546 12515 tablet_replica.cc:333] T 4077af80765d460586125b4f312f5cfb P 6a2c895eab0c40d6b22be18ca84fed16: stopping tablet replica
I20260709 12:08:45.736441 12515 raft_consensus.cc:2243] T 4077af80765d460586125b4f312f5cfb P 6a2c895eab0c40d6b22be18ca84fed16 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.737057 12515 raft_consensus.cc:2272] T 4077af80765d460586125b4f312f5cfb P 6a2c895eab0c40d6b22be18ca84fed16 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.739802 12515 tablet_replica.cc:333] T 41a081ffb7f74fe598b4689f85e3f19d P 6a2c895eab0c40d6b22be18ca84fed16: stopping tablet replica
W20260709 12:08:45.740487 12764 consensus_peers.cc:597] T d6f93f92c31a40318d4b51b090c5209b P 034d7c10edb342ab936e590793980fc0 -> Peer 6a2c895eab0c40d6b22be18ca84fed16 (127.12.56.194:46297): Couldn't send request to peer 6a2c895eab0c40d6b22be18ca84fed16. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:08:45.740569 12515 raft_consensus.cc:2243] T 41a081ffb7f74fe598b4689f85e3f19d P 6a2c895eab0c40d6b22be18ca84fed16 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.741261 12515 raft_consensus.cc:2272] T 41a081ffb7f74fe598b4689f85e3f19d P 6a2c895eab0c40d6b22be18ca84fed16 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.743353 12515 tablet_replica.cc:333] T d6f93f92c31a40318d4b51b090c5209b P 6a2c895eab0c40d6b22be18ca84fed16: stopping tablet replica
I20260709 12:08:45.744024 12515 raft_consensus.cc:2243] T d6f93f92c31a40318d4b51b090c5209b P 6a2c895eab0c40d6b22be18ca84fed16 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.744593 12515 raft_consensus.cc:2272] T d6f93f92c31a40318d4b51b090c5209b P 6a2c895eab0c40d6b22be18ca84fed16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.747053 12515 tablet_replica.cc:333] T 155e9b7aa7aa40a587d743d6a30ccf7e P 6a2c895eab0c40d6b22be18ca84fed16: stopping tablet replica
I20260709 12:08:45.747627 12515 raft_consensus.cc:2243] T 155e9b7aa7aa40a587d743d6a30ccf7e P 6a2c895eab0c40d6b22be18ca84fed16 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.748167 12515 raft_consensus.cc:2272] T 155e9b7aa7aa40a587d743d6a30ccf7e P 6a2c895eab0c40d6b22be18ca84fed16 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.750042 12515 tablet_replica.cc:333] T efe4e5e9a1b54e3987e81561775a89d6 P 6a2c895eab0c40d6b22be18ca84fed16: stopping tablet replica
I20260709 12:08:45.750577 12515 raft_consensus.cc:2243] T efe4e5e9a1b54e3987e81561775a89d6 P 6a2c895eab0c40d6b22be18ca84fed16 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.751065 12515 raft_consensus.cc:2272] T efe4e5e9a1b54e3987e81561775a89d6 P 6a2c895eab0c40d6b22be18ca84fed16 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.752784 12515 tablet_replica.cc:333] T 6a014226736c4b259b23ca9932bbef77 P 6a2c895eab0c40d6b22be18ca84fed16: stopping tablet replica
I20260709 12:08:45.753325 12515 raft_consensus.cc:2243] T 6a014226736c4b259b23ca9932bbef77 P 6a2c895eab0c40d6b22be18ca84fed16 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:08:45.754243 12515 raft_consensus.cc:2272] T 6a014226736c4b259b23ca9932bbef77 P 6a2c895eab0c40d6b22be18ca84fed16 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.755952 12515 tablet_replica.cc:333] T d8698d4730834dc582e8564c0a98eb86 P 6a2c895eab0c40d6b22be18ca84fed16: stopping tablet replica
I20260709 12:08:45.756419 12515 raft_consensus.cc:2243] T d8698d4730834dc582e8564c0a98eb86 P 6a2c895eab0c40d6b22be18ca84fed16 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:08:45.757201 12515 raft_consensus.cc:2272] T d8698d4730834dc582e8564c0a98eb86 P 6a2c895eab0c40d6b22be18ca84fed16 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.758929 12515 tablet_replica.cc:333] T b4669889b41c4e0f8e3e35cd4fde8736 P 6a2c895eab0c40d6b22be18ca84fed16: stopping tablet replica
I20260709 12:08:45.759407 12515 raft_consensus.cc:2243] T b4669889b41c4e0f8e3e35cd4fde8736 P 6a2c895eab0c40d6b22be18ca84fed16 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:08:45.760201 12515 raft_consensus.cc:2272] T b4669889b41c4e0f8e3e35cd4fde8736 P 6a2c895eab0c40d6b22be18ca84fed16 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.791397 12515 tablet_server.cc:196] TabletServer@127.12.56.194:0 shutdown complete.
I20260709 12:08:45.813201 12515 tablet_server.cc:179] TabletServer@127.12.56.195:0 shutting down...
I20260709 12:08:45.843056 12515 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:08:45.843866 12515 tablet_replica.cc:333] T b4669889b41c4e0f8e3e35cd4fde8736 P 034d7c10edb342ab936e590793980fc0: stopping tablet replica
I20260709 12:08:45.844645 12515 raft_consensus.cc:2243] T b4669889b41c4e0f8e3e35cd4fde8736 P 034d7c10edb342ab936e590793980fc0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.845184 12515 raft_consensus.cc:2272] T b4669889b41c4e0f8e3e35cd4fde8736 P 034d7c10edb342ab936e590793980fc0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.847247 12515 tablet_replica.cc:333] T 5957ce50d01e4214bc908e402a78a32e P 034d7c10edb342ab936e590793980fc0: stopping tablet replica
I20260709 12:08:45.847805 12515 raft_consensus.cc:2243] T 5957ce50d01e4214bc908e402a78a32e P 034d7c10edb342ab936e590793980fc0 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.848416 12515 raft_consensus.cc:2272] T 5957ce50d01e4214bc908e402a78a32e P 034d7c10edb342ab936e590793980fc0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.850458 12515 tablet_replica.cc:333] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0: stopping tablet replica
I20260709 12:08:45.851048 12515 raft_consensus.cc:2243] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:08:45.852083 12515 raft_consensus.cc:2272] T 4077af80765d460586125b4f312f5cfb P 034d7c10edb342ab936e590793980fc0 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.854084 12515 tablet_replica.cc:333] T 155e9b7aa7aa40a587d743d6a30ccf7e P 034d7c10edb342ab936e590793980fc0: stopping tablet replica
I20260709 12:08:45.854652 12515 raft_consensus.cc:2243] T 155e9b7aa7aa40a587d743d6a30ccf7e P 034d7c10edb342ab936e590793980fc0 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.855159 12515 raft_consensus.cc:2272] T 155e9b7aa7aa40a587d743d6a30ccf7e P 034d7c10edb342ab936e590793980fc0 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.857009 12515 tablet_replica.cc:333] T efe4e5e9a1b54e3987e81561775a89d6 P 034d7c10edb342ab936e590793980fc0: stopping tablet replica
I20260709 12:08:45.857658 12515 raft_consensus.cc:2243] T efe4e5e9a1b54e3987e81561775a89d6 P 034d7c10edb342ab936e590793980fc0 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:08:45.858548 12515 raft_consensus.cc:2272] T efe4e5e9a1b54e3987e81561775a89d6 P 034d7c10edb342ab936e590793980fc0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.860368 12515 tablet_replica.cc:333] T d6f93f92c31a40318d4b51b090c5209b P 034d7c10edb342ab936e590793980fc0: stopping tablet replica
I20260709 12:08:45.860894 12515 raft_consensus.cc:2243] T d6f93f92c31a40318d4b51b090c5209b P 034d7c10edb342ab936e590793980fc0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:08:45.861910 12515 raft_consensus.cc:2272] T d6f93f92c31a40318d4b51b090c5209b P 034d7c10edb342ab936e590793980fc0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.863842 12515 tablet_replica.cc:333] T 41a081ffb7f74fe598b4689f85e3f19d P 034d7c10edb342ab936e590793980fc0: stopping tablet replica
I20260709 12:08:45.864459 12515 raft_consensus.cc:2243] T 41a081ffb7f74fe598b4689f85e3f19d P 034d7c10edb342ab936e590793980fc0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.864964 12515 raft_consensus.cc:2272] T 41a081ffb7f74fe598b4689f85e3f19d P 034d7c10edb342ab936e590793980fc0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.866971 12515 tablet_replica.cc:333] T 6a014226736c4b259b23ca9932bbef77 P 034d7c10edb342ab936e590793980fc0: stopping tablet replica
I20260709 12:08:45.867573 12515 raft_consensus.cc:2243] T 6a014226736c4b259b23ca9932bbef77 P 034d7c10edb342ab936e590793980fc0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.868069 12515 raft_consensus.cc:2272] T 6a014226736c4b259b23ca9932bbef77 P 034d7c10edb342ab936e590793980fc0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.869910 12515 tablet_replica.cc:333] T d8698d4730834dc582e8564c0a98eb86 P 034d7c10edb342ab936e590793980fc0: stopping tablet replica
I20260709 12:08:45.870417 12515 raft_consensus.cc:2243] T d8698d4730834dc582e8564c0a98eb86 P 034d7c10edb342ab936e590793980fc0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.870877 12515 raft_consensus.cc:2272] T d8698d4730834dc582e8564c0a98eb86 P 034d7c10edb342ab936e590793980fc0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.900538 12515 tablet_server.cc:196] TabletServer@127.12.56.195:0 shutdown complete.
I20260709 12:08:45.920739 12515 master.cc:562] Master@127.12.56.254:44149 shutting down...
I20260709 12:08:46.113569 12515 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 8f1b96eeb4054e82beab9d1faded0ec4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:08:46.114358 12515 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 8f1b96eeb4054e82beab9d1faded0ec4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.114741 12515 tablet_replica.cc:333] T 00000000000000000000000000000000 P 8f1b96eeb4054e82beab9d1faded0ec4: stopping tablet replica
I20260709 12:08:46.137173 12515 master.cc:584] Master@127.12.56.254:44149 shutdown complete.
034d7c10edb342ab936e590793980fc0  1
6a2c895eab0c40d6b22be18ca84fed16  4
e9591e45f9b241f09c8367c42be07b4f  4
034d7c10edb342ab936e590793980fc0  3
6a2c895eab0c40d6b22be18ca84fed16  3
e9591e45f9b241f09c8367c42be07b4f  3
034d7c10edb342ab936e590793980fc0  1
6a2c895eab0c40d6b22be18ca84fed16  8
e9591e45f9b241f09c8367c42be07b4f  0
034d7c10edb342ab936e590793980fc0  3
6a2c895eab0c40d6b22be18ca84fed16  3
e9591e45f9b241f09c8367c42be07b4f  3
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (31303 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:08:46.183694 12515 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.12.56.254:33517
I20260709 12:08:46.184984 12515 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:46.191638 13040 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:46.192698 13043 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:46.192924 13041 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:46.193408 12515 server_base.cc:1061] running on GCE node
I20260709 12:08:46.195796 12515 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:46.196050 12515 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:46.196245 12515 hybrid_clock.cc:648] HybridClock initialized: now 1783598926196227 us; error 0 us; skew 500 ppm
I20260709 12:08:46.196841 12515 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:46.199847 12515 webserver.cc:533] Webserver started at http://127.12.56.254:44431/ using document root <none> and password file <none>
I20260709 12:08:46.200387 12515 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:46.200598 12515 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:46.200888 12515 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:46.202282 12515 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894707649-12515-0/minicluster-data/master-0-root/instance:
uuid: "2e15c6519d0a439f80d0167dfe9b9499"
format_stamp: "Formatted at 2026-07-09 12:08:46 on dist-test-slave-705g"
I20260709 12:08:46.207213 12515 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:08:46.211169 13048 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:46.212123 12515 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 12:08:46.212400 12515 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894707649-12515-0/minicluster-data/master-0-root
uuid: "2e15c6519d0a439f80d0167dfe9b9499"
format_stamp: "Formatted at 2026-07-09 12:08:46 on dist-test-slave-705g"
I20260709 12:08:46.212647 12515 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894707649-12515-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894707649-12515-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894707649-12515-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:46.252224 12515 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:46.253646 12515 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:46.298655 12515 rpc_server.cc:307] RPC server started. Bound to: 127.12.56.254:33517
I20260709 12:08:46.298795 13099 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.56.254:33517 every 8 connection(s)
I20260709 12:08:46.303086 13100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.314517 13100 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e15c6519d0a439f80d0167dfe9b9499: Bootstrap starting.
I20260709 12:08:46.320066 13100 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2e15c6519d0a439f80d0167dfe9b9499: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:46.325035 13100 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e15c6519d0a439f80d0167dfe9b9499: No bootstrap required, opened a new log
I20260709 12:08:46.327316 13100 raft_consensus.cc:359] T 00000000000000000000000000000000 P 2e15c6519d0a439f80d0167dfe9b9499 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e15c6519d0a439f80d0167dfe9b9499" member_type: VOTER }
I20260709 12:08:46.327811 13100 raft_consensus.cc:385] T 00000000000000000000000000000000 P 2e15c6519d0a439f80d0167dfe9b9499 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:46.328107 13100 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2e15c6519d0a439f80d0167dfe9b9499 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e15c6519d0a439f80d0167dfe9b9499, State: Initialized, Role: FOLLOWER
I20260709 12:08:46.328683 13100 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2e15c6519d0a439f80d0167dfe9b9499 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e15c6519d0a439f80d0167dfe9b9499" member_type: VOTER }
I20260709 12:08:46.329150 13100 raft_consensus.cc:399] T 00000000000000000000000000000000 P 2e15c6519d0a439f80d0167dfe9b9499 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:08:46.329442 13100 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2e15c6519d0a439f80d0167dfe9b9499 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:08:46.329747 13100 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2e15c6519d0a439f80d0167dfe9b9499 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:46.333757 13100 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2e15c6519d0a439f80d0167dfe9b9499 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e15c6519d0a439f80d0167dfe9b9499" member_type: VOTER }
I20260709 12:08:46.334403 13100 leader_election.cc:304] T 00000000000000000000000000000000 P 2e15c6519d0a439f80d0167dfe9b9499 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2e15c6519d0a439f80d0167dfe9b9499; no voters: 
I20260709 12:08:46.335562 13100 leader_election.cc:290] T 00000000000000000000000000000000 P 2e15c6519d0a439f80d0167dfe9b9499 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:08:46.336074 13103 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 2e15c6519d0a439f80d0167dfe9b9499 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:46.337462 13103 raft_consensus.cc:697] T 00000000000000000000000000000000 P 2e15c6519d0a439f80d0167dfe9b9499 [term 1 LEADER]: Becoming Leader. State: Replica: 2e15c6519d0a439f80d0167dfe9b9499, State: Running, Role: LEADER
I20260709 12:08:46.338291 13103 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2e15c6519d0a439f80d0167dfe9b9499 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e15c6519d0a439f80d0167dfe9b9499" member_type: VOTER }
I20260709 12:08:46.339286 13100 sys_catalog.cc:565] T 00000000000000000000000000000000 P 2e15c6519d0a439f80d0167dfe9b9499 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:08:46.344175 13105 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e15c6519d0a439f80d0167dfe9b9499 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2e15c6519d0a439f80d0167dfe9b9499. Latest consensus state: current_term: 1 leader_uuid: "2e15c6519d0a439f80d0167dfe9b9499" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e15c6519d0a439f80d0167dfe9b9499" member_type: VOTER } }
I20260709 12:08:46.345027 13105 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e15c6519d0a439f80d0167dfe9b9499 [sys.catalog]: This master's current role is: LEADER
I20260709 12:08:46.344209 13104 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e15c6519d0a439f80d0167dfe9b9499 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2e15c6519d0a439f80d0167dfe9b9499" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e15c6519d0a439f80d0167dfe9b9499" member_type: VOTER } }
I20260709 12:08:46.347115 13104 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e15c6519d0a439f80d0167dfe9b9499 [sys.catalog]: This master's current role is: LEADER
I20260709 12:08:46.347426 13111 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:08:46.353143 13111 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:08:46.358530 12515 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:08:46.363807 13111 catalog_manager.cc:1383] Generated new cluster ID: c0bf7f1d7da04837985c5219ab0cf09a
I20260709 12:08:46.364176 13111 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:08:46.392979 13111 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:08:46.394374 13111 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:08:46.414438 13111 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 2e15c6519d0a439f80d0167dfe9b9499: Generated new TSK 0
I20260709 12:08:46.415115 13111 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:08:46.429462 12515 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:46.436272 13121 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:46.437335 13122 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:46.440476 13124 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:46.441588 12515 server_base.cc:1061] running on GCE node
I20260709 12:08:46.443078 12515 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:46.443281 12515 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:46.443439 12515 hybrid_clock.cc:648] HybridClock initialized: now 1783598926443395 us; error 0 us; skew 500 ppm
I20260709 12:08:46.443943 12515 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:46.446761 12515 webserver.cc:533] Webserver started at http://127.12.56.193:42519/ using document root <none> and password file <none>
I20260709 12:08:46.447250 12515 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:46.447417 12515 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:46.447630 12515 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:46.448963 12515 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894707649-12515-0/minicluster-data/ts-0-root/instance:
uuid: "1badc676cc734a90900be6af887e027a"
format_stamp: "Formatted at 2026-07-09 12:08:46 on dist-test-slave-705g"
I20260709 12:08:46.454458 12515 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:08:46.458199 13129 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:46.459131 12515 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 12:08:46.459542 12515 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894707649-12515-0/minicluster-data/ts-0-root
uuid: "1badc676cc734a90900be6af887e027a"
format_stamp: "Formatted at 2026-07-09 12:08:46 on dist-test-slave-705g"
I20260709 12:08:46.459836 12515 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894707649-12515-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894707649-12515-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894707649-12515-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:46.490440 12515 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:46.491779 12515 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:46.493474 12515 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:46.495960 12515 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:46.496168 12515 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:46.496385 12515 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:46.496836 12515 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:46.545063 12515 rpc_server.cc:307] RPC server started. Bound to: 127.12.56.193:36691
I20260709 12:08:46.545208 13191 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.56.193:36691 every 8 connection(s)
I20260709 12:08:46.550657 12515 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:46.559527 13196 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:46.560777 13197 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:46.565482 12515 server_base.cc:1061] running on GCE node
W20260709 12:08:46.566416 13200 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:46.567636 12515 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:46.567901 12515 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:46.568151 12515 hybrid_clock.cc:648] HybridClock initialized: now 1783598926568131 us; error 0 us; skew 500 ppm
I20260709 12:08:46.568356 13192 heartbeater.cc:344] Connected to a master server at 127.12.56.254:33517
I20260709 12:08:46.568785 13192 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:46.568830 12515 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:46.569875 13192 heartbeater.cc:507] Master 127.12.56.254:33517 requested a full tablet report, sending...
I20260709 12:08:46.572177 12515 webserver.cc:533] Webserver started at http://127.12.56.194:37101/ using document root <none> and password file <none>
I20260709 12:08:46.572206 13065 ts_manager.cc:194] Registered new tserver with Master: 1badc676cc734a90900be6af887e027a (127.12.56.193:36691)
I20260709 12:08:46.573042 12515 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:46.573428 12515 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:46.573763 12515 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:46.574714 13065 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53492
I20260709 12:08:46.575158 12515 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894707649-12515-0/minicluster-data/ts-1-root/instance:
uuid: "2768c30a298e46b784868aea92ffdb0d"
format_stamp: "Formatted at 2026-07-09 12:08:46 on dist-test-slave-705g"
I20260709 12:08:46.580617 12515 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:08:46.584471 13204 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:46.585263 12515 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:08:46.585564 12515 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894707649-12515-0/minicluster-data/ts-1-root
uuid: "2768c30a298e46b784868aea92ffdb0d"
format_stamp: "Formatted at 2026-07-09 12:08:46 on dist-test-slave-705g"
I20260709 12:08:46.585951 12515 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894707649-12515-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894707649-12515-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894707649-12515-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:46.609699 12515 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:46.611148 12515 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:46.612871 12515 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:46.615422 12515 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:46.615684 12515 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:46.615959 12515 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:46.616164 12515 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:46.663576 12515 rpc_server.cc:307] RPC server started. Bound to: 127.12.56.194:37951
I20260709 12:08:46.663730 13266 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.56.194:37951 every 8 connection(s)
I20260709 12:08:46.669081 12515 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:46.677070 13270 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:46.679345 13271 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:46.680964 13273 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:46.682111 12515 server_base.cc:1061] running on GCE node
I20260709 12:08:46.683231 12515 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:08:46.683432 13267 heartbeater.cc:344] Connected to a master server at 127.12.56.254:33517
W20260709 12:08:46.683573 12515 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:46.683853 12515 hybrid_clock.cc:648] HybridClock initialized: now 1783598926683833 us; error 0 us; skew 500 ppm
I20260709 12:08:46.683893 13267 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:46.684544 12515 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:46.684878 13267 heartbeater.cc:507] Master 127.12.56.254:33517 requested a full tablet report, sending...
I20260709 12:08:46.687142 13065 ts_manager.cc:194] Registered new tserver with Master: 2768c30a298e46b784868aea92ffdb0d (127.12.56.194:37951)
I20260709 12:08:46.687521 12515 webserver.cc:533] Webserver started at http://127.12.56.195:38499/ using document root <none> and password file <none>
I20260709 12:08:46.688164 12515 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:46.688354 12515 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:46.688721 12515 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:46.688795 13065 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53494
I20260709 12:08:46.690270 12515 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894707649-12515-0/minicluster-data/ts-2-root/instance:
uuid: "da0f578f1d4541ada6f9aad99f761e8c"
format_stamp: "Formatted at 2026-07-09 12:08:46 on dist-test-slave-705g"
I20260709 12:08:46.695340 12515 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:08:46.699088 13278 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:46.699972 12515 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:08:46.700354 12515 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894707649-12515-0/minicluster-data/ts-2-root
uuid: "da0f578f1d4541ada6f9aad99f761e8c"
format_stamp: "Formatted at 2026-07-09 12:08:46 on dist-test-slave-705g"
I20260709 12:08:46.700709 12515 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894707649-12515-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894707649-12515-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894707649-12515-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:46.722254 12515 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:46.723692 12515 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:46.725184 12515 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:46.727886 12515 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:46.728170 12515 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:46.728462 12515 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:46.728662 12515 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:46.776064 12515 rpc_server.cc:307] RPC server started. Bound to: 127.12.56.195:40703
I20260709 12:08:46.776189 13340 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.56.195:40703 every 8 connection(s)
I20260709 12:08:46.792075 13341 heartbeater.cc:344] Connected to a master server at 127.12.56.254:33517
I20260709 12:08:46.792479 13341 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:46.793483 13341 heartbeater.cc:507] Master 127.12.56.254:33517 requested a full tablet report, sending...
I20260709 12:08:46.796012 13065 ts_manager.cc:194] Registered new tserver with Master: da0f578f1d4541ada6f9aad99f761e8c (127.12.56.195:40703)
I20260709 12:08:46.796514 12515 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016754588s
I20260709 12:08:46.797457 13065 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53502
I20260709 12:08:46.828327 13065 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53504:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:08:46.831498 13065 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:08:46.909621 13306 tablet_service.cc:1511] Processing CreateTablet for tablet 0548d800f00849639c60c9fc6a0b3b44 (DEFAULT_TABLE table=test-workload [id=f28ef9eed27c4c8f85f2ce7c74070397]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:08:46.911643 13306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0548d800f00849639c60c9fc6a0b3b44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.915226 13305 tablet_service.cc:1511] Processing CreateTablet for tablet c6d14c392db54aeca8c6ff936e6ea348 (DEFAULT_TABLE table=test-workload [id=f28ef9eed27c4c8f85f2ce7c74070397]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:08:46.916836 13305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6d14c392db54aeca8c6ff936e6ea348. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.920562 13304 tablet_service.cc:1511] Processing CreateTablet for tablet 05e69121e8b54b96bfd2863422f446b9 (DEFAULT_TABLE table=test-workload [id=f28ef9eed27c4c8f85f2ce7c74070397]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:08:46.924579 13304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05e69121e8b54b96bfd2863422f446b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.924332 13303 tablet_service.cc:1511] Processing CreateTablet for tablet 31db820ce3cc45e0bb5f3560f7cc60e4 (DEFAULT_TABLE table=test-workload [id=f28ef9eed27c4c8f85f2ce7c74070397]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:08:46.927067 13302 tablet_service.cc:1511] Processing CreateTablet for tablet 3db6a69f63d049fca47cec510aa05a89 (DEFAULT_TABLE table=test-workload [id=f28ef9eed27c4c8f85f2ce7c74070397]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:08:46.928894 13302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3db6a69f63d049fca47cec510aa05a89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.934372 13303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31db820ce3cc45e0bb5f3560f7cc60e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.947496 13356 tablet_bootstrap.cc:492] T c6d14c392db54aeca8c6ff936e6ea348 P da0f578f1d4541ada6f9aad99f761e8c: Bootstrap starting.
I20260709 12:08:46.953397 13305 tablet_service.cc:1511] Processing CreateTablet for tablet fac4c58593a44cd5a45e96d22fb3f0dd (DEFAULT_TABLE table=test-workload [id=f28ef9eed27c4c8f85f2ce7c74070397]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:08:46.955081 13305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fac4c58593a44cd5a45e96d22fb3f0dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.956403 13232 tablet_service.cc:1511] Processing CreateTablet for tablet 0548d800f00849639c60c9fc6a0b3b44 (DEFAULT_TABLE table=test-workload [id=f28ef9eed27c4c8f85f2ce7c74070397]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:08:46.959122 13231 tablet_service.cc:1511] Processing CreateTablet for tablet c6d14c392db54aeca8c6ff936e6ea348 (DEFAULT_TABLE table=test-workload [id=f28ef9eed27c4c8f85f2ce7c74070397]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:08:46.961956 13230 tablet_service.cc:1511] Processing CreateTablet for tablet 05e69121e8b54b96bfd2863422f446b9 (DEFAULT_TABLE table=test-workload [id=f28ef9eed27c4c8f85f2ce7c74070397]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:08:46.964813 13229 tablet_service.cc:1511] Processing CreateTablet for tablet 31db820ce3cc45e0bb5f3560f7cc60e4 (DEFAULT_TABLE table=test-workload [id=f28ef9eed27c4c8f85f2ce7c74070397]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:08:46.969451 13228 tablet_service.cc:1511] Processing CreateTablet for tablet 3db6a69f63d049fca47cec510aa05a89 (DEFAULT_TABLE table=test-workload [id=f28ef9eed27c4c8f85f2ce7c74070397]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:08:46.973093 13227 tablet_service.cc:1511] Processing CreateTablet for tablet fac4c58593a44cd5a45e96d22fb3f0dd (DEFAULT_TABLE table=test-workload [id=f28ef9eed27c4c8f85f2ce7c74070397]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:08:46.973351 13226 tablet_service.cc:1511] Processing CreateTablet for tablet 3feb7c5af98049f09244f7e2266f3b62 (DEFAULT_TABLE table=test-workload [id=f28ef9eed27c4c8f85f2ce7c74070397]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:08:46.967929 13356 tablet_bootstrap.cc:654] T c6d14c392db54aeca8c6ff936e6ea348 P da0f578f1d4541ada6f9aad99f761e8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:46.978690 13157 tablet_service.cc:1511] Processing CreateTablet for tablet 0548d800f00849639c60c9fc6a0b3b44 (DEFAULT_TABLE table=test-workload [id=f28ef9eed27c4c8f85f2ce7c74070397]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:08:46.980197 13157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0548d800f00849639c60c9fc6a0b3b44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.983006 13155 tablet_service.cc:1511] Processing CreateTablet for tablet 05e69121e8b54b96bfd2863422f446b9 (DEFAULT_TABLE table=test-workload [id=f28ef9eed27c4c8f85f2ce7c74070397]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:08:46.984484 13155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05e69121e8b54b96bfd2863422f446b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.987020 13154 tablet_service.cc:1511] Processing CreateTablet for tablet 31db820ce3cc45e0bb5f3560f7cc60e4 (DEFAULT_TABLE table=test-workload [id=f28ef9eed27c4c8f85f2ce7c74070397]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:08:46.984746 13304 tablet_service.cc:1511] Processing CreateTablet for tablet 3feb7c5af98049f09244f7e2266f3b62 (DEFAULT_TABLE table=test-workload [id=f28ef9eed27c4c8f85f2ce7c74070397]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:08:46.989528 13156 tablet_service.cc:1511] Processing CreateTablet for tablet c6d14c392db54aeca8c6ff936e6ea348 (DEFAULT_TABLE table=test-workload [id=f28ef9eed27c4c8f85f2ce7c74070397]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:08:46.987624 13303 tablet_service.cc:1511] Processing CreateTablet for tablet 864c0069cfc244d7a79fc504e0fc0221 (DEFAULT_TABLE table=test-workload [id=f28ef9eed27c4c8f85f2ce7c74070397]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:08:46.991068 13304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3feb7c5af98049f09244f7e2266f3b62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.994567 13302 tablet_service.cc:1511] Processing CreateTablet for tablet 5500cd37d9d844aebeb99f48c3a0f8fe (DEFAULT_TABLE table=test-workload [id=f28ef9eed27c4c8f85f2ce7c74070397]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:08:46.994787 13152 tablet_service.cc:1511] Processing CreateTablet for tablet fac4c58593a44cd5a45e96d22fb3f0dd (DEFAULT_TABLE table=test-workload [id=f28ef9eed27c4c8f85f2ce7c74070397]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:08:46.998215 13151 tablet_service.cc:1511] Processing CreateTablet for tablet 3feb7c5af98049f09244f7e2266f3b62 (DEFAULT_TABLE table=test-workload [id=f28ef9eed27c4c8f85f2ce7c74070397]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:08:46.998198 13150 tablet_service.cc:1511] Processing CreateTablet for tablet 864c0069cfc244d7a79fc504e0fc0221 (DEFAULT_TABLE table=test-workload [id=f28ef9eed27c4c8f85f2ce7c74070397]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:08:46.992055 13153 tablet_service.cc:1511] Processing CreateTablet for tablet 3db6a69f63d049fca47cec510aa05a89 (DEFAULT_TABLE table=test-workload [id=f28ef9eed27c4c8f85f2ce7c74070397]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:08:47.000543 13232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0548d800f00849639c60c9fc6a0b3b44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.000878 13302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5500cd37d9d844aebeb99f48c3a0f8fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.001327 13226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3feb7c5af98049f09244f7e2266f3b62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.003333 13152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fac4c58593a44cd5a45e96d22fb3f0dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.005143 13151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3feb7c5af98049f09244f7e2266f3b62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.006299 13228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3db6a69f63d049fca47cec510aa05a89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.006491 13154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31db820ce3cc45e0bb5f3560f7cc60e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.007138 13227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fac4c58593a44cd5a45e96d22fb3f0dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.008045 13153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3db6a69f63d049fca47cec510aa05a89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.010139 13230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05e69121e8b54b96bfd2863422f446b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.009671 13150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 864c0069cfc244d7a79fc504e0fc0221. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.013255 13229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31db820ce3cc45e0bb5f3560f7cc60e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.013952 13156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6d14c392db54aeca8c6ff936e6ea348. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.018263 13231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6d14c392db54aeca8c6ff936e6ea348. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.020073 13149 tablet_service.cc:1511] Processing CreateTablet for tablet 5500cd37d9d844aebeb99f48c3a0f8fe (DEFAULT_TABLE table=test-workload [id=f28ef9eed27c4c8f85f2ce7c74070397]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:08:47.021518 13149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5500cd37d9d844aebeb99f48c3a0f8fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.027081 13224 tablet_service.cc:1511] Processing CreateTablet for tablet 5500cd37d9d844aebeb99f48c3a0f8fe (DEFAULT_TABLE table=test-workload [id=f28ef9eed27c4c8f85f2ce7c74070397]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:08:47.027799 13356 tablet_bootstrap.cc:492] T c6d14c392db54aeca8c6ff936e6ea348 P da0f578f1d4541ada6f9aad99f761e8c: No bootstrap required, opened a new log
I20260709 12:08:47.028316 13356 ts_tablet_manager.cc:1403] T c6d14c392db54aeca8c6ff936e6ea348 P da0f578f1d4541ada6f9aad99f761e8c: Time spent bootstrapping tablet: real 0.083s	user 0.007s	sys 0.013s
I20260709 12:08:47.028617 13224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5500cd37d9d844aebeb99f48c3a0f8fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.026582 13225 tablet_service.cc:1511] Processing CreateTablet for tablet 864c0069cfc244d7a79fc504e0fc0221 (DEFAULT_TABLE table=test-workload [id=f28ef9eed27c4c8f85f2ce7c74070397]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:08:47.031709 13225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 864c0069cfc244d7a79fc504e0fc0221. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.047178 13356 raft_consensus.cc:359] T c6d14c392db54aeca8c6ff936e6ea348 P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.048002 13356 raft_consensus.cc:385] T c6d14c392db54aeca8c6ff936e6ea348 P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.048326 13356 raft_consensus.cc:740] T c6d14c392db54aeca8c6ff936e6ea348 P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da0f578f1d4541ada6f9aad99f761e8c, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.054193 13303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 864c0069cfc244d7a79fc504e0fc0221. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.049160 13356 consensus_queue.cc:260] T c6d14c392db54aeca8c6ff936e6ea348 P da0f578f1d4541ada6f9aad99f761e8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.110451 13148 tablet_service.cc:1511] Processing CreateTablet for tablet c4eca66176fa42acaf5926f8b6fab9d0 (DEFAULT_TABLE table=test-workload [id=f28ef9eed27c4c8f85f2ce7c74070397]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:08:47.112617 13148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4eca66176fa42acaf5926f8b6fab9d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.136428 13356 ts_tablet_manager.cc:1434] T c6d14c392db54aeca8c6ff936e6ea348 P da0f578f1d4541ada6f9aad99f761e8c: Time spent starting tablet: real 0.108s	user 0.012s	sys 0.003s
I20260709 12:08:47.138219 13341 heartbeater.cc:499] Master 127.12.56.254:33517 was elected leader, sending a full tablet report...
I20260709 12:08:47.144879 13356 tablet_bootstrap.cc:492] T 05e69121e8b54b96bfd2863422f446b9 P da0f578f1d4541ada6f9aad99f761e8c: Bootstrap starting.
I20260709 12:08:47.170228 13227 tablet_service.cc:1511] Processing CreateTablet for tablet c4eca66176fa42acaf5926f8b6fab9d0 (DEFAULT_TABLE table=test-workload [id=f28ef9eed27c4c8f85f2ce7c74070397]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:08:47.171161 13359 tablet_bootstrap.cc:492] T 5500cd37d9d844aebeb99f48c3a0f8fe P 1badc676cc734a90900be6af887e027a: Bootstrap starting.
I20260709 12:08:47.171577 13227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4eca66176fa42acaf5926f8b6fab9d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.171660 13304 tablet_service.cc:1511] Processing CreateTablet for tablet c4eca66176fa42acaf5926f8b6fab9d0 (DEFAULT_TABLE table=test-workload [id=f28ef9eed27c4c8f85f2ce7c74070397]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:08:47.176666 13360 tablet_bootstrap.cc:492] T fac4c58593a44cd5a45e96d22fb3f0dd P 2768c30a298e46b784868aea92ffdb0d: Bootstrap starting.
I20260709 12:08:47.180594 13304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4eca66176fa42acaf5926f8b6fab9d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.182653 13356 tablet_bootstrap.cc:654] T 05e69121e8b54b96bfd2863422f446b9 P da0f578f1d4541ada6f9aad99f761e8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.188413 13360 tablet_bootstrap.cc:654] T fac4c58593a44cd5a45e96d22fb3f0dd P 2768c30a298e46b784868aea92ffdb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.187407 13359 tablet_bootstrap.cc:654] T 5500cd37d9d844aebeb99f48c3a0f8fe P 1badc676cc734a90900be6af887e027a: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.201920 13356 tablet_bootstrap.cc:492] T 05e69121e8b54b96bfd2863422f446b9 P da0f578f1d4541ada6f9aad99f761e8c: No bootstrap required, opened a new log
I20260709 12:08:47.202018 13360 tablet_bootstrap.cc:492] T fac4c58593a44cd5a45e96d22fb3f0dd P 2768c30a298e46b784868aea92ffdb0d: No bootstrap required, opened a new log
I20260709 12:08:47.202668 13360 ts_tablet_manager.cc:1403] T fac4c58593a44cd5a45e96d22fb3f0dd P 2768c30a298e46b784868aea92ffdb0d: Time spent bootstrapping tablet: real 0.026s	user 0.018s	sys 0.000s
I20260709 12:08:47.202739 13356 ts_tablet_manager.cc:1403] T 05e69121e8b54b96bfd2863422f446b9 P da0f578f1d4541ada6f9aad99f761e8c: Time spent bootstrapping tablet: real 0.065s	user 0.014s	sys 0.008s
I20260709 12:08:47.206372 13356 raft_consensus.cc:359] T 05e69121e8b54b96bfd2863422f446b9 P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.206251 13360 raft_consensus.cc:359] T fac4c58593a44cd5a45e96d22fb3f0dd P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.207242 13356 raft_consensus.cc:385] T 05e69121e8b54b96bfd2863422f446b9 P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.207381 13360 raft_consensus.cc:385] T fac4c58593a44cd5a45e96d22fb3f0dd P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.207656 13356 raft_consensus.cc:740] T 05e69121e8b54b96bfd2863422f446b9 P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da0f578f1d4541ada6f9aad99f761e8c, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.207835 13360 raft_consensus.cc:740] T fac4c58593a44cd5a45e96d22fb3f0dd P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2768c30a298e46b784868aea92ffdb0d, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.208886 13360 consensus_queue.cc:260] T fac4c58593a44cd5a45e96d22fb3f0dd P 2768c30a298e46b784868aea92ffdb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.208822 13356 consensus_queue.cc:260] T 05e69121e8b54b96bfd2863422f446b9 P da0f578f1d4541ada6f9aad99f761e8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.215798 13356 ts_tablet_manager.cc:1434] T 05e69121e8b54b96bfd2863422f446b9 P da0f578f1d4541ada6f9aad99f761e8c: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:08:47.216965 13359 tablet_bootstrap.cc:492] T 5500cd37d9d844aebeb99f48c3a0f8fe P 1badc676cc734a90900be6af887e027a: No bootstrap required, opened a new log
I20260709 12:08:47.217060 13356 tablet_bootstrap.cc:492] T 0548d800f00849639c60c9fc6a0b3b44 P da0f578f1d4541ada6f9aad99f761e8c: Bootstrap starting.
I20260709 12:08:47.217619 13359 ts_tablet_manager.cc:1403] T 5500cd37d9d844aebeb99f48c3a0f8fe P 1badc676cc734a90900be6af887e027a: Time spent bootstrapping tablet: real 0.047s	user 0.016s	sys 0.014s
I20260709 12:08:47.219517 13360 ts_tablet_manager.cc:1434] T fac4c58593a44cd5a45e96d22fb3f0dd P 2768c30a298e46b784868aea92ffdb0d: Time spent starting tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 12:08:47.220383 13267 heartbeater.cc:499] Master 127.12.56.254:33517 was elected leader, sending a full tablet report...
I20260709 12:08:47.232956 13360 tablet_bootstrap.cc:492] T 0548d800f00849639c60c9fc6a0b3b44 P 2768c30a298e46b784868aea92ffdb0d: Bootstrap starting.
I20260709 12:08:47.235085 13359 raft_consensus.cc:359] T 5500cd37d9d844aebeb99f48c3a0f8fe P 1badc676cc734a90900be6af887e027a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.236007 13359 raft_consensus.cc:385] T 5500cd37d9d844aebeb99f48c3a0f8fe P 1badc676cc734a90900be6af887e027a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.236382 13359 raft_consensus.cc:740] T 5500cd37d9d844aebeb99f48c3a0f8fe P 1badc676cc734a90900be6af887e027a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1badc676cc734a90900be6af887e027a, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.237579 13356 tablet_bootstrap.cc:654] T 0548d800f00849639c60c9fc6a0b3b44 P da0f578f1d4541ada6f9aad99f761e8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.237404 13359 consensus_queue.cc:260] T 5500cd37d9d844aebeb99f48c3a0f8fe P 1badc676cc734a90900be6af887e027a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.241297 13360 tablet_bootstrap.cc:654] T 0548d800f00849639c60c9fc6a0b3b44 P 2768c30a298e46b784868aea92ffdb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.251258 13359 ts_tablet_manager.cc:1434] T 5500cd37d9d844aebeb99f48c3a0f8fe P 1badc676cc734a90900be6af887e027a: Time spent starting tablet: real 0.033s	user 0.029s	sys 0.004s
I20260709 12:08:47.251924 13356 tablet_bootstrap.cc:492] T 0548d800f00849639c60c9fc6a0b3b44 P da0f578f1d4541ada6f9aad99f761e8c: No bootstrap required, opened a new log
I20260709 12:08:47.252169 13192 heartbeater.cc:499] Master 127.12.56.254:33517 was elected leader, sending a full tablet report...
I20260709 12:08:47.252193 13360 tablet_bootstrap.cc:492] T 0548d800f00849639c60c9fc6a0b3b44 P 2768c30a298e46b784868aea92ffdb0d: No bootstrap required, opened a new log
I20260709 12:08:47.252487 13356 ts_tablet_manager.cc:1403] T 0548d800f00849639c60c9fc6a0b3b44 P da0f578f1d4541ada6f9aad99f761e8c: Time spent bootstrapping tablet: real 0.036s	user 0.021s	sys 0.013s
I20260709 12:08:47.252694 13359 tablet_bootstrap.cc:492] T 864c0069cfc244d7a79fc504e0fc0221 P 1badc676cc734a90900be6af887e027a: Bootstrap starting.
I20260709 12:08:47.252938 13360 ts_tablet_manager.cc:1403] T 0548d800f00849639c60c9fc6a0b3b44 P 2768c30a298e46b784868aea92ffdb0d: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.005s
I20260709 12:08:47.256067 13356 raft_consensus.cc:359] T 0548d800f00849639c60c9fc6a0b3b44 P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } }
I20260709 12:08:47.256430 13360 raft_consensus.cc:359] T 0548d800f00849639c60c9fc6a0b3b44 P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } }
I20260709 12:08:47.257109 13356 raft_consensus.cc:385] T 0548d800f00849639c60c9fc6a0b3b44 P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.257336 13360 raft_consensus.cc:385] T 0548d800f00849639c60c9fc6a0b3b44 P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.257558 13356 raft_consensus.cc:740] T 0548d800f00849639c60c9fc6a0b3b44 P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da0f578f1d4541ada6f9aad99f761e8c, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.257766 13360 raft_consensus.cc:740] T 0548d800f00849639c60c9fc6a0b3b44 P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2768c30a298e46b784868aea92ffdb0d, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.258949 13360 consensus_queue.cc:260] T 0548d800f00849639c60c9fc6a0b3b44 P 2768c30a298e46b784868aea92ffdb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } }
I20260709 12:08:47.259295 13356 consensus_queue.cc:260] T 0548d800f00849639c60c9fc6a0b3b44 P da0f578f1d4541ada6f9aad99f761e8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } }
I20260709 12:08:47.261102 13359 tablet_bootstrap.cc:654] T 864c0069cfc244d7a79fc504e0fc0221 P 1badc676cc734a90900be6af887e027a: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.261859 13360 ts_tablet_manager.cc:1434] T 0548d800f00849639c60c9fc6a0b3b44 P 2768c30a298e46b784868aea92ffdb0d: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:08:47.261973 13356 ts_tablet_manager.cc:1434] T 0548d800f00849639c60c9fc6a0b3b44 P da0f578f1d4541ada6f9aad99f761e8c: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 12:08:47.262979 13360 tablet_bootstrap.cc:492] T 3feb7c5af98049f09244f7e2266f3b62 P 2768c30a298e46b784868aea92ffdb0d: Bootstrap starting.
I20260709 12:08:47.263255 13356 tablet_bootstrap.cc:492] T 3db6a69f63d049fca47cec510aa05a89 P da0f578f1d4541ada6f9aad99f761e8c: Bootstrap starting.
I20260709 12:08:47.271113 13360 tablet_bootstrap.cc:654] T 3feb7c5af98049f09244f7e2266f3b62 P 2768c30a298e46b784868aea92ffdb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.272712 13356 tablet_bootstrap.cc:654] T 3db6a69f63d049fca47cec510aa05a89 P da0f578f1d4541ada6f9aad99f761e8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.283808 13360 tablet_bootstrap.cc:492] T 3feb7c5af98049f09244f7e2266f3b62 P 2768c30a298e46b784868aea92ffdb0d: No bootstrap required, opened a new log
I20260709 12:08:47.284401 13360 ts_tablet_manager.cc:1403] T 3feb7c5af98049f09244f7e2266f3b62 P 2768c30a298e46b784868aea92ffdb0d: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.009s
I20260709 12:08:47.290079 13360 raft_consensus.cc:359] T 3feb7c5af98049f09244f7e2266f3b62 P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.291224 13360 raft_consensus.cc:385] T 3feb7c5af98049f09244f7e2266f3b62 P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.291648 13360 raft_consensus.cc:740] T 3feb7c5af98049f09244f7e2266f3b62 P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2768c30a298e46b784868aea92ffdb0d, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.292668 13360 consensus_queue.cc:260] T 3feb7c5af98049f09244f7e2266f3b62 P 2768c30a298e46b784868aea92ffdb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.295759 13356 tablet_bootstrap.cc:492] T 3db6a69f63d049fca47cec510aa05a89 P da0f578f1d4541ada6f9aad99f761e8c: No bootstrap required, opened a new log
I20260709 12:08:47.296375 13356 ts_tablet_manager.cc:1403] T 3db6a69f63d049fca47cec510aa05a89 P da0f578f1d4541ada6f9aad99f761e8c: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.011s
I20260709 12:08:47.302326 13360 ts_tablet_manager.cc:1434] T 3feb7c5af98049f09244f7e2266f3b62 P 2768c30a298e46b784868aea92ffdb0d: Time spent starting tablet: real 0.018s	user 0.011s	sys 0.000s
I20260709 12:08:47.303592 13360 tablet_bootstrap.cc:492] T 3db6a69f63d049fca47cec510aa05a89 P 2768c30a298e46b784868aea92ffdb0d: Bootstrap starting.
I20260709 12:08:47.305370 13364 raft_consensus.cc:493] T fac4c58593a44cd5a45e96d22fb3f0dd P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:47.305922 13364 raft_consensus.cc:515] T fac4c58593a44cd5a45e96d22fb3f0dd P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.299716 13356 raft_consensus.cc:359] T 3db6a69f63d049fca47cec510aa05a89 P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.308588 13356 raft_consensus.cc:385] T 3db6a69f63d049fca47cec510aa05a89 P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.310333 13356 raft_consensus.cc:740] T 3db6a69f63d049fca47cec510aa05a89 P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da0f578f1d4541ada6f9aad99f761e8c, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.311614 13356 consensus_queue.cc:260] T 3db6a69f63d049fca47cec510aa05a89 P da0f578f1d4541ada6f9aad99f761e8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.318118 13364 leader_election.cc:290] T fac4c58593a44cd5a45e96d22fb3f0dd P 2768c30a298e46b784868aea92ffdb0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1badc676cc734a90900be6af887e027a (127.12.56.193:36691), da0f578f1d4541ada6f9aad99f761e8c (127.12.56.195:40703)
I20260709 12:08:47.332147 13360 tablet_bootstrap.cc:654] T 3db6a69f63d049fca47cec510aa05a89 P 2768c30a298e46b784868aea92ffdb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.333968 13358 raft_consensus.cc:493] T 3db6a69f63d049fca47cec510aa05a89 P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:47.334524 13356 ts_tablet_manager.cc:1434] T 3db6a69f63d049fca47cec510aa05a89 P da0f578f1d4541ada6f9aad99f761e8c: Time spent starting tablet: real 0.038s	user 0.009s	sys 0.003s
I20260709 12:08:47.334604 13358 raft_consensus.cc:515] T 3db6a69f63d049fca47cec510aa05a89 P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.335815 13356 tablet_bootstrap.cc:492] T 31db820ce3cc45e0bb5f3560f7cc60e4 P da0f578f1d4541ada6f9aad99f761e8c: Bootstrap starting.
I20260709 12:08:47.342700 13316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac4c58593a44cd5a45e96d22fb3f0dd" candidate_uuid: "2768c30a298e46b784868aea92ffdb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da0f578f1d4541ada6f9aad99f761e8c" is_pre_election: true
I20260709 12:08:47.344031 13356 tablet_bootstrap.cc:654] T 31db820ce3cc45e0bb5f3560f7cc60e4 P da0f578f1d4541ada6f9aad99f761e8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.346683 13358 leader_election.cc:290] T 3db6a69f63d049fca47cec510aa05a89 P da0f578f1d4541ada6f9aad99f761e8c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1badc676cc734a90900be6af887e027a (127.12.56.193:36691), 2768c30a298e46b784868aea92ffdb0d (127.12.56.194:37951)
W20260709 12:08:47.352937 13113 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:08:47.333992 13359 tablet_bootstrap.cc:492] T 864c0069cfc244d7a79fc504e0fc0221 P 1badc676cc734a90900be6af887e027a: No bootstrap required, opened a new log
I20260709 12:08:47.358197 13359 ts_tablet_manager.cc:1403] T 864c0069cfc244d7a79fc504e0fc0221 P 1badc676cc734a90900be6af887e027a: Time spent bootstrapping tablet: real 0.106s	user 0.028s	sys 0.043s
W20260709 12:08:47.345484 13207 leader_election.cc:343] T fac4c58593a44cd5a45e96d22fb3f0dd P 2768c30a298e46b784868aea92ffdb0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da0f578f1d4541ada6f9aad99f761e8c (127.12.56.195:40703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:47.373190 13359 raft_consensus.cc:359] T 864c0069cfc244d7a79fc504e0fc0221 P 1badc676cc734a90900be6af887e027a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.374392 13359 raft_consensus.cc:385] T 864c0069cfc244d7a79fc504e0fc0221 P 1badc676cc734a90900be6af887e027a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.374812 13359 raft_consensus.cc:740] T 864c0069cfc244d7a79fc504e0fc0221 P 1badc676cc734a90900be6af887e027a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1badc676cc734a90900be6af887e027a, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.376025 13359 consensus_queue.cc:260] T 864c0069cfc244d7a79fc504e0fc0221 P 1badc676cc734a90900be6af887e027a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.387935 13364 raft_consensus.cc:493] T 3feb7c5af98049f09244f7e2266f3b62 P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:47.388486 13364 raft_consensus.cc:515] T 3feb7c5af98049f09244f7e2266f3b62 P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.389906 13359 ts_tablet_manager.cc:1434] T 864c0069cfc244d7a79fc504e0fc0221 P 1badc676cc734a90900be6af887e027a: Time spent starting tablet: real 0.031s	user 0.009s	sys 0.002s
I20260709 12:08:47.390859 13364 leader_election.cc:290] T 3feb7c5af98049f09244f7e2266f3b62 P 2768c30a298e46b784868aea92ffdb0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1badc676cc734a90900be6af887e027a (127.12.56.193:36691), da0f578f1d4541ada6f9aad99f761e8c (127.12.56.195:40703)
I20260709 12:08:47.391702 13359 tablet_bootstrap.cc:492] T fac4c58593a44cd5a45e96d22fb3f0dd P 1badc676cc734a90900be6af887e027a: Bootstrap starting.
I20260709 12:08:47.394011 13167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac4c58593a44cd5a45e96d22fb3f0dd" candidate_uuid: "2768c30a298e46b784868aea92ffdb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1badc676cc734a90900be6af887e027a" is_pre_election: true
I20260709 12:08:47.394196 13316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3feb7c5af98049f09244f7e2266f3b62" candidate_uuid: "2768c30a298e46b784868aea92ffdb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da0f578f1d4541ada6f9aad99f761e8c" is_pre_election: true
I20260709 12:08:47.396169 13167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3feb7c5af98049f09244f7e2266f3b62" candidate_uuid: "2768c30a298e46b784868aea92ffdb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1badc676cc734a90900be6af887e027a" is_pre_election: true
W20260709 12:08:47.396337 13208 leader_election.cc:343] T fac4c58593a44cd5a45e96d22fb3f0dd P 2768c30a298e46b784868aea92ffdb0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1badc676cc734a90900be6af887e027a (127.12.56.193:36691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:47.396835 13208 leader_election.cc:304] T fac4c58593a44cd5a45e96d22fb3f0dd P 2768c30a298e46b784868aea92ffdb0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2768c30a298e46b784868aea92ffdb0d; no voters: 1badc676cc734a90900be6af887e027a, da0f578f1d4541ada6f9aad99f761e8c
W20260709 12:08:47.398285 13208 leader_election.cc:343] T 3feb7c5af98049f09244f7e2266f3b62 P 2768c30a298e46b784868aea92ffdb0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1badc676cc734a90900be6af887e027a (127.12.56.193:36691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:47.399092 13356 tablet_bootstrap.cc:492] T 31db820ce3cc45e0bb5f3560f7cc60e4 P da0f578f1d4541ada6f9aad99f761e8c: No bootstrap required, opened a new log
I20260709 12:08:47.399224 13364 raft_consensus.cc:2749] T fac4c58593a44cd5a45e96d22fb3f0dd P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:47.399544 13356 ts_tablet_manager.cc:1403] T 31db820ce3cc45e0bb5f3560f7cc60e4 P da0f578f1d4541ada6f9aad99f761e8c: Time spent bootstrapping tablet: real 0.064s	user 0.030s	sys 0.024s
W20260709 12:08:47.400557 13207 leader_election.cc:343] T 3feb7c5af98049f09244f7e2266f3b62 P 2768c30a298e46b784868aea92ffdb0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da0f578f1d4541ada6f9aad99f761e8c (127.12.56.195:40703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:47.401383 13207 leader_election.cc:304] T 3feb7c5af98049f09244f7e2266f3b62 P 2768c30a298e46b784868aea92ffdb0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2768c30a298e46b784868aea92ffdb0d; no voters: 1badc676cc734a90900be6af887e027a, da0f578f1d4541ada6f9aad99f761e8c
I20260709 12:08:47.402396 13359 tablet_bootstrap.cc:654] T fac4c58593a44cd5a45e96d22fb3f0dd P 1badc676cc734a90900be6af887e027a: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.402349 13356 raft_consensus.cc:359] T 31db820ce3cc45e0bb5f3560f7cc60e4 P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.402915 13364 raft_consensus.cc:2749] T 3feb7c5af98049f09244f7e2266f3b62 P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:47.403252 13356 raft_consensus.cc:385] T 31db820ce3cc45e0bb5f3560f7cc60e4 P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.403645 13356 raft_consensus.cc:740] T 31db820ce3cc45e0bb5f3560f7cc60e4 P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da0f578f1d4541ada6f9aad99f761e8c, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.404520 13356 consensus_queue.cc:260] T 31db820ce3cc45e0bb5f3560f7cc60e4 P da0f578f1d4541ada6f9aad99f761e8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.406909 13356 ts_tablet_manager.cc:1434] T 31db820ce3cc45e0bb5f3560f7cc60e4 P da0f578f1d4541ada6f9aad99f761e8c: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:08:47.407927 13356 tablet_bootstrap.cc:492] T fac4c58593a44cd5a45e96d22fb3f0dd P da0f578f1d4541ada6f9aad99f761e8c: Bootstrap starting.
I20260709 12:08:47.414209 13358 raft_consensus.cc:493] T c6d14c392db54aeca8c6ff936e6ea348 P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:47.414503 13356 tablet_bootstrap.cc:654] T fac4c58593a44cd5a45e96d22fb3f0dd P da0f578f1d4541ada6f9aad99f761e8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.420193 13358 raft_consensus.cc:515] T c6d14c392db54aeca8c6ff936e6ea348 P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.423374 13358 leader_election.cc:290] T c6d14c392db54aeca8c6ff936e6ea348 P da0f578f1d4541ada6f9aad99f761e8c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1badc676cc734a90900be6af887e027a (127.12.56.193:36691), 2768c30a298e46b784868aea92ffdb0d (127.12.56.194:37951)
I20260709 12:08:47.424190 13167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db6a69f63d049fca47cec510aa05a89" candidate_uuid: "da0f578f1d4541ada6f9aad99f761e8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1badc676cc734a90900be6af887e027a" is_pre_election: true
I20260709 12:08:47.426436 13166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d14c392db54aeca8c6ff936e6ea348" candidate_uuid: "da0f578f1d4541ada6f9aad99f761e8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1badc676cc734a90900be6af887e027a" is_pre_election: true
W20260709 12:08:47.426980 13282 leader_election.cc:343] T 3db6a69f63d049fca47cec510aa05a89 P da0f578f1d4541ada6f9aad99f761e8c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1badc676cc734a90900be6af887e027a (127.12.56.193:36691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:47.427935 13358 raft_consensus.cc:493] T 05e69121e8b54b96bfd2863422f446b9 P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:08:47.428746 13282 leader_election.cc:343] T c6d14c392db54aeca8c6ff936e6ea348 P da0f578f1d4541ada6f9aad99f761e8c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1badc676cc734a90900be6af887e027a (127.12.56.193:36691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:47.428635 13358 raft_consensus.cc:515] T 05e69121e8b54b96bfd2863422f446b9 P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.431807 13358 leader_election.cc:290] T 05e69121e8b54b96bfd2863422f446b9 P da0f578f1d4541ada6f9aad99f761e8c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1badc676cc734a90900be6af887e027a (127.12.56.193:36691), 2768c30a298e46b784868aea92ffdb0d (127.12.56.194:37951)
I20260709 12:08:47.434127 13166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05e69121e8b54b96bfd2863422f446b9" candidate_uuid: "da0f578f1d4541ada6f9aad99f761e8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1badc676cc734a90900be6af887e027a" is_pre_election: true
W20260709 12:08:47.436264 13282 leader_election.cc:343] T 05e69121e8b54b96bfd2863422f446b9 P da0f578f1d4541ada6f9aad99f761e8c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1badc676cc734a90900be6af887e027a (127.12.56.193:36691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:47.440006 13360 tablet_bootstrap.cc:492] T 3db6a69f63d049fca47cec510aa05a89 P 2768c30a298e46b784868aea92ffdb0d: No bootstrap required, opened a new log
I20260709 12:08:47.440630 13360 ts_tablet_manager.cc:1403] T 3db6a69f63d049fca47cec510aa05a89 P 2768c30a298e46b784868aea92ffdb0d: Time spent bootstrapping tablet: real 0.137s	user 0.057s	sys 0.050s
I20260709 12:08:47.442211 13242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db6a69f63d049fca47cec510aa05a89" candidate_uuid: "da0f578f1d4541ada6f9aad99f761e8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2768c30a298e46b784868aea92ffdb0d" is_pre_election: true
I20260709 12:08:47.443836 13241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d14c392db54aeca8c6ff936e6ea348" candidate_uuid: "da0f578f1d4541ada6f9aad99f761e8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2768c30a298e46b784868aea92ffdb0d" is_pre_election: true
I20260709 12:08:47.443676 13360 raft_consensus.cc:359] T 3db6a69f63d049fca47cec510aa05a89 P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.444522 13360 raft_consensus.cc:385] T 3db6a69f63d049fca47cec510aa05a89 P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.444839 13360 raft_consensus.cc:740] T 3db6a69f63d049fca47cec510aa05a89 P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2768c30a298e46b784868aea92ffdb0d, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.445281 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05e69121e8b54b96bfd2863422f446b9" candidate_uuid: "da0f578f1d4541ada6f9aad99f761e8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2768c30a298e46b784868aea92ffdb0d" is_pre_election: true
I20260709 12:08:47.445565 13360 consensus_queue.cc:260] T 3db6a69f63d049fca47cec510aa05a89 P 2768c30a298e46b784868aea92ffdb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
W20260709 12:08:47.447288 13279 leader_election.cc:343] T 3db6a69f63d049fca47cec510aa05a89 P da0f578f1d4541ada6f9aad99f761e8c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2768c30a298e46b784868aea92ffdb0d (127.12.56.194:37951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:47.447774 13279 leader_election.cc:304] T 3db6a69f63d049fca47cec510aa05a89 P da0f578f1d4541ada6f9aad99f761e8c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da0f578f1d4541ada6f9aad99f761e8c; no voters: 1badc676cc734a90900be6af887e027a, 2768c30a298e46b784868aea92ffdb0d
W20260709 12:08:47.449010 13279 leader_election.cc:343] T c6d14c392db54aeca8c6ff936e6ea348 P da0f578f1d4541ada6f9aad99f761e8c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2768c30a298e46b784868aea92ffdb0d (127.12.56.194:37951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:47.449491 13279 leader_election.cc:304] T c6d14c392db54aeca8c6ff936e6ea348 P da0f578f1d4541ada6f9aad99f761e8c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da0f578f1d4541ada6f9aad99f761e8c; no voters: 1badc676cc734a90900be6af887e027a, 2768c30a298e46b784868aea92ffdb0d
I20260709 12:08:47.450412 13359 tablet_bootstrap.cc:492] T fac4c58593a44cd5a45e96d22fb3f0dd P 1badc676cc734a90900be6af887e027a: No bootstrap required, opened a new log
I20260709 12:08:47.450443 13358 raft_consensus.cc:2749] T 3db6a69f63d049fca47cec510aa05a89 P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:47.452224 13358 raft_consensus.cc:2749] T c6d14c392db54aeca8c6ff936e6ea348 P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:47.451541 13359 ts_tablet_manager.cc:1403] T fac4c58593a44cd5a45e96d22fb3f0dd P 1badc676cc734a90900be6af887e027a: Time spent bootstrapping tablet: real 0.060s	user 0.013s	sys 0.006s
W20260709 12:08:47.455436 13279 leader_election.cc:343] T 05e69121e8b54b96bfd2863422f446b9 P da0f578f1d4541ada6f9aad99f761e8c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2768c30a298e46b784868aea92ffdb0d (127.12.56.194:37951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:47.455936 13279 leader_election.cc:304] T 05e69121e8b54b96bfd2863422f446b9 P da0f578f1d4541ada6f9aad99f761e8c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da0f578f1d4541ada6f9aad99f761e8c; no voters: 1badc676cc734a90900be6af887e027a, 2768c30a298e46b784868aea92ffdb0d
I20260709 12:08:47.456780 13360 ts_tablet_manager.cc:1434] T 3db6a69f63d049fca47cec510aa05a89 P 2768c30a298e46b784868aea92ffdb0d: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:08:47.457329 13380 raft_consensus.cc:2749] T 05e69121e8b54b96bfd2863422f446b9 P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:47.458253 13359 raft_consensus.cc:359] T fac4c58593a44cd5a45e96d22fb3f0dd P 1badc676cc734a90900be6af887e027a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.459162 13360 tablet_bootstrap.cc:492] T 05e69121e8b54b96bfd2863422f446b9 P 2768c30a298e46b784868aea92ffdb0d: Bootstrap starting.
I20260709 12:08:47.459136 13359 raft_consensus.cc:385] T fac4c58593a44cd5a45e96d22fb3f0dd P 1badc676cc734a90900be6af887e027a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.459699 13359 raft_consensus.cc:740] T fac4c58593a44cd5a45e96d22fb3f0dd P 1badc676cc734a90900be6af887e027a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1badc676cc734a90900be6af887e027a, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.460681 13356 tablet_bootstrap.cc:492] T fac4c58593a44cd5a45e96d22fb3f0dd P da0f578f1d4541ada6f9aad99f761e8c: No bootstrap required, opened a new log
I20260709 12:08:47.461254 13356 ts_tablet_manager.cc:1403] T fac4c58593a44cd5a45e96d22fb3f0dd P da0f578f1d4541ada6f9aad99f761e8c: Time spent bootstrapping tablet: real 0.054s	user 0.024s	sys 0.027s
I20260709 12:08:47.460618 13359 consensus_queue.cc:260] T fac4c58593a44cd5a45e96d22fb3f0dd P 1badc676cc734a90900be6af887e027a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.464288 13356 raft_consensus.cc:359] T fac4c58593a44cd5a45e96d22fb3f0dd P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.464847 13356 raft_consensus.cc:385] T fac4c58593a44cd5a45e96d22fb3f0dd P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.465029 13356 raft_consensus.cc:740] T fac4c58593a44cd5a45e96d22fb3f0dd P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da0f578f1d4541ada6f9aad99f761e8c, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.465866 13356 consensus_queue.cc:260] T fac4c58593a44cd5a45e96d22fb3f0dd P da0f578f1d4541ada6f9aad99f761e8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.466439 13360 tablet_bootstrap.cc:654] T 05e69121e8b54b96bfd2863422f446b9 P 2768c30a298e46b784868aea92ffdb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.468541 13356 ts_tablet_manager.cc:1434] T fac4c58593a44cd5a45e96d22fb3f0dd P da0f578f1d4541ada6f9aad99f761e8c: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:08:47.469450 13356 tablet_bootstrap.cc:492] T 5500cd37d9d844aebeb99f48c3a0f8fe P da0f578f1d4541ada6f9aad99f761e8c: Bootstrap starting.
I20260709 12:08:47.470268 13359 ts_tablet_manager.cc:1434] T fac4c58593a44cd5a45e96d22fb3f0dd P 1badc676cc734a90900be6af887e027a: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 12:08:47.474277 13360 tablet_bootstrap.cc:492] T 05e69121e8b54b96bfd2863422f446b9 P 2768c30a298e46b784868aea92ffdb0d: No bootstrap required, opened a new log
I20260709 12:08:47.474445 13359 tablet_bootstrap.cc:492] T 0548d800f00849639c60c9fc6a0b3b44 P 1badc676cc734a90900be6af887e027a: Bootstrap starting.
I20260709 12:08:47.474856 13360 ts_tablet_manager.cc:1403] T 05e69121e8b54b96bfd2863422f446b9 P 2768c30a298e46b784868aea92ffdb0d: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.004s
I20260709 12:08:47.475694 13356 tablet_bootstrap.cc:654] T 5500cd37d9d844aebeb99f48c3a0f8fe P da0f578f1d4541ada6f9aad99f761e8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.477242 13365 raft_consensus.cc:493] T fac4c58593a44cd5a45e96d22fb3f0dd P 1badc676cc734a90900be6af887e027a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:47.477823 13365 raft_consensus.cc:515] T fac4c58593a44cd5a45e96d22fb3f0dd P 1badc676cc734a90900be6af887e027a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.478291 13360 raft_consensus.cc:359] T 05e69121e8b54b96bfd2863422f446b9 P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.479091 13360 raft_consensus.cc:385] T 05e69121e8b54b96bfd2863422f446b9 P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.479413 13360 raft_consensus.cc:740] T 05e69121e8b54b96bfd2863422f446b9 P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2768c30a298e46b784868aea92ffdb0d, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.485819 13359 tablet_bootstrap.cc:654] T 0548d800f00849639c60c9fc6a0b3b44 P 1badc676cc734a90900be6af887e027a: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.480360 13360 consensus_queue.cc:260] T 05e69121e8b54b96bfd2863422f446b9 P 2768c30a298e46b784868aea92ffdb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.490448 13365 leader_election.cc:290] T fac4c58593a44cd5a45e96d22fb3f0dd P 1badc676cc734a90900be6af887e027a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2768c30a298e46b784868aea92ffdb0d (127.12.56.194:37951), da0f578f1d4541ada6f9aad99f761e8c (127.12.56.195:40703)
I20260709 12:08:47.496392 13360 ts_tablet_manager.cc:1434] T 05e69121e8b54b96bfd2863422f446b9 P 2768c30a298e46b784868aea92ffdb0d: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:08:47.508554 13360 tablet_bootstrap.cc:492] T 5500cd37d9d844aebeb99f48c3a0f8fe P 2768c30a298e46b784868aea92ffdb0d: Bootstrap starting.
I20260709 12:08:47.514842 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac4c58593a44cd5a45e96d22fb3f0dd" candidate_uuid: "1badc676cc734a90900be6af887e027a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2768c30a298e46b784868aea92ffdb0d" is_pre_election: true
I20260709 12:08:47.515772 13240 raft_consensus.cc:2468] T fac4c58593a44cd5a45e96d22fb3f0dd P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1badc676cc734a90900be6af887e027a in term 0.
I20260709 12:08:47.517457 13130 leader_election.cc:304] T fac4c58593a44cd5a45e96d22fb3f0dd P 1badc676cc734a90900be6af887e027a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1badc676cc734a90900be6af887e027a, 2768c30a298e46b784868aea92ffdb0d; no voters: 
I20260709 12:08:47.518566 13365 raft_consensus.cc:2804] T fac4c58593a44cd5a45e96d22fb3f0dd P 1badc676cc734a90900be6af887e027a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:47.518741 13359 tablet_bootstrap.cc:492] T 0548d800f00849639c60c9fc6a0b3b44 P 1badc676cc734a90900be6af887e027a: No bootstrap required, opened a new log
I20260709 12:08:47.518963 13365 raft_consensus.cc:493] T fac4c58593a44cd5a45e96d22fb3f0dd P 1badc676cc734a90900be6af887e027a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:47.519265 13359 ts_tablet_manager.cc:1403] T 0548d800f00849639c60c9fc6a0b3b44 P 1badc676cc734a90900be6af887e027a: Time spent bootstrapping tablet: real 0.045s	user 0.019s	sys 0.001s
I20260709 12:08:47.519338 13365 raft_consensus.cc:3060] T fac4c58593a44cd5a45e96d22fb3f0dd P 1badc676cc734a90900be6af887e027a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.522492 13359 raft_consensus.cc:359] T 0548d800f00849639c60c9fc6a0b3b44 P 1badc676cc734a90900be6af887e027a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } }
I20260709 12:08:47.523195 13360 tablet_bootstrap.cc:654] T 5500cd37d9d844aebeb99f48c3a0f8fe P 2768c30a298e46b784868aea92ffdb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.523298 13359 raft_consensus.cc:385] T 0548d800f00849639c60c9fc6a0b3b44 P 1badc676cc734a90900be6af887e027a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.523720 13359 raft_consensus.cc:740] T 0548d800f00849639c60c9fc6a0b3b44 P 1badc676cc734a90900be6af887e027a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1badc676cc734a90900be6af887e027a, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.523968 13356 tablet_bootstrap.cc:492] T 5500cd37d9d844aebeb99f48c3a0f8fe P da0f578f1d4541ada6f9aad99f761e8c: No bootstrap required, opened a new log
I20260709 12:08:47.524705 13356 ts_tablet_manager.cc:1403] T 5500cd37d9d844aebeb99f48c3a0f8fe P da0f578f1d4541ada6f9aad99f761e8c: Time spent bootstrapping tablet: real 0.055s	user 0.027s	sys 0.023s
I20260709 12:08:47.524628 13359 consensus_queue.cc:260] T 0548d800f00849639c60c9fc6a0b3b44 P 1badc676cc734a90900be6af887e027a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } }
I20260709 12:08:47.528340 13356 raft_consensus.cc:359] T 5500cd37d9d844aebeb99f48c3a0f8fe P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.529281 13356 raft_consensus.cc:385] T 5500cd37d9d844aebeb99f48c3a0f8fe P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.529719 13356 raft_consensus.cc:740] T 5500cd37d9d844aebeb99f48c3a0f8fe P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da0f578f1d4541ada6f9aad99f761e8c, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.527422 13365 raft_consensus.cc:515] T fac4c58593a44cd5a45e96d22fb3f0dd P 1badc676cc734a90900be6af887e027a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.530763 13356 consensus_queue.cc:260] T 5500cd37d9d844aebeb99f48c3a0f8fe P da0f578f1d4541ada6f9aad99f761e8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.531219 13316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac4c58593a44cd5a45e96d22fb3f0dd" candidate_uuid: "1badc676cc734a90900be6af887e027a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da0f578f1d4541ada6f9aad99f761e8c" is_pre_election: true
I20260709 12:08:47.531998 13316 raft_consensus.cc:2468] T fac4c58593a44cd5a45e96d22fb3f0dd P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1badc676cc734a90900be6af887e027a in term 0.
I20260709 12:08:47.533490 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac4c58593a44cd5a45e96d22fb3f0dd" candidate_uuid: "1badc676cc734a90900be6af887e027a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2768c30a298e46b784868aea92ffdb0d"
I20260709 12:08:47.534209 13240 raft_consensus.cc:3060] T fac4c58593a44cd5a45e96d22fb3f0dd P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.536091 13359 ts_tablet_manager.cc:1434] T 0548d800f00849639c60c9fc6a0b3b44 P 1badc676cc734a90900be6af887e027a: Time spent starting tablet: real 0.016s	user 0.011s	sys 0.002s
I20260709 12:08:47.538496 13359 tablet_bootstrap.cc:492] T c6d14c392db54aeca8c6ff936e6ea348 P 1badc676cc734a90900be6af887e027a: Bootstrap starting.
I20260709 12:08:47.540619 13360 tablet_bootstrap.cc:492] T 5500cd37d9d844aebeb99f48c3a0f8fe P 2768c30a298e46b784868aea92ffdb0d: No bootstrap required, opened a new log
I20260709 12:08:47.541208 13360 ts_tablet_manager.cc:1403] T 5500cd37d9d844aebeb99f48c3a0f8fe P 2768c30a298e46b784868aea92ffdb0d: Time spent bootstrapping tablet: real 0.043s	user 0.012s	sys 0.000s
I20260709 12:08:47.544844 13240 raft_consensus.cc:2468] T fac4c58593a44cd5a45e96d22fb3f0dd P 2768c30a298e46b784868aea92ffdb0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1badc676cc734a90900be6af887e027a in term 1.
I20260709 12:08:47.544593 13360 raft_consensus.cc:359] T 5500cd37d9d844aebeb99f48c3a0f8fe P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.545585 13359 tablet_bootstrap.cc:654] T c6d14c392db54aeca8c6ff936e6ea348 P 1badc676cc734a90900be6af887e027a: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.547303 13316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac4c58593a44cd5a45e96d22fb3f0dd" candidate_uuid: "1badc676cc734a90900be6af887e027a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da0f578f1d4541ada6f9aad99f761e8c"
I20260709 12:08:47.545966 13365 leader_election.cc:290] T fac4c58593a44cd5a45e96d22fb3f0dd P 1badc676cc734a90900be6af887e027a [CANDIDATE]: Term 1 election: Requested vote from peers 2768c30a298e46b784868aea92ffdb0d (127.12.56.194:37951), da0f578f1d4541ada6f9aad99f761e8c (127.12.56.195:40703)
I20260709 12:08:47.547633 13130 leader_election.cc:304] T fac4c58593a44cd5a45e96d22fb3f0dd P 1badc676cc734a90900be6af887e027a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1badc676cc734a90900be6af887e027a, 2768c30a298e46b784868aea92ffdb0d; no voters: 
I20260709 12:08:47.547966 13316 raft_consensus.cc:3060] T fac4c58593a44cd5a45e96d22fb3f0dd P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.533520 13356 ts_tablet_manager.cc:1434] T 5500cd37d9d844aebeb99f48c3a0f8fe P da0f578f1d4541ada6f9aad99f761e8c: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:08:47.549340 13356 tablet_bootstrap.cc:492] T 3feb7c5af98049f09244f7e2266f3b62 P da0f578f1d4541ada6f9aad99f761e8c: Bootstrap starting.
I20260709 12:08:47.553084 13365 raft_consensus.cc:2804] T fac4c58593a44cd5a45e96d22fb3f0dd P 1badc676cc734a90900be6af887e027a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:47.553864 13365 raft_consensus.cc:697] T fac4c58593a44cd5a45e96d22fb3f0dd P 1badc676cc734a90900be6af887e027a [term 1 LEADER]: Becoming Leader. State: Replica: 1badc676cc734a90900be6af887e027a, State: Running, Role: LEADER
I20260709 12:08:47.546823 13360 raft_consensus.cc:385] T 5500cd37d9d844aebeb99f48c3a0f8fe P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.555332 13360 raft_consensus.cc:740] T 5500cd37d9d844aebeb99f48c3a0f8fe P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2768c30a298e46b784868aea92ffdb0d, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.556093 13360 consensus_queue.cc:260] T 5500cd37d9d844aebeb99f48c3a0f8fe P 2768c30a298e46b784868aea92ffdb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.558529 13360 ts_tablet_manager.cc:1434] T 5500cd37d9d844aebeb99f48c3a0f8fe P 2768c30a298e46b784868aea92ffdb0d: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.003s
I20260709 12:08:47.559505 13360 tablet_bootstrap.cc:492] T 31db820ce3cc45e0bb5f3560f7cc60e4 P 2768c30a298e46b784868aea92ffdb0d: Bootstrap starting.
I20260709 12:08:47.559765 13359 tablet_bootstrap.cc:492] T c6d14c392db54aeca8c6ff936e6ea348 P 1badc676cc734a90900be6af887e027a: No bootstrap required, opened a new log
I20260709 12:08:47.560410 13359 ts_tablet_manager.cc:1403] T c6d14c392db54aeca8c6ff936e6ea348 P 1badc676cc734a90900be6af887e027a: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.005s
I20260709 12:08:47.554740 13365 consensus_queue.cc:237] T fac4c58593a44cd5a45e96d22fb3f0dd P 1badc676cc734a90900be6af887e027a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.562383 13316 raft_consensus.cc:2468] T fac4c58593a44cd5a45e96d22fb3f0dd P da0f578f1d4541ada6f9aad99f761e8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1badc676cc734a90900be6af887e027a in term 1.
I20260709 12:08:47.563910 13359 raft_consensus.cc:359] T c6d14c392db54aeca8c6ff936e6ea348 P 1badc676cc734a90900be6af887e027a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.564668 13359 raft_consensus.cc:385] T c6d14c392db54aeca8c6ff936e6ea348 P 1badc676cc734a90900be6af887e027a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.565022 13359 raft_consensus.cc:740] T c6d14c392db54aeca8c6ff936e6ea348 P 1badc676cc734a90900be6af887e027a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1badc676cc734a90900be6af887e027a, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.565917 13364 raft_consensus.cc:493] T 0548d800f00849639c60c9fc6a0b3b44 P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:47.565749 13359 consensus_queue.cc:260] T c6d14c392db54aeca8c6ff936e6ea348 P 1badc676cc734a90900be6af887e027a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.566514 13364 raft_consensus.cc:515] T 0548d800f00849639c60c9fc6a0b3b44 P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } }
I20260709 12:08:47.568614 13359 ts_tablet_manager.cc:1434] T c6d14c392db54aeca8c6ff936e6ea348 P 1badc676cc734a90900be6af887e027a: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:08:47.569054 13364 leader_election.cc:290] T 0548d800f00849639c60c9fc6a0b3b44 P 2768c30a298e46b784868aea92ffdb0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da0f578f1d4541ada6f9aad99f761e8c (127.12.56.195:40703), 1badc676cc734a90900be6af887e027a (127.12.56.193:36691)
I20260709 12:08:47.569730 13359 tablet_bootstrap.cc:492] T 3db6a69f63d049fca47cec510aa05a89 P 1badc676cc734a90900be6af887e027a: Bootstrap starting.
I20260709 12:08:47.569909 13356 tablet_bootstrap.cc:654] T 3feb7c5af98049f09244f7e2266f3b62 P da0f578f1d4541ada6f9aad99f761e8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.570986 13316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0548d800f00849639c60c9fc6a0b3b44" candidate_uuid: "2768c30a298e46b784868aea92ffdb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da0f578f1d4541ada6f9aad99f761e8c" is_pre_election: true
I20260709 12:08:47.571673 13316 raft_consensus.cc:2468] T 0548d800f00849639c60c9fc6a0b3b44 P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2768c30a298e46b784868aea92ffdb0d in term 0.
I20260709 12:08:47.571759 13166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0548d800f00849639c60c9fc6a0b3b44" candidate_uuid: "2768c30a298e46b784868aea92ffdb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1badc676cc734a90900be6af887e027a" is_pre_election: true
I20260709 12:08:47.572479 13166 raft_consensus.cc:2468] T 0548d800f00849639c60c9fc6a0b3b44 P 1badc676cc734a90900be6af887e027a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2768c30a298e46b784868aea92ffdb0d in term 0.
I20260709 12:08:47.573083 13207 leader_election.cc:304] T 0548d800f00849639c60c9fc6a0b3b44 P 2768c30a298e46b784868aea92ffdb0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2768c30a298e46b784868aea92ffdb0d, da0f578f1d4541ada6f9aad99f761e8c; no voters: 
I20260709 12:08:47.574731 13364 raft_consensus.cc:2804] T 0548d800f00849639c60c9fc6a0b3b44 P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:47.575232 13364 raft_consensus.cc:493] T 0548d800f00849639c60c9fc6a0b3b44 P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:47.575692 13364 raft_consensus.cc:3060] T 0548d800f00849639c60c9fc6a0b3b44 P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.578214 13360 tablet_bootstrap.cc:654] T 31db820ce3cc45e0bb5f3560f7cc60e4 P 2768c30a298e46b784868aea92ffdb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.579176 13061 catalog_manager.cc:5697] T fac4c58593a44cd5a45e96d22fb3f0dd P 1badc676cc734a90900be6af887e027a reported cstate change: term changed from 0 to 1, leader changed from <none> to 1badc676cc734a90900be6af887e027a (127.12.56.193). New cstate: current_term: 1 leader_uuid: "1badc676cc734a90900be6af887e027a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:47.580421 13359 tablet_bootstrap.cc:654] T 3db6a69f63d049fca47cec510aa05a89 P 1badc676cc734a90900be6af887e027a: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.586586 13356 tablet_bootstrap.cc:492] T 3feb7c5af98049f09244f7e2266f3b62 P da0f578f1d4541ada6f9aad99f761e8c: No bootstrap required, opened a new log
I20260709 12:08:47.587193 13356 ts_tablet_manager.cc:1403] T 3feb7c5af98049f09244f7e2266f3b62 P da0f578f1d4541ada6f9aad99f761e8c: Time spent bootstrapping tablet: real 0.038s	user 0.013s	sys 0.003s
I20260709 12:08:47.589210 13360 tablet_bootstrap.cc:492] T 31db820ce3cc45e0bb5f3560f7cc60e4 P 2768c30a298e46b784868aea92ffdb0d: No bootstrap required, opened a new log
I20260709 12:08:47.589675 13360 ts_tablet_manager.cc:1403] T 31db820ce3cc45e0bb5f3560f7cc60e4 P 2768c30a298e46b784868aea92ffdb0d: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.001s
I20260709 12:08:47.589941 13356 raft_consensus.cc:359] T 3feb7c5af98049f09244f7e2266f3b62 P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.590631 13356 raft_consensus.cc:385] T 3feb7c5af98049f09244f7e2266f3b62 P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.590893 13356 raft_consensus.cc:740] T 3feb7c5af98049f09244f7e2266f3b62 P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da0f578f1d4541ada6f9aad99f761e8c, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.591696 13356 consensus_queue.cc:260] T 3feb7c5af98049f09244f7e2266f3b62 P da0f578f1d4541ada6f9aad99f761e8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.592564 13360 raft_consensus.cc:359] T 31db820ce3cc45e0bb5f3560f7cc60e4 P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.593274 13360 raft_consensus.cc:385] T 31db820ce3cc45e0bb5f3560f7cc60e4 P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.592871 13364 raft_consensus.cc:515] T 0548d800f00849639c60c9fc6a0b3b44 P 2768c30a298e46b784868aea92ffdb0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } }
I20260709 12:08:47.593578 13360 raft_consensus.cc:740] T 31db820ce3cc45e0bb5f3560f7cc60e4 P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2768c30a298e46b784868aea92ffdb0d, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.594024 13356 ts_tablet_manager.cc:1434] T 3feb7c5af98049f09244f7e2266f3b62 P da0f578f1d4541ada6f9aad99f761e8c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:08:47.594880 13356 tablet_bootstrap.cc:492] T 864c0069cfc244d7a79fc504e0fc0221 P da0f578f1d4541ada6f9aad99f761e8c: Bootstrap starting.
I20260709 12:08:47.595902 13364 leader_election.cc:290] T 0548d800f00849639c60c9fc6a0b3b44 P 2768c30a298e46b784868aea92ffdb0d [CANDIDATE]: Term 1 election: Requested vote from peers da0f578f1d4541ada6f9aad99f761e8c (127.12.56.195:40703), 1badc676cc734a90900be6af887e027a (127.12.56.193:36691)
I20260709 12:08:47.597143 13316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0548d800f00849639c60c9fc6a0b3b44" candidate_uuid: "2768c30a298e46b784868aea92ffdb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da0f578f1d4541ada6f9aad99f761e8c"
I20260709 12:08:47.598078 13316 raft_consensus.cc:3060] T 0548d800f00849639c60c9fc6a0b3b44 P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.599952 13166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0548d800f00849639c60c9fc6a0b3b44" candidate_uuid: "2768c30a298e46b784868aea92ffdb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1badc676cc734a90900be6af887e027a"
I20260709 12:08:47.600627 13356 tablet_bootstrap.cc:654] T 864c0069cfc244d7a79fc504e0fc0221 P da0f578f1d4541ada6f9aad99f761e8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.600539 13166 raft_consensus.cc:3060] T 0548d800f00849639c60c9fc6a0b3b44 P 1badc676cc734a90900be6af887e027a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.609508 13166 raft_consensus.cc:2468] T 0548d800f00849639c60c9fc6a0b3b44 P 1badc676cc734a90900be6af887e027a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2768c30a298e46b784868aea92ffdb0d in term 1.
I20260709 12:08:47.611388 13380 raft_consensus.cc:493] T 31db820ce3cc45e0bb5f3560f7cc60e4 P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:47.597477 13360 consensus_queue.cc:260] T 31db820ce3cc45e0bb5f3560f7cc60e4 P 2768c30a298e46b784868aea92ffdb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.611982 13380 raft_consensus.cc:515] T 31db820ce3cc45e0bb5f3560f7cc60e4 P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.614413 13208 leader_election.cc:304] T 0548d800f00849639c60c9fc6a0b3b44 P 2768c30a298e46b784868aea92ffdb0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1badc676cc734a90900be6af887e027a, 2768c30a298e46b784868aea92ffdb0d; no voters: 
I20260709 12:08:47.615831 13364 raft_consensus.cc:2804] T 0548d800f00849639c60c9fc6a0b3b44 P 2768c30a298e46b784868aea92ffdb0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:47.616248 13380 leader_election.cc:290] T 31db820ce3cc45e0bb5f3560f7cc60e4 P da0f578f1d4541ada6f9aad99f761e8c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1badc676cc734a90900be6af887e027a (127.12.56.193:36691), 2768c30a298e46b784868aea92ffdb0d (127.12.56.194:37951)
I20260709 12:08:47.617532 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31db820ce3cc45e0bb5f3560f7cc60e4" candidate_uuid: "da0f578f1d4541ada6f9aad99f761e8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2768c30a298e46b784868aea92ffdb0d" is_pre_election: true
I20260709 12:08:47.618257 13240 raft_consensus.cc:2468] T 31db820ce3cc45e0bb5f3560f7cc60e4 P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da0f578f1d4541ada6f9aad99f761e8c in term 0.
I20260709 12:08:47.619020 13166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31db820ce3cc45e0bb5f3560f7cc60e4" candidate_uuid: "da0f578f1d4541ada6f9aad99f761e8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1badc676cc734a90900be6af887e027a" is_pre_election: true
I20260709 12:08:47.619896 13279 leader_election.cc:304] T 31db820ce3cc45e0bb5f3560f7cc60e4 P da0f578f1d4541ada6f9aad99f761e8c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2768c30a298e46b784868aea92ffdb0d, da0f578f1d4541ada6f9aad99f761e8c; no voters: 
W20260709 12:08:47.620877 13282 leader_election.cc:343] T 31db820ce3cc45e0bb5f3560f7cc60e4 P da0f578f1d4541ada6f9aad99f761e8c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1badc676cc734a90900be6af887e027a (127.12.56.193:36691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:47.621037 13380 raft_consensus.cc:2804] T 31db820ce3cc45e0bb5f3560f7cc60e4 P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:47.621567 13380 raft_consensus.cc:493] T 31db820ce3cc45e0bb5f3560f7cc60e4 P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:47.622026 13380 raft_consensus.cc:3060] T 31db820ce3cc45e0bb5f3560f7cc60e4 P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.622740 13359 tablet_bootstrap.cc:492] T 3db6a69f63d049fca47cec510aa05a89 P 1badc676cc734a90900be6af887e027a: No bootstrap required, opened a new log
I20260709 12:08:47.623557 13359 ts_tablet_manager.cc:1403] T 3db6a69f63d049fca47cec510aa05a89 P 1badc676cc734a90900be6af887e027a: Time spent bootstrapping tablet: real 0.054s	user 0.023s	sys 0.017s
I20260709 12:08:47.625205 13365 raft_consensus.cc:493] T 864c0069cfc244d7a79fc504e0fc0221 P 1badc676cc734a90900be6af887e027a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:47.625844 13365 raft_consensus.cc:515] T 864c0069cfc244d7a79fc504e0fc0221 P 1badc676cc734a90900be6af887e027a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.626698 13316 raft_consensus.cc:2468] T 0548d800f00849639c60c9fc6a0b3b44 P da0f578f1d4541ada6f9aad99f761e8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2768c30a298e46b784868aea92ffdb0d in term 1.
I20260709 12:08:47.627936 13359 raft_consensus.cc:359] T 3db6a69f63d049fca47cec510aa05a89 P 1badc676cc734a90900be6af887e027a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.628638 13365 leader_election.cc:290] T 864c0069cfc244d7a79fc504e0fc0221 P 1badc676cc734a90900be6af887e027a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2768c30a298e46b784868aea92ffdb0d (127.12.56.194:37951), da0f578f1d4541ada6f9aad99f761e8c (127.12.56.195:40703)
I20260709 12:08:47.628870 13359 raft_consensus.cc:385] T 3db6a69f63d049fca47cec510aa05a89 P 1badc676cc734a90900be6af887e027a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.629528 13359 raft_consensus.cc:740] T 3db6a69f63d049fca47cec510aa05a89 P 1badc676cc734a90900be6af887e027a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1badc676cc734a90900be6af887e027a, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.630679 13359 consensus_queue.cc:260] T 3db6a69f63d049fca47cec510aa05a89 P 1badc676cc734a90900be6af887e027a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.631210 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864c0069cfc244d7a79fc504e0fc0221" candidate_uuid: "1badc676cc734a90900be6af887e027a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2768c30a298e46b784868aea92ffdb0d" is_pre_election: true
I20260709 12:08:47.631589 13364 raft_consensus.cc:697] T 0548d800f00849639c60c9fc6a0b3b44 P 2768c30a298e46b784868aea92ffdb0d [term 1 LEADER]: Becoming Leader. State: Replica: 2768c30a298e46b784868aea92ffdb0d, State: Running, Role: LEADER
I20260709 12:08:47.632596 13364 consensus_queue.cc:237] T 0548d800f00849639c60c9fc6a0b3b44 P 2768c30a298e46b784868aea92ffdb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } }
W20260709 12:08:47.633123 13130 leader_election.cc:343] T 864c0069cfc244d7a79fc504e0fc0221 P 1badc676cc734a90900be6af887e027a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2768c30a298e46b784868aea92ffdb0d (127.12.56.194:37951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:47.633715 13359 ts_tablet_manager.cc:1434] T 3db6a69f63d049fca47cec510aa05a89 P 1badc676cc734a90900be6af887e027a: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.004s
I20260709 12:08:47.634904 13359 tablet_bootstrap.cc:492] T 31db820ce3cc45e0bb5f3560f7cc60e4 P 1badc676cc734a90900be6af887e027a: Bootstrap starting.
I20260709 12:08:47.639447 13356 tablet_bootstrap.cc:492] T 864c0069cfc244d7a79fc504e0fc0221 P da0f578f1d4541ada6f9aad99f761e8c: No bootstrap required, opened a new log
I20260709 12:08:47.640002 13356 ts_tablet_manager.cc:1403] T 864c0069cfc244d7a79fc504e0fc0221 P da0f578f1d4541ada6f9aad99f761e8c: Time spent bootstrapping tablet: real 0.045s	user 0.005s	sys 0.013s
I20260709 12:08:47.643026 13359 tablet_bootstrap.cc:654] T 31db820ce3cc45e0bb5f3560f7cc60e4 P 1badc676cc734a90900be6af887e027a: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.642963 13316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864c0069cfc244d7a79fc504e0fc0221" candidate_uuid: "1badc676cc734a90900be6af887e027a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da0f578f1d4541ada6f9aad99f761e8c" is_pre_election: true
I20260709 12:08:47.643792 13397 raft_consensus.cc:493] T 3db6a69f63d049fca47cec510aa05a89 P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:47.644353 13397 raft_consensus.cc:515] T 3db6a69f63d049fca47cec510aa05a89 P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
W20260709 12:08:47.645260 13132 leader_election.cc:343] T 864c0069cfc244d7a79fc504e0fc0221 P 1badc676cc734a90900be6af887e027a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da0f578f1d4541ada6f9aad99f761e8c (127.12.56.195:40703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:47.645973 13132 leader_election.cc:304] T 864c0069cfc244d7a79fc504e0fc0221 P 1badc676cc734a90900be6af887e027a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1badc676cc734a90900be6af887e027a; no voters: 2768c30a298e46b784868aea92ffdb0d, da0f578f1d4541ada6f9aad99f761e8c
I20260709 12:08:47.647886 13386 raft_consensus.cc:2749] T 864c0069cfc244d7a79fc504e0fc0221 P 1badc676cc734a90900be6af887e027a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:47.648628 13386 raft_consensus.cc:493] T 5500cd37d9d844aebeb99f48c3a0f8fe P 1badc676cc734a90900be6af887e027a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:47.648702 13397 leader_election.cc:290] T 3db6a69f63d049fca47cec510aa05a89 P 2768c30a298e46b784868aea92ffdb0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1badc676cc734a90900be6af887e027a (127.12.56.193:36691), da0f578f1d4541ada6f9aad99f761e8c (127.12.56.195:40703)
I20260709 12:08:47.648768 13315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db6a69f63d049fca47cec510aa05a89" candidate_uuid: "2768c30a298e46b784868aea92ffdb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da0f578f1d4541ada6f9aad99f761e8c" is_pre_election: true
I20260709 12:08:47.649204 13386 raft_consensus.cc:515] T 5500cd37d9d844aebeb99f48c3a0f8fe P 1badc676cc734a90900be6af887e027a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.649806 13315 raft_consensus.cc:2468] T 3db6a69f63d049fca47cec510aa05a89 P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2768c30a298e46b784868aea92ffdb0d in term 0.
I20260709 12:08:47.651866 13207 leader_election.cc:304] T 3db6a69f63d049fca47cec510aa05a89 P 2768c30a298e46b784868aea92ffdb0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2768c30a298e46b784868aea92ffdb0d, da0f578f1d4541ada6f9aad99f761e8c; no voters: 
I20260709 12:08:47.652508 13386 leader_election.cc:290] T 5500cd37d9d844aebeb99f48c3a0f8fe P 1badc676cc734a90900be6af887e027a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2768c30a298e46b784868aea92ffdb0d (127.12.56.194:37951), da0f578f1d4541ada6f9aad99f761e8c (127.12.56.195:40703)
I20260709 12:08:47.653344 13399 raft_consensus.cc:2804] T 3db6a69f63d049fca47cec510aa05a89 P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:47.653853 13399 raft_consensus.cc:493] T 3db6a69f63d049fca47cec510aa05a89 P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:47.655679 13166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db6a69f63d049fca47cec510aa05a89" candidate_uuid: "2768c30a298e46b784868aea92ffdb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1badc676cc734a90900be6af887e027a" is_pre_election: true
I20260709 12:08:47.656056 13356 raft_consensus.cc:359] T 864c0069cfc244d7a79fc504e0fc0221 P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.656526 13166 raft_consensus.cc:2468] T 3db6a69f63d049fca47cec510aa05a89 P 1badc676cc734a90900be6af887e027a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2768c30a298e46b784868aea92ffdb0d in term 0.
I20260709 12:08:47.656819 13356 raft_consensus.cc:385] T 864c0069cfc244d7a79fc504e0fc0221 P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.657177 13356 raft_consensus.cc:740] T 864c0069cfc244d7a79fc504e0fc0221 P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da0f578f1d4541ada6f9aad99f761e8c, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.657823 13359 tablet_bootstrap.cc:492] T 31db820ce3cc45e0bb5f3560f7cc60e4 P 1badc676cc734a90900be6af887e027a: No bootstrap required, opened a new log
I20260709 12:08:47.658517 13359 ts_tablet_manager.cc:1403] T 31db820ce3cc45e0bb5f3560f7cc60e4 P 1badc676cc734a90900be6af887e027a: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.011s
I20260709 12:08:47.659616 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5500cd37d9d844aebeb99f48c3a0f8fe" candidate_uuid: "1badc676cc734a90900be6af887e027a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2768c30a298e46b784868aea92ffdb0d" is_pre_election: true
I20260709 12:08:47.662241 13315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5500cd37d9d844aebeb99f48c3a0f8fe" candidate_uuid: "1badc676cc734a90900be6af887e027a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da0f578f1d4541ada6f9aad99f761e8c" is_pre_election: true
I20260709 12:08:47.662942 13315 raft_consensus.cc:2468] T 5500cd37d9d844aebeb99f48c3a0f8fe P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1badc676cc734a90900be6af887e027a in term 0.
I20260709 12:08:47.664017 13359 raft_consensus.cc:359] T 31db820ce3cc45e0bb5f3560f7cc60e4 P 1badc676cc734a90900be6af887e027a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.664898 13359 raft_consensus.cc:385] T 31db820ce3cc45e0bb5f3560f7cc60e4 P 1badc676cc734a90900be6af887e027a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.661818 13240 raft_consensus.cc:2468] T 5500cd37d9d844aebeb99f48c3a0f8fe P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1badc676cc734a90900be6af887e027a in term 0.
I20260709 12:08:47.664366 13132 leader_election.cc:304] T 5500cd37d9d844aebeb99f48c3a0f8fe P 1badc676cc734a90900be6af887e027a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1badc676cc734a90900be6af887e027a, da0f578f1d4541ada6f9aad99f761e8c; no voters: 
I20260709 12:08:47.665445 13359 raft_consensus.cc:740] T 31db820ce3cc45e0bb5f3560f7cc60e4 P 1badc676cc734a90900be6af887e027a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1badc676cc734a90900be6af887e027a, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.654289 13399 raft_consensus.cc:3060] T 3db6a69f63d049fca47cec510aa05a89 P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.665822 13365 raft_consensus.cc:2804] T 5500cd37d9d844aebeb99f48c3a0f8fe P 1badc676cc734a90900be6af887e027a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:47.666319 13365 raft_consensus.cc:493] T 5500cd37d9d844aebeb99f48c3a0f8fe P 1badc676cc734a90900be6af887e027a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:47.666720 13365 raft_consensus.cc:3060] T 5500cd37d9d844aebeb99f48c3a0f8fe P 1badc676cc734a90900be6af887e027a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.661309 13356 consensus_queue.cc:260] T 864c0069cfc244d7a79fc504e0fc0221 P da0f578f1d4541ada6f9aad99f761e8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.673297 13360 ts_tablet_manager.cc:1434] T 31db820ce3cc45e0bb5f3560f7cc60e4 P 2768c30a298e46b784868aea92ffdb0d: Time spent starting tablet: real 0.083s	user 0.017s	sys 0.027s
I20260709 12:08:47.673651 13356 ts_tablet_manager.cc:1434] T 864c0069cfc244d7a79fc504e0fc0221 P da0f578f1d4541ada6f9aad99f761e8c: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.002s
I20260709 12:08:47.674628 13356 tablet_bootstrap.cc:492] T c4eca66176fa42acaf5926f8b6fab9d0 P da0f578f1d4541ada6f9aad99f761e8c: Bootstrap starting.
I20260709 12:08:47.674628 13360 tablet_bootstrap.cc:492] T c6d14c392db54aeca8c6ff936e6ea348 P 2768c30a298e46b784868aea92ffdb0d: Bootstrap starting.
I20260709 12:08:47.680105 13365 raft_consensus.cc:515] T 5500cd37d9d844aebeb99f48c3a0f8fe P 1badc676cc734a90900be6af887e027a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.683604 13365 leader_election.cc:290] T 5500cd37d9d844aebeb99f48c3a0f8fe P 1badc676cc734a90900be6af887e027a [CANDIDATE]: Term 1 election: Requested vote from peers 2768c30a298e46b784868aea92ffdb0d (127.12.56.194:37951), da0f578f1d4541ada6f9aad99f761e8c (127.12.56.195:40703)
I20260709 12:08:47.684373 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5500cd37d9d844aebeb99f48c3a0f8fe" candidate_uuid: "1badc676cc734a90900be6af887e027a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2768c30a298e46b784868aea92ffdb0d"
I20260709 12:08:47.684787 13240 raft_consensus.cc:3060] T 5500cd37d9d844aebeb99f48c3a0f8fe P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.684818 13316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5500cd37d9d844aebeb99f48c3a0f8fe" candidate_uuid: "1badc676cc734a90900be6af887e027a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da0f578f1d4541ada6f9aad99f761e8c"
I20260709 12:08:47.685411 13316 raft_consensus.cc:3060] T 5500cd37d9d844aebeb99f48c3a0f8fe P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.692708 13064 catalog_manager.cc:5697] T 0548d800f00849639c60c9fc6a0b3b44 P 2768c30a298e46b784868aea92ffdb0d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2768c30a298e46b784868aea92ffdb0d (127.12.56.194). New cstate: current_term: 1 leader_uuid: "2768c30a298e46b784868aea92ffdb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:47.694386 13356 tablet_bootstrap.cc:654] T c4eca66176fa42acaf5926f8b6fab9d0 P da0f578f1d4541ada6f9aad99f761e8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.696502 13360 tablet_bootstrap.cc:654] T c6d14c392db54aeca8c6ff936e6ea348 P 2768c30a298e46b784868aea92ffdb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.693452 13240 raft_consensus.cc:2468] T 5500cd37d9d844aebeb99f48c3a0f8fe P 2768c30a298e46b784868aea92ffdb0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1badc676cc734a90900be6af887e027a in term 1.
I20260709 12:08:47.698148 13130 leader_election.cc:304] T 5500cd37d9d844aebeb99f48c3a0f8fe P 1badc676cc734a90900be6af887e027a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1badc676cc734a90900be6af887e027a, 2768c30a298e46b784868aea92ffdb0d; no voters: 
I20260709 12:08:47.698524 13316 raft_consensus.cc:2468] T 5500cd37d9d844aebeb99f48c3a0f8fe P da0f578f1d4541ada6f9aad99f761e8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1badc676cc734a90900be6af887e027a in term 1.
I20260709 12:08:47.699180 13365 raft_consensus.cc:2804] T 5500cd37d9d844aebeb99f48c3a0f8fe P 1badc676cc734a90900be6af887e027a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:47.682662 13359 consensus_queue.cc:260] T 31db820ce3cc45e0bb5f3560f7cc60e4 P 1badc676cc734a90900be6af887e027a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.702447 13365 raft_consensus.cc:697] T 5500cd37d9d844aebeb99f48c3a0f8fe P 1badc676cc734a90900be6af887e027a [term 1 LEADER]: Becoming Leader. State: Replica: 1badc676cc734a90900be6af887e027a, State: Running, Role: LEADER
I20260709 12:08:47.706238 13359 ts_tablet_manager.cc:1434] T 31db820ce3cc45e0bb5f3560f7cc60e4 P 1badc676cc734a90900be6af887e027a: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.001s
I20260709 12:08:47.703975 13365 consensus_queue.cc:237] T 5500cd37d9d844aebeb99f48c3a0f8fe P 1badc676cc734a90900be6af887e027a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.707839 13380 raft_consensus.cc:515] T 31db820ce3cc45e0bb5f3560f7cc60e4 P da0f578f1d4541ada6f9aad99f761e8c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.711145 13359 tablet_bootstrap.cc:492] T 3feb7c5af98049f09244f7e2266f3b62 P 1badc676cc734a90900be6af887e027a: Bootstrap starting.
I20260709 12:08:47.716207 13360 tablet_bootstrap.cc:492] T c6d14c392db54aeca8c6ff936e6ea348 P 2768c30a298e46b784868aea92ffdb0d: No bootstrap required, opened a new log
I20260709 12:08:47.716805 13360 ts_tablet_manager.cc:1403] T c6d14c392db54aeca8c6ff936e6ea348 P 2768c30a298e46b784868aea92ffdb0d: Time spent bootstrapping tablet: real 0.042s	user 0.017s	sys 0.001s
I20260709 12:08:47.716847 13380 leader_election.cc:290] T 31db820ce3cc45e0bb5f3560f7cc60e4 P da0f578f1d4541ada6f9aad99f761e8c [CANDIDATE]: Term 1 election: Requested vote from peers 1badc676cc734a90900be6af887e027a (127.12.56.193:36691), 2768c30a298e46b784868aea92ffdb0d (127.12.56.194:37951)
I20260709 12:08:47.717770 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31db820ce3cc45e0bb5f3560f7cc60e4" candidate_uuid: "da0f578f1d4541ada6f9aad99f761e8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2768c30a298e46b784868aea92ffdb0d"
I20260709 12:08:47.717733 13356 tablet_bootstrap.cc:492] T c4eca66176fa42acaf5926f8b6fab9d0 P da0f578f1d4541ada6f9aad99f761e8c: No bootstrap required, opened a new log
I20260709 12:08:47.719106 13356 ts_tablet_manager.cc:1403] T c4eca66176fa42acaf5926f8b6fab9d0 P da0f578f1d4541ada6f9aad99f761e8c: Time spent bootstrapping tablet: real 0.045s	user 0.007s	sys 0.008s
I20260709 12:08:47.712481 13399 raft_consensus.cc:515] T 3db6a69f63d049fca47cec510aa05a89 P 2768c30a298e46b784868aea92ffdb0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.719413 13166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31db820ce3cc45e0bb5f3560f7cc60e4" candidate_uuid: "da0f578f1d4541ada6f9aad99f761e8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1badc676cc734a90900be6af887e027a"
I20260709 12:08:47.718782 13240 raft_consensus.cc:3060] T 31db820ce3cc45e0bb5f3560f7cc60e4 P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.722625 13166 raft_consensus.cc:3060] T 31db820ce3cc45e0bb5f3560f7cc60e4 P 1badc676cc734a90900be6af887e027a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.725100 13167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db6a69f63d049fca47cec510aa05a89" candidate_uuid: "2768c30a298e46b784868aea92ffdb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1badc676cc734a90900be6af887e027a"
I20260709 12:08:47.725330 13399 leader_election.cc:290] T 3db6a69f63d049fca47cec510aa05a89 P 2768c30a298e46b784868aea92ffdb0d [CANDIDATE]: Term 1 election: Requested vote from peers 1badc676cc734a90900be6af887e027a (127.12.56.193:36691), da0f578f1d4541ada6f9aad99f761e8c (127.12.56.195:40703)
I20260709 12:08:47.728210 13167 raft_consensus.cc:3060] T 3db6a69f63d049fca47cec510aa05a89 P 1badc676cc734a90900be6af887e027a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.728253 13360 raft_consensus.cc:359] T c6d14c392db54aeca8c6ff936e6ea348 P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.729192 13360 raft_consensus.cc:385] T c6d14c392db54aeca8c6ff936e6ea348 P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.729554 13360 raft_consensus.cc:740] T c6d14c392db54aeca8c6ff936e6ea348 P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2768c30a298e46b784868aea92ffdb0d, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.730227 13316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db6a69f63d049fca47cec510aa05a89" candidate_uuid: "2768c30a298e46b784868aea92ffdb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da0f578f1d4541ada6f9aad99f761e8c"
I20260709 12:08:47.730842 13316 raft_consensus.cc:3060] T 3db6a69f63d049fca47cec510aa05a89 P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.730549 13360 consensus_queue.cc:260] T c6d14c392db54aeca8c6ff936e6ea348 P 2768c30a298e46b784868aea92ffdb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.732765 13166 raft_consensus.cc:2468] T 31db820ce3cc45e0bb5f3560f7cc60e4 P 1badc676cc734a90900be6af887e027a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da0f578f1d4541ada6f9aad99f761e8c in term 1.
I20260709 12:08:47.733004 13360 ts_tablet_manager.cc:1434] T c6d14c392db54aeca8c6ff936e6ea348 P 2768c30a298e46b784868aea92ffdb0d: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.003s
I20260709 12:08:47.734333 13360 tablet_bootstrap.cc:492] T 864c0069cfc244d7a79fc504e0fc0221 P 2768c30a298e46b784868aea92ffdb0d: Bootstrap starting.
I20260709 12:08:47.734229 13282 leader_election.cc:304] T 31db820ce3cc45e0bb5f3560f7cc60e4 P da0f578f1d4541ada6f9aad99f761e8c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1badc676cc734a90900be6af887e027a, da0f578f1d4541ada6f9aad99f761e8c; no voters: 
I20260709 12:08:47.735258 13380 raft_consensus.cc:2804] T 31db820ce3cc45e0bb5f3560f7cc60e4 P da0f578f1d4541ada6f9aad99f761e8c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:47.735774 13380 raft_consensus.cc:697] T 31db820ce3cc45e0bb5f3560f7cc60e4 P da0f578f1d4541ada6f9aad99f761e8c [term 1 LEADER]: Becoming Leader. State: Replica: da0f578f1d4541ada6f9aad99f761e8c, State: Running, Role: LEADER
I20260709 12:08:47.736639 13380 consensus_queue.cc:237] T 31db820ce3cc45e0bb5f3560f7cc60e4 P da0f578f1d4541ada6f9aad99f761e8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.739179 13316 raft_consensus.cc:2468] T 3db6a69f63d049fca47cec510aa05a89 P da0f578f1d4541ada6f9aad99f761e8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2768c30a298e46b784868aea92ffdb0d in term 1.
I20260709 12:08:47.740758 13207 leader_election.cc:304] T 3db6a69f63d049fca47cec510aa05a89 P 2768c30a298e46b784868aea92ffdb0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2768c30a298e46b784868aea92ffdb0d, da0f578f1d4541ada6f9aad99f761e8c; no voters: 
I20260709 12:08:47.742165 13360 tablet_bootstrap.cc:654] T 864c0069cfc244d7a79fc504e0fc0221 P 2768c30a298e46b784868aea92ffdb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.742646 13399 raft_consensus.cc:2804] T 3db6a69f63d049fca47cec510aa05a89 P 2768c30a298e46b784868aea92ffdb0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:47.744768 13399 raft_consensus.cc:697] T 3db6a69f63d049fca47cec510aa05a89 P 2768c30a298e46b784868aea92ffdb0d [term 1 LEADER]: Becoming Leader. State: Replica: 2768c30a298e46b784868aea92ffdb0d, State: Running, Role: LEADER
I20260709 12:08:47.747089 13356 raft_consensus.cc:359] T c4eca66176fa42acaf5926f8b6fab9d0 P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.747864 13356 raft_consensus.cc:385] T c4eca66176fa42acaf5926f8b6fab9d0 P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.748204 13356 raft_consensus.cc:740] T c4eca66176fa42acaf5926f8b6fab9d0 P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da0f578f1d4541ada6f9aad99f761e8c, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.747473 13399 consensus_queue.cc:237] T 3db6a69f63d049fca47cec510aa05a89 P 2768c30a298e46b784868aea92ffdb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.749004 13356 consensus_queue.cc:260] T c4eca66176fa42acaf5926f8b6fab9d0 P da0f578f1d4541ada6f9aad99f761e8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.744113 13061 catalog_manager.cc:5697] T 5500cd37d9d844aebeb99f48c3a0f8fe P 1badc676cc734a90900be6af887e027a reported cstate change: term changed from 0 to 1, leader changed from <none> to 1badc676cc734a90900be6af887e027a (127.12.56.193). New cstate: current_term: 1 leader_uuid: "1badc676cc734a90900be6af887e027a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:47.754858 13356 ts_tablet_manager.cc:1434] T c4eca66176fa42acaf5926f8b6fab9d0 P da0f578f1d4541ada6f9aad99f761e8c: Time spent starting tablet: real 0.035s	user 0.004s	sys 0.005s
I20260709 12:08:47.756230 13167 raft_consensus.cc:2468] T 3db6a69f63d049fca47cec510aa05a89 P 1badc676cc734a90900be6af887e027a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2768c30a298e46b784868aea92ffdb0d in term 1.
I20260709 12:08:47.768810 13398 raft_consensus.cc:493] T c6d14c392db54aeca8c6ff936e6ea348 P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:47.770890 13359 tablet_bootstrap.cc:654] T 3feb7c5af98049f09244f7e2266f3b62 P 1badc676cc734a90900be6af887e027a: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.770562 13398 raft_consensus.cc:515] T c6d14c392db54aeca8c6ff936e6ea348 P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.773929 13240 raft_consensus.cc:2468] T 31db820ce3cc45e0bb5f3560f7cc60e4 P 2768c30a298e46b784868aea92ffdb0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da0f578f1d4541ada6f9aad99f761e8c in term 1.
I20260709 12:08:47.773999 13316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d14c392db54aeca8c6ff936e6ea348" candidate_uuid: "2768c30a298e46b784868aea92ffdb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da0f578f1d4541ada6f9aad99f761e8c" is_pre_election: true
I20260709 12:08:47.774068 13167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d14c392db54aeca8c6ff936e6ea348" candidate_uuid: "2768c30a298e46b784868aea92ffdb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1badc676cc734a90900be6af887e027a" is_pre_election: true
I20260709 12:08:47.775169 13398 leader_election.cc:290] T c6d14c392db54aeca8c6ff936e6ea348 P 2768c30a298e46b784868aea92ffdb0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1badc676cc734a90900be6af887e027a (127.12.56.193:36691), da0f578f1d4541ada6f9aad99f761e8c (127.12.56.195:40703)
I20260709 12:08:47.775842 13167 raft_consensus.cc:2468] T c6d14c392db54aeca8c6ff936e6ea348 P 1badc676cc734a90900be6af887e027a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2768c30a298e46b784868aea92ffdb0d in term 0.
I20260709 12:08:47.774992 13316 raft_consensus.cc:2468] T c6d14c392db54aeca8c6ff936e6ea348 P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2768c30a298e46b784868aea92ffdb0d in term 0.
I20260709 12:08:47.777273 13208 leader_election.cc:304] T c6d14c392db54aeca8c6ff936e6ea348 P 2768c30a298e46b784868aea92ffdb0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1badc676cc734a90900be6af887e027a, 2768c30a298e46b784868aea92ffdb0d; no voters: 
I20260709 12:08:47.778149 13398 raft_consensus.cc:2804] T c6d14c392db54aeca8c6ff936e6ea348 P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:47.778509 13398 raft_consensus.cc:493] T c6d14c392db54aeca8c6ff936e6ea348 P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:47.778860 13398 raft_consensus.cc:3060] T c6d14c392db54aeca8c6ff936e6ea348 P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.781975 13360 tablet_bootstrap.cc:492] T 864c0069cfc244d7a79fc504e0fc0221 P 2768c30a298e46b784868aea92ffdb0d: No bootstrap required, opened a new log
I20260709 12:08:47.782732 13360 ts_tablet_manager.cc:1403] T 864c0069cfc244d7a79fc504e0fc0221 P 2768c30a298e46b784868aea92ffdb0d: Time spent bootstrapping tablet: real 0.049s	user 0.023s	sys 0.010s
I20260709 12:08:47.784226 13398 raft_consensus.cc:515] T c6d14c392db54aeca8c6ff936e6ea348 P 2768c30a298e46b784868aea92ffdb0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
W20260709 12:08:47.787302 13342 tablet.cc:2406] T 3feb7c5af98049f09244f7e2266f3b62 P da0f578f1d4541ada6f9aad99f761e8c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:08:47.788723 13064 catalog_manager.cc:5697] T 31db820ce3cc45e0bb5f3560f7cc60e4 P da0f578f1d4541ada6f9aad99f761e8c reported cstate change: term changed from 0 to 1, leader changed from <none> to da0f578f1d4541ada6f9aad99f761e8c (127.12.56.195). New cstate: current_term: 1 leader_uuid: "da0f578f1d4541ada6f9aad99f761e8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:47.792102 13167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d14c392db54aeca8c6ff936e6ea348" candidate_uuid: "2768c30a298e46b784868aea92ffdb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1badc676cc734a90900be6af887e027a"
I20260709 12:08:47.792866 13167 raft_consensus.cc:3060] T c6d14c392db54aeca8c6ff936e6ea348 P 1badc676cc734a90900be6af887e027a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.786962 13360 raft_consensus.cc:359] T 864c0069cfc244d7a79fc504e0fc0221 P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.798718 13360 raft_consensus.cc:385] T 864c0069cfc244d7a79fc504e0fc0221 P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.799031 13360 raft_consensus.cc:740] T 864c0069cfc244d7a79fc504e0fc0221 P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2768c30a298e46b784868aea92ffdb0d, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.800230 13359 tablet_bootstrap.cc:492] T 3feb7c5af98049f09244f7e2266f3b62 P 1badc676cc734a90900be6af887e027a: No bootstrap required, opened a new log
I20260709 12:08:47.800848 13359 ts_tablet_manager.cc:1403] T 3feb7c5af98049f09244f7e2266f3b62 P 1badc676cc734a90900be6af887e027a: Time spent bootstrapping tablet: real 0.091s	user 0.013s	sys 0.007s
I20260709 12:08:47.801944 13063 catalog_manager.cc:5697] T 3db6a69f63d049fca47cec510aa05a89 P 2768c30a298e46b784868aea92ffdb0d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2768c30a298e46b784868aea92ffdb0d (127.12.56.194). New cstate: current_term: 1 leader_uuid: "2768c30a298e46b784868aea92ffdb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:47.803272 13380 raft_consensus.cc:493] T c4eca66176fa42acaf5926f8b6fab9d0 P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:47.803745 13380 raft_consensus.cc:515] T c4eca66176fa42acaf5926f8b6fab9d0 P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.805878 13380 leader_election.cc:290] T c4eca66176fa42acaf5926f8b6fab9d0 P da0f578f1d4541ada6f9aad99f761e8c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1badc676cc734a90900be6af887e027a (127.12.56.193:36691), 2768c30a298e46b784868aea92ffdb0d (127.12.56.194:37951)
I20260709 12:08:47.807665 13359 raft_consensus.cc:359] T 3feb7c5af98049f09244f7e2266f3b62 P 1badc676cc734a90900be6af887e027a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.808429 13359 raft_consensus.cc:385] T 3feb7c5af98049f09244f7e2266f3b62 P 1badc676cc734a90900be6af887e027a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.808487 13166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4eca66176fa42acaf5926f8b6fab9d0" candidate_uuid: "da0f578f1d4541ada6f9aad99f761e8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1badc676cc734a90900be6af887e027a" is_pre_election: true
I20260709 12:08:47.808880 13359 raft_consensus.cc:740] T 3feb7c5af98049f09244f7e2266f3b62 P 1badc676cc734a90900be6af887e027a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1badc676cc734a90900be6af887e027a, State: Initialized, Role: FOLLOWER
W20260709 12:08:47.809985 13282 leader_election.cc:343] T c4eca66176fa42acaf5926f8b6fab9d0 P da0f578f1d4541ada6f9aad99f761e8c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1badc676cc734a90900be6af887e027a (127.12.56.193:36691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:47.809650 13359 consensus_queue.cc:260] T 3feb7c5af98049f09244f7e2266f3b62 P 1badc676cc734a90900be6af887e027a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.810281 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4eca66176fa42acaf5926f8b6fab9d0" candidate_uuid: "da0f578f1d4541ada6f9aad99f761e8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2768c30a298e46b784868aea92ffdb0d" is_pre_election: true
I20260709 12:08:47.810731 13360 consensus_queue.cc:260] T 864c0069cfc244d7a79fc504e0fc0221 P 2768c30a298e46b784868aea92ffdb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
W20260709 12:08:47.812036 13279 leader_election.cc:343] T c4eca66176fa42acaf5926f8b6fab9d0 P da0f578f1d4541ada6f9aad99f761e8c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2768c30a298e46b784868aea92ffdb0d (127.12.56.194:37951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:47.812510 13279 leader_election.cc:304] T c4eca66176fa42acaf5926f8b6fab9d0 P da0f578f1d4541ada6f9aad99f761e8c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da0f578f1d4541ada6f9aad99f761e8c; no voters: 1badc676cc734a90900be6af887e027a, 2768c30a298e46b784868aea92ffdb0d
I20260709 12:08:47.813067 13360 ts_tablet_manager.cc:1434] T 864c0069cfc244d7a79fc504e0fc0221 P 2768c30a298e46b784868aea92ffdb0d: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 12:08:47.813633 13380 raft_consensus.cc:2749] T c4eca66176fa42acaf5926f8b6fab9d0 P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:47.814191 13360 tablet_bootstrap.cc:492] T c4eca66176fa42acaf5926f8b6fab9d0 P 2768c30a298e46b784868aea92ffdb0d: Bootstrap starting.
I20260709 12:08:47.816295 13359 ts_tablet_manager.cc:1434] T 3feb7c5af98049f09244f7e2266f3b62 P 1badc676cc734a90900be6af887e027a: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:08:47.817378 13359 tablet_bootstrap.cc:492] T 05e69121e8b54b96bfd2863422f446b9 P 1badc676cc734a90900be6af887e027a: Bootstrap starting.
I20260709 12:08:47.819461 13167 raft_consensus.cc:2468] T c6d14c392db54aeca8c6ff936e6ea348 P 1badc676cc734a90900be6af887e027a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2768c30a298e46b784868aea92ffdb0d in term 1.
I20260709 12:08:47.820861 13208 leader_election.cc:304] T c6d14c392db54aeca8c6ff936e6ea348 P 2768c30a298e46b784868aea92ffdb0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1badc676cc734a90900be6af887e027a, 2768c30a298e46b784868aea92ffdb0d; no voters: 
I20260709 12:08:47.821969 13399 raft_consensus.cc:2804] T c6d14c392db54aeca8c6ff936e6ea348 P 2768c30a298e46b784868aea92ffdb0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:47.822491 13399 raft_consensus.cc:697] T c6d14c392db54aeca8c6ff936e6ea348 P 2768c30a298e46b784868aea92ffdb0d [term 1 LEADER]: Becoming Leader. State: Replica: 2768c30a298e46b784868aea92ffdb0d, State: Running, Role: LEADER
I20260709 12:08:47.823338 13399 consensus_queue.cc:237] T c6d14c392db54aeca8c6ff936e6ea348 P 2768c30a298e46b784868aea92ffdb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.824244 13360 tablet_bootstrap.cc:654] T c4eca66176fa42acaf5926f8b6fab9d0 P 2768c30a298e46b784868aea92ffdb0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.824285 13359 tablet_bootstrap.cc:654] T 05e69121e8b54b96bfd2863422f446b9 P 1badc676cc734a90900be6af887e027a: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.830134 13364 raft_consensus.cc:493] T 05e69121e8b54b96bfd2863422f446b9 P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:47.830845 13364 raft_consensus.cc:515] T 05e69121e8b54b96bfd2863422f446b9 P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.831350 13365 raft_consensus.cc:493] T 3feb7c5af98049f09244f7e2266f3b62 P 1badc676cc734a90900be6af887e027a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:47.832019 13365 raft_consensus.cc:515] T 3feb7c5af98049f09244f7e2266f3b62 P 1badc676cc734a90900be6af887e027a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.833739 13364 leader_election.cc:290] T 05e69121e8b54b96bfd2863422f446b9 P 2768c30a298e46b784868aea92ffdb0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1badc676cc734a90900be6af887e027a (127.12.56.193:36691), da0f578f1d4541ada6f9aad99f761e8c (127.12.56.195:40703)
I20260709 12:08:47.834666 13365 leader_election.cc:290] T 3feb7c5af98049f09244f7e2266f3b62 P 1badc676cc734a90900be6af887e027a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2768c30a298e46b784868aea92ffdb0d (127.12.56.194:37951), da0f578f1d4541ada6f9aad99f761e8c (127.12.56.195:40703)
I20260709 12:08:47.835858 13167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05e69121e8b54b96bfd2863422f446b9" candidate_uuid: "2768c30a298e46b784868aea92ffdb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1badc676cc734a90900be6af887e027a" is_pre_election: true
I20260709 12:08:47.837071 13316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3feb7c5af98049f09244f7e2266f3b62" candidate_uuid: "1badc676cc734a90900be6af887e027a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da0f578f1d4541ada6f9aad99f761e8c" is_pre_election: true
W20260709 12:08:47.838156 13208 leader_election.cc:343] T 05e69121e8b54b96bfd2863422f446b9 P 2768c30a298e46b784868aea92ffdb0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1badc676cc734a90900be6af887e027a (127.12.56.193:36691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:47.838815 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3feb7c5af98049f09244f7e2266f3b62" candidate_uuid: "1badc676cc734a90900be6af887e027a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2768c30a298e46b784868aea92ffdb0d" is_pre_election: true
I20260709 12:08:47.839145 13316 raft_consensus.cc:2468] T 3feb7c5af98049f09244f7e2266f3b62 P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1badc676cc734a90900be6af887e027a in term 0.
I20260709 12:08:47.839475 13240 raft_consensus.cc:2468] T 3feb7c5af98049f09244f7e2266f3b62 P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1badc676cc734a90900be6af887e027a in term 0.
I20260709 12:08:47.840483 13315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d14c392db54aeca8c6ff936e6ea348" candidate_uuid: "2768c30a298e46b784868aea92ffdb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da0f578f1d4541ada6f9aad99f761e8c"
I20260709 12:08:47.840597 13132 leader_election.cc:304] T 3feb7c5af98049f09244f7e2266f3b62 P 1badc676cc734a90900be6af887e027a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1badc676cc734a90900be6af887e027a, da0f578f1d4541ada6f9aad99f761e8c; no voters: 
I20260709 12:08:47.841079 13315 raft_consensus.cc:3060] T c6d14c392db54aeca8c6ff936e6ea348 P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.843039 13316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05e69121e8b54b96bfd2863422f446b9" candidate_uuid: "2768c30a298e46b784868aea92ffdb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da0f578f1d4541ada6f9aad99f761e8c" is_pre_election: true
I20260709 12:08:47.843760 13316 raft_consensus.cc:2468] T 05e69121e8b54b96bfd2863422f446b9 P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2768c30a298e46b784868aea92ffdb0d in term 0.
I20260709 12:08:47.845160 13207 leader_election.cc:304] T 05e69121e8b54b96bfd2863422f446b9 P 2768c30a298e46b784868aea92ffdb0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2768c30a298e46b784868aea92ffdb0d, da0f578f1d4541ada6f9aad99f761e8c; no voters: 1badc676cc734a90900be6af887e027a
I20260709 12:08:47.846453 13365 raft_consensus.cc:2804] T 3feb7c5af98049f09244f7e2266f3b62 P 1badc676cc734a90900be6af887e027a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:47.846557 13398 leader_election.cc:290] T c6d14c392db54aeca8c6ff936e6ea348 P 2768c30a298e46b784868aea92ffdb0d [CANDIDATE]: Term 1 election: Requested vote from peers 1badc676cc734a90900be6af887e027a (127.12.56.193:36691), da0f578f1d4541ada6f9aad99f761e8c (127.12.56.195:40703)
I20260709 12:08:47.848730 13365 raft_consensus.cc:493] T 3feb7c5af98049f09244f7e2266f3b62 P 1badc676cc734a90900be6af887e027a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:47.849151 13365 raft_consensus.cc:3060] T 3feb7c5af98049f09244f7e2266f3b62 P 1badc676cc734a90900be6af887e027a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.850929 13360 tablet_bootstrap.cc:492] T c4eca66176fa42acaf5926f8b6fab9d0 P 2768c30a298e46b784868aea92ffdb0d: No bootstrap required, opened a new log
I20260709 12:08:47.851543 13360 ts_tablet_manager.cc:1403] T c4eca66176fa42acaf5926f8b6fab9d0 P 2768c30a298e46b784868aea92ffdb0d: Time spent bootstrapping tablet: real 0.038s	user 0.014s	sys 0.008s
I20260709 12:08:47.852535 13315 raft_consensus.cc:2468] T c6d14c392db54aeca8c6ff936e6ea348 P da0f578f1d4541ada6f9aad99f761e8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2768c30a298e46b784868aea92ffdb0d in term 1.
I20260709 12:08:47.851909 13061 catalog_manager.cc:5697] T c6d14c392db54aeca8c6ff936e6ea348 P 2768c30a298e46b784868aea92ffdb0d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2768c30a298e46b784868aea92ffdb0d (127.12.56.194). New cstate: current_term: 1 leader_uuid: "2768c30a298e46b784868aea92ffdb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:47.854830 13360 raft_consensus.cc:359] T c4eca66176fa42acaf5926f8b6fab9d0 P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.855824 13360 raft_consensus.cc:385] T c4eca66176fa42acaf5926f8b6fab9d0 P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.856164 13360 raft_consensus.cc:740] T c4eca66176fa42acaf5926f8b6fab9d0 P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2768c30a298e46b784868aea92ffdb0d, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.856945 13360 consensus_queue.cc:260] T c4eca66176fa42acaf5926f8b6fab9d0 P 2768c30a298e46b784868aea92ffdb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.856592 13365 raft_consensus.cc:515] T 3feb7c5af98049f09244f7e2266f3b62 P 1badc676cc734a90900be6af887e027a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.859233 13360 ts_tablet_manager.cc:1434] T c4eca66176fa42acaf5926f8b6fab9d0 P 2768c30a298e46b784868aea92ffdb0d: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.004s
I20260709 12:08:47.848336 13399 raft_consensus.cc:2804] T 05e69121e8b54b96bfd2863422f446b9 P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:47.860191 13399 raft_consensus.cc:493] T 05e69121e8b54b96bfd2863422f446b9 P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:47.860563 13399 raft_consensus.cc:3060] T 05e69121e8b54b96bfd2863422f446b9 P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.862449 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3feb7c5af98049f09244f7e2266f3b62" candidate_uuid: "1badc676cc734a90900be6af887e027a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2768c30a298e46b784868aea92ffdb0d"
I20260709 12:08:47.863157 13240 raft_consensus.cc:3060] T 3feb7c5af98049f09244f7e2266f3b62 P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.867761 13399 raft_consensus.cc:515] T 05e69121e8b54b96bfd2863422f446b9 P 2768c30a298e46b784868aea92ffdb0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.862443 13359 tablet_bootstrap.cc:492] T 05e69121e8b54b96bfd2863422f446b9 P 1badc676cc734a90900be6af887e027a: No bootstrap required, opened a new log
I20260709 12:08:47.870026 13399 leader_election.cc:290] T 05e69121e8b54b96bfd2863422f446b9 P 2768c30a298e46b784868aea92ffdb0d [CANDIDATE]: Term 1 election: Requested vote from peers 1badc676cc734a90900be6af887e027a (127.12.56.193:36691), da0f578f1d4541ada6f9aad99f761e8c (127.12.56.195:40703)
I20260709 12:08:47.870329 13359 ts_tablet_manager.cc:1403] T 05e69121e8b54b96bfd2863422f446b9 P 1badc676cc734a90900be6af887e027a: Time spent bootstrapping tablet: real 0.053s	user 0.016s	sys 0.002s
I20260709 12:08:47.870947 13167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05e69121e8b54b96bfd2863422f446b9" candidate_uuid: "2768c30a298e46b784868aea92ffdb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1badc676cc734a90900be6af887e027a"
I20260709 12:08:47.872105 13315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05e69121e8b54b96bfd2863422f446b9" candidate_uuid: "2768c30a298e46b784868aea92ffdb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da0f578f1d4541ada6f9aad99f761e8c"
I20260709 12:08:47.872684 13315 raft_consensus.cc:3060] T 05e69121e8b54b96bfd2863422f446b9 P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:08:47.873162 13208 leader_election.cc:343] T 05e69121e8b54b96bfd2863422f446b9 P 2768c30a298e46b784868aea92ffdb0d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1badc676cc734a90900be6af887e027a (127.12.56.193:36691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:47.873379 13359 raft_consensus.cc:359] T 05e69121e8b54b96bfd2863422f446b9 P 1badc676cc734a90900be6af887e027a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.869652 13240 raft_consensus.cc:2468] T 3feb7c5af98049f09244f7e2266f3b62 P 2768c30a298e46b784868aea92ffdb0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1badc676cc734a90900be6af887e027a in term 1.
I20260709 12:08:47.874163 13359 raft_consensus.cc:385] T 05e69121e8b54b96bfd2863422f446b9 P 1badc676cc734a90900be6af887e027a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.874514 13359 raft_consensus.cc:740] T 05e69121e8b54b96bfd2863422f446b9 P 1badc676cc734a90900be6af887e027a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1badc676cc734a90900be6af887e027a, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.875600 13316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3feb7c5af98049f09244f7e2266f3b62" candidate_uuid: "1badc676cc734a90900be6af887e027a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da0f578f1d4541ada6f9aad99f761e8c"
I20260709 12:08:47.875325 13359 consensus_queue.cc:260] T 05e69121e8b54b96bfd2863422f446b9 P 1badc676cc734a90900be6af887e027a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.875859 13130 leader_election.cc:304] T 3feb7c5af98049f09244f7e2266f3b62 P 1badc676cc734a90900be6af887e027a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1badc676cc734a90900be6af887e027a, 2768c30a298e46b784868aea92ffdb0d; no voters: 
I20260709 12:08:47.876216 13316 raft_consensus.cc:3060] T 3feb7c5af98049f09244f7e2266f3b62 P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.876753 13386 raft_consensus.cc:2804] T 3feb7c5af98049f09244f7e2266f3b62 P 1badc676cc734a90900be6af887e027a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:47.877277 13386 raft_consensus.cc:697] T 3feb7c5af98049f09244f7e2266f3b62 P 1badc676cc734a90900be6af887e027a [term 1 LEADER]: Becoming Leader. State: Replica: 1badc676cc734a90900be6af887e027a, State: Running, Role: LEADER
I20260709 12:08:47.881284 13315 raft_consensus.cc:2468] T 05e69121e8b54b96bfd2863422f446b9 P da0f578f1d4541ada6f9aad99f761e8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2768c30a298e46b784868aea92ffdb0d in term 1.
I20260709 12:08:47.881541 13365 leader_election.cc:290] T 3feb7c5af98049f09244f7e2266f3b62 P 1badc676cc734a90900be6af887e027a [CANDIDATE]: Term 1 election: Requested vote from peers 2768c30a298e46b784868aea92ffdb0d (127.12.56.194:37951), da0f578f1d4541ada6f9aad99f761e8c (127.12.56.195:40703)
I20260709 12:08:47.881619 13386 consensus_queue.cc:237] T 3feb7c5af98049f09244f7e2266f3b62 P 1badc676cc734a90900be6af887e027a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.882745 13207 leader_election.cc:304] T 05e69121e8b54b96bfd2863422f446b9 P 2768c30a298e46b784868aea92ffdb0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2768c30a298e46b784868aea92ffdb0d, da0f578f1d4541ada6f9aad99f761e8c; no voters: 1badc676cc734a90900be6af887e027a
I20260709 12:08:47.884032 13316 raft_consensus.cc:2468] T 3feb7c5af98049f09244f7e2266f3b62 P da0f578f1d4541ada6f9aad99f761e8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1badc676cc734a90900be6af887e027a in term 1.
I20260709 12:08:47.884323 13399 raft_consensus.cc:2804] T 05e69121e8b54b96bfd2863422f446b9 P 2768c30a298e46b784868aea92ffdb0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:47.884940 13399 raft_consensus.cc:697] T 05e69121e8b54b96bfd2863422f446b9 P 2768c30a298e46b784868aea92ffdb0d [term 1 LEADER]: Becoming Leader. State: Replica: 2768c30a298e46b784868aea92ffdb0d, State: Running, Role: LEADER
I20260709 12:08:47.885867 13399 consensus_queue.cc:237] T 05e69121e8b54b96bfd2863422f446b9 P 2768c30a298e46b784868aea92ffdb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.889349 13359 ts_tablet_manager.cc:1434] T 05e69121e8b54b96bfd2863422f446b9 P 1badc676cc734a90900be6af887e027a: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.002s
I20260709 12:08:47.890429 13359 tablet_bootstrap.cc:492] T c4eca66176fa42acaf5926f8b6fab9d0 P 1badc676cc734a90900be6af887e027a: Bootstrap starting.
I20260709 12:08:47.899961 13359 tablet_bootstrap.cc:654] T c4eca66176fa42acaf5926f8b6fab9d0 P 1badc676cc734a90900be6af887e027a: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.899094 13061 catalog_manager.cc:5697] T 05e69121e8b54b96bfd2863422f446b9 P 2768c30a298e46b784868aea92ffdb0d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2768c30a298e46b784868aea92ffdb0d (127.12.56.194). New cstate: current_term: 1 leader_uuid: "2768c30a298e46b784868aea92ffdb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:47.904888 13359 tablet_bootstrap.cc:492] T c4eca66176fa42acaf5926f8b6fab9d0 P 1badc676cc734a90900be6af887e027a: No bootstrap required, opened a new log
I20260709 12:08:47.905376 13359 ts_tablet_manager.cc:1403] T c4eca66176fa42acaf5926f8b6fab9d0 P 1badc676cc734a90900be6af887e027a: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.000s
I20260709 12:08:47.907503 13359 raft_consensus.cc:359] T c4eca66176fa42acaf5926f8b6fab9d0 P 1badc676cc734a90900be6af887e027a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.908187 13359 raft_consensus.cc:385] T c4eca66176fa42acaf5926f8b6fab9d0 P 1badc676cc734a90900be6af887e027a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.908468 13359 raft_consensus.cc:740] T c4eca66176fa42acaf5926f8b6fab9d0 P 1badc676cc734a90900be6af887e027a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1badc676cc734a90900be6af887e027a, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.909260 13359 consensus_queue.cc:260] T c4eca66176fa42acaf5926f8b6fab9d0 P 1badc676cc734a90900be6af887e027a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.909116 13063 catalog_manager.cc:5697] T 3feb7c5af98049f09244f7e2266f3b62 P 1badc676cc734a90900be6af887e027a reported cstate change: term changed from 0 to 1, leader changed from <none> to 1badc676cc734a90900be6af887e027a (127.12.56.193). New cstate: current_term: 1 leader_uuid: "1badc676cc734a90900be6af887e027a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:47.911239 13359 ts_tablet_manager.cc:1434] T c4eca66176fa42acaf5926f8b6fab9d0 P 1badc676cc734a90900be6af887e027a: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:08:47.987450 13412 consensus_queue.cc:1048] T fac4c58593a44cd5a45e96d22fb3f0dd P 1badc676cc734a90900be6af887e027a [LEADER]: Connected to new peer: Peer: permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:47.996331 13386 raft_consensus.cc:493] T 05e69121e8b54b96bfd2863422f446b9 P 1badc676cc734a90900be6af887e027a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:47.996909 13386 raft_consensus.cc:515] T 05e69121e8b54b96bfd2863422f446b9 P 1badc676cc734a90900be6af887e027a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:47.999322 13386 leader_election.cc:290] T 05e69121e8b54b96bfd2863422f446b9 P 1badc676cc734a90900be6af887e027a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2768c30a298e46b784868aea92ffdb0d (127.12.56.194:37951), da0f578f1d4541ada6f9aad99f761e8c (127.12.56.195:40703)
I20260709 12:08:48.000130 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05e69121e8b54b96bfd2863422f446b9" candidate_uuid: "1badc676cc734a90900be6af887e027a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2768c30a298e46b784868aea92ffdb0d" is_pre_election: true
I20260709 12:08:48.000746 13316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05e69121e8b54b96bfd2863422f446b9" candidate_uuid: "1badc676cc734a90900be6af887e027a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da0f578f1d4541ada6f9aad99f761e8c" is_pre_election: true
I20260709 12:08:48.002015 13316 raft_consensus.cc:2393] T 05e69121e8b54b96bfd2863422f446b9 P da0f578f1d4541ada6f9aad99f761e8c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1badc676cc734a90900be6af887e027a in current term 1: Already voted for candidate 2768c30a298e46b784868aea92ffdb0d in this term.
I20260709 12:08:48.004181 13132 leader_election.cc:304] T 05e69121e8b54b96bfd2863422f446b9 P 1badc676cc734a90900be6af887e027a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1badc676cc734a90900be6af887e027a; no voters: 2768c30a298e46b784868aea92ffdb0d, da0f578f1d4541ada6f9aad99f761e8c
I20260709 12:08:48.005940 13412 raft_consensus.cc:3060] T 05e69121e8b54b96bfd2863422f446b9 P 1badc676cc734a90900be6af887e027a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.008669 13386 consensus_queue.cc:1048] T fac4c58593a44cd5a45e96d22fb3f0dd P 1badc676cc734a90900be6af887e027a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:48.017954 13412 raft_consensus.cc:2749] T 05e69121e8b54b96bfd2863422f446b9 P 1badc676cc734a90900be6af887e027a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:48.104408 13399 raft_consensus.cc:493] T c4eca66176fa42acaf5926f8b6fab9d0 P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:48.105005 13399 raft_consensus.cc:515] T c4eca66176fa42acaf5926f8b6fab9d0 P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:48.105894 13412 consensus_queue.cc:1048] T 5500cd37d9d844aebeb99f48c3a0f8fe P 1badc676cc734a90900be6af887e027a [LEADER]: Connected to new peer: Peer: permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:48.106987 13399 leader_election.cc:290] T c4eca66176fa42acaf5926f8b6fab9d0 P 2768c30a298e46b784868aea92ffdb0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1badc676cc734a90900be6af887e027a (127.12.56.193:36691), da0f578f1d4541ada6f9aad99f761e8c (127.12.56.195:40703)
I20260709 12:08:48.107791 13167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4eca66176fa42acaf5926f8b6fab9d0" candidate_uuid: "2768c30a298e46b784868aea92ffdb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1badc676cc734a90900be6af887e027a" is_pre_election: true
I20260709 12:08:48.108165 13316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4eca66176fa42acaf5926f8b6fab9d0" candidate_uuid: "2768c30a298e46b784868aea92ffdb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da0f578f1d4541ada6f9aad99f761e8c" is_pre_election: true
I20260709 12:08:48.108438 13167 raft_consensus.cc:2468] T c4eca66176fa42acaf5926f8b6fab9d0 P 1badc676cc734a90900be6af887e027a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2768c30a298e46b784868aea92ffdb0d in term 0.
I20260709 12:08:48.108776 13316 raft_consensus.cc:2468] T c4eca66176fa42acaf5926f8b6fab9d0 P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2768c30a298e46b784868aea92ffdb0d in term 0.
I20260709 12:08:48.109829 13208 leader_election.cc:304] T c4eca66176fa42acaf5926f8b6fab9d0 P 2768c30a298e46b784868aea92ffdb0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1badc676cc734a90900be6af887e027a, 2768c30a298e46b784868aea92ffdb0d; no voters: 
I20260709 12:08:48.111047 13399 raft_consensus.cc:2804] T c4eca66176fa42acaf5926f8b6fab9d0 P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:48.111410 13399 raft_consensus.cc:493] T c4eca66176fa42acaf5926f8b6fab9d0 P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:48.111774 13399 raft_consensus.cc:3060] T c4eca66176fa42acaf5926f8b6fab9d0 P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.120044 13399 raft_consensus.cc:515] T c4eca66176fa42acaf5926f8b6fab9d0 P 2768c30a298e46b784868aea92ffdb0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:48.121654 13420 consensus_queue.cc:1048] T 5500cd37d9d844aebeb99f48c3a0f8fe P 1badc676cc734a90900be6af887e027a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:48.123057 13167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4eca66176fa42acaf5926f8b6fab9d0" candidate_uuid: "2768c30a298e46b784868aea92ffdb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1badc676cc734a90900be6af887e027a"
I20260709 12:08:48.123709 13167 raft_consensus.cc:3060] T c4eca66176fa42acaf5926f8b6fab9d0 P 1badc676cc734a90900be6af887e027a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.124130 13399 leader_election.cc:290] T c4eca66176fa42acaf5926f8b6fab9d0 P 2768c30a298e46b784868aea92ffdb0d [CANDIDATE]: Term 1 election: Requested vote from peers 1badc676cc734a90900be6af887e027a (127.12.56.193:36691), da0f578f1d4541ada6f9aad99f761e8c (127.12.56.195:40703)
I20260709 12:08:48.125581 13315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4eca66176fa42acaf5926f8b6fab9d0" candidate_uuid: "2768c30a298e46b784868aea92ffdb0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da0f578f1d4541ada6f9aad99f761e8c"
I20260709 12:08:48.126639 13315 raft_consensus.cc:3060] T c4eca66176fa42acaf5926f8b6fab9d0 P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.133479 13167 raft_consensus.cc:2468] T c4eca66176fa42acaf5926f8b6fab9d0 P 1badc676cc734a90900be6af887e027a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2768c30a298e46b784868aea92ffdb0d in term 1.
I20260709 12:08:48.135064 13208 leader_election.cc:304] T c4eca66176fa42acaf5926f8b6fab9d0 P 2768c30a298e46b784868aea92ffdb0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1badc676cc734a90900be6af887e027a, 2768c30a298e46b784868aea92ffdb0d; no voters: 
I20260709 12:08:48.135319 13315 raft_consensus.cc:2468] T c4eca66176fa42acaf5926f8b6fab9d0 P da0f578f1d4541ada6f9aad99f761e8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2768c30a298e46b784868aea92ffdb0d in term 1.
I20260709 12:08:48.135982 13399 raft_consensus.cc:2804] T c4eca66176fa42acaf5926f8b6fab9d0 P 2768c30a298e46b784868aea92ffdb0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:48.136552 13399 raft_consensus.cc:697] T c4eca66176fa42acaf5926f8b6fab9d0 P 2768c30a298e46b784868aea92ffdb0d [term 1 LEADER]: Becoming Leader. State: Replica: 2768c30a298e46b784868aea92ffdb0d, State: Running, Role: LEADER
I20260709 12:08:48.136663 13380 raft_consensus.cc:493] T 864c0069cfc244d7a79fc504e0fc0221 P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:48.137236 13380 raft_consensus.cc:515] T 864c0069cfc244d7a79fc504e0fc0221 P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:48.137611 13399 consensus_queue.cc:237] T c4eca66176fa42acaf5926f8b6fab9d0 P 2768c30a298e46b784868aea92ffdb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:48.139510 13380 leader_election.cc:290] T 864c0069cfc244d7a79fc504e0fc0221 P da0f578f1d4541ada6f9aad99f761e8c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1badc676cc734a90900be6af887e027a (127.12.56.193:36691), 2768c30a298e46b784868aea92ffdb0d (127.12.56.194:37951)
I20260709 12:08:48.140434 13167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864c0069cfc244d7a79fc504e0fc0221" candidate_uuid: "da0f578f1d4541ada6f9aad99f761e8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1badc676cc734a90900be6af887e027a" is_pre_election: true
I20260709 12:08:48.141211 13167 raft_consensus.cc:2468] T 864c0069cfc244d7a79fc504e0fc0221 P 1badc676cc734a90900be6af887e027a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da0f578f1d4541ada6f9aad99f761e8c in term 0.
I20260709 12:08:48.141499 13241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864c0069cfc244d7a79fc504e0fc0221" candidate_uuid: "da0f578f1d4541ada6f9aad99f761e8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2768c30a298e46b784868aea92ffdb0d" is_pre_election: true
I20260709 12:08:48.142509 13241 raft_consensus.cc:2468] T 864c0069cfc244d7a79fc504e0fc0221 P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da0f578f1d4541ada6f9aad99f761e8c in term 0.
I20260709 12:08:48.142567 13282 leader_election.cc:304] T 864c0069cfc244d7a79fc504e0fc0221 P da0f578f1d4541ada6f9aad99f761e8c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1badc676cc734a90900be6af887e027a, da0f578f1d4541ada6f9aad99f761e8c; no voters: 
I20260709 12:08:48.143581 13380 raft_consensus.cc:2804] T 864c0069cfc244d7a79fc504e0fc0221 P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:48.143980 13380 raft_consensus.cc:493] T 864c0069cfc244d7a79fc504e0fc0221 P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:48.144555 13380 raft_consensus.cc:3060] T 864c0069cfc244d7a79fc504e0fc0221 P da0f578f1d4541ada6f9aad99f761e8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.148231 13063 catalog_manager.cc:5697] T c4eca66176fa42acaf5926f8b6fab9d0 P 2768c30a298e46b784868aea92ffdb0d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2768c30a298e46b784868aea92ffdb0d (127.12.56.194). New cstate: current_term: 1 leader_uuid: "2768c30a298e46b784868aea92ffdb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:48.150104 13380 raft_consensus.cc:515] T 864c0069cfc244d7a79fc504e0fc0221 P da0f578f1d4541ada6f9aad99f761e8c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:48.152228 13380 leader_election.cc:290] T 864c0069cfc244d7a79fc504e0fc0221 P da0f578f1d4541ada6f9aad99f761e8c [CANDIDATE]: Term 1 election: Requested vote from peers 1badc676cc734a90900be6af887e027a (127.12.56.193:36691), 2768c30a298e46b784868aea92ffdb0d (127.12.56.194:37951)
I20260709 12:08:48.153276 13167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864c0069cfc244d7a79fc504e0fc0221" candidate_uuid: "da0f578f1d4541ada6f9aad99f761e8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1badc676cc734a90900be6af887e027a"
I20260709 12:08:48.153443 13241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864c0069cfc244d7a79fc504e0fc0221" candidate_uuid: "da0f578f1d4541ada6f9aad99f761e8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2768c30a298e46b784868aea92ffdb0d"
I20260709 12:08:48.153976 13167 raft_consensus.cc:3060] T 864c0069cfc244d7a79fc504e0fc0221 P 1badc676cc734a90900be6af887e027a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.154166 13241 raft_consensus.cc:3060] T 864c0069cfc244d7a79fc504e0fc0221 P 2768c30a298e46b784868aea92ffdb0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.162140 13241 raft_consensus.cc:2468] T 864c0069cfc244d7a79fc504e0fc0221 P 2768c30a298e46b784868aea92ffdb0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da0f578f1d4541ada6f9aad99f761e8c in term 1.
I20260709 12:08:48.163203 13167 raft_consensus.cc:2468] T 864c0069cfc244d7a79fc504e0fc0221 P 1badc676cc734a90900be6af887e027a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da0f578f1d4541ada6f9aad99f761e8c in term 1.
I20260709 12:08:48.163604 13279 leader_election.cc:304] T 864c0069cfc244d7a79fc504e0fc0221 P da0f578f1d4541ada6f9aad99f761e8c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2768c30a298e46b784868aea92ffdb0d, da0f578f1d4541ada6f9aad99f761e8c; no voters: 
I20260709 12:08:48.164546 13380 raft_consensus.cc:2804] T 864c0069cfc244d7a79fc504e0fc0221 P da0f578f1d4541ada6f9aad99f761e8c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:48.164419 13399 consensus_queue.cc:1048] T 3db6a69f63d049fca47cec510aa05a89 P 2768c30a298e46b784868aea92ffdb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:48.165117 13380 raft_consensus.cc:697] T 864c0069cfc244d7a79fc504e0fc0221 P da0f578f1d4541ada6f9aad99f761e8c [term 1 LEADER]: Becoming Leader. State: Replica: da0f578f1d4541ada6f9aad99f761e8c, State: Running, Role: LEADER
I20260709 12:08:48.166131 13380 consensus_queue.cc:237] T 864c0069cfc244d7a79fc504e0fc0221 P da0f578f1d4541ada6f9aad99f761e8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:48.177078 13063 catalog_manager.cc:5697] T 864c0069cfc244d7a79fc504e0fc0221 P da0f578f1d4541ada6f9aad99f761e8c reported cstate change: term changed from 0 to 1, leader changed from <none> to da0f578f1d4541ada6f9aad99f761e8c (127.12.56.195). New cstate: current_term: 1 leader_uuid: "da0f578f1d4541ada6f9aad99f761e8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:48.183095 13364 consensus_queue.cc:1048] T 3db6a69f63d049fca47cec510aa05a89 P 2768c30a298e46b784868aea92ffdb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:48.229668 13399 consensus_queue.cc:1048] T 0548d800f00849639c60c9fc6a0b3b44 P 2768c30a298e46b784868aea92ffdb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:48.241958 13428 consensus_queue.cc:1048] T 0548d800f00849639c60c9fc6a0b3b44 P 2768c30a298e46b784868aea92ffdb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:48.279783 13428 consensus_queue.cc:1048] T c6d14c392db54aeca8c6ff936e6ea348 P 2768c30a298e46b784868aea92ffdb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:48.291616 13364 consensus_queue.cc:1048] T c6d14c392db54aeca8c6ff936e6ea348 P 2768c30a298e46b784868aea92ffdb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:48.333114 13380 consensus_queue.cc:1048] T 31db820ce3cc45e0bb5f3560f7cc60e4 P da0f578f1d4541ada6f9aad99f761e8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:48.341231 13380 consensus_queue.cc:1048] T 31db820ce3cc45e0bb5f3560f7cc60e4 P da0f578f1d4541ada6f9aad99f761e8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:48.374163 13241 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0548d800f00849639c60c9fc6a0b3b44"
dest_uuid: "2768c30a298e46b784868aea92ffdb0d"
mode: GRACEFUL
new_leader_uuid: "1badc676cc734a90900be6af887e027a"
 from {username='slave'} at 127.0.0.1:40370
I20260709 12:08:48.375026 13241 raft_consensus.cc:606] T 0548d800f00849639c60c9fc6a0b3b44 P 2768c30a298e46b784868aea92ffdb0d [term 1 LEADER]: Received request to transfer leadership to TS 1badc676cc734a90900be6af887e027a
I20260709 12:08:48.381412 13241 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6d14c392db54aeca8c6ff936e6ea348"
dest_uuid: "2768c30a298e46b784868aea92ffdb0d"
mode: GRACEFUL
new_leader_uuid: "1badc676cc734a90900be6af887e027a"
 from {username='slave'} at 127.0.0.1:40370
I20260709 12:08:48.382133 13241 raft_consensus.cc:606] T c6d14c392db54aeca8c6ff936e6ea348 P 2768c30a298e46b784868aea92ffdb0d [term 1 LEADER]: Received request to transfer leadership to TS 1badc676cc734a90900be6af887e027a
I20260709 12:08:48.387938 13241 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05e69121e8b54b96bfd2863422f446b9"
dest_uuid: "2768c30a298e46b784868aea92ffdb0d"
mode: GRACEFUL
new_leader_uuid: "1badc676cc734a90900be6af887e027a"
 from {username='slave'} at 127.0.0.1:40370
I20260709 12:08:48.388543 13241 raft_consensus.cc:606] T 05e69121e8b54b96bfd2863422f446b9 P 2768c30a298e46b784868aea92ffdb0d [term 1 LEADER]: Received request to transfer leadership to TS 1badc676cc734a90900be6af887e027a
I20260709 12:08:48.397145 13420 consensus_queue.cc:1048] T 3feb7c5af98049f09244f7e2266f3b62 P 1badc676cc734a90900be6af887e027a [LEADER]: Connected to new peer: Peer: permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:48.407369 13364 consensus_queue.cc:1048] T 05e69121e8b54b96bfd2863422f446b9 P 2768c30a298e46b784868aea92ffdb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:48.410794 13419 consensus_queue.cc:1048] T 3feb7c5af98049f09244f7e2266f3b62 P 1badc676cc734a90900be6af887e027a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:48.419134 13315 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "31db820ce3cc45e0bb5f3560f7cc60e4"
dest_uuid: "da0f578f1d4541ada6f9aad99f761e8c"
mode: GRACEFUL
new_leader_uuid: "1badc676cc734a90900be6af887e027a"
 from {username='slave'} at 127.0.0.1:50470
I20260709 12:08:48.419762 13315 raft_consensus.cc:606] T 31db820ce3cc45e0bb5f3560f7cc60e4 P da0f578f1d4541ada6f9aad99f761e8c [term 1 LEADER]: Received request to transfer leadership to TS 1badc676cc734a90900be6af887e027a
I20260709 12:08:48.428164 13241 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3db6a69f63d049fca47cec510aa05a89"
dest_uuid: "2768c30a298e46b784868aea92ffdb0d"
mode: GRACEFUL
new_leader_uuid: "1badc676cc734a90900be6af887e027a"
 from {username='slave'} at 127.0.0.1:40370
I20260709 12:08:48.428959 13241 raft_consensus.cc:606] T 3db6a69f63d049fca47cec510aa05a89 P 2768c30a298e46b784868aea92ffdb0d [term 1 LEADER]: Received request to transfer leadership to TS 1badc676cc734a90900be6af887e027a
I20260709 12:08:48.434708 13364 raft_consensus.cc:993] T 05e69121e8b54b96bfd2863422f446b9 P 2768c30a298e46b784868aea92ffdb0d: : Instructing follower 1badc676cc734a90900be6af887e027a to start an election
I20260709 12:08:48.435256 13364 raft_consensus.cc:1081] T 05e69121e8b54b96bfd2863422f446b9 P 2768c30a298e46b784868aea92ffdb0d [term 1 LEADER]: Signalling peer 1badc676cc734a90900be6af887e027a to start an election
I20260709 12:08:48.436321 13398 consensus_queue.cc:1048] T 05e69121e8b54b96bfd2863422f446b9 P 2768c30a298e46b784868aea92ffdb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:48.446000 13167 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "05e69121e8b54b96bfd2863422f446b9"
dest_uuid: "1badc676cc734a90900be6af887e027a"
 from {username='slave'} at 127.0.0.1:36390
I20260709 12:08:48.449904 13167 raft_consensus.cc:493] T 05e69121e8b54b96bfd2863422f446b9 P 1badc676cc734a90900be6af887e027a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:48.450379 13167 raft_consensus.cc:3060] T 05e69121e8b54b96bfd2863422f446b9 P 1badc676cc734a90900be6af887e027a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.459555 13167 raft_consensus.cc:515] T 05e69121e8b54b96bfd2863422f446b9 P 1badc676cc734a90900be6af887e027a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:48.463111 13241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05e69121e8b54b96bfd2863422f446b9" candidate_uuid: "1badc676cc734a90900be6af887e027a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2768c30a298e46b784868aea92ffdb0d"
I20260709 12:08:48.463312 13166 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fac4c58593a44cd5a45e96d22fb3f0dd"
dest_uuid: "1badc676cc734a90900be6af887e027a"
mode: GRACEFUL
new_leader_uuid: "2768c30a298e46b784868aea92ffdb0d"
 from {username='slave'} at 127.0.0.1:36402
I20260709 12:08:48.463758 13241 raft_consensus.cc:3055] T 05e69121e8b54b96bfd2863422f446b9 P 2768c30a298e46b784868aea92ffdb0d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:48.463868 13166 raft_consensus.cc:606] T fac4c58593a44cd5a45e96d22fb3f0dd P 1badc676cc734a90900be6af887e027a [term 1 LEADER]: Received request to transfer leadership to TS 2768c30a298e46b784868aea92ffdb0d
I20260709 12:08:48.464155 13241 raft_consensus.cc:740] T 05e69121e8b54b96bfd2863422f446b9 P 2768c30a298e46b784868aea92ffdb0d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2768c30a298e46b784868aea92ffdb0d, State: Running, Role: LEADER
I20260709 12:08:48.464315 13167 leader_election.cc:290] T 05e69121e8b54b96bfd2863422f446b9 P 1badc676cc734a90900be6af887e027a [CANDIDATE]: Term 2 election: Requested vote from peers 2768c30a298e46b784868aea92ffdb0d (127.12.56.194:37951), da0f578f1d4541ada6f9aad99f761e8c (127.12.56.195:40703)
I20260709 12:08:48.465039 13241 consensus_queue.cc:260] T 05e69121e8b54b96bfd2863422f446b9 P 2768c30a298e46b784868aea92ffdb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:48.465538 13315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05e69121e8b54b96bfd2863422f446b9" candidate_uuid: "1badc676cc734a90900be6af887e027a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da0f578f1d4541ada6f9aad99f761e8c"
I20260709 12:08:48.466257 13315 raft_consensus.cc:3060] T 05e69121e8b54b96bfd2863422f446b9 P da0f578f1d4541ada6f9aad99f761e8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.466266 13241 raft_consensus.cc:3060] T 05e69121e8b54b96bfd2863422f446b9 P 2768c30a298e46b784868aea92ffdb0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.470428 13167 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3feb7c5af98049f09244f7e2266f3b62"
dest_uuid: "1badc676cc734a90900be6af887e027a"
mode: GRACEFUL
new_leader_uuid: "2768c30a298e46b784868aea92ffdb0d"
 from {username='slave'} at 127.0.0.1:36402
I20260709 12:08:48.471016 13167 raft_consensus.cc:606] T 3feb7c5af98049f09244f7e2266f3b62 P 1badc676cc734a90900be6af887e027a [term 1 LEADER]: Received request to transfer leadership to TS 2768c30a298e46b784868aea92ffdb0d
I20260709 12:08:48.473491 13315 raft_consensus.cc:2468] T 05e69121e8b54b96bfd2863422f446b9 P da0f578f1d4541ada6f9aad99f761e8c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1badc676cc734a90900be6af887e027a in term 2.
I20260709 12:08:48.473507 13241 raft_consensus.cc:2468] T 05e69121e8b54b96bfd2863422f446b9 P 2768c30a298e46b784868aea92ffdb0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1badc676cc734a90900be6af887e027a in term 2.
I20260709 12:08:48.474752 13130 leader_election.cc:304] T 05e69121e8b54b96bfd2863422f446b9 P 1badc676cc734a90900be6af887e027a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1badc676cc734a90900be6af887e027a, 2768c30a298e46b784868aea92ffdb0d; no voters: 
I20260709 12:08:48.475673 13419 raft_consensus.cc:2804] T 05e69121e8b54b96bfd2863422f446b9 P 1badc676cc734a90900be6af887e027a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:48.476145 13419 raft_consensus.cc:697] T 05e69121e8b54b96bfd2863422f446b9 P 1badc676cc734a90900be6af887e027a [term 2 LEADER]: Becoming Leader. State: Replica: 1badc676cc734a90900be6af887e027a, State: Running, Role: LEADER
I20260709 12:08:48.476963 13419 consensus_queue.cc:237] T 05e69121e8b54b96bfd2863422f446b9 P 1badc676cc734a90900be6af887e027a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:48.477882 13315 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "864c0069cfc244d7a79fc504e0fc0221"
dest_uuid: "da0f578f1d4541ada6f9aad99f761e8c"
mode: GRACEFUL
new_leader_uuid: "2768c30a298e46b784868aea92ffdb0d"
 from {username='slave'} at 127.0.0.1:50470
I20260709 12:08:48.478497 13315 raft_consensus.cc:606] T 864c0069cfc244d7a79fc504e0fc0221 P da0f578f1d4541ada6f9aad99f761e8c [term 1 LEADER]: Received request to transfer leadership to TS 2768c30a298e46b784868aea92ffdb0d
I20260709 12:08:48.484346 13167 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5500cd37d9d844aebeb99f48c3a0f8fe"
dest_uuid: "1badc676cc734a90900be6af887e027a"
mode: GRACEFUL
new_leader_uuid: "2768c30a298e46b784868aea92ffdb0d"
 from {username='slave'} at 127.0.0.1:36402
I20260709 12:08:48.484973 13167 raft_consensus.cc:606] T 5500cd37d9d844aebeb99f48c3a0f8fe P 1badc676cc734a90900be6af887e027a [term 1 LEADER]: Received request to transfer leadership to TS 2768c30a298e46b784868aea92ffdb0d
I20260709 12:08:48.485219 13061 catalog_manager.cc:5697] T 05e69121e8b54b96bfd2863422f446b9 P 1badc676cc734a90900be6af887e027a reported cstate change: term changed from 1 to 2, leader changed from 2768c30a298e46b784868aea92ffdb0d (127.12.56.194) to 1badc676cc734a90900be6af887e027a (127.12.56.193). New cstate: current_term: 2 leader_uuid: "1badc676cc734a90900be6af887e027a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:48.490900 13241 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4eca66176fa42acaf5926f8b6fab9d0"
dest_uuid: "2768c30a298e46b784868aea92ffdb0d"
mode: GRACEFUL
new_leader_uuid: "da0f578f1d4541ada6f9aad99f761e8c"
 from {username='slave'} at 127.0.0.1:40370
I20260709 12:08:48.491667 13241 raft_consensus.cc:606] T c4eca66176fa42acaf5926f8b6fab9d0 P 2768c30a298e46b784868aea92ffdb0d [term 1 LEADER]: Received request to transfer leadership to TS da0f578f1d4541ada6f9aad99f761e8c
I20260709 12:08:48.674185 13412 raft_consensus.cc:993] T 5500cd37d9d844aebeb99f48c3a0f8fe P 1badc676cc734a90900be6af887e027a: : Instructing follower 2768c30a298e46b784868aea92ffdb0d to start an election
I20260709 12:08:48.674664 13412 raft_consensus.cc:1081] T 5500cd37d9d844aebeb99f48c3a0f8fe P 1badc676cc734a90900be6af887e027a [term 1 LEADER]: Signalling peer 2768c30a298e46b784868aea92ffdb0d to start an election
I20260709 12:08:48.676084 13398 raft_consensus.cc:993] T 3db6a69f63d049fca47cec510aa05a89 P 2768c30a298e46b784868aea92ffdb0d: : Instructing follower 1badc676cc734a90900be6af887e027a to start an election
I20260709 12:08:48.676462 13241 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5500cd37d9d844aebeb99f48c3a0f8fe"
dest_uuid: "2768c30a298e46b784868aea92ffdb0d"
 from {username='slave'} at 127.0.0.1:40368
I20260709 12:08:48.676545 13398 raft_consensus.cc:1081] T 3db6a69f63d049fca47cec510aa05a89 P 2768c30a298e46b784868aea92ffdb0d [term 1 LEADER]: Signalling peer 1badc676cc734a90900be6af887e027a to start an election
I20260709 12:08:48.678038 13241 raft_consensus.cc:493] T 5500cd37d9d844aebeb99f48c3a0f8fe P 2768c30a298e46b784868aea92ffdb0d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:48.678558 13241 raft_consensus.cc:3060] T 5500cd37d9d844aebeb99f48c3a0f8fe P 2768c30a298e46b784868aea92ffdb0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.678534 13167 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3db6a69f63d049fca47cec510aa05a89"
dest_uuid: "1badc676cc734a90900be6af887e027a"
 from {username='slave'} at 127.0.0.1:36390
I20260709 12:08:48.679354 13167 raft_consensus.cc:493] T 3db6a69f63d049fca47cec510aa05a89 P 1badc676cc734a90900be6af887e027a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:48.679728 13167 raft_consensus.cc:3060] T 3db6a69f63d049fca47cec510aa05a89 P 1badc676cc734a90900be6af887e027a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.683635 13241 raft_consensus.cc:515] T 5500cd37d9d844aebeb99f48c3a0f8fe P 2768c30a298e46b784868aea92ffdb0d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:48.685379 13241 leader_election.cc:290] T 5500cd37d9d844aebeb99f48c3a0f8fe P 2768c30a298e46b784868aea92ffdb0d [CANDIDATE]: Term 2 election: Requested vote from peers 1badc676cc734a90900be6af887e027a (127.12.56.193:36691), da0f578f1d4541ada6f9aad99f761e8c (127.12.56.195:40703)
I20260709 12:08:48.684964 13167 raft_consensus.cc:515] T 3db6a69f63d049fca47cec510aa05a89 P 1badc676cc734a90900be6af887e027a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:48.686568 13166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5500cd37d9d844aebeb99f48c3a0f8fe" candidate_uuid: "2768c30a298e46b784868aea92ffdb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1badc676cc734a90900be6af887e027a"
I20260709 12:08:48.686606 13315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5500cd37d9d844aebeb99f48c3a0f8fe" candidate_uuid: "2768c30a298e46b784868aea92ffdb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da0f578f1d4541ada6f9aad99f761e8c"
I20260709 12:08:48.687354 13166 raft_consensus.cc:3055] T 5500cd37d9d844aebeb99f48c3a0f8fe P 1badc676cc734a90900be6af887e027a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:48.687840 13166 raft_consensus.cc:740] T 5500cd37d9d844aebeb99f48c3a0f8fe P 1badc676cc734a90900be6af887e027a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1badc676cc734a90900be6af887e027a, State: Running, Role: LEADER
I20260709 12:08:48.687995 13167 leader_election.cc:290] T 3db6a69f63d049fca47cec510aa05a89 P 1badc676cc734a90900be6af887e027a [CANDIDATE]: Term 2 election: Requested vote from peers 2768c30a298e46b784868aea92ffdb0d (127.12.56.194:37951), da0f578f1d4541ada6f9aad99f761e8c (127.12.56.195:40703)
I20260709 12:08:48.688370 13241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db6a69f63d049fca47cec510aa05a89" candidate_uuid: "1badc676cc734a90900be6af887e027a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2768c30a298e46b784868aea92ffdb0d"
I20260709 12:08:48.687448 13315 raft_consensus.cc:3060] T 5500cd37d9d844aebeb99f48c3a0f8fe P da0f578f1d4541ada6f9aad99f761e8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.688778 13166 consensus_queue.cc:260] T 5500cd37d9d844aebeb99f48c3a0f8fe P 1badc676cc734a90900be6af887e027a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:48.690119 13316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db6a69f63d049fca47cec510aa05a89" candidate_uuid: "1badc676cc734a90900be6af887e027a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da0f578f1d4541ada6f9aad99f761e8c"
I20260709 12:08:48.690301 13166 raft_consensus.cc:3060] T 5500cd37d9d844aebeb99f48c3a0f8fe P 1badc676cc734a90900be6af887e027a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.690726 13316 raft_consensus.cc:3060] T 3db6a69f63d049fca47cec510aa05a89 P da0f578f1d4541ada6f9aad99f761e8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.694212 13241 raft_consensus.cc:3055] T 3db6a69f63d049fca47cec510aa05a89 P 2768c30a298e46b784868aea92ffdb0d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:48.694653 13241 raft_consensus.cc:740] T 3db6a69f63d049fca47cec510aa05a89 P 2768c30a298e46b784868aea92ffdb0d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2768c30a298e46b784868aea92ffdb0d, State: Running, Role: LEADER
I20260709 12:08:48.694762 13315 raft_consensus.cc:2468] T 5500cd37d9d844aebeb99f48c3a0f8fe P da0f578f1d4541ada6f9aad99f761e8c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2768c30a298e46b784868aea92ffdb0d in term 2.
I20260709 12:08:48.695771 13241 consensus_queue.cc:260] T 3db6a69f63d049fca47cec510aa05a89 P 2768c30a298e46b784868aea92ffdb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:48.696074 13207 leader_election.cc:304] T 5500cd37d9d844aebeb99f48c3a0f8fe P 2768c30a298e46b784868aea92ffdb0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2768c30a298e46b784868aea92ffdb0d, da0f578f1d4541ada6f9aad99f761e8c; no voters: 
I20260709 12:08:48.697074 13398 raft_consensus.cc:2804] T 5500cd37d9d844aebeb99f48c3a0f8fe P 2768c30a298e46b784868aea92ffdb0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:48.697189 13241 raft_consensus.cc:3060] T 3db6a69f63d049fca47cec510aa05a89 P 2768c30a298e46b784868aea92ffdb0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.697578 13398 raft_consensus.cc:697] T 5500cd37d9d844aebeb99f48c3a0f8fe P 2768c30a298e46b784868aea92ffdb0d [term 2 LEADER]: Becoming Leader. State: Replica: 2768c30a298e46b784868aea92ffdb0d, State: Running, Role: LEADER
I20260709 12:08:48.698479 13316 raft_consensus.cc:2468] T 3db6a69f63d049fca47cec510aa05a89 P da0f578f1d4541ada6f9aad99f761e8c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1badc676cc734a90900be6af887e027a in term 2.
I20260709 12:08:48.698927 13166 raft_consensus.cc:2468] T 5500cd37d9d844aebeb99f48c3a0f8fe P 1badc676cc734a90900be6af887e027a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2768c30a298e46b784868aea92ffdb0d in term 2.
I20260709 12:08:48.698519 13398 consensus_queue.cc:237] T 5500cd37d9d844aebeb99f48c3a0f8fe P 2768c30a298e46b784868aea92ffdb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:48.699990 13132 leader_election.cc:304] T 3db6a69f63d049fca47cec510aa05a89 P 1badc676cc734a90900be6af887e027a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1badc676cc734a90900be6af887e027a, da0f578f1d4541ada6f9aad99f761e8c; no voters: 
I20260709 12:08:48.700898 13412 raft_consensus.cc:2804] T 3db6a69f63d049fca47cec510aa05a89 P 1badc676cc734a90900be6af887e027a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:48.701501 13412 raft_consensus.cc:697] T 3db6a69f63d049fca47cec510aa05a89 P 1badc676cc734a90900be6af887e027a [term 2 LEADER]: Becoming Leader. State: Replica: 1badc676cc734a90900be6af887e027a, State: Running, Role: LEADER
I20260709 12:08:48.702394 13412 consensus_queue.cc:237] T 3db6a69f63d049fca47cec510aa05a89 P 1badc676cc734a90900be6af887e027a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:48.705072 13241 raft_consensus.cc:2468] T 3db6a69f63d049fca47cec510aa05a89 P 2768c30a298e46b784868aea92ffdb0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1badc676cc734a90900be6af887e027a in term 2.
I20260709 12:08:48.708292 13061 catalog_manager.cc:5697] T 5500cd37d9d844aebeb99f48c3a0f8fe P 2768c30a298e46b784868aea92ffdb0d reported cstate change: term changed from 1 to 2, leader changed from 1badc676cc734a90900be6af887e027a (127.12.56.193) to 2768c30a298e46b784868aea92ffdb0d (127.12.56.194). New cstate: current_term: 2 leader_uuid: "2768c30a298e46b784868aea92ffdb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:48.711040 13065 catalog_manager.cc:5697] T 3db6a69f63d049fca47cec510aa05a89 P 1badc676cc734a90900be6af887e027a reported cstate change: term changed from 1 to 2, leader changed from 2768c30a298e46b784868aea92ffdb0d (127.12.56.194) to 1badc676cc734a90900be6af887e027a (127.12.56.193). New cstate: current_term: 2 leader_uuid: "1badc676cc734a90900be6af887e027a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:48.742949 13435 raft_consensus.cc:993] T 31db820ce3cc45e0bb5f3560f7cc60e4 P da0f578f1d4541ada6f9aad99f761e8c: : Instructing follower 1badc676cc734a90900be6af887e027a to start an election
I20260709 12:08:48.743432 13380 raft_consensus.cc:1081] T 31db820ce3cc45e0bb5f3560f7cc60e4 P da0f578f1d4541ada6f9aad99f761e8c [term 1 LEADER]: Signalling peer 1badc676cc734a90900be6af887e027a to start an election
I20260709 12:08:48.745121 13380 consensus_queue.cc:1048] T 864c0069cfc244d7a79fc504e0fc0221 P da0f578f1d4541ada6f9aad99f761e8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:48.745443 13166 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "31db820ce3cc45e0bb5f3560f7cc60e4"
dest_uuid: "1badc676cc734a90900be6af887e027a"
 from {username='slave'} at 127.0.0.1:36396
I20260709 12:08:48.746169 13166 raft_consensus.cc:493] T 31db820ce3cc45e0bb5f3560f7cc60e4 P 1badc676cc734a90900be6af887e027a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:48.746609 13166 raft_consensus.cc:3060] T 31db820ce3cc45e0bb5f3560f7cc60e4 P 1badc676cc734a90900be6af887e027a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.748593 13364 consensus_queue.cc:1048] T c4eca66176fa42acaf5926f8b6fab9d0 P 2768c30a298e46b784868aea92ffdb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:48.753618 13358 raft_consensus.cc:993] T 864c0069cfc244d7a79fc504e0fc0221 P da0f578f1d4541ada6f9aad99f761e8c: : Instructing follower 2768c30a298e46b784868aea92ffdb0d to start an election
I20260709 12:08:48.754138 13358 raft_consensus.cc:1081] T 864c0069cfc244d7a79fc504e0fc0221 P da0f578f1d4541ada6f9aad99f761e8c [term 1 LEADER]: Signalling peer 2768c30a298e46b784868aea92ffdb0d to start an election
I20260709 12:08:48.755851 13166 raft_consensus.cc:515] T 31db820ce3cc45e0bb5f3560f7cc60e4 P 1badc676cc734a90900be6af887e027a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:48.760489 13166 leader_election.cc:290] T 31db820ce3cc45e0bb5f3560f7cc60e4 P 1badc676cc734a90900be6af887e027a [CANDIDATE]: Term 2 election: Requested vote from peers 2768c30a298e46b784868aea92ffdb0d (127.12.56.194:37951), da0f578f1d4541ada6f9aad99f761e8c (127.12.56.195:40703)
I20260709 12:08:48.761227 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31db820ce3cc45e0bb5f3560f7cc60e4" candidate_uuid: "1badc676cc734a90900be6af887e027a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2768c30a298e46b784868aea92ffdb0d"
I20260709 12:08:48.761952 13240 raft_consensus.cc:3060] T 31db820ce3cc45e0bb5f3560f7cc60e4 P 2768c30a298e46b784868aea92ffdb0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.764334 13364 raft_consensus.cc:993] T c6d14c392db54aeca8c6ff936e6ea348 P 2768c30a298e46b784868aea92ffdb0d: : Instructing follower 1badc676cc734a90900be6af887e027a to start an election
I20260709 12:08:48.764865 13398 raft_consensus.cc:1081] T c6d14c392db54aeca8c6ff936e6ea348 P 2768c30a298e46b784868aea92ffdb0d [term 1 LEADER]: Signalling peer 1badc676cc734a90900be6af887e027a to start an election
I20260709 12:08:48.768251 13398 raft_consensus.cc:993] T c4eca66176fa42acaf5926f8b6fab9d0 P 2768c30a298e46b784868aea92ffdb0d: : Instructing follower da0f578f1d4541ada6f9aad99f761e8c to start an election
I20260709 12:08:48.769768 13399 raft_consensus.cc:1081] T c4eca66176fa42acaf5926f8b6fab9d0 P 2768c30a298e46b784868aea92ffdb0d [term 1 LEADER]: Signalling peer da0f578f1d4541ada6f9aad99f761e8c to start an election
I20260709 12:08:48.770900 13435 consensus_queue.cc:1048] T 864c0069cfc244d7a79fc504e0fc0221 P da0f578f1d4541ada6f9aad99f761e8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:48.771445 13316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31db820ce3cc45e0bb5f3560f7cc60e4" candidate_uuid: "1badc676cc734a90900be6af887e027a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da0f578f1d4541ada6f9aad99f761e8c"
I20260709 12:08:48.771982 13314 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c4eca66176fa42acaf5926f8b6fab9d0"
dest_uuid: "da0f578f1d4541ada6f9aad99f761e8c"
 from {username='slave'} at 127.0.0.1:50448
I20260709 12:08:48.772675 13314 raft_consensus.cc:493] T c4eca66176fa42acaf5926f8b6fab9d0 P da0f578f1d4541ada6f9aad99f761e8c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:48.773169 13314 raft_consensus.cc:3060] T c4eca66176fa42acaf5926f8b6fab9d0 P da0f578f1d4541ada6f9aad99f761e8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.775281 13165 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c6d14c392db54aeca8c6ff936e6ea348"
dest_uuid: "1badc676cc734a90900be6af887e027a"
 from {username='slave'} at 127.0.0.1:36390
I20260709 12:08:48.772704 13241 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "864c0069cfc244d7a79fc504e0fc0221"
dest_uuid: "2768c30a298e46b784868aea92ffdb0d"
 from {username='slave'} at 127.0.0.1:40360
I20260709 12:08:48.778436 13240 raft_consensus.cc:2468] T 31db820ce3cc45e0bb5f3560f7cc60e4 P 2768c30a298e46b784868aea92ffdb0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1badc676cc734a90900be6af887e027a in term 2.
I20260709 12:08:48.772130 13316 raft_consensus.cc:3055] T 31db820ce3cc45e0bb5f3560f7cc60e4 P da0f578f1d4541ada6f9aad99f761e8c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:48.778811 13241 raft_consensus.cc:493] T 864c0069cfc244d7a79fc504e0fc0221 P 2768c30a298e46b784868aea92ffdb0d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:48.778986 13165 raft_consensus.cc:493] T c6d14c392db54aeca8c6ff936e6ea348 P 1badc676cc734a90900be6af887e027a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:48.779954 13165 raft_consensus.cc:3060] T c6d14c392db54aeca8c6ff936e6ea348 P 1badc676cc734a90900be6af887e027a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.780047 13130 leader_election.cc:304] T 31db820ce3cc45e0bb5f3560f7cc60e4 P 1badc676cc734a90900be6af887e027a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1badc676cc734a90900be6af887e027a, 2768c30a298e46b784868aea92ffdb0d; no voters: 
I20260709 12:08:48.781381 13412 raft_consensus.cc:2804] T 31db820ce3cc45e0bb5f3560f7cc60e4 P 1badc676cc734a90900be6af887e027a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:48.781561 13364 consensus_queue.cc:1048] T c4eca66176fa42acaf5926f8b6fab9d0 P 2768c30a298e46b784868aea92ffdb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:48.781966 13412 raft_consensus.cc:697] T 31db820ce3cc45e0bb5f3560f7cc60e4 P 1badc676cc734a90900be6af887e027a [term 2 LEADER]: Becoming Leader. State: Replica: 1badc676cc734a90900be6af887e027a, State: Running, Role: LEADER
I20260709 12:08:48.782938 13412 consensus_queue.cc:237] T 31db820ce3cc45e0bb5f3560f7cc60e4 P 1badc676cc734a90900be6af887e027a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:48.784057 13316 raft_consensus.cc:740] T 31db820ce3cc45e0bb5f3560f7cc60e4 P da0f578f1d4541ada6f9aad99f761e8c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: da0f578f1d4541ada6f9aad99f761e8c, State: Running, Role: LEADER
I20260709 12:08:48.785090 13316 consensus_queue.cc:260] T 31db820ce3cc45e0bb5f3560f7cc60e4 P da0f578f1d4541ada6f9aad99f761e8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:48.786629 13316 raft_consensus.cc:3060] T 31db820ce3cc45e0bb5f3560f7cc60e4 P da0f578f1d4541ada6f9aad99f761e8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.787731 13241 raft_consensus.cc:3060] T 864c0069cfc244d7a79fc504e0fc0221 P 2768c30a298e46b784868aea92ffdb0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.791711 13165 raft_consensus.cc:515] T c6d14c392db54aeca8c6ff936e6ea348 P 1badc676cc734a90900be6af887e027a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:48.795312 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d14c392db54aeca8c6ff936e6ea348" candidate_uuid: "1badc676cc734a90900be6af887e027a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2768c30a298e46b784868aea92ffdb0d"
I20260709 12:08:48.795778 13165 leader_election.cc:290] T c6d14c392db54aeca8c6ff936e6ea348 P 1badc676cc734a90900be6af887e027a [CANDIDATE]: Term 2 election: Requested vote from peers 2768c30a298e46b784868aea92ffdb0d (127.12.56.194:37951), da0f578f1d4541ada6f9aad99f761e8c (127.12.56.195:40703)
I20260709 12:08:48.796030 13240 raft_consensus.cc:3055] T c6d14c392db54aeca8c6ff936e6ea348 P 2768c30a298e46b784868aea92ffdb0d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:48.796428 13240 raft_consensus.cc:740] T c6d14c392db54aeca8c6ff936e6ea348 P 2768c30a298e46b784868aea92ffdb0d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2768c30a298e46b784868aea92ffdb0d, State: Running, Role: LEADER
I20260709 12:08:48.796339 13313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d14c392db54aeca8c6ff936e6ea348" candidate_uuid: "1badc676cc734a90900be6af887e027a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da0f578f1d4541ada6f9aad99f761e8c"
I20260709 12:08:48.797250 13313 raft_consensus.cc:3060] T c6d14c392db54aeca8c6ff936e6ea348 P da0f578f1d4541ada6f9aad99f761e8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.797623 13240 consensus_queue.cc:260] T c6d14c392db54aeca8c6ff936e6ea348 P 2768c30a298e46b784868aea92ffdb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:48.799007 13240 raft_consensus.cc:3060] T c6d14c392db54aeca8c6ff936e6ea348 P 2768c30a298e46b784868aea92ffdb0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.807489 13240 raft_consensus.cc:2468] T c6d14c392db54aeca8c6ff936e6ea348 P 2768c30a298e46b784868aea92ffdb0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1badc676cc734a90900be6af887e027a in term 2.
I20260709 12:08:48.808772 13130 leader_election.cc:304] T c6d14c392db54aeca8c6ff936e6ea348 P 1badc676cc734a90900be6af887e027a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1badc676cc734a90900be6af887e027a, 2768c30a298e46b784868aea92ffdb0d; no voters: 
I20260709 12:08:48.809563 13316 raft_consensus.cc:2468] T 31db820ce3cc45e0bb5f3560f7cc60e4 P da0f578f1d4541ada6f9aad99f761e8c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1badc676cc734a90900be6af887e027a in term 2.
I20260709 12:08:48.810072 13412 raft_consensus.cc:2804] T c6d14c392db54aeca8c6ff936e6ea348 P 1badc676cc734a90900be6af887e027a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:48.811657 13412 raft_consensus.cc:697] T c6d14c392db54aeca8c6ff936e6ea348 P 1badc676cc734a90900be6af887e027a [term 2 LEADER]: Becoming Leader. State: Replica: 1badc676cc734a90900be6af887e027a, State: Running, Role: LEADER
I20260709 12:08:48.812500 13412 consensus_queue.cc:237] T c6d14c392db54aeca8c6ff936e6ea348 P 1badc676cc734a90900be6af887e027a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:48.813344 13314 raft_consensus.cc:515] T c4eca66176fa42acaf5926f8b6fab9d0 P da0f578f1d4541ada6f9aad99f761e8c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:48.810482 13241 raft_consensus.cc:515] T 864c0069cfc244d7a79fc504e0fc0221 P 2768c30a298e46b784868aea92ffdb0d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:48.815852 13313 raft_consensus.cc:2468] T c6d14c392db54aeca8c6ff936e6ea348 P da0f578f1d4541ada6f9aad99f761e8c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1badc676cc734a90900be6af887e027a in term 2.
I20260709 12:08:48.817083 13241 leader_election.cc:290] T 864c0069cfc244d7a79fc504e0fc0221 P 2768c30a298e46b784868aea92ffdb0d [CANDIDATE]: Term 2 election: Requested vote from peers 1badc676cc734a90900be6af887e027a (127.12.56.193:36691), da0f578f1d4541ada6f9aad99f761e8c (127.12.56.195:40703)
I20260709 12:08:48.818228 13315 raft_consensus.cc:1240] T c4eca66176fa42acaf5926f8b6fab9d0 P da0f578f1d4541ada6f9aad99f761e8c [term 2 FOLLOWER]: Rejecting Update request from peer 2768c30a298e46b784868aea92ffdb0d for earlier term 1. Current term is 2. Ops: []
I20260709 12:08:48.818306 13313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864c0069cfc244d7a79fc504e0fc0221" candidate_uuid: "2768c30a298e46b784868aea92ffdb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da0f578f1d4541ada6f9aad99f761e8c"
I20260709 12:08:48.819219 13313 raft_consensus.cc:3055] T 864c0069cfc244d7a79fc504e0fc0221 P da0f578f1d4541ada6f9aad99f761e8c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:48.819597 13313 raft_consensus.cc:740] T 864c0069cfc244d7a79fc504e0fc0221 P da0f578f1d4541ada6f9aad99f761e8c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: da0f578f1d4541ada6f9aad99f761e8c, State: Running, Role: LEADER
I20260709 12:08:48.820991 13313 consensus_queue.cc:260] T 864c0069cfc244d7a79fc504e0fc0221 P da0f578f1d4541ada6f9aad99f761e8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:48.822477 13313 raft_consensus.cc:3060] T 864c0069cfc244d7a79fc504e0fc0221 P da0f578f1d4541ada6f9aad99f761e8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.823392 13241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4eca66176fa42acaf5926f8b6fab9d0" candidate_uuid: "da0f578f1d4541ada6f9aad99f761e8c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2768c30a298e46b784868aea92ffdb0d"
I20260709 12:08:48.823524 13364 consensus_queue.cc:1059] T c4eca66176fa42acaf5926f8b6fab9d0 P 2768c30a298e46b784868aea92ffdb0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:48.824849 13241 raft_consensus.cc:3055] T c4eca66176fa42acaf5926f8b6fab9d0 P 2768c30a298e46b784868aea92ffdb0d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:48.825368 13166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864c0069cfc244d7a79fc504e0fc0221" candidate_uuid: "2768c30a298e46b784868aea92ffdb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1badc676cc734a90900be6af887e027a"
I20260709 12:08:48.826069 13166 raft_consensus.cc:3060] T 864c0069cfc244d7a79fc504e0fc0221 P 1badc676cc734a90900be6af887e027a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.826256 13165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4eca66176fa42acaf5926f8b6fab9d0" candidate_uuid: "da0f578f1d4541ada6f9aad99f761e8c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1badc676cc734a90900be6af887e027a"
I20260709 12:08:48.819547 13314 leader_election.cc:290] T c4eca66176fa42acaf5926f8b6fab9d0 P da0f578f1d4541ada6f9aad99f761e8c [CANDIDATE]: Term 2 election: Requested vote from peers 1badc676cc734a90900be6af887e027a (127.12.56.193:36691), 2768c30a298e46b784868aea92ffdb0d (127.12.56.194:37951)
I20260709 12:08:48.826999 13165 raft_consensus.cc:3060] T c4eca66176fa42acaf5926f8b6fab9d0 P 1badc676cc734a90900be6af887e027a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.825289 13241 raft_consensus.cc:740] T c4eca66176fa42acaf5926f8b6fab9d0 P 2768c30a298e46b784868aea92ffdb0d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2768c30a298e46b784868aea92ffdb0d, State: Running, Role: LEADER
I20260709 12:08:48.834556 13166 raft_consensus.cc:2468] T 864c0069cfc244d7a79fc504e0fc0221 P 1badc676cc734a90900be6af887e027a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2768c30a298e46b784868aea92ffdb0d in term 2.
I20260709 12:08:48.835438 13165 raft_consensus.cc:2468] T c4eca66176fa42acaf5926f8b6fab9d0 P 1badc676cc734a90900be6af887e027a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da0f578f1d4541ada6f9aad99f761e8c in term 2.
I20260709 12:08:48.829746 13241 consensus_queue.cc:260] T c4eca66176fa42acaf5926f8b6fab9d0 P 2768c30a298e46b784868aea92ffdb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:48.835904 13208 leader_election.cc:304] T 864c0069cfc244d7a79fc504e0fc0221 P 2768c30a298e46b784868aea92ffdb0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1badc676cc734a90900be6af887e027a, 2768c30a298e46b784868aea92ffdb0d; no voters: 
I20260709 12:08:48.836767 13241 raft_consensus.cc:3060] T c4eca66176fa42acaf5926f8b6fab9d0 P 2768c30a298e46b784868aea92ffdb0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.836820 13398 raft_consensus.cc:2804] T 864c0069cfc244d7a79fc504e0fc0221 P 2768c30a298e46b784868aea92ffdb0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:48.837523 13398 raft_consensus.cc:697] T 864c0069cfc244d7a79fc504e0fc0221 P 2768c30a298e46b784868aea92ffdb0d [term 2 LEADER]: Becoming Leader. State: Replica: 2768c30a298e46b784868aea92ffdb0d, State: Running, Role: LEADER
I20260709 12:08:48.838635 13398 consensus_queue.cc:237] T 864c0069cfc244d7a79fc504e0fc0221 P 2768c30a298e46b784868aea92ffdb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:48.842089 13313 raft_consensus.cc:2468] T 864c0069cfc244d7a79fc504e0fc0221 P da0f578f1d4541ada6f9aad99f761e8c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2768c30a298e46b784868aea92ffdb0d in term 2.
I20260709 12:08:48.843585 13282 leader_election.cc:304] T c4eca66176fa42acaf5926f8b6fab9d0 P da0f578f1d4541ada6f9aad99f761e8c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1badc676cc734a90900be6af887e027a, da0f578f1d4541ada6f9aad99f761e8c; no voters: 
I20260709 12:08:48.844485 13435 raft_consensus.cc:2804] T c4eca66176fa42acaf5926f8b6fab9d0 P da0f578f1d4541ada6f9aad99f761e8c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:48.845021 13435 raft_consensus.cc:697] T c4eca66176fa42acaf5926f8b6fab9d0 P da0f578f1d4541ada6f9aad99f761e8c [term 2 LEADER]: Becoming Leader. State: Replica: da0f578f1d4541ada6f9aad99f761e8c, State: Running, Role: LEADER
I20260709 12:08:48.846568 13435 consensus_queue.cc:237] T c4eca66176fa42acaf5926f8b6fab9d0 P da0f578f1d4541ada6f9aad99f761e8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:48.850353 13241 raft_consensus.cc:2468] T c4eca66176fa42acaf5926f8b6fab9d0 P 2768c30a298e46b784868aea92ffdb0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da0f578f1d4541ada6f9aad99f761e8c in term 2.
W20260709 12:08:48.851693 13364 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:08:48.848378 13065 catalog_manager.cc:5697] T c6d14c392db54aeca8c6ff936e6ea348 P 1badc676cc734a90900be6af887e027a reported cstate change: term changed from 1 to 2, leader changed from 2768c30a298e46b784868aea92ffdb0d (127.12.56.194) to 1badc676cc734a90900be6af887e027a (127.12.56.193). New cstate: current_term: 2 leader_uuid: "1badc676cc734a90900be6af887e027a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:48.856601 13065 catalog_manager.cc:5697] T 31db820ce3cc45e0bb5f3560f7cc60e4 P 1badc676cc734a90900be6af887e027a reported cstate change: term changed from 1 to 2, leader changed from da0f578f1d4541ada6f9aad99f761e8c (127.12.56.195) to 1badc676cc734a90900be6af887e027a (127.12.56.193). New cstate: current_term: 2 leader_uuid: "1badc676cc734a90900be6af887e027a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:48.857455 13398 raft_consensus.cc:993] T 0548d800f00849639c60c9fc6a0b3b44 P 2768c30a298e46b784868aea92ffdb0d: : Instructing follower 1badc676cc734a90900be6af887e027a to start an election
I20260709 12:08:48.858108 13398 raft_consensus.cc:1081] T 0548d800f00849639c60c9fc6a0b3b44 P 2768c30a298e46b784868aea92ffdb0d [term 1 LEADER]: Signalling peer 1badc676cc734a90900be6af887e027a to start an election
I20260709 12:08:48.859922 13165 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0548d800f00849639c60c9fc6a0b3b44"
dest_uuid: "1badc676cc734a90900be6af887e027a"
 from {username='slave'} at 127.0.0.1:36390
I20260709 12:08:48.860529 13165 raft_consensus.cc:493] T 0548d800f00849639c60c9fc6a0b3b44 P 1badc676cc734a90900be6af887e027a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:48.860911 13165 raft_consensus.cc:3060] T 0548d800f00849639c60c9fc6a0b3b44 P 1badc676cc734a90900be6af887e027a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.867569 13165 raft_consensus.cc:515] T 0548d800f00849639c60c9fc6a0b3b44 P 1badc676cc734a90900be6af887e027a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } }
I20260709 12:08:48.867671 13063 catalog_manager.cc:5697] T c4eca66176fa42acaf5926f8b6fab9d0 P da0f578f1d4541ada6f9aad99f761e8c reported cstate change: term changed from 1 to 2, leader changed from 2768c30a298e46b784868aea92ffdb0d (127.12.56.194) to da0f578f1d4541ada6f9aad99f761e8c (127.12.56.195). New cstate: current_term: 2 leader_uuid: "da0f578f1d4541ada6f9aad99f761e8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:48.867741 13061 catalog_manager.cc:5697] T 864c0069cfc244d7a79fc504e0fc0221 P 2768c30a298e46b784868aea92ffdb0d reported cstate change: term changed from 1 to 2, leader changed from da0f578f1d4541ada6f9aad99f761e8c (127.12.56.195) to 2768c30a298e46b784868aea92ffdb0d (127.12.56.194). New cstate: current_term: 2 leader_uuid: "2768c30a298e46b784868aea92ffdb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:48.870743 13165 leader_election.cc:290] T 0548d800f00849639c60c9fc6a0b3b44 P 1badc676cc734a90900be6af887e027a [CANDIDATE]: Term 2 election: Requested vote from peers da0f578f1d4541ada6f9aad99f761e8c (127.12.56.195:40703), 2768c30a298e46b784868aea92ffdb0d (127.12.56.194:37951)
I20260709 12:08:48.870944 13313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0548d800f00849639c60c9fc6a0b3b44" candidate_uuid: "1badc676cc734a90900be6af887e027a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da0f578f1d4541ada6f9aad99f761e8c"
I20260709 12:08:48.871773 13313 raft_consensus.cc:3060] T 0548d800f00849639c60c9fc6a0b3b44 P da0f578f1d4541ada6f9aad99f761e8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.871773 13241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0548d800f00849639c60c9fc6a0b3b44" candidate_uuid: "1badc676cc734a90900be6af887e027a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2768c30a298e46b784868aea92ffdb0d"
I20260709 12:08:48.872530 13241 raft_consensus.cc:3055] T 0548d800f00849639c60c9fc6a0b3b44 P 2768c30a298e46b784868aea92ffdb0d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:48.872869 13241 raft_consensus.cc:740] T 0548d800f00849639c60c9fc6a0b3b44 P 2768c30a298e46b784868aea92ffdb0d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2768c30a298e46b784868aea92ffdb0d, State: Running, Role: LEADER
I20260709 12:08:48.873878 13241 consensus_queue.cc:260] T 0548d800f00849639c60c9fc6a0b3b44 P 2768c30a298e46b784868aea92ffdb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } }
I20260709 12:08:48.875209 13241 raft_consensus.cc:3060] T 0548d800f00849639c60c9fc6a0b3b44 P 2768c30a298e46b784868aea92ffdb0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.880280 13313 raft_consensus.cc:2468] T 0548d800f00849639c60c9fc6a0b3b44 P da0f578f1d4541ada6f9aad99f761e8c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1badc676cc734a90900be6af887e027a in term 2.
I20260709 12:08:48.881597 13132 leader_election.cc:304] T 0548d800f00849639c60c9fc6a0b3b44 P 1badc676cc734a90900be6af887e027a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1badc676cc734a90900be6af887e027a, da0f578f1d4541ada6f9aad99f761e8c; no voters: 
I20260709 12:08:48.882082 13241 raft_consensus.cc:2468] T 0548d800f00849639c60c9fc6a0b3b44 P 2768c30a298e46b784868aea92ffdb0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1badc676cc734a90900be6af887e027a in term 2.
I20260709 12:08:48.882620 13412 raft_consensus.cc:2804] T 0548d800f00849639c60c9fc6a0b3b44 P 1badc676cc734a90900be6af887e027a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:48.883181 13412 raft_consensus.cc:697] T 0548d800f00849639c60c9fc6a0b3b44 P 1badc676cc734a90900be6af887e027a [term 2 LEADER]: Becoming Leader. State: Replica: 1badc676cc734a90900be6af887e027a, State: Running, Role: LEADER
I20260709 12:08:48.884099 13412 consensus_queue.cc:237] T 0548d800f00849639c60c9fc6a0b3b44 P 1badc676cc734a90900be6af887e027a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } }
I20260709 12:08:48.891774 13063 catalog_manager.cc:5697] T 0548d800f00849639c60c9fc6a0b3b44 P 1badc676cc734a90900be6af887e027a reported cstate change: term changed from 1 to 2, leader changed from 2768c30a298e46b784868aea92ffdb0d (127.12.56.194) to 1badc676cc734a90900be6af887e027a (127.12.56.193). New cstate: current_term: 2 leader_uuid: "1badc676cc734a90900be6af887e027a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:48.894835 13313 raft_consensus.cc:1275] T 05e69121e8b54b96bfd2863422f446b9 P da0f578f1d4541ada6f9aad99f761e8c [term 2 FOLLOWER]: Refusing update from remote peer 1badc676cc734a90900be6af887e027a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:48.896251 13412 consensus_queue.cc:1048] T 05e69121e8b54b96bfd2863422f446b9 P 1badc676cc734a90900be6af887e027a [LEADER]: Connected to new peer: Peer: permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:48.905071 13241 raft_consensus.cc:1275] T 05e69121e8b54b96bfd2863422f446b9 P 2768c30a298e46b784868aea92ffdb0d [term 2 FOLLOWER]: Refusing update from remote peer 1badc676cc734a90900be6af887e027a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:48.906667 13420 consensus_queue.cc:1048] T 05e69121e8b54b96bfd2863422f446b9 P 1badc676cc734a90900be6af887e027a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:48.942531 13412 raft_consensus.cc:993] T 3feb7c5af98049f09244f7e2266f3b62 P 1badc676cc734a90900be6af887e027a: : Instructing follower 2768c30a298e46b784868aea92ffdb0d to start an election
I20260709 12:08:48.943094 13420 raft_consensus.cc:1081] T 3feb7c5af98049f09244f7e2266f3b62 P 1badc676cc734a90900be6af887e027a [term 1 LEADER]: Signalling peer 2768c30a298e46b784868aea92ffdb0d to start an election
I20260709 12:08:48.945008 13241 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3feb7c5af98049f09244f7e2266f3b62"
dest_uuid: "2768c30a298e46b784868aea92ffdb0d"
 from {username='slave'} at 127.0.0.1:40368
I20260709 12:08:48.945590 13241 raft_consensus.cc:493] T 3feb7c5af98049f09244f7e2266f3b62 P 2768c30a298e46b784868aea92ffdb0d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:48.945984 13241 raft_consensus.cc:3060] T 3feb7c5af98049f09244f7e2266f3b62 P 2768c30a298e46b784868aea92ffdb0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.950716 13241 raft_consensus.cc:515] T 3feb7c5af98049f09244f7e2266f3b62 P 2768c30a298e46b784868aea92ffdb0d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:48.952369 13241 leader_election.cc:290] T 3feb7c5af98049f09244f7e2266f3b62 P 2768c30a298e46b784868aea92ffdb0d [CANDIDATE]: Term 2 election: Requested vote from peers 1badc676cc734a90900be6af887e027a (127.12.56.193:36691), da0f578f1d4541ada6f9aad99f761e8c (127.12.56.195:40703)
I20260709 12:08:48.953478 13165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3feb7c5af98049f09244f7e2266f3b62" candidate_uuid: "2768c30a298e46b784868aea92ffdb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1badc676cc734a90900be6af887e027a"
I20260709 12:08:48.953504 13313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3feb7c5af98049f09244f7e2266f3b62" candidate_uuid: "2768c30a298e46b784868aea92ffdb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da0f578f1d4541ada6f9aad99f761e8c"
I20260709 12:08:48.954077 13165 raft_consensus.cc:3055] T 3feb7c5af98049f09244f7e2266f3b62 P 1badc676cc734a90900be6af887e027a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:48.954245 13313 raft_consensus.cc:3060] T 3feb7c5af98049f09244f7e2266f3b62 P da0f578f1d4541ada6f9aad99f761e8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.954468 13165 raft_consensus.cc:740] T 3feb7c5af98049f09244f7e2266f3b62 P 1badc676cc734a90900be6af887e027a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1badc676cc734a90900be6af887e027a, State: Running, Role: LEADER
I20260709 12:08:48.955327 13165 consensus_queue.cc:260] T 3feb7c5af98049f09244f7e2266f3b62 P 1badc676cc734a90900be6af887e027a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:48.956301 13165 raft_consensus.cc:3060] T 3feb7c5af98049f09244f7e2266f3b62 P 1badc676cc734a90900be6af887e027a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.959595 13313 raft_consensus.cc:2468] T 3feb7c5af98049f09244f7e2266f3b62 P da0f578f1d4541ada6f9aad99f761e8c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2768c30a298e46b784868aea92ffdb0d in term 2.
I20260709 12:08:48.960870 13207 leader_election.cc:304] T 3feb7c5af98049f09244f7e2266f3b62 P 2768c30a298e46b784868aea92ffdb0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2768c30a298e46b784868aea92ffdb0d, da0f578f1d4541ada6f9aad99f761e8c; no voters: 
I20260709 12:08:48.962123 13165 raft_consensus.cc:2468] T 3feb7c5af98049f09244f7e2266f3b62 P 1badc676cc734a90900be6af887e027a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2768c30a298e46b784868aea92ffdb0d in term 2.
I20260709 12:08:48.961934 13398 raft_consensus.cc:2804] T 3feb7c5af98049f09244f7e2266f3b62 P 2768c30a298e46b784868aea92ffdb0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:48.962769 13398 raft_consensus.cc:697] T 3feb7c5af98049f09244f7e2266f3b62 P 2768c30a298e46b784868aea92ffdb0d [term 2 LEADER]: Becoming Leader. State: Replica: 2768c30a298e46b784868aea92ffdb0d, State: Running, Role: LEADER
I20260709 12:08:48.963867 13398 consensus_queue.cc:237] T 3feb7c5af98049f09244f7e2266f3b62 P 2768c30a298e46b784868aea92ffdb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:48.970683 13061 catalog_manager.cc:5697] T 3feb7c5af98049f09244f7e2266f3b62 P 2768c30a298e46b784868aea92ffdb0d reported cstate change: term changed from 1 to 2, leader changed from 1badc676cc734a90900be6af887e027a (127.12.56.193) to 2768c30a298e46b784868aea92ffdb0d (127.12.56.194). New cstate: current_term: 2 leader_uuid: "2768c30a298e46b784868aea92ffdb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:49.006395 13412 raft_consensus.cc:993] T fac4c58593a44cd5a45e96d22fb3f0dd P 1badc676cc734a90900be6af887e027a: : Instructing follower 2768c30a298e46b784868aea92ffdb0d to start an election
I20260709 12:08:49.006901 13420 raft_consensus.cc:1081] T fac4c58593a44cd5a45e96d22fb3f0dd P 1badc676cc734a90900be6af887e027a [term 1 LEADER]: Signalling peer 2768c30a298e46b784868aea92ffdb0d to start an election
I20260709 12:08:49.008685 13241 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fac4c58593a44cd5a45e96d22fb3f0dd"
dest_uuid: "2768c30a298e46b784868aea92ffdb0d"
 from {username='slave'} at 127.0.0.1:40368
I20260709 12:08:49.009281 13241 raft_consensus.cc:493] T fac4c58593a44cd5a45e96d22fb3f0dd P 2768c30a298e46b784868aea92ffdb0d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:49.009634 13241 raft_consensus.cc:3060] T fac4c58593a44cd5a45e96d22fb3f0dd P 2768c30a298e46b784868aea92ffdb0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:49.015431 13241 raft_consensus.cc:515] T fac4c58593a44cd5a45e96d22fb3f0dd P 2768c30a298e46b784868aea92ffdb0d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:49.017334 13241 leader_election.cc:290] T fac4c58593a44cd5a45e96d22fb3f0dd P 2768c30a298e46b784868aea92ffdb0d [CANDIDATE]: Term 2 election: Requested vote from peers 1badc676cc734a90900be6af887e027a (127.12.56.193:36691), da0f578f1d4541ada6f9aad99f761e8c (127.12.56.195:40703)
I20260709 12:08:49.018389 13165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac4c58593a44cd5a45e96d22fb3f0dd" candidate_uuid: "2768c30a298e46b784868aea92ffdb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1badc676cc734a90900be6af887e027a"
I20260709 12:08:49.018514 13313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac4c58593a44cd5a45e96d22fb3f0dd" candidate_uuid: "2768c30a298e46b784868aea92ffdb0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da0f578f1d4541ada6f9aad99f761e8c"
I20260709 12:08:49.019129 13165 raft_consensus.cc:3055] T fac4c58593a44cd5a45e96d22fb3f0dd P 1badc676cc734a90900be6af887e027a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:49.019129 13313 raft_consensus.cc:3060] T fac4c58593a44cd5a45e96d22fb3f0dd P da0f578f1d4541ada6f9aad99f761e8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:49.019685 13165 raft_consensus.cc:740] T fac4c58593a44cd5a45e96d22fb3f0dd P 1badc676cc734a90900be6af887e027a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1badc676cc734a90900be6af887e027a, State: Running, Role: LEADER
I20260709 12:08:49.020669 13165 consensus_queue.cc:260] T fac4c58593a44cd5a45e96d22fb3f0dd P 1badc676cc734a90900be6af887e027a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:49.021968 13165 raft_consensus.cc:3060] T fac4c58593a44cd5a45e96d22fb3f0dd P 1badc676cc734a90900be6af887e027a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:49.026932 13313 raft_consensus.cc:2468] T fac4c58593a44cd5a45e96d22fb3f0dd P da0f578f1d4541ada6f9aad99f761e8c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2768c30a298e46b784868aea92ffdb0d in term 2.
I20260709 12:08:49.028221 13207 leader_election.cc:304] T fac4c58593a44cd5a45e96d22fb3f0dd P 2768c30a298e46b784868aea92ffdb0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2768c30a298e46b784868aea92ffdb0d, da0f578f1d4541ada6f9aad99f761e8c; no voters: 
I20260709 12:08:49.028838 13165 raft_consensus.cc:2468] T fac4c58593a44cd5a45e96d22fb3f0dd P 1badc676cc734a90900be6af887e027a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2768c30a298e46b784868aea92ffdb0d in term 2.
I20260709 12:08:49.028971 13398 raft_consensus.cc:2804] T fac4c58593a44cd5a45e96d22fb3f0dd P 2768c30a298e46b784868aea92ffdb0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:49.029512 13398 raft_consensus.cc:697] T fac4c58593a44cd5a45e96d22fb3f0dd P 2768c30a298e46b784868aea92ffdb0d [term 2 LEADER]: Becoming Leader. State: Replica: 2768c30a298e46b784868aea92ffdb0d, State: Running, Role: LEADER
I20260709 12:08:49.030371 13398 consensus_queue.cc:237] T fac4c58593a44cd5a45e96d22fb3f0dd P 2768c30a298e46b784868aea92ffdb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:49.038033 13061 catalog_manager.cc:5697] T fac4c58593a44cd5a45e96d22fb3f0dd P 2768c30a298e46b784868aea92ffdb0d reported cstate change: term changed from 1 to 2, leader changed from 1badc676cc734a90900be6af887e027a (127.12.56.193) to 2768c30a298e46b784868aea92ffdb0d (127.12.56.194). New cstate: current_term: 2 leader_uuid: "2768c30a298e46b784868aea92ffdb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:49.136497 13313 raft_consensus.cc:1275] T 5500cd37d9d844aebeb99f48c3a0f8fe P da0f578f1d4541ada6f9aad99f761e8c [term 2 FOLLOWER]: Refusing update from remote peer 2768c30a298e46b784868aea92ffdb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.138166 13398 consensus_queue.cc:1048] T 5500cd37d9d844aebeb99f48c3a0f8fe P 2768c30a298e46b784868aea92ffdb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.148207 13165 raft_consensus.cc:1275] T 5500cd37d9d844aebeb99f48c3a0f8fe P 1badc676cc734a90900be6af887e027a [term 2 FOLLOWER]: Refusing update from remote peer 2768c30a298e46b784868aea92ffdb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.151311 13364 consensus_queue.cc:1048] T 5500cd37d9d844aebeb99f48c3a0f8fe P 2768c30a298e46b784868aea92ffdb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:08:49.186168 13313 raft_consensus.cc:1275] T 3db6a69f63d049fca47cec510aa05a89 P da0f578f1d4541ada6f9aad99f761e8c [term 2 FOLLOWER]: Refusing update from remote peer 1badc676cc734a90900be6af887e027a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.187444 13420 consensus_queue.cc:1048] T 3db6a69f63d049fca47cec510aa05a89 P 1badc676cc734a90900be6af887e027a [LEADER]: Connected to new peer: Peer: permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.195643 13241 raft_consensus.cc:1275] T 3db6a69f63d049fca47cec510aa05a89 P 2768c30a298e46b784868aea92ffdb0d [term 2 FOLLOWER]: Refusing update from remote peer 1badc676cc734a90900be6af887e027a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.198714 13420 consensus_queue.cc:1048] T 3db6a69f63d049fca47cec510aa05a89 P 1badc676cc734a90900be6af887e027a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.284130 13241 raft_consensus.cc:1275] T 0548d800f00849639c60c9fc6a0b3b44 P 2768c30a298e46b784868aea92ffdb0d [term 2 FOLLOWER]: Refusing update from remote peer 1badc676cc734a90900be6af887e027a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.285511 13420 consensus_queue.cc:1048] T 0548d800f00849639c60c9fc6a0b3b44 P 1badc676cc734a90900be6af887e027a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.301708 13313 raft_consensus.cc:1275] T 0548d800f00849639c60c9fc6a0b3b44 P da0f578f1d4541ada6f9aad99f761e8c [term 2 FOLLOWER]: Refusing update from remote peer 1badc676cc734a90900be6af887e027a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.302587 13315 raft_consensus.cc:1275] T c6d14c392db54aeca8c6ff936e6ea348 P da0f578f1d4541ada6f9aad99f761e8c [term 2 FOLLOWER]: Refusing update from remote peer 1badc676cc734a90900be6af887e027a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.304141 13386 consensus_queue.cc:1048] T 0548d800f00849639c60c9fc6a0b3b44 P 1badc676cc734a90900be6af887e027a [LEADER]: Connected to new peer: Peer: permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:08:49.304457 13420 consensus_queue.cc:1048] T c6d14c392db54aeca8c6ff936e6ea348 P 1badc676cc734a90900be6af887e027a [LEADER]: Connected to new peer: Peer: permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.319332 13241 raft_consensus.cc:1275] T c6d14c392db54aeca8c6ff936e6ea348 P 2768c30a298e46b784868aea92ffdb0d [term 2 FOLLOWER]: Refusing update from remote peer 1badc676cc734a90900be6af887e027a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.320891 13419 consensus_queue.cc:1048] T c6d14c392db54aeca8c6ff936e6ea348 P 1badc676cc734a90900be6af887e027a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.346757 13313 raft_consensus.cc:1275] T 31db820ce3cc45e0bb5f3560f7cc60e4 P da0f578f1d4541ada6f9aad99f761e8c [term 2 FOLLOWER]: Refusing update from remote peer 1badc676cc734a90900be6af887e027a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.348274 13365 consensus_queue.cc:1048] T 31db820ce3cc45e0bb5f3560f7cc60e4 P 1badc676cc734a90900be6af887e027a [LEADER]: Connected to new peer: Peer: permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.358174 13241 raft_consensus.cc:1275] T 31db820ce3cc45e0bb5f3560f7cc60e4 P 2768c30a298e46b784868aea92ffdb0d [term 2 FOLLOWER]: Refusing update from remote peer 1badc676cc734a90900be6af887e027a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.359897 13386 consensus_queue.cc:1048] T 31db820ce3cc45e0bb5f3560f7cc60e4 P 1badc676cc734a90900be6af887e027a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.403731 13313 raft_consensus.cc:1275] T 864c0069cfc244d7a79fc504e0fc0221 P da0f578f1d4541ada6f9aad99f761e8c [term 2 FOLLOWER]: Refusing update from remote peer 2768c30a298e46b784868aea92ffdb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.404402 13241 raft_consensus.cc:1275] T c4eca66176fa42acaf5926f8b6fab9d0 P 2768c30a298e46b784868aea92ffdb0d [term 2 FOLLOWER]: Refusing update from remote peer da0f578f1d4541ada6f9aad99f761e8c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.405002 13364 consensus_queue.cc:1048] T 864c0069cfc244d7a79fc504e0fc0221 P 2768c30a298e46b784868aea92ffdb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.405946 13435 consensus_queue.cc:1048] T c4eca66176fa42acaf5926f8b6fab9d0 P da0f578f1d4541ada6f9aad99f761e8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.413712 13165 raft_consensus.cc:1275] T 864c0069cfc244d7a79fc504e0fc0221 P 1badc676cc734a90900be6af887e027a [term 2 FOLLOWER]: Refusing update from remote peer 2768c30a298e46b784868aea92ffdb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.415956 13428 consensus_queue.cc:1048] T 864c0069cfc244d7a79fc504e0fc0221 P 2768c30a298e46b784868aea92ffdb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:08:49.433389 13165 raft_consensus.cc:1275] T c4eca66176fa42acaf5926f8b6fab9d0 P 1badc676cc734a90900be6af887e027a [term 2 FOLLOWER]: Refusing update from remote peer da0f578f1d4541ada6f9aad99f761e8c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.434762 13166 raft_consensus.cc:1275] T fac4c58593a44cd5a45e96d22fb3f0dd P 1badc676cc734a90900be6af887e027a [term 2 FOLLOWER]: Refusing update from remote peer 2768c30a298e46b784868aea92ffdb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.435335 13461 consensus_queue.cc:1048] T c4eca66176fa42acaf5926f8b6fab9d0 P da0f578f1d4541ada6f9aad99f761e8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.436383 13428 consensus_queue.cc:1048] T fac4c58593a44cd5a45e96d22fb3f0dd P 2768c30a298e46b784868aea92ffdb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.447522 13313 raft_consensus.cc:1275] T fac4c58593a44cd5a45e96d22fb3f0dd P da0f578f1d4541ada6f9aad99f761e8c [term 2 FOLLOWER]: Refusing update from remote peer 2768c30a298e46b784868aea92ffdb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.449609 13399 consensus_queue.cc:1048] T fac4c58593a44cd5a45e96d22fb3f0dd P 2768c30a298e46b784868aea92ffdb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.512529 13166 raft_consensus.cc:1275] T 3feb7c5af98049f09244f7e2266f3b62 P 1badc676cc734a90900be6af887e027a [term 2 FOLLOWER]: Refusing update from remote peer 2768c30a298e46b784868aea92ffdb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.514070 13399 consensus_queue.cc:1048] T 3feb7c5af98049f09244f7e2266f3b62 P 2768c30a298e46b784868aea92ffdb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.524791 13313 raft_consensus.cc:1275] T 3feb7c5af98049f09244f7e2266f3b62 P da0f578f1d4541ada6f9aad99f761e8c [term 2 FOLLOWER]: Refusing update from remote peer 2768c30a298e46b784868aea92ffdb0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.526638 13399 consensus_queue.cc:1048] T 3feb7c5af98049f09244f7e2266f3b62 P 2768c30a298e46b784868aea92ffdb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:08:51.528415 12515 auto_leader_rebalancer-test.cc:365] The leader distribution is 
I20260709 12:08:51.529150 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:51.555526 13166 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05e69121e8b54b96bfd2863422f446b9"
dest_uuid: "1badc676cc734a90900be6af887e027a"
mode: GRACEFUL
new_leader_uuid: "da0f578f1d4541ada6f9aad99f761e8c"
 from {username='slave'} at 127.0.0.1:34030
I20260709 12:08:51.556111 13166 raft_consensus.cc:606] T 05e69121e8b54b96bfd2863422f446b9 P 1badc676cc734a90900be6af887e027a [term 2 LEADER]: Received request to transfer leadership to TS da0f578f1d4541ada6f9aad99f761e8c
I20260709 12:08:51.558898 13166 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6d14c392db54aeca8c6ff936e6ea348"
dest_uuid: "1badc676cc734a90900be6af887e027a"
mode: GRACEFUL
new_leader_uuid: "da0f578f1d4541ada6f9aad99f761e8c"
 from {username='slave'} at 127.0.0.1:34030
I20260709 12:08:51.559566 13166 raft_consensus.cc:606] T c6d14c392db54aeca8c6ff936e6ea348 P 1badc676cc734a90900be6af887e027a [term 2 LEADER]: Received request to transfer leadership to TS da0f578f1d4541ada6f9aad99f761e8c
I20260709 12:08:51.560788 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:08:51.561362 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:51.699153 13386 raft_consensus.cc:993] T 05e69121e8b54b96bfd2863422f446b9 P 1badc676cc734a90900be6af887e027a: : Instructing follower da0f578f1d4541ada6f9aad99f761e8c to start an election
I20260709 12:08:51.699705 13386 raft_consensus.cc:1081] T 05e69121e8b54b96bfd2863422f446b9 P 1badc676cc734a90900be6af887e027a [term 2 LEADER]: Signalling peer da0f578f1d4541ada6f9aad99f761e8c to start an election
I20260709 12:08:51.701649 13313 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "05e69121e8b54b96bfd2863422f446b9"
dest_uuid: "da0f578f1d4541ada6f9aad99f761e8c"
 from {username='slave'} at 127.0.0.1:50460
I20260709 12:08:51.702242 13313 raft_consensus.cc:493] T 05e69121e8b54b96bfd2863422f446b9 P da0f578f1d4541ada6f9aad99f761e8c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:51.702585 13313 raft_consensus.cc:3060] T 05e69121e8b54b96bfd2863422f446b9 P da0f578f1d4541ada6f9aad99f761e8c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:51.707594 13313 raft_consensus.cc:515] T 05e69121e8b54b96bfd2863422f446b9 P da0f578f1d4541ada6f9aad99f761e8c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:51.709475 13313 leader_election.cc:290] T 05e69121e8b54b96bfd2863422f446b9 P da0f578f1d4541ada6f9aad99f761e8c [CANDIDATE]: Term 3 election: Requested vote from peers 1badc676cc734a90900be6af887e027a (127.12.56.193:36691), 2768c30a298e46b784868aea92ffdb0d (127.12.56.194:37951)
I20260709 12:08:51.710520 13241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05e69121e8b54b96bfd2863422f446b9" candidate_uuid: "da0f578f1d4541ada6f9aad99f761e8c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2768c30a298e46b784868aea92ffdb0d"
I20260709 12:08:51.710510 13166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05e69121e8b54b96bfd2863422f446b9" candidate_uuid: "da0f578f1d4541ada6f9aad99f761e8c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1badc676cc734a90900be6af887e027a"
I20260709 12:08:51.711199 13241 raft_consensus.cc:3060] T 05e69121e8b54b96bfd2863422f446b9 P 2768c30a298e46b784868aea92ffdb0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:51.711364 13166 raft_consensus.cc:3055] T 05e69121e8b54b96bfd2863422f446b9 P 1badc676cc734a90900be6af887e027a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:51.711714 13166 raft_consensus.cc:740] T 05e69121e8b54b96bfd2863422f446b9 P 1badc676cc734a90900be6af887e027a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1badc676cc734a90900be6af887e027a, State: Running, Role: LEADER
I20260709 12:08:51.712438 13166 consensus_queue.cc:260] T 05e69121e8b54b96bfd2863422f446b9 P 1badc676cc734a90900be6af887e027a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:51.713392 13166 raft_consensus.cc:3060] T 05e69121e8b54b96bfd2863422f446b9 P 1badc676cc734a90900be6af887e027a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:51.716110 13241 raft_consensus.cc:2468] T 05e69121e8b54b96bfd2863422f446b9 P 2768c30a298e46b784868aea92ffdb0d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da0f578f1d4541ada6f9aad99f761e8c in term 3.
I20260709 12:08:51.717312 13279 leader_election.cc:304] T 05e69121e8b54b96bfd2863422f446b9 P da0f578f1d4541ada6f9aad99f761e8c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2768c30a298e46b784868aea92ffdb0d, da0f578f1d4541ada6f9aad99f761e8c; no voters: 
I20260709 12:08:51.718135 13461 raft_consensus.cc:2804] T 05e69121e8b54b96bfd2863422f446b9 P da0f578f1d4541ada6f9aad99f761e8c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:51.718815 13166 raft_consensus.cc:2468] T 05e69121e8b54b96bfd2863422f446b9 P 1badc676cc734a90900be6af887e027a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da0f578f1d4541ada6f9aad99f761e8c in term 3.
I20260709 12:08:51.719290 13461 raft_consensus.cc:697] T 05e69121e8b54b96bfd2863422f446b9 P da0f578f1d4541ada6f9aad99f761e8c [term 3 LEADER]: Becoming Leader. State: Replica: da0f578f1d4541ada6f9aad99f761e8c, State: Running, Role: LEADER
I20260709 12:08:51.720136 13461 consensus_queue.cc:237] T 05e69121e8b54b96bfd2863422f446b9 P da0f578f1d4541ada6f9aad99f761e8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:51.728034 13065 catalog_manager.cc:5697] T 05e69121e8b54b96bfd2863422f446b9 P da0f578f1d4541ada6f9aad99f761e8c reported cstate change: term changed from 2 to 3, leader changed from 1badc676cc734a90900be6af887e027a (127.12.56.193) to da0f578f1d4541ada6f9aad99f761e8c (127.12.56.195). New cstate: current_term: 3 leader_uuid: "da0f578f1d4541ada6f9aad99f761e8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:52.100080 13386 raft_consensus.cc:993] T c6d14c392db54aeca8c6ff936e6ea348 P 1badc676cc734a90900be6af887e027a: : Instructing follower da0f578f1d4541ada6f9aad99f761e8c to start an election
I20260709 12:08:52.100543 13386 raft_consensus.cc:1081] T c6d14c392db54aeca8c6ff936e6ea348 P 1badc676cc734a90900be6af887e027a [term 2 LEADER]: Signalling peer da0f578f1d4541ada6f9aad99f761e8c to start an election
I20260709 12:08:52.102604 13313 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c6d14c392db54aeca8c6ff936e6ea348"
dest_uuid: "da0f578f1d4541ada6f9aad99f761e8c"
 from {username='slave'} at 127.0.0.1:50460
I20260709 12:08:52.103127 13313 raft_consensus.cc:493] T c6d14c392db54aeca8c6ff936e6ea348 P da0f578f1d4541ada6f9aad99f761e8c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:52.103528 13313 raft_consensus.cc:3060] T c6d14c392db54aeca8c6ff936e6ea348 P da0f578f1d4541ada6f9aad99f761e8c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:52.108826 13313 raft_consensus.cc:515] T c6d14c392db54aeca8c6ff936e6ea348 P da0f578f1d4541ada6f9aad99f761e8c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:52.110988 13313 leader_election.cc:290] T c6d14c392db54aeca8c6ff936e6ea348 P da0f578f1d4541ada6f9aad99f761e8c [CANDIDATE]: Term 3 election: Requested vote from peers 1badc676cc734a90900be6af887e027a (127.12.56.193:36691), 2768c30a298e46b784868aea92ffdb0d (127.12.56.194:37951)
I20260709 12:08:52.111968 13166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d14c392db54aeca8c6ff936e6ea348" candidate_uuid: "da0f578f1d4541ada6f9aad99f761e8c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1badc676cc734a90900be6af887e027a"
I20260709 12:08:52.112195 13241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d14c392db54aeca8c6ff936e6ea348" candidate_uuid: "da0f578f1d4541ada6f9aad99f761e8c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2768c30a298e46b784868aea92ffdb0d"
I20260709 12:08:52.112574 13166 raft_consensus.cc:3055] T c6d14c392db54aeca8c6ff936e6ea348 P 1badc676cc734a90900be6af887e027a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:52.112872 13241 raft_consensus.cc:3060] T c6d14c392db54aeca8c6ff936e6ea348 P 2768c30a298e46b784868aea92ffdb0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:52.113054 13166 raft_consensus.cc:740] T c6d14c392db54aeca8c6ff936e6ea348 P 1badc676cc734a90900be6af887e027a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1badc676cc734a90900be6af887e027a, State: Running, Role: LEADER
I20260709 12:08:52.114223 13166 consensus_queue.cc:260] T c6d14c392db54aeca8c6ff936e6ea348 P 1badc676cc734a90900be6af887e027a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:52.115525 13166 raft_consensus.cc:3060] T c6d14c392db54aeca8c6ff936e6ea348 P 1badc676cc734a90900be6af887e027a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:52.118521 13241 raft_consensus.cc:2468] T c6d14c392db54aeca8c6ff936e6ea348 P 2768c30a298e46b784868aea92ffdb0d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da0f578f1d4541ada6f9aad99f761e8c in term 3.
I20260709 12:08:52.119666 13279 leader_election.cc:304] T c6d14c392db54aeca8c6ff936e6ea348 P da0f578f1d4541ada6f9aad99f761e8c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2768c30a298e46b784868aea92ffdb0d, da0f578f1d4541ada6f9aad99f761e8c; no voters: 
I20260709 12:08:52.120558 13461 raft_consensus.cc:2804] T c6d14c392db54aeca8c6ff936e6ea348 P da0f578f1d4541ada6f9aad99f761e8c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:52.121003 13461 raft_consensus.cc:697] T c6d14c392db54aeca8c6ff936e6ea348 P da0f578f1d4541ada6f9aad99f761e8c [term 3 LEADER]: Becoming Leader. State: Replica: da0f578f1d4541ada6f9aad99f761e8c, State: Running, Role: LEADER
I20260709 12:08:52.121307 13166 raft_consensus.cc:2468] T c6d14c392db54aeca8c6ff936e6ea348 P 1badc676cc734a90900be6af887e027a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da0f578f1d4541ada6f9aad99f761e8c in term 3.
I20260709 12:08:52.121829 13461 consensus_queue.cc:237] T c6d14c392db54aeca8c6ff936e6ea348 P da0f578f1d4541ada6f9aad99f761e8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:08:52.132138 13065 catalog_manager.cc:5697] T c6d14c392db54aeca8c6ff936e6ea348 P da0f578f1d4541ada6f9aad99f761e8c reported cstate change: term changed from 2 to 3, leader changed from 1badc676cc734a90900be6af887e027a (127.12.56.193) to da0f578f1d4541ada6f9aad99f761e8c (127.12.56.195). New cstate: current_term: 3 leader_uuid: "da0f578f1d4541ada6f9aad99f761e8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:52.157732 13241 raft_consensus.cc:1275] T 05e69121e8b54b96bfd2863422f446b9 P 2768c30a298e46b784868aea92ffdb0d [term 3 FOLLOWER]: Refusing update from remote peer da0f578f1d4541ada6f9aad99f761e8c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:52.159130 13461 consensus_queue.cc:1048] T 05e69121e8b54b96bfd2863422f446b9 P da0f578f1d4541ada6f9aad99f761e8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:52.170621 13166 raft_consensus.cc:1275] T 05e69121e8b54b96bfd2863422f446b9 P 1badc676cc734a90900be6af887e027a [term 3 FOLLOWER]: Refusing update from remote peer da0f578f1d4541ada6f9aad99f761e8c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:52.172230 13471 consensus_queue.cc:1048] T 05e69121e8b54b96bfd2863422f446b9 P da0f578f1d4541ada6f9aad99f761e8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:52.544049 13166 raft_consensus.cc:1275] T c6d14c392db54aeca8c6ff936e6ea348 P 1badc676cc734a90900be6af887e027a [term 3 FOLLOWER]: Refusing update from remote peer da0f578f1d4541ada6f9aad99f761e8c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:52.545403 13471 consensus_queue.cc:1048] T c6d14c392db54aeca8c6ff936e6ea348 P da0f578f1d4541ada6f9aad99f761e8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:52.554095 13241 raft_consensus.cc:1275] T c6d14c392db54aeca8c6ff936e6ea348 P 2768c30a298e46b784868aea92ffdb0d [term 3 FOLLOWER]: Refusing update from remote peer da0f578f1d4541ada6f9aad99f761e8c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:52.555634 13480 consensus_queue.cc:1048] T c6d14c392db54aeca8c6ff936e6ea348 P da0f578f1d4541ada6f9aad99f761e8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:52.562402 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:52.570415 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:52.570863 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:53.571997 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:53.578337 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:53.578884 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:54.579917 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:54.586771 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:54.587199 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:55.588562 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:55.596366 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:55.596870 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:56.598239 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:56.604430 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:56.604851 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:57.605907 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:57.612020 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:57.612425 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:58.613327 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:58.618839 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:58.619233 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:59.620127 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:59.626215 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:59.626648 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:00.627743 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:00.633634 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:00.634083 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:01.674630 12515 auto_leader_rebalancer-test.cc:384] The leader distribution is 
I20260709 12:09:01.684561 13313 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6d14c392db54aeca8c6ff936e6ea348"
dest_uuid: "da0f578f1d4541ada6f9aad99f761e8c"
mode: GRACEFUL
new_leader_uuid: "1badc676cc734a90900be6af887e027a"
 from {username='slave'} at 127.0.0.1:50470
I20260709 12:09:01.685328 13313 raft_consensus.cc:606] T c6d14c392db54aeca8c6ff936e6ea348 P da0f578f1d4541ada6f9aad99f761e8c [term 3 LEADER]: Received request to transfer leadership to TS 1badc676cc734a90900be6af887e027a
I20260709 12:09:01.692132 13313 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05e69121e8b54b96bfd2863422f446b9"
dest_uuid: "da0f578f1d4541ada6f9aad99f761e8c"
mode: GRACEFUL
new_leader_uuid: "1badc676cc734a90900be6af887e027a"
 from {username='slave'} at 127.0.0.1:50470
I20260709 12:09:01.692723 13313 raft_consensus.cc:606] T 05e69121e8b54b96bfd2863422f446b9 P da0f578f1d4541ada6f9aad99f761e8c [term 3 LEADER]: Received request to transfer leadership to TS 1badc676cc734a90900be6af887e027a
I20260709 12:09:01.707306 13241 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fac4c58593a44cd5a45e96d22fb3f0dd"
dest_uuid: "2768c30a298e46b784868aea92ffdb0d"
mode: GRACEFUL
new_leader_uuid: "1badc676cc734a90900be6af887e027a"
 from {username='slave'} at 127.0.0.1:40370
I20260709 12:09:01.707916 13241 raft_consensus.cc:606] T fac4c58593a44cd5a45e96d22fb3f0dd P 2768c30a298e46b784868aea92ffdb0d [term 2 LEADER]: Received request to transfer leadership to TS 1badc676cc734a90900be6af887e027a
I20260709 12:09:01.715054 13241 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3feb7c5af98049f09244f7e2266f3b62"
dest_uuid: "2768c30a298e46b784868aea92ffdb0d"
mode: GRACEFUL
new_leader_uuid: "1badc676cc734a90900be6af887e027a"
 from {username='slave'} at 127.0.0.1:40370
I20260709 12:09:01.715649 13241 raft_consensus.cc:606] T 3feb7c5af98049f09244f7e2266f3b62 P 2768c30a298e46b784868aea92ffdb0d [term 2 LEADER]: Received request to transfer leadership to TS 1badc676cc734a90900be6af887e027a
I20260709 12:09:01.722563 13241 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "864c0069cfc244d7a79fc504e0fc0221"
dest_uuid: "2768c30a298e46b784868aea92ffdb0d"
mode: GRACEFUL
new_leader_uuid: "1badc676cc734a90900be6af887e027a"
 from {username='slave'} at 127.0.0.1:40370
I20260709 12:09:01.723345 13241 raft_consensus.cc:606] T 864c0069cfc244d7a79fc504e0fc0221 P 2768c30a298e46b784868aea92ffdb0d [term 2 LEADER]: Received request to transfer leadership to TS 1badc676cc734a90900be6af887e027a
I20260709 12:09:01.986253 13480 raft_consensus.cc:993] T 05e69121e8b54b96bfd2863422f446b9 P da0f578f1d4541ada6f9aad99f761e8c: : Instructing follower 1badc676cc734a90900be6af887e027a to start an election
I20260709 12:09:01.987082 13480 raft_consensus.cc:1081] T 05e69121e8b54b96bfd2863422f446b9 P da0f578f1d4541ada6f9aad99f761e8c [term 3 LEADER]: Signalling peer 1badc676cc734a90900be6af887e027a to start an election
I20260709 12:09:01.989396 13166 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "05e69121e8b54b96bfd2863422f446b9"
dest_uuid: "1badc676cc734a90900be6af887e027a"
 from {username='slave'} at 127.0.0.1:36396
I20260709 12:09:01.990024 13166 raft_consensus.cc:493] T 05e69121e8b54b96bfd2863422f446b9 P 1badc676cc734a90900be6af887e027a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:01.990403 13166 raft_consensus.cc:3060] T 05e69121e8b54b96bfd2863422f446b9 P 1badc676cc734a90900be6af887e027a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:01.997076 13166 raft_consensus.cc:515] T 05e69121e8b54b96bfd2863422f446b9 P 1badc676cc734a90900be6af887e027a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:09:01.999637 13166 leader_election.cc:290] T 05e69121e8b54b96bfd2863422f446b9 P 1badc676cc734a90900be6af887e027a [CANDIDATE]: Term 4 election: Requested vote from peers 2768c30a298e46b784868aea92ffdb0d (127.12.56.194:37951), da0f578f1d4541ada6f9aad99f761e8c (127.12.56.195:40703)
I20260709 12:09:02.001036 13313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05e69121e8b54b96bfd2863422f446b9" candidate_uuid: "1badc676cc734a90900be6af887e027a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "da0f578f1d4541ada6f9aad99f761e8c"
I20260709 12:09:02.001204 13241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05e69121e8b54b96bfd2863422f446b9" candidate_uuid: "1badc676cc734a90900be6af887e027a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2768c30a298e46b784868aea92ffdb0d"
I20260709 12:09:02.001924 13313 raft_consensus.cc:3055] T 05e69121e8b54b96bfd2863422f446b9 P da0f578f1d4541ada6f9aad99f761e8c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:02.002167 13241 raft_consensus.cc:3060] T 05e69121e8b54b96bfd2863422f446b9 P 2768c30a298e46b784868aea92ffdb0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:02.002305 13313 raft_consensus.cc:740] T 05e69121e8b54b96bfd2863422f446b9 P da0f578f1d4541ada6f9aad99f761e8c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: da0f578f1d4541ada6f9aad99f761e8c, State: Running, Role: LEADER
I20260709 12:09:02.003458 13313 consensus_queue.cc:260] T 05e69121e8b54b96bfd2863422f446b9 P da0f578f1d4541ada6f9aad99f761e8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:09:02.004695 13313 raft_consensus.cc:3060] T 05e69121e8b54b96bfd2863422f446b9 P da0f578f1d4541ada6f9aad99f761e8c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:02.008736 13241 raft_consensus.cc:2468] T 05e69121e8b54b96bfd2863422f446b9 P 2768c30a298e46b784868aea92ffdb0d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1badc676cc734a90900be6af887e027a in term 4.
I20260709 12:09:02.010592 13130 leader_election.cc:304] T 05e69121e8b54b96bfd2863422f446b9 P 1badc676cc734a90900be6af887e027a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1badc676cc734a90900be6af887e027a, 2768c30a298e46b784868aea92ffdb0d; no voters: 
I20260709 12:09:02.011691 13313 raft_consensus.cc:2468] T 05e69121e8b54b96bfd2863422f446b9 P da0f578f1d4541ada6f9aad99f761e8c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1badc676cc734a90900be6af887e027a in term 4.
I20260709 12:09:02.011833 13493 raft_consensus.cc:2804] T 05e69121e8b54b96bfd2863422f446b9 P 1badc676cc734a90900be6af887e027a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:02.013311 13493 raft_consensus.cc:697] T 05e69121e8b54b96bfd2863422f446b9 P 1badc676cc734a90900be6af887e027a [term 4 LEADER]: Becoming Leader. State: Replica: 1badc676cc734a90900be6af887e027a, State: Running, Role: LEADER
I20260709 12:09:02.015184 13493 consensus_queue.cc:237] T 05e69121e8b54b96bfd2863422f446b9 P 1badc676cc734a90900be6af887e027a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:09:02.024569 13061 catalog_manager.cc:5697] T 05e69121e8b54b96bfd2863422f446b9 P 1badc676cc734a90900be6af887e027a reported cstate change: term changed from 3 to 4, leader changed from da0f578f1d4541ada6f9aad99f761e8c (127.12.56.195) to 1badc676cc734a90900be6af887e027a (127.12.56.193). New cstate: current_term: 4 leader_uuid: "1badc676cc734a90900be6af887e027a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:02.033888 13485 raft_consensus.cc:993] T 3feb7c5af98049f09244f7e2266f3b62 P 2768c30a298e46b784868aea92ffdb0d: : Instructing follower 1badc676cc734a90900be6af887e027a to start an election
I20260709 12:09:02.034664 13498 raft_consensus.cc:1081] T 3feb7c5af98049f09244f7e2266f3b62 P 2768c30a298e46b784868aea92ffdb0d [term 2 LEADER]: Signalling peer 1badc676cc734a90900be6af887e027a to start an election
I20260709 12:09:02.037698 13166 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3feb7c5af98049f09244f7e2266f3b62"
dest_uuid: "1badc676cc734a90900be6af887e027a"
 from {username='slave'} at 127.0.0.1:36390
I20260709 12:09:02.038338 13166 raft_consensus.cc:493] T 3feb7c5af98049f09244f7e2266f3b62 P 1badc676cc734a90900be6af887e027a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:02.038735 13166 raft_consensus.cc:3060] T 3feb7c5af98049f09244f7e2266f3b62 P 1badc676cc734a90900be6af887e027a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:02.047145 13166 raft_consensus.cc:515] T 3feb7c5af98049f09244f7e2266f3b62 P 1badc676cc734a90900be6af887e027a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:09:02.048964 13166 leader_election.cc:290] T 3feb7c5af98049f09244f7e2266f3b62 P 1badc676cc734a90900be6af887e027a [CANDIDATE]: Term 3 election: Requested vote from peers 2768c30a298e46b784868aea92ffdb0d (127.12.56.194:37951), da0f578f1d4541ada6f9aad99f761e8c (127.12.56.195:40703)
I20260709 12:09:02.050045 13241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3feb7c5af98049f09244f7e2266f3b62" candidate_uuid: "1badc676cc734a90900be6af887e027a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2768c30a298e46b784868aea92ffdb0d"
I20260709 12:09:02.050333 13313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3feb7c5af98049f09244f7e2266f3b62" candidate_uuid: "1badc676cc734a90900be6af887e027a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "da0f578f1d4541ada6f9aad99f761e8c"
I20260709 12:09:02.050734 13241 raft_consensus.cc:3055] T 3feb7c5af98049f09244f7e2266f3b62 P 2768c30a298e46b784868aea92ffdb0d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:02.050864 13313 raft_consensus.cc:3060] T 3feb7c5af98049f09244f7e2266f3b62 P da0f578f1d4541ada6f9aad99f761e8c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:02.051070 13241 raft_consensus.cc:740] T 3feb7c5af98049f09244f7e2266f3b62 P 2768c30a298e46b784868aea92ffdb0d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2768c30a298e46b784868aea92ffdb0d, State: Running, Role: LEADER
I20260709 12:09:02.052012 13241 consensus_queue.cc:260] T 3feb7c5af98049f09244f7e2266f3b62 P 2768c30a298e46b784868aea92ffdb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:09:02.053020 13241 raft_consensus.cc:3060] T 3feb7c5af98049f09244f7e2266f3b62 P 2768c30a298e46b784868aea92ffdb0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:02.056988 13313 raft_consensus.cc:2468] T 3feb7c5af98049f09244f7e2266f3b62 P da0f578f1d4541ada6f9aad99f761e8c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1badc676cc734a90900be6af887e027a in term 3.
I20260709 12:09:02.058558 13132 leader_election.cc:304] T 3feb7c5af98049f09244f7e2266f3b62 P 1badc676cc734a90900be6af887e027a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1badc676cc734a90900be6af887e027a, da0f578f1d4541ada6f9aad99f761e8c; no voters: 
I20260709 12:09:02.059551 13493 raft_consensus.cc:2804] T 3feb7c5af98049f09244f7e2266f3b62 P 1badc676cc734a90900be6af887e027a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:02.060199 13493 raft_consensus.cc:697] T 3feb7c5af98049f09244f7e2266f3b62 P 1badc676cc734a90900be6af887e027a [term 3 LEADER]: Becoming Leader. State: Replica: 1badc676cc734a90900be6af887e027a, State: Running, Role: LEADER
I20260709 12:09:02.061017 13241 raft_consensus.cc:2468] T 3feb7c5af98049f09244f7e2266f3b62 P 2768c30a298e46b784868aea92ffdb0d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1badc676cc734a90900be6af887e027a in term 3.
I20260709 12:09:02.061483 13493 consensus_queue.cc:237] T 3feb7c5af98049f09244f7e2266f3b62 P 1badc676cc734a90900be6af887e027a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:09:02.071173 13061 catalog_manager.cc:5697] T 3feb7c5af98049f09244f7e2266f3b62 P 1badc676cc734a90900be6af887e027a reported cstate change: term changed from 2 to 3, leader changed from 2768c30a298e46b784868aea92ffdb0d (127.12.56.194) to 1badc676cc734a90900be6af887e027a (127.12.56.193). New cstate: current_term: 3 leader_uuid: "1badc676cc734a90900be6af887e027a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:02.103996 13498 raft_consensus.cc:993] T 864c0069cfc244d7a79fc504e0fc0221 P 2768c30a298e46b784868aea92ffdb0d: : Instructing follower 1badc676cc734a90900be6af887e027a to start an election
I20260709 12:09:02.104377 13498 raft_consensus.cc:1081] T 864c0069cfc244d7a79fc504e0fc0221 P 2768c30a298e46b784868aea92ffdb0d [term 2 LEADER]: Signalling peer 1badc676cc734a90900be6af887e027a to start an election
I20260709 12:09:02.106932 13166 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "864c0069cfc244d7a79fc504e0fc0221"
dest_uuid: "1badc676cc734a90900be6af887e027a"
 from {username='slave'} at 127.0.0.1:36390
I20260709 12:09:02.107434 13166 raft_consensus.cc:493] T 864c0069cfc244d7a79fc504e0fc0221 P 1badc676cc734a90900be6af887e027a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:02.107676 13166 raft_consensus.cc:3060] T 864c0069cfc244d7a79fc504e0fc0221 P 1badc676cc734a90900be6af887e027a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:02.112673 13166 raft_consensus.cc:515] T 864c0069cfc244d7a79fc504e0fc0221 P 1badc676cc734a90900be6af887e027a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:09:02.114372 13166 leader_election.cc:290] T 864c0069cfc244d7a79fc504e0fc0221 P 1badc676cc734a90900be6af887e027a [CANDIDATE]: Term 3 election: Requested vote from peers 2768c30a298e46b784868aea92ffdb0d (127.12.56.194:37951), da0f578f1d4541ada6f9aad99f761e8c (127.12.56.195:40703)
I20260709 12:09:02.115296 13313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864c0069cfc244d7a79fc504e0fc0221" candidate_uuid: "1badc676cc734a90900be6af887e027a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "da0f578f1d4541ada6f9aad99f761e8c"
I20260709 12:09:02.115433 13241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864c0069cfc244d7a79fc504e0fc0221" candidate_uuid: "1badc676cc734a90900be6af887e027a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2768c30a298e46b784868aea92ffdb0d"
I20260709 12:09:02.115794 13313 raft_consensus.cc:3060] T 864c0069cfc244d7a79fc504e0fc0221 P da0f578f1d4541ada6f9aad99f761e8c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:02.115998 13241 raft_consensus.cc:3055] T 864c0069cfc244d7a79fc504e0fc0221 P 2768c30a298e46b784868aea92ffdb0d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:02.116501 13241 raft_consensus.cc:740] T 864c0069cfc244d7a79fc504e0fc0221 P 2768c30a298e46b784868aea92ffdb0d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2768c30a298e46b784868aea92ffdb0d, State: Running, Role: LEADER
I20260709 12:09:02.117344 13241 consensus_queue.cc:260] T 864c0069cfc244d7a79fc504e0fc0221 P 2768c30a298e46b784868aea92ffdb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:09:02.118563 13241 raft_consensus.cc:3060] T 864c0069cfc244d7a79fc504e0fc0221 P 2768c30a298e46b784868aea92ffdb0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:02.120326 13494 raft_consensus.cc:993] T c6d14c392db54aeca8c6ff936e6ea348 P da0f578f1d4541ada6f9aad99f761e8c: : Instructing follower 1badc676cc734a90900be6af887e027a to start an election
I20260709 12:09:02.121084 13494 raft_consensus.cc:1081] T c6d14c392db54aeca8c6ff936e6ea348 P da0f578f1d4541ada6f9aad99f761e8c [term 3 LEADER]: Signalling peer 1badc676cc734a90900be6af887e027a to start an election
I20260709 12:09:02.121240 13313 raft_consensus.cc:2468] T 864c0069cfc244d7a79fc504e0fc0221 P da0f578f1d4541ada6f9aad99f761e8c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1badc676cc734a90900be6af887e027a in term 3.
I20260709 12:09:02.122272 13132 leader_election.cc:304] T 864c0069cfc244d7a79fc504e0fc0221 P 1badc676cc734a90900be6af887e027a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1badc676cc734a90900be6af887e027a, da0f578f1d4541ada6f9aad99f761e8c; no voters: 
I20260709 12:09:02.123153 13495 raft_consensus.cc:2804] T 864c0069cfc244d7a79fc504e0fc0221 P 1badc676cc734a90900be6af887e027a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:02.123601 13165 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c6d14c392db54aeca8c6ff936e6ea348"
dest_uuid: "1badc676cc734a90900be6af887e027a"
 from {username='slave'} at 127.0.0.1:36396
I20260709 12:09:02.123613 13495 raft_consensus.cc:697] T 864c0069cfc244d7a79fc504e0fc0221 P 1badc676cc734a90900be6af887e027a [term 3 LEADER]: Becoming Leader. State: Replica: 1badc676cc734a90900be6af887e027a, State: Running, Role: LEADER
I20260709 12:09:02.124238 13165 raft_consensus.cc:493] T c6d14c392db54aeca8c6ff936e6ea348 P 1badc676cc734a90900be6af887e027a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:02.124631 13165 raft_consensus.cc:3060] T c6d14c392db54aeca8c6ff936e6ea348 P 1badc676cc734a90900be6af887e027a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:02.124763 13495 consensus_queue.cc:237] T 864c0069cfc244d7a79fc504e0fc0221 P 1badc676cc734a90900be6af887e027a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:09:02.125610 13241 raft_consensus.cc:2468] T 864c0069cfc244d7a79fc504e0fc0221 P 2768c30a298e46b784868aea92ffdb0d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1badc676cc734a90900be6af887e027a in term 3.
I20260709 12:09:02.132854 13165 raft_consensus.cc:515] T c6d14c392db54aeca8c6ff936e6ea348 P 1badc676cc734a90900be6af887e027a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:09:02.133718 13061 catalog_manager.cc:5697] T 864c0069cfc244d7a79fc504e0fc0221 P 1badc676cc734a90900be6af887e027a reported cstate change: term changed from 2 to 3, leader changed from 2768c30a298e46b784868aea92ffdb0d (127.12.56.194) to 1badc676cc734a90900be6af887e027a (127.12.56.193). New cstate: current_term: 3 leader_uuid: "1badc676cc734a90900be6af887e027a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:02.135392 13165 leader_election.cc:290] T c6d14c392db54aeca8c6ff936e6ea348 P 1badc676cc734a90900be6af887e027a [CANDIDATE]: Term 4 election: Requested vote from peers 2768c30a298e46b784868aea92ffdb0d (127.12.56.194:37951), da0f578f1d4541ada6f9aad99f761e8c (127.12.56.195:40703)
I20260709 12:09:02.135660 13241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d14c392db54aeca8c6ff936e6ea348" candidate_uuid: "1badc676cc734a90900be6af887e027a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2768c30a298e46b784868aea92ffdb0d"
I20260709 12:09:02.135995 13313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d14c392db54aeca8c6ff936e6ea348" candidate_uuid: "1badc676cc734a90900be6af887e027a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "da0f578f1d4541ada6f9aad99f761e8c"
I20260709 12:09:02.136246 13241 raft_consensus.cc:3060] T c6d14c392db54aeca8c6ff936e6ea348 P 2768c30a298e46b784868aea92ffdb0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:02.136624 13313 raft_consensus.cc:3055] T c6d14c392db54aeca8c6ff936e6ea348 P da0f578f1d4541ada6f9aad99f761e8c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:02.136950 13313 raft_consensus.cc:740] T c6d14c392db54aeca8c6ff936e6ea348 P da0f578f1d4541ada6f9aad99f761e8c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: da0f578f1d4541ada6f9aad99f761e8c, State: Running, Role: LEADER
I20260709 12:09:02.137957 13313 consensus_queue.cc:260] T c6d14c392db54aeca8c6ff936e6ea348 P da0f578f1d4541ada6f9aad99f761e8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:09:02.139420 13313 raft_consensus.cc:3060] T c6d14c392db54aeca8c6ff936e6ea348 P da0f578f1d4541ada6f9aad99f761e8c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:02.144927 13241 raft_consensus.cc:2468] T c6d14c392db54aeca8c6ff936e6ea348 P 2768c30a298e46b784868aea92ffdb0d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1badc676cc734a90900be6af887e027a in term 4.
I20260709 12:09:02.146092 13130 leader_election.cc:304] T c6d14c392db54aeca8c6ff936e6ea348 P 1badc676cc734a90900be6af887e027a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1badc676cc734a90900be6af887e027a, 2768c30a298e46b784868aea92ffdb0d; no voters: 
I20260709 12:09:02.146672 13313 raft_consensus.cc:2468] T c6d14c392db54aeca8c6ff936e6ea348 P da0f578f1d4541ada6f9aad99f761e8c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1badc676cc734a90900be6af887e027a in term 4.
I20260709 12:09:02.147055 13495 raft_consensus.cc:2804] T c6d14c392db54aeca8c6ff936e6ea348 P 1badc676cc734a90900be6af887e027a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:02.147954 13495 raft_consensus.cc:697] T c6d14c392db54aeca8c6ff936e6ea348 P 1badc676cc734a90900be6af887e027a [term 4 LEADER]: Becoming Leader. State: Replica: 1badc676cc734a90900be6af887e027a, State: Running, Role: LEADER
I20260709 12:09:02.148989 13495 consensus_queue.cc:237] T c6d14c392db54aeca8c6ff936e6ea348 P 1badc676cc734a90900be6af887e027a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:09:02.157254 13061 catalog_manager.cc:5697] T c6d14c392db54aeca8c6ff936e6ea348 P 1badc676cc734a90900be6af887e027a reported cstate change: term changed from 3 to 4, leader changed from da0f578f1d4541ada6f9aad99f761e8c (127.12.56.195) to 1badc676cc734a90900be6af887e027a (127.12.56.193). New cstate: current_term: 4 leader_uuid: "1badc676cc734a90900be6af887e027a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:02.221515 13485 raft_consensus.cc:993] T fac4c58593a44cd5a45e96d22fb3f0dd P 2768c30a298e46b784868aea92ffdb0d: : Instructing follower 1badc676cc734a90900be6af887e027a to start an election
I20260709 12:09:02.222352 13498 raft_consensus.cc:1081] T fac4c58593a44cd5a45e96d22fb3f0dd P 2768c30a298e46b784868aea92ffdb0d [term 2 LEADER]: Signalling peer 1badc676cc734a90900be6af887e027a to start an election
I20260709 12:09:02.224335 13165 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fac4c58593a44cd5a45e96d22fb3f0dd"
dest_uuid: "1badc676cc734a90900be6af887e027a"
 from {username='slave'} at 127.0.0.1:36390
I20260709 12:09:02.224890 13165 raft_consensus.cc:493] T fac4c58593a44cd5a45e96d22fb3f0dd P 1badc676cc734a90900be6af887e027a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:02.225277 13165 raft_consensus.cc:3060] T fac4c58593a44cd5a45e96d22fb3f0dd P 1badc676cc734a90900be6af887e027a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:02.231333 13165 raft_consensus.cc:515] T fac4c58593a44cd5a45e96d22fb3f0dd P 1badc676cc734a90900be6af887e027a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:09:02.233165 13165 leader_election.cc:290] T fac4c58593a44cd5a45e96d22fb3f0dd P 1badc676cc734a90900be6af887e027a [CANDIDATE]: Term 3 election: Requested vote from peers 2768c30a298e46b784868aea92ffdb0d (127.12.56.194:37951), da0f578f1d4541ada6f9aad99f761e8c (127.12.56.195:40703)
I20260709 12:09:02.234160 13241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac4c58593a44cd5a45e96d22fb3f0dd" candidate_uuid: "1badc676cc734a90900be6af887e027a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2768c30a298e46b784868aea92ffdb0d"
I20260709 12:09:02.234290 13313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fac4c58593a44cd5a45e96d22fb3f0dd" candidate_uuid: "1badc676cc734a90900be6af887e027a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "da0f578f1d4541ada6f9aad99f761e8c"
I20260709 12:09:02.234926 13313 raft_consensus.cc:3060] T fac4c58593a44cd5a45e96d22fb3f0dd P da0f578f1d4541ada6f9aad99f761e8c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:02.234907 13241 raft_consensus.cc:3055] T fac4c58593a44cd5a45e96d22fb3f0dd P 2768c30a298e46b784868aea92ffdb0d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:02.235489 13241 raft_consensus.cc:740] T fac4c58593a44cd5a45e96d22fb3f0dd P 2768c30a298e46b784868aea92ffdb0d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2768c30a298e46b784868aea92ffdb0d, State: Running, Role: LEADER
I20260709 12:09:02.236418 13241 consensus_queue.cc:260] T fac4c58593a44cd5a45e96d22fb3f0dd P 2768c30a298e46b784868aea92ffdb0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:09:02.237725 13241 raft_consensus.cc:3060] T fac4c58593a44cd5a45e96d22fb3f0dd P 2768c30a298e46b784868aea92ffdb0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:02.242491 13313 raft_consensus.cc:2468] T fac4c58593a44cd5a45e96d22fb3f0dd P da0f578f1d4541ada6f9aad99f761e8c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1badc676cc734a90900be6af887e027a in term 3.
I20260709 12:09:02.244239 13132 leader_election.cc:304] T fac4c58593a44cd5a45e96d22fb3f0dd P 1badc676cc734a90900be6af887e027a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1badc676cc734a90900be6af887e027a, da0f578f1d4541ada6f9aad99f761e8c; no voters: 
I20260709 12:09:02.244750 13241 raft_consensus.cc:2468] T fac4c58593a44cd5a45e96d22fb3f0dd P 2768c30a298e46b784868aea92ffdb0d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1badc676cc734a90900be6af887e027a in term 3.
I20260709 12:09:02.245370 13495 raft_consensus.cc:2804] T fac4c58593a44cd5a45e96d22fb3f0dd P 1badc676cc734a90900be6af887e027a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:02.245785 13495 raft_consensus.cc:697] T fac4c58593a44cd5a45e96d22fb3f0dd P 1badc676cc734a90900be6af887e027a [term 3 LEADER]: Becoming Leader. State: Replica: 1badc676cc734a90900be6af887e027a, State: Running, Role: LEADER
I20260709 12:09:02.246639 13495 consensus_queue.cc:237] T fac4c58593a44cd5a45e96d22fb3f0dd P 1badc676cc734a90900be6af887e027a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:09:02.254456 13061 catalog_manager.cc:5697] T fac4c58593a44cd5a45e96d22fb3f0dd P 1badc676cc734a90900be6af887e027a reported cstate change: term changed from 2 to 3, leader changed from 2768c30a298e46b784868aea92ffdb0d (127.12.56.194) to 1badc676cc734a90900be6af887e027a (127.12.56.193). New cstate: current_term: 3 leader_uuid: "1badc676cc734a90900be6af887e027a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:02.517481 13313 raft_consensus.cc:1275] T 05e69121e8b54b96bfd2863422f446b9 P da0f578f1d4541ada6f9aad99f761e8c [term 4 FOLLOWER]: Refusing update from remote peer 1badc676cc734a90900be6af887e027a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:02.519133 13495 consensus_queue.cc:1048] T 05e69121e8b54b96bfd2863422f446b9 P 1badc676cc734a90900be6af887e027a [LEADER]: Connected to new peer: Peer: permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:02.531283 13241 raft_consensus.cc:1275] T 05e69121e8b54b96bfd2863422f446b9 P 2768c30a298e46b784868aea92ffdb0d [term 4 FOLLOWER]: Refusing update from remote peer 1badc676cc734a90900be6af887e027a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:02.533682 13495 consensus_queue.cc:1048] T 05e69121e8b54b96bfd2863422f446b9 P 1badc676cc734a90900be6af887e027a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:02.548143 13313 raft_consensus.cc:1275] T 3feb7c5af98049f09244f7e2266f3b62 P da0f578f1d4541ada6f9aad99f761e8c [term 3 FOLLOWER]: Refusing update from remote peer 1badc676cc734a90900be6af887e027a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:02.549525 13495 consensus_queue.cc:1048] T 3feb7c5af98049f09244f7e2266f3b62 P 1badc676cc734a90900be6af887e027a [LEADER]: Connected to new peer: Peer: permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:02.559470 13241 raft_consensus.cc:1275] T 3feb7c5af98049f09244f7e2266f3b62 P 2768c30a298e46b784868aea92ffdb0d [term 3 FOLLOWER]: Refusing update from remote peer 1badc676cc734a90900be6af887e027a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:02.562078 13509 consensus_queue.cc:1048] T 3feb7c5af98049f09244f7e2266f3b62 P 1badc676cc734a90900be6af887e027a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:02.574676 13241 raft_consensus.cc:1275] T 864c0069cfc244d7a79fc504e0fc0221 P 2768c30a298e46b784868aea92ffdb0d [term 3 FOLLOWER]: Refusing update from remote peer 1badc676cc734a90900be6af887e027a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:02.576344 13509 consensus_queue.cc:1048] T 864c0069cfc244d7a79fc504e0fc0221 P 1badc676cc734a90900be6af887e027a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:02.576779 13313 raft_consensus.cc:1275] T 864c0069cfc244d7a79fc504e0fc0221 P da0f578f1d4541ada6f9aad99f761e8c [term 3 FOLLOWER]: Refusing update from remote peer 1badc676cc734a90900be6af887e027a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:02.578552 13509 consensus_queue.cc:1048] T 864c0069cfc244d7a79fc504e0fc0221 P 1badc676cc734a90900be6af887e027a [LEADER]: Connected to new peer: Peer: permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:02.581001 13240 raft_consensus.cc:1275] T c6d14c392db54aeca8c6ff936e6ea348 P 2768c30a298e46b784868aea92ffdb0d [term 4 FOLLOWER]: Refusing update from remote peer 1badc676cc734a90900be6af887e027a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:02.583474 13509 consensus_queue.cc:1048] T c6d14c392db54aeca8c6ff936e6ea348 P 1badc676cc734a90900be6af887e027a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:02.616142 13313 raft_consensus.cc:1275] T c6d14c392db54aeca8c6ff936e6ea348 P da0f578f1d4541ada6f9aad99f761e8c [term 4 FOLLOWER]: Refusing update from remote peer 1badc676cc734a90900be6af887e027a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:02.617900 13493 consensus_queue.cc:1048] T c6d14c392db54aeca8c6ff936e6ea348 P 1badc676cc734a90900be6af887e027a [LEADER]: Connected to new peer: Peer: permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:02.679019 13313 raft_consensus.cc:1275] T fac4c58593a44cd5a45e96d22fb3f0dd P da0f578f1d4541ada6f9aad99f761e8c [term 3 FOLLOWER]: Refusing update from remote peer 1badc676cc734a90900be6af887e027a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:02.680320 13493 consensus_queue.cc:1048] T fac4c58593a44cd5a45e96d22fb3f0dd P 1badc676cc734a90900be6af887e027a [LEADER]: Connected to new peer: Peer: permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:02.691244 13240 raft_consensus.cc:1275] T fac4c58593a44cd5a45e96d22fb3f0dd P 2768c30a298e46b784868aea92ffdb0d [term 3 FOLLOWER]: Refusing update from remote peer 1badc676cc734a90900be6af887e027a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:02.693964 13493 consensus_queue.cc:1048] T fac4c58593a44cd5a45e96d22fb3f0dd P 1badc676cc734a90900be6af887e027a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:04.772604 12515 auto_leader_rebalancer-test.cc:399] The leader distribution is 
I20260709 12:09:04.773264 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:04.781353 13165 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0548d800f00849639c60c9fc6a0b3b44"
dest_uuid: "1badc676cc734a90900be6af887e027a"
mode: GRACEFUL
new_leader_uuid: "2768c30a298e46b784868aea92ffdb0d"
 from {username='slave'} at 127.0.0.1:34030
I20260709 12:09:04.781944 13165 raft_consensus.cc:606] T 0548d800f00849639c60c9fc6a0b3b44 P 1badc676cc734a90900be6af887e027a [term 2 LEADER]: Received request to transfer leadership to TS 2768c30a298e46b784868aea92ffdb0d
I20260709 12:09:04.785238 13165 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05e69121e8b54b96bfd2863422f446b9"
dest_uuid: "1badc676cc734a90900be6af887e027a"
mode: GRACEFUL
new_leader_uuid: "da0f578f1d4541ada6f9aad99f761e8c"
 from {username='slave'} at 127.0.0.1:34030
I20260709 12:09:04.785832 13165 raft_consensus.cc:606] T 05e69121e8b54b96bfd2863422f446b9 P 1badc676cc734a90900be6af887e027a [term 4 LEADER]: Received request to transfer leadership to TS da0f578f1d4541ada6f9aad99f761e8c
I20260709 12:09:04.788833 13165 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3db6a69f63d049fca47cec510aa05a89"
dest_uuid: "1badc676cc734a90900be6af887e027a"
mode: GRACEFUL
new_leader_uuid: "2768c30a298e46b784868aea92ffdb0d"
 from {username='slave'} at 127.0.0.1:34030
I20260709 12:09:04.789585 13165 raft_consensus.cc:606] T 3db6a69f63d049fca47cec510aa05a89 P 1badc676cc734a90900be6af887e027a [term 2 LEADER]: Received request to transfer leadership to TS 2768c30a298e46b784868aea92ffdb0d
I20260709 12:09:04.792593 13165 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "864c0069cfc244d7a79fc504e0fc0221"
dest_uuid: "1badc676cc734a90900be6af887e027a"
mode: GRACEFUL
new_leader_uuid: "da0f578f1d4541ada6f9aad99f761e8c"
 from {username='slave'} at 127.0.0.1:34030
I20260709 12:09:04.793246 13165 raft_consensus.cc:606] T 864c0069cfc244d7a79fc504e0fc0221 P 1badc676cc734a90900be6af887e027a [term 3 LEADER]: Received request to transfer leadership to TS da0f578f1d4541ada6f9aad99f761e8c
I20260709 12:09:04.794651 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:09:04.795226 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:04.818173 13523 raft_consensus.cc:993] T 0548d800f00849639c60c9fc6a0b3b44 P 1badc676cc734a90900be6af887e027a: : Instructing follower 2768c30a298e46b784868aea92ffdb0d to start an election
I20260709 12:09:04.818703 13522 raft_consensus.cc:1081] T 0548d800f00849639c60c9fc6a0b3b44 P 1badc676cc734a90900be6af887e027a [term 2 LEADER]: Signalling peer 2768c30a298e46b784868aea92ffdb0d to start an election
I20260709 12:09:04.820500 13242 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0548d800f00849639c60c9fc6a0b3b44"
dest_uuid: "2768c30a298e46b784868aea92ffdb0d"
 from {username='slave'} at 127.0.0.1:40368
I20260709 12:09:04.821122 13242 raft_consensus.cc:493] T 0548d800f00849639c60c9fc6a0b3b44 P 2768c30a298e46b784868aea92ffdb0d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:04.821419 13242 raft_consensus.cc:3060] T 0548d800f00849639c60c9fc6a0b3b44 P 2768c30a298e46b784868aea92ffdb0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:04.827625 13242 raft_consensus.cc:515] T 0548d800f00849639c60c9fc6a0b3b44 P 2768c30a298e46b784868aea92ffdb0d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } }
I20260709 12:09:04.830057 13242 leader_election.cc:290] T 0548d800f00849639c60c9fc6a0b3b44 P 2768c30a298e46b784868aea92ffdb0d [CANDIDATE]: Term 3 election: Requested vote from peers da0f578f1d4541ada6f9aad99f761e8c (127.12.56.195:40703), 1badc676cc734a90900be6af887e027a (127.12.56.193:36691)
I20260709 12:09:04.831148 13165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0548d800f00849639c60c9fc6a0b3b44" candidate_uuid: "2768c30a298e46b784868aea92ffdb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1badc676cc734a90900be6af887e027a"
I20260709 12:09:04.831187 13315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0548d800f00849639c60c9fc6a0b3b44" candidate_uuid: "2768c30a298e46b784868aea92ffdb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "da0f578f1d4541ada6f9aad99f761e8c"
I20260709 12:09:04.831887 13165 raft_consensus.cc:3055] T 0548d800f00849639c60c9fc6a0b3b44 P 1badc676cc734a90900be6af887e027a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:04.831947 13315 raft_consensus.cc:3060] T 0548d800f00849639c60c9fc6a0b3b44 P da0f578f1d4541ada6f9aad99f761e8c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:04.832389 13165 raft_consensus.cc:740] T 0548d800f00849639c60c9fc6a0b3b44 P 1badc676cc734a90900be6af887e027a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1badc676cc734a90900be6af887e027a, State: Running, Role: LEADER
I20260709 12:09:04.833280 13165 consensus_queue.cc:260] T 0548d800f00849639c60c9fc6a0b3b44 P 1badc676cc734a90900be6af887e027a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } }
I20260709 12:09:04.834568 13165 raft_consensus.cc:3060] T 0548d800f00849639c60c9fc6a0b3b44 P 1badc676cc734a90900be6af887e027a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:04.839634 13315 raft_consensus.cc:2468] T 0548d800f00849639c60c9fc6a0b3b44 P da0f578f1d4541ada6f9aad99f761e8c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2768c30a298e46b784868aea92ffdb0d in term 3.
I20260709 12:09:04.841125 13207 leader_election.cc:304] T 0548d800f00849639c60c9fc6a0b3b44 P 2768c30a298e46b784868aea92ffdb0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2768c30a298e46b784868aea92ffdb0d, da0f578f1d4541ada6f9aad99f761e8c; no voters: 
I20260709 12:09:04.841311 13165 raft_consensus.cc:2468] T 0548d800f00849639c60c9fc6a0b3b44 P 1badc676cc734a90900be6af887e027a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2768c30a298e46b784868aea92ffdb0d in term 3.
I20260709 12:09:04.842129 13485 raft_consensus.cc:2804] T 0548d800f00849639c60c9fc6a0b3b44 P 2768c30a298e46b784868aea92ffdb0d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:04.843303 13485 raft_consensus.cc:697] T 0548d800f00849639c60c9fc6a0b3b44 P 2768c30a298e46b784868aea92ffdb0d [term 3 LEADER]: Becoming Leader. State: Replica: 2768c30a298e46b784868aea92ffdb0d, State: Running, Role: LEADER
I20260709 12:09:04.844055 13485 consensus_queue.cc:237] T 0548d800f00849639c60c9fc6a0b3b44 P 2768c30a298e46b784868aea92ffdb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } }
I20260709 12:09:04.851496 13061 catalog_manager.cc:5697] T 0548d800f00849639c60c9fc6a0b3b44 P 2768c30a298e46b784868aea92ffdb0d reported cstate change: term changed from 2 to 3, leader changed from 1badc676cc734a90900be6af887e027a (127.12.56.193) to 2768c30a298e46b784868aea92ffdb0d (127.12.56.194). New cstate: current_term: 3 leader_uuid: "2768c30a298e46b784868aea92ffdb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:04.960027 13523 raft_consensus.cc:993] T 864c0069cfc244d7a79fc504e0fc0221 P 1badc676cc734a90900be6af887e027a: : Instructing follower da0f578f1d4541ada6f9aad99f761e8c to start an election
I20260709 12:09:04.960527 13522 raft_consensus.cc:1081] T 864c0069cfc244d7a79fc504e0fc0221 P 1badc676cc734a90900be6af887e027a [term 3 LEADER]: Signalling peer da0f578f1d4541ada6f9aad99f761e8c to start an election
I20260709 12:09:04.962484 13315 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "864c0069cfc244d7a79fc504e0fc0221"
dest_uuid: "da0f578f1d4541ada6f9aad99f761e8c"
 from {username='slave'} at 127.0.0.1:50460
I20260709 12:09:04.963094 13315 raft_consensus.cc:493] T 864c0069cfc244d7a79fc504e0fc0221 P da0f578f1d4541ada6f9aad99f761e8c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:04.963416 13315 raft_consensus.cc:3060] T 864c0069cfc244d7a79fc504e0fc0221 P da0f578f1d4541ada6f9aad99f761e8c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:04.969344 13315 raft_consensus.cc:515] T 864c0069cfc244d7a79fc504e0fc0221 P da0f578f1d4541ada6f9aad99f761e8c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:09:04.971632 13315 leader_election.cc:290] T 864c0069cfc244d7a79fc504e0fc0221 P da0f578f1d4541ada6f9aad99f761e8c [CANDIDATE]: Term 4 election: Requested vote from peers 1badc676cc734a90900be6af887e027a (127.12.56.193:36691), 2768c30a298e46b784868aea92ffdb0d (127.12.56.194:37951)
I20260709 12:09:04.972846 13242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864c0069cfc244d7a79fc504e0fc0221" candidate_uuid: "da0f578f1d4541ada6f9aad99f761e8c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2768c30a298e46b784868aea92ffdb0d"
I20260709 12:09:04.972569 13165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "864c0069cfc244d7a79fc504e0fc0221" candidate_uuid: "da0f578f1d4541ada6f9aad99f761e8c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1badc676cc734a90900be6af887e027a"
I20260709 12:09:04.973737 13242 raft_consensus.cc:3060] T 864c0069cfc244d7a79fc504e0fc0221 P 2768c30a298e46b784868aea92ffdb0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:04.974004 13165 raft_consensus.cc:3055] T 864c0069cfc244d7a79fc504e0fc0221 P 1badc676cc734a90900be6af887e027a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:04.974407 13165 raft_consensus.cc:740] T 864c0069cfc244d7a79fc504e0fc0221 P 1badc676cc734a90900be6af887e027a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1badc676cc734a90900be6af887e027a, State: Running, Role: LEADER
I20260709 12:09:04.975131 13165 consensus_queue.cc:260] T 864c0069cfc244d7a79fc504e0fc0221 P 1badc676cc734a90900be6af887e027a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:09:04.976204 13165 raft_consensus.cc:3060] T 864c0069cfc244d7a79fc504e0fc0221 P 1badc676cc734a90900be6af887e027a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:04.981122 13242 raft_consensus.cc:2468] T 864c0069cfc244d7a79fc504e0fc0221 P 2768c30a298e46b784868aea92ffdb0d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da0f578f1d4541ada6f9aad99f761e8c in term 4.
I20260709 12:09:04.982375 13165 raft_consensus.cc:2468] T 864c0069cfc244d7a79fc504e0fc0221 P 1badc676cc734a90900be6af887e027a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da0f578f1d4541ada6f9aad99f761e8c in term 4.
I20260709 12:09:04.982640 13279 leader_election.cc:304] T 864c0069cfc244d7a79fc504e0fc0221 P da0f578f1d4541ada6f9aad99f761e8c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2768c30a298e46b784868aea92ffdb0d, da0f578f1d4541ada6f9aad99f761e8c; no voters: 
I20260709 12:09:04.983553 13480 raft_consensus.cc:2804] T 864c0069cfc244d7a79fc504e0fc0221 P da0f578f1d4541ada6f9aad99f761e8c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:04.984724 13480 raft_consensus.cc:697] T 864c0069cfc244d7a79fc504e0fc0221 P da0f578f1d4541ada6f9aad99f761e8c [term 4 LEADER]: Becoming Leader. State: Replica: da0f578f1d4541ada6f9aad99f761e8c, State: Running, Role: LEADER
I20260709 12:09:04.985495 13480 consensus_queue.cc:237] T 864c0069cfc244d7a79fc504e0fc0221 P da0f578f1d4541ada6f9aad99f761e8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:09:04.994175 13061 catalog_manager.cc:5697] T 864c0069cfc244d7a79fc504e0fc0221 P da0f578f1d4541ada6f9aad99f761e8c reported cstate change: term changed from 3 to 4, leader changed from 1badc676cc734a90900be6af887e027a (127.12.56.193) to da0f578f1d4541ada6f9aad99f761e8c (127.12.56.195). New cstate: current_term: 4 leader_uuid: "da0f578f1d4541ada6f9aad99f761e8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:05.038225 13522 raft_consensus.cc:993] T 05e69121e8b54b96bfd2863422f446b9 P 1badc676cc734a90900be6af887e027a: : Instructing follower da0f578f1d4541ada6f9aad99f761e8c to start an election
I20260709 12:09:05.039496 13523 raft_consensus.cc:1081] T 05e69121e8b54b96bfd2863422f446b9 P 1badc676cc734a90900be6af887e027a [term 4 LEADER]: Signalling peer da0f578f1d4541ada6f9aad99f761e8c to start an election
I20260709 12:09:05.041567 13315 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "05e69121e8b54b96bfd2863422f446b9"
dest_uuid: "da0f578f1d4541ada6f9aad99f761e8c"
 from {username='slave'} at 127.0.0.1:50460
I20260709 12:09:05.042171 13315 raft_consensus.cc:493] T 05e69121e8b54b96bfd2863422f446b9 P da0f578f1d4541ada6f9aad99f761e8c [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:05.042718 13315 raft_consensus.cc:3060] T 05e69121e8b54b96bfd2863422f446b9 P da0f578f1d4541ada6f9aad99f761e8c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:05.048879 13315 raft_consensus.cc:515] T 05e69121e8b54b96bfd2863422f446b9 P da0f578f1d4541ada6f9aad99f761e8c [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:09:05.051155 13315 leader_election.cc:290] T 05e69121e8b54b96bfd2863422f446b9 P da0f578f1d4541ada6f9aad99f761e8c [CANDIDATE]: Term 5 election: Requested vote from peers 1badc676cc734a90900be6af887e027a (127.12.56.193:36691), 2768c30a298e46b784868aea92ffdb0d (127.12.56.194:37951)
I20260709 12:09:05.052239 13165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05e69121e8b54b96bfd2863422f446b9" candidate_uuid: "da0f578f1d4541ada6f9aad99f761e8c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "1badc676cc734a90900be6af887e027a"
I20260709 12:09:05.052291 13242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05e69121e8b54b96bfd2863422f446b9" candidate_uuid: "da0f578f1d4541ada6f9aad99f761e8c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "2768c30a298e46b784868aea92ffdb0d"
I20260709 12:09:05.053002 13165 raft_consensus.cc:3055] T 05e69121e8b54b96bfd2863422f446b9 P 1badc676cc734a90900be6af887e027a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:09:05.053223 13242 raft_consensus.cc:3060] T 05e69121e8b54b96bfd2863422f446b9 P 2768c30a298e46b784868aea92ffdb0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:05.053367 13165 raft_consensus.cc:740] T 05e69121e8b54b96bfd2863422f446b9 P 1badc676cc734a90900be6af887e027a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1badc676cc734a90900be6af887e027a, State: Running, Role: LEADER
I20260709 12:09:05.054204 13165 consensus_queue.cc:260] T 05e69121e8b54b96bfd2863422f446b9 P 1badc676cc734a90900be6af887e027a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:09:05.055186 13165 raft_consensus.cc:3060] T 05e69121e8b54b96bfd2863422f446b9 P 1badc676cc734a90900be6af887e027a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:05.059248 13242 raft_consensus.cc:2468] T 05e69121e8b54b96bfd2863422f446b9 P 2768c30a298e46b784868aea92ffdb0d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da0f578f1d4541ada6f9aad99f761e8c in term 5.
I20260709 12:09:05.060083 13165 raft_consensus.cc:2468] T 05e69121e8b54b96bfd2863422f446b9 P 1badc676cc734a90900be6af887e027a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da0f578f1d4541ada6f9aad99f761e8c in term 5.
I20260709 12:09:05.060474 13279 leader_election.cc:304] T 05e69121e8b54b96bfd2863422f446b9 P da0f578f1d4541ada6f9aad99f761e8c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2768c30a298e46b784868aea92ffdb0d, da0f578f1d4541ada6f9aad99f761e8c; no voters: 
I20260709 12:09:05.061292 13480 raft_consensus.cc:2804] T 05e69121e8b54b96bfd2863422f446b9 P da0f578f1d4541ada6f9aad99f761e8c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:09:05.061748 13480 raft_consensus.cc:697] T 05e69121e8b54b96bfd2863422f446b9 P da0f578f1d4541ada6f9aad99f761e8c [term 5 LEADER]: Becoming Leader. State: Replica: da0f578f1d4541ada6f9aad99f761e8c, State: Running, Role: LEADER
I20260709 12:09:05.062456 13480 consensus_queue.cc:237] T 05e69121e8b54b96bfd2863422f446b9 P da0f578f1d4541ada6f9aad99f761e8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:09:05.070017 13061 catalog_manager.cc:5697] T 05e69121e8b54b96bfd2863422f446b9 P da0f578f1d4541ada6f9aad99f761e8c reported cstate change: term changed from 4 to 5, leader changed from 1badc676cc734a90900be6af887e027a (127.12.56.193) to da0f578f1d4541ada6f9aad99f761e8c (127.12.56.195). New cstate: current_term: 5 leader_uuid: "da0f578f1d4541ada6f9aad99f761e8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:05.076332 13532 raft_consensus.cc:993] T 3db6a69f63d049fca47cec510aa05a89 P 1badc676cc734a90900be6af887e027a: : Instructing follower 2768c30a298e46b784868aea92ffdb0d to start an election
I20260709 12:09:05.076838 13523 raft_consensus.cc:1081] T 3db6a69f63d049fca47cec510aa05a89 P 1badc676cc734a90900be6af887e027a [term 2 LEADER]: Signalling peer 2768c30a298e46b784868aea92ffdb0d to start an election
I20260709 12:09:05.078754 13242 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3db6a69f63d049fca47cec510aa05a89"
dest_uuid: "2768c30a298e46b784868aea92ffdb0d"
 from {username='slave'} at 127.0.0.1:40368
I20260709 12:09:05.079396 13242 raft_consensus.cc:493] T 3db6a69f63d049fca47cec510aa05a89 P 2768c30a298e46b784868aea92ffdb0d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:05.079798 13242 raft_consensus.cc:3060] T 3db6a69f63d049fca47cec510aa05a89 P 2768c30a298e46b784868aea92ffdb0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:05.084978 13242 raft_consensus.cc:515] T 3db6a69f63d049fca47cec510aa05a89 P 2768c30a298e46b784868aea92ffdb0d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:09:05.086709 13242 leader_election.cc:290] T 3db6a69f63d049fca47cec510aa05a89 P 2768c30a298e46b784868aea92ffdb0d [CANDIDATE]: Term 3 election: Requested vote from peers 1badc676cc734a90900be6af887e027a (127.12.56.193:36691), da0f578f1d4541ada6f9aad99f761e8c (127.12.56.195:40703)
I20260709 12:09:05.087548 13165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db6a69f63d049fca47cec510aa05a89" candidate_uuid: "2768c30a298e46b784868aea92ffdb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1badc676cc734a90900be6af887e027a"
I20260709 12:09:05.087739 13315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db6a69f63d049fca47cec510aa05a89" candidate_uuid: "2768c30a298e46b784868aea92ffdb0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "da0f578f1d4541ada6f9aad99f761e8c"
I20260709 12:09:05.088361 13165 raft_consensus.cc:3055] T 3db6a69f63d049fca47cec510aa05a89 P 1badc676cc734a90900be6af887e027a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:05.088554 13315 raft_consensus.cc:3060] T 3db6a69f63d049fca47cec510aa05a89 P da0f578f1d4541ada6f9aad99f761e8c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:05.088634 13165 raft_consensus.cc:740] T 3db6a69f63d049fca47cec510aa05a89 P 1badc676cc734a90900be6af887e027a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1badc676cc734a90900be6af887e027a, State: Running, Role: LEADER
I20260709 12:09:05.089529 13165 consensus_queue.cc:260] T 3db6a69f63d049fca47cec510aa05a89 P 1badc676cc734a90900be6af887e027a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:09:05.090530 13165 raft_consensus.cc:3060] T 3db6a69f63d049fca47cec510aa05a89 P 1badc676cc734a90900be6af887e027a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:05.093834 13315 raft_consensus.cc:2468] T 3db6a69f63d049fca47cec510aa05a89 P da0f578f1d4541ada6f9aad99f761e8c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2768c30a298e46b784868aea92ffdb0d in term 3.
I20260709 12:09:05.094964 13207 leader_election.cc:304] T 3db6a69f63d049fca47cec510aa05a89 P 2768c30a298e46b784868aea92ffdb0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2768c30a298e46b784868aea92ffdb0d, da0f578f1d4541ada6f9aad99f761e8c; no voters: 
I20260709 12:09:05.095111 13165 raft_consensus.cc:2468] T 3db6a69f63d049fca47cec510aa05a89 P 1badc676cc734a90900be6af887e027a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2768c30a298e46b784868aea92ffdb0d in term 3.
I20260709 12:09:05.095849 13485 raft_consensus.cc:2804] T 3db6a69f63d049fca47cec510aa05a89 P 2768c30a298e46b784868aea92ffdb0d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:05.096328 13485 raft_consensus.cc:697] T 3db6a69f63d049fca47cec510aa05a89 P 2768c30a298e46b784868aea92ffdb0d [term 3 LEADER]: Becoming Leader. State: Replica: 2768c30a298e46b784868aea92ffdb0d, State: Running, Role: LEADER
I20260709 12:09:05.097186 13485 consensus_queue.cc:237] T 3db6a69f63d049fca47cec510aa05a89 P 2768c30a298e46b784868aea92ffdb0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } }
I20260709 12:09:05.104504 13061 catalog_manager.cc:5697] T 3db6a69f63d049fca47cec510aa05a89 P 2768c30a298e46b784868aea92ffdb0d reported cstate change: term changed from 2 to 3, leader changed from 1badc676cc734a90900be6af887e027a (127.12.56.193) to 2768c30a298e46b784868aea92ffdb0d (127.12.56.194). New cstate: current_term: 3 leader_uuid: "2768c30a298e46b784868aea92ffdb0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:05.267109 13315 raft_consensus.cc:1275] T 0548d800f00849639c60c9fc6a0b3b44 P da0f578f1d4541ada6f9aad99f761e8c [term 3 FOLLOWER]: Refusing update from remote peer 2768c30a298e46b784868aea92ffdb0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:05.268643 13485 consensus_queue.cc:1048] T 0548d800f00849639c60c9fc6a0b3b44 P 2768c30a298e46b784868aea92ffdb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:05.284240 13165 raft_consensus.cc:1275] T 0548d800f00849639c60c9fc6a0b3b44 P 1badc676cc734a90900be6af887e027a [term 3 FOLLOWER]: Refusing update from remote peer 2768c30a298e46b784868aea92ffdb0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:05.286319 13485 consensus_queue.cc:1048] T 0548d800f00849639c60c9fc6a0b3b44 P 2768c30a298e46b784868aea92ffdb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:05.464293 13165 raft_consensus.cc:1275] T 864c0069cfc244d7a79fc504e0fc0221 P 1badc676cc734a90900be6af887e027a [term 4 FOLLOWER]: Refusing update from remote peer da0f578f1d4541ada6f9aad99f761e8c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:05.466004 13480 consensus_queue.cc:1048] T 864c0069cfc244d7a79fc504e0fc0221 P da0f578f1d4541ada6f9aad99f761e8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:05.479585 13242 raft_consensus.cc:1275] T 864c0069cfc244d7a79fc504e0fc0221 P 2768c30a298e46b784868aea92ffdb0d [term 4 FOLLOWER]: Refusing update from remote peer da0f578f1d4541ada6f9aad99f761e8c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:05.481851 13543 consensus_queue.cc:1048] T 864c0069cfc244d7a79fc504e0fc0221 P da0f578f1d4541ada6f9aad99f761e8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:09:05.524945 13242 raft_consensus.cc:1275] T 05e69121e8b54b96bfd2863422f446b9 P 2768c30a298e46b784868aea92ffdb0d [term 5 FOLLOWER]: Refusing update from remote peer da0f578f1d4541ada6f9aad99f761e8c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:09:05.526746 13543 consensus_queue.cc:1048] T 05e69121e8b54b96bfd2863422f446b9 P da0f578f1d4541ada6f9aad99f761e8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2768c30a298e46b784868aea92ffdb0d" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:09:05.543582 13165 raft_consensus.cc:1275] T 05e69121e8b54b96bfd2863422f446b9 P 1badc676cc734a90900be6af887e027a [term 5 FOLLOWER]: Refusing update from remote peer da0f578f1d4541ada6f9aad99f761e8c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:09:05.545068 13543 consensus_queue.cc:1048] T 05e69121e8b54b96bfd2863422f446b9 P da0f578f1d4541ada6f9aad99f761e8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:09:05.551659 13165 raft_consensus.cc:1275] T 3db6a69f63d049fca47cec510aa05a89 P 1badc676cc734a90900be6af887e027a [term 3 FOLLOWER]: Refusing update from remote peer 2768c30a298e46b784868aea92ffdb0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:05.555058 13485 consensus_queue.cc:1048] T 3db6a69f63d049fca47cec510aa05a89 P 2768c30a298e46b784868aea92ffdb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1badc676cc734a90900be6af887e027a" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 36691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:05.571429 13315 raft_consensus.cc:1275] T 3db6a69f63d049fca47cec510aa05a89 P da0f578f1d4541ada6f9aad99f761e8c [term 3 FOLLOWER]: Refusing update from remote peer 2768c30a298e46b784868aea92ffdb0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:05.573277 13524 consensus_queue.cc:1048] T 3db6a69f63d049fca47cec510aa05a89 P 2768c30a298e46b784868aea92ffdb0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "da0f578f1d4541ada6f9aad99f761e8c" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 40703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:05.796674 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:05.803602 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:05.804126 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:06.805287 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:06.812419 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:06.812927 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:07.814129 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:07.819710 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:07.820220 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:08.821172 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:08.827021 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:08.827477 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:09.828490 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:09.834286 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:09.834787 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:10.903239 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:10.910498 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:10.911057 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:09:11.239462 13263 debug-util.cc:398] Leaking SignalData structure 0x7b0800101740 after lost signal to thread 12518
W20260709 12:09:11.240432 13263 debug-util.cc:398] Leaking SignalData structure 0x7b0800101e20 after lost signal to thread 13099
W20260709 12:09:11.241521 13263 debug-util.cc:398] Leaking SignalData structure 0x7b08000a8c00 after lost signal to thread 13191
W20260709 12:09:11.242424 13263 debug-util.cc:398] Leaking SignalData structure 0x7b08000ba780 after lost signal to thread 13266
W20260709 12:09:11.243378 13263 debug-util.cc:398] Leaking SignalData structure 0x7b08000d38e0 after lost signal to thread 13340
I20260709 12:09:11.911995 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:11.919358 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:11.919875 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:12.921051 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:12.930744 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:12.931373 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:13.932462 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:13.938251 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:13.939105 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:14.979506 12515 auto_leader_rebalancer-test.cc:410] The leader distribution is 
I20260709 12:09:14.980293 12515 tablet_server.cc:179] TabletServer@127.12.56.193:0 shutting down...
I20260709 12:09:15.020332 12515 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:09:15.021340 12515 tablet_replica.cc:333] T c4eca66176fa42acaf5926f8b6fab9d0 P 1badc676cc734a90900be6af887e027a: stopping tablet replica
I20260709 12:09:15.022395 12515 raft_consensus.cc:2243] T c4eca66176fa42acaf5926f8b6fab9d0 P 1badc676cc734a90900be6af887e027a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.023389 12515 raft_consensus.cc:2272] T c4eca66176fa42acaf5926f8b6fab9d0 P 1badc676cc734a90900be6af887e027a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.025763 12515 tablet_replica.cc:333] T 05e69121e8b54b96bfd2863422f446b9 P 1badc676cc734a90900be6af887e027a: stopping tablet replica
I20260709 12:09:15.026527 12515 raft_consensus.cc:2243] T 05e69121e8b54b96bfd2863422f446b9 P 1badc676cc734a90900be6af887e027a [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.026997 12515 raft_consensus.cc:2272] T 05e69121e8b54b96bfd2863422f446b9 P 1badc676cc734a90900be6af887e027a [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.028743 12515 tablet_replica.cc:333] T 31db820ce3cc45e0bb5f3560f7cc60e4 P 1badc676cc734a90900be6af887e027a: stopping tablet replica
I20260709 12:09:15.029302 12515 raft_consensus.cc:2243] T 31db820ce3cc45e0bb5f3560f7cc60e4 P 1badc676cc734a90900be6af887e027a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:09:15.030144 12515 raft_consensus.cc:2272] T 31db820ce3cc45e0bb5f3560f7cc60e4 P 1badc676cc734a90900be6af887e027a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.031919 12515 tablet_replica.cc:333] T fac4c58593a44cd5a45e96d22fb3f0dd P 1badc676cc734a90900be6af887e027a: stopping tablet replica
I20260709 12:09:15.032456 12515 raft_consensus.cc:2243] T fac4c58593a44cd5a45e96d22fb3f0dd P 1badc676cc734a90900be6af887e027a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:09:15.033248 12515 raft_consensus.cc:2272] T fac4c58593a44cd5a45e96d22fb3f0dd P 1badc676cc734a90900be6af887e027a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.035128 12515 tablet_replica.cc:333] T 3db6a69f63d049fca47cec510aa05a89 P 1badc676cc734a90900be6af887e027a: stopping tablet replica
I20260709 12:09:15.035681 12515 raft_consensus.cc:2243] T 3db6a69f63d049fca47cec510aa05a89 P 1badc676cc734a90900be6af887e027a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.036131 12515 raft_consensus.cc:2272] T 3db6a69f63d049fca47cec510aa05a89 P 1badc676cc734a90900be6af887e027a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.037842 12515 tablet_replica.cc:333] T c6d14c392db54aeca8c6ff936e6ea348 P 1badc676cc734a90900be6af887e027a: stopping tablet replica
I20260709 12:09:15.038357 12515 raft_consensus.cc:2243] T c6d14c392db54aeca8c6ff936e6ea348 P 1badc676cc734a90900be6af887e027a [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:09:15.039175 12515 raft_consensus.cc:2272] T c6d14c392db54aeca8c6ff936e6ea348 P 1badc676cc734a90900be6af887e027a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.040900 12515 tablet_replica.cc:333] T 864c0069cfc244d7a79fc504e0fc0221 P 1badc676cc734a90900be6af887e027a: stopping tablet replica
I20260709 12:09:15.041424 12515 raft_consensus.cc:2243] T 864c0069cfc244d7a79fc504e0fc0221 P 1badc676cc734a90900be6af887e027a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.041898 12515 raft_consensus.cc:2272] T 864c0069cfc244d7a79fc504e0fc0221 P 1badc676cc734a90900be6af887e027a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.043639 12515 tablet_replica.cc:333] T 0548d800f00849639c60c9fc6a0b3b44 P 1badc676cc734a90900be6af887e027a: stopping tablet replica
I20260709 12:09:15.044127 12515 raft_consensus.cc:2243] T 0548d800f00849639c60c9fc6a0b3b44 P 1badc676cc734a90900be6af887e027a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.044571 12515 raft_consensus.cc:2272] T 0548d800f00849639c60c9fc6a0b3b44 P 1badc676cc734a90900be6af887e027a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.046264 12515 tablet_replica.cc:333] T 3feb7c5af98049f09244f7e2266f3b62 P 1badc676cc734a90900be6af887e027a: stopping tablet replica
I20260709 12:09:15.046789 12515 raft_consensus.cc:2243] T 3feb7c5af98049f09244f7e2266f3b62 P 1badc676cc734a90900be6af887e027a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:09:15.047659 12515 raft_consensus.cc:2272] T 3feb7c5af98049f09244f7e2266f3b62 P 1badc676cc734a90900be6af887e027a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.049494 12515 tablet_replica.cc:333] T 5500cd37d9d844aebeb99f48c3a0f8fe P 1badc676cc734a90900be6af887e027a: stopping tablet replica
I20260709 12:09:15.050064 12515 raft_consensus.cc:2243] T 5500cd37d9d844aebeb99f48c3a0f8fe P 1badc676cc734a90900be6af887e027a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.050508 12515 raft_consensus.cc:2272] T 5500cd37d9d844aebeb99f48c3a0f8fe P 1badc676cc734a90900be6af887e027a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.087805 12515 tablet_server.cc:196] TabletServer@127.12.56.193:0 shutdown complete.
I20260709 12:09:15.110648 12515 tablet_server.cc:179] TabletServer@127.12.56.194:0 shutting down...
I20260709 12:09:15.142953 12515 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:09:15.144037 12515 tablet_replica.cc:333] T c4eca66176fa42acaf5926f8b6fab9d0 P 2768c30a298e46b784868aea92ffdb0d: stopping tablet replica
I20260709 12:09:15.144925 12515 raft_consensus.cc:2243] T c4eca66176fa42acaf5926f8b6fab9d0 P 2768c30a298e46b784868aea92ffdb0d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.145653 12515 raft_consensus.cc:2272] T c4eca66176fa42acaf5926f8b6fab9d0 P 2768c30a298e46b784868aea92ffdb0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.147735 12515 tablet_replica.cc:333] T 864c0069cfc244d7a79fc504e0fc0221 P 2768c30a298e46b784868aea92ffdb0d: stopping tablet replica
I20260709 12:09:15.148289 12515 raft_consensus.cc:2243] T 864c0069cfc244d7a79fc504e0fc0221 P 2768c30a298e46b784868aea92ffdb0d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.148746 12515 raft_consensus.cc:2272] T 864c0069cfc244d7a79fc504e0fc0221 P 2768c30a298e46b784868aea92ffdb0d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.151108 12515 tablet_replica.cc:333] T 31db820ce3cc45e0bb5f3560f7cc60e4 P 2768c30a298e46b784868aea92ffdb0d: stopping tablet replica
I20260709 12:09:15.151950 12515 raft_consensus.cc:2243] T 31db820ce3cc45e0bb5f3560f7cc60e4 P 2768c30a298e46b784868aea92ffdb0d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.152561 12515 raft_consensus.cc:2272] T 31db820ce3cc45e0bb5f3560f7cc60e4 P 2768c30a298e46b784868aea92ffdb0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.154858 12515 tablet_replica.cc:333] T 05e69121e8b54b96bfd2863422f446b9 P 2768c30a298e46b784868aea92ffdb0d: stopping tablet replica
I20260709 12:09:15.155377 12515 raft_consensus.cc:2243] T 05e69121e8b54b96bfd2863422f446b9 P 2768c30a298e46b784868aea92ffdb0d [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.155802 12515 raft_consensus.cc:2272] T 05e69121e8b54b96bfd2863422f446b9 P 2768c30a298e46b784868aea92ffdb0d [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.157474 12515 tablet_replica.cc:333] T 5500cd37d9d844aebeb99f48c3a0f8fe P 2768c30a298e46b784868aea92ffdb0d: stopping tablet replica
I20260709 12:09:15.158109 12515 raft_consensus.cc:2243] T 5500cd37d9d844aebeb99f48c3a0f8fe P 2768c30a298e46b784868aea92ffdb0d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:09:15.158924 12515 raft_consensus.cc:2272] T 5500cd37d9d844aebeb99f48c3a0f8fe P 2768c30a298e46b784868aea92ffdb0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.160866 12515 tablet_replica.cc:333] T 3feb7c5af98049f09244f7e2266f3b62 P 2768c30a298e46b784868aea92ffdb0d: stopping tablet replica
I20260709 12:09:15.161388 12515 raft_consensus.cc:2243] T 3feb7c5af98049f09244f7e2266f3b62 P 2768c30a298e46b784868aea92ffdb0d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.161880 12515 raft_consensus.cc:2272] T 3feb7c5af98049f09244f7e2266f3b62 P 2768c30a298e46b784868aea92ffdb0d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.163568 12515 tablet_replica.cc:333] T c6d14c392db54aeca8c6ff936e6ea348 P 2768c30a298e46b784868aea92ffdb0d: stopping tablet replica
I20260709 12:09:15.164041 12515 raft_consensus.cc:2243] T c6d14c392db54aeca8c6ff936e6ea348 P 2768c30a298e46b784868aea92ffdb0d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.164510 12515 raft_consensus.cc:2272] T c6d14c392db54aeca8c6ff936e6ea348 P 2768c30a298e46b784868aea92ffdb0d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.166237 12515 tablet_replica.cc:333] T 3db6a69f63d049fca47cec510aa05a89 P 2768c30a298e46b784868aea92ffdb0d: stopping tablet replica
I20260709 12:09:15.166674 12515 raft_consensus.cc:2243] T 3db6a69f63d049fca47cec510aa05a89 P 2768c30a298e46b784868aea92ffdb0d [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:09:15.167471 12515 raft_consensus.cc:2272] T 3db6a69f63d049fca47cec510aa05a89 P 2768c30a298e46b784868aea92ffdb0d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.169437 12515 tablet_replica.cc:333] T 0548d800f00849639c60c9fc6a0b3b44 P 2768c30a298e46b784868aea92ffdb0d: stopping tablet replica
I20260709 12:09:15.170059 12515 raft_consensus.cc:2243] T 0548d800f00849639c60c9fc6a0b3b44 P 2768c30a298e46b784868aea92ffdb0d [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:09:15.170836 12515 raft_consensus.cc:2272] T 0548d800f00849639c60c9fc6a0b3b44 P 2768c30a298e46b784868aea92ffdb0d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.172638 12515 tablet_replica.cc:333] T fac4c58593a44cd5a45e96d22fb3f0dd P 2768c30a298e46b784868aea92ffdb0d: stopping tablet replica
I20260709 12:09:15.173147 12515 raft_consensus.cc:2243] T fac4c58593a44cd5a45e96d22fb3f0dd P 2768c30a298e46b784868aea92ffdb0d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.173614 12515 raft_consensus.cc:2272] T fac4c58593a44cd5a45e96d22fb3f0dd P 2768c30a298e46b784868aea92ffdb0d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.224004 12515 tablet_server.cc:196] TabletServer@127.12.56.194:0 shutdown complete.
I20260709 12:09:15.263592 12515 tablet_server.cc:179] TabletServer@127.12.56.195:0 shutting down...
I20260709 12:09:15.310140 12515 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:09:15.312095 12515 tablet_replica.cc:333] T c4eca66176fa42acaf5926f8b6fab9d0 P da0f578f1d4541ada6f9aad99f761e8c: stopping tablet replica
I20260709 12:09:15.313205 12515 raft_consensus.cc:2243] T c4eca66176fa42acaf5926f8b6fab9d0 P da0f578f1d4541ada6f9aad99f761e8c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:09:15.315833 12515 raft_consensus.cc:2272] T c4eca66176fa42acaf5926f8b6fab9d0 P da0f578f1d4541ada6f9aad99f761e8c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.318876 12515 tablet_replica.cc:333] T 864c0069cfc244d7a79fc504e0fc0221 P da0f578f1d4541ada6f9aad99f761e8c: stopping tablet replica
I20260709 12:09:15.319511 12515 raft_consensus.cc:2243] T 864c0069cfc244d7a79fc504e0fc0221 P da0f578f1d4541ada6f9aad99f761e8c [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:09:15.320938 12515 raft_consensus.cc:2272] T 864c0069cfc244d7a79fc504e0fc0221 P da0f578f1d4541ada6f9aad99f761e8c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.323246 12515 tablet_replica.cc:333] T 3feb7c5af98049f09244f7e2266f3b62 P da0f578f1d4541ada6f9aad99f761e8c: stopping tablet replica
I20260709 12:09:15.324007 12515 raft_consensus.cc:2243] T 3feb7c5af98049f09244f7e2266f3b62 P da0f578f1d4541ada6f9aad99f761e8c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.324643 12515 raft_consensus.cc:2272] T 3feb7c5af98049f09244f7e2266f3b62 P da0f578f1d4541ada6f9aad99f761e8c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.327009 12515 tablet_replica.cc:333] T 5500cd37d9d844aebeb99f48c3a0f8fe P da0f578f1d4541ada6f9aad99f761e8c: stopping tablet replica
I20260709 12:09:15.328018 12515 raft_consensus.cc:2243] T 5500cd37d9d844aebeb99f48c3a0f8fe P da0f578f1d4541ada6f9aad99f761e8c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.328763 12515 raft_consensus.cc:2272] T 5500cd37d9d844aebeb99f48c3a0f8fe P da0f578f1d4541ada6f9aad99f761e8c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.330945 12515 tablet_replica.cc:333] T fac4c58593a44cd5a45e96d22fb3f0dd P da0f578f1d4541ada6f9aad99f761e8c: stopping tablet replica
I20260709 12:09:15.332167 12515 raft_consensus.cc:2243] T fac4c58593a44cd5a45e96d22fb3f0dd P da0f578f1d4541ada6f9aad99f761e8c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.332939 12515 raft_consensus.cc:2272] T fac4c58593a44cd5a45e96d22fb3f0dd P da0f578f1d4541ada6f9aad99f761e8c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.336385 12515 tablet_replica.cc:333] T 05e69121e8b54b96bfd2863422f446b9 P da0f578f1d4541ada6f9aad99f761e8c: stopping tablet replica
I20260709 12:09:15.337357 12515 raft_consensus.cc:2243] T 05e69121e8b54b96bfd2863422f446b9 P da0f578f1d4541ada6f9aad99f761e8c [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:09:15.338811 12515 raft_consensus.cc:2272] T 05e69121e8b54b96bfd2863422f446b9 P da0f578f1d4541ada6f9aad99f761e8c [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.342201 12515 tablet_replica.cc:333] T 31db820ce3cc45e0bb5f3560f7cc60e4 P da0f578f1d4541ada6f9aad99f761e8c: stopping tablet replica
I20260709 12:09:15.342804 12515 raft_consensus.cc:2243] T 31db820ce3cc45e0bb5f3560f7cc60e4 P da0f578f1d4541ada6f9aad99f761e8c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.343386 12515 raft_consensus.cc:2272] T 31db820ce3cc45e0bb5f3560f7cc60e4 P da0f578f1d4541ada6f9aad99f761e8c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.346678 12515 tablet_replica.cc:333] T c6d14c392db54aeca8c6ff936e6ea348 P da0f578f1d4541ada6f9aad99f761e8c: stopping tablet replica
I20260709 12:09:15.347308 12515 raft_consensus.cc:2243] T c6d14c392db54aeca8c6ff936e6ea348 P da0f578f1d4541ada6f9aad99f761e8c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.348265 12515 raft_consensus.cc:2272] T c6d14c392db54aeca8c6ff936e6ea348 P da0f578f1d4541ada6f9aad99f761e8c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.351402 12515 tablet_replica.cc:333] T 3db6a69f63d049fca47cec510aa05a89 P da0f578f1d4541ada6f9aad99f761e8c: stopping tablet replica
I20260709 12:09:15.352075 12515 raft_consensus.cc:2243] T 3db6a69f63d049fca47cec510aa05a89 P da0f578f1d4541ada6f9aad99f761e8c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.352772 12515 raft_consensus.cc:2272] T 3db6a69f63d049fca47cec510aa05a89 P da0f578f1d4541ada6f9aad99f761e8c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.355394 12515 tablet_replica.cc:333] T 0548d800f00849639c60c9fc6a0b3b44 P da0f578f1d4541ada6f9aad99f761e8c: stopping tablet replica
I20260709 12:09:15.356284 12515 raft_consensus.cc:2243] T 0548d800f00849639c60c9fc6a0b3b44 P da0f578f1d4541ada6f9aad99f761e8c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.356976 12515 raft_consensus.cc:2272] T 0548d800f00849639c60c9fc6a0b3b44 P da0f578f1d4541ada6f9aad99f761e8c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.392163 12515 tablet_server.cc:196] TabletServer@127.12.56.195:0 shutdown complete.
I20260709 12:09:15.415781 12515 master.cc:562] Master@127.12.56.254:33517 shutting down...
I20260709 12:09:15.454207 12515 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 2e15c6519d0a439f80d0167dfe9b9499 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:09:15.454974 12515 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 2e15c6519d0a439f80d0167dfe9b9499 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.455303 12515 tablet_replica.cc:333] T 00000000000000000000000000000000 P 2e15c6519d0a439f80d0167dfe9b9499: stopping tablet replica
I20260709 12:09:15.477267 12515 master.cc:584] Master@127.12.56.254:33517 shutdown complete.
1badc676cc734a90900be6af887e027a  5
2768c30a298e46b784868aea92ffdb0d  4
da0f578f1d4541ada6f9aad99f761e8c  1
1badc676cc734a90900be6af887e027a  3
2768c30a298e46b784868aea92ffdb0d  4
da0f578f1d4541ada6f9aad99f761e8c  3
1badc676cc734a90900be6af887e027a  8
2768c30a298e46b784868aea92ffdb0d  1
da0f578f1d4541ada6f9aad99f761e8c  1
1badc676cc734a90900be6af887e027a  4
2768c30a298e46b784868aea92ffdb0d  3
da0f578f1d4541ada6f9aad99f761e8c  3
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (29343 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:09:15.526955 12515 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.12.56.254:40645
I20260709 12:09:15.528107 12515 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:09:15.536247 13561 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:15.536221 13562 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:15.536212 13564 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:15.537155 12515 server_base.cc:1061] running on GCE node
I20260709 12:09:15.538328 12515 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:09:15.538514 12515 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:15.538632 12515 hybrid_clock.cc:648] HybridClock initialized: now 1783598955538621 us; error 0 us; skew 500 ppm
I20260709 12:09:15.539135 12515 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:15.541988 12515 webserver.cc:533] Webserver started at http://127.12.56.254:39623/ using document root <none> and password file <none>
I20260709 12:09:15.542584 12515 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:15.542755 12515 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:15.542980 12515 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:15.544273 12515 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894707649-12515-0/minicluster-data/master-0-root/instance:
uuid: "17d79eae88f84be7a847d0cf544674cd"
format_stamp: "Formatted at 2026-07-09 12:09:15 on dist-test-slave-705g"
I20260709 12:09:15.549273 12515 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 12:09:15.554169 13569 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:15.555238 12515 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.003s
I20260709 12:09:15.555596 12515 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894707649-12515-0/minicluster-data/master-0-root
uuid: "17d79eae88f84be7a847d0cf544674cd"
format_stamp: "Formatted at 2026-07-09 12:09:15 on dist-test-slave-705g"
I20260709 12:09:15.556005 12515 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894707649-12515-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894707649-12515-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894707649-12515-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:15.567412 12515 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:15.568843 12515 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:15.621209 12515 rpc_server.cc:307] RPC server started. Bound to: 127.12.56.254:40645
I20260709 12:09:15.621280 13620 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.56.254:40645 every 8 connection(s)
I20260709 12:09:15.627852 13621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.644073 13621 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 17d79eae88f84be7a847d0cf544674cd: Bootstrap starting.
I20260709 12:09:15.652184 13621 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 17d79eae88f84be7a847d0cf544674cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.658958 13621 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 17d79eae88f84be7a847d0cf544674cd: No bootstrap required, opened a new log
I20260709 12:09:15.662642 13621 raft_consensus.cc:359] T 00000000000000000000000000000000 P 17d79eae88f84be7a847d0cf544674cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17d79eae88f84be7a847d0cf544674cd" member_type: VOTER }
I20260709 12:09:15.663341 13621 raft_consensus.cc:385] T 00000000000000000000000000000000 P 17d79eae88f84be7a847d0cf544674cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.663724 13621 raft_consensus.cc:740] T 00000000000000000000000000000000 P 17d79eae88f84be7a847d0cf544674cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17d79eae88f84be7a847d0cf544674cd, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.664597 13621 consensus_queue.cc:260] T 00000000000000000000000000000000 P 17d79eae88f84be7a847d0cf544674cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17d79eae88f84be7a847d0cf544674cd" member_type: VOTER }
I20260709 12:09:15.665376 13621 raft_consensus.cc:399] T 00000000000000000000000000000000 P 17d79eae88f84be7a847d0cf544674cd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:09:15.665751 13621 raft_consensus.cc:493] T 00000000000000000000000000000000 P 17d79eae88f84be7a847d0cf544674cd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:09:15.666190 13621 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 17d79eae88f84be7a847d0cf544674cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:15.671326 13621 raft_consensus.cc:515] T 00000000000000000000000000000000 P 17d79eae88f84be7a847d0cf544674cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17d79eae88f84be7a847d0cf544674cd" member_type: VOTER }
I20260709 12:09:15.671900 13621 leader_election.cc:304] T 00000000000000000000000000000000 P 17d79eae88f84be7a847d0cf544674cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 17d79eae88f84be7a847d0cf544674cd; no voters: 
I20260709 12:09:15.673074 13621 leader_election.cc:290] T 00000000000000000000000000000000 P 17d79eae88f84be7a847d0cf544674cd [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:09:15.673434 13624 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 17d79eae88f84be7a847d0cf544674cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:15.674993 13624 raft_consensus.cc:697] T 00000000000000000000000000000000 P 17d79eae88f84be7a847d0cf544674cd [term 1 LEADER]: Becoming Leader. State: Replica: 17d79eae88f84be7a847d0cf544674cd, State: Running, Role: LEADER
I20260709 12:09:15.675763 13624 consensus_queue.cc:237] T 00000000000000000000000000000000 P 17d79eae88f84be7a847d0cf544674cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17d79eae88f84be7a847d0cf544674cd" member_type: VOTER }
I20260709 12:09:15.676537 13621 sys_catalog.cc:565] T 00000000000000000000000000000000 P 17d79eae88f84be7a847d0cf544674cd [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:09:15.682294 13625 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17d79eae88f84be7a847d0cf544674cd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "17d79eae88f84be7a847d0cf544674cd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17d79eae88f84be7a847d0cf544674cd" member_type: VOTER } }
I20260709 12:09:15.682476 13626 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17d79eae88f84be7a847d0cf544674cd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 17d79eae88f84be7a847d0cf544674cd. Latest consensus state: current_term: 1 leader_uuid: "17d79eae88f84be7a847d0cf544674cd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17d79eae88f84be7a847d0cf544674cd" member_type: VOTER } }
I20260709 12:09:15.683058 13625 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17d79eae88f84be7a847d0cf544674cd [sys.catalog]: This master's current role is: LEADER
I20260709 12:09:15.683072 13626 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17d79eae88f84be7a847d0cf544674cd [sys.catalog]: This master's current role is: LEADER
I20260709 12:09:15.685400 13631 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:09:15.692329 13631 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:09:15.695117 12515 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:09:15.703096 13631 catalog_manager.cc:1383] Generated new cluster ID: f5871385f0204989bd9a9a9541a2da0c
I20260709 12:09:15.703454 13631 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:09:15.725446 13631 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:09:15.727080 13631 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:09:15.746838 13631 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 17d79eae88f84be7a847d0cf544674cd: Generated new TSK 0
I20260709 12:09:15.747540 13631 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:09:15.761899 12515 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:09:15.769582 13642 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:15.770582 13643 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:15.773241 13645 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:15.774287 12515 server_base.cc:1061] running on GCE node
I20260709 12:09:15.775414 12515 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:09:15.775626 12515 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:15.775869 12515 hybrid_clock.cc:648] HybridClock initialized: now 1783598955775847 us; error 0 us; skew 500 ppm
I20260709 12:09:15.776500 12515 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:15.779780 12515 webserver.cc:533] Webserver started at http://127.12.56.193:33015/ using document root <none> and password file <none>
I20260709 12:09:15.780362 12515 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:15.780582 12515 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:15.780936 12515 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:15.782332 12515 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894707649-12515-0/minicluster-data/ts-0-root/instance:
uuid: "b98d2519bb504dc6905ed2ede4571835"
format_stamp: "Formatted at 2026-07-09 12:09:15 on dist-test-slave-705g"
I20260709 12:09:15.787765 12515 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:09:15.791985 13650 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:15.792927 12515 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:09:15.793284 12515 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894707649-12515-0/minicluster-data/ts-0-root
uuid: "b98d2519bb504dc6905ed2ede4571835"
format_stamp: "Formatted at 2026-07-09 12:09:15 on dist-test-slave-705g"
I20260709 12:09:15.793556 12515 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894707649-12515-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894707649-12515-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894707649-12515-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:15.817516 12515 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:15.818822 12515 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:15.820333 12515 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:09:15.823587 12515 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:09:15.823846 12515 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:15.824167 12515 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:09:15.824344 12515 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:15.878449 12515 rpc_server.cc:307] RPC server started. Bound to: 127.12.56.193:33199
I20260709 12:09:15.878611 13712 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.56.193:33199 every 8 connection(s)
I20260709 12:09:15.883611 12515 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:09:15.892235 13717 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:15.899385 13718 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:15.905052 13720 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:15.906229 13713 heartbeater.cc:344] Connected to a master server at 127.12.56.254:40645
I20260709 12:09:15.906847 13713 heartbeater.cc:461] Registering TS with master...
I20260709 12:09:15.907002 12515 server_base.cc:1061] running on GCE node
I20260709 12:09:15.907888 13713 heartbeater.cc:507] Master 127.12.56.254:40645 requested a full tablet report, sending...
I20260709 12:09:15.909062 12515 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:09:15.909377 12515 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:15.909811 12515 hybrid_clock.cc:648] HybridClock initialized: now 1783598955909728 us; error 0 us; skew 500 ppm
I20260709 12:09:15.910506 12515 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:15.910799 13586 ts_manager.cc:194] Registered new tserver with Master: b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199)
I20260709 12:09:15.912910 13586 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45610
I20260709 12:09:15.913475 12515 webserver.cc:533] Webserver started at http://127.12.56.194:40641/ using document root <none> and password file <none>
I20260709 12:09:15.914214 12515 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:15.914494 12515 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:15.914892 12515 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:15.916496 12515 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894707649-12515-0/minicluster-data/ts-1-root/instance:
uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
format_stamp: "Formatted at 2026-07-09 12:09:15 on dist-test-slave-705g"
I20260709 12:09:15.922219 12515 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:09:15.926227 13725 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:15.927229 12515 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:09:15.927656 12515 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894707649-12515-0/minicluster-data/ts-1-root
uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
format_stamp: "Formatted at 2026-07-09 12:09:15 on dist-test-slave-705g"
I20260709 12:09:15.927939 12515 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894707649-12515-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894707649-12515-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894707649-12515-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:15.960278 12515 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:15.961575 12515 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:15.963217 12515 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:09:15.965823 12515 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:09:15.966091 12515 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:15.966351 12515 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:09:15.966547 12515 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:16.017725 12515 rpc_server.cc:307] RPC server started. Bound to: 127.12.56.194:39545
I20260709 12:09:16.017951 13787 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.56.194:39545 every 8 connection(s)
I20260709 12:09:16.022687 12515 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:09:16.031599 13792 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:16.032605 13791 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:16.033317 13794 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:16.034176 12515 server_base.cc:1061] running on GCE node
I20260709 12:09:16.035111 12515 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:09:16.035300 12515 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:16.035548 12515 hybrid_clock.cc:648] HybridClock initialized: now 1783598956035528 us; error 0 us; skew 500 ppm
I20260709 12:09:16.036090 12515 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:16.036257 13788 heartbeater.cc:344] Connected to a master server at 127.12.56.254:40645
I20260709 12:09:16.036666 13788 heartbeater.cc:461] Registering TS with master...
I20260709 12:09:16.037739 13788 heartbeater.cc:507] Master 127.12.56.254:40645 requested a full tablet report, sending...
I20260709 12:09:16.038957 12515 webserver.cc:533] Webserver started at http://127.12.56.195:33251/ using document root <none> and password file <none>
I20260709 12:09:16.039476 12515 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:16.039695 12515 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:16.040081 12515 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:16.040534 13586 ts_manager.cc:194] Registered new tserver with Master: 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:16.041388 12515 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894707649-12515-0/minicluster-data/ts-2-root/instance:
uuid: "96701a74fdee481fb5f54aac841e17dd"
format_stamp: "Formatted at 2026-07-09 12:09:16 on dist-test-slave-705g"
I20260709 12:09:16.042184 13586 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45618
I20260709 12:09:16.047140 12515 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.000s	sys 0.004s
I20260709 12:09:16.051388 13799 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:16.052506 12515 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 12:09:16.052815 12515 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894707649-12515-0/minicluster-data/ts-2-root
uuid: "96701a74fdee481fb5f54aac841e17dd"
format_stamp: "Formatted at 2026-07-09 12:09:16 on dist-test-slave-705g"
I20260709 12:09:16.053208 12515 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894707649-12515-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894707649-12515-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894707649-12515-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:16.070981 12515 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:16.072414 12515 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:16.074358 12515 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:09:16.077023 12515 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:09:16.077311 12515 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:16.077620 12515 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:09:16.077886 12515 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:09:16.127759 12515 rpc_server.cc:307] RPC server started. Bound to: 127.12.56.195:36603
I20260709 12:09:16.128255 13861 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.56.195:36603 every 8 connection(s)
I20260709 12:09:16.146522 13862 heartbeater.cc:344] Connected to a master server at 127.12.56.254:40645
I20260709 12:09:16.146912 13862 heartbeater.cc:461] Registering TS with master...
I20260709 12:09:16.147765 13862 heartbeater.cc:507] Master 127.12.56.254:40645 requested a full tablet report, sending...
I20260709 12:09:16.150241 13586 ts_manager.cc:194] Registered new tserver with Master: 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:16.151363 12515 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.019778324s
I20260709 12:09:16.151880 13586 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45620
I20260709 12:09:16.188329 13586 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45634:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:09:16.194689 13586 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:09:16.422742 13753 tablet_service.cc:1511] Processing CreateTablet for tablet e229ea1f19c74be5884179acde106305 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:09:16.423120 13752 tablet_service.cc:1511] Processing CreateTablet for tablet c8195765ed074b74be387475c214120b (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:09:16.425588 13753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e229ea1f19c74be5884179acde106305. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.425856 13751 tablet_service.cc:1511] Processing CreateTablet for tablet 232d133451004a83941860574adec712 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:09:16.430655 13827 tablet_service.cc:1511] Processing CreateTablet for tablet e229ea1f19c74be5884179acde106305 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:09:16.432381 13827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e229ea1f19c74be5884179acde106305. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.435258 13825 tablet_service.cc:1511] Processing CreateTablet for tablet 232d133451004a83941860574adec712 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:09:16.437271 13825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 232d133451004a83941860574adec712. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.439049 13824 tablet_service.cc:1511] Processing CreateTablet for tablet 2e7fcff4988b4d928d7bb79c969a2025 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:09:16.441702 13678 tablet_service.cc:1511] Processing CreateTablet for tablet e229ea1f19c74be5884179acde106305 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:09:16.443493 13678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e229ea1f19c74be5884179acde106305. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.445281 13826 tablet_service.cc:1511] Processing CreateTablet for tablet c8195765ed074b74be387475c214120b (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:09:16.457404 13750 tablet_service.cc:1511] Processing CreateTablet for tablet 2e7fcff4988b4d928d7bb79c969a2025 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:09:16.459766 13749 tablet_service.cc:1511] Processing CreateTablet for tablet e8e96840ffec4e38a0f975263031c226 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:09:16.460919 13751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 232d133451004a83941860574adec712. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.463267 13822 tablet_service.cc:1511] Processing CreateTablet for tablet 566e3cc2115c4b6dbd3070c4f4f4f11b (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:09:16.445822 13671 tablet_service.cc:1511] Processing CreateTablet for tablet b2210d5649f048c68ae57986b065cb28 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:09:16.465909 13821 tablet_service.cc:1511] Processing CreateTablet for tablet 0e3f87a61fef4f1ca0b961e7c64d63f8 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:09:16.466848 13671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2210d5649f048c68ae57986b065cb28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.447299 13676 tablet_service.cc:1511] Processing CreateTablet for tablet 232d133451004a83941860574adec712 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:09:16.448833 13677 tablet_service.cc:1511] Processing CreateTablet for tablet c8195765ed074b74be387475c214120b (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:09:16.449378 13673 tablet_service.cc:1511] Processing CreateTablet for tablet 566e3cc2115c4b6dbd3070c4f4f4f11b (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:09:16.459766 13820 tablet_service.cc:1511] Processing CreateTablet for tablet b2210d5649f048c68ae57986b065cb28 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:09:16.451649 13674 tablet_service.cc:1511] Processing CreateTablet for tablet e8e96840ffec4e38a0f975263031c226 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:09:16.453457 13670 tablet_service.cc:1511] Processing CreateTablet for tablet d43dfb2e8dc04299ad696b99238cf41a (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:09:16.470999 13676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 232d133451004a83941860574adec712. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.453713 13675 tablet_service.cc:1511] Processing CreateTablet for tablet 2e7fcff4988b4d928d7bb79c969a2025 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:09:16.443200 13672 tablet_service.cc:1511] Processing CreateTablet for tablet 0e3f87a61fef4f1ca0b961e7c64d63f8 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:09:16.472307 13673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 566e3cc2115c4b6dbd3070c4f4f4f11b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.476924 13669 tablet_service.cc:1511] Processing CreateTablet for tablet dabf40829555486da9d6b588472147ec (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:09:16.469164 13823 tablet_service.cc:1511] Processing CreateTablet for tablet e8e96840ffec4e38a0f975263031c226 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:09:16.478216 13824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e7fcff4988b4d928d7bb79c969a2025. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.480391 13826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8195765ed074b74be387475c214120b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.478360 13670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d43dfb2e8dc04299ad696b99238cf41a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.482127 13820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2210d5649f048c68ae57986b065cb28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.482649 13677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8195765ed074b74be387475c214120b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.484103 13821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e3f87a61fef4f1ca0b961e7c64d63f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.484541 13674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8e96840ffec4e38a0f975263031c226. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.486160 13672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e3f87a61fef4f1ca0b961e7c64d63f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.486852 13822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 566e3cc2115c4b6dbd3070c4f4f4f11b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.487991 13669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dabf40829555486da9d6b588472147ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.488758 13823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8e96840ffec4e38a0f975263031c226. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.480963 13749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8e96840ffec4e38a0f975263031c226. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.491878 13752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8195765ed074b74be387475c214120b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.495630 13748 tablet_service.cc:1511] Processing CreateTablet for tablet 566e3cc2115c4b6dbd3070c4f4f4f11b (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:09:16.498562 13750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e7fcff4988b4d928d7bb79c969a2025. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.500515 13748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 566e3cc2115c4b6dbd3070c4f4f4f11b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.507404 13675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e7fcff4988b4d928d7bb79c969a2025. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.511190 13819 tablet_service.cc:1511] Processing CreateTablet for tablet d43dfb2e8dc04299ad696b99238cf41a (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:09:16.513347 13819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d43dfb2e8dc04299ad696b99238cf41a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.516088 13818 tablet_service.cc:1511] Processing CreateTablet for tablet dabf40829555486da9d6b588472147ec (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:09:16.519281 13818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dabf40829555486da9d6b588472147ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.521649 13747 tablet_service.cc:1511] Processing CreateTablet for tablet 0e3f87a61fef4f1ca0b961e7c64d63f8 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:09:16.523686 13747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e3f87a61fef4f1ca0b961e7c64d63f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.524257 13745 tablet_service.cc:1511] Processing CreateTablet for tablet d43dfb2e8dc04299ad696b99238cf41a (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:09:16.527179 13744 tablet_service.cc:1511] Processing CreateTablet for tablet dabf40829555486da9d6b588472147ec (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:09:16.521911 13746 tablet_service.cc:1511] Processing CreateTablet for tablet b2210d5649f048c68ae57986b065cb28 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:09:16.529364 13745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d43dfb2e8dc04299ad696b99238cf41a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.534552 13744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dabf40829555486da9d6b588472147ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.536473 13746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2210d5649f048c68ae57986b065cb28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.559845 13678 tablet_service.cc:1511] Processing CreateTablet for tablet 3f29dda715314a93a03981264972c4c3 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:09:16.561304 13678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f29dda715314a93a03981264972c4c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.567818 13671 tablet_service.cc:1511] Processing CreateTablet for tablet e5274c30729744338992e7c7710e5266 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:09:16.570478 13671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5274c30729744338992e7c7710e5266. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.583197 13753 tablet_service.cc:1511] Processing CreateTablet for tablet 3f29dda715314a93a03981264972c4c3 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:09:16.585006 13753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f29dda715314a93a03981264972c4c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.594612 13876 tablet_bootstrap.cc:492] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7: Bootstrap starting.
I20260709 12:09:16.594614 13877 tablet_bootstrap.cc:492] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835: Bootstrap starting.
I20260709 12:09:16.613516 13877 tablet_bootstrap.cc:654] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.619014 13669 tablet_service.cc:1511] Processing CreateTablet for tablet d2f365337b324999a073edacbe6c6e09 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:09:16.641554 13878 tablet_bootstrap.cc:492] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd: Bootstrap starting.
I20260709 12:09:16.642241 13747 tablet_service.cc:1511] Processing CreateTablet for tablet e5274c30729744338992e7c7710e5266 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:09:16.652830 13876 tablet_bootstrap.cc:654] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.649300 13820 tablet_service.cc:1511] Processing CreateTablet for tablet e5274c30729744338992e7c7710e5266 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:09:16.655102 13820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5274c30729744338992e7c7710e5266. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.658030 13747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5274c30729744338992e7c7710e5266. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.627966 13818 tablet_service.cc:1511] Processing CreateTablet for tablet 3f29dda715314a93a03981264972c4c3 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:09:16.662655 13818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f29dda715314a93a03981264972c4c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.662355 13751 tablet_service.cc:1511] Processing CreateTablet for tablet d2f365337b324999a073edacbe6c6e09 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:09:16.671109 13751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2f365337b324999a073edacbe6c6e09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.673761 13826 tablet_service.cc:1511] Processing CreateTablet for tablet d2f365337b324999a073edacbe6c6e09 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:09:16.681457 13826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2f365337b324999a073edacbe6c6e09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.684690 13674 tablet_service.cc:1511] Processing CreateTablet for tablet 637cf9d05e2348118404a474b84d67d7 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
W20260709 12:09:16.690035 13634 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:16.690696 13878 tablet_bootstrap.cc:654] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.691893 13821 tablet_service.cc:1511] Processing CreateTablet for tablet 637cf9d05e2348118404a474b84d67d7 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:09:16.693441 13821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 637cf9d05e2348118404a474b84d67d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.699795 13750 tablet_service.cc:1511] Processing CreateTablet for tablet 637cf9d05e2348118404a474b84d67d7 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:09:16.706934 13744 tablet_service.cc:1511] Processing CreateTablet for tablet d9c029efbe5e410cb15f323fd19bf316 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:09:16.707638 13672 tablet_service.cc:1511] Processing CreateTablet for tablet 15347ea1eb2348e7b262bd0d59ce6f3a (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:09:16.711331 13674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 637cf9d05e2348118404a474b84d67d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.744709 13876 tablet_bootstrap.cc:492] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7: No bootstrap required, opened a new log
I20260709 12:09:16.747462 13671 tablet_service.cc:1511] Processing CreateTablet for tablet d9c029efbe5e410cb15f323fd19bf316 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:09:16.731364 13825 tablet_service.cc:1511] Processing CreateTablet for tablet d9c029efbe5e410cb15f323fd19bf316 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:09:16.737699 13678 tablet_service.cc:1511] Processing CreateTablet for tablet dca45e62639f49b4a8367d6868dabc07 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:09:16.753883 13825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9c029efbe5e410cb15f323fd19bf316. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.754336 13669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2f365337b324999a073edacbe6c6e09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.755482 13678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dca45e62639f49b4a8367d6868dabc07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.761716 13672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15347ea1eb2348e7b262bd0d59ce6f3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.769645 13877 tablet_bootstrap.cc:492] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835: No bootstrap required, opened a new log
I20260709 12:09:16.770198 13877 ts_tablet_manager.cc:1403] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835: Time spent bootstrapping tablet: real 0.176s	user 0.025s	sys 0.019s
I20260709 12:09:16.771373 13878 tablet_bootstrap.cc:492] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd: No bootstrap required, opened a new log
I20260709 12:09:16.771946 13878 ts_tablet_manager.cc:1403] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd: Time spent bootstrapping tablet: real 0.131s	user 0.018s	sys 0.016s
I20260709 12:09:16.772809 13671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9c029efbe5e410cb15f323fd19bf316. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.771291 13824 tablet_service.cc:1511] Processing CreateTablet for tablet dca45e62639f49b4a8367d6868dabc07 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:09:16.773257 13877 raft_consensus.cc:359] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } }
I20260709 12:09:16.778501 13877 raft_consensus.cc:385] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.778859 13877 raft_consensus.cc:740] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.780318 13824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dca45e62639f49b4a8367d6868dabc07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.777437 13676 tablet_service.cc:1511] Processing CreateTablet for tablet 14d7a26ca33940fbba5fa30c5212e5ac (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:09:16.756373 13876 ts_tablet_manager.cc:1403] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent bootstrapping tablet: real 0.162s	user 0.008s	sys 0.017s
I20260709 12:09:16.785794 13676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14d7a26ca33940fbba5fa30c5212e5ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.786214 13747 tablet_service.cc:1511] Processing CreateTablet for tablet dca45e62639f49b4a8367d6868dabc07 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:09:16.779794 13877 consensus_queue.cc:260] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } }
I20260709 12:09:16.774796 13878 raft_consensus.cc:359] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:16.782040 13744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9c029efbe5e410cb15f323fd19bf316. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.783181 13749 tablet_service.cc:1511] Processing CreateTablet for tablet 15347ea1eb2348e7b262bd0d59ce6f3a (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:09:16.791889 13747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dca45e62639f49b4a8367d6868dabc07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.792800 13749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15347ea1eb2348e7b262bd0d59ce6f3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.789964 13878 raft_consensus.cc:385] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.801589 13878 raft_consensus.cc:740] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.802448 13878 consensus_queue.cc:260] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:16.789055 13876 raft_consensus.cc:359] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } }
I20260709 12:09:16.803979 13876 raft_consensus.cc:385] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.804327 13876 raft_consensus.cc:740] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.806571 13826 tablet_service.cc:1511] Processing CreateTablet for tablet 15347ea1eb2348e7b262bd0d59ce6f3a (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:09:16.808657 13826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15347ea1eb2348e7b262bd0d59ce6f3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.819471 13876 consensus_queue.cc:260] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } }
I20260709 12:09:16.822767 13823 tablet_service.cc:1511] Processing CreateTablet for tablet 14d7a26ca33940fbba5fa30c5212e5ac (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:09:16.824693 13823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14d7a26ca33940fbba5fa30c5212e5ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.826571 13750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 637cf9d05e2348118404a474b84d67d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.839257 13746 tablet_service.cc:1511] Processing CreateTablet for tablet 14d7a26ca33940fbba5fa30c5212e5ac (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:09:16.840204 13713 heartbeater.cc:499] Master 127.12.56.254:40645 was elected leader, sending a full tablet report...
I20260709 12:09:16.840895 13746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14d7a26ca33940fbba5fa30c5212e5ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.841764 13877 ts_tablet_manager.cc:1434] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835: Time spent starting tablet: real 0.071s	user 0.009s	sys 0.000s
I20260709 12:09:16.843159 13877 tablet_bootstrap.cc:492] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835: Bootstrap starting.
I20260709 12:09:16.859122 13862 heartbeater.cc:499] Master 127.12.56.254:40645 was elected leader, sending a full tablet report...
I20260709 12:09:16.859184 13673 tablet_service.cc:1511] Processing CreateTablet for tablet a3c0f10b06fa4aa48a99239da6d81a1f (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:09:16.860033 13878 ts_tablet_manager.cc:1434] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd: Time spent starting tablet: real 0.088s	user 0.020s	sys 0.024s
I20260709 12:09:16.860842 13673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3c0f10b06fa4aa48a99239da6d81a1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.861521 13878 tablet_bootstrap.cc:492] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd: Bootstrap starting.
I20260709 12:09:16.868482 13878 tablet_bootstrap.cc:654] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.870982 13748 tablet_service.cc:1511] Processing CreateTablet for tablet a3c0f10b06fa4aa48a99239da6d81a1f (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:09:16.872825 13748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3c0f10b06fa4aa48a99239da6d81a1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.873284 13788 heartbeater.cc:499] Master 127.12.56.254:40645 was elected leader, sending a full tablet report...
I20260709 12:09:16.874051 13876 ts_tablet_manager.cc:1434] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent starting tablet: real 0.088s	user 0.014s	sys 0.010s
I20260709 12:09:16.875240 13876 tablet_bootstrap.cc:492] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7: Bootstrap starting.
I20260709 12:09:16.907764 13877 tablet_bootstrap.cc:654] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.916033 13878 tablet_bootstrap.cc:492] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd: No bootstrap required, opened a new log
I20260709 12:09:16.922082 13878 ts_tablet_manager.cc:1403] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd: Time spent bootstrapping tablet: real 0.061s	user 0.009s	sys 0.015s
I20260709 12:09:16.926282 13878 raft_consensus.cc:359] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:16.927242 13878 raft_consensus.cc:385] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.927670 13878 raft_consensus.cc:740] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.928875 13878 consensus_queue.cc:260] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:16.931993 13878 ts_tablet_manager.cc:1434] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 12:09:16.933215 13878 tablet_bootstrap.cc:492] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd: Bootstrap starting.
I20260709 12:09:16.935168 13876 tablet_bootstrap.cc:654] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.956009 13819 tablet_service.cc:1511] Processing CreateTablet for tablet a3c0f10b06fa4aa48a99239da6d81a1f (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:09:16.960182 13884 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:16.961402 13884 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } }
I20260709 12:09:16.968825 13745 tablet_service.cc:1511] Processing CreateTablet for tablet 58c7d3b9588c414ba528311a1818a44b (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:09:16.983484 13821 tablet_service.cc:1511] Processing CreateTablet for tablet c89d2a3019c74941a4f8dffc9aa5cf40 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:09:16.986754 13818 tablet_service.cc:1511] Processing CreateTablet for tablet 407aabb01908409185c74e2349da4c3d (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:09:16.995434 13745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58c7d3b9588c414ba528311a1818a44b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.995574 13882 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:16.996276 13819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3c0f10b06fa4aa48a99239da6d81a1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.996405 13672 tablet_service.cc:1511] Processing CreateTablet for tablet 58c7d3b9588c414ba528311a1818a44b (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:09:17.020094 13744 tablet_service.cc:1511] Processing CreateTablet for tablet 407aabb01908409185c74e2349da4c3d (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:09:17.020633 13748 tablet_service.cc:1511] Processing CreateTablet for tablet c89d2a3019c74941a4f8dffc9aa5cf40 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:09:17.009581 13882 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } }
I20260709 12:09:17.022907 13823 tablet_service.cc:1511] Processing CreateTablet for tablet a34b21ec197b4241a780a8ae562e4602 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:09:17.025352 13748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c89d2a3019c74941a4f8dffc9aa5cf40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.991518 13884 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199)
I20260709 12:09:17.027240 13824 tablet_service.cc:1511] Processing CreateTablet for tablet 58c7d3b9588c414ba528311a1818a44b (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:09:17.042886 13672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58c7d3b9588c414ba528311a1818a44b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.043751 13825 tablet_service.cc:1511] Processing CreateTablet for tablet cad007c01ddb46db81e7206ec8b58024 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:09:17.043812 13676 tablet_service.cc:1511] Processing CreateTablet for tablet c89d2a3019c74941a4f8dffc9aa5cf40 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:09:17.046124 13876 tablet_bootstrap.cc:492] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7: No bootstrap required, opened a new log
I20260709 12:09:17.046815 13876 ts_tablet_manager.cc:1403] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent bootstrapping tablet: real 0.172s	user 0.044s	sys 0.028s
I20260709 12:09:17.047303 13818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 407aabb01908409185c74e2349da4c3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.046171 13676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c89d2a3019c74941a4f8dffc9aa5cf40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.050635 13744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 407aabb01908409185c74e2349da4c3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.052624 13878 tablet_bootstrap.cc:654] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.034046 13882 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:17.055914 13823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a34b21ec197b4241a780a8ae562e4602. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.058590 13821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c89d2a3019c74941a4f8dffc9aa5cf40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.059355 13825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cad007c01ddb46db81e7206ec8b58024. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.059201 13669 tablet_service.cc:1511] Processing CreateTablet for tablet a34b21ec197b4241a780a8ae562e4602 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:09:17.059504 13674 tablet_service.cc:1511] Processing CreateTablet for tablet cad007c01ddb46db81e7206ec8b58024 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:09:17.060783 13669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a34b21ec197b4241a780a8ae562e4602. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.062809 13824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58c7d3b9588c414ba528311a1818a44b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.064239 13674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cad007c01ddb46db81e7206ec8b58024. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.065459 13673 tablet_service.cc:1511] Processing CreateTablet for tablet 407aabb01908409185c74e2349da4c3d (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:09:17.066929 13673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 407aabb01908409185c74e2349da4c3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.078696 13876 raft_consensus.cc:359] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:17.079895 13876 raft_consensus.cc:385] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.080377 13876 raft_consensus.cc:740] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.087474 13822 tablet_service.cc:1511] Processing CreateTablet for tablet 658b56fb08f0467fa5a9d602dd275f81 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:09:17.089318 13822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 658b56fb08f0467fa5a9d602dd275f81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.092803 13877 tablet_bootstrap.cc:492] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835: No bootstrap required, opened a new log
I20260709 12:09:17.093410 13877 ts_tablet_manager.cc:1403] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835: Time spent bootstrapping tablet: real 0.251s	user 0.015s	sys 0.008s
I20260709 12:09:17.115787 13678 tablet_service.cc:1511] Processing CreateTablet for tablet 658b56fb08f0467fa5a9d602dd275f81 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:09:17.117587 13678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 658b56fb08f0467fa5a9d602dd275f81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.122714 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:17.123580 13688 raft_consensus.cc:2468] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 0.
I20260709 12:09:17.125200 13726 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:09:17.126264 13884 raft_consensus.cc:2804] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:17.126654 13884 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:17.126994 13884 raft_consensus.cc:3060] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.106123 13876 consensus_queue.cc:260] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:17.144102 13883 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.144719 13883 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:17.159938 13883 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:17.169064 13748 tablet_service.cc:1511] Processing CreateTablet for tablet a34b21ec197b4241a780a8ae562e4602 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:09:17.170567 13748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a34b21ec197b4241a780a8ae562e4602. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.175017 13746 tablet_service.cc:1511] Processing CreateTablet for tablet cad007c01ddb46db81e7206ec8b58024 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:09:17.177073 13746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cad007c01ddb46db81e7206ec8b58024. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.179500 13876 ts_tablet_manager.cc:1434] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent starting tablet: real 0.132s	user 0.014s	sys 0.017s
I20260709 12:09:17.180716 13876 tablet_bootstrap.cc:492] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7: Bootstrap starting.
I20260709 12:09:17.181308 13750 tablet_service.cc:1511] Processing CreateTablet for tablet 658b56fb08f0467fa5a9d602dd275f81 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:09:17.150904 13884 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } }
I20260709 12:09:17.183871 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:17.186887 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:09:17.187590 13688 raft_consensus.cc:3060] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.192420 13750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 658b56fb08f0467fa5a9d602dd275f81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.199252 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:09:17.176898 13877 raft_consensus.cc:359] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:17.188386 13884 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199)
I20260709 12:09:17.202872 13877 raft_consensus.cc:385] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.210682 13877 raft_consensus.cc:740] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.214880 13671 tablet_service.cc:1511] Processing CreateTablet for tablet 2614cf111d8b41fca205e6eff5934612 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:09:17.216276 13671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2614cf111d8b41fca205e6eff5934612. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.230726 13821 tablet_service.cc:1511] Processing CreateTablet for tablet 2614cf111d8b41fca205e6eff5934612 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:09:17.232822 13821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2614cf111d8b41fca205e6eff5934612. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:09:17.206189 13727 leader_election.cc:343] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.244596 13876 tablet_bootstrap.cc:654] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.245005 13877 consensus_queue.cc:260] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:17.250646 13688 raft_consensus.cc:2468] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 1.
W20260709 12:09:17.253675 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 48185.4us
I20260709 12:09:17.259229 13674 tablet_service.cc:1511] Processing CreateTablet for tablet c97f901403f34a8ca78bfeb8472bfa6e (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
W20260709 12:09:17.260521 13727 leader_election.cc:343] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.260805 13674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c97f901403f34a8ca78bfeb8472bfa6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.262300 13749 tablet_service.cc:1511] Processing CreateTablet for tablet 2614cf111d8b41fca205e6eff5934612 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:09:17.263902 13749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2614cf111d8b41fca205e6eff5934612. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.266913 13751 tablet_service.cc:1511] Processing CreateTablet for tablet c97f901403f34a8ca78bfeb8472bfa6e (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:09:17.268322 13751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c97f901403f34a8ca78bfeb8472bfa6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.270094 13670 tablet_service.cc:1511] Processing CreateTablet for tablet f1bace76cb204a6d92c38685645dd9db (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:09:17.273631 13670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1bace76cb204a6d92c38685645dd9db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.275836 13883 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.276386 13883 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:17.257692 13878 tablet_bootstrap.cc:492] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd: No bootstrap required, opened a new log
I20260709 12:09:17.278223 13878 ts_tablet_manager.cc:1403] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd: Time spent bootstrapping tablet: real 0.345s	user 0.017s	sys 0.013s
I20260709 12:09:17.278826 13883 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:17.290817 13726 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:09:17.292135 13744 tablet_service.cc:1511] Processing CreateTablet for tablet f1bace76cb204a6d92c38685645dd9db (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:09:17.293834 13744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1bace76cb204a6d92c38685645dd9db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.296315 13822 tablet_service.cc:1511] Processing CreateTablet for tablet c97f901403f34a8ca78bfeb8472bfa6e (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:09:17.292634 13884 raft_consensus.cc:2804] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:17.297849 13822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c97f901403f34a8ca78bfeb8472bfa6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.298285 13884 raft_consensus.cc:697] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:09:17.299516 13884 consensus_queue.cc:237] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } }
I20260709 12:09:17.301147 13877 ts_tablet_manager.cc:1434] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835: Time spent starting tablet: real 0.198s	user 0.007s	sys 0.002s
I20260709 12:09:17.306734 13877 tablet_bootstrap.cc:492] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835: Bootstrap starting.
I20260709 12:09:17.315459 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:17.312047 13825 tablet_service.cc:1511] Processing CreateTablet for tablet f1bace76cb204a6d92c38685645dd9db (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:09:17.317454 13825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1bace76cb204a6d92c38685645dd9db. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:09:17.317682 13652 leader_election.cc:343] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.333935 13878 raft_consensus.cc:359] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:17.334887 13878 raft_consensus.cc:385] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.335412 13878 raft_consensus.cc:740] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.336467 13878 consensus_queue.cc:260] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:17.338581 13745 tablet_service.cc:1511] Processing CreateTablet for tablet 66aa0310b814479591b9f665634674f1 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:09:17.339219 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:17.341091 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:17.353196 13745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66aa0310b814479591b9f665634674f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.353358 13687 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 0.
I20260709 12:09:17.343071 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:17.358240 13878 ts_tablet_manager.cc:1434] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd: Time spent starting tablet: real 0.080s	user 0.009s	sys 0.000s
I20260709 12:09:17.349653 13672 tablet_service.cc:1511] Processing CreateTablet for tablet 277b655b7311432a95ed2ad291df0b8d (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:09:17.350643 13669 tablet_service.cc:1511] Processing CreateTablet for tablet 66aa0310b814479591b9f665634674f1 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:09:17.359586 13669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66aa0310b814479591b9f665634674f1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:09:17.359911 13800 leader_election.cc:343] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.360726 13800 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:09:17.344835 13819 tablet_service.cc:1511] Processing CreateTablet for tablet 66aa0310b814479591b9f665634674f1 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:09:17.363082 13883 raft_consensus.cc:2804] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:17.363845 13883 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:17.364488 13819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66aa0310b814479591b9f665634674f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.364962 13651 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:09:17.366358 13882 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:17.367915 13823 tablet_service.cc:1511] Processing CreateTablet for tablet 277b655b7311432a95ed2ad291df0b8d (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:09:17.370132 13823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 277b655b7311432a95ed2ad291df0b8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.364269 13883 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.329610 13877 tablet_bootstrap.cc:654] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.377750 13672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 277b655b7311432a95ed2ad291df0b8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.378932 13748 tablet_service.cc:1511] Processing CreateTablet for tablet 277b655b7311432a95ed2ad291df0b8d (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:09:17.380431 13748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 277b655b7311432a95ed2ad291df0b8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.393481 13676 tablet_service.cc:1511] Processing CreateTablet for tablet c95811190f014949bb25448e8db1040e (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:09:17.396348 13676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c95811190f014949bb25448e8db1040e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.372694 13878 tablet_bootstrap.cc:492] T c8195765ed074b74be387475c214120b P 96701a74fdee481fb5f54aac841e17dd: Bootstrap starting.
I20260709 12:09:17.403183 13876 tablet_bootstrap.cc:492] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7: No bootstrap required, opened a new log
I20260709 12:09:17.404034 13876 ts_tablet_manager.cc:1403] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent bootstrapping tablet: real 0.224s	user 0.020s	sys 0.004s
I20260709 12:09:17.417099 13824 tablet_service.cc:1511] Processing CreateTablet for tablet c95811190f014949bb25448e8db1040e (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:09:17.418525 13824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c95811190f014949bb25448e8db1040e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.421401 13818 tablet_service.cc:1511] Processing CreateTablet for tablet f9139e027a704f14bb60e60e22390d08 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:09:17.421864 13749 tablet_service.cc:1511] Processing CreateTablet for tablet f9139e027a704f14bb60e60e22390d08 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:09:17.422860 13671 tablet_service.cc:1511] Processing CreateTablet for tablet f9139e027a704f14bb60e60e22390d08 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:09:17.422870 13818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9139e027a704f14bb60e60e22390d08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.424089 13749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9139e027a704f14bb60e60e22390d08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.414038 13751 tablet_service.cc:1511] Processing CreateTablet for tablet c95811190f014949bb25448e8db1040e (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:09:17.426884 13751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c95811190f014949bb25448e8db1040e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.430217 13585 catalog_manager.cc:5697] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 1 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:17.409346 13883 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:17.439908 13883 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:17.454475 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:09:17.455265 13687 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.454712 13678 tablet_service.cc:1511] Processing CreateTablet for tablet 25896261d1204b3d858fb5b478a89034 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:09:17.458377 13678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25896261d1204b3d858fb5b478a89034. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.459141 13671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9139e027a704f14bb60e60e22390d08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.464345 13744 tablet_service.cc:1511] Processing CreateTablet for tablet 25896261d1204b3d858fb5b478a89034 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:09:17.465744 13744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25896261d1204b3d858fb5b478a89034. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.471994 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:17.472187 13822 tablet_service.cc:1511] Processing CreateTablet for tablet 25896261d1204b3d858fb5b478a89034 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:09:17.473560 13822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25896261d1204b3d858fb5b478a89034. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.473335 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:17.474706 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:09:17.479564 13800 leader_election.cc:343] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.483017 13826 tablet_service.cc:1511] Processing CreateTablet for tablet b57529c42e834d3f85dd24588a5d5773 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:09:17.484566 13670 tablet_service.cc:1511] Processing CreateTablet for tablet b57529c42e834d3f85dd24588a5d5773 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:09:17.486614 13670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b57529c42e834d3f85dd24588a5d5773. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.490917 13883 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:17.491245 13800 leader_election.cc:343] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.491541 13883 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:09:17.492045 13800 leader_election.cc:343] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.492455 13800 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:09:17.493736 13883 leader_election.cc:290] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:17.494323 13883 raft_consensus.cc:2749] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:17.484524 13826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b57529c42e834d3f85dd24588a5d5773. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.506541 13878 tablet_bootstrap.cc:654] T c8195765ed074b74be387475c214120b P 96701a74fdee481fb5f54aac841e17dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.509903 13673 tablet_service.cc:1511] Processing CreateTablet for tablet ca94d8f3109143599733e3a684149726 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:09:17.511461 13673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca94d8f3109143599733e3a684149726. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.534849 13821 tablet_service.cc:1511] Processing CreateTablet for tablet ca94d8f3109143599733e3a684149726 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:09:17.536386 13821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca94d8f3109143599733e3a684149726. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.538282 13818 tablet_service.cc:1511] Processing CreateTablet for tablet 51d10bdf51504a12a70a50e9a48f7ede (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:09:17.539656 13818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51d10bdf51504a12a70a50e9a48f7ede. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.540843 13677 tablet_service.cc:1511] Processing CreateTablet for tablet 51d10bdf51504a12a70a50e9a48f7ede (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:09:17.541219 13675 tablet_service.cc:1511] Processing CreateTablet for tablet ab7af43351ec498cb9e13128a20c3c89 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:09:17.542232 13677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51d10bdf51504a12a70a50e9a48f7ede. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.518515 13876 raft_consensus.cc:359] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:17.556111 13820 tablet_service.cc:1511] Processing CreateTablet for tablet ab7af43351ec498cb9e13128a20c3c89 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:09:17.557433 13884 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.557766 13820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab7af43351ec498cb9e13128a20c3c89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.558058 13884 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:17.568544 13884 leader_election.cc:290] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:17.551038 13876 raft_consensus.cc:385] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.570021 13876 raft_consensus.cc:740] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.570535 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:17.570823 13876 consensus_queue.cc:260] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:09:17.572480 13726 leader_election.cc:343] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.561648 13675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab7af43351ec498cb9e13128a20c3c89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.573417 13876 ts_tablet_manager.cc:1434] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent starting tablet: real 0.169s	user 0.008s	sys 0.002s
I20260709 12:09:17.581605 13876 tablet_bootstrap.cc:492] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7: Bootstrap starting.
W20260709 12:09:17.576890 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 84880.5us
I20260709 12:09:17.587281 13825 tablet_service.cc:1511] Processing CreateTablet for tablet 7639868c5cbf467e82d51f50ad8d6379 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:09:17.588779 13825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7639868c5cbf467e82d51f50ad8d6379. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.590981 13824 tablet_service.cc:1511] Processing CreateTablet for tablet c6d20ad9ea2849238148cd46eb3be62c (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:09:17.593000 13877 tablet_bootstrap.cc:492] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835: No bootstrap required, opened a new log
I20260709 12:09:17.594630 13878 tablet_bootstrap.cc:492] T c8195765ed074b74be387475c214120b P 96701a74fdee481fb5f54aac841e17dd: No bootstrap required, opened a new log
I20260709 12:09:17.595170 13878 ts_tablet_manager.cc:1403] T c8195765ed074b74be387475c214120b P 96701a74fdee481fb5f54aac841e17dd: Time spent bootstrapping tablet: real 0.236s	user 0.011s	sys 0.008s
I20260709 12:09:17.595021 13745 tablet_service.cc:1511] Processing CreateTablet for tablet b57529c42e834d3f85dd24588a5d5773 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:09:17.596740 13745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b57529c42e834d3f85dd24588a5d5773. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.597039 13669 tablet_service.cc:1511] Processing CreateTablet for tablet 7639868c5cbf467e82d51f50ad8d6379 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:09:17.579372 13687 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 1.
I20260709 12:09:17.598131 13824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6d20ad9ea2849238148cd46eb3be62c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.599715 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:17.600440 13837 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 0.
I20260709 12:09:17.593572 13877 ts_tablet_manager.cc:1403] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835: Time spent bootstrapping tablet: real 0.287s	user 0.035s	sys 0.019s
I20260709 12:09:17.603471 13746 tablet_service.cc:1511] Processing CreateTablet for tablet 51d10bdf51504a12a70a50e9a48f7ede (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:09:17.607314 13746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51d10bdf51504a12a70a50e9a48f7ede. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.615391 13749 tablet_service.cc:1511] Processing CreateTablet for tablet ca94d8f3109143599733e3a684149726 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:09:17.619297 13749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca94d8f3109143599733e3a684149726. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.626722 13669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7639868c5cbf467e82d51f50ad8d6379. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.629334 13876 tablet_bootstrap.cc:654] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.635766 13750 tablet_service.cc:1511] Processing CreateTablet for tablet 7639868c5cbf467e82d51f50ad8d6379 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:09:17.637132 13800 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:09:17.637351 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:17.638732 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:17.638759 13905 raft_consensus.cc:2804] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:17.639619 13761 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 0.
I20260709 12:09:17.639876 13905 raft_consensus.cc:697] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:09:17.637435 13750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7639868c5cbf467e82d51f50ad8d6379. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.609086 13877 raft_consensus.cc:359] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:17.642529 13905 consensus_queue.cc:237] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:17.652585 13745 tablet_service.cc:1511] Processing CreateTablet for tablet ab7af43351ec498cb9e13128a20c3c89 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:09:17.668511 13672 tablet_service.cc:1511] Processing CreateTablet for tablet 026a826aa72f4cbea032d49e318401ae (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:09:17.668715 13751 tablet_service.cc:1511] Processing CreateTablet for tablet c6d20ad9ea2849238148cd46eb3be62c (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:09:17.671168 13672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 026a826aa72f4cbea032d49e318401ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.669190 13727 leader_election.cc:304] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:09:17.644932 13877 raft_consensus.cc:385] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.664239 13745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab7af43351ec498cb9e13128a20c3c89. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:09:17.647440 13800 leader_election.cc:343] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.680433 13877 raft_consensus.cc:740] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.688298 13751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6d20ad9ea2849238148cd46eb3be62c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.681125 13884 raft_consensus.cc:2804] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:17.696617 13884 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:17.697078 13884 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.697332 13819 tablet_service.cc:1511] Processing CreateTablet for tablet 026a826aa72f4cbea032d49e318401ae (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
W20260709 12:09:17.695027 13634 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:17.705380 13819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 026a826aa72f4cbea032d49e318401ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.698767 13800 leader_election.cc:304] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:09:17.710880 13883 raft_consensus.cc:2804] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:17.711304 13883 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:17.711710 13883 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.711549 13748 tablet_service.cc:1511] Processing CreateTablet for tablet 026a826aa72f4cbea032d49e318401ae (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:09:17.713009 13748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 026a826aa72f4cbea032d49e318401ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.716344 13878 raft_consensus.cc:359] T c8195765ed074b74be387475c214120b P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:17.717458 13674 tablet_service.cc:1511] Processing CreateTablet for tablet c6d20ad9ea2849238148cd46eb3be62c (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:09:17.693293 13877 consensus_queue.cc:260] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:17.749307 13876 tablet_bootstrap.cc:492] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7: No bootstrap required, opened a new log
I20260709 12:09:17.749938 13876 ts_tablet_manager.cc:1403] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent bootstrapping tablet: real 0.169s	user 0.011s	sys 0.038s
I20260709 12:09:17.752120 13877 ts_tablet_manager.cc:1434] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835: Time spent starting tablet: real 0.146s	user 0.005s	sys 0.004s
I20260709 12:09:17.740892 13878 raft_consensus.cc:385] T c8195765ed074b74be387475c214120b P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.759485 13876 raft_consensus.cc:359] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:17.760293 13876 raft_consensus.cc:385] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.760661 13876 raft_consensus.cc:740] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.757367 13878 raft_consensus.cc:740] T c8195765ed074b74be387475c214120b P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.783736 13878 consensus_queue.cc:260] T c8195765ed074b74be387475c214120b P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:17.761493 13876 consensus_queue.cc:260] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:17.760667 13744 tablet_service.cc:1511] Processing CreateTablet for tablet 64b889ec5fe4445d81fe94e0ae9fb087 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:09:17.756561 13883 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:17.771235 13818 tablet_service.cc:1511] Processing CreateTablet for tablet 64b889ec5fe4445d81fe94e0ae9fb087 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:09:17.791906 13884 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:17.787782 13877 tablet_bootstrap.cc:492] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835: Bootstrap starting.
I20260709 12:09:17.770797 13674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6d20ad9ea2849238148cd46eb3be62c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.796928 13818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64b889ec5fe4445d81fe94e0ae9fb087. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.797245 13744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64b889ec5fe4445d81fe94e0ae9fb087. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.800763 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:09:17.802507 13905 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.804600 13876 ts_tablet_manager.cc:1434] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.002s
I20260709 12:09:17.805755 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:09:17.812417 13800 leader_election.cc:343] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.802536 13878 ts_tablet_manager.cc:1434] T c8195765ed074b74be387475c214120b P 96701a74fdee481fb5f54aac841e17dd: Time spent starting tablet: real 0.207s	user 0.010s	sys 0.001s
I20260709 12:09:17.770239 13671 tablet_service.cc:1511] Processing CreateTablet for tablet 64b889ec5fe4445d81fe94e0ae9fb087 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:09:17.850121 13752 tablet_service.cc:1511] Processing CreateTablet for tablet aa310cca462541d39d36ebe94a27446e (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:09:17.850661 13671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64b889ec5fe4445d81fe94e0ae9fb087. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.851408 13752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa310cca462541d39d36ebe94a27446e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.851105 13820 tablet_service.cc:1511] Processing CreateTablet for tablet 107415ab6e76484890fa8115e8832a21 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:09:17.852430 13820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 107415ab6e76484890fa8115e8832a21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.808725 13883 leader_election.cc:290] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:17.819094 13761 raft_consensus.cc:2393] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 1: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:09:17.854751 13751 tablet_service.cc:1511] Processing CreateTablet for tablet 107415ab6e76484890fa8115e8832a21 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:09:17.855546 13750 tablet_service.cc:1511] Processing CreateTablet for tablet a2541d5a960c4a8ba1d642e9a29fd19c (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:09:17.856897 13800 leader_election.cc:304] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:09:17.858479 13883 raft_consensus.cc:2749] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:09:17.856935 13750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2541d5a960c4a8ba1d642e9a29fd19c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.820660 13669 tablet_service.cc:1511] Processing CreateTablet for tablet a2541d5a960c4a8ba1d642e9a29fd19c (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:09:17.821628 13586 catalog_manager.cc:5697] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 1 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:17.822505 13826 tablet_service.cc:1511] Processing CreateTablet for tablet c3c06f5564ed4c259ca5c238c3faf2a3 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:09:17.823843 13746 tablet_service.cc:1511] Processing CreateTablet for tablet c3c06f5564ed4c259ca5c238c3faf2a3 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:09:17.813730 13905 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:17.835274 13753 tablet_service.cc:1511] Processing CreateTablet for tablet 1d3056e0d375412a9db3769da3ef2eb9 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:09:17.836925 13823 tablet_service.cc:1511] Processing CreateTablet for tablet 1d3056e0d375412a9db3769da3ef2eb9 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:09:17.835569 13678 tablet_service.cc:1511] Processing CreateTablet for tablet 1d3056e0d375412a9db3769da3ef2eb9 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:09:17.840817 13676 tablet_service.cc:1511] Processing CreateTablet for tablet 56d28ac895464968890083dea150a58d (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:09:17.841969 13878 tablet_bootstrap.cc:492] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd: Bootstrap starting.
I20260709 12:09:17.843183 13747 tablet_service.cc:1511] Processing CreateTablet for tablet 56d28ac895464968890083dea150a58d (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:09:17.844235 13827 tablet_service.cc:1511] Processing CreateTablet for tablet 56d28ac895464968890083dea150a58d (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:09:17.845170 13882 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.849642 13877 tablet_bootstrap.cc:654] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.874222 13876 tablet_bootstrap.cc:492] T 2e7fcff4988b4d928d7bb79c969a2025 P 3f37c9cc9dda46b4be21dd675ba78fb7: Bootstrap starting.
I20260709 12:09:17.878298 13826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3c06f5564ed4c259ca5c238c3faf2a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.882174 13753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d3056e0d375412a9db3769da3ef2eb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.883853 13827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56d28ac895464968890083dea150a58d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:09:17.883801 13727 consensus_peers.cc:597] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Couldn't send request to peer 96701a74fdee481fb5f54aac841e17dd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:17.884320 13746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3c06f5564ed4c259ca5c238c3faf2a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.885433 13821 tablet_service.cc:1511] Processing CreateTablet for tablet a2541d5a960c4a8ba1d642e9a29fd19c (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:09:17.886117 13823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d3056e0d375412a9db3769da3ef2eb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.886834 13821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2541d5a960c4a8ba1d642e9a29fd19c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.880923 13882 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:09:17.889812 13714 tablet.cc:2406] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:09:17.889259 13882 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:17.891253 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:09:17.892081 13837 raft_consensus.cc:2393] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 1: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:09:17.892217 13747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56d28ac895464968890083dea150a58d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.891996 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:17.892809 13763 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 0.
I20260709 12:09:17.895035 13651 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:09:17.895957 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:17.896842 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:17.897568 13837 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 0.
W20260709 12:09:17.897725 13800 leader_election.cc:343] T c8195765ed074b74be387475c214120b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.846500 13673 tablet_service.cc:1511] Processing CreateTablet for tablet 107415ab6e76484890fa8115e8832a21 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:09:17.902186 13669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2541d5a960c4a8ba1d642e9a29fd19c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.879357 13905 leader_election.cc:290] T c8195765ed074b74be387475c214120b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:17.903856 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:17.904871 13897 consensus_queue.cc:1048] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:17.905296 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:09:17.901139 13882 raft_consensus.cc:2804] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:09:17.905403 13800 leader_election.cc:343] T c8195765ed074b74be387475c214120b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.906065 13882 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:17.906383 13800 leader_election.cc:304] T c8195765ed074b74be387475c214120b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:09:17.907788 13726 leader_election.cc:343] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.908236 13726 leader_election.cc:304] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:09:17.881613 13677 tablet_service.cc:1511] Processing CreateTablet for tablet c3c06f5564ed4c259ca5c238c3faf2a3 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:09:17.909065 13897 raft_consensus.cc:2749] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:09:17.909643 13905 raft_consensus.cc:2749] T c8195765ed074b74be387475c214120b P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:17.910686 13675 tablet_service.cc:1511] Processing CreateTablet for tablet aa310cca462541d39d36ebe94a27446e (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:09:17.911222 13878 tablet_bootstrap.cc:654] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.906517 13882 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.900512 13884 leader_election.cc:290] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:17.922596 13676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56d28ac895464968890083dea150a58d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.941967 13677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3c06f5564ed4c259ca5c238c3faf2a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.947495 13884 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.948108 13884 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:17.949272 13672 tablet_service.cc:1511] Processing CreateTablet for tablet 625e9b5c2aa14658af58496a21f9ee8b (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:09:17.949312 13822 tablet_service.cc:1511] Processing CreateTablet for tablet aa310cca462541d39d36ebe94a27446e (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:09:17.951509 13749 tablet_service.cc:1511] Processing CreateTablet for tablet 625e9b5c2aa14658af58496a21f9ee8b (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:09:17.952184 13822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa310cca462541d39d36ebe94a27446e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.955780 13825 tablet_service.cc:1511] Processing CreateTablet for tablet 625e9b5c2aa14658af58496a21f9ee8b (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:09:17.956005 13670 tablet_service.cc:1511] Processing CreateTablet for tablet 9dfb6cae84194e19bf3a75e14c3d2263 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:09:17.955920 13882 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:17.957504 13825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 625e9b5c2aa14658af58496a21f9ee8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.960352 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:09:17.961212 13761 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.962401 13675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa310cca462541d39d36ebe94a27446e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.964987 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:17.967012 13678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d3056e0d375412a9db3769da3ef2eb9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:09:17.979220 13726 leader_election.cc:343] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.979568 13884 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:17.980357 13751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 107415ab6e76484890fa8115e8832a21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.008030 13877 tablet_bootstrap.cc:492] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835: No bootstrap required, opened a new log
I20260709 12:09:18.008728 13877 ts_tablet_manager.cc:1403] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835: Time spent bootstrapping tablet: real 0.221s	user 0.015s	sys 0.012s
I20260709 12:09:17.986407 13672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 625e9b5c2aa14658af58496a21f9ee8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.022807 13673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 107415ab6e76484890fa8115e8832a21. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:09:18.026011 13570 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 43810.6us
I20260709 12:09:18.034211 13749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 625e9b5c2aa14658af58496a21f9ee8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.036552 13761 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 1.
I20260709 12:09:18.037717 13670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dfb6cae84194e19bf3a75e14c3d2263. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.037833 13882 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:18.038131 13651 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:09:18.039149 13882 raft_consensus.cc:2804] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.039638 13882 raft_consensus.cc:697] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:09:18.040454 13882 consensus_queue.cc:237] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.043391 13753 tablet_service.cc:1511] Processing CreateTablet for tablet 9dfb6cae84194e19bf3a75e14c3d2263 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:09:18.044782 13753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dfb6cae84194e19bf3a75e14c3d2263. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.044935 13748 tablet_service.cc:1511] Processing CreateTablet for tablet 956300599d004370953188dd3ae3a256 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:09:18.046036 13745 tablet_service.cc:1511] Processing CreateTablet for tablet 243ef5a036904f43835a7e29d96599de (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:09:18.078136 13747 tablet_service.cc:1511] Processing CreateTablet for tablet 7a7564a63b8041ff80f64a7f8d533acb (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:09:18.078660 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:18.081802 13878 tablet_bootstrap.cc:492] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd: No bootstrap required, opened a new log
W20260709 12:09:18.082129 13727 leader_election.cc:343] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.082314 13878 ts_tablet_manager.cc:1403] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd: Time spent bootstrapping tablet: real 0.241s	user 0.025s	sys 0.004s
I20260709 12:09:18.082696 13727 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:09:18.084159 13746 tablet_service.cc:1511] Processing CreateTablet for tablet d8f8986661dd4d049ab4a79338d33a1a (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:09:18.085764 13878 raft_consensus.cc:359] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.094179 13827 tablet_service.cc:1511] Processing CreateTablet for tablet 7a7564a63b8041ff80f64a7f8d533acb (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:09:18.095623 13827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a7564a63b8041ff80f64a7f8d533acb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.089740 13897 raft_consensus.cc:2749] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:18.097075 13744 tablet_service.cc:1511] Processing CreateTablet for tablet e39d323dce0c45249bf1cf9b6062ab9a (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:09:18.098802 13824 tablet_service.cc:1511] Processing CreateTablet for tablet 956300599d004370953188dd3ae3a256 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:09:18.100180 13824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 956300599d004370953188dd3ae3a256. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.102780 13818 tablet_service.cc:1511] Processing CreateTablet for tablet 9dfb6cae84194e19bf3a75e14c3d2263 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:09:18.103736 13877 raft_consensus.cc:359] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.104336 13818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dfb6cae84194e19bf3a75e14c3d2263. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.104568 13877 raft_consensus.cc:385] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.105065 13877 raft_consensus.cc:740] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.105933 13745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 243ef5a036904f43835a7e29d96599de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.089190 13819 tablet_service.cc:1511] Processing CreateTablet for tablet d8f8986661dd4d049ab4a79338d33a1a (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:09:18.107182 13819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8f8986661dd4d049ab4a79338d33a1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.114063 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:09:18.114800 13837 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.118335 13747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a7564a63b8041ff80f64a7f8d533acb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.118839 13825 tablet_service.cc:1511] Processing CreateTablet for tablet e39d323dce0c45249bf1cf9b6062ab9a (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:09:18.120275 13825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e39d323dce0c45249bf1cf9b6062ab9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.122138 13748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 956300599d004370953188dd3ae3a256. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.123096 13744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e39d323dce0c45249bf1cf9b6062ab9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.124953 13876 tablet_bootstrap.cc:654] T 2e7fcff4988b4d928d7bb79c969a2025 P 3f37c9cc9dda46b4be21dd675ba78fb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.127077 13674 tablet_service.cc:1511] Processing CreateTablet for tablet 243ef5a036904f43835a7e29d96599de (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:09:18.128508 13674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 243ef5a036904f43835a7e29d96599de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.128508 13746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8f8986661dd4d049ab4a79338d33a1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.130719 13823 tablet_service.cc:1511] Processing CreateTablet for tablet 243ef5a036904f43835a7e29d96599de (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:09:18.132108 13823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 243ef5a036904f43835a7e29d96599de. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:09:18.134609 13800 consensus_peers.cc:597] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd -> Peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Couldn't send request to peer 3f37c9cc9dda46b4be21dd675ba78fb7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:18.146164 13747 tablet_service.cc:1511] Processing CreateTablet for tablet 34a12e91341d4472be7460f1061495db (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:09:18.153407 13747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34a12e91341d4472be7460f1061495db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.153024 13752 tablet_service.cc:1511] Processing CreateTablet for tablet 1e31cd7111f2470d8d34b5898dce5765 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:09:18.086658 13878 raft_consensus.cc:385] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.179291 13585 catalog_manager.cc:5697] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 0 to 1, leader changed from <none> to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 1 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:18.174820 13877 consensus_queue.cc:260] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.183990 13820 tablet_service.cc:1511] Processing CreateTablet for tablet 1e31cd7111f2470d8d34b5898dce5765 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:09:18.185595 13820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e31cd7111f2470d8d34b5898dce5765. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.157656 13878 raft_consensus.cc:740] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.185716 13877 ts_tablet_manager.cc:1434] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835: Time spent starting tablet: real 0.177s	user 0.010s	sys 0.000s
I20260709 12:09:18.209200 13677 tablet_service.cc:1511] Processing CreateTablet for tablet 34a12e91341d4472be7460f1061495db (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:09:18.210196 13877 tablet_bootstrap.cc:492] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835: Bootstrap starting.
I20260709 12:09:18.210754 13677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34a12e91341d4472be7460f1061495db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.188562 13671 tablet_service.cc:1511] Processing CreateTablet for tablet 956300599d004370953188dd3ae3a256 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:09:18.211607 13820 tablet_service.cc:1511] Processing CreateTablet for tablet f1494f6353074242857c7901c21da06d (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:09:18.212312 13671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 956300599d004370953188dd3ae3a256. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.213032 13820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1494f6353074242857c7901c21da06d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.189335 13878 consensus_queue.cc:260] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.219223 13752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e31cd7111f2470d8d34b5898dce5765. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.220914 13751 tablet_service.cc:1511] Processing CreateTablet for tablet f1494f6353074242857c7901c21da06d (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:09:18.224396 13751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1494f6353074242857c7901c21da06d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.189818 13826 tablet_service.cc:1511] Processing CreateTablet for tablet 34a12e91341d4472be7460f1061495db (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:09:18.232153 13826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34a12e91341d4472be7460f1061495db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.237815 13750 tablet_service.cc:1511] Processing CreateTablet for tablet 0a8c7c772cf44d36bc44b25edc405d1d (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:09:18.194495 13676 tablet_service.cc:1511] Processing CreateTablet for tablet e39d323dce0c45249bf1cf9b6062ab9a (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:09:18.241456 13676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e39d323dce0c45249bf1cf9b6062ab9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.191557 13678 tablet_service.cc:1511] Processing CreateTablet for tablet d8f8986661dd4d049ab4a79338d33a1a (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:09:18.239454 13750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a8c7c772cf44d36bc44b25edc405d1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.239444 13878 ts_tablet_manager.cc:1434] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd: Time spent starting tablet: real 0.157s	user 0.006s	sys 0.001s
I20260709 12:09:18.250988 13878 tablet_bootstrap.cc:492] T e229ea1f19c74be5884179acde106305 P 96701a74fdee481fb5f54aac841e17dd: Bootstrap starting.
I20260709 12:09:18.259313 13678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8f8986661dd4d049ab4a79338d33a1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.261004 13744 tablet_service.cc:1511] Processing CreateTablet for tablet e880992fc1b041b1a1717bb18203a22f (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:09:18.267828 13818 tablet_service.cc:1511] Processing CreateTablet for tablet e880992fc1b041b1a1717bb18203a22f (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:09:18.270269 13818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e880992fc1b041b1a1717bb18203a22f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.205188 13675 tablet_service.cc:1511] Processing CreateTablet for tablet 7a7564a63b8041ff80f64a7f8d533acb (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:09:18.273654 13675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a7564a63b8041ff80f64a7f8d533acb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.278121 13744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e880992fc1b041b1a1717bb18203a22f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.279457 13882 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.279127 13824 tablet_service.cc:1511] Processing CreateTablet for tablet 0a8c7c772cf44d36bc44b25edc405d1d (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:09:18.280103 13882 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.280820 13824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a8c7c772cf44d36bc44b25edc405d1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.278960 13837 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 1.
I20260709 12:09:18.291337 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:09:18.293030 13651 leader_election.cc:343] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.295691 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:09:18.298749 13652 leader_election.cc:343] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.299384 13652 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:09:18.300798 13912 raft_consensus.cc:2749] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:18.303200 13882 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:18.306627 13876 tablet_bootstrap.cc:492] T 2e7fcff4988b4d928d7bb79c969a2025 P 3f37c9cc9dda46b4be21dd675ba78fb7: No bootstrap required, opened a new log
I20260709 12:09:18.307515 13876 ts_tablet_manager.cc:1403] T 2e7fcff4988b4d928d7bb79c969a2025 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent bootstrapping tablet: real 0.434s	user 0.017s	sys 0.003s
I20260709 12:09:18.311462 13670 tablet_service.cc:1511] Processing CreateTablet for tablet 1e31cd7111f2470d8d34b5898dce5765 (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:09:18.312219 13669 tablet_service.cc:1511] Processing CreateTablet for tablet 0a8c7c772cf44d36bc44b25edc405d1d (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:09:18.313021 13670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e31cd7111f2470d8d34b5898dce5765. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.315445 13876 raft_consensus.cc:359] T 2e7fcff4988b4d928d7bb79c969a2025 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.316612 13876 raft_consensus.cc:385] T 2e7fcff4988b4d928d7bb79c969a2025 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.316977 13876 raft_consensus.cc:740] T 2e7fcff4988b4d928d7bb79c969a2025 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.311462 13673 tablet_service.cc:1511] Processing CreateTablet for tablet f1494f6353074242857c7901c21da06d (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:09:18.319886 13673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1494f6353074242857c7901c21da06d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.318041 13876 consensus_queue.cc:260] T 2e7fcff4988b4d928d7bb79c969a2025 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.324743 13905 consensus_queue.cc:1048] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:18.336329 13876 ts_tablet_manager.cc:1434] T 2e7fcff4988b4d928d7bb79c969a2025 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent starting tablet: real 0.028s	user 0.009s	sys 0.000s
I20260709 12:09:18.312997 13674 tablet_service.cc:1511] Processing CreateTablet for tablet e880992fc1b041b1a1717bb18203a22f (DEFAULT_TABLE table=test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:09:18.363291 13876 tablet_bootstrap.cc:492] T e8e96840ffec4e38a0f975263031c226 P 3f37c9cc9dda46b4be21dd675ba78fb7: Bootstrap starting.
I20260709 12:09:18.365717 13669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a8c7c772cf44d36bc44b25edc405d1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.376915 13877 tablet_bootstrap.cc:654] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.381202 13876 tablet_bootstrap.cc:654] T e8e96840ffec4e38a0f975263031c226 P 3f37c9cc9dda46b4be21dd675ba78fb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.403085 13878 tablet_bootstrap.cc:654] T e229ea1f19c74be5884179acde106305 P 96701a74fdee481fb5f54aac841e17dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.414453 13674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e880992fc1b041b1a1717bb18203a22f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.442570 13876 tablet_bootstrap.cc:492] T e8e96840ffec4e38a0f975263031c226 P 3f37c9cc9dda46b4be21dd675ba78fb7: No bootstrap required, opened a new log
I20260709 12:09:18.443586 13876 ts_tablet_manager.cc:1403] T e8e96840ffec4e38a0f975263031c226 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent bootstrapping tablet: real 0.081s	user 0.019s	sys 0.023s
I20260709 12:09:18.453712 13876 raft_consensus.cc:359] T e8e96840ffec4e38a0f975263031c226 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.469309 13876 raft_consensus.cc:385] T e8e96840ffec4e38a0f975263031c226 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.469696 13876 raft_consensus.cc:740] T e8e96840ffec4e38a0f975263031c226 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.470561 13876 consensus_queue.cc:260] T e8e96840ffec4e38a0f975263031c226 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.473246 13877 tablet_bootstrap.cc:492] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835: No bootstrap required, opened a new log
I20260709 12:09:18.473876 13877 ts_tablet_manager.cc:1403] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835: Time spent bootstrapping tablet: real 0.264s	user 0.020s	sys 0.023s
I20260709 12:09:18.474241 13876 ts_tablet_manager.cc:1434] T e8e96840ffec4e38a0f975263031c226 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.002s
I20260709 12:09:18.475435 13876 tablet_bootstrap.cc:492] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7: Bootstrap starting.
I20260709 12:09:18.477252 13877 raft_consensus.cc:359] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.478173 13877 raft_consensus.cc:385] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.478524 13877 raft_consensus.cc:740] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.479453 13877 consensus_queue.cc:260] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.482092 13877 ts_tablet_manager.cc:1434] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:09:18.462975 13923 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.482947 13923 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.484733 13878 tablet_bootstrap.cc:492] T e229ea1f19c74be5884179acde106305 P 96701a74fdee481fb5f54aac841e17dd: No bootstrap required, opened a new log
I20260709 12:09:18.485388 13878 ts_tablet_manager.cc:1403] T e229ea1f19c74be5884179acde106305 P 96701a74fdee481fb5f54aac841e17dd: Time spent bootstrapping tablet: real 0.235s	user 0.011s	sys 0.008s
I20260709 12:09:18.485497 13923 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:18.487422 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:18.488166 13761 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 0.
I20260709 12:09:18.490036 13800 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:09:18.490175 13878 raft_consensus.cc:359] T e229ea1f19c74be5884179acde106305 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } }
I20260709 12:09:18.490991 13923 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.491215 13878 raft_consensus.cc:385] T e229ea1f19c74be5884179acde106305 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.491787 13878 raft_consensus.cc:740] T e229ea1f19c74be5884179acde106305 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.491438 13923 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.492777 13923 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.497860 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:18.498500 13877 tablet_bootstrap.cc:492] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835: Bootstrap starting.
W20260709 12:09:18.499583 13800 leader_election.cc:343] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.501983 13878 consensus_queue.cc:260] T e229ea1f19c74be5884179acde106305 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } }
I20260709 12:09:18.506843 13876 tablet_bootstrap.cc:654] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.510284 13878 ts_tablet_manager.cc:1434] T e229ea1f19c74be5884179acde106305 P 96701a74fdee481fb5f54aac841e17dd: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.003s
I20260709 12:09:18.511644 13878 tablet_bootstrap.cc:492] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd: Bootstrap starting.
I20260709 12:09:18.511644 13923 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.515249 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:09:18.517212 13800 leader_election.cc:343] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.519707 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:09:18.520447 13878 tablet_bootstrap.cc:654] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.520565 13761 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.522356 13897 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.522902 13897 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.523577 13877 tablet_bootstrap.cc:654] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.525085 13897 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:18.527222 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:18.528457 13882 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.529053 13882 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.529867 13876 tablet_bootstrap.cc:492] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7: No bootstrap required, opened a new log
W20260709 12:09:18.530129 13727 leader_election.cc:343] T 2e7fcff4988b4d928d7bb79c969a2025 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.530529 13876 ts_tablet_manager.cc:1403] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent bootstrapping tablet: real 0.055s	user 0.014s	sys 0.012s
I20260709 12:09:18.531347 13882 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:18.533624 13877 tablet_bootstrap.cc:492] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835: No bootstrap required, opened a new log
I20260709 12:09:18.533859 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:18.534190 13877 ts_tablet_manager.cc:1403] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835: Time spent bootstrapping tablet: real 0.036s	user 0.008s	sys 0.010s
I20260709 12:09:18.534505 13763 raft_consensus.cc:2468] T e8e96840ffec4e38a0f975263031c226 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 0.
I20260709 12:09:18.534247 13876 raft_consensus.cc:359] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.535317 13876 raft_consensus.cc:385] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.535715 13876 raft_consensus.cc:740] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.536064 13651 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:09:18.536710 13876 consensus_queue.cc:260] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.539705 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:18.537266 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:18.540438 13876 ts_tablet_manager.cc:1434] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
W20260709 12:09:18.541798 13726 leader_election.cc:343] T 2e7fcff4988b4d928d7bb79c969a2025 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.542019 13876 tablet_bootstrap.cc:492] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7: Bootstrap starting.
I20260709 12:09:18.542253 13726 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
W20260709 12:09:18.544404 13652 leader_election.cc:343] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.545356 13884 raft_consensus.cc:2749] T 2e7fcff4988b4d928d7bb79c969a2025 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:18.547197 13912 raft_consensus.cc:2804] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.547603 13912 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.547922 13912 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.552670 13876 tablet_bootstrap.cc:654] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.559233 13761 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 1.
I20260709 12:09:18.560171 13923 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:18.537380 13877 raft_consensus.cc:359] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.561299 13877 raft_consensus.cc:385] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.561805 13882 consensus_queue.cc:1048] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:18.562259 13800 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:09:18.563133 13923 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.563644 13923 raft_consensus.cc:697] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:09:18.564038 13878 tablet_bootstrap.cc:492] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd: No bootstrap required, opened a new log
I20260709 12:09:18.564745 13878 ts_tablet_manager.cc:1403] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd: Time spent bootstrapping tablet: real 0.053s	user 0.020s	sys 0.020s
I20260709 12:09:18.561689 13877 raft_consensus.cc:740] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.564517 13923 consensus_queue.cc:237] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.565850 13877 consensus_queue.cc:260] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.568495 13877 ts_tablet_manager.cc:1434] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.001s
I20260709 12:09:18.568361 13878 raft_consensus.cc:359] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.569252 13878 raft_consensus.cc:385] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.569610 13878 raft_consensus.cc:740] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.570906 13876 tablet_bootstrap.cc:492] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7: No bootstrap required, opened a new log
I20260709 12:09:18.570484 13878 consensus_queue.cc:260] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.571408 13876 ts_tablet_manager.cc:1403] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent bootstrapping tablet: real 0.030s	user 0.018s	sys 0.000s
I20260709 12:09:18.572968 13878 ts_tablet_manager.cc:1434] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:09:18.574087 13878 tablet_bootstrap.cc:492] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd: Bootstrap starting.
I20260709 12:09:18.574476 13876 raft_consensus.cc:359] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.575227 13876 raft_consensus.cc:385] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.575539 13876 raft_consensus.cc:740] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.573889 13912 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.581212 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:09:18.582049 13761 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.588618 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:09:18.590607 13761 raft_consensus.cc:2468] T e8e96840ffec4e38a0f975263031c226 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 1.
I20260709 12:09:18.591774 13912 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:09:18.590816 13652 leader_election.cc:343] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.582021 13878 tablet_bootstrap.cc:654] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.592571 13877 tablet_bootstrap.cc:492] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835: Bootstrap starting.
I20260709 12:09:18.592752 13651 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:09:18.594043 13882 raft_consensus.cc:2804] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.595134 13876 consensus_queue.cc:260] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.597594 13876 ts_tablet_manager.cc:1434] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 12:09:18.602384 13876 tablet_bootstrap.cc:492] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7: Bootstrap starting.
I20260709 12:09:18.605053 13882 raft_consensus.cc:697] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:09:18.606550 13882 consensus_queue.cc:237] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.610486 13876 tablet_bootstrap.cc:654] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.618615 13878 tablet_bootstrap.cc:492] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd: No bootstrap required, opened a new log
I20260709 12:09:18.619302 13878 ts_tablet_manager.cc:1403] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd: Time spent bootstrapping tablet: real 0.045s	user 0.003s	sys 0.017s
I20260709 12:09:18.622813 13877 tablet_bootstrap.cc:654] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.626806 13878 raft_consensus.cc:359] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.628264 13938 consensus_queue.cc:1048] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:18.628726 13878 raft_consensus.cc:385] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.629231 13878 raft_consensus.cc:740] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.627198 13586 catalog_manager.cc:5697] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 1 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:18.630020 13878 consensus_queue.cc:260] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.632946 13878 ts_tablet_manager.cc:1434] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:09:18.634945 13878 tablet_bootstrap.cc:492] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd: Bootstrap starting.
I20260709 12:09:18.644246 13878 tablet_bootstrap.cc:654] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.653102 13584 catalog_manager.cc:5697] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 0 to 1, leader changed from <none> to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 1 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:18.661902 13876 tablet_bootstrap.cc:492] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7: No bootstrap required, opened a new log
I20260709 12:09:18.662451 13876 ts_tablet_manager.cc:1403] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent bootstrapping tablet: real 0.060s	user 0.026s	sys 0.005s
I20260709 12:09:18.666347 13876 raft_consensus.cc:359] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.667327 13876 raft_consensus.cc:385] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.667703 13876 raft_consensus.cc:740] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.668655 13876 consensus_queue.cc:260] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.672945 13877 tablet_bootstrap.cc:492] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835: No bootstrap required, opened a new log
I20260709 12:09:18.673720 13877 ts_tablet_manager.cc:1403] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835: Time spent bootstrapping tablet: real 0.081s	user 0.012s	sys 0.008s
I20260709 12:09:18.680019 13876 ts_tablet_manager.cc:1434] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:09:18.681387 13876 tablet_bootstrap.cc:492] T dca45e62639f49b4a8367d6868dabc07 P 3f37c9cc9dda46b4be21dd675ba78fb7: Bootstrap starting.
I20260709 12:09:18.686090 13877 raft_consensus.cc:359] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.687242 13877 raft_consensus.cc:385] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.687669 13877 raft_consensus.cc:740] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.690054 13877 consensus_queue.cc:260] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.690922 13878 tablet_bootstrap.cc:492] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd: No bootstrap required, opened a new log
I20260709 12:09:18.691406 13878 ts_tablet_manager.cc:1403] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd: Time spent bootstrapping tablet: real 0.057s	user 0.022s	sys 0.016s
I20260709 12:09:18.692458 13877 ts_tablet_manager.cc:1434] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 12:09:18.693917 13877 tablet_bootstrap.cc:492] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835: Bootstrap starting.
I20260709 12:09:18.694164 13878 raft_consensus.cc:359] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.694844 13878 raft_consensus.cc:385] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.695137 13878 raft_consensus.cc:740] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.695748 13876 tablet_bootstrap.cc:654] T dca45e62639f49b4a8367d6868dabc07 P 3f37c9cc9dda46b4be21dd675ba78fb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.695919 13878 consensus_queue.cc:260] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.698448 13878 ts_tablet_manager.cc:1434] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:09:18.700376 13878 tablet_bootstrap.cc:492] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd: Bootstrap starting.
I20260709 12:09:18.701395 13877 tablet_bootstrap.cc:654] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.707720 13876 tablet_bootstrap.cc:492] T dca45e62639f49b4a8367d6868dabc07 P 3f37c9cc9dda46b4be21dd675ba78fb7: No bootstrap required, opened a new log
I20260709 12:09:18.707985 13878 tablet_bootstrap.cc:654] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.708290 13876 ts_tablet_manager.cc:1403] T dca45e62639f49b4a8367d6868dabc07 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.003s
W20260709 12:09:18.708297 13634 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:18.711990 13876 raft_consensus.cc:359] T dca45e62639f49b4a8367d6868dabc07 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.712929 13876 raft_consensus.cc:385] T dca45e62639f49b4a8367d6868dabc07 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.713354 13876 raft_consensus.cc:740] T dca45e62639f49b4a8367d6868dabc07 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.714515 13877 tablet_bootstrap.cc:492] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835: No bootstrap required, opened a new log
I20260709 12:09:18.715265 13877 ts_tablet_manager.cc:1403] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.003s
I20260709 12:09:18.714563 13876 consensus_queue.cc:260] T dca45e62639f49b4a8367d6868dabc07 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.718344 13876 ts_tablet_manager.cc:1434] T dca45e62639f49b4a8367d6868dabc07 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:09:18.719521 13876 tablet_bootstrap.cc:492] T 3f29dda715314a93a03981264972c4c3 P 3f37c9cc9dda46b4be21dd675ba78fb7: Bootstrap starting.
I20260709 12:09:18.721033 13878 tablet_bootstrap.cc:492] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd: No bootstrap required, opened a new log
I20260709 12:09:18.721554 13878 ts_tablet_manager.cc:1403] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.006s
I20260709 12:09:18.724148 13923 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.724413 13877 raft_consensus.cc:359] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.724738 13923 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.725248 13877 raft_consensus.cc:385] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.725656 13877 raft_consensus.cc:740] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.725858 13876 tablet_bootstrap.cc:654] T 3f29dda715314a93a03981264972c4c3 P 3f37c9cc9dda46b4be21dd675ba78fb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.726660 13877 consensus_queue.cc:260] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.727290 13923 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:18.729542 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:18.730129 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:09:18.731304 13800 leader_election.cc:343] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:18.732122 13800 leader_election.cc:343] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.732268 13878 raft_consensus.cc:359] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.732609 13800 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:09:18.733146 13878 raft_consensus.cc:385] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.733527 13878 raft_consensus.cc:740] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.733934 13923 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:18.734622 13877 ts_tablet_manager.cc:1434] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:09:18.734551 13878 consensus_queue.cc:260] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.735862 13877 tablet_bootstrap.cc:492] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835: Bootstrap starting.
I20260709 12:09:18.738436 13878 ts_tablet_manager.cc:1434] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:09:18.740352 13878 tablet_bootstrap.cc:492] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd: Bootstrap starting.
I20260709 12:09:18.743288 13877 tablet_bootstrap.cc:654] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.744031 13876 tablet_bootstrap.cc:492] T 3f29dda715314a93a03981264972c4c3 P 3f37c9cc9dda46b4be21dd675ba78fb7: No bootstrap required, opened a new log
I20260709 12:09:18.744642 13876 ts_tablet_manager.cc:1403] T 3f29dda715314a93a03981264972c4c3 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.005s
I20260709 12:09:18.747720 13878 tablet_bootstrap.cc:654] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.747853 13876 raft_consensus.cc:359] T 3f29dda715314a93a03981264972c4c3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.748667 13876 raft_consensus.cc:385] T 3f29dda715314a93a03981264972c4c3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.749001 13876 raft_consensus.cc:740] T 3f29dda715314a93a03981264972c4c3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.750628 13876 consensus_queue.cc:260] T 3f29dda715314a93a03981264972c4c3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.753960 13876 ts_tablet_manager.cc:1434] T 3f29dda715314a93a03981264972c4c3 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 12:09:18.755447 13876 tablet_bootstrap.cc:492] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7: Bootstrap starting.
I20260709 12:09:18.755965 13877 tablet_bootstrap.cc:492] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835: No bootstrap required, opened a new log
I20260709 12:09:18.756511 13877 ts_tablet_manager.cc:1403] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.004s
I20260709 12:09:18.759500 13877 raft_consensus.cc:359] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.760387 13877 raft_consensus.cc:385] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.760726 13877 raft_consensus.cc:740] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.761593 13877 consensus_queue.cc:260] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.764684 13877 ts_tablet_manager.cc:1434] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:09:18.765699 13877 tablet_bootstrap.cc:492] T 566e3cc2115c4b6dbd3070c4f4f4f11b P b98d2519bb504dc6905ed2ede4571835: Bootstrap starting.
I20260709 12:09:18.765858 13876 tablet_bootstrap.cc:654] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.765818 13878 tablet_bootstrap.cc:492] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd: No bootstrap required, opened a new log
I20260709 12:09:18.766587 13878 ts_tablet_manager.cc:1403] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd: Time spent bootstrapping tablet: real 0.027s	user 0.021s	sys 0.003s
I20260709 12:09:18.769909 13878 raft_consensus.cc:359] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.771176 13878 raft_consensus.cc:385] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.771632 13878 raft_consensus.cc:740] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.772545 13877 tablet_bootstrap.cc:654] T 566e3cc2115c4b6dbd3070c4f4f4f11b P b98d2519bb504dc6905ed2ede4571835: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.772863 13878 consensus_queue.cc:260] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.776821 13878 ts_tablet_manager.cc:1434] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:09:18.777900 13878 tablet_bootstrap.cc:492] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd: Bootstrap starting.
I20260709 12:09:18.778144 13876 tablet_bootstrap.cc:492] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7: No bootstrap required, opened a new log
I20260709 12:09:18.778755 13876 ts_tablet_manager.cc:1403] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.003s
I20260709 12:09:18.781934 13837 raft_consensus.cc:3060] T e229ea1f19c74be5884179acde106305 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.784406 13877 tablet_bootstrap.cc:492] T 566e3cc2115c4b6dbd3070c4f4f4f11b P b98d2519bb504dc6905ed2ede4571835: No bootstrap required, opened a new log
I20260709 12:09:18.784895 13877 ts_tablet_manager.cc:1403] T 566e3cc2115c4b6dbd3070c4f4f4f11b P b98d2519bb504dc6905ed2ede4571835: Time spent bootstrapping tablet: real 0.019s	user 0.003s	sys 0.013s
I20260709 12:09:18.785403 13878 tablet_bootstrap.cc:654] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.789098 13877 raft_consensus.cc:359] T 566e3cc2115c4b6dbd3070c4f4f4f11b P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.789942 13877 raft_consensus.cc:385] T 566e3cc2115c4b6dbd3070c4f4f4f11b P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.790269 13877 raft_consensus.cc:740] T 566e3cc2115c4b6dbd3070c4f4f4f11b P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.791090 13877 consensus_queue.cc:260] T 566e3cc2115c4b6dbd3070c4f4f4f11b P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.793459 13877 ts_tablet_manager.cc:1434] T 566e3cc2115c4b6dbd3070c4f4f4f11b P b98d2519bb504dc6905ed2ede4571835: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.007s
I20260709 12:09:18.794634 13877 tablet_bootstrap.cc:492] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835: Bootstrap starting.
I20260709 12:09:18.795473 13876 raft_consensus.cc:359] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.798017 13876 raft_consensus.cc:385] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.798426 13876 raft_consensus.cc:740] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.797086 13878 tablet_bootstrap.cc:492] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd: No bootstrap required, opened a new log
I20260709 12:09:18.799659 13878 ts_tablet_manager.cc:1403] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.004s
I20260709 12:09:18.803633 13878 raft_consensus.cc:359] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.804662 13878 raft_consensus.cc:385] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.805083 13878 raft_consensus.cc:740] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.805255 13877 tablet_bootstrap.cc:654] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.806082 13878 consensus_queue.cc:260] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.809172 13878 ts_tablet_manager.cc:1434] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 12:09:18.810613 13876 consensus_queue.cc:260] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.812242 13876 ts_tablet_manager.cc:1434] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 12:09:18.813315 13876 tablet_bootstrap.cc:492] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7: Bootstrap starting.
I20260709 12:09:18.814339 13878 tablet_bootstrap.cc:492] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd: Bootstrap starting.
I20260709 12:09:18.818392 13877 tablet_bootstrap.cc:492] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835: No bootstrap required, opened a new log
I20260709 12:09:18.818989 13877 ts_tablet_manager.cc:1403] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.006s
I20260709 12:09:18.820058 13876 tablet_bootstrap.cc:654] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.821630 13878 tablet_bootstrap.cc:654] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.822094 13877 raft_consensus.cc:359] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.822811 13877 raft_consensus.cc:385] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.822785 13897 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.823310 13877 raft_consensus.cc:740] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.823565 13897 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.824162 13877 consensus_queue.cc:260] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.827546 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:18.828274 13688 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 0.
I20260709 12:09:18.829581 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:18.830865 13837 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 0.
I20260709 12:09:18.831403 13726 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:09:18.832357 13884 raft_consensus.cc:2804] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.832733 13884 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.833102 13884 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.833065 13897 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:18.843086 13884 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.843945 13877 ts_tablet_manager.cc:1434] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.005s
I20260709 12:09:18.845113 13877 tablet_bootstrap.cc:492] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835: Bootstrap starting.
I20260709 12:09:18.847636 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:09:18.848333 13688 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.853298 13897 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.854208 13897 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.856258 13688 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 1.
I20260709 12:09:18.858189 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:09:18.859771 13726 leader_election.cc:343] T dca45e62639f49b4a8367d6868dabc07 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.859419 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:09:18.861441 13727 leader_election.cc:343] T dca45e62639f49b4a8367d6868dabc07 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.862227 13727 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:09:18.862633 13726 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:09:18.862635 13884 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:18.860280 13897 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:18.864705 13884 raft_consensus.cc:2749] T dca45e62639f49b4a8367d6868dabc07 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:18.865043 13897 raft_consensus.cc:2804] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.865846 13876 tablet_bootstrap.cc:492] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7: No bootstrap required, opened a new log
I20260709 12:09:18.866564 13876 ts_tablet_manager.cc:1403] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent bootstrapping tablet: real 0.054s	user 0.025s	sys 0.027s
I20260709 12:09:18.865885 13897 raft_consensus.cc:697] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:09:18.871065 13878 tablet_bootstrap.cc:492] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd: No bootstrap required, opened a new log
I20260709 12:09:18.870903 13897 consensus_queue.cc:237] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.872687 13876 raft_consensus.cc:359] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.873175 13877 tablet_bootstrap.cc:654] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.873481 13876 raft_consensus.cc:385] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.874048 13876 raft_consensus.cc:740] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.874724 13876 consensus_queue.cc:260] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.876893 13878 ts_tablet_manager.cc:1403] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd: Time spent bootstrapping tablet: real 0.063s	user 0.016s	sys 0.013s
I20260709 12:09:18.877738 13876 ts_tablet_manager.cc:1434] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:09:18.881318 13876 tablet_bootstrap.cc:492] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7: Bootstrap starting.
I20260709 12:09:18.883049 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:09:18.883754 13837 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.888204 13876 tablet_bootstrap.cc:654] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.893178 13837 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 1.
I20260709 12:09:18.896075 13876 tablet_bootstrap.cc:492] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7: No bootstrap required, opened a new log
I20260709 12:09:18.895660 13878 raft_consensus.cc:359] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.896536 13878 raft_consensus.cc:385] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.896723 13876 ts_tablet_manager.cc:1403] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.004s
I20260709 12:09:18.896876 13878 raft_consensus.cc:740] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.897981 13941 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.898169 13877 tablet_bootstrap.cc:492] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835: No bootstrap required, opened a new log
I20260709 12:09:18.898831 13877 ts_tablet_manager.cc:1403] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835: Time spent bootstrapping tablet: real 0.054s	user 0.017s	sys 0.013s
I20260709 12:09:18.898566 13941 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.898644 13878 consensus_queue.cc:260] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.901680 13878 ts_tablet_manager.cc:1434] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.002s
I20260709 12:09:18.902325 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:18.903275 13761 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 0.
I20260709 12:09:18.903966 13938 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.904515 13938 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.904793 13651 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:09:18.905095 13876 raft_consensus.cc:359] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.905941 13876 raft_consensus.cc:385] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.905747 13912 raft_consensus.cc:2804] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.906347 13876 raft_consensus.cc:740] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.906472 13912 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.907126 13912 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.907740 13938 leader_election.cc:290] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:18.907428 13876 consensus_queue.cc:260] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.909732 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:18.910485 13837 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 0.
I20260709 12:09:18.910570 13897 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.911165 13876 ts_tablet_manager.cc:1434] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.004s
I20260709 12:09:18.911665 13941 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:18.911532 13897 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.912566 13652 leader_election.cc:304] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:09:18.913620 13941 raft_consensus.cc:2804] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.914146 13941 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.914597 13941 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.915681 13912 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.916050 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:18.916812 13836 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 0.
I20260709 12:09:18.918388 13727 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:09:18.919298 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:18.919515 13959 raft_consensus.cc:2804] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.919938 13761 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 0.
I20260709 12:09:18.920100 13959 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.920538 13959 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.919633 13897 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:18.920759 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:09:18.917860 13584 catalog_manager.cc:5697] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 1 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:18.921396 13763 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.921594 13877 raft_consensus.cc:359] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.922319 13877 raft_consensus.cc:385] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.922612 13877 raft_consensus.cc:740] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.923256 13877 consensus_queue.cc:260] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.920390 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:18.926127 13837 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 0.
I20260709 12:09:18.928958 13877 ts_tablet_manager.cc:1434] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.000s
I20260709 12:09:18.930123 13877 tablet_bootstrap.cc:492] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835: Bootstrap starting.
I20260709 12:09:18.931149 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:18.932077 13876 tablet_bootstrap.cc:492] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7: Bootstrap starting.
W20260709 12:09:18.932458 13726 leader_election.cc:343] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.934516 13959 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.935463 13923 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.939157 13877 tablet_bootstrap.cc:654] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.903447 13878 tablet_bootstrap.cc:492] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd: Bootstrap starting.
I20260709 12:09:18.938934 13923 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.941735 13923 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:18.944373 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:18.947117 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:18.947876 13687 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 0.
W20260709 12:09:18.949129 13800 leader_election.cc:343] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.949909 13763 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 1.
I20260709 12:09:18.950359 13800 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:09:18.951164 13923 raft_consensus.cc:2804] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.951529 13923 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.951879 13923 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.952260 13959 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:18.952806 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:09:18.954435 13726 leader_election.cc:343] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.954535 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:09:18.955188 13837 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.955068 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:09:18.955739 13836 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.941732 13941 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.960125 13941 leader_election.cc:290] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:18.958536 13651 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:09:18.960686 13912 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:18.961292 13912 raft_consensus.cc:2804] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.961730 13912 raft_consensus.cc:697] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:09:18.962296 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:09:18.962890 13761 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.962962 13837 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 1.
I20260709 12:09:18.963630 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:09:18.964332 13835 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.962617 13912 consensus_queue.cc:237] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.966949 13878 tablet_bootstrap.cc:654] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.972443 13876 tablet_bootstrap.cc:654] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.975906 13835 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 1.
I20260709 12:09:18.974246 13687 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.983229 13652 leader_election.cc:304] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:09:18.987445 13941 raft_consensus.cc:2804] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.991271 13585 catalog_manager.cc:5697] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 0 to 1, leader changed from <none> to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 1 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:18.992924 13878 tablet_bootstrap.cc:492] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd: No bootstrap required, opened a new log
I20260709 12:09:18.992959 13941 raft_consensus.cc:697] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:09:18.993798 13878 ts_tablet_manager.cc:1403] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd: Time spent bootstrapping tablet: real 0.091s	user 0.014s	sys 0.002s
I20260709 12:09:18.994478 13941 consensus_queue.cc:237] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.994273 13923 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.997447 13878 raft_consensus.cc:359] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.998227 13878 raft_consensus.cc:385] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.998512 13878 raft_consensus.cc:740] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.999225 13878 consensus_queue.cc:260] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:18.983233 13761 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 1.
I20260709 12:09:18.991614 13836 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 1.
I20260709 12:09:19.003190 13928 consensus_queue.cc:1048] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.003389 13923 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:19.004060 13878 ts_tablet_manager.cc:1434] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:09:19.011287 13877 tablet_bootstrap.cc:492] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835: No bootstrap required, opened a new log
I20260709 12:09:19.013691 13877 ts_tablet_manager.cc:1403] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835: Time spent bootstrapping tablet: real 0.084s	user 0.004s	sys 0.011s
I20260709 12:09:19.014173 13878 tablet_bootstrap.cc:492] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd: Bootstrap starting.
I20260709 12:09:19.015643 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:09:19.016373 13687 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.015796 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:09:19.016419 13877 raft_consensus.cc:359] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.017216 13877 raft_consensus.cc:385] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.017546 13877 raft_consensus.cc:740] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Initialized, Role: FOLLOWER
W20260709 12:09:19.018043 13800 leader_election.cc:343] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.018507 13877 consensus_queue.cc:260] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.013877 13912 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.023168 13912 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.026185 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:19.026683 13727 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:09:19.026872 13761 raft_consensus.cc:2468] T 2e7fcff4988b4d928d7bb79c969a2025 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 0.
I20260709 12:09:19.027184 13877 ts_tablet_manager.cc:1434] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.002s
I20260709 12:09:19.027881 13959 raft_consensus.cc:2804] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.028081 13651 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:09:19.028439 13959 raft_consensus.cc:697] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:09:19.028821 13912 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:19.028103 13877 tablet_bootstrap.cc:492] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835: Bootstrap starting.
I20260709 12:09:19.029451 13938 raft_consensus.cc:2804] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.029347 13959 consensus_queue.cc:237] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.030036 13938 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.030504 13938 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.034693 13876 tablet_bootstrap.cc:492] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7: No bootstrap required, opened a new log
I20260709 12:09:19.035168 13876 ts_tablet_manager.cc:1403] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent bootstrapping tablet: real 0.105s	user 0.015s	sys 0.015s
I20260709 12:09:19.036613 13897 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.037086 13897 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.038281 13876 raft_consensus.cc:359] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.038903 13876 raft_consensus.cc:385] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.039178 13876 raft_consensus.cc:740] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.039624 13897 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:19.039902 13876 consensus_queue.cc:260] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.041224 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:19.041738 13928 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.041888 13836 raft_consensus.cc:2468] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 0.
I20260709 12:09:19.042268 13928 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.042958 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:19.044658 13876 ts_tablet_manager.cc:1434] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260709 12:09:19.045399 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:19.048851 13726 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:09:19.050482 13897 raft_consensus.cc:2749] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.044912 13928 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:19.051718 13877 tablet_bootstrap.cc:654] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.052045 13878 tablet_bootstrap.cc:654] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.045639 13876 tablet_bootstrap.cc:492] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7: Bootstrap starting.
I20260709 12:09:19.049139 13585 catalog_manager.cc:5697] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 0 to 1, leader changed from <none> to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 1 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:19.059042 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:19.059793 13688 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 0.
I20260709 12:09:19.061661 13938 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.066466 13800 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:09:19.070022 13928 raft_consensus.cc:2804] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.070996 13928 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.071504 13928 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.075950 13584 catalog_manager.cc:5697] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 1 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:19.079842 13967 consensus_queue.cc:1048] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:09:19.081702 13941 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:09:19.083096 13941 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.090153 13912 consensus_queue.cc:1048] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:19.090761 13941 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:19.091624 13938 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:19.091470 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:19.092442 13762 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 1.
I20260709 12:09:19.093259 13763 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.093803 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:09:19.094852 13762 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.096961 13651 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:09:19.081569 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:19.102696 13761 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 0.
I20260709 12:09:19.105365 13938 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:19.105903 13938 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:09:19.106319 13938 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:19.106356 13687 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 1.
I20260709 12:09:19.108234 13762 raft_consensus.cc:2468] T 2e7fcff4988b4d928d7bb79c969a2025 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 1.
I20260709 12:09:19.109488 13651 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:09:19.110296 13912 raft_consensus.cc:2804] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.111006 13912 raft_consensus.cc:697] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:09:19.111419 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:19.112109 13912 consensus_queue.cc:237] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.113692 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:09:19.114344 13835 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.120793 13800 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:09:19.123708 13967 raft_consensus.cc:2804] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.121187 13928 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.124259 13967 raft_consensus.cc:697] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:09:19.125468 13967 consensus_queue.cc:237] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.126863 13928 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:19.135293 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:09:19.135645 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:09:19.136157 13687 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.136293 13761 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.144712 13761 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 1.
I20260709 12:09:19.151589 13800 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:09:19.157225 13897 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.143836 13835 raft_consensus.cc:2468] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 1.
I20260709 12:09:19.164371 13928 raft_consensus.cc:2804] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.171795 13928 raft_consensus.cc:697] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:09:19.172729 13928 consensus_queue.cc:237] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.164753 13897 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.179652 13687 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 1.
I20260709 12:09:19.187131 13941 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.171439 13938 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.187712 13941 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.186403 13876 tablet_bootstrap.cc:654] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.197135 13941 leader_election.cc:290] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:19.202873 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:09:19.204057 13878 tablet_bootstrap.cc:492] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd: No bootstrap required, opened a new log
I20260709 12:09:19.204690 13878 ts_tablet_manager.cc:1403] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd: Time spent bootstrapping tablet: real 0.191s	user 0.011s	sys 0.006s
I20260709 12:09:19.214464 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:19.212759 13585 catalog_manager.cc:5697] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 1 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:19.216078 13584 catalog_manager.cc:5697] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 0 to 1, leader changed from <none> to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 1 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:19.217737 13897 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:19.216295 13762 raft_consensus.cc:2393] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 1: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:09:19.220259 13897 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.220736 13897 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.222932 13938 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:19.221840 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:19.228794 13877 tablet_bootstrap.cc:492] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835: No bootstrap required, opened a new log
I20260709 12:09:19.229745 13877 ts_tablet_manager.cc:1403] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835: Time spent bootstrapping tablet: real 0.202s	user 0.002s	sys 0.016s
I20260709 12:09:19.235618 13878 raft_consensus.cc:359] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.236290 13878 raft_consensus.cc:385] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.236588 13878 raft_consensus.cc:740] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.240788 13837 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.243376 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:19.244338 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:19.245160 13836 raft_consensus.cc:2393] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 1: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:09:19.248029 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:09:19.248696 13727 leader_election.cc:343] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.246261 13833 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 0.
I20260709 12:09:19.241850 13897 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:19.276041 13941 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.276829 13941 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.302237 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:19.317910 13651 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:09:19.324746 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:19.329651 13912 raft_consensus.cc:2749] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:19.329399 13651 leader_election.cc:304] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:09:19.344388 13726 leader_election.cc:343] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.344844 13912 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.344558 13878 consensus_queue.cc:260] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.344944 13726 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:09:19.345716 13727 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:09:19.345948 13897 raft_consensus.cc:2749] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.346699 13884 raft_consensus.cc:2804] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.347179 13884 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.348443 13884 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:19.348896 13975 log.cc:927] Time spent T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 12:09:19.350529 13877 raft_consensus.cc:359] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.351322 13877 raft_consensus.cc:385] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.351639 13877 raft_consensus.cc:740] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.352542 13877 consensus_queue.cc:260] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:09:19.353399 13726 leader_election.cc:343] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.355525 13877 ts_tablet_manager.cc:1434] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835: Time spent starting tablet: real 0.124s	user 0.001s	sys 0.006s
I20260709 12:09:19.356634 13877 tablet_bootstrap.cc:492] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835: Bootstrap starting.
I20260709 12:09:19.360208 13938 consensus_queue.cc:1048] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.363677 13878 ts_tablet_manager.cc:1434] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd: Time spent starting tablet: real 0.159s	user 0.011s	sys 0.001s
I20260709 12:09:19.387863 13878 tablet_bootstrap.cc:492] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd: Bootstrap starting.
I20260709 12:09:19.398428 13687 raft_consensus.cc:1240] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:19.401944 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:19.406890 13876 tablet_bootstrap.cc:492] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7: No bootstrap required, opened a new log
I20260709 12:09:19.406646 13981 consensus_queue.cc:1048] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:09:19.407437 13876 ts_tablet_manager.cc:1403] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent bootstrapping tablet: real 0.362s	user 0.013s	sys 0.009s
I20260709 12:09:19.395648 13884 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.412689 13912 raft_consensus.cc:2749] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.411785 13928 consensus_queue.cc:1059] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:09:19.414038 13967 raft_consensus.cc:3055] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:19.414575 13967 raft_consensus.cc:740] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:09:19.415968 13876 raft_consensus.cc:359] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.415747 13967 consensus_queue.cc:260] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.416699 13876 raft_consensus.cc:385] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.417037 13876 raft_consensus.cc:740] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.417588 13967 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:19.425240 13876 consensus_queue.cc:260] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.428138 13877 tablet_bootstrap.cc:654] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.429091 13878 tablet_bootstrap.cc:654] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.429271 13876 ts_tablet_manager.cc:1434] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 12:09:19.432767 13876 tablet_bootstrap.cc:492] T a3c0f10b06fa4aa48a99239da6d81a1f P 3f37c9cc9dda46b4be21dd675ba78fb7: Bootstrap starting.
I20260709 12:09:19.430765 13958 consensus_queue.cc:1048] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:09:19.438944 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:09:19.434448 13959 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.447892 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:09:19.448532 13834 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.448959 13877 tablet_bootstrap.cc:492] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835: No bootstrap required, opened a new log
I20260709 12:09:19.444698 13959 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.449478 13877 ts_tablet_manager.cc:1403] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835: Time spent bootstrapping tablet: real 0.093s	user 0.012s	sys 0.002s
W20260709 12:09:19.450052 13726 leader_election.cc:343] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.446373 13884 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:19.461887 13959 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:19.463723 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:19.464011 13877 raft_consensus.cc:359] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.462519 13959 consensus_queue.cc:1048] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.467065 13897 consensus_queue.cc:1048] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.469640 13834 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 1.
I20260709 12:09:19.464736 13877 raft_consensus.cc:385] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.470118 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:19.475085 13877 raft_consensus.cc:740] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.475946 13877 consensus_queue.cc:260] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.475386 13583 catalog_manager.cc:5697] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 1 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
W20260709 12:09:19.478547 13727 leader_election.cc:343] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.474820 13833 raft_consensus.cc:2393] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 1: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:09:19.482731 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:09:19.484609 13726 leader_election.cc:343] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.485178 13726 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:09:19.473510 13941 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:19.486775 13876 tablet_bootstrap.cc:654] T a3c0f10b06fa4aa48a99239da6d81a1f P 3f37c9cc9dda46b4be21dd675ba78fb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.487867 13877 ts_tablet_manager.cc:1434] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.001s
I20260709 12:09:19.488006 13884 raft_consensus.cc:2749] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.490623 13877 tablet_bootstrap.cc:492] T 15347ea1eb2348e7b262bd0d59ce6f3a P b98d2519bb504dc6905ed2ede4571835: Bootstrap starting.
I20260709 12:09:19.491896 13912 consensus_queue.cc:1048] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:19.492257 13652 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:09:19.495639 13727 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:09:19.497705 13884 raft_consensus.cc:2804] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.499516 13884 raft_consensus.cc:697] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:09:19.501597 13884 consensus_queue.cc:237] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.506567 13941 consensus_queue.cc:1048] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:19.504436 13981 consensus_queue.cc:1048] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:19.498101 13912 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.535596 13967 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.538050 13967 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.540037 13967 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:19.542683 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:19.543238 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:19.543931 13763 raft_consensus.cc:2468] T dca45e62639f49b4a8367d6868dabc07 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 0.
W20260709 12:09:19.545060 13800 leader_election.cc:343] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.546046 13800 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:09:19.547081 13967 raft_consensus.cc:2804] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.547561 13967 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.548038 13967 raft_consensus.cc:3060] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.566216 13877 tablet_bootstrap.cc:654] T 15347ea1eb2348e7b262bd0d59ce6f3a P b98d2519bb504dc6905ed2ede4571835: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.575448 13878 tablet_bootstrap.cc:492] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd: No bootstrap required, opened a new log
I20260709 12:09:19.576010 13878 ts_tablet_manager.cc:1403] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd: Time spent bootstrapping tablet: real 0.211s	user 0.019s	sys 0.024s
I20260709 12:09:19.566807 13967 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.581240 13967 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:19.583599 13981 consensus_queue.cc:1048] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.583983 13878 raft_consensus.cc:359] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.584700 13878 raft_consensus.cc:385] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.585039 13878 raft_consensus.cc:740] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.589233 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:09:19.590029 13762 raft_consensus.cc:3060] T dca45e62639f49b4a8367d6868dabc07 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.595824 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:09:19.598541 13800 leader_election.cc:343] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.600013 13928 consensus_queue.cc:1048] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.599761 13583 catalog_manager.cc:5697] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 1 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:19.604009 13878 consensus_queue.cc:260] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.604650 13928 consensus_queue.cc:1048] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:09:19.609282 13878 ts_tablet_manager.cc:1434] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd: Time spent starting tablet: real 0.033s	user 0.004s	sys 0.003s
I20260709 12:09:19.610683 13878 tablet_bootstrap.cc:492] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd: Bootstrap starting.
I20260709 12:09:19.614019 13762 raft_consensus.cc:2468] T dca45e62639f49b4a8367d6868dabc07 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 1.
I20260709 12:09:19.636144 13912 raft_consensus.cc:2749] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.624491 13800 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:09:19.638979 13979 raft_consensus.cc:2804] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.639518 13979 raft_consensus.cc:697] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:09:19.640461 13979 consensus_queue.cc:237] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.641978 13878 tablet_bootstrap.cc:654] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.645398 13959 consensus_queue.cc:1048] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:19.647957 13876 tablet_bootstrap.cc:492] T a3c0f10b06fa4aa48a99239da6d81a1f P 3f37c9cc9dda46b4be21dd675ba78fb7: No bootstrap required, opened a new log
I20260709 12:09:19.648505 13876 ts_tablet_manager.cc:1403] T a3c0f10b06fa4aa48a99239da6d81a1f P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent bootstrapping tablet: real 0.216s	user 0.014s	sys 0.005s
I20260709 12:09:19.653293 13981 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.654507 13981 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.658607 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:19.659453 13876 raft_consensus.cc:359] T a3c0f10b06fa4aa48a99239da6d81a1f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.660215 13876 raft_consensus.cc:385] T a3c0f10b06fa4aa48a99239da6d81a1f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.660517 13876 raft_consensus.cc:740] T a3c0f10b06fa4aa48a99239da6d81a1f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.660621 13981 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:19.661216 13876 consensus_queue.cc:260] T a3c0f10b06fa4aa48a99239da6d81a1f P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.661970 13878 tablet_bootstrap.cc:492] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd: No bootstrap required, opened a new log
I20260709 12:09:19.662045 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:19.662453 13878 ts_tablet_manager.cc:1403] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd: Time spent bootstrapping tablet: real 0.052s	user 0.009s	sys 0.005s
I20260709 12:09:19.662935 13835 raft_consensus.cc:2393] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 1: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:09:19.663434 13876 ts_tablet_manager.cc:1434] T a3c0f10b06fa4aa48a99239da6d81a1f P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:09:19.663995 13652 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:09:19.664350 13876 tablet_bootstrap.cc:492] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7: Bootstrap starting.
I20260709 12:09:19.664867 13912 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.665187 13878 raft_consensus.cc:359] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.666002 13878 raft_consensus.cc:385] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.666275 13878 raft_consensus.cc:740] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.667016 13878 consensus_queue.cc:260] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.670262 13878 ts_tablet_manager.cc:1434] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:09:19.671217 13878 tablet_bootstrap.cc:492] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd: Bootstrap starting.
I20260709 12:09:19.671391 13877 tablet_bootstrap.cc:492] T 15347ea1eb2348e7b262bd0d59ce6f3a P b98d2519bb504dc6905ed2ede4571835: No bootstrap required, opened a new log
I20260709 12:09:19.671571 13876 tablet_bootstrap.cc:654] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.671902 13877 ts_tablet_manager.cc:1403] T 15347ea1eb2348e7b262bd0d59ce6f3a P b98d2519bb504dc6905ed2ede4571835: Time spent bootstrapping tablet: real 0.182s	user 0.012s	sys 0.022s
I20260709 12:09:19.674767 13938 consensus_queue.cc:1048] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:19.676079 13877 raft_consensus.cc:359] T 15347ea1eb2348e7b262bd0d59ce6f3a P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.676823 13877 raft_consensus.cc:385] T 15347ea1eb2348e7b262bd0d59ce6f3a P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.677107 13877 raft_consensus.cc:740] T 15347ea1eb2348e7b262bd0d59ce6f3a P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.678025 13877 consensus_queue.cc:260] T 15347ea1eb2348e7b262bd0d59ce6f3a P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.680823 13877 ts_tablet_manager.cc:1434] T 15347ea1eb2348e7b262bd0d59ce6f3a P b98d2519bb504dc6905ed2ede4571835: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:09:19.682032 13877 tablet_bootstrap.cc:492] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835: Bootstrap starting.
I20260709 12:09:19.684952 13912 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:09:19.685158 13800 consensus_peers.cc:597] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd -> Peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Couldn't send request to peer 3f37c9cc9dda46b4be21dd675ba78fb7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:19.687275 13876 tablet_bootstrap.cc:492] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7: No bootstrap required, opened a new log
I20260709 12:09:19.699294 13876 ts_tablet_manager.cc:1403] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.005s
I20260709 12:09:19.689038 13877 tablet_bootstrap.cc:654] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.691789 13878 tablet_bootstrap.cc:654] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.702248 13876 raft_consensus.cc:359] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.702952 13876 raft_consensus.cc:385] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.703260 13876 raft_consensus.cc:740] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.703990 13876 consensus_queue.cc:260] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.706233 13876 ts_tablet_manager.cc:1434] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:09:19.707291 13876 tablet_bootstrap.cc:492] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7: Bootstrap starting.
W20260709 12:09:19.714038 13634 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:19.714640 13876 tablet_bootstrap.cc:654] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.738262 13967 consensus_queue.cc:1048] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:19.762172 13877 tablet_bootstrap.cc:492] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835: No bootstrap required, opened a new log
I20260709 12:09:19.763051 13877 ts_tablet_manager.cc:1403] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835: Time spent bootstrapping tablet: real 0.081s	user 0.008s	sys 0.006s
I20260709 12:09:19.766464 13878 tablet_bootstrap.cc:492] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd: No bootstrap required, opened a new log
I20260709 12:09:19.767045 13876 tablet_bootstrap.cc:492] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7: No bootstrap required, opened a new log
I20260709 12:09:19.767163 13878 ts_tablet_manager.cc:1403] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd: Time spent bootstrapping tablet: real 0.096s	user 0.029s	sys 0.029s
I20260709 12:09:19.766866 13877 raft_consensus.cc:359] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.767944 13877 raft_consensus.cc:385] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.768280 13877 raft_consensus.cc:740] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.769061 13877 consensus_queue.cc:260] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.770882 13586 catalog_manager.cc:5697] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 1 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:19.771672 13878 raft_consensus.cc:359] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.772501 13938 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.772576 13878 raft_consensus.cc:385] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.773059 13878 raft_consensus.cc:740] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.773207 13938 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.773890 13878 consensus_queue.cc:260] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.767621 13876 ts_tablet_manager.cc:1403] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent bootstrapping tablet: real 0.061s	user 0.034s	sys 0.021s
I20260709 12:09:19.777439 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:19.778239 13763 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 0.
I20260709 12:09:19.779631 13878 ts_tablet_manager.cc:1434] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:09:19.780224 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:19.780584 13876 raft_consensus.cc:359] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.781031 13878 tablet_bootstrap.cc:492] T 658b56fb08f0467fa5a9d602dd275f81 P 96701a74fdee481fb5f54aac841e17dd: Bootstrap starting.
I20260709 12:09:19.781374 13876 raft_consensus.cc:385] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.782407 13876 raft_consensus.cc:740] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.782862 13651 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:09:19.783669 13652 leader_election.cc:343] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.783263 13876 consensus_queue.cc:260] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.783990 13912 raft_consensus.cc:2804] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.784495 13912 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.784936 13912 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.776648 13938 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:19.771926 13877 ts_tablet_manager.cc:1434] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:09:19.789000 13878 tablet_bootstrap.cc:654] T 658b56fb08f0467fa5a9d602dd275f81 P 96701a74fdee481fb5f54aac841e17dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.789654 13877 tablet_bootstrap.cc:492] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835: Bootstrap starting.
I20260709 12:09:19.797966 13877 tablet_bootstrap.cc:654] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.799012 13876 ts_tablet_manager.cc:1434] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.001s
I20260709 12:09:19.800132 13876 tablet_bootstrap.cc:492] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7: Bootstrap starting.
I20260709 12:09:19.807781 13938 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.808347 13938 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.810537 13938 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:19.811592 13877 tablet_bootstrap.cc:492] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835: No bootstrap required, opened a new log
I20260709 12:09:19.812131 13877 ts_tablet_manager.cc:1403] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835: Time spent bootstrapping tablet: real 0.023s	user 0.007s	sys 0.007s
I20260709 12:09:19.812340 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:19.813079 13835 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 0.
I20260709 12:09:19.814527 13652 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:09:19.815332 13877 raft_consensus.cc:359] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.816148 13877 raft_consensus.cc:385] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.816506 13877 raft_consensus.cc:740] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.817018 13876 tablet_bootstrap.cc:654] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.817018 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:09:19.818953 13651 leader_election.cc:343] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.820173 13938 raft_consensus.cc:2804] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.820650 13938 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.821151 13938 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.817348 13877 consensus_queue.cc:260] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.809162 13912 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.824643 13877 ts_tablet_manager.cc:1434] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:09:19.828389 13877 tablet_bootstrap.cc:492] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835: Bootstrap starting.
I20260709 12:09:19.830579 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:09:19.831506 13763 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.840531 13877 tablet_bootstrap.cc:654] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.846634 13763 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 1.
I20260709 12:09:19.853705 13912 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:19.855682 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:09:19.857933 13652 leader_election.cc:343] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.858644 13652 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:09:19.861042 13878 tablet_bootstrap.cc:492] T 658b56fb08f0467fa5a9d602dd275f81 P 96701a74fdee481fb5f54aac841e17dd: No bootstrap required, opened a new log
I20260709 12:09:19.860954 13912 raft_consensus.cc:2804] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.861711 13878 ts_tablet_manager.cc:1403] T 658b56fb08f0467fa5a9d602dd275f81 P 96701a74fdee481fb5f54aac841e17dd: Time spent bootstrapping tablet: real 0.081s	user 0.015s	sys 0.033s
I20260709 12:09:19.862358 13912 raft_consensus.cc:697] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:09:19.863776 13912 consensus_queue.cc:237] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.865010 13878 raft_consensus.cc:359] T 658b56fb08f0467fa5a9d602dd275f81 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.865669 13878 raft_consensus.cc:385] T 658b56fb08f0467fa5a9d602dd275f81 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.866024 13878 raft_consensus.cc:740] T 658b56fb08f0467fa5a9d602dd275f81 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.867030 13878 consensus_queue.cc:260] T 658b56fb08f0467fa5a9d602dd275f81 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.869134 13877 tablet_bootstrap.cc:492] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835: No bootstrap required, opened a new log
I20260709 12:09:19.869748 13877 ts_tablet_manager.cc:1403] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835: Time spent bootstrapping tablet: real 0.042s	user 0.010s	sys 0.007s
I20260709 12:09:19.873297 13967 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.872906 13877 raft_consensus.cc:359] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.874078 13877 raft_consensus.cc:385] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.874507 13877 raft_consensus.cc:740] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.873907 13967 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.875313 13877 consensus_queue.cc:260] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.877846 13877 ts_tablet_manager.cc:1434] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 12:09:19.878995 13877 tablet_bootstrap.cc:492] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835: Bootstrap starting.
I20260709 12:09:19.879274 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:19.882334 13959 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.882704 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:19.883078 13959 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.884145 13967 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:09:19.886157 13800 leader_election.cc:343] T 658b56fb08f0467fa5a9d602dd275f81 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.886723 13877 tablet_bootstrap.cc:654] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.887760 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:19.889086 13959 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:19.889210 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:09:19.890415 13800 leader_election.cc:343] T 658b56fb08f0467fa5a9d602dd275f81 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.891085 13800 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:09:19.893581 13726 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:09:19.895650 13959 raft_consensus.cc:2749] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.897382 13967 raft_consensus.cc:2749] T 658b56fb08f0467fa5a9d602dd275f81 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.873905 13938 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.901999 13959 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.903055 13959 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.908023 13959 leader_election.cc:290] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:19.910748 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:09:19.907559 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:19.912173 13686 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 1.
I20260709 12:09:19.910888 13878 ts_tablet_manager.cc:1434] T 658b56fb08f0467fa5a9d602dd275f81 P 96701a74fdee481fb5f54aac841e17dd: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.001s
I20260709 12:09:19.909036 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:09:19.913451 13651 leader_election.cc:343] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.913865 13835 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 1.
I20260709 12:09:19.915021 13726 leader_election.cc:304] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:09:19.921669 13959 raft_consensus.cc:2804] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:19.922533 13959 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.923250 13959 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:19.927608 13878 tablet_bootstrap.cc:492] T c89d2a3019c74941a4f8dffc9aa5cf40 P 96701a74fdee481fb5f54aac841e17dd: Bootstrap starting.
I20260709 12:09:19.938266 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:09:19.939116 13878 tablet_bootstrap.cc:654] T c89d2a3019c74941a4f8dffc9aa5cf40 P 96701a74fdee481fb5f54aac841e17dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.939105 13835 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.939457 13586 catalog_manager.cc:5697] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 0 to 1, leader changed from <none> to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 1 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:19.944753 13876 tablet_bootstrap.cc:492] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7: No bootstrap required, opened a new log
I20260709 12:09:19.945560 13876 ts_tablet_manager.cc:1403] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent bootstrapping tablet: real 0.146s	user 0.034s	sys 0.081s
I20260709 12:09:19.952121 13959 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.956377 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:09:19.956207 13876 raft_consensus.cc:359] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.957010 13686 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:19.941860 13938 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:19.957080 13876 raft_consensus.cc:385] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.959410 13876 raft_consensus.cc:740] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.960266 13876 consensus_queue.cc:260] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.963477 13876 ts_tablet_manager.cc:1434] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 12:09:19.961515 13959 leader_election.cc:290] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:19.964953 13876 tablet_bootstrap.cc:492] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7: Bootstrap starting.
I20260709 12:09:19.975723 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:09:19.976838 13836 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:19.982926 13686 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 2.
I20260709 12:09:19.986248 13726 leader_election.cc:304] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:09:19.993032 13876 tablet_bootstrap.cc:654] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.995195 13877 tablet_bootstrap.cc:492] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835: No bootstrap required, opened a new log
I20260709 12:09:19.995754 13877 ts_tablet_manager.cc:1403] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835: Time spent bootstrapping tablet: real 0.117s	user 0.042s	sys 0.061s
I20260709 12:09:19.993530 13836 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 2.
I20260709 12:09:19.998252 13835 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 1.
I20260709 12:09:19.999670 13652 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:09:20.000586 13877 raft_consensus.cc:359] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.001056 13938 raft_consensus.cc:2804] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.001473 13877 raft_consensus.cc:385] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.001853 13877 raft_consensus.cc:740] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.002032 13938 raft_consensus.cc:697] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:09:20.007781 13967 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.015980 13938 consensus_queue.cc:237] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.016506 13967 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.016681 13884 consensus_queue.cc:1048] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:20.015638 13877 consensus_queue.cc:260] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:19.990064 13959 raft_consensus.cc:2804] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:20.019299 13877 ts_tablet_manager.cc:1434] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.000s
I20260709 12:09:20.021152 13959 raft_consensus.cc:697] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:09:20.021525 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:20.022217 13877 tablet_bootstrap.cc:492] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835: Bootstrap starting.
I20260709 12:09:20.022328 13686 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 0.
I20260709 12:09:20.022459 13878 tablet_bootstrap.cc:492] T c89d2a3019c74941a4f8dffc9aa5cf40 P 96701a74fdee481fb5f54aac841e17dd: No bootstrap required, opened a new log
I20260709 12:09:20.023214 13878 ts_tablet_manager.cc:1403] T c89d2a3019c74941a4f8dffc9aa5cf40 P 96701a74fdee481fb5f54aac841e17dd: Time spent bootstrapping tablet: real 0.096s	user 0.025s	sys 0.010s
I20260709 12:09:20.022451 13959 consensus_queue.cc:237] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.024003 13800 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:09:20.025231 13979 raft_consensus.cc:2804] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.025676 13979 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.026218 13979 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.029927 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:20.031164 13763 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 0.
I20260709 12:09:20.028745 13967 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:20.036592 13979 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.036595 13878 raft_consensus.cc:359] T c89d2a3019c74941a4f8dffc9aa5cf40 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.037683 13876 tablet_bootstrap.cc:492] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7: No bootstrap required, opened a new log
I20260709 12:09:20.038062 13878 raft_consensus.cc:385] T c89d2a3019c74941a4f8dffc9aa5cf40 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.038322 13876 ts_tablet_manager.cc:1403] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent bootstrapping tablet: real 0.074s	user 0.013s	sys 0.009s
I20260709 12:09:20.038404 13878 raft_consensus.cc:740] T c89d2a3019c74941a4f8dffc9aa5cf40 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.039390 13878 consensus_queue.cc:260] T c89d2a3019c74941a4f8dffc9aa5cf40 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.040607 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:09:20.041429 13686 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.042119 13876 raft_consensus.cc:359] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.042870 13876 raft_consensus.cc:385] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.043156 13876 raft_consensus.cc:740] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.043305 13878 ts_tablet_manager.cc:1434] T c89d2a3019c74941a4f8dffc9aa5cf40 P 96701a74fdee481fb5f54aac841e17dd: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:09:20.044049 13876 consensus_queue.cc:260] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.045544 13878 tablet_bootstrap.cc:492] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd: Bootstrap starting.
I20260709 12:09:20.046505 13876 ts_tablet_manager.cc:1434] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:09:20.047483 13876 tablet_bootstrap.cc:492] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7: Bootstrap starting.
I20260709 12:09:20.053074 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:09:20.074297 13763 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.059142 13979 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:20.060423 13583 catalog_manager.cc:5697] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 0 to 1, leader changed from <none> to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 1 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:20.079048 13878 tablet_bootstrap.cc:654] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.063366 13584 catalog_manager.cc:5697] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 0 to 2, leader changed from <none> to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 2 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:20.082530 13877 tablet_bootstrap.cc:654] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.050050 13686 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 1.
I20260709 12:09:20.067349 13941 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.087725 13941 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.067831 13981 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.090106 13981 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.092270 13981 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:20.068274 13967 consensus_queue.cc:1048] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:20.096189 13967 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.096706 13967 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.099927 13941 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:20.069695 13884 consensus_queue.cc:1048] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:20.104048 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:20.104804 13763 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 1.
I20260709 12:09:20.105582 13876 tablet_bootstrap.cc:654] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.106438 13800 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:09:20.108368 13979 raft_consensus.cc:2804] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.109151 13979 raft_consensus.cc:697] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:09:20.110273 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:20.110772 13979 consensus_queue.cc:237] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.113330 13967 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:09:20.116216 13652 leader_election.cc:343] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.118183 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:20.119202 13688 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 0.
I20260709 12:09:20.119426 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:20.120733 13762 raft_consensus.cc:2393] T dca45e62639f49b4a8367d6868dabc07 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 1: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:09:20.121130 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:20.122829 13763 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 0.
I20260709 12:09:20.124297 13800 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:09:20.126122 13928 raft_consensus.cc:2804] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.132120 13928 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.132534 13928 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.130343 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:20.126041 13651 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:09:20.144982 13651 leader_election.cc:343] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.146598 13688 raft_consensus.cc:3060] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.149632 13928 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.155860 13583 catalog_manager.cc:5697] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 1 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:20.145738 13651 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:09:20.168797 13878 tablet_bootstrap.cc:492] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd: No bootstrap required, opened a new log
I20260709 12:09:20.169396 13878 ts_tablet_manager.cc:1403] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd: Time spent bootstrapping tablet: real 0.124s	user 0.026s	sys 0.020s
I20260709 12:09:20.175072 13941 raft_consensus.cc:2749] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:20.188092 13876 tablet_bootstrap.cc:492] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7: No bootstrap required, opened a new log
I20260709 12:09:20.188731 13876 ts_tablet_manager.cc:1403] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent bootstrapping tablet: real 0.141s	user 0.020s	sys 0.023s
I20260709 12:09:20.193117 13877 tablet_bootstrap.cc:492] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835: No bootstrap required, opened a new log
I20260709 12:09:20.193675 13877 ts_tablet_manager.cc:1403] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835: Time spent bootstrapping tablet: real 0.172s	user 0.017s	sys 0.008s
I20260709 12:09:20.194051 13928 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:20.194280 13878 raft_consensus.cc:359] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.196636 13878 raft_consensus.cc:385] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.196365 13877 raft_consensus.cc:359] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.196920 13878 raft_consensus.cc:740] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.197057 13877 raft_consensus.cc:385] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.197346 13877 raft_consensus.cc:740] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.197625 13878 consensus_queue.cc:260] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.198163 13877 consensus_queue.cc:260] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.199077 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:09:20.199741 13760 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.200811 13877 ts_tablet_manager.cc:1434] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:09:20.200811 13878 ts_tablet_manager.cc:1434] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 12:09:20.202000 13877 tablet_bootstrap.cc:492] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835: Bootstrap starting.
I20260709 12:09:20.206521 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:09:20.201440 13876 raft_consensus.cc:359] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.207219 13687 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.209151 13878 tablet_bootstrap.cc:492] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd: Bootstrap starting.
I20260709 12:09:20.207844 13876 raft_consensus.cc:385] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.210304 13876 raft_consensus.cc:740] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.252677 13763 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:20.256170 14022 log.cc:927] Time spent T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
W20260709 12:09:20.254447 14025 log.cc:927] Time spent T dca45e62639f49b4a8367d6868dabc07 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.074s	user 0.001s	sys 0.001s
I20260709 12:09:20.265302 13958 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.265911 13958 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.267021 13760 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 1.
I20260709 12:09:20.268308 13958 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:20.268554 13800 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:09:20.269526 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:20.270293 13836 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 0.
I20260709 12:09:20.270704 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:20.271256 13967 raft_consensus.cc:2804] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.271694 13981 raft_consensus.cc:2749] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:20.272867 13727 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:09:20.273803 13958 raft_consensus.cc:2804] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.274191 13958 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.274573 13958 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.276163 13878 tablet_bootstrap.cc:654] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:20.276579 13726 leader_election.cc:343] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.270938 13876 consensus_queue.cc:260] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.293274 13877 tablet_bootstrap.cc:654] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.294661 13979 consensus_queue.cc:1048] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:20.299988 13876 ts_tablet_manager.cc:1434] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent starting tablet: real 0.111s	user 0.008s	sys 0.002s
I20260709 12:09:20.302772 13876 tablet_bootstrap.cc:492] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7: Bootstrap starting.
I20260709 12:09:20.301558 13967 raft_consensus.cc:697] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:09:20.317627 13687 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 1.
W20260709 12:09:20.317938 13652 consensus_peers.cc:597] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 -> Peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Couldn't send request to peer 96701a74fdee481fb5f54aac841e17dd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:20.318579 13928 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.318995 13928 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.324360 13928 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:20.337570 13967 consensus_queue.cc:237] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.338791 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:20.339766 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:20.341451 13763 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 0.
I20260709 12:09:20.349398 13877 tablet_bootstrap.cc:492] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835: No bootstrap required, opened a new log
I20260709 12:09:20.349992 13877 ts_tablet_manager.cc:1403] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835: Time spent bootstrapping tablet: real 0.148s	user 0.013s	sys 0.023s
I20260709 12:09:20.350726 13878 tablet_bootstrap.cc:492] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd: No bootstrap required, opened a new log
I20260709 12:09:20.351233 13878 ts_tablet_manager.cc:1403] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd: Time spent bootstrapping tablet: real 0.142s	user 0.019s	sys 0.023s
I20260709 12:09:20.353259 13876 tablet_bootstrap.cc:654] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.353272 13877 raft_consensus.cc:359] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.354699 13877 raft_consensus.cc:385] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.355060 13877 raft_consensus.cc:740] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.355911 13877 consensus_queue.cc:260] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.358532 13800 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
W20260709 12:09:20.367717 13800 leader_election.cc:343] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.370236 13979 raft_consensus.cc:2804] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.370810 13979 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.371315 13979 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.369951 13958 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.374212 13959 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.374920 13959 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.378319 13958 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:20.381240 13959 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:20.384080 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:09:20.384966 13835 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.385075 13878 raft_consensus.cc:359] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.386070 13878 raft_consensus.cc:385] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.386330 13878 raft_consensus.cc:740] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.387091 13878 consensus_queue.cc:260] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.389139 13979 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.389597 13878 ts_tablet_manager.cc:1434] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd: Time spent starting tablet: real 0.038s	user 0.013s	sys 0.004s
I20260709 12:09:20.380219 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:20.392078 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:20.392350 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:09:20.392910 13878 tablet_bootstrap.cc:492] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd: Bootstrap starting.
W20260709 12:09:20.393548 13727 leader_election.cc:343] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.395362 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:09:20.395949 13726 leader_election.cc:343] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.392926 13686 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.398527 13835 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 1.
I20260709 12:09:20.396405 13726 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:09:20.397084 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:09:20.399632 13763 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:20.399930 13726 leader_election.cc:343] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.400650 13959 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:20.402210 13727 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:09:20.403116 13959 raft_consensus.cc:2804] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.403635 13959 raft_consensus.cc:697] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:09:20.404520 13959 consensus_queue.cc:237] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.406399 13686 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 1.
I20260709 12:09:20.408402 13877 ts_tablet_manager.cc:1434] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835: Time spent starting tablet: real 0.058s	user 0.002s	sys 0.014s
I20260709 12:09:20.396354 13979 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:20.409166 13800 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:09:20.410369 13979 raft_consensus.cc:2804] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.410867 13979 raft_consensus.cc:697] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:09:20.411914 13877 tablet_bootstrap.cc:492] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835: Bootstrap starting.
I20260709 12:09:20.411713 13979 consensus_queue.cc:237] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.407181 13763 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 1.
I20260709 12:09:20.418892 13877 tablet_bootstrap.cc:654] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.408452 13586 catalog_manager.cc:5697] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 1 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:20.424823 13878 tablet_bootstrap.cc:654] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.434217 13877 tablet_bootstrap.cc:492] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835: No bootstrap required, opened a new log
I20260709 12:09:20.435045 13958 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.437415 13877 ts_tablet_manager.cc:1403] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.004s
I20260709 12:09:20.437361 13958 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.440559 13877 raft_consensus.cc:359] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.440876 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:20.441334 13877 raft_consensus.cc:385] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.441749 13835 raft_consensus.cc:2393] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 1: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:09:20.441910 13877 raft_consensus.cc:740] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.443334 13877 consensus_queue.cc:260] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.443962 13958 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:20.444276 13941 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.444782 13941 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.445050 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:20.445540 13877 ts_tablet_manager.cc:1434] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 12:09:20.446596 13726 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:09:20.446861 13941 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:20.447767 13958 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.447908 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:09:20.450086 13651 leader_election.cc:343] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.451830 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:20.452550 13835 raft_consensus.cc:2468] T 658b56fb08f0467fa5a9d602dd275f81 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 0.
I20260709 12:09:20.453914 13652 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:09:20.454610 13877 tablet_bootstrap.cc:492] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835: Bootstrap starting.
I20260709 12:09:20.455283 13941 raft_consensus.cc:2804] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.455772 13941 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.455404 13586 catalog_manager.cc:5697] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 1 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:20.458259 13958 raft_consensus.cc:2749] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:20.456219 13941 raft_consensus.cc:3060] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.464252 13877 tablet_bootstrap.cc:654] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.471925 13583 catalog_manager.cc:5697] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 1 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:20.473551 13981 consensus_queue.cc:1048] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:20.477247 13941 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.488056 13876 tablet_bootstrap.cc:492] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7: No bootstrap required, opened a new log
I20260709 12:09:20.488659 13876 ts_tablet_manager.cc:1403] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent bootstrapping tablet: real 0.186s	user 0.031s	sys 0.011s
I20260709 12:09:20.490257 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:09:20.490633 13941 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:20.491024 13835 raft_consensus.cc:3060] T 658b56fb08f0467fa5a9d602dd275f81 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.493558 13878 tablet_bootstrap.cc:492] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd: No bootstrap required, opened a new log
I20260709 12:09:20.494110 13878 ts_tablet_manager.cc:1403] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd: Time spent bootstrapping tablet: real 0.101s	user 0.026s	sys 0.001s
I20260709 12:09:20.498262 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:09:20.498793 13878 raft_consensus.cc:359] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.499585 13878 raft_consensus.cc:385] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:09:20.499905 13651 leader_election.cc:343] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.500453 13876 raft_consensus.cc:359] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.507757 13876 raft_consensus.cc:385] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.508132 13876 raft_consensus.cc:740] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.509195 13877 tablet_bootstrap.cc:492] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835: No bootstrap required, opened a new log
I20260709 12:09:20.508922 13876 consensus_queue.cc:260] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.509817 13877 ts_tablet_manager.cc:1403] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835: Time spent bootstrapping tablet: real 0.055s	user 0.024s	sys 0.003s
I20260709 12:09:20.499925 13878 raft_consensus.cc:740] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.510861 13979 consensus_queue.cc:1048] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:20.511412 13878 consensus_queue.cc:260] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.512825 13877 raft_consensus.cc:359] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.513592 13877 raft_consensus.cc:385] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.513854 13878 ts_tablet_manager.cc:1434] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 12:09:20.513921 13877 raft_consensus.cc:740] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.514780 13877 consensus_queue.cc:260] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.517602 13877 ts_tablet_manager.cc:1434] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:09:20.518628 13836 raft_consensus.cc:1275] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:09:20.518811 13877 tablet_bootstrap.cc:492] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835: Bootstrap starting.
I20260709 12:09:20.520619 13959 consensus_queue.cc:1048] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:20.525524 13876 ts_tablet_manager.cc:1434] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent starting tablet: real 0.037s	user 0.009s	sys 0.000s
I20260709 12:09:20.526618 13876 tablet_bootstrap.cc:492] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7: Bootstrap starting.
I20260709 12:09:20.506454 13835 raft_consensus.cc:2468] T 658b56fb08f0467fa5a9d602dd275f81 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 1.
I20260709 12:09:20.530968 13652 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:09:20.532833 13941 raft_consensus.cc:2804] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.533699 13941 raft_consensus.cc:697] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:09:20.535284 13877 tablet_bootstrap.cc:654] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.534818 13941 consensus_queue.cc:237] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.541132 13878 tablet_bootstrap.cc:492] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd: Bootstrap starting.
I20260709 12:09:20.547147 13979 consensus_queue.cc:1048] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:20.548872 13938 consensus_queue.cc:1048] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:20.562618 13876 tablet_bootstrap.cc:654] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.568145 13687 raft_consensus.cc:1275] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:09:20.565454 13938 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.578208 13938 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.583602 13938 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:20.585378 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:20.586467 13760 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 0.
I20260709 12:09:20.589627 13651 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:09:20.591063 13938 raft_consensus.cc:2804] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.613435 13938 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.613946 13938 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.619167 13878 tablet_bootstrap.cc:654] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.622558 13938 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.604156 13586 catalog_manager.cc:5697] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 0 to 1, leader changed from <none> to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 1 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:20.625099 13876 tablet_bootstrap.cc:492] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7: No bootstrap required, opened a new log
I20260709 12:09:20.625656 13876 ts_tablet_manager.cc:1403] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent bootstrapping tablet: real 0.099s	user 0.019s	sys 0.008s
I20260709 12:09:20.606877 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:20.626781 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:09:20.627343 13652 leader_election.cc:343] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.627676 13760 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.608573 13877 tablet_bootstrap.cc:492] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835: No bootstrap required, opened a new log
I20260709 12:09:20.629988 13877 ts_tablet_manager.cc:1403] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835: Time spent bootstrapping tablet: real 0.112s	user 0.035s	sys 0.039s
I20260709 12:09:20.598215 13941 consensus_queue.cc:1048] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.033s
I20260709 12:09:20.633327 13877 raft_consensus.cc:359] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.634119 13877 raft_consensus.cc:385] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.634399 13877 raft_consensus.cc:740] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.596323 14045 consensus_queue.cc:1048] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.039s
I20260709 12:09:20.636763 13877 consensus_queue.cc:260] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.639614 13877 ts_tablet_manager.cc:1434] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:09:20.640991 13877 tablet_bootstrap.cc:492] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835: Bootstrap starting.
I20260709 12:09:20.643718 13876 raft_consensus.cc:359] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.644541 13876 raft_consensus.cc:385] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.644881 13876 raft_consensus.cc:740] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.658782 13876 consensus_queue.cc:260] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.666124 13876 ts_tablet_manager.cc:1434] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent starting tablet: real 0.040s	user 0.010s	sys 0.001s
I20260709 12:09:20.674937 13877 tablet_bootstrap.cc:654] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.678927 13979 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.679507 13979 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.682097 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:09:20.683912 13652 leader_election.cc:343] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.684861 13878 tablet_bootstrap.cc:492] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd: No bootstrap required, opened a new log
I20260709 12:09:20.685428 13878 ts_tablet_manager.cc:1403] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd: Time spent bootstrapping tablet: real 0.145s	user 0.024s	sys 0.034s
I20260709 12:09:20.685595 13760 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 1.
I20260709 12:09:20.689740 13878 raft_consensus.cc:359] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.690606 13878 raft_consensus.cc:385] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.690919 13878 raft_consensus.cc:740] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.691092 13979 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:20.691831 13878 consensus_queue.cc:260] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.693809 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:20.694442 13878 ts_tablet_manager.cc:1434] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.004s
I20260709 12:09:20.695559 13878 tablet_bootstrap.cc:492] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd: Bootstrap starting.
I20260709 12:09:20.700006 13834 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.701325 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:20.704063 13878 tablet_bootstrap.cc:654] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.710850 13800 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:09:20.678967 13876 tablet_bootstrap.cc:492] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7: Bootstrap starting.
I20260709 12:09:20.733433 13878 tablet_bootstrap.cc:492] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd: No bootstrap required, opened a new log
I20260709 12:09:20.734195 13878 ts_tablet_manager.cc:1403] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd: Time spent bootstrapping tablet: real 0.039s	user 0.013s	sys 0.006s
I20260709 12:09:20.735929 13938 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:20.740617 13651 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:09:20.741710 13938 raft_consensus.cc:2804] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.742357 13938 raft_consensus.cc:697] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:09:20.742738 13877 tablet_bootstrap.cc:492] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835: No bootstrap required, opened a new log
I20260709 12:09:20.743866 13877 ts_tablet_manager.cc:1403] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835: Time spent bootstrapping tablet: real 0.103s	user 0.036s	sys 0.031s
I20260709 12:09:20.744155 13938 consensus_queue.cc:237] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.745371 14045 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:09:20.746009 14045 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.742540 14052 consensus_queue.cc:1048] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:20.748456 14045 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:20.750676 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:20.751333 13835 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 2.
I20260709 12:09:20.752010 13877 raft_consensus.cc:359] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.752789 13877 raft_consensus.cc:385] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.753084 13877 raft_consensus.cc:740] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.753691 13727 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:09:20.754777 13959 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:20.755195 13959 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:09:20.754988 13878 raft_consensus.cc:359] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.755636 13959 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:20.756119 13877 consensus_queue.cc:260] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.756743 13876 tablet_bootstrap.cc:654] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.757902 13877 ts_tablet_manager.cc:1434] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 12:09:20.758219 14045 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.758754 13877 tablet_bootstrap.cc:492] T f1bace76cb204a6d92c38685645dd9db P b98d2519bb504dc6905ed2ede4571835: Bootstrap starting.
I20260709 12:09:20.758769 14045 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.761315 14045 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:20.766075 13877 tablet_bootstrap.cc:654] T f1bace76cb204a6d92c38685645dd9db P b98d2519bb504dc6905ed2ede4571835: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.769308 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:20.773170 13687 raft_consensus.cc:2393] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 2: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:09:20.767517 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:20.774585 13835 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 0.
I20260709 12:09:20.765029 13959 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.776192 13727 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:09:20.779228 14045 raft_consensus.cc:2804] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.779791 14045 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.780304 14045 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.755738 13878 raft_consensus.cc:385] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.780625 13876 tablet_bootstrap.cc:492] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7: No bootstrap required, opened a new log
I20260709 12:09:20.780897 13878 raft_consensus.cc:740] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.776705 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:20.783519 13687 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 0.
I20260709 12:09:20.786031 13979 raft_consensus.cc:2749] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:20.781140 13876 ts_tablet_manager.cc:1403] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent bootstrapping tablet: real 0.102s	user 0.002s	sys 0.008s
I20260709 12:09:20.788741 13878 consensus_queue.cc:260] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.790079 13959 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:20.792654 13878 ts_tablet_manager.cc:1434] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd: Time spent starting tablet: real 0.058s	user 0.006s	sys 0.000s
I20260709 12:09:20.796054 13878 tablet_bootstrap.cc:492] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd: Bootstrap starting.
I20260709 12:09:20.795645 13876 raft_consensus.cc:359] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.807996 13876 raft_consensus.cc:385] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.808511 13876 raft_consensus.cc:740] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Initialized, Role: FOLLOWER
W20260709 12:09:20.793620 13634 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:20.809257 13876 consensus_queue.cc:260] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.811955 13876 ts_tablet_manager.cc:1434] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent starting tablet: real 0.024s	user 0.003s	sys 0.003s
I20260709 12:09:20.813585 13878 tablet_bootstrap.cc:654] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.814116 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:09:20.814990 13687 raft_consensus.cc:2393] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 2: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:09:20.816468 13688 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.817878 13979 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.818693 13979 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.817875 13876 tablet_bootstrap.cc:492] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7: Bootstrap starting.
I20260709 12:09:20.823521 13877 tablet_bootstrap.cc:492] T f1bace76cb204a6d92c38685645dd9db P b98d2519bb504dc6905ed2ede4571835: No bootstrap required, opened a new log
I20260709 12:09:20.824059 13877 ts_tablet_manager.cc:1403] T f1bace76cb204a6d92c38685645dd9db P b98d2519bb504dc6905ed2ede4571835: Time spent bootstrapping tablet: real 0.065s	user 0.026s	sys 0.022s
I20260709 12:09:20.824956 14052 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.825626 14052 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.828051 13877 raft_consensus.cc:359] T f1bace76cb204a6d92c38685645dd9db P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.828784 13877 raft_consensus.cc:385] T f1bace76cb204a6d92c38685645dd9db P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.828691 14052 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:20.829265 13877 raft_consensus.cc:740] T f1bace76cb204a6d92c38685645dd9db P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.829993 13979 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:20.830112 13877 consensus_queue.cc:260] T f1bace76cb204a6d92c38685645dd9db P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.832933 13877 ts_tablet_manager.cc:1434] T f1bace76cb204a6d92c38685645dd9db P b98d2519bb504dc6905ed2ede4571835: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.002s
I20260709 12:09:20.834100 13877 tablet_bootstrap.cc:492] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835: Bootstrap starting.
I20260709 12:09:20.834021 14045 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.837860 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:09:20.838600 13835 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.838325 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:20.839625 13763 raft_consensus.cc:2393] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 1: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:09:20.841429 13877 tablet_bootstrap.cc:654] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.843739 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:20.844513 13687 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 0.
I20260709 12:09:20.846345 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:20.846746 13835 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 1.
I20260709 12:09:20.848338 13727 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:09:20.849112 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:09:20.850104 13685 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:20.861009 13800 leader_election.cc:343] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.862767 13800 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:09:20.863432 13884 raft_consensus.cc:2804] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.858080 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:09:20.865767 13876 tablet_bootstrap.cc:654] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.866258 14045 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:20.906634 13884 raft_consensus.cc:697] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:09:20.908001 13884 consensus_queue.cc:237] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.866359 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:20.875303 13583 catalog_manager.cc:5697] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 0 to 1, leader changed from <none> to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 1 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:20.871341 13959 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.878578 13958 consensus_queue.cc:1048] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:20.917388 13959 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.920338 13959 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:20.921164 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:20.922086 13686 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 0.
W20260709 12:09:20.923636 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 60983us
I20260709 12:09:20.927485 14026 raft_consensus.cc:2804] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.928063 14026 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.928486 14026 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.932585 13834 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 2.
I20260709 12:09:20.936213 13726 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:09:20.938043 13876 tablet_bootstrap.cc:492] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7: No bootstrap required, opened a new log
I20260709 12:09:20.938722 13876 ts_tablet_manager.cc:1403] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent bootstrapping tablet: real 0.121s	user 0.010s	sys 0.004s
I20260709 12:09:20.943396 13876 raft_consensus.cc:359] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.944406 13876 raft_consensus.cc:385] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.944761 13876 raft_consensus.cc:740] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.957439 13958 raft_consensus.cc:2804] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.958333 13958 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.958853 13958 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.966511 13727 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:09:20.968010 14045 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:20.968719 14045 raft_consensus.cc:697] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:09:20.970124 14045 consensus_queue.cc:237] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.970872 13938 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.971616 13938 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.975504 13938 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:20.979992 13685 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 1.
I20260709 12:09:20.945703 13876 consensus_queue.cc:260] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:20.989607 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:20.886046 14052 consensus_queue.cc:1048] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:20.997404 13959 consensus_queue.cc:1048] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:20.999253 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:21.000777 13876 ts_tablet_manager.cc:1434] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent starting tablet: real 0.061s	user 0.009s	sys 0.000s
I20260709 12:09:21.001922 13876 tablet_bootstrap.cc:492] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7: Bootstrap starting.
W20260709 12:09:21.004563 13727 leader_election.cc:343] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.007258 13878 tablet_bootstrap.cc:492] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd: No bootstrap required, opened a new log
I20260709 12:09:21.007920 13878 ts_tablet_manager.cc:1403] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd: Time spent bootstrapping tablet: real 0.212s	user 0.099s	sys 0.087s
I20260709 12:09:21.009182 13877 tablet_bootstrap.cc:492] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835: No bootstrap required, opened a new log
I20260709 12:09:21.009690 13877 ts_tablet_manager.cc:1403] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835: Time spent bootstrapping tablet: real 0.176s	user 0.059s	sys 0.097s
I20260709 12:09:21.012060 13878 raft_consensus.cc:359] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.012359 13877 raft_consensus.cc:359] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.013183 13877 raft_consensus.cc:385] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.012986 13878 raft_consensus.cc:385] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.013510 13877 raft_consensus.cc:740] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.013692 13878 raft_consensus.cc:740] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.014469 13877 consensus_queue.cc:260] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.014899 13878 consensus_queue.cc:260] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.016158 13877 ts_tablet_manager.cc:1434] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:09:21.017006 13958 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.017935 13878 ts_tablet_manager.cc:1434] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:09:21.017058 13877 tablet_bootstrap.cc:492] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835: Bootstrap starting.
I20260709 12:09:21.020836 13876 tablet_bootstrap.cc:654] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.044508 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:09:21.026597 14026 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:09:21.046135 13727 leader_election.cc:343] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.046748 13958 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:21.038906 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:21.039949 13585 catalog_manager.cc:5697] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 1 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:21.047540 14026 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:21.048226 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:09:21.048696 13877 tablet_bootstrap.cc:654] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.049073 13685 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.060204 13878 tablet_bootstrap.cc:492] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd: Bootstrap starting.
I20260709 12:09:21.068593 13878 tablet_bootstrap.cc:654] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.040642 13800 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:09:21.076412 14026 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.079939 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:09:21.080973 13688 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.079900 13652 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:09:21.082264 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:09:21.082558 13938 raft_consensus.cc:2749] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:21.083364 13967 consensus_queue.cc:1048] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:21.084904 13967 consensus_queue.cc:1048] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:21.096482 13688 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 1.
I20260709 12:09:21.098876 13876 tablet_bootstrap.cc:492] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7: No bootstrap required, opened a new log
I20260709 12:09:21.099370 13876 ts_tablet_manager.cc:1403] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent bootstrapping tablet: real 0.098s	user 0.013s	sys 0.024s
I20260709 12:09:21.103453 14026 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.073423 13685 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 1.
I20260709 12:09:21.108217 13876 raft_consensus.cc:359] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.108937 13876 raft_consensus.cc:385] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.109215 13876 raft_consensus.cc:740] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.109313 13726 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:09:21.109973 13876 consensus_queue.cc:260] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:09:21.111016 13800 leader_election.cc:343] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.111521 13884 raft_consensus.cc:2804] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.115684 13884 raft_consensus.cc:697] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:09:21.116732 13884 consensus_queue.cc:237] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.114156 13876 ts_tablet_manager.cc:1434] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 12:09:21.114471 13761 raft_consensus.cc:3060] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.124778 13876 tablet_bootstrap.cc:492] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7: Bootstrap starting.
I20260709 12:09:21.130853 13938 consensus_queue.cc:1048] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:21.132427 13800 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:09:21.133327 14026 raft_consensus.cc:2804] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.126993 13877 tablet_bootstrap.cc:492] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835: No bootstrap required, opened a new log
I20260709 12:09:21.133894 14026 raft_consensus.cc:697] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:09:21.133411 13585 catalog_manager.cc:5697] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 1 to 2, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 2 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:21.141291 13877 ts_tablet_manager.cc:1403] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835: Time spent bootstrapping tablet: real 0.124s	user 0.012s	sys 0.009s
I20260709 12:09:21.140523 14026 consensus_queue.cc:237] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.144438 13884 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.147478 13877 raft_consensus.cc:359] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.150229 13877 raft_consensus.cc:385] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.149303 13884 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.150938 13877 raft_consensus.cc:740] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.155479 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:21.155761 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:21.156301 13686 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 0.
I20260709 12:09:21.156664 13837 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 0.
I20260709 12:09:21.158609 13877 consensus_queue.cc:260] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.159471 13726 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:09:21.160451 14045 raft_consensus.cc:2804] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.160851 14045 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.161173 13877 ts_tablet_manager.cc:1434] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.002s
I20260709 12:09:21.161226 14045 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.164708 13876 tablet_bootstrap.cc:654] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.168967 13877 tablet_bootstrap.cc:492] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835: Bootstrap starting.
I20260709 12:09:21.167796 13981 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.167835 13884 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:21.181633 13912 consensus_queue.cc:1048] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:09:21.188362 14060 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.188959 14060 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.182968 13981 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.197093 13878 tablet_bootstrap.cc:492] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd: No bootstrap required, opened a new log
I20260709 12:09:21.200330 13878 ts_tablet_manager.cc:1403] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd: Time spent bootstrapping tablet: real 0.140s	user 0.013s	sys 0.016s
I20260709 12:09:21.207590 14060 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:21.210506 13878 raft_consensus.cc:359] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.212623 13878 raft_consensus.cc:385] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.213117 13878 raft_consensus.cc:740] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.216156 14045 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.218091 13981 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:21.219667 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:21.221061 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:21.225361 13837 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 2.
I20260709 12:09:21.226732 14045 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:21.227166 13652 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:09:21.224118 13878 consensus_queue.cc:260] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.228255 13938 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:21.228416 13834 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 0.
I20260709 12:09:21.228718 13938 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.229166 13938 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:21.229888 13584 catalog_manager.cc:5697] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 1 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:21.233891 13727 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:09:21.234189 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:09:21.234843 13837 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.234972 13981 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.235486 13981 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.237113 13938 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.238685 14060 raft_consensus.cc:2804] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.239399 14060 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.240440 14060 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:21.241662 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 51661.6us
I20260709 12:09:21.237648 13981 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:21.245832 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:21.245968 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:09:21.247396 13686 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 0.
I20260709 12:09:21.248068 13878 ts_tablet_manager.cc:1434] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd: Time spent starting tablet: real 0.047s	user 0.009s	sys 0.000s
I20260709 12:09:21.247426 13685 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.248829 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:21.249317 13878 tablet_bootstrap.cc:492] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd: Bootstrap starting.
I20260709 12:09:21.248541 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:21.253866 13836 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 0.
I20260709 12:09:21.254938 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:21.255419 13652 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:09:21.263192 13981 raft_consensus.cc:2804] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.265723 13981 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.266489 13981 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.307380 14045 consensus_queue.cc:1048] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:21.288395 13585 catalog_manager.cc:5697] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 1 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:21.360548 13876 tablet_bootstrap.cc:492] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7: No bootstrap required, opened a new log
I20260709 12:09:21.361168 13876 ts_tablet_manager.cc:1403] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent bootstrapping tablet: real 0.237s	user 0.026s	sys 0.001s
I20260709 12:09:21.367431 13877 tablet_bootstrap.cc:654] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.370986 13878 tablet_bootstrap.cc:654] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:21.346622 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 91918.8us
I20260709 12:09:21.381997 13912 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.394131 13912 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.395578 13938 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:21.395572 13837 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 1.
I20260709 12:09:21.396356 13912 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:21.398761 13727 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:09:21.399708 14045 raft_consensus.cc:2804] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.400305 14045 raft_consensus.cc:697] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:09:21.400187 13876 raft_consensus.cc:359] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.400892 13876 raft_consensus.cc:385] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.401185 13876 raft_consensus.cc:740] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.401274 14045 consensus_queue.cc:237] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.399758 13981 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.404500 14060 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.406340 13763 raft_consensus.cc:2393] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 1: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:09:21.408540 13981 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:21.411224 13876 consensus_queue.cc:260] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.416481 14060 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:21.420877 13876 ts_tablet_manager.cc:1434] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent starting tablet: real 0.059s	user 0.006s	sys 0.001s
I20260709 12:09:21.421653 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:09:21.422453 13834 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.427193 13685 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 1.
I20260709 12:09:21.428817 13876 tablet_bootstrap.cc:492] T cad007c01ddb46db81e7206ec8b58024 P 3f37c9cc9dda46b4be21dd675ba78fb7: Bootstrap starting.
I20260709 12:09:21.430747 14082 consensus_queue.cc:1048] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:21.432415 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:09:21.435496 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:21.436367 13760 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 0.
I20260709 12:09:21.436439 14078 consensus_queue.cc:1048] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:21.441856 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:09:21.442677 13835 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:21.442767 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:21.444801 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:09:21.446033 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:09:21.446983 13760 raft_consensus.cc:2393] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 1: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
W20260709 12:09:21.447969 13652 leader_election.cc:343] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.448364 13877 tablet_bootstrap.cc:492] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835: No bootstrap required, opened a new log
I20260709 12:09:21.451220 13688 raft_consensus.cc:1240] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:21.448864 13877 ts_tablet_manager.cc:1403] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835: Time spent bootstrapping tablet: real 0.280s	user 0.022s	sys 0.017s
I20260709 12:09:21.451843 13835 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 3.
I20260709 12:09:21.452757 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:09:21.453549 13688 raft_consensus.cc:2393] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 1: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:09:21.456753 13878 tablet_bootstrap.cc:492] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd: No bootstrap required, opened a new log
I20260709 12:09:21.457288 13878 ts_tablet_manager.cc:1403] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd: Time spent bootstrapping tablet: real 0.208s	user 0.013s	sys 0.014s
I20260709 12:09:21.458134 13652 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:09:21.459357 14078 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:21.459865 14078 raft_consensus.cc:697] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 3 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:09:21.460698 14078 consensus_queue.cc:237] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.461196 13878 raft_consensus.cc:359] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.461990 13878 raft_consensus.cc:385] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.462313 13878 raft_consensus.cc:740] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.463078 13878 consensus_queue.cc:260] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.454547 13877 raft_consensus.cc:359] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.465986 13877 raft_consensus.cc:385] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.466338 13877 raft_consensus.cc:740] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.466956 13877 consensus_queue.cc:260] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.469818 13877 ts_tablet_manager.cc:1434] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 12:09:21.470789 13877 tablet_bootstrap.cc:492] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835: Bootstrap starting.
I20260709 12:09:21.476872 13877 tablet_bootstrap.cc:654] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.478446 13878 ts_tablet_manager.cc:1434] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.000s
I20260709 12:09:21.479642 13878 tablet_bootstrap.cc:492] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd: Bootstrap starting.
I20260709 12:09:21.481819 13876 tablet_bootstrap.cc:654] T cad007c01ddb46db81e7206ec8b58024 P 3f37c9cc9dda46b4be21dd675ba78fb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.485729 14045 consensus_queue.cc:1059] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:21.489411 13878 tablet_bootstrap.cc:654] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.489565 13584 catalog_manager.cc:5697] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 1 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:21.491267 13958 raft_consensus.cc:3055] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:21.491752 13958 raft_consensus.cc:740] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:09:21.494274 13834 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 1.
I20260709 12:09:21.492734 13958 consensus_queue.cc:260] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.496337 13727 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:09:21.497339 13959 raft_consensus.cc:2804] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.497929 13959 raft_consensus.cc:697] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:09:21.498952 13959 consensus_queue.cc:237] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.499670 13958 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:21.502275 13884 consensus_queue.cc:1048] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:21.516187 13878 tablet_bootstrap.cc:492] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd: No bootstrap required, opened a new log
I20260709 12:09:21.516692 13878 ts_tablet_manager.cc:1403] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.003s
I20260709 12:09:21.519845 13878 raft_consensus.cc:359] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.520567 13878 raft_consensus.cc:385] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.520846 13878 raft_consensus.cc:740] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.529155 13877 tablet_bootstrap.cc:492] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835: No bootstrap required, opened a new log
I20260709 12:09:21.529706 13877 ts_tablet_manager.cc:1403] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835: Time spent bootstrapping tablet: real 0.059s	user 0.013s	sys 0.001s
I20260709 12:09:21.532598 13877 raft_consensus.cc:359] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.533293 13877 raft_consensus.cc:385] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.533586 13877 raft_consensus.cc:740] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.534263 13877 consensus_queue.cc:260] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.535207 13651 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:09:21.536391 14082 raft_consensus.cc:2804] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.536871 14082 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.537267 14082 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.538249 13878 consensus_queue.cc:260] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.540620 13878 ts_tablet_manager.cc:1434] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.001s
I20260709 12:09:21.541395 13878 tablet_bootstrap.cc:492] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd: Bootstrap starting.
I20260709 12:09:21.536484 13877 ts_tablet_manager.cc:1434] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:09:21.545733 13877 tablet_bootstrap.cc:492] T f9139e027a704f14bb60e60e22390d08 P b98d2519bb504dc6905ed2ede4571835: Bootstrap starting.
I20260709 12:09:21.546988 14082 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.550969 14082 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:21.551118 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:09:21.552552 13652 leader_election.cc:343] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.557870 13878 tablet_bootstrap.cc:654] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.559478 13877 tablet_bootstrap.cc:654] T f9139e027a704f14bb60e60e22390d08 P b98d2519bb504dc6905ed2ede4571835: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.558360 13585 catalog_manager.cc:5697] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 1 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:21.567229 13800 consensus_peers.cc:597] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd -> Peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Couldn't send request to peer 3f37c9cc9dda46b4be21dd675ba78fb7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:21.569221 13877 tablet_bootstrap.cc:492] T f9139e027a704f14bb60e60e22390d08 P b98d2519bb504dc6905ed2ede4571835: No bootstrap required, opened a new log
I20260709 12:09:21.569803 13877 ts_tablet_manager.cc:1403] T f9139e027a704f14bb60e60e22390d08 P b98d2519bb504dc6905ed2ede4571835: Time spent bootstrapping tablet: real 0.024s	user 0.004s	sys 0.009s
I20260709 12:09:21.572715 13877 raft_consensus.cc:359] T f9139e027a704f14bb60e60e22390d08 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.573416 13877 raft_consensus.cc:385] T f9139e027a704f14bb60e60e22390d08 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.573696 13877 raft_consensus.cc:740] T f9139e027a704f14bb60e60e22390d08 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.574376 13877 consensus_queue.cc:260] T f9139e027a704f14bb60e60e22390d08 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:09:21.576252 13727 consensus_peers.cc:597] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Couldn't send request to peer 96701a74fdee481fb5f54aac841e17dd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:21.576459 13877 ts_tablet_manager.cc:1434] T f9139e027a704f14bb60e60e22390d08 P b98d2519bb504dc6905ed2ede4571835: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:09:21.578648 13877 tablet_bootstrap.cc:492] T 25896261d1204b3d858fb5b478a89034 P b98d2519bb504dc6905ed2ede4571835: Bootstrap starting.
W20260709 12:09:21.581791 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 44376us
I20260709 12:09:21.583427 13651 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:09:21.584134 13878 tablet_bootstrap.cc:492] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd: No bootstrap required, opened a new log
I20260709 12:09:21.584280 14082 raft_consensus.cc:2749] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.584966 13878 ts_tablet_manager.cc:1403] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd: Time spent bootstrapping tablet: real 0.043s	user 0.016s	sys 0.011s
I20260709 12:09:21.586470 13876 tablet_bootstrap.cc:492] T cad007c01ddb46db81e7206ec8b58024 P 3f37c9cc9dda46b4be21dd675ba78fb7: No bootstrap required, opened a new log
I20260709 12:09:21.586933 13876 ts_tablet_manager.cc:1403] T cad007c01ddb46db81e7206ec8b58024 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent bootstrapping tablet: real 0.158s	user 0.010s	sys 0.002s
I20260709 12:09:21.587850 13878 raft_consensus.cc:359] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.588646 13878 raft_consensus.cc:385] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.588963 13878 raft_consensus.cc:740] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.589071 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:09:21.589617 13876 raft_consensus.cc:359] T cad007c01ddb46db81e7206ec8b58024 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.590351 13876 raft_consensus.cc:385] T cad007c01ddb46db81e7206ec8b58024 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.589854 13878 consensus_queue.cc:260] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.590634 13876 raft_consensus.cc:740] T cad007c01ddb46db81e7206ec8b58024 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.590512 13584 catalog_manager.cc:5697] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 2 to 3, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 3 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:21.591404 13876 consensus_queue.cc:260] T cad007c01ddb46db81e7206ec8b58024 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.593335 13878 ts_tablet_manager.cc:1434] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:09:21.589818 13761 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.594573 13878 tablet_bootstrap.cc:492] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd: Bootstrap starting.
I20260709 12:09:21.597975 13877 tablet_bootstrap.cc:654] T 25896261d1204b3d858fb5b478a89034 P b98d2519bb504dc6905ed2ede4571835: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.602006 13878 tablet_bootstrap.cc:654] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.593453 13876 ts_tablet_manager.cc:1434] T cad007c01ddb46db81e7206ec8b58024 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:09:21.603233 13876 tablet_bootstrap.cc:492] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7: Bootstrap starting.
I20260709 12:09:21.612567 13761 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 1.
I20260709 12:09:21.641448 13876 tablet_bootstrap.cc:654] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.648694 13877 tablet_bootstrap.cc:492] T 25896261d1204b3d858fb5b478a89034 P b98d2519bb504dc6905ed2ede4571835: No bootstrap required, opened a new log
I20260709 12:09:21.649190 13877 ts_tablet_manager.cc:1403] T 25896261d1204b3d858fb5b478a89034 P b98d2519bb504dc6905ed2ede4571835: Time spent bootstrapping tablet: real 0.071s	user 0.007s	sys 0.007s
I20260709 12:09:21.650969 13884 consensus_queue.cc:1048] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:21.652114 13877 raft_consensus.cc:359] T 25896261d1204b3d858fb5b478a89034 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.652829 13877 raft_consensus.cc:385] T 25896261d1204b3d858fb5b478a89034 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.653124 13877 raft_consensus.cc:740] T 25896261d1204b3d858fb5b478a89034 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.653658 13979 consensus_queue.cc:1048] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:21.653939 13877 consensus_queue.cc:260] T 25896261d1204b3d858fb5b478a89034 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.657658 13651 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:09:21.659194 14076 raft_consensus.cc:2804] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.659739 14076 raft_consensus.cc:697] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:09:21.660652 13877 ts_tablet_manager.cc:1434] T 25896261d1204b3d858fb5b478a89034 P b98d2519bb504dc6905ed2ede4571835: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 12:09:21.660678 14076 consensus_queue.cc:237] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.662003 13877 tablet_bootstrap.cc:492] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835: Bootstrap starting.
I20260709 12:09:21.666627 13884 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.667344 13884 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.668151 13878 tablet_bootstrap.cc:492] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd: No bootstrap required, opened a new log
I20260709 12:09:21.668686 13878 ts_tablet_manager.cc:1403] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd: Time spent bootstrapping tablet: real 0.074s	user 0.021s	sys 0.022s
I20260709 12:09:21.670886 13876 tablet_bootstrap.cc:492] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7: No bootstrap required, opened a new log
I20260709 12:09:21.671484 13876 ts_tablet_manager.cc:1403] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent bootstrapping tablet: real 0.068s	user 0.009s	sys 0.004s
I20260709 12:09:21.671438 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:21.672508 13878 raft_consensus.cc:359] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.673278 13878 raft_consensus.cc:385] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.673795 13878 raft_consensus.cc:740] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.674559 13876 raft_consensus.cc:359] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.674506 13878 consensus_queue.cc:260] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.675254 13876 raft_consensus.cc:385] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.676551 13878 ts_tablet_manager.cc:1434] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:09:21.675539 13876 raft_consensus.cc:740] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.677702 13884 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:21.679438 13878 tablet_bootstrap.cc:492] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd: Bootstrap starting.
I20260709 12:09:21.680786 14076 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.686108 14076 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.678210 13876 consensus_queue.cc:260] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.690397 13876 ts_tablet_manager.cc:1434] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:09:21.683118 13877 tablet_bootstrap.cc:654] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.690711 13878 tablet_bootstrap.cc:654] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.694443 13876 tablet_bootstrap.cc:492] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7: Bootstrap starting.
I20260709 12:09:21.693239 13583 catalog_manager.cc:5697] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 0 to 1, leader changed from <none> to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 1 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:21.700510 13876 tablet_bootstrap.cc:654] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.702253 14076 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:21.703306 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:21.704155 13685 raft_consensus.cc:2393] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 1: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:09:21.705204 14076 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.705683 14076 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.706604 13726 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:09:21.707870 14076 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:21.708298 14091 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.712963 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:09:21.715643 13652 leader_election.cc:343] T 25896261d1204b3d858fb5b478a89034 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.718402 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:21.721987 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:21.723053 13833 raft_consensus.cc:2468] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 0.
I20260709 12:09:21.725277 13652 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:09:21.726806 13981 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.727430 13981 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.730530 13981 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:21.731281 13981 raft_consensus.cc:2804] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.731738 13981 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.732175 13981 raft_consensus.cc:3060] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.737365 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:21.738489 13833 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 0.
I20260709 12:09:21.740492 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:21.723197 14091 raft_consensus.cc:2749] T cad007c01ddb46db81e7206ec8b58024 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.745139 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:21.747987 13652 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:09:21.750036 14076 raft_consensus.cc:2804] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.750581 14076 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.751040 14076 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.758229 13878 tablet_bootstrap.cc:492] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd: No bootstrap required, opened a new log
I20260709 12:09:21.759948 13878 ts_tablet_manager.cc:1403] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd: Time spent bootstrapping tablet: real 0.081s	user 0.037s	sys 0.009s
I20260709 12:09:21.762089 13878 raft_consensus.cc:359] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.762647 13878 raft_consensus.cc:385] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.762878 13878 raft_consensus.cc:740] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.763465 13878 consensus_queue.cc:260] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.764931 13878 ts_tablet_manager.cc:1434] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
I20260709 12:09:21.767099 13878 tablet_bootstrap.cc:492] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd: Bootstrap starting.
I20260709 12:09:21.773818 13878 tablet_bootstrap.cc:654] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:21.788312 13651 leader_election.cc:343] T 25896261d1204b3d858fb5b478a89034 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.789016 13651 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:09:21.791719 13878 tablet_bootstrap.cc:492] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd: No bootstrap required, opened a new log
I20260709 12:09:21.792443 13878 ts_tablet_manager.cc:1403] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.004s
I20260709 12:09:21.795069 13877 tablet_bootstrap.cc:492] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835: No bootstrap required, opened a new log
I20260709 12:09:21.795631 13877 ts_tablet_manager.cc:1403] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835: Time spent bootstrapping tablet: real 0.134s	user 0.031s	sys 0.023s
I20260709 12:09:21.795461 13878 raft_consensus.cc:359] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.796537 13878 raft_consensus.cc:385] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.796821 13878 raft_consensus.cc:740] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.797406 13878 consensus_queue.cc:260] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.799003 13878 ts_tablet_manager.cc:1434] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:09:21.800171 13878 tablet_bootstrap.cc:492] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd: Bootstrap starting.
I20260709 12:09:21.806087 13912 raft_consensus.cc:2749] T 25896261d1204b3d858fb5b478a89034 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:09:21.806452 13651 leader_election.cc:343] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:21.807430 13651 leader_election.cc:343] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.808363 13877 raft_consensus.cc:359] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.809124 13877 raft_consensus.cc:385] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.809405 13877 raft_consensus.cc:740] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.810159 13877 consensus_queue.cc:260] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.812391 13877 ts_tablet_manager.cc:1434] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:09:21.813501 13877 tablet_bootstrap.cc:492] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835: Bootstrap starting.
I20260709 12:09:21.791764 14076 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.817333 14076 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:21.818686 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:09:21.819350 13834 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.820065 13981 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.821339 13877 tablet_bootstrap.cc:654] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.823421 13979 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.823985 13979 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.824991 13878 tablet_bootstrap.cc:654] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.826320 13876 tablet_bootstrap.cc:492] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7: No bootstrap required, opened a new log
I20260709 12:09:21.826267 13979 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:21.826920 13876 ts_tablet_manager.cc:1403] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent bootstrapping tablet: real 0.133s	user 0.030s	sys 0.029s
I20260709 12:09:21.828405 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:21.829059 13760 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 0.
I20260709 12:09:21.829677 13876 raft_consensus.cc:359] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.830396 13876 raft_consensus.cc:385] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.831247 13876 raft_consensus.cc:740] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.831368 13800 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:09:21.831637 13981 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:21.832039 13876 consensus_queue.cc:260] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.832855 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:09:21.832953 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:09:21.834540 13876 ts_tablet_manager.cc:1434] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:09:21.834664 13967 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.835031 13967 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.835548 13876 tablet_bootstrap.cc:492] T 277b655b7311432a95ed2ad291df0b8d P 3f37c9cc9dda46b4be21dd675ba78fb7: Bootstrap starting.
I20260709 12:09:21.835044 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:21.838064 13686 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 0.
W20260709 12:09:21.838362 13651 leader_election.cc:343] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.835376 13967 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:21.839207 13651 leader_election.cc:343] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.845112 13877 tablet_bootstrap.cc:492] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835: No bootstrap required, opened a new log
I20260709 12:09:21.845626 13877 ts_tablet_manager.cc:1403] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.000s
I20260709 12:09:21.848284 13877 raft_consensus.cc:359] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.848958 13877 raft_consensus.cc:385] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.849253 13877 raft_consensus.cc:740] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.850157 13877 consensus_queue.cc:260] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.853492 13877 ts_tablet_manager.cc:1434] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.001s
I20260709 12:09:21.854650 13877 tablet_bootstrap.cc:492] T 51d10bdf51504a12a70a50e9a48f7ede P b98d2519bb504dc6905ed2ede4571835: Bootstrap starting.
I20260709 12:09:21.855773 13876 tablet_bootstrap.cc:654] T 277b655b7311432a95ed2ad291df0b8d P 3f37c9cc9dda46b4be21dd675ba78fb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.861006 13834 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 1.
I20260709 12:09:21.864846 13877 tablet_bootstrap.cc:654] T 51d10bdf51504a12a70a50e9a48f7ede P b98d2519bb504dc6905ed2ede4571835: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.865737 13878 tablet_bootstrap.cc:492] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd: No bootstrap required, opened a new log
I20260709 12:09:21.866317 13878 ts_tablet_manager.cc:1403] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd: Time spent bootstrapping tablet: real 0.066s	user 0.009s	sys 0.023s
I20260709 12:09:21.866956 13967 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.869247 13878 raft_consensus.cc:359] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.870114 13878 raft_consensus.cc:385] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.870442 13878 raft_consensus.cc:740] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.871167 13878 consensus_queue.cc:260] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.871925 13876 tablet_bootstrap.cc:492] T 277b655b7311432a95ed2ad291df0b8d P 3f37c9cc9dda46b4be21dd675ba78fb7: No bootstrap required, opened a new log
I20260709 12:09:21.872520 13876 ts_tablet_manager.cc:1403] T 277b655b7311432a95ed2ad291df0b8d P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent bootstrapping tablet: real 0.037s	user 0.009s	sys 0.004s
I20260709 12:09:21.873663 13878 ts_tablet_manager.cc:1434] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 12:09:21.879128 13878 tablet_bootstrap.cc:492] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd: Bootstrap starting.
W20260709 12:09:21.879899 13634 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:21.886296 13878 tablet_bootstrap.cc:654] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.875571 13876 raft_consensus.cc:359] T 277b655b7311432a95ed2ad291df0b8d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.886824 13876 raft_consensus.cc:385] T 277b655b7311432a95ed2ad291df0b8d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.887148 13876 raft_consensus.cc:740] T 277b655b7311432a95ed2ad291df0b8d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.889325 13876 consensus_queue.cc:260] T 277b655b7311432a95ed2ad291df0b8d P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.893317 13981 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.894016 13981 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.896797 13981 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:21.898847 13981 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.899333 13981 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:09:21.900331 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 68197.3us
I20260709 12:09:21.901844 13981 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:21.901732 14091 consensus_queue.cc:1048] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:21.869767 13967 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:21.903743 13876 ts_tablet_manager.cc:1434] T 277b655b7311432a95ed2ad291df0b8d P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 12:09:21.904815 13876 tablet_bootstrap.cc:492] T c95811190f014949bb25448e8db1040e P 3f37c9cc9dda46b4be21dd675ba78fb7: Bootstrap starting.
I20260709 12:09:21.904819 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:21.911305 13958 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.912012 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:21.912019 13958 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:09:21.913110 13651 leader_election.cc:343] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.927793 13958 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:09:21.932886 13651 leader_election.cc:343] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.936487 13652 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:09:21.938045 13981 raft_consensus.cc:2804] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.938697 13981 raft_consensus.cc:697] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:09:21.939605 13981 consensus_queue.cc:237] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.943535 13877 tablet_bootstrap.cc:492] T 51d10bdf51504a12a70a50e9a48f7ede P b98d2519bb504dc6905ed2ede4571835: No bootstrap required, opened a new log
I20260709 12:09:21.944205 13877 ts_tablet_manager.cc:1403] T 51d10bdf51504a12a70a50e9a48f7ede P b98d2519bb504dc6905ed2ede4571835: Time spent bootstrapping tablet: real 0.090s	user 0.012s	sys 0.020s
I20260709 12:09:21.948036 13877 raft_consensus.cc:359] T 51d10bdf51504a12a70a50e9a48f7ede P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.949534 13877 raft_consensus.cc:385] T 51d10bdf51504a12a70a50e9a48f7ede P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.949972 13877 raft_consensus.cc:740] T 51d10bdf51504a12a70a50e9a48f7ede P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.954396 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:21.957249 13834 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 0.
I20260709 12:09:21.957701 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:09:21.958621 13837 raft_consensus.cc:3060] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.971732 13833 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.972919 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:21.974521 13727 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:09:21.954658 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:09:21.976694 13884 raft_consensus.cc:2804] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.977377 13687 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.977577 13884 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.978209 13884 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.949137 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:21.986188 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:09:21.988121 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:21.988722 13762 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.986636 13877 consensus_queue.cc:260] T 51d10bdf51504a12a70a50e9a48f7ede P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:21.999346 13958 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.000104 13958 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.003300 13958 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:09:22.004271 13652 leader_election.cc:343] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.004972 13652 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:09:22.006508 13877 ts_tablet_manager.cc:1434] T 51d10bdf51504a12a70a50e9a48f7ede P b98d2519bb504dc6905ed2ede4571835: Time spent starting tablet: real 0.062s	user 0.010s	sys 0.000s
I20260709 12:09:22.007153 14076 raft_consensus.cc:2749] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.008028 13762 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 1.
I20260709 12:09:22.009003 13877 tablet_bootstrap.cc:492] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835: Bootstrap starting.
W20260709 12:09:22.010671 13726 leader_election.cc:343] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.012071 14113 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.012574 14113 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.035002 13687 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 1.
I20260709 12:09:22.015332 13958 consensus_queue.cc:1048] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.037s
I20260709 12:09:22.107754 13884 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.126405 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:22.127452 13834 raft_consensus.cc:2393] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 1: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
W20260709 12:09:22.128234 13652 leader_election.cc:343] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.128705 13652 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:09:22.129279 13876 tablet_bootstrap.cc:654] T c95811190f014949bb25448e8db1040e P 3f37c9cc9dda46b4be21dd675ba78fb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.129534 13912 raft_consensus.cc:2749] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.130674 13878 tablet_bootstrap.cc:492] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd: No bootstrap required, opened a new log
I20260709 12:09:22.131215 13878 ts_tablet_manager.cc:1403] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd: Time spent bootstrapping tablet: real 0.252s	user 0.064s	sys 0.054s
I20260709 12:09:22.124835 13884 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:22.135267 13835 raft_consensus.cc:1275] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:22.135525 13836 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.136314 13800 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:09:22.143312 13837 raft_consensus.cc:2468] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 1.
I20260709 12:09:22.148216 13583 catalog_manager.cc:5697] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 0 to 1, leader changed from <none> to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 1 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:22.147190 14113 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:22.144536 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:22.147650 13967 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.158473 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:22.159762 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:09:22.160769 13652 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:09:22.162166 14076 consensus_queue.cc:1048] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:09:22.165549 13967 raft_consensus.cc:697] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:09:22.164705 13912 raft_consensus.cc:2804] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.170166 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:09:22.169822 13967 consensus_queue.cc:237] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.174762 13912 raft_consensus.cc:697] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:09:22.180495 13912 consensus_queue.cc:237] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.181540 13835 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.184824 14076 consensus_queue.cc:1048] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:09:22.187042 13726 leader_election.cc:343] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.188135 13727 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:09:22.188969 13959 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.191072 13762 raft_consensus.cc:1275] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:09:22.191687 13762 pending_rounds.cc:85] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting all ops after (but not including) 1
I20260709 12:09:22.192104 13762 pending_rounds.cc:107] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:09:22.192516 13762 raft_consensus.cc:2889] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:09:22.196935 13958 consensus_queue.cc:1048] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:22.221280 13876 tablet_bootstrap.cc:492] T c95811190f014949bb25448e8db1040e P 3f37c9cc9dda46b4be21dd675ba78fb7: No bootstrap required, opened a new log
I20260709 12:09:22.222245 13876 ts_tablet_manager.cc:1403] T c95811190f014949bb25448e8db1040e P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent bootstrapping tablet: real 0.318s	user 0.009s	sys 0.013s
I20260709 12:09:22.245047 13877 tablet_bootstrap.cc:654] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.248396 13878 raft_consensus.cc:359] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.249225 13878 raft_consensus.cc:385] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.249537 13878 raft_consensus.cc:740] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.250409 13878 consensus_queue.cc:260] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.252856 13878 ts_tablet_manager.cc:1434] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd: Time spent starting tablet: real 0.121s	user 0.006s	sys 0.001s
I20260709 12:09:22.253942 13878 tablet_bootstrap.cc:492] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd: Bootstrap starting.
I20260709 12:09:22.222319 14082 consensus_queue.cc:1048] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260709 12:09:22.221944 14078 consensus_queue.cc:1048] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:09:22.259737 14091 consensus_queue.cc:1048] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:22.271631 13835 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 1.
I20260709 12:09:22.272281 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:22.278609 13760 raft_consensus.cc:2393] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 1: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:09:22.274417 13959 raft_consensus.cc:2749] T 277b655b7311432a95ed2ad291df0b8d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.284688 13584 catalog_manager.cc:5697] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 0 to 1, leader changed from <none> to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 1 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:22.297384 13727 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:09:22.299073 13959 raft_consensus.cc:2804] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.299780 13959 raft_consensus.cc:697] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:09:22.300989 13959 consensus_queue.cc:237] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.323694 13800 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:09:22.317066 13876 raft_consensus.cc:359] T c95811190f014949bb25448e8db1040e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.325184 13876 raft_consensus.cc:385] T c95811190f014949bb25448e8db1040e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.325469 13876 raft_consensus.cc:740] T c95811190f014949bb25448e8db1040e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.331148 13876 consensus_queue.cc:260] T c95811190f014949bb25448e8db1040e P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.351964 13878 tablet_bootstrap.cc:654] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.353196 14110 raft_consensus.cc:2749] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.366982 13876 ts_tablet_manager.cc:1434] T c95811190f014949bb25448e8db1040e P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent starting tablet: real 0.144s	user 0.007s	sys 0.002s
I20260709 12:09:22.370923 13876 tablet_bootstrap.cc:492] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7: Bootstrap starting.
I20260709 12:09:22.375814 14110 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.377003 14110 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.385465 14113 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.386103 14113 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.388243 14113 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:22.390244 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:22.390803 14110 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:22.390442 13583 catalog_manager.cc:5697] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 1 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:22.391048 13683 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 0.
I20260709 12:09:22.393215 13877 tablet_bootstrap.cc:492] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835: No bootstrap required, opened a new log
I20260709 12:09:22.396118 13877 ts_tablet_manager.cc:1403] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835: Time spent bootstrapping tablet: real 0.387s	user 0.019s	sys 0.011s
I20260709 12:09:22.397606 13800 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:09:22.398926 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:09:22.401117 13800 leader_election.cc:343] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.402024 14109 raft_consensus.cc:2804] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:22.402510 14109 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:22.413321 14109 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.421553 13877 raft_consensus.cc:359] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.421280 13584 catalog_manager.cc:5697] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 1 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:22.422403 13877 raft_consensus.cc:385] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.422835 13877 raft_consensus.cc:740] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.420706 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:22.424497 13683 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 0.
I20260709 12:09:22.425222 13877 consensus_queue.cc:260] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.427663 13877 ts_tablet_manager.cc:1434] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 12:09:22.428709 13877 tablet_bootstrap.cc:492] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835: Bootstrap starting.
I20260709 12:09:22.430971 13878 tablet_bootstrap.cc:492] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd: No bootstrap required, opened a new log
I20260709 12:09:22.431515 13878 ts_tablet_manager.cc:1403] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd: Time spent bootstrapping tablet: real 0.178s	user 0.024s	sys 0.012s
I20260709 12:09:22.434906 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:22.439971 14109 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.442445 13800 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:09:22.445622 13878 raft_consensus.cc:359] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.447561 13878 raft_consensus.cc:385] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.447973 13878 raft_consensus.cc:740] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.447043 14110 raft_consensus.cc:2804] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:22.448835 14110 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:22.449309 14110 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.449357 13878 consensus_queue.cc:260] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.451972 13878 ts_tablet_manager.cc:1434] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 12:09:22.448868 14109 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:09:22.446976 13800 leader_election.cc:343] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.453533 13878 tablet_bootstrap.cc:492] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd: Bootstrap starting.
I20260709 12:09:22.455899 13876 tablet_bootstrap.cc:654] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.459307 13877 tablet_bootstrap.cc:654] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.462472 13878 tablet_bootstrap.cc:654] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.465322 14082 consensus_queue.cc:1048] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:22.460036 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:09:22.467484 13683 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.469420 13877 tablet_bootstrap.cc:492] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835: No bootstrap required, opened a new log
I20260709 12:09:22.470248 13877 ts_tablet_manager.cc:1403] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835: Time spent bootstrapping tablet: real 0.042s	user 0.015s	sys 0.000s
I20260709 12:09:22.473925 14045 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.474495 14045 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.478266 14045 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:22.478889 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:22.479911 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:22.480765 13834 raft_consensus.cc:2393] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 1: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:09:22.482152 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:09:22.484568 13800 leader_election.cc:343] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.485778 13683 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 1.
I20260709 12:09:22.486991 13800 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:09:22.495230 13876 tablet_bootstrap.cc:492] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7: No bootstrap required, opened a new log
I20260709 12:09:22.495796 13876 ts_tablet_manager.cc:1403] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent bootstrapping tablet: real 0.125s	user 0.009s	sys 0.005s
I20260709 12:09:22.496452 14026 raft_consensus.cc:2804] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.497756 14110 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.498442 14026 raft_consensus.cc:697] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:09:22.499406 14026 consensus_queue.cc:237] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.500242 13727 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:09:22.502018 13959 raft_consensus.cc:3060] T c95811190f014949bb25448e8db1040e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.510746 13876 raft_consensus.cc:359] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.511584 13876 raft_consensus.cc:385] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.511885 13876 raft_consensus.cc:740] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.512645 13876 consensus_queue.cc:260] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.515810 14110 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:22.517963 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:09:22.518643 13683 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.528043 13876 ts_tablet_manager.cc:1434] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.001s
I20260709 12:09:22.528865 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:09:22.529182 13876 tablet_bootstrap.cc:492] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7: Bootstrap starting.
I20260709 12:09:22.531422 13959 raft_consensus.cc:2749] T c95811190f014949bb25448e8db1040e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.533653 13683 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 1.
I20260709 12:09:22.535279 13877 raft_consensus.cc:359] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.536473 13877 raft_consensus.cc:385] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.536780 13877 raft_consensus.cc:740] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.537539 13877 consensus_queue.cc:260] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.539314 13877 ts_tablet_manager.cc:1434] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835: Time spent starting tablet: real 0.069s	user 0.008s	sys 0.000s
I20260709 12:09:22.539602 13912 consensus_queue.cc:1048] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:22.540315 13877 tablet_bootstrap.cc:492] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835: Bootstrap starting.
I20260709 12:09:22.545502 13800 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:09:22.547035 14113 raft_consensus.cc:2804] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.546296 14110 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:22.547129 13800 leader_election.cc:343] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.547758 14113 raft_consensus.cc:697] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:09:22.548632 14113 consensus_queue.cc:237] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.555162 14110 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.564390 14110 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:22.564855 13878 tablet_bootstrap.cc:492] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd: No bootstrap required, opened a new log
I20260709 12:09:22.565340 13878 ts_tablet_manager.cc:1403] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd: Time spent bootstrapping tablet: real 0.112s	user 0.013s	sys 0.015s
I20260709 12:09:22.564435 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:22.569527 13683 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 0.
I20260709 12:09:22.572186 13800 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:09:22.571127 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:22.573968 14113 raft_consensus.cc:2804] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:22.574448 14113 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:09:22.574718 13800 leader_election.cc:343] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.574864 14113 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.576887 13876 tablet_bootstrap.cc:654] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.580868 13877 tablet_bootstrap.cc:654] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.583324 13876 tablet_bootstrap.cc:492] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7: No bootstrap required, opened a new log
I20260709 12:09:22.587636 13877 tablet_bootstrap.cc:492] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835: No bootstrap required, opened a new log
I20260709 12:09:22.588222 13877 ts_tablet_manager.cc:1403] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835: Time spent bootstrapping tablet: real 0.048s	user 0.011s	sys 0.003s
I20260709 12:09:22.588881 13876 ts_tablet_manager.cc:1403] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent bootstrapping tablet: real 0.060s	user 0.009s	sys 0.003s
I20260709 12:09:22.590883 13877 raft_consensus.cc:359] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.591586 13877 raft_consensus.cc:385] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.591847 13877 raft_consensus.cc:740] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.590022 14113 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.592566 13877 consensus_queue.cc:260] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.592288 13585 catalog_manager.cc:5697] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 1 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:22.592286 13876 raft_consensus.cc:359] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.594390 13876 raft_consensus.cc:385] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.594692 13877 ts_tablet_manager.cc:1434] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.002s
I20260709 12:09:22.594676 13876 raft_consensus.cc:740] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.596547 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:09:22.596858 14113 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:22.597153 13683 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.598414 13877 tablet_bootstrap.cc:492] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835: Bootstrap starting.
I20260709 12:09:22.600291 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:09:22.602581 13876 consensus_queue.cc:260] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.604851 13683 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 1.
W20260709 12:09:22.605333 13800 leader_election.cc:343] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.606026 13876 ts_tablet_manager.cc:1434] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:09:22.606086 13800 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:09:22.606837 14113 raft_consensus.cc:2804] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.607511 14113 raft_consensus.cc:697] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:09:22.608392 14113 consensus_queue.cc:237] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.612459 13876 tablet_bootstrap.cc:492] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7: Bootstrap starting.
I20260709 12:09:22.612296 13878 raft_consensus.cc:359] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.613255 13878 raft_consensus.cc:385] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.613616 13878 raft_consensus.cc:740] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.614389 13878 consensus_queue.cc:260] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.616868 13878 ts_tablet_manager.cc:1434] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.000s
I20260709 12:09:22.618237 13877 tablet_bootstrap.cc:654] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.618624 13878 tablet_bootstrap.cc:492] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd: Bootstrap starting.
I20260709 12:09:22.625981 14082 consensus_queue.cc:1048] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:22.627835 13876 tablet_bootstrap.cc:654] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.633332 13585 catalog_manager.cc:5697] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 1 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:22.635351 13585 catalog_manager.cc:5697] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 1 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:22.639264 13878 tablet_bootstrap.cc:654] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.639974 14113 consensus_queue.cc:1048] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:22.645074 13877 tablet_bootstrap.cc:492] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835: No bootstrap required, opened a new log
I20260709 12:09:22.645648 13877 ts_tablet_manager.cc:1403] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835: Time spent bootstrapping tablet: real 0.047s	user 0.006s	sys 0.010s
I20260709 12:09:22.648893 13877 raft_consensus.cc:359] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.649806 13877 raft_consensus.cc:385] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.650096 13877 raft_consensus.cc:740] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.650774 13877 consensus_queue.cc:260] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.652922 13877 ts_tablet_manager.cc:1434] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:09:22.668439 13877 tablet_bootstrap.cc:492] T c3c06f5564ed4c259ca5c238c3faf2a3 P b98d2519bb504dc6905ed2ede4571835: Bootstrap starting.
I20260709 12:09:22.672267 13912 consensus_queue.cc:1048] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:22.676419 13876 tablet_bootstrap.cc:492] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7: No bootstrap required, opened a new log
I20260709 12:09:22.677070 13876 ts_tablet_manager.cc:1403] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent bootstrapping tablet: real 0.065s	user 0.021s	sys 0.001s
I20260709 12:09:22.686473 14113 consensus_queue.cc:1048] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:22.687672 13876 raft_consensus.cc:359] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.688473 13876 raft_consensus.cc:385] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.688552 13877 tablet_bootstrap.cc:654] T c3c06f5564ed4c259ca5c238c3faf2a3 P b98d2519bb504dc6905ed2ede4571835: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.688771 13876 raft_consensus.cc:740] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.689639 13876 consensus_queue.cc:260] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.691823 13876 ts_tablet_manager.cc:1434] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.003s
I20260709 12:09:22.692967 13876 tablet_bootstrap.cc:492] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7: Bootstrap starting.
I20260709 12:09:22.701139 13876 tablet_bootstrap.cc:654] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.702015 13878 tablet_bootstrap.cc:492] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd: No bootstrap required, opened a new log
I20260709 12:09:22.702649 13878 ts_tablet_manager.cc:1403] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd: Time spent bootstrapping tablet: real 0.085s	user 0.010s	sys 0.008s
I20260709 12:09:22.703781 14060 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.704406 14060 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.706924 13878 raft_consensus.cc:359] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.708511 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:22.708788 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:22.727785 13683 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 0.
I20260709 12:09:22.711269 13688 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.712962 14060 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:22.734411 13726 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:09:22.735653 14091 raft_consensus.cc:2804] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:22.736054 14091 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:22.736400 14091 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.738265 13912 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.738831 13912 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.738945 13959 consensus_queue.cc:1048] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:22.739837 13877 tablet_bootstrap.cc:492] T c3c06f5564ed4c259ca5c238c3faf2a3 P b98d2519bb504dc6905ed2ede4571835: No bootstrap required, opened a new log
I20260709 12:09:22.740330 13877 ts_tablet_manager.cc:1403] T c3c06f5564ed4c259ca5c238c3faf2a3 P b98d2519bb504dc6905ed2ede4571835: Time spent bootstrapping tablet: real 0.072s	user 0.021s	sys 0.022s
I20260709 12:09:22.741149 13912 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:22.742899 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:22.743610 13834 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 1.
I20260709 12:09:22.744876 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:22.747838 13652 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:09:22.749128 13877 raft_consensus.cc:359] T c3c06f5564ed4c259ca5c238c3faf2a3 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.749899 13877 raft_consensus.cc:385] T c3c06f5564ed4c259ca5c238c3faf2a3 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.750193 13877 raft_consensus.cc:740] T c3c06f5564ed4c259ca5c238c3faf2a3 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.750909 13877 consensus_queue.cc:260] T c3c06f5564ed4c259ca5c238c3faf2a3 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.756582 14091 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.758051 14076 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.757009 13877 ts_tablet_manager.cc:1434] T c3c06f5564ed4c259ca5c238c3faf2a3 P b98d2519bb504dc6905ed2ede4571835: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.004s
I20260709 12:09:22.758725 14076 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.760120 13877 tablet_bootstrap.cc:492] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835: Bootstrap starting.
I20260709 12:09:22.759995 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:09:22.760854 14076 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:22.727983 13878 raft_consensus.cc:385] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.762817 13878 raft_consensus.cc:740] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.765475 14091 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:22.765993 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:09:22.766517 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:22.766652 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:09:22.768294 13652 leader_election.cc:343] T c3c06f5564ed4c259ca5c238c3faf2a3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.769084 13912 raft_consensus.cc:2804] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:22.766654 13686 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.770241 13878 consensus_queue.cc:260] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.771661 13912 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:09:22.772080 13912 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:22.776758 13878 ts_tablet_manager.cc:1434] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd: Time spent starting tablet: real 0.074s	user 0.005s	sys 0.000s
W20260709 12:09:22.769749 13651 leader_election.cc:343] T c3c06f5564ed4c259ca5c238c3faf2a3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.777983 13651 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:09:22.777992 13878 tablet_bootstrap.cc:492] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd: Bootstrap starting.
I20260709 12:09:22.780247 13831 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 0.
I20260709 12:09:22.780129 14076 raft_consensus.cc:2749] T c3c06f5564ed4c259ca5c238c3faf2a3 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.781526 13912 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.777622 13686 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 1.
I20260709 12:09:22.784175 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:09:22.785573 13912 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:22.786160 13726 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:09:22.787000 14091 raft_consensus.cc:2804] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.787526 14091 raft_consensus.cc:697] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:09:22.790848 13876 tablet_bootstrap.cc:492] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7: No bootstrap required, opened a new log
I20260709 12:09:22.791380 13876 ts_tablet_manager.cc:1403] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent bootstrapping tablet: real 0.099s	user 0.012s	sys 0.015s
I20260709 12:09:22.791563 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:09:22.792201 13831 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:22.789024 14091 consensus_queue.cc:237] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.800681 13878 tablet_bootstrap.cc:654] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.801195 13686 raft_consensus.cc:1240] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:22.803700 13877 tablet_bootstrap.cc:654] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.804472 14060 consensus_queue.cc:1059] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:22.805838 13959 raft_consensus.cc:3055] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:22.806361 13959 raft_consensus.cc:740] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:09:22.807530 13959 consensus_queue.cc:260] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.808724 13959 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:22.808619 13876 raft_consensus.cc:359] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.809736 13876 raft_consensus.cc:385] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.810184 13876 raft_consensus.cc:740] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.811120 13876 consensus_queue.cc:260] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.814590 13876 ts_tablet_manager.cc:1434] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.003s
I20260709 12:09:22.815336 13877 tablet_bootstrap.cc:492] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835: No bootstrap required, opened a new log
I20260709 12:09:22.815824 13877 ts_tablet_manager.cc:1403] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835: Time spent bootstrapping tablet: real 0.056s	user 0.012s	sys 0.000s
I20260709 12:09:22.815817 13876 tablet_bootstrap.cc:492] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7: Bootstrap starting.
I20260709 12:09:22.821486 13877 raft_consensus.cc:359] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.822269 13877 raft_consensus.cc:385] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.822727 13877 raft_consensus.cc:740] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.835098 13831 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 2.
I20260709 12:09:22.835947 13834 raft_consensus.cc:1240] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:22.838547 13652 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:09:22.839470 14076 raft_consensus.cc:2804] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:22.841259 14076 raft_consensus.cc:697] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 2 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:09:22.842482 14076 consensus_queue.cc:237] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.844249 13878 tablet_bootstrap.cc:492] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd: No bootstrap required, opened a new log
I20260709 12:09:22.844725 13878 ts_tablet_manager.cc:1403] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd: Time spent bootstrapping tablet: real 0.067s	user 0.013s	sys 0.010s
I20260709 12:09:22.842497 13877 consensus_queue.cc:260] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.847776 13878 raft_consensus.cc:359] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.848429 13878 raft_consensus.cc:385] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.848696 13878 raft_consensus.cc:740] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.848891 13877 ts_tablet_manager.cc:1434] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 12:09:22.849324 13878 consensus_queue.cc:260] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.850225 13877 tablet_bootstrap.cc:492] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835: Bootstrap starting.
I20260709 12:09:22.852707 13583 catalog_manager.cc:5697] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 1 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:22.843961 13876 tablet_bootstrap.cc:654] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.856455 13878 ts_tablet_manager.cc:1434] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:09:22.857519 13878 tablet_bootstrap.cc:492] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd: Bootstrap starting.
I20260709 12:09:22.861457 13877 tablet_bootstrap.cc:654] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.860668 13584 catalog_manager.cc:5697] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 1 to 2, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 2 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:22.868086 13876 tablet_bootstrap.cc:492] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7: No bootstrap required, opened a new log
I20260709 12:09:22.868556 13876 ts_tablet_manager.cc:1403] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent bootstrapping tablet: real 0.053s	user 0.012s	sys 0.001s
I20260709 12:09:22.869298 13878 tablet_bootstrap.cc:654] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.872388 13876 raft_consensus.cc:359] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.873119 13876 raft_consensus.cc:385] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.873385 13876 raft_consensus.cc:740] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.874879 13876 consensus_queue.cc:260] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.878957 13877 tablet_bootstrap.cc:492] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835: No bootstrap required, opened a new log
I20260709 12:09:22.879454 13877 ts_tablet_manager.cc:1403] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.000s
I20260709 12:09:22.880937 14076 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.881449 14076 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.882036 13877 raft_consensus.cc:359] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.882761 13877 raft_consensus.cc:385] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.883019 13877 raft_consensus.cc:740] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.883576 14076 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:22.883706 13877 consensus_queue.cc:260] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.885044 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:22.885677 13762 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 0.
I20260709 12:09:22.885900 13877 ts_tablet_manager.cc:1434] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:09:22.886860 13877 tablet_bootstrap.cc:492] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835: Bootstrap starting.
I20260709 12:09:22.887123 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:22.887820 13831 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 0.
I20260709 12:09:22.889451 13652 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:09:22.890653 14076 raft_consensus.cc:2804] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:22.891055 14076 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:22.891702 14076 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.898288 13876 ts_tablet_manager.cc:1434] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 12:09:22.899348 13876 tablet_bootstrap.cc:492] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7: Bootstrap starting.
I20260709 12:09:22.905478 13876 tablet_bootstrap.cc:654] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.906723 14076 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.908165 13959 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.908638 13959 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.910066 14076 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:22.910678 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:09:22.911442 13834 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.912148 13959 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:22.919288 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:09:22.919701 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:22.920024 13762 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.919965 13877 tablet_bootstrap.cc:654] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.924387 13834 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 1.
I20260709 12:09:22.925710 13652 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:09:22.926654 14076 raft_consensus.cc:2804] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.927229 14076 raft_consensus.cc:697] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:09:22.928299 13876 tablet_bootstrap.cc:492] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7: No bootstrap required, opened a new log
I20260709 12:09:22.928788 13876 ts_tablet_manager.cc:1403] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent bootstrapping tablet: real 0.030s	user 0.008s	sys 0.004s
I20260709 12:09:22.928166 14076 consensus_queue.cc:237] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.929988 13878 tablet_bootstrap.cc:492] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd: No bootstrap required, opened a new log
I20260709 12:09:22.930119 13959 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.930951 13959 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.931835 13876 raft_consensus.cc:359] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.932509 13876 raft_consensus.cc:385] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.932576 13878 ts_tablet_manager.cc:1403] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd: Time spent bootstrapping tablet: real 0.075s	user 0.014s	sys 0.004s
I20260709 12:09:22.932859 13876 raft_consensus.cc:740] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.933559 13876 consensus_queue.cc:260] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.935424 13878 raft_consensus.cc:359] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.935909 13876 ts_tablet_manager.cc:1434] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:09:22.936133 13878 raft_consensus.cc:385] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.936405 13878 raft_consensus.cc:740] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.936918 13876 tablet_bootstrap.cc:492] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7: Bootstrap starting.
I20260709 12:09:22.937304 13878 consensus_queue.cc:260] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.938544 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:22.939512 13878 ts_tablet_manager.cc:1434] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:09:22.939703 13683 raft_consensus.cc:2393] T 51d10bdf51504a12a70a50e9a48f7ede P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 1: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:09:22.940768 13878 tablet_bootstrap.cc:492] T 64b889ec5fe4445d81fe94e0ae9fb087 P 96701a74fdee481fb5f54aac841e17dd: Bootstrap starting.
I20260709 12:09:22.946972 13878 tablet_bootstrap.cc:654] T 64b889ec5fe4445d81fe94e0ae9fb087 P 96701a74fdee481fb5f54aac841e17dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.950994 13876 tablet_bootstrap.cc:654] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.963291 13760 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.965632 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:09:22.966766 13634 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:22.967298 13683 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 0.
I20260709 12:09:22.968569 13959 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:22.969334 13726 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:09:22.971871 13876 tablet_bootstrap.cc:492] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7: No bootstrap required, opened a new log
I20260709 12:09:22.972359 13876 ts_tablet_manager.cc:1403] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent bootstrapping tablet: real 0.036s	user 0.013s	sys 0.000s
I20260709 12:09:22.972577 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:22.973285 13834 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 0.
I20260709 12:09:22.974644 13727 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:09:22.975508 14060 raft_consensus.cc:2804] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:22.975199 13876 raft_consensus.cc:359] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.975965 13876 raft_consensus.cc:385] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.975922 14060 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:22.976459 14060 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.979995 13959 raft_consensus.cc:2749] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.944510 13762 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 1.
I20260709 12:09:22.983448 14060 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.984157 13876 raft_consensus.cc:740] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.987512 14026 consensus_queue.cc:1048] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:22.988518 13878 tablet_bootstrap.cc:492] T 64b889ec5fe4445d81fe94e0ae9fb087 P 96701a74fdee481fb5f54aac841e17dd: No bootstrap required, opened a new log
I20260709 12:09:22.988258 13876 consensus_queue.cc:260] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.989002 13878 ts_tablet_manager.cc:1403] T 64b889ec5fe4445d81fe94e0ae9fb087 P 96701a74fdee481fb5f54aac841e17dd: Time spent bootstrapping tablet: real 0.048s	user 0.020s	sys 0.000s
I20260709 12:09:22.991775 13878 raft_consensus.cc:359] T 64b889ec5fe4445d81fe94e0ae9fb087 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:22.995463 14060 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:22.997032 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:09:23.006940 13834 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.001201 13876 ts_tablet_manager.cc:1434] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 12:09:23.012459 13876 tablet_bootstrap.cc:492] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7: Bootstrap starting.
I20260709 12:09:23.014885 13834 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 1.
I20260709 12:09:23.016337 13727 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:09:23.017657 13959 raft_consensus.cc:2804] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.018203 13959 raft_consensus.cc:697] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:09:23.019008 13959 consensus_queue.cc:237] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:23.020634 13876 tablet_bootstrap.cc:654] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.021406 14078 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.021986 14078 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:23.005856 13877 tablet_bootstrap.cc:492] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835: No bootstrap required, opened a new log
I20260709 12:09:22.998414 13878 raft_consensus.cc:385] T 64b889ec5fe4445d81fe94e0ae9fb087 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.024108 14078 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:23.024168 13878 raft_consensus.cc:740] T 64b889ec5fe4445d81fe94e0ae9fb087 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.024940 13878 consensus_queue.cc:260] T 64b889ec5fe4445d81fe94e0ae9fb087 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:23.026839 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:23.027195 13878 ts_tablet_manager.cc:1434] T 64b889ec5fe4445d81fe94e0ae9fb087 P 96701a74fdee481fb5f54aac841e17dd: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 12:09:23.027486 13834 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 0.
I20260709 12:09:23.027644 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:09:23.028151 13878 tablet_bootstrap.cc:492] T c6d20ad9ea2849238148cd46eb3be62c P 96701a74fdee481fb5f54aac841e17dd: Bootstrap starting.
I20260709 12:09:23.028353 13686 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.028625 13652 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:09:23.029951 13912 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.030452 13912 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.030639 13877 ts_tablet_manager.cc:1403] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835: Time spent bootstrapping tablet: real 0.144s	user 0.018s	sys 0.021s
I20260709 12:09:23.030915 13912 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.033253 13877 raft_consensus.cc:359] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:23.034075 13877 raft_consensus.cc:385] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.034327 13877 raft_consensus.cc:740] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.035568 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:23.039585 13877 consensus_queue.cc:260] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:23.043285 13878 tablet_bootstrap.cc:654] T c6d20ad9ea2849238148cd46eb3be62c P 96701a74fdee481fb5f54aac841e17dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.025180 13585 catalog_manager.cc:5697] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 0 to 1, leader changed from <none> to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 1 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:23.048763 13877 ts_tablet_manager.cc:1434] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:09:23.049649 13877 tablet_bootstrap.cc:492] T aa310cca462541d39d36ebe94a27446e P b98d2519bb504dc6905ed2ede4571835: Bootstrap starting.
I20260709 12:09:23.050390 14078 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.050922 14078 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:23.051424 14076 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.052131 14076 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:23.052985 14078 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:23.054842 14076 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:23.054834 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:09:23.057232 13652 leader_election.cc:343] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.058545 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:23.059302 13834 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 0.
I20260709 12:09:23.060786 13652 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:09:23.061659 14076 raft_consensus.cc:2804] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.062099 13877 tablet_bootstrap.cc:654] T aa310cca462541d39d36ebe94a27446e P b98d2519bb504dc6905ed2ede4571835: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.062211 14091 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.062722 14091 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:23.065246 14076 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.065760 14076 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.068449 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:09:23.070806 13727 leader_election.cc:343] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.071228 13762 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.071754 14091 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:09:23.078696 13651 leader_election.cc:343] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.092489 13912 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:23.100040 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:23.101079 13760 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 0.
I20260709 12:09:23.101367 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:23.101910 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:23.102507 13683 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 0.
I20260709 12:09:23.103803 14110 consensus_queue.cc:1048] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.105099 13726 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:09:23.106962 14091 raft_consensus.cc:2804] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.107370 14091 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.107730 14091 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.114532 13686 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 1.
I20260709 12:09:23.114936 14091 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:23.118075 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:09:23.118716 13834 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.118862 13912 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:23.122440 13763 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.124629 14113 consensus_queue.cc:1048] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.139477 13876 tablet_bootstrap.cc:492] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7: No bootstrap required, opened a new log
I20260709 12:09:23.140053 13876 ts_tablet_manager.cc:1403] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent bootstrapping tablet: real 0.128s	user 0.017s	sys 0.017s
I20260709 12:09:23.139771 14113 consensus_queue.cc:1048] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.141498 14109 consensus_queue.cc:1048] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:23.142804 13651 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:09:23.143937 13912 raft_consensus.cc:2804] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.144352 13912 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.143585 13586 catalog_manager.cc:5697] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 1 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:23.144686 13912 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.148707 13877 tablet_bootstrap.cc:492] T aa310cca462541d39d36ebe94a27446e P b98d2519bb504dc6905ed2ede4571835: No bootstrap required, opened a new log
I20260709 12:09:23.149427 13877 ts_tablet_manager.cc:1403] T aa310cca462541d39d36ebe94a27446e P b98d2519bb504dc6905ed2ede4571835: Time spent bootstrapping tablet: real 0.100s	user 0.028s	sys 0.036s
I20260709 12:09:23.153891 13876 raft_consensus.cc:359] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:23.154819 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:09:23.157241 13876 raft_consensus.cc:385] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.157646 13876 raft_consensus.cc:740] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Initialized, Role: FOLLOWER
W20260709 12:09:23.158428 13727 leader_election.cc:343] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.158532 13876 consensus_queue.cc:260] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:23.161928 13958 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.162465 13958 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:23.164661 13958 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:23.166323 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:23.166455 13912 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:09:23.167936 13727 leader_election.cc:343] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.155367 14091 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:23.100708 14076 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:23.152558 13877 raft_consensus.cc:359] T aa310cca462541d39d36ebe94a27446e P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:23.169823 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:09:23.148610 13834 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 1.
W20260709 12:09:23.143936 13651 leader_election.cc:343] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.170249 13877 raft_consensus.cc:385] T aa310cca462541d39d36ebe94a27446e P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:09:23.171168 13652 leader_election.cc:343] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.171205 13877 raft_consensus.cc:740] T aa310cca462541d39d36ebe94a27446e P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.172763 14076 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:23.173414 13652 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:09:23.172921 13877 consensus_queue.cc:260] T aa310cca462541d39d36ebe94a27446e P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:23.176079 13876 ts_tablet_manager.cc:1434] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 12:09:23.176637 14076 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.177006 13876 tablet_bootstrap.cc:492] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7: Bootstrap starting.
I20260709 12:09:23.177408 14076 raft_consensus.cc:697] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:09:23.180250 13878 tablet_bootstrap.cc:492] T c6d20ad9ea2849238148cd46eb3be62c P 96701a74fdee481fb5f54aac841e17dd: No bootstrap required, opened a new log
I20260709 12:09:23.180763 13878 ts_tablet_manager.cc:1403] T c6d20ad9ea2849238148cd46eb3be62c P 96701a74fdee481fb5f54aac841e17dd: Time spent bootstrapping tablet: real 0.153s	user 0.012s	sys 0.019s
I20260709 12:09:23.174948 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:09:23.175422 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:09:23.182209 13834 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.186553 13912 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:23.186992 13876 tablet_bootstrap.cc:654] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.188161 14076 consensus_queue.cc:237] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:23.193645 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:09:23.194021 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:23.194592 13686 raft_consensus.cc:2393] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 1: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:09:23.194705 13683 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 0.
I20260709 12:09:23.195775 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:09:23.196625 13763 raft_consensus.cc:2393] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 1: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:09:23.191123 13878 raft_consensus.cc:359] T c6d20ad9ea2849238148cd46eb3be62c P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:23.201709 13876 tablet_bootstrap.cc:492] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7: No bootstrap required, opened a new log
I20260709 12:09:23.205163 13876 ts_tablet_manager.cc:1403] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.004s
I20260709 12:09:23.207841 13876 raft_consensus.cc:359] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:23.208544 13876 raft_consensus.cc:385] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.208820 13876 raft_consensus.cc:740] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.199405 13878 raft_consensus.cc:385] T c6d20ad9ea2849238148cd46eb3be62c P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.209465 13878 raft_consensus.cc:740] T c6d20ad9ea2849238148cd46eb3be62c P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.210695 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:09:23.213727 13878 consensus_queue.cc:260] T c6d20ad9ea2849238148cd46eb3be62c P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:23.218653 13878 ts_tablet_manager.cc:1434] T c6d20ad9ea2849238148cd46eb3be62c P 96701a74fdee481fb5f54aac841e17dd: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.001s
I20260709 12:09:23.219852 13878 tablet_bootstrap.cc:492] T 625e9b5c2aa14658af58496a21f9ee8b P 96701a74fdee481fb5f54aac841e17dd: Bootstrap starting.
I20260709 12:09:23.223977 13876 consensus_queue.cc:260] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:23.225071 13763 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.229281 13726 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:09:23.230597 14091 raft_consensus.cc:2749] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.234038 13876 ts_tablet_manager.cc:1434] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent starting tablet: real 0.029s	user 0.003s	sys 0.004s
I20260709 12:09:23.235168 13876 tablet_bootstrap.cc:492] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7: Bootstrap starting.
I20260709 12:09:23.237008 13726 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:09:23.238842 13877 ts_tablet_manager.cc:1434] T aa310cca462541d39d36ebe94a27446e P b98d2519bb504dc6905ed2ede4571835: Time spent starting tablet: real 0.089s	user 0.006s	sys 0.002s
I20260709 12:09:23.251935 13877 tablet_bootstrap.cc:492] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835: Bootstrap starting.
W20260709 12:09:23.238533 13651 leader_election.cc:343] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.253252 13651 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:09:23.243397 13878 tablet_bootstrap.cc:654] T 625e9b5c2aa14658af58496a21f9ee8b P 96701a74fdee481fb5f54aac841e17dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.257931 13912 raft_consensus.cc:2749] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.256825 13958 raft_consensus.cc:2804] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.262948 13958 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.263355 13958 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.268610 13831 raft_consensus.cc:1275] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:23.269870 13584 catalog_manager.cc:5697] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 0 to 1, leader changed from <none> to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 1 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:23.246728 13834 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 1.
I20260709 12:09:23.275331 13652 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:09:23.276388 14082 consensus_queue.cc:1048] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.277935 14082 raft_consensus.cc:2804] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.278205 13958 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:23.278488 14082 raft_consensus.cc:697] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:09:23.279572 14082 consensus_queue.cc:237] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:23.280530 13958 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:23.279582 13831 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.273798 13763 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 1.
I20260709 12:09:23.293135 13877 tablet_bootstrap.cc:654] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.321550 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:09:23.322369 13688 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.324703 14110 consensus_queue.cc:1048] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.335233 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:09:23.350312 13876 tablet_bootstrap.cc:654] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.362051 13958 consensus_queue.cc:1048] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 12:09:23.383446 13959 consensus_queue.cc:1048] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.392447 13763 raft_consensus.cc:1275] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:09:23.393966 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 98917.4us
I20260709 12:09:23.400066 13912 consensus_queue.cc:1048] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:09:23.398001 13727 leader_election.cc:343] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.406296 13876 tablet_bootstrap.cc:492] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7: No bootstrap required, opened a new log
I20260709 12:09:23.406819 13876 ts_tablet_manager.cc:1403] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent bootstrapping tablet: real 0.172s	user 0.018s	sys 0.000s
I20260709 12:09:23.421638 13586 catalog_manager.cc:5697] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 0 to 1, leader changed from <none> to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 1 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:23.430011 13877 tablet_bootstrap.cc:492] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835: No bootstrap required, opened a new log
I20260709 12:09:23.430567 13877 ts_tablet_manager.cc:1403] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835: Time spent bootstrapping tablet: real 0.179s	user 0.008s	sys 0.008s
I20260709 12:09:23.442559 13878 tablet_bootstrap.cc:492] T 625e9b5c2aa14658af58496a21f9ee8b P 96701a74fdee481fb5f54aac841e17dd: No bootstrap required, opened a new log
I20260709 12:09:23.443198 13878 ts_tablet_manager.cc:1403] T 625e9b5c2aa14658af58496a21f9ee8b P 96701a74fdee481fb5f54aac841e17dd: Time spent bootstrapping tablet: real 0.224s	user 0.040s	sys 0.024s
I20260709 12:09:23.457966 13878 raft_consensus.cc:359] T 625e9b5c2aa14658af58496a21f9ee8b P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:23.459074 13878 raft_consensus.cc:385] T 625e9b5c2aa14658af58496a21f9ee8b P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.459448 13878 raft_consensus.cc:740] T 625e9b5c2aa14658af58496a21f9ee8b P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.446651 14169 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.461678 13876 raft_consensus.cc:359] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:23.463788 13876 raft_consensus.cc:385] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.461411 13878 consensus_queue.cc:260] T 625e9b5c2aa14658af58496a21f9ee8b P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:23.465308 13876 raft_consensus.cc:740] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Initialized, Role: FOLLOWER
W20260709 12:09:23.455574 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 50005.5us
I20260709 12:09:23.466912 13877 raft_consensus.cc:359] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:23.467465 13877 raft_consensus.cc:385] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.467734 13877 raft_consensus.cc:740] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.467196 13876 consensus_queue.cc:260] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:23.468274 13877 consensus_queue.cc:260] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:23.453179 13688 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 1.
I20260709 12:09:23.485678 13877 ts_tablet_manager.cc:1434] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835: Time spent starting tablet: real 0.055s	user 0.005s	sys 0.001s
I20260709 12:09:23.489284 13878 ts_tablet_manager.cc:1434] T 625e9b5c2aa14658af58496a21f9ee8b P 96701a74fdee481fb5f54aac841e17dd: Time spent starting tablet: real 0.046s	user 0.010s	sys 0.000s
I20260709 12:09:23.491912 13876 ts_tablet_manager.cc:1434] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent starting tablet: real 0.085s	user 0.009s	sys 0.000s
I20260709 12:09:23.466202 14169 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:23.494573 13876 tablet_bootstrap.cc:492] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7: Bootstrap starting.
I20260709 12:09:23.496641 13878 tablet_bootstrap.cc:492] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd: Bootstrap starting.
I20260709 12:09:23.537319 14169 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:23.538364 14082 consensus_queue.cc:1048] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.538483 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:23.547783 13877 tablet_bootstrap.cc:492] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835: Bootstrap starting.
I20260709 12:09:23.541168 13726 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:09:23.564870 13876 tablet_bootstrap.cc:654] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:23.557173 13652 leader_election.cc:343] T aa310cca462541d39d36ebe94a27446e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.566876 14091 raft_consensus.cc:2804] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.592898 14076 consensus_queue.cc:1048] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:23.593760 14091 raft_consensus.cc:697] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:09:23.594733 14091 consensus_queue.cc:237] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:23.603179 13958 consensus_queue.cc:1048] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.615408 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:09:23.657002 14188 log.cc:927] Time spent T 25896261d1204b3d858fb5b478a89034 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:09:23.659693 13877 tablet_bootstrap.cc:654] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.664113 14111 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.664661 14111 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:09:23.674014 13651 leader_election.cc:343] T aa310cca462541d39d36ebe94a27446e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.674574 13651 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:09:23.688716 13876 tablet_bootstrap.cc:492] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7: No bootstrap required, opened a new log
I20260709 12:09:23.689249 13876 ts_tablet_manager.cc:1403] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent bootstrapping tablet: real 0.195s	user 0.049s	sys 0.034s
I20260709 12:09:23.689414 13912 raft_consensus.cc:2749] T aa310cca462541d39d36ebe94a27446e P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.689641 14179 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.741412 13912 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.742159 13912 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:23.697527 14179 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:23.748410 13912 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:23.757552 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:23.795130 13878 tablet_bootstrap.cc:654] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.799204 13876 raft_consensus.cc:359] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:23.800006 13876 raft_consensus.cc:385] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.800315 13876 raft_consensus.cc:740] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.790052 14111 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:23.801029 13876 consensus_queue.cc:260] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:23.802474 13877 tablet_bootstrap.cc:492] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835: No bootstrap required, opened a new log
I20260709 12:09:23.801469 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:23.803485 13687 raft_consensus.cc:2393] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 1: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
W20260709 12:09:23.804121 13651 consensus_peers.cc:597] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 -> Peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Couldn't send request to peer 3f37c9cc9dda46b4be21dd675ba78fb7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:23.808071 13876 ts_tablet_manager.cc:1434] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent starting tablet: real 0.118s	user 0.007s	sys 0.000s
I20260709 12:09:23.809038 14091 consensus_queue.cc:1048] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:23.812143 13877 ts_tablet_manager.cc:1403] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835: Time spent bootstrapping tablet: real 0.265s	user 0.011s	sys 0.013s
I20260709 12:09:23.816766 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:23.819981 13876 tablet_bootstrap.cc:492] T 7a7564a63b8041ff80f64a7f8d533acb P 3f37c9cc9dda46b4be21dd675ba78fb7: Bootstrap starting.
I20260709 12:09:23.829861 13877 raft_consensus.cc:359] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:23.830713 13877 raft_consensus.cc:385] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.834637 13876 tablet_bootstrap.cc:654] T 7a7564a63b8041ff80f64a7f8d533acb P 3f37c9cc9dda46b4be21dd675ba78fb7: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:23.836635 13652 leader_election.cc:343] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.840600 14076 consensus_queue.cc:1048] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.841658 13878 tablet_bootstrap.cc:492] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd: No bootstrap required, opened a new log
I20260709 12:09:23.842244 13878 ts_tablet_manager.cc:1403] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd: Time spent bootstrapping tablet: real 0.346s	user 0.019s	sys 0.025s
I20260709 12:09:23.845105 13878 raft_consensus.cc:359] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:23.845872 13878 raft_consensus.cc:385] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.846184 13878 raft_consensus.cc:740] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.846889 13878 consensus_queue.cc:260] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:23.849630 14169 consensus_queue.cc:1048] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:23.850270 13878 ts_tablet_manager.cc:1434] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:09:23.853657 14179 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:23.857048 13878 tablet_bootstrap.cc:492] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd: Bootstrap starting.
I20260709 12:09:23.856288 13585 catalog_manager.cc:5697] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 1 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:23.831100 13877 raft_consensus.cc:740] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.859855 13877 consensus_queue.cc:260] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:23.865957 13877 ts_tablet_manager.cc:1434] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835: Time spent starting tablet: real 0.053s	user 0.008s	sys 0.000s
I20260709 12:09:23.867115 13877 tablet_bootstrap.cc:492] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835: Bootstrap starting.
I20260709 12:09:23.875715 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:23.876705 13761 raft_consensus.cc:2393] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 1: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:09:23.881914 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:23.885908 13800 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:09:23.887178 14179 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:23.890821 13651 leader_election.cc:343] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.901885 13651 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:09:23.898819 13800 leader_election.cc:343] T 625e9b5c2aa14658af58496a21f9ee8b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.904693 14186 raft_consensus.cc:2749] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.907828 13876 tablet_bootstrap.cc:492] T 7a7564a63b8041ff80f64a7f8d533acb P 3f37c9cc9dda46b4be21dd675ba78fb7: No bootstrap required, opened a new log
I20260709 12:09:23.908349 13876 ts_tablet_manager.cc:1403] T 7a7564a63b8041ff80f64a7f8d533acb P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent bootstrapping tablet: real 0.089s	user 0.041s	sys 0.032s
I20260709 12:09:23.909304 14186 consensus_queue.cc:1048] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.911177 13876 raft_consensus.cc:359] T 7a7564a63b8041ff80f64a7f8d533acb P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:23.912396 14179 raft_consensus.cc:2749] T c6d20ad9ea2849238148cd46eb3be62c P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.913237 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:23.909250 13878 tablet_bootstrap.cc:654] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.911928 13876 raft_consensus.cc:385] T 7a7564a63b8041ff80f64a7f8d533acb P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.917512 13876 raft_consensus.cc:740] T 7a7564a63b8041ff80f64a7f8d533acb P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.918392 13876 consensus_queue.cc:260] T 7a7564a63b8041ff80f64a7f8d533acb P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:23.920584 13876 ts_tablet_manager.cc:1434] T 7a7564a63b8041ff80f64a7f8d533acb P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent starting tablet: real 0.012s	user 0.001s	sys 0.003s
I20260709 12:09:23.921501 13876 tablet_bootstrap.cc:492] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7: Bootstrap starting.
I20260709 12:09:23.926467 13877 tablet_bootstrap.cc:654] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:23.935672 13800 leader_election.cc:343] T 625e9b5c2aa14658af58496a21f9ee8b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.936151 13800 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:09:23.937664 13876 tablet_bootstrap.cc:654] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.939370 13958 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.939874 13958 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:23.942646 14109 raft_consensus.cc:2749] T 625e9b5c2aa14658af58496a21f9ee8b P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.946400 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:09:23.950783 13727 leader_election.cc:343] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.952401 13958 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:23.972117 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:23.972999 13682 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 0.
I20260709 12:09:23.988790 13726 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:09:23.990505 13958 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.991075 13958 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:23.994776 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:23.996014 13959 raft_consensus.cc:2804] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.996488 13959 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.996793 13959 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.997639 13876 tablet_bootstrap.cc:492] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7: No bootstrap required, opened a new log
I20260709 12:09:23.998147 13876 ts_tablet_manager.cc:1403] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent bootstrapping tablet: real 0.077s	user 0.032s	sys 0.025s
I20260709 12:09:24.003325 13878 tablet_bootstrap.cc:492] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd: No bootstrap required, opened a new log
I20260709 12:09:24.003961 13878 ts_tablet_manager.cc:1403] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd: Time spent bootstrapping tablet: real 0.147s	user 0.010s	sys 0.003s
I20260709 12:09:24.006521 13878 raft_consensus.cc:359] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.007200 13878 raft_consensus.cc:385] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.007464 13878 raft_consensus.cc:740] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.007623 13958 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:24.011276 13959 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.011552 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:24.013424 13726 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:09:24.014505 13959 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:24.016103 13878 consensus_queue.cc:260] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.018342 13878 ts_tablet_manager.cc:1434] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 12:09:24.018520 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:09:24.018386 13876 raft_consensus.cc:359] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.019217 13876 raft_consensus.cc:385] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.019367 13878 tablet_bootstrap.cc:492] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd: Bootstrap starting.
I20260709 12:09:24.019510 13876 raft_consensus.cc:740] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Initialized, Role: FOLLOWER
W20260709 12:09:24.020174 13727 leader_election.cc:343] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.020480 13876 consensus_queue.cc:260] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.015679 13958 raft_consensus.cc:2749] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:24.022368 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:09:24.023173 13682 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.023989 13876 ts_tablet_manager.cc:1434] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 12:09:24.025518 13876 tablet_bootstrap.cc:492] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7: Bootstrap starting.
I20260709 12:09:24.024982 14109 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.026803 14109 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.032600 14109 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:24.034348 13876 tablet_bootstrap.cc:654] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.034866 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:24.030748 13877 tablet_bootstrap.cc:492] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835: No bootstrap required, opened a new log
I20260709 12:09:24.038658 13682 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 1.
W20260709 12:09:24.038892 13800 leader_election.cc:343] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.039255 13877 ts_tablet_manager.cc:1403] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835: Time spent bootstrapping tablet: real 0.172s	user 0.024s	sys 0.014s
I20260709 12:09:24.042539 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:24.044018 13877 raft_consensus.cc:359] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.044759 13877 raft_consensus.cc:385] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.045069 13877 raft_consensus.cc:740] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.046943 13877 consensus_queue.cc:260] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:09:24.047951 13800 leader_election.cc:343] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.048605 13800 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:09:24.048952 13877 ts_tablet_manager.cc:1434] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.001s
I20260709 12:09:24.050105 13877 tablet_bootstrap.cc:492] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835: Bootstrap starting.
I20260709 12:09:24.054841 13726 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:09:24.056499 13877 tablet_bootstrap.cc:654] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.056787 14091 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.057500 14091 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.060550 14091 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:24.062088 13959 raft_consensus.cc:2804] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.062805 13959 raft_consensus.cc:697] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:09:24.063870 13959 consensus_queue.cc:237] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.068694 14109 raft_consensus.cc:2749] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:24.069069 13876 tablet_bootstrap.cc:492] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7: No bootstrap required, opened a new log
I20260709 12:09:24.069231 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:24.069546 13876 ts_tablet_manager.cc:1403] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent bootstrapping tablet: real 0.044s	user 0.018s	sys 0.019s
I20260709 12:09:24.072675 13877 tablet_bootstrap.cc:492] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835: No bootstrap required, opened a new log
I20260709 12:09:24.073547 13877 ts_tablet_manager.cc:1403] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.007s
I20260709 12:09:24.073372 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:09:24.078517 13634 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:24.072976 13876 raft_consensus.cc:359] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.080009 13876 raft_consensus.cc:385] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:09:24.073858 13727 leader_election.cc:343] T 7a7564a63b8041ff80f64a7f8d533acb P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.080439 13876 raft_consensus.cc:740] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.081421 13876 consensus_queue.cc:260] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.061321 14091 consensus_queue.cc:1048] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 12:09:24.083632 13876 ts_tablet_manager.cc:1434] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:09:24.084837 13876 tablet_bootstrap.cc:492] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7: Bootstrap starting.
W20260709 12:09:24.086974 13726 leader_election.cc:343] T 7a7564a63b8041ff80f64a7f8d533acb P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.087476 13726 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:09:24.090842 13959 raft_consensus.cc:2749] T 7a7564a63b8041ff80f64a7f8d533acb P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:24.091550 13836 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.095075 14186 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.095715 14186 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.099872 13877 raft_consensus.cc:359] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.101532 13877 raft_consensus.cc:385] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.101819 13877 raft_consensus.cc:740] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.102478 13877 consensus_queue.cc:260] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.104030 13759 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.104548 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:24.105214 13877 ts_tablet_manager.cc:1434] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835: Time spent starting tablet: real 0.026s	user 0.002s	sys 0.004s
W20260709 12:09:24.105947 13651 leader_election.cc:343] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.103693 13583 catalog_manager.cc:5697] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 1 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:24.113034 13876 tablet_bootstrap.cc:654] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.113332 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:24.114097 13877 tablet_bootstrap.cc:492] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835: Bootstrap starting.
I20260709 12:09:24.100369 14186 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:24.115008 13959 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.115479 13959 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.117343 13959 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:24.118340 13833 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 0.
I20260709 12:09:24.120088 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:24.120857 13652 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:09:24.122618 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:24.123529 13832 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 0.
I20260709 12:09:24.125023 14082 raft_consensus.cc:2804] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.125454 14082 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.125767 13727 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
W20260709 12:09:24.126454 13726 leader_election.cc:343] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.127269 14091 raft_consensus.cc:2804] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.127816 14091 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.128288 14091 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.125833 14082 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.138021 13878 tablet_bootstrap.cc:654] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.169163 14179 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.169745 14179 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.173134 14179 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:24.175860 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:24.175662 14082 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.177044 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:24.178704 13800 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:09:24.182268 14185 consensus_queue.cc:1048] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:09:24.184075 14179 raft_consensus.cc:2749] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:24.148518 14091 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.193215 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:09:24.194855 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:09:24.195540 13832 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:24.195101 13651 leader_election.cc:343] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.185300 14082 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:24.206920 13876 tablet_bootstrap.cc:492] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7: No bootstrap required, opened a new log
I20260709 12:09:24.207425 13876 ts_tablet_manager.cc:1403] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent bootstrapping tablet: real 0.123s	user 0.020s	sys 0.012s
I20260709 12:09:24.212826 13878 tablet_bootstrap.cc:492] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd: No bootstrap required, opened a new log
I20260709 12:09:24.213379 13878 ts_tablet_manager.cc:1403] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd: Time spent bootstrapping tablet: real 0.194s	user 0.006s	sys 0.015s
I20260709 12:09:24.219244 13877 tablet_bootstrap.cc:654] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.221376 14091 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:24.223737 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:09:24.224829 13832 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 1.
I20260709 12:09:24.225196 13833 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.225124 13876 raft_consensus.cc:359] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.225984 13876 raft_consensus.cc:385] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.226292 13876 raft_consensus.cc:740] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.226145 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:09:24.227680 13726 leader_election.cc:343] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.230032 13652 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:09:24.230732 14185 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.231279 14185 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.231858 14186 raft_consensus.cc:2804] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.232437 14186 raft_consensus.cc:697] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:09:24.227008 13876 consensus_queue.cc:260] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.233388 14186 consensus_queue.cc:237] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.234937 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:24.236006 13876 ts_tablet_manager.cc:1434] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.002s
I20260709 12:09:24.236845 14185 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:24.238221 13876 tablet_bootstrap.cc:492] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7: Bootstrap starting.
W20260709 12:09:24.240129 13727 leader_election.cc:343] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.242137 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:24.242930 13685 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 0.
I20260709 12:09:24.245023 14091 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.245289 13726 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:09:24.246394 13958 raft_consensus.cc:2804] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.246764 13958 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.247160 13876 tablet_bootstrap.cc:654] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.247133 13958 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.245733 14091 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.252633 14091 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:24.254994 13833 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 1.
I20260709 12:09:24.258888 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:24.261704 13727 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:09:24.262387 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:24.263721 14185 raft_consensus.cc:2804] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:09:24.264497 13727 leader_election.cc:343] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.263746 13685 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 0.
I20260709 12:09:24.269234 13726 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:09:24.270740 14091 raft_consensus.cc:2804] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.271588 14091 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.272181 14091 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.265401 14185 raft_consensus.cc:697] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:09:24.277586 14185 consensus_queue.cc:237] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.278699 14082 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.279529 14082 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.283010 14082 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:24.286396 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:09:24.289346 13651 leader_election.cc:343] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.305042 14091 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.307540 13876 tablet_bootstrap.cc:492] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7: No bootstrap required, opened a new log
I20260709 12:09:24.308065 13876 ts_tablet_manager.cc:1403] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent bootstrapping tablet: real 0.071s	user 0.012s	sys 0.006s
I20260709 12:09:24.309432 13877 tablet_bootstrap.cc:492] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835: No bootstrap required, opened a new log
I20260709 12:09:24.309412 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:09:24.310067 13877 ts_tablet_manager.cc:1403] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835: Time spent bootstrapping tablet: real 0.204s	user 0.012s	sys 0.006s
I20260709 12:09:24.310268 13685 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.310846 13876 raft_consensus.cc:359] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.311532 13876 raft_consensus.cc:385] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.311812 13876 raft_consensus.cc:740] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.312819 13877 raft_consensus.cc:359] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.312440 13876 consensus_queue.cc:260] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.313510 13877 raft_consensus.cc:385] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.313694 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:09:24.314486 14212 log.cc:927] Time spent T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
W20260709 12:09:24.316663 13727 leader_election.cc:343] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.321480 13876 ts_tablet_manager.cc:1434] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.001s
I20260709 12:09:24.313897 13877 raft_consensus.cc:740] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.322464 13877 consensus_queue.cc:260] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.330616 13685 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 1.
I20260709 12:09:24.329627 13876 tablet_bootstrap.cc:492] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7: Bootstrap starting.
I20260709 12:09:24.309000 14091 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:24.332033 13877 ts_tablet_manager.cc:1434] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 12:09:24.334971 13877 tablet_bootstrap.cc:492] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835: Bootstrap starting.
I20260709 12:09:24.339489 13726 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:09:24.341543 14091 raft_consensus.cc:2804] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.342654 14091 raft_consensus.cc:697] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:09:24.345803 14091 consensus_queue.cc:237] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.359937 13876 tablet_bootstrap.cc:654] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.362171 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:24.363472 13877 tablet_bootstrap.cc:654] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.369086 13958 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.371505 13958 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:09:24.373291 13652 leader_election.cc:343] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.373762 13652 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:09:24.374029 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:09:24.374516 14076 raft_consensus.cc:2749] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:09:24.375738 13727 leader_election.cc:343] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.382758 13877 tablet_bootstrap.cc:492] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835: No bootstrap required, opened a new log
I20260709 12:09:24.383458 13877 ts_tablet_manager.cc:1403] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835: Time spent bootstrapping tablet: real 0.049s	user 0.016s	sys 0.002s
I20260709 12:09:24.386291 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:09:24.386884 13685 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.394111 13685 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 1.
I20260709 12:09:24.393496 13583 catalog_manager.cc:5697] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 0 to 1, leader changed from <none> to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 1 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:24.396106 13877 raft_consensus.cc:359] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.396848 13877 raft_consensus.cc:385] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.397264 13877 raft_consensus.cc:740] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.398092 13877 consensus_queue.cc:260] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.400491 13877 ts_tablet_manager.cc:1434] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.002s
I20260709 12:09:24.401413 13877 tablet_bootstrap.cc:492] T 1e31cd7111f2470d8d34b5898dce5765 P b98d2519bb504dc6905ed2ede4571835: Bootstrap starting.
I20260709 12:09:24.403339 13726 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:09:24.404105 13878 raft_consensus.cc:359] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.404855 13878 raft_consensus.cc:385] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.405135 13586 catalog_manager.cc:5697] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 1 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:24.408262 13877 tablet_bootstrap.cc:654] T 1e31cd7111f2470d8d34b5898dce5765 P b98d2519bb504dc6905ed2ede4571835: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.406407 14185 raft_consensus.cc:2804] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.410436 14185 raft_consensus.cc:697] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:09:24.411701 14185 consensus_queue.cc:237] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.405138 13878 raft_consensus.cc:740] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.418992 13877 tablet_bootstrap.cc:492] T 1e31cd7111f2470d8d34b5898dce5765 P b98d2519bb504dc6905ed2ede4571835: No bootstrap required, opened a new log
I20260709 12:09:24.418910 13878 consensus_queue.cc:260] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.419418 13877 ts_tablet_manager.cc:1403] T 1e31cd7111f2470d8d34b5898dce5765 P b98d2519bb504dc6905ed2ede4571835: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.003s
I20260709 12:09:24.422250 13877 raft_consensus.cc:359] T 1e31cd7111f2470d8d34b5898dce5765 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.422865 13878 ts_tablet_manager.cc:1434] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd: Time spent starting tablet: real 0.209s	user 0.003s	sys 0.004s
I20260709 12:09:24.422941 13877 raft_consensus.cc:385] T 1e31cd7111f2470d8d34b5898dce5765 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.423193 13876 tablet_bootstrap.cc:492] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7: No bootstrap required, opened a new log
I20260709 12:09:24.423388 13877 raft_consensus.cc:740] T 1e31cd7111f2470d8d34b5898dce5765 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.423648 13876 ts_tablet_manager.cc:1403] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent bootstrapping tablet: real 0.094s	user 0.011s	sys 0.006s
I20260709 12:09:24.423964 13878 tablet_bootstrap.cc:492] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd: Bootstrap starting.
I20260709 12:09:24.424042 13877 consensus_queue.cc:260] T 1e31cd7111f2470d8d34b5898dce5765 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.426573 13877 ts_tablet_manager.cc:1434] T 1e31cd7111f2470d8d34b5898dce5765 P b98d2519bb504dc6905ed2ede4571835: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:09:24.427487 13877 tablet_bootstrap.cc:492] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835: Bootstrap starting.
I20260709 12:09:24.427466 13876 raft_consensus.cc:359] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.428296 13876 raft_consensus.cc:385] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.428555 13876 raft_consensus.cc:740] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.430727 13878 tablet_bootstrap.cc:654] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.433980 13877 tablet_bootstrap.cc:654] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.432279 13876 consensus_queue.cc:260] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.437282 13876 ts_tablet_manager.cc:1434] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 12:09:24.438547 13876 tablet_bootstrap.cc:492] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7: Bootstrap starting.
I20260709 12:09:24.454804 13876 tablet_bootstrap.cc:654] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.454926 13877 tablet_bootstrap.cc:492] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835: No bootstrap required, opened a new log
I20260709 12:09:24.455636 13877 ts_tablet_manager.cc:1403] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.016s
I20260709 12:09:24.456794 13878 tablet_bootstrap.cc:492] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd: No bootstrap required, opened a new log
I20260709 12:09:24.459837 14110 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.460399 14110 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.461498 14186 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.462575 13878 ts_tablet_manager.cc:1403] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.007s
I20260709 12:09:24.462419 14186 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.462433 14110 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:24.465670 13878 raft_consensus.cc:359] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.468395 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:24.468837 13878 raft_consensus.cc:385] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.469117 13878 raft_consensus.cc:740] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.470147 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:24.471360 13685 raft_consensus.cc:2393] T c3c06f5564ed4c259ca5c238c3faf2a3 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 1: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:09:24.473582 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:24.474146 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:09:24.476037 13652 leader_election.cc:343] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.476452 13878 consensus_queue.cc:260] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.477995 13800 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:09:24.478827 13651 leader_election.cc:343] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.479326 13651 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:09:24.481045 14110 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.484422 14082 raft_consensus.cc:2749] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:24.481716 14186 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:24.487398 14091 consensus_queue.cc:1048] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:24.471024 13583 catalog_manager.cc:5697] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 1 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:24.492547 14110 raft_consensus.cc:2749] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:24.495028 14091 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.496380 14091 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.498747 14091 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:24.498942 13878 ts_tablet_manager.cc:1434] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 12:09:24.498154 13583 catalog_manager.cc:5697] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 1 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:24.500444 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:09:24.502009 13727 leader_election.cc:343] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.502210 13877 raft_consensus.cc:359] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.503456 13877 raft_consensus.cc:385] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.503755 13877 raft_consensus.cc:740] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.499923 13878 tablet_bootstrap.cc:492] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd: Bootstrap starting.
I20260709 12:09:24.504393 13877 consensus_queue.cc:260] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.507091 13877 ts_tablet_manager.cc:1434] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.000s
I20260709 12:09:24.507684 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:24.508051 13877 tablet_bootstrap.cc:492] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835: Bootstrap starting.
I20260709 12:09:24.509248 13685 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 0.
I20260709 12:09:24.514494 13877 tablet_bootstrap.cc:654] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.515808 13726 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:09:24.516952 14091 raft_consensus.cc:2804] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.517372 14091 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.517656 14091 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.525259 13878 tablet_bootstrap.cc:654] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.534134 13876 tablet_bootstrap.cc:492] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7: No bootstrap required, opened a new log
I20260709 12:09:24.533869 14185 consensus_queue.cc:1048] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:24.534654 13876 ts_tablet_manager.cc:1403] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent bootstrapping tablet: real 0.096s	user 0.022s	sys 0.055s
I20260709 12:09:24.543640 13877 tablet_bootstrap.cc:492] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835: No bootstrap required, opened a new log
I20260709 12:09:24.538146 13876 raft_consensus.cc:359] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.544257 13877 ts_tablet_manager.cc:1403] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835: Time spent bootstrapping tablet: real 0.036s	user 0.019s	sys 0.000s
I20260709 12:09:24.544473 13876 raft_consensus.cc:385] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.544853 13876 raft_consensus.cc:740] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.546393 13876 consensus_queue.cc:260] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.547361 13877 raft_consensus.cc:359] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.548128 13877 raft_consensus.cc:385] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.548454 13877 raft_consensus.cc:740] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.548674 13876 ts_tablet_manager.cc:1434] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.002s
I20260709 12:09:24.549329 13877 consensus_queue.cc:260] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.550140 13876 tablet_bootstrap.cc:492] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7: Bootstrap starting.
I20260709 12:09:24.560009 14082 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.560611 14082 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.562512 14076 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.563005 14082 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:24.563083 14076 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.552253 13877 ts_tablet_manager.cc:1434] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:09:24.564970 13877 tablet_bootstrap.cc:492] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835: Bootstrap starting.
I20260709 12:09:24.565279 14076 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:24.565327 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:24.566247 13876 tablet_bootstrap.cc:654] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.566463 13759 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 0.
I20260709 12:09:24.566941 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:24.567354 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:09:24.568578 13652 leader_election.cc:343] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.569146 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:09:24.570775 13652 leader_election.cc:343] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.571979 13651 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:09:24.582438 14186 raft_consensus.cc:2804] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.583089 14186 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.583600 14186 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.583839 13877 tablet_bootstrap.cc:654] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:24.585666 13651 leader_election.cc:343] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.586355 13651 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:09:24.596648 14082 raft_consensus.cc:2749] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:24.615418 14169 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.616110 14169 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.618265 14169 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:24.623589 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:24.624928 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:24.625765 13836 raft_consensus.cc:2393] T 625e9b5c2aa14658af58496a21f9ee8b P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 1: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:09:24.630506 13652 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:09:24.631260 14076 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.636133 13877 tablet_bootstrap.cc:492] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835: No bootstrap required, opened a new log
I20260709 12:09:24.636796 13877 ts_tablet_manager.cc:1403] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835: Time spent bootstrapping tablet: real 0.072s	user 0.014s	sys 0.008s
I20260709 12:09:24.642202 14091 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.643067 13878 tablet_bootstrap.cc:492] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd: No bootstrap required, opened a new log
I20260709 12:09:24.643589 13878 ts_tablet_manager.cc:1403] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd: Time spent bootstrapping tablet: real 0.144s	user 0.023s	sys 0.023s
I20260709 12:09:24.651062 14076 raft_consensus.cc:2749] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:24.651821 13876 tablet_bootstrap.cc:492] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7: No bootstrap required, opened a new log
I20260709 12:09:24.652319 13876 ts_tablet_manager.cc:1403] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent bootstrapping tablet: real 0.102s	user 0.043s	sys 0.018s
I20260709 12:09:24.655601 13876 raft_consensus.cc:359] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.656284 13876 raft_consensus.cc:385] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.656558 13876 raft_consensus.cc:740] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.657194 13876 consensus_queue.cc:260] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.659224 13876 ts_tablet_manager.cc:1434] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:09:24.660122 13876 tablet_bootstrap.cc:492] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7: Bootstrap starting.
I20260709 12:09:24.664799 14185 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.665885 14185 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.670809 13877 raft_consensus.cc:359] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.671528 13877 raft_consensus.cc:385] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.671461 14185 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:24.672972 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:24.676106 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:24.673934 13877 raft_consensus.cc:740] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.678066 13756 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.678314 13833 raft_consensus.cc:2393] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 1: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:09:24.678644 13877 consensus_queue.cc:260] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.679533 13727 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:09:24.681324 13877 ts_tablet_manager.cc:1434] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835: Time spent starting tablet: real 0.044s	user 0.005s	sys 0.001s
I20260709 12:09:24.682667 13877 tablet_bootstrap.cc:492] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835: Bootstrap starting.
I20260709 12:09:24.674651 14169 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.673625 13876 tablet_bootstrap.cc:654] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.684686 14169 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.688233 13912 consensus_queue.cc:1048] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.690429 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:24.690757 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:24.691166 13760 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 0.
W20260709 12:09:24.692173 13652 leader_election.cc:343] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.688302 14169 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:24.692732 14091 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:24.688274 14185 raft_consensus.cc:2749] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:24.716426 13878 raft_consensus.cc:359] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.692189 14082 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.718456 13651 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:09:24.766518 13878 raft_consensus.cc:385] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.766906 13878 raft_consensus.cc:740] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.767037 13912 raft_consensus.cc:2804] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:09:24.767139 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 48779.2us
I20260709 12:09:24.715909 14186 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.767551 13878 consensus_queue.cc:260] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.771865 14082 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.772782 13912 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.773252 13912 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.773924 14186 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:24.774296 14082 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:24.776149 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:09:24.776958 13759 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.778376 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:09:24.779212 13685 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.779498 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:09:24.781025 13651 leader_election.cc:343] T 1e31cd7111f2470d8d34b5898dce5765 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.784401 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:09:24.794776 13878 ts_tablet_manager.cc:1434] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd: Time spent starting tablet: real 0.151s	user 0.021s	sys 0.017s
I20260709 12:09:24.795236 13912 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.795780 13878 tablet_bootstrap.cc:492] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd: Bootstrap starting.
I20260709 12:09:24.801148 13912 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:24.795976 13877 tablet_bootstrap.cc:654] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:24.797621 13727 leader_election.cc:343] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.798277 13876 tablet_bootstrap.cc:492] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7: No bootstrap required, opened a new log
I20260709 12:09:24.806258 13876 ts_tablet_manager.cc:1403] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent bootstrapping tablet: real 0.146s	user 0.014s	sys 0.000s
I20260709 12:09:24.818790 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:24.831760 13836 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 0.
I20260709 12:09:24.823777 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:09:24.833372 13761 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.824417 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:09:24.816284 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:09:24.841326 13685 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 1.
I20260709 12:09:24.845088 13877 tablet_bootstrap.cc:492] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835: No bootstrap required, opened a new log
I20260709 12:09:24.844666 13759 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 1.
I20260709 12:09:24.830744 13878 tablet_bootstrap.cc:654] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.830183 13832 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.846339 13651 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:09:24.847486 14186 raft_consensus.cc:2804] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.847985 14186 raft_consensus.cc:697] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:09:24.848806 14186 consensus_queue.cc:237] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.828941 13876 raft_consensus.cc:359] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.851459 13876 raft_consensus.cc:385] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.852010 13876 raft_consensus.cc:740] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.853430 13876 consensus_queue.cc:260] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.845680 13877 ts_tablet_manager.cc:1403] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835: Time spent bootstrapping tablet: real 0.164s	user 0.012s	sys 0.001s
I20260709 12:09:24.855602 13878 tablet_bootstrap.cc:492] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd: No bootstrap required, opened a new log
I20260709 12:09:24.856122 13878 ts_tablet_manager.cc:1403] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd: Time spent bootstrapping tablet: real 0.061s	user 0.006s	sys 0.005s
I20260709 12:09:24.865620 13878 raft_consensus.cc:359] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.866395 13878 raft_consensus.cc:385] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.866690 13878 raft_consensus.cc:740] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.844928 13761 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 1.
I20260709 12:09:24.867380 13878 consensus_queue.cc:260] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:09:24.869650 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 81685.8us
I20260709 12:09:24.870972 13651 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:09:24.871831 14169 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.876096 14169 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.869694 13877 raft_consensus.cc:359] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.891218 13877 raft_consensus.cc:385] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.875432 13876 ts_tablet_manager.cc:1434] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent starting tablet: real 0.069s	user 0.006s	sys 0.000s
I20260709 12:09:24.891566 13877 raft_consensus.cc:740] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.878211 14169 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:24.880611 14082 raft_consensus.cc:2804] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.892318 14082 raft_consensus.cc:697] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:09:24.892215 13877 consensus_queue.cc:260] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.893193 14082 consensus_queue.cc:237] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.893658 13876 tablet_bootstrap.cc:492] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7: Bootstrap starting.
I20260709 12:09:24.883033 14237 consensus_queue.cc:1048] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.902798 13652 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:09:24.873097 13878 ts_tablet_manager.cc:1434] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
W20260709 12:09:24.903895 13652 leader_election.cc:343] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:24.904743 13652 leader_election.cc:343] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.904951 13878 tablet_bootstrap.cc:492] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd: Bootstrap starting.
I20260709 12:09:24.883538 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:24.894476 13877 ts_tablet_manager.cc:1434] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260709 12:09:24.869223 14236 consensus_queue.cc:1048] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.026s
I20260709 12:09:24.905706 14076 consensus_queue.cc:1048] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:24.906122 13760 raft_consensus.cc:2468] T 7a7564a63b8041ff80f64a7f8d533acb P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 0.
I20260709 12:09:24.907305 14076 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.907789 14076 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.908167 14076 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.917037 13837 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.882421 13726 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:09:24.922500 14237 raft_consensus.cc:2804] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.923307 14237 raft_consensus.cc:697] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:09:24.926416 13877 tablet_bootstrap.cc:492] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835: Bootstrap starting.
I20260709 12:09:24.925272 14237 consensus_queue.cc:237] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.929216 14192 consensus_queue.cc:1048] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.931535 14076 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.923039 13878 tablet_bootstrap.cc:654] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.932789 14192 consensus_queue.cc:1048] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:24.933745 14182 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.937846 14182 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:24.940481 14182 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:24.945119 13876 tablet_bootstrap.cc:654] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.945348 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:24.936131 14076 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:24.960132 13584 catalog_manager.cc:5697] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 1 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:24.963019 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 57295.1us
I20260709 12:09:24.952389 13877 tablet_bootstrap.cc:654] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.965010 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:24.953262 13583 catalog_manager.cc:5697] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 0 to 1, leader changed from <none> to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 1 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:24.969226 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:09:24.970003 13836 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.954252 13651 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:09:24.991807 14169 raft_consensus.cc:2804] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.992313 14169 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.992734 14169 raft_consensus.cc:3060] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.998147 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:24.998956 13687 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 1.
I20260709 12:09:25.004532 14237 consensus_queue.cc:1048] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:25.008694 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:09:24.955423 13878 tablet_bootstrap.cc:492] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd: No bootstrap required, opened a new log
I20260709 12:09:25.013167 14236 consensus_queue.cc:1048] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:25.014380 13878 ts_tablet_manager.cc:1403] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd: Time spent bootstrapping tablet: real 0.110s	user 0.013s	sys 0.001s
I20260709 12:09:25.018371 13800 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:09:25.019151 14169 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:09:25.020052 13651 leader_election.cc:343] T 1e31cd7111f2470d8d34b5898dce5765 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:25.021191 13652 leader_election.cc:343] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.027665 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:09:25.017526 13878 raft_consensus.cc:359] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:25.038036 13878 raft_consensus.cc:385] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.038540 13878 raft_consensus.cc:740] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.040937 13877 tablet_bootstrap.cc:492] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835: No bootstrap required, opened a new log
I20260709 12:09:25.043102 13877 ts_tablet_manager.cc:1403] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835: Time spent bootstrapping tablet: real 0.117s	user 0.013s	sys 0.007s
I20260709 12:09:25.024784 13836 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 1.
I20260709 12:09:25.044287 14239 raft_consensus.cc:2804] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:25.046350 13878 consensus_queue.cc:260] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:25.035365 14169 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:25.035586 13760 raft_consensus.cc:3060] T 7a7564a63b8041ff80f64a7f8d533acb P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.050232 13652 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:09:25.052964 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:09:25.053929 14186 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:25.054658 14186 raft_consensus.cc:697] T 1e31cd7111f2470d8d34b5898dce5765 P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:09:25.055806 14186 consensus_queue.cc:237] T 1e31cd7111f2470d8d34b5898dce5765 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:25.068176 13760 raft_consensus.cc:2468] T 7a7564a63b8041ff80f64a7f8d533acb P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 1.
I20260709 12:09:25.071310 13876 tablet_bootstrap.cc:492] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7: No bootstrap required, opened a new log
I20260709 12:09:25.072037 13876 ts_tablet_manager.cc:1403] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent bootstrapping tablet: real 0.180s	user 0.017s	sys 0.005s
I20260709 12:09:25.075635 13876 raft_consensus.cc:359] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:25.094008 13876 raft_consensus.cc:385] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.101892 13876 raft_consensus.cc:740] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.060454 13583 catalog_manager.cc:5697] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 0 to 1, leader changed from <none> to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 1 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:25.079720 13877 raft_consensus.cc:359] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:25.110666 13877 raft_consensus.cc:385] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.057525 13878 ts_tablet_manager.cc:1434] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.000s
I20260709 12:09:25.051784 14239 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:09:25.111086 13877 raft_consensus.cc:740] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.111470 14239 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:25.103264 13876 consensus_queue.cc:260] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:25.111982 13878 tablet_bootstrap.cc:492] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd: Bootstrap starting.
W20260709 12:09:25.058751 13652 leader_election.cc:343] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:25.112478 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 53769.8us
I20260709 12:09:25.113884 13877 consensus_queue.cc:260] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:25.116289 13876 ts_tablet_manager.cc:1434] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.000s
I20260709 12:09:25.117846 13876 tablet_bootstrap.cc:492] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7: Bootstrap starting.
I20260709 12:09:25.119573 13651 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
W20260709 12:09:25.120455 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 45030.4us
I20260709 12:09:25.123473 14249 raft_consensus.cc:2804] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:25.124137 14249 raft_consensus.cc:697] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:09:25.124974 14249 consensus_queue.cc:237] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:25.130688 13877 ts_tablet_manager.cc:1434] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835: Time spent starting tablet: real 0.087s	user 0.008s	sys 0.000s
I20260709 12:09:25.136943 13877 tablet_bootstrap.cc:492] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835: Bootstrap starting.
I20260709 12:09:25.133853 14239 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:25.143381 13878 tablet_bootstrap.cc:654] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:25.147891 13634 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:25.163609 13876 tablet_bootstrap.cc:654] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.181564 13586 catalog_manager.cc:5697] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 0 to 1, leader changed from <none> to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 1 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:25.183162 13586 catalog_manager.cc:5697] T 1e31cd7111f2470d8d34b5898dce5765 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 0 to 1, leader changed from <none> to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 1 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:25.160706 14249 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.198312 14239 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:25.199378 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:09:25.206689 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:09:25.208326 13800 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:09:25.209558 14238 raft_consensus.cc:2749] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:25.202006 14249 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:25.213244 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:25.213973 13763 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 1.
I20260709 12:09:25.215075 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:25.215741 13832 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 1.
I20260709 12:09:25.216254 13878 tablet_bootstrap.cc:492] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd: No bootstrap required, opened a new log
I20260709 12:09:25.215349 13651 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:09:25.216835 13878 ts_tablet_manager.cc:1403] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd: Time spent bootstrapping tablet: real 0.105s	user 0.019s	sys 0.030s
I20260709 12:09:25.219188 14249 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:25.219015 13877 tablet_bootstrap.cc:654] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.223928 13878 raft_consensus.cc:359] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:25.224368 14249 raft_consensus.cc:2804] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:25.224685 13878 raft_consensus.cc:385] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.224812 14249 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:25.225068 13878 raft_consensus.cc:740] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.225317 13876 tablet_bootstrap.cc:492] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7: No bootstrap required, opened a new log
I20260709 12:09:25.225829 13876 ts_tablet_manager.cc:1403] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent bootstrapping tablet: real 0.108s	user 0.006s	sys 0.008s
I20260709 12:09:25.225931 13878 consensus_queue.cc:260] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:25.228340 13878 ts_tablet_manager.cc:1434] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:09:25.228730 13876 raft_consensus.cc:359] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:25.229389 13878 tablet_bootstrap.cc:492] T e39d323dce0c45249bf1cf9b6062ab9a P 96701a74fdee481fb5f54aac841e17dd: Bootstrap starting.
I20260709 12:09:25.229491 13876 raft_consensus.cc:385] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.230006 13876 raft_consensus.cc:740] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.230760 13876 consensus_queue.cc:260] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:25.238545 14249 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:25.239631 13876 ts_tablet_manager.cc:1434] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:09:25.240638 13876 tablet_bootstrap.cc:492] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7: Bootstrap starting.
I20260709 12:09:25.243577 14091 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.244174 14091 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:25.246502 14091 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:25.248111 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:25.245416 14249 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:09:25.251319 13727 leader_election.cc:343] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.253029 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:09:25.253629 13760 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:25.255589 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:25.257951 13685 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 0.
I20260709 12:09:25.258517 14091 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.259086 14091 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:25.261700 13878 tablet_bootstrap.cc:654] T e39d323dce0c45249bf1cf9b6062ab9a P 96701a74fdee481fb5f54aac841e17dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.269199 13726 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:09:25.271970 14192 raft_consensus.cc:2804] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:25.272374 14192 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:25.272742 14192 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.277853 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:25.278142 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:25.278927 13687 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 0.
I20260709 12:09:25.278941 13836 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 0.
I20260709 12:09:25.282333 13726 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:09:25.283528 14236 raft_consensus.cc:2804] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:25.284080 14236 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:25.284700 14236 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.285228 13760 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 2.
I20260709 12:09:25.292181 14192 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:09:25.296088 13652 consensus_peers.cc:597] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 -> Peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Couldn't send request to peer 96701a74fdee481fb5f54aac841e17dd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:25.294518 13651 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:09:25.300182 14091 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:25.312350 13877 tablet_bootstrap.cc:492] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835: No bootstrap required, opened a new log
I20260709 12:09:25.312876 13877 ts_tablet_manager.cc:1403] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835: Time spent bootstrapping tablet: real 0.176s	user 0.016s	sys 0.000s
I20260709 12:09:25.301597 14169 raft_consensus.cc:2804] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:25.311410 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:09:25.314544 13687 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.314549 14169 raft_consensus.cc:697] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 2 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:09:25.319927 13876 tablet_bootstrap.cc:654] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.313053 14192 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:25.317591 14169 consensus_queue.cc:237] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:25.322001 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:09:25.326401 14249 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:25.315917 14236 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:25.331527 13878 tablet_bootstrap.cc:492] T e39d323dce0c45249bf1cf9b6062ab9a P 96701a74fdee481fb5f54aac841e17dd: No bootstrap required, opened a new log
I20260709 12:09:25.330951 13837 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.332019 13878 ts_tablet_manager.cc:1403] T e39d323dce0c45249bf1cf9b6062ab9a P 96701a74fdee481fb5f54aac841e17dd: Time spent bootstrapping tablet: real 0.103s	user 0.027s	sys 0.023s
I20260709 12:09:25.329636 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:09:25.333544 13727 leader_election.cc:343] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.333514 13836 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:25.338064 14236 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:25.338893 13878 raft_consensus.cc:359] T e39d323dce0c45249bf1cf9b6062ab9a P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:25.339610 13878 raft_consensus.cc:385] T e39d323dce0c45249bf1cf9b6062ab9a P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.339879 13878 raft_consensus.cc:740] T e39d323dce0c45249bf1cf9b6062ab9a P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.340585 13878 consensus_queue.cc:260] T e39d323dce0c45249bf1cf9b6062ab9a P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:25.340963 13877 raft_consensus.cc:359] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:25.341853 13877 raft_consensus.cc:385] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.342186 13877 raft_consensus.cc:740] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.342872 13877 consensus_queue.cc:260] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:25.346626 13878 ts_tablet_manager.cc:1434] T e39d323dce0c45249bf1cf9b6062ab9a P 96701a74fdee481fb5f54aac841e17dd: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:09:25.347134 13877 ts_tablet_manager.cc:1434] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 12:09:25.347754 13878 tablet_bootstrap.cc:492] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd: Bootstrap starting.
I20260709 12:09:25.348160 13877 tablet_bootstrap.cc:492] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835: Bootstrap starting.
I20260709 12:09:25.406689 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:09:25.409422 13834 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.428423 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:09:25.429622 13685 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.513794 13877 tablet_bootstrap.cc:654] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.513592 13836 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 2.
I20260709 12:09:25.518347 13687 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 1.
I20260709 12:09:25.520648 13584 catalog_manager.cc:5697] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 0 to 2, leader changed from <none> to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 2 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:25.524730 14169 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.529917 13834 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 1.
I20260709 12:09:25.532121 14169 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:25.556198 13685 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 1.
I20260709 12:09:25.559783 14169 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:25.580938 14239 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.581606 14239 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:25.583297 13878 tablet_bootstrap.cc:654] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.583169 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:25.584725 14239 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:25.580956 13726 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:09:25.588977 14192 raft_consensus.cc:2804] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:25.592675 14192 raft_consensus.cc:697] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:09:25.587404 13727 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:09:25.596925 14236 raft_consensus.cc:2804] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:25.599784 14236 raft_consensus.cc:697] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:09:25.602398 14236 consensus_queue.cc:237] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:25.605958 14249 consensus_queue.cc:1048] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:25.594071 14192 consensus_queue.cc:237] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:25.610414 13876 tablet_bootstrap.cc:492] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7: No bootstrap required, opened a new log
I20260709 12:09:25.611459 13876 ts_tablet_manager.cc:1403] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent bootstrapping tablet: real 0.371s	user 0.020s	sys 0.006s
I20260709 12:09:25.613253 14249 consensus_queue.cc:1048] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:25.615221 14237 consensus_queue.cc:1048] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 12:09:25.616634 13877 tablet_bootstrap.cc:492] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835: No bootstrap required, opened a new log
I20260709 12:09:25.617345 13877 ts_tablet_manager.cc:1403] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835: Time spent bootstrapping tablet: real 0.269s	user 0.015s	sys 0.024s
I20260709 12:09:25.622236 13958 consensus_queue.cc:1048] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:09:25.624764 13877 raft_consensus.cc:359] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:25.649953 13877 raft_consensus.cc:385] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.653673 13877 raft_consensus.cc:740] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Initialized, Role: FOLLOWER
W20260709 12:09:25.657058 13651 leader_election.cc:343] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.662945 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:25.661815 13877 consensus_queue.cc:260] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:25.655298 13833 raft_consensus.cc:1240] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:25.682037 14192 consensus_queue.cc:1059] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:25.699849 13878 tablet_bootstrap.cc:492] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd: No bootstrap required, opened a new log
I20260709 12:09:25.728443 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:25.729288 13682 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 1.
W20260709 12:09:25.733760 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 74655.9us
I20260709 12:09:25.742125 14217 raft_consensus.cc:3055] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:25.742733 14217 raft_consensus.cc:740] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:09:25.746883 14179 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.747666 14179 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:25.798923 14217 consensus_queue.cc:260] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:25.822149 13877 ts_tablet_manager.cc:1434] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835: Time spent starting tablet: real 0.204s	user 0.020s	sys 0.017s
I20260709 12:09:25.824692 14186 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.826452 13836 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.834259 13878 ts_tablet_manager.cc:1403] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd: Time spent bootstrapping tablet: real 0.487s	user 0.026s	sys 0.019s
I20260709 12:09:25.830165 14217 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:25.841627 13958 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.842269 13958 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:25.843025 13876 raft_consensus.cc:359] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:25.843776 13958 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:25.844054 13876 raft_consensus.cc:385] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.844527 13876 raft_consensus.cc:740] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.845544 13876 consensus_queue.cc:260] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:25.825337 14186 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:25.887552 13800 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:09:25.921589 13912 consensus_queue.cc:1048] T 1e31cd7111f2470d8d34b5898dce5765 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.095s
I20260709 12:09:25.922750 14238 raft_consensus.cc:2804] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:25.923221 14238 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:09:25.923616 14238 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:25.927785 14186 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:25.930531 13876 ts_tablet_manager.cc:1434] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent starting tablet: real 0.318s	user 0.010s	sys 0.000s
W20260709 12:09:25.949481 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 62103.7us
I20260709 12:09:25.952221 13878 raft_consensus.cc:359] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:25.966349 13878 raft_consensus.cc:385] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.966950 13878 raft_consensus.cc:740] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.968961 13878 consensus_queue.cc:260] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:25.971844 13876 tablet_bootstrap.cc:492] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7: Bootstrap starting.
I20260709 12:09:25.977075 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:25.987430 13878 ts_tablet_manager.cc:1434] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd: Time spent starting tablet: real 0.153s	user 0.002s	sys 0.019s
I20260709 12:09:25.997956 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:25.983939 13687 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 0.
I20260709 12:09:26.005930 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:09:26.022240 13652 consensus_peers.cc:597] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 -> Peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Couldn't send request to peer 96701a74fdee481fb5f54aac841e17dd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:26.025456 14186 consensus_queue.cc:1048] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
W20260709 12:09:26.040818 14278 log.cc:927] Time spent T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 12:09:26.041252 13762 raft_consensus.cc:1275] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:09:26.046901 14082 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:26.047813 14082 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:26.027145 14179 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:09:26.052024 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 47665.7us
I20260709 12:09:26.053380 13876 tablet_bootstrap.cc:654] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:26.057240 13651 consensus_peers.cc:597] T 1e31cd7111f2470d8d34b5898dce5765 P b98d2519bb504dc6905ed2ede4571835 -> Peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Couldn't send request to peer 3f37c9cc9dda46b4be21dd675ba78fb7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:26.064742 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:26.083061 13878 tablet_bootstrap.cc:492] T 34a12e91341d4472be7460f1061495db P 96701a74fdee481fb5f54aac841e17dd: Bootstrap starting.
I20260709 12:09:26.086828 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:09:26.093659 13652 leader_election.cc:343] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.096884 14082 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:09:26.106765 13727 leader_election.cc:343] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.066264 14238 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:09:26.124164 13651 leader_election.cc:343] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.124644 14249 consensus_queue.cc:1048] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:26.125739 13651 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:09:26.127764 14076 raft_consensus.cc:2749] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:26.129231 14186 consensus_queue.cc:1048] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:26.131237 14238 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:26.133103 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:26.139815 13831 raft_consensus.cc:1240] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:26.151086 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:26.154712 13726 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:09:26.206998 13878 tablet_bootstrap.cc:654] T 34a12e91341d4472be7460f1061495db P 96701a74fdee481fb5f54aac841e17dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.177069 14236 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:26.212993 13584 catalog_manager.cc:5697] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 1 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:26.221176 13584 catalog_manager.cc:5697] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 1 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:26.222057 13800 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:09:26.223217 13958 consensus_queue.cc:1059] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:26.210544 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:09:26.232208 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 46258.4us
I20260709 12:09:26.232651 13876 tablet_bootstrap.cc:492] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7: No bootstrap required, opened a new log
I20260709 12:09:26.233170 13876 ts_tablet_manager.cc:1403] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent bootstrapping tablet: real 0.266s	user 0.019s	sys 0.014s
I20260709 12:09:26.216310 14236 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:26.230448 14238 raft_consensus.cc:2749] T e39d323dce0c45249bf1cf9b6062ab9a P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:26.258769 14091 raft_consensus.cc:2804] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:26.259295 14091 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:26.259627 14091 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.266670 13876 raft_consensus.cc:359] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:26.267755 13876 raft_consensus.cc:385] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.268116 13876 raft_consensus.cc:740] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.287833 13876 consensus_queue.cc:260] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:26.281708 13757 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 0.
I20260709 12:09:26.303399 14236 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:26.305876 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:09:26.309937 14091 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:09:26.315275 14292 log.cc:927] Time spent T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:09:26.282374 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:26.325111 14091 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:26.329372 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:09:26.332474 13876 ts_tablet_manager.cc:1434] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent starting tablet: real 0.099s	user 0.008s	sys 0.002s
W20260709 12:09:26.332901 13727 leader_election.cc:343] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.334858 14279 raft_consensus.cc:3055] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:26.335325 14279 raft_consensus.cc:740] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:09:26.336886 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:26.293390 14286 consensus_queue.cc:1048] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.145s
W20260709 12:09:26.349849 13727 leader_election.cc:343] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.366631 13876 tablet_bootstrap.cc:492] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7: Bootstrap starting.
I20260709 12:09:26.336249 14279 consensus_queue.cc:260] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:26.375020 14279 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:09:26.382261 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 43605.2us
W20260709 12:09:26.393520 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 190938us
W20260709 12:09:26.399780 13652 leader_election.cc:343] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.400264 13652 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:09:26.402875 14076 raft_consensus.cc:2749] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:26.334221 14274 consensus_queue.cc:1048] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.143s
I20260709 12:09:26.410523 14281 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:26.411212 14281 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:26.436007 13878 tablet_bootstrap.cc:492] T 34a12e91341d4472be7460f1061495db P 96701a74fdee481fb5f54aac841e17dd: No bootstrap required, opened a new log
I20260709 12:09:26.436517 13878 ts_tablet_manager.cc:1403] T 34a12e91341d4472be7460f1061495db P 96701a74fdee481fb5f54aac841e17dd: Time spent bootstrapping tablet: real 0.354s	user 0.036s	sys 0.016s
I20260709 12:09:26.454010 13651 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:09:26.459929 14277 raft_consensus.cc:2804] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:26.459724 14281 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:26.481732 13876 tablet_bootstrap.cc:654] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.480978 14277 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:26.487645 14277 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.505264 13878 raft_consensus.cc:359] T 34a12e91341d4472be7460f1061495db P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:26.506497 13878 raft_consensus.cc:385] T 34a12e91341d4472be7460f1061495db P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.506856 13878 raft_consensus.cc:740] T 34a12e91341d4472be7460f1061495db P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.507565 13878 consensus_queue.cc:260] T 34a12e91341d4472be7460f1061495db P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:26.510975 13833 raft_consensus.cc:3060] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.513438 13878 ts_tablet_manager.cc:1434] T 34a12e91341d4472be7460f1061495db P 96701a74fdee481fb5f54aac841e17dd: Time spent starting tablet: real 0.077s	user 0.008s	sys 0.000s
W20260709 12:09:26.516394 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:26.523742 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:09:26.536448 13876 tablet_bootstrap.cc:492] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7: No bootstrap required, opened a new log
I20260709 12:09:26.537213 13876 ts_tablet_manager.cc:1403] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent bootstrapping tablet: real 0.171s	user 0.016s	sys 0.005s
I20260709 12:09:26.527551 14277 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:09:26.552367 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 349225us
I20260709 12:09:26.557821 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:09:26.559764 13834 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.559316 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:26.563036 13688 raft_consensus.cc:2393] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 1: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:09:26.571936 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:09:26.584689 13683 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.585119 13830 raft_consensus.cc:1275] T c6d20ad9ea2849238148cd46eb3be62c P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
W20260709 12:09:26.590356 13652 leader_election.cc:343] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.594679 13878 tablet_bootstrap.cc:492] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd: Bootstrap starting.
I20260709 12:09:26.602989 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:26.603791 13756 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 2.
I20260709 12:09:26.608526 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:26.610145 13876 raft_consensus.cc:359] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:26.613482 13876 raft_consensus.cc:385] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.616058 13876 raft_consensus.cc:740] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.617187 13876 consensus_queue.cc:260] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:26.615298 13800 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:09:26.570685 14277 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:26.635720 13800 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:09:26.636682 14282 raft_consensus.cc:2804] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:26.637756 14282 raft_consensus.cc:697] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 2 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:09:26.640648 14306 raft_consensus.cc:2749] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:26.667867 14091 consensus_queue.cc:1048] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:26.701310 13726 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:09:26.658773 14282 consensus_queue.cc:237] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:09:26.710865 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 59581.6us
I20260709 12:09:26.724511 13834 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 1.
I20260709 12:09:26.746124 13652 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:09:26.755026 14192 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:26.757023 14076 raft_consensus.cc:2804] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:26.757493 14076 raft_consensus.cc:697] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:09:26.755616 14192 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:26.768527 13876 ts_tablet_manager.cc:1434] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent starting tablet: real 0.231s	user 0.009s	sys 0.000s
I20260709 12:09:26.768685 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:26.769438 13686 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 0.
I20260709 12:09:26.769665 13876 tablet_bootstrap.cc:492] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7: Bootstrap starting.
I20260709 12:09:26.770265 14076 consensus_queue.cc:237] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:26.780176 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:09:26.838477 13958 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:26.839195 13958 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:26.844969 13958 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:26.845532 14311 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.845945 14314 consensus_queue.cc:1048] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.176s
I20260709 12:09:26.868439 13878 tablet_bootstrap.cc:654] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.871950 13683 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 1.
I20260709 12:09:26.895807 13876 tablet_bootstrap.cc:654] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:26.908924 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 59262.5us
I20260709 12:09:26.923060 14192 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:26.927269 13584 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45618 (request call id 103) took 1073 ms. Trace:
I20260709 12:09:26.954638 14311 raft_consensus.cc:2749] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:26.970844 13726 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:09:26.973047 13958 raft_consensus.cc:2804] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:26.973150 13726 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:09:26.973440 13958 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:26.974153 13958 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.987205 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:26.988169 13681 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 0.
I20260709 12:09:26.978073 14237 raft_consensus.cc:2804] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:26.991571 14237 raft_consensus.cc:697] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:09:26.992637 14237 consensus_queue.cc:237] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:09:26.993861 13634 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:26.927750 13584 rpcz_store.cc:276] 0709 12:09:25.853586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:25.853988 (+   402us) service_pool.cc:224] Handling call
0709 12:09:26.927175 (+1073187us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:09:26.410497 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:09:26.411219 (+   722us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:09:26.411257 (+    38us) write_op.cc:435] Acquired schema lock
0709 12:09:26.411277 (+    20us) tablet.cc:662] Decoding operations
0709 12:09:26.411713 (+   436us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:09:26.411792 (+    79us) write_op.cc:641] Partition lock acquired for write op
0709 12:09:26.411835 (+    43us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:09:26.412284 (+   449us) tablet.cc:701] Row locks acquired
0709 12:09:26.412301 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:09:26.412451 (+   150us) write_op.cc:270] Start()
0709 12:09:26.412559 (+   108us) write_op.cc:276] Timestamp: P: 1783598966412404 usec, L: 0
0709 12:09:26.412591 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 12:09:26.443239 (+ 30648us) log.cc:844] Serialized 928 byte log entry
0709 12:09:26.514777 (+ 71538us) op_driver.cc:464] REPLICATION: finished
0709 12:09:26.587137 (+ 72360us) write_op.cc:301] APPLY: starting
0709 12:09:26.587224 (+    87us) tablet.cc:1367] starting BulkCheckPresence
0709 12:09:26.587359 (+   135us) tablet.cc:1370] finished BulkCheckPresence
0709 12:09:26.587504 (+   145us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:09:26.646927 (+ 59423us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:09:26.647084 (+   157us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:09:26.647128 (+    44us) write_op.cc:312] APPLY: finished
0709 12:09:26.647357 (+   229us) log.cc:844] Serialized 28 byte log entry
0709 12:09:26.647537 (+   180us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:26.647633 (+    96us) write_op.cc:454] Released schema lock
0709 12:09:26.647669 (+    36us) write_op.cc:341] FINISH: Updating metrics
0709 12:09:26.647990 (+   321us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:26.648022 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":16348,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":72035,"apply.run_cpu_time_us":2496,"apply.run_wall_time_us":60844,"num_ops":2,"prepare.queue_time_us":176483,"prepare.run_cpu_time_us":3526,"prepare.run_wall_time_us":36317,"replication_time_us":101980,"thread_start_us":39421,"threads_started":2}]]}
I20260709 12:09:26.981242 14312 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:09:27.012553 14312 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:27.018970 13726 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:09:27.015012 14312 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:27.032778 14192 raft_consensus.cc:2804] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:27.036003 14192 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:27.036440 14192 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.038383 13878 tablet_bootstrap.cc:492] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd: No bootstrap required, opened a new log
I20260709 12:09:27.038902 13878 ts_tablet_manager.cc:1403] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd: Time spent bootstrapping tablet: real 0.445s	user 0.020s	sys 0.022s
I20260709 12:09:27.040879 13756 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 1.
I20260709 12:09:27.054795 13958 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:27.067301 13958 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:09:27.066355 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 47522.5us
I20260709 12:09:27.077126 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:09:27.079281 13685 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.079628 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:27.109323 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:27.133262 13876 tablet_bootstrap.cc:492] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7: No bootstrap required, opened a new log
I20260709 12:09:27.133831 13876 ts_tablet_manager.cc:1403] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent bootstrapping tablet: real 0.364s	user 0.015s	sys 0.010s
I20260709 12:09:27.136538 13685 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 1.
I20260709 12:09:27.142956 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:27.143898 13835 raft_consensus.cc:2393] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 2: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:09:27.153738 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:27.159874 13726 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:09:27.156888 13758 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 2.
I20260709 12:09:27.169111 14192 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:27.169674 13878 raft_consensus.cc:359] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:27.170385 13878 raft_consensus.cc:385] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:27.170825 13878 raft_consensus.cc:740] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Initialized, Role: FOLLOWER
I20260709 12:09:27.171573 14298 raft_consensus.cc:2804] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:27.175325 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:09:27.175704 14298 raft_consensus.cc:697] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:09:27.176047 13682 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.177407 14298 consensus_queue.cc:237] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:27.179325 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:09:27.188464 14333 log.cc:927] Time spent T c6d20ad9ea2849238148cd46eb3be62c P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:09:27.195727 13876 raft_consensus.cc:359] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:27.196484 13876 raft_consensus.cc:385] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:27.196779 13876 raft_consensus.cc:740] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Initialized, Role: FOLLOWER
I20260709 12:09:27.197465 13876 consensus_queue.cc:260] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:27.200351 13682 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 1.
I20260709 12:09:27.206794 14192 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:27.230147 13876 ts_tablet_manager.cc:1434] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent starting tablet: real 0.096s	user 0.007s	sys 0.000s
W20260709 12:09:27.241207 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 72317us
I20260709 12:09:27.245886 13726 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:09:27.247977 14311 raft_consensus.cc:2804] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:27.248526 14311 raft_consensus.cc:697] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:09:27.249428 14311 consensus_queue.cc:237] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:27.252208 13651 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:09:27.253039 14082 raft_consensus.cc:2804] T aa310cca462541d39d36ebe94a27446e P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:27.253489 14082 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:09:27.253950 14082 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:27.260862 13878 consensus_queue.cc:260] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:27.264719 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:09:27.267978 13727 leader_election.cc:343] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:27.268646 13586 catalog_manager.cc:5697] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 0 to 1, leader changed from <none> to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 1 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:27.274940 14082 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:09:27.275871 13727 leader_election.cc:343] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:27.301853 13727 leader_election.cc:343] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:27.277653 13878 ts_tablet_manager.cc:1434] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd: Time spent starting tablet: real 0.238s	user 0.012s	sys 0.011s
W20260709 12:09:27.304661 13727 consensus_peers.cc:597] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Couldn't send request to peer 96701a74fdee481fb5f54aac841e17dd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:27.305300 13878 tablet_bootstrap.cc:492] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd: Bootstrap starting.
W20260709 12:09:27.308895 13727 leader_election.cc:343] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:27.319130 13828 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.335285 13761 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.346779 14244 consensus_queue.cc:1048] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:27.334277 14082 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:27.354773 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:09:27.356338 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:09:27.357182 13833 raft_consensus.cc:2393] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 2: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:09:27.367551 13878 tablet_bootstrap.cc:654] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:27.380591 13762 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 2.
I20260709 12:09:27.413836 14342 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:27.414616 14342 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:27.417829 14342 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:27.434141 13651 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:09:27.436000 13912 raft_consensus.cc:2804] T aa310cca462541d39d36ebe94a27446e P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:27.436483 13912 raft_consensus.cc:697] T aa310cca462541d39d36ebe94a27446e P b98d2519bb504dc6905ed2ede4571835 [term 2 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:09:27.437280 13912 consensus_queue.cc:237] T aa310cca462541d39d36ebe94a27446e P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:27.443066 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:27.447490 13878 tablet_bootstrap.cc:492] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd: No bootstrap required, opened a new log
I20260709 12:09:27.448041 13878 ts_tablet_manager.cc:1403] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd: Time spent bootstrapping tablet: real 0.143s	user 0.036s	sys 0.028s
I20260709 12:09:27.449282 13763 raft_consensus.cc:1275] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:27.451385 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:27.452000 13763 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 2.
I20260709 12:09:27.455439 14275 consensus_queue.cc:1048] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:09:27.464902 14342 consensus_queue.cc:1048] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:27.469946 13585 catalog_manager.cc:5697] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 1 to 2, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 2 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:27.475555 13878 raft_consensus.cc:359] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:27.476612 13878 raft_consensus.cc:385] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:27.476974 13878 raft_consensus.cc:740] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Initialized, Role: FOLLOWER
I20260709 12:09:27.476974 13800 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:09:27.488440 13878 consensus_queue.cc:260] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:27.489527 14342 raft_consensus.cc:2804] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:27.490072 14342 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:27.490447 14342 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:27.496606 13584 catalog_manager.cc:5697] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 1 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:27.500608 14342 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:27.502961 14342 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:27.504377 13584 catalog_manager.cc:5697] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 1 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:27.507233 13878 ts_tablet_manager.cc:1434] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd: Time spent starting tablet: real 0.059s	user 0.005s	sys 0.003s
I20260709 12:09:27.508417 13878 tablet_bootstrap.cc:492] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd: Bootstrap starting.
I20260709 12:09:27.509254 13684 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:27.515290 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:09:27.522961 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:09:27.523765 13762 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:27.529860 13684 raft_consensus.cc:1275] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:27.531055 14244 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:27.531711 14244 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:27.515329 13878 tablet_bootstrap.cc:654] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:27.549721 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:27.564630 14283 consensus_queue.cc:1048] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:27.565025 14244 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:27.570981 13833 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.577154 13762 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 3.
I20260709 12:09:27.579246 13878 tablet_bootstrap.cc:492] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd: No bootstrap required, opened a new log
I20260709 12:09:27.586236 13878 ts_tablet_manager.cc:1403] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd: Time spent bootstrapping tablet: real 0.078s	user 0.013s	sys 0.006s
I20260709 12:09:27.595620 14341 consensus_queue.cc:1048] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:27.596602 13878 raft_consensus.cc:359] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:27.597517 13878 raft_consensus.cc:385] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:27.598845 13878 raft_consensus.cc:740] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Initialized, Role: FOLLOWER
I20260709 12:09:27.599686 13878 consensus_queue.cc:260] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:27.602424 13878 ts_tablet_manager.cc:1434] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:09:27.603561 13878 tablet_bootstrap.cc:492] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd: Bootstrap starting.
I20260709 12:09:27.612387 13878 tablet_bootstrap.cc:654] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:27.619872 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:27.627570 13586 catalog_manager.cc:5697] T aa310cca462541d39d36ebe94a27446e P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 1 to 2, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 2 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:27.628674 14286 consensus_queue.cc:1048] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:27.644176 13878 tablet_bootstrap.cc:492] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd: No bootstrap required, opened a new log
I20260709 12:09:27.644724 13878 ts_tablet_manager.cc:1403] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd: Time spent bootstrapping tablet: real 0.041s	user 0.001s	sys 0.012s
I20260709 12:09:27.656129 13652 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:09:27.658073 14244 raft_consensus.cc:2749] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:27.660079 13800 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:09:27.661067 14342 raft_consensus.cc:2804] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:27.656323 13878 raft_consensus.cc:359] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:27.661872 13878 raft_consensus.cc:385] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:27.662232 13878 raft_consensus.cc:740] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Initialized, Role: FOLLOWER
I20260709 12:09:27.663034 13878 consensus_queue.cc:260] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:27.670271 14342 raft_consensus.cc:697] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 3 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:09:27.700448 13584 catalog_manager.cc:5697] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 1 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:27.708873 13878 ts_tablet_manager.cc:1434] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd: Time spent starting tablet: real 0.064s	user 0.006s	sys 0.001s
I20260709 12:09:27.709412 14283 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:27.710371 13878 tablet_bootstrap.cc:492] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd: Bootstrap starting.
I20260709 12:09:27.710028 14283 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:27.712352 14283 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:27.717675 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:27.718307 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:27.723680 13800 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:09:27.727134 14283 raft_consensus.cc:2749] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:27.729828 14192 consensus_queue.cc:1048] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:27.736449 14342 consensus_queue.cc:237] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:27.747795 14298 consensus_queue.cc:1048] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:27.778647 13878 tablet_bootstrap.cc:654] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:27.798208 13727 consensus_peers.cc:597] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Couldn't send request to peer 96701a74fdee481fb5f54aac841e17dd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:27.801685 13586 catalog_manager.cc:5697] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 2 to 3, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 3 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:27.808624 13833 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.824733 14280 consensus_queue.cc:1048] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:27.829061 13878 tablet_bootstrap.cc:492] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd: No bootstrap required, opened a new log
I20260709 12:09:27.829809 13878 ts_tablet_manager.cc:1403] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd: Time spent bootstrapping tablet: real 0.120s	user 0.008s	sys 0.016s
I20260709 12:09:27.832917 13878 raft_consensus.cc:359] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:27.833840 13878 raft_consensus.cc:385] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:27.834260 13878 raft_consensus.cc:740] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Initialized, Role: FOLLOWER
I20260709 12:09:27.835331 13878 consensus_queue.cc:260] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:27.837996 13878 ts_tablet_manager.cc:1434] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:09:27.977248 13829 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.997155 13831 raft_consensus.cc:1240] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 3 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:27.999540 14275 consensus_queue.cc:1059] T aa310cca462541d39d36ebe94a27446e P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:28.000348 14275 consensus_queue.cc:1243] T aa310cca462541d39d36ebe94a27446e P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer 96701a74fdee481fb5f54aac841e17dd log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:09:28.000852 14275 raft_consensus.cc:3055] T aa310cca462541d39d36ebe94a27446e P b98d2519bb504dc6905ed2ede4571835 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:28.001188 14275 raft_consensus.cc:740] T aa310cca462541d39d36ebe94a27446e P b98d2519bb504dc6905ed2ede4571835 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:09:28.001976 14275 consensus_queue.cc:260] T aa310cca462541d39d36ebe94a27446e P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:28.003177 14275 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:28.169991 14342 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:28.170575 14342 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:28.173103 14342 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:28.174412 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:28.173991 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:28.176440 13800 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:09:28.177204 14342 raft_consensus.cc:2749] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:28.195760 13762 raft_consensus.cc:1275] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:28.197008 14283 consensus_queue.cc:1048] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:28.214497 13682 raft_consensus.cc:1275] T aa310cca462541d39d36ebe94a27446e P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:09:28.214864 13682 pending_rounds.cc:85] T aa310cca462541d39d36ebe94a27446e P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 1
I20260709 12:09:28.215078 13682 pending_rounds.cc:107] T aa310cca462541d39d36ebe94a27446e P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:09:28.215360 13682 raft_consensus.cc:2889] T aa310cca462541d39d36ebe94a27446e P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:09:28.218048 13829 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:28.222339 14283 consensus_queue.cc:1048] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:29.256798 12515 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:09:29.289227 14373 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:29.302232 14371 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:29.308655 12515 server_base.cc:1061] running on GCE node
W20260709 12:09:29.308964 14370 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:29.312973 12515 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:09:29.313352 12515 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:29.313560 12515 hybrid_clock.cc:648] HybridClock initialized: now 1783598969313545 us; error 0 us; skew 500 ppm
I20260709 12:09:29.314437 12515 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:29.318331 12515 webserver.cc:533] Webserver started at http://127.12.56.196:45725/ using document root <none> and password file <none>
I20260709 12:09:29.318938 12515 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:29.319185 12515 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:29.319569 12515 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:29.320863 12515 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894707649-12515-0/minicluster-data/ts-3-root/instance:
uuid: "ca9fbbc2c0a94897897d502d42f3951f"
format_stamp: "Formatted at 2026-07-09 12:09:29 on dist-test-slave-705g"
I20260709 12:09:29.328632 12515 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.008s	sys 0.002s
I20260709 12:09:29.333285 14378 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:29.334486 12515 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:09:29.335009 12515 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894707649-12515-0/minicluster-data/ts-3-root
uuid: "ca9fbbc2c0a94897897d502d42f3951f"
format_stamp: "Formatted at 2026-07-09 12:09:29 on dist-test-slave-705g"
I20260709 12:09:29.335419 12515 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894707649-12515-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894707649-12515-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894707649-12515-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:29.360059 12515 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:29.362187 12515 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:29.364689 12515 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:09:29.367897 12515 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:09:29.368216 12515 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:29.368572 12515 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:09:29.368770 12515 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:29.471177 12515 rpc_server.cc:307] RPC server started. Bound to: 127.12.56.196:46341
I20260709 12:09:29.471511 14440 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.56.196:46341 every 8 connection(s)
I20260709 12:09:29.478996 12515 auto_leader_rebalancer-test.cc:439] add a tserver: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:09:29.496017 14441 heartbeater.cc:344] Connected to a master server at 127.12.56.254:40645
I20260709 12:09:29.496778 14441 heartbeater.cc:461] Registering TS with master...
I20260709 12:09:29.498147 14441 heartbeater.cc:507] Master 127.12.56.254:40645 requested a full tablet report, sending...
I20260709 12:09:29.500844 13586 ts_manager.cc:194] Registered new tserver with Master: ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:09:29.502982 13586 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53318
I20260709 12:09:30.233069 13687 consensus_queue.cc:237] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:30.241199 13762 raft_consensus.cc:1275] T 3f29dda715314a93a03981264972c4c3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:30.242908 13831 raft_consensus.cc:1275] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:30.253021 14447 consensus_queue.cc:1048] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:30.258075 14275 consensus_queue.cc:1048] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:09:30.273500 13652 consensus_peers.cc:597] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 -> Peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Couldn't send request to peer ca9fbbc2c0a94897897d502d42f3951f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3f29dda715314a93a03981264972c4c3. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:30.277696 14275 raft_consensus.cc:2955] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:30.279661 13758 raft_consensus.cc:2955] T 3f29dda715314a93a03981264972c4c3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:30.282290 13831 raft_consensus.cc:2955] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:30.294965 13687 consensus_queue.cc:237] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:30.298462 13586 catalog_manager.cc:5697] T 3f29dda715314a93a03981264972c4c3 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New cstate: current_term: 1 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:30.319620 13833 raft_consensus.cc:1275] T 64b889ec5fe4445d81fe94e0ae9fb087 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:30.321513 14369 consensus_queue.cc:1048] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:09:30.326948 13652 consensus_peers.cc:597] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 -> Peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Couldn't send request to peer ca9fbbc2c0a94897897d502d42f3951f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 64b889ec5fe4445d81fe94e0ae9fb087. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:30.327833 13762 raft_consensus.cc:1275] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:30.329936 14369 consensus_queue.cc:1048] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:30.345463 14369 raft_consensus.cc:2955] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:30.351459 13831 raft_consensus.cc:2955] T 64b889ec5fe4445d81fe94e0ae9fb087 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:30.362843 13762 raft_consensus.cc:2955] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:30.385646 13584 catalog_manager.cc:5697] T 64b889ec5fe4445d81fe94e0ae9fb087 P 96701a74fdee481fb5f54aac841e17dd reported cstate change: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New cstate: current_term: 1 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:30.425711 13833 consensus_queue.cc:237] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:30.433729 13762 raft_consensus.cc:1275] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:30.435581 13682 raft_consensus.cc:1275] T 15347ea1eb2348e7b262bd0d59ce6f3a P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:30.437422 14342 consensus_queue.cc:1048] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:30.440507 14342 consensus_queue.cc:1048] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:09:30.452581 13801 consensus_peers.cc:597] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd -> Peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Couldn't send request to peer ca9fbbc2c0a94897897d502d42f3951f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 15347ea1eb2348e7b262bd0d59ce6f3a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:30.455518 14445 raft_consensus.cc:2955] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:30.460906 13758 raft_consensus.cc:2955] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:30.461483 13682 raft_consensus.cc:2955] T 15347ea1eb2348e7b262bd0d59ce6f3a P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:30.484135 13583 catalog_manager.cc:5697] T 15347ea1eb2348e7b262bd0d59ce6f3a P b98d2519bb504dc6905ed2ede4571835 reported cstate change: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New cstate: current_term: 1 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:30.503744 13687 consensus_queue.cc:237] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:30.507233 14441 heartbeater.cc:499] Master 127.12.56.254:40645 was elected leader, sending a full tablet report...
I20260709 12:09:30.541379 13762 raft_consensus.cc:1275] T 7a7564a63b8041ff80f64a7f8d533acb P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:30.542213 13652 consensus_peers.cc:597] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 -> Peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Couldn't send request to peer ca9fbbc2c0a94897897d502d42f3951f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7a7564a63b8041ff80f64a7f8d533acb. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:30.543835 13829 raft_consensus.cc:1275] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:30.544968 14464 consensus_queue.cc:1048] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:30.546815 14465 consensus_queue.cc:1048] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:30.563663 14464 raft_consensus.cc:2955] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:30.567665 13833 raft_consensus.cc:2955] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:30.572326 13762 raft_consensus.cc:2955] T 7a7564a63b8041ff80f64a7f8d533acb P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:30.584918 13584 catalog_manager.cc:5697] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 reported cstate change: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New cstate: current_term: 1 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:30.623678 14481 ts_tablet_manager.cc:933] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f: Initiating tablet copy from peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199)
I20260709 12:09:30.627570 14481 tablet_copy_client.cc:323] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Beginning tablet copy session from remote peer at address 127.12.56.193:33199
I20260709 12:09:30.643272 13698 tablet_copy_service.cc:140] P b98d2519bb504dc6905ed2ede4571835: Received BeginTabletCopySession request for tablet 3f29dda715314a93a03981264972c4c3 from peer ca9fbbc2c0a94897897d502d42f3951f ({username='slave'} at 127.0.0.1:48212)
I20260709 12:09:30.643857 13698 tablet_copy_service.cc:161] P b98d2519bb504dc6905ed2ede4571835: Beginning new tablet copy session on tablet 3f29dda715314a93a03981264972c4c3 from peer ca9fbbc2c0a94897897d502d42f3951f at {username='slave'} at 127.0.0.1:48212: session id = ca9fbbc2c0a94897897d502d42f3951f-3f29dda715314a93a03981264972c4c3
I20260709 12:09:30.651368 13698 tablet_copy_source_session.cc:215] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:30.654932 14481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f29dda715314a93a03981264972c4c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:30.667766 14481 tablet_copy_client.cc:806] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:30.668423 14481 tablet_copy_client.cc:670] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:30.673679 14481 tablet_copy_client.cc:538] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:30.686021 14481 tablet_bootstrap.cc:492] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap starting.
I20260709 12:09:30.713227 14481 tablet_bootstrap.cc:492] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:30.714112 14481 tablet_bootstrap.cc:492] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap complete.
I20260709 12:09:30.714774 14481 ts_tablet_manager.cc:1403] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.012s
I20260709 12:09:30.717743 14481 raft_consensus.cc:359] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:30.718580 14481 raft_consensus.cc:740] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Initialized, Role: LEARNER
I20260709 12:09:30.719144 14481 consensus_queue.cc:260] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:30.722371 14481 ts_tablet_manager.cc:1434] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.005s
I20260709 12:09:30.725126 13698 tablet_copy_service.cc:342] P b98d2519bb504dc6905ed2ede4571835: Request end of tablet copy session ca9fbbc2c0a94897897d502d42f3951f-3f29dda715314a93a03981264972c4c3 received from {username='slave'} at 127.0.0.1:48212
I20260709 12:09:30.725696 13698 tablet_copy_service.cc:434] P b98d2519bb504dc6905ed2ede4571835: ending tablet copy session ca9fbbc2c0a94897897d502d42f3951f-3f29dda715314a93a03981264972c4c3 on tablet 3f29dda715314a93a03981264972c4c3 with peer ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:09:30.807356 14481 ts_tablet_manager.cc:933] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f: Initiating tablet copy from peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199)
I20260709 12:09:30.811450 14481 tablet_copy_client.cc:323] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Beginning tablet copy session from remote peer at address 127.12.56.193:33199
I20260709 12:09:30.813323 13698 tablet_copy_service.cc:140] P b98d2519bb504dc6905ed2ede4571835: Received BeginTabletCopySession request for tablet 64b889ec5fe4445d81fe94e0ae9fb087 from peer ca9fbbc2c0a94897897d502d42f3951f ({username='slave'} at 127.0.0.1:48212)
I20260709 12:09:30.813927 13698 tablet_copy_service.cc:161] P b98d2519bb504dc6905ed2ede4571835: Beginning new tablet copy session on tablet 64b889ec5fe4445d81fe94e0ae9fb087 from peer ca9fbbc2c0a94897897d502d42f3951f at {username='slave'} at 127.0.0.1:48212: session id = ca9fbbc2c0a94897897d502d42f3951f-64b889ec5fe4445d81fe94e0ae9fb087
I20260709 12:09:30.821826 13698 tablet_copy_source_session.cc:215] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:30.824846 14481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64b889ec5fe4445d81fe94e0ae9fb087. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:30.836198 14481 tablet_copy_client.cc:806] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:30.836805 14481 tablet_copy_client.cc:670] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:30.840946 14481 tablet_copy_client.cc:538] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:30.849201 14481 tablet_bootstrap.cc:492] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap starting.
I20260709 12:09:30.867820 14481 tablet_bootstrap.cc:492] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:30.868736 14481 tablet_bootstrap.cc:492] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap complete.
I20260709 12:09:30.869469 14481 ts_tablet_manager.cc:1403] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.006s
I20260709 12:09:30.872404 14481 raft_consensus.cc:359] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:30.873257 14481 raft_consensus.cc:740] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Initialized, Role: LEARNER
I20260709 12:09:30.873943 14481 consensus_queue.cc:260] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:30.876109 14481 ts_tablet_manager.cc:1434] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:09:30.879535 13698 tablet_copy_service.cc:342] P b98d2519bb504dc6905ed2ede4571835: Request end of tablet copy session ca9fbbc2c0a94897897d502d42f3951f-64b889ec5fe4445d81fe94e0ae9fb087 received from {username='slave'} at 127.0.0.1:48212
I20260709 12:09:30.879993 13698 tablet_copy_service.cc:434] P b98d2519bb504dc6905ed2ede4571835: ending tablet copy session ca9fbbc2c0a94897897d502d42f3951f-64b889ec5fe4445d81fe94e0ae9fb087 on tablet 64b889ec5fe4445d81fe94e0ae9fb087 with peer ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:09:30.895924 14481 ts_tablet_manager.cc:933] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f: Initiating tablet copy from peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:30.912923 14481 tablet_copy_client.cc:323] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Beginning tablet copy session from remote peer at address 127.12.56.195:36603
I20260709 12:09:30.924144 13847 tablet_copy_service.cc:140] P 96701a74fdee481fb5f54aac841e17dd: Received BeginTabletCopySession request for tablet 15347ea1eb2348e7b262bd0d59ce6f3a from peer ca9fbbc2c0a94897897d502d42f3951f ({username='slave'} at 127.0.0.1:35422)
I20260709 12:09:30.924971 13847 tablet_copy_service.cc:161] P 96701a74fdee481fb5f54aac841e17dd: Beginning new tablet copy session on tablet 15347ea1eb2348e7b262bd0d59ce6f3a from peer ca9fbbc2c0a94897897d502d42f3951f at {username='slave'} at 127.0.0.1:35422: session id = ca9fbbc2c0a94897897d502d42f3951f-15347ea1eb2348e7b262bd0d59ce6f3a
I20260709 12:09:30.933471 13847 tablet_copy_source_session.cc:215] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:30.937057 14481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15347ea1eb2348e7b262bd0d59ce6f3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:30.955161 14481 tablet_copy_client.cc:806] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:30.955760 14481 tablet_copy_client.cc:670] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:30.960671 14481 tablet_copy_client.cc:538] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:30.969144 14481 tablet_bootstrap.cc:492] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap starting.
I20260709 12:09:30.994431 14481 tablet_bootstrap.cc:492] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:30.995333 14481 tablet_bootstrap.cc:492] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap complete.
I20260709 12:09:30.995932 14481 ts_tablet_manager.cc:1403] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f: Time spent bootstrapping tablet: real 0.027s	user 0.022s	sys 0.003s
I20260709 12:09:30.998471 14481 raft_consensus.cc:359] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:30.999224 14481 raft_consensus.cc:740] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Initialized, Role: LEARNER
I20260709 12:09:30.999778 14481 consensus_queue.cc:260] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:31.008618 14481 ts_tablet_manager.cc:1434] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:09:31.010439 13847 tablet_copy_service.cc:342] P 96701a74fdee481fb5f54aac841e17dd: Request end of tablet copy session ca9fbbc2c0a94897897d502d42f3951f-15347ea1eb2348e7b262bd0d59ce6f3a received from {username='slave'} at 127.0.0.1:35422
I20260709 12:09:31.010915 13847 tablet_copy_service.cc:434] P 96701a74fdee481fb5f54aac841e17dd: ending tablet copy session ca9fbbc2c0a94897897d502d42f3951f-15347ea1eb2348e7b262bd0d59ce6f3a on tablet 15347ea1eb2348e7b262bd0d59ce6f3a with peer ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:09:31.083191 14416 raft_consensus.cc:1217] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:31.106724 14481 ts_tablet_manager.cc:933] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f: Initiating tablet copy from peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199)
I20260709 12:09:31.113283 14481 tablet_copy_client.cc:323] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Beginning tablet copy session from remote peer at address 127.12.56.193:33199
I20260709 12:09:31.116585 13698 tablet_copy_service.cc:140] P b98d2519bb504dc6905ed2ede4571835: Received BeginTabletCopySession request for tablet 7a7564a63b8041ff80f64a7f8d533acb from peer ca9fbbc2c0a94897897d502d42f3951f ({username='slave'} at 127.0.0.1:48212)
I20260709 12:09:31.117223 13698 tablet_copy_service.cc:161] P b98d2519bb504dc6905ed2ede4571835: Beginning new tablet copy session on tablet 7a7564a63b8041ff80f64a7f8d533acb from peer ca9fbbc2c0a94897897d502d42f3951f at {username='slave'} at 127.0.0.1:48212: session id = ca9fbbc2c0a94897897d502d42f3951f-7a7564a63b8041ff80f64a7f8d533acb
I20260709 12:09:31.123075 13698 tablet_copy_source_session.cc:215] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:31.126091 14481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a7564a63b8041ff80f64a7f8d533acb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:31.137959 14481 tablet_copy_client.cc:806] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:31.138846 14481 tablet_copy_client.cc:670] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:31.142841 14481 tablet_copy_client.cc:538] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:31.150291 14481 tablet_bootstrap.cc:492] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap starting.
I20260709 12:09:31.172415 14481 tablet_bootstrap.cc:492] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:31.173482 14481 tablet_bootstrap.cc:492] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap complete.
I20260709 12:09:31.174243 14481 ts_tablet_manager.cc:1403] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f: Time spent bootstrapping tablet: real 0.024s	user 0.019s	sys 0.000s
I20260709 12:09:31.177076 14481 raft_consensus.cc:359] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:31.177977 14481 raft_consensus.cc:740] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Initialized, Role: LEARNER
I20260709 12:09:31.178711 14481 consensus_queue.cc:260] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:31.181257 14481 ts_tablet_manager.cc:1434] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:09:31.183040 13698 tablet_copy_service.cc:342] P b98d2519bb504dc6905ed2ede4571835: Request end of tablet copy session ca9fbbc2c0a94897897d502d42f3951f-7a7564a63b8041ff80f64a7f8d533acb received from {username='slave'} at 127.0.0.1:48212
I20260709 12:09:31.183529 13698 tablet_copy_service.cc:434] P b98d2519bb504dc6905ed2ede4571835: ending tablet copy session ca9fbbc2c0a94897897d502d42f3951f-7a7564a63b8041ff80f64a7f8d533acb on tablet 7a7564a63b8041ff80f64a7f8d533acb with peer ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:09:31.272061 14416 raft_consensus.cc:1217] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:31.328770 14416 raft_consensus.cc:1217] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:31.603560 14464 raft_consensus.cc:1064] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835: attempting to promote NON_VOTER ca9fbbc2c0a94897897d502d42f3951f to VOTER
I20260709 12:09:31.606353 14464 consensus_queue.cc:237] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:31.614850 13829 raft_consensus.cc:1275] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:31.617017 14369 consensus_queue.cc:1048] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:31.617501 14416 raft_consensus.cc:1275] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:31.618650 13758 raft_consensus.cc:1275] T 3f29dda715314a93a03981264972c4c3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:31.619760 14369 consensus_queue.cc:1048] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:31.622349 14369 consensus_queue.cc:1048] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:31.664742 14369 raft_consensus.cc:2955] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:31.667583 13758 raft_consensus.cc:2955] T 3f29dda715314a93a03981264972c4c3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:31.673488 13829 raft_consensus.cc:2955] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:31.678079 14416 raft_consensus.cc:2955] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:31.695451 13583 catalog_manager.cc:5697] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:31.731366 14416 raft_consensus.cc:1217] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:31.758550 13687 consensus_queue.cc:237] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:31.762696 14495 raft_consensus.cc:1064] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd: attempting to promote NON_VOTER ca9fbbc2c0a94897897d502d42f3951f to VOTER
I20260709 12:09:31.776146 14495 consensus_queue.cc:237] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:31.782371 14416 raft_consensus.cc:1275] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:31.785804 13831 raft_consensus.cc:1275] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:31.784235 14464 consensus_queue.cc:1048] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:31.789834 14416 raft_consensus.cc:1275] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:31.789901 13758 raft_consensus.cc:1275] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:31.791697 14369 consensus_queue.cc:1048] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:31.793008 14477 consensus_queue.cc:1048] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:31.793054 13687 raft_consensus.cc:1275] T 15347ea1eb2348e7b262bd0d59ce6f3a P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:31.795295 14477 consensus_queue.cc:1048] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:31.800710 14476 consensus_queue.cc:1048] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:31.804423 14369 raft_consensus.cc:2955] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:31.811619 13829 raft_consensus.cc:2955] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:31.818992 14415 raft_consensus.cc:2955] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:31.836676 13570 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3f29dda715314a93a03981264972c4c3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:31.848083 13585 catalog_manager.cc:5697] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: config changed from index 3 to 4, VOTER 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) evicted. New cstate: current_term: 1 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:31.857995 14477 raft_consensus.cc:2955] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:31.864923 14464 raft_consensus.cc:1064] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835: attempting to promote NON_VOTER ca9fbbc2c0a94897897d502d42f3951f to VOTER
I20260709 12:09:31.867799 14464 consensus_queue.cc:237] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:31.869107 13687 raft_consensus.cc:2955] T 15347ea1eb2348e7b262bd0d59ce6f3a P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:31.878538 13758 raft_consensus.cc:2955] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:31.883250 13752 tablet_service.cc:1558] Processing DeleteTablet for tablet 3f29dda715314a93a03981264972c4c3 with delete_type TABLET_DATA_TOMBSTONED (TS 3f37c9cc9dda46b4be21dd675ba78fb7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48110
I20260709 12:09:31.897414 14416 raft_consensus.cc:1275] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:31.898947 14369 consensus_queue.cc:1048] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:31.902769 13831 raft_consensus.cc:1275] T 64b889ec5fe4445d81fe94e0ae9fb087 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:31.906829 14369 consensus_queue.cc:1048] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:31.931108 13758 raft_consensus.cc:1275] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:31.936519 14464 consensus_queue.cc:1048] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:31.951467 14415 raft_consensus.cc:2955] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
W20260709 12:09:32.000702 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 54732.1us
I20260709 12:09:32.057842 14369 raft_consensus.cc:2955] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:32.065474 14509 tablet_replica.cc:333] T 3f29dda715314a93a03981264972c4c3 P 3f37c9cc9dda46b4be21dd675ba78fb7: stopping tablet replica
I20260709 12:09:32.070843 14509 raft_consensus.cc:2243] T 3f29dda715314a93a03981264972c4c3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:32.118476 14509 raft_consensus.cc:2272] T 3f29dda715314a93a03981264972c4c3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:09:32.123400 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 43765us
I20260709 12:09:32.126315 14416 raft_consensus.cc:2955] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:32.126920 13831 raft_consensus.cc:2955] T 64b889ec5fe4445d81fe94e0ae9fb087 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:32.180181 13763 raft_consensus.cc:2955] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:31.913573 13585 catalog_manager.cc:5697] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
W20260709 12:09:32.280988 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 96420.9us
I20260709 12:09:32.335358 14447 raft_consensus.cc:1064] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835: attempting to promote NON_VOTER ca9fbbc2c0a94897897d502d42f3951f to VOTER
I20260709 12:09:32.336071 13833 consensus_queue.cc:237] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:32.337946 14447 consensus_queue.cc:237] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:32.352433 14416 raft_consensus.cc:1275] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:32.354332 14513 consensus_queue.cc:1048] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:32.150718 14509 ts_tablet_manager.cc:1916] T 3f29dda715314a93a03981264972c4c3 P 3f37c9cc9dda46b4be21dd675ba78fb7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:32.358003 13584 catalog_manager.cc:5697] T 64b889ec5fe4445d81fe94e0ae9fb087 P 96701a74fdee481fb5f54aac841e17dd reported cstate change: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:32.366039 14476 raft_consensus.cc:2955] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:32.380927 13686 consensus_queue.cc:237] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:32.382736 14415 raft_consensus.cc:2955] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:32.413352 14414 raft_consensus.cc:1275] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:32.415040 13763 raft_consensus.cc:1275] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:32.416951 14518 consensus_queue.cc:1048] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:32.424295 14518 consensus_queue.cc:1048] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:32.427856 14519 raft_consensus.cc:2955] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:32.433907 13763 raft_consensus.cc:2955] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:32.451421 14416 raft_consensus.cc:2955] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:32.435942 13758 raft_consensus.cc:1275] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:32.454340 13570 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 64b889ec5fe4445d81fe94e0ae9fb087 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:32.469748 13585 catalog_manager.cc:5697] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: config changed from index 3 to 4, VOTER 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) evicted. New cstate: current_term: 1 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:32.476537 14514 consensus_queue.cc:1048] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:32.484472 13824 tablet_service.cc:1558] Processing DeleteTablet for tablet 64b889ec5fe4445d81fe94e0ae9fb087 with delete_type TABLET_DATA_TOMBSTONED (TS 96701a74fdee481fb5f54aac841e17dd not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54808
I20260709 12:09:32.496397 13758 raft_consensus.cc:2955] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:32.500027 14414 raft_consensus.cc:1275] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:32.503818 14509 ts_tablet_manager.cc:1929] T 3f29dda715314a93a03981264972c4c3 P 3f37c9cc9dda46b4be21dd675ba78fb7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:32.504660 14517 consensus_queue.cc:1048] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:32.504268 13585 catalog_manager.cc:5697] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: config changed from index 3 to 4, VOTER b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) evicted. New cstate: current_term: 1 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:32.505409 14524 tablet_replica.cc:333] T 64b889ec5fe4445d81fe94e0ae9fb087 P 96701a74fdee481fb5f54aac841e17dd: stopping tablet replica
I20260709 12:09:32.505971 14509 log.cc:1199] T 3f29dda715314a93a03981264972c4c3 P 3f37c9cc9dda46b4be21dd675ba78fb7: Deleting WAL directory at /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894707649-12515-0/minicluster-data/ts-1-root/wals/3f29dda715314a93a03981264972c4c3
I20260709 12:09:32.506659 14524 raft_consensus.cc:2243] T 64b889ec5fe4445d81fe94e0ae9fb087 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:32.515638 13763 raft_consensus.cc:1275] T 7a7564a63b8041ff80f64a7f8d533acb P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:32.516323 13674 tablet_service.cc:1558] Processing DeleteTablet for tablet 15347ea1eb2348e7b262bd0d59ce6f3a with delete_type TABLET_DATA_TOMBSTONED (TS b98d2519bb504dc6905ed2ede4571835 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41682
I20260709 12:09:32.518884 14447 consensus_queue.cc:1048] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:32.520270 13833 raft_consensus.cc:1275] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:32.530185 13571 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 15347ea1eb2348e7b262bd0d59ce6f3a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:32.531028 14524 raft_consensus.cc:2272] T 64b889ec5fe4445d81fe94e0ae9fb087 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:32.531299 13570 catalog_manager.cc:5028] TS 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): tablet 3f29dda715314a93a03981264972c4c3 (table test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]) successfully deleted
I20260709 12:09:32.543700 14524 ts_tablet_manager.cc:1916] T 64b889ec5fe4445d81fe94e0ae9fb087 P 96701a74fdee481fb5f54aac841e17dd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:32.553113 14526 tablet_replica.cc:333] T 15347ea1eb2348e7b262bd0d59ce6f3a P b98d2519bb504dc6905ed2ede4571835: stopping tablet replica
I20260709 12:09:32.566605 14524 ts_tablet_manager.cc:1929] T 64b889ec5fe4445d81fe94e0ae9fb087 P 96701a74fdee481fb5f54aac841e17dd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:32.567281 14524 log.cc:1199] T 64b889ec5fe4445d81fe94e0ae9fb087 P 96701a74fdee481fb5f54aac841e17dd: Deleting WAL directory at /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894707649-12515-0/minicluster-data/ts-2-root/wals/64b889ec5fe4445d81fe94e0ae9fb087
I20260709 12:09:32.567329 14447 consensus_queue.cc:1048] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:32.574903 14526 raft_consensus.cc:2243] T 15347ea1eb2348e7b262bd0d59ce6f3a P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:32.575697 14526 raft_consensus.cc:2272] T 15347ea1eb2348e7b262bd0d59ce6f3a P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:32.579553 14526 ts_tablet_manager.cc:1916] T 15347ea1eb2348e7b262bd0d59ce6f3a P b98d2519bb504dc6905ed2ede4571835: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:32.580299 13571 catalog_manager.cc:5028] TS 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): tablet 64b889ec5fe4445d81fe94e0ae9fb087 (table test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]) successfully deleted
I20260709 12:09:32.587641 14519 raft_consensus.cc:2955] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:32.599105 13763 raft_consensus.cc:2955] T 7a7564a63b8041ff80f64a7f8d533acb P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:32.604995 14416 raft_consensus.cc:2955] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:32.619561 14526 ts_tablet_manager.cc:1929] T 15347ea1eb2348e7b262bd0d59ce6f3a P b98d2519bb504dc6905ed2ede4571835: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:32.620347 14526 log.cc:1199] T 15347ea1eb2348e7b262bd0d59ce6f3a P b98d2519bb504dc6905ed2ede4571835: Deleting WAL directory at /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894707649-12515-0/minicluster-data/ts-0-root/wals/15347ea1eb2348e7b262bd0d59ce6f3a
I20260709 12:09:32.622334 13570 catalog_manager.cc:5028] TS b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): tablet 15347ea1eb2348e7b262bd0d59ce6f3a (table test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]) successfully deleted
I20260709 12:09:32.622915 13585 catalog_manager.cc:5697] T 7a7564a63b8041ff80f64a7f8d533acb P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:32.638835 13833 raft_consensus.cc:2955] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:32.667652 13687 consensus_queue.cc:237] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:32.672277 14416 raft_consensus.cc:1275] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:32.674307 14447 consensus_queue.cc:1048] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:32.675490 13833 raft_consensus.cc:1275] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:32.677872 14447 consensus_queue.cc:1048] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:32.682520 14518 raft_consensus.cc:2955] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:32.685168 14416 raft_consensus.cc:2955] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:32.695235 13570 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7a7564a63b8041ff80f64a7f8d533acb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:32.697386 13833 raft_consensus.cc:2955] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:32.705732 13585 catalog_manager.cc:5697] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 reported cstate change: config changed from index 3 to 4, VOTER 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) evicted. New cstate: current_term: 1 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:32.725988 13752 tablet_service.cc:1558] Processing DeleteTablet for tablet 7a7564a63b8041ff80f64a7f8d533acb with delete_type TABLET_DATA_TOMBSTONED (TS 3f37c9cc9dda46b4be21dd675ba78fb7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48110
I20260709 12:09:32.727025 14509 tablet_replica.cc:333] T 7a7564a63b8041ff80f64a7f8d533acb P 3f37c9cc9dda46b4be21dd675ba78fb7: stopping tablet replica
I20260709 12:09:32.728118 14509 raft_consensus.cc:2243] T 7a7564a63b8041ff80f64a7f8d533acb P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:32.728823 14509 raft_consensus.cc:2272] T 7a7564a63b8041ff80f64a7f8d533acb P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:32.734875 14509 ts_tablet_manager.cc:1916] T 7a7564a63b8041ff80f64a7f8d533acb P 3f37c9cc9dda46b4be21dd675ba78fb7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:32.753561 14509 ts_tablet_manager.cc:1929] T 7a7564a63b8041ff80f64a7f8d533acb P 3f37c9cc9dda46b4be21dd675ba78fb7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:32.754012 14509 log.cc:1199] T 7a7564a63b8041ff80f64a7f8d533acb P 3f37c9cc9dda46b4be21dd675ba78fb7: Deleting WAL directory at /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894707649-12515-0/minicluster-data/ts-1-root/wals/7a7564a63b8041ff80f64a7f8d533acb
I20260709 12:09:32.755509 13570 catalog_manager.cc:5028] TS 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): tablet 7a7564a63b8041ff80f64a7f8d533acb (table test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]) successfully deleted
W20260709 12:09:33.253895 13784 debug-util.cc:398] Leaking SignalData structure 0x7b08000f0e80 after lost signal to thread 12518
W20260709 12:09:33.254878 13784 debug-util.cc:398] Leaking SignalData structure 0x7b08001e7a60 after lost signal to thread 13620
W20260709 12:09:33.256175 13784 debug-util.cc:398] Leaking SignalData structure 0x7b08002e7940 after lost signal to thread 13712
W20260709 12:09:33.257150 13784 debug-util.cc:398] Leaking SignalData structure 0x7b08002ea5a0 after lost signal to thread 13787
W20260709 12:09:33.258282 13784 debug-util.cc:398] Leaking SignalData structure 0x7b08002ee2a0 after lost signal to thread 13861
W20260709 12:09:33.259459 13784 debug-util.cc:398] Leaking SignalData structure 0x7b080028d160 after lost signal to thread 14440
I20260709 12:09:33.847440 13686 consensus_queue.cc:237] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:33.855803 13833 raft_consensus.cc:1275] T c6d20ad9ea2849238148cd46eb3be62c P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:33.855960 13763 raft_consensus.cc:1275] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:09:33.856981 13652 consensus_peers.cc:597] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 -> Peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Couldn't send request to peer ca9fbbc2c0a94897897d502d42f3951f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c6d20ad9ea2849238148cd46eb3be62c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:33.857820 14447 consensus_queue.cc:1048] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:33.859231 14530 consensus_queue.cc:1048] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:33.886888 14447 raft_consensus.cc:2955] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:33.899639 13763 raft_consensus.cc:2955] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:33.899641 13830 raft_consensus.cc:2955] T c6d20ad9ea2849238148cd46eb3be62c P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:33.914170 13833 consensus_queue.cc:237] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
W20260709 12:09:33.939884 13801 consensus_peers.cc:597] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd -> Peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Couldn't send request to peer ca9fbbc2c0a94897897d502d42f3951f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f9139e027a704f14bb60e60e22390d08. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:33.942531 13682 raft_consensus.cc:1275] T f9139e027a704f14bb60e60e22390d08 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:33.942620 13763 raft_consensus.cc:1275] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:33.933440 13586 catalog_manager.cc:5697] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 reported cstate change: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New cstate: current_term: 2 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:33.945040 14513 consensus_queue.cc:1048] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:33.948199 14513 consensus_queue.cc:1048] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:33.971985 14476 raft_consensus.cc:2955] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:33.973474 13763 raft_consensus.cc:2955] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:33.998391 13682 raft_consensus.cc:2955] T f9139e027a704f14bb60e60e22390d08 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:34.005280 13686 consensus_queue.cc:237] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:34.019892 13833 raft_consensus.cc:1275] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:34.022200 14447 consensus_queue.cc:1048] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:34.022179 13763 raft_consensus.cc:1275] T 2e7fcff4988b4d928d7bb79c969a2025 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:34.026641 14534 consensus_queue.cc:1048] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:09:34.037794 13652 consensus_peers.cc:597] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 -> Peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Couldn't send request to peer ca9fbbc2c0a94897897d502d42f3951f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2e7fcff4988b4d928d7bb79c969a2025. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:34.056545 14447 raft_consensus.cc:2955] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:34.068883 13833 raft_consensus.cc:2955] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:34.105767 13763 raft_consensus.cc:2955] T 2e7fcff4988b4d928d7bb79c969a2025 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:34.112951 13682 consensus_queue.cc:237] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:34.139959 13833 raft_consensus.cc:1275] T c8195765ed074b74be387475c214120b P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:34.141335 14447 consensus_queue.cc:1048] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:09:34.144219 13652 consensus_peers.cc:597] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 -> Peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Couldn't send request to peer ca9fbbc2c0a94897897d502d42f3951f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c8195765ed074b74be387475c214120b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:34.146543 13763 raft_consensus.cc:1275] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:34.148262 14534 consensus_queue.cc:1048] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:34.151628 13584 catalog_manager.cc:5697] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd reported cstate change: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New cstate: current_term: 1 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:34.159308 13584 catalog_manager.cc:5697] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd reported cstate change: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New cstate: current_term: 1 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:34.200769 14530 raft_consensus.cc:2955] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:34.203894 13836 raft_consensus.cc:2955] T c8195765ed074b74be387475c214120b P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:34.237462 13758 raft_consensus.cc:2955] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:34.262023 13584 catalog_manager.cc:5697] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 reported cstate change: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New cstate: current_term: 1 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:34.353273 14550 ts_tablet_manager.cc:933] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f: Initiating tablet copy from peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199)
I20260709 12:09:34.371332 14550 tablet_copy_client.cc:323] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Beginning tablet copy session from remote peer at address 127.12.56.193:33199
I20260709 12:09:34.375195 13698 tablet_copy_service.cc:140] P b98d2519bb504dc6905ed2ede4571835: Received BeginTabletCopySession request for tablet c6d20ad9ea2849238148cd46eb3be62c from peer ca9fbbc2c0a94897897d502d42f3951f ({username='slave'} at 127.0.0.1:48212)
I20260709 12:09:34.375916 13698 tablet_copy_service.cc:161] P b98d2519bb504dc6905ed2ede4571835: Beginning new tablet copy session on tablet c6d20ad9ea2849238148cd46eb3be62c from peer ca9fbbc2c0a94897897d502d42f3951f at {username='slave'} at 127.0.0.1:48212: session id = ca9fbbc2c0a94897897d502d42f3951f-c6d20ad9ea2849238148cd46eb3be62c
I20260709 12:09:34.430171 13698 tablet_copy_source_session.cc:215] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:34.435138 14550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6d20ad9ea2849238148cd46eb3be62c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:09:34.449929 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 52236.7us
W20260709 12:09:34.456609 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 61634.9us
I20260709 12:09:34.474680 14550 tablet_copy_client.cc:806] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:34.475451 14550 tablet_copy_client.cc:670] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:34.481490 14550 tablet_copy_client.cc:538] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:34.508744 14550 tablet_bootstrap.cc:492] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap starting.
I20260709 12:09:34.516917 14557 ts_tablet_manager.cc:933] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f: Initiating tablet copy from peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:34.533952 14557 tablet_copy_client.cc:323] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Beginning tablet copy session from remote peer at address 127.12.56.195:36603
I20260709 12:09:34.540989 14559 ts_tablet_manager.cc:933] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f: Initiating tablet copy from peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199)
I20260709 12:09:34.542007 13847 tablet_copy_service.cc:140] P 96701a74fdee481fb5f54aac841e17dd: Received BeginTabletCopySession request for tablet f9139e027a704f14bb60e60e22390d08 from peer ca9fbbc2c0a94897897d502d42f3951f ({username='slave'} at 127.0.0.1:35422)
I20260709 12:09:34.542644 13847 tablet_copy_service.cc:161] P 96701a74fdee481fb5f54aac841e17dd: Beginning new tablet copy session on tablet f9139e027a704f14bb60e60e22390d08 from peer ca9fbbc2c0a94897897d502d42f3951f at {username='slave'} at 127.0.0.1:35422: session id = ca9fbbc2c0a94897897d502d42f3951f-f9139e027a704f14bb60e60e22390d08
I20260709 12:09:34.557459 14550 tablet_bootstrap.cc:492] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:34.558947 14559 tablet_copy_client.cc:323] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Beginning tablet copy session from remote peer at address 127.12.56.193:33199
I20260709 12:09:34.559710 14550 tablet_bootstrap.cc:492] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap complete.
I20260709 12:09:34.560541 14550 ts_tablet_manager.cc:1403] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f: Time spent bootstrapping tablet: real 0.052s	user 0.024s	sys 0.004s
I20260709 12:09:34.560994 13698 tablet_copy_service.cc:140] P b98d2519bb504dc6905ed2ede4571835: Received BeginTabletCopySession request for tablet 2e7fcff4988b4d928d7bb79c969a2025 from peer ca9fbbc2c0a94897897d502d42f3951f ({username='slave'} at 127.0.0.1:48212)
I20260709 12:09:34.561404 13847 tablet_copy_source_session.cc:215] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:34.564245 14550 raft_consensus.cc:359] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:34.571218 14550 raft_consensus.cc:740] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Initialized, Role: LEARNER
I20260709 12:09:34.573441 14557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9139e027a704f14bb60e60e22390d08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:34.561645 13698 tablet_copy_service.cc:161] P b98d2519bb504dc6905ed2ede4571835: Beginning new tablet copy session on tablet 2e7fcff4988b4d928d7bb79c969a2025 from peer ca9fbbc2c0a94897897d502d42f3951f at {username='slave'} at 127.0.0.1:48212: session id = ca9fbbc2c0a94897897d502d42f3951f-2e7fcff4988b4d928d7bb79c969a2025
I20260709 12:09:34.585275 13698 tablet_copy_source_session.cc:215] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:34.587666 14560 ts_tablet_manager.cc:933] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f: Initiating tablet copy from peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199)
I20260709 12:09:34.589247 14559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e7fcff4988b4d928d7bb79c969a2025. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:34.572019 14550 consensus_queue.cc:260] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:34.603042 14560 tablet_copy_client.cc:323] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Beginning tablet copy session from remote peer at address 127.12.56.193:33199
I20260709 12:09:34.605413 13698 tablet_copy_service.cc:140] P b98d2519bb504dc6905ed2ede4571835: Received BeginTabletCopySession request for tablet c8195765ed074b74be387475c214120b from peer ca9fbbc2c0a94897897d502d42f3951f ({username='slave'} at 127.0.0.1:48212)
I20260709 12:09:34.606043 13698 tablet_copy_service.cc:161] P b98d2519bb504dc6905ed2ede4571835: Beginning new tablet copy session on tablet c8195765ed074b74be387475c214120b from peer ca9fbbc2c0a94897897d502d42f3951f at {username='slave'} at 127.0.0.1:48212: session id = ca9fbbc2c0a94897897d502d42f3951f-c8195765ed074b74be387475c214120b
I20260709 12:09:34.608815 14550 ts_tablet_manager.cc:1434] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f: Time spent starting tablet: real 0.048s	user 0.012s	sys 0.004s
I20260709 12:09:34.617046 13697 tablet_copy_service.cc:342] P b98d2519bb504dc6905ed2ede4571835: Request end of tablet copy session ca9fbbc2c0a94897897d502d42f3951f-c6d20ad9ea2849238148cd46eb3be62c received from {username='slave'} at 127.0.0.1:48212
I20260709 12:09:34.617548 13697 tablet_copy_service.cc:434] P b98d2519bb504dc6905ed2ede4571835: ending tablet copy session ca9fbbc2c0a94897897d502d42f3951f-c6d20ad9ea2849238148cd46eb3be62c on tablet c6d20ad9ea2849238148cd46eb3be62c with peer ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:09:34.630438 13698 tablet_copy_source_session.cc:215] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:34.632213 14557 tablet_copy_client.cc:806] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:34.636011 14557 tablet_copy_client.cc:670] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:34.636303 14560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8195765ed074b74be387475c214120b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:34.642424 14559 tablet_copy_client.cc:806] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:34.643138 14559 tablet_copy_client.cc:670] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:34.649578 14559 tablet_copy_client.cc:538] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:34.649861 14557 tablet_copy_client.cc:538] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:34.661446 14559 tablet_bootstrap.cc:492] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap starting.
I20260709 12:09:34.669008 14557 tablet_bootstrap.cc:492] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap starting.
I20260709 12:09:34.672811 14560 tablet_copy_client.cc:806] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:34.673535 14560 tablet_copy_client.cc:670] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:34.678310 14560 tablet_copy_client.cc:538] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:34.703701 14560 tablet_bootstrap.cc:492] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap starting.
I20260709 12:09:34.718302 14559 tablet_bootstrap.cc:492] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:34.719439 14559 tablet_bootstrap.cc:492] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap complete.
I20260709 12:09:34.720222 14559 ts_tablet_manager.cc:1403] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f: Time spent bootstrapping tablet: real 0.060s	user 0.024s	sys 0.003s
I20260709 12:09:34.745353 14557 tablet_bootstrap.cc:492] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:34.747059 14557 tablet_bootstrap.cc:492] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap complete.
I20260709 12:09:34.748242 14557 ts_tablet_manager.cc:1403] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f: Time spent bootstrapping tablet: real 0.079s	user 0.020s	sys 0.014s
I20260709 12:09:34.748937 14559 raft_consensus.cc:359] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:34.750278 14559 raft_consensus.cc:740] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Initialized, Role: LEARNER
I20260709 12:09:34.751083 14559 consensus_queue.cc:260] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:34.755439 14559 ts_tablet_manager.cc:1434] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f: Time spent starting tablet: real 0.035s	user 0.009s	sys 0.000s
I20260709 12:09:34.752978 14557 raft_consensus.cc:359] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:34.757930 14557 raft_consensus.cc:740] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Initialized, Role: LEARNER
I20260709 12:09:34.758756 14557 consensus_queue.cc:260] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:34.761629 14557 ts_tablet_manager.cc:1434] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.004s
I20260709 12:09:34.765725 14414 raft_consensus.cc:1217] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 12:09:34.767169 14560 tablet_bootstrap.cc:492] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:34.768262 14560 tablet_bootstrap.cc:492] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap complete.
I20260709 12:09:34.769742 13847 tablet_copy_service.cc:342] P 96701a74fdee481fb5f54aac841e17dd: Request end of tablet copy session ca9fbbc2c0a94897897d502d42f3951f-f9139e027a704f14bb60e60e22390d08 received from {username='slave'} at 127.0.0.1:35422
I20260709 12:09:34.770745 13847 tablet_copy_service.cc:434] P 96701a74fdee481fb5f54aac841e17dd: ending tablet copy session ca9fbbc2c0a94897897d502d42f3951f-f9139e027a704f14bb60e60e22390d08 on tablet f9139e027a704f14bb60e60e22390d08 with peer ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:09:34.770922 14560 ts_tablet_manager.cc:1403] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f: Time spent bootstrapping tablet: real 0.067s	user 0.019s	sys 0.014s
I20260709 12:09:34.769707 13698 tablet_copy_service.cc:342] P b98d2519bb504dc6905ed2ede4571835: Request end of tablet copy session ca9fbbc2c0a94897897d502d42f3951f-2e7fcff4988b4d928d7bb79c969a2025 received from {username='slave'} at 127.0.0.1:48212
I20260709 12:09:34.772753 13698 tablet_copy_service.cc:434] P b98d2519bb504dc6905ed2ede4571835: ending tablet copy session ca9fbbc2c0a94897897d502d42f3951f-2e7fcff4988b4d928d7bb79c969a2025 on tablet 2e7fcff4988b4d928d7bb79c969a2025 with peer ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:09:34.773535 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 46372us
I20260709 12:09:34.788837 14560 raft_consensus.cc:359] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:34.789954 14560 raft_consensus.cc:740] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Initialized, Role: LEARNER
I20260709 12:09:34.790772 14560 consensus_queue.cc:260] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:34.793623 14560 ts_tablet_manager.cc:1434] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f: Time spent starting tablet: real 0.022s	user 0.002s	sys 0.003s
I20260709 12:09:34.797083 13698 tablet_copy_service.cc:342] P b98d2519bb504dc6905ed2ede4571835: Request end of tablet copy session ca9fbbc2c0a94897897d502d42f3951f-c8195765ed074b74be387475c214120b received from {username='slave'} at 127.0.0.1:48212
I20260709 12:09:34.797627 13698 tablet_copy_service.cc:434] P b98d2519bb504dc6905ed2ede4571835: ending tablet copy session ca9fbbc2c0a94897897d502d42f3951f-c8195765ed074b74be387475c214120b on tablet c8195765ed074b74be387475c214120b with peer ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:09:34.996874 14414 raft_consensus.cc:1217] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:35.042138 14414 raft_consensus.cc:1217] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:35.112771 14414 raft_consensus.cc:1217] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:35.127096 14534 raft_consensus.cc:1064] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835: attempting to promote NON_VOTER ca9fbbc2c0a94897897d502d42f3951f to VOTER
I20260709 12:09:35.129998 14534 consensus_queue.cc:237] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:35.147801 13833 raft_consensus.cc:1275] T c6d20ad9ea2849238148cd46eb3be62c P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:35.149080 13763 raft_consensus.cc:1275] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:35.149248 14414 raft_consensus.cc:1275] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 2 LEARNER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:35.151782 14519 consensus_queue.cc:1048] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:35.153542 14519 consensus_queue.cc:1048] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:35.155148 14555 consensus_queue.cc:1048] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:35.179584 14555 raft_consensus.cc:2955] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:35.184087 13833 raft_consensus.cc:2955] T c6d20ad9ea2849238148cd46eb3be62c P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:35.192029 13763 raft_consensus.cc:2955] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:35.204232 13583 catalog_manager.cc:5697] T c6d20ad9ea2849238148cd46eb3be62c P 96701a74fdee481fb5f54aac841e17dd reported cstate change: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:35.250535 14414 raft_consensus.cc:2955] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:35.308305 13686 consensus_queue.cc:237] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:35.319429 14414 raft_consensus.cc:1275] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:09:35.319587 13758 raft_consensus.cc:1275] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:09:35.321045 14555 consensus_queue.cc:1048] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:35.322005 14534 consensus_queue.cc:1048] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:35.346398 14519 raft_consensus.cc:2955] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:35.368151 13763 raft_consensus.cc:2955] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:35.377378 13570 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c6d20ad9ea2849238148cd46eb3be62c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:09:35.395015 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 51950.6us
I20260709 12:09:35.398367 14414 raft_consensus.cc:2955] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:35.403542 13586 catalog_manager.cc:5697] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: config changed from index 3 to 4, VOTER 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) evicted. New cstate: current_term: 2 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:35.436509 13824 tablet_service.cc:1558] Processing DeleteTablet for tablet c6d20ad9ea2849238148cd46eb3be62c with delete_type TABLET_DATA_TOMBSTONED (TS 96701a74fdee481fb5f54aac841e17dd not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54808
I20260709 12:09:35.497594 14582 tablet_replica.cc:333] T c6d20ad9ea2849238148cd46eb3be62c P 96701a74fdee481fb5f54aac841e17dd: stopping tablet replica
I20260709 12:09:35.500018 14582 raft_consensus.cc:2243] T c6d20ad9ea2849238148cd46eb3be62c P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:35.501066 14582 raft_consensus.cc:2272] T c6d20ad9ea2849238148cd46eb3be62c P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:35.506779 14582 ts_tablet_manager.cc:1916] T c6d20ad9ea2849238148cd46eb3be62c P 96701a74fdee481fb5f54aac841e17dd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:35.512998 14540 raft_consensus.cc:1064] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd: attempting to promote NON_VOTER ca9fbbc2c0a94897897d502d42f3951f to VOTER
I20260709 12:09:35.515941 14540 consensus_queue.cc:237] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:35.579347 13763 raft_consensus.cc:1275] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:35.583310 14414 raft_consensus.cc:1275] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:35.585057 13686 raft_consensus.cc:1275] T f9139e027a704f14bb60e60e22390d08 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:35.585758 14570 consensus_queue.cc:1048] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:35.588142 14568 consensus_queue.cc:1048] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:09:35.603078 14584 log.cc:927] Time spent T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:09:35.647790 14582 ts_tablet_manager.cc:1929] T c6d20ad9ea2849238148cd46eb3be62c P 96701a74fdee481fb5f54aac841e17dd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 12:09:35.657155 14570 consensus_queue.cc:1048] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:35.670774 14582 log.cc:1199] T c6d20ad9ea2849238148cd46eb3be62c P 96701a74fdee481fb5f54aac841e17dd: Deleting WAL directory at /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894707649-12515-0/minicluster-data/ts-2-root/wals/c6d20ad9ea2849238148cd46eb3be62c
I20260709 12:09:35.673672 13571 catalog_manager.cc:5028] TS 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): tablet c6d20ad9ea2849238148cd46eb3be62c (table test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]) successfully deleted
I20260709 12:09:35.683456 14580 raft_consensus.cc:1064] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835: attempting to promote NON_VOTER ca9fbbc2c0a94897897d502d42f3951f to VOTER
I20260709 12:09:35.700654 14447 raft_consensus.cc:1064] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835: attempting to promote NON_VOTER ca9fbbc2c0a94897897d502d42f3951f to VOTER
I20260709 12:09:35.704428 14447 consensus_queue.cc:237] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:35.711540 14570 raft_consensus.cc:2955] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:35.718269 14414 raft_consensus.cc:2955] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:35.688839 14580 consensus_queue.cc:237] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:35.775966 13763 raft_consensus.cc:1275] T 2e7fcff4988b4d928d7bb79c969a2025 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:35.779700 14416 raft_consensus.cc:1275] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:35.782578 14581 consensus_queue.cc:1048] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:35.784139 13831 raft_consensus.cc:1275] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:35.800664 14585 consensus_queue.cc:1048] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:35.815685 14447 consensus_queue.cc:1048] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:09:35.821172 13758 raft_consensus.cc:2955] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:35.821087 13586 catalog_manager.cc:5697] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd reported cstate change: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:35.816013 13686 raft_consensus.cc:2955] T f9139e027a704f14bb60e60e22390d08 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:35.845408 14415 raft_consensus.cc:1275] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:35.848493 14580 consensus_queue.cc:1048] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:35.875276 13755 raft_consensus.cc:1275] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:35.889823 14447 consensus_queue.cc:1048] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:35.921988 13828 raft_consensus.cc:1275] T c8195765ed074b74be387475c214120b P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:35.931466 14556 consensus_queue.cc:1048] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:09:36.055436 14598 log.cc:927] Time spent T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:09:36.106082 14581 raft_consensus.cc:2955] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
W20260709 12:09:36.108951 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 77560.7us
I20260709 12:09:36.108366 13756 raft_consensus.cc:2955] T 2e7fcff4988b4d928d7bb79c969a2025 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:36.147110 13830 consensus_queue.cc:237] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:09:36.165171 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:36.185421 13836 raft_consensus.cc:2955] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:36.228451 14414 raft_consensus.cc:1275] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:36.234862 14540 consensus_queue.cc:1048] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:36.248518 14580 raft_consensus.cc:2955] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:36.266623 14414 raft_consensus.cc:2955] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:36.280609 14415 raft_consensus.cc:2955] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:36.299026 13830 raft_consensus.cc:2955] T c8195765ed074b74be387475c214120b P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:36.328295 13757 raft_consensus.cc:1275] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:36.269683 13583 catalog_manager.cc:5697] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:36.256397 14513 raft_consensus.cc:2955] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:36.289971 13755 raft_consensus.cc:2955] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:36.354252 14540 consensus_queue.cc:1048] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:36.357976 14416 raft_consensus.cc:2955] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:36.390672 13757 raft_consensus.cc:2955] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:36.412590 13686 consensus_queue.cc:237] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:36.451694 14413 raft_consensus.cc:1275] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:36.470479 13586 catalog_manager.cc:5697] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:36.473100 13571 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f9139e027a704f14bb60e60e22390d08 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:36.476104 14581 consensus_queue.cc:1048] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:36.480932 13832 raft_consensus.cc:1275] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:36.509436 14585 consensus_queue.cc:1048] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:36.515514 14581 raft_consensus.cc:2955] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:36.527483 13830 raft_consensus.cc:2955] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:36.542878 13583 catalog_manager.cc:5697] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: config changed from index 3 to 4, VOTER b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) evicted. New cstate: current_term: 1 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:36.544715 14413 raft_consensus.cc:2955] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:36.593751 13570 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2e7fcff4988b4d928d7bb79c969a2025 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:36.607177 13674 tablet_service.cc:1558] Processing DeleteTablet for tablet f9139e027a704f14bb60e60e22390d08 with delete_type TABLET_DATA_TOMBSTONED (TS b98d2519bb504dc6905ed2ede4571835 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41682
I20260709 12:09:36.625607 13585 catalog_manager.cc:5697] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: config changed from index 3 to 4, VOTER 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) evicted. New cstate: current_term: 1 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:36.628106 14609 tablet_replica.cc:333] T f9139e027a704f14bb60e60e22390d08 P b98d2519bb504dc6905ed2ede4571835: stopping tablet replica
I20260709 12:09:36.629480 14609 raft_consensus.cc:2243] T f9139e027a704f14bb60e60e22390d08 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:36.631873 14609 raft_consensus.cc:2272] T f9139e027a704f14bb60e60e22390d08 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:36.635937 14609 ts_tablet_manager.cc:1916] T f9139e027a704f14bb60e60e22390d08 P b98d2519bb504dc6905ed2ede4571835: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:36.653648 13752 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e7fcff4988b4d928d7bb79c969a2025 with delete_type TABLET_DATA_TOMBSTONED (TS 3f37c9cc9dda46b4be21dd675ba78fb7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48110
I20260709 12:09:36.659850 14610 tablet_replica.cc:333] T 2e7fcff4988b4d928d7bb79c969a2025 P 3f37c9cc9dda46b4be21dd675ba78fb7: stopping tablet replica
I20260709 12:09:36.661849 14610 raft_consensus.cc:2243] T 2e7fcff4988b4d928d7bb79c969a2025 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:36.664338 14610 raft_consensus.cc:2272] T 2e7fcff4988b4d928d7bb79c969a2025 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:36.664208 13686 consensus_queue.cc:237] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:36.665966 14609 ts_tablet_manager.cc:1929] T f9139e027a704f14bb60e60e22390d08 P b98d2519bb504dc6905ed2ede4571835: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:36.670516 14609 log.cc:1199] T f9139e027a704f14bb60e60e22390d08 P b98d2519bb504dc6905ed2ede4571835: Deleting WAL directory at /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894707649-12515-0/minicluster-data/ts-0-root/wals/f9139e027a704f14bb60e60e22390d08
I20260709 12:09:36.675033 13755 raft_consensus.cc:1275] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:36.675819 14413 raft_consensus.cc:1275] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:36.677264 13570 catalog_manager.cc:5028] TS b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): tablet f9139e027a704f14bb60e60e22390d08 (table test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]) successfully deleted
I20260709 12:09:36.677119 14581 consensus_queue.cc:1048] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:36.680158 14581 consensus_queue.cc:1048] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 12:09:36.688298 14610 ts_tablet_manager.cc:1916] T 2e7fcff4988b4d928d7bb79c969a2025 P 3f37c9cc9dda46b4be21dd675ba78fb7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:36.693239 14585 raft_consensus.cc:2955] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:36.697510 13757 raft_consensus.cc:2955] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:36.701409 14413 raft_consensus.cc:2955] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:36.723224 14610 ts_tablet_manager.cc:1929] T 2e7fcff4988b4d928d7bb79c969a2025 P 3f37c9cc9dda46b4be21dd675ba78fb7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:36.723834 14610 log.cc:1199] T 2e7fcff4988b4d928d7bb79c969a2025 P 3f37c9cc9dda46b4be21dd675ba78fb7: Deleting WAL directory at /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894707649-12515-0/minicluster-data/ts-1-root/wals/2e7fcff4988b4d928d7bb79c969a2025
I20260709 12:09:36.726253 13570 catalog_manager.cc:5028] TS 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): tablet 2e7fcff4988b4d928d7bb79c969a2025 (table test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]) successfully deleted
I20260709 12:09:36.734802 13570 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c8195765ed074b74be387475c214120b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:36.747890 13585 catalog_manager.cc:5697] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 reported cstate change: config changed from index 3 to 4, VOTER 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) evicted. New cstate: current_term: 1 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:36.779239 13824 tablet_service.cc:1558] Processing DeleteTablet for tablet c8195765ed074b74be387475c214120b with delete_type TABLET_DATA_TOMBSTONED (TS 96701a74fdee481fb5f54aac841e17dd not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54808
I20260709 12:09:36.792464 14611 tablet_replica.cc:333] T c8195765ed074b74be387475c214120b P 96701a74fdee481fb5f54aac841e17dd: stopping tablet replica
I20260709 12:09:36.793812 14611 raft_consensus.cc:2243] T c8195765ed074b74be387475c214120b P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:36.794833 14611 raft_consensus.cc:2272] T c8195765ed074b74be387475c214120b P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:36.800092 14611 ts_tablet_manager.cc:1916] T c8195765ed074b74be387475c214120b P 96701a74fdee481fb5f54aac841e17dd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:36.820494 14611 ts_tablet_manager.cc:1929] T c8195765ed074b74be387475c214120b P 96701a74fdee481fb5f54aac841e17dd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:36.821108 14611 log.cc:1199] T c8195765ed074b74be387475c214120b P 96701a74fdee481fb5f54aac841e17dd: Deleting WAL directory at /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894707649-12515-0/minicluster-data/ts-2-root/wals/c8195765ed074b74be387475c214120b
I20260709 12:09:36.823570 13571 catalog_manager.cc:5028] TS 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): tablet c8195765ed074b74be387475c214120b (table test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]) successfully deleted
I20260709 12:09:37.888898 13829 consensus_queue.cc:237] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:37.897631 13757 raft_consensus.cc:1275] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:37.897866 13801 consensus_peers.cc:597] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd -> Peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Couldn't send request to peer ca9fbbc2c0a94897897d502d42f3951f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 51d10bdf51504a12a70a50e9a48f7ede. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:37.899835 14594 consensus_queue.cc:1048] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:37.901113 13686 raft_consensus.cc:1275] T 51d10bdf51504a12a70a50e9a48f7ede P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:37.903024 14513 consensus_queue.cc:1048] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:37.912623 14614 raft_consensus.cc:2955] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:37.914974 13755 raft_consensus.cc:2955] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:37.932178 13832 consensus_queue.cc:237] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:37.943285 13585 catalog_manager.cc:5697] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd reported cstate change: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New cstate: current_term: 1 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:37.952932 13686 raft_consensus.cc:2955] T 51d10bdf51504a12a70a50e9a48f7ede P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:38.000070 13755 raft_consensus.cc:1275] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:09:38.000344 13801 consensus_peers.cc:597] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd -> Peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Couldn't send request to peer ca9fbbc2c0a94897897d502d42f3951f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa310cca462541d39d36ebe94a27446e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:38.021081 14621 consensus_queue.cc:1048] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:09:38.031143 13684 raft_consensus.cc:1275] T aa310cca462541d39d36ebe94a27446e P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:38.049393 14617 consensus_queue.cc:1048] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:09:38.101543 13757 raft_consensus.cc:2955] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:38.097261 14621 raft_consensus.cc:2955] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:38.147054 13586 catalog_manager.cc:5697] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd reported cstate change: config changed from index -1 to 3, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New cstate: current_term: 3 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:38.153920 13681 raft_consensus.cc:2955] T aa310cca462541d39d36ebe94a27446e P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:38.196231 13757 consensus_queue.cc:237] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:38.210312 13681 raft_consensus.cc:1275] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:38.212340 14624 consensus_queue.cc:1048] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:38.223711 13829 raft_consensus.cc:1275] T e229ea1f19c74be5884179acde106305 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:38.226651 14624 consensus_queue.cc:1048] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:38.246958 14553 raft_consensus.cc:2955] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:38.250777 13681 raft_consensus.cc:2955] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:38.252298 13832 raft_consensus.cc:2955] T e229ea1f19c74be5884179acde106305 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
W20260709 12:09:38.253679 13727 consensus_peers.cc:597] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Couldn't send request to peer ca9fbbc2c0a94897897d502d42f3951f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e229ea1f19c74be5884179acde106305. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:38.265031 13830 consensus_queue.cc:237] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:38.268935 13586 catalog_manager.cc:5697] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New cstate: current_term: 1 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:38.302225 13686 raft_consensus.cc:1275] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:38.304853 13801 consensus_peers.cc:597] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd -> Peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Couldn't send request to peer ca9fbbc2c0a94897897d502d42f3951f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dca45e62639f49b4a8367d6868dabc07. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:38.305056 13757 raft_consensus.cc:1275] T dca45e62639f49b4a8367d6868dabc07 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:38.307230 14621 consensus_queue.cc:1048] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:38.309042 14594 consensus_queue.cc:1048] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:38.322034 14639 ts_tablet_manager.cc:933] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f: Initiating tablet copy from peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:38.344074 14639 tablet_copy_client.cc:323] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Beginning tablet copy session from remote peer at address 127.12.56.195:36603
I20260709 12:09:38.345187 14594 raft_consensus.cc:2955] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:38.348541 13847 tablet_copy_service.cc:140] P 96701a74fdee481fb5f54aac841e17dd: Received BeginTabletCopySession request for tablet 51d10bdf51504a12a70a50e9a48f7ede from peer ca9fbbc2c0a94897897d502d42f3951f ({username='slave'} at 127.0.0.1:35422)
I20260709 12:09:38.349218 13847 tablet_copy_service.cc:161] P 96701a74fdee481fb5f54aac841e17dd: Beginning new tablet copy session on tablet 51d10bdf51504a12a70a50e9a48f7ede from peer ca9fbbc2c0a94897897d502d42f3951f at {username='slave'} at 127.0.0.1:35422: session id = ca9fbbc2c0a94897897d502d42f3951f-51d10bdf51504a12a70a50e9a48f7ede
I20260709 12:09:38.352908 13757 raft_consensus.cc:2955] T dca45e62639f49b4a8367d6868dabc07 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:38.364367 13847 tablet_copy_source_session.cc:215] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:38.368377 13681 raft_consensus.cc:2955] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:38.376811 14639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51d10bdf51504a12a70a50e9a48f7ede. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:38.380646 13586 catalog_manager.cc:5697] T dca45e62639f49b4a8367d6868dabc07 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New cstate: current_term: 1 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:38.443259 14639 tablet_copy_client.cc:806] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:38.444016 14639 tablet_copy_client.cc:670] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:38.449090 14639 tablet_copy_client.cc:538] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:38.473964 14639 tablet_bootstrap.cc:492] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap starting.
I20260709 12:09:38.520262 14643 ts_tablet_manager.cc:933] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f: Initiating tablet copy from peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:38.525823 14639 tablet_bootstrap.cc:492] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:38.526974 14639 tablet_bootstrap.cc:492] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap complete.
I20260709 12:09:38.527762 14639 ts_tablet_manager.cc:1403] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f: Time spent bootstrapping tablet: real 0.054s	user 0.029s	sys 0.004s
I20260709 12:09:38.531365 14639 raft_consensus.cc:359] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:38.532316 14639 raft_consensus.cc:740] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Initialized, Role: LEARNER
I20260709 12:09:38.533412 14639 consensus_queue.cc:260] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:38.542218 14643 tablet_copy_client.cc:323] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Beginning tablet copy session from remote peer at address 127.12.56.195:36603
I20260709 12:09:38.544904 13847 tablet_copy_service.cc:140] P 96701a74fdee481fb5f54aac841e17dd: Received BeginTabletCopySession request for tablet aa310cca462541d39d36ebe94a27446e from peer ca9fbbc2c0a94897897d502d42f3951f ({username='slave'} at 127.0.0.1:35422)
I20260709 12:09:38.545614 13847 tablet_copy_service.cc:161] P 96701a74fdee481fb5f54aac841e17dd: Beginning new tablet copy session on tablet aa310cca462541d39d36ebe94a27446e from peer ca9fbbc2c0a94897897d502d42f3951f at {username='slave'} at 127.0.0.1:35422: session id = ca9fbbc2c0a94897897d502d42f3951f-aa310cca462541d39d36ebe94a27446e
I20260709 12:09:38.545822 14639 ts_tablet_manager.cc:1434] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f: Time spent starting tablet: real 0.018s	user 0.011s	sys 0.000s
I20260709 12:09:38.559924 13846 tablet_copy_service.cc:342] P 96701a74fdee481fb5f54aac841e17dd: Request end of tablet copy session ca9fbbc2c0a94897897d502d42f3951f-51d10bdf51504a12a70a50e9a48f7ede received from {username='slave'} at 127.0.0.1:35422
I20260709 12:09:38.560556 13846 tablet_copy_service.cc:434] P 96701a74fdee481fb5f54aac841e17dd: ending tablet copy session ca9fbbc2c0a94897897d502d42f3951f-51d10bdf51504a12a70a50e9a48f7ede on tablet 51d10bdf51504a12a70a50e9a48f7ede with peer ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:09:38.582157 13847 tablet_copy_source_session.cc:215] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:38.586970 14643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa310cca462541d39d36ebe94a27446e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:38.608649 14643 tablet_copy_client.cc:806] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:38.609474 14643 tablet_copy_client.cc:670] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:38.615433 14643 tablet_copy_client.cc:538] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:38.627897 14643 tablet_bootstrap.cc:492] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap starting.
I20260709 12:09:38.662717 14413 raft_consensus.cc:1217] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:38.678680 14643 tablet_bootstrap.cc:492] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:38.680492 14643 tablet_bootstrap.cc:492] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap complete.
I20260709 12:09:38.681349 14643 ts_tablet_manager.cc:1403] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f: Time spent bootstrapping tablet: real 0.054s	user 0.029s	sys 0.007s
I20260709 12:09:38.684553 14643 raft_consensus.cc:359] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:38.699654 14643 raft_consensus.cc:740] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Initialized, Role: LEARNER
I20260709 12:09:38.700417 14643 consensus_queue.cc:260] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:38.702889 14643 ts_tablet_manager.cc:1434] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:09:38.705533 13847 tablet_copy_service.cc:342] P 96701a74fdee481fb5f54aac841e17dd: Request end of tablet copy session ca9fbbc2c0a94897897d502d42f3951f-aa310cca462541d39d36ebe94a27446e received from {username='slave'} at 127.0.0.1:35422
I20260709 12:09:38.706061 13847 tablet_copy_service.cc:434] P 96701a74fdee481fb5f54aac841e17dd: ending tablet copy session ca9fbbc2c0a94897897d502d42f3951f-aa310cca462541d39d36ebe94a27446e on tablet aa310cca462541d39d36ebe94a27446e with peer ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:09:38.756248 14643 ts_tablet_manager.cc:933] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f: Initiating tablet copy from peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:38.758085 14643 tablet_copy_client.cc:323] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Beginning tablet copy session from remote peer at address 127.12.56.194:39545
I20260709 12:09:38.777233 14639 ts_tablet_manager.cc:933] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f: Initiating tablet copy from peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:38.782408 13773 tablet_copy_service.cc:140] P 3f37c9cc9dda46b4be21dd675ba78fb7: Received BeginTabletCopySession request for tablet e229ea1f19c74be5884179acde106305 from peer ca9fbbc2c0a94897897d502d42f3951f ({username='slave'} at 127.0.0.1:38932)
I20260709 12:09:38.783305 13773 tablet_copy_service.cc:161] P 3f37c9cc9dda46b4be21dd675ba78fb7: Beginning new tablet copy session on tablet e229ea1f19c74be5884179acde106305 from peer ca9fbbc2c0a94897897d502d42f3951f at {username='slave'} at 127.0.0.1:38932: session id = ca9fbbc2c0a94897897d502d42f3951f-e229ea1f19c74be5884179acde106305
I20260709 12:09:38.802361 13773 tablet_copy_source_session.cc:215] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:38.805728 14639 tablet_copy_client.cc:323] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Beginning tablet copy session from remote peer at address 127.12.56.195:36603
I20260709 12:09:38.806758 14643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e229ea1f19c74be5884179acde106305. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:38.807874 13847 tablet_copy_service.cc:140] P 96701a74fdee481fb5f54aac841e17dd: Received BeginTabletCopySession request for tablet dca45e62639f49b4a8367d6868dabc07 from peer ca9fbbc2c0a94897897d502d42f3951f ({username='slave'} at 127.0.0.1:35422)
I20260709 12:09:38.808477 13847 tablet_copy_service.cc:161] P 96701a74fdee481fb5f54aac841e17dd: Beginning new tablet copy session on tablet dca45e62639f49b4a8367d6868dabc07 from peer ca9fbbc2c0a94897897d502d42f3951f at {username='slave'} at 127.0.0.1:35422: session id = ca9fbbc2c0a94897897d502d42f3951f-dca45e62639f49b4a8367d6868dabc07
I20260709 12:09:38.819763 13847 tablet_copy_source_session.cc:215] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:38.832062 14639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dca45e62639f49b4a8367d6868dabc07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:38.845127 14643 tablet_copy_client.cc:806] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:38.845974 14643 tablet_copy_client.cc:670] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:38.873457 14643 tablet_copy_client.cc:538] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:38.884465 14639 tablet_copy_client.cc:806] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:38.885236 14639 tablet_copy_client.cc:670] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:38.886730 14643 tablet_bootstrap.cc:492] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap starting.
I20260709 12:09:38.891115 14639 tablet_copy_client.cc:538] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:38.907081 14639 tablet_bootstrap.cc:492] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap starting.
I20260709 12:09:38.961628 14643 tablet_bootstrap.cc:492] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:38.974665 14643 tablet_bootstrap.cc:492] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap complete.
I20260709 12:09:38.979241 14643 ts_tablet_manager.cc:1403] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f: Time spent bootstrapping tablet: real 0.093s	user 0.022s	sys 0.007s
I20260709 12:09:38.982817 14643 raft_consensus.cc:359] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:38.986135 14413 raft_consensus.cc:1217] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 12:09:38.998694 14643 raft_consensus.cc:740] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Initialized, Role: LEARNER
I20260709 12:09:39.000370 14643 consensus_queue.cc:260] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:38.999528 14639 tablet_bootstrap.cc:492] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:39.006474 14639 tablet_bootstrap.cc:492] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap complete.
I20260709 12:09:39.007386 14639 ts_tablet_manager.cc:1403] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f: Time spent bootstrapping tablet: real 0.101s	user 0.021s	sys 0.005s
I20260709 12:09:39.014052 14643 ts_tablet_manager.cc:1434] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.002s
I20260709 12:09:39.025686 14639 raft_consensus.cc:359] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:39.026938 14639 raft_consensus.cc:740] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Initialized, Role: LEARNER
I20260709 12:09:39.029207 14639 consensus_queue.cc:260] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:39.036736 14639 ts_tablet_manager.cc:1434] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 12:09:39.039552 13847 tablet_copy_service.cc:342] P 96701a74fdee481fb5f54aac841e17dd: Request end of tablet copy session ca9fbbc2c0a94897897d502d42f3951f-dca45e62639f49b4a8367d6868dabc07 received from {username='slave'} at 127.0.0.1:35422
I20260709 12:09:39.040196 13847 tablet_copy_service.cc:434] P 96701a74fdee481fb5f54aac841e17dd: ending tablet copy session ca9fbbc2c0a94897897d502d42f3951f-dca45e62639f49b4a8367d6868dabc07 on tablet dca45e62639f49b4a8367d6868dabc07 with peer ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:09:39.044263 13773 tablet_copy_service.cc:342] P 3f37c9cc9dda46b4be21dd675ba78fb7: Request end of tablet copy session ca9fbbc2c0a94897897d502d42f3951f-e229ea1f19c74be5884179acde106305 received from {username='slave'} at 127.0.0.1:38932
I20260709 12:09:39.044961 13773 tablet_copy_service.cc:434] P 3f37c9cc9dda46b4be21dd675ba78fb7: ending tablet copy session ca9fbbc2c0a94897897d502d42f3951f-e229ea1f19c74be5884179acde106305 on tablet e229ea1f19c74be5884179acde106305 with peer ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:09:39.099243 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 88538.9us
I20260709 12:09:39.198275 14614 raft_consensus.cc:1064] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd: attempting to promote NON_VOTER ca9fbbc2c0a94897897d502d42f3951f to VOTER
I20260709 12:09:39.204041 14614 consensus_queue.cc:237] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:39.211308 14413 raft_consensus.cc:1217] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:39.213692 14412 raft_consensus.cc:1217] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:39.240968 13757 raft_consensus.cc:1275] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:39.240968 14413 raft_consensus.cc:1275] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:39.242925 14614 consensus_queue.cc:1048] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:39.244277 14660 consensus_queue.cc:1048] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:39.246223 13684 raft_consensus.cc:1275] T 51d10bdf51504a12a70a50e9a48f7ede P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:39.256606 14660 consensus_queue.cc:1048] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:39.272059 14621 raft_consensus.cc:2955] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:39.277689 14412 raft_consensus.cc:2955] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:39.288878 13684 raft_consensus.cc:2955] T 51d10bdf51504a12a70a50e9a48f7ede P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:39.315228 13756 raft_consensus.cc:2955] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:39.323843 13584 catalog_manager.cc:5697] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd reported cstate change: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:39.414080 13836 consensus_queue.cc:237] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:39.420297 14413 raft_consensus.cc:1275] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:39.422135 14594 consensus_queue.cc:1048] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:39.435582 14621 raft_consensus.cc:2955] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:39.441478 13757 raft_consensus.cc:1275] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:39.444943 14660 consensus_queue.cc:1048] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:39.443511 14413 raft_consensus.cc:2955] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:39.455890 13757 raft_consensus.cc:2955] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:39.461684 14660 raft_consensus.cc:1064] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd: attempting to promote NON_VOTER ca9fbbc2c0a94897897d502d42f3951f to VOTER
I20260709 12:09:39.467686 14660 consensus_queue.cc:237] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:09:39.465853 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 82221.7us
I20260709 12:09:39.473897 13571 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 51d10bdf51504a12a70a50e9a48f7ede with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:39.489822 13586 catalog_manager.cc:5697] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd reported cstate change: config changed from index 3 to 4, VOTER b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) evicted. New cstate: current_term: 1 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:39.494319 14412 raft_consensus.cc:1275] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 3 LEARNER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:09:39.496742 14614 consensus_queue.cc:1048] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:39.497303 13755 raft_consensus.cc:1275] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:09:39.515616 14621 consensus_queue.cc:1048] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:39.520735 13674 tablet_service.cc:1558] Processing DeleteTablet for tablet 51d10bdf51504a12a70a50e9a48f7ede with delete_type TABLET_DATA_TOMBSTONED (TS b98d2519bb504dc6905ed2ede4571835 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41682
I20260709 12:09:39.537142 13684 raft_consensus.cc:1275] T aa310cca462541d39d36ebe94a27446e P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:09:39.538897 14670 tablet_replica.cc:333] T 51d10bdf51504a12a70a50e9a48f7ede P b98d2519bb504dc6905ed2ede4571835: stopping tablet replica
I20260709 12:09:39.548134 14670 raft_consensus.cc:2243] T 51d10bdf51504a12a70a50e9a48f7ede P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:39.559051 14660 consensus_queue.cc:1048] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:39.571938 14670 raft_consensus.cc:2272] T 51d10bdf51504a12a70a50e9a48f7ede P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:39.577209 14670 ts_tablet_manager.cc:1916] T 51d10bdf51504a12a70a50e9a48f7ede P b98d2519bb504dc6905ed2ede4571835: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:39.595976 14660 raft_consensus.cc:1064] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd: attempting to promote NON_VOTER ca9fbbc2c0a94897897d502d42f3951f to VOTER
I20260709 12:09:39.599731 14660 consensus_queue.cc:237] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:39.641300 14416 raft_consensus.cc:1275] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:39.643940 14621 consensus_queue.cc:1048] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:39.654166 13757 raft_consensus.cc:1275] T dca45e62639f49b4a8367d6868dabc07 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:39.657863 14660 consensus_queue.cc:1048] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:39.663975 14670 ts_tablet_manager.cc:1929] T 51d10bdf51504a12a70a50e9a48f7ede P b98d2519bb504dc6905ed2ede4571835: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
W20260709 12:09:39.665395 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 72717.1us
I20260709 12:09:39.688699 14670 log.cc:1199] T 51d10bdf51504a12a70a50e9a48f7ede P b98d2519bb504dc6905ed2ede4571835: Deleting WAL directory at /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894707649-12515-0/minicluster-data/ts-0-root/wals/51d10bdf51504a12a70a50e9a48f7ede
I20260709 12:09:39.738616 13758 raft_consensus.cc:2955] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:39.741853 14614 raft_consensus.cc:2955] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:39.743548 13755 raft_consensus.cc:2955] T dca45e62639f49b4a8367d6868dabc07 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:39.760691 14553 raft_consensus.cc:1064] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7: attempting to promote NON_VOTER ca9fbbc2c0a94897897d502d42f3951f to VOTER
I20260709 12:09:39.763940 14553 consensus_queue.cc:237] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:39.737497 14660 raft_consensus.cc:2955] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:39.782204 13585 catalog_manager.cc:5697] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: config changed from index 3 to 4, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:39.801767 13570 catalog_manager.cc:5028] TS b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): tablet 51d10bdf51504a12a70a50e9a48f7ede (table test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]) successfully deleted
I20260709 12:09:39.804390 14413 raft_consensus.cc:2955] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:39.814736 14416 raft_consensus.cc:2955] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:39.828902 13585 catalog_manager.cc:5697] T dca45e62639f49b4a8367d6868dabc07 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:39.835320 13829 consensus_queue.cc:237] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:39.843933 13683 raft_consensus.cc:1275] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:39.853523 14414 raft_consensus.cc:1275] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:39.855425 14656 consensus_queue.cc:1048] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:39.856441 13755 raft_consensus.cc:1275] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:09:39.858161 14681 consensus_queue.cc:1048] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:39.866287 13836 raft_consensus.cc:1275] T e229ea1f19c74be5884179acde106305 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:39.868158 14657 consensus_queue.cc:1048] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:39.872575 14614 raft_consensus.cc:2955] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:39.935729 14412 raft_consensus.cc:1275] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:09:39.955333 14594 consensus_queue.cc:1048] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:39.956152 14624 raft_consensus.cc:2955] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
W20260709 12:09:39.967192 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:39.968006 13829 raft_consensus.cc:2955] T e229ea1f19c74be5884179acde106305 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:39.984623 13682 raft_consensus.cc:1275] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:39.985538 14416 raft_consensus.cc:2955] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:39.992870 13571 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet aa310cca462541d39d36ebe94a27446e with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:39.994381 13758 raft_consensus.cc:2955] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:39.999929 14660 consensus_queue.cc:1048] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:40.001608 13586 catalog_manager.cc:5697] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:39.998885 14413 raft_consensus.cc:2955] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
W20260709 12:09:40.022439 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 45781.7us
I20260709 12:09:40.025602 13585 catalog_manager.cc:5697] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd reported cstate change: config changed from index 4 to 5, VOTER b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) evicted. New cstate: current_term: 3 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:40.028367 14624 consensus_queue.cc:1048] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:09:40.085247 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 43491.7us
I20260709 12:09:40.124397 13674 tablet_service.cc:1558] Processing DeleteTablet for tablet aa310cca462541d39d36ebe94a27446e with delete_type TABLET_DATA_TOMBSTONED (TS b98d2519bb504dc6905ed2ede4571835 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:41682
I20260709 12:09:40.125423 14670 tablet_replica.cc:333] T aa310cca462541d39d36ebe94a27446e P b98d2519bb504dc6905ed2ede4571835: stopping tablet replica
I20260709 12:09:40.155050 13683 raft_consensus.cc:2955] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:40.157471 13682 raft_consensus.cc:2955] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:40.170437 14670 raft_consensus.cc:2243] T aa310cca462541d39d36ebe94a27446e P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:40.173067 14670 pending_rounds.cc:70] T aa310cca462541d39d36ebe94a27446e P b98d2519bb504dc6905ed2ede4571835: Trying to abort 1 pending ops.
I20260709 12:09:40.173422 14670 pending_rounds.cc:77] T aa310cca462541d39d36ebe94a27446e P b98d2519bb504dc6905ed2ede4571835: Aborting op as it isn't in flight: id { term: 3 index: 4 } timestamp: 7305621419891724288 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "aa310cca462541d39d36ebe94a27446e" old_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } } new_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } } }
I20260709 12:09:40.174871 14670 raft_consensus.cc:2917] T aa310cca462541d39d36ebe94a27446e P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Aborting config change with OpId 3.4: Aborted: Op aborted
I20260709 12:09:40.175309 14670 raft_consensus.cc:2889] T aa310cca462541d39d36ebe94a27446e P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 12:09:40.175681 14670 raft_consensus.cc:2272] T aa310cca462541d39d36ebe94a27446e P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:40.180405 14670 ts_tablet_manager.cc:1916] T aa310cca462541d39d36ebe94a27446e P b98d2519bb504dc6905ed2ede4571835: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:40.201611 14670 ts_tablet_manager.cc:1929] T aa310cca462541d39d36ebe94a27446e P b98d2519bb504dc6905ed2ede4571835: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 12:09:40.202132 14670 log.cc:1199] T aa310cca462541d39d36ebe94a27446e P b98d2519bb504dc6905ed2ede4571835: Deleting WAL directory at /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894707649-12515-0/minicluster-data/ts-0-root/wals/aa310cca462541d39d36ebe94a27446e
I20260709 12:09:40.204044 13570 catalog_manager.cc:5028] TS b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): tablet aa310cca462541d39d36ebe94a27446e (table test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]) successfully deleted
I20260709 12:09:40.450026 13836 consensus_queue.cc:237] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:40.455993 14413 raft_consensus.cc:1275] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:40.467648 14681 consensus_queue.cc:1048] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:40.477167 13682 raft_consensus.cc:1275] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:40.480319 14682 consensus_queue.cc:1048] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:40.493480 14660 raft_consensus.cc:2955] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:40.516010 14416 raft_consensus.cc:2955] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:40.520797 13571 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet dca45e62639f49b4a8367d6868dabc07 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:40.529464 13586 catalog_manager.cc:5697] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd reported cstate change: config changed from index 3 to 4, VOTER 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) evicted. New cstate: current_term: 1 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:40.551121 13683 raft_consensus.cc:2955] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:40.571772 13752 tablet_service.cc:1558] Processing DeleteTablet for tablet dca45e62639f49b4a8367d6868dabc07 with delete_type TABLET_DATA_TOMBSTONED (TS 3f37c9cc9dda46b4be21dd675ba78fb7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48110
I20260709 12:09:40.615187 14693 tablet_replica.cc:333] T dca45e62639f49b4a8367d6868dabc07 P 3f37c9cc9dda46b4be21dd675ba78fb7: stopping tablet replica
I20260709 12:09:40.629908 14693 raft_consensus.cc:2243] T dca45e62639f49b4a8367d6868dabc07 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:40.632823 14693 raft_consensus.cc:2272] T dca45e62639f49b4a8367d6868dabc07 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:40.666224 14693 ts_tablet_manager.cc:1916] T dca45e62639f49b4a8367d6868dabc07 P 3f37c9cc9dda46b4be21dd675ba78fb7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:40.669013 13758 consensus_queue.cc:237] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:40.679273 14416 raft_consensus.cc:1275] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:40.682166 13680 raft_consensus.cc:1275] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:40.682554 14657 consensus_queue.cc:1048] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:40.699857 14688 consensus_queue.cc:1048] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:40.709604 14416 raft_consensus.cc:2955] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:40.710103 14690 raft_consensus.cc:2955] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:40.715593 13680 raft_consensus.cc:2955] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:40.740041 13586 catalog_manager.cc:5697] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: config changed from index 3 to 4, VOTER 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) evicted. New cstate: current_term: 1 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:40.769744 13824 tablet_service.cc:1558] Processing DeleteTablet for tablet e229ea1f19c74be5884179acde106305 with delete_type TABLET_DATA_TOMBSTONED (TS 96701a74fdee481fb5f54aac841e17dd not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54808
I20260709 12:09:40.779688 13570 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e229ea1f19c74be5884179acde106305 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:40.784502 14697 tablet_replica.cc:333] T e229ea1f19c74be5884179acde106305 P 96701a74fdee481fb5f54aac841e17dd: stopping tablet replica
I20260709 12:09:40.785943 14697 raft_consensus.cc:2243] T e229ea1f19c74be5884179acde106305 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:40.786966 14697 raft_consensus.cc:2272] T e229ea1f19c74be5884179acde106305 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:40.789747 14693 ts_tablet_manager.cc:1929] T dca45e62639f49b4a8367d6868dabc07 P 3f37c9cc9dda46b4be21dd675ba78fb7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:40.790444 14693 log.cc:1199] T dca45e62639f49b4a8367d6868dabc07 P 3f37c9cc9dda46b4be21dd675ba78fb7: Deleting WAL directory at /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894707649-12515-0/minicluster-data/ts-1-root/wals/dca45e62639f49b4a8367d6868dabc07
I20260709 12:09:40.793758 13570 catalog_manager.cc:5028] TS 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): tablet dca45e62639f49b4a8367d6868dabc07 (table test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]) successfully deleted
I20260709 12:09:40.794801 14697 ts_tablet_manager.cc:1916] T e229ea1f19c74be5884179acde106305 P 96701a74fdee481fb5f54aac841e17dd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:40.820679 14697 ts_tablet_manager.cc:1929] T e229ea1f19c74be5884179acde106305 P 96701a74fdee481fb5f54aac841e17dd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:40.821158 14697 log.cc:1199] T e229ea1f19c74be5884179acde106305 P 96701a74fdee481fb5f54aac841e17dd: Deleting WAL directory at /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894707649-12515-0/minicluster-data/ts-2-root/wals/e229ea1f19c74be5884179acde106305
I20260709 12:09:40.823030 13571 catalog_manager.cc:5028] TS 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): tablet e229ea1f19c74be5884179acde106305 (table test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]) successfully deleted
I20260709 12:09:41.840183 13758 consensus_queue.cc:237] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:41.847378 13829 raft_consensus.cc:1275] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:41.848805 13681 raft_consensus.cc:1275] T f1bace76cb204a6d92c38685645dd9db P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:41.849644 13727 consensus_peers.cc:597] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Couldn't send request to peer ca9fbbc2c0a94897897d502d42f3951f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f1bace76cb204a6d92c38685645dd9db. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:41.850003 14695 consensus_queue.cc:1048] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:41.851147 14696 consensus_queue.cc:1048] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:41.862027 14695 raft_consensus.cc:2955] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:41.863889 13681 raft_consensus.cc:2955] T f1bace76cb204a6d92c38685645dd9db P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:41.866912 13832 raft_consensus.cc:2955] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:41.894212 13585 catalog_manager.cc:5697] T f1bace76cb204a6d92c38685645dd9db P b98d2519bb504dc6905ed2ede4571835 reported cstate change: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New cstate: current_term: 1 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:41.914526 13680 consensus_queue.cc:237] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:41.924446 13758 raft_consensus.cc:1275] T e8e96840ffec4e38a0f975263031c226 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:41.924934 13832 raft_consensus.cc:1275] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:41.926702 13652 consensus_peers.cc:597] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 -> Peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Couldn't send request to peer ca9fbbc2c0a94897897d502d42f3951f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e8e96840ffec4e38a0f975263031c226. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:41.927915 14679 consensus_queue.cc:1048] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:41.929950 14679 consensus_queue.cc:1048] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:41.948679 14679 raft_consensus.cc:2955] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:41.951241 13757 raft_consensus.cc:2955] T e8e96840ffec4e38a0f975263031c226 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:41.967195 13829 raft_consensus.cc:2955] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:41.969096 13681 consensus_queue.cc:237] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:41.972924 13586 catalog_manager.cc:5697] T e8e96840ffec4e38a0f975263031c226 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New cstate: current_term: 1 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:41.982180 13832 raft_consensus.cc:1275] T 34a12e91341d4472be7460f1061495db P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:41.987280 13758 raft_consensus.cc:1275] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:41.987726 14706 consensus_queue.cc:1048] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:41.989022 14679 consensus_queue.cc:1048] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:09:41.989909 13652 consensus_peers.cc:597] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 -> Peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Couldn't send request to peer ca9fbbc2c0a94897897d502d42f3951f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 34a12e91341d4472be7460f1061495db. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:42.004676 14710 raft_consensus.cc:2955] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:42.008054 13757 raft_consensus.cc:2955] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:42.021248 13758 consensus_queue.cc:237] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:42.027309 13585 catalog_manager.cc:5697] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 reported cstate change: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New cstate: current_term: 1 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:42.032265 13727 consensus_peers.cc:597] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Couldn't send request to peer ca9fbbc2c0a94897897d502d42f3951f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 25896261d1204b3d858fb5b478a89034. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:42.033488 13829 raft_consensus.cc:1275] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:42.034509 13681 raft_consensus.cc:1275] T 25896261d1204b3d858fb5b478a89034 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:42.035233 14695 consensus_queue.cc:1048] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:42.036664 14688 consensus_queue.cc:1048] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:42.034708 13832 raft_consensus.cc:2955] T 34a12e91341d4472be7460f1061495db P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:42.052924 14688 raft_consensus.cc:2955] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:42.055266 13681 raft_consensus.cc:2955] T 25896261d1204b3d858fb5b478a89034 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:42.068563 13829 raft_consensus.cc:2955] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:42.091995 13584 catalog_manager.cc:5697] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New cstate: current_term: 1 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:42.314237 14718 ts_tablet_manager.cc:933] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f: Initiating tablet copy from peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:42.316710 14718 tablet_copy_client.cc:323] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Beginning tablet copy session from remote peer at address 127.12.56.194:39545
I20260709 12:09:42.318614 13773 tablet_copy_service.cc:140] P 3f37c9cc9dda46b4be21dd675ba78fb7: Received BeginTabletCopySession request for tablet f1bace76cb204a6d92c38685645dd9db from peer ca9fbbc2c0a94897897d502d42f3951f ({username='slave'} at 127.0.0.1:38932)
I20260709 12:09:42.319144 13773 tablet_copy_service.cc:161] P 3f37c9cc9dda46b4be21dd675ba78fb7: Beginning new tablet copy session on tablet f1bace76cb204a6d92c38685645dd9db from peer ca9fbbc2c0a94897897d502d42f3951f at {username='slave'} at 127.0.0.1:38932: session id = ca9fbbc2c0a94897897d502d42f3951f-f1bace76cb204a6d92c38685645dd9db
I20260709 12:09:42.324838 13773 tablet_copy_source_session.cc:215] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:42.327937 14718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1bace76cb204a6d92c38685645dd9db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:42.342767 14718 tablet_copy_client.cc:806] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:42.343392 14718 tablet_copy_client.cc:670] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:42.348322 14718 tablet_copy_client.cc:538] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:42.360869 14718 tablet_bootstrap.cc:492] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap starting.
I20260709 12:09:42.375026 14720 ts_tablet_manager.cc:933] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f: Initiating tablet copy from peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199)
I20260709 12:09:42.377899 14720 tablet_copy_client.cc:323] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Beginning tablet copy session from remote peer at address 127.12.56.193:33199
I20260709 12:09:42.380386 13698 tablet_copy_service.cc:140] P b98d2519bb504dc6905ed2ede4571835: Received BeginTabletCopySession request for tablet 34a12e91341d4472be7460f1061495db from peer ca9fbbc2c0a94897897d502d42f3951f ({username='slave'} at 127.0.0.1:48212)
I20260709 12:09:42.381035 13698 tablet_copy_service.cc:161] P b98d2519bb504dc6905ed2ede4571835: Beginning new tablet copy session on tablet 34a12e91341d4472be7460f1061495db from peer ca9fbbc2c0a94897897d502d42f3951f at {username='slave'} at 127.0.0.1:48212: session id = ca9fbbc2c0a94897897d502d42f3951f-34a12e91341d4472be7460f1061495db
I20260709 12:09:42.392000 13698 tablet_copy_source_session.cc:215] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:42.397030 14720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34a12e91341d4472be7460f1061495db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:42.401978 14718 tablet_bootstrap.cc:492] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:42.403076 14718 tablet_bootstrap.cc:492] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap complete.
I20260709 12:09:42.404353 14718 ts_tablet_manager.cc:1403] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f: Time spent bootstrapping tablet: real 0.044s	user 0.014s	sys 0.015s
I20260709 12:09:42.407732 14718 raft_consensus.cc:359] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:42.408696 14718 raft_consensus.cc:740] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Initialized, Role: LEARNER
I20260709 12:09:42.409449 14718 consensus_queue.cc:260] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:42.420770 14720 tablet_copy_client.cc:806] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:42.421446 14720 tablet_copy_client.cc:670] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:42.426107 14720 tablet_copy_client.cc:538] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:42.480846 14725 ts_tablet_manager.cc:933] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f: Initiating tablet copy from peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:42.491966 14720 tablet_bootstrap.cc:492] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap starting.
I20260709 12:09:42.498890 14725 tablet_copy_client.cc:323] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Beginning tablet copy session from remote peer at address 127.12.56.194:39545
I20260709 12:09:42.500815 13773 tablet_copy_service.cc:140] P 3f37c9cc9dda46b4be21dd675ba78fb7: Received BeginTabletCopySession request for tablet 25896261d1204b3d858fb5b478a89034 from peer ca9fbbc2c0a94897897d502d42f3951f ({username='slave'} at 127.0.0.1:38932)
I20260709 12:09:42.501451 13773 tablet_copy_service.cc:161] P 3f37c9cc9dda46b4be21dd675ba78fb7: Beginning new tablet copy session on tablet 25896261d1204b3d858fb5b478a89034 from peer ca9fbbc2c0a94897897d502d42f3951f at {username='slave'} at 127.0.0.1:38932: session id = ca9fbbc2c0a94897897d502d42f3951f-25896261d1204b3d858fb5b478a89034
I20260709 12:09:42.510339 13773 tablet_copy_source_session.cc:215] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:42.514393 14725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25896261d1204b3d858fb5b478a89034. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:42.544004 14725 tablet_copy_client.cc:806] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:42.544674 14725 tablet_copy_client.cc:670] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:42.550925 14725 tablet_copy_client.cc:538] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:09:42.557375 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 45767.7us
I20260709 12:09:42.561767 14725 tablet_bootstrap.cc:492] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap starting.
I20260709 12:09:42.616086 14725 tablet_bootstrap.cc:492] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:42.617142 14725 tablet_bootstrap.cc:492] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap complete.
I20260709 12:09:42.626619 14725 ts_tablet_manager.cc:1403] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f: Time spent bootstrapping tablet: real 0.065s	user 0.027s	sys 0.003s
I20260709 12:09:42.628470 14723 ts_tablet_manager.cc:933] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f: Initiating tablet copy from peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199)
I20260709 12:09:42.630160 14725 raft_consensus.cc:359] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:42.631201 14725 raft_consensus.cc:740] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Initialized, Role: LEARNER
I20260709 12:09:42.631953 14725 consensus_queue.cc:260] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:42.643240 14725 ts_tablet_manager.cc:1434] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:09:42.658787 13773 tablet_copy_service.cc:342] P 3f37c9cc9dda46b4be21dd675ba78fb7: Request end of tablet copy session ca9fbbc2c0a94897897d502d42f3951f-25896261d1204b3d858fb5b478a89034 received from {username='slave'} at 127.0.0.1:38932
I20260709 12:09:42.659305 13773 tablet_copy_service.cc:434] P 3f37c9cc9dda46b4be21dd675ba78fb7: ending tablet copy session ca9fbbc2c0a94897897d502d42f3951f-25896261d1204b3d858fb5b478a89034 on tablet 25896261d1204b3d858fb5b478a89034 with peer ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:09:42.664232 14723 tablet_copy_client.cc:323] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Beginning tablet copy session from remote peer at address 127.12.56.193:33199
I20260709 12:09:42.666035 13698 tablet_copy_service.cc:140] P b98d2519bb504dc6905ed2ede4571835: Received BeginTabletCopySession request for tablet e8e96840ffec4e38a0f975263031c226 from peer ca9fbbc2c0a94897897d502d42f3951f ({username='slave'} at 127.0.0.1:48212)
I20260709 12:09:42.666605 13698 tablet_copy_service.cc:161] P b98d2519bb504dc6905ed2ede4571835: Beginning new tablet copy session on tablet e8e96840ffec4e38a0f975263031c226 from peer ca9fbbc2c0a94897897d502d42f3951f at {username='slave'} at 127.0.0.1:48212: session id = ca9fbbc2c0a94897897d502d42f3951f-e8e96840ffec4e38a0f975263031c226
I20260709 12:09:42.674978 13698 tablet_copy_source_session.cc:215] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:42.699816 14720 tablet_bootstrap.cc:492] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:42.700986 14720 tablet_bootstrap.cc:492] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap complete.
I20260709 12:09:42.701757 14720 ts_tablet_manager.cc:1403] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f: Time spent bootstrapping tablet: real 0.210s	user 0.050s	sys 0.047s
I20260709 12:09:42.703197 14723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8e96840ffec4e38a0f975263031c226. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:42.705133 14718 ts_tablet_manager.cc:1434] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f: Time spent starting tablet: real 0.300s	user 0.101s	sys 0.140s
I20260709 12:09:42.712180 14720 raft_consensus.cc:359] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:42.715137 14720 raft_consensus.cc:740] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Initialized, Role: LEARNER
I20260709 12:09:42.715924 14720 consensus_queue.cc:260] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:42.716542 13773 tablet_copy_service.cc:342] P 3f37c9cc9dda46b4be21dd675ba78fb7: Request end of tablet copy session ca9fbbc2c0a94897897d502d42f3951f-f1bace76cb204a6d92c38685645dd9db received from {username='slave'} at 127.0.0.1:38932
I20260709 12:09:42.717718 13773 tablet_copy_service.cc:434] P 3f37c9cc9dda46b4be21dd675ba78fb7: ending tablet copy session ca9fbbc2c0a94897897d502d42f3951f-f1bace76cb204a6d92c38685645dd9db on tablet f1bace76cb204a6d92c38685645dd9db with peer ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:09:42.718869 14720 ts_tablet_manager.cc:1434] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:09:42.731040 14723 tablet_copy_client.cc:806] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:42.731743 14723 tablet_copy_client.cc:670] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 1 WAL segments...
W20260709 12:09:42.735682 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 52638.2us
I20260709 12:09:42.738516 14723 tablet_copy_client.cc:538] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:42.748819 13698 tablet_copy_service.cc:342] P b98d2519bb504dc6905ed2ede4571835: Request end of tablet copy session ca9fbbc2c0a94897897d502d42f3951f-34a12e91341d4472be7460f1061495db received from {username='slave'} at 127.0.0.1:48212
I20260709 12:09:42.749402 13698 tablet_copy_service.cc:434] P b98d2519bb504dc6905ed2ede4571835: ending tablet copy session ca9fbbc2c0a94897897d502d42f3951f-34a12e91341d4472be7460f1061495db on tablet 34a12e91341d4472be7460f1061495db with peer ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:09:42.752948 14723 tablet_bootstrap.cc:492] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap starting.
I20260709 12:09:42.794158 14723 tablet_bootstrap.cc:492] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:42.795862 14723 tablet_bootstrap.cc:492] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap complete.
I20260709 12:09:42.796593 14723 ts_tablet_manager.cc:1403] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f: Time spent bootstrapping tablet: real 0.044s	user 0.028s	sys 0.005s
I20260709 12:09:42.799975 14723 raft_consensus.cc:359] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:42.800953 14723 raft_consensus.cc:740] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Initialized, Role: LEARNER
I20260709 12:09:42.801697 14723 consensus_queue.cc:260] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:42.804481 14723 ts_tablet_manager.cc:1434] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.008s
I20260709 12:09:42.806970 13698 tablet_copy_service.cc:342] P b98d2519bb504dc6905ed2ede4571835: Request end of tablet copy session ca9fbbc2c0a94897897d502d42f3951f-e8e96840ffec4e38a0f975263031c226 received from {username='slave'} at 127.0.0.1:48212
I20260709 12:09:42.807447 13698 tablet_copy_service.cc:434] P b98d2519bb504dc6905ed2ede4571835: ending tablet copy session ca9fbbc2c0a94897897d502d42f3951f-e8e96840ffec4e38a0f975263031c226 on tablet e8e96840ffec4e38a0f975263031c226 with peer ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:09:42.885011 14416 raft_consensus.cc:1217] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:42.897521 14416 raft_consensus.cc:1217] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:42.919981 14416 raft_consensus.cc:1217] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:42.940718 14416 raft_consensus.cc:1217] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 12:09:43.390586 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 70532.6us
I20260709 12:09:43.427376 14695 raft_consensus.cc:1064] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7: attempting to promote NON_VOTER ca9fbbc2c0a94897897d502d42f3951f to VOTER
I20260709 12:09:43.452173 14710 raft_consensus.cc:1064] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835: attempting to promote NON_VOTER ca9fbbc2c0a94897897d502d42f3951f to VOTER
I20260709 12:09:43.455147 14710 consensus_queue.cc:237] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:43.463534 14695 consensus_queue.cc:237] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:09:43.471546 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 54198.5us
I20260709 12:09:43.474393 14688 raft_consensus.cc:1064] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7: attempting to promote NON_VOTER ca9fbbc2c0a94897897d502d42f3951f to VOTER
I20260709 12:09:43.481513 13758 raft_consensus.cc:1275] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:43.484776 14736 consensus_queue.cc:1048] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:43.487124 14688 consensus_queue.cc:237] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:43.494505 13829 raft_consensus.cc:1275] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:43.497854 13683 raft_consensus.cc:1275] T 25896261d1204b3d858fb5b478a89034 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:43.497717 14416 raft_consensus.cc:1275] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:43.499323 14695 consensus_queue.cc:1048] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:43.503849 14416 raft_consensus.cc:1275] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:43.504216 14734 consensus_queue.cc:1048] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:43.509093 13682 raft_consensus.cc:1275] T f1bace76cb204a6d92c38685645dd9db P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:43.509223 14696 consensus_queue.cc:1048] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:43.510613 13829 raft_consensus.cc:1275] T 34a12e91341d4472be7460f1061495db P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:43.513190 14416 raft_consensus.cc:1275] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:43.516412 14696 consensus_queue.cc:1048] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:43.516251 14736 consensus_queue.cc:1048] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:43.523772 13836 raft_consensus.cc:1275] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:43.525327 14696 consensus_queue.cc:1048] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:43.528230 14736 consensus_queue.cc:1048] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:43.528774 14696 consensus_queue.cc:1048] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:43.540225 14696 raft_consensus.cc:2955] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:43.544593 14413 raft_consensus.cc:2955] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:43.560036 14738 raft_consensus.cc:1064] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835: attempting to promote NON_VOTER ca9fbbc2c0a94897897d502d42f3951f to VOTER
I20260709 12:09:43.561751 14734 raft_consensus.cc:2955] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:43.562981 14738 consensus_queue.cc:237] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:43.563143 13829 raft_consensus.cc:2955] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:43.580097 14736 raft_consensus.cc:2955] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:43.587404 13829 raft_consensus.cc:2955] T 34a12e91341d4472be7460f1061495db P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:43.593200 13683 raft_consensus.cc:2955] T 25896261d1204b3d858fb5b478a89034 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:43.607204 14416 raft_consensus.cc:2955] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:43.605253 14414 raft_consensus.cc:2955] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:43.612200 13585 catalog_manager.cc:5697] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd reported cstate change: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:43.614476 13583 catalog_manager.cc:5697] T 25896261d1204b3d858fb5b478a89034 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:43.617049 13832 raft_consensus.cc:1275] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:43.618994 13757 raft_consensus.cc:1275] T e8e96840ffec4e38a0f975263031c226 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:43.619367 14412 raft_consensus.cc:1275] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:43.622020 14679 consensus_queue.cc:1048] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:43.623358 14738 consensus_queue.cc:1048] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:43.625859 14679 consensus_queue.cc:1048] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:43.629474 13682 raft_consensus.cc:2955] T f1bace76cb204a6d92c38685645dd9db P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:43.637696 13836 raft_consensus.cc:2955] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:43.641091 13758 raft_consensus.cc:2955] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
W20260709 12:09:43.708626 14755 log.cc:927] Time spent T e8e96840ffec4e38a0f975263031c226 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:09:43.719513 14679 raft_consensus.cc:2955] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:43.730144 14414 raft_consensus.cc:2955] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:43.737191 13832 raft_consensus.cc:2955] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:43.735494 13758 raft_consensus.cc:2955] T e8e96840ffec4e38a0f975263031c226 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:43.760310 13757 consensus_queue.cc:237] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:43.767302 13832 raft_consensus.cc:1275] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:43.768847 14696 consensus_queue.cc:1048] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:43.781082 14688 raft_consensus.cc:2955] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:43.782356 14414 raft_consensus.cc:1275] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:43.785104 13586 catalog_manager.cc:5697] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:43.787293 14695 consensus_queue.cc:1048] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:43.787055 13586 catalog_manager.cc:5697] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:43.792642 13832 raft_consensus.cc:2955] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:43.796190 13570 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f1bace76cb204a6d92c38685645dd9db with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:43.795694 14414 raft_consensus.cc:2955] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:43.826220 13683 consensus_queue.cc:237] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:43.826612 13681 consensus_queue.cc:237] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:43.828131 13584 catalog_manager.cc:5697] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: config changed from index 3 to 4, VOTER b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) evicted. New cstate: current_term: 1 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:43.833112 13757 consensus_queue.cc:237] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:43.834311 13755 raft_consensus.cc:1275] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:43.837724 13829 raft_consensus.cc:1275] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:43.838641 14412 raft_consensus.cc:1275] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:43.839486 14679 consensus_queue.cc:1048] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:43.839754 14711 consensus_queue.cc:1048] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:43.840649 14414 raft_consensus.cc:1275] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:43.845052 13674 tablet_service.cc:1558] Processing DeleteTablet for tablet f1bace76cb204a6d92c38685645dd9db with delete_type TABLET_DATA_TOMBSTONED (TS b98d2519bb504dc6905ed2ede4571835 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41682
I20260709 12:09:43.852165 14737 consensus_queue.cc:1048] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:43.850646 14679 raft_consensus.cc:2955] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:43.855491 13756 raft_consensus.cc:2955] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:43.862808 14762 tablet_replica.cc:333] T f1bace76cb204a6d92c38685645dd9db P b98d2519bb504dc6905ed2ede4571835: stopping tablet replica
I20260709 12:09:43.864362 14762 raft_consensus.cc:2243] T f1bace76cb204a6d92c38685645dd9db P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:43.865250 14762 raft_consensus.cc:2272] T f1bace76cb204a6d92c38685645dd9db P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:43.868950 13832 raft_consensus.cc:1275] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:43.872718 14676 consensus_queue.cc:1048] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:43.875538 14412 raft_consensus.cc:1275] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:43.876232 13570 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 34a12e91341d4472be7460f1061495db with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:43.881999 14736 raft_consensus.cc:2955] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:43.884032 14762 ts_tablet_manager.cc:1916] T f1bace76cb204a6d92c38685645dd9db P b98d2519bb504dc6905ed2ede4571835: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:43.885506 14696 consensus_queue.cc:1048] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:43.886996 14735 consensus_queue.cc:1048] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:43.895877 14414 raft_consensus.cc:2955] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:43.902513 13585 catalog_manager.cc:5697] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 reported cstate change: config changed from index 3 to 4, VOTER 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) evicted. New cstate: current_term: 1 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:43.914723 14688 raft_consensus.cc:2955] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:43.916664 14414 raft_consensus.cc:2955] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:43.924278 13570 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e8e96840ffec4e38a0f975263031c226 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:43.928298 14762 ts_tablet_manager.cc:1929] T f1bace76cb204a6d92c38685645dd9db P b98d2519bb504dc6905ed2ede4571835: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:43.928884 13829 raft_consensus.cc:2955] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:43.933450 13824 tablet_service.cc:1558] Processing DeleteTablet for tablet 34a12e91341d4472be7460f1061495db with delete_type TABLET_DATA_TOMBSTONED (TS 96701a74fdee481fb5f54aac841e17dd not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54808
I20260709 12:09:43.941995 14763 tablet_replica.cc:333] T 34a12e91341d4472be7460f1061495db P 96701a74fdee481fb5f54aac841e17dd: stopping tablet replica
I20260709 12:09:43.943339 14763 raft_consensus.cc:2243] T 34a12e91341d4472be7460f1061495db P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:43.944288 14763 raft_consensus.cc:2272] T 34a12e91341d4472be7460f1061495db P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:43.958195 14763 ts_tablet_manager.cc:1916] T 34a12e91341d4472be7460f1061495db P 96701a74fdee481fb5f54aac841e17dd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:43.959360 13584 catalog_manager.cc:5697] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: config changed from index 3 to 4, VOTER 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) evicted. New cstate: current_term: 1 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:43.912757 14412 raft_consensus.cc:2955] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:43.962708 13832 raft_consensus.cc:2955] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:43.928913 14762 log.cc:1199] T f1bace76cb204a6d92c38685645dd9db P b98d2519bb504dc6905ed2ede4571835: Deleting WAL directory at /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894707649-12515-0/minicluster-data/ts-0-root/wals/f1bace76cb204a6d92c38685645dd9db
I20260709 12:09:43.981583 13570 catalog_manager.cc:5028] TS b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): tablet f1bace76cb204a6d92c38685645dd9db (table test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]) successfully deleted
I20260709 12:09:43.991582 13583 catalog_manager.cc:5697] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: config changed from index 3 to 4, VOTER b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) evicted. New cstate: current_term: 1 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:43.996196 13570 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 25896261d1204b3d858fb5b478a89034 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:44.021368 13674 tablet_service.cc:1558] Processing DeleteTablet for tablet 25896261d1204b3d858fb5b478a89034 with delete_type TABLET_DATA_TOMBSTONED (TS b98d2519bb504dc6905ed2ede4571835 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41682
I20260709 12:09:44.022886 14762 tablet_replica.cc:333] T 25896261d1204b3d858fb5b478a89034 P b98d2519bb504dc6905ed2ede4571835: stopping tablet replica
I20260709 12:09:44.026708 14763 ts_tablet_manager.cc:1929] T 34a12e91341d4472be7460f1061495db P 96701a74fdee481fb5f54aac841e17dd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:44.027284 14763 log.cc:1199] T 34a12e91341d4472be7460f1061495db P 96701a74fdee481fb5f54aac841e17dd: Deleting WAL directory at /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894707649-12515-0/minicluster-data/ts-2-root/wals/34a12e91341d4472be7460f1061495db
I20260709 12:09:44.034294 13571 catalog_manager.cc:5028] TS 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): tablet 34a12e91341d4472be7460f1061495db (table test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]) successfully deleted
I20260709 12:09:44.035399 13752 tablet_service.cc:1558] Processing DeleteTablet for tablet e8e96840ffec4e38a0f975263031c226 with delete_type TABLET_DATA_TOMBSTONED (TS 3f37c9cc9dda46b4be21dd675ba78fb7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48110
I20260709 12:09:44.048962 14765 tablet_replica.cc:333] T e8e96840ffec4e38a0f975263031c226 P 3f37c9cc9dda46b4be21dd675ba78fb7: stopping tablet replica
I20260709 12:09:44.052796 14765 raft_consensus.cc:2243] T e8e96840ffec4e38a0f975263031c226 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:44.053828 14765 raft_consensus.cc:2272] T e8e96840ffec4e38a0f975263031c226 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:44.061527 14765 ts_tablet_manager.cc:1916] T e8e96840ffec4e38a0f975263031c226 P 3f37c9cc9dda46b4be21dd675ba78fb7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:44.064855 14762 raft_consensus.cc:2243] T 25896261d1204b3d858fb5b478a89034 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:44.065912 14762 raft_consensus.cc:2272] T 25896261d1204b3d858fb5b478a89034 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:44.070096 14762 ts_tablet_manager.cc:1916] T 25896261d1204b3d858fb5b478a89034 P b98d2519bb504dc6905ed2ede4571835: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:44.085505 14765 ts_tablet_manager.cc:1929] T e8e96840ffec4e38a0f975263031c226 P 3f37c9cc9dda46b4be21dd675ba78fb7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:44.086189 14765 log.cc:1199] T e8e96840ffec4e38a0f975263031c226 P 3f37c9cc9dda46b4be21dd675ba78fb7: Deleting WAL directory at /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894707649-12515-0/minicluster-data/ts-1-root/wals/e8e96840ffec4e38a0f975263031c226
I20260709 12:09:44.088156 13570 catalog_manager.cc:5028] TS 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): tablet e8e96840ffec4e38a0f975263031c226 (table test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]) successfully deleted
I20260709 12:09:44.092311 14762 ts_tablet_manager.cc:1929] T 25896261d1204b3d858fb5b478a89034 P b98d2519bb504dc6905ed2ede4571835: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:44.092886 14762 log.cc:1199] T 25896261d1204b3d858fb5b478a89034 P b98d2519bb504dc6905ed2ede4571835: Deleting WAL directory at /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894707649-12515-0/minicluster-data/ts-0-root/wals/25896261d1204b3d858fb5b478a89034
I20260709 12:09:44.094638 13570 catalog_manager.cc:5028] TS b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): tablet 25896261d1204b3d858fb5b478a89034 (table test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]) successfully deleted
I20260709 12:09:45.124120 13682 consensus_queue.cc:237] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:45.130817 13836 raft_consensus.cc:1275] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:45.131014 13652 consensus_peers.cc:597] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 -> Peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Couldn't send request to peer ca9fbbc2c0a94897897d502d42f3951f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a3c0f10b06fa4aa48a99239da6d81a1f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:45.131217 13757 raft_consensus.cc:1275] T a3c0f10b06fa4aa48a99239da6d81a1f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:45.132231 14679 consensus_queue.cc:1048] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:45.132890 14737 consensus_queue.cc:1048] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:45.140313 14711 raft_consensus.cc:2955] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:45.142316 13757 raft_consensus.cc:2955] T a3c0f10b06fa4aa48a99239da6d81a1f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:45.142729 13836 raft_consensus.cc:2955] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:45.162875 13682 consensus_queue.cc:237] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:45.164575 13583 catalog_manager.cc:5697] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 reported cstate change: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New cstate: current_term: 1 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:45.189503 13832 raft_consensus.cc:1275] T 658b56fb08f0467fa5a9d602dd275f81 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:45.192435 13757 raft_consensus.cc:1275] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:45.193203 14711 consensus_queue.cc:1048] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:09:45.195878 13652 consensus_peers.cc:597] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 -> Peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Couldn't send request to peer ca9fbbc2c0a94897897d502d42f3951f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 658b56fb08f0467fa5a9d602dd275f81. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:45.196718 14711 consensus_queue.cc:1048] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:45.206076 14679 raft_consensus.cc:2955] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:45.208058 13836 raft_consensus.cc:2955] T 658b56fb08f0467fa5a9d602dd275f81 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:45.211656 13757 raft_consensus.cc:2955] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:45.226552 13682 consensus_queue.cc:237] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:45.240732 13584 catalog_manager.cc:5697] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New cstate: current_term: 1 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:45.244057 13757 raft_consensus.cc:1275] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:45.245657 13832 raft_consensus.cc:1275] T e39d323dce0c45249bf1cf9b6062ab9a P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:45.245472 14737 consensus_queue.cc:1048] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:45.247121 14679 consensus_queue.cc:1048] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:45.256518 13758 raft_consensus.cc:2955] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:45.255259 14737 raft_consensus.cc:2955] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
W20260709 12:09:45.267082 13652 consensus_peers.cc:597] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 -> Peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Couldn't send request to peer ca9fbbc2c0a94897897d502d42f3951f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e39d323dce0c45249bf1cf9b6062ab9a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:45.274263 13836 consensus_queue.cc:237] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:45.278014 13583 catalog_manager.cc:5697] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 reported cstate change: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New cstate: current_term: 1 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:45.289403 13832 raft_consensus.cc:2955] T e39d323dce0c45249bf1cf9b6062ab9a P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
W20260709 12:09:45.308915 13801 consensus_peers.cc:597] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd -> Peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Couldn't send request to peer ca9fbbc2c0a94897897d502d42f3951f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 566e3cc2115c4b6dbd3070c4f4f4f11b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:45.309384 13681 raft_consensus.cc:1275] T 566e3cc2115c4b6dbd3070c4f4f4f11b P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:45.310135 13758 raft_consensus.cc:1275] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:45.311489 14732 consensus_queue.cc:1048] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:45.312947 14766 consensus_queue.cc:1048] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:45.320959 14766 raft_consensus.cc:2955] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:45.324025 13758 raft_consensus.cc:2955] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:45.325032 13681 raft_consensus.cc:2955] T 566e3cc2115c4b6dbd3070c4f4f4f11b P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:45.351629 13583 catalog_manager.cc:5697] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New cstate: current_term: 1 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:45.746647 14785 ts_tablet_manager.cc:933] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f: Initiating tablet copy from peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199)
I20260709 12:09:45.761179 14789 ts_tablet_manager.cc:933] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f: Initiating tablet copy from peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199)
I20260709 12:09:45.779045 14788 ts_tablet_manager.cc:933] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f: Initiating tablet copy from peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199)
I20260709 12:09:45.789579 14788 tablet_copy_client.cc:323] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Beginning tablet copy session from remote peer at address 127.12.56.193:33199
I20260709 12:09:45.792809 13698 tablet_copy_service.cc:140] P b98d2519bb504dc6905ed2ede4571835: Received BeginTabletCopySession request for tablet a3c0f10b06fa4aa48a99239da6d81a1f from peer ca9fbbc2c0a94897897d502d42f3951f ({username='slave'} at 127.0.0.1:48212)
I20260709 12:09:45.793913 13698 tablet_copy_service.cc:161] P b98d2519bb504dc6905ed2ede4571835: Beginning new tablet copy session on tablet a3c0f10b06fa4aa48a99239da6d81a1f from peer ca9fbbc2c0a94897897d502d42f3951f at {username='slave'} at 127.0.0.1:48212: session id = ca9fbbc2c0a94897897d502d42f3951f-a3c0f10b06fa4aa48a99239da6d81a1f
I20260709 12:09:45.814495 14789 tablet_copy_client.cc:323] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Beginning tablet copy session from remote peer at address 127.12.56.193:33199
I20260709 12:09:45.817052 13697 tablet_copy_service.cc:140] P b98d2519bb504dc6905ed2ede4571835: Received BeginTabletCopySession request for tablet 658b56fb08f0467fa5a9d602dd275f81 from peer ca9fbbc2c0a94897897d502d42f3951f ({username='slave'} at 127.0.0.1:48212)
I20260709 12:09:45.817744 13697 tablet_copy_service.cc:161] P b98d2519bb504dc6905ed2ede4571835: Beginning new tablet copy session on tablet 658b56fb08f0467fa5a9d602dd275f81 from peer ca9fbbc2c0a94897897d502d42f3951f at {username='slave'} at 127.0.0.1:48212: session id = ca9fbbc2c0a94897897d502d42f3951f-658b56fb08f0467fa5a9d602dd275f81
I20260709 12:09:45.846475 13697 tablet_copy_source_session.cc:215] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:45.828807 14785 tablet_copy_client.cc:323] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Beginning tablet copy session from remote peer at address 127.12.56.193:33199
I20260709 12:09:45.867157 13696 tablet_copy_service.cc:140] P b98d2519bb504dc6905ed2ede4571835: Received BeginTabletCopySession request for tablet e39d323dce0c45249bf1cf9b6062ab9a from peer ca9fbbc2c0a94897897d502d42f3951f ({username='slave'} at 127.0.0.1:48212)
I20260709 12:09:45.868275 13696 tablet_copy_service.cc:161] P b98d2519bb504dc6905ed2ede4571835: Beginning new tablet copy session on tablet e39d323dce0c45249bf1cf9b6062ab9a from peer ca9fbbc2c0a94897897d502d42f3951f at {username='slave'} at 127.0.0.1:48212: session id = ca9fbbc2c0a94897897d502d42f3951f-e39d323dce0c45249bf1cf9b6062ab9a
I20260709 12:09:45.876112 13698 tablet_copy_source_session.cc:215] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:45.878368 14789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 658b56fb08f0467fa5a9d602dd275f81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:45.891116 14788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3c0f10b06fa4aa48a99239da6d81a1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:45.948673 13696 tablet_copy_source_session.cc:215] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:45.952288 14785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e39d323dce0c45249bf1cf9b6062ab9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:45.952147 14794 ts_tablet_manager.cc:933] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f: Initiating tablet copy from peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:45.999850 14794 tablet_copy_client.cc:323] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Beginning tablet copy session from remote peer at address 127.12.56.195:36603
I20260709 12:09:46.002573 13847 tablet_copy_service.cc:140] P 96701a74fdee481fb5f54aac841e17dd: Received BeginTabletCopySession request for tablet 566e3cc2115c4b6dbd3070c4f4f4f11b from peer ca9fbbc2c0a94897897d502d42f3951f ({username='slave'} at 127.0.0.1:35422)
I20260709 12:09:46.003270 13847 tablet_copy_service.cc:161] P 96701a74fdee481fb5f54aac841e17dd: Beginning new tablet copy session on tablet 566e3cc2115c4b6dbd3070c4f4f4f11b from peer ca9fbbc2c0a94897897d502d42f3951f at {username='slave'} at 127.0.0.1:35422: session id = ca9fbbc2c0a94897897d502d42f3951f-566e3cc2115c4b6dbd3070c4f4f4f11b
I20260709 12:09:46.012228 14788 tablet_copy_client.cc:806] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:46.013113 14788 tablet_copy_client.cc:670] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:46.014732 14789 tablet_copy_client.cc:806] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:46.015432 14789 tablet_copy_client.cc:670] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:46.015316 13847 tablet_copy_source_session.cc:215] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:46.019390 14794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 566e3cc2115c4b6dbd3070c4f4f4f11b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:46.019958 14788 tablet_copy_client.cc:538] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:46.020543 14789 tablet_copy_client.cc:538] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:46.051011 14785 tablet_copy_client.cc:806] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:46.052829 14785 tablet_copy_client.cc:670] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:46.060262 14785 tablet_copy_client.cc:538] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:46.067132 14789 tablet_bootstrap.cc:492] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap starting.
I20260709 12:09:46.070246 14794 tablet_copy_client.cc:806] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:46.071065 14794 tablet_copy_client.cc:670] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:46.071831 14788 tablet_bootstrap.cc:492] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap starting.
I20260709 12:09:46.103654 14788 tablet_bootstrap.cc:492] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:46.104737 14788 tablet_bootstrap.cc:492] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap complete.
I20260709 12:09:46.105504 14788 ts_tablet_manager.cc:1403] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.009s
I20260709 12:09:46.106277 14794 tablet_copy_client.cc:538] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:46.107419 14789 tablet_bootstrap.cc:492] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:46.109810 14789 tablet_bootstrap.cc:492] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap complete.
I20260709 12:09:46.109678 14788 raft_consensus.cc:359] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:46.111162 14788 raft_consensus.cc:740] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Initialized, Role: LEARNER
I20260709 12:09:46.111900 14788 consensus_queue.cc:260] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:46.110747 14789 ts_tablet_manager.cc:1403] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f: Time spent bootstrapping tablet: real 0.044s	user 0.020s	sys 0.012s
I20260709 12:09:46.129624 14785 tablet_bootstrap.cc:492] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap starting.
I20260709 12:09:46.129922 14789 raft_consensus.cc:359] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:46.131948 14789 raft_consensus.cc:740] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Initialized, Role: LEARNER
I20260709 12:09:46.132781 14789 consensus_queue.cc:260] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:46.135691 14789 ts_tablet_manager.cc:1434] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:09:46.138113 14788 ts_tablet_manager.cc:1434] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f: Time spent starting tablet: real 0.032s	user 0.004s	sys 0.014s
I20260709 12:09:46.151276 14794 tablet_bootstrap.cc:492] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap starting.
I20260709 12:09:46.138022 13698 tablet_copy_service.cc:342] P b98d2519bb504dc6905ed2ede4571835: Request end of tablet copy session ca9fbbc2c0a94897897d502d42f3951f-658b56fb08f0467fa5a9d602dd275f81 received from {username='slave'} at 127.0.0.1:48212
I20260709 12:09:46.153167 13698 tablet_copy_service.cc:434] P b98d2519bb504dc6905ed2ede4571835: ending tablet copy session ca9fbbc2c0a94897897d502d42f3951f-658b56fb08f0467fa5a9d602dd275f81 on tablet 658b56fb08f0467fa5a9d602dd275f81 with peer ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:09:46.156086 13696 tablet_copy_service.cc:342] P b98d2519bb504dc6905ed2ede4571835: Request end of tablet copy session ca9fbbc2c0a94897897d502d42f3951f-a3c0f10b06fa4aa48a99239da6d81a1f received from {username='slave'} at 127.0.0.1:48212
I20260709 12:09:46.156558 13696 tablet_copy_service.cc:434] P b98d2519bb504dc6905ed2ede4571835: ending tablet copy session ca9fbbc2c0a94897897d502d42f3951f-a3c0f10b06fa4aa48a99239da6d81a1f on tablet a3c0f10b06fa4aa48a99239da6d81a1f with peer ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:09:46.199209 14785 tablet_bootstrap.cc:492] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:46.200321 14785 tablet_bootstrap.cc:492] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap complete.
I20260709 12:09:46.201182 14785 ts_tablet_manager.cc:1403] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f: Time spent bootstrapping tablet: real 0.072s	user 0.032s	sys 0.009s
I20260709 12:09:46.204696 14785 raft_consensus.cc:359] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:46.205708 14785 raft_consensus.cc:740] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Initialized, Role: LEARNER
I20260709 12:09:46.206521 14785 consensus_queue.cc:260] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:46.211293 14785 ts_tablet_manager.cc:1434] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:09:46.213953 13696 tablet_copy_service.cc:342] P b98d2519bb504dc6905ed2ede4571835: Request end of tablet copy session ca9fbbc2c0a94897897d502d42f3951f-e39d323dce0c45249bf1cf9b6062ab9a received from {username='slave'} at 127.0.0.1:48212
I20260709 12:09:46.214414 13696 tablet_copy_service.cc:434] P b98d2519bb504dc6905ed2ede4571835: ending tablet copy session ca9fbbc2c0a94897897d502d42f3951f-e39d323dce0c45249bf1cf9b6062ab9a on tablet e39d323dce0c45249bf1cf9b6062ab9a with peer ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:09:46.218961 14794 tablet_bootstrap.cc:492] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:46.224859 14794 tablet_bootstrap.cc:492] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap complete.
I20260709 12:09:46.226779 14794 ts_tablet_manager.cc:1403] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f: Time spent bootstrapping tablet: real 0.076s	user 0.019s	sys 0.015s
I20260709 12:09:46.230062 14794 raft_consensus.cc:359] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:46.231070 14794 raft_consensus.cc:740] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Initialized, Role: LEARNER
I20260709 12:09:46.231814 14794 consensus_queue.cc:260] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:46.234406 14794 ts_tablet_manager.cc:1434] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:09:46.236687 13847 tablet_copy_service.cc:342] P 96701a74fdee481fb5f54aac841e17dd: Request end of tablet copy session ca9fbbc2c0a94897897d502d42f3951f-566e3cc2115c4b6dbd3070c4f4f4f11b received from {username='slave'} at 127.0.0.1:35422
I20260709 12:09:46.237232 13847 tablet_copy_service.cc:434] P 96701a74fdee481fb5f54aac841e17dd: ending tablet copy session ca9fbbc2c0a94897897d502d42f3951f-566e3cc2115c4b6dbd3070c4f4f4f11b on tablet 566e3cc2115c4b6dbd3070c4f4f4f11b with peer ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:09:46.271163 14416 raft_consensus.cc:1217] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:46.357059 14416 raft_consensus.cc:1217] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:46.531813 14416 raft_consensus.cc:1217] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:46.677486 14679 raft_consensus.cc:1064] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835: attempting to promote NON_VOTER ca9fbbc2c0a94897897d502d42f3951f to VOTER
I20260709 12:09:46.680882 14679 consensus_queue.cc:237] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:46.689695 14416 raft_consensus.cc:1217] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:46.692876 14414 raft_consensus.cc:1275] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:46.693584 13756 raft_consensus.cc:1275] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:46.694545 13829 raft_consensus.cc:1275] T e39d323dce0c45249bf1cf9b6062ab9a P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:46.695230 14679 consensus_queue.cc:1048] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:46.697526 14781 consensus_queue.cc:1048] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:46.701153 14781 consensus_queue.cc:1048] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:46.759068 14737 raft_consensus.cc:2955] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:46.767863 13832 raft_consensus.cc:2955] T e39d323dce0c45249bf1cf9b6062ab9a P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:46.775700 14414 raft_consensus.cc:2955] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:46.811959 13583 catalog_manager.cc:5697] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:46.825318 13756 raft_consensus.cc:2955] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:46.873078 13682 consensus_queue.cc:237] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:46.881233 14414 raft_consensus.cc:1275] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:46.882886 14781 consensus_queue.cc:1048] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:46.883852 13756 raft_consensus.cc:1275] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:46.886229 14679 consensus_queue.cc:1048] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:46.893868 14805 raft_consensus.cc:2955] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:46.896732 13756 raft_consensus.cc:2955] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:46.900107 14414 raft_consensus.cc:2955] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:46.916669 13570 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e39d323dce0c45249bf1cf9b6062ab9a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:46.922801 13585 catalog_manager.cc:5697] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: config changed from index 3 to 4, VOTER 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) evicted. New cstate: current_term: 1 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:46.939647 13824 tablet_service.cc:1558] Processing DeleteTablet for tablet e39d323dce0c45249bf1cf9b6062ab9a with delete_type TABLET_DATA_TOMBSTONED (TS 96701a74fdee481fb5f54aac841e17dd not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54808
I20260709 12:09:46.941958 14811 tablet_replica.cc:333] T e39d323dce0c45249bf1cf9b6062ab9a P 96701a74fdee481fb5f54aac841e17dd: stopping tablet replica
I20260709 12:09:46.943306 14811 raft_consensus.cc:2243] T e39d323dce0c45249bf1cf9b6062ab9a P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:46.957405 14811 raft_consensus.cc:2272] T e39d323dce0c45249bf1cf9b6062ab9a P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:46.965854 14759 raft_consensus.cc:1064] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd: attempting to promote NON_VOTER ca9fbbc2c0a94897897d502d42f3951f to VOTER
I20260709 12:09:46.968518 14811 ts_tablet_manager.cc:1916] T e39d323dce0c45249bf1cf9b6062ab9a P 96701a74fdee481fb5f54aac841e17dd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:46.968941 14759 consensus_queue.cc:237] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:46.988595 14811 ts_tablet_manager.cc:1929] T e39d323dce0c45249bf1cf9b6062ab9a P 96701a74fdee481fb5f54aac841e17dd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:46.988897 14416 raft_consensus.cc:1275] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:46.989234 14811 log.cc:1199] T e39d323dce0c45249bf1cf9b6062ab9a P 96701a74fdee481fb5f54aac841e17dd: Deleting WAL directory at /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894707649-12515-0/minicluster-data/ts-2-root/wals/e39d323dce0c45249bf1cf9b6062ab9a
I20260709 12:09:46.990587 14759 consensus_queue.cc:1048] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:46.991402 13758 raft_consensus.cc:1275] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:46.992725 13571 catalog_manager.cc:5028] TS 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): tablet e39d323dce0c45249bf1cf9b6062ab9a (table test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]) successfully deleted
I20260709 12:09:46.993047 13682 raft_consensus.cc:1275] T 566e3cc2115c4b6dbd3070c4f4f4f11b P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:46.993064 14806 consensus_queue.cc:1048] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:46.994625 14732 consensus_queue.cc:1048] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:47.006949 14732 raft_consensus.cc:2955] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:47.009285 14414 raft_consensus.cc:2955] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:47.016311 13756 raft_consensus.cc:2955] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:47.023608 13682 raft_consensus.cc:2955] T 566e3cc2115c4b6dbd3070c4f4f4f11b P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:47.032585 14679 raft_consensus.cc:1064] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835: attempting to promote NON_VOTER ca9fbbc2c0a94897897d502d42f3951f to VOTER
I20260709 12:09:47.035459 14679 consensus_queue.cc:237] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:47.034514 13584 catalog_manager.cc:5697] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd reported cstate change: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:47.078492 13829 consensus_queue.cc:237] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:47.082294 13832 raft_consensus.cc:1275] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:47.084750 14416 raft_consensus.cc:1275] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:47.085041 13756 raft_consensus.cc:1275] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:47.088029 14806 consensus_queue.cc:1048] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:47.090394 14792 consensus_queue.cc:1048] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:47.098397 14679 consensus_queue.cc:1048] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:47.099231 14414 raft_consensus.cc:1275] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:47.100551 14732 raft_consensus.cc:2955] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:47.102387 13756 raft_consensus.cc:2955] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:47.098471 13758 raft_consensus.cc:1275] T a3c0f10b06fa4aa48a99239da6d81a1f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:47.120457 14737 consensus_queue.cc:1048] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:47.104436 14412 raft_consensus.cc:2955] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:47.127074 14737 consensus_queue.cc:1048] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:47.139297 13586 catalog_manager.cc:5697] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: config changed from index 3 to 4, VOTER b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) evicted. New cstate: current_term: 1 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:47.147783 13571 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 566e3cc2115c4b6dbd3070c4f4f4f11b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:47.174383 14781 raft_consensus.cc:2955] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:47.176815 13674 tablet_service.cc:1558] Processing DeleteTablet for tablet 566e3cc2115c4b6dbd3070c4f4f4f11b with delete_type TABLET_DATA_TOMBSTONED (TS b98d2519bb504dc6905ed2ede4571835 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41682
I20260709 12:09:47.179872 14414 raft_consensus.cc:2955] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:47.188838 13756 raft_consensus.cc:2955] T a3c0f10b06fa4aa48a99239da6d81a1f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:47.209430 14820 tablet_replica.cc:333] T 566e3cc2115c4b6dbd3070c4f4f4f11b P b98d2519bb504dc6905ed2ede4571835: stopping tablet replica
I20260709 12:09:47.213070 14820 raft_consensus.cc:2243] T 566e3cc2115c4b6dbd3070c4f4f4f11b P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:47.213954 14820 raft_consensus.cc:2272] T 566e3cc2115c4b6dbd3070c4f4f4f11b P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:47.201025 13829 raft_consensus.cc:2955] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:47.209092 13586 catalog_manager.cc:5697] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:47.229426 14805 raft_consensus.cc:1064] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835: attempting to promote NON_VOTER ca9fbbc2c0a94897897d502d42f3951f to VOTER
I20260709 12:09:47.229641 14820 ts_tablet_manager.cc:1916] T 566e3cc2115c4b6dbd3070c4f4f4f11b P b98d2519bb504dc6905ed2ede4571835: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:47.235173 14805 consensus_queue.cc:237] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:47.254287 13683 consensus_queue.cc:237] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:47.261649 14414 raft_consensus.cc:1275] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:47.261754 13836 raft_consensus.cc:1275] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:47.265120 14737 consensus_queue.cc:1048] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:47.269574 14820 ts_tablet_manager.cc:1929] T 566e3cc2115c4b6dbd3070c4f4f4f11b P b98d2519bb504dc6905ed2ede4571835: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:47.269935 14711 consensus_queue.cc:1048] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:47.274706 14820 log.cc:1199] T 566e3cc2115c4b6dbd3070c4f4f4f11b P b98d2519bb504dc6905ed2ede4571835: Deleting WAL directory at /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894707649-12515-0/minicluster-data/ts-0-root/wals/566e3cc2115c4b6dbd3070c4f4f4f11b
I20260709 12:09:47.276741 13570 catalog_manager.cc:5028] TS b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): tablet 566e3cc2115c4b6dbd3070c4f4f4f11b (table test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]) successfully deleted
I20260709 12:09:47.285099 14679 raft_consensus.cc:2955] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:47.297027 13756 raft_consensus.cc:1275] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:47.300644 14711 consensus_queue.cc:1048] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:47.309101 13570 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a3c0f10b06fa4aa48a99239da6d81a1f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:47.315474 13836 raft_consensus.cc:1275] T 658b56fb08f0467fa5a9d602dd275f81 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:47.316696 14414 raft_consensus.cc:1275] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:47.320464 13585 catalog_manager.cc:5697] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 reported cstate change: config changed from index 3 to 4, VOTER 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) evicted. New cstate: current_term: 1 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:47.322738 13832 raft_consensus.cc:2955] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:47.323674 14414 raft_consensus.cc:2955] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:47.327008 14711 consensus_queue.cc:1048] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:47.337744 14737 consensus_queue.cc:1048] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:47.339351 13752 tablet_service.cc:1558] Processing DeleteTablet for tablet a3c0f10b06fa4aa48a99239da6d81a1f with delete_type TABLET_DATA_TOMBSTONED (TS 3f37c9cc9dda46b4be21dd675ba78fb7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48110
I20260709 12:09:47.407485 14828 tablet_replica.cc:333] T a3c0f10b06fa4aa48a99239da6d81a1f P 3f37c9cc9dda46b4be21dd675ba78fb7: stopping tablet replica
I20260709 12:09:47.409474 14781 raft_consensus.cc:2955] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:47.412106 14828 raft_consensus.cc:2243] T a3c0f10b06fa4aa48a99239da6d81a1f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:47.413044 14828 raft_consensus.cc:2272] T a3c0f10b06fa4aa48a99239da6d81a1f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:47.415233 14412 raft_consensus.cc:2955] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:47.421657 14828 ts_tablet_manager.cc:1916] T a3c0f10b06fa4aa48a99239da6d81a1f P 3f37c9cc9dda46b4be21dd675ba78fb7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:47.415231 13832 raft_consensus.cc:2955] T 658b56fb08f0467fa5a9d602dd275f81 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:47.448580 13584 catalog_manager.cc:5697] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:47.452960 14828 ts_tablet_manager.cc:1929] T a3c0f10b06fa4aa48a99239da6d81a1f P 3f37c9cc9dda46b4be21dd675ba78fb7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:47.455367 14828 log.cc:1199] T a3c0f10b06fa4aa48a99239da6d81a1f P 3f37c9cc9dda46b4be21dd675ba78fb7: Deleting WAL directory at /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894707649-12515-0/minicluster-data/ts-1-root/wals/a3c0f10b06fa4aa48a99239da6d81a1f
I20260709 12:09:47.457242 13758 raft_consensus.cc:2955] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:47.458906 13570 catalog_manager.cc:5028] TS 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): tablet a3c0f10b06fa4aa48a99239da6d81a1f (table test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]) successfully deleted
I20260709 12:09:47.491936 13683 consensus_queue.cc:237] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:47.497478 13758 raft_consensus.cc:1275] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:47.497689 14412 raft_consensus.cc:1275] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:47.499137 14824 consensus_queue.cc:1048] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:47.500114 14781 consensus_queue.cc:1048] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:47.508661 14679 raft_consensus.cc:2955] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:47.518316 13570 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 658b56fb08f0467fa5a9d602dd275f81 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:47.518150 14412 raft_consensus.cc:2955] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:47.527724 13586 catalog_manager.cc:5697] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: config changed from index 3 to 4, VOTER 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) evicted. New cstate: current_term: 1 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:47.523157 13758 raft_consensus.cc:2955] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:47.545076 13824 tablet_service.cc:1558] Processing DeleteTablet for tablet 658b56fb08f0467fa5a9d602dd275f81 with delete_type TABLET_DATA_TOMBSTONED (TS 96701a74fdee481fb5f54aac841e17dd not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54808
I20260709 12:09:47.566777 14830 tablet_replica.cc:333] T 658b56fb08f0467fa5a9d602dd275f81 P 96701a74fdee481fb5f54aac841e17dd: stopping tablet replica
I20260709 12:09:47.567740 14830 raft_consensus.cc:2243] T 658b56fb08f0467fa5a9d602dd275f81 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:47.568599 14830 raft_consensus.cc:2272] T 658b56fb08f0467fa5a9d602dd275f81 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:47.571668 14830 ts_tablet_manager.cc:1916] T 658b56fb08f0467fa5a9d602dd275f81 P 96701a74fdee481fb5f54aac841e17dd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:47.586663 14830 ts_tablet_manager.cc:1929] T 658b56fb08f0467fa5a9d602dd275f81 P 96701a74fdee481fb5f54aac841e17dd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:47.587057 14830 log.cc:1199] T 658b56fb08f0467fa5a9d602dd275f81 P 96701a74fdee481fb5f54aac841e17dd: Deleting WAL directory at /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894707649-12515-0/minicluster-data/ts-2-root/wals/658b56fb08f0467fa5a9d602dd275f81
I20260709 12:09:47.588804 13571 catalog_manager.cc:5028] TS 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): tablet 658b56fb08f0467fa5a9d602dd275f81 (table test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]) successfully deleted
I20260709 12:09:48.657941 13682 consensus_queue.cc:237] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:48.664068 13755 raft_consensus.cc:1275] T 277b655b7311432a95ed2ad291df0b8d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:48.664486 13836 raft_consensus.cc:1275] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:48.666707 14805 consensus_queue.cc:1048] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:48.668458 14679 consensus_queue.cc:1048] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:09:48.669552 13652 consensus_peers.cc:597] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 -> Peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Couldn't send request to peer ca9fbbc2c0a94897897d502d42f3951f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 277b655b7311432a95ed2ad291df0b8d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:48.676183 14831 raft_consensus.cc:2955] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:48.677867 13755 raft_consensus.cc:2955] T 277b655b7311432a95ed2ad291df0b8d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:48.679978 13836 raft_consensus.cc:2955] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:48.699646 13585 catalog_manager.cc:5697] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd reported cstate change: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New cstate: current_term: 1 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:48.701169 13755 consensus_queue.cc:237] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
W20260709 12:09:48.711851 13727 consensus_peers.cc:597] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Couldn't send request to peer ca9fbbc2c0a94897897d502d42f3951f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3c06f5564ed4c259ca5c238c3faf2a3. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:48.712510 13682 raft_consensus.cc:1275] T c3c06f5564ed4c259ca5c238c3faf2a3 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:48.712971 13836 raft_consensus.cc:1275] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:48.714068 14786 consensus_queue.cc:1048] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:48.715901 14735 consensus_queue.cc:1048] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:48.739663 14786 raft_consensus.cc:2955] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:48.741725 13832 raft_consensus.cc:2955] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:48.768435 13682 raft_consensus.cc:2955] T c3c06f5564ed4c259ca5c238c3faf2a3 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:48.774570 13584 catalog_manager.cc:5697] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd reported cstate change: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New cstate: current_term: 1 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
W20260709 12:09:48.801121 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 44403.2us
I20260709 12:09:48.817363 13755 consensus_queue.cc:237] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:48.838445 13682 raft_consensus.cc:1275] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:48.838819 13832 raft_consensus.cc:1275] T 625e9b5c2aa14658af58496a21f9ee8b P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:48.840328 14786 consensus_queue.cc:1048] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:48.842283 14695 consensus_queue.cc:1048] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:09:48.847986 13727 consensus_peers.cc:597] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Couldn't send request to peer ca9fbbc2c0a94897897d502d42f3951f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 625e9b5c2aa14658af58496a21f9ee8b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:48.856281 14735 raft_consensus.cc:2955] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:48.861044 13682 raft_consensus.cc:2955] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:48.873445 13836 raft_consensus.cc:2955] T 625e9b5c2aa14658af58496a21f9ee8b P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:48.875524 13832 consensus_queue.cc:237] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:48.881345 13584 catalog_manager.cc:5697] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New cstate: current_term: 1 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:48.893959 13682 raft_consensus.cc:1275] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:48.894279 13801 consensus_peers.cc:597] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd -> Peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Couldn't send request to peer ca9fbbc2c0a94897897d502d42f3951f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cad007c01ddb46db81e7206ec8b58024. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:48.895612 13755 raft_consensus.cc:1275] T cad007c01ddb46db81e7206ec8b58024 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:48.897564 14843 consensus_queue.cc:1048] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:48.898698 14806 consensus_queue.cc:1048] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:48.936797 14843 raft_consensus.cc:2955] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:48.940312 13682 raft_consensus.cc:2955] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:48.939522 13755 raft_consensus.cc:2955] T cad007c01ddb46db81e7206ec8b58024 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:48.959952 13584 catalog_manager.cc:5697] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd reported cstate change: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New cstate: current_term: 1 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:49.233915 14854 ts_tablet_manager.cc:933] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f: Initiating tablet copy from peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:49.237003 14854 tablet_copy_client.cc:323] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Beginning tablet copy session from remote peer at address 127.12.56.194:39545
I20260709 12:09:49.240191 13773 tablet_copy_service.cc:140] P 3f37c9cc9dda46b4be21dd675ba78fb7: Received BeginTabletCopySession request for tablet 625e9b5c2aa14658af58496a21f9ee8b from peer ca9fbbc2c0a94897897d502d42f3951f ({username='slave'} at 127.0.0.1:38932)
I20260709 12:09:49.240840 13773 tablet_copy_service.cc:161] P 3f37c9cc9dda46b4be21dd675ba78fb7: Beginning new tablet copy session on tablet 625e9b5c2aa14658af58496a21f9ee8b from peer ca9fbbc2c0a94897897d502d42f3951f at {username='slave'} at 127.0.0.1:38932: session id = ca9fbbc2c0a94897897d502d42f3951f-625e9b5c2aa14658af58496a21f9ee8b
I20260709 12:09:49.252185 13773 tablet_copy_source_session.cc:215] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:49.257740 14854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 625e9b5c2aa14658af58496a21f9ee8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:49.292834 14854 tablet_copy_client.cc:806] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:49.293972 14854 tablet_copy_client.cc:670] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:49.301407 14854 tablet_copy_client.cc:538] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:49.319360 14854 tablet_bootstrap.cc:492] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap starting.
I20260709 12:09:49.323153 14856 ts_tablet_manager.cc:933] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f: Initiating tablet copy from peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199)
I20260709 12:09:49.345549 14857 ts_tablet_manager.cc:933] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f: Initiating tablet copy from peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:49.347586 14856 tablet_copy_client.cc:323] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Beginning tablet copy session from remote peer at address 127.12.56.193:33199
I20260709 12:09:49.349994 13696 tablet_copy_service.cc:140] P b98d2519bb504dc6905ed2ede4571835: Received BeginTabletCopySession request for tablet 277b655b7311432a95ed2ad291df0b8d from peer ca9fbbc2c0a94897897d502d42f3951f ({username='slave'} at 127.0.0.1:48212)
I20260709 12:09:49.350857 13696 tablet_copy_service.cc:161] P b98d2519bb504dc6905ed2ede4571835: Beginning new tablet copy session on tablet 277b655b7311432a95ed2ad291df0b8d from peer ca9fbbc2c0a94897897d502d42f3951f at {username='slave'} at 127.0.0.1:48212: session id = ca9fbbc2c0a94897897d502d42f3951f-277b655b7311432a95ed2ad291df0b8d
I20260709 12:09:49.356331 14857 tablet_copy_client.cc:323] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Beginning tablet copy session from remote peer at address 127.12.56.194:39545
I20260709 12:09:49.358770 13773 tablet_copy_service.cc:140] P 3f37c9cc9dda46b4be21dd675ba78fb7: Received BeginTabletCopySession request for tablet c3c06f5564ed4c259ca5c238c3faf2a3 from peer ca9fbbc2c0a94897897d502d42f3951f ({username='slave'} at 127.0.0.1:38932)
I20260709 12:09:49.359474 13773 tablet_copy_service.cc:161] P 3f37c9cc9dda46b4be21dd675ba78fb7: Beginning new tablet copy session on tablet c3c06f5564ed4c259ca5c238c3faf2a3 from peer ca9fbbc2c0a94897897d502d42f3951f at {username='slave'} at 127.0.0.1:38932: session id = ca9fbbc2c0a94897897d502d42f3951f-c3c06f5564ed4c259ca5c238c3faf2a3
I20260709 12:09:49.362526 13696 tablet_copy_source_session.cc:215] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:49.367890 14856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 277b655b7311432a95ed2ad291df0b8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:49.368753 14859 ts_tablet_manager.cc:933] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f: Initiating tablet copy from peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:49.374724 13773 tablet_copy_source_session.cc:215] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:49.382583 14859 tablet_copy_client.cc:323] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Beginning tablet copy session from remote peer at address 127.12.56.195:36603
I20260709 12:09:49.389456 13847 tablet_copy_service.cc:140] P 96701a74fdee481fb5f54aac841e17dd: Received BeginTabletCopySession request for tablet cad007c01ddb46db81e7206ec8b58024 from peer ca9fbbc2c0a94897897d502d42f3951f ({username='slave'} at 127.0.0.1:35422)
I20260709 12:09:49.390125 13847 tablet_copy_service.cc:161] P 96701a74fdee481fb5f54aac841e17dd: Beginning new tablet copy session on tablet cad007c01ddb46db81e7206ec8b58024 from peer ca9fbbc2c0a94897897d502d42f3951f at {username='slave'} at 127.0.0.1:35422: session id = ca9fbbc2c0a94897897d502d42f3951f-cad007c01ddb46db81e7206ec8b58024
I20260709 12:09:49.390550 14857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3c06f5564ed4c259ca5c238c3faf2a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:49.395394 14856 tablet_copy_client.cc:806] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:49.396199 14856 tablet_copy_client.cc:670] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:49.401542 14856 tablet_copy_client.cc:538] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:49.412840 13847 tablet_copy_source_session.cc:215] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:49.420138 14859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cad007c01ddb46db81e7206ec8b58024. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:49.451881 14854 tablet_bootstrap.cc:492] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:49.453444 14854 tablet_bootstrap.cc:492] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap complete.
I20260709 12:09:49.461369 14856 tablet_bootstrap.cc:492] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap starting.
I20260709 12:09:49.465407 14854 ts_tablet_manager.cc:1403] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f: Time spent bootstrapping tablet: real 0.146s	user 0.031s	sys 0.001s
I20260709 12:09:49.478452 14854 raft_consensus.cc:359] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:49.479682 14854 raft_consensus.cc:740] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Initialized, Role: LEARNER
I20260709 12:09:49.480392 14854 consensus_queue.cc:260] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:49.485690 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:49.501134 14857 tablet_copy_client.cc:806] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:49.501915 14857 tablet_copy_client.cc:670] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:49.509438 14854 ts_tablet_manager.cc:1434] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f: Time spent starting tablet: real 0.044s	user 0.011s	sys 0.004s
I20260709 12:09:49.519726 14856 tablet_bootstrap.cc:492] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:49.521287 14856 tablet_bootstrap.cc:492] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap complete.
I20260709 12:09:49.522328 14856 ts_tablet_manager.cc:1403] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f: Time spent bootstrapping tablet: real 0.061s	user 0.030s	sys 0.000s
I20260709 12:09:49.525182 13773 tablet_copy_service.cc:342] P 3f37c9cc9dda46b4be21dd675ba78fb7: Request end of tablet copy session ca9fbbc2c0a94897897d502d42f3951f-625e9b5c2aa14658af58496a21f9ee8b received from {username='slave'} at 127.0.0.1:38932
I20260709 12:09:49.525756 13773 tablet_copy_service.cc:434] P 3f37c9cc9dda46b4be21dd675ba78fb7: ending tablet copy session ca9fbbc2c0a94897897d502d42f3951f-625e9b5c2aa14658af58496a21f9ee8b on tablet 625e9b5c2aa14658af58496a21f9ee8b with peer ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:09:49.525465 14856 raft_consensus.cc:359] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:49.526433 14856 raft_consensus.cc:740] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Initialized, Role: LEARNER
I20260709 12:09:49.528837 14857 tablet_copy_client.cc:538] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:49.527359 14856 consensus_queue.cc:260] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:49.532428 14856 ts_tablet_manager.cc:1434] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:09:49.534399 14859 tablet_copy_client.cc:806] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:49.535188 14859 tablet_copy_client.cc:670] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:49.540160 13696 tablet_copy_service.cc:342] P b98d2519bb504dc6905ed2ede4571835: Request end of tablet copy session ca9fbbc2c0a94897897d502d42f3951f-277b655b7311432a95ed2ad291df0b8d received from {username='slave'} at 127.0.0.1:48212
I20260709 12:09:49.540853 13696 tablet_copy_service.cc:434] P b98d2519bb504dc6905ed2ede4571835: ending tablet copy session ca9fbbc2c0a94897897d502d42f3951f-277b655b7311432a95ed2ad291df0b8d on tablet 277b655b7311432a95ed2ad291df0b8d with peer ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:09:49.547269 14857 tablet_bootstrap.cc:492] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap starting.
I20260709 12:09:49.548007 14859 tablet_copy_client.cc:538] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:49.565168 14859 tablet_bootstrap.cc:492] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap starting.
I20260709 12:09:49.600230 14857 tablet_bootstrap.cc:492] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:49.622089 14857 tablet_bootstrap.cc:492] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap complete.
I20260709 12:09:49.623435 14857 ts_tablet_manager.cc:1403] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f: Time spent bootstrapping tablet: real 0.076s	user 0.032s	sys 0.006s
I20260709 12:09:49.635784 14857 raft_consensus.cc:359] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:49.636842 14857 raft_consensus.cc:740] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Initialized, Role: LEARNER
I20260709 12:09:49.637912 14857 consensus_queue.cc:260] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:49.639828 14859 tablet_bootstrap.cc:492] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:49.641315 14859 tablet_bootstrap.cc:492] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap complete.
I20260709 12:09:49.642118 14859 ts_tablet_manager.cc:1403] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f: Time spent bootstrapping tablet: real 0.077s	user 0.039s	sys 0.029s
I20260709 12:09:49.647222 14857 ts_tablet_manager.cc:1434] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 12:09:49.647312 14859 raft_consensus.cc:359] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:49.649222 14859 raft_consensus.cc:740] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Initialized, Role: LEARNER
I20260709 12:09:49.650043 14859 consensus_queue.cc:260] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:49.650612 13773 tablet_copy_service.cc:342] P 3f37c9cc9dda46b4be21dd675ba78fb7: Request end of tablet copy session ca9fbbc2c0a94897897d502d42f3951f-c3c06f5564ed4c259ca5c238c3faf2a3 received from {username='slave'} at 127.0.0.1:38932
I20260709 12:09:49.651538 13773 tablet_copy_service.cc:434] P 3f37c9cc9dda46b4be21dd675ba78fb7: ending tablet copy session ca9fbbc2c0a94897897d502d42f3951f-c3c06f5564ed4c259ca5c238c3faf2a3 on tablet c3c06f5564ed4c259ca5c238c3faf2a3 with peer ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:09:49.653263 14859 ts_tablet_manager.cc:1434] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:09:49.660076 13847 tablet_copy_service.cc:342] P 96701a74fdee481fb5f54aac841e17dd: Request end of tablet copy session ca9fbbc2c0a94897897d502d42f3951f-cad007c01ddb46db81e7206ec8b58024 received from {username='slave'} at 127.0.0.1:35422
I20260709 12:09:49.660580 13847 tablet_copy_service.cc:434] P 96701a74fdee481fb5f54aac841e17dd: ending tablet copy session ca9fbbc2c0a94897897d502d42f3951f-cad007c01ddb46db81e7206ec8b58024 on tablet cad007c01ddb46db81e7206ec8b58024 with peer ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:09:49.713128 14412 raft_consensus.cc:1217] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:49.758394 13758 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "107415ab6e76484890fa8115e8832a21"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:09:49.759212 13758 raft_consensus.cc:606] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:09:49.770685 14414 raft_consensus.cc:1217] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:49.777683 14412 raft_consensus.cc:1217] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:49.798198 13755 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:09:49.798830 13755 raft_consensus.cc:606] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:09:49.804549 14412 raft_consensus.cc:1217] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:49.831401 13683 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8195765ed074b74be387475c214120b"
dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
mode: GRACEFUL
new_leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
 from {username='slave'} at 127.0.0.1:58734
I20260709 12:09:49.832038 13683 raft_consensus.cc:606] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Received request to transfer leadership to TS ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:09:49.837857 13758 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e5274c30729744338992e7c7710e5266"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:09:49.838492 13758 raft_consensus.cc:606] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:09:49.842272 13758 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1494f6353074242857c7901c21da06d"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:09:49.842794 13758 raft_consensus.cc:606] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:09:49.845606 13758 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:09:49.846411 13758 raft_consensus.cc:606] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Received request to transfer leadership to TS ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:09:49.847719 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:09:49.849447 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:49.850656 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:49.901160 14735 raft_consensus.cc:993] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7: : Instructing follower 96701a74fdee481fb5f54aac841e17dd to start an election
I20260709 12:09:49.901822 14735 raft_consensus.cc:1081] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Signalling peer 96701a74fdee481fb5f54aac841e17dd to start an election
I20260709 12:09:49.905992 13832 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f1494f6353074242857c7901c21da06d"
dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:54820
I20260709 12:09:49.906633 13832 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:49.906970 13832 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.918247 13832 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:49.920506 13832 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:49.921342 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:09:49.922122 13683 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.921499 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:09:49.922892 13755 raft_consensus.cc:3055] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:49.923213 13755 raft_consensus.cc:740] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:09:49.923933 13755 consensus_queue.cc:260] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:49.925150 13755 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.931143 13683 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 2.
I20260709 12:09:49.933034 13800 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:09:49.934414 14850 raft_consensus.cc:2804] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:49.934942 14850 raft_consensus.cc:697] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 2 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:09:49.935830 14850 consensus_queue.cc:237] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:49.938651 13755 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 2.
I20260709 12:09:49.956535 13584 catalog_manager.cc:5697] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 1 to 2, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 2 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:50.041492 14735 raft_consensus.cc:993] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7: : Instructing follower 96701a74fdee481fb5f54aac841e17dd to start an election
I20260709 12:09:50.042204 14735 raft_consensus.cc:1081] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Signalling peer 96701a74fdee481fb5f54aac841e17dd to start an election
I20260709 12:09:50.044411 13832 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379"
dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:54820
I20260709 12:09:50.045253 13832 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:50.045823 13832 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.046765 14695 raft_consensus.cc:993] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7: : Instructing follower 96701a74fdee481fb5f54aac841e17dd to start an election
I20260709 12:09:50.047350 14786 raft_consensus.cc:1081] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Signalling peer 96701a74fdee481fb5f54aac841e17dd to start an election
I20260709 12:09:50.049228 14695 raft_consensus.cc:993] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7: : Instructing follower 96701a74fdee481fb5f54aac841e17dd to start an election
I20260709 12:09:50.049729 14695 raft_consensus.cc:1081] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Signalling peer 96701a74fdee481fb5f54aac841e17dd to start an election
I20260709 12:09:50.051976 13836 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "107415ab6e76484890fa8115e8832a21"
dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:54820
I20260709 12:09:50.052014 13829 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e5274c30729744338992e7c7710e5266"
dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:54820
I20260709 12:09:50.052639 13836 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:50.052708 13829 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:50.053164 13836 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.053287 13829 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.060590 13832 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:50.066390 13829 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:50.068563 13829 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:50.068488 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:09:50.069298 13755 raft_consensus.cc:3055] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:50.069669 13755 raft_consensus.cc:740] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:09:50.070633 13755 consensus_queue.cc:260] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:50.071767 13755 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.074259 13836 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:50.076376 13836 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:50.078321 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:09:50.079020 13756 raft_consensus.cc:3055] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:50.079361 13756 raft_consensus.cc:740] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:09:50.078536 13832 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:50.080142 13756 consensus_queue.cc:260] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:50.082640 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:09:50.083163 13756 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.083357 13683 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.087536 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:09:50.088238 13681 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.090332 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:09:50.091043 13682 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.095975 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:09:50.096693 13761 raft_consensus.cc:3055] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:50.097052 13761 raft_consensus.cc:740] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:09:50.097930 13761 consensus_queue.cc:260] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:50.099318 13761 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.099814 13681 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 2.
I20260709 12:09:50.104686 13682 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 2.
I20260709 12:09:50.105175 14695 raft_consensus.cc:993] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7: : Instructing follower ca9fbbc2c0a94897897d502d42f3951f to start an election
I20260709 12:09:50.105263 13756 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 2.
I20260709 12:09:50.105875 14695 raft_consensus.cc:1081] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Signalling peer ca9fbbc2c0a94897897d502d42f3951f to start an election
I20260709 12:09:50.106577 13800 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:09:50.107707 14850 raft_consensus.cc:2804] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:50.107808 13761 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 2.
I20260709 12:09:50.108309 14850 raft_consensus.cc:697] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 2 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:09:50.108578 13683 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 2.
I20260709 12:09:50.108906 13755 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 2.
I20260709 12:09:50.110116 13800 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:09:50.111114 13800 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:09:50.112075 14806 raft_consensus.cc:2804] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:50.112421 14843 raft_consensus.cc:2804] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:50.109687 14850 consensus_queue.cc:237] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:50.115923 14843 raft_consensus.cc:697] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 2 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:09:50.119728 14843 consensus_queue.cc:237] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:50.120636 14414 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db"
dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
 from {username='slave'} at 127.0.0.1:41700
I20260709 12:09:50.121238 14414 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:50.121591 14414 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.133738 14414 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:50.148065 14853 raft_consensus.cc:993] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835: : Instructing follower ca9fbbc2c0a94897897d502d42f3951f to start an election
I20260709 12:09:50.148641 14853 raft_consensus.cc:1081] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Signalling peer ca9fbbc2c0a94897897d502d42f3951f to start an election
I20260709 12:09:50.153748 14416 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c8195765ed074b74be387475c214120b"
dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
 from {username='slave'} at 127.0.0.1:41688
I20260709 12:09:50.154399 14416 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:50.154858 14416 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.175814 14875 raft_consensus.cc:1064] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd: attempting to promote NON_VOTER ca9fbbc2c0a94897897d502d42f3951f to VOTER
I20260709 12:09:50.179462 14875 consensus_queue.cc:237] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:50.181182 14805 raft_consensus.cc:1064] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835: attempting to promote NON_VOTER ca9fbbc2c0a94897897d502d42f3951f to VOTER
I20260709 12:09:50.208231 14805 consensus_queue.cc:237] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:50.192555 13584 catalog_manager.cc:5697] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 1 to 2, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 2 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:50.242291 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:09:50.243212 13761 raft_consensus.cc:3055] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:50.243794 13761 raft_consensus.cc:740] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:09:50.244801 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:09:50.244701 13761 consensus_queue.cc:260] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:50.245396 13829 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.247852 13761 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.252076 14786 raft_consensus.cc:1064] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7: attempting to promote NON_VOTER ca9fbbc2c0a94897897d502d42f3951f to VOTER
I20260709 12:09:50.255864 14786 consensus_queue.cc:237] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:50.256444 13829 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 2.
I20260709 12:09:50.258685 14380 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:09:50.260080 14863 raft_consensus.cc:2804] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:50.244926 14414 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:50.264915 14806 raft_consensus.cc:697] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 2 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:09:50.266485 14806 consensus_queue.cc:237] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:50.274472 13761 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 2.
I20260709 12:09:50.290288 14416 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:50.306035 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:09:50.306797 13682 raft_consensus.cc:3055] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:50.306756 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:09:50.307382 13682 raft_consensus.cc:740] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:09:50.307631 13761 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.308447 13682 consensus_queue.cc:260] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:50.309731 13682 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.316715 13761 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 2.
I20260709 12:09:50.323553 14379 leader_election.cc:304] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:09:50.305032 14416 leader_election.cc:290] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:50.318579 13682 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 2.
I20260709 12:09:50.318931 14735 raft_consensus.cc:1064] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7: attempting to promote NON_VOTER ca9fbbc2c0a94897897d502d42f3951f to VOTER
I20260709 12:09:50.332607 14735 consensus_queue.cc:237] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:50.325481 14863 raft_consensus.cc:697] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 2 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:09:50.356374 13832 raft_consensus.cc:1275] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:50.355685 14863 consensus_queue.cc:237] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:50.362829 14886 raft_consensus.cc:2804] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:50.365334 14416 raft_consensus.cc:1275] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:50.366827 14414 raft_consensus.cc:1275] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:50.392874 14886 raft_consensus.cc:697] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 2 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:09:50.393419 14414 raft_consensus.cc:1275] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:50.397961 14695 consensus_queue.cc:1048] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:50.402791 13682 raft_consensus.cc:1275] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:50.406409 13832 raft_consensus.cc:1275] T 625e9b5c2aa14658af58496a21f9ee8b P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:50.409373 14695 consensus_queue.cc:1048] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:50.438117 14882 consensus_queue.cc:1048] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 12:09:50.441352 13683 raft_consensus.cc:1275] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:50.442014 14845 consensus_queue.cc:1048] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 12:09:50.444916 14786 consensus_queue.cc:1048] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:50.451974 13829 raft_consensus.cc:1275] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:50.455555 14679 consensus_queue.cc:1048] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:50.446198 14886 consensus_queue.cc:237] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:50.464735 13584 catalog_manager.cc:5697] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 1 to 2, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 2 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:50.470486 13584 catalog_manager.cc:5697] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 1 to 2, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 2 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:50.491698 14413 raft_consensus.cc:1275] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:50.446326 14875 consensus_queue.cc:1048] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 12:09:50.495764 14679 consensus_queue.cc:1048] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:09:50.490033 14887 log.cc:927] Time spent T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 12:09:50.508220 13755 raft_consensus.cc:1275] T cad007c01ddb46db81e7206ec8b58024 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:50.509596 13761 raft_consensus.cc:1275] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:50.513109 14806 consensus_queue.cc:1048] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:50.516629 14843 consensus_queue.cc:1048] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:09:50.602276 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 71770.4us
W20260709 12:09:50.681176 14894 log.cc:927] Time spent T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:09:50.771478 13584 catalog_manager.cc:5697] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 1 to 2, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 2 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:50.773224 13584 catalog_manager.cc:5697] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 1 to 2, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 2 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:50.777959 14905 raft_consensus.cc:2955] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:50.788618 13761 raft_consensus.cc:1275] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:50.798111 14695 raft_consensus.cc:2955] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:50.803956 14903 raft_consensus.cc:2955] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:50.794466 13832 raft_consensus.cc:2955] T 625e9b5c2aa14658af58496a21f9ee8b P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:50.806609 14413 raft_consensus.cc:2955] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:50.824990 14875 consensus_queue.cc:1048] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:50.843765 14413 raft_consensus.cc:2955] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:50.853744 13586 catalog_manager.cc:5697] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:50.868957 13756 raft_consensus.cc:1275] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:50.860688 13830 raft_consensus.cc:2955] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:50.872378 13583 catalog_manager.cc:5697] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 reported cstate change: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:50.875654 14413 raft_consensus.cc:2955] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:50.859537 13761 raft_consensus.cc:1275] T 277b655b7311432a95ed2ad291df0b8d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:50.864180 13828 raft_consensus.cc:2955] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:50.865908 13585 catalog_manager.cc:5697] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:50.891458 13681 consensus_queue.cc:237] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:50.902062 13682 raft_consensus.cc:1275] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:50.907513 13761 raft_consensus.cc:1275] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:50.908890 13683 raft_consensus.cc:1275] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:50.911356 13682 raft_consensus.cc:1275] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:50.911857 14886 consensus_queue.cc:1048] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:50.924197 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:50.924201 14413 raft_consensus.cc:1275] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:50.944914 13681 raft_consensus.cc:1275] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:50.944788 14909 raft_consensus.cc:2955] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:50.954491 13681 raft_consensus.cc:1275] T c3c06f5564ed4c259ca5c238c3faf2a3 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:50.958276 14910 consensus_queue.cc:1048] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:09:50.947127 14875 consensus_queue.cc:1048] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 12:09:50.943795 14879 consensus_queue.cc:1048] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:09:50.968315 13688 raft_consensus.cc:1275] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:50.970060 13828 raft_consensus.cc:1275] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:50.978981 13756 consensus_queue.cc:237] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:50.993510 14843 consensus_queue.cc:1048] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:50.994285 14877 consensus_queue.cc:1048] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.070s
I20260709 12:09:51.009958 14735 consensus_queue.cc:1048] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:51.012852 13758 raft_consensus.cc:2955] T cad007c01ddb46db81e7206ec8b58024 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:51.056051 14679 consensus_queue.cc:1048] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:51.009228 14910 consensus_queue.cc:1048] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 12:09:51.027055 14850 consensus_queue.cc:1048] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 12:09:51.156739 13828 raft_consensus.cc:1275] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:51.162259 14886 consensus_queue.cc:1048] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
W20260709 12:09:51.272060 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 131492us
I20260709 12:09:51.254251 13688 raft_consensus.cc:2955] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
W20260709 12:09:51.339711 14919 log.cc:927] Time spent T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:09:51.380935 14679 raft_consensus.cc:2955] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
W20260709 12:09:51.393160 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 186267us
I20260709 12:09:51.406061 14414 raft_consensus.cc:2955] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:51.412736 14413 raft_consensus.cc:1275] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:51.420776 13836 raft_consensus.cc:1275] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:51.448415 14735 consensus_queue.cc:1048] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:51.450224 14735 consensus_queue.cc:1048] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:09:51.472003 14927 log.cc:927] Time spent T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:09:51.481403 13570 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 277b655b7311432a95ed2ad291df0b8d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:51.509358 14414 raft_consensus.cc:2955] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
W20260709 12:09:51.575596 14925 log.cc:927] Time spent T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 12:09:51.577900 14892 log.cc:927] Time spent T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
W20260709 12:09:51.583843 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 120670us
I20260709 12:09:51.586740 13582 catalog_manager.cc:5697] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: config changed from index 3 to 4, VOTER 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) evicted. New cstate: current_term: 1 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:51.610513 14905 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:09:51.612778 14905 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:51.615279 13585 catalog_manager.cc:5697] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd reported cstate change: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:09:51.619524 14931 log.cc:927] Time spent T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
I20260709 12:09:51.612612 13679 raft_consensus.cc:2955] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:51.631080 14905 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:51.684813 14877 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:09:51.708811 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 254464us
I20260709 12:09:51.688333 14877 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:51.734090 14877 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:09:51.722823 13761 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.013s	sys 0.007s
W20260709 12:09:51.735296 13761 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.013s	sys 0.007s
I20260709 12:09:51.750696 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:51.758584 13832 raft_consensus.cc:2955] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:51.775233 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:09:51.784245 14932 log.cc:927] Time spent T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.301s	user 0.006s	sys 0.000s
I20260709 12:09:51.877708 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:51.861187 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:51.920042 13762 raft_consensus.cc:1275] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:51.846781 14941 raft_consensus.cc:2955] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:51.975416 13727 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:09:51.986614 14410 raft_consensus.cc:2955] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
W20260709 12:09:51.991699 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 73374us
W20260709 12:09:51.994216 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 63350us
I20260709 12:09:51.994773 13836 raft_consensus.cc:2955] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:52.002074 14936 consensus_queue.cc:1048] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:09:52.009690 13651 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:09:52.000366 14933 raft_consensus.cc:2749] T 277b655b7311432a95ed2ad291df0b8d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:52.016651 14939 raft_consensus.cc:2749] T c3c06f5564ed4c259ca5c238c3faf2a3 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:52.047284 13763 raft_consensus.cc:1275] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:52.074888 14936 consensus_queue.cc:1048] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:09:52.113358 14941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:48110 (request call id 68) took 1136 ms. Trace:
I20260709 12:09:52.113937 14941 rpcz_store.cc:276] 0709 12:09:50.976726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:50.976876 (+   150us) service_pool.cc:224] Handling call
0709 12:09:50.996293 (+ 19417us) log.cc:844] Serialized 501 byte log entry
0709 12:09:51.056495 (+ 60202us) spinlock_profiling.cc:243] Waited 2.12 ms on lock 0x7b1800286780. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924ea03f3 00007fa924ea27c1 00007fa924ea2779 00007fa924ea2709 00007fa924ea26d1 00007fa924ea19cd 0000000000388634 0000000000388479 00007fa924e8383a
0709 12:09:51.150035 (+ 93540us) spinlock_profiling.cc:243] Waited 8.44 ms on lock 0x7b2c00010828. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa926886a11 00007fa926895a0a 00007fa926895693 00007fa926895631 00007fa927fc9b52 00007fa927fc9cf5 00007fa927f06691 00007fa927ee6eaa 00007fa927eedd53 00007fa927eedcd9 00007fa927eedc69
0709 12:09:51.400671 (+250636us) spinlock_profiling.cc:243] Waited 2.32 ms on lock 0x7b2c00010828. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa926886a11 00007fa926895a0a 00007fa926895693 00007fa926895631 00007fa927fc9b52 00007fa927fc9cf5 00007fa927f06691 00007fa927ee6eaa 00007fa927eedd53 00007fa927eedcd9 00007fa927eedc69
0709 12:09:51.401806 (+  1135us) spinlock_profiling.cc:243] Waited 93.6 ms on lock 0x7b18002eb960. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927fc9d01 00007fa927f06691 00007fa927ee6eaa 00007fa927eedd53 00007fa927eedcd9 00007fa927eedc69 00007fa927eedc31 00007fa927eecdfd 0000000000388634 0000000000388479
0709 12:09:52.113249 (+711443us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26078,"raft.queue_time_us":28627,"raft.run_cpu_time_us":19547,"raft.run_wall_time_us":541026,"spinlock_wait_cycles":244836352}
I20260709 12:09:52.123864 13570 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c3c06f5564ed4c259ca5c238c3faf2a3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:52.194548 13828 consensus_queue.cc:237] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:52.196895 13752 tablet_service.cc:1558] Processing DeleteTablet for tablet 277b655b7311432a95ed2ad291df0b8d with delete_type TABLET_DATA_TOMBSTONED (TS 3f37c9cc9dda46b4be21dd675ba78fb7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48110
I20260709 12:09:52.202553 13836 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a"
dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
mode: GRACEFUL
new_leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
 from {username='slave'} at 127.0.0.1:52702
I20260709 12:09:52.203227 13836 raft_consensus.cc:606] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Received request to transfer leadership to TS ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:09:52.212473 13583 catalog_manager.cc:5697] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: config changed from index 3 to 4, VOTER b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) evicted. New cstate: current_term: 1 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:52.220620 13761 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25896261d1204b3d858fb5b478a89034"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:09:52.226204 13761 raft_consensus.cc:606] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Received request to transfer leadership to TS ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:09:52.230369 13685 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb"
dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
mode: GRACEFUL
new_leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
 from {username='slave'} at 127.0.0.1:58734
I20260709 12:09:52.231016 13685 raft_consensus.cc:606] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Received request to transfer leadership to TS ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:09:52.237881 13836 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89"
dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
mode: GRACEFUL
new_leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
 from {username='slave'} at 127.0.0.1:52702
I20260709 12:09:52.238508 13836 raft_consensus.cc:606] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Received request to transfer leadership to TS 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:09:52.242173 13836 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1494f6353074242857c7901c21da06d"
dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
mode: GRACEFUL
new_leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
 from {username='slave'} at 127.0.0.1:52702
I20260709 12:09:52.242286 14963 tablet_replica.cc:333] T 277b655b7311432a95ed2ad291df0b8d P 3f37c9cc9dda46b4be21dd675ba78fb7: stopping tablet replica
I20260709 12:09:52.243166 13836 raft_consensus.cc:606] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 2 LEADER]: Received request to transfer leadership to TS 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:09:52.244273 14963 raft_consensus.cc:2243] T 277b655b7311432a95ed2ad291df0b8d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:52.245079 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:09:52.245223 14963 raft_consensus.cc:2272] T 277b655b7311432a95ed2ad291df0b8d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:52.249848 14963 ts_tablet_manager.cc:1916] T 277b655b7311432a95ed2ad291df0b8d P 3f37c9cc9dda46b4be21dd675ba78fb7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:52.260059 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:52.264875 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:52.274179 14877 raft_consensus.cc:993] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835: : Instructing follower ca9fbbc2c0a94897897d502d42f3951f to start an election
I20260709 12:09:52.274235 14963 ts_tablet_manager.cc:1929] T 277b655b7311432a95ed2ad291df0b8d P 3f37c9cc9dda46b4be21dd675ba78fb7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.2
I20260709 12:09:52.274834 14963 log.cc:1199] T 277b655b7311432a95ed2ad291df0b8d P 3f37c9cc9dda46b4be21dd675ba78fb7: Deleting WAL directory at /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894707649-12515-0/minicluster-data/ts-1-root/wals/277b655b7311432a95ed2ad291df0b8d
I20260709 12:09:52.274834 14939 raft_consensus.cc:1081] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Signalling peer ca9fbbc2c0a94897897d502d42f3951f to start an election
I20260709 12:09:52.277503 13570 catalog_manager.cc:5028] TS 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): tablet 277b655b7311432a95ed2ad291df0b8d (table test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]) successfully deleted
I20260709 12:09:52.278781 14410 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb"
dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
 from {username='slave'} at 127.0.0.1:41688
I20260709 12:09:52.279426 14410 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:52.279816 14410 raft_consensus.cc:3060] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.292065 13674 tablet_service.cc:1558] Processing DeleteTablet for tablet c3c06f5564ed4c259ca5c238c3faf2a3 with delete_type TABLET_DATA_TOMBSTONED (TS b98d2519bb504dc6905ed2ede4571835 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41682
I20260709 12:09:52.293444 13757 consensus_queue.cc:237] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:52.295831 14410 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:52.298959 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:09:52.299681 13679 raft_consensus.cc:3055] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:52.300034 13679 raft_consensus.cc:740] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:09:52.300837 13679 consensus_queue.cc:260] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:52.302510 13679 raft_consensus.cc:3060] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:09:52.314954 14962 log.cc:927] Time spent T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 12:09:52.322747 14965 tablet_replica.cc:333] T c3c06f5564ed4c259ca5c238c3faf2a3 P b98d2519bb504dc6905ed2ede4571835: stopping tablet replica
I20260709 12:09:52.327559 14965 raft_consensus.cc:2243] T c3c06f5564ed4c259ca5c238c3faf2a3 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:52.332793 14412 raft_consensus.cc:1275] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:52.333297 14965 raft_consensus.cc:2272] T c3c06f5564ed4c259ca5c238c3faf2a3 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:52.334216 14410 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:52.335882 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:09:52.348296 13828 raft_consensus.cc:3060] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.349999 13688 raft_consensus.cc:1275] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:52.336576 14959 consensus_queue.cc:1048] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:52.353463 14965 ts_tablet_manager.cc:1916] T c3c06f5564ed4c259ca5c238c3faf2a3 P b98d2519bb504dc6905ed2ede4571835: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:52.368471 14882 raft_consensus.cc:2955] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:52.379813 14410 raft_consensus.cc:2955] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:52.381326 14957 consensus_queue.cc:1048] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:52.390929 13571 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cad007c01ddb46db81e7206ec8b58024 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:52.396052 14965 ts_tablet_manager.cc:1929] T c3c06f5564ed4c259ca5c238c3faf2a3 P b98d2519bb504dc6905ed2ede4571835: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.2
I20260709 12:09:52.396673 14965 log.cc:1199] T c3c06f5564ed4c259ca5c238c3faf2a3 P b98d2519bb504dc6905ed2ede4571835: Deleting WAL directory at /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894707649-12515-0/minicluster-data/ts-0-root/wals/c3c06f5564ed4c259ca5c238c3faf2a3
I20260709 12:09:52.399374 13570 catalog_manager.cc:5028] TS b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): tablet c3c06f5564ed4c259ca5c238c3faf2a3 (table test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]) successfully deleted
I20260709 12:09:52.339185 13679 raft_consensus.cc:2468] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 2.
I20260709 12:09:52.400981 14379 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:09:52.402671 14886 raft_consensus.cc:2804] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:52.403345 14886 raft_consensus.cc:697] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 2 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:09:52.404366 14886 consensus_queue.cc:237] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:52.411525 13688 raft_consensus.cc:2955] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:52.419286 14410 raft_consensus.cc:1275] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:52.430806 13828 raft_consensus.cc:2468] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 2.
I20260709 12:09:52.444044 13582 catalog_manager.cc:5697] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: config changed from index 3 to 4, VOTER 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) evicted. New cstate: current_term: 1 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:52.445546 14893 consensus_queue.cc:1048] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:52.460040 14960 raft_consensus.cc:993] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd: : Instructing follower 3f37c9cc9dda46b4be21dd675ba78fb7 to start an election
I20260709 12:09:52.462848 14882 raft_consensus.cc:1081] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Signalling peer 3f37c9cc9dda46b4be21dd675ba78fb7 to start an election
I20260709 12:09:52.465451 13762 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
 from {username='slave'} at 127.0.0.1:48120
I20260709 12:09:52.466245 13762 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:52.467132 13762 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.487607 13762 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:52.491639 13762 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:52.493418 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:09:52.494895 13836 raft_consensus.cc:3055] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:52.495209 13836 raft_consensus.cc:740] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:09:52.495959 13836 consensus_queue.cc:260] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:52.497388 13836 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.499112 13687 raft_consensus.cc:1275] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:52.508262 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:09:52.509426 13683 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.510071 14941 consensus_queue.cc:1048] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:52.514204 14928 raft_consensus.cc:993] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7: : Instructing follower ca9fbbc2c0a94897897d502d42f3951f to start an election
I20260709 12:09:52.514816 14928 raft_consensus.cc:1081] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Signalling peer ca9fbbc2c0a94897897d502d42f3951f to start an election
I20260709 12:09:52.517751 14410 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "25896261d1204b3d858fb5b478a89034"
dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
 from {username='slave'} at 127.0.0.1:41700
I20260709 12:09:52.518530 14410 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:52.518913 14410 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.523133 13836 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 2.
I20260709 12:09:52.524308 13727 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:09:52.528051 14941 raft_consensus.cc:2804] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:52.530207 14941 raft_consensus.cc:697] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:09:52.539563 13752 tablet_service.cc:1558] Processing DeleteTablet for tablet cad007c01ddb46db81e7206ec8b58024 with delete_type TABLET_DATA_TOMBSTONED (TS 3f37c9cc9dda46b4be21dd675ba78fb7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48110
I20260709 12:09:52.540738 14963 tablet_replica.cc:333] T cad007c01ddb46db81e7206ec8b58024 P 3f37c9cc9dda46b4be21dd675ba78fb7: stopping tablet replica
I20260709 12:09:52.541895 14963 raft_consensus.cc:2243] T cad007c01ddb46db81e7206ec8b58024 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:52.542917 14963 raft_consensus.cc:2272] T cad007c01ddb46db81e7206ec8b58024 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:52.546079 14963 ts_tablet_manager.cc:1916] T cad007c01ddb46db81e7206ec8b58024 P 3f37c9cc9dda46b4be21dd675ba78fb7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:52.539954 14941 consensus_queue.cc:237] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:52.557127 14960 raft_consensus.cc:993] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd: : Instructing follower ca9fbbc2c0a94897897d502d42f3951f to start an election
I20260709 12:09:52.561137 14882 raft_consensus.cc:1081] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Signalling peer ca9fbbc2c0a94897897d502d42f3951f to start an election
I20260709 12:09:52.563625 14412 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a"
dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
 from {username='slave'} at 127.0.0.1:41692
I20260709 12:09:52.564400 14412 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:52.564888 14412 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.563961 14889 raft_consensus.cc:2955] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:52.588546 13683 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 2.
I20260709 12:09:52.592176 14414 raft_consensus.cc:2955] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:52.610893 13583 catalog_manager.cc:5697] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 1 to 2, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 2 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:52.633487 14883 raft_consensus.cc:993] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd: : Instructing follower 3f37c9cc9dda46b4be21dd675ba78fb7 to start an election
I20260709 12:09:52.585425 14412 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:52.670876 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:09:52.847514 13763 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:09:52.824570 14968 log.cc:927] Time spent T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.145s	user 0.002s	sys 0.005s
I20260709 12:09:52.826275 14412 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:52.659802 14960 raft_consensus.cc:1081] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 2 LEADER]: Signalling peer 3f37c9cc9dda46b4be21dd675ba78fb7 to start an election
I20260709 12:09:52.842759 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:09:52.858775 13828 raft_consensus.cc:3055] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:52.859328 13828 raft_consensus.cc:740] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:09:52.860605 13828 consensus_queue.cc:260] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:52.862288 13763 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 2.
I20260709 12:09:52.644009 14410 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:52.862351 13828 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.877455 13762 raft_consensus.cc:1240] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:52.843966 14963 ts_tablet_manager.cc:1929] T cad007c01ddb46db81e7206ec8b58024 P 3f37c9cc9dda46b4be21dd675ba78fb7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:52.879662 14963 log.cc:1199] T cad007c01ddb46db81e7206ec8b58024 P 3f37c9cc9dda46b4be21dd675ba78fb7: Deleting WAL directory at /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894707649-12515-0/minicluster-data/ts-1-root/wals/cad007c01ddb46db81e7206ec8b58024
I20260709 12:09:52.880765 14410 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:52.884783 13762 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f1494f6353074242857c7901c21da06d"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
 from {username='slave'} at 127.0.0.1:48120
I20260709 12:09:52.885905 13762 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:52.886624 13762 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:52.898016 13570 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 625e9b5c2aa14658af58496a21f9ee8b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:52.915235 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:09:52.915946 13831 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.930507 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:09:52.931393 13757 raft_consensus.cc:3055] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:52.931838 13757 raft_consensus.cc:740] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:09:52.929611 14379 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:09:52.935405 14974 raft_consensus.cc:2804] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:52.937354 14974 raft_consensus.cc:697] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 2 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:09:52.938566 13828 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 2.
I20260709 12:09:52.938930 14974 consensus_queue.cc:237] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:52.899775 13570 catalog_manager.cc:5028] TS 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): tablet cad007c01ddb46db81e7206ec8b58024 (table test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]) successfully deleted
W20260709 12:09:52.946983 13570 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 47221.8us
I20260709 12:09:52.947607 13582 catalog_manager.cc:5697] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 1 to 2, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 2 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:52.956077 13757 consensus_queue.cc:260] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:53.007355 13688 raft_consensus.cc:2955] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:53.012878 13831 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 2.
I20260709 12:09:53.015750 13757 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:09:53.064409 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 78482.2us
I20260709 12:09:53.154876 13831 raft_consensus.cc:1275] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:53.157498 14380 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:09:53.158486 14936 raft_consensus.cc:2804] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:53.159034 14936 raft_consensus.cc:697] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 2 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:09:53.158568 13762 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:53.159973 14936 consensus_queue.cc:237] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:53.161290 13762 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:53.179416 13757 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 2.
I20260709 12:09:53.204617 13582 catalog_manager.cc:5697] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 reported cstate change: config changed from index 3 to 4, VOTER 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) evicted. New cstate: current_term: 1 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:53.209151 13831 raft_consensus.cc:1240] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:53.233435 14969 consensus_queue.cc:1048] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:09:53.306298 13830 raft_consensus.cc:1275] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:09:53.336862 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 95375.7us
I20260709 12:09:53.329587 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:09:53.339664 14695 consensus_queue.cc:1048] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:53.339087 13828 raft_consensus.cc:3055] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:53.344632 13828 raft_consensus.cc:740] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:09:53.345541 13828 consensus_queue.cc:260] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:53.350582 13828 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:09:53.363188 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 104773us
I20260709 12:09:53.372848 13763 raft_consensus.cc:1240] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:53.393119 13683 raft_consensus.cc:1275] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:53.409199 13824 tablet_service.cc:1558] Processing DeleteTablet for tablet 625e9b5c2aa14658af58496a21f9ee8b with delete_type TABLET_DATA_TOMBSTONED (TS 96701a74fdee481fb5f54aac841e17dd not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54808
I20260709 12:09:53.401495 13583 catalog_manager.cc:5697] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 1 to 2, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 2 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:53.425526 13828 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 3.
I20260709 12:09:53.430696 13727 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:09:53.431948 14906 raft_consensus.cc:2804] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:53.432693 14906 raft_consensus.cc:697] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:09:53.433904 14906 consensus_queue.cc:237] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:09:53.440917 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 185105us
I20260709 12:09:53.443037 14969 consensus_queue.cc:1048] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:53.454192 14987 tablet_replica.cc:333] T 625e9b5c2aa14658af58496a21f9ee8b P 96701a74fdee481fb5f54aac841e17dd: stopping tablet replica
I20260709 12:09:53.468204 14987 raft_consensus.cc:2243] T 625e9b5c2aa14658af58496a21f9ee8b P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:53.475538 14987 raft_consensus.cc:2272] T 625e9b5c2aa14658af58496a21f9ee8b P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:53.481563 13756 raft_consensus.cc:1275] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:53.501919 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:09:53.510299 13679 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:53.510790 14973 consensus_queue.cc:1048] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:53.520274 13681 raft_consensus.cc:1275] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:09:53.520818 14930 raft_consensus.cc:670] T 625e9b5c2aa14658af58496a21f9ee8b P 96701a74fdee481fb5f54aac841e17dd: failed to trigger leader election: Illegal state: RaftConsensus is not running: State = Stopped
I20260709 12:09:53.530735 13835 raft_consensus.cc:1275] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:53.535323 14973 consensus_queue.cc:1048] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:53.543363 14987 ts_tablet_manager.cc:1916] T 625e9b5c2aa14658af58496a21f9ee8b P 96701a74fdee481fb5f54aac841e17dd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:53.572059 14981 consensus_queue.cc:1048] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:53.586652 13679 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 3.
I20260709 12:09:53.597226 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:53.647621 13582 catalog_manager.cc:5697] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 2 to 3, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 3 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:53.702003 14987 ts_tablet_manager.cc:1929] T 625e9b5c2aa14658af58496a21f9ee8b P 96701a74fdee481fb5f54aac841e17dd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:53.702677 14987 log.cc:1199] T 625e9b5c2aa14658af58496a21f9ee8b P 96701a74fdee481fb5f54aac841e17dd: Deleting WAL directory at /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894707649-12515-0/minicluster-data/ts-2-root/wals/625e9b5c2aa14658af58496a21f9ee8b
I20260709 12:09:53.706394 13583 catalog_manager.cc:5697] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 1 to 2, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 2 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:53.708949 13571 catalog_manager.cc:5028] TS 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): tablet 625e9b5c2aa14658af58496a21f9ee8b (table test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]) successfully deleted
I20260709 12:09:53.726501 13831 raft_consensus.cc:1275] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:53.730087 14936 consensus_queue.cc:1048] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:53.744482 13756 raft_consensus.cc:1275] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:53.755283 13679 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac"
dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
mode: GRACEFUL
new_leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
 from {username='slave'} at 127.0.0.1:58734
I20260709 12:09:53.756098 13679 raft_consensus.cc:606] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Received request to transfer leadership to TS 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:09:53.756589 14936 consensus_queue.cc:1048] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:53.761699 13679 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765"
dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:58734
I20260709 12:09:53.762540 13679 raft_consensus.cc:606] T 1e31cd7111f2470d8d34b5898dce5765 P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:09:53.767477 13679 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773"
dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
mode: GRACEFUL
new_leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
 from {username='slave'} at 127.0.0.1:58734
I20260709 12:09:53.776041 13679 raft_consensus.cc:606] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 2 LEADER]: Received request to transfer leadership to TS 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:09:53.780715 13761 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e229ea1f19c74be5884179acde106305"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:09:53.781337 13761 raft_consensus.cc:606] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Received request to transfer leadership to TS ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:09:53.785070 13761 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1494f6353074242857c7901c21da06d"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:09:53.785691 13761 raft_consensus.cc:606] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 LEADER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:09:53.786962 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:09:53.789312 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:53.838814 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:53.863445 14877 raft_consensus.cc:993] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835: : Instructing follower 3f37c9cc9dda46b4be21dd675ba78fb7 to start an election
I20260709 12:09:53.864079 14877 raft_consensus.cc:1081] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 2 LEADER]: Signalling peer 3f37c9cc9dda46b4be21dd675ba78fb7 to start an election
I20260709 12:09:53.866436 13756 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
 from {username='slave'} at 127.0.0.1:48114
I20260709 12:09:53.867172 13756 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:53.867550 13756 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:53.874697 13756 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:53.876618 13756 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:53.877478 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:09:53.877835 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:09:53.878398 13679 raft_consensus.cc:3055] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:53.878592 13828 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:53.878949 13679 raft_consensus.cc:740] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:09:53.879855 13679 consensus_queue.cc:260] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:53.881042 13679 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:53.886978 13679 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 3.
I20260709 12:09:53.888334 13726 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:09:53.888656 13828 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 3.
I20260709 12:09:53.889104 14928 raft_consensus.cc:2804] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:53.889940 14928 raft_consensus.cc:697] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:09:53.891218 14928 consensus_queue.cc:237] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:53.911242 13582 catalog_manager.cc:5697] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 2 to 3, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 3 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:53.964339 13683 raft_consensus.cc:1275] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:53.966091 14928 consensus_queue.cc:1048] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:53.987870 13828 raft_consensus.cc:1275] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:53.990234 14928 consensus_queue.cc:1048] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:54.014727 14941 raft_consensus.cc:993] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7: : Instructing follower 96701a74fdee481fb5f54aac841e17dd to start an election
I20260709 12:09:54.015244 14941 raft_consensus.cc:1081] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 LEADER]: Signalling peer 96701a74fdee481fb5f54aac841e17dd to start an election
I20260709 12:09:54.019289 14983 raft_consensus.cc:993] T 1e31cd7111f2470d8d34b5898dce5765 P b98d2519bb504dc6905ed2ede4571835: : Instructing follower 96701a74fdee481fb5f54aac841e17dd to start an election
I20260709 12:09:54.020020 14939 raft_consensus.cc:1081] T 1e31cd7111f2470d8d34b5898dce5765 P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Signalling peer 96701a74fdee481fb5f54aac841e17dd to start an election
I20260709 12:09:54.022044 13835 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765"
dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:54830
I20260709 12:09:54.022656 13835 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:54.023116 13835 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.024233 13828 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f1494f6353074242857c7901c21da06d"
dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:54820
I20260709 12:09:54.024780 13828 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:54.025121 13828 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:54.034942 13828 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:54.036361 13835 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:54.037575 13828 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:54.038509 13835 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:54.040690 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:09:54.041399 13761 raft_consensus.cc:3055] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:54.041730 13761 raft_consensus.cc:740] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:09:54.042857 13761 consensus_queue.cc:260] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:54.044420 13761 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:54.044950 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:09:54.045580 13756 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.047912 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:09:54.048581 13679 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:54.056245 13761 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 4.
I20260709 12:09:54.058099 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:09:54.058871 13683 raft_consensus.cc:3055] T 1e31cd7111f2470d8d34b5898dce5765 P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:54.059175 13683 raft_consensus.cc:740] T 1e31cd7111f2470d8d34b5898dce5765 P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:09:54.060005 13683 consensus_queue.cc:260] T 1e31cd7111f2470d8d34b5898dce5765 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:54.061259 13683 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.061519 14939 raft_consensus.cc:993] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835: : Instructing follower 3f37c9cc9dda46b4be21dd675ba78fb7 to start an election
I20260709 12:09:54.057914 13679 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 4.
I20260709 12:09:54.062914 13756 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 2.
I20260709 12:09:54.063230 13800 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:09:54.064738 13800 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:09:54.064795 14882 raft_consensus.cc:2804] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:54.065318 14877 raft_consensus.cc:1081] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Signalling peer 3f37c9cc9dda46b4be21dd675ba78fb7 to start an election
I20260709 12:09:54.065430 14882 raft_consensus.cc:697] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 4 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:09:54.066406 14882 consensus_queue.cc:237] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:54.067348 13756 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
 from {username='slave'} at 127.0.0.1:48114
I20260709 12:09:54.068239 13756 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:54.068667 13756 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.069165 13683 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 2.
I20260709 12:09:54.071409 14930 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:54.071936 14930 raft_consensus.cc:697] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 2 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:09:54.072784 14930 consensus_queue.cc:237] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:54.079006 13586 catalog_manager.cc:5697] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 3 to 4, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 4 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:54.081634 13756 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:54.085202 13756 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:54.085686 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:09:54.086413 13835 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.086627 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:09:54.087368 13683 raft_consensus.cc:3055] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:54.087574 13683 raft_consensus.cc:740] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:09:54.088339 13683 consensus_queue.cc:260] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:54.089677 13683 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.094831 13683 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 2.
I20260709 12:09:54.094887 13835 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 2.
I20260709 12:09:54.096019 13726 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:09:54.096963 14695 raft_consensus.cc:2804] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:54.097420 14695 raft_consensus.cc:697] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:09:54.099090 14695 consensus_queue.cc:237] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:54.100955 13586 catalog_manager.cc:5697] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 1 to 2, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 2 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:54.115953 13582 catalog_manager.cc:5697] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 1 to 2, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 2 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:54.184110 14928 raft_consensus.cc:993] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7: : Instructing follower ca9fbbc2c0a94897897d502d42f3951f to start an election
I20260709 12:09:54.184916 14928 raft_consensus.cc:1081] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Signalling peer ca9fbbc2c0a94897897d502d42f3951f to start an election
I20260709 12:09:54.187346 14410 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e229ea1f19c74be5884179acde106305"
dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
 from {username='slave'} at 127.0.0.1:41700
I20260709 12:09:54.188024 14410 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:54.188663 14410 raft_consensus.cc:3060] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.196815 14410 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:54.200007 14410 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199)
I20260709 12:09:54.202167 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:09:54.202934 13683 raft_consensus.cc:3060] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.203769 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:09:54.204526 13756 raft_consensus.cc:3055] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:54.204813 13756 raft_consensus.cc:740] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:09:54.205853 13756 consensus_queue.cc:260] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:54.206947 13756 raft_consensus.cc:3060] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.211695 13683 raft_consensus.cc:2468] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 2.
I20260709 12:09:54.213310 14379 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:09:54.214459 14936 raft_consensus.cc:2804] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:54.215070 14936 raft_consensus.cc:697] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 2 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:09:54.216264 13756 raft_consensus.cc:2468] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 2.
I20260709 12:09:54.215907 14936 consensus_queue.cc:237] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:54.228663 13582 catalog_manager.cc:5697] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 1 to 2, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 2 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:54.351928 13683 raft_consensus.cc:1275] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:54.353672 14928 consensus_queue.cc:1048] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:54.364423 13828 raft_consensus.cc:1275] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:54.372200 14928 consensus_queue.cc:1048] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:54.458873 13679 raft_consensus.cc:1275] T 1e31cd7111f2470d8d34b5898dce5765 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:54.460841 14930 consensus_queue.cc:1048] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:54.476555 13756 raft_consensus.cc:1275] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:54.481226 13828 consensus_queue.cc:237] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
W20260709 12:09:54.491753 13801 consensus_peers.cc:597] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd -> Peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Couldn't send request to peer ca9fbbc2c0a94897897d502d42f3951f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1e31cd7111f2470d8d34b5898dce5765. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:54.497610 13756 raft_consensus.cc:1275] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:54.498873 13680 raft_consensus.cc:1275] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:54.500001 14883 consensus_queue.cc:1048] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:54.501134 13684 raft_consensus.cc:1275] T 1e31cd7111f2470d8d34b5898dce5765 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:54.502698 13679 raft_consensus.cc:1275] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:54.503608 14882 consensus_queue.cc:1048] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:54.507169 14883 consensus_queue.cc:1048] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:54.507290 14981 consensus_queue.cc:1048] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:54.527855 14882 raft_consensus.cc:2955] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:54.533711 13761 raft_consensus.cc:1275] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:54.533550 13828 raft_consensus.cc:1275] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:54.538252 14928 consensus_queue.cc:1048] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:54.543411 14957 consensus_queue.cc:1048] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:54.552995 13679 raft_consensus.cc:2955] T 1e31cd7111f2470d8d34b5898dce5765 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:54.555421 13687 consensus_queue.cc:237] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:54.559513 13755 raft_consensus.cc:2955] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:54.583487 13828 raft_consensus.cc:1275] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:54.587038 14977 consensus_queue.cc:1048] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:09:54.595158 13652 consensus_peers.cc:597] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 -> Peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Couldn't send request to peer ca9fbbc2c0a94897897d502d42f3951f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c95811190f014949bb25448e8db1040e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:54.592667 13582 catalog_manager.cc:5697] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd reported cstate change: config changed from index -1 to 3, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New cstate: current_term: 2 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:54.600275 13756 raft_consensus.cc:1275] T c95811190f014949bb25448e8db1040e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:54.603677 14877 consensus_queue.cc:1048] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:54.626932 15021 raft_consensus.cc:2955] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:54.629958 13835 raft_consensus.cc:2955] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:54.630442 13756 raft_consensus.cc:2955] T c95811190f014949bb25448e8db1040e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:54.653546 13586 catalog_manager.cc:5697] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd reported cstate change: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New cstate: current_term: 1 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:54.671747 13756 consensus_queue.cc:237] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:54.687090 13680 raft_consensus.cc:1275] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:54.687090 13835 raft_consensus.cc:1275] T c89d2a3019c74941a4f8dffc9aa5cf40 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:54.687312 13727 consensus_peers.cc:597] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Couldn't send request to peer ca9fbbc2c0a94897897d502d42f3951f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c89d2a3019c74941a4f8dffc9aa5cf40. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:54.688987 15018 consensus_queue.cc:1048] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:54.690024 15019 consensus_queue.cc:1048] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:54.701018 15018 raft_consensus.cc:2955] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:54.704989 13837 raft_consensus.cc:2955] T c89d2a3019c74941a4f8dffc9aa5cf40 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:54.710376 13680 raft_consensus.cc:2955] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:54.734280 13586 catalog_manager.cc:5697] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New cstate: current_term: 1 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:54.742014 13680 consensus_queue.cc:237] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:54.752534 13687 raft_consensus.cc:1275] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:54.754325 15009 consensus_queue.cc:1048] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:54.757230 13828 raft_consensus.cc:1275] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:54.759193 13652 consensus_peers.cc:597] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 -> Peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Couldn't send request to peer ca9fbbc2c0a94897897d502d42f3951f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a34b21ec197b4241a780a8ae562e4602. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:54.759655 13756 raft_consensus.cc:1275] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:54.764757 15024 consensus_queue.cc:1048] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:54.765717 15021 consensus_queue.cc:1048] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:54.785903 13755 raft_consensus.cc:1275] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:54.791244 14974 consensus_queue.cc:1048] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:54.791270 15021 raft_consensus.cc:2955] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:54.793530 13756 raft_consensus.cc:2955] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:54.797138 13837 raft_consensus.cc:2955] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:54.823403 13583 catalog_manager.cc:5697] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd reported cstate change: config changed from index -1 to 2, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New cstate: current_term: 1 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:09:54.947553 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:55.009076 13680 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae"
dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
mode: GRACEFUL
new_leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
 from {username='slave'} at 127.0.0.1:58734
I20260709 12:09:55.009694 13680 raft_consensus.cc:606] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Received request to transfer leadership to TS 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:09:55.013561 13755 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:09:55.014194 13755 raft_consensus.cc:606] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Received request to transfer leadership to TS ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:09:55.017380 13755 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:09:55.017970 13755 raft_consensus.cc:606] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 LEADER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:09:55.021343 13828 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1494f6353074242857c7901c21da06d"
dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
mode: GRACEFUL
new_leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
 from {username='slave'} at 127.0.0.1:52702
I20260709 12:09:55.021994 13828 raft_consensus.cc:606] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 4 LEADER]: Received request to transfer leadership to TS 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:09:55.024935 13828 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08"
dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
mode: GRACEFUL
new_leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
 from {username='slave'} at 127.0.0.1:52702
I20260709 12:09:55.025671 13828 raft_consensus.cc:606] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Received request to transfer leadership to TS ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:09:55.027441 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:09:55.034096 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:55.035141 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:55.130838 15035 ts_tablet_manager.cc:933] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f: Initiating tablet copy from peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199)
I20260709 12:09:55.155121 15037 ts_tablet_manager.cc:933] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f: Initiating tablet copy from peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:55.162268 14928 raft_consensus.cc:993] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7: : Instructing follower ca9fbbc2c0a94897897d502d42f3951f to start an election
I20260709 12:09:55.162926 14928 raft_consensus.cc:1081] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Signalling peer ca9fbbc2c0a94897897d502d42f3951f to start an election
I20260709 12:09:55.165251 14414 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b"
dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
 from {username='slave'} at 127.0.0.1:41700
I20260709 12:09:55.166006 14414 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:55.166358 14414 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.171295 15037 tablet_copy_client.cc:323] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Beginning tablet copy session from remote peer at address 127.12.56.195:36603
I20260709 12:09:55.173384 13847 tablet_copy_service.cc:140] P 96701a74fdee481fb5f54aac841e17dd: Received BeginTabletCopySession request for tablet 1e31cd7111f2470d8d34b5898dce5765 from peer ca9fbbc2c0a94897897d502d42f3951f ({username='slave'} at 127.0.0.1:35422)
I20260709 12:09:55.174242 13847 tablet_copy_service.cc:161] P 96701a74fdee481fb5f54aac841e17dd: Beginning new tablet copy session on tablet 1e31cd7111f2470d8d34b5898dce5765 from peer ca9fbbc2c0a94897897d502d42f3951f at {username='slave'} at 127.0.0.1:35422: session id = ca9fbbc2c0a94897897d502d42f3951f-1e31cd7111f2470d8d34b5898dce5765
I20260709 12:09:55.189898 14928 raft_consensus.cc:993] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7: : Instructing follower 96701a74fdee481fb5f54aac841e17dd to start an election
I20260709 12:09:55.190583 15018 raft_consensus.cc:1081] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 LEADER]: Signalling peer 96701a74fdee481fb5f54aac841e17dd to start an election
I20260709 12:09:55.192404 15039 ts_tablet_manager.cc:933] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f: Initiating tablet copy from peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199)
I20260709 12:09:55.192783 13837 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773"
dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:54820
I20260709 12:09:55.194244 13837 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:55.194685 13837 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:55.201726 13837 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:55.202008 14414 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:55.205682 14414 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:55.207455 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:09:55.208130 13837 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:55.208288 13763 raft_consensus.cc:3055] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:55.208458 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:09:55.208710 13763 raft_consensus.cc:740] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:09:55.209142 13680 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.209501 13763 consensus_queue.cc:260] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:55.212088 15039 tablet_copy_client.cc:323] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Beginning tablet copy session from remote peer at address 127.12.56.193:33199
I20260709 12:09:55.214124 15035 tablet_copy_client.cc:323] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Beginning tablet copy session from remote peer at address 127.12.56.193:33199
I20260709 12:09:55.215560 13696 tablet_copy_service.cc:140] P b98d2519bb504dc6905ed2ede4571835: Received BeginTabletCopySession request for tablet a34b21ec197b4241a780a8ae562e4602 from peer ca9fbbc2c0a94897897d502d42f3951f ({username='slave'} at 127.0.0.1:48212)
I20260709 12:09:55.216158 13696 tablet_copy_service.cc:161] P b98d2519bb504dc6905ed2ede4571835: Beginning new tablet copy session on tablet a34b21ec197b4241a780a8ae562e4602 from peer ca9fbbc2c0a94897897d502d42f3951f at {username='slave'} at 127.0.0.1:48212: session id = ca9fbbc2c0a94897897d502d42f3951f-a34b21ec197b4241a780a8ae562e4602
I20260709 12:09:55.217545 14883 raft_consensus.cc:993] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd: : Instructing follower 3f37c9cc9dda46b4be21dd675ba78fb7 to start an election
I20260709 12:09:55.220184 13698 tablet_copy_service.cc:140] P b98d2519bb504dc6905ed2ede4571835: Received BeginTabletCopySession request for tablet c95811190f014949bb25448e8db1040e from peer ca9fbbc2c0a94897897d502d42f3951f ({username='slave'} at 127.0.0.1:48212)
I20260709 12:09:55.220911 14883 raft_consensus.cc:1081] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 4 LEADER]: Signalling peer 3f37c9cc9dda46b4be21dd675ba78fb7 to start an election
I20260709 12:09:55.221016 13698 tablet_copy_service.cc:161] P b98d2519bb504dc6905ed2ede4571835: Beginning new tablet copy session on tablet c95811190f014949bb25448e8db1040e from peer ca9fbbc2c0a94897897d502d42f3951f at {username='slave'} at 127.0.0.1:48212: session id = ca9fbbc2c0a94897897d502d42f3951f-c95811190f014949bb25448e8db1040e
I20260709 12:09:55.231129 13763 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.251349 13847 tablet_copy_source_session.cc:215] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:55.256018 13756 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f1494f6353074242857c7901c21da06d"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
 from {username='slave'} at 127.0.0.1:48120
I20260709 12:09:55.256671 13756 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:55.257225 13756 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:55.264822 13698 tablet_copy_source_session.cc:215] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:55.265157 15037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e31cd7111f2470d8d34b5898dce5765. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:55.266088 13680 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 2.
I20260709 12:09:55.267613 14379 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:09:55.268537 14936 raft_consensus.cc:2804] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:55.269069 14936 raft_consensus.cc:697] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 2 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:09:55.254990 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:09:55.270134 13755 raft_consensus.cc:3055] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:55.270010 14936 consensus_queue.cc:237] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:55.270512 13755 raft_consensus.cc:740] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:09:55.277685 13755 consensus_queue.cc:260] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:55.279299 13755 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:55.281841 15035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c95811190f014949bb25448e8db1040e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:55.282732 13756 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:55.285084 13763 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 2.
I20260709 12:09:55.255254 13696 tablet_copy_source_session.cc:215] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:55.255416 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:09:55.298681 13684 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:55.298249 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:09:55.299839 13680 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:55.297613 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:09:55.307808 15039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a34b21ec197b4241a780a8ae562e4602. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:55.308147 13828 raft_consensus.cc:3055] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:09:55.308480 13828 raft_consensus.cc:740] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:09:55.309724 13755 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 4.
I20260709 12:09:55.316120 13800 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:09:55.316987 14883 raft_consensus.cc:2804] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:55.317649 14883 raft_consensus.cc:697] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 4 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:09:55.321380 14883 consensus_queue.cc:237] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:55.327793 13680 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 5.
I20260709 12:09:55.331298 13726 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:09:55.332265 14928 raft_consensus.cc:2804] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:09:55.332765 14928 raft_consensus.cc:697] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:09:55.309477 13828 consensus_queue.cc:260] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:55.335493 13828 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:55.338654 15035 tablet_copy_client.cc:806] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:55.339524 15035 tablet_copy_client.cc:670] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:55.340528 13583 catalog_manager.cc:5697] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 1 to 2, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 2 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:55.344830 15035 tablet_copy_client.cc:538] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:55.333655 14928 consensus_queue.cc:237] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:55.346549 13582 catalog_manager.cc:5697] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 3 to 4, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 4 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:55.348937 15037 tablet_copy_client.cc:806] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:55.356586 15037 tablet_copy_client.cc:670] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:55.364635 15035 tablet_bootstrap.cc:492] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap starting.
I20260709 12:09:55.365688 14977 raft_consensus.cc:993] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835: : Instructing follower 3f37c9cc9dda46b4be21dd675ba78fb7 to start an election
I20260709 12:09:55.366227 14977 raft_consensus.cc:1081] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Signalling peer 3f37c9cc9dda46b4be21dd675ba78fb7 to start an election
I20260709 12:09:55.367177 13828 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 5.
I20260709 12:09:55.372449 13756 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:55.374401 13684 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 4.
I20260709 12:09:55.375685 15037 tablet_copy_client.cc:538] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:55.381461 13586 catalog_manager.cc:5697] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 4 to 5, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 5 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:55.394951 15015 raft_consensus.cc:993] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd: : Instructing follower ca9fbbc2c0a94897897d502d42f3951f to start an election
I20260709 12:09:55.395538 15015 raft_consensus.cc:1081] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Signalling peer ca9fbbc2c0a94897897d502d42f3951f to start an election
I20260709 12:09:55.398413 14414 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08"
dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
 from {username='slave'} at 127.0.0.1:41692
I20260709 12:09:55.402252 14414 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:55.412065 14414 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:09:55.414044 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 81202.1us
I20260709 12:09:55.402719 15039 tablet_copy_client.cc:806] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:55.415216 15039 tablet_copy_client.cc:670] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:55.401312 15041 ts_tablet_manager.cc:933] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f: Initiating tablet copy from peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:55.407991 13755 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
 from {username='slave'} at 127.0.0.1:48114
I20260709 12:09:55.416857 13755 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:55.417412 13755 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.420826 15037 tablet_bootstrap.cc:492] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap starting.
I20260709 12:09:55.427379 15039 tablet_copy_client.cc:538] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:55.435367 15041 tablet_copy_client.cc:323] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Beginning tablet copy session from remote peer at address 127.12.56.194:39545
I20260709 12:09:55.440584 13773 tablet_copy_service.cc:140] P 3f37c9cc9dda46b4be21dd675ba78fb7: Received BeginTabletCopySession request for tablet c89d2a3019c74941a4f8dffc9aa5cf40 from peer ca9fbbc2c0a94897897d502d42f3951f ({username='slave'} at 127.0.0.1:38932)
I20260709 12:09:55.441268 13773 tablet_copy_service.cc:161] P 3f37c9cc9dda46b4be21dd675ba78fb7: Beginning new tablet copy session on tablet c89d2a3019c74941a4f8dffc9aa5cf40 from peer ca9fbbc2c0a94897897d502d42f3951f at {username='slave'} at 127.0.0.1:38932: session id = ca9fbbc2c0a94897897d502d42f3951f-c89d2a3019c74941a4f8dffc9aa5cf40
I20260709 12:09:55.451881 15035 tablet_bootstrap.cc:492] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:55.452800 13773 tablet_copy_source_session.cc:215] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:55.457970 13755 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:55.460261 15035 tablet_bootstrap.cc:492] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap complete.
I20260709 12:09:55.461180 15035 ts_tablet_manager.cc:1403] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f: Time spent bootstrapping tablet: real 0.097s	user 0.023s	sys 0.006s
I20260709 12:09:55.464401 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:09:55.465303 13755 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:55.465909 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:09:55.465335 13683 raft_consensus.cc:3055] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:55.469666 13683 raft_consensus.cc:740] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:09:55.469406 14414 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:55.470551 13683 consensus_queue.cc:260] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:55.471872 13683 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.473237 14414 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:55.469425 13828 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.474339 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:09:55.467437 15041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c89d2a3019c74941a4f8dffc9aa5cf40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:55.475005 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:09:55.475631 13831 raft_consensus.cc:3055] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:55.475917 13831 raft_consensus.cc:740] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:09:55.476650 13831 consensus_queue.cc:260] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:55.478142 13831 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.485467 13831 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 2.
I20260709 12:09:55.486901 14380 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:09:55.487967 14936 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:55.488633 14936 raft_consensus.cc:697] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 2 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:09:55.468295 15035 raft_consensus.cc:359] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:55.489660 14936 consensus_queue.cc:237] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:55.489998 15035 raft_consensus.cc:740] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Initialized, Role: LEARNER
I20260709 12:09:55.474979 13755 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.499778 13828 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 2.
I20260709 12:09:55.501628 13727 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:09:55.503890 14928 raft_consensus.cc:2804] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:55.504432 14928 raft_consensus.cc:697] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:09:55.505328 14928 consensus_queue.cc:237] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:55.515771 15037 tablet_bootstrap.cc:492] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:55.521126 15037 tablet_bootstrap.cc:492] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap complete.
I20260709 12:09:55.491063 15035 consensus_queue.cc:260] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:55.522037 15037 ts_tablet_manager.cc:1403] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f: Time spent bootstrapping tablet: real 0.102s	user 0.024s	sys 0.012s
I20260709 12:09:55.519927 13755 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 2.
I20260709 12:09:55.526141 15035 ts_tablet_manager.cc:1434] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f: Time spent starting tablet: real 0.065s	user 0.005s	sys 0.003s
I20260709 12:09:55.526086 15037 raft_consensus.cc:359] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:55.527237 15037 raft_consensus.cc:740] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Initialized, Role: LEARNER
I20260709 12:09:55.528020 15037 consensus_queue.cc:260] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:55.531088 15037 ts_tablet_manager.cc:1434] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260709 12:09:55.531263 15039 tablet_bootstrap.cc:492] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap starting.
I20260709 12:09:55.535476 13847 tablet_copy_service.cc:342] P 96701a74fdee481fb5f54aac841e17dd: Request end of tablet copy session ca9fbbc2c0a94897897d502d42f3951f-1e31cd7111f2470d8d34b5898dce5765 received from {username='slave'} at 127.0.0.1:35422
I20260709 12:09:55.554634 13847 tablet_copy_service.cc:434] P 96701a74fdee481fb5f54aac841e17dd: ending tablet copy session ca9fbbc2c0a94897897d502d42f3951f-1e31cd7111f2470d8d34b5898dce5765 on tablet 1e31cd7111f2470d8d34b5898dce5765 with peer ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:09:55.535954 13586 catalog_manager.cc:5697] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 1 to 2, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 2 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:55.536190 13696 tablet_copy_service.cc:342] P b98d2519bb504dc6905ed2ede4571835: Request end of tablet copy session ca9fbbc2c0a94897897d502d42f3951f-c95811190f014949bb25448e8db1040e received from {username='slave'} at 127.0.0.1:48212
I20260709 12:09:55.560405 13696 tablet_copy_service.cc:434] P b98d2519bb504dc6905ed2ede4571835: ending tablet copy session ca9fbbc2c0a94897897d502d42f3951f-c95811190f014949bb25448e8db1040e on tablet c95811190f014949bb25448e8db1040e with peer ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:09:55.536756 14414 raft_consensus.cc:1217] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:09:55.548062 13583 catalog_manager.cc:5697] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 1 to 2, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 2 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:55.552081 13683 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 2.
I20260709 12:09:55.585511 15041 tablet_copy_client.cc:806] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:55.587944 15041 tablet_copy_client.cc:670] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:55.596364 15041 tablet_copy_client.cc:538] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:55.609493 15039 tablet_bootstrap.cc:492] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:55.610877 15039 tablet_bootstrap.cc:492] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap complete.
I20260709 12:09:55.611630 15039 ts_tablet_manager.cc:1403] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f: Time spent bootstrapping tablet: real 0.081s	user 0.023s	sys 0.008s
I20260709 12:09:55.614912 15039 raft_consensus.cc:359] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:55.615896 15039 raft_consensus.cc:740] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Initialized, Role: LEARNER
I20260709 12:09:55.616690 15039 consensus_queue.cc:260] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:55.619330 15039 ts_tablet_manager.cc:1434] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:09:55.621482 13696 tablet_copy_service.cc:342] P b98d2519bb504dc6905ed2ede4571835: Request end of tablet copy session ca9fbbc2c0a94897897d502d42f3951f-a34b21ec197b4241a780a8ae562e4602 received from {username='slave'} at 127.0.0.1:48212
I20260709 12:09:55.621989 13696 tablet_copy_service.cc:434] P b98d2519bb504dc6905ed2ede4571835: ending tablet copy session ca9fbbc2c0a94897897d502d42f3951f-a34b21ec197b4241a780a8ae562e4602 on tablet a34b21ec197b4241a780a8ae562e4602 with peer ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:09:55.623383 15041 tablet_bootstrap.cc:492] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap starting.
I20260709 12:09:55.649468 15041 tablet_bootstrap.cc:492] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:55.650651 15041 tablet_bootstrap.cc:492] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap complete.
I20260709 12:09:55.651568 15041 ts_tablet_manager.cc:1403] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f: Time spent bootstrapping tablet: real 0.029s	user 0.025s	sys 0.000s
I20260709 12:09:55.654383 15041 raft_consensus.cc:359] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:55.655097 15041 raft_consensus.cc:740] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Initialized, Role: LEARNER
I20260709 12:09:55.655706 15041 consensus_queue.cc:260] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:09:55.657883 15041 ts_tablet_manager.cc:1434] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:09:55.659917 13773 tablet_copy_service.cc:342] P 3f37c9cc9dda46b4be21dd675ba78fb7: Request end of tablet copy session ca9fbbc2c0a94897897d502d42f3951f-c89d2a3019c74941a4f8dffc9aa5cf40 received from {username='slave'} at 127.0.0.1:38932
I20260709 12:09:55.660408 13773 tablet_copy_service.cc:434] P 3f37c9cc9dda46b4be21dd675ba78fb7: ending tablet copy session ca9fbbc2c0a94897897d502d42f3951f-c89d2a3019c74941a4f8dffc9aa5cf40 on tablet c89d2a3019c74941a4f8dffc9aa5cf40 with peer ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:09:55.684043 13684 raft_consensus.cc:1275] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:55.685640 14936 consensus_queue.cc:1048] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:55.688614 14414 raft_consensus.cc:1217] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:55.709921 14414 raft_consensus.cc:1217] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:55.749109 13755 raft_consensus.cc:1275] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:55.750633 15058 consensus_queue.cc:1048] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:55.941156 14414 raft_consensus.cc:1217] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 12:09:55.954049 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 84058.1us
W20260709 12:09:56.021867 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 58680.5us
I20260709 12:09:56.027634 13829 raft_consensus.cc:1275] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:56.051625 13831 raft_consensus.cc:1275] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:09:56.063584 14936 consensus_queue.cc:1048] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:56.161628 13683 raft_consensus.cc:1275] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:56.168193 13756 raft_consensus.cc:1275] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:56.211644 13687 raft_consensus.cc:1275] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:09:56.222970 13684 raft_consensus.cc:1275] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:09:56.234411 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 184189us
I20260709 12:09:56.238660 13756 raft_consensus.cc:1275] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:56.285983 15068 consensus_queue.cc:1048] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 12:09:56.299007 13828 raft_consensus.cc:1275] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:56.318014 15071 consensus_queue.cc:1048] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:56.322043 15072 consensus_queue.cc:1048] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:56.324896 15019 consensus_queue.cc:1048] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:56.371121 15021 raft_consensus.cc:1064] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835: attempting to promote NON_VOTER ca9fbbc2c0a94897897d502d42f3951f to VOTER
I20260709 12:09:56.373222 15066 raft_consensus.cc:1064] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835: attempting to promote NON_VOTER ca9fbbc2c0a94897897d502d42f3951f to VOTER
I20260709 12:09:56.416553 15019 consensus_queue.cc:1048] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:56.434258 15063 consensus_queue.cc:1048] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:56.448143 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:09:56.474339 15074 log.cc:927] Time spent T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:09:56.476367 15072 raft_consensus.cc:1064] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd: attempting to promote NON_VOTER ca9fbbc2c0a94897897d502d42f3951f to VOTER
I20260709 12:09:56.476284 15070 consensus_queue.cc:1048] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
W20260709 12:09:56.511920 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 50286us
I20260709 12:09:56.517156 15066 consensus_queue.cc:237] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:09:56.567233 15076 log.cc:927] Time spent T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 12:09:56.584834 15075 log.cc:927] Time spent T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 12:09:56.551230 15021 consensus_queue.cc:237] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:09:56.618853 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 70372us
W20260709 12:09:56.641479 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:56.648654 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 51092.5us
I20260709 12:09:56.626717 15071 raft_consensus.cc:1064] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7: attempting to promote NON_VOTER ca9fbbc2c0a94897897d502d42f3951f to VOTER
W20260709 12:09:56.691002 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 102474us
W20260709 12:09:56.703456 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 120938us
I20260709 12:09:56.650148 15072 consensus_queue.cc:237] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:09:56.747586 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 168808us
W20260709 12:09:56.792752 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 46607.5us
W20260709 12:09:56.815562 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 129025us
W20260709 12:09:56.828214 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 48033.8us
I20260709 12:09:56.874418 15071 consensus_queue.cc:237] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:09:56.906873 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 60525.4us
W20260709 12:09:56.914858 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:56.916077 13763 raft_consensus.cc:1275] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260709 12:09:56.967800 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 113255us
I20260709 12:09:56.987504 13687 raft_consensus.cc:1275] T 1e31cd7111f2470d8d34b5898dce5765 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:09:57.003275 13828 raft_consensus.cc:1275] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:57.099373 15066 consensus_queue.cc:1048] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:57.101172 14413 raft_consensus.cc:1275] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 2 LEARNER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:09:57.102640 13835 raft_consensus.cc:1275] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:57.121174 14413 raft_consensus.cc:1275] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:57.125447 15015 consensus_queue.cc:1048] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:57.128847 15067 consensus_queue.cc:1048] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:57.137840 15088 consensus_queue.cc:1048] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:57.147964 14413 raft_consensus.cc:1275] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:57.153141 15070 consensus_queue.cc:1048] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:09:57.157640 15066 consensus_queue.cc:1048] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:57.159682 15093 consensus_queue.cc:1048] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:57.184357 14413 raft_consensus.cc:1275] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 1 LEARNER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 12:09:57.181263 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 62141.8us
I20260709 12:09:57.217021 13759 raft_consensus.cc:1275] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:57.249053 13758 raft_consensus.cc:1275] T c95811190f014949bb25448e8db1040e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 12:09:57.269061 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 65990.9us
I20260709 12:09:57.272478 13832 raft_consensus.cc:1275] T c89d2a3019c74941a4f8dffc9aa5cf40 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:57.297945 15065 consensus_queue.cc:1048] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 12:09:57.311270 15019 consensus_queue.cc:1048] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:09:57.377471 13682 raft_consensus.cc:1275] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:57.432677 15109 raft_consensus.cc:2955] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:57.463289 15067 consensus_queue.cc:1048] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:09:57.480607 15095 consensus_queue.cc:1048] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 12:09:57.491861 15071 consensus_queue.cc:1048] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:57.544387 13680 raft_consensus.cc:2955] T 1e31cd7111f2470d8d34b5898dce5765 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:57.666373 14413 raft_consensus.cc:2955] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:57.591085 14412 raft_consensus.cc:2955] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:57.659531 15107 raft_consensus.cc:2955] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:57.788272 13761 raft_consensus.cc:2955] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
W20260709 12:09:57.827387 15133 log.cc:927] Time spent T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
W20260709 12:09:58.014783 15140 log.cc:927] Time spent T c95811190f014949bb25448e8db1040e P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
I20260709 12:09:58.023573 13682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8"
dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
mode: GRACEFUL
new_leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
 from {username='slave'} at 127.0.0.1:58734
I20260709 12:09:58.024678 13682 raft_consensus.cc:606] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 3 LEADER]: Received request to transfer leadership to TS 3f37c9cc9dda46b4be21dd675ba78fb7
W20260709 12:09:58.034255 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 182111us
I20260709 12:09:58.025682 13832 raft_consensus.cc:2955] T c89d2a3019c74941a4f8dffc9aa5cf40 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:58.033692 14414 raft_consensus.cc:2955] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:58.069262 15065 raft_consensus.cc:2955] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:58.031539 13835 raft_consensus.cc:2955] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:58.096509 13682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3f29dda715314a93a03981264972c4c3"
dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:58734
I20260709 12:09:58.097223 13682 raft_consensus.cc:606] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:09:58.144263 13586 catalog_manager.cc:5697] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: config changed from index 3 to 4, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:58.146145 13685 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087"
dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
mode: GRACEFUL
new_leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
 from {username='slave'} at 127.0.0.1:58734
I20260709 12:09:58.147038 13685 raft_consensus.cc:606] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Received request to transfer leadership to TS 3f37c9cc9dda46b4be21dd675ba78fb7
W20260709 12:09:58.155411 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 76905.7us
W20260709 12:09:58.245620 15128 log.cc:927] Time spent T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
W20260709 12:09:58.254882 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 66332.5us
W20260709 12:09:58.255844 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 55783.1us
W20260709 12:09:58.265354 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 103463us
W20260709 12:09:58.266511 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 75976.3us
I20260709 12:09:58.251417 15083 raft_consensus.cc:2955] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
W20260709 12:09:58.280017 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 194530us
W20260709 12:09:58.287890 15136 log.cc:927] Time spent T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.280s	user 0.000s	sys 0.003s
I20260709 12:09:58.301591 15094 raft_consensus.cc:993] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835: : Instructing follower 3f37c9cc9dda46b4be21dd675ba78fb7 to start an election
I20260709 12:09:58.302191 15094 raft_consensus.cc:1081] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 3 LEADER]: Signalling peer 3f37c9cc9dda46b4be21dd675ba78fb7 to start an election
I20260709 12:09:58.321030 13680 raft_consensus.cc:2955] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:58.345149 13834 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07"
dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
mode: GRACEFUL
new_leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
 from {username='slave'} at 127.0.0.1:52702
I20260709 12:09:58.345970 13834 raft_consensus.cc:606] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Received request to transfer leadership to TS ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:09:58.369086 15142 raft_consensus.cc:993] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835: : Instructing follower 3f37c9cc9dda46b4be21dd675ba78fb7 to start an election
I20260709 12:09:58.382941 13756 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1494f6353074242857c7901c21da06d"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:09:58.383674 13756 raft_consensus.cc:606] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 LEADER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:09:58.393612 15107 raft_consensus.cc:1081] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Signalling peer 3f37c9cc9dda46b4be21dd675ba78fb7 to start an election
W20260709 12:09:58.461006 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 74171.7us
I20260709 12:09:58.466305 13757 raft_consensus.cc:2955] T c95811190f014949bb25448e8db1040e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:58.466318 13761 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
 from {username='slave'} at 127.0.0.1:48114
I20260709 12:09:58.474839 13761 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:58.475239 13761 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:09:58.479554 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 273356us
W20260709 12:09:58.536121 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 52522us
I20260709 12:09:58.539402 13761 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:58.545816 14414 raft_consensus.cc:2955] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
W20260709 12:09:58.538004 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 54546.3us
I20260709 12:09:58.553077 13762 raft_consensus.cc:2955] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:58.560245 13761 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:58.562449 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:09:58.563241 13828 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:09:58.566983 15160 log.cc:927] Time spent T 00000000000000000000000000000000 P 17d79eae88f84be7a847d0cf544674cd: Append to log took a long time: real 0.084s	user 0.000s	sys 0.003s
I20260709 12:09:58.579263 13761 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
 from {username='slave'} at 127.0.0.1:48114
I20260709 12:09:58.580039 13761 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:58.580431 13761 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.619563 13828 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 4.
I20260709 12:09:58.676205 13582 catalog_manager.cc:5697] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
W20260709 12:09:59.605866 13761 consensus_meta.cc:287] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 1.025s	user 0.021s	sys 0.000s
I20260709 12:09:59.606398 13761 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:59.609347 13761 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:09:59.609944 13761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:48114 (request call id 1578) took 1047 ms. Trace:
I20260709 12:09:59.610388 13761 rpcz_store.cc:276] 0709 12:09:58.562350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:58.579060 (+ 16710us) service_pool.cc:224] Handling call
0709 12:09:59.609838 (+1030778us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:59.614135 15097 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:09:59.614785 15097 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:59.617126 15097 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:59.617709 15097 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:09:59.618307 15097 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:59.620977 15097 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:59.621433 15097 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:09:59.621963 15097 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:59.624469 15097 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:09:59.652298 14936 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:09:59.653543 14936 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:59.657083 14936 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:59.658497 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:09:59.663060 13682 raft_consensus.cc:3055] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:59.662295 15143 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:09:59.663472 13682 raft_consensus.cc:740] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:09:59.663887 15083 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:09:59.663864 15143 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:59.664306 13682 consensus_queue.cc:260] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:59.664634 15083 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:59.665220 13682 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:59.666065 15143 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:59.666052 14936 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:09:59.667290 14936 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:59.667798 15083 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:09:59.668365 15083 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:09:59.668852 15083 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:59.669658 14936 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:59.672008 13682 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 4.
I20260709 12:09:59.672407 15069 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:09:59.673197 15083 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:09:59.673039 15069 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:59.673313 15107 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
W20260709 12:09:59.674566 13617 debug-util.cc:398] Leaking SignalData structure 0x7b0800194380 after lost signal to thread 12515
W20260709 12:09:59.675171 13617 debug-util.cc:398] Leaking SignalData structure 0x7b08001943a0 after lost signal to thread 12518
I20260709 12:09:59.674350 15107 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:59.675370 15069 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:59.675926 15069 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:09:59.676463 15069 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:59.677115 15107 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:59.678685 15069 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:59.680083 15069 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:09:59.680274 15066 raft_consensus.cc:993] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835: : Instructing follower 96701a74fdee481fb5f54aac841e17dd to start an election
W20260709 12:09:59.680744 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:59.673844 15083 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:09:59.682097 13617 debug-util.cc:398] Leaking SignalData structure 0x7b0800194b80 after lost signal to thread 13620
I20260709 12:09:59.681085 15066 raft_consensus.cc:1081] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Signalling peer 96701a74fdee481fb5f54aac841e17dd to start an election
I20260709 12:09:59.681663 15083 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:59.682143 15069 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:59.686175 15083 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:59.687278 15086 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:09:59.688123 15069 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:59.687974 15086 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:59.691352 15086 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:09:59.697258 15083 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:09:59.698071 15083 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:59.700393 15083 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:09:59.701745 15143 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:09:59.702160 15146 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:09:59.702287 15142 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:09:59.702551 15143 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:59.702775 15146 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:59.702864 15142 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:59.704955 15143 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:59.705154 15146 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:59.705233 15142 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:59.705538 15143 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:09:59.705834 15146 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:09:59.706324 15143 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:59.706461 15146 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:59.709473 15143 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:59.710456 15146 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:09:59.717020 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 1.15554e+06us
I20260709 12:09:59.720372 15156 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:09:59.720973 15156 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:59.721611 15146 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:09:59.722340 15085 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:09:59.722373 15146 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:59.723071 15085 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:59.724465 15156 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:09:59.725672 15146 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:59.726584 15085 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:59.727609 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:09:59.728550 14416 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:59.732488 13831 raft_consensus.cc:2955] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:09:59.734352 13835 raft_consensus.cc:1240] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 3. Current term is 4. Ops: []
I20260709 12:09:59.735219 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:59.736586 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:59.737206 13828 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 1.
I20260709 12:09:59.738067 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:59.739140 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:59.740831 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:59.735260 13835 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3f29dda715314a93a03981264972c4c3"
dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:54830
I20260709 12:09:59.742949 13835 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:59.743296 13835 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:59.743811 13762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 1577) took 1191 ms. Trace:
I20260709 12:09:59.744087 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:59.744213 13762 rpcz_store.cc:276] 0709 12:09:58.552016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:58.552128 (+   112us) service_pool.cc:224] Handling call
0709 12:09:58.552378 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:58.552555 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:09:58.567986 (+ 15431us) log.cc:844] Serialized 14 byte log entry
0709 12:09:59.743463 (+1175477us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:59.743540 (+    77us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:09:59.743578 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:59.743638 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:59.743734 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1175193}
I20260709 12:09:59.744822 13682 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 1.
I20260709 12:09:59.747931 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:59.749538 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:59.749414 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:59.750190 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:59.736598 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:59.753405 13835 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:59.754146 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:09:59.754449 15084 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:09:59.755088 15084 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:59.755482 13835 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:09:59.757408 15084 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:59.763123 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:59.764355 13834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 85) took 1147 ms. Trace:
I20260709 12:09:59.766738 13834 rpcz_store.cc:276] 0709 12:09:58.616700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:59.763634 (+1146934us) service_pool.cc:224] Handling call
0709 12:09:59.763914 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:59.764071 (+   157us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:59.764092 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:59.764127 (+    35us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:09:59.764156 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:59.764202 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:59.764299 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:59.754177 15145 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:09:59.768421 15145 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:59.765347 13761 raft_consensus.cc:1240] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 3. Current term is 4. Ops: []
I20260709 12:09:59.739800 13586 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45618 (request call id 228) took 1646 ms. Trace:
I20260709 12:09:59.770668 15145 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:09:59.775403 14928 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:09:59.776082 14928 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:59.782480 14416 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 2.
I20260709 12:09:59.783978 14928 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:09:59.770984 13586 rpcz_store.cc:276] 0709 12:09:58.093112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:58.093302 (+   190us) service_pool.cc:224] Handling call
0709 12:09:59.739713 (+1646411us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:09:58.279560 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:09:58.280255 (+   695us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:09:58.280301 (+    46us) write_op.cc:435] Acquired schema lock
0709 12:09:58.280335 (+    34us) tablet.cc:662] Decoding operations
0709 12:09:58.280747 (+   412us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:09:58.280846 (+    99us) write_op.cc:641] Partition lock acquired for write op
0709 12:09:58.280881 (+    35us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:09:58.281194 (+   313us) tablet.cc:701] Row locks acquired
0709 12:09:58.281248 (+    54us) write_op.cc:260] PREPARE: finished
0709 12:09:58.281422 (+   174us) write_op.cc:270] Start()
0709 12:09:58.281611 (+   189us) write_op.cc:276] Timestamp: P: 1783598998281360 usec, L: 0
0709 12:09:58.281668 (+    57us) op_driver.cc:348] REPLICATION: starting
0709 12:09:58.357867 (+ 76199us) log.cc:844] Serialized 599 byte log entry
0709 12:09:58.671040 (+313173us) op_driver.cc:464] REPLICATION: finished
0709 12:09:58.683580 (+ 12540us) write_op.cc:301] APPLY: starting
0709 12:09:58.683713 (+   133us) tablet.cc:1367] starting BulkCheckPresence
0709 12:09:58.683858 (+   145us) tablet.cc:1370] finished BulkCheckPresence
0709 12:09:58.684022 (+   164us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:09:58.685140 (+  1118us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:09:58.685439 (+   299us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:09:58.685511 (+    72us) write_op.cc:312] APPLY: finished
0709 12:09:58.685882 (+   371us) log.cc:844] Serialized 23 byte log entry
0709 12:09:58.686124 (+   242us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:58.686217 (+    93us) write_op.cc:454] Released schema lock
0709 12:09:58.686277 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 12:09:58.686648 (+   371us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:58.686676 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":49,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":12084,"apply.run_cpu_time_us":2516,"apply.run_wall_time_us":3173,"num_ops":1,"prepare.queue_time_us":131365,"prepare.run_cpu_time_us":21631,"prepare.run_wall_time_us":203588,"raft.queue_time_us":76431,"raft.run_cpu_time_us":7241,"raft.run_wall_time_us":15720,"replication_time_us":389140,"spinlock_wait_cycles":27520,"thread_start_us":238459,"threads_started":4,"wal-append.queue_time_us":124167,"wal-append.run_cpu_time_us":15917,"wal-append.run_wall_time_us":1206049}]]}
I20260709 12:09:59.786227 14928 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:09:59.786623 15019 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:09:59.787369 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:59.787982 13762 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 1.
I20260709 12:09:59.787176 15019 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:59.788288 14928 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:59.790081 15019 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:09:59.790689 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:59.790928 14928 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:09:59.794996 13759 raft_consensus.cc:1240] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:59.791316 13760 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 2.
I20260709 12:09:59.791538 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:59.793848 15109 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:09:59.794557 15148 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:09:59.822551 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:09:59.825444 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:09:59.826289 14414 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 1.
I20260709 12:09:59.827538 15153 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:09:59.828285 15153 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:59.831573 15153 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:09:59.834252 15069 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:09:59.835137 15069 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:59.840847 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:59.843185 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:09:59.844000 14416 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:59.848623 15112 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:09:59.845068 13833 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 1.
I20260709 12:09:59.816612 15152 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:09:59.849254 15112 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:09:59.816658 15109 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:09:59.972110 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:09:59.973016 13680 raft_consensus.cc:3055] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:59.973430 13680 raft_consensus.cc:740] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:09:59.980060 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:00.013368 15103 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:00.015260 15081 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:09:59.821200 15148 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:00.012123 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:00.026194 14928 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:00.016034 15081 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:00.056298 15081 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:00.027428 15069 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:00.041740 13680 consensus_queue.cc:260] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:00.068907 14416 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 2.
I20260709 12:10:00.081162 13680 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.083158 15169 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:00.069762 15144 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:09:59.908751 15153 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:09:59.870904 15021 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:00.057534 14928 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:00.075297 13831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 1557) took 1467 ms. Trace:
I20260709 12:09:59.870296 15019 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:09:59.908030 15155 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:09:59.908524 15094 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:09:59.879920 15127 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:09:59.870514 15084 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:09:59.903667 15165 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:09:59.908316 15093 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:09:59.912758 15066 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:00.099043 13680 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 2.
I20260709 12:10:00.089124 15097 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:00.101341 15009 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:00.102131 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:00.102375 14977 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:00.058779 15088 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:00.103222 15142 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:00.094723 13726 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:00.106541 15081 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:00.106432 15145 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:00.143807 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:00.072790 15143 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:00.014276 15103 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:00.073642 15147 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:00.161592 15146 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:00.162390 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:00.165331 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:09:59.909538 15095 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:00.173296 13756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:39554 (request call id 10) took 1789 ms. Trace:
I20260709 12:10:00.143381 15085 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:00.083918 15169 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:00.026855 15152 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:00.193219 13727 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:10:00.201304 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 106719us
W20260709 12:10:00.161847 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:00.211133 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:00.211153 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:00.214952 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:00.215703 14928 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:00.212658 13756 rpcz_store.cc:276] 0709 12:09:58.369956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:58.382758 (+ 12802us) service_pool.cc:224] Handling call
0709 12:10:00.158504 (+1775746us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54002970a0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f0a520 00007fa927f87652 00007fa92cf5560a 00007fa9264db7d4 00007fa9264db762 00007fa9264db691 00007fa9264db60c 00007fa9264da8c2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:00.158770 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2880930688}
I20260709 12:10:00.143996 15153 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:00.248970 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:00.155319 15019 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:00.174435 15069 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:00.174844 15107 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:00.148370 15021 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:00.257121 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:00.257417 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:00.258069 15112 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:00.257731 15097 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:00.259469 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:00.213450 15109 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:10:00.214147 13617 debug-util.cc:398] Leaking SignalData structure 0x7b08000b9fa0 after lost signal to thread 13712
W20260709 12:10:00.264586 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 71496.3us
I20260709 12:10:00.214951 15063 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:00.201329 15143 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:00.197705 15145 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:00.195807 15066 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:00.274005 15152 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:00.173971 14977 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:00.215317 15081 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:00.213275 15088 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:00.174657 15009 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:00.247573 15175 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:00.259424 15156 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:00.282555 13830 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 1.
I20260709 12:10:00.198599 15084 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:00.213132 15166 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:00.290733 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 12:10:00.319911 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 58932us
I20260709 12:10:00.266875 15107 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:00.322297 13801 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:00.323176 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:00.324342 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:00.324671 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:00.325407 13680 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 2.
I20260709 12:10:00.327402 13726 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:00.211189 15142 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:00.307449 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:00.309394 15176 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:00.213716 15167 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:00.213281 15146 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:00.331820 14410 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 1.
I20260709 12:10:00.333145 15146 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:00.269254 15071 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:10:00.291754 13617 debug-util.cc:398] Leaking SignalData structure 0x7b0800359de0 after lost signal to thread 13713
W20260709 12:10:00.334911 13617 debug-util.cc:398] Leaking SignalData structure 0x7b0800362720 after lost signal to thread 13787
I20260709 12:10:00.248138 15085 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:00.170343 15093 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:00.213335 15095 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:00.299692 15109 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:00.337179 15085 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:00.336949 15109 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:00.339291 15109 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:00.340442 15109 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:00.170228 15094 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:00.340997 15109 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:00.346889 15142 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:00.344743 15109 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:00.350404 15109 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:00.195724 15155 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:00.198796 15165 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:00.267086 15069 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:00.354966 15109 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:00.363859 15173 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:00.195465 15127 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:00.372758 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:00.330649 15167 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:00.163334 15144 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:00.368902 15155 leader_election.cc:290] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:00.369196 15165 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:00.290217 15063 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:00.385936 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 63767us
W20260709 12:10:00.387580 15171 log.cc:927] Time spent T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 12:10:00.376535 15071 raft_consensus.cc:697] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:00.251519 15147 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:00.395743 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 106533us
I20260709 12:10:00.359191 15156 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:00.396864 13801 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:00.398437 15168 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:00.329694 15176 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:00.384989 15174 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:00.364645 15175 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:00.417062 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:00.418713 14414 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 1.
I20260709 12:10:00.415452 15019 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:00.370492 15166 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:00.392735 15180 raft_consensus.cc:2804] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:00.399021 15071 consensus_queue.cc:237] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:00.423882 15168 raft_consensus.cc:697] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:00.432492 15186 raft_consensus.cc:2804] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:00.409228 15095 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:00.438793 15172 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:00.439443 15172 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:00.441648 15190 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:00.442500 15190 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:00.430670 15019 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:00.433315 15180 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:00.463317 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:00.127288 13831 rpcz_store.cc:276] 0709 12:09:58.607865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:59.731837 (+1123972us) service_pool.cc:224] Handling call
0709 12:09:59.732176 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:59.732374 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:09:59.796986 (+ 64612us) log.cc:844] Serialized 14 byte log entry
0709 12:10:00.074830 (+277844us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:00.074911 (+    81us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:00.074974 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:00.075075 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:00.075226 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13109,"raft.queue_time_us":94826,"thread_start_us":233300,"threads_started":1,"wal-append.queue_time_us":327372}
I20260709 12:10:00.390451 15173 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:00.472895 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:00.473709 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:00.427189 15170 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:00.426914 15145 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:00.419975 15181 raft_consensus.cc:2804] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:00.480469 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:00.420192 15009 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:00.427134 15063 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:00.487524 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:00.466871 15180 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.426010 15174 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:00.426618 14977 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:00.462039 15019 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:00.502238 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:00.484297 15066 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:00.502169 15137 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:00.502808 15189 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
W20260709 12:10:00.508262 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 68818.5us
I20260709 12:10:00.510583 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:00.512100 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:00.514470 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:00.515291 13757 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 1.
I20260709 12:10:00.486043 15176 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:00.516142 13651 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:00.517086 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:00.517369 13727 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:00.518482 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:00.433149 15168 consensus_queue.cc:237] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:00.533460 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:00.533278 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:00.491641 15181 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:00.529219 15084 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:00.537462 15095 raft_consensus.cc:2804] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:00.578613 15172 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:00.579783 15190 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:00.581573 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:00.584625 15127 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:00.582036 15095 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:00.585899 15178 raft_consensus.cc:993] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd: : Instructing follower ca9fbbc2c0a94897897d502d42f3951f to start an election
I20260709 12:10:00.586022 15095 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.587805 15019 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:00.525832 15148 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:00.588438 15021 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:00.589078 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:00.590435 13651 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:00.546859 15107 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:00.551772 15109 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:00.539541 15181 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:00.594301 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:00.575762 15094 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:00.574432 15176 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:00.580227 15166 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:00.602775 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:00.519341 15137 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:00.573738 15186 raft_consensus.cc:697] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 2 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:00.605934 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:00.607255 14412 raft_consensus.cc:2468] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 1.
I20260709 12:10:00.605449 15196 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:00.507112 15170 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:00.598836 15143 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:00.645648 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:00.597625 15066 raft_consensus.cc:2804] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:00.642532 15148 raft_consensus.cc:1081] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Signalling peer ca9fbbc2c0a94897897d502d42f3951f to start an election
I20260709 12:10:00.657965 15093 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:00.604166 15069 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:10:00.647027 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 109478us
I20260709 12:10:00.675460 15192 raft_consensus.cc:2804] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:00.539273 15189 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:00.682746 13800 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:00.689443 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:00.681108 15066 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:00.642762 15176 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:00.701139 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:00.703912 13652 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:00.704195 15197 raft_consensus.cc:2804] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:00.704890 15197 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:00.705348 15197 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.708225 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:00.686978 15144 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:00.687776 15156 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:00.713061 13652 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:00.713532 15173 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:00.684407 15196 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:00.703649 15066 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.721969 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:00.723368 13652 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:00.687749 15192 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:00.724417 14414 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07"
dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
 from {username='slave'} at 127.0.0.1:41692
I20260709 12:10:00.724668 15192 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.725133 14414 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:00.725590 14414 raft_consensus.cc:3060] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.733165 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:00.729031 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:00.735215 13652 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:00.736053 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:00.730949 13726 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:00.736759 13680 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 2.
I20260709 12:10:00.736940 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:00.705242 15187 raft_consensus.cc:2804] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:00.739442 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:00.739969 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:00.740180 14416 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 1.
I20260709 12:10:00.741706 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:00.737596 13755 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 2.
I20260709 12:10:00.743355 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:10:00.744408 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:00.732960 15153 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:00.722018 15094 raft_consensus.cc:2749] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:00.708613 15175 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:00.725158 15107 raft_consensus.cc:2749] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:00.740078 15167 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:00.741297 14977 raft_consensus.cc:2804] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:00.753048 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:00.751042 15187 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:00.754988 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:00.755549 15196 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:00.755743 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:00.741101 15019 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:00.749254 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:00.739857 15170 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:00.777909 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:00.778820 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:00.779093 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:00.758173 14977 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:00.779573 13680 raft_consensus.cc:3055] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:00.779911 13680 raft_consensus.cc:740] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:00.779951 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:00.781535 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:00.784416 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:00.785701 15103 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:00.779855 14977 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.763924 15187 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.766441 15137 leader_election.cc:290] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:00.815793 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:00.823745 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:00.785634 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:00.748263 15186 consensus_queue.cc:237] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:00.855816 15195 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:00.859691 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:00.880981 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:00.881950 13761 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 2.
I20260709 12:10:00.882589 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:00.881249 15169 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:00.890580 15193 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
W20260709 12:10:00.922819 15199 log.cc:927] Time spent T 00000000000000000000000000000000 P 17d79eae88f84be7a847d0cf544674cd: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:10:00.850481 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:10:00.943595 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 139768us
I20260709 12:10:00.758388 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:00.943748 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:00.955786 13800 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:00.957223 13800 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:00.961939 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:00.785665 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:00.967211 13800 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:00.964982 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:00.893567 15193 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:00.970295 14414 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:00.977571 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:01.074900 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:01.024736 13680 consensus_queue.cc:260] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:01.076574 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 106812us
I20260709 12:10:01.077569 13800 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:01.081099 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:01.084075 13684 raft_consensus.cc:2393] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 2: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:01.085675 14379 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:01.087388 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:00.966892 15172 raft_consensus.cc:2749] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:00.901993 15195 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:01.090081 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:01.092074 14414 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:01.131868 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:01.094798 15081 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:01.134356 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:01.135249 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:01.024201 15194 raft_consensus.cc:2804] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:00.969453 15097 leader_election.cc:290] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:01.135872 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:01.140619 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:00.967917 15198 raft_consensus.cc:2749] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:01.143103 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:01.140157 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:01.134486 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:10:01.088292 13617 debug-util.cc:398] Leaking SignalData structure 0x7b0800333e20 after lost signal to thread 13861
I20260709 12:10:01.138681 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:01.163371 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:01.209231 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:01.136478 15156 raft_consensus.cc:2749] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:01.237818 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:01.238467 15176 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:01.239133 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:01.249053 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:10:01.239385 15095 consensus_meta.cc:287] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.653s	user 0.029s	sys 0.076s
I20260709 12:10:01.239689 15149 raft_consensus.cc:2749] T c89d2a3019c74941a4f8dffc9aa5cf40 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:01.241649 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:01.244241 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:01.246459 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:01.259416 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:10:01.145920 13617 debug-util.cc:398] Leaking SignalData structure 0x7b0800334220 after lost signal to thread 13862
I20260709 12:10:01.138427 15194 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:01.252051 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:01.260237 13687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 1474) took 1247 ms. Trace:
I20260709 12:10:01.243158 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:01.265657 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:01.264343 13687 rpcz_store.cc:276] 0709 12:10:00.003822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:00.003971 (+   149us) service_pool.cc:224] Handling call
0709 12:10:00.004376 (+   405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:00.342417 (+338041us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:00.342467 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:00.342531 (+    64us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:00.342577 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:01.251022 (+908445us) spinlock_profiling.cc:243] Waited 338 ms on lock 0x7b54003124d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:01.251071 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:01.251193 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":776771968}
I20260709 12:10:01.275415 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:01.279136 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:01.280323 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:01.281623 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:01.283296 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:01.284464 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:01.250641 15097 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:01.291836 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:01.292546 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:01.295672 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:01.296401 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:01.298230 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:01.299114 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:01.286996 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:01.306305 14414 raft_consensus.cc:1240] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:01.268466 15194 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:01.260931 15183 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:01.286562 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:01.316239 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:01.316949 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:01.314383 13837 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 4.
I20260709 12:10:01.263125 15095 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:01.329288 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:01.332266 13683 raft_consensus.cc:2468] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 1.
I20260709 12:10:01.330334 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:01.333195 13832 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 1.
I20260709 12:10:01.335583 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:10:01.301707 13617 debug-util.cc:398] Leaking SignalData structure 0x7b0800232520 after lost signal to thread 14440
I20260709 12:10:01.337307 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:01.341859 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:10:01.315685 15197 consensus_meta.cc:287] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.610s	user 0.007s	sys 0.019s
I20260709 12:10:01.344847 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:01.345886 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:01.302726 15081 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:01.347950 15081 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:01.314306 15112 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:01.347086 15193 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:01.350286 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:01.361810 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:01.362249 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:01.368347 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:01.363675 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:01.368997 14413 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 2.
I20260709 12:10:01.369431 13726 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:01.369416 13833 raft_consensus.cc:2468] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 1.
W20260709 12:10:01.333900 13652 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.56.196:46341 timed out after 1.609s (SENT) [suppressed 4 similar messages]
W20260709 12:10:01.354586 15181 consensus_meta.cc:287] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.680s	user 0.017s	sys 0.014s
I20260709 12:10:01.382104 15181 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:01.382607 13681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 1481) took 1059 ms. Trace:
I20260709 12:10:01.383003 13681 rpcz_store.cc:276] 0709 12:10:00.323765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:00.323995 (+   230us) service_pool.cc:224] Handling call
0709 12:10:00.324309 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:00.379157 (+ 54848us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:00.379202 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:00.379265 (+    63us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:00.379309 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:01.382346 (+1003037us) spinlock_profiling.cc:243] Waited 54.6 ms on lock 0x7b54003f11d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:01.382395 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:01.382545 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":125565312}
I20260709 12:10:01.384516 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:01.384704 15181 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:01.385360 15181 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
W20260709 12:10:01.355195 13617 debug-util.cc:398] Leaking SignalData structure 0x7b0800271220 after lost signal to thread 14441
I20260709 12:10:01.349695 15095 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:01.338997 15183 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:01.396050 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:01.396580 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:01.397976 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:01.344095 15097 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:01.337244 15189 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:01.376850 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:01.381292 14413 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41700 (request call id 142) took 1169 ms. Trace:
I20260709 12:10:01.347122 13679 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 4.
I20260709 12:10:01.400738 13687 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 2.
I20260709 12:10:01.400599 14413 rpcz_store.cc:276] 0709 12:10:00.199965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:00.200094 (+   129us) service_pool.cc:224] Handling call
0709 12:10:01.368180 (+1168086us) spinlock_profiling.cc:243] Waited 1.41 ms on lock 0x7b5800003c98. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924e68b71 00007fa924e68a22 00007fa92dd818d9 00007fa92cedbee0 00007fa92cfa50ab 00007fa92cfa5131 00007fa92cf530a0 00007fa92cf52984 00007fa9264cd6d4 00007fa9264cd662
0709 12:10:01.369500 (+  1320us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3250048}
I20260709 12:10:01.402858 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:01.406339 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:01.405225 13687 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 1.
I20260709 12:10:01.402122 15081 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:01.350452 15112 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:01.418460 13682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 1476) took 1408 ms. Trace:
I20260709 12:10:01.364990 15197 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:01.400529 15187 consensus_meta.cc:287] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.584s	user 0.009s	sys 0.018s
I20260709 12:10:01.419111 13682 rpcz_store.cc:276] 0709 12:10:00.009629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:00.026213 (+ 16584us) service_pool.cc:224] Handling call
0709 12:10:00.079109 (+ 52896us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:00.341552 (+262443us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:00.341582 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:00.341623 (+    41us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:00.341653 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:01.417874 (+1076221us) spinlock_profiling.cc:243] Waited 262 ms on lock 0x7b5400285ad4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:01.418189 (+   315us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:01.418374 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":603069184}
I20260709 12:10:01.434846 15112 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:01.439476 13679 raft_consensus.cc:1240] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:01.443583 15183 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:01.432327 15081 raft_consensus.cc:2804] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:01.452732 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:01.448170 15081 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:01.448170 15097 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:01.474212 13800 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:10:01.456729 14977 consensus_meta.cc:287] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.670s	user 0.050s	sys 0.045s
I20260709 12:10:01.401187 15181 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:01.482836 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 154357us
I20260709 12:10:01.478503 13800 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:01.467818 15081 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:01.449407 15187 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:01.501246 15187 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:01.503468 14410 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41700 (request call id 141) took 1330 ms (client timeout 1570 ms). Trace:
I20260709 12:10:01.504046 13800 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:01.506016 13652 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:01.506536 13800 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:10:01.507308 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 137954us
I20260709 12:10:01.507751 13652 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:01.509085 13685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 1480) took 1348 ms. Trace:
I20260709 12:10:01.479795 15198 raft_consensus.cc:2749] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:01.512404 13652 leader_election.cc:304] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:01.510596 15103 raft_consensus.cc:2749] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:01.511000 15186 raft_consensus.cc:2749] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:01.514042 15206 raft_consensus.cc:2749] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:01.516912 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:01.517467 15187 raft_consensus.cc:2749] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:01.518788 15103 raft_consensus.cc:2749] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:01.519760 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:01.521067 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:01.509429 13685 rpcz_store.cc:276] 0709 12:10:00.160791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:00.160961 (+   170us) service_pool.cc:224] Handling call
0709 12:10:00.195116 (+ 34155us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:00.268319 (+ 73203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:00.268365 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:00.268427 (+    62us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:00.268472 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:01.508899 (+1240427us) spinlock_profiling.cc:243] Waited 72.9 ms on lock 0x7b5400272254. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:01.508932 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:01.509033 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":167713024}
I20260709 12:10:01.521662 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:01.504747 15097 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:10:01.527558 15192 consensus_meta.cc:287] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.802s	user 0.036s	sys 0.072s
I20260709 12:10:01.527415 15097 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:01.528086 15192 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:01.529209 13755 raft_consensus.cc:1240] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:01.529929 15203 raft_consensus.cc:2749] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:01.536458 15192 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:01.538621 15209 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:01.536625 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:01.539283 15209 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:01.538174 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:01.542836 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:01.540858 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:01.532989 15183 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:01.546803 15183 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:01.548339 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:01.549996 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:01.550954 15183 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:01.545205 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:10:01.550966 15180 consensus_meta.cc:287] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 1.042s	user 0.016s	sys 0.024s
I20260709 12:10:01.552278 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:01.551752 15208 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:01.553013 15208 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:01.553404 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:01.573691 15197 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:01.574700 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:01.575155 15209 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:01.554387 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:01.552465 15180 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:01.551110 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:01.578470 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:01.578562 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:01.579813 15180 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:01.580099 13834 raft_consensus.cc:1240] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:01.556910 14415 raft_consensus.cc:1240] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:01.557021 14379 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
W20260709 12:10:01.503976 14410 rpcz_store.cc:269] 0709 12:10:00.172803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:00.178063 (+  5260us) service_pool.cc:224] Handling call
0709 12:10:01.503197 (+1325134us) spinlock_profiling.cc:243] Waited 63.5 ms on lock 0x7b54006b0154. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:01.503355 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":146113024}
I20260709 12:10:01.558928 15181 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:01.482122 14977 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:01.561343 15097 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:01.595785 14379 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:01.582962 13833 raft_consensus.cc:1240] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 2 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:01.597327 14379 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:01.568946 15176 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:01.568974 15088 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:01.570060 15092 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:01.555698 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:01.571820 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:10:01.572042 15066 consensus_meta.cc:287] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.836s	user 0.008s	sys 0.017s
I20260709 12:10:01.573057 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:01.604328 15176 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:01.553685 13763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 1597) took 1042 ms. Trace:
I20260709 12:10:01.598611 15156 raft_consensus.cc:2749] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:01.605623 13763 rpcz_store.cc:276] 0709 12:10:00.511137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:00.511288 (+   151us) service_pool.cc:224] Handling call
0709 12:10:00.511599 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:00.692579 (+180980us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:00.692603 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:00.692632 (+    29us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:00.692657 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:01.553432 (+860775us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b54003331d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:01.553479 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:01.553618 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":415832320}
I20260709 12:10:01.555651 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:01.600991 15193 raft_consensus.cc:2749] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:01.576411 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:01.607589 15176 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:01.592880 14977 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:01.608143 13828 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 2.
I20260709 12:10:01.609715 14977 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:01.610683 14977 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:01.615273 15174 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:01.615849 13651 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:01.616636 13652 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:01.616871 15174 consensus_queue.cc:1059] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:01.617333 13651 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:01.617813 15187 raft_consensus.cc:2749] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:01.618376 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:01.576653 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:01.620647 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:01.621074 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:01.622213 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:01.622814 14414 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:01.622972 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 53934.5us
W20260709 12:10:01.585041 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 50396.5us
I20260709 12:10:01.599421 14379 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:01.583665 14411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41692 (request call id 297) took 1168 ms. Trace:
I20260709 12:10:01.600517 15144 raft_consensus.cc:2764] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:10:01.603273 15092 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:01.585688 15147 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:01.603685 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:01.618446 14977 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:01.625066 15081 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:01.626899 15174 raft_consensus.cc:2749] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:01.626618 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:01.611191 15195 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:01.630095 15142 raft_consensus.cc:3055] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:01.629528 15066 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:01.649935 15142 raft_consensus.cc:740] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:01.650941 13681 raft_consensus.cc:1240] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:01.651510 15142 consensus_queue.cc:260] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:01.656867 15066 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:01.630201 15156 raft_consensus.cc:2749] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:01.630337 15187 raft_consensus.cc:2804] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:01.659407 15187 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:01.659834 15187 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:01.653298 15142 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:01.630384 14410 raft_consensus.cc:1240] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:01.662464 13582 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53318 (request call id 137) took 3500 ms. Trace:
I20260709 12:10:01.628466 14379 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:01.631345 14412 raft_consensus.cc:1275] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:01.628679 13651 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:01.632736 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:01.664896 13651 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:01.626271 14411 rpcz_store.cc:276] 0709 12:10:00.415052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:00.415317 (+   265us) service_pool.cc:224] Handling call
0709 12:10:01.510030 (+1094713us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:01.516077 (+  6047us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:01.516109 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:01.516151 (+    42us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:01.516187 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:01.516248 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:01.583421 (+ 67173us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54006b0150. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:01.583571 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2476413184}
I20260709 12:10:01.635550 13686 raft_consensus.cc:1240] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:01.666779 13651 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:01.667604 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:01.646067 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:10:01.668794 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 44456.6us
W20260709 12:10:01.642588 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:01.630714 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:01.644536 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:01.670660 13828 raft_consensus.cc:3055] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:01.671054 13828 raft_consensus.cc:740] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:01.671929 15156 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:01.632967 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:01.643936 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:01.638264 15095 consensus_queue.cc:1059] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:10:01.673167 15066 raft_consensus.cc:2749] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:01.641760 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:01.675308 13800 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:01.675925 13651 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:01.576592 15208 leader_election.cc:290] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:01.677248 13800 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:01.678490 15173 raft_consensus.cc:2749] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:01.638027 13754 raft_consensus.cc:1240] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:01.689083 15195 raft_consensus.cc:2749] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:01.689458 15174 raft_consensus.cc:2749] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:01.662884 13582 rpcz_store.cc:276] 0709 12:09:58.181909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:58.188671 (+  6762us) service_pool.cc:224] Handling call
0709 12:09:58.313509 (+124838us) spinlock_profiling.cc:243] Waited 1.89 ms on lock 0x7b54002eff90. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924e68b71 00007fa924e690b2 00007fa92dde2759 00007fa92dd7aa76 00007fa92dd4bd58 00007fa92de4a04e 00007fa92c30b2a4 00007fa92c30b232 00007fa92c30b161 00007fa92c30b0dc
0709 12:09:58.564248 (+250739us) spinlock_profiling.cc:243] Waited 250 ms on lock 0x7b5400373cd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef7090 00007fa927f95f3a 00007fa92dd4be9c 00007fa92de4a04e 00007fa92c30b2a4 00007fa92c30b232 00007fa92c30b161 00007fa92c30b0dc 00007fa92c30a392 00007fa9262c848c 00007fa9262c78c6
0709 12:10:01.662369 (+3098121us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:00.297883 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:00.395432 (+ 97549us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:00.396594 (+  1162us) write_op.cc:435] Acquired schema lock
0709 12:10:00.397320 (+   726us) tablet.cc:662] Decoding operations
0709 12:10:00.422845 (+ 25525us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:00.428281 (+  5436us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:00.431295 (+  3014us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:10:00.475318 (+ 44023us) tablet.cc:701] Row locks acquired
0709 12:10:00.480917 (+  5599us) write_op.cc:260] PREPARE: finished
0709 12:10:00.491850 (+ 10933us) write_op.cc:270] Start()
0709 12:10:00.500878 (+  9028us) write_op.cc:276] Timestamp: P: 1783599000488830 usec, L: 0
0709 12:10:00.504522 (+  3644us) op_driver.cc:348] REPLICATION: starting
0709 12:10:00.590958 (+ 86436us) log.cc:844] Serialized 599 byte log entry
0709 12:10:01.237765 (+646807us) op_driver.cc:464] REPLICATION: finished
0709 12:10:01.350927 (+113162us) write_op.cc:301] APPLY: starting
0709 12:10:01.351038 (+   111us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:01.351188 (+   150us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:01.351345 (+   157us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:01.351696 (+   351us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:01.351922 (+   226us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:10:01.352000 (+    78us) write_op.cc:312] APPLY: finished
0709 12:10:01.352252 (+   252us) log.cc:844] Serialized 23 byte log entry
0709 12:10:01.352450 (+   198us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:01.352542 (+    92us) write_op.cc:454] Released schema lock
0709 12:10:01.352581 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:01.352971 (+   390us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:01.353002 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":269750,"reported_tablets":1,"spinlock_wait_cycles":578547456,"child_traces":[["op",{"apply.queue_time_us":112803,"apply.run_cpu_time_us":2040,"apply.run_wall_time_us":2042,"num_ops":1,"prepare.queue_time_us":1582474,"prepare.run_cpu_time_us":32074,"prepare.run_wall_time_us":456395,"raft.queue_time_us":226058,"raft.run_cpu_time_us":1256,"raft.run_wall_time_us":105643,"replication_time_us":733025,"thread_start_us":308701,"threads_started":3,"wal-append.queue_time_us":168734}]]}
I20260709 12:10:01.673631 15095 consensus_queue.cc:1243] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Peer 96701a74fdee481fb5f54aac841e17dd log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:10:01.678876 15201 raft_consensus.cc:2749] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:01.704707 13585 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45620 (request call id 243) took 3566 ms. Trace:
I20260709 12:10:01.705147 13585 rpcz_store.cc:276] 0709 12:09:58.138563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:58.140880 (+  2317us) service_pool.cc:224] Handling call
0709 12:10:01.704471 (+3563591us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52878,"reported_tablets":5}
I20260709 12:10:01.705960 13680 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:01.680455 13828 consensus_queue.cc:260] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:01.639153 15092 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:01.636994 14414 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 2.
I20260709 12:10:01.676980 15212 raft_consensus.cc:2749] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:01.714900 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:01.715251 13830 consensus_queue.cc:237] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:01.667613 14379 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:01.640353 15081 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:01.717970 15156 raft_consensus.cc:2749] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:10:01.717077 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 53247.6us
I20260709 12:10:01.721463 14379 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:01.722302 14415 raft_consensus.cc:1240] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:01.715018 15187 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:01.723495 13680 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 2.
I20260709 12:10:01.724668 13680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 969) took 1007 ms. Trace:
I20260709 12:10:01.725018 13680 rpcz_store.cc:276] 0709 12:10:00.717187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:00.778852 (+ 61665us) service_pool.cc:224] Handling call
0709 12:10:01.636791 (+857939us) spinlock_profiling.cc:243] Waited 462 ms on lock 0x7b58002237d0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927ee90aa 00007fa927f6b447 00007fa927f83fe7 00007fa927f857de 00007fa927f9127c 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c
0709 12:10:01.679503 (+ 42712us) spinlock_profiling.cc:243] Waited 1.5 ms on lock 0x7b58000428d0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927ee90aa 00007fa927f6b447 00007fa927f83fe7 00007fa927f857de 00007fa927f9127c 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c
0709 12:10:01.705550 (+ 26047us) spinlock_profiling.cc:243] Waited 21.4 ms on lock 0x7b54002510a0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f02a1d 00007fa927ee91a4 00007fa927f6b447 00007fa927f83fe7 00007fa927f857de 00007fa927f9127c 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591
0709 12:10:01.724598 (+ 19048us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1114415104}
I20260709 12:10:01.725066 15187 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:01.727864 15156 raft_consensus.cc:2804] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:01.728363 15156 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:01.728863 15156 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:01.687758 13800 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:01.687986 13727 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
W20260709 12:10:01.734938 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 47059.4us
I20260709 12:10:01.735132 15081 raft_consensus.cc:2749] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:01.736367 13727 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:01.581707 15194 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:01.690380 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:01.701742 13583 catalog_manager.cc:5697] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 reported cstate change: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:01.738134 13727 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:01.739142 15213 raft_consensus.cc:2749] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:01.739035 15194 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:01.738933 13583 catalog_manager.cc:5697] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: config changed from index 2 to 3, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:01.741276 15194 raft_consensus.cc:2749] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:01.738997 15092 raft_consensus.cc:2749] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:01.742481 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 54802.1us
I20260709 12:10:01.743997 13800 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:01.703155 13801 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:01.678000 13651 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:01.745496 15194 raft_consensus.cc:2749] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:10:01.746822 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 68900.6us
I20260709 12:10:01.747187 15142 raft_consensus.cc:2749] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:01.747663 13651 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:01.708756 15195 consensus_queue.cc:1059] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:01.749012 13651 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:01.750027 15142 raft_consensus.cc:2749] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:01.751282 15212 raft_consensus.cc:2749] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:01.752074 13800 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:10:01.754429 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 51364.8us
I20260709 12:10:01.756408 13727 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:01.760567 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:01.762046 13651 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:01.775533 13727 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:01.778944 13652 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:01.776510 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:01.780529 13828 raft_consensus.cc:3060] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:01.785935 15155 raft_consensus.cc:2749] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:01.759900 15173 raft_consensus.cc:2749] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:01.761731 15069 consensus_queue.cc:1059] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:10:01.799832 15069 raft_consensus.cc:3055] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:01.800488 15069 raft_consensus.cc:740] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:01.804055 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:01.798413 13652 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:01.801990 15176 consensus_queue.cc:1059] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:01.810433 15137 consensus_queue.cc:1059] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:01.811491 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:01.762879 15148 raft_consensus.cc:2749] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:01.811655 15137 raft_consensus.cc:3055] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:01.812825 15137 raft_consensus.cc:740] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:01.813619 15156 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:01.814047 15137 consensus_queue.cc:260] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:01.815593 15137 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:01.816136 15156 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:01.782019 15081 raft_consensus.cc:2749] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:01.822656 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 47249.8us
I20260709 12:10:01.823952 13727 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:01.822508 15081 raft_consensus.cc:2749] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:01.827456 15181 raft_consensus.cc:993] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7: : Instructing follower 96701a74fdee481fb5f54aac841e17dd to start an election
I20260709 12:10:01.827910 15181 raft_consensus.cc:1081] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 LEADER]: Signalling peer 96701a74fdee481fb5f54aac841e17dd to start an election
I20260709 12:10:01.834618 13727 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:01.837145 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:01.839136 13727 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:01.820992 15174 raft_consensus.cc:2749] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:01.842546 13727 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:01.841655 15081 raft_consensus.cc:2749] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:01.845083 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:01.843202 15208 raft_consensus.cc:2749] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:10:01.847852 13800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:01.848140 13727 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:01.847052 15081 raft_consensus.cc:2804] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:01.851394 15081 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:01.851613 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:01.851958 15081 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:01.854422 13680 raft_consensus.cc:3060] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:01.855634 13828 raft_consensus.cc:2468] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 2.
I20260709 12:10:01.856792 13800 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:01.857012 13727 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:01.854060 15208 raft_consensus.cc:2804] T c95811190f014949bb25448e8db1040e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:01.861485 15208 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:01.862474 15194 raft_consensus.cc:2749] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:01.863227 15208 raft_consensus.cc:3060] T c95811190f014949bb25448e8db1040e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:01.866901 13828 raft_consensus.cc:1240] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:01.880458 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:01.868767 13652 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:01.869493 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:10:01.870353 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 112283us
I20260709 12:10:01.881868 13759 raft_consensus.cc:1275] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:01.872135 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:01.888850 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:01.879971 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:01.888617 15212 raft_consensus.cc:2749] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:01.890588 13837 raft_consensus.cc:1275] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:01.890487 15086 consensus_queue.cc:1048] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:01.864172 15181 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:01.896448 15181 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:01.897261 15181 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:01.902477 13800 leader_election.cc:304] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:01.903704 13830 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f1494f6353074242857c7901c21da06d"
dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:54820
I20260709 12:10:01.904240 15194 raft_consensus.cc:2749] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:01.904414 13830 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:01.904827 13830 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:01.906508 13652 leader_election.cc:304] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:01.883746 15066 raft_consensus.cc:2749] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:01.910247 15212 raft_consensus.cc:2749] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:01.879962 15069 consensus_queue.cc:260] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:01.910733 13800 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:01.911603 15173 raft_consensus.cc:2749] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:01.911943 15069 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:01.917209 13800 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:01.919179 15173 raft_consensus.cc:2749] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:01.920557 15214 log.cc:927] Time spent T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:10:01.923419 14379 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:01.926391 14379 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:01.931010 13680 raft_consensus.cc:2468] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 2.
I20260709 12:10:01.933835 13652 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:01.945662 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:01.929996 15144 raft_consensus.cc:2749] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:10:01.957204 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 72384us
I20260709 12:10:01.950985 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:01.943882 15095 raft_consensus.cc:2749] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:01.962090 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:01.967721 14379 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:01.970688 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:01.973165 15144 raft_consensus.cc:2749] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:01.974352 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:01.975060 13758 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 1.
I20260709 12:10:01.976780 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:01.977285 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:01.978233 15173 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:01.978389 14380 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:01.978878 15173 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:01.979789 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 93212us
I20260709 12:10:01.980063 15194 consensus_queue.cc:1059] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:01.981303 15216 raft_consensus.cc:2804] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:01.981515 15088 raft_consensus.cc:3055] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:01.981962 15216 raft_consensus.cc:697] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 2 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:01.982193 15088 raft_consensus.cc:740] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:01.982693 14415 raft_consensus.cc:1275] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:01.983124 15216 consensus_queue.cc:237] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:01.983518 15088 consensus_queue.cc:260] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:01.943486 15081 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:01.986423 14413 raft_consensus.cc:1275] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:01.986563 13800 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:01.988164 14379 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:01.985154 15217 consensus_queue.cc:1059] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:01.991034 15088 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:01.991636 15193 raft_consensus.cc:3055] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:01.970417 13830 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:01.993322 14379 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:01.995584 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:01.997234 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:01.977514 15208 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:01.992285 14936 raft_consensus.cc:2749] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:02.006188 15176 consensus_queue.cc:1048] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:02.006768 13762 raft_consensus.cc:1240] T c95811190f014949bb25448e8db1040e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:02.003314 13830 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:02.007638 15210 consensus_queue.cc:1059] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:02.011198 15147 consensus_queue.cc:1048] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:02.012014 15210 raft_consensus.cc:3055] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:02.015390 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:02.003440 14379 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:02.004330 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:02.005167 14415 raft_consensus.cc:1240] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:02.024081 15156 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:01.994380 15193 raft_consensus.cc:740] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:02.015507 15195 consensus_queue.cc:1048] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 12:10:02.024727 15156 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:02.025573 15193 consensus_queue.cc:260] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:02.027201 15156 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:02.012626 15148 raft_consensus.cc:2749] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:02.012451 15210 raft_consensus.cc:740] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:01.994483 15144 raft_consensus.cc:2749] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:02.022627 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:02.023489 15181 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:02.028849 15210 consensus_queue.cc:260] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:02.031031 15210 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:01.991173 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:02.014828 13727 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:02.034456 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:02.041083 13688 raft_consensus.cc:1240] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:02.045984 13727 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:02.047816 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:02.047847 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:02.049165 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:02.038192 14936 raft_consensus.cc:2749] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:02.052039 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:02.052687 13759 raft_consensus.cc:3055] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:02.053040 13759 raft_consensus.cc:740] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:02.028215 15193 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.008692 15217 raft_consensus.cc:2749] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:02.036322 15208 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:02.059098 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:02.062122 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:02.064076 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:02.064855 13688 raft_consensus.cc:1275] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:02.054373 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:02.062490 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:02.031005 15181 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:02.037096 15213 raft_consensus.cc:2804] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:02.072383 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:02.071673 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:02.072376 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:02.038509 15173 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:02.058377 15183 raft_consensus.cc:2749] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:02.079586 13681 raft_consensus.cc:1275] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:02.048935 15176 consensus_queue.cc:1059] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:10:02.080498 15213 raft_consensus.cc:697] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:02.081143 15176 raft_consensus.cc:3055] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:02.082866 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:02.038398 15194 consensus_queue.cc:1059] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:10:02.091900 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:02.081558 15176 raft_consensus.cc:740] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:02.104785 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:02.108670 13762 raft_consensus.cc:1240] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:02.054320 13759 consensus_queue.cc:260] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:02.095387 15213 consensus_queue.cc:237] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:02.136219 15176 consensus_queue.cc:260] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:02.141444 15081 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:02.126338 15209 consensus_queue.cc:1048] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:10:02.144778 13759 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:02.147657 15173 raft_consensus.cc:3055] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:02.148159 15173 raft_consensus.cc:740] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:02.154861 15015 raft_consensus.cc:2955] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:10:02.156617 13754 raft_consensus.cc:2955] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:10:02.123754 15195 consensus_queue.cc:1059] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:10:02.158382 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:02.159439 15195 raft_consensus.cc:3055] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:02.160079 15195 raft_consensus.cc:740] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:02.149024 15173 consensus_queue.cc:260] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:02.167958 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:02.169721 15173 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:02.170604 15176 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:02.160988 15195 consensus_queue.cc:260] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:02.183812 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:02.212369 15195 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.218868 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:02.235009 13727 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:02.238238 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:02.242020 13727 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:02.255786 13836 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 3.
I20260709 12:10:02.251298 15019 raft_consensus.cc:2749] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:02.271382 14410 raft_consensus.cc:2955] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:10:02.279816 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:02.280705 13680 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 4.
I20260709 12:10:02.281630 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:02.283242 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:02.284734 13680 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:02.286485 13685 raft_consensus.cc:1275] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:02.287326 13686 raft_consensus.cc:1240] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:02.290505 13571 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1e31cd7111f2470d8d34b5898dce5765 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:10:02.291564 13759 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 6.
I20260709 12:10:02.292492 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:02.291711 15019 raft_consensus.cc:2749] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:02.294592 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:02.295001 13800 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
W20260709 12:10:02.296020 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 54083.1us
I20260709 12:10:02.296896 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:02.303479 13688 raft_consensus.cc:2393] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 2: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:02.301357 13727 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:02.306998 13758 raft_consensus.cc:1240] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:02.308274 15189 raft_consensus.cc:2749] T c95811190f014949bb25448e8db1040e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:02.301121 13726 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:02.309892 15015 raft_consensus.cc:2804] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:02.310590 15189 raft_consensus.cc:2749] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:02.311408 15015 raft_consensus.cc:697] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 6 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:02.311795 13726 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:02.312718 15189 raft_consensus.cc:2749] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:02.312978 13726 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:02.312743 15015 consensus_queue.cc:237] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:02.323402 13800 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:02.326877 13726 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:02.328363 13800 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:02.336580 15172 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:02.339437 15172 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:02.340852 15172 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:02.331477 13585 catalog_manager.cc:5697] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 1 to 2, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 2 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:02.344658 13583 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45610 (request call id 250) took 3918 ms. Trace:
I20260709 12:10:02.346812 13585 catalog_manager.cc:5697] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 3 to 4, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 4 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:02.349939 13680 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 6.
I20260709 12:10:02.351112 15142 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:02.347410 13688 consensus_queue.cc:237] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:02.351841 15142 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:02.345340 13583 rpcz_store.cc:276] 0709 12:09:58.425993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:58.556426 (+130433us) service_pool.cc:224] Handling call
0709 12:10:02.344574 (+3788148us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:01.862244 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:01.922207 (+ 59963us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:01.922246 (+    39us) write_op.cc:435] Acquired schema lock
0709 12:10:01.922263 (+    17us) tablet.cc:662] Decoding operations
0709 12:10:01.954293 (+ 32030us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:01.954371 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:01.954399 (+    28us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:10:01.954826 (+   427us) tablet.cc:701] Row locks acquired
0709 12:10:01.954846 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:10:01.955008 (+   162us) write_op.cc:270] Start()
0709 12:10:01.955242 (+   234us) write_op.cc:276] Timestamp: P: 1783599001954963 usec, L: 0
0709 12:10:01.955320 (+    78us) op_driver.cc:348] REPLICATION: starting
0709 12:10:01.959522 (+  4202us) log.cc:844] Serialized 1045 byte log entry
0709 12:10:02.035474 (+ 75952us) op_driver.cc:464] REPLICATION: finished
0709 12:10:02.246958 (+211484us) write_op.cc:301] APPLY: starting
0709 12:10:02.247041 (+    83us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:02.247158 (+   117us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:02.247277 (+   119us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:02.254439 (+  7162us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:02.255004 (+   565us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:10:02.255045 (+    41us) write_op.cc:312] APPLY: finished
0709 12:10:02.255310 (+   265us) log.cc:844] Serialized 29 byte log entry
0709 12:10:02.255547 (+   237us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:02.255799 (+   252us) write_op.cc:454] Released schema lock
0709 12:10:02.255847 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:02.256428 (+   581us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:02.256458 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":16605,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":200117,"apply.run_cpu_time_us":2971,"apply.run_wall_time_us":9428,"num_ops":2,"prepare.queue_time_us":103817,"prepare.run_cpu_time_us":4791,"prepare.run_wall_time_us":99462,"replication_time_us":79964,"spinlock_wait_cycles":112384,"thread_start_us":216126,"threads_started":2}]]}
I20260709 12:10:02.328311 15189 raft_consensus.cc:2749] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:02.355677 15142 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:02.352819 15092 raft_consensus.cc:2749] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:02.359368 13681 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 2.
I20260709 12:10:02.377753 13726 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:02.382690 13726 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
W20260709 12:10:02.389532 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:02.393303 13800 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:10:02.398561 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 365721us
I20260709 12:10:02.400444 14379 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:02.366001 15088 raft_consensus.cc:2749] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:02.404881 14379 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:02.430856 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:02.431185 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:02.394184 15147 raft_consensus.cc:2749] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:02.408455 15149 raft_consensus.cc:2749] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:02.407327 15216 raft_consensus.cc:2749] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:02.387445 15173 consensus_queue.cc:1048] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 12:10:02.455476 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:02.390941 15183 consensus_queue.cc:1059] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 12:10:02.393050 15015 consensus_queue.cc:1059] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 12:10:02.426851 15217 raft_consensus.cc:2749] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:02.437237 15210 raft_consensus.cc:2749] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:10:02.454792 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 57598.3us
I20260709 12:10:02.470419 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:02.483943 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:02.484843 13679 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 2.
I20260709 12:10:02.459451 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:10:02.468616 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 94310us
I20260709 12:10:02.492560 15172 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:02.504159 15195 raft_consensus.cc:3055] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:02.504667 15195 raft_consensus.cc:740] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:02.507843 13727 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:02.509088 13727 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:02.474452 14379 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:02.521190 13652 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:02.524634 14379 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:02.506852 15092 raft_consensus.cc:3055] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:02.505615 15195 consensus_queue.cc:260] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:02.526806 14379 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:02.530512 15172 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:10:02.532258 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:02.527570 15210 raft_consensus.cc:2804] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:02.525484 15208 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:02.528148 15201 raft_consensus.cc:2749] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:02.519773 14936 raft_consensus.cc:2749] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:02.567314 13830 raft_consensus.cc:1240] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:02.572306 13762 raft_consensus.cc:1240] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:02.575273 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:02.560613 13652 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:02.582183 14412 raft_consensus.cc:1275] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260709 12:10:02.584362 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 204376us
I20260709 12:10:02.590487 13837 raft_consensus.cc:1275] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:10:02.527637 15225 raft_consensus.cc:2749] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:02.527652 15092 raft_consensus.cc:740] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:02.611291 13828 raft_consensus.cc:1275] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:02.616061 13726 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:02.621119 13726 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:02.587013 15233 raft_consensus.cc:2749] T 1e31cd7111f2470d8d34b5898dce5765 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:02.597507 15210 raft_consensus.cc:697] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:02.602909 15193 raft_consensus.cc:2804] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:02.633654 15092 consensus_queue.cc:260] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:02.586103 15156 consensus_queue.cc:1059] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:10:02.637681 13582 catalog_manager.cc:5697] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 1 to 2, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 2 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:02.671624 15092 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:02.603926 15174 consensus_queue.cc:1048] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 12:10:02.625149 15209 raft_consensus.cc:2749] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:02.688917 13681 raft_consensus.cc:1275] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:10:02.684908 15231 log.cc:927] Time spent T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:10:02.681588 15216 raft_consensus.cc:3055] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:02.624868 15147 consensus_queue.cc:1048] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
W20260709 12:10:02.728843 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 54518.2us
I20260709 12:10:02.693351 15144 consensus_queue.cc:1048] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:10:02.737910 15236 consensus_queue.cc:1048] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
W20260709 12:10:02.741302 15237 log.cc:927] Time spent T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:10:02.746574 15210 consensus_queue.cc:237] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:02.760829 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 101973us
I20260709 12:10:02.761803 13726 leader_election.cc:304] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:02.786883 13726 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
W20260709 12:10:02.787747 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 161166us
I20260709 12:10:02.696076 15216 raft_consensus.cc:740] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:02.788451 13726 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:02.789535 13651 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:10:02.794703 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 43742us
I20260709 12:10:02.795706 13651 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:02.731163 15244 raft_consensus.cc:2749] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:02.793453 15081 raft_consensus.cc:2749] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:02.739398 15142 consensus_queue.cc:1048] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 12:10:02.793205 15019 raft_consensus.cc:2749] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:02.796234 15183 raft_consensus.cc:2749] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:02.809371 15242 consensus_queue.cc:1048] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:10:02.814600 15155 raft_consensus.cc:2749] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:02.796209 15095 raft_consensus.cc:2749] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:02.852174 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 46162.7us
I20260709 12:10:02.860952 13758 raft_consensus.cc:1275] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 12:10:02.867986 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 69191.7us
W20260709 12:10:02.872900 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 64143.9us
W20260709 12:10:02.873595 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 77990us
I20260709 12:10:02.874533 13651 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:02.878245 13651 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:02.879617 13651 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:02.881053 13651 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:02.882066 15253 raft_consensus.cc:2804] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:02.882391 13651 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:02.882625 15253 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:02.870115 15088 consensus_queue.cc:1048] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:10:02.877477 15095 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:02.880409 15247 raft_consensus.cc:2749] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:02.865643 15245 consensus_queue.cc:1059] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:10:02.863262 15216 consensus_queue.cc:260] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:02.885810 15253 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:02.893883 15252 raft_consensus.cc:2749] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:02.897395 15216 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:02.900391 15251 consensus_queue.cc:1175] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "96701a74fdee481fb5f54aac841e17dd" responder_term: 2 status { last_received { term: 2 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 2 index: 5 } }
I20260709 12:10:02.905185 15233 raft_consensus.cc:2749] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:10:03.022166 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 160252us
I20260709 12:10:03.029211 15208 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
W20260709 12:10:03.021699 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 139365us
W20260709 12:10:03.032164 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:03.034241 15195 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:03.029942 15208 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:03.026666 15232 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:03.044915 15232 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:03.045696 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:03.046516 13651 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:03.062601 15155 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:03.062713 15208 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:03.070425 15155 consensus_queue.cc:1059] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:03.071645 15155 raft_consensus.cc:3055] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:03.072024 15155 raft_consensus.cc:740] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:03.072860 15155 consensus_queue.cc:260] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:03.075364 15155 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.065223 15232 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:10:03.088912 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:03.092415 15212 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:03.096841 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:03.097851 13684 raft_consensus.cc:2393] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 2: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:03.093303 15212 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:03.100687 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:03.108484 13683 raft_consensus.cc:1275] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:10:03.100824 15137 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:03.112344 15193 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:03.112953 15193 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:03.116618 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:03.120182 15168 raft_consensus.cc:3055] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:03.120721 15168 raft_consensus.cc:740] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:03.112957 15137 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:03.122104 15168 consensus_queue.cc:260] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:03.123572 15168 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:03.125339 15137 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:03.126008 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:03.126756 14410 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 2.
I20260709 12:10:03.129698 13837 raft_consensus.cc:1275] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:03.131688 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:03.136374 13836 raft_consensus.cc:1240] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:03.127590 14408 raft_consensus.cc:1275] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:03.138384 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:03.141070 13836 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 2.
I20260709 12:10:03.146087 15253 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:03.151648 13727 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:03.152906 15232 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:03.155596 15232 consensus_queue.cc:1048] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:03.152922 15253 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:03.162905 15181 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
W20260709 12:10:03.163695 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:03.163532 15181 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:03.157078 13684 raft_consensus.cc:1240] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:03.167250 15181 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:03.172757 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:03.177692 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:03.181682 13800 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:03.188151 15212 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:03.185417 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:03.176512 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:03.193837 13684 raft_consensus.cc:2393] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 2: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:03.198858 13800 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:03.199241 13801 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:03.203737 15189 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:03.204402 15189 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:03.206784 15189 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:03.207559 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:03.218401 15173 raft_consensus.cc:2804] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:03.219148 15173 raft_consensus.cc:697] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 2 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:03.220104 15173 consensus_queue.cc:237] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:03.222045 15193 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:03.224992 15193 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 3 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:03.226147 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:03.230043 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:03.218536 15088 raft_consensus.cc:2804] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:03.235141 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:03.238252 14380 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:03.229612 13582 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45620 (request call id 244) took 1494 ms. Trace:
I20260709 12:10:03.236426 13651 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:03.222105 15144 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:03.242995 15144 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:03.249645 15253 raft_consensus.cc:2955] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
W20260709 12:10:03.254261 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 43764.9us
I20260709 12:10:03.262120 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:03.262938 13687 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 2.
W20260709 12:10:03.267683 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 51744us
I20260709 12:10:03.217221 15137 raft_consensus.cc:2749] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:03.270222 13726 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:03.236104 15088 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:03.268467 15217 raft_consensus.cc:2749] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:03.272166 15176 consensus_queue.cc:1048] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:10:03.272465 15088 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:03.273823 15208 consensus_queue.cc:1048] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 12:10:03.288555 15144 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:03.240041 13582 rpcz_store.cc:276] 0709 12:10:01.735307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:01.735471 (+   164us) service_pool.cc:224] Handling call
0709 12:10:02.685928 (+950457us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:02.685967 (+    39us) write_op.cc:454] Released schema lock
0709 12:10:03.229547 (+543580us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:02.674674 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:02.675335 (+   661us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:02.675378 (+    43us) write_op.cc:435] Acquired schema lock
0709 12:10:02.675401 (+    23us) tablet.cc:662] Decoding operations
0709 12:10:02.675822 (+   421us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:02.675896 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:02.675931 (+    35us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:10:02.676168 (+   237us) tablet.cc:701] Row locks acquired
0709 12:10:02.676185 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:10:02.676356 (+   171us) write_op.cc:270] Start()
0709 12:10:02.676485 (+   129us) write_op.cc:276] Timestamp: P: 1783599002676305 usec, L: 0
0709 12:10:02.676510 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:10:02.677231 (+   721us) log.cc:844] Serialized 536 byte log entry
0709 12:10:02.679518 (+  2287us) op_driver.cc:464] REPLICATION: finished
0709 12:10:02.679881 (+   363us) write_op.cc:301] APPLY: starting
0709 12:10:02.679965 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:02.680090 (+   125us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:02.680379 (+   289us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:02.680648 (+   269us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:02.680791 (+   143us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:10:02.680835 (+    44us) write_op.cc:312] APPLY: finished
0709 12:10:02.681316 (+   481us) log.cc:844] Serialized 23 byte log entry
0709 12:10:02.681502 (+   186us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:02.681592 (+    90us) write_op.cc:454] Released schema lock
0709 12:10:02.681767 (+   175us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":131,"apply.run_cpu_time_us":2204,"apply.run_wall_time_us":2204,"num_ops":1,"prepare.queue_time_us":6420,"prepare.run_cpu_time_us":2857,"prepare.run_wall_time_us":2856,"replication_time_us":2852}]]}
I20260709 12:10:03.305650 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:03.310529 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:03.308421 13727 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:03.312458 13800 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:03.317250 13681 raft_consensus.cc:2393] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 2: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:03.291119 15194 consensus_queue.cc:1059] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 12:10:03.285616 13754 consensus_queue.cc:237] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:03.306066 15232 raft_consensus.cc:2804] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:03.330866 14379 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:03.334615 13835 raft_consensus.cc:1275] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:03.337409 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:03.338398 13830 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 2.
I20260709 12:10:03.339668 15232 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:03.342909 15232 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:03.343453 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:03.344277 13828 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 2.
I20260709 12:10:03.322889 15069 raft_consensus.cc:2749] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:03.339115 15209 raft_consensus.cc:2804] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:03.357089 15209 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:03.357690 15209 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.343961 15194 raft_consensus.cc:3055] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:03.339219 15217 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:03.370712 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:03.373579 13727 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:03.350564 15174 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:03.378422 15147 consensus_queue.cc:1048] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:03.363207 15194 raft_consensus.cc:740] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:03.384021 15238 raft_consensus.cc:2804] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:03.409425 15238 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:03.420962 13586 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53318 (request call id 138) took 1581 ms. Trace:
I20260709 12:10:03.421537 13586 rpcz_store.cc:276] 0709 12:10:01.839209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:01.839433 (+   224us) service_pool.cc:224] Handling call
0709 12:10:03.420878 (+1581445us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":109245,"reported_tablets":3}
I20260709 12:10:02.702597 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:03.422693 13585 catalog_manager.cc:5697] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 1 to 2, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 2 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:03.418562 15238 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.396602 15174 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:03.495175 13583 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45610 (request call id 251) took 1084 ms. Trace:
I20260709 12:10:03.448460 15225 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:03.495638 13583 rpcz_store.cc:276] 0709 12:10:02.410765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:02.410919 (+   154us) service_pool.cc:224] Handling call
0709 12:10:02.553495 (+142576us) spinlock_profiling.cc:243] Waited 22.1 ms on lock 0x7b54002eff90. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924e68b71 00007fa924e690b2 00007fa92dde2759 00007fa92dd7aa76 00007fa92dd4bd58 00007fa92de4a04e 00007fa92c30b2a4 00007fa92c30b232 00007fa92c30b161 00007fa92c30b0dc
0709 12:10:03.495102 (+941607us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":257809,"reported_tablets":1,"spinlock_wait_cycles":50774400}
W20260709 12:10:03.498309 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 148572us
I20260709 12:10:03.497805 13585 catalog_manager.cc:5697] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: config changed from index 4 to 5, VOTER b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) evicted. New cstate: current_term: 2 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:10:03.479633 15155 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:03.477453 15212 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:03.518108 13652 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:03.562760 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:03.340660 14409 raft_consensus.cc:2955] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:10:03.554788 15095 raft_consensus.cc:2749] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:03.491196 15194 consensus_queue.cc:260] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:03.585067 15253 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:41682 (request call id 79) took 1239 ms. Trace:
I20260709 12:10:03.585701 15253 rpcz_store.cc:276] 0709 12:10:02.345358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:02.345529 (+   171us) service_pool.cc:224] Handling call
0709 12:10:02.376954 (+ 31425us) log.cc:844] Serialized 501 byte log entry
0709 12:10:02.899866 (+522912us) spinlock_profiling.cc:243] Waited 5.71 ms on lock 0x7b5400201118. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f497bc 00007fa927f4c2c0 00007fa927f4c248 00007fa927f4c1c8 00007fa927f4c183 00007fa927f4b44c 00007fa92ddf82f6 00007fa92ddf2aa8 00007fa927b34b41 00007fa927b27f2a
0709 12:10:03.584928 (+685062us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36347,"raft.queue_time_us":28139,"raft.run_cpu_time_us":1460,"raft.run_wall_time_us":34394,"spinlock_wait_cycles":13136768,"thread_start_us":100284,"threads_started":1,"wal-append.queue_time_us":211589}
I20260709 12:10:03.520429 15225 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:03.536998 15212 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:03.558881 15155 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:03.607221 15266 log.cc:927] Time spent T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:10:03.610662 15066 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:03.611541 15066 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:03.622398 15194 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:03.644052 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 128623us
I20260709 12:10:03.626569 15209 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:03.677731 13680 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:03.678038 14412 raft_consensus.cc:1240] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:03.680099 15201 raft_consensus.cc:2749] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:03.711815 15269 log.cc:927] Time spent T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:10:03.715721 15209 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:03.696300 15195 consensus_queue.cc:1059] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:10:03.717710 15195 raft_consensus.cc:3055] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:03.717453 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:03.718214 15195 raft_consensus.cc:740] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:03.718787 13686 raft_consensus.cc:2393] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 2: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:03.719211 15195 consensus_queue.cc:260] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:03.720729 15195 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:03.730597 15225 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:03.732214 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:03.732991 13830 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 3.
I20260709 12:10:03.734277 15174 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:03.734727 14380 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:03.736256 14936 raft_consensus.cc:2804] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:03.736712 14936 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:03.737123 14936 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:03.739990 13680 raft_consensus.cc:1275] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:03.740049 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:03.741545 15212 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:03.730255 15238 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:03.750133 15155 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:03.745028 15232 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:03.764786 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:03.737534 15217 raft_consensus.cc:2749] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:10:03.810575 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 55750us
I20260709 12:10:03.811257 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:10:03.823833 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 74155.3us
I20260709 12:10:03.826601 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:03.827409 13680 raft_consensus.cc:2393] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 2: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:03.828121 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:03.828979 14407 raft_consensus.cc:2393] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 2: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:10:03.832899 15209 consensus_queue.cc:1048] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:03.752585 15238 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:03.840299 13832 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 2.
W20260709 12:10:03.842267 15088 consensus_meta.cc:287] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.554s	user 0.013s	sys 0.000s
I20260709 12:10:03.842762 15088 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:03.844115 13834 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 2.
I20260709 12:10:03.844281 15168 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:03.846141 15232 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:03.736366 15066 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:03.845801 15168 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:03.844264 13828 raft_consensus.cc:1240] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:10:03.854046 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:03.854928 13680 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:03.810088 15149 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:03.875707 15149 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:03.878285 15149 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:03.879369 13757 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "b98d2519bb504dc6905ed2ede4571835"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:10:03.883239 13757 raft_consensus.cc:606] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 LEADER]: Received request to transfer leadership to TS b98d2519bb504dc6905ed2ede4571835
W20260709 12:10:03.885249 14410 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.035s	sys 0.081s
W20260709 12:10:03.885862 14410 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.036s	sys 0.081s
I20260709 12:10:03.888973 13680 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 3.
W20260709 12:10:03.889632 13684 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.032s	sys 0.072s
W20260709 12:10:03.890280 13684 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.033s	sys 0.072s
I20260709 12:10:03.891273 13570 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c95811190f014949bb25448e8db1040e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:10:03.908982 13726 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:03.916175 15243 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:03.925055 15210 raft_consensus.cc:2804] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:10:03.944820 13570 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet a34b21ec197b4241a780a8ae562e4602 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica b98d2519bb504dc6905ed2ede4571835 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
W20260709 12:10:04.003590 13570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 78437.2us
I20260709 12:10:04.013849 15243 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:04.017159 15243 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:04.020769 13757 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "b98d2519bb504dc6905ed2ede4571835"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:10:04.037233 13757 raft_consensus.cc:606] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Received request to transfer leadership to TS b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:03.955051 15247 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:10:04.030483 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:04.012315 15236 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:04.018987 15210 raft_consensus.cc:697] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:03.973484 14936 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:04.052812 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 255596us
I20260709 12:10:04.060302 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:04.060976 13835 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:04.062732 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:04.063560 13832 raft_consensus.cc:2393] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 3: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:04.073706 13727 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:04.035509 15144 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:04.047999 15275 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:04.041229 15225 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:04.045816 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:04.153676 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:04.046698 15247 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:04.053298 15236 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:04.152686 15088 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:04.167927 13828 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3f29dda715314a93a03981264972c4c3"
dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
mode: GRACEFUL
new_leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
 from {username='slave'} at 127.0.0.1:52702
I20260709 12:10:04.153469 15181 raft_consensus.cc:2804] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:04.146363 15285 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:04.177439 14415 raft_consensus.cc:2368] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 3. Current term is 4.
I20260709 12:10:04.180815 15210 consensus_queue.cc:237] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:04.141423 15144 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:04.253304 15181 raft_consensus.cc:697] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:04.202548 15288 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:04.204452 15236 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:04.218581 15268 log.cc:927] Time spent T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
W20260709 12:10:04.219929 15279 log.cc:927] Time spent T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.183s	user 0.000s	sys 0.000s
W20260709 12:10:04.221292 15286 log.cc:927] Time spent T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 12:10:04.222687 15287 log.cc:927] Time spent T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:10:04.239209 14936 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 4 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:04.242448 15168 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:04.245858 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:04.149019 15275 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:04.278692 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 219305us
I20260709 12:10:04.254289 15144 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:04.150781 15225 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:04.266356 13835 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 3.
I20260709 12:10:04.282387 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:04.293730 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:04.294085 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:04.294494 13835 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 2.
I20260709 12:10:04.294646 13832 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 3.
I20260709 12:10:04.297228 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:04.299685 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:04.308333 13832 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 2.
I20260709 12:10:04.274705 15236 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:04.311679 13829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 1636) took 1130 ms. Trace:
I20260709 12:10:04.321312 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:04.321610 13652 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:04.322413 13762 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 2.
I20260709 12:10:04.311400 15149 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:04.254355 15181 consensus_queue.cc:237] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:04.327307 15149 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:04.315899 15201 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:04.332574 15225 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:04.333509 15201 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:04.335747 15277 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:04.336552 15277 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:04.336948 15201 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:04.341704 15149 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:04.324525 15281 raft_consensus.cc:2749] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:04.351819 13759 raft_consensus.cc:2393] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 3: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:04.353946 15176 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:04.272356 15288 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:04.354569 15176 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:04.357265 15288 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:04.254979 15285 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:04.359500 15176 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:04.308916 15194 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:10:04.363170 15267 log.cc:927] Time spent T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.802s	user 0.000s	sys 0.008s
I20260709 12:10:04.364565 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:04.410567 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:04.365343 15247 leader_election.cc:290] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:04.411298 13760 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 2.
I20260709 12:10:04.367183 15275 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:10:04.370950 15195 consensus_meta.cc:287] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.632s	user 0.005s	sys 0.007s
I20260709 12:10:04.309409 15088 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:04.323592 15236 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:04.476265 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:04.373589 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:04.374560 15289 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:04.378662 15251 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:04.379206 14409 consensus_meta.cc:287] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.738s	user 0.013s	sys 0.000s
I20260709 12:10:04.384267 15277 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:04.390198 14412 raft_consensus.cc:1275] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:04.313637 13829 rpcz_store.cc:276] 0709 12:10:03.176152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:03.179444 (+  3292us) service_pool.cc:224] Handling call
0709 12:10:03.180177 (+   733us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:03.194333 (+ 14156us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:03.194362 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:03.215021 (+ 20659us) log.cc:844] Serialized 501 byte log entry
0709 12:10:03.644364 (+429343us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:03.644410 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:03.644482 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:04.302596 (+658114us) raft_consensus.cc:1685] finished
0709 12:10:04.302618 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:04.306867 (+  4249us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":429028,"threads_started":1,"wal-append.queue_time_us":709386}
W20260709 12:10:04.395130 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 319133us
I20260709 12:10:04.508473 13727 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:04.387991 15285 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:04.430934 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:04.441581 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:04.519268 13757 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 3.
I20260709 12:10:04.446347 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:10:04.411105 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 206980us
I20260709 12:10:04.451463 13679 raft_consensus.cc:1275] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:04.454353 13828 raft_consensus.cc:606] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Received request to transfer leadership to TS ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:04.471976 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:10:04.521952 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 209499us
I20260709 12:10:04.472288 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:04.478909 13686 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 2.
I20260709 12:10:04.497264 13688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1005) took 1394 ms. Trace:
I20260709 12:10:04.523026 13685 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 2.
I20260709 12:10:04.524905 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:04.526022 13829 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:04.536139 13652 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:04.522383 13761 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 2.
I20260709 12:10:04.538247 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:10:04.538584 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 242520us
I20260709 12:10:04.521376 13828 raft_consensus.cc:614] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:04.523473 13688 rpcz_store.cc:276] 0709 12:10:03.102706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:03.103141 (+   435us) service_pool.cc:224] Handling call
0709 12:10:03.103484 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:03.106012 (+  2528us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:03.106043 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:03.117110 (+ 11067us) log.cc:844] Serialized 26 byte log entry
0709 12:10:03.434662 (+317552us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:03.553444 (+118782us) log.cc:844] Serialized 14 byte log entry
0709 12:10:03.561287 (+  7843us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:03.561371 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:04.329485 (+768114us) spinlock_profiling.cc:243] Waited 3.73 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:10:04.474566 (+145081us) raft_consensus.cc:1685] finished
0709 12:10:04.496989 (+ 22423us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:04.497193 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13212,"prepare.queue_time_us":176225,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":46,"raft.queue_time_us":38013,"raft.run_cpu_time_us":283,"raft.run_wall_time_us":285,"spinlock_wait_cycles":8574720,"thread_start_us":356691,"threads_started":2,"wal-append.queue_time_us":353105}
I20260709 12:10:04.542665 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:04.544926 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:04.471994 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:04.550199 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:04.552323 13688 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 2.
I20260709 12:10:04.500417 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:04.545696 13837 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 1.
I20260709 12:10:04.499272 15183 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:04.556715 15292 raft_consensus.cc:993] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7: : Instructing follower b98d2519bb504dc6905ed2ede4571835 to start an election
I20260709 12:10:04.557958 15189 consensus_queue.cc:1059] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:04.588089 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:04.588935 15294 raft_consensus.cc:1081] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Signalling peer b98d2519bb504dc6905ed2ede4571835 to start an election
I20260709 12:10:04.589967 15243 raft_consensus.cc:3055] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:04.590349 15243 raft_consensus.cc:740] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:04.558983 15081 raft_consensus.cc:2804] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:04.591181 15243 consensus_queue.cc:260] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:04.591454 15081 raft_consensus.cc:697] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:04.521229 15288 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:04.592748 15081 consensus_queue.cc:237] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:04.450151 15194 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:04.593179 15288 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:04.595482 15194 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:04.498011 15088 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:04.517751 15293 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:04.597975 15088 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:04.565558 13726 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:04.573791 15236 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:04.575894 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:04.576006 15183 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:04.518441 15251 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:04.592581 15243 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:04.507347 15289 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:04.587033 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:04.517014 15217 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:04.550879 15285 raft_consensus.cc:2804] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:04.588984 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:04.607872 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:04.609489 13836 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 1.
I20260709 12:10:04.609826 13680 raft_consensus.cc:2393] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 3: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:04.603870 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:04.597121 15293 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:04.570819 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:04.583825 14414 raft_consensus.cc:1275] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:10:04.589833 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:04.616756 13652 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:04.619802 13652 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:04.627923 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:04.630023 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:04.631007 13680 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 3.
I20260709 12:10:04.631954 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:04.632709 13761 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 2.
I20260709 12:10:04.635249 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:04.635856 13652 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:04.636219 13680 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 1.
I20260709 12:10:04.638113 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:04.638890 14414 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 2.
I20260709 12:10:04.599754 15250 raft_consensus.cc:2804] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:04.601532 15183 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:04.609241 15238 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:04.642074 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:04.642273 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:04.668061 13801 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:04.684788 13837 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 2.
I20260709 12:10:04.641136 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:04.612893 13754 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:10:04.603353 15251 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:04.599146 15288 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:04.654412 13727 leader_election.cc:400] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 3. Current term is 4.
I20260709 12:10:04.612574 15285 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:04.655476 14379 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:04.671681 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:04.673400 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:04.676299 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:04.612735 15245 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:04.686856 13680 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 2.
I20260709 12:10:04.642206 15295 raft_consensus.cc:2804] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:10:04.746166 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 72315.9us
I20260709 12:10:04.689575 13756 raft_consensus.cc:2393] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 2: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:04.690702 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:04.633617 15088 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:04.643303 15250 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:04.687131 15212 raft_consensus.cc:2749] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:04.626735 15142 raft_consensus.cc:2804] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:04.679401 15095 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:04.733963 15277 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:04.738905 13727 leader_election.cc:403] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:10:04.745373 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 89971.8us
I20260709 12:10:04.774556 14379 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:04.619374 15217 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:04.722100 14380 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:04.735880 13836 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 1.
I20260709 12:10:04.763213 13680 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612"
dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
 from {username='slave'} at 127.0.0.1:41688
I20260709 12:10:04.779539 13680 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:04.779948 13680 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:04.679685 15194 consensus_queue.cc:1048] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
W20260709 12:10:04.776795 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 149876us
I20260709 12:10:04.734592 15195 raft_consensus.cc:2804] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:04.731576 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:04.787652 13727 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:04.755324 15288 raft_consensus.cc:2749] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:04.799109 13763 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:10:04.692039 15238 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:04.792582 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:10:04.792949 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 87974.5us
I20260709 12:10:04.746416 15295 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:04.739169 15285 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:04.755638 15250 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:04.795156 13800 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:04.800129 13763 raft_consensus.cc:606] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 LEADER]: Received request to transfer leadership to TS ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:04.799144 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:04.828261 13837 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 3.
I20260709 12:10:04.806419 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:04.760281 15142 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:04.792351 15195 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:04.758100 15088 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:04.801375 15249 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:04.793020 15209 raft_consensus.cc:2749] T c95811190f014949bb25448e8db1040e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:04.779703 15095 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:04.749514 15245 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:04.801379 15210 consensus_queue.cc:1048] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.089s
I20260709 12:10:04.797711 15277 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:04.811192 15295 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:04.832554 14409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 542) took 1562 ms. Trace:
I20260709 12:10:04.922713 13761 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:39554
W20260709 12:10:05.109021 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:05.268114 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:05.272313 14379 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:05.103410 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:05.299011 14414 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 2.
I20260709 12:10:05.092041 13680 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:04.810344 14411 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 1.
W20260709 12:10:05.287206 13829 consensus_meta.cc:287] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.760s	user 0.010s	sys 0.004s
I20260709 12:10:05.301653 13829 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 4.
I20260709 12:10:05.059620 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:05.302578 13757 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 3.
I20260709 12:10:05.232388 15261 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:04.832877 15142 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:05.080384 15019 raft_consensus.cc:993] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7: : Instructing follower b98d2519bb504dc6905ed2ede4571835 to start an election
I20260709 12:10:04.841602 15282 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:05.046975 15189 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:04.940555 15300 raft_consensus.cc:2749] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:05.252744 15288 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:04.884222 15195 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:04.918368 15304 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:05.294350 15289 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:04.917899 15248 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:05.047240 15217 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:05.294222 15249 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:05.297132 15176 raft_consensus.cc:2804] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:05.317142 15306 log.cc:927] Time spent T 00000000000000000000000000000000 P 17d79eae88f84be7a847d0cf544674cd: Append to log took a long time: real 0.454s	user 0.000s	sys 0.001s
I20260709 12:10:05.312232 15261 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:04.918586 15280 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:10:05.318812 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 333782us
W20260709 12:10:05.374778 13685 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.765s	user 0.004s	sys 0.026s
W20260709 12:10:05.375778 13685 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.770s	user 0.005s	sys 0.027s
I20260709 12:10:05.306044 15209 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:05.327870 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:05.320005 15019 raft_consensus.cc:1081] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 LEADER]: Signalling peer b98d2519bb504dc6905ed2ede4571835 to start an election
I20260709 12:10:05.313047 13680 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:05.367851 13727 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.024s	sys 0.013s
W20260709 12:10:05.385648 13727 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.024s	sys 0.013s
I20260709 12:10:05.351137 15249 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:05.317962 15189 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:05.360316 15217 raft_consensus.cc:2804] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:05.351379 15176 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:05.386008 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 555338us
I20260709 12:10:05.431509 13727 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:05.436442 15244 raft_consensus.cc:2749] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:05.323797 15288 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:05.440045 15288 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:05.369347 15238 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:05.323621 15282 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:05.389585 15095 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:05.395668 15318 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:05.417922 15319 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:05.441435 15176 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:05.418092 15217 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:05.426110 15233 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:10:05.464999 13570 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet a34b21ec197b4241a780a8ae562e4602 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica b98d2519bb504dc6905ed2ede4571835 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:10:05.385962 15209 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:05.461320 15250 consensus_meta.cc:287] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.616s	user 0.006s	sys 0.005s
I20260709 12:10:05.368717 15248 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:05.449306 15293 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:05.456256 15253 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:05.365443 15304 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:05.550709 13800 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.718s	user 0.051s	sys 0.143s
I20260709 12:10:05.476611 15217 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:05.418844 15280 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:05.551373 13800 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.051s	sys 0.143s
W20260709 12:10:05.559353 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 764493us
I20260709 12:10:05.561061 13800 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:10:05.515175 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 338988us
W20260709 12:10:05.562412 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 131015us
I20260709 12:10:05.563318 13727 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:05.565294 13800 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:10:05.566272 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:05.569557 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:05.570397 13760 raft_consensus.cc:3055] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:05.574285 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:05.570783 13760 raft_consensus.cc:740] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:05.519482 15019 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:05.558404 15245 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:05.509500 15233 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:05.587910 15194 raft_consensus.cc:2804] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:05.604224 13680 raft_consensus.cc:1240] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 1. Current term is 2. Ops: []
W20260709 12:10:05.602172 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 329934us
I20260709 12:10:05.573717 15155 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:05.551806 15253 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:05.473928 15318 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:05.618991 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:05.298267 14409 rpcz_store.cc:276] 0709 12:10:03.270434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:03.270987 (+   553us) service_pool.cc:224] Handling call
0709 12:10:03.307806 (+ 36819us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:03.327739 (+ 19933us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:04.539693 (+1211954us) log.cc:844] Serialized 14 byte log entry
0709 12:10:04.776035 (+236342us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:04.778236 (+  2201us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:04.789649 (+ 11413us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:04.800595 (+ 10946us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:04.815317 (+ 14722us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5099,"raft.queue_time_us":24996,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":15522,"thread_start_us":160958,"threads_started":1,"wal-append.queue_time_us":295439}
I20260709 12:10:05.625248 13687 raft_consensus.cc:1275] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:05.475204 15319 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:05.591487 15238 raft_consensus.cc:2804] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:05.512384 15250 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:05.553051 15320 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:05.590658 13760 consensus_queue.cc:260] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:05.629323 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:05.754798 13686 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 2.
I20260709 12:10:05.601459 15019 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:05.755985 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:05.742830 13688 raft_consensus.cc:1275] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:05.718387 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:10:05.758678 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 124715us
I20260709 12:10:05.630043 13681 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac"
dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
 from {username='slave'} at 127.0.0.1:41688
I20260709 12:10:05.762493 13681 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:05.763075 13681 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:05.590317 15325 raft_consensus.cc:2749] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:05.770558 13760 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:05.631583 15333 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:05.603312 15088 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:05.787365 13680 raft_consensus.cc:2393] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 2: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:05.618916 15277 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:05.716507 15155 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:05.796401 15317 log.cc:927] Time spent T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.244s	user 0.001s	sys 0.000s
I20260709 12:10:05.623873 15194 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:05.798421 15194 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:05.798982 15233 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:05.802151 13685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 1570) took 1199 ms. Trace:
I20260709 12:10:05.784734 15333 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:05.802878 13686 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 2.
I20260709 12:10:05.806708 14380 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:05.808836 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:05.810447 13829 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 3.
W20260709 12:10:05.801857 13754 consensus_meta.cc:287] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 1.071s	user 0.008s	sys 0.005s
I20260709 12:10:05.819990 13754 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 4.
W20260709 12:10:05.820650 13754 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38932 (request call id 130) took 1422 ms (client timeout 1629 ms). Trace:
W20260709 12:10:05.821041 13754 rpcz_store.cc:269] 0709 12:10:04.398246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:04.410562 (+ 12316us) service_pool.cc:224] Handling call
0709 12:10:05.820554 (+1409992us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:05.757862 15261 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:05.782850 15244 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:05.802556 13685 rpcz_store.cc:276] 0709 12:10:04.602769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:04.603321 (+   552us) service_pool.cc:224] Handling call
0709 12:10:04.603919 (+   598us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:04.604251 (+   332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:04.604275 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:04.605112 (+   837us) log.cc:844] Serialized 501 byte log entry
0709 12:10:05.376152 (+771040us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:05.376194 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:05.376263 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:05.801899 (+425636us) raft_consensus.cc:1685] finished
0709 12:10:05.801929 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:05.802086 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":35072,"thread_start_us":770562,"threads_started":1,"wal-append.queue_time_us":850804}
I20260709 12:10:05.822796 13761 raft_consensus.cc:606] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:05.827060 13801 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:05.831182 13761 raft_consensus.cc:614] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:05.832463 14936 raft_consensus.cc:2804] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:05.766690 15238 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:05.590029 15323 consensus_queue.cc:1048] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.219s
I20260709 12:10:05.628312 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:05.792714 15326 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:05.631861 15316 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:05.826016 15277 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:05.822044 15318 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:05.833022 14936 raft_consensus.cc:697] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 4 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:05.834939 15321 raft_consensus.cc:993] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7: : Instructing follower ca9fbbc2c0a94897897d502d42f3951f to start an election
I20260709 12:10:05.832237 15155 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:05.836697 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:05.818364 15189 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:05.838280 15209 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:05.838469 15325 raft_consensus.cc:2804] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:05.839330 15217 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:05.839840 14380 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:05.785049 15320 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:05.847801 15280 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:10:05.848107 15285 consensus_meta.cc:287] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 1.002s	user 0.011s	sys 0.000s
I20260709 12:10:05.847159 15248 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:05.875453 15285 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:05.848707 15282 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:05.863310 15323 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:05.863570 13681 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:05.845793 15253 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:05.864801 13760 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 2.
W20260709 12:10:05.888933 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 273934us
I20260709 12:10:05.860172 14936 consensus_queue.cc:237] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:05.844388 15243 consensus_meta.cc:287] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 1.241s	user 0.002s	sys 0.012s
I20260709 12:10:05.842711 15244 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:05.847163 15250 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:05.842804 15238 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:05.891463 13800 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:05.894025 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:05.896677 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:05.850952 15277 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:05.899192 14414 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 2.
I20260709 12:10:05.900197 13681 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:05.900517 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:05.872874 15325 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:05.902760 13829 raft_consensus.cc:2468] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 1.
I20260709 12:10:05.892087 15321 raft_consensus.cc:1081] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 LEADER]: Signalling peer ca9fbbc2c0a94897897d502d42f3951f to start an election
W20260709 12:10:05.889940 15142 consensus_meta.cc:287] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.572s	user 0.011s	sys 0.000s
I20260709 12:10:05.845739 15255 raft_consensus.cc:2749] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 3. Current term is 4.
I20260709 12:10:05.904229 14379 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:10:05.907833 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 327552us
I20260709 12:10:05.848824 15195 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:05.851774 15319 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:05.898566 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:05.931210 13762 raft_consensus.cc:2368] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 2. Current term is 3.
I20260709 12:10:05.916435 14380 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:05.844769 15326 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:05.918017 15325 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:05.934866 15296 raft_consensus.cc:2804] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:05.935367 15296 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:05.935573 15331 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:05.935804 15296 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:05.917716 15194 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:05.940236 13831 raft_consensus.cc:2393] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 3: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:05.928956 15333 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:05.929543 15253 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:05.922974 15142 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:05.846293 15316 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:05.945879 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 306401us
I20260709 12:10:05.950193 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:05.951808 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:05.907083 15323 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:05.954876 15142 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:05.959139 15309 log.cc:927] Time spent T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 1.066s	user 0.008s	sys 0.002s
I20260709 12:10:05.961655 15217 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:05.936918 15248 raft_consensus.cc:2804] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:05.964598 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:10:05.943243 15249 consensus_meta.cc:287] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.501s	user 0.010s	sys 0.000s
W20260709 12:10:05.961575 15295 consensus_meta.cc:287] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.657s	user 0.005s	sys 0.006s
I20260709 12:10:05.981333 15248 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:05.962234 15285 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:05.978078 15195 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:05.944257 15176 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:05.936240 15331 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:05.992285 15320 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:05.981406 15295 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:05.962806 15253 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:05.970052 15330 raft_consensus.cc:2749] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:05.985951 15248 raft_consensus.cc:3060] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:06.002189 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:06.002904 13833 raft_consensus.cc:2468] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 1.
I20260709 12:10:05.999233 15331 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:06.006330 14380 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:05.993667 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:05.999897 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:05.982383 15249 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:05.984935 15304 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:06.047559 15326 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:06.001448 15244 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:06.023694 15330 raft_consensus.cc:2804] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:06.049250 15304 raft_consensus.cc:2749] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:06.046216 15277 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:06.048336 15325 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:06.062076 15316 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:06.064088 15325 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:06.064034 15330 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:06.065358 15330 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:06.091097 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 120011us
W20260709 12:10:06.094340 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 123096us
I20260709 12:10:06.096066 13652 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:10:06.096995 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:06.107292 13651 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:06.098620 13679 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 2.
I20260709 12:10:06.098706 14411 raft_consensus.cc:2393] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 4: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:10:06.100323 14409 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:06.100991 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 477809us
I20260709 12:10:06.116106 15176 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:06.117182 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:06.118307 15195 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:06.119608 15195 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:06.120546 15174 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:06.122236 15155 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:06.122434 15194 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:06.123512 15194 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:06.123355 15155 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:06.128146 15155 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:06.056527 15295 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:06.124272 15194 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:06.101408 13829 raft_consensus.cc:2393] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 2: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:06.101559 14415 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 1.
W20260709 12:10:06.098086 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 190518us
I20260709 12:10:06.141155 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:06.129715 15280 raft_consensus.cc:2804] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:06.135591 15253 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:06.172672 15280 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:06.176286 15280 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:06.133285 15282 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:06.064007 15323 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:06.178234 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:06.180526 15340 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:06.181224 15333 raft_consensus.cc:2804] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:06.136492 15277 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:06.181553 15340 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:06.129864 15174 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:06.124264 15195 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:06.182255 14413 raft_consensus.cc:2393] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 2: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:10:06.243072 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:10:06.180583 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 73565.7us
I20260709 12:10:06.259071 13761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:39554 (request call id 14) took 1336 ms. Trace:
I20260709 12:10:06.200789 13652 leader_election.cc:304] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:06.260776 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:06.201956 15194 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:06.182130 15333 raft_consensus.cc:697] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 2 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:06.320494 15326 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:06.320549 15339 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:06.321760 15339 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:06.321704 15326 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:06.196790 15249 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 4 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:06.229501 15081 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:06.221621 15305 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:06.240896 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:06.330202 15326 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:06.332383 15173 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:06.335774 15173 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:06.340826 15173 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:06.341647 15315 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:06.341910 15147 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:06.342372 15339 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:06.342700 15147 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:06.342623 15315 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:06.199381 15019 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:06.343087 13756 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 5.
I20260709 12:10:06.341694 13800 leader_election.cc:400] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 2. Current term is 3.
I20260709 12:10:06.349613 13800 leader_election.cc:403] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:06.230132 15282 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:06.351046 13679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48212 (request call id 135) took 1025 ms. Trace:
I20260709 12:10:06.308002 15195 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:06.195849 15344 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:06.237174 15248 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:06.196415 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:06.303032 13761 rpcz_store.cc:276] 0709 12:10:04.922344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:04.922559 (+   215us) service_pool.cc:224] Handling call
0709 12:10:06.258457 (+1335898us) spinlock_profiling.cc:243] Waited 527 ms on lock 0x7b540038bdd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f87853 00007fa92cf5560a 00007fa9264db7d4 00007fa9264db762 00007fa9264db691 00007fa9264db60c 00007fa9264da8c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:06.258748 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1211977600}
I20260709 12:10:06.352300 15212 raft_consensus.cc:2749] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:06.352156 13679 rpcz_store.cc:276] 0709 12:10:05.325202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:05.327549 (+  2347us) service_pool.cc:224] Handling call
0709 12:10:06.346128 (+1018579us) spinlock_profiling.cc:243] Waited 718 ms on lock 0x7b5400311fd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:06.350965 (+  4837us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1650551552}
W20260709 12:10:06.358944 13831 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35422 (request call id 135) took 1692 ms (client timeout 1866 ms). Trace:
I20260709 12:10:06.359431 15303 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:06.240070 14415 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087"
dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
 from {username='slave'} at 127.0.0.1:41700
W20260709 12:10:06.362877 13831 rpcz_store.cc:269] 0709 12:10:04.666985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:04.667246 (+   261us) service_pool.cc:224] Handling call
0709 12:10:06.358349 (+1691103us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54003babd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:06.358678 (+   329us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2740676992}
I20260709 12:10:06.380832 15315 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:06.379776 15147 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:06.393546 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:06.392109 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:06.384493 15303 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:06.353933 15277 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:06.408689 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:10:06.408882 15289 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:06.386593 14415 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:06.412411 14415 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:06.412393 15289 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:06.416191 15289 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:06.411293 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:06.419595 15212 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:06.422498 15212 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:06.423147 15333 consensus_queue.cc:237] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:06.419754 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:06.378805 15081 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:06.387223 15195 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:06.387050 15305 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:06.435534 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 235344us
I20260709 12:10:06.425314 15212 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:06.430153 15346 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:10:06.446270 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:06.449559 13686 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 2.
I20260709 12:10:06.451844 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:06.445556 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:06.458102 13761 raft_consensus.cc:2393] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 2: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:06.453544 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:06.459486 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:06.459620 13828 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 2.
I20260709 12:10:06.448773 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:06.466295 14408 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 1.
I20260709 12:10:06.464773 14412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41692 (request call id 339) took 1196 ms. Trace:
I20260709 12:10:06.464937 13652 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:06.465199 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:06.445669 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:06.466814 15296 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:06.471144 14412 rpcz_store.cc:276] 0709 12:10:05.233472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:05.969663 (+736191us) service_pool.cc:224] Handling call
0709 12:10:05.978655 (+  8992us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:05.982652 (+  3997us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:05.982708 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:05.993449 (+ 10741us) log.cc:844] Serialized 26 byte log entry
0709 12:10:06.243657 (+250208us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:06.243824 (+   167us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:06.243972 (+   148us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:06.421506 (+177534us) raft_consensus.cc:1685] finished
0709 12:10:06.421534 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:06.429503 (+  7969us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1882,"raft.queue_time_us":4953,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":3984,"thread_start_us":213191,"threads_started":1,"wal-append.queue_time_us":358640}
I20260709 12:10:06.482254 14410 raft_consensus.cc:2368] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 3. Current term is 4.
I20260709 12:10:06.448067 15088 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:06.483418 15088 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:06.463063 13756 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:06.465390 15238 consensus_meta.cc:287] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.540s	user 0.012s	sys 0.006s
I20260709 12:10:06.473109 13837 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 2.
I20260709 12:10:06.478674 13833 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 2.
I20260709 12:10:06.479794 13759 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 2.
I20260709 12:10:06.478706 13831 raft_consensus.cc:2955] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:10:06.467181 15174 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:06.457703 14409 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 3.
I20260709 12:10:06.492846 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:06.493000 15088 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:06.496263 15238 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:06.484594 15296 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 4 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:06.469375 15305 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:06.501955 13828 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:10:06.448576 15344 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:06.489053 15340 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:06.507043 14379 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:06.511915 15015 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:06.514213 15238 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:06.514678 13837 raft_consensus.cc:1275] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:06.514959 15095 raft_consensus.cc:2804] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:06.518832 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:06.508992 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:06.521257 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:06.522337 14410 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 2.
I20260709 12:10:06.506551 15248 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:06.520476 15095 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:06.525272 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:06.526362 13837 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:06.527622 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 70977us
I20260709 12:10:06.529263 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:06.529654 15015 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:06.530293 13585 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45618 (request call id 230) took 3913 ms. Trace:
I20260709 12:10:06.530663 13830 raft_consensus.cc:2393] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 3: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:06.527539 15095 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:06.532335 15015 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:06.532413 13674 tablet_service.cc:1558] Processing DeleteTablet for tablet 1e31cd7111f2470d8d34b5898dce5765 with delete_type TABLET_DATA_TOMBSTONED (TS b98d2519bb504dc6905ed2ede4571835 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:41682
I20260709 12:10:06.533995 15288 raft_consensus.cc:2764] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:10:06.533648 13586 catalog_manager.cc:5697] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 5 to 6, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 6 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:10:06.535701 13586 catalog_manager.cc:5697] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 1 to 2, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 2 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:10:06.546443 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:06.547958 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:06.549058 13830 raft_consensus.cc:2393] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 5: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:06.552340 13828 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 4.
I20260709 12:10:06.519433 15282 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:06.561465 15351 tablet_replica.cc:333] T 1e31cd7111f2470d8d34b5898dce5765 P b98d2519bb504dc6905ed2ede4571835: stopping tablet replica
I20260709 12:10:06.537720 13586 catalog_manager.cc:5697] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 reported cstate change: config changed from index 3 to 4, VOTER 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) evicted. New cstate: current_term: 1 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:06.564376 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:06.564746 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:06.565217 13680 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:10:06.566772 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:06.579114 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:06.579977 13834 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 5.
I20260709 12:10:06.530684 13585 rpcz_store.cc:276] 0709 12:10:02.635152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:02.663260 (+ 28108us) service_pool.cc:224] Handling call
0709 12:10:02.902917 (+239657us) spinlock_profiling.cc:243] Waited 2.35 ms on lock 0x7b54002eff38. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd4be43 00007fa92de4a04e 00007fa92c30b2a4 00007fa92c30b232 00007fa92c30b161 00007fa92c30b0dc 00007fa92c30a392 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:06.529990 (+3627073us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:04.143365 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:04.235664 (+ 92299us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:04.235723 (+    59us) write_op.cc:435] Acquired schema lock
0709 12:10:04.235753 (+    30us) tablet.cc:662] Decoding operations
0709 12:10:04.236400 (+   647us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:04.236500 (+   100us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:04.236565 (+    65us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:10:04.237205 (+   640us) tablet.cc:701] Row locks acquired
0709 12:10:04.237280 (+    75us) write_op.cc:260] PREPARE: finished
0709 12:10:04.237521 (+   241us) write_op.cc:270] Start()
0709 12:10:04.262134 (+ 24613us) write_op.cc:276] Timestamp: P: 1783599004237449 usec, L: 0
0709 12:10:04.265846 (+  3712us) op_driver.cc:348] REPLICATION: starting
0709 12:10:04.368559 (+102713us) log.cc:844] Serialized 919 byte log entry
0709 12:10:05.794761 (+1426202us) op_driver.cc:464] REPLICATION: finished
0709 12:10:05.935426 (+140665us) spinlock_profiling.cc:243] Waited 1.86 ms on lock 0x7b5400373cd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f88e28 00007fa92b9c3581 00007fa92b9c2d58 00007fa92b9c79f1 00007fa92b9c79a9 00007fa92b9c7939 00007fa92b9c7901 00007fa92b9c6b2d 0000000000388634 0000000000388479
0709 12:10:06.054731 (+119305us) write_op.cc:301] APPLY: starting
0709 12:10:06.056032 (+  1301us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:06.058672 (+  2640us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:06.059021 (+   349us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:06.060894 (+  1873us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:06.061077 (+   183us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:10:06.061124 (+    47us) write_op.cc:312] APPLY: finished
0709 12:10:06.061355 (+   231us) log.cc:844] Serialized 29 byte log entry
0709 12:10:06.061530 (+   175us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:06.061628 (+    98us) write_op.cc:454] Released schema lock
0709 12:10:06.061683 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:06.062778 (+  1095us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:06.062810 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":550688,"reported_tablets":2,"spinlock_wait_cycles":5395840,"child_traces":[["op",{"apply.queue_time_us":246590,"apply.run_cpu_time_us":2319,"apply.run_wall_time_us":10575,"num_ops":2,"prepare.queue_time_us":484543,"prepare.run_cpu_time_us":51094,"prepare.run_wall_time_us":1812660,"raft.queue_time_us":268221,"raft.run_cpu_time_us":14701,"raft.run_wall_time_us":278295,"replication_time_us":1489240,"spinlock_wait_cycles":4266752,"thread_start_us":885169,"threads_started":4,"wal-append.queue_time_us":389288}]]}
I20260709 12:10:06.581018 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:06.582587 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:06.583118 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:06.584093 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:06.564400 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:06.587734 13832 raft_consensus.cc:1275] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:06.587821 15344 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:06.590113 15195 leader_election.cc:290] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:06.591208 13726 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:06.636442 13833 raft_consensus.cc:1275] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:10:06.637123 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 46233.2us
W20260709 12:10:06.592136 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 127385us
I20260709 12:10:06.592063 15095 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:06.592764 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:06.639082 13829 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:06.639770 15238 raft_consensus.cc:2804] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:06.640170 15238 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:06.593927 13756 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 4.
I20260709 12:10:06.594913 14415 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:06.585851 15342 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:06.596621 15277 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:06.597272 15280 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:06.601634 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:06.602454 14411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41700 (request call id 183) took 1035 ms. Trace:
I20260709 12:10:06.602993 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:06.602890 13586 catalog_manager.cc:5697] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 2 to 3, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 3 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:10:06.606783 15303 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:06.607925 13801 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:06.608448 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:06.610987 15081 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:06.565584 13754 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 3.
I20260709 12:10:06.613678 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:10:06.615381 15330 consensus_meta.cc:287] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.549s	user 0.016s	sys 0.000s
I20260709 12:10:06.621003 14379 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:06.623227 13759 raft_consensus.cc:1275] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:06.624050 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:06.601001 13727 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:06.624979 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:06.625214 13680 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 4.
W20260709 12:10:06.660400 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:06.625589 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:06.625960 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:06.626838 15346 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 2. Current term is 3.
I20260709 12:10:06.625033 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:06.630852 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:06.666384 13762 raft_consensus.cc:1813] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Handling vote request from an unknown peer b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:06.632551 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:06.633054 15333 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:06.633970 15282 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:06.634799 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:06.635452 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:06.638300 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:06.640532 15238 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:06.649765 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:06.650357 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:06.651682 15095 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:06.652177 14413 raft_consensus.cc:1240] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:06.652791 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:06.652987 14415 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 3 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:06.653188 14411 rpcz_store.cc:276] 0709 12:10:05.566897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:05.573897 (+  7000us) service_pool.cc:224] Handling call
0709 12:10:06.602216 (+1028319us) spinlock_profiling.cc:243] Waited 239 ms on lock 0x7b5400530054. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:06.602389 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":549522176}
I20260709 12:10:06.654045 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:06.654719 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:06.674729 13762 raft_consensus.cc:2410] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:10:06.658470 13837 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 2.
I20260709 12:10:06.658612 13829 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 4.
I20260709 12:10:06.659366 13763 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 4.
I20260709 12:10:06.666320 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:10:06.670981 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 70050.6us
I20260709 12:10:06.673894 13758 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 1.
I20260709 12:10:06.676177 13833 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 3.
W20260709 12:10:06.675258 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 67657.9us
I20260709 12:10:06.680512 13727 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:06.681668 13828 raft_consensus.cc:2368] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 3. Current term is 4.
I20260709 12:10:06.683616 13682 raft_consensus.cc:2393] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 2: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:06.684641 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:06.685122 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:06.669888 15330 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:06.690081 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:06.691454 13684 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 2.
I20260709 12:10:06.690903 15232 raft_consensus.cc:2955] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:10:06.693218 15195 raft_consensus.cc:2804] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:06.693760 15195 raft_consensus.cc:697] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 3 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:06.694088 15330 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:06.694780 15195 consensus_queue.cc:237] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:06.698058 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:06.698828 13680 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 4.
I20260709 12:10:06.700722 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:06.703763 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:06.704670 13685 raft_consensus.cc:2393] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 3: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:06.705021 13652 leader_election.cc:400] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 3. Current term is 4.
I20260709 12:10:06.705391 13652 leader_election.cc:403] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:06.706305 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:06.706992 13687 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:06.707680 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:06.708873 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:06.692189 13755 raft_consensus.cc:3055] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:06.709427 13831 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:06.709565 13755 raft_consensus.cc:740] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:06.710582 13832 raft_consensus.cc:2368] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 3. Current term is 4.
I20260709 12:10:06.712419 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:06.714184 13829 raft_consensus.cc:1275] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:06.673203 15288 raft_consensus.cc:2749] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:06.720584 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:06.721318 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:06.721892 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:06.722970 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:06.710458 13755 consensus_queue.cc:260] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:06.722529 13835 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 2.
I20260709 12:10:06.726970 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:06.679710 15081 consensus_queue.cc:1048] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:10:06.726706 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:06.730176 15236 raft_consensus.cc:2804] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:06.730665 15236 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:06.731071 15236 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:06.731156 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:06.732350 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:06.734061 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:06.734558 13755 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:06.734787 13835 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 2.
I20260709 12:10:06.672645 15342 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:06.674271 15333 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:06.738122 15342 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:06.738608 15333 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:06.738140 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:06.680576 15282 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:06.742288 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 121443us
I20260709 12:10:06.844241 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:06.756886 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:06.962689 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:06.963654 13762 raft_consensus.cc:2393] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 3: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:06.964030 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:06.787127 13834 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 3.
I20260709 12:10:06.797118 15155 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:06.964854 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:06.962785 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:06.804669 15340 consensus_queue.cc:1059] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.161s
I20260709 12:10:06.965633 15155 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:06.790330 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:06.758271 13680 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 4.
I20260709 12:10:06.761615 15295 raft_consensus.cc:2749] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 3. Current term is 4.
I20260709 12:10:06.788185 14380 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:06.756660 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:06.954273 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:06.971832 13835 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:06.822341 13651 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:06.962559 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:06.854254 14409 raft_consensus.cc:2955] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:10:06.949630 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:06.750252 13684 raft_consensus.cc:1240] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:06.837014 15282 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:06.958730 15194 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:06.959389 15342 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:06.797475 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:06.818485 13687 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 3.
I20260709 12:10:06.761446 15244 consensus_queue.cc:1048] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.304s
W20260709 12:10:06.883613 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:06.951543 13831 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 3.
I20260709 12:10:06.823201 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:06.719501 15147 raft_consensus.cc:2804] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:06.964928 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:06.953015 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:06.970633 14379 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:06.967077 13832 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 3.
I20260709 12:10:06.763175 13726 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:10:06.975605 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 256419us
I20260709 12:10:06.985282 14380 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:10:06.978737 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 156511us
I20260709 12:10:06.985594 13828 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 1.
I20260709 12:10:06.980500 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:06.984071 13829 raft_consensus.cc:2368] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 3. Current term is 4.
W20260709 12:10:06.991879 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 228835us
I20260709 12:10:06.993014 13651 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:06.983125 15333 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:06.985538 15351 raft_consensus.cc:2243] T 1e31cd7111f2470d8d34b5898dce5765 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:10:07.009846 14379 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:06.983448 15147 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:07.002935 13755 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 3.
W20260709 12:10:07.005259 15350 log.cc:927] Time spent T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 12:10:06.983757 15330 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:07.008208 15183 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:06.935437 13570 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet a34b21ec197b4241a780a8ae562e4602 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica b98d2519bb504dc6905ed2ede4571835 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:10:07.015268 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:07.015039 15217 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:10:07.021310 13570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 86113.7us
I20260709 12:10:07.022221 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:06.996275 15248 raft_consensus.cc:2804] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:07.025650 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:07.027786 13835 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 3.
I20260709 12:10:06.995581 15333 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:06.984323 15194 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:07.040865 13759 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 1.
I20260709 12:10:07.032058 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:07.033735 14379 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:07.035907 15351 raft_consensus.cc:2272] T 1e31cd7111f2470d8d34b5898dce5765 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:10:07.036475 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:07.017591 15147 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:07.046651 13758 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 1.
I20260709 12:10:07.024504 15249 raft_consensus.cc:2749] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:06.991219 15342 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:07.024551 15183 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:07.028740 15295 raft_consensus.cc:2804] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:07.037285 13726 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:07.061363 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:06.996423 15288 consensus_queue.cc:1048] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:10:07.039374 15333 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:07.064775 13830 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.067492 13762 raft_consensus.cc:1275] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:07.028347 15340 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:07.075052 13685 raft_consensus.cc:1240] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:10:07.074965 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:07.078066 13679 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.078634 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:07.079288 13685 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:07.075315 15351 ts_tablet_manager.cc:1916] T 1e31cd7111f2470d8d34b5898dce5765 P b98d2519bb504dc6905ed2ede4571835: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:10:07.075759 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:07.075902 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:07.060062 15305 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:07.066179 15303 raft_consensus.cc:2804] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:07.089900 13679 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 3.
I20260709 12:10:07.066042 15183 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:07.065842 15295 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:07.097967 15295 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.100521 15194 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:10:07.097015 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 59840.8us
I20260709 12:10:07.108188 15342 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:07.108148 15340 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:07.121307 15213 raft_consensus.cc:2749] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:07.121665 15183 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:07.123311 15340 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:07.123943 15183 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:07.127089 13727 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:07.128360 13727 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:07.128608 13830 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 3.
I20260709 12:10:07.108807 15305 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:07.110399 13685 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 4.
I20260709 12:10:07.110038 15155 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:10:07.155314 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 98591.3us
I20260709 12:10:07.134491 13651 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:07.094569 15303 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:07.163295 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:10:07.166162 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 71187.7us
W20260709 12:10:07.158845 15354 log.cc:927] Time spent T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 12:10:07.152233 15183 raft_consensus.cc:2804] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:07.180883 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:07.133332 15217 consensus_queue.cc:1048] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:10:07.185431 15305 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:07.189518 15095 raft_consensus.cc:2804] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:07.189697 13651 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:07.190105 15095 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:07.190588 15095 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:07.191047 13651 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:10:07.191730 13651 raft_consensus.cc:2686] T 1e31cd7111f2470d8d34b5898dce5765 P b98d2519bb504dc6905ed2ede4571835: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:10:07.194886 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:07.197028 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:07.160182 15155 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:07.166731 15303 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:07.201284 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 47309.6us
I20260709 12:10:07.163991 15330 raft_consensus.cc:697] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 4 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:07.211383 13684 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.180687 15183 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:07.215474 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:07.216207 14416 raft_consensus.cc:2368] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 2. Current term is 3.
W20260709 12:10:07.200125 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 92449.4us
I20260709 12:10:07.204752 15340 raft_consensus.cc:2764] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:10:07.204298 15015 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:07.202762 15248 raft_consensus.cc:697] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 4 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:07.221796 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:07.222074 15248 consensus_queue.cc:237] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:07.210479 15155 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:07.226409 15015 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:07.227756 15155 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:07.216550 15183 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:07.228127 15236 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:07.233930 15236 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:07.236742 13688 raft_consensus.cc:2955] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:10:07.238057 15280 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:07.243916 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:07.244624 13757 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:07.247768 15247 raft_consensus.cc:2804] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:07.248255 15247 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:07.248654 15247 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.248972 13726 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:07.252036 15236 raft_consensus.cc:2804] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:07.252436 15236 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:07.252827 15236 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:07.254094 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:10:07.257925 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 128440us
I20260709 12:10:07.277552 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:07.277599 13726 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:07.278671 13759 raft_consensus.cc:2393] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 6: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:07.282019 15213 consensus_queue.cc:1048] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:10:07.282351 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:07.282915 13755 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:07.284502 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:07.284866 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:07.285697 13758 raft_consensus.cc:2393] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 2: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:07.313819 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:07.317168 13756 raft_consensus.cc:1240] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:07.320773 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:07.284215 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:10:07.364243 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 79795.4us
I20260709 12:10:07.363790 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:10:07.373713 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 59787.4us
W20260709 12:10:07.364099 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 105133us
I20260709 12:10:07.374565 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:07.375319 13756 raft_consensus.cc:2393] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 3: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:07.376710 13757 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 4.
I20260709 12:10:07.377624 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:07.378334 14413 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:07.349714 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 156676us
I20260709 12:10:07.347932 15173 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:07.381423 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 111937us
W20260709 12:10:07.381722 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.382056 13684 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 3.
I20260709 12:10:07.384110 13727 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:07.385200 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:07.386286 14379 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:07.394971 15364 consensus_queue.cc:1059] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 12:10:07.387930 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:07.398687 15333 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:07.400550 15333 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:07.380914 15232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:48110 (request call id 72) took 4788 ms. Trace:
I20260709 12:10:07.382411 15183 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:07.349972 15330 consensus_queue.cc:237] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:07.404193 15015 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:07.406024 13652 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:07.408398 13800 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:07.413038 15081 raft_consensus.cc:3055] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:07.411921 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:07.401219 15095 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:07.420254 14379 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:07.420414 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:07.423341 13755 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 4.
I20260709 12:10:07.425374 13800 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:07.425880 15015 raft_consensus.cc:2749] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:07.426564 13800 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:07.426982 15015 raft_consensus.cc:2804] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:07.427493 15015 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:07.427872 15015 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.428948 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:07.429623 13756 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 1.
I20260709 12:10:07.418435 15362 raft_consensus.cc:2749] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:07.413480 15081 raft_consensus.cc:740] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:07.433000 15364 raft_consensus.cc:2749] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:07.432664 15081 consensus_queue.cc:260] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:07.433642 15340 raft_consensus.cc:3055] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:07.384797 15244 raft_consensus.cc:2804] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:07.433986 15081 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.434145 15340 raft_consensus.cc:740] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:07.434366 15244 raft_consensus.cc:697] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:07.435390 15340 consensus_queue.cc:260] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:07.435750 15244 consensus_queue.cc:237] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:07.436728 15340 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.404575 15173 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:07.438670 15194 raft_consensus.cc:2749] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:07.440220 15173 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:07.440714 15217 raft_consensus.cc:2749] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:07.440842 14379 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:07.444792 15217 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:07.446777 15217 raft_consensus.cc:697] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 3 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:07.432595 14413 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 3.
I20260709 12:10:07.454244 14379 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
W20260709 12:10:07.458778 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 74774.6us
I20260709 12:10:07.459957 13727 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:07.456780 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:07.461892 15253 raft_consensus.cc:2749] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:07.467136 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:07.470963 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:07.471175 13759 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 4.
W20260709 12:10:07.474397 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 68464.1us
I20260709 12:10:07.483922 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:07.407982 15247 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:07.498894 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:07.402046 15232 rpcz_store.cc:276] 0709 12:10:02.563419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:02.563757 (+   338us) service_pool.cc:224] Handling call
0709 12:10:02.675752 (+111995us) spinlock_profiling.cc:243] Waited 5.41 ms on lock 0x7b54003776a0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f0a520 00007fa927f93b42 00007fa927f92800 00007fa927f8b9fa 00007fa92cf534c9 00007fa9264cfc54 00007fa9264cfbe2 00007fa9264cfb11 00007fa9264cfa8c 00007fa9264ced42
0709 12:10:03.284521 (+608769us) spinlock_profiling.cc:243] Waited 477 ms on lock 0x7b580045d7d0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927ee90aa 00007fa927f6b447 00007fa927f8870a 00007fa927f8976a 00007fa927f8891b 00007fa927f9403c 00007fa927f936b3 00007fa927f8b9fa 00007fa92cf534c9 00007fa9264cfc54
0709 12:10:03.635121 (+350600us) log.cc:844] Serialized 501 byte log entry
0709 12:10:04.253620 (+618499us) spinlock_profiling.cc:243] Waited 7.35 ms on lock 0x7b18003051a0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924ea03f3 00007fa924ea27c1 00007fa924ea2779 00007fa924ea2709 00007fa924ea26d1 00007fa924ea19cd 0000000000388634 0000000000388479 00007fa924e8383a
0709 12:10:04.456156 (+202536us) spinlock_profiling.cc:243] Waited 321 ms on lock 0x7b580045dad0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef7090 00007fa927ee743c 00007fa927eedd53 00007fa927eedcd9 00007fa927eedc69 00007fa927eedc31 00007fa927eecdfd 0000000000388634 0000000000388479 00007fa924ea0475 00007fa924ea27c1
0709 12:10:04.574058 (+117902us) spinlock_profiling.cc:243] Waited 320 ms on lock 0x7b58003d01d0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef7090 00007fa927ee743c 00007fa927eedd53 00007fa927eedcd9 00007fa927eedc69 00007fa927eedc31 00007fa927eecdfd 0000000000388634 0000000000388479 00007fa924ea0475 00007fa924ea27c1
0709 12:10:07.339995 (+2765937us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23458,"raft.queue_time_us":12716,"raft.run_cpu_time_us":5845,"raft.run_wall_time_us":735259,"spinlock_wait_cycles":2600161792,"thread_start_us":354692,"threads_started":1,"wal-append.queue_time_us":431586,"wal-append.run_cpu_time_us":6104,"wal-append.run_wall_time_us":1257182}
I20260709 12:10:07.500854 15015 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:07.502189 14411 raft_consensus.cc:1275] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:07.503672 15183 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:07.503955 15363 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
W20260709 12:10:07.505468 15238 consensus_meta.cc:287] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.796s	user 0.010s	sys 0.008s
I20260709 12:10:07.505988 15238 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:07.474517 15147 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:07.507491 13761 raft_consensus.cc:2393] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 3: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:07.508989 15238 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:07.509073 15147 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:07.476758 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:07.512629 13652 leader_election.cc:400] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 3. Current term is 4.
I20260709 12:10:07.516170 13727 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:07.386443 15295 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:07.472712 15248 raft_consensus.cc:2804] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:07.536469 15295 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:07.544771 15247 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:07.471505 15368 raft_consensus.cc:2749] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:07.547379 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 54318.3us
I20260709 12:10:07.533795 13651 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:07.504961 15363 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:07.560623 15247 raft_consensus.cc:2804] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:07.561275 15015 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:07.561810 15247 raft_consensus.cc:697] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 3 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:07.559383 13651 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:10:07.564232 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 67352.1us
I20260709 12:10:07.538702 15248 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:07.562687 15351 ts_tablet_manager.cc:1929] T 1e31cd7111f2470d8d34b5898dce5765 P b98d2519bb504dc6905ed2ede4571835: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:10:07.567377 15351 log.cc:1199] T 1e31cd7111f2470d8d34b5898dce5765 P b98d2519bb504dc6905ed2ede4571835: Deleting WAL directory at /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894707649-12515-0/minicluster-data/ts-0-root/wals/1e31cd7111f2470d8d34b5898dce5765
I20260709 12:10:07.554025 15213 raft_consensus.cc:2749] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:07.598701 15095 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:07.604065 15363 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:07.557077 15217 consensus_queue.cc:237] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:07.616755 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 62877us
I20260709 12:10:07.618227 13652 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:07.575870 15248 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:07.682951 15370 log.cc:927] Time spent T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.221s	user 0.000s	sys 0.007s
W20260709 12:10:07.713766 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 144353us
W20260709 12:10:07.763386 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 181993us
I20260709 12:10:07.764601 13800 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:07.551502 15236 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:07.860234 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.581161 15295 raft_consensus.cc:2804] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:10:07.883631 15303 consensus_meta.cc:287] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.669s	user 0.010s	sys 0.018s
W20260709 12:10:07.902643 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 138169us
I20260709 12:10:07.905436 15194 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:07.911118 15368 consensus_queue.cc:1048] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:10:07.896225 15173 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:07.919579 15173 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:07.927975 15236 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:07.932413 15374 log.cc:927] Time spent T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.379s	user 0.000s	sys 0.001s
I20260709 12:10:07.935808 15173 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:07.935799 13757 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 3.
I20260709 12:10:07.912534 13727 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:07.938989 15247 consensus_queue.cc:237] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:07.944907 15351 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41682 (request call id 87) took 1376 ms. Trace:
I20260709 12:10:07.897217 15295 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:07.953897 15295 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:07.909683 15303 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:07.965459 15303 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 3 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:07.948217 15351 rpcz_store.cc:276] 0709 12:10:06.531778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:06.532081 (+   303us) service_pool.cc:224] Handling call
0709 12:10:06.560866 (+ 28785us) ts_tablet_manager.cc:1151] Deleting tablet 1e31cd7111f2470d8d34b5898dce5765
0709 12:10:06.560955 (+    89us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:10:07.219980 (+659025us) tablet_metadata.cc:665] Metadata flushed
0709 12:10:07.562550 (+342570us) tablet_metadata.cc:665] Metadata flushed
0709 12:10:07.907607 (+345057us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":228483,"tablet-delete.queue_time_us":27578,"thread_start_us":27068,"threads_started":1}
W20260709 12:10:07.970490 15340 consensus_meta.cc:287] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.533s	user 0.012s	sys 0.003s
I20260709 12:10:07.960853 15248 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:07.971493 13758 raft_consensus.cc:2410] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:10:07.974849 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 62419.7us
I20260709 12:10:07.975660 13727 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:07.976693 13727 leader_election.cc:400] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 election: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 3. Current term is 4.
I20260709 12:10:07.976938 13727 leader_election.cc:403] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:10:07.978705 15236 raft_consensus.cc:2749] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:07.979382 15248 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:07.979553 15236 raft_consensus.cc:2749] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:07.981076 15173 consensus_queue.cc:1059] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:07.982327 15346 raft_consensus.cc:3055] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:07.982465 15303 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:07.982833 15346 raft_consensus.cc:740] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:07.983196 15303 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:07.984047 15346 consensus_queue.cc:260] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:07.986140 15173 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:07.986836 15173 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:07.988914 13800 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:07.992415 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:07.985697 15346 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:07.993244 13762 raft_consensus.cc:2368] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for earlier term 3. Current term is 4.
I20260709 12:10:07.995810 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:07.996403 13762 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:08.001187 15295 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:08.009581 13762 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 2.
I20260709 12:10:08.009202 15295 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:08.010353 15340 raft_consensus.cc:2749] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 3. Current term is 4.
I20260709 12:10:08.020413 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:08.023619 13800 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:08.025075 14379 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:08.029362 14379 leader_election.cc:400] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 3 election: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for earlier term 3. Current term is 4.
I20260709 12:10:08.026942 15330 raft_consensus.cc:2749] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:08.030364 15195 raft_consensus.cc:2804] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:08.032135 14379 leader_election.cc:403] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:10:08.031188 13754 raft_consensus.cc:1275] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:08.027860 15342 raft_consensus.cc:2804] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:08.038112 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:08.021540 15303 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:08.035049 14379 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:08.040700 15248 raft_consensus.cc:2804] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:08.041335 15248 raft_consensus.cc:697] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 2 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:08.042138 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:08.042754 14413 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:08.042595 15248 consensus_queue.cc:237] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:08.043427 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:08.044111 13830 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:08.048017 13570 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c89d2a3019c74941a4f8dffc9aa5cf40 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:10:08.049201 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:08.055106 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:08.055967 13829 raft_consensus.cc:2368] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 2. Current term is 3.
I20260709 12:10:08.067082 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:08.067869 13834 raft_consensus.cc:2393] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 3: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:08.069344 13800 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:08.038502 15380 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:08.073683 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:08.076997 13830 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 6.
I20260709 12:10:08.078079 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:08.078394 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:08.078079 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:08.079710 13835 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:08.079774 14411 raft_consensus.cc:2393] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 3: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:08.051116 15195 raft_consensus.cc:697] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 4 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:08.078522 15383 raft_consensus.cc:2804] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:08.081919 15195 consensus_queue.cc:237] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:08.082773 15383 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:08.083268 15383 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:08.085397 15288 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:08.086388 15288 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:08.089833 15288 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:08.090499 15288 consensus_queue.cc:1048] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:08.075259 15173 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:08.057760 15342 raft_consensus.cc:697] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 4 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
W20260709 12:10:08.094939 15378 log.cc:927] Time spent T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.179s	user 0.003s	sys 0.000s
I20260709 12:10:08.096517 15342 consensus_queue.cc:237] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:08.099066 13835 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 4.
I20260709 12:10:08.104056 13761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48114 (request call id 1701) took 1119 ms. Trace:
I20260709 12:10:08.104709 13761 rpcz_store.cc:276] 0709 12:10:06.983715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:06.996949 (+ 13234us) service_pool.cc:224] Handling call
0709 12:10:08.102655 (+1105706us) spinlock_profiling.cc:243] Waited 478 ms on lock 0x7b54002ef754. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:08.102831 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1100294400}
I20260709 12:10:08.112910 15173 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:08.113903 15173 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:08.116359 15173 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:08.120446 14413 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 2.
I20260709 12:10:08.065303 13828 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 2.
I20260709 12:10:08.135275 15173 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:08.135988 15173 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:08.137585 15081 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:08.138283 15173 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:08.138141 15081 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:08.117121 15383 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:08.140285 15081 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:08.141113 13727 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:08.141863 15081 raft_consensus.cc:2749] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.142059 15383 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:08.145176 13727 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:08.167761 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:08.168551 14416 raft_consensus.cc:2468] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 1.
I20260709 12:10:08.168634 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:08.169662 14415 raft_consensus.cc:2393] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 2: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:10:08.169620 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:08.173739 15380 raft_consensus.cc:2749] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for earlier term 3. Current term is 4.
I20260709 12:10:08.175509 14413 raft_consensus.cc:1240] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 1. Current term is 2. Ops: []
W20260709 12:10:08.178017 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 109812us
I20260709 12:10:08.179862 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:08.183583 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:08.187064 13835 raft_consensus.cc:1275] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:08.187490 13758 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.189829 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:08.190055 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:08.193668 13760 raft_consensus.cc:1240] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:08.189705 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 44608.7us
I20260709 12:10:08.194834 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:08.199352 13828 raft_consensus.cc:2468] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 1.
I20260709 12:10:08.197863 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:08.196907 13834 raft_consensus.cc:1275] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:08.201490 13727 leader_election.cc:400] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 election: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 2. Current term is 3.
I20260709 12:10:08.204774 13727 leader_election.cc:403] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:10:08.192358 15236 raft_consensus.cc:2804] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:08.207660 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:08.208410 13829 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 2.
I20260709 12:10:08.212662 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:08.213408 13830 raft_consensus.cc:2368] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for earlier term 3. Current term is 4.
I20260709 12:10:08.209223 13727 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:08.217700 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:08.218020 13830 raft_consensus.cc:1275] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:08.216519 15236 raft_consensus.cc:697] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:08.230942 15236 consensus_queue.cc:237] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:08.217737 15388 consensus_queue.cc:1059] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:10:08.235654 15388 raft_consensus.cc:3055] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:08.236308 15388 raft_consensus.cc:740] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:08.216668 15081 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.237638 15388 consensus_queue.cc:260] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:08.267722 14410 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 4.
I20260709 12:10:08.281868 15388 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:08.288873 15391 log.cc:927] Time spent T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 12:10:08.298970 15147 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:08.299841 15147 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:08.354744 15330 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:08.355619 15330 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:08.364954 15342 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:08.366008 15342 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:08.375478 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:08.384562 15173 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:08.385521 15173 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:08.426800 13831 raft_consensus.cc:1275] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:08.427022 15330 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:08.430101 15173 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:08.430472 15147 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:08.435007 13727 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:08.436352 13727 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:08.437331 15081 raft_consensus.cc:2804] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:08.437975 15081 raft_consensus.cc:697] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:08.439162 15081 consensus_queue.cc:237] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:08.442049 15213 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:08.442796 15213 raft_consensus.cc:697] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:08.444172 15213 consensus_queue.cc:237] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:08.449791 13727 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:08.454042 15368 raft_consensus.cc:2804] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:08.454972 15368 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:08.455464 15368 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.456284 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:08.461089 15342 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:10:08.472697 13800 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.515s (SENT) [suppressed 2 similar messages]
I20260709 12:10:08.473810 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:08.474675 13831 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 1.
I20260709 12:10:08.476979 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:08.477511 13758 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 3.
I20260709 12:10:08.478173 15340 raft_consensus.cc:2749] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 2. Current term is 3.
I20260709 12:10:08.489383 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:08.496615 15173 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:08.497614 15173 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:08.500602 15383 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:08.501540 15383 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:08.504593 13801 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:08.506615 15383 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:08.510815 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:08.513325 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:08.514515 13830 raft_consensus.cc:1240] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:08.502135 15368 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:08.503293 15385 consensus_queue.cc:1048] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:08.503732 15173 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:08.529215 13801 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:08.530553 15173 raft_consensus.cc:2749] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:08.492939 15342 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:08.523422 15194 raft_consensus.cc:2804] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:08.536845 14380 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:08.538525 15380 consensus_queue.cc:1048] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:08.539911 15380 raft_consensus.cc:2804] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:08.540493 15380 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:08.540745 14380 leader_election.cc:400] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 3 election: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for earlier term 3. Current term is 4.
I20260709 12:10:08.541035 15380 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:08.542130 15379 consensus_queue.cc:1048] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:08.542502 15248 consensus_queue.cc:1059] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:08.543560 15288 raft_consensus.cc:3055] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:08.543960 15288 raft_consensus.cc:740] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:08.544756 15288 consensus_queue.cc:260] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:08.545922 15288 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:08.549299 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:10:08.539847 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 48706.4us
I20260709 12:10:08.534385 15194 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:08.557032 15194 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:08.559070 15380 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:08.535925 15342 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:08.568640 15342 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:08.524344 15147 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:08.575529 13757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38932 (request call id 152) took 1155 ms. Trace:
I20260709 12:10:08.576042 13757 rpcz_store.cc:276] 0709 12:10:07.419956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:07.420058 (+   102us) service_pool.cc:224] Handling call
0709 12:10:08.575326 (+1155268us) spinlock_profiling.cc:243] Waited 496 ms on lock 0x7b54000a0ad4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:08.575458 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1141188352}
I20260709 12:10:08.572270 15147 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:08.595896 15213 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:08.597947 15368 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:08.599841 13759 raft_consensus.cc:1275] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:08.601433 13760 raft_consensus.cc:1275] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:08.602383 15194 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:08.603335 13727 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:08.599951 15213 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:08.604187 15398 consensus_queue.cc:1048] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:08.613112 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:08.618953 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:08.601500 15380 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:08.620537 13759 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 1.
I20260709 12:10:08.621968 15213 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:08.622495 15393 log.cc:927] Time spent T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.418s	user 0.010s	sys 0.000s
I20260709 12:10:08.619879 13831 raft_consensus.cc:2393] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 2: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:08.651176 15402 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.102640 15402 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:09.106479 15402 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:08.673168 15398 raft_consensus.cc:2804] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:09.107362 15398 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:09.107899 15398 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:08.671305 14380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:08.778877 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 1.16068e+06us
I20260709 12:10:09.117514 13652 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:09.118563 15253 raft_consensus.cc:2804] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:09.118981 15253 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:09.119567 15253 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:09.120337 13652 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:10:08.780756 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 249177us
I20260709 12:10:08.794430 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:08.794896 13688 raft_consensus.cc:1275] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:08.799216 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:08.800722 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:08.802743 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:09.126307 13681 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 3.
I20260709 12:10:08.650240 15194 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:08.813313 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:08.789691 15247 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:09.130934 15247 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:09.133208 15247 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:08.783807 15280 consensus_queue.cc:1048] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 12:10:08.777617 15365 raft_consensus.cc:2749] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.852906 15252 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:09.137600 15252 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:09.139966 15252 leader_election.cc:290] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:08.868664 15340 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:09.140659 15340 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:09.141952 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:09.142745 14413 raft_consensus.cc:2393] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 2: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:10:09.142928 15340 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:08.953614 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:09.146073 13682 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 1.
W20260709 12:10:08.989934 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:08.991451 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:08.991463 13685 raft_consensus.cc:1275] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:10:08.993779 15371 log.cc:927] Time spent T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 1.531s	user 0.016s	sys 0.013s
I20260709 12:10:08.994890 13684 raft_consensus.cc:3055] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:09.149590 13684 raft_consensus.cc:740] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:09.150975 15155 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:09.016592 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:09.151628 15155 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:09.016999 15173 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:09.152832 15173 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:09.154435 15155 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:09.154865 15173 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:09.032294 15342 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:09.041075 15303 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:08.562028 13570 catalog_manager.cc:5028] TS b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): tablet 1e31cd7111f2470d8d34b5898dce5765 (table test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]) successfully deleted
W20260709 12:10:09.158845 13570 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 596802us
I20260709 12:10:09.158792 15303 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:09.052174 13586 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45610 (request call id 252) took 4433 ms. Trace:
I20260709 12:10:09.071806 15346 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:09.161008 15303 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:09.082477 13582 catalog_manager.cc:5697] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 1 to 2, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 2 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:10:09.085512 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 482259us
I20260709 12:10:09.160725 13586 rpcz_store.cc:276] 0709 12:10:04.619295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:04.624764 (+  5469us) service_pool.cc:224] Handling call
0709 12:10:09.052067 (+4427303us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:07.083503 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:07.333369 (+249866us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:07.346100 (+ 12731us) write_op.cc:435] Acquired schema lock
0709 12:10:07.348215 (+  2115us) tablet.cc:662] Decoding operations
0709 12:10:07.395696 (+ 47481us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:07.395810 (+   114us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:07.395839 (+    29us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:10:07.396333 (+   494us) tablet.cc:701] Row locks acquired
0709 12:10:07.396378 (+    45us) write_op.cc:260] PREPARE: finished
0709 12:10:07.396570 (+   192us) write_op.cc:270] Start()
0709 12:10:07.396748 (+   178us) write_op.cc:276] Timestamp: P: 1783599007396502 usec, L: 0
0709 12:10:07.396787 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 12:10:07.397479 (+   692us) log.cc:844] Serialized 1696 byte log entry
0709 12:10:08.103495 (+706016us) op_driver.cc:464] REPLICATION: finished
0709 12:10:08.129884 (+ 26389us) write_op.cc:301] APPLY: starting
0709 12:10:08.130044 (+   160us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:08.130269 (+   225us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:08.130467 (+   198us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:08.131385 (+   918us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:08.131752 (+   367us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:10:08.131831 (+    79us) write_op.cc:312] APPLY: finished
0709 12:10:08.132234 (+   403us) log.cc:844] Serialized 41 byte log entry
0709 12:10:08.198016 (+ 65782us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:08.204609 (+  6593us) write_op.cc:454] Released schema lock
0709 12:10:08.213245 (+  8636us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:08.260271 (+ 47026us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:08.261568 (+  1297us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":54213,"reported_tablets":7,"spinlock_wait_cycles":7424,"child_traces":[["op",{"apply.queue_time_us":26017,"apply.run_cpu_time_us":3503,"apply.run_wall_time_us":95229,"num_ops":4,"prepare.queue_time_us":297008,"prepare.run_cpu_time_us":64868,"prepare.run_wall_time_us":528017,"raft.queue_time_us":143565,"raft.run_cpu_time_us":6796,"raft.run_wall_time_us":40926,"replication_time_us":706555,"spinlock_wait_cycles":16640,"thread_start_us":528877,"threads_started":4,"wal-append.queue_time_us":502656,"wal-append.run_cpu_time_us":55851,"wal-append.run_wall_time_us":1232959}]]}
I20260709 12:10:09.161273 15346 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:09.168314 15346 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:09.173305 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:09.091487 13583 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53318 (request call id 139) took 4549 ms. Trace:
I20260709 12:10:09.099196 15249 consensus_queue.cc:1048] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:09.197154 13583 rpcz_store.cc:276] 0709 12:10:04.575055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:04.580210 (+  5155us) service_pool.cc:224] Handling call
0709 12:10:04.659797 (+ 79587us) spinlock_profiling.cc:243] Waited 48.6 ms on lock 0x7b5400373cd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef7090 00007fa927f95f3a 00007fa92dd4be9c 00007fa92de4a04e 00007fa92c30b2a4 00007fa92c30b232 00007fa92c30b161 00007fa92c30b0dc 00007fa92c30a392 00007fa9262c848c 00007fa9262c78c6
0709 12:10:09.091294 (+4431497us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":471010,"reported_tablets":5,"spinlock_wait_cycles":111832832}
I20260709 12:10:09.113382 13800 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:10:09.204891 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 91589.8us
I20260709 12:10:09.205058 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:09.205667 13683 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:09.206521 13828 raft_consensus.cc:1275] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:09.208720 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:09.209008 15194 raft_consensus.cc:2749] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:09.210594 13760 raft_consensus.cc:1275] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:09.211319 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:09.211719 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:09.213325 13800 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:09.215368 13680 raft_consensus.cc:2393] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 3: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:09.216305 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:09.217728 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:09.115306 15288 consensus_queue.cc:1048] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:09.126994 15295 raft_consensus.cc:2749] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:09.129276 13652 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:09.149243 15248 consensus_queue.cc:1048] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:10:09.220124 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 90963.6us
W20260709 12:10:09.220568 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 70329.7us
I20260709 12:10:09.221832 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:09.221951 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:09.225435 13759 raft_consensus.cc:1240] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:09.150571 13684 consensus_queue.cc:260] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:09.032814 15330 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:09.156368 14379 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:10:09.230311 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 74017.1us
I20260709 12:10:09.231055 14379 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:09.039997 15380 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:09.174784 15398 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:09.232380 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:09.232909 13836 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:09.180491 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:10:09.192022 13570 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet a34b21ec197b4241a780a8ae562e4602 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica b98d2519bb504dc6905ed2ede4571835 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:10:09.087585 15147 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:09.198518 13688 raft_consensus.cc:2393] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 5: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:09.236217 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:09.202054 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:09.238245 13758 raft_consensus.cc:2393] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 3: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:09.238744 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:09.200543 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:09.236318 15236 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.242012 13684 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:09.290217 13687 raft_consensus.cc:2368] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 2. Current term is 3.
I20260709 12:10:09.158094 15342 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:09.202776 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:09.228107 13800 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:09.293610 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:09.238011 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:09.296989 13834 raft_consensus.cc:1275] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:10:09.300453 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 72456.6us
I20260709 12:10:09.300712 13837 raft_consensus.cc:1813] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Handling vote request from an unknown peer 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:09.302280 13837 raft_consensus.cc:2410] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 3 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:10:09.310129 13652 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:09.311017 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:09.312021 13652 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:09.308346 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:10:09.293036 15401 log.cc:927] Time spent T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:10:09.346127 13830 raft_consensus.cc:2468] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 1.
I20260709 12:10:09.347774 13652 leader_election.cc:400] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 election: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 3. Current term is 4.
I20260709 12:10:09.239378 14408 raft_consensus.cc:1813] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Handling vote request from an unknown peer 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:09.295055 15365 raft_consensus.cc:2749] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:09.229887 15346 raft_consensus.cc:2804] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:09.230613 15081 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:09.231366 15368 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:09.407981 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:09.408136 13756 raft_consensus.cc:1275] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:09.408252 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:09.408983 13758 raft_consensus.cc:1275] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:09.404031 13652 leader_election.cc:403] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:10:09.411024 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:09.427600 13837 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 1.
I20260709 12:10:09.425470 13683 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 6.
I20260709 12:10:09.247566 15340 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:09.359825 13686 raft_consensus.cc:1275] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:09.348201 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:09.405474 15247 raft_consensus.cc:2804] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:09.287575 15330 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:09.313978 15015 raft_consensus.cc:2804] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:09.344534 15280 raft_consensus.cc:2804] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:09.472110 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:09.308254 15236 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:09.309437 15417 raft_consensus.cc:2749] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:09.411134 15303 raft_consensus.cc:2804] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:09.437141 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:09.405056 14411 raft_consensus.cc:1275] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:10:09.464573 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 116967us
I20260709 12:10:09.507481 13652 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:09.439687 13681 raft_consensus.cc:1275] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:09.498807 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:09.404003 15380 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:09.438428 15346 raft_consensus.cc:697] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 3 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:09.470672 15194 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:09.484905 14408 raft_consensus.cc:2410] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 3 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:10:09.510037 13652 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:09.510804 14413 raft_consensus.cc:2468] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 1.
I20260709 12:10:09.520257 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:09.521065 13687 raft_consensus.cc:2368] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 2. Current term is 3.
I20260709 12:10:09.468894 15383 consensus_queue.cc:1059] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:10:09.462128 15247 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:09.525398 15247 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:09.522835 15365 raft_consensus.cc:2749] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:09.529196 15383 raft_consensus.cc:3055] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:09.529838 15383 raft_consensus.cc:740] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:09.531200 15236 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:09.530995 15383 consensus_queue.cc:260] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:09.533047 15383 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:09.430472 15081 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:09.480116 15280 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:09.479542 15252 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:09.505940 13684 raft_consensus.cc:1275] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:09.477757 15015 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:09.426910 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:09.523172 13652 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:09.524931 13754 raft_consensus.cc:2393] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 5: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
W20260709 12:10:09.515872 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 81409.4us
I20260709 12:10:09.462627 15340 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:09.507903 15303 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:09.433399 15368 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:09.510473 15295 raft_consensus.cc:2749] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:09.559638 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:09.562400 13681 raft_consensus.cc:1240] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:09.564680 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 333682us
I20260709 12:10:09.566164 14379 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:09.554744 15280 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:09.555015 15015 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:09.560431 15253 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:09.573624 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:09.567816 15173 consensus_queue.cc:1048] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:10:09.558504 15303 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:09.576627 13679 raft_consensus.cc:2393] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 3: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:09.577157 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:09.562801 15365 raft_consensus.cc:2804] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:09.550303 15194 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:09.578605 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:10:09.583627 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:09.587396 13681 raft_consensus.cc:2393] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 6: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:09.588500 14379 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:09.565577 15388 consensus_queue.cc:1048] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 12:10:09.597939 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:09.600104 15330 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:09.600562 15413 raft_consensus.cc:2804] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:09.601444 13837 raft_consensus.cc:1240] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:09.575129 15155 consensus_queue.cc:1048] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:10:09.606719 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:09.615403 13836 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 3.
I20260709 12:10:09.616503 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:09.585562 15365 raft_consensus.cc:697] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 3 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:09.624797 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:09.623291 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:09.627336 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:09.627701 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:09.632445 15288 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.617226 15413 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:09.633414 15413 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:09.633049 15288 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:09.632941 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:09.634871 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:09.636298 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:09.588676 15426 raft_consensus.cc:2749] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:09.640506 13683 raft_consensus.cc:2410] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:09.646579 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:09.647435 13686 raft_consensus.cc:1813] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Handling vote request from an unknown peer 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:09.648154 13686 raft_consensus.cc:2410] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:10:09.649119 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:09.651019 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:09.652803 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:09.651742 13830 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 1.
I20260709 12:10:09.653610 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:09.654161 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:09.654758 13836 raft_consensus.cc:2368] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 5. Current term is 6.
I20260709 12:10:09.656208 13680 raft_consensus.cc:1240] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:09.586858 15346 consensus_queue.cc:237] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:09.658802 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:09.659956 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:09.659682 13682 raft_consensus.cc:2393] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 3: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:09.660987 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:10:09.663466 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:09.665570 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:09.666445 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:09.666905 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:09.675987 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:09.690817 13686 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 3.
I20260709 12:10:09.682312 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:09.669066 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:09.683111 15365 consensus_queue.cc:237] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:09.685290 15081 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:10:09.685462 15422 log.cc:927] Time spent T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:10:09.687845 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:09.674513 15368 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:09.622143 15424 consensus_queue.cc:1048] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 12:10:09.689543 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:09.667660 15380 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:09.691051 15288 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:09.667305 15253 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:09.684473 15252 raft_consensus.cc:2749] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 3. Current term is 4.
I20260709 12:10:09.675376 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:09.693903 15155 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:09.695945 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:09.693507 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:09.714288 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:09.696880 13683 raft_consensus.cc:1275] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:09.703320 13830 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 5.
I20260709 12:10:09.705451 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:09.706947 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:09.709553 13833 raft_consensus.cc:1275] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:09.715843 13835 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 2.
I20260709 12:10:09.692276 15342 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:10:09.704547 13652 connection.cc:256] RPC call timeout handler was delayed by -1.5253696360000504s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15910000000000002s for a response
W20260709 12:10:09.717685 13652 connection.cc:256] RPC call timeout handler was delayed by -1.3659318270001677s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1644s for a response
W20260709 12:10:09.718258 13652 connection.cc:256] RPC call timeout handler was delayed by -1.3462696359999882s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17900000000000002s for a response
W20260709 12:10:09.718689 13652 connection.cc:256] RPC call timeout handler was delayed by -1.3441092099999423s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1705s for a response
I20260709 12:10:09.719496 13652 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:09.707450 15295 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.713325 15368 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.704188 15303 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:09.725626 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:09.749558 13752 tablet_service.cc:1558] Processing DeleteTablet for tablet c95811190f014949bb25448e8db1040e with delete_type TABLET_DATA_TOMBSTONED (TS 3f37c9cc9dda46b4be21dd675ba78fb7 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48110
W20260709 12:10:09.964371 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:09.924521 13726 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.860s	user 0.035s	sys 0.047s
I20260709 12:10:09.922124 14408 raft_consensus.cc:1240] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:09.953790 14380 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:09.900225 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:09.988438 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:09.990259 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:09.993459 15295 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:09.747759 13727 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:09.991158 14414 raft_consensus.cc:1240] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:09.991140 13652 leader_election.cc:400] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 election: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 2. Current term is 3.
I20260709 12:10:09.996008 15081 raft_consensus.cc:2804] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:09.763854 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:09.996807 15081 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:09.997260 15081 raft_consensus.cc:3060] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:09.898511 15015 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:09.998778 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:09.999123 13832 raft_consensus.cc:2393] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 2: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:10.000339 15015 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:09.939890 15280 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:09.740417 15427 log.cc:927] Time spent T 00000000000000000000000000000000 P 17d79eae88f84be7a847d0cf544674cd: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 12:10:09.751447 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:09.743337 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:09.805917 15424 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.013921 15424 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:09.721547 15428 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.753098 15247 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:10.017642 15428 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:10.019908 15398 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:10.021893 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:10.022480 15194 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:10.025418 15426 consensus_queue.cc:1048] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:10.026947 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:10.028301 13685 raft_consensus.cc:2393] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 3: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:10.029515 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:09.907361 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:09.751163 15406 consensus_queue.cc:1048] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.254s
I20260709 12:10:09.896288 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:09.779568 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:10:10.005903 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 258287us
I20260709 12:10:09.717336 15155 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:10.047600 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:09.994939 13652 leader_election.cc:403] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:10:09.878345 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:10.006779 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:10:10.050529 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 59549us
I20260709 12:10:10.051028 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:10.052241 13652 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:10.052505 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:10.053031 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:10.053292 13687 raft_consensus.cc:2393] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 6: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:10.050910 15365 raft_consensus.cc:2749] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 2. Current term is 3.
I20260709 12:10:10.055436 15252 raft_consensus.cc:2749] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:09.995973 15295 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:10.057138 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:10.007616 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:10.007814 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:10.062239 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:10:09.823801 13709 debug-util.cc:398] Leaking SignalData structure 0x7b0800107ae0 after lost signal to thread 12518
I20260709 12:10:09.950165 15413 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:09.982856 13726 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.918s	user 0.036s	sys 0.052s
I20260709 12:10:09.877892 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:10.008694 15368 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:10.009894 15081 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:10.010561 13684 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 4.
I20260709 12:10:10.011504 13762 raft_consensus.cc:1240] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:10:09.724522 15253 raft_consensus.cc:2749] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:09.979336 14412 raft_consensus.cc:1240] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:09.923308 14416 raft_consensus.cc:1240] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:10.014286 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:10.014743 15417 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:10.015026 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:10.015923 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:09.998045 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:10.020684 13683 raft_consensus.cc:2376] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 4. Re-sending same reply.
I20260709 12:10:10.003794 15280 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:10.036121 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 53402.2us
I20260709 12:10:10.013190 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:10.082556 15015 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.021571 15340 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:10.139209 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:10:10.082525 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:10.140520 15439 log.cc:927] Time spent T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:10:10.141284 15194 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:10.082903 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:10:10.085650 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 1.02124e+06us
I20260709 12:10:10.086879 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:10:10.100247 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:10.142387 14408 raft_consensus.cc:1240] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:10.126890 13686 raft_consensus.cc:2368] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 2. Current term is 3.
I20260709 12:10:10.078547 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:10.143369 15194 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:10.144439 15346 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.145030 15195 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:10.145747 15385 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.175908 13800 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:10.146049 15015 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:10.179019 15388 raft_consensus.cc:2749] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:10.146953 13709 debug-util.cc:398] Leaking SignalData structure 0x7b08000cb080 after lost signal to thread 13620
I20260709 12:10:10.128572 15417 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:10.147897 15431 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.148993 15155 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:10.019938 15247 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:10.153137 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:10.154328 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:10.186254 13831 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:10.158313 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:10:10.159438 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 107269us
I20260709 12:10:10.187284 13652 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:10.124264 15380 raft_consensus.cc:2804] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:10.122867 15423 consensus_queue.cc:1048] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 12:10:10.183921 13800 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:10:10.160126 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 76103.8us
I20260709 12:10:10.195622 14379 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:10.177289 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:10.196825 13832 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 3.
I20260709 12:10:10.205061 13682 raft_consensus.cc:1275] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:10.209985 13800 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:10.213850 13800 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:10.186014 15424 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:10.225631 13831 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 2.
I20260709 12:10:10.179997 15195 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:10.218060 15342 raft_consensus.cc:2749] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:10.185050 15383 consensus_queue.cc:1059] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
W20260709 12:10:10.258045 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 62529us
I20260709 12:10:10.227496 15388 raft_consensus.cc:2749] T c89d2a3019c74941a4f8dffc9aa5cf40 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:10.183250 15385 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:10.260699 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 73529.9us
W20260709 12:10:10.243011 13709 debug-util.cc:398] Leaking SignalData structure 0x7b08002b0cc0 after lost signal to thread 13712
I20260709 12:10:10.181522 15346 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:10.257162 15438 tablet_replica.cc:333] T c95811190f014949bb25448e8db1040e P 3f37c9cc9dda46b4be21dd675ba78fb7: stopping tablet replica
I20260709 12:10:10.268558 15413 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:10.270260 15443 raft_consensus.cc:2804] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:10.270421 15194 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:10.213284 15247 consensus_queue.cc:1048] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
W20260709 12:10:10.265988 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 150230us
W20260709 12:10:10.272724 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 91805.4us
I20260709 12:10:10.269333 15420 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:10:10.274825 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 61099.6us
I20260709 12:10:10.284621 13800 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:10.275417 14379 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:10.191432 15431 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:10.279834 13835 raft_consensus.cc:1275] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:10.277493 15342 raft_consensus.cc:2749] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:10.282351 15449 raft_consensus.cc:2749] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:10.285837 13800 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:10.304385 13800 leader_election.cc:304] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:10.286556 15443 raft_consensus.cc:697] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 3 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:10.288441 15194 raft_consensus.cc:2749] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:10.289990 15424 raft_consensus.cc:2749] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:10.292371 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:10.293917 15417 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:10.294363 13709 debug-util.cc:398] Leaking SignalData structure 0x7b0800126b80 after lost signal to thread 13787
I20260709 12:10:10.294622 15015 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:10.296518 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:10.297493 15346 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:10.299070 15420 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:10.301195 15380 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:10.306433 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:10.301857 15195 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:10.309763 13800 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:10.317646 15342 raft_consensus.cc:2804] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:10.316781 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:10.275048 15253 consensus_queue.cc:1059] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:10:10.336220 13687 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:10.320345 13727 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:10.361018 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:10.328133 13726 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:10.353726 14380 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
W20260709 12:10:10.357658 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 46834.1us
I20260709 12:10:10.360719 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:10.366820 13652 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:10.361676 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:10.361130 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:10.370352 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:10.371665 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:10.367846 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:10.322316 15194 raft_consensus.cc:2749] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:10.325565 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:10.318434 15081 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:10.452715 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:10:10.453658 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 100038us
I20260709 12:10:10.453277 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:10.460717 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:10.378088 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:10:10.408706 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 99048.3us
I20260709 12:10:10.325014 15431 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:10:10.463264 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 96530.6us
I20260709 12:10:10.462302 13800 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:10.466502 13652 leader_election.cc:400] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 election: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 5. Current term is 6.
I20260709 12:10:10.325336 15428 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:10.467012 13652 leader_election.cc:403] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:10:10.463475 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:10.328205 15385 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:10.379104 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:10.369010 13686 raft_consensus.cc:2376] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 6. Re-sending same reply.
I20260709 12:10:10.357640 15380 raft_consensus.cc:3060] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:10.409142 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 48653.4us
W20260709 12:10:10.407892 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 79832.6us
I20260709 12:10:10.475140 13652 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:10.472076 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:10.478890 13683 raft_consensus.cc:1240] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:10.358899 15342 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:10.366725 15368 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:10.479697 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:10.449606 15402 raft_consensus.cc:2749] T c95811190f014949bb25448e8db1040e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:10.498088 15455 raft_consensus.cc:2749] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:10.368937 15452 consensus_queue.cc:1059] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.130s
I20260709 12:10:10.479673 15247 raft_consensus.cc:2804] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:10.499768 15252 raft_consensus.cc:3055] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:10.500285 15247 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:10.500416 15252 raft_consensus.cc:740] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:10.500746 15247 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:10.501381 15252 consensus_queue.cc:260] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:10.502910 15252 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:10.462939 15417 raft_consensus.cc:2749] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:10.491839 13834 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 5.
I20260709 12:10:10.408564 15446 raft_consensus.cc:2749] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:10.332862 15443 consensus_queue.cc:237] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:10.476190 15155 raft_consensus.cc:2749] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 5. Current term is 6.
I20260709 12:10:10.483944 13726 leader_election.cc:400] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 election: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 2. Current term is 3.
I20260709 12:10:10.485067 13800 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:10.509220 13800 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:10.479862 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:10.452837 15217 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.486660 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:10.322530 15340 consensus_queue.cc:1048] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.149s
I20260709 12:10:10.521311 15420 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:10.521989 15383 raft_consensus.cc:2749] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:10.408878 15195 raft_consensus.cc:2749] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:10.488771 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:10.490553 13687 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 2.
I20260709 12:10:10.493827 15303 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 4 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:10.495388 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:10.496852 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:10.481516 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:10:10.408214 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 87954.9us
I20260709 12:10:10.528786 14416 raft_consensus.cc:2410] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 5 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:10:10.528726 13727 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:10.358083 15450 consensus_queue.cc:1059] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.127s
I20260709 12:10:10.492452 15342 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:10.487746 13709 debug-util.cc:398] Leaking SignalData structure 0x7b0800377f80 after lost signal to thread 13861
I20260709 12:10:10.532230 13727 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:10.483628 13652 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:10.530663 14380 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:10.476820 15015 consensus_queue.cc:1048] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:10:10.476675 13754 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 4.
I20260709 12:10:10.489374 15428 raft_consensus.cc:2749] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:10.540299 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:10.517481 15217 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:10.518026 15194 raft_consensus.cc:2749] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:10.540825 13727 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:10.523653 15247 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:10.525570 14379 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:10.530944 14409 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 2.
I20260709 12:10:10.513622 13800 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:10.531436 15081 consensus_queue.cc:1048] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:10:10.534363 15303 raft_consensus.cc:2749] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:10.530262 15340 consensus_queue.cc:1048] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:10:10.553473 13727 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:10.555977 13727 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:10.534898 15446 raft_consensus.cc:2804] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:10.556572 15461 raft_consensus.cc:2804] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:10.556656 15446 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:10.557175 15461 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:10.557274 15446 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:10.550930 15402 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:10.535552 15450 raft_consensus.cc:3055] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:10.536032 14415 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 5.
I20260709 12:10:10.536429 14380 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:10:10.532346 13709 debug-util.cc:398] Leaking SignalData structure 0x7b0800377fc0 after lost signal to thread 13862
I20260709 12:10:10.539938 15368 raft_consensus.cc:2804] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:10.543802 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:10:10.544797 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 61244.7us
W20260709 12:10:10.558815 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 45312.4us
I20260709 12:10:10.566069 13800 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:10.561691 15450 raft_consensus.cc:740] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:10.557633 15461 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:10.563181 13682 raft_consensus.cc:1240] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:10.562311 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:10.569114 13652 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:10.550841 15365 raft_consensus.cc:2749] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:10.571907 13800 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:10.612527 13800 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:10.570820 13686 raft_consensus.cc:1240] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:10.560094 15417 raft_consensus.cc:2804] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:10.556828 15213 raft_consensus.cc:2804] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:10.612744 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:10.609655 15385 consensus_queue.cc:1059] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:10.566439 15249 raft_consensus.cc:2804] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:10.635080 13801 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:10.564177 15015 raft_consensus.cc:2749] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:10.642745 13800 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:10.643839 13800 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:10.606966 15195 raft_consensus.cc:2749] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:10.647953 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:10.648620 14414 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 5.
I20260709 12:10:10.617466 15295 raft_consensus.cc:2749] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:10.617460 15194 raft_consensus.cc:2749] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:10.648993 13800 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:10.676374 13800 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:10:10.667668 13709 debug-util.cc:398] Leaking SignalData structure 0x7b080028d2a0 after lost signal to thread 14440
I20260709 12:10:10.651099 15383 raft_consensus.cc:2749] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:10.670083 15430 raft_consensus.cc:2804] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:10.691928 13800 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:10.693190 13800 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:10.672027 15015 raft_consensus.cc:2749] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:10.669667 15417 raft_consensus.cc:697] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 2 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:10.696466 13800 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:10.678403 14408 raft_consensus.cc:1275] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:10.702910 13800 leader_election.cc:400] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 election: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 2. Current term is 3.
I20260709 12:10:10.689749 15249 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:10.694692 15430 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:10.868533 15430 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:10.874711 15247 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:10.645190 15459 consensus_queue.cc:1048] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.090s
I20260709 12:10:10.695541 15195 raft_consensus.cc:2749] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:10.698215 15194 raft_consensus.cc:2749] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:10.899828 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 186976us
I20260709 12:10:10.913686 13800 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:10.827725 15461 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:10.859349 15457 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:10.859935 15467 raft_consensus.cc:2749] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:10.699002 15431 raft_consensus.cc:2749] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:10.860818 15280 raft_consensus.cc:3055] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:10.930776 15280 raft_consensus.cc:740] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:10.705899 15383 raft_consensus.cc:2749] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:10.861193 15458 log.cc:927] Time spent T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.250s	user 0.001s	sys 0.000s
W20260709 12:10:10.864784 15464 log.cc:927] Time spent T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.215s	user 0.000s	sys 0.000s
I20260709 12:10:10.884610 15249 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:10.929050 13800 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:10.706363 15380 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:10.718937 13754 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "b98d2519bb504dc6905ed2ede4571835"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:10:10.947634 15446 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:10.933403 15194 raft_consensus.cc:2749] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:10.920011 15303 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:10.920730 15015 consensus_queue.cc:1048] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:10:10.931955 15280 consensus_queue.cc:260] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:10.966182 13727 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:10.952345 15383 raft_consensus.cc:2749] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:11.002434 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:11.005340 15247 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:11.006192 15247 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:11.006491 15388 raft_consensus.cc:3055] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:11.007174 15388 raft_consensus.cc:740] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:11.008342 15247 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:10.972847 15280 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:10.974906 15453 log.cc:927] Time spent T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.723s	user 0.004s	sys 0.010s
I20260709 12:10:10.954387 15417 consensus_queue.cc:237] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:11.014019 15217 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:10.978521 15473 consensus_queue.cc:1059] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:11.015136 15473 raft_consensus.cc:3055] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:10.958814 13754 raft_consensus.cc:606] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Received request to transfer leadership to TS b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:11.015529 15473 raft_consensus.cc:740] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:10.967164 15459 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:11.016471 15459 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:11.016404 15473 consensus_queue.cc:260] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:11.018759 15459 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:10.985118 15380 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 3 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:10.985875 15081 raft_consensus.cc:2749] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:10.961560 15430 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:10.961467 15303 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:11.022296 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:11.017719 15473 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:11.032399 15303 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:11.034750 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:10:11.040433 15342 consensus_meta.cc:287] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.509s	user 0.010s	sys 0.002s
I20260709 12:10:11.040995 15342 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:11.033104 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:10:11.043407 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 73166.3us
I20260709 12:10:11.053004 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:11.053938 13686 raft_consensus.cc:2393] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 3: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:11.054513 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:11.056237 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
W20260709 12:10:11.063700 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 448977us
W20260709 12:10:11.068128 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 108464us
I20260709 12:10:11.065387 13652 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:11.093080 14379 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:11.093858 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:11.094786 13686 raft_consensus.cc:2393] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 2: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:11.078787 13652 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:11.063232 15368 raft_consensus.cc:697] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:11.101497 13679 raft_consensus.cc:1240] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:11.102370 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:11.098903 13652 leader_election.cc:304] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:11.100217 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:11.104192 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:11.104643 13683 raft_consensus.cc:2393] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 3: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:11.106120 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:11.109519 13652 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:11.061187 15213 raft_consensus.cc:697] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:11.115998 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:11.097867 15443 raft_consensus.cc:2749] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:11.066804 13754 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "232d133451004a83941860574adec712"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:10:11.051493 15430 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:10:11.072191 15402 consensus_meta.cc:287] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.506s	user 0.007s	sys 0.004s
I20260709 12:10:11.121354 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:11.121965 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:11.124987 13834 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:11.113646 15253 raft_consensus.cc:2804] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:11.093370 15342 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:11.078207 15446 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:11.124080 13687 raft_consensus.cc:1240] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:11.125308 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:11.133927 13835 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:11.126360 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:11.134987 13831 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 3.
I20260709 12:10:11.091786 15252 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:11.113847 15217 raft_consensus.cc:2749] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:11.132481 13828 raft_consensus.cc:1240] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:10:11.112159 15383 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.071779 14411 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 3.
I20260709 12:10:11.137869 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:11.099866 15155 consensus_queue.cc:1048] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:10:11.155786 13835 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 2.
I20260709 12:10:11.145879 13834 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 4.
I20260709 12:10:11.130235 15253 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:11.127344 15015 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:11.141224 13832 raft_consensus.cc:1240] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:11.132107 13754 raft_consensus.cc:606] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 LEADER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:11.141141 15443 raft_consensus.cc:2804] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:11.134795 15402 raft_consensus.cc:2749] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:11.173278 15432 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.173878 15432 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:11.176512 15478 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:11.177237 15478 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:11.180153 15478 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:11.181130 15469 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:11.181994 15469 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:11.183537 14412 raft_consensus.cc:3060] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:11.185091 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:11.190572 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:11.191555 13831 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 3.
W20260709 12:10:11.193128 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 85106.9us
I20260709 12:10:11.201478 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:11.202620 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:11.203361 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:11.204658 13759 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 3.
I20260709 12:10:11.207868 13756 raft_consensus.cc:1275] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:11.203402 13757 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 4.
I20260709 12:10:11.210186 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:11.211159 13837 raft_consensus.cc:3060] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Advancing to term 3
W20260709 12:10:11.171237 15412 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.904s	user 0.015s	sys 0.015s
I20260709 12:10:11.216655 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:11.217442 13833 raft_consensus.cc:2393] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 5: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:11.217941 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:11.218539 13758 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 3.
I20260709 12:10:11.161253 15253 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:11.161463 15446 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:11.222389 13835 raft_consensus.cc:1240] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:11.228259 13832 raft_consensus.cc:1240] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:10:11.230338 13835 raft_consensus.cc:1240] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:11.235334 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:11.236301 13833 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 3.
I20260709 12:10:11.235030 13652 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:11.158540 15383 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:11.241869 13801 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:11.242846 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:11.176240 15432 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:11.193671 15081 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
W20260709 12:10:11.220548 15412 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.003s	user 0.015s	sys 0.016s
I20260709 12:10:11.327323 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:11.248065 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:11.209048 15443 raft_consensus.cc:697] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 5 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:11.242012 13652 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:11.321851 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:10:11.318845 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 77095.3us
I20260709 12:10:11.170395 15015 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:11.324591 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:11.329345 13832 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 3.
I20260709 12:10:11.212318 15469 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:11.243582 15247 raft_consensus.cc:2749] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:11.337386 13837 raft_consensus.cc:2468] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 3.
I20260709 12:10:11.332201 15455 raft_consensus.cc:2804] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:11.342453 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 100529us
I20260709 12:10:11.371116 13828 raft_consensus.cc:1240] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:11.320009 15413 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.172749 15368 consensus_queue.cc:237] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:11.376545 14380 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:11.239895 15446 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:11.227995 15249 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:11.389259 14379 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:11.213853 15213 consensus_queue.cc:237] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:11.371223 15455 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:11.416245 13727 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:11.418066 15459 raft_consensus.cc:2804] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:11.418522 15459 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:11.419008 15459 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:11.418910 15469 consensus_queue.cc:1048] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:11.485524 15402 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:11.486519 15402 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:11.490000 15402 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:11.386535 15487 log.cc:927] Time spent T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
W20260709 12:10:11.579368 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 174679us
I20260709 12:10:11.580535 13652 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:11.385978 15248 raft_consensus.cc:2804] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:11.376591 15490 raft_consensus.cc:2804] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:11.379597 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:10:11.658941 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 78525.2us
I20260709 12:10:11.677362 14412 raft_consensus.cc:2468] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 2.
I20260709 12:10:11.668354 13759 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:10:11.384832 15417 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:11.403407 15380 raft_consensus.cc:2804] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:11.340420 15081 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:11.678188 13759 raft_consensus.cc:606] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:11.677634 13652 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:11.685266 15380 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:11.578874 15365 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:11.574115 15455 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:11.403023 15247 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:11.380059 15481 consensus_queue.cc:1059] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.299s
I20260709 12:10:11.659595 15398 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:11.376725 15388 consensus_queue.cc:260] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:11.578291 15295 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:10:11.683216 15453 log.cc:927] Time spent T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.279s	user 0.000s	sys 0.000s
I20260709 12:10:11.387291 15413 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:11.675755 15402 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:11.717869 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:11.712802 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:11.679950 15495 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:10:11.724067 15489 log.cc:927] Time spent T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.400s	user 0.001s	sys 0.000s
I20260709 12:10:11.724509 15252 raft_consensus.cc:2749] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:11.676754 15490 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:11.694730 15444 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.770068 15490 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:11.770484 15444 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:11.772917 15444 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:11.667199 15155 consensus_queue.cc:1059] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 12:10:11.774075 15252 raft_consensus.cc:3055] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:11.774533 15252 raft_consensus.cc:740] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:11.775537 15252 consensus_queue.cc:260] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:11.777104 15252 raft_consensus.cc:3060] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:11.731036 14416 raft_consensus.cc:1240] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:11.693748 15248 raft_consensus.cc:697] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 3 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:11.738962 15495 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:11.743826 15457 consensus_meta.cc:287] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.811s	user 0.008s	sys 0.002s
I20260709 12:10:11.725433 15365 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:11.799463 13837 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 2.
I20260709 12:10:11.745003 15402 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:11.745824 14412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41700 (request call id 211) took 1114 ms. Trace:
I20260709 12:10:11.805393 14412 rpcz_store.cc:276] 0709 12:10:10.612195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.612393 (+   198us) service_pool.cc:224] Handling call
0709 12:10:11.726198 (+1113805us) spinlock_profiling.cc:243] Waited 549 ms on lock 0x7b54004d6054. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:11.726475 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1261990784}
I20260709 12:10:11.701234 15380 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:11.705811 15452 raft_consensus.cc:2749] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:11.753136 13727 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:11.757292 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:10:11.810307 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 57268.3us
I20260709 12:10:11.709970 15480 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:11.763311 15249 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 6 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:11.769263 15081 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:11.777833 15388 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:11.733582 15295 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:11.825187 15295 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:11.779079 13755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 1729) took 1295 ms. Trace:
I20260709 12:10:11.825939 13755 rpcz_store.cc:276] 0709 12:10:10.483644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.037884 (+554240us) service_pool.cc:224] Handling call
0709 12:10:11.038211 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:11.038525 (+   314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:11.038552 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:11.039022 (+   470us) log.cc:844] Serialized 26 byte log entry
0709 12:10:11.109309 (+ 70287us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:11.109365 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:11.109456 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:11.778755 (+669299us) raft_consensus.cc:1685] finished
0709 12:10:11.778792 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:11.778995 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2612,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":132,"thread_start_us":69836,"threads_started":1,"wal-append.queue_time_us":174126}
I20260709 12:10:11.816018 13754 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "b98d2519bb504dc6905ed2ede4571835"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:10:11.737125 15413 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:11.716527 15247 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:11.827620 13754 raft_consensus.cc:606] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Received request to transfer leadership to TS b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:11.787365 15015 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:10:11.788455 15280 consensus_meta.cc:287] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.767s	user 0.006s	sys 0.005s
I20260709 12:10:11.789144 15455 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:11.789642 15495 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:11.792135 15461 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:11.726796 15398 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:11.868593 15398 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:11.816350 15480 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:11.794466 15248 consensus_queue.cc:237] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:11.796828 15383 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:11.697350 15417 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:11.698132 15443 consensus_queue.cc:237] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:11.763688 15446 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:11.800565 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:11.758827 15484 log.cc:927] Time spent T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.561s	user 0.000s	sys 0.001s
I20260709 12:10:11.842034 15247 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:11.806825 15457 raft_consensus.cc:2749] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:11.745028 15459 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:11.856282 15253 consensus_meta.cc:287] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.607s	user 0.008s	sys 0.000s
I20260709 12:10:11.858001 15455 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:11.857831 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:11.842664 15385 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.876993 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:11.911113 13688 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 3.
I20260709 12:10:11.882700 15480 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:11.884701 15417 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:11.892367 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:11.894367 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:11.898367 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:11.913214 13829 raft_consensus.cc:1240] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:11.914088 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:11.918563 13760 raft_consensus.cc:1240] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:11.921013 13757 raft_consensus.cc:1240] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:11.922269 13755 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:11.930004 15483 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.022s	sys 0.020s
W20260709 12:10:11.930491 15483 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.022s	sys 0.020s
I20260709 12:10:11.908704 15253 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:11.991992 15253 leader_election.cc:290] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:11.994153 13757 raft_consensus.cc:1240] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:11.918244 15385 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:11.991020 15473 consensus_meta.cc:287] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.949s	user 0.011s	sys 0.002s
I20260709 12:10:12.011736 13756 raft_consensus.cc:1275] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:12.013937 15402 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:12.014552 14381 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.040s	sys 0.063s
I20260709 12:10:12.005038 15173 raft_consensus.cc:3055] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:12.030505 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:11.998624 15471 raft_consensus.cc:2804] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:12.018370 14381 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.040s	sys 0.063s
I20260709 12:10:12.021164 13755 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 6.
I20260709 12:10:12.054186 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:12.054975 14416 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 3.
I20260709 12:10:12.056875 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:12.062472 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:10:12.063524 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:12.023701 15173 raft_consensus.cc:740] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:12.068140 15385 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:12.068498 15380 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:12.070752 13757 raft_consensus.cc:1275] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:10:12.052327 15471 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:12.053264 15452 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:12.098881 15380 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 4 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:12.115607 15488 log.cc:927] Time spent T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.798s	user 0.002s	sys 0.006s
I20260709 12:10:12.116526 15452 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:12.122902 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:12.140272 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:12.122831 13761 raft_consensus.cc:1240] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:12.136806 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:12.143456 13757 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 2.
I20260709 12:10:12.172298 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:12.175474 15483 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:12.126520 15450 consensus_queue.cc:260] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:12.176146 15483 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:12.176718 15450 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:12.178529 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 49047us
I20260709 12:10:12.120472 15452 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:10:12.183656 15500 log.cc:927] Time spent T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.745s	user 0.005s	sys 0.000s
I20260709 12:10:12.186517 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:12.187644 13761 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 1.
I20260709 12:10:12.189002 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:12.126430 15471 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:12.120759 15499 log.cc:927] Time spent T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.222s	user 0.002s	sys 0.000s
I20260709 12:10:12.083045 15365 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:12.170136 15402 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:12.206734 15194 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:12.222469 15194 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:12.225188 15194 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:12.225536 15253 consensus_queue.cc:1059] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:12.227262 15253 consensus_queue.cc:1048] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:12.227789 15481 raft_consensus.cc:3055] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:12.228401 15481 raft_consensus.cc:740] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:12.229909 15247 consensus_queue.cc:1059] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:12.231606 15295 raft_consensus.cc:3055] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:12.232249 15295 raft_consensus.cc:740] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:12.231743 15402 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:12.229841 15481 consensus_queue.cc:260] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:12.235039 15481 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:12.173830 15459 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:12.241269 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:12.109048 15490 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:12.235321 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:12.244208 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:12.245436 13682 raft_consensus.cc:1240] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:12.246973 13681 raft_consensus.cc:1240] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:12.211303 15483 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:12.256003 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:12.256342 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:12.257045 13681 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 3.
I20260709 12:10:12.258486 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:12.259295 13682 raft_consensus.cc:2468] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 2.
I20260709 12:10:12.258692 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:10:12.235935 15491 log.cc:927] Time spent T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.692s	user 0.002s	sys 0.002s
I20260709 12:10:12.261585 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:12.252326 13582 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45620 (request call id 245) took 7507 ms. Trace:
I20260709 12:10:12.263003 13686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1097) took 1157 ms. Trace:
I20260709 12:10:12.121263 15173 consensus_queue.cc:260] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:12.233522 15295 consensus_queue.cc:260] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:12.259644 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:12.263430 13583 catalog_manager.cc:5697] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:12.266966 13583 catalog_manager.cc:5697] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:12.267593 15295 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:12.235091 15402 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:12.206369 15452 consensus_queue.cc:1059] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 12:10:12.263437 13686 rpcz_store.cc:276] 0709 12:10:11.119031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.120396 (+  1365us) service_pool.cc:224] Handling call
0709 12:10:11.120758 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:11.120982 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:11.121009 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:11.129549 (+  8540us) log.cc:844] Serialized 26 byte log entry
0709 12:10:11.238221 (+108672us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:11.332363 (+ 94142us) log.cc:844] Serialized 14 byte log entry
0709 12:10:11.332645 (+   282us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:11.332750 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:11.925900 (+593150us) spinlock_profiling.cc:243] Waited 5.5 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:10:12.262710 (+336810us) raft_consensus.cc:1685] finished
0709 12:10:12.262814 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:12.262927 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13372,"prepare.queue_time_us":143299,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":100,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":33012,"spinlock_wait_cycles":12648704,"thread_start_us":81340,"threads_started":1,"wal-append.queue_time_us":200984}
W20260709 12:10:12.279574 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 468601us
I20260709 12:10:12.292542 13726 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:12.269140 13583 catalog_manager.cc:5697] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 1 to 2, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 2 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:12.303471 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:12.304569 13681 raft_consensus.cc:2393] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 3: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
W20260709 12:10:12.295893 14380 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.018s	sys 0.013s
W20260709 12:10:12.306521 14380 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.018s	sys 0.013s
W20260709 12:10:12.306944 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 644251us
I20260709 12:10:12.310448 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:12.311419 14412 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 1.
I20260709 12:10:12.314071 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:12.315058 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:12.314133 13583 catalog_manager.cc:5697] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:12.335824 13726 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:12.339593 13726 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:12.341120 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:10:12.342168 13830 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.937s	user 0.024s	sys 0.031s
W20260709 12:10:12.342532 13830 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.940s	user 0.024s	sys 0.031s
I20260709 12:10:12.344473 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:12.293655 15469 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
W20260709 12:10:12.350059 13652 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.014s	sys 0.045s
W20260709 12:10:12.350703 13652 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.014s	sys 0.045s
W20260709 12:10:12.351449 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 673898us
W20260709 12:10:12.320704 15195 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.009s	sys 0.023s
I20260709 12:10:12.317520 13583 catalog_manager.cc:5697] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 1 to 2, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 2 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:12.293885 15459 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:12.351824 13651 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:12.352537 13652 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:12.358283 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:12.263053 13582 rpcz_store.cc:276] 0709 12:10:04.744824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:04.744959 (+   135us) service_pool.cc:224] Handling call
0709 12:10:06.202515 (+1457556us) spinlock_profiling.cc:243] Waited 6.41 ms on lock 0x7b54002eff90. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924e69640 00007fa92dd40846 00007fa92de4a90e 00007fa92c30b2a4 00007fa92c30b232 00007fa92c30b161 00007fa92c30b0dc 00007fa92c30a392 00007fa9262c848c 00007fa9262c78c6
0709 12:10:12.252247 (+6049732us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:09.304579 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:09.305443 (+   864us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:09.305496 (+    53us) write_op.cc:435] Acquired schema lock
0709 12:10:09.305528 (+    32us) tablet.cc:662] Decoding operations
0709 12:10:09.306031 (+   503us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:09.306128 (+    97us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:09.306489 (+   361us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:10:09.306825 (+   336us) tablet.cc:701] Row locks acquired
0709 12:10:09.306859 (+    34us) write_op.cc:260] PREPARE: finished
0709 12:10:09.307046 (+   187us) write_op.cc:270] Start()
0709 12:10:09.307159 (+   113us) write_op.cc:276] Timestamp: P: 1783599009306992 usec, L: 0
0709 12:10:09.307180 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:10:09.438354 (+131174us) log.cc:844] Serialized 536 byte log entry
0709 12:10:10.228730 (+790376us) op_driver.cc:464] REPLICATION: finished
0709 12:10:10.318129 (+ 89399us) write_op.cc:301] APPLY: starting
0709 12:10:10.319786 (+  1657us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:10.357981 (+ 38195us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:10.458117 (+100136us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:10.487101 (+ 28984us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:10.518794 (+ 31693us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:10:10.518863 (+    69us) write_op.cc:312] APPLY: finished
0709 12:10:10.519108 (+   245us) log.cc:844] Serialized 23 byte log entry
0709 12:10:10.519312 (+   204us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:10.519420 (+   108us) write_op.cc:454] Released schema lock
0709 12:10:10.519468 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:10.519918 (+   450us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:10.519952 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":325781,"reported_tablets":7,"spinlock_wait_cycles":14734720,"child_traces":[["op",{"apply.queue_time_us":86674,"apply.run_cpu_time_us":2403,"apply.run_wall_time_us":201756,"num_ops":1,"prepare.queue_time_us":140290,"prepare.run_cpu_time_us":12152,"prepare.run_wall_time_us":262327,"raft.queue_time_us":181988,"raft.run_cpu_time_us":1721,"raft.run_wall_time_us":90961,"replication_time_us":906218,"thread_start_us":347060,"threads_started":4,"wal-append.queue_time_us":106888,"wal-append.run_cpu_time_us":26430,"wal-append.run_wall_time_us":1942807}]]}
I20260709 12:10:12.359962 13583 catalog_manager.cc:5697] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: config changed from index 3 to 4, VOTER 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) evicted. New cstate: current_term: 1 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:10:12.373610 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:12.372857 13583 catalog_manager.cc:5697] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:12.362663 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:12.375072 14412 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 2.
I20260709 12:10:12.363229 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:10:12.361348 13728 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.004s	sys 0.024s
W20260709 12:10:12.377347 13728 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.005s	sys 0.025s
I20260709 12:10:12.338182 15398 raft_consensus.cc:2749] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:12.433766 13829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 1710) took 1169 ms. Trace:
I20260709 12:10:12.433560 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:12.342485 15480 raft_consensus.cc:2749] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:12.436669 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:12.437464 13763 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:12.357012 13651 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:12.435833 13829 rpcz_store.cc:276] 0709 12:10:11.194378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.196526 (+  2148us) service_pool.cc:224] Handling call
0709 12:10:11.196799 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:11.921691 (+724892us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:12.363159 (+441468us) spinlock_profiling.cc:243] Waited 716 ms on lock 0x7b5400363154. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:12.363366 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1646945664}
I20260709 12:10:12.408282 13583 catalog_manager.cc:5697] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
W20260709 12:10:12.452219 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:12.352914 15195 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.009s	sys 0.023s
W20260709 12:10:12.489552 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 150263us
I20260709 12:10:12.337817 15446 consensus_queue.cc:1059] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.098s
I20260709 12:10:12.496395 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:12.360316 15428 raft_consensus.cc:2749] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:12.495657 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:12.344133 15461 consensus_queue.cc:1059] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.104s
I20260709 12:10:12.360505 15253 raft_consensus.cc:2804] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:12.492537 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:10:12.510815 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:12.511291 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:12.511746 13836 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:12.512490 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:12.497417 13834 raft_consensus.cc:2468] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 2.
I20260709 12:10:12.502653 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:10:12.490335 15213 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.019s	sys 0.015s
W20260709 12:10:12.442662 15280 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.015s	sys 0.017s
I20260709 12:10:12.506176 13756 raft_consensus.cc:2393] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 6: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:12.506350 14379 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:12.507495 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:12.515395 13829 raft_consensus.cc:2393] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 6: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:12.516923 13801 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:12.530156 13801 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:12.360203 15452 consensus_queue.cc:1059] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.141s
I20260709 12:10:12.526628 13679 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 3.
I20260709 12:10:12.492949 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:12.359033 15469 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:12.494211 15483 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:12.387365 15459 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:12.494305 13583 catalog_manager.cc:5697] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:10:12.491952 15472 consensus_queue.cc:1059] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.186s
W20260709 12:10:12.524539 15213 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.019s	sys 0.015s
W20260709 12:10:12.533973 15280 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.015s	sys 0.021s
I20260709 12:10:12.508925 15217 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:12.508924 15253 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:12.554760 14380 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:12.509331 15398 consensus_queue.cc:1059] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.061s
W20260709 12:10:12.537611 13759 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.011s	sys 0.019s
W20260709 12:10:12.635468 13759 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.011s	sys 0.022s
W20260709 12:10:12.628425 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 190826us
I20260709 12:10:12.574761 13836 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 4.
W20260709 12:10:12.535214 15443 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.014s	sys 0.039s
I20260709 12:10:12.583712 13762 raft_consensus.cc:1240] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:12.553140 15452 consensus_queue.cc:1243] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer 3f37c9cc9dda46b4be21dd675ba78fb7 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:10:12.550432 15444 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:12.602394 14408 raft_consensus.cc:2393] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 6: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:10:12.749648 15452 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:10:12.731371 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 176774us
W20260709 12:10:12.578924 15248 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.022s	sys 0.034s
W20260709 12:10:12.750380 15368 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.003s	user 0.015s	sys 0.036s
W20260709 12:10:12.750722 15248 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.864s	user 0.022s	sys 0.052s
W20260709 12:10:12.603895 15511 log.cc:927] Time spent T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
W20260709 12:10:12.683614 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:12.753301 13831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 1711) took 1556 ms. Trace:
I20260709 12:10:12.753809 13831 rpcz_store.cc:276] 0709 12:10:11.197122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.197425 (+   303us) service_pool.cc:224] Handling call
0709 12:10:11.197830 (+   405us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:11.383836 (+186006us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:11.383859 (+    23us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:11.392385 (+  8526us) log.cc:844] Serialized 52 byte log entry
0709 12:10:12.070886 (+678501us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:12.261437 (+190551us) log.cc:844] Serialized 14 byte log entry
0709 12:10:12.266672 (+  5235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:12.266753 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:12.753000 (+486247us) raft_consensus.cc:1685] finished
0709 12:10:12.753032 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:12.753224 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22235,"prepare.queue_time_us":186907,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":47540,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":6308,"thread_start_us":559623,"threads_started":2,"wal-append.queue_time_us":769355}
I20260709 12:10:12.612234 15252 raft_consensus.cc:3055] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:12.756455 15252 raft_consensus.cc:740] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:12.549079 15480 raft_consensus.cc:2749] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:12.749696 15444 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:12.750406 15452 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:12.764490 15452 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:12.765321 15452 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:10:12.682814 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:12.544363 15194 raft_consensus.cc:2804] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:12.541375 15195 raft_consensus.cc:2804] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:10:12.649348 15443 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.020s	sys 0.043s
I20260709 12:10:12.783526 15194 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:12.784082 15194 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:12.579291 15247 raft_consensus.cc:2804] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:12.785218 15247 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:12.605757 15402 raft_consensus.cc:3055] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:12.786535 15402 raft_consensus.cc:740] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:12.785487 13652 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:12.787719 15402 consensus_queue.cc:260] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:12.613994 15490 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:12.556025 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:10:12.742431 13800 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.861s	user 0.029s	sys 0.049s
I20260709 12:10:12.639338 15253 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:12.790401 13800 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.910s	user 0.030s	sys 0.049s
W20260709 12:10:12.790755 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 910974us
I20260709 12:10:12.791375 15195 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:12.791864 15195 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:12.602196 15504 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:12.794212 15504 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:12.750881 15368 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.004s	user 0.015s	sys 0.036s
I20260709 12:10:12.798645 13754 raft_consensus.cc:1240] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:10:12.789455 15402 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:12.772920 15452 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:12.785853 15247 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:12.807933 15490 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:12.808745 15490 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:12.809593 13652 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:12.811811 15490 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:12.812567 15490 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:12.813220 15490 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:12.630704 15385 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
W20260709 12:10:12.825078 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:12.730273 15471 consensus_meta.cc:287] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.539s	user 0.011s	sys 0.003s
I20260709 12:10:12.547552 15428 consensus_queue.cc:1059] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.195s
I20260709 12:10:12.827008 15461 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:12.831415 15461 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:12.831852 15513 log.cc:927] Time spent T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:10:12.734668 15510 raft_consensus.cc:2804] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:12.816825 15380 raft_consensus.cc:2804] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:12.556737 15483 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:12.680161 15217 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:12.850996 13727 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.010s	sys 0.032s
I20260709 12:10:12.830387 15365 raft_consensus.cc:2804] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:10:12.862027 13727 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.011s	sys 0.033s
I20260709 12:10:12.829928 15472 raft_consensus.cc:3055] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:12.832065 15478 raft_consensus.cc:3055] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:10:12.862535 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 515235us
I20260709 12:10:12.847924 15510 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:12.847138 15467 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:12.828191 15385 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:12.850705 15380 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:12.909646 13727 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:12.830590 15471 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:12.944671 15481 consensus_meta.cc:287] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.708s	user 0.005s	sys 0.009s
I20260709 12:10:12.930698 15467 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:12.945544 15481 consensus_queue.cc:1059] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:12.946943 15461 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:12.947904 15467 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:12.930968 15452 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:12.948756 15446 consensus_queue.cc:1059] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 12:10:12.949115 15452 raft_consensus.cc:3055] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:12.949594 15452 raft_consensus.cc:740] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:12.949868 15446 raft_consensus.cc:3055] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:12.950314 15446 raft_consensus.cc:740] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:12.950685 15452 consensus_queue.cc:260] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:12.951066 15446 consensus_queue.cc:260] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:12.951874 13763 consensus_meta.cc:287] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.514s	user 0.008s	sys 0.000s
I20260709 12:10:12.952234 13763 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 4.
I20260709 12:10:12.952359 15446 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:12.952934 13757 raft_consensus.cc:1240] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 12:10:12.948776 15481 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:12.954008 15481 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:12.955005 15217 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:12.955323 15385 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:12.955881 15385 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:12.956346 15385 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:12.957022 15481 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:12.952431 15452 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:12.867156 15478 raft_consensus.cc:740] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:12.958885 15483 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:12.959383 15490 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:12.963527 15247 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:12.966442 15480 raft_consensus.cc:993] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7: : Instructing follower 96701a74fdee481fb5f54aac841e17dd to start an election
I20260709 12:10:12.966967 15480 raft_consensus.cc:1081] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Signalling peer 96701a74fdee481fb5f54aac841e17dd to start an election
W20260709 12:10:12.906435 15513 log.cc:927] Time spent T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:10:12.868806 15428 raft_consensus.cc:2804] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:12.958475 15478 consensus_queue.cc:260] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:12.892485 14411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 582) took 1491 ms. Trace:
I20260709 12:10:12.865790 15472 raft_consensus.cc:740] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:12.939392 15380 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:12.989487 13758 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.010s	sys 0.010s
W20260709 12:10:12.992786 13758 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.011s	sys 0.010s
I20260709 12:10:12.905194 15365 raft_consensus.cc:697] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 2 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:12.993136 13761 raft_consensus.cc:1240] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:12.991920 13728 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.032s	sys 0.041s
I20260709 12:10:12.968355 15432 raft_consensus.cc:2804] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:12.997884 13728 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.032s	sys 0.041s
I20260709 12:10:12.932396 15510 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:12.945291 15194 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:12.990325 15247 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:12.988583 15459 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:10:13.029321 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:12.994710 15428 raft_consensus.cc:697] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 4 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:13.035956 13762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 1730) took 1991 ms. Trace:
I20260709 12:10:13.037838 13762 rpcz_store.cc:276] 0709 12:10:11.044467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.050091 (+  5624us) service_pool.cc:224] Handling call
0709 12:10:11.050433 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:12.749729 (+1699296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:13.029047 (+279318us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b54000889d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:13.029202 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3525564160}
W20260709 12:10:13.061058 13651 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.010s	sys 0.020s
I20260709 12:10:13.000342 15432 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:13.005088 15469 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:13.062592 13726 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.012s	sys 0.030s
W20260709 12:10:13.072827 13726 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.012s	sys 0.030s
W20260709 12:10:13.064343 13651 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.011s	sys 0.020s
I20260709 12:10:13.028651 15478 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:13.070564 14379 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.010s	sys 0.022s
I20260709 12:10:13.072656 13830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 1706) took 1884 ms. Trace:
W20260709 12:10:13.073611 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 716628us
W20260709 12:10:13.073908 14379 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.010s	sys 0.022s
W20260709 12:10:13.074736 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 568445us
W20260709 12:10:13.073342 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 582010us
I20260709 12:10:13.074070 13830 rpcz_store.cc:276] 0709 12:10:11.188451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.189959 (+  1508us) service_pool.cc:224] Handling call
0709 12:10:11.190293 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:11.215044 (+ 24751us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:11.330417 (+115373us) log.cc:844] Serialized 14 byte log entry
0709 12:10:12.343092 (+1012675us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:12.361014 (+ 17922us) log.cc:844] Serialized 26 byte log entry
0709 12:10:12.361160 (+   146us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:12.361193 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:12.361259 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:13.072446 (+711187us) raft_consensus.cc:1685] finished
0709 12:10:13.072465 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:13.072597 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8683,"prepare.queue_time_us":165648,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":3758,"raft.queue_time_us":25629,"raft.run_cpu_time_us":320,"raft.run_wall_time_us":22528,"thread_start_us":1019618,"threads_started":2,"wal-append.queue_time_us":1217628}
I20260709 12:10:13.076417 13759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 1255) took 1183 ms. Trace:
I20260709 12:10:13.087015 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:13.088030 14412 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 1.
W20260709 12:10:13.072266 15295 consensus_meta.cc:287] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.804s	user 0.018s	sys 0.004s
I20260709 12:10:13.100317 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:13.104619 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:13.106654 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:13.112366 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:13.114058 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:10:13.061582 15473 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.014s	sys 0.016s
I20260709 12:10:13.075512 15432 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:13.127794 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:13.103045 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:13.129171 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:13.129766 13837 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:13.129851 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:13.130817 13830 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 3.
I20260709 12:10:13.116299 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:13.131318 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:13.131948 13760 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 1.
I20260709 12:10:13.120153 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:13.132845 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:13.123070 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:13.123232 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:13.123878 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:13.125257 13679 raft_consensus.cc:1275] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:13.134397 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:13.135071 13834 raft_consensus.cc:2368] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 5. Current term is 6.
I20260709 12:10:13.135931 14414 raft_consensus.cc:2368] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 5. Current term is 6.
I20260709 12:10:13.078606 15385 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:13.138916 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:13.140316 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:10:13.125765 13800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.141764 13800 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:13.143386 13688 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 2.
I20260709 12:10:13.150493 13837 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 4.
W20260709 12:10:13.126063 15473 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.014s	sys 0.016s
I20260709 12:10:13.160260 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:13.102939 15507 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:13.080859 15247 consensus_queue.cc:1059] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.072s
I20260709 12:10:13.115429 15483 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:13.172281 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:12.991580 14411 rpcz_store.cc:276] 0709 12:10:11.380099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.382058 (+  1959us) service_pool.cc:224] Handling call
0709 12:10:11.655107 (+273049us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:11.899460 (+244353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:11.901672 (+  2212us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:11.907210 (+  5538us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:11.910638 (+  3428us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:12.848251 (+937613us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b5400554954. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:12.854087 (+  5836us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:12.866192 (+ 12105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":519342848}
I20260709 12:10:13.179163 14379 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:13.084935 15529 consensus_queue.cc:1059] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.083s
I20260709 12:10:13.032200 15472 consensus_queue.cc:260] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:13.152034 15452 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:13.172896 14413 raft_consensus.cc:1240] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:13.152280 15490 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:13.180044 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 52804.6us
I20260709 12:10:13.189913 14379 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:13.162441 15330 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:13.163976 15385 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:13.206887 14379 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:10:13.200475 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:13.220383 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:13.221629 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.169807 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:13.175357 15504 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:13.170233 15481 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:13.177511 15173 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:13.183166 15534 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:13.226806 14379 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:13.164381 15253 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:13.220633 15516 log.cc:927] Time spent T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.312s	user 0.000s	sys 0.001s
I20260709 12:10:13.199729 15363 raft_consensus.cc:2749] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:13.181242 15465 consensus_queue.cc:1048] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:10:13.214440 15248 raft_consensus.cc:2749] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:13.218918 15247 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:13.172124 15507 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:13.226528 15385 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:13.250412 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 108716us
I20260709 12:10:13.230120 15449 raft_consensus.cc:2749] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:13.196342 15483 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:13.230382 15471 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:13.184407 15428 consensus_queue.cc:237] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:13.277125 13726 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:13.278342 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:13.278487 15406 consensus_queue.cc:1059] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:13.278376 13726 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:13.279616 15406 raft_consensus.cc:2804] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:13.279872 15528 log.cc:927] Time spent T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:10:13.280030 15406 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:13.280445 15406 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:13.280884 15459 raft_consensus.cc:3055] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:13.281282 15459 raft_consensus.cc:740] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:13.281726 15526 raft_consensus.cc:2749] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:13.281973 15540 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:13.282085 15459 consensus_queue.cc:260] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:13.282578 15540 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:13.283039 15253 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:13.283363 15459 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:13.239986 15539 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:13.284873 15540 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:13.285434 15540 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:13.285074 15539 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:13.219969 15452 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:13.239552 15368 raft_consensus.cc:3055] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:13.256659 15247 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:13.270900 15527 log.cc:927] Time spent T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:10:13.272308 15507 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:13.326179 15507 raft_consensus.cc:2749] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:13.274175 15530 raft_consensus.cc:993] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7: : Instructing follower b98d2519bb504dc6905ed2ede4571835 to start an election
W20260709 12:10:13.326910 13802 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.001s	sys 0.013s
I20260709 12:10:13.275518 15483 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:13.327286 15530 raft_consensus.cc:1081] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Signalling peer b98d2519bb504dc6905ed2ede4571835 to start an election
I20260709 12:10:13.327709 15483 consensus_queue.cc:1059] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:10:13.327265 13802 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.001s	sys 0.013s
I20260709 12:10:13.328722 15483 raft_consensus.cc:3055] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:13.247527 15534 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:13.329011 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:13.329716 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.331210 15534 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:13.171180 15365 consensus_queue.cc:237] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:13.266785 13800 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:13.287599 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:13.289980 15540 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:13.336035 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 69351.3us
I20260709 12:10:13.337625 15540 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:13.291357 13726 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:13.294828 15406 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:13.224303 15490 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:13.244168 15426 raft_consensus.cc:2804] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:13.250772 15295 raft_consensus.cc:3055] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:13.224268 15330 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:13.318224 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 73191.1us
I20260709 12:10:13.238387 15481 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:13.329087 15483 raft_consensus.cc:740] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:13.337743 13800 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:10:13.338529 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 47309.5us
W20260709 12:10:13.356245 13570 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet a34b21ec197b4241a780a8ae562e4602 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:10:13.340211 15406 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:13.342746 15295 raft_consensus.cc:740] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:13.344889 15330 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:13.346118 15483 consensus_queue.cc:260] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:13.342265 15490 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:13.344662 15481 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:13.344472 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.338214 15540 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:13.397156 15483 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:13.301412 15194 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:13.394547 15295 consensus_queue.cc:260] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:13.345235 15213 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:13.312194 15368 raft_consensus.cc:740] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:13.259591 15195 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:13.397377 15540 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:13.429726 15295 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:13.440416 13757 raft_consensus.cc:1240] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:10:13.427786 15428 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:13.445592 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:13.442451 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:13.442773 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:13.404809 15544 consensus_queue.cc:1059] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:10:13.450904 13763 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:13.432497 15450 consensus_meta.cc:287] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 1.255s	user 0.015s	sys 0.001s
I20260709 12:10:13.447175 13760 raft_consensus.cc:1240] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:13.420015 15507 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:13.461122 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:13.442618 15194 raft_consensus.cc:2749] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:13.430562 15426 raft_consensus.cc:697] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 4 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:13.432124 15213 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:13.494020 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:13.498524 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:13.503760 13684 raft_consensus.cc:2393] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 2: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:13.503152 13681 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f"
dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
 from {username='slave'} at 127.0.0.1:41688
I20260709 12:10:13.444739 15548 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:13.437913 15541 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:13.515396 13651 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:10:13.559525 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 44199us
W20260709 12:10:13.519158 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 170964us
I20260709 12:10:13.555680 13681 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:13.562410 13681 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:13.493337 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:13.498908 15330 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
W20260709 12:10:13.573565 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.563902 13757 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 4.
I20260709 12:10:13.564527 13687 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:13.566500 13763 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 2.
I20260709 12:10:13.557519 14416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41700 (request call id 216) took 1312 ms. Trace:
I20260709 12:10:13.496261 15365 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:13.513325 15546 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:13.520602 15529 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:13.521234 15450 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:13.519213 15550 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:13.517357 15534 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:13.579210 14416 rpcz_store.cc:276] 0709 12:10:12.244988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:12.245152 (+   164us) service_pool.cc:224] Handling call
0709 12:10:12.245591 (+   439us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:12.287880 (+ 42289us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:12.287931 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:12.300785 (+ 12854us) log.cc:844] Serialized 26 byte log entry
0709 12:10:12.852298 (+551513us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:12.852343 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:12.852414 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:13.534570 (+682156us) raft_consensus.cc:1685] finished
0709 12:10:13.555269 (+ 20699us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:13.557452 (+  2183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85983,"raft.queue_time_us":48358,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":19471,"thread_start_us":489363,"threads_started":1,"wal-append.queue_time_us":819982}
I20260709 12:10:13.461175 15428 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:13.590272 13758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 1247) took 2239 ms. Trace:
I20260709 12:10:13.564342 15213 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:13.610114 13687 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 4.
W20260709 12:10:13.622390 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 187322us
I20260709 12:10:13.502904 15507 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:13.624977 13758 rpcz_store.cc:276] 0709 12:10:11.331794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.334993 (+  3199us) service_pool.cc:224] Handling call
0709 12:10:11.341328 (+  6335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:11.870404 (+529076us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:12.361410 (+491006us) log.cc:844] Serialized 14 byte log entry
0709 12:10:12.996216 (+634806us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:12.996271 (+    55us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:12.996313 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:13.570324 (+574011us) spinlock_profiling.cc:243] Waited 529 ms on lock 0x7b54001d2c54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:13.570405 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:13.570614 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16579,"prepare.queue_time_us":780493,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":46,"raft.queue_time_us":2475,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":22812,"spinlock_wait_cycles":1216181504,"thread_start_us":1112265,"threads_started":2,"wal-append.queue_time_us":808356}
W20260709 12:10:13.631793 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 71317.9us
I20260709 12:10:13.502862 15368 consensus_queue.cc:260] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:13.586556 14411 raft_consensus.cc:2468] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 2.
I20260709 12:10:13.584517 15541 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:13.588972 15330 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:13.640961 13651 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:10:13.644315 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.645485 15452 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:13.651345 15247 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:10:13.652416 15556 log.cc:927] Time spent T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:10:13.614217 15546 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:13.654861 15546 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:13.655531 13829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 203) took 1119 ms. Trace:
I20260709 12:10:13.655992 13829 rpcz_store.cc:276] 0709 12:10:12.536057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:12.536267 (+   210us) service_pool.cc:224] Handling call
0709 12:10:12.536653 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:12.885354 (+348701us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:12.885404 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:12.885464 (+    60us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:12.885508 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:13.655253 (+769745us) spinlock_profiling.cc:243] Waited 348 ms on lock 0x7b54003241d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:13.655311 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:13.655467 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":801293696}
I20260709 12:10:13.622505 15450 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:13.595999 15365 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:13.627889 15534 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:13.614097 15529 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:13.640061 15549 raft_consensus.cc:2804] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:13.686586 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:13.687273 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 46381.5us
I20260709 12:10:13.642386 15385 leader_election.cc:290] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:13.695780 13651 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:13.646700 15368 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:13.641629 15426 consensus_queue.cc:237] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:13.704013 15545 raft_consensus.cc:2804] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:13.704088 15552 raft_consensus.cc:2804] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:13.704684 15545 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:13.705164 15545 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:13.705132 15552 raft_consensus.cc:697] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 2 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:13.706410 15552 consensus_queue.cc:237] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:13.674432 15195 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:13.708202 15539 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:13.641652 15501 consensus_queue.cc:1048] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 12:10:13.716182 15428 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:13.713402 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:13.626294 15550 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:13.696568 15247 consensus_queue.cc:1059] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
W20260709 12:10:13.717072 15510 consensus_meta.cc:287] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.685s	user 0.011s	sys 0.006s
I20260709 12:10:13.718613 15247 consensus_queue.cc:1243] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer 3f37c9cc9dda46b4be21dd675ba78fb7 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:10:13.720834 15550 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:13.722235 13754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 1734) took 1818 ms. Trace:
I20260709 12:10:13.696264 15438 raft_consensus.cc:2243] T c95811190f014949bb25448e8db1040e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:10:13.724128 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:13.725275 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.690335 14409 raft_consensus.cc:1240] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:13.692894 15549 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:13.723740 15380 consensus_meta.cc:287] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.721s	user 0.008s	sys 0.002s
I20260709 12:10:13.735555 15213 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:13.761538 13688 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 1657) took 1507 ms (client timeout 1948 ms). Trace:
W20260709 12:10:13.764464 13688 rpcz_store.cc:269] 0709 12:10:12.239840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:12.240012 (+   172us) service_pool.cc:224] Handling call
0709 12:10:13.747071 (+1507059us) spinlock_profiling.cc:243] Waited 877 ms on lock 0x7b5400312ed4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:13.747184 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2018099584}
I20260709 12:10:13.770386 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:13.771126 13688 raft_consensus.cc:2468] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 2.
I20260709 12:10:13.772944 13688 raft_consensus.cc:1240] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:13.773725 13687 raft_consensus.cc:3060] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:13.772833 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 77143.8us
I20260709 12:10:13.776371 15562 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:13.777247 15562 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:13.778005 15508 raft_consensus.cc:3055] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:13.778456 15508 raft_consensus.cc:740] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:13.778620 13726 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:13.779608 15398 raft_consensus.cc:2804] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:13.779366 15508 consensus_queue.cc:260] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:13.779775 15562 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:13.780289 15398 raft_consensus.cc:697] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:13.780684 15508 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:13.781548 15562 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:13.781299 15398 consensus_queue.cc:237] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:13.782083 15562 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:13.782904 13726 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:13.784078 15469 raft_consensus.cc:2804] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:13.784207 15562 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:13.784847 15469 raft_consensus.cc:697] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:13.785553 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:13.786017 15469 consensus_queue.cc:237] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:13.784914 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:13.786737 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:13.787146 13758 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 2.
I20260709 12:10:13.788288 13756 raft_consensus.cc:1240] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 12:10:13.789037 13651 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:13.790210 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:13.790455 15562 raft_consensus.cc:2804] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:13.791056 15562 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:13.791563 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:13.791626 15562 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:13.784442 14379 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:10:13.793708 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:13.794839 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.750203 15549 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:13.804950 13687 raft_consensus.cc:1275] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:10:13.809631 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 246108us
I20260709 12:10:13.767053 15540 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:13.810488 13800 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:13.730720 15510 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:13.808890 15445 raft_consensus.cc:2804] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:13.797235 15432 consensus_meta.cc:287] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.639s	user 0.011s	sys 0.001s
I20260709 12:10:13.765151 15380 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:13.819468 13800 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:13.728173 13754 rpcz_store.cc:276] 0709 12:10:11.903555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.916832 (+ 13277us) service_pool.cc:224] Handling call
0709 12:10:11.917188 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:12.799239 (+882051us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:13.721945 (+922706us) spinlock_profiling.cc:243] Waited 881 ms on lock 0x7b54000efe54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:13.722167 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2026258304}
I20260709 12:10:13.824923 13800 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:13.827358 13800 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:13.823113 15483 raft_consensus.cc:2749] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:13.830659 13800 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:13.800053 15303 consensus_queue.cc:1059] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:10:13.821506 15438 raft_consensus.cc:2272] T c95811190f014949bb25448e8db1040e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:10:13.835631 13800 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:13.818389 15563 raft_consensus.cc:2764] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:10:13.826059 15445 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:13.812953 15363 consensus_queue.cc:1048] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:10:13.828639 15194 raft_consensus.cc:2749] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:13.818065 15540 consensus_queue.cc:1048] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:10:13.832294 15195 raft_consensus.cc:2749] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:13.859647 13800 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:13.830840 15507 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:13.873101 13800 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:13.836689 14415 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:13.876103 15444 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:13.824139 15432 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:13.877583 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:13.877981 13755 raft_consensus.cc:1240] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:13.880242 15446 consensus_meta.cc:287] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.927s	user 0.015s	sys 0.001s
I20260709 12:10:13.880236 15539 raft_consensus.cc:2749] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:13.880970 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:13.882112 15432 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:13.882105 14415 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 4.
I20260709 12:10:13.883038 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:13.883910 13831 raft_consensus.cc:2393] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 3: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:13.884749 13830 raft_consensus.cc:1275] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:13.885171 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:13.886214 13760 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 3.
I20260709 12:10:13.884824 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:13.872709 15252 consensus_queue.cc:260] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:13.887420 15213 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:13.887825 13828 raft_consensus.cc:1240] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 1. Current term is 3. Ops: []
I20260709 12:10:13.888180 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:13.885350 15540 raft_consensus.cc:2804] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:13.888351 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:13.888820 15540 raft_consensus.cc:697] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 6 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:13.859133 15450 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:13.859460 15445 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:13.854799 15385 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:13.891078 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:13.896126 13830 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 1.
I20260709 12:10:13.891885 13837 raft_consensus.cc:1240] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:13.825488 15564 consensus_queue.cc:1059] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:10:13.892483 13836 raft_consensus.cc:1240] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:13.894068 13681 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:13.899516 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:13.899734 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:13.903993 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:13.904156 13830 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 1.
I20260709 12:10:13.905246 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:13.905880 13830 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:13.905939 13837 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:13.905890 13828 raft_consensus.cc:1240] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:13.904199 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:13.908954 13836 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 1.
I20260709 12:10:13.909183 13833 raft_consensus.cc:1240] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:10:13.910245 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:13.914995 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:13.858729 15365 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:13.915675 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:13.916574 13757 raft_consensus.cc:3055] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:13.916896 13757 raft_consensus.cc:740] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:13.917292 15380 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 3 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:13.863521 15566 raft_consensus.cc:2749] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:13.920894 13727 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:13.921470 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:13.922263 13727 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:13.923466 13727 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:10:13.897874 15173 consensus_meta.cc:287] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.659s	user 0.005s	sys 0.011s
I20260709 12:10:13.923645 15510 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 3 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:13.924129 15432 raft_consensus.cc:2804] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:13.915802 13833 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 1.
I20260709 12:10:13.928133 13727 leader_election.cc:400] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 election: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 5. Current term is 6.
I20260709 12:10:13.896622 15330 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:13.928572 13681 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:13.902623 15548 raft_consensus.cc:2749] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:13.929553 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:13.927961 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:13.932094 13727 leader_election.cc:403] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
W20260709 12:10:13.935107 15478 consensus_meta.cc:287] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.856s	user 0.000s	sys 0.015s
I20260709 12:10:13.936546 13835 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 2.
I20260709 12:10:13.937738 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:13.932608 13832 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 4.
I20260709 12:10:13.908047 15529 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:13.940778 15545 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:13.917614 13757 consensus_queue.cc:260] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:13.889853 15540 consensus_queue.cc:237] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:13.943429 13757 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:13.943657 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:13.952411 13833 raft_consensus.cc:1275] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:10:13.952747 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:13.953610 13835 raft_consensus.cc:2468] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 1.
I20260709 12:10:13.931365 15446 raft_consensus.cc:2804] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:13.954196 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:13.932550 15402 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:13.955925 15526 raft_consensus.cc:2749] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 5. Current term is 6.
I20260709 12:10:13.951012 15432 raft_consensus.cc:697] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:13.957394 15438 ts_tablet_manager.cc:1916] T c95811190f014949bb25448e8db1040e P 3f37c9cc9dda46b4be21dd675ba78fb7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:10:13.958370 13687 raft_consensus.cc:1240] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:13.968360 15399 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:13.974556 15399 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:13.081552 13759 rpcz_store.cc:276] 0709 12:10:11.893123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.893266 (+   143us) service_pool.cc:224] Handling call
0709 12:10:11.893543 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:11.893750 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:12.636091 (+742341us) log.cc:844] Serialized 14 byte log entry
0709 12:10:13.075654 (+439563us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:13.076065 (+   411us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:13.076129 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:13.076222 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:13.076357 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":947495,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":3155,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":5834,"thread_start_us":1165403,"threads_started":2}
I20260709 12:10:13.976553 15549 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:13.932616 15385 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:13.960335 13829 raft_consensus.cc:2393] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 4: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:13.979933 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:13.980834 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:13.981487 13759 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:13.982488 13831 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 2.
I20260709 12:10:13.985380 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:13.985695 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:13.988816 13837 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 3.
I20260709 12:10:13.990396 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:13.962044 15446 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:13.997289 15446 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:13.997510 13829 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3"
dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:54820
I20260709 12:10:13.998452 13758 raft_consensus.cc:1240] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:13.998692 13829 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:13.999369 13829 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:13.999730 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:14.001405 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:14.002336 13687 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 2.
I20260709 12:10:14.003172 15472 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:14.003449 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:14.003662 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:14.001677 13837 raft_consensus.cc:1240] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:13.971923 13757 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 2.
I20260709 12:10:14.006139 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:13.966966 15432 consensus_queue.cc:237] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:13.993994 15562 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:13.993263 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:14.007400 13651 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:14.008808 13830 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 4.
I20260709 12:10:14.005571 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:13.997668 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:14.011264 13833 raft_consensus.cc:1240] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:14.003190 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:14.014719 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:14.011899 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:14.015779 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:14.015908 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:14.016634 13681 raft_consensus.cc:2393] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 4: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:14.017066 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:10:14.014062 15295 consensus_meta.cc:287] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.555s	user 0.013s	sys 0.007s
I20260709 12:10:14.018874 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:14.020042 15399 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:14.020975 15252 raft_consensus.cc:3060] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:14.043234 15514 log.cc:927] Time spent T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.973s	user 0.005s	sys 0.000s
I20260709 12:10:14.045372 15446 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:14.047791 15446 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:14.023940 13758 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 2.
I20260709 12:10:13.988790 15385 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:14.013477 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:14.015707 13837 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 2.
I20260709 12:10:14.055198 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:14.025960 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:14.057142 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:14.028626 13682 raft_consensus.cc:2393] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 4: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:14.014732 15529 raft_consensus.cc:2804] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:14.031790 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:14.032436 15547 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.034152 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:10:14.034852 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.035369 13800 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:14.059717 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:14.035285 15467 consensus_queue.cc:1059] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:14.036742 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:14.037051 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:14.039870 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:14.024296 13829 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:14.048198 15443 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.062879 13837 raft_consensus.cc:1240] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 1. Current term is 3. Ops: []
I20260709 12:10:14.062636 15443 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:14.049926 13834 raft_consensus.cc:1240] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:10:14.063777 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:14.062279 13757 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 2.
I20260709 12:10:14.051891 13683 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 4.
I20260709 12:10:14.063149 15545 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:14.022716 13727 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:14.068332 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:10:14.068426 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 45787.9us
I20260709 12:10:14.070231 15549 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:14.070587 15467 raft_consensus.cc:3055] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:14.071051 15467 raft_consensus.cc:740] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:14.072005 15467 consensus_queue.cc:260] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:14.073308 15467 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:14.053439 13759 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 5.
I20260709 12:10:14.064568 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:14.076064 13800 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:14.078418 13800 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:14.080487 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:14.069614 13727 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:14.084497 13829 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:14.085364 13681 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:14.061419 15529 raft_consensus.cc:697] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 2 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:14.063928 15547 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:14.088250 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:14.091064 13651 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:14.077318 15548 raft_consensus.cc:2749] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:14.093940 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:14.083959 15173 raft_consensus.cc:2749] T c89d2a3019c74941a4f8dffc9aa5cf40 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:14.088286 15385 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:14.082505 15566 raft_consensus.cc:2804] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:14.093940 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:14.094519 13727 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:14.073313 15532 raft_consensus.cc:2749] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:14.096971 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:14.098146 13762 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 4.
W20260709 12:10:14.098487 15570 log.cc:927] Time spent T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.218s	user 0.001s	sys 0.001s
I20260709 12:10:14.096647 15508 raft_consensus.cc:2804] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:14.096788 13800 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:14.106729 13830 raft_consensus.cc:1275] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:14.107440 13679 raft_consensus.cc:2393] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 3: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:14.104048 13686 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 1.
W20260709 12:10:14.111580 15537 log.cc:927] Time spent T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.865s	user 0.000s	sys 0.004s
I20260709 12:10:14.112429 15472 raft_consensus.cc:2749] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:14.113570 15501 raft_consensus.cc:3055] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:14.114123 15501 raft_consensus.cc:740] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:14.115154 15501 consensus_queue.cc:260] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:14.116607 15501 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:14.110780 13727 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:14.118736 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:14.119992 13727 leader_election.cc:400] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 election: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 5. Current term is 6.
I20260709 12:10:14.123440 15547 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:14.121613 13727 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:14.097657 15368 raft_consensus.cc:2804] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:14.125352 13681 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 4.
I20260709 12:10:14.128496 13800 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:14.104892 15518 raft_consensus.cc:993] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7: : Instructing follower 96701a74fdee481fb5f54aac841e17dd to start an election
I20260709 12:10:14.133044 15518 raft_consensus.cc:1081] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 LEADER]: Signalling peer 96701a74fdee481fb5f54aac841e17dd to start an election
I20260709 12:10:14.133745 13754 raft_consensus.cc:1240] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:14.102555 15566 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:14.135572 15566 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:14.124884 15399 raft_consensus.cc:2749] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:10:14.140036 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.136811 15508 raft_consensus.cc:697] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 5 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:14.142306 15443 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:14.129752 15385 raft_consensus.cc:2749] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:14.142885 15508 consensus_queue.cc:237] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:14.143554 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:14.144178 13758 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:10:14.105180 15529 consensus_queue.cc:237] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:14.148175 13835 raft_consensus.cc:1240] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 1. Current term is 2. Ops: []
W20260709 12:10:14.149662 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 265437us
I20260709 12:10:14.150874 13758 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 3.
I20260709 12:10:14.153084 13800 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:14.130626 13727 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:14.139906 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:14.154345 13679 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 1.
I20260709 12:10:14.156068 15399 raft_consensus.cc:2804] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:14.137223 15532 raft_consensus.cc:2749] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:14.131819 15368 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:14.157531 15368 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:14.158054 13801 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:14.159468 15195 raft_consensus.cc:2804] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:14.159605 13801 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:14.159907 15195 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:14.160370 15195 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:14.160531 15563 raft_consensus.cc:2749] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:14.162575 13727 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:14.162362 13651 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:14.162839 13800 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:14.163727 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:14.102411 15540 consensus_queue.cc:1059] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 12:10:14.164667 13684 raft_consensus.cc:2468] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 2.
I20260709 12:10:14.163390 15399 raft_consensus.cc:697] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:14.170536 15552 raft_consensus.cc:2804] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:14.169365 15385 raft_consensus.cc:2749] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:14.171164 15399 consensus_queue.cc:237] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:14.166599 15473 raft_consensus.cc:2764] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:10:14.169623 13801 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:14.175388 15552 raft_consensus.cc:697] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 3 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:14.177935 15552 consensus_queue.cc:237] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:14.181314 15534 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:14.181142 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:14.181906 15385 raft_consensus.cc:2804] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:14.186579 13685 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 3.
I20260709 12:10:14.161502 15547 raft_consensus.cc:2804] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:14.186843 15385 raft_consensus.cc:697] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 4 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:14.184548 13800 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:14.184894 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:14.183936 13758 raft_consensus.cc:1240] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 1. Current term is 3. Ops: []
W20260709 12:10:14.194195 13652 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 2.155s (SENT) [suppressed 24 similar messages]
I20260709 12:10:14.195766 13683 raft_consensus.cc:1240] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 2 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:14.179299 15445 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:14.210139 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:14.210690 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:14.209555 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:14.211328 13834 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 4.
I20260709 12:10:14.192340 14380 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:14.191557 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:14.199721 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:14.200040 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:14.200780 15540 raft_consensus.cc:2749] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:14.205848 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:14.188124 15547 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:14.208362 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:14.236508 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:14.235232 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:14.236523 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:14.237699 14416 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:10:14.208968 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:14.212996 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:14.240386 13834 raft_consensus.cc:2393] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 3: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:10:14.241523 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:14.242378 13834 raft_consensus.cc:2468] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 1.
W20260709 12:10:14.244109 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.213182 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:14.213627 13800 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:14.246645 13800 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:14.183429 15548 raft_consensus.cc:2804] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:14.223023 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 44836.3us
I20260709 12:10:14.222920 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:14.250923 13686 raft_consensus.cc:1240] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:14.252537 13686 raft_consensus.cc:1275] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:14.227977 14410 raft_consensus.cc:1240] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 4 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 12:10:14.221436 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:14.230527 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:14.231542 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:14.229485 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:14.231419 15195 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:14.267798 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:14.233114 13829 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 1.
I20260709 12:10:14.207623 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:14.257527 13727 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:14.257884 14380 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:14.259603 13800 leader_election.cc:304] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:14.260967 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:14.222555 15545 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.262708 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:14.258463 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:14.283803 14380 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:10:14.264647 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.285007 13800 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:14.265720 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:14.266098 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:14.232273 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:14.286490 13833 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:14.286947 14413 raft_consensus.cc:2393] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 4: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:10:14.282650 13836 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 3.
I20260709 12:10:14.236766 15547 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:14.282245 13830 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 4.
I20260709 12:10:14.294924 13727 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:14.298993 13652 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:14.301254 13727 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:14.256892 15548 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:14.302732 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.303089 13651 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:14.263738 15538 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:14.260411 15446 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.260941 15467 raft_consensus.cc:2749] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:14.382025 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 80860.9us
I20260709 12:10:14.378669 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:14.382843 13762 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 4.
I20260709 12:10:14.382943 13727 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:10:14.329391 13800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:14.379312 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 80460.2us
I20260709 12:10:14.382858 13686 raft_consensus.cc:1240] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:14.384115 13652 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:14.286823 15452 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.309140 13685 raft_consensus.cc:1240] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 5 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:14.305984 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:14.393350 13830 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 3.
I20260709 12:10:14.393654 13801 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:14.263453 15558 raft_consensus.cc:2804] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:14.287684 15081 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:14.287671 15303 raft_consensus.cc:2749] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:14.396694 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.303941 15472 raft_consensus.cc:2749] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:14.401353 13652 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:14.402639 13652 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:14.397397 13800 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:14.403661 13652 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:14.385406 14409 raft_consensus.cc:2393] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 4: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:14.259536 15532 consensus_queue.cc:1059] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 12:10:14.411654 13652 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:14.412879 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:14.415822 13832 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:14.298271 15507 raft_consensus.cc:2749] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:14.381662 15550 raft_consensus.cc:2804] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:14.385010 15365 raft_consensus.cc:2804] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:14.304944 15510 raft_consensus.cc:2804] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:14.414372 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:14.416949 13652 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:14.398932 15558 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:14.408815 15252 raft_consensus.cc:2764] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 2 LEADER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:10:14.385279 15469 raft_consensus.cc:2749] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:14.300566 15478 raft_consensus.cc:2749] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:14.305395 15540 raft_consensus.cc:2804] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:14.422423 15549 raft_consensus.cc:2749] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:14.409451 15467 raft_consensus.cc:2749] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:14.408628 15081 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:14.428202 13755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 210) took 1280 ms. Trace:
I20260709 12:10:14.388998 15473 raft_consensus.cc:2749] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:14.395579 15548 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:14.438362 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:14.516932 13762 raft_consensus.cc:3055] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:14.429075 15550 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:14.413753 15247 raft_consensus.cc:2749] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:14.442497 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.266583 15505 consensus_queue.cc:1048] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.164s
I20260709 12:10:14.455228 15563 raft_consensus.cc:3055] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:14.456717 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:14.424633 15534 raft_consensus.cc:2804] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:10:14.448153 13800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.503717 13837 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "232d133451004a83941860574adec712"
dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:54820
I20260709 12:10:14.455793 15538 raft_consensus.cc:2749] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:14.299566 15545 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:14.460275 15566 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:14.560493 13759 raft_consensus.cc:1240] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:14.564020 13759 raft_consensus.cc:1240] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:14.389317 15446 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:14.429651 15173 raft_consensus.cc:2804] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:14.396625 15452 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:14.429278 15365 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:14.570205 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:14.517364 13762 raft_consensus.cc:740] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:14.442812 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:14.516288 13755 rpcz_store.cc:276] 0709 12:10:13.147990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.148186 (+   196us) service_pool.cc:224] Handling call
0709 12:10:13.148524 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:13.878444 (+729920us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:14.427987 (+549543us) spinlock_profiling.cc:243] Waited 729 ms on lock 0x7b54000a0354. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:14.428139 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1677156096}
I20260709 12:10:14.449415 15253 raft_consensus.cc:3055] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:14.378885 15385 consensus_queue.cc:237] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:14.406745 15508 raft_consensus.cc:2749] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:14.440073 15541 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:14.439438 15558 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:14.495704 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 78905.3us
I20260709 12:10:14.581302 13652 leader_election.cc:304] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:14.582688 13652 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:14.553556 13837 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:14.583395 13837 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:14.510332 15531 raft_consensus.cc:2804] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:14.555122 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 161602us
I20260709 12:10:14.514093 15540 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:14.509330 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:14.590855 13829 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:14.520779 15550 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:14.531843 15563 raft_consensus.cc:740] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:14.551311 15534 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:14.586588 13652 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:14.567698 15173 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:14.573066 15365 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:14.573237 15253 raft_consensus.cc:740] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:14.593729 13727 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:14.594590 13651 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:14.590778 15549 raft_consensus.cc:2804] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:14.595469 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:14.597486 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:14.600569 13759 raft_consensus.cc:1240] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:14.584146 15252 consensus_queue.cc:1048] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:10:14.624668 13837 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:14.607719 15582 log.cc:927] Time spent T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260709 12:10:14.608971 15580 log.cc:927] Time spent T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 12:10:14.609166 15508 raft_consensus.cc:2804] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:14.599997 15534 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:14.599727 15402 consensus_queue.cc:1048] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:10:14.592396 15540 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:14.610716 15173 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:14.587087 15552 raft_consensus.cc:2804] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:14.588438 15531 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:14.608987 13652 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:14.583182 13762 consensus_queue.cc:260] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:14.618741 13727 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:14.663444 13762 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:10:14.623267 14412 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 3.
W20260709 12:10:14.663753 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 45175us
I20260709 12:10:14.625155 13759 raft_consensus.cc:1275] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:14.632997 13829 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 3.
I20260709 12:10:14.637250 13837 leader_election.cc:290] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:14.625983 15490 raft_consensus.cc:2804] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:14.621069 15518 raft_consensus.cc:2749] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:14.668632 15562 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:14.669359 15532 raft_consensus.cc:2804] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:14.669899 15532 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:14.670354 15532 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:14.670101 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.655592 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:14.660159 13833 raft_consensus.cc:2468] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 3.
I20260709 12:10:14.637279 15549 raft_consensus.cc:697] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 4 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:14.621467 13832 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 2.
I20260709 12:10:14.688705 14416 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 3.
I20260709 12:10:14.606077 15507 consensus_queue.cc:1059] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
W20260709 12:10:14.663654 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 54733.6us
I20260709 12:10:14.692575 13652 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:14.640448 15195 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:14.640710 15508 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:14.704468 13832 raft_consensus.cc:1275] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:14.671633 15531 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:14.639112 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:14.695333 13652 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:14.706004 13762 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 3.
I20260709 12:10:14.667469 15490 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:14.690650 13801 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:14.672228 15450 raft_consensus.cc:2804] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:14.674886 15552 raft_consensus.cc:697] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 3 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:14.710973 15508 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:14.703301 15295 raft_consensus.cc:2804] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:14.712294 15490 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:14.710237 15529 raft_consensus.cc:2749] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:14.700461 15589 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:14.692013 15550 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:14.716992 15450 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:14.653416 15563 consensus_queue.cc:260] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:14.728904 15195 raft_consensus.cc:2804] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:14.729192 15295 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:14.732546 15545 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:14.742271 15450 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:14.743453 15452 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:14.745512 15446 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:14.684284 15253 consensus_queue.cc:260] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:14.749027 15295 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:14.740828 15467 consensus_queue.cc:1059] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:10:14.763794 15552 consensus_queue.cc:237] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:14.770237 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 63935us
I20260709 12:10:14.749733 15195 raft_consensus.cc:697] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 3 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
W20260709 12:10:14.761751 15368 consensus_meta.cc:287] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.602s	user 0.006s	sys 0.006s
I20260709 12:10:14.752945 15566 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:14.790027 13759 raft_consensus.cc:1275] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:14.791457 13755 raft_consensus.cc:1240] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 12:10:14.786510 13800 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:14.794296 13800 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:14.739439 15589 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:14.796063 13763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 1769) took 1013 ms. Trace:
I20260709 12:10:14.799036 15599 raft_consensus.cc:2749] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:14.802253 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:14.804010 15195 consensus_queue.cc:237] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:14.811628 13763 rpcz_store.cc:276] 0709 12:10:13.782823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.789157 (+  6334us) service_pool.cc:224] Handling call
0709 12:10:13.789449 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:13.789670 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:13.789696 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:14.426762 (+637066us) spinlock_profiling.cc:243] Waited 4.62 ms on lock 0x7b2c00010828. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa926886a11 00007fa926896372 00007fa927fc8a01 00007fa927f8d43a 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2
0709 12:10:14.494207 (+ 67445us) log.cc:844] Serialized 26 byte log entry
0709 12:10:14.623235 (+129028us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:14.623273 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:14.623345 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:14.785877 (+162532us) raft_consensus.cc:1685] finished
0709 12:10:14.785907 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:14.795962 (+ 10055us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10626304,"thread_start_us":90869,"threads_started":1,"wal-append.queue_time_us":208124}
W20260709 12:10:14.817672 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.748253 15549 consensus_queue.cc:237] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:14.792074 15253 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:14.819078 13800 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:14.780732 15368 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:14.826568 15173 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:14.832944 15532 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:14.771461 13652 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:10:14.839370 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.815018 15596 raft_consensus.cc:2804] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:14.843938 14379 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:14.844269 13755 raft_consensus.cc:1275] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:14.850912 13757 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:14.850994 13829 raft_consensus.cc:1240] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:14.852061 15585 raft_consensus.cc:3055] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:14.852458 15585 raft_consensus.cc:740] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:14.853673 13800 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:14.834329 15599 consensus_queue.cc:1059] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:10:14.848953 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 77598.2us
I20260709 12:10:14.809625 15534 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:14.852849 15544 raft_consensus.cc:2749] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:14.860286 13759 raft_consensus.cc:1240] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:14.825567 15547 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:14.866714 13757 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 4.
I20260709 12:10:14.867786 13652 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:14.869650 13652 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:14.850442 15589 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:14.850275 15596 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:14.848763 15507 raft_consensus.cc:2749] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:14.841032 15545 consensus_queue.cc:1048] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:10:14.878844 13831 raft_consensus.cc:2393] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 4: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:14.880177 15605 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:14.880654 15368 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:14.876925 15444 consensus_queue.cc:1059] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
W20260709 12:10:14.899539 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 44032.5us
W20260709 12:10:14.882020 15595 log.cc:927] Time spent T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:10:14.884419 15081 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:10:14.904341 15597 log.cc:927] Time spent T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 12:10:14.888763 15445 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 3 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:14.888288 15365 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:14.890650 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:14.910223 13835 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:10:14.862576 15501 raft_consensus.cc:2749] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:14.890836 15534 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:14.867264 15566 raft_consensus.cc:2749] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:14.867450 15599 consensus_queue.cc:1243] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Peer b98d2519bb504dc6905ed2ede4571835 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:10:14.849346 15538 consensus_queue.cc:1059] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:10:14.902063 13800 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:14.895596 15450 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:14.873519 15529 raft_consensus.cc:2749] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:14.900521 15550 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:14.904093 15502 consensus_queue.cc:1048] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:10:14.878688 15596 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:14.886464 15585 consensus_queue.cc:260] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:14.923053 13835 raft_consensus.cc:2468] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 3.
I20260709 12:10:14.923156 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:10:14.923974 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 50802.9us
I20260709 12:10:14.924495 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:14.924657 13652 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:14.925230 13681 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:14.925894 13652 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:14.916996 15507 raft_consensus.cc:2749] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:14.927003 15606 consensus_queue.cc:1059] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:10:14.930068 15365 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:14.932116 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:14.934446 15540 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:14.935927 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.919382 15602 raft_consensus.cc:2749] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:14.937964 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:14.938910 13682 raft_consensus.cc:2393] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 2: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:14.941490 15540 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:14.942632 14410 raft_consensus.cc:1240] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 1. Current term is 3. Ops: []
I20260709 12:10:14.944115 14416 raft_consensus.cc:1275] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:14.946491 13652 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:14.942660 15438 ts_tablet_manager.cc:1929] T c95811190f014949bb25448e8db1040e P 3f37c9cc9dda46b4be21dd675ba78fb7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:10:14.963845 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:14.964836 14413 raft_consensus.cc:2393] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 3: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:10:14.965373 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:14.966339 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:14.967559 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:14.968775 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:14.969946 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:14.970677 13834 raft_consensus.cc:2376] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 2. Re-sending same reply.
I20260709 12:10:14.971849 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:14.975536 13835 raft_consensus.cc:2393] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 3: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:10:14.972491 13834 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 2.
I20260709 12:10:15.014640 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:15.015919 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:10:15.018394 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.019537 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:14.942374 15550 raft_consensus.cc:2749] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:14.949847 15438 log.cc:1199] T c95811190f014949bb25448e8db1040e P 3f37c9cc9dda46b4be21dd675ba78fb7: Deleting WAL directory at /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894707649-12515-0/minicluster-data/ts-1-root/wals/c95811190f014949bb25448e8db1040e
I20260709 12:10:15.020964 13834 raft_consensus.cc:2393] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 4: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:15.020540 13652 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:15.018402 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:15.029155 13681 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 3.
I20260709 12:10:14.937594 15490 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:15.024693 15606 consensus_queue.cc:1243] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Peer b98d2519bb504dc6905ed2ede4571835 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:10:15.033085 15490 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:15.034504 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:14.949504 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:14.946471 15529 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:15.027020 15558 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:14.952512 15563 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:15.025645 15548 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:14.952389 15450 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:14.951416 15173 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:15.068454 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:15.075160 13828 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 2.
W20260709 12:10:15.033906 15601 log.cc:927] Time spent T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 12:10:14.970526 15253 raft_consensus.cc:2749] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:15.076504 13727 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:14.955585 15446 consensus_queue.cc:1048] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.115s
I20260709 12:10:15.101431 13830 raft_consensus.cc:1240] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:15.102478 13684 raft_consensus.cc:3055] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:15.102972 13684 raft_consensus.cc:740] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:15.028398 15295 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:15.095268 15589 raft_consensus.cc:2804] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:15.106460 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 85985.9us
I20260709 12:10:15.076766 15596 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:15.107986 13652 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:15.095392 15530 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.109390 13684 consensus_queue.cc:260] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:15.111466 13684 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.111589 13652 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:10:15.104595 15603 log.cc:927] Time spent T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.233s	user 0.002s	sys 0.000s
I20260709 12:10:15.102799 15459 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.926393 15605 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:15.102226 15532 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:15.103340 15547 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:15.107082 15490 raft_consensus.cc:2749] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:15.108807 15589 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:15.028901 15531 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:15.113726 15550 raft_consensus.cc:2804] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:15.114902 15253 raft_consensus.cc:2804] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:15.120890 15589 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.114667 15530 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:15.130631 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:15.123080 15438 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48110 (request call id 73) took 5405 ms. Trace:
I20260709 12:10:15.132550 13684 raft_consensus.cc:2410] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260709 12:10:15.125653 15253 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:15.116956 15459 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:15.126811 15550 raft_consensus.cc:697] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 2 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:15.145897 15295 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:15.154585 13833 raft_consensus.cc:1240] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 2. Current term is 4. Ops: []
I20260709 12:10:15.155309 15469 raft_consensus.cc:3055] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:15.155723 15469 raft_consensus.cc:740] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:15.155905 13833 raft_consensus.cc:1240] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:15.156528 15469 consensus_queue.cc:260] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:15.160075 15469 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:15.160879 15610 log.cc:927] Time spent T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:10:15.162185 15548 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:15.162281 15295 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.163147 15510 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:15.163100 15295 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:15.163821 15510 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:15.166927 13831 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:15.169210 15295 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:15.171517 15550 consensus_queue.cc:237] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:15.173509 15402 consensus_queue.cc:1059] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:15.174978 15402 raft_consensus.cc:3055] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:15.175431 15402 raft_consensus.cc:740] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:15.176477 15402 consensus_queue.cc:260] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:15.177981 15518 consensus_queue.cc:1059] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:10:15.180233 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 49070.4us
I20260709 12:10:15.140756 15253 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.182715 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:15.186522 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:15.188385 13652 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:15.189429 15295 raft_consensus.cc:2749] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:15.204586 13831 raft_consensus.cc:1275] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:15.206645 13831 raft_consensus.cc:1275] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:10:15.207109 13831 pending_rounds.cc:85] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 1
I20260709 12:10:15.207403 13831 pending_rounds.cc:107] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:10:15.207746 13831 raft_consensus.cc:2889] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:15.209074 15510 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:15.213928 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:15.215415 13831 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:15.218308 15459 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:15.214648 15510 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 5 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:15.219841 15531 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:15.135982 15438 rpcz_store.cc:276] 0709 12:10:09.722773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:09.748279 (+ 25506us) service_pool.cc:224] Handling call
0709 12:10:10.213326 (+465047us) ts_tablet_manager.cc:1151] Deleting tablet c95811190f014949bb25448e8db1040e
0709 12:10:10.216626 (+  3300us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:10:14.668268 (+4451642us) tablet_metadata.cc:665] Metadata flushed
0709 12:10:14.941640 (+273372us) tablet_metadata.cc:665] Metadata flushed
0709 12:10:15.116966 (+175326us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3043080,"tablet-delete.queue_time_us":210164,"thread_start_us":117403,"threads_started":1}
I20260709 12:10:15.194247 15402 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.199270 15558 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:15.230831 13828 raft_consensus.cc:1275] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:15.244585 13831 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 5.
W20260709 12:10:15.249981 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 55522.4us
I20260709 12:10:15.249446 15596 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:15.246825 15510 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:15.258767 15510 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:15.261296 15510 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:15.262598 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:15.263432 13680 raft_consensus.cc:2393] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 3: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:15.264801 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:15.242514 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:15.298560 13681 raft_consensus.cc:1240] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:15.276546 15518 consensus_queue.cc:1048] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:15.282222 15618 consensus_queue.cc:1048] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:15.296089 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:15.303141 13837 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 2.
I20260709 12:10:15.303628 13683 raft_consensus.cc:1275] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:15.303926 13759 raft_consensus.cc:1275] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:15.304137 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:15.304797 13837 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 4.
I20260709 12:10:15.200088 15508 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:15.306753 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:15.307562 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:15.307801 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:15.308030 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:15.308339 13680 raft_consensus.cc:2368] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 3. Current term is 4.
W20260709 12:10:15.308840 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 53995.4us
I20260709 12:10:15.309842 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:15.310497 13756 raft_consensus.cc:1275] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:15.311003 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:15.311884 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:15.313712 13679 raft_consensus.cc:1240] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:15.314985 13680 raft_consensus.cc:2410] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:10:15.316551 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:15.318624 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:15.318660 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:15.320581 13688 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 4.
I20260709 12:10:15.323946 13727 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:15.325963 13686 raft_consensus.cc:1240] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:15.320151 14409 raft_consensus.cc:2393] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 3: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:10:15.337754 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:15.342861 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:15.343734 13759 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.346796 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:15.349058 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:15.349316 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:15.324795 15490 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.323117 15446 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:15.360121 13757 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 4.
I20260709 12:10:15.361039 15502 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.369706 15502 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:15.372430 13759 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 4.
I20260709 12:10:15.372880 15585 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:15.358440 15490 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:15.378787 15508 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:15.354859 15621 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.416600 15544 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.417255 15544 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:15.414150 15621 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:15.404785 15406 raft_consensus.cc:2804] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:15.362326 15446 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:15.433151 15406 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:15.457554 15406 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.469674 13830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 1746) took 1180 ms. Trace:
I20260709 12:10:15.470515 13830 rpcz_store.cc:276] 0709 12:10:14.289807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.592706 (+302899us) service_pool.cc:224] Handling call
0709 12:10:14.607153 (+ 14447us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:15.101937 (+494784us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.469380 (+367443us) spinlock_profiling.cc:243] Waited 489 ms on lock 0x7b54000b40d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:15.469593 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1124201216}
I20260709 12:10:15.506413 13830 raft_consensus.cc:1240] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:15.501003 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:15.507860 14413 raft_consensus.cc:2368] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 4. Current term is 5.
I20260709 12:10:15.512910 13830 raft_consensus.cc:1240] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 1. Current term is 2. Ops: []
W20260709 12:10:15.519728 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:15.532855 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:15.536716 15617 log.cc:927] Time spent T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 12:10:15.542140 15490 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:15.542534 15544 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:15.545136 15446 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:15.546286 15621 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:15.546895 15621 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:15.547384 15621 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:15.548273 15618 consensus_queue.cc:1059] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:15.555658 14380 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:15.558437 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:15.558676 15217 raft_consensus.cc:2804] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:15.559062 15505 raft_consensus.cc:3055] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:15.559338 13687 raft_consensus.cc:2368] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for earlier term 3. Current term is 4.
I20260709 12:10:15.559567 15505 raft_consensus.cc:740] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:15.560535 15505 consensus_queue.cc:260] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:15.562162 13759 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "b98d2519bb504dc6905ed2ede4571835"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:10:15.563195 13759 raft_consensus.cc:606] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 LEADER]: Received request to transfer leadership to TS b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:15.562414 14409 raft_consensus.cc:1275] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:15.561589 15505 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.569525 13688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48212 (request call id 208) took 1792 ms. Trace:
I20260709 12:10:15.570019 13688 rpcz_store.cc:276] 0709 12:10:13.777250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.777390 (+   140us) service_pool.cc:224] Handling call
0709 12:10:14.655440 (+878050us) spinlock_profiling.cc:243] Waited 1.58 ms on lock 0x7b5800002798. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924e68b71 00007fa924e68a22 00007fa92dd818d9 00007fa92cedbee0 00007fa92cfa50ab 00007fa92cfa5131 00007fa92cf530a0 00007fa92cf52984 00007fa9264cd6d4 00007fa9264cd662
0709 12:10:15.569312 (+913872us) spinlock_profiling.cc:243] Waited 648 ms on lock 0x7b5400311fd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:15.569453 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1493195904}
I20260709 12:10:15.571347 13652 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:15.574602 15490 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.575527 13829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 1748) took 1285 ms. Trace:
I20260709 12:10:15.575934 13829 rpcz_store.cc:276] 0709 12:10:14.290340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.671828 (+381488us) service_pool.cc:224] Handling call
0709 12:10:14.672174 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:14.851658 (+179484us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.575284 (+723626us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b54003c1c54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:15.575465 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":410642688}
I20260709 12:10:15.577569 15472 raft_consensus.cc:3055] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:15.578099 15472 raft_consensus.cc:740] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:15.578914 15472 consensus_queue.cc:260] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:15.581892 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:15.585556 14379 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:15.587234 15504 raft_consensus.cc:2804] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:15.587705 15504 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:15.588138 15502 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:15.588713 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:15.589583 13687 raft_consensus.cc:2393] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 3: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:15.590626 15501 raft_consensus.cc:3055] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:15.591050 15501 raft_consensus.cc:740] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:15.592458 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:15.593120 13687 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:15.592098 15501 consensus_queue.cc:260] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:15.599776 15501 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.546188 15446 consensus_queue.cc:1059] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 12:10:15.599387 13754 raft_consensus.cc:1240] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:10:15.601928 15446 raft_consensus.cc:3055] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:15.602604 15446 raft_consensus.cc:740] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:15.603345 13754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 1273) took 1561 ms. Trace:
I20260709 12:10:15.603539 13683 raft_consensus.cc:1275] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 4. (term mismatch)
I20260709 12:10:15.603924 13683 pending_rounds.cc:85] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 3
I20260709 12:10:15.604190 13683 pending_rounds.cc:107] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 3.4
I20260709 12:10:15.604070 15446 consensus_queue.cc:260] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:15.604676 13683 raft_consensus.cc:2889] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:15.588165 15504 raft_consensus.cc:3060] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.606159 13759 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "b98d2519bb504dc6905ed2ede4571835"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:10:15.609095 13652 leader_election.cc:400] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 election: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 4. Current term is 5.
I20260709 12:10:15.609490 13652 leader_election.cc:403] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:10:15.549573 15621 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:15.611707 13800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.623229 14379 leader_election.cc:400] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 3 election: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for earlier term 3. Current term is 4.
I20260709 12:10:15.624333 14379 leader_election.cc:403] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 12:10:15.626916 13800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.628954 13836 raft_consensus.cc:1275] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:15.639777 13687 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 5.
I20260709 12:10:15.643105 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:15.644057 13828 raft_consensus.cc:2393] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 4: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:15.645550 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:15.646569 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:15.647418 13831 raft_consensus.cc:1275] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:15.648567 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:15.623139 15446 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:15.671676 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 45730.2us
I20260709 12:10:15.675457 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:15.675927 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:15.676363 13687 raft_consensus.cc:2393] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 4: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:15.676595 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:15.677135 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:15.677663 15606 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:15.677983 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:15.678731 13832 raft_consensus.cc:2393] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 3: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:10:15.646632 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:15.603789 13754 rpcz_store.cc:276] 0709 12:10:14.042393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.200787 (+158394us) service_pool.cc:224] Handling call
0709 12:10:14.201146 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:15.602472 (+1401326us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.603073 (+   601us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b5400332cd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:15.603271 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3214931200}
I20260709 12:10:15.679884 13834 raft_consensus.cc:2368] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 4. Current term is 5.
I20260709 12:10:15.679945 15406 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:15.677676 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:15.677397 13683 raft_consensus.cc:2393] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 4: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:15.682538 15406 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:15.683256 15606 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:15.685997 15606 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:15.646605 13800 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:15.687654 15606 raft_consensus.cc:2804] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:15.688540 15606 raft_consensus.cc:697] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 3 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:15.690028 15606 consensus_queue.cc:237] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:15.693286 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 46759.9us
I20260709 12:10:15.626122 15467 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:15.628857 15195 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.688136 15508 consensus_queue.cc:1059] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:15.598979 15589 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:15.707687 13834 raft_consensus.cc:1275] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:15.641417 15562 consensus_queue.cc:1059] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.073s
I20260709 12:10:15.640959 15544 raft_consensus.cc:2749] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 4. Current term is 5.
I20260709 12:10:15.738073 13829 raft_consensus.cc:1240] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:15.744501 13760 raft_consensus.cc:2393] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 3: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:15.715242 13652 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:10:15.747568 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 190724us
I20260709 12:10:15.707345 15552 consensus_queue.cc:1048] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 12:10:15.754213 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:15.754472 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:15.709755 15467 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:15.731385 15550 consensus_queue.cc:1048] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:10:15.757357 13652 leader_election.cc:400] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 election: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 4. Current term is 5.
I20260709 12:10:15.758234 13755 raft_consensus.cc:2393] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 5: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:15.761585 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:15.762049 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:15.762467 13761 raft_consensus.cc:2393] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 4: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:15.762213 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:15.763078 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:15.742787 15252 consensus_queue.cc:1048] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
W20260709 12:10:15.757246 15253 consensus_meta.cc:287] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.560s	user 0.013s	sys 0.002s
I20260709 12:10:15.757085 15217 raft_consensus.cc:697] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 3 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:15.710865 15195 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:15.761490 15510 raft_consensus.cc:2749] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for earlier term 3. Current term is 4.
I20260709 12:10:15.782924 13757 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 4.
I20260709 12:10:15.784548 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:15.766584 14380 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:15.773267 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:15.785355 13761 raft_consensus.cc:2393] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 4: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:15.785373 13756 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.784480 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:15.787354 13757 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 1.
I20260709 12:10:15.776265 13754 raft_consensus.cc:1240] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:15.789577 13830 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 4.
I20260709 12:10:15.778489 15558 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.838326 13761 raft_consensus.cc:1275] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:15.826481 14380 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:15.772616 15253 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:15.849368 13761 raft_consensus.cc:1275] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:15.835704 15552 raft_consensus.cc:2749] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:15.835105 15548 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:15.838074 15502 raft_consensus.cc:2804] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:15.859066 13685 raft_consensus.cc:2393] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 3: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:15.861873 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:15.862649 13761 raft_consensus.cc:2393] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 4: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
W20260709 12:10:15.865530 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 350869us
I20260709 12:10:15.867527 13756 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 3.
I20260709 12:10:15.867854 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:15.838876 15550 consensus_queue.cc:1059] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:10:15.882797 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:15.886766 13761 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 6.
W20260709 12:10:15.887844 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 264755us
W20260709 12:10:15.888463 14380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.894095 13800 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:15.844393 15558 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:15.858490 15585 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:15.905418 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 186327us
I20260709 12:10:15.908560 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:15.909266 14416 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 3.
I20260709 12:10:15.865599 15330 raft_consensus.cc:2804] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:15.914284 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:15.884449 15589 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:15.861524 15548 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:15.928810 15631 log.cc:927] Time spent T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
W20260709 12:10:15.929738 15627 log.cc:927] Time spent T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 12:10:15.981690 15518 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.982523 15518 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:15.930971 15635 log.cc:927] Time spent T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:10:15.864542 15217 consensus_queue.cc:237] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:15.985347 15518 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:15.941455 14416 raft_consensus.cc:1275] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:10:15.942202 15630 log.cc:927] Time spent T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 12:10:15.915089 13828 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 1.
I20260709 12:10:15.886543 15502 raft_consensus.cc:697] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 3 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:15.990418 15518 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.990958 15502 consensus_queue.cc:237] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:15.991400 15518 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:15.947175 13834 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 3.
W20260709 12:10:15.978533 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 213742us
I20260709 12:10:15.879001 15552 consensus_queue.cc:1048] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 12:10:15.994500 15518 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:15.995321 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:15.997856 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.999014 15526 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.999832 15526 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:16.002732 15526 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:16.004305 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:16.005148 13828 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:16.012550 15504 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:16.014288 14413 raft_consensus.cc:1240] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:16.017306 15504 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 3 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:15.995704 15490 raft_consensus.cc:2749] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:15.916869 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:16.031947 15642 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.089596 15642 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:16.052306 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 53537us
I20260709 12:10:15.898082 15638 consensus_queue.cc:1048] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.150s
I20260709 12:10:16.025097 15550 raft_consensus.cc:3055] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:15.916589 15585 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:16.092157 15642 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:16.092293 15550 raft_consensus.cc:740] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:16.093298 15550 consensus_queue.cc:260] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:16.027173 15467 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:16.076066 15606 consensus_queue.cc:1048] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:10:16.093842 15585 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:10:16.086391 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 186142us
I20260709 12:10:16.094719 15467 raft_consensus.cc:2749] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:16.094815 15550 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:16.096784 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.102773 13686 raft_consensus.cc:2468] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 3.
I20260709 12:10:16.105230 13828 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 3.
I20260709 12:10:16.106680 13758 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 2.
I20260709 12:10:16.107546 13759 raft_consensus.cc:606] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Received request to transfer leadership to TS b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:16.108031 13759 raft_consensus.cc:614] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:16.095490 13727 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:10:16.120823 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 226850us
I20260709 12:10:16.124023 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:16.095788 15585 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:16.129503 13680 raft_consensus.cc:3060] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:16.131031 13800 leader_election.cc:304] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:16.135747 13727 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
W20260709 12:10:16.136914 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 275721us
I20260709 12:10:16.110553 15638 consensus_queue.cc:1048] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:10:16.146443 13727 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:16.118841 15402 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:16.154726 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:16.155488 13837 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:16.156283 13800 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:16.159513 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:16.160369 13831 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 2.
I20260709 12:10:16.121946 15634 raft_consensus.cc:2804] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:16.167745 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 261320us
I20260709 12:10:16.096031 15641 consensus_queue.cc:1059] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 12:10:16.182296 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:16.182624 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:16.166118 15406 raft_consensus.cc:2804] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:16.143990 15253 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:16.184144 13727 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:16.143021 15643 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:10:16.202708 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.161010 15467 raft_consensus.cc:2804] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:16.150290 15399 raft_consensus.cc:2804] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:16.186066 13680 raft_consensus.cc:2468] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 3.
I20260709 12:10:16.187403 13651 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:16.190284 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:16.208266 13829 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 3.
I20260709 12:10:16.140837 15585 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:16.168087 15634 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:16.206521 13837 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 3.
I20260709 12:10:16.187526 15605 leader_election.cc:290] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:16.202121 15330 raft_consensus.cc:697] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 5 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
W20260709 12:10:16.251556 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 47461.3us
I20260709 12:10:16.205538 15652 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.183701 15402 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:16.225497 15385 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:16.207046 15399 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:16.252882 14379 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:16.207828 15558 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:16.210224 15295 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:16.262862 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 81933.8us
I20260709 12:10:16.216143 15634 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:16.248494 15647 log.cc:927] Time spent T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
W20260709 12:10:16.271371 15639 log.cc:927] Time spent T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.245s	user 0.001s	sys 0.000s
I20260709 12:10:16.216084 15467 raft_consensus.cc:697] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 4 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
W20260709 12:10:16.252029 15469 consensus_meta.cc:287] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 1.072s	user 0.015s	sys 0.005s
I20260709 12:10:16.276018 15605 raft_consensus.cc:2804] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:10:16.271723 15620 log.cc:927] Time spent T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:10:16.274235 15548 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:16.274783 15446 raft_consensus.cc:2804] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:16.289630 14412 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 587) took 3122 ms (client timeout 1729 ms). Trace:
W20260709 12:10:16.309059 14412 rpcz_store.cc:269] 0709 12:10:13.163891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.164046 (+   155us) service_pool.cc:224] Handling call
0709 12:10:14.265960 (+1101914us) spinlock_profiling.cc:243] Waited 5.65 ms on lock 0x7b5800003c98. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924e68b71 00007fa924e68a22 00007fa92dd818d9 00007fa92cedbee0 00007fa92cfa50ab 00007fa92cfa5131 00007fa92cf530a0 00007fa92cf52984 00007fa9264cd6d4 00007fa9264cd662
0709 12:10:16.285941 (+2019981us) spinlock_profiling.cc:243] Waited 285 ms on lock 0x7b54006400d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:16.286073 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":669410304}
W20260709 12:10:16.289494 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 97768.7us
I20260709 12:10:16.283834 13651 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:10:16.315164 15645 log.cc:927] Time spent T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
I20260709 12:10:16.279906 15385 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:16.316332 15467 consensus_queue.cc:237] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:16.320698 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:16.321990 14412 raft_consensus.cc:2410] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 12:10:16.278293 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 122124us
I20260709 12:10:16.209074 15643 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:16.279212 15399 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:16.298796 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.329027 13726 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:16.288770 13727 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:16.285815 15660 raft_consensus.cc:2804] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:16.334820 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:16.290798 15662 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:16.272205 15652 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:16.300526 15518 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:16.284991 15295 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:16.308995 15446 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:16.288527 15253 consensus_queue.cc:1048] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 12:10:16.308091 15605 raft_consensus.cc:697] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 4 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:16.369954 15605 consensus_queue.cc:237] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:16.371834 15652 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:16.372490 15446 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:16.373811 15623 raft_consensus.cc:2804] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:16.361023 14409 raft_consensus.cc:1275] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:16.361238 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:16.334875 15368 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:16.355993 15330 consensus_queue.cc:237] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:16.364748 15585 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:16.365800 15643 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:16.366390 15558 consensus_queue.cc:1048] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:10:16.331475 15505 consensus_meta.cc:287] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.765s	user 0.011s	sys 0.001s
I20260709 12:10:16.366909 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:16.336056 15660 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:16.356025 15540 consensus_queue.cc:1048] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:10:16.357717 15518 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:16.386032 15660 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:16.387997 15623 raft_consensus.cc:697] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:16.420409 15665 raft_consensus.cc:2804] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:16.429999 15665 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:16.430512 15665 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:16.396986 15585 consensus_queue.cc:1048] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:10:16.435777 15518 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:10:16.439066 15501 consensus_meta.cc:287] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.839s	user 0.014s	sys 0.000s
I20260709 12:10:16.442746 15662 raft_consensus.cc:2749] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:16.421612 15623 consensus_queue.cc:237] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:16.429179 15634 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:16.451378 15634 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:15.253695 13570 catalog_manager.cc:5028] TS 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): tablet c95811190f014949bb25448e8db1040e (table test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]) successfully deleted
W20260709 12:10:16.497315 13570 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 1.24341e+06us
W20260709 12:10:16.510860 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.508348 13586 catalog_manager.cc:5697] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 2 to 4, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 4 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:10:16.516153 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 232241us
I20260709 12:10:16.517444 13682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 1687) took 1255 ms. Trace:
I20260709 12:10:16.518097 13682 rpcz_store.cc:276] 0709 12:10:15.261755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.262374 (+   619us) service_pool.cc:224] Handling call
0709 12:10:15.298373 (+ 35999us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:15.450154 (+151781us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:15.450200 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:15.450263 (+    63us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:15.450309 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:16.516787 (+1066478us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b5400270e54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:16.516916 (+   129us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:16.517212 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":348449664}
I20260709 12:10:16.516408 13685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 1689) took 1253 ms. Trace:
I20260709 12:10:16.521001 13651 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:16.521267 13685 rpcz_store.cc:276] 0709 12:10:15.262431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.262639 (+   208us) service_pool.cc:224] Handling call
0709 12:10:16.515811 (+1253172us) spinlock_profiling.cc:243] Waited 550 ms on lock 0x7b540021e154. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:16.516152 (+   341us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1265858816}
I20260709 12:10:16.524178 13651 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:16.528329 13583 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45618 (request call id 231) took 7073 ms. Trace:
I20260709 12:10:16.528121 13726 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:16.535506 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:16.537663 13726 leader_election.cc:400] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 election: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 3. Current term is 4.
I20260709 12:10:16.528218 13651 leader_election.cc:304] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:16.538537 13726 leader_election.cc:403] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:10:16.539361 13756 raft_consensus.cc:1240] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:16.516280 13586 catalog_manager.cc:5697] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 2 to 3, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 3 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:16.547493 13760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48114 (request call id 1788) took 1284 ms. Trace:
I20260709 12:10:16.548146 13760 rpcz_store.cc:276] 0709 12:10:15.263276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.264494 (+  1218us) service_pool.cc:224] Handling call
0709 12:10:16.546960 (+1282466us) spinlock_profiling.cc:243] Waited 478 ms on lock 0x7b54003930d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:16.547267 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1100538752}
I20260709 12:10:16.556130 13824 tablet_service.cc:1558] Processing DeleteTablet for tablet c89d2a3019c74941a4f8dffc9aa5cf40 with delete_type TABLET_DATA_TOMBSTONED (TS 96701a74fdee481fb5f54aac841e17dd not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54808
W20260709 12:10:16.554921 14380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.540814 13651 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:16.562736 15490 raft_consensus.cc:2749] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:16.385957 15368 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:16.576133 15562 raft_consensus.cc:2749] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:16.578699 15643 raft_consensus.cc:2749] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:16.577344 15562 raft_consensus.cc:2749] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:16.575512 13586 catalog_manager.cc:5697] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 1 to 2, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 2 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:16.574237 15670 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.636868 15432 consensus_queue.cc:1048] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:16.643656 15368 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:16.646620 15432 raft_consensus.cc:2749] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 3. Current term is 4.
I20260709 12:10:16.650110 15550 consensus_queue.cc:1048] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:16.675110 15481 raft_consensus.cc:3055] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:16.682045 15481 raft_consensus.cc:740] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:16.669996 15518 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:16.666404 15670 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:16.688041 15670 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:16.688694 15670 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:16.683976 15481 consensus_queue.cc:260] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:16.653674 15195 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:16.693506 15195 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:16.694032 15481 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:16.659137 15081 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.700130 15504 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:16.700073 15081 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:16.669085 15402 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:16.701134 15504 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:16.675884 15508 raft_consensus.cc:3055] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:16.702386 15508 raft_consensus.cc:740] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:16.703948 15508 consensus_queue.cc:260] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:16.705364 15508 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:16.707684 15081 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:16.708083 15504 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:16.694469 15195 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:16.691941 15472 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:16.715973 15195 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:16.716421 13833 raft_consensus.cc:1275] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:16.718245 15540 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:16.719412 15530 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:16.719208 15540 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:16.694495 15632 consensus_queue.cc:1048] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:16.696460 15562 raft_consensus.cc:2749] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:16.740257 15490 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.741084 15490 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:16.558022 13583 rpcz_store.cc:276] 0709 12:10:09.478424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:09.488013 (+  9589us) service_pool.cc:224] Handling call
0709 12:10:16.528009 (+7039996us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:13.312136 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:13.593188 (+281052us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:13.598517 (+  5329us) write_op.cc:435] Acquired schema lock
0709 12:10:13.609275 (+ 10758us) tablet.cc:662] Decoding operations
0709 12:10:13.774471 (+165196us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:13.793061 (+ 18590us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:13.794415 (+  1354us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:10:13.870789 (+ 76374us) tablet.cc:701] Row locks acquired
0709 12:10:13.878650 (+  7861us) write_op.cc:260] PREPARE: finished
0709 12:10:13.878813 (+   163us) write_op.cc:270] Start()
0709 12:10:13.878936 (+   123us) write_op.cc:276] Timestamp: P: 1783599013878771 usec, L: 0
0709 12:10:13.878957 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:10:13.879703 (+   746us) log.cc:844] Serialized 3621 byte log entry
0709 12:10:14.124329 (+244626us) spinlock_profiling.cc:243] Waited 50.8 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa924e830ac 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9fc02 00007fa927b2720b
0709 12:10:14.438802 (+314473us) op_driver.cc:464] REPLICATION: finished
0709 12:10:14.740682 (+301880us) write_op.cc:301] APPLY: starting
0709 12:10:14.745188 (+  4506us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:14.765852 (+ 20664us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:14.765880 (+    28us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:14.800996 (+ 35116us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:14.801354 (+   358us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 12:10:14.801434 (+    80us) write_op.cc:312] APPLY: finished
0709 12:10:14.801889 (+   455us) log.cc:844] Serialized 71 byte log entry
0709 12:10:14.802147 (+   258us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:14.802345 (+   198us) write_op.cc:454] Released schema lock
0709 12:10:14.802417 (+    72us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:14.802897 (+   480us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:14.802941 (+    44us) write_op.cc:454] Released schema lock
0709 12:10:15.228043 (+425102us) spinlock_profiling.cc:243] Waited 3.45 ms on lock 0x7b5400373cd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8a32a 00007fa927f0ff14 00007fa927f0fec3 00007fa927f0fe38 00007fa927f0fdf3 00007fa927f0f0dc 00007fa927f38e16 00007fa927f20cbb 00007fa927f0b39d 00007fa927f0ed75
Metrics: {"mutex_wait_us":36492,"reported_tablets":13,"child_traces":[["op",{"apply.queue_time_us":268256,"apply.run_cpu_time_us":4338,"apply.run_wall_time_us":66387,"num_ops":9,"prepare.queue_time_us":434394,"prepare.run_cpu_time_us":17809,"prepare.run_wall_time_us":865034,"raft.queue_time_us":149855,"raft.run_cpu_time_us":42592,"raft.run_wall_time_us":848160,"replication_time_us":518232,"spinlock_wait_cycles":124777216,"thread_start_us":949454,"threads_started":4,"wal-append.queue_time_us":253415,"wal-append.run_cpu_time_us":7842,"wal-append.run_wall_time_us":1694823}]]}
W20260709 12:10:16.697638 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 157160us
W20260709 12:10:16.698112 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 157320us
I20260709 12:10:16.698446 15295 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:16.689587 15670 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:16.775203 13651 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:16.775453 13726 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:16.770227 15540 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:10:16.789251 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 484779us
W20260709 12:10:16.799552 15406 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.015s	sys 0.034s
W20260709 12:10:16.807622 15406 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.015s	sys 0.035s
W20260709 12:10:16.807860 15589 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.006s	sys 0.068s
W20260709 12:10:16.808359 15589 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.006s	sys 0.068s
I20260709 12:10:16.808143 15406 raft_consensus.cc:697] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:16.809859 14379 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:16.809988 15406 consensus_queue.cc:237] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:16.815796 15678 consensus_queue.cc:1048] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
W20260709 12:10:16.818913 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 67320.4us
I20260709 12:10:16.820482 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:16.821187 15592 raft_consensus.cc:2749] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:16.821463 14412 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 3.
I20260709 12:10:16.822096 15670 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:10:16.822643 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 591867us
W20260709 12:10:16.823146 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.827628 13830 raft_consensus.cc:1240] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 3 LEADER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:16.828574 15641 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:16.822098 15592 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:16.829461 15641 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:16.832492 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:16.832815 15641 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:16.833067 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:16.833585 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:10:16.834475 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 87288.9us
I20260709 12:10:16.835656 13651 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:16.835834 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:16.837360 13651 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:16.837738 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:16.832885 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:16.825433 13726 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:10:16.841894 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 451351us
W20260709 12:10:16.913206 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 75994.5us
I20260709 12:10:16.906391 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:16.806648 15295 raft_consensus.cc:2749] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:16.900316 13759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:39554 (request call id 20) took 1294 ms. Trace:
I20260709 12:10:16.853909 13829 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 5.
I20260709 12:10:16.907680 13836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 1764) took 1878 ms. Trace:
I20260709 12:10:16.854359 14410 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:16.805804 15490 leader_election.cc:290] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:16.902787 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:16.907472 15685 tablet_replica.cc:333] T c89d2a3019c74941a4f8dffc9aa5cf40 P 96701a74fdee481fb5f54aac841e17dd: stopping tablet replica
I20260709 12:10:16.929170 13836 rpcz_store.cc:276] 0709 12:10:14.969641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.146568 (+176927us) service_pool.cc:224] Handling call
0709 12:10:15.146913 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:15.629336 (+482423us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:16.848001 (+1218665us) spinlock_profiling.cc:243] Waited 482 ms on lock 0x7b54001676d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:16.848349 (+   348us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1107707776}
I20260709 12:10:16.924297 13759 rpcz_store.cc:276] 0709 12:10:15.605848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.606004 (+   156us) service_pool.cc:224] Handling call
0709 12:10:16.899855 (+1293851us) spinlock_profiling.cc:243] Waited 501 ms on lock 0x7b5400417654. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f87853 00007fa92cf5560a 00007fa9264db7d4 00007fa9264db762 00007fa9264db691 00007fa9264db60c 00007fa9264da8c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:16.900060 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1151657344}
I20260709 12:10:16.838200 15481 raft_consensus.cc:2804] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:16.895625 15504 raft_consensus.cc:2804] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:16.841603 15658 raft_consensus.cc:476] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 2 LEADER]: Not starting pre-election -- already a leader
I20260709 12:10:16.903314 15515 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.962539 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:16.964277 15660 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:16.967142 15660 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:16.967932 13801 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:10:16.968814 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 117726us
I20260709 12:10:16.969859 15467 raft_consensus.cc:2804] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:16.970427 15467 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:16.970362 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:16.971026 15467 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:16.971357 14379 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:16.972046 15472 raft_consensus.cc:2749] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:16.972420 15531 raft_consensus.cc:2804] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:16.971488 13682 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 3.
I20260709 12:10:16.838418 15665 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:16.976576 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:16.951164 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:16.844161 15592 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:16.828668 15633 consensus_queue.cc:1059] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.133s
I20260709 12:10:16.986280 13761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 236) took 1097 ms. Trace:
I20260709 12:10:16.988284 15538 raft_consensus.cc:2804] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:16.993058 13761 rpcz_store.cc:276] 0709 12:10:15.888282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.888408 (+   126us) service_pool.cc:224] Handling call
0709 12:10:16.985077 (+1096669us) spinlock_profiling.cc:243] Waited 9.68 ms on lock 0x7b58001e3f98. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924e68b71 00007fa924e68a22 00007fa92dd818d9 00007fa92cedbee0 00007fa92cfa50ab 00007fa92cfa5131 00007fa92cf66fc0 00007fa92cf51929 00007fa92cf513d2 00007fa9264c8bd4
0709 12:10:16.985419 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:16.985761 (+   342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:16.985806 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:16.985857 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:16.985897 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:16.985950 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:16.986068 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22267136}
I20260709 12:10:16.995308 15641 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:16.996069 15641 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:16.988533 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:16.998190 15538 raft_consensus.cc:697] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 3 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:16.998798 13836 raft_consensus.cc:1275] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:16.999609 15538 consensus_queue.cc:237] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:16.983355 15531 raft_consensus.cc:697] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 4 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:16.988435 13685 raft_consensus.cc:1275] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:17.004024 15515 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:17.004870 15531 consensus_queue.cc:237] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:16.989194 13651 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:17.006059 14412 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 4.
I20260709 12:10:17.006522 15515 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:17.007360 15515 raft_consensus.cc:2749] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:17.003513 15399 consensus_meta.cc:287] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.660s	user 0.009s	sys 0.009s
I20260709 12:10:16.991313 13763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48114 (request call id 1802) took 1085 ms. Trace:
I20260709 12:10:16.975373 15481 raft_consensus.cc:697] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 4 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:16.979202 15518 raft_consensus.cc:2749] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:16.978909 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:16.982014 15660 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.021741 13763 rpcz_store.cc:276] 0709 12:10:15.896645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.983668 (+ 87023us) service_pool.cc:224] Handling call
0709 12:10:16.902383 (+918715us) spinlock_profiling.cc:243] Waited 41.8 ms on lock 0x7b58001e3f98. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924e68b71 00007fa924e68a22 00007fa92dd818d9 00007fa92cedbee0 00007fa92cfa50ab 00007fa92cfa5131 00007fa92cf530a0 00007fa92cf52984 00007fa9264cd6d4 00007fa9264cd662
0709 12:10:16.981297 (+ 78914us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":96176896}
I20260709 12:10:17.029969 15540 consensus_queue.cc:1048] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:17.030480 13800 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:17.047825 15641 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:17.031694 15399 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:17.049921 15217 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:17.050792 15399 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:17.050699 15217 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:17.051847 13758 raft_consensus.cc:1240] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:17.015048 15678 consensus_queue.cc:1048] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:10:17.043540 15195 consensus_queue.cc:1059] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:10:17.056259 15548 raft_consensus.cc:3055] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:17.056694 15548 raft_consensus.cc:740] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
W20260709 12:10:17.057998 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 232844us
I20260709 12:10:17.057801 15548 consensus_queue.cc:260] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:17.060104 15592 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:17.067031 15665 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:17.070109 13761 raft_consensus.cc:1240] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:17.071228 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:17.071296 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:17.072566 13685 raft_consensus.cc:1275] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:17.080698 15596 raft_consensus.cc:2804] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:17.027055 13754 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 2.
I20260709 12:10:17.081569 15596 raft_consensus.cc:697] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 3 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:17.082906 13754 raft_consensus.cc:1240] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:10:17.082922 15596 consensus_queue.cc:237] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:17.085598 15641 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:17.086210 15641 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:17.087932 15446 consensus_meta.cc:287] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.715s	user 0.015s	sys 0.005s
I20260709 12:10:17.088420 15446 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:17.089031 15399 consensus_queue.cc:1059] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:17.090258 15399 raft_consensus.cc:3055] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:10:17.090462 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.090691 15399 raft_consensus.cc:740] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:17.091747 15399 consensus_queue.cc:260] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:17.093150 15399 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:17.095011 15643 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:17.095777 15643 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:17.098107 15680 log.cc:927] Time spent T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:10:17.088500 15641 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:17.102012 15643 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:17.102187 13727 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:17.103715 13727 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:10:17.077207 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 46886us
I20260709 12:10:17.103708 15592 consensus_queue.cc:1059] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:10:17.108876 15505 consensus_queue.cc:1048] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:10:17.110780 15633 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:17.111233 15633 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:17.111585 15633 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:17.112375 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:17.113255 13763 raft_consensus.cc:2393] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 3: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:17.120707 13758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 1804) took 1223 ms. Trace:
I20260709 12:10:17.120814 13832 raft_consensus.cc:1275] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:17.123104 15385 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:17.109558 15592 raft_consensus.cc:3055] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:17.121172 13758 rpcz_store.cc:276] 0709 12:10:15.897325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.378208 (+480883us) service_pool.cc:224] Handling call
0709 12:10:16.378699 (+   491us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:17.052432 (+673733us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:17.120466 (+ 68034us) spinlock_profiling.cc:243] Waited 673 ms on lock 0x7b54003c9954. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:17.120646 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1547258240}
I20260709 12:10:17.132472 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:17.136663 13761 raft_consensus.cc:1240] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:10:17.130935 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:17.143183 13836 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:17.144225 13832 raft_consensus.cc:2393] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 2: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:17.111234 13762 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "232d133451004a83941860574adec712"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:10:17.132145 15665 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.130455 15592 raft_consensus.cc:740] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:17.148066 13762 raft_consensus.cc:606] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:17.117661 15660 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:17.155440 13755 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 2.
I20260709 12:10:17.157939 13762 raft_consensus.cc:614] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:17.132342 15658 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:17.167292 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:17.169553 15618 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.170379 15618 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:17.170605 15665 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:17.172525 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:17.172703 15618 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:17.173244 15665 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:17.173904 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:17.153919 13800 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:17.350914 13688 raft_consensus.cc:1275] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:17.358520 15677 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:17.359511 15677 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:17.360787 15695 log.cc:927] Time spent T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 12:10:17.174268 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:10:17.331037 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 82840.4us
I20260709 12:10:17.207171 13681 raft_consensus.cc:2393] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 4: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:17.182559 13727 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:17.156744 15368 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.206591 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:17.154376 15472 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.214177 13759 raft_consensus.cc:1275] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:17.289995 14410 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 4.
I20260709 12:10:17.372725 13836 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 4.
W20260709 12:10:17.322310 15694 log.cc:927] Time spent T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 12:10:17.374161 13828 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 1.
I20260709 12:10:17.392417 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:17.237210 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:17.392270 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:17.307263 15446 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:17.351097 15532 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:17.398770 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 249215us
I20260709 12:10:17.245759 15504 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
W20260709 12:10:17.408799 14380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.404945 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:17.399986 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:17.210016 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:17.405856 15643 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.428045 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:17.429183 13687 raft_consensus.cc:2393] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 3: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
W20260709 12:10:17.428113 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 292786us
I20260709 12:10:17.409665 15368 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:17.428218 15643 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:17.432097 13727 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:17.433159 15643 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:17.433576 13762 raft_consensus.cc:1275] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:17.178172 15481 consensus_queue.cc:237] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:17.434731 15623 consensus_queue.cc:1059] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:17.435554 15623 consensus_queue.cc:1243] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer 96701a74fdee481fb5f54aac841e17dd log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 12:10:17.435896 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 62370.4us
I20260709 12:10:17.436408 15623 raft_consensus.cc:2749] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:17.437098 15623 raft_consensus.cc:3055] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:17.437639 13754 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 4.
I20260709 12:10:17.437470 15623 raft_consensus.cc:740] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:17.442111 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:17.442504 15623 consensus_queue.cc:260] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:17.444041 15623 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:17.444576 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:10:17.446852 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.447232 15596 raft_consensus.cc:2804] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:17.447845 15596 raft_consensus.cc:697] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 2 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:17.448958 15596 consensus_queue.cc:237] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:17.450163 13681 raft_consensus.cc:1240] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:17.450505 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:17.332024 15467 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:17.446509 13760 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 3.
I20260709 12:10:17.408322 15504 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:17.416693 15406 raft_consensus.cc:2804] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:17.469291 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:17.469559 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:17.472811 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:17.331277 15658 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:17.474306 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:17.474618 13683 raft_consensus.cc:1240] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:10:17.476902 15658 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:17.478642 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:10:17.479045 15689 log.cc:927] Time spent T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.452s	user 0.004s	sys 0.000s
I20260709 12:10:17.247958 15592 consensus_queue.cc:260] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:17.492836 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:17.470760 13755 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48120 (request call id 1291) took 1714 ms (client timeout 1523 ms). Trace:
W20260709 12:10:17.495249 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 61472.9us
W20260709 12:10:17.493902 13755 rpcz_store.cc:269] 0709 12:10:15.756703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.761889 (+  5186us) service_pool.cc:224] Handling call
0709 12:10:17.466755 (+1704866us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b540035edd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:17.470678 (+  3923us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2709036928}
I20260709 12:10:17.490578 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:17.412251 15472 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:17.506645 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:17.507838 13755 raft_consensus.cc:2393] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 3: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:17.455832 15677 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:17.512647 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:17.539345 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:17.502187 15406 raft_consensus.cc:697] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:17.541353 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:17.509063 15658 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:17.516769 15605 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.553490 13727 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:17.531787 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:17.549746 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:17.568096 13652 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:17.576777 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:17.580976 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:17.583765 13727 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:17.545648 15643 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:17.585752 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:17.587253 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:17.564281 15660 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:10:17.590961 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 46562.8us
I20260709 12:10:17.608633 13755 raft_consensus.cc:2393] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 4: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
W20260709 12:10:17.609831 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.594483 13727 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:17.633121 13687 raft_consensus.cc:1275] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:17.641602 13835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 232) took 1381 ms. Trace:
I20260709 12:10:17.643020 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:17.643643 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:17.586714 15618 consensus_queue.cc:1048] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 12:10:17.673059 13756 raft_consensus.cc:2393] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 2: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:17.565402 15605 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:17.693945 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 58967.7us
I20260709 12:10:17.694031 15549 raft_consensus.cc:2804] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:17.694792 15549 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:17.642572 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:10:17.690922 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 45468.1us
I20260709 12:10:17.672452 15385 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:17.642448 15699 log.cc:927] Time spent T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:10:17.642395 15472 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:17.695302 15549 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:17.726313 13837 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "407aabb01908409185c74e2349da4c3d"
dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
mode: GRACEFUL
new_leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
 from {username='slave'} at 127.0.0.1:52702
I20260709 12:10:17.727229 13837 raft_consensus.cc:606] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Received request to transfer leadership to TS 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:17.727698 13837 raft_consensus.cc:614] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:17.691094 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:17.752429 13757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 228) took 1915 ms. Trace:
I20260709 12:10:17.752812 15640 raft_consensus.cc:2804] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:17.646694 13835 rpcz_store.cc:276] 0709 12:10:16.191418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.192885 (+  1467us) service_pool.cc:224] Handling call
0709 12:10:16.193351 (+   466us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:16.280888 (+ 87537us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:16.283122 (+  2234us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:17.147439 (+864317us) spinlock_profiling.cc:243] Waited 6.51 ms on lock 0x7b2c0000bb28. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa926886a11 00007fa926896372 00007fa927fc8a01 00007fa927f8d43a 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2
0709 12:10:17.157081 (+  9642us) log.cc:844] Serialized 26 byte log entry
0709 12:10:17.385984 (+228903us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:17.386105 (+   121us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:17.406633 (+ 20528us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:17.555107 (+148474us) raft_consensus.cc:1685] finished
0709 12:10:17.555135 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:17.573107 (+ 17972us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12038,"raft.queue_time_us":97270,"raft.run_cpu_time_us":389,"raft.run_wall_time_us":75867,"spinlock_wait_cycles":14980480,"thread_start_us":218397,"threads_started":2,"wal-append.queue_time_us":293251}
I20260709 12:10:17.674350 13754 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 4.
I20260709 12:10:17.673038 15658 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:17.745621 15472 raft_consensus.cc:2804] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:17.690493 15643 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:17.878453 13836 raft_consensus.cc:1275] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:17.729167 15641 consensus_queue.cc:1048] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.137s
I20260709 12:10:17.898300 14379 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:17.757468 13757 rpcz_store.cc:276] 0709 12:10:15.837405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.855411 (+ 18006us) service_pool.cc:224] Handling call
0709 12:10:17.100277 (+1244866us) spinlock_profiling.cc:243] Waited 9.96 ms on lock 0x7b58001e3f98. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924e68b71 00007fa924e68a22 00007fa92dd818d9 00007fa92cedbee0 00007fa92cfa50ab 00007fa92cfa5131 00007fa92cf66fc0 00007fa92cf51929 00007fa92cf513d2 00007fa9264c8bd4
0709 12:10:17.100670 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:17.101189 (+   519us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:17.101217 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:17.104668 (+  3451us) log.cc:844] Serialized 26 byte log entry
0709 12:10:17.153012 (+ 48344us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:17.153048 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:17.153127 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:17.751918 (+598791us) raft_consensus.cc:1685] finished
0709 12:10:17.751945 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:17.752213 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2375,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":112,"spinlock_wait_cycles":22928512,"thread_start_us":28885,"threads_started":1,"wal-append.queue_time_us":281837}
I20260709 12:10:17.906489 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:17.917342 14379 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:17.879295 15472 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:17.718555 15406 consensus_queue.cc:237] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:17.914912 13681 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 3.
I20260709 12:10:17.980628 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:17.844234 15385 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:17.907385 15679 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:17.990406 13679 raft_consensus.cc:1240] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:10:17.922436 15640 raft_consensus.cc:697] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:17.921947 15677 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.968034 15665 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:18.003254 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 408849us
I20260709 12:10:18.007673 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:10:18.013459 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.022168 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:18.022076 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:17.984300 15472 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:18.031567 13836 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 4.
I20260709 12:10:18.032852 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:18.036216 13681 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 6.
I20260709 12:10:18.048367 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:17.990543 15518 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:18.051578 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:18.053475 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:18.058022 15330 raft_consensus.cc:2804] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:18.058620 15330 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:18.059793 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:18.056790 13835 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 3.
W20260709 12:10:18.073148 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.076979 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:18.086401 13832 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:18.059096 15330 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:18.052340 15538 raft_consensus.cc:2749] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:18.104528 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:10:18.108278 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 109552us
I20260709 12:10:18.109198 13726 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:18.050776 15679 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:18.117903 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:18.058631 15605 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:18.119535 15619 raft_consensus.cc:3055] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:18.120086 15619 raft_consensus.cc:740] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:18.125854 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:18.126827 15658 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:18.067468 15670 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:18.142354 15670 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:18.078349 15385 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:18.078112 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:18.121145 15619 consensus_queue.cc:260] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:18.038668 15677 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:18.067188 15665 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:18.103817 15623 consensus_meta.cc:287] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.649s	user 0.009s	sys 0.003s
W20260709 12:10:18.130455 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 56133.5us
W20260709 12:10:18.158258 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 49176us
I20260709 12:10:18.172744 13759 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 3.
I20260709 12:10:18.151049 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:18.245597 13758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 1815) took 1098 ms. Trace:
I20260709 12:10:18.145744 15670 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:10:18.173975 15705 log.cc:927] Time spent T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
W20260709 12:10:18.147532 15703 log.cc:927] Time spent T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
W20260709 12:10:18.148136 15704 log.cc:927] Time spent T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
W20260709 12:10:18.163393 15504 consensus_meta.cc:287] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.688s	user 0.008s	sys 0.007s
I20260709 12:10:18.152460 15619 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:18.169742 15217 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:18.161576 15618 raft_consensus.cc:2749] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:18.174928 15709 log.cc:927] Time spent T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.421s	user 0.000s	sys 0.002s
I20260709 12:10:18.146586 14415 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 3.
I20260709 12:10:18.165233 15677 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:18.157693 15715 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:18.171888 15665 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:18.246299 13758 rpcz_store.cc:276] 0709 12:10:17.147637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.150520 (+  2883us) service_pool.cc:224] Handling call
0709 12:10:17.158241 (+  7721us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:17.363142 (+204901us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:17.405488 (+ 42346us) log.cc:844] Serialized 14 byte log entry
0709 12:10:18.244056 (+838568us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:18.245109 (+  1053us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:18.245195 (+    86us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.245301 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:18.245509 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29182,"prepare.queue_time_us":38686,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":4155,"raft.queue_time_us":44508,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":78306,"spinlock_wait_cycles":9504512,"thread_start_us":643071,"threads_started":2,"wal-append.queue_time_us":462750}
I20260709 12:10:18.146844 15684 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:18.256099 15399 raft_consensus.cc:2804] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:18.161121 15330 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:18.255645 15540 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:18.299053 13832 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 3.
I20260709 12:10:18.146579 15518 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:18.161989 15714 consensus_queue.cc:1048] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.173s
W20260709 12:10:18.302299 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 118108us
W20260709 12:10:18.306365 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:18.312740 15711 log.cc:927] Time spent T 00000000000000000000000000000000 P 17d79eae88f84be7a847d0cf544674cd: Append to log took a long time: real 0.254s	user 0.000s	sys 0.002s
I20260709 12:10:18.306923 15715 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:18.317219 15715 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:18.264415 15504 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:18.165712 15640 consensus_queue.cc:237] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:18.324224 13727 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
W20260709 12:10:18.327075 15633 consensus_meta.cc:287] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 1.215s	user 0.007s	sys 0.008s
I20260709 12:10:18.327840 15633 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:18.332556 15633 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:18.334559 13755 raft_consensus.cc:1275] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:18.337725 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:10:18.341518 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 424283us
W20260709 12:10:18.343839 13800 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.014s	sys 0.005s
W20260709 12:10:18.344609 13800 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.014s	sys 0.005s
I20260709 12:10:18.317247 15518 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:18.345976 13686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 244) took 1209 ms. Trace:
W20260709 12:10:18.350010 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 276517us
I20260709 12:10:18.348212 13686 rpcz_store.cc:276] 0709 12:10:17.113462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.116110 (+  2648us) service_pool.cc:224] Handling call
0709 12:10:17.116501 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:17.149096 (+ 32595us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:17.149132 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:17.155117 (+  5985us) log.cc:844] Serialized 26 byte log entry
0709 12:10:17.480540 (+325423us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:17.480580 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:17.480672 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:18.322692 (+842020us) raft_consensus.cc:1685] finished
0709 12:10:18.322737 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:18.322926 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10428,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":5747,"thread_start_us":163110,"threads_started":1,"wal-append.queue_time_us":575678}
I20260709 12:10:18.355980 13726 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:18.301607 15684 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:18.318653 15540 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:18.377985 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:18.379905 13755 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "b98d2519bb504dc6905ed2ede4571835"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:10:18.380740 13755 raft_consensus.cc:606] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 LEADER]: Received request to transfer leadership to TS b98d2519bb504dc6905ed2ede4571835
W20260709 12:10:18.348553 13800 connection.cc:256] RPC call timeout handler was delayed by -1.0388277110000672s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1523s for a response
W20260709 12:10:18.366464 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 43906.7us
I20260709 12:10:18.363865 15217 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:18.368645 15643 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:18.369462 15719 consensus_queue.cc:1059] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:18.366175 15644 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:18.401443 13831 raft_consensus.cc:1275] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:18.401352 15644 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:18.402560 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:18.403738 15644 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:18.404428 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 48582.5us
I20260709 12:10:18.406179 13726 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:18.406215 15217 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:18.408474 15217 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:18.371017 15707 log.cc:927] Time spent T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:10:18.371977 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:18.408995 15726 consensus_queue.cc:1059] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:10:18.373364 15723 log.cc:927] Time spent T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:10:18.409993 15726 consensus_queue.cc:1243] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer b98d2519bb504dc6905ed2ede4571835 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:10:18.376569 15504 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:18.410549 15726 raft_consensus.cc:2749] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:18.410998 15508 consensus_queue.cc:1059] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:18.411495 15726 raft_consensus.cc:3055] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:18.412055 15726 raft_consensus.cc:740] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:18.412171 15508 raft_consensus.cc:3055] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:18.412621 15508 raft_consensus.cc:740] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:18.378751 14411 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 4.
I20260709 12:10:18.347602 15385 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:18.414544 15385 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:18.415643 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:18.416819 15385 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:18.417362 15330 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 3 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:18.366114 15518 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:18.421471 15549 consensus_meta.cc:287] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.695s	user 0.005s	sys 0.005s
I20260709 12:10:18.392190 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:18.434789 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:10:18.435114 13829 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 4.
I20260709 12:10:18.434932 15549 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:18.393584 13727 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:18.436427 13684 raft_consensus.cc:1240] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:18.436849 13727 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:18.395744 13828 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.438189 13727 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:18.440078 15399 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:18.427700 13651 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:18.396519 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:18.378911 15540 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:10:18.389238 13800 connection.cc:256] RPC call timeout handler was delayed by -1.0388277110000672s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1523s for a response
I20260709 12:10:18.421972 14379 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:18.422173 15679 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:18.423225 15605 consensus_queue.cc:1059] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:10:18.424193 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.370371 13685 raft_consensus.cc:1275] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:18.431928 15481 consensus_queue.cc:1059] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:18.361995 15633 raft_consensus.cc:2804] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:18.499930 15490 consensus_queue.cc:1048] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:18.413161 15726 consensus_queue.cc:260] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:18.413647 15508 consensus_queue.cc:260] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:18.477116 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 76651.6us
I20260709 12:10:18.443764 15472 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:18.465711 13651 leader_election.cc:304] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:18.442904 15385 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:18.466187 15720 raft_consensus.cc:2804] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:18.445226 15677 raft_consensus.cc:2804] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:18.444790 15399 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:18.464587 15719 consensus_queue.cc:1243] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer 3f37c9cc9dda46b4be21dd675ba78fb7 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:10:18.491429 15531 raft_consensus.cc:2749] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:18.478106 15623 raft_consensus.cc:2804] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:10:18.515537 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 75620.9us
I20260709 12:10:18.473652 15684 leader_election.cc:290] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:18.519160 15720 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:18.497249 15549 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:18.532797 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:18.479436 15715 consensus_queue.cc:1048] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 12:10:18.522429 15505 consensus_queue.cc:1048] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:10:18.537225 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:18.496392 15658 consensus_queue.cc:1048] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:10:18.539700 15670 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.521934 15677 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:18.543973 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:18.533516 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:18.525455 15385 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:18.749807 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:18.651816 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 186164us
W20260709 12:10:18.715181 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 127395us
W20260709 12:10:18.677506 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.780395 14410 raft_consensus.cc:1240] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:18.587632 14416 raft_consensus.cc:1240] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:18.734133 13727 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:18.728560 13828 raft_consensus.cc:1275] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:18.534674 15722 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:18.533551 15730 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:18.738860 15508 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.539945 15720 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.539937 15623 raft_consensus.cc:697] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:18.593026 15490 raft_consensus.cc:2804] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:18.590626 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:18.803448 13800 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:18.771746 15744 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.803589 13833 raft_consensus.cc:2393] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 2: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:18.569056 15684 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.787644 15677 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:18.812815 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 272192us
W20260709 12:10:18.596650 15693 log.cc:927] Time spent T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 1.383s	user 0.004s	sys 0.015s
I20260709 12:10:18.630092 15532 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:18.756003 15748 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:18.814473 15490 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:18.782828 14411 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 1.
I20260709 12:10:18.818740 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:18.819510 15721 raft_consensus.cc:2749] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:18.821514 13800 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:18.822132 15715 raft_consensus.cc:2804] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:18.597914 15726 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.829972 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:10:18.832417 15706 log.cc:927] Time spent T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.803s	user 0.002s	sys 0.000s
I20260709 12:10:18.834789 15738 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.837066 15549 raft_consensus.cc:3055] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:18.828409 15633 raft_consensus.cc:697] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:18.537765 15719 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.734057 15685 raft_consensus.cc:2243] T c89d2a3019c74941a4f8dffc9aa5cf40 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:10:18.767284 15743 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.589888 15724 raft_consensus.cc:2804] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:18.629803 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
W20260709 12:10:18.871532 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 93754.3us
I20260709 12:10:18.931246 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:18.870451 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:18.883581 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:18.791953 15670 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:18.870129 15490 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:18.812693 15730 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:18.959748 15730 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:18.930946 15724 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:18.962286 15724 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.918257 14411 raft_consensus.cc:1240] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:18.917713 15719 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:18.918558 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:18.884690 15744 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:18.920092 15738 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:18.920105 15548 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.922848 13652 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:18.910398 15549 raft_consensus.cc:740] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:18.886207 15715 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:18.809929 15660 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:18.964860 15743 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:18.816272 15722 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:18.942272 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:10:18.952203 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 127323us
I20260709 12:10:18.957309 15606 raft_consensus.cc:2749] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:18.878337 15504 consensus_queue.cc:1048] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 12:10:18.900470 15505 consensus_queue.cc:1048] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 12:10:18.909646 15748 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:18.877789 15532 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:18.875561 15684 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:19.043496 15385 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:18.968003 15368 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:18.966560 15623 consensus_queue.cc:237] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:18.974341 14414 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:19.045014 15722 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:19.169981 13685 raft_consensus.cc:1275] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:18.995685 13763 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:18.978132 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 55393.4us
I20260709 12:10:19.191860 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:19.295321 13683 raft_consensus.cc:2393] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 5: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
W20260709 12:10:19.202557 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:18.966394 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:19.040930 13760 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38932 (request call id 238) took 2135 ms (client timeout 2100 ms). Trace:
I20260709 12:10:19.040952 13757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 245) took 1047 ms. Trace:
W20260709 12:10:19.296226 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:19.206774 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:19.777885 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:10:19.071281 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:19.782680 13762 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 6.
I20260709 12:10:19.186908 14414 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 5.
W20260709 12:10:19.186136 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 452114us
W20260709 12:10:19.358590 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 537168us
I20260709 12:10:19.677371 13763 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 3.
I20260709 12:10:19.788170 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:10:19.749650 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 839892us
W20260709 12:10:19.333220 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:19.347218 13834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 1807) took 1285 ms. Trace:
I20260709 12:10:19.359812 13759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48114 (request call id 1819) took 2189 ms. Trace:
I20260709 12:10:19.285100 14412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41700 (request call id 244) took 1274 ms. Trace:
W20260709 12:10:19.388816 15720 consensus_meta.cc:287] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.522s	user 0.011s	sys 0.000s
I20260709 12:10:19.766736 13757 rpcz_store.cc:276] 0709 12:10:17.993343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.993523 (+   180us) service_pool.cc:224] Handling call
0709 12:10:18.045596 (+ 52073us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.434162 (+388566us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:18.434200 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:18.434252 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:18.434292 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:19.040634 (+606342us) spinlock_profiling.cc:243] Waited 388 ms on lock 0x7b540032e454. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:19.040694 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:19.040883 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":893039488}
I20260709 12:10:19.793275 13759 rpcz_store.cc:276] 0709 12:10:17.170251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.407635 (+237384us) service_pool.cc:224] Handling call
0709 12:10:19.359557 (+1951922us) spinlock_profiling.cc:243] Waited 730 ms on lock 0x7b54002b07d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:19.359730 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1678648064}
I20260709 12:10:19.294044 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:19.490756 15652 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.798501 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:10:19.255609 15399 consensus_meta.cc:287] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.713s	user 0.013s	sys 0.000s
I20260709 12:10:19.794970 13756 raft_consensus.cc:2368] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 4. Current term is 5.
W20260709 12:10:19.748333 13760 rpcz_store.cc:269] 0709 12:10:16.905729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.905966 (+   237us) service_pool.cc:224] Handling call
0709 12:10:19.040642 (+2134676us) spinlock_profiling.cc:243] Waited 523 ms on lock 0x7b54003ca354. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:19.040807 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1203539712}
I20260709 12:10:18.979951 15472 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:19.792668 13834 rpcz_store.cc:276] 0709 12:10:18.013190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.013351 (+   161us) service_pool.cc:224] Handling call
0709 12:10:18.045017 (+ 31666us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.197156 (+152139us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:18.197210 (+    54us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:18.197279 (+    69us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:18.197326 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:19.298210 (+1100884us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b5400362c54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:19.298277 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:19.298464 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":327415040}
I20260709 12:10:19.366704 15684 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:19.248765 15722 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.802660 13684 raft_consensus.cc:1813] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Handling vote request from an unknown peer 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:19.677820 15764 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.042296 15685 raft_consensus.cc:2272] T c89d2a3019c74941a4f8dffc9aa5cf40 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:10:19.794158 14412 rpcz_store.cc:276] 0709 12:10:18.010599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.010747 (+   148us) service_pool.cc:224] Handling call
0709 12:10:18.047615 (+ 36868us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.173206 (+125591us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:18.173247 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:18.173331 (+    84us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:18.173376 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:19.284726 (+1111350us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b54004b41d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:19.284788 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:19.284979 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":288158976}
I20260709 12:10:19.046201 15641 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.006392 15643 raft_consensus.cc:3055] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:19.388123 15756 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:18.978552 15508 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:18.984344 15751 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:18.974402 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:18.976366 15719 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:19.857510 15719 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:19.857529 15385 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.858304 15719 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:19.858364 15385 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:19.854568 15641 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:19.860942 15719 leader_election.cc:290] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:19.861250 15385 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:18.976137 15744 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:18.997561 15446 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.862701 13836 raft_consensus.cc:1240] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 3 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:10:19.860971 15641 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:19.808065 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:19.864800 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:19.865047 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:19.865522 13755 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 2.
I20260709 12:10:19.867568 13837 raft_consensus.cc:1240] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:10:19.867705 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:19.868616 13836 raft_consensus.cc:2393] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 3: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:19.868844 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:18.979562 15633 consensus_queue.cc:237] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:19.871775 15758 log.cc:927] Time spent T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260709 12:10:19.282938 15618 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.872422 15618 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:19.872949 13582 catalog_manager.cc:5697] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:10:19.875080 15618 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:19.831068 15399 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:19.813077 15619 raft_consensus.cc:993] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7: : Instructing follower b98d2519bb504dc6905ed2ede4571835 to start an election
I20260709 12:10:19.814657 15750 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.877112 15619 raft_consensus.cc:1081] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 LEADER]: Signalling peer b98d2519bb504dc6905ed2ede4571835 to start an election
I20260709 12:10:19.877197 15750 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:19.815310 15531 raft_consensus.cc:3055] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:19.878360 15531 raft_consensus.cc:740] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:19.879388 15531 consensus_queue.cc:260] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:19.879878 15763 log.cc:927] Time spent T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
I20260709 12:10:19.879964 15750 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:19.853482 15685 ts_tablet_manager.cc:1916] T c89d2a3019c74941a4f8dffc9aa5cf40 P 96701a74fdee481fb5f54aac841e17dd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:10:19.288802 14415 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 3.
I20260709 12:10:19.838379 15640 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:19.828785 13835 raft_consensus.cc:1240] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:10:19.829077 13833 raft_consensus.cc:1240] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 12:10:19.830425 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.999703 15467 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:19.783255 15759 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.834518 13763 raft_consensus.cc:1275] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:19.835995 13684 raft_consensus.cc:2393] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 2: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:10:19.009550 15748 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:18.991520 15490 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:18.969290 15605 consensus_queue.cc:1048] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.863s
I20260709 12:10:19.836012 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:18.979116 15660 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:19.840693 14379 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:19.914938 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:10:19.916857 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 76319.6us
I20260709 12:10:19.916913 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:19.918155 13686 raft_consensus.cc:2410] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:19.920074 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:19.838737 15722 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:19.849264 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:19.920780 13685 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 2.
I20260709 12:10:19.844120 15764 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:19.844314 15768 consensus_queue.cc:1048] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 12:10:19.843326 15643 raft_consensus.cc:740] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:19.855932 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:19.287796 15677 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:19.641964 15725 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:19.862375 15446 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:19.925256 15769 raft_consensus.cc:2804] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:19.927918 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:19.928220 13757 raft_consensus.cc:1240] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:19.928385 15769 raft_consensus.cc:697] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 3 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:19.928735 13683 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 4.
I20260709 12:10:18.978354 15715 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:19.866040 13831 raft_consensus.cc:2393] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 2: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:18.978755 15549 consensus_queue.cc:260] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:19.292654 15743 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:19.875483 13582 catalog_manager.cc:5697] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 3 to 4, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 4 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:19.820967 15592 raft_consensus.cc:3060] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:19.004982 15738 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:19.207907 15670 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:19.041368 15606 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:19.847412 14380 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:19.005760 15532 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:19.884040 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:19.880918 15531 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:19.832386 15652 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:19.905092 14415 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41692 (request call id 415) took 1377 ms (client timeout 1596 ms). Trace:
I20260709 12:10:19.905568 15759 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:19.806103 15720 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:19.854748 15596 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:19.909417 13834 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 4.
I20260709 12:10:19.881269 15756 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:19.884052 15750 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:19.856436 15508 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:20.060238 15508 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:20.060263 15750 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:20.061710 15756 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:19.132355 15724 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:19.924072 13684 raft_consensus.cc:1275] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:19.925871 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:19.981272 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:19.883479 15751 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:19.910527 15640 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:19.921445 14379 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.56.194:39545 timed out after 2.100s (SENT) [suppressed 8 similar messages]
I20260709 12:10:20.047983 13837 raft_consensus.cc:2410] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:20.028556 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:19.929479 15769 consensus_queue.cc:237] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:19.927054 13833 raft_consensus.cc:1240] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 1. Current term is 2. Ops: []
W20260709 12:10:20.075523 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 228227us
I20260709 12:10:19.929878 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:20.009572 13828 raft_consensus.cc:1240] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:20.077370 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:19.930084 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:20.074318 13679 raft_consensus.cc:1275] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:20.065383 13763 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 2.
I20260709 12:10:20.065160 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:20.079319 14380 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:19.929677 15446 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:20.080253 13687 raft_consensus.cc:2410] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:20.041280 15399 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:19.966446 14409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41692 (request call id 417) took 1286 ms. Trace:
I20260709 12:10:20.077991 13834 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 6.
I20260709 12:10:20.064524 15750 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:20.027812 15490 leader_election.cc:290] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:20.011543 15623 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.044189 15643 consensus_queue.cc:260] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:20.080567 13680 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 2.
I20260709 12:10:20.064536 15724 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 4 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:20.092988 15720 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:20.094065 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:20.099074 15764 leader_election.cc:290] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:20.089761 14409 rpcz_store.cc:276] 0709 12:10:18.546132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.586265 (+ 40133us) service_pool.cc:224] Handling call
0709 12:10:18.772626 (+186361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.791404 (+ 18778us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:19.176711 (+385307us) log.cc:844] Serialized 14 byte log entry
0709 12:10:19.755711 (+579000us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:19.784239 (+ 28528us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:19.789012 (+  4773us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:19.801405 (+ 12393us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:19.832127 (+ 30722us) inbound_call.cc:177] Queueing success response
0709 12:10:20.063127 (+231000us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b180020f5c0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924ea03f3 00007fa924ea27c1 00007fa924ea2779 00007fa924ea2709 00007fa924ea26d1 00007fa924ea19cd 0000000000388634 0000000000388479 00007fa924e8383a
Metrics: {"mutex_wait_us":14922,"prepare.queue_time_us":110581,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":68611,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":122,"spinlock_wait_cycles":42722560,"thread_start_us":699425,"threads_started":2,"wal-append.queue_time_us":563863}
I20260709 12:10:20.173151 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:20.153405 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:20.173928 13834 raft_consensus.cc:2468] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 3.
I20260709 12:10:20.102118 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:20.101956 15715 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:20.106177 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:20.107818 15677 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:20.111274 15652 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:20.067639 15606 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:20.184067 15640 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:20.184904 15643 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:20.186532 15606 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:20.175899 15750 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:20.046444 14415 rpcz_store.cc:269] 0709 12:10:18.528755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.540022 (+ 11267us) service_pool.cc:224] Handling call
0709 12:10:19.902326 (+1362304us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:20.081566 15756 raft_consensus.cc:2749] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:20.188707 15750 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:20.190528 15548 consensus_meta.cc:287] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 1.213s	user 0.004s	sys 0.013s
W20260709 12:10:20.172801 15766 log.cc:927] Time spent T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.270s	user 0.000s	sys 0.001s
I20260709 12:10:20.191226 15750 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:20.086591 15768 raft_consensus.cc:2749] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:20.192814 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:20.193660 15715 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:20.184953 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:20.194619 13837 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 5.
I20260709 12:10:20.194665 13763 raft_consensus.cc:1240] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:20.195866 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:20.196496 13837 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:20.198318 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:20.198868 15722 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:20.199194 13834 raft_consensus.cc:2393] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 3: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:20.200138 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:20.201246 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:20.193759 13830 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 4.
I20260709 12:10:20.202556 15751 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:20.204192 13834 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 4.
I20260709 12:10:20.180454 13831 raft_consensus.cc:2410] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:10:20.182263 15660 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:20.182577 13760 raft_consensus.cc:1240] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:20.183350 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:20.193581 13833 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 2.
I20260709 12:10:20.178200 15759 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:20.067101 15596 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:20.221187 13688 raft_consensus.cc:2468] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 2.
I20260709 12:10:20.225158 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:20.249496 13688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1148) took 1033 ms. Trace:
I20260709 12:10:20.250152 13688 rpcz_store.cc:276] 0709 12:10:19.215964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.248626 (+ 32662us) service_pool.cc:224] Handling call
0709 12:10:20.183190 (+934564us) spinlock_profiling.cc:243] Waited 1.54 ms on lock 0x7b5800002798. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924e68b71 00007fa924e68a22 00007fa92dd818d9 00007fa92cedbee0 00007fa92cfa50ab 00007fa92cfa5131 00007fa92cf530a0 00007fa92cf52984 00007fa9264cd6d4 00007fa9264cd662
0709 12:10:20.249398 (+ 66208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3545344}
I20260709 12:10:20.205286 15508 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:20.216414 15605 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.927963 15725 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:20.513211 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:20.448244 13836 raft_consensus.cc:1275] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:20.514503 13834 raft_consensus.cc:2393] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 2: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:20.308964 13837 raft_consensus.cc:2410] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:20.513584 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:20.517685 13833 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 1.
W20260709 12:10:20.386895 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:20.437528 13653 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.000s	sys 0.006s
W20260709 12:10:20.523161 13653 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.000s	sys 0.007s
W20260709 12:10:20.437245 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 388870us
W20260709 12:10:20.436959 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 515910us
I20260709 12:10:20.495486 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:20.450340 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:20.317111 13761 raft_consensus.cc:2410] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:10:20.529140 13688 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 2.
W20260709 12:10:20.447110 13652 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.000s	sys 0.007s
W20260709 12:10:20.531198 13652 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.000s	sys 0.008s
W20260709 12:10:20.531934 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:20.532634 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:20.533504 13686 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:20.536710 15508 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:20.232117 15750 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.315421 15776 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:20.545766 15744 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:20.530040 15747 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.529928 15678 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
W20260709 12:10:20.405373 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:20.841363 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:20.786505 13582 catalog_manager.cc:5697] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 2 to 3, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 3 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:20.573627 15776 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:20.630067 15765 log.cc:927] Time spent T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.325s	user 0.001s	sys 0.000s
I20260709 12:10:20.842635 13582 catalog_manager.cc:5697] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 1 to 3, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 3 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:20.844094 15504 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:20.795518 13835 raft_consensus.cc:1275] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:20.788892 13586 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53318 (request call id 140) took 9370 ms. Trace:
I20260709 12:10:20.844707 15504 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:20.689931 13727 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.898s	user 0.031s	sys 0.037s
W20260709 12:10:20.846551 13727 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.055s	user 0.031s	sys 0.038s
I20260709 12:10:20.847869 15504 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:20.641765 13761 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48114 (request call id 1814) took 3498 ms (client timeout 1924 ms). Trace:
W20260709 12:10:20.563472 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 551353us
W20260709 12:10:20.848770 13761 rpcz_store.cc:269] 0709 12:10:17.143235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.450210 (+306975us) service_pool.cc:224] Handling call
0709 12:10:20.621374 (+3171164us) spinlock_profiling.cc:243] Waited 2.87 s on lock 0x7b54003331d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:20.641620 (+ 20246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6590690560}
W20260709 12:10:20.849298 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 1.05782e+06us
I20260709 12:10:20.850255 13829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 1776) took 1022 ms. Trace:
I20260709 12:10:20.850515 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:20.850710 13829 rpcz_store.cc:276] 0709 12:10:19.827664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.827814 (+   150us) service_pool.cc:224] Handling call
0709 12:10:19.828229 (+   415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:19.828616 (+   387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:19.828646 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:19.829188 (+   542us) log.cc:844] Serialized 26 byte log entry
0709 12:10:20.246175 (+416987us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:20.246250 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:20.246369 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:20.850019 (+603650us) raft_consensus.cc:1685] finished
0709 12:10:20.850042 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:20.850177 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1119,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":133,"thread_start_us":416492,"threads_started":1,"wal-append.queue_time_us":747314}
I20260709 12:10:20.797679 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:20.852444 15714 consensus_queue.cc:1048] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:10:20.853555 13682 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1146) took 1647 ms (client timeout 2014 ms). Trace:
W20260709 12:10:20.854069 13682 rpcz_store.cc:269] 0709 12:10:19.205914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.210077 (+  4163us) service_pool.cc:224] Handling call
0709 12:10:20.797454 (+1587377us) spinlock_profiling.cc:243] Waited 1.46 ms on lock 0x7b5800002798. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924e68b71 00007fa924e68a22 00007fa92dd818d9 00007fa92cedbee0 00007fa92cfa50ab 00007fa92cfa5131 00007fa92cf530a0 00007fa92cf52984 00007fa9264cd6d4 00007fa9264cd662
0709 12:10:20.853491 (+ 56037us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3359488}
I20260709 12:10:20.686106 13686 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 5.
I20260709 12:10:20.382424 15759 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:20.857206 13828 raft_consensus.cc:1275] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:10:20.782755 13830 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54820 (request call id 1806) took 2770 ms (client timeout 2968 ms). Trace:
W20260709 12:10:20.858858 13830 rpcz_store.cc:269] 0709 12:10:18.012730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.012902 (+   172us) service_pool.cc:224] Handling call
0709 12:10:18.150873 (+137971us) spinlock_profiling.cc:243] Waited 2.4 ms on lock 0x7b5800034898. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924e68b71 00007fa924e68a22 00007fa92dd818d9 00007fa92cedbee0 00007fa92cfa50ab 00007fa92cfa5131 00007fa92cf530a0 00007fa92cf52984 00007fa9264cd6d4 00007fa9264cd662
0709 12:10:20.782423 (+2631550us) spinlock_profiling.cc:243] Waited 2 s on lock 0x7b540020e254. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:20.782618 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4615095936}
W20260709 12:10:20.860785 13726 connection.cc:256] RPC call timeout handler was delayed by -1.1940036440000767s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22060000000000002s for a response
I20260709 12:10:20.861519 15714 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:20.862398 13651 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:20.862174 15714 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:20.558784 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:10:20.523866 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:20.867223 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:20.381943 15641 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:20.877377 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:20.893440 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:20.885051 13582 catalog_manager.cc:5697] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
W20260709 12:10:20.705650 15643 consensus_meta.cc:287] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.517s	user 0.013s	sys 0.000s
I20260709 12:10:20.887732 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:20.845425 13586 rpcz_store.cc:276] 0709 12:10:11.418432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.418784 (+   352us) service_pool.cc:224] Handling call
0709 12:10:20.788796 (+9370012us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:17.007852 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:17.210450 (+202598us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:17.210505 (+    55us) write_op.cc:435] Acquired schema lock
0709 12:10:17.210522 (+    17us) tablet.cc:662] Decoding operations
0709 12:10:17.289071 (+ 78549us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:17.322843 (+ 33772us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:17.331623 (+  8780us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:10:17.451125 (+119502us) tablet.cc:701] Row locks acquired
0709 12:10:17.451180 (+    55us) write_op.cc:260] PREPARE: finished
0709 12:10:17.451381 (+   201us) write_op.cc:270] Start()
0709 12:10:17.451523 (+   142us) write_op.cc:276] Timestamp: P: 1783599017451301 usec, L: 0
0709 12:10:17.451543 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:10:17.452293 (+   750us) log.cc:844] Serialized 1302 byte log entry
0709 12:10:18.534335 (+1082042us) op_driver.cc:464] REPLICATION: finished
0709 12:10:18.831048 (+296713us) write_op.cc:301] APPLY: starting
0709 12:10:18.831175 (+   127us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:18.831399 (+   224us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:18.831570 (+   171us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:18.832357 (+   787us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:18.832713 (+   356us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:10:18.832788 (+    75us) write_op.cc:312] APPLY: finished
0709 12:10:18.833180 (+   392us) log.cc:844] Serialized 35 byte log entry
0709 12:10:18.834020 (+   840us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:18.834158 (+   138us) write_op.cc:454] Released schema lock
0709 12:10:18.834249 (+    91us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:18.834790 (+   541us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:18.834831 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1756224,"reported_tablets":11,"spinlock_wait_cycles":9344,"child_traces":[["op",{"apply.queue_time_us":296313,"apply.run_cpu_time_us":3166,"apply.run_wall_time_us":3709,"num_ops":3,"prepare.queue_time_us":311842,"prepare.run_cpu_time_us":27262,"prepare.run_wall_time_us":882061,"raft.queue_time_us":159296,"raft.run_cpu_time_us":10408,"raft.run_wall_time_us":258258,"replication_time_us":1082596,"thread_start_us":898697,"threads_started":4,"wal-append.queue_time_us":606323,"wal-append.run_cpu_time_us":46882,"wal-append.run_wall_time_us":1778636}]]}
I20260709 12:10:20.907675 13834 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 5.
W20260709 12:10:20.870923 13652 connection.cc:256] RPC call timeout handler was delayed by -1.2195689410000341s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2068s for a response
W20260709 12:10:20.909473 13652 connection.cc:256] RPC call timeout handler was delayed by -1.203677197999923s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16180000000000003s for a response
I20260709 12:10:20.584825 15549 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:20.914104 13685 raft_consensus.cc:1275] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:10:20.921422 13685 pending_rounds.cc:85] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 1
I20260709 12:10:20.921571 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:20.922746 13836 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 4.
I20260709 12:10:20.812783 15762 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.209614 15623 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:20.914433 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:20.926594 13582 catalog_manager.cc:5697] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:20.896871 15786 raft_consensus.cc:2804] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:20.844406 15776 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:10:20.930922 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 66256.3us
I20260709 12:10:20.931327 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:20.939481 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:20.738654 15685 ts_tablet_manager.cc:1929] T c89d2a3019c74941a4f8dffc9aa5cf40 P 96701a74fdee481fb5f54aac841e17dd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:10:20.899791 15504 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.921702 13685 pending_rounds.cc:107] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:10:20.971783 13685 raft_consensus.cc:2889] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:20.944152 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:10:20.918988 13652 connection.cc:256] RPC call timeout handler was delayed by -1.1673689410001771s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2126s for a response
I20260709 12:10:20.962340 13651 leader_election.cc:400] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 4. Current term is 5.
I20260709 12:10:20.973491 13651 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:20.869416 15678 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:20.966436 13833 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 1.
I20260709 12:10:20.968170 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:20.970693 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:20.556730 15605 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:20.940815 15725 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:20.974215 14407 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 1.
I20260709 12:10:20.574107 15750 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:20.897400 15747 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:20.986586 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:20.968398 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:20.936223 15762 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:20.999527 13685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 1729) took 1075 ms. Trace:
I20260709 12:10:21.029477 13685 rpcz_store.cc:276] 0709 12:10:19.924613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.924761 (+   148us) service_pool.cc:224] Handling call
0709 12:10:19.925060 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:20.972402 (+1047342us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:20.999280 (+ 26878us) spinlock_profiling.cc:243] Waited 988 ms on lock 0x7b5400271854. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:20.999463 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2273366272}
I20260709 12:10:20.920578 15641 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:20.869295 15744 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:20.942514 15786 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:20.978228 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:20.978998 13829 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:20.979272 14414 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:20.984827 15767 log.cc:927] Time spent T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.202s	user 0.003s	sys 0.000s
I20260709 12:10:20.897639 15759 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:20.987156 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:20.975616 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:20.994383 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:20.999413 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:21.045540 13834 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:20.999855 13651 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:21.034323 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:20.998529 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:20.981580 15714 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:21.028760 13582 catalog_manager.cc:5697] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:10:20.988839 15605 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:20.983078 15623 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:21.032305 14412 raft_consensus.cc:2410] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:10:20.980530 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:21.034849 13685 raft_consensus.cc:3055] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:21.008167 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:21.039649 14379 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:21.008980 15685 log.cc:1199] T c89d2a3019c74941a4f8dffc9aa5cf40 P 96701a74fdee481fb5f54aac841e17dd: Deleting WAL directory at /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894707649-12515-0/minicluster-data/ts-2-root/wals/c89d2a3019c74941a4f8dffc9aa5cf40
I20260709 12:10:20.994263 15596 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:21.042717 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:21.068059 13837 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 4.
I20260709 12:10:20.977226 15504 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:20.994087 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:21.046845 14410 raft_consensus.cc:2393] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 4: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:10:20.979548 15776 raft_consensus.cc:2804] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:20.975642 13652 connection.cc:256] RPC call timeout handler was delayed by -1.0638689410000097s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22410000000000002s for a response
W20260709 12:10:21.050097 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 50329.8us
I20260709 12:10:21.051666 13801 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:21.053437 14414 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 4.
I20260709 12:10:21.053252 13582 catalog_manager.cc:5697] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:10:21.028803 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:21.078516 13682 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:21.058534 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:21.064046 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:21.079486 13828 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:21.061337 13685 raft_consensus.cc:740] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:21.038719 15786 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:21.060969 15508 raft_consensus.cc:2804] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:21.035562 14409 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 4.
I20260709 12:10:21.083192 13685 consensus_queue.cc:260] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:21.092056 13685 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:21.087083 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:21.094034 13582 catalog_manager.cc:5697] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 4 to 5, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 5 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:21.099915 13837 raft_consensus.cc:1240] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:21.101572 15719 consensus_queue.cc:1059] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:21.106725 15685 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54808 (request call id 75) took 4560 ms. Trace:
I20260709 12:10:21.107236 15685 rpcz_store.cc:276] 0709 12:10:16.546704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.555633 (+  8929us) service_pool.cc:224] Handling call
0709 12:10:16.906409 (+350776us) ts_tablet_manager.cc:1151] Deleting tablet c89d2a3019c74941a4f8dffc9aa5cf40
0709 12:10:16.906528 (+   119us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:10:20.205411 (+3298883us) tablet_metadata.cc:665] Metadata flushed
0709 12:10:20.738487 (+533076us) tablet_metadata.cc:665] Metadata flushed
0709 12:10:21.106633 (+368146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1533949,"tablet-delete.queue_time_us":349179,"thread_start_us":239489,"threads_started":1}
I20260709 12:10:21.110445 13571 catalog_manager.cc:5028] TS 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): tablet c89d2a3019c74941a4f8dffc9aa5cf40 (table test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]) successfully deleted
I20260709 12:10:21.082917 14407 raft_consensus.cc:2368] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 4. Current term is 5.
W20260709 12:10:21.113060 15772 log.cc:927] Time spent T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:10:21.064522 15660 consensus_queue.cc:1059] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:10:21.082041 15776 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:21.084548 15330 raft_consensus.cc:2804] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:21.084978 13754 raft_consensus.cc:1275] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:10:21.121417 13652 leader_election.cc:336] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 1.685s (SENT)
I20260709 12:10:21.091607 15508 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:21.138140 13652 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:21.089725 15605 consensus_queue.cc:1048] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 12:10:21.131862 15776 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:21.101819 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:21.154235 13828 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 5.
I20260709 12:10:21.156643 13755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 1831) took 1354 ms. Trace:
I20260709 12:10:21.163394 13755 rpcz_store.cc:276] 0709 12:10:19.802706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.866611 (+ 63905us) service_pool.cc:224] Handling call
0709 12:10:19.866938 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:19.867322 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:19.867371 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:19.867885 (+   514us) log.cc:844] Serialized 26 byte log entry
0709 12:10:20.179170 (+311285us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:20.179215 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:20.179300 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:21.156434 (+977134us) raft_consensus.cc:1685] finished
0709 12:10:21.156453 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:21.156580 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8421,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":128,"thread_start_us":310811,"threads_started":1,"wal-append.queue_time_us":1270758}
I20260709 12:10:21.135850 15330 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:21.142040 15508 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:21.191670 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 323442us
W20260709 12:10:21.195428 13726 connection.cc:256] RPC call timeout handler was delayed by -1.0345238600000357s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1988s for a response
W20260709 12:10:21.198094 13726 connection.cc:256] RPC call timeout handler was delayed by -1.0327238600000328s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.199s for a response
I20260709 12:10:21.187292 15330 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:21.214854 15775 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:21.221572 15549 raft_consensus.cc:3055] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:21.210085 15665 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:21.239337 13726 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:10:21.258195 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:21.261521 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.280628 13829 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 4.
I20260709 12:10:21.287573 13726 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:21.325111 13726 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:21.228240 15596 raft_consensus.cc:2804] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:21.301157 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:21.341735 13761 raft_consensus.cc:2368] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 3. Current term is 4.
I20260709 12:10:21.225190 15549 raft_consensus.cc:740] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:21.343564 15549 consensus_queue.cc:260] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:21.240365 15641 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:21.340509 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:10:21.344628 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.240979 15605 raft_consensus.cc:2749] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:21.289937 15750 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:21.370919 13757 raft_consensus.cc:1275] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:10:21.381572 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.339690 15762 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:21.345685 15787 raft_consensus.cc:2804] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:21.341355 15596 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:21.247574 15714 consensus_queue.cc:1059] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.126s
I20260709 12:10:21.242684 15665 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:21.408290 15791 log.cc:927] Time spent T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 12:10:21.409381 15665 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:21.339991 15678 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:21.394590 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:21.410904 13757 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 4.
I20260709 12:10:21.397142 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:21.412038 13755 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 4.
I20260709 12:10:21.400004 15787 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:21.413036 15787 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:21.418944 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 327858us
I20260709 12:10:21.406489 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:21.404609 15596 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:21.228665 15775 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:21.386232 15774 log.cc:927] Time spent T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.318s	user 0.000s	sys 0.001s
I20260709 12:10:21.388654 15725 raft_consensus.cc:2804] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:21.384780 15623 raft_consensus.cc:2749] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:21.400971 15759 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:21.428618 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:21.450300 13682 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 4.
I20260709 12:10:21.430176 13680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 255) took 1159 ms. Trace:
W20260709 12:10:21.454649 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.425344 13651 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:10:21.459898 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 366293us
W20260709 12:10:21.460956 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 421385us
I20260709 12:10:21.405491 15504 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:21.462008 13762 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 4.
I20260709 12:10:21.424364 15714 consensus_queue.cc:1243] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer b98d2519bb504dc6905ed2ede4571835 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
W20260709 12:10:21.464967 13800 connection.cc:256] RPC call timeout handler was delayed by -1.3581814379999742s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1587s for a response
W20260709 12:10:21.465736 13800 connection.cc:256] RPC call timeout handler was delayed by -1.2627814380000473s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1693s for a response
W20260709 12:10:21.466358 13800 connection.cc:256] RPC call timeout handler was delayed by -1.2510814380000284s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1706s for a response
W20260709 12:10:21.466862 13800 connection.cc:256] RPC call timeout handler was delayed by -1.2510814380000284s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1706s for a response
W20260709 12:10:21.467252 13800 connection.cc:256] RPC call timeout handler was delayed by -1.0548814379999385s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19240000000000002s for a response
I20260709 12:10:21.425197 15665 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:21.476594 13834 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 5.
W20260709 12:10:21.480331 13652 leader_election.cc:336] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 2.133s (SENT)
I20260709 12:10:21.452872 13680 rpcz_store.cc:276] 0709 12:10:20.271228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.271441 (+   213us) service_pool.cc:224] Handling call
0709 12:10:20.314839 (+ 43398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:20.549516 (+234677us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:20.549595 (+    79us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:20.621435 (+ 71840us) log.cc:844] Serialized 26 byte log entry
0709 12:10:20.976393 (+354958us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:21.046154 (+ 69761us) log.cc:844] Serialized 14 byte log entry
0709 12:10:21.047220 (+  1066us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.047298 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:21.429916 (+382618us) raft_consensus.cc:1685] finished
0709 12:10:21.429938 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:21.430098 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":205862,"prepare.queue_time_us":91366,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":5373,"raft.queue_time_us":209706,"raft.run_cpu_time_us":597,"raft.run_wall_time_us":33068,"thread_start_us":262734,"threads_started":1,"wal-append.queue_time_us":549684}
W20260709 12:10:21.451843 15789 log.cc:927] Time spent T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
W20260709 12:10:21.467671 13800 connection.cc:256] RPC call timeout handler was delayed by -1.0476814379999269s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1932s for a response
W20260709 12:10:21.469131 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 43874.7us
W20260709 12:10:21.485157 13800 connection.cc:256] RPC call timeout handler was delayed by -1.0476814379999269s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1932s for a response
I20260709 12:10:21.450798 15725 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:21.490172 13652 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:21.492129 13761 raft_consensus.cc:1275] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:10:21.497710 13800 connection.cc:256] RPC call timeout handler was delayed by -1.0242814380001164s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1958s for a response
W20260709 12:10:21.508306 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 424234us
I20260709 12:10:21.483063 15714 raft_consensus.cc:3055] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:21.510087 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:21.478775 15605 raft_consensus.cc:2804] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:21.503337 15725 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:21.518819 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:21.527168 13762 raft_consensus.cc:2393] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 6: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:21.530248 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:21.512969 14379 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:21.531100 13757 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 2.
I20260709 12:10:21.517261 15714 raft_consensus.cc:740] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:21.516594 15605 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:21.544710 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:10:21.545655 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 65446.9us
I20260709 12:10:21.547662 15806 raft_consensus.cc:2749] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:21.566310 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:21.542054 15623 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.567030 13761 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 4.
I20260709 12:10:21.567149 15623 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:21.568033 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:21.568606 13761 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 2.
I20260709 12:10:21.548619 15714 consensus_queue.cc:260] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:21.570489 15714 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:21.570541 13684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 257) took 1213 ms. Trace:
I20260709 12:10:21.551606 15787 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:21.552229 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:21.572093 13758 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 3.
I20260709 12:10:21.571026 13684 rpcz_store.cc:276] 0709 12:10:20.357058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.555966 (+198908us) service_pool.cc:224] Handling call
0709 12:10:20.577353 (+ 21387us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:20.577957 (+   604us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:20.578000 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:20.578754 (+   754us) log.cc:844] Serialized 52 byte log entry
0709 12:10:21.007265 (+428511us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:21.464843 (+457578us) log.cc:844] Serialized 14 byte log entry
0709 12:10:21.465143 (+   300us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.465215 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:21.570331 (+105116us) raft_consensus.cc:1685] finished
0709 12:10:21.570351 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:21.570485 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38522,"prepare.queue_time_us":104401,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":14244,"raft.run_cpu_time_us":364,"raft.run_wall_time_us":15422,"spinlock_wait_cycles":16256,"thread_start_us":824899,"threads_started":2,"wal-append.queue_time_us":631226}
I20260709 12:10:21.542244 15808 raft_consensus.cc:3055] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:21.573093 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:21.569516 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:21.573791 13758 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 3.
I20260709 12:10:21.553177 15744 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:21.553256 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:21.576717 13760 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 5.
I20260709 12:10:21.551651 13763 raft_consensus.cc:1240] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:10:21.554733 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:21.555025 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:21.556524 13759 raft_consensus.cc:1240] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:10:21.508827 15665 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:21.579171 13756 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 2.
I20260709 12:10:21.585140 13762 raft_consensus.cc:1240] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:21.559235 13679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 1736) took 1594 ms. Trace:
W20260709 12:10:21.558621 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.509578 15759 consensus_queue.cc:1059] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:10:21.562058 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:21.562204 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:21.573421 15787 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:21.591897 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:21.592767 13755 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:21.575711 13688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 260) took 1217 ms. Trace:
I20260709 12:10:21.584864 13681 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 2.
I20260709 12:10:21.557699 15747 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:10:21.588955 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:21.598994 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.558030 15504 raft_consensus.cc:2804] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:21.569517 15623 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:21.558586 15605 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:21.602350 14380 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:21.609431 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:21.612069 13763 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 4.
I20260709 12:10:21.586516 13679 rpcz_store.cc:276] 0709 12:10:19.965154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.106868 (+141714us) service_pool.cc:224] Handling call
0709 12:10:20.107197 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:20.107588 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:20.107619 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:20.108109 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 12:10:20.222312 (+114203us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:20.256276 (+ 33964us) log.cc:844] Serialized 14 byte log entry
0709 12:10:20.271951 (+ 15675us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:20.272067 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:20.580999 (+308932us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b18003a37e0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924ea0522 00007fa924ea27c1 00007fa924ea2779 00007fa924ea2709 00007fa924ea26d1 00007fa924ea19cd 0000000000388634 0000000000388479 00007fa924e8383a
0709 12:10:21.545922 (+964923us) raft_consensus.cc:1685] finished
0709 12:10:21.559056 (+ 13134us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:21.559180 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56172,"prepare.queue_time_us":33966,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":74,"raft.queue_time_us":172165,"raft.run_cpu_time_us":353,"raft.run_wall_time_us":45811,"spinlock_wait_cycles":32339200,"thread_start_us":113728,"threads_started":1,"wal-append.queue_time_us":914793}
I20260709 12:10:21.601545 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:21.612994 13760 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 2.
I20260709 12:10:21.593384 13688 rpcz_store.cc:276] 0709 12:10:20.357983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.800552 (+442569us) service_pool.cc:224] Handling call
0709 12:10:20.801015 (+   463us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:20.802652 (+  1637us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:20.802697 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:20.869742 (+ 67045us) log.cc:844] Serialized 26 byte log entry
0709 12:10:21.372459 (+502717us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:21.372514 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.372586 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:21.574923 (+202337us) raft_consensus.cc:1685] finished
0709 12:10:21.574949 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:21.575626 (+   677us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":812,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":246,"thread_start_us":411858,"threads_started":1,"wal-append.queue_time_us":578202}
I20260709 12:10:21.608875 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:21.610864 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:21.573115 15808 raft_consensus.cc:740] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
W20260709 12:10:21.614248 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 108213us
I20260709 12:10:21.615813 13800 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:21.539973 15799 consensus_queue.cc:1048] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.069s
I20260709 12:10:21.617291 13834 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 3.
I20260709 12:10:21.613405 15330 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:21.619647 15768 raft_consensus.cc:2804] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:21.621511 15504 raft_consensus.cc:697] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 4 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:21.603003 15813 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.631115 13755 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 5.
W20260709 12:10:21.658476 15800 log.cc:927] Time spent T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 12:10:21.627569 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:21.632004 15768 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:21.661381 15725 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:21.094254 15643 consensus_queue.cc:1175] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ca9fbbc2c0a94897897d502d42f3951f" responder_term: 3 status { last_received { term: 2 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:10:21.688753 15725 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:21.690222 13800 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:10:21.692411 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 56534.9us
W20260709 12:10:21.671339 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 138823us
I20260709 12:10:21.669240 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:10:21.696784 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.688757 15330 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:21.680500 15768 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:21.691397 15805 raft_consensus.cc:2749] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:21.702556 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:10:21.713567 13652 leader_election.cc:336] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 2.192s (SENT)
I20260709 12:10:21.714144 13652 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:21.716754 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:21.717561 13684 raft_consensus.cc:2393] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 4: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:10:21.719009 13688 raft_consensus.cc:1275] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:21.720209 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:21.720897 13682 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 4.
I20260709 12:10:21.720942 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:21.696856 15759 raft_consensus.cc:3055] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:21.717175 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:21.721612 13686 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 2.
I20260709 12:10:21.726111 13687 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 5.
I20260709 12:10:21.647082 15813 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:21.724959 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:21.728381 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:21.728804 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:21.729415 13758 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 3.
I20260709 12:10:21.730911 13760 raft_consensus.cc:2368] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 4. Current term is 5.
I20260709 12:10:21.712654 15775 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:21.734118 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:21.734380 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:21.735127 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:21.717669 15623 consensus_queue.cc:1048] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
W20260709 12:10:21.735771 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 45655.6us
I20260709 12:10:21.745324 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:21.746637 13755 raft_consensus.cc:2410] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:21.746773 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:21.747483 13684 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 2.
I20260709 12:10:21.735827 13679 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89"
dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
 from {username='slave'} at 127.0.0.1:41688
I20260709 12:10:21.748175 13679 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:21.748780 13679 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:21.737950 13681 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1149) took 2520 ms (client timeout 1706 ms). Trace:
W20260709 12:10:21.738667 15776 consensus_meta.cc:287] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.545s	user 0.010s	sys 0.000s
I20260709 12:10:21.735200 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:21.734143 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:21.740973 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:21.716331 15806 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:21.753139 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:21.755254 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:21.743757 13763 raft_consensus.cc:2410] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 12:10:21.750280 13681 rpcz_store.cc:269] 0709 12:10:19.217319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.248910 (+ 31591us) service_pool.cc:224] Handling call
0709 12:10:20.558599 (+1309689us) spinlock_profiling.cc:243] Waited 1.5 ms on lock 0x7b5800002798. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924e68b71 00007fa924e68a22 00007fa92dd818d9 00007fa92cedbee0 00007fa92cfa50ab 00007fa92cfa5131 00007fa92cf530a0 00007fa92cf52984 00007fa9264cd6d4 00007fa9264cd662
0709 12:10:21.737675 (+1179076us) spinlock_profiling.cc:243] Waited 354 ms on lock 0x7b54002c3b54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:21.737831 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":818284160}
I20260709 12:10:21.835332 13652 leader_election.cc:400] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 election: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 4. Current term is 5.
I20260709 12:10:21.835719 13652 leader_election.cc:403] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:10:21.838433 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:21.773512 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:21.739285 13754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 250) took 2836 ms. Trace:
I20260709 12:10:21.725665 15759 raft_consensus.cc:740] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:21.845203 13754 rpcz_store.cc:276] 0709 12:10:18.902444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.930903 (+ 28459us) service_pool.cc:224] Handling call
0709 12:10:20.630412 (+1699509us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:21.136309 (+505897us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.679207 (+542898us) spinlock_profiling.cc:243] Waited 415 ms on lock 0x7b54003331d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:21.738992 (+ 59785us) spinlock_profiling.cc:243] Waited 1.64 s on lock 0x7b54003331d0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:21.739183 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4732321536}
W20260709 12:10:21.807379 13727 connection.cc:256] RPC call timeout handler was delayed by -1.1066185689999202s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1511s for a response
W20260709 12:10:21.847259 13727 connection.cc:256] RPC call timeout handler was delayed by -1.0967185689999042s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1522s for a response
W20260709 12:10:21.847641 13727 connection.cc:256] RPC call timeout handler was delayed by -1.0947023439998702s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.195s for a response
I20260709 12:10:21.848243 13727 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:21.757867 15719 raft_consensus.cc:2749] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:21.844197 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:21.803671 13679 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:21.850416 13727 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:21.799125 15806 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:21.807753 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:10:21.806499 13570 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet a34b21ec197b4241a780a8ae562e4602 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica b98d2519bb504dc6905ed2ede4571835 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
W20260709 12:10:21.851755 13570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 45323.6us
I20260709 12:10:21.810577 15813 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:21.802582 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:10:21.811079 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 188596us
I20260709 12:10:21.811281 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:21.711018 15504 consensus_queue.cc:237] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:21.749343 15812 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:21.854692 15747 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:21.854965 15806 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:21.855273 15747 raft_consensus.cc:697] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:21.855129 15812 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:21.855650 13651 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:21.856261 15747 consensus_queue.cc:237] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:21.730347 15820 raft_consensus.cc:2749] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:21.814025 15665 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:21.740386 15549 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:21.857756 15812 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:21.858001 15744 raft_consensus.cc:2764] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:10:21.858587 15725 consensus_queue.cc:1048] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:21.858841 15744 consensus_queue.cc:1059] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:21.857844 13651 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:21.860059 15744 raft_consensus.cc:3055] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:21.860456 15744 raft_consensus.cc:740] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:21.823570 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:21.826180 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:21.861461 15641 raft_consensus.cc:2804] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:21.861897 15641 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:21.826718 15816 log.cc:927] Time spent T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.177s	user 0.003s	sys 0.000s
I20260709 12:10:21.862200 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:21.862859 13684 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 3.
I20260709 12:10:21.863821 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:21.820595 15808 consensus_queue.cc:260] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:21.829092 13800 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:21.865084 15808 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:21.865260 13726 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:21.864018 15759 consensus_queue.cc:260] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:21.865639 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 58844.2us
I20260709 12:10:21.866318 15759 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:21.866457 13726 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:21.831080 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:21.866847 13800 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:21.867615 15820 raft_consensus.cc:2749] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:21.868371 15820 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:21.869138 15623 raft_consensus.cc:2804] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:21.869580 15623 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:21.869971 15623 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:21.870085 15813 raft_consensus.cc:2804] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:21.868290 13800 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:21.839965 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:10:21.830256 15508 consensus_meta.cc:287] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.627s	user 0.010s	sys 0.002s
I20260709 12:10:21.871263 13681 raft_consensus.cc:2393] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 3: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:21.871387 15508 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:21.872097 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:21.873281 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:21.839781 15643 raft_consensus.cc:2749] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 4. Current term is 5.
I20260709 12:10:21.874446 13680 raft_consensus.cc:2376] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 5. Re-sending same reply.
I20260709 12:10:21.844714 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:21.875466 14408 raft_consensus.cc:2368] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 3. Current term is 4.
I20260709 12:10:21.832638 15605 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:21.844164 15786 consensus_meta.cc:287] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.723s	user 0.009s	sys 0.002s
I20260709 12:10:21.877842 15605 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:21.878202 13685 raft_consensus.cc:2368] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 2. Current term is 3.
I20260709 12:10:21.878078 15786 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:21.878866 13681 raft_consensus.cc:2393] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 4: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:21.879346 13682 raft_consensus.cc:2393] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 7: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:21.862237 15641 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:21.879808 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:21.881103 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:21.882140 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:21.852924 14380 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:21.883016 13684 raft_consensus.cc:2393] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 5: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:21.854185 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:21.883528 15802 raft_consensus.cc:2804] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:21.858646 15750 consensus_queue.cc:1059] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:21.883950 15802 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:21.884531 15802 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:21.885468 15798 raft_consensus.cc:2804] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:21.864144 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:21.885962 15798 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:21.886132 13687 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:21.886346 15798 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:21.888716 14380 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:21.890848 15821 raft_consensus.cc:2804] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:21.870582 15813 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:21.785699 15776 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:21.891322 15821 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:21.891435 15813 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:21.891774 15821 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:21.892999 15776 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:21.885031 13800 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:10:21.894050 13800 raft_consensus.cc:2686] T c89d2a3019c74941a4f8dffc9aa5cf40 P 96701a74fdee481fb5f54aac841e17dd: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:10:21.844247 15596 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:21.827391 13755 raft_consensus.cc:1240] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:21.895125 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:21.890717 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:21.895917 13682 raft_consensus.cc:2393] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 2: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:21.870769 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:21.899120 15750 raft_consensus.cc:3055] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:21.899523 15750 raft_consensus.cc:740] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:21.900157 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:21.900686 13681 raft_consensus.cc:2393] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 4: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:21.900363 15750 consensus_queue.cc:260] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:21.883862 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:21.850803 15794 raft_consensus.cc:2749] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:21.903296 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:21.904393 13685 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 4.
I20260709 12:10:21.905246 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:21.873594 15508 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:21.901577 15750 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:21.906391 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:21.907804 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:21.908471 13801 leader_election.cc:400] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 election: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 3. Current term is 4.
I20260709 12:10:21.908833 13801 leader_election.cc:403] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:10:21.908977 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:21.909951 15809 raft_consensus.cc:2749] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 3. Current term is 4.
I20260709 12:10:21.910501 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:21.910985 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:21.911705 13830 raft_consensus.cc:2368] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for earlier term 2. Current term is 3.
I20260709 12:10:21.911187 13685 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 3.
I20260709 12:10:21.914474 13686 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 1.
I20260709 12:10:21.860738 13651 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:21.901405 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:21.852284 13727 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:21.915627 13685 raft_consensus.cc:1240] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:21.915807 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 55135.6us
I20260709 12:10:21.917227 13651 leader_election.cc:400] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 election: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 4. Current term is 5.
I20260709 12:10:21.918810 13800 leader_election.cc:400] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 election: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 3. Current term is 4.
I20260709 12:10:21.897543 13687 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 5.
I20260709 12:10:21.920042 13651 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:21.921188 13687 pending_rounds.cc:85] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 1
W20260709 12:10:21.921408 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 69179.7us
I20260709 12:10:21.921453 13687 pending_rounds.cc:107] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:10:21.920061 13800 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:21.902426 13684 raft_consensus.cc:2376] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 5. Re-sending same reply.
I20260709 12:10:21.922070 13687 raft_consensus.cc:2889] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:21.923452 13679 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:21.922138 13727 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:21.927774 15725 raft_consensus.cc:2804] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:21.928283 15725 raft_consensus.cc:697] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:21.922701 15508 raft_consensus.cc:2804] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:21.920228 15596 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:21.929833 15508 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:21.930169 15776 raft_consensus.cc:2749] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:21.930392 15508 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:21.931088 13684 raft_consensus.cc:1240] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:21.931282 15786 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:21.935561 13680 raft_consensus.cc:2410] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:21.942835 13800 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:21.943637 13727 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:21.926256 13688 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 2.
I20260709 12:10:21.943617 14380 leader_election.cc:400] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 election: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for earlier term 2. Current term is 3.
I20260709 12:10:21.952229 14380 leader_election.cc:403] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:10:21.958837 13688 pending_rounds.cc:85] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 1
I20260709 12:10:21.959370 13688 pending_rounds.cc:107] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:10:21.959728 13688 raft_consensus.cc:2889] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:21.966153 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:21.970289 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:21.949731 13727 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:21.941550 15794 raft_consensus.cc:2749] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:21.929211 15725 consensus_queue.cc:237] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:21.971985 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:21.953879 15665 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:21.981474 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:21.981849 13726 leader_election.cc:304] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:21.991251 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:21.992300 13726 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:21.993160 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:21.993978 14414 raft_consensus.cc:2393] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 7: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:10:22.002727 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:21.967043 15801 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:22.012867 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:22.007622 13726 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:22.015208 13828 raft_consensus.cc:1275] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:10:21.942075 15768 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:22.025085 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:22.013563 13836 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 2.
I20260709 12:10:22.011490 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:22.018246 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:22.022342 15508 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:22.024009 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:21.941670 15809 consensus_queue.cc:1048] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 12:10:22.024426 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:22.030145 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:21.985881 15775 raft_consensus.cc:2804] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:21.985951 15762 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:22.033468 13756 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:22.036718 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:22.049700 13755 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:22.028823 13757 raft_consensus.cc:2376] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 5. Re-sending same reply.
I20260709 12:10:21.984416 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:22.042098 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:21.998157 15787 raft_consensus.cc:2749] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:22.054369 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
W20260709 12:10:22.059990 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 56370.2us
I20260709 12:10:22.061681 14379 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:22.053870 13760 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 2.
I20260709 12:10:22.063126 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:22.063479 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:22.012807 15801 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:22.024366 15805 raft_consensus.cc:2804] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:22.082069 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:22.028026 15759 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:22.092180 13686 raft_consensus.cc:1240] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:22.010929 15815 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:22.048794 15775 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:22.047642 15799 raft_consensus.cc:2749] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:22.105952 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:22.046669 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:22.067401 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:22.111703 13754 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 5.
I20260709 12:10:22.114104 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:22.115413 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:21.977943 15744 consensus_queue.cc:260] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:22.132509 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:22.093807 15801 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:22.065616 15714 consensus_queue.cc:1048] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.064s
I20260709 12:10:22.091001 15787 consensus_queue.cc:1059] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 12:10:22.142696 13651 leader_election.cc:304] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:22.104655 15775 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:22.094095 15805 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:10:22.146128 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.104292 15759 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:22.151600 13651 leader_election.cc:304] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:22.155416 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:22.170131 15769 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.179556 15623 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:22.195035 15813 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:22.158144 15806 raft_consensus.cc:2804] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:22.192418 15812 raft_consensus.cc:2804] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:22.148859 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 115514us
W20260709 12:10:22.218115 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.159492 15835 raft_consensus.cc:2804] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:22.205235 13651 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:22.223340 13755 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 4.
W20260709 12:10:22.169945 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 227149us
W20260709 12:10:22.226991 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 207362us
W20260709 12:10:22.292241 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 104058us
I20260709 12:10:22.301681 13800 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:22.239773 13829 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 7.
I20260709 12:10:22.159132 15744 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:22.275523 13726 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:10:22.252017 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 190551us
W20260709 12:10:22.292197 15828 log.cc:927] Time spent T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.200s	user 0.003s	sys 0.000s
I20260709 12:10:22.291777 15835 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
W20260709 12:10:22.292431 15826 log.cc:927] Time spent T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.135s	user 0.000s	sys 0.002s
I20260709 12:10:22.345525 15806 raft_consensus.cc:697] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 5 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
W20260709 12:10:22.346678 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 53312.9us
I20260709 12:10:22.472682 13727 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
W20260709 12:10:22.347716 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.475242 13651 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:22.160452 15805 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:22.349267 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:22.350244 14379 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:10:22.350198 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 48617.3us
I20260709 12:10:22.482046 13762 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:22.352602 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 77217us
I20260709 12:10:22.276160 15812 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:22.483984 13726 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:22.425595 15665 raft_consensus.cc:2749] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:22.343626 15643 raft_consensus.cc:2804] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:22.370370 15820 consensus_meta.cc:287] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.501s	user 0.005s	sys 0.005s
I20260709 12:10:22.372071 15719 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:10:22.378350 15829 log.cc:927] Time spent T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
I20260709 12:10:22.381606 13757 raft_consensus.cc:3055] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:22.501907 13757 raft_consensus.cc:740] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:10:22.384784 15843 log.cc:927] Time spent T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
W20260709 12:10:22.391727 15838 log.cc:927] Time spent T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260709 12:10:22.392076 15768 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 5 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:22.392817 15508 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:22.400329 15821 consensus_meta.cc:287] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.508s	user 0.011s	sys 0.000s
I20260709 12:10:22.402930 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:22.505697 13830 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:22.505577 15821 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:22.408993 15623 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:22.508036 15821 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 5 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:22.508729 14412 raft_consensus.cc:1240] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:22.509601 15806 consensus_queue.cc:237] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:22.353335 15822 raft_consensus.cc:2804] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:22.512490 15822 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:22.512979 15822 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:22.493111 15812 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:22.514030 13830 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 5.
I20260709 12:10:22.492923 15605 raft_consensus.cc:2804] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:22.519554 15605 raft_consensus.cc:697] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 4 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
W20260709 12:10:22.413179 15641 consensus_meta.cc:287] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.533s	user 0.007s	sys 0.000s
I20260709 12:10:22.521911 15820 raft_consensus.cc:2749] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:22.417552 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.418013 15840 raft_consensus.cc:2804] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:22.523180 13832 raft_consensus.cc:1275] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:22.523458 15840 raft_consensus.cc:697] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:10:22.421213 15549 consensus_meta.cc:287] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.563s	user 0.004s	sys 0.004s
I20260709 12:10:22.433696 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:22.534813 14380 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:22.487149 15786 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:10:22.435556 15798 consensus_meta.cc:287] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.549s	user 0.010s	sys 0.000s
W20260709 12:10:22.436510 15802 consensus_meta.cc:287] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.552s	user 0.003s	sys 0.006s
I20260709 12:10:22.437759 15759 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:22.471133 13756 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 3.
I20260709 12:10:22.481293 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:22.487993 13800 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:22.362299 15848 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:22.573204 15824 raft_consensus.cc:2804] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:22.573058 15848 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:22.574079 15824 raft_consensus.cc:697] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 5 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:22.575783 15848 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:22.575371 15824 consensus_queue.cc:237] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:22.493510 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 143365us
I20260709 12:10:22.500728 15719 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:22.521811 15641 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:22.431396 15813 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:22.545115 15623 raft_consensus.cc:2804] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:22.536072 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:22.593922 13832 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:22.593842 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:22.524477 15840 consensus_queue.cc:237] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:22.231148 15769 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:22.541205 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 57281us
I20260709 12:10:22.601706 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:22.520874 15605 consensus_queue.cc:237] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:22.541566 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 68989.8us
I20260709 12:10:22.611698 13727 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:22.498859 15330 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:22.495904 15643 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:22.570708 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 83796.3us
I20260709 12:10:22.569718 13760 raft_consensus.cc:2393] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 3: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:22.572268 15820 raft_consensus.cc:2749] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:22.585062 13652 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:10:22.766139 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 181194us
I20260709 12:10:22.592752 15786 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:22.767896 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:22.768457 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.470767 15835 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:22.545169 15725 raft_consensus.cc:2804] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:22.769411 15786 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:22.769505 15725 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:22.770121 15725 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:22.583768 13757 consensus_queue.cc:260] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:22.525261 15846 consensus_queue.cc:1048] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.096s
I20260709 12:10:22.615603 13832 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 5.
I20260709 12:10:22.613082 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:22.617026 13680 raft_consensus.cc:1275] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:22.630510 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:10:22.679742 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 182606us
W20260709 12:10:22.660766 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.651362 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:22.568579 15798 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:22.639828 15330 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:22.597795 15641 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:22.795655 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:22.797528 13686 raft_consensus.cc:2393] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 3: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
W20260709 12:10:22.732961 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 70880.2us
I20260709 12:10:22.653570 15643 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:22.593556 15623 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:22.662523 15839 raft_consensus.cc:2749] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:22.675738 15822 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:22.763257 15808 consensus_queue.cc:1048] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:22.763581 13800 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:22.775015 13652 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:22.778031 14380 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:22.776597 15759 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:22.785501 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:22.581660 15802 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:22.798616 13651 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:22.815644 13683 raft_consensus.cc:1275] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:10:22.781441 15815 consensus_meta.cc:287] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.646s	user 0.007s	sys 0.003s
I20260709 12:10:22.803505 15623 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:22.773476 15719 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:22.777387 13763 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 3.
W20260709 12:10:22.811268 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 47792.5us
I20260709 12:10:22.816890 13727 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:22.796674 15806 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:10:22.819813 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 44915.1us
I20260709 12:10:22.808772 15863 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.823928 14379 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:22.799973 15330 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:22.834105 13800 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:22.819254 15830 raft_consensus.cc:2749] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:22.839237 13800 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:22.813974 15861 raft_consensus.cc:2804] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:22.823056 15641 raft_consensus.cc:2749] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:22.827101 15750 raft_consensus.cc:2804] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:22.825793 15815 raft_consensus.cc:2749] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:22.847076 13800 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
W20260709 12:10:22.896837 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.833138 15855 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:22.904208 13762 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 4.
W20260709 12:10:22.904966 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 57979.1us
I20260709 12:10:22.907680 13800 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:22.843683 15831 raft_consensus.cc:2804] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:22.915611 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 71960.1us
W20260709 12:10:22.855181 15801 consensus_meta.cc:287] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.695s	user 0.004s	sys 0.007s
W20260709 12:10:22.922873 15832 log.cc:927] Time spent T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:10:22.833675 15863 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:22.923084 15850 consensus_queue.cc:1048] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:22.852108 15846 raft_consensus.cc:2749] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:22.907186 15750 raft_consensus.cc:697] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 3 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
W20260709 12:10:22.920693 15870 log.cc:927] Time spent T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 12:10:22.945861 15862 consensus_queue.cc:1059] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:22.948791 15862 raft_consensus.cc:3055] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:22.949178 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:22.950083 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:22.916872 15769 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:22.910655 15830 raft_consensus.cc:2804] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:22.952530 15830 raft_consensus.cc:697] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 2 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:22.828437 15806 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:22.840663 15809 consensus_queue.cc:1048] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.089s
I20260709 12:10:22.918649 15813 raft_consensus.cc:2749] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:10:22.977931 15858 log.cc:927] Time spent T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:10:22.951407 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:22.928458 15861 raft_consensus.cc:697] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 5 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:22.979637 13757 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:22.980216 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 70887.3us
I20260709 12:10:22.981083 13727 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:22.983490 15867 raft_consensus.cc:2749] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:22.984009 15822 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:22.953521 15812 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:22.931296 15801 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:22.988066 15812 leader_election.cc:290] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:22.988271 13831 raft_consensus.cc:1240] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:22.995980 15750 consensus_queue.cc:237] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:23.000480 13681 raft_consensus.cc:1240] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:23.002321 13727 leader_election.cc:304] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:23.004765 13727 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:23.006016 15714 raft_consensus.cc:2749] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:23.006423 15747 raft_consensus.cc:2749] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:23.009076 15762 consensus_meta.cc:287] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.943s	user 0.006s	sys 0.007s
I20260709 12:10:22.922181 15831 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:22.945648 15846 raft_consensus.cc:2804] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:22.980538 15861 consensus_queue.cc:237] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:22.976205 15802 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 5 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:22.949265 15862 raft_consensus.cc:740] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
W20260709 12:10:23.010368 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:23.011798 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 53890.6us
I20260709 12:10:22.913985 15855 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:22.971936 15863 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:23.022125 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:23.025573 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:22.989478 15801 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:23.037299 13727 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:23.046861 13762 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 6.
I20260709 12:10:23.046962 13761 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:23.038190 13686 raft_consensus.cc:1240] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:23.059693 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:23.058883 13760 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "b98d2519bb504dc6905ed2ede4571835"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:10:23.065083 13760 raft_consensus.cc:606] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Received request to transfer leadership to TS b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:23.065603 13760 raft_consensus.cc:614] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:23.067322 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:23.068424 13759 raft_consensus.cc:2393] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 3: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
W20260709 12:10:23.066255 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 158653us
I20260709 12:10:23.059768 13651 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:23.073671 13727 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:23.074669 13800 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:10:23.079499 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 245420us
I20260709 12:10:23.040438 15831 raft_consensus.cc:3060] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:23.041589 15762 raft_consensus.cc:2749] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for earlier term 2. Current term is 3.
I20260709 12:10:23.040232 15846 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:22.964215 15724 consensus_queue.cc:1048] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.097s
I20260709 12:10:23.106105 15799 raft_consensus.cc:2804] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:23.050428 15855 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:23.108933 13727 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:23.109933 13800 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:23.101290 15605 raft_consensus.cc:2804] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:23.136873 13727 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:23.130188 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:23.138362 13685 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 5.
I20260709 12:10:23.130702 13684 raft_consensus.cc:1240] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:23.139683 13726 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:23.135342 13800 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:23.149480 13800 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:23.109344 15801 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:23.152447 15727 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.153534 15605 raft_consensus.cc:697] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 4 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:23.154642 15605 consensus_queue.cc:237] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:22.963734 15830 consensus_queue.cc:237] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:23.162742 15806 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:23.163652 15877 raft_consensus.cc:2749] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:23.166966 15813 raft_consensus.cc:2749] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:23.102236 15798 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:23.140251 15846 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:23.170930 15809 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:23.171303 15877 raft_consensus.cc:2749] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:23.172271 15867 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:23.173139 15867 raft_consensus.cc:2804] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:23.174866 13759 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:10:23.175572 13759 raft_consensus.cc:606] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 LEADER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:23.181092 15725 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:23.109207 15665 raft_consensus.cc:2804] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:23.071981 15769 consensus_queue.cc:1048] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 12:10:23.181715 13800 leader_election.cc:400] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 2. Current term is 3.
I20260709 12:10:23.181972 15799 raft_consensus.cc:697] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:10:23.183192 15775 consensus_meta.cc:287] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 1.011s	user 0.006s	sys 0.004s
I20260709 12:10:23.184758 13759 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "232d133451004a83941860574adec712"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:10:23.173609 15867 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:23.153116 15727 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:23.187937 13761 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 3.
W20260709 12:10:23.189312 15805 consensus_meta.cc:287] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.691s	user 0.011s	sys 0.000s
I20260709 12:10:23.199090 13800 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:23.205096 13759 raft_consensus.cc:606] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:23.215664 13759 raft_consensus.cc:614] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:23.187439 15643 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:23.207495 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 157540us
I20260709 12:10:23.221184 13800 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:23.223416 13800 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:23.228935 13800 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:23.250046 13800 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:23.216639 15867 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:23.195590 15813 consensus_queue.cc:1048] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:10:23.212484 15665 raft_consensus.cc:697] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:10:23.266649 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 130802us
I20260709 12:10:23.225164 15822 raft_consensus.cc:2749] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:23.272766 15865 log.cc:927] Time spent T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.289s	user 0.003s	sys 0.000s
I20260709 12:10:23.273010 15643 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:23.256186 15809 raft_consensus.cc:2804] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:23.255497 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 118685us
I20260709 12:10:23.247249 15798 raft_consensus.cc:2749] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:23.214632 15775 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:23.269220 13652 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:23.275393 14379 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:23.227255 15880 raft_consensus.cc:2804] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:23.278970 13727 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:23.280303 13759 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "956300599d004370953188dd3ae3a256"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "b98d2519bb504dc6905ed2ede4571835"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:10:23.284885 13759 raft_consensus.cc:606] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Received request to transfer leadership to TS b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:23.285149 13759 raft_consensus.cc:614] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:23.220857 15805 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:23.262632 15847 consensus_queue.cc:1059] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:10:23.279492 15809 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:23.298563 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:23.274806 15835 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:23.309443 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:23.257181 15877 consensus_queue.cc:1059] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:10:23.339995 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:23.340638 13834 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Advancing to term 3
W20260709 12:10:23.340765 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 90823.4us
W20260709 12:10:23.318631 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:23.342458 13727 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:23.336874 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:23.343289 13828 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 5.
I20260709 12:10:23.337380 13832 raft_consensus.cc:2393] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 5: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:10:23.309849 13756 raft_consensus.cc:2393] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 5: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:23.306347 15750 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:23.348722 13727 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:23.315502 13837 raft_consensus.cc:1275] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:10:23.346575 15623 consensus_meta.cc:287] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.518s	user 0.009s	sys 0.001s
I20260709 12:10:23.282933 15880 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:23.287235 15822 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:23.311167 15744 consensus_meta.cc:287] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.953s	user 0.009s	sys 0.003s
I20260709 12:10:23.347682 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
W20260709 12:10:23.349582 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:23.355711 13727 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:23.364143 14414 raft_consensus.cc:1240] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:23.320835 15809 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:23.317373 15643 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.315493 15848 raft_consensus.cc:2804] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:23.365542 13727 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:23.356475 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:23.377157 13830 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 7.
I20260709 12:10:23.367431 15775 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:23.367611 15725 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:23.347255 15857 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.306939 15889 raft_consensus.cc:2804] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:23.347379 15665 consensus_queue.cc:237] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:23.353452 15812 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.360849 15623 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:23.360260 15881 raft_consensus.cc:2749] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:23.374828 15859 raft_consensus.cc:2749] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:23.368317 15719 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.362087 15880 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:23.409528 15725 raft_consensus.cc:2749] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:23.421821 15871 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:23.313977 15855 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:23.281271 15799 consensus_queue.cc:237] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:23.429039 13652 leader_election.cc:336] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 1.519s (SENT)
I20260709 12:10:23.431720 13759 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:10:23.381215 15848 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:23.337381 15882 consensus_queue.cc:1048] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.079s
I20260709 12:10:23.384822 15889 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:23.437597 13757 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 3.
I20260709 12:10:23.451697 15805 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:10:23.452085 15885 log.cc:927] Time spent T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:10:23.383709 15643 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:23.683369 13757 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48114 (request call id 1869) took 1657 ms (client timeout 1873 ms). Trace:
W20260709 12:10:23.683918 13757 rpcz_store.cc:269] 0709 12:10:22.026301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.090759 (+ 64458us) service_pool.cc:224] Handling call
0709 12:10:22.381461 (+290702us) spinlock_profiling.cc:243] Waited 61.1 ms on lock 0x7b54003c03a0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f04dc0 00007fa927f90e18 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:22.547129 (+165668us) spinlock_profiling.cc:243] Waited 23.4 ms on lock 0x7b4c000bf300. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa926259a20 00007fa92626aa29 00007fa926230644 00007fa926257f2d 00007fa926257b93 00007fa927f8818b 00007fa927f88cb5 00007fa927f83f30 00007fa927f857de 00007fa927f9127c 00007fa92cf52b17
0709 12:10:22.979465 (+432336us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b58004208d0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927ee90aa 00007fa927f6b447 00007fa927f83fe7 00007fa927f857de 00007fa927f9127c 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c
0709 12:10:23.683294 (+703829us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":666523008}
I20260709 12:10:23.684969 13652 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:23.684526 13759 raft_consensus.cc:606] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:23.686452 13759 raft_consensus.cc:614] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:23.688620 13834 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 3.
I20260709 12:10:23.497119 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:23.689715 13828 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:23.690294 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 324855us
I20260709 12:10:23.691414 13727 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:10:23.692471 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 350679us
W20260709 12:10:23.705926 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 276925us
W20260709 12:10:23.707638 13652 leader_election.cc:336] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 1.618s (SENT)
I20260709 12:10:23.708181 13652 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:23.679751 15623 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:23.715970 13652 leader_election.cc:336] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 1.743s (SENT)
W20260709 12:10:23.681449 15801 consensus_meta.cc:287] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.531s	user 0.009s	sys 0.002s
I20260709 12:10:23.717546 13652 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:10:23.636899 15896 log.cc:927] Time spent T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
W20260709 12:10:23.681630 15330 consensus_meta.cc:287] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.839s	user 0.004s	sys 0.005s
W20260709 12:10:23.731635 13652 leader_election.cc:336] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 1.774s (SENT)
W20260709 12:10:23.704659 15787 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 12:10:23.622527 15750 raft_consensus.cc:2749] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:23.732553 15893 log.cc:927] Time spent T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.276s	user 0.000s	sys 0.013s
I20260709 12:10:23.745828 15330 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:23.747617 15860 log.cc:927] Time spent T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.832s	user 0.003s	sys 0.000s
I20260709 12:10:23.729029 15883 raft_consensus.cc:2749] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:23.748034 15643 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:23.748350 15330 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 6 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:23.736168 15801 raft_consensus.cc:2749] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:23.408165 15857 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:23.688791 15848 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:23.455941 15835 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 5 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:23.705508 15889 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:23.499275 14408 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 3.
I20260709 12:10:23.514482 15727 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:23.714511 15806 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.459029 15719 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:23.760941 15831 consensus_meta.cc:287] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.632s	user 0.011s	sys 0.001s
W20260709 12:10:23.750859 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 59561.9us
I20260709 12:10:23.716987 15894 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.758733 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:10:23.759963 14414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41692 (request call id 432) took 1324 ms. Trace:
I20260709 12:10:23.734107 15805 consensus_queue.cc:1059] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 12:10:23.420799 15812 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:23.734907 15508 raft_consensus.cc:2749] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:23.733948 15744 raft_consensus.cc:2749] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:10:23.752081 13652 leader_election.cc:336] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 1.913s (SENT)
I20260709 12:10:23.796370 13652 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:23.774374 13828 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 5.
I20260709 12:10:23.714787 15859 raft_consensus.cc:2749] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:23.783933 13727 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:23.786684 14414 rpcz_store.cc:276] 0709 12:10:22.435847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.436034 (+   187us) service_pool.cc:224] Handling call
0709 12:10:22.436452 (+   418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:23.364629 (+928177us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:23.759624 (+394995us) spinlock_profiling.cc:243] Waited 927 ms on lock 0x7b54003ebf54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:23.759865 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2133024512}
W20260709 12:10:23.797338 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 45285.7us
I20260709 12:10:23.802392 13652 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:23.815412 15857 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:23.816856 15883 raft_consensus.cc:2749] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:23.825744 15830 raft_consensus.cc:3055] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:23.826534 15830 raft_consensus.cc:740] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:23.827739 15830 consensus_queue.cc:260] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:23.829253 15830 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:23.847039 15855 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 3 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:23.847729 13756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38932 (request call id 265) took 1247 ms. Trace:
I20260709 12:10:23.848162 13756 rpcz_store.cc:276] 0709 12:10:22.600094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.600787 (+   693us) service_pool.cc:224] Handling call
0709 12:10:23.847524 (+1246737us) spinlock_profiling.cc:243] Waited 530 ms on lock 0x7b540032e954. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:23.847667 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1219474816}
I20260709 12:10:23.859786 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:23.860788 13834 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:23.861075 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:23.862030 13830 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:23.776881 15806 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:23.868956 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 60850.6us
I20260709 12:10:23.781726 15831 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:23.878348 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:23.802568 15605 raft_consensus.cc:2749] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:23.910110 13828 raft_consensus.cc:2393] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 5: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:10:23.921418 13834 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 6.
I20260709 12:10:23.791852 15894 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:23.852264 15882 raft_consensus.cc:2749] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:23.928193 13652 leader_election.cc:336] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 2.068s (SENT)
I20260709 12:10:23.928791 13652 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:23.930341 13757 raft_consensus.cc:1240] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:10:23.930171 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:23.931030 13763 raft_consensus.cc:2368] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 2. Current term is 3.
W20260709 12:10:23.932473 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 72412.3us
I20260709 12:10:23.936738 13727 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
W20260709 12:10:23.934950 13652 leader_election.cc:336] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 2.086s (SENT)
I20260709 12:10:23.938810 13652 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:23.934926 13830 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 3.
I20260709 12:10:23.940474 13755 raft_consensus.cc:1240] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:10:23.941895 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:23.942585 13760 raft_consensus.cc:1240] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:23.937736 14379 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:23.796746 15899 consensus_queue.cc:1059] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.138s
W20260709 12:10:23.928802 15815 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.941s	user 0.011s	sys 0.011s
I20260709 12:10:23.951033 13756 raft_consensus.cc:1240] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:23.951081 13828 raft_consensus.cc:1240] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 4. Current term is 5. Ops: [2.5-4.6]
I20260709 12:10:23.944774 13757 raft_consensus.cc:1240] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:23.985555 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:10:23.995869 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 55666.8us
I20260709 12:10:23.997246 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:23.997952 13755 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:23.999191 14408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41692 (request call id 430) took 2077 ms. Trace:
I20260709 12:10:23.999687 14408 rpcz_store.cc:276] 0709 12:10:21.922146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.922941 (+   795us) service_pool.cc:224] Handling call
0709 12:10:23.998978 (+2076037us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54006adbd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:23.999115 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2621819648}
W20260709 12:10:24.000921 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:23.943188 15903 log.cc:927] Time spent T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:10:24.003057 15806 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:10:24.005505 15867 consensus_meta.cc:287] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.741s	user 0.008s	sys 0.004s
I20260709 12:10:24.005990 15867 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:24.006597 15719 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:24.008711 15809 consensus_meta.cc:287] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.624s	user 0.010s	sys 0.001s
I20260709 12:10:24.009248 15809 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:24.011154 15894 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:24.012136 15809 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:23.995296 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:23.931829 15805 consensus_queue.cc:1243] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer b98d2519bb504dc6905ed2ede4571835 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:10:23.932323 15775 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:23.932144 15840 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
W20260709 12:10:24.012275 15880 consensus_meta.cc:287] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.554s	user 0.012s	sys 0.000s
I20260709 12:10:24.050581 15880 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:24.051863 13828 raft_consensus.cc:1240] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:24.053041 15880 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:24.013567 13829 raft_consensus.cc:1240] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:10:24.017853 15867 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:23.932888 15508 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:24.055341 15508 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:23.944456 15744 raft_consensus.cc:2749] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:23.942005 15643 raft_consensus.cc:2749] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:24.027846 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:24.059438 14412 raft_consensus.cc:2393] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 6: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:10:24.049618 15831 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:24.029506 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:24.060534 13837 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:23.993824 15504 raft_consensus.cc:2804] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:24.062095 15504 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:24.062547 15504 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:24.034502 15902 log.cc:927] Time spent T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 12:10:24.040861 15906 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.067456 15906 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:24.070214 13837 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 6.
I20260709 12:10:24.042740 15775 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:24.076195 15775 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:24.044600 15812 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:23.941838 15813 raft_consensus.cc:2749] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:10:24.078665 13652 leader_election.cc:336] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 1.550s (SENT)
I20260709 12:10:24.079036 15906 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:24.079778 15724 raft_consensus.cc:3055] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:24.080365 15724 raft_consensus.cc:740] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:24.083901 15848 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:24.084777 15875 consensus_queue.cc:1059] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:24.085317 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:24.085995 13686 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.086688 15847 raft_consensus.cc:3055] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:24.001391 15889 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:23.989952 15815 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.002s	user 0.012s	sys 0.011s
I20260709 12:10:24.047729 15840 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:24.049679 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:24.104147 13754 raft_consensus.cc:2368] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 2. Current term is 3.
I20260709 12:10:23.925710 15857 consensus_queue.cc:1048] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.070s
I20260709 12:10:24.108167 15840 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:24.058566 15846 consensus_meta.cc:287] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.889s	user 0.012s	sys 0.000s
W20260709 12:10:24.030694 15822 consensus_meta.cc:287] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.652s	user 0.012s	sys 0.000s
I20260709 12:10:24.114051 15822 raft_consensus.cc:2749] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:24.063139 15508 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:24.087132 15847 raft_consensus.cc:740] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:24.115991 15847 consensus_queue.cc:260] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:24.117257 15847 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:24.046648 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:24.097013 13758 raft_consensus.cc:1240] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:10:24.118317 13727 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:24.120700 15815 consensus_queue.cc:1048] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:24.122198 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:24.122852 13832 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 5.
I20260709 12:10:24.123827 15867 raft_consensus.cc:2804] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:24.124409 15867 raft_consensus.cc:697] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:24.126940 15867 consensus_queue.cc:237] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:24.081600 15724 consensus_queue.cc:260] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:24.113881 15846 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:24.138999 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:10:24.130641 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:24.141487 13686 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 5.
I20260709 12:10:24.133106 13837 raft_consensus.cc:1240] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:24.134063 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:24.142835 13834 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 4.
I20260709 12:10:24.143791 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:24.144268 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:24.144949 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:24.146149 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:24.134020 13757 raft_consensus.cc:1275] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:24.135598 13756 raft_consensus.cc:1240] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:24.136220 13652 leader_election.cc:336] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 2.126s (SENT)
I20260709 12:10:24.132875 13727 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:24.147601 13652 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:24.149010 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:24.152009 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:24.012311 13755 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 5.
I20260709 12:10:24.167440 13831 raft_consensus.cc:2368] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 5. Current term is 6.
I20260709 12:10:24.168007 14412 raft_consensus.cc:1275] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:24.168262 15508 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.168563 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:24.168741 15508 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:24.167518 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:24.169883 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:24.179256 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:24.180444 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:24.181504 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:24.182790 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:24.183522 13831 raft_consensus.cc:2393] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 3: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:24.184285 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:24.185271 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:24.187978 14416 raft_consensus.cc:1240] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:24.190896 15846 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:24.170576 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:24.171309 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:24.193193 13687 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:24.193701 13832 raft_consensus.cc:2393] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 6: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:24.176869 15812 raft_consensus.cc:2749] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:24.169510 13652 leader_election.cc:336] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 2.241s (SENT)
I20260709 12:10:24.177428 13760 raft_consensus.cc:1240] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:24.202437 13831 raft_consensus.cc:2410] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:24.193131 13651 leader_election.cc:304] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:24.199071 13836 raft_consensus.cc:1240] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:24.166764 13727 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:24.212069 13835 raft_consensus.cc:1240] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:24.212828 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:24.213668 13834 raft_consensus.cc:2468] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 2.
I20260709 12:10:24.217017 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:24.218111 13833 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 3.
I20260709 12:10:24.219213 13758 raft_consensus.cc:1275] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:10:24.230490 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 60993.8us
W20260709 12:10:24.231958 13652 leader_election.cc:336] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 1.687s (SENT)
W20260709 12:10:24.233266 13652 leader_election.cc:336] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 1.746s (SENT)
I20260709 12:10:24.143671 15805 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.145617 15744 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.261648 13763 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 4.
W20260709 12:10:24.246167 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 97527.8us
I20260709 12:10:24.262437 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:24.268710 13832 raft_consensus.cc:2393] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 3: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:24.263038 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:24.247093 13651 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:10:24.272300 13652 leader_election.cc:336] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 1.830s (SENT)
I20260709 12:10:24.272919 13652 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:24.273696 13837 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 7.
I20260709 12:10:24.274145 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:24.279093 13727 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:24.279471 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:24.280071 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:24.280759 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:24.281577 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:24.282343 13680 raft_consensus.cc:1240] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:24.282833 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:24.283531 13835 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 4.
I20260709 12:10:24.284428 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:24.285179 13835 raft_consensus.cc:2393] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 6: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:24.285261 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:24.286305 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:24.256621 15794 raft_consensus.cc:2804] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:24.245404 15806 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:24.288941 15889 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:24.290150 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:24.290822 13834 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:24.244999 15883 raft_consensus.cc:2804] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:24.258284 15725 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.292323 15724 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:24.292178 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:24.293424 15812 raft_consensus.cc:2804] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:24.276648 15805 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:24.295523 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:24.296788 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:24.293767 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:24.278048 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:24.297654 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:24.203063 15775 raft_consensus.cc:2804] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:24.300530 13754 raft_consensus.cc:1275] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:24.292198 15883 raft_consensus.cc:697] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 3 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:24.302417 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:24.287120 13832 raft_consensus.cc:2393] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 6: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:24.315598 13758 raft_consensus.cc:1240] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:24.314451 13687 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 6.
I20260709 12:10:24.311261 13834 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 3.
I20260709 12:10:24.320583 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:24.319283 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:24.294190 15812 raft_consensus.cc:697] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 3 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:24.293883 15850 consensus_queue.cc:1059] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 12:10:24.299292 15744 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:24.417590 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:24.326843 13684 raft_consensus.cc:1240] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 4 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 12:10:24.470170 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:24.333431 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:10:24.957329 13757 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.087s	sys 0.135s
I20260709 12:10:25.213577 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:10:25.214035 13757 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.914s	user 0.092s	sys 0.148s
I20260709 12:10:24.546651 13682 raft_consensus.cc:1240] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 5 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:25.215981 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:24.330574 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:10:24.443970 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 164954us
I20260709 12:10:24.321604 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:25.218566 13687 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:25.218747 13727 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:24.417590 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:25.220548 13834 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 4.
I20260709 12:10:24.415912 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:24.415400 13683 raft_consensus.cc:1240] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 4. Current term is 5. Ops: [2.5-4.6]
W20260709 12:10:24.481891 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:24.541054 14414 raft_consensus.cc:1240] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:24.321544 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:25.217878 13829 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 2.
I20260709 12:10:25.223981 13829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54830 (request call id 1846) took 1032 ms. Trace:
I20260709 12:10:25.224589 13829 rpcz_store.cc:276] 0709 12:10:24.198164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.305042 (+106878us) service_pool.cc:224] Handling call
0709 12:10:25.223919 (+918877us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:24.327376 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:24.338451 13801 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:24.340698 13836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 1857) took 1040 ms. Trace:
I20260709 12:10:24.540372 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:10:25.233342 13762 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.005s	sys 0.007s
W20260709 12:10:25.261986 13762 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.006s	sys 0.015s
I20260709 12:10:25.266136 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:24.344715 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:25.262698 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:25.264173 13685 raft_consensus.cc:2393] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 4: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:25.261603 13831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54830 (request call id 1836) took 1072 ms. Trace:
I20260709 12:10:25.271493 13833 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 5.
I20260709 12:10:24.447703 15889 raft_consensus.cc:993] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7: : Instructing follower 96701a74fdee481fb5f54aac841e17dd to start an election
I20260709 12:10:24.312776 15857 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:25.262831 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:25.270603 13831 rpcz_store.cc:276] 0709 12:10:24.188732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.314641 (+125909us) service_pool.cc:224] Handling call
0709 12:10:25.261530 (+946889us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:25.279026 13681 raft_consensus.cc:1275] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:25.280004 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:10:25.203122 15724 consensus_meta.cc:287] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.910s	user 0.012s	sys 0.001s
I20260709 12:10:25.280838 13682 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:10:24.573941 15747 raft_consensus.cc:2804] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:25.227958 13679 raft_consensus.cc:2393] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 6: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:25.288833 13681 raft_consensus.cc:1240] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:10:24.640089 15719 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:25.292384 14411 raft_consensus.cc:1240] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:25.293109 15719 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:25.295598 15719 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:25.294718 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:24.313180 15775 raft_consensus.cc:697] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:25.297463 15775 consensus_queue.cc:237] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:24.568917 15504 consensus_meta.cc:287] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.506s	user 0.008s	sys 0.001s
I20260709 12:10:25.299369 15504 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:25.303328 13682 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 3.
I20260709 12:10:24.894593 15840 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.304385 15840 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:24.416278 15643 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:24.895346 15859 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.313047 14408 raft_consensus.cc:1240] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:24.304536 15806 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:24.964118 15805 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:25.309760 13683 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:25.262856 15855 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.708s	user 0.001s	sys 0.015s
I20260709 12:10:25.328696 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:25.313007 13687 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 3.
I20260709 12:10:25.318325 14416 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 3.
I20260709 12:10:25.317373 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:24.575780 15508 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:24.563038 15848 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 4 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:25.314795 15643 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:24.549437 15794 raft_consensus.cc:697] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:25.251298 15900 raft_consensus.cc:2804] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:25.262734 13836 rpcz_store.cc:276] 0709 12:10:23.300146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.300282 (+   136us) service_pool.cc:224] Handling call
0709 12:10:23.300550 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:24.213987 (+913437us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:24.340361 (+126374us) spinlock_profiling.cc:243] Waited 891 ms on lock 0x7b54000b2cd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:24.340606 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2050299648}
I20260709 12:10:24.775596 15750 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:25.335832 13687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1168) took 1017 ms. Trace:
I20260709 12:10:25.337527 13680 raft_consensus.cc:2393] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 3: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:25.318460 15889 raft_consensus.cc:1081] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 LEADER]: Signalling peer 96701a74fdee481fb5f54aac841e17dd to start an election
I20260709 12:10:25.318936 15840 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:24.641090 15908 consensus_queue.cc:1059] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.809s
W20260709 12:10:25.381350 13755 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.950s	user 0.015s	sys 0.040s
I20260709 12:10:24.574239 15883 consensus_queue.cc:237] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:25.320058 15835 consensus_queue.cc:1059] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 12:10:25.419416 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:25.446712 13680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 1792) took 1027 ms. Trace:
I20260709 12:10:24.317606 15725 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:25.447232 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:25.338033 13763 raft_consensus.cc:1275] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:10:25.472038 13755 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.041s	user 0.015s	sys 0.048s
I20260709 12:10:25.338892 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:10:25.410744 13651 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.56.194:39545 timed out after 1.948s (SENT) [suppressed 44 similar messages]
I20260709 12:10:25.377079 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:25.480321 13832 raft_consensus.cc:2393] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 3: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
W20260709 12:10:25.391069 15867 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.261s	user 0.038s	sys 0.077s
I20260709 12:10:25.481765 13836 raft_consensus.cc:2393] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 3: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:25.480532 13834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54830 (request call id 1842) took 1290 ms. Trace:
I20260709 12:10:25.482398 13836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54830 (request call id 1848) took 1198 ms. Trace:
I20260709 12:10:25.484556 13836 rpcz_store.cc:276] 0709 12:10:24.283578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.446952 (+1163374us) service_pool.cc:224] Handling call
0709 12:10:25.482322 (+ 35370us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:25.482635 13834 rpcz_store.cc:276] 0709 12:10:24.190317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.330361 (+1140044us) service_pool.cc:224] Handling call
0709 12:10:25.480469 (+150108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:25.454855 15900 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:25.482939 13832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54830 (request call id 1844) took 1292 ms. Trace:
I20260709 12:10:25.472072 13687 rpcz_store.cc:276] 0709 12:10:24.318614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.319061 (+   447us) service_pool.cc:224] Handling call
0709 12:10:25.335746 (+1016685us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:25.472131 13680 rpcz_store.cc:276] 0709 12:10:24.419396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.262289 (+842893us) service_pool.cc:224] Handling call
0709 12:10:25.446633 (+184344us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:25.486514 13832 rpcz_store.cc:276] 0709 12:10:24.190802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.321401 (+1130599us) service_pool.cc:224] Handling call
0709 12:10:25.482875 (+161474us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:25.376850 15875 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.822s	user 0.017s	sys 0.037s
I20260709 12:10:25.321646 15747 raft_consensus.cc:697] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:10:25.326933 15855 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.809s	user 0.001s	sys 0.015s
I20260709 12:10:25.488020 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:25.498661 13763 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 2.
W20260709 12:10:25.485023 15914 log.cc:927] Time spent T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.294s	user 0.000s	sys 0.001s
W20260709 12:10:25.481453 15867 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.351s	user 0.038s	sys 0.089s
I20260709 12:10:25.427114 15504 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:25.330919 15859 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:25.495327 15875 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.940s	user 0.024s	sys 0.038s
I20260709 12:10:25.504065 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:10:25.504884 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 247027us
I20260709 12:10:25.505609 15924 raft_consensus.cc:2804] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:25.339288 15805 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:25.338538 14408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41700 (request call id 264) took 1195 ms. Trace:
I20260709 12:10:25.506294 13757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 281) took 1210 ms. Trace:
I20260709 12:10:25.527311 13757 rpcz_store.cc:276] 0709 12:10:24.295427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.295546 (+   119us) service_pool.cc:224] Handling call
0709 12:10:24.295853 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:24.296117 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:25.214579 (+918462us) log.cc:844] Serialized 14 byte log entry
0709 12:10:25.505865 (+291286us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:25.505936 (+    71us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:25.505986 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.506073 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:25.506220 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":658833,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":58,"raft.queue_time_us":179,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":716,"spinlock_wait_cycles":60672,"thread_start_us":1204854,"threads_started":2,"wal-append.queue_time_us":291153}
I20260709 12:10:25.480665 15908 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:25.493896 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:25.485077 15882 raft_consensus.cc:3055] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:25.509490 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:25.509997 13834 raft_consensus.cc:2410] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:25.556327 13836 raft_consensus.cc:2410] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:10:25.488041 15907 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:25.511850 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:25.397727 15812 consensus_queue.cc:237] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:25.489699 15900 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:25.471642 15750 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:25.533715 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 268550us
I20260709 12:10:25.562700 14380 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:25.556638 13832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54830 (request call id 1828) took 1370 ms. Trace:
W20260709 12:10:25.534439 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 1.196e+06us
I20260709 12:10:25.563349 13832 rpcz_store.cc:276] 0709 12:10:24.186507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.495699 (+1309192us) service_pool.cc:224] Handling call
0709 12:10:25.556579 (+ 60880us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:25.564833 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:25.564035 13836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54830 (request call id 1827) took 1377 ms. Trace:
I20260709 12:10:25.566912 13836 rpcz_store.cc:276] 0709 12:10:24.186183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.493452 (+1307269us) service_pool.cc:224] Handling call
0709 12:10:25.563954 (+ 70502us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:25.567286 13683 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 6.
I20260709 12:10:25.570490 13683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 1791) took 1151 ms. Trace:
I20260709 12:10:25.548450 15744 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:25.522437 15881 consensus_queue.cc:1059] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 12:10:25.573869 15925 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.479562 15862 consensus_queue.cc:260] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:25.574505 15925 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:25.575723 15927 log.cc:927] Time spent T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:10:25.577841 15928 raft_consensus.cc:3055] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:25.563958 15794 consensus_queue.cc:237] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:25.578260 15928 raft_consensus.cc:740] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:25.579298 15928 consensus_queue.cc:260] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:25.580595 15928 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:25.574318 15750 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:25.555006 15921 log.cc:927] Time spent T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:10:25.532883 15924 raft_consensus.cc:697] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 3 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:25.574980 15862 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:25.592468 14380 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:25.592693 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:25.572058 13683 rpcz_store.cc:276] 0709 12:10:24.419070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.262223 (+843153us) service_pool.cc:224] Handling call
0709 12:10:25.570401 (+308178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:25.598646 15881 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.581831 13830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 1866) took 1630 ms. Trace:
I20260709 12:10:25.636946 13830 rpcz_store.cc:276] 0709 12:10:23.951605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.985634 (+ 34029us) service_pool.cc:224] Handling call
0709 12:10:23.986004 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:24.041479 (+ 55475us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:24.041513 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:24.042070 (+   557us) log.cc:844] Serialized 26 byte log entry
0709 12:10:24.316747 (+274677us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:24.826822 (+510075us) log.cc:844] Serialized 14 byte log entry
0709 12:10:25.487895 (+661073us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.488421 (+   526us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:25.581531 (+ 93110us) raft_consensus.cc:1685] finished
0709 12:10:25.581558 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:25.581730 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":156558,"prepare.queue_time_us":509671,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":69,"raft.queue_time_us":566843,"raft.run_cpu_time_us":287,"raft.run_wall_time_us":2841,"thread_start_us":550135,"threads_started":2,"wal-append.queue_time_us":1086500}
I20260709 12:10:25.555393 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:25.627303 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:25.577163 15925 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:25.631867 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 221221us
I20260709 12:10:25.631709 13836 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 6.
W20260709 12:10:25.575783 15917 log.cc:927] Time spent T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:10:25.635461 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:25.647934 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:25.557063 15882 raft_consensus.cc:740] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:25.650372 13757 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 6.
I20260709 12:10:25.661051 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:25.591351 15744 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:25.546586 15889 consensus_queue.cc:1059] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.088s
W20260709 12:10:25.652153 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.660279 13832 raft_consensus.cc:2468] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 3.
I20260709 12:10:25.662894 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:25.625711 15504 raft_consensus.cc:2804] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:25.540896 15805 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:25.577222 15806 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:25.638870 15855 raft_consensus.cc:2804] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:24.118469 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:25.711503 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:25.690642 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:25.672247 13755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 1881) took 1371 ms. Trace:
W20260709 12:10:25.713284 14416 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41700 (request call id 267) took 1546 ms (client timeout 1684 ms). Trace:
I20260709 12:10:25.715796 13755 rpcz_store.cc:276] 0709 12:10:24.300907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.302002 (+  1095us) service_pool.cc:224] Handling call
0709 12:10:24.318419 (+ 16417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:24.318633 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:25.473542 (+1154909us) log.cc:844] Serialized 14 byte log entry
0709 12:10:25.671881 (+198339us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:25.671935 (+    54us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:25.671988 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.672052 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:25.672178 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9084,"prepare.queue_time_us":804943,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":3309,"thread_start_us":1231014,"threads_started":2}
I20260709 12:10:25.690928 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:25.683260 13687 raft_consensus.cc:1240] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:25.684233 13682 raft_consensus.cc:1275] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:25.700706 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:25.685634 13683 raft_consensus.cc:1275] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:10:25.719404 13683 pending_rounds.cc:85] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 2
I20260709 12:10:25.719827 13683 pending_rounds.cc:107] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:10:25.720155 13683 raft_consensus.cc:2889] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:25.685866 15882 consensus_queue.cc:260] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:25.687170 15918 log.cc:927] Time spent T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:10:25.668042 13835 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 3.
I20260709 12:10:25.666244 15714 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:25.688129 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:25.724007 13680 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 5.
I20260709 12:10:25.688918 13758 raft_consensus.cc:1275] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:25.530690 14408 rpcz_store.cc:276] 0709 12:10:24.143276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.148919 (+  5643us) service_pool.cc:224] Handling call
0709 12:10:24.275306 (+126387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:25.324302 (+1048996us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.338461 (+ 14159us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:25.694927 13837 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54830 (request call id 1822) took 1557 ms (client timeout 1774 ms). Trace:
I20260709 12:10:25.651320 15926 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:25.715883 13831 raft_consensus.cc:2368] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 2. Current term is 3.
W20260709 12:10:25.722193 13835 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54830 (request call id 1834) took 1534 ms (client timeout 1873 ms). Trace:
W20260709 12:10:25.734052 13835 rpcz_store.cc:269] 0709 12:10:24.188125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.303372 (+115247us) service_pool.cc:224] Handling call
0709 12:10:25.722106 (+1418734us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:25.716897 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:10:25.716508 14416 rpcz_store.cc:269] 0709 12:10:24.197759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.216392 (+ 18633us) service_pool.cc:224] Handling call
0709 12:10:25.713081 (+1496689us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b540016b7d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:25.713211 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2399252224}
I20260709 12:10:25.689945 13763 raft_consensus.cc:1275] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:25.726253 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:25.735303 13830 raft_consensus.cc:2376] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 3. Re-sending same reply.
W20260709 12:10:25.727285 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.729334 15824 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.571310 15908 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:25.741374 13652 connection.cc:256] RPC call timeout handler was delayed by -1.1411048069999197s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3026s for a response
I20260709 12:10:25.733469 15504 raft_consensus.cc:697] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 5 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:25.747387 13831 raft_consensus.cc:3055] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:25.747821 13831 raft_consensus.cc:740] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
W20260709 12:10:25.751801 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.710391 15798 raft_consensus.cc:3055] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:10:25.730312 13837 rpcz_store.cc:269] 0709 12:10:24.137208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.145170 (+  7962us) service_pool.cc:224] Handling call
0709 12:10:25.694669 (+1549499us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b54001680d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:25.694802 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":245342976}
I20260709 12:10:25.657964 15750 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:25.736383 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:25.761595 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.736182 13830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54830 (request call id 1841) took 1546 ms. Trace:
I20260709 12:10:25.763330 13830 rpcz_store.cc:276] 0709 12:10:24.190033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.651681 (+1461648us) service_pool.cc:224] Handling call
0709 12:10:25.736081 (+ 84400us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:25.737802 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:25.764744 13680 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:25.705888 15936 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.768828 13837 raft_consensus.cc:3055] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:25.769378 13837 raft_consensus.cc:740] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
W20260709 12:10:25.757419 13652 leader_election.cc:336] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 2.782s (SENT)
I20260709 12:10:25.770064 13652 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:10:25.771068 13652 connection.cc:256] RPC call timeout handler was delayed by -1.0290393230000063s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1533s for a response
I20260709 12:10:25.732111 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:25.771878 13836 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 5.
I20260709 12:10:25.725556 15855 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:25.749552 14411 raft_consensus.cc:2368] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 7. Current term is 8.
I20260709 12:10:25.748634 13831 consensus_queue.cc:260] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:25.806506 13831 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:25.721551 15725 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:25.785444 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.786727 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:25.811892 13832 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 1.
I20260709 12:10:25.786780 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:25.785152 15508 raft_consensus.cc:2749] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:25.652232 15881 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:25.581563 15907 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:25.739354 15714 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:25.629448 15747 consensus_queue.cc:237] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:25.790777 15929 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.792361 15504 consensus_queue.cc:237] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:25.839164 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:25.840505 13682 raft_consensus.cc:3060] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:25.702896 15924 consensus_queue.cc:237] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:25.794585 15855 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:25.795444 15867 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.760169 15798 raft_consensus.cc:740] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:25.766412 15812 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:25.797586 13834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 290) took 1524 ms. Trace:
I20260709 12:10:25.916355 13834 rpcz_store.cc:276] 0709 12:10:24.273121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.750885 (+1477764us) service_pool.cc:224] Handling call
0709 12:10:25.796837 (+ 45952us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:25.797124 (+   287us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:25.797163 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:25.797222 (+    59us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:25.797267 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.797344 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:25.797506 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:25.799474 15875 consensus_queue.cc:1048] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:25.750308 15926 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:25.925628 15926 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:25.926013 15942 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:25.926258 15926 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:25.926613 15942 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:25.928224 15815 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.928855 15942 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:25.928735 15815 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:25.929399 15942 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:25.800688 15908 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:25.930064 15908 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.930518 15908 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:25.932667 15908 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:25.933163 15908 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:25.835011 15857 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.755831 15824 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:25.743413 15665 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:25.812270 13829 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 7.
W20260709 12:10:25.820664 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.774976 13837 consensus_queue.cc:260] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:25.715945 15744 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:25.834743 13832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 292) took 1518 ms. Trace:
W20260709 12:10:25.835284 13762 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.021s	sys 0.021s
I20260709 12:10:25.856846 15883 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:10:25.857033 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 302983us
I20260709 12:10:25.751029 15806 consensus_queue.cc:1048] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.077s
I20260709 12:10:25.818044 15882 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:25.810217 15725 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:25.920040 15719 consensus_queue.cc:1059] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:10:25.811173 15936 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:25.923045 15812 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:25.733419 15813 raft_consensus.cc:3055] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:10:25.936213 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 164979us
I20260709 12:10:25.810883 15750 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:25.940989 13680 raft_consensus.cc:2410] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:25.942027 15942 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:25.945160 13831 raft_consensus.cc:1275] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:25.978682 15934 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:25.836176 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 74442.3us
W20260709 12:10:25.947242 13762 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.022s	sys 0.021s
I20260709 12:10:26.012907 13762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 272) took 2069 ms. Trace:
I20260709 12:10:26.013449 13651 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:26.014892 13651 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:25.947016 13832 rpcz_store.cc:276] 0709 12:10:24.315984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.833656 (+1517672us) service_pool.cc:224] Handling call
0709 12:10:25.834049 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:25.834285 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:25.834323 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:25.834379 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:25.834423 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.834496 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:25.834636 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:25.934151 15857 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:25.926733 15926 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:25.974701 13834 raft_consensus.cc:1240] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:25.977242 13682 raft_consensus.cc:2468] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 3.
I20260709 12:10:25.977896 13837 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:26.030593 13834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 295) took 1693 ms. Trace:
I20260709 12:10:25.974784 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:26.031051 13834 rpcz_store.cc:276] 0709 12:10:24.337566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.935588 (+1598022us) service_pool.cc:224] Handling call
0709 12:10:25.974405 (+ 38817us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:26.030288 (+ 55883us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.030523 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:26.031903 13685 raft_consensus.cc:2410] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:25.948767 13829 raft_consensus.cc:3055] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:26.032397 13829 raft_consensus.cc:740] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:26.033510 13829 consensus_queue.cc:260] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:26.034837 13829 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:25.918116 15859 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:26.038167 15859 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:25.933614 15908 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:25.918690 15867 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:26.040014 15889 consensus_queue.cc:1048] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:26.041476 15867 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:26.041518 15908 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:26.042318 15867 consensus_queue.cc:1048] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:25.861379 15643 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:26.043681 15643 consensus_queue.cc:1048] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:26.045501 15643 raft_consensus.cc:2804] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:26.046020 15643 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:26.046450 15643 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:26.010605 13831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 1845) took 1819 ms. Trace:
I20260709 12:10:26.049962 13831 rpcz_store.cc:276] 0709 12:10:24.191064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.746967 (+1555903us) service_pool.cc:224] Handling call
0709 12:10:25.747268 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:26.010306 (+263038us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.010544 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:26.052153 13831 raft_consensus.cc:1275] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:25.856500 15929 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:26.020176 14379 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:26.013345 13762 rpcz_store.cc:276] 0709 12:10:23.943751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.014895 (+ 71144us) service_pool.cc:224] Handling call
0709 12:10:24.054879 (+ 39984us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:24.055256 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:24.055287 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:24.416387 (+361100us) spinlock_profiling.cc:243] Waited 35.8 ms on lock 0x7b2c00010828. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa926886a11 00007fa926896372 00007fa927fc8a01 00007fa927f8d43a 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2
0709 12:10:24.541455 (+125068us) log.cc:844] Serialized 26 byte log entry
0709 12:10:25.267810 (+726355us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:25.287465 (+ 19655us) log.cc:844] Serialized 14 byte log entry
0709 12:10:25.951502 (+664037us) spinlock_profiling.cc:243] Waited 4.83 ms on lock 0x7b48001a01d8. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92ceb6aa1 00007fa92ceadb37 00007fa92cead9ca 00007fa92cfa526f 00007fa92cfa4f37 00007fa92cfb955c 00007fa92cfb9508 00007fa92cfb9488 00007fa92cfb9443 00007fa92cfb86ec 00007fa92bee2a96
0709 12:10:26.012571 (+ 61069us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.012656 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:26.012705 (+    49us) raft_consensus.cc:1685] finished
0709 12:10:26.012720 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:26.012850 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37009,"prepare.queue_time_us":19071,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":50,"raft.queue_time_us":215974,"raft.run_cpu_time_us":5398,"raft.run_wall_time_us":488062,"spinlock_wait_cycles":93415424,"thread_start_us":1418899,"threads_started":2,"wal-append.queue_time_us":937881}
I20260709 12:10:26.054247 13687 raft_consensus.cc:1240] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:26.090556 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.950438 15665 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:26.002265 15945 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:26.008292 15938 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.005533 15775 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:26.126260 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:26.127195 13800 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:10:26.221199 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 95501.5us
I20260709 12:10:26.005374 15840 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.178761 13686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 297) took 1923 ms. Trace:
I20260709 12:10:26.222579 13686 rpcz_store.cc:276] 0709 12:10:24.255964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.257379 (+  1415us) service_pool.cc:224] Handling call
0709 12:10:24.263504 (+  6125us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:25.367902 (+1104398us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:25.367951 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:25.368011 (+    60us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:25.368058 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.178434 (+810376us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54002850d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:26.178491 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:26.178679 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2539237120}
I20260709 12:10:26.005259 15813 raft_consensus.cc:740] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:25.982450 15900 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:26.239583 13829 raft_consensus.cc:1275] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:26.012460 15953 raft_consensus.cc:3055] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:25.978272 15883 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:26.212908 13831 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8"
dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:54820
I20260709 12:10:26.244872 13831 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:26.245355 13831 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:26.038795 15859 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:26.224946 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 243012us
I20260709 12:10:26.006100 15725 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:26.227934 13833 raft_consensus.cc:1275] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:10:26.250029 13800 leader_election.cc:336] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Timed out: RequestConsensusVote RPC to 127.12.56.194:39545 timed out after 1.523s (SENT)
I20260709 12:10:26.250500 13800 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:26.005457 15798 consensus_queue.cc:260] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:26.216635 15908 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.053553 15835 consensus_queue.cc:1048] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.172s
W20260709 12:10:26.219857 15928 consensus_meta.cc:287] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.639s	user 0.015s	sys 0.000s
I20260709 12:10:26.214850 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:10:26.261814 13828 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54830 (request call id 1853) took 1976 ms (client timeout 1938 ms). Trace:
W20260709 12:10:26.262428 13828 rpcz_store.cc:269] 0709 12:10:24.285018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.261524 (+1976506us) service_pool.cc:211] Skipping call since client already timed out
0709 12:10:26.261697 (+   173us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:10:26.029413 15934 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:26.263671 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 275118us
I20260709 12:10:26.252437 13837 raft_consensus.cc:1275] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:10:26.264585 13837 pending_rounds.cc:85] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 2
I20260709 12:10:26.219660 15945 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:26.265004 13837 pending_rounds.cc:107] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 3.3
W20260709 12:10:26.266609 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 251784us
I20260709 12:10:26.264449 13727 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:26.329162 13651 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:26.248353 15508 raft_consensus.cc:2749] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:26.268077 13831 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:26.241669 15950 raft_consensus.cc:2749] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:26.334270 13837 raft_consensus.cc:2889] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:26.291088 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.254681 15724 raft_consensus.cc:2749] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:10:26.348491 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 98481.7us
I20260709 12:10:26.244796 15948 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:26.396628 13837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 1849) took 2112 ms. Trace:
I20260709 12:10:26.397220 13837 rpcz_store.cc:276] 0709 12:10:24.283849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.760555 (+1476706us) service_pool.cc:224] Handling call
0709 12:10:25.768671 (+  8116us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:26.396275 (+627604us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.396539 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:26.362445 13830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 1854) took 2077 ms. Trace:
W20260709 12:10:26.368898 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.257064 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:26.244202 15953 raft_consensus.cc:740] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:26.327991 15798 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:26.242187 15775 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:26.267048 15815 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:26.245666 15840 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:26.329810 15952 raft_consensus.cc:2749] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:10:26.440311 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 185126us
W20260709 12:10:26.441743 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.227087 15938 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:26.267295 15908 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:26.454347 13760 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48114 (request call id 1882) took 1915 ms (client timeout 1533 ms). Trace:
W20260709 12:10:26.456614 13760 rpcz_store.cc:269] 0709 12:10:24.539469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.261314 (+721845us) service_pool.cc:224] Handling call
0709 12:10:26.454136 (+1192822us) spinlock_profiling.cc:243] Waited 709 ms on lock 0x7b54003336d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:26.454270 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1631472000}
I20260709 12:10:26.448307 13828 raft_consensus.cc:1275] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:26.408594 15824 leader_election.cc:290] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:26.443384 15508 raft_consensus.cc:2804] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:26.465649 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:26.438177 15750 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:10:26.467706 14410 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41692 (request call id 436) took 1827 ms (client timeout 2138 ms). Trace:
I20260709 12:10:26.466466 13836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 291) took 2151 ms. Trace:
I20260709 12:10:26.468721 13836 rpcz_store.cc:276] 0709 12:10:24.315537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.772901 (+1457364us) service_pool.cc:224] Handling call
0709 12:10:25.773375 (+   474us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:25.934175 (+160800us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:25.934217 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:25.934273 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:25.934318 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.466214 (+531896us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b54003babd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:26.466257 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:26.466406 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":368880512}
W20260709 12:10:26.468089 14410 rpcz_store.cc:269] 0709 12:10:24.640443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.640955 (+   512us) service_pool.cc:224] Handling call
0709 12:10:26.465486 (+1824531us) spinlock_profiling.cc:243] Waited 48 ms on lock 0x7b5800003c98. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924e68b71 00007fa924e68a22 00007fa92dd818d9 00007fa92cedbee0 00007fa92cfa50ab 00007fa92cfa5131 00007fa92cf530a0 00007fa92cf52984 00007fa9264cd6d4 00007fa9264cd662
0709 12:10:26.467646 (+  2160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":110420864}
W20260709 12:10:26.471112 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 451015us
I20260709 12:10:26.350106 15813 consensus_queue.cc:260] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:26.474002 13834 raft_consensus.cc:1240] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:26.451022 15881 leader_election.cc:290] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:26.435889 15946 consensus_queue.cc:1059] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
W20260709 12:10:26.471406 15943 log.cc:927] Time spent T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.483s	user 0.001s	sys 0.000s
I20260709 12:10:26.476054 15959 raft_consensus.cc:2749] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:10:26.488801 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 468111us
I20260709 12:10:26.470208 15508 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:26.408783 15948 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:26.504369 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 239999us
I20260709 12:10:26.479420 15812 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:26.505453 13727 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:26.506815 13836 raft_consensus.cc:1275] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:26.510587 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:26.495537 15881 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.515800 13727 leader_election.cc:400] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 election: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 7. Current term is 8.
W20260709 12:10:26.517405 13688 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.013s	sys 0.023s
I20260709 12:10:26.501579 15926 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:10:26.522536 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 192424us
W20260709 12:10:26.522553 13688 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.014s	sys 0.023s
I20260709 12:10:26.512180 14379 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:26.519349 13727 leader_election.cc:403] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260709 12:10:26.520845 13729 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.010s	sys 0.040s
I20260709 12:10:26.503885 15508 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:26.523694 13688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 300) took 2180 ms. Trace:
I20260709 12:10:26.503612 15665 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:26.486524 15824 consensus_queue.cc:1059] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:10:26.525906 13686 raft_consensus.cc:1240] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:26.525741 13682 raft_consensus.cc:1240] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 4 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:10:26.509136 15857 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:10:26.524003 13729 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.010s	sys 0.040s
I20260709 12:10:26.524277 13688 rpcz_store.cc:276] 0709 12:10:24.343493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.260374 (+916881us) service_pool.cc:224] Handling call
0709 12:10:25.260795 (+   421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:25.261101 (+   306us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:25.592591 (+331490us) log.cc:844] Serialized 14 byte log entry
0709 12:10:26.523336 (+930745us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:26.523398 (+    62us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:26.523443 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.523510 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:26.523631 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34801,"prepare.queue_time_us":405577,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":91391,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":102,"thread_start_us":1230128,"threads_started":3,"wal-append.queue_time_us":415998}
I20260709 12:10:26.564260 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:26.548729 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:26.576628 13683 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:26.563098 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:26.526229 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:10:26.565531 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.513880 15813 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:26.517136 15959 raft_consensus.cc:2804] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:26.515389 15936 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:26.582258 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:26.634405 13686 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 5.
W20260709 12:10:26.582231 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:26.513315 15944 log.cc:927] Time spent T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.297s	user 0.001s	sys 0.000s
I20260709 12:10:26.576758 13836 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 4.
I20260709 12:10:26.512061 15928 consensus_queue.cc:1059] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 12:10:26.527820 15929 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:26.506291 15952 consensus_queue.cc:1059] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 12:10:26.603462 15750 consensus_queue.cc:1048] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:26.603679 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:26.525170 15881 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:26.597201 15861 raft_consensus.cc:2804] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:26.611409 15859 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:10:26.612262 15962 log.cc:927] Time spent T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 12:10:26.614301 15938 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:26.479532 15953 consensus_queue.cc:260] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:26.618021 15965 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.618670 15840 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:26.513464 15947 consensus_queue.cc:1059] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 12:10:26.620990 13832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 1871) took 1097 ms. Trace:
I20260709 12:10:26.622049 15948 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:26.627763 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:10:26.628414 15862 consensus_meta.cc:287] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.989s	user 0.009s	sys 0.002s
I20260709 12:10:26.630012 15908 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:26.630110 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:26.631755 15934 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:26.631932 15882 consensus_meta.cc:287] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.644s	user 0.011s	sys 0.000s
I20260709 12:10:26.632340 15945 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:26.672513 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:26.637202 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:26.673763 13686 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 7.
I20260709 12:10:26.563709 15883 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:26.638796 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:26.549713 15665 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:26.521906 15946 consensus_queue.cc:1059] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.112s
I20260709 12:10:26.587857 15959 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:26.675346 13836 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 7.
I20260709 12:10:26.646394 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:26.653301 13829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 1863) took 1070 ms. Trace:
I20260709 12:10:26.678400 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:26.652506 13832 rpcz_store.cc:276] 0709 12:10:25.524091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.029896 (+505805us) service_pool.cc:224] Handling call
0709 12:10:26.030295 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:26.056201 (+ 25906us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:26.124302 (+ 68101us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:26.212340 (+ 88038us) log.cc:844] Serialized 26 byte log entry
0709 12:10:26.436161 (+223821us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:26.436241 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.436761 (+   520us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:26.620759 (+183998us) raft_consensus.cc:1685] finished
0709 12:10:26.620795 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:26.620929 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":23689,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":161860,"thread_start_us":185918,"threads_started":1,"wal-append.queue_time_us":338249}
I20260709 12:10:26.680029 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:10:26.653904 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.654304 15861 raft_consensus.cc:697] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 5 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:26.601382 15806 consensus_queue.cc:1048] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 12:10:26.678135 13829 rpcz_store.cc:276] 0709 12:10:25.582740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.240474 (+657734us) service_pool.cc:224] Handling call
0709 12:10:26.258597 (+ 18123us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:26.258745 (+   148us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:10:26.515215 (+256470us) log.cc:844] Serialized 14 byte log entry
0709 12:10:26.652819 (+137604us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:26.652906 (+    87us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:26.652973 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.653066 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:26.653242 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2736,"prepare.queue_time_us":203512,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":12598,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":8801,"thread_start_us":319386,"threads_started":2}
I20260709 12:10:26.664018 13683 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 4.
I20260709 12:10:26.634967 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:10:26.610960 15951 log.cc:927] Time spent T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260709 12:10:26.685613 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:26.662433 15938 raft_consensus.cc:3055] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:26.672351 15930 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.688380 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:26.688953 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:26.690122 13836 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 3.
I20260709 12:10:26.691267 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:26.691349 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:26.692096 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:26.692634 13836 raft_consensus.cc:2410] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260709 12:10:26.693284 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:26.693058 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:26.694355 13832 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 6.
I20260709 12:10:26.694802 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:26.695590 13685 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 4.
I20260709 12:10:26.695621 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:26.695825 13727 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:26.696523 13832 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 2.
I20260709 12:10:26.700215 13836 raft_consensus.cc:1240] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:26.679171 15959 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:26.701594 15945 consensus_queue.cc:1059] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:26.662175 15965 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:26.704173 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:26.705088 13829 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:26.708228 15862 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.709025 15936 raft_consensus.cc:2804] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:26.708895 15862 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:26.709420 15936 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:26.709707 13727 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:26.710362 15840 consensus_queue.cc:1048] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:26.710764 13727 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:26.711139 15862 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:26.702404 15930 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:26.712486 15840 consensus_queue.cc:1048] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:26.713338 15882 raft_consensus.cc:2804] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:26.713815 15882 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:26.714258 15882 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:26.715905 13829 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 8.
I20260709 12:10:26.716675 15947 raft_consensus.cc:2804] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:26.717097 15947 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:26.717433 15947 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:26.708318 15945 raft_consensus.cc:3055] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:26.718117 15945 raft_consensus.cc:740] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:26.712641 13727 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:26.718961 15945 consensus_queue.cc:260] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:26.719614 15815 raft_consensus.cc:2804] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:26.720063 15815 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:26.720319 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:26.720602 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:26.721662 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:26.721839 13727 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:26.722626 13754 raft_consensus.cc:1275] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:26.722926 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:26.722621 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:10:26.725193 15855 consensus_meta.cc:287] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.804s	user 0.006s	sys 0.006s
I20260709 12:10:26.725332 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:26.720455 15815 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:26.709806 15936 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:26.725649 15855 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:26.727015 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:26.727924 13763 raft_consensus.cc:2410] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:10:26.728017 15855 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 5 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:26.729259 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:26.730031 15977 raft_consensus.cc:2804] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:26.730798 15977 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:26.731207 15977 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:26.733462 15643 consensus_meta.cc:287] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.686s	user 0.013s	sys 0.000s
I20260709 12:10:26.733898 15643 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:26.736078 15643 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:26.736892 13684 raft_consensus.cc:2393] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 3: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:26.730005 13763 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 2.
I20260709 12:10:26.738320 15744 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:26.738472 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:26.739151 13761 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:26.739315 13727 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:26.741940 15926 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.742532 13758 raft_consensus.cc:1275] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:10:26.742440 15926 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:26.744494 15926 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:26.744892 15815 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:26.745764 13681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 1790) took 2376 ms. Trace:
I20260709 12:10:26.729669 15881 leader_election.cc:290] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:26.742869 13758 pending_rounds.cc:85] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting all ops after (but not including) 5
I20260709 12:10:26.746593 13761 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 4.
I20260709 12:10:26.747004 13758 pending_rounds.cc:107] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:10:26.747339 13758 raft_consensus.cc:2889] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:26.748633 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:26.753516 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:26.754447 14410 raft_consensus.cc:2393] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 3: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:10:26.754594 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:26.755168 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:26.755393 14411 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 3.
I20260709 12:10:26.756326 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:26.756516 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:26.758066 14414 raft_consensus.cc:1240] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:10:26.759166 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:26.760272 15900 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:26.760069 15861 consensus_queue.cc:237] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:26.760628 14410 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 3.
I20260709 12:10:26.761824 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:26.762776 15744 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:26.763459 15882 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:26.763409 15744 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:26.765944 15744 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:26.746702 15881 raft_consensus.cc:2804] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:26.766686 15881 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:26.766384 15977 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:26.767153 15881 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:26.398576 13830 rpcz_store.cc:276] 0709 12:10:24.285386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.764344 (+1478958us) service_pool.cc:224] Handling call
0709 12:10:25.825200 (+ 60856us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:25.825508 (+   308us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:26.053655 (+228147us) log.cc:844] Serialized 14 byte log entry
0709 12:10:26.361944 (+308289us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:26.362025 (+    81us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:26.362094 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.362187 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:26.362361 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":36299,"thread_start_us":523016,"threads_started":2}
I20260709 12:10:26.768810 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:26.768914 15977 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:26.769428 13830 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 5.
W20260709 12:10:26.771312 13652 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.925s	user 0.021s	sys 0.018s
W20260709 12:10:26.830304 13652 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.984s	user 0.021s	sys 0.018s
W20260709 12:10:26.830708 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 1.04062e+06us
I20260709 12:10:26.832269 13687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 302) took 1127 ms. Trace:
I20260709 12:10:26.772172 15815 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:26.772981 15882 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:26.774286 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:26.843552 13829 raft_consensus.cc:1275] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:26.845481 15963 consensus_queue.cc:1059] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:26.845856 15504 consensus_queue.cc:1048] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:26.847059 15963 consensus_queue.cc:1048] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:26.847344 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:26.775033 15959 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:26.848869 15963 raft_consensus.cc:3055] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:26.848605 15504 consensus_queue.cc:1059] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:26.849247 15963 raft_consensus.cc:740] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:26.777050 13727 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:26.779035 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:26.781121 15775 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:26.784202 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:26.850239 13832 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:26.850412 13836 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:26.784984 15850 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.857333 15850 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:26.857986 15775 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:26.858932 13831 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:26.859510 13831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:54820 (request call id 1877) took 1333 ms. Trace:
I20260709 12:10:26.859156 15963 consensus_queue.cc:260] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:26.787349 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:26.787484 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:26.860677 15963 raft_consensus.cc:3060] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:26.861305 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:26.859834 13831 rpcz_store.cc:276] 0709 12:10:25.526251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.212790 (+686539us) service_pool.cc:224] Handling call
0709 12:10:26.858413 (+645623us) spinlock_profiling.cc:243] Waited 54 ms on lock 0x7b4c00257ec0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa926259a20 00007fa92626aa29 00007fa92626b13f 00007fa92622f2ab 00007fa92625cf3c 00007fa92625d3fe 00007fa9264ea88b 00007fa927ee9495 00007fa927f3a30f 00007fa927f84a55 00007fa92cf54cd0
0709 12:10:26.859374 (+   961us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":124292864}
I20260709 12:10:26.862674 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:26.862808 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:26.863381 13763 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 3.
I20260709 12:10:26.863478 13679 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 3.
I20260709 12:10:26.863798 13834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 1873) took 1339 ms. Trace:
I20260709 12:10:26.788926 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:26.864470 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:26.865687 15714 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:26.790364 15725 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:26.790669 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:26.868351 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:26.792382 13756 raft_consensus.cc:1240] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:10:26.689646 15938 raft_consensus.cc:740] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:26.794401 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:26.782917 15881 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:26.869741 15938 consensus_queue.cc:260] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:26.871883 15929 raft_consensus.cc:3055] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:26.872081 15881 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:26.872463 15938 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:26.869957 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:26.705953 15965 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:26.865556 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:26.746203 13681 rpcz_store.cc:276] 0709 12:10:24.369697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.291625 (+921928us) service_pool.cc:224] Handling call
0709 12:10:25.292061 (+   436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:25.483170 (+191109us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:25.483219 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:25.483300 (+    81us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:25.483356 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.745515 (+1262159us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b54002c2c54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:26.745563 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:26.745701 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":438994176}
I20260709 12:10:26.799362 15977 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.800407 15812 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:26.757694 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:26.864223 13834 rpcz_store.cc:276] 0709 12:10:25.524770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.032084 (+507314us) service_pool.cc:224] Handling call
0709 12:10:26.213969 (+181885us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:26.475090 (+261121us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.863554 (+388464us) spinlock_profiling.cc:243] Waited 260 ms on lock 0x7b540020ce54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:26.863735 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":597344640}
I20260709 12:10:26.802363 15848 raft_consensus.cc:3055] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:26.804513 13683 raft_consensus.cc:1275] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:10:26.805990 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:26.876157 13755 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 3.
I20260709 12:10:26.876423 14380 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:26.876441 13683 pending_rounds.cc:85] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 2
I20260709 12:10:26.878950 13683 pending_rounds.cc:107] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:10:26.879233 13683 raft_consensus.cc:2889] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:26.879500 13688 raft_consensus.cc:1275] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:10:26.879854 13688 pending_rounds.cc:85] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 3
I20260709 12:10:26.807271 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:26.865594 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:26.811182 15900 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:26.812785 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:26.813283 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:26.813962 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:26.815707 13828 raft_consensus.cc:1275] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:26.823117 15930 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:26.828439 15805 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:26.828851 15941 raft_consensus.cc:3055] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:26.833226 13652 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:26.832842 13687 rpcz_store.cc:276] 0709 12:10:25.705114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.718531 (+ 13417us) service_pool.cc:224] Handling call
0709 12:10:25.744534 (+ 26003us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:26.180192 (+435658us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.831932 (+651740us) spinlock_profiling.cc:243] Waited 309 ms on lock 0x7b54002c3154. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:26.832182 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":711650048}
W20260709 12:10:26.834254 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.829743 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:26.836747 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:26.907316 13762 raft_consensus.cc:2410] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:26.848634 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:10:26.854596 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 77621.5us
I20260709 12:10:26.854875 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:26.909005 13686 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 3.
I20260709 12:10:26.909237 13727 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:26.860944 15959 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:26.786644 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:26.914620 13760 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 2.
I20260709 12:10:26.871114 13685 raft_consensus.cc:1275] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:26.880064 13688 pending_rounds.cc:107] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:10:26.881755 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:26.916148 13835 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:26.880292 15848 raft_consensus.cc:740] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:26.880759 15929 raft_consensus.cc:740] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
W20260709 12:10:26.918759 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 107037us
I20260709 12:10:26.864411 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:26.919864 13763 raft_consensus.cc:2468] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 2.
W20260709 12:10:26.920887 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.885231 13836 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 5.
I20260709 12:10:26.881825 13832 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 4.
W20260709 12:10:26.900039 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 387926us
I20260709 12:10:26.926832 13836 raft_consensus.cc:1240] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:26.906177 13651 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:26.837271 15945 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:26.928759 13832 raft_consensus.cc:1275] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:26.907099 15768 raft_consensus.cc:2804] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:26.903183 15941 raft_consensus.cc:740] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:26.910951 13727 leader_election.cc:304] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:26.856315 15967 raft_consensus.cc:3055] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:26.937342 13651 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:26.880698 13679 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 2.
I20260709 12:10:26.918097 13688 raft_consensus.cc:2889] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:26.928051 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:26.942627 13756 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 3.
I20260709 12:10:26.933144 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:26.862946 15508 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:26.911929 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 78770.5us
I20260709 12:10:26.947041 13652 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:26.945070 13835 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 7.
I20260709 12:10:26.917181 15744 raft_consensus.cc:2749] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:26.950590 13652 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:26.919095 15881 raft_consensus.cc:2804] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:26.959167 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:26.901593 15812 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:26.960965 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.901381 15977 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:26.963577 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:26.964453 14416 raft_consensus.cc:2393] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 4: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:10:26.903808 15900 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:26.929324 15805 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.966261 15768 raft_consensus.cc:697] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 8 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:26.978259 15850 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:26.969141 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:26.940434 15967 raft_consensus.cc:740] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:26.978895 15848 consensus_queue.cc:260] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:26.940907 15882 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:26.975083 15941 consensus_queue.cc:260] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:26.968302 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:26.976950 15787 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.919373 15965 consensus_queue.cc:1059] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:10:26.978695 15768 consensus_queue.cc:237] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:26.946405 15934 raft_consensus.cc:2804] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:26.977509 15867 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:27.071787 14412 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 3.
W20260709 12:10:27.049896 13800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:27.111327 13800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.112880 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:27.113469 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:26.962073 15881 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:27.020351 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.980403 14379 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:26.957705 15643 raft_consensus.cc:2749] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:27.081696 13833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 1866) took 1409 ms. Trace:
I20260709 12:10:26.957109 15961 raft_consensus.cc:2804] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:27.117440 15926 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.961498 15750 raft_consensus.cc:2749] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:27.072460 15984 log.cc:927] Time spent T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:10:26.964148 15719 raft_consensus.cc:2804] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:27.123253 15961 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:27.110466 15953 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:27.094300 15960 raft_consensus.cc:3055] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:10:27.120242 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 139950us
I20260709 12:10:27.124106 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:27.080991 15665 raft_consensus.cc:2749] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 7. Current term is 8.
I20260709 12:10:27.081830 15907 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:27.110111 15934 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:27.123276 15861 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:27.137249 15508 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:27.137544 15942 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:27.121606 15881 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:26.959913 15806 consensus_queue.cc:1059] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.162s
I20260709 12:10:27.041193 15936 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:27.118620 15867 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:27.122965 15926 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:27.143795 15812 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:27.151398 15867 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:27.147567 15861 raft_consensus.cc:697] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 6 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:27.154906 15861 consensus_queue.cc:237] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:27.146121 15977 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:27.132810 15961 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:27.160895 15775 raft_consensus.cc:2749] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:27.207576 13682 raft_consensus.cc:2393] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 7: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
W20260709 12:10:27.011795 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.163040 15747 raft_consensus.cc:3055] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:27.235139 15747 raft_consensus.cc:740] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:26.957556 13652 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:10:27.240397 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 282793us
I20260709 12:10:27.240165 15775 consensus_queue.cc:1048] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:10:27.210537 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:10:27.213127 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 247541us
I20260709 12:10:27.215168 13757 raft_consensus.cc:2368] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 2. Current term is 3.
I20260709 12:10:26.970078 13727 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:27.100687 13754 raft_consensus.cc:1240] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:27.051543 13758 raft_consensus.cc:2468] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 3.
I20260709 12:10:27.081704 13763 raft_consensus.cc:1240] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 12:10:27.222887 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 105925us
I20260709 12:10:27.107834 15787 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:27.230594 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:10:27.231882 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 89362us
I20260709 12:10:27.255894 13651 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:27.127278 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:27.258941 13834 raft_consensus.cc:2393] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 4: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:27.259143 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:27.136250 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:27.260885 13837 raft_consensus.cc:2393] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 4: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:27.261808 15787 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:27.122275 13833 rpcz_store.cc:276] 0709 12:10:25.672500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.250294 (+577794us) service_pool.cc:224] Handling call
0709 12:10:26.250612 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:26.264593 (+ 13981us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:26.264614 (+    21us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:26.265019 (+   405us) log.cc:844] Serialized 26 byte log entry
0709 12:10:26.926108 (+661089us) spinlock_profiling.cc:243] Waited 3.35 ms on lock 0x7b1800466c00. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e82e07 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9fc02 00007fa927b2720b 00007fa927b2cd23 00007fa927b2d0d1 00007fa927f48a0f
0709 12:10:26.953439 (+ 27331us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:26.954305 (+   866us) log.cc:844] Serialized 14 byte log entry
0709 12:10:26.964786 (+ 10481us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.964875 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:26.964918 (+    43us) raft_consensus.cc:1685] finished
0709 12:10:26.970563 (+  5645us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:27.081634 (+111071us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27645,"prepare.queue_time_us":341,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":48,"raft.queue_time_us":87695,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":19401,"spinlock_wait_cycles":34967680,"thread_start_us":27127,"threads_started":1,"wal-append.queue_time_us":621519}
I20260709 12:10:27.133567 15719 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:27.265501 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:27.267462 15719 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:27.229130 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.268424 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:10:27.269529 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.275661 13828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 1868) took 1602 ms. Trace:
I20260709 12:10:27.276253 13828 rpcz_store.cc:276] 0709 12:10:25.673257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.459838 (+786581us) service_pool.cc:224] Handling call
0709 12:10:26.460201 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:26.882174 (+421973us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:27.275051 (+392877us) spinlock_profiling.cc:243] Waited 355 ms on lock 0x7b54000b40d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:27.275412 (+   361us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":816775424}
I20260709 12:10:27.237502 15747 consensus_queue.cc:260] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:27.284124 15747 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:27.001585 15805 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:27.286513 15508 raft_consensus.cc:3055] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:27.287130 15508 raft_consensus.cc:740] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:27.132572 15848 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:27.289733 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:27.281491 15643 raft_consensus.cc:2749] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:27.291528 15812 raft_consensus.cc:2804] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:27.302646 15812 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:27.303118 15812 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:27.294445 13684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 1798) took 1614 ms. Trace:
I20260709 12:10:27.290606 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:27.109753 15882 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:27.305375 13684 rpcz_store.cc:276] 0709 12:10:25.680877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.683480 (+  2603us) service_pool.cc:224] Handling call
0709 12:10:26.126045 (+442565us) spinlock_profiling.cc:243] Waited 1.05 ms on lock 0x7b5800002798. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924e68b71 00007fa924e68a22 00007fa92dd818d9 00007fa92cedbee0 00007fa92cfa50ab 00007fa92cfa5131 00007fa92cf530a0 00007fa92cf52984 00007fa9264cd6d4 00007fa9264cd662
0709 12:10:27.293957 (+1167912us) spinlock_profiling.cc:243] Waited 516 ms on lock 0x7b540021fa54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:27.294221 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1189570176}
I20260709 12:10:27.307853 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:27.309074 15926 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:27.310683 13688 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 3.
I20260709 12:10:27.132872 15960 raft_consensus.cc:740] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:27.291028 15805 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:27.141551 15934 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:27.153309 15936 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:27.170904 15941 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:27.121160 15947 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:27.364558 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 394445us
I20260709 12:10:27.170764 15961 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:27.371690 15947 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:27.372176 15961 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:27.135915 15967 consensus_queue.cc:260] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:27.374191 15967 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:27.310068 15926 consensus_queue.cc:1059] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:27.376506 15926 raft_consensus.cc:3055] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:27.377087 15926 raft_consensus.cc:740] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:27.379148 15945 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:27.379799 15945 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:27.380242 15945 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:27.237608 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.385169 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:27.288969 15508 consensus_queue.cc:260] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:27.017232 15929 consensus_queue.cc:260] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:27.390036 14410 raft_consensus.cc:2468] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 3.
I20260709 12:10:27.312199 13726 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:27.309525 15882 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:27.332669 13759 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 4.
I20260709 12:10:27.335628 15960 consensus_queue.cc:260] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:27.342082 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:27.349972 13652 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:27.359791 15900 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:10:27.396378 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 68197.4us
I20260709 12:10:27.401562 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:10:27.336381 14379 connection.cc:256] RPC call timeout handler was delayed by -1.0065009669999654s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2171s for a response
W20260709 12:10:27.148972 15982 log.cc:927] Time spent T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
W20260709 12:10:27.404045 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 80801us
I20260709 12:10:27.404434 13758 raft_consensus.cc:2393] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 7: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:27.405746 15961 raft_consensus.cc:2804] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:27.257581 13651 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:27.355229 15805 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:27.385223 13828 raft_consensus.cc:1275] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:10:27.414515 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 157191us
I20260709 12:10:27.414332 15805 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:27.415184 13800 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:27.415416 13651 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:27.416661 13651 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:27.417168 15805 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:27.409329 15938 consensus_queue.cc:1048] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:10:27.418102 15953 raft_consensus.cc:2804] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:27.418660 15953 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:27.419148 15953 raft_consensus.cc:3060] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:27.420140 15882 raft_consensus.cc:2749] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:27.420540 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 174990us
I20260709 12:10:27.417243 13800 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:10:27.425107 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.426060 15643 consensus_queue.cc:1059] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:27.427433 15643 raft_consensus.cc:3055] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:27.427857 15643 raft_consensus.cc:740] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:27.430182 15883 consensus_queue.cc:1059] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:27.431931 15744 raft_consensus.cc:3055] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:27.432463 15744 raft_consensus.cc:740] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:27.433853 15744 consensus_queue.cc:260] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:27.435528 15744 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:27.436086 13727 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:27.437135 15882 consensus_queue.cc:1048] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:27.432029 15806 raft_consensus.cc:2804] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:27.438208 15806 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:27.438618 15806 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:27.439458 15882 raft_consensus.cc:2804] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:27.440059 15882 raft_consensus.cc:697] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:27.442005 13681 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 3.
I20260709 12:10:27.442723 15750 raft_consensus.cc:2804] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:27.443471 13727 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:27.444476 15900 raft_consensus.cc:2804] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:27.451776 15926 consensus_queue.cc:260] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:27.453368 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 56000.3us
I20260709 12:10:27.462532 15925 consensus_queue.cc:1059] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:10:27.479439 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:27.467141 13586 catalog_manager.cc:5697] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 2 to 4, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 4 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:27.464617 15787 consensus_queue.cc:1048] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 12:10:27.408202 15961 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:27.478072 13761 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 8.
I20260709 12:10:27.479782 15925 raft_consensus.cc:3055] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:27.469395 13726 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:27.461122 13652 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:27.478869 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:27.461825 15508 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:27.429116 15643 consensus_queue.cc:260] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:27.464049 15750 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:27.461026 15930 consensus_queue.cc:1048] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:10:27.453380 15929 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:27.498544 13726 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
W20260709 12:10:27.499111 15989 log.cc:927] Time spent T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 12:10:27.464754 14379 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:27.441210 15882 consensus_queue.cc:237] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:27.497205 13586 catalog_manager.cc:5697] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 1 to 3, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 3 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:10:27.467334 15900 raft_consensus.cc:697] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:27.508226 13652 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:27.500078 13651 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:27.453750 15926 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:27.467859 15960 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:27.491770 15993 log.cc:927] Time spent T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.070s	user 0.000s	sys 0.002s
W20260709 12:10:27.508082 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.492690 15961 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:27.492926 15925 raft_consensus.cc:740] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:27.518512 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:27.507026 15750 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:27.521124 15798 raft_consensus.cc:2804] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:27.522321 15930 raft_consensus.cc:2804] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:27.527570 13761 raft_consensus.cc:2410] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:27.515043 13727 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:27.524559 13801 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:27.529235 15798 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:27.518613 15883 raft_consensus.cc:2749] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:27.529847 15798 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:27.530036 13582 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45610 (request call id 253) took 12938 ms (client timeout 15000 ms). Trace:
I20260709 12:10:27.531028 15900 consensus_queue.cc:237] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:27.534257 13586 catalog_manager.cc:5697] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:27.539064 15936 raft_consensus.cc:2749] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:10:27.539281 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 74661.5us
I20260709 12:10:27.541155 15963 consensus_queue.cc:1048] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:27.510569 15747 raft_consensus.cc:2749] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:27.538970 15930 raft_consensus.cc:697] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 4 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:27.507308 15719 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:27.560052 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 142951us
W20260709 12:10:27.564286 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 55588.3us
W20260709 12:10:27.567307 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 76748.1us
I20260709 12:10:27.584900 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:27.587287 13682 raft_consensus.cc:1240] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:27.591585 13800 leader_election.cc:400] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 2. Current term is 3.
I20260709 12:10:27.592022 13800 leader_election.cc:403] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:27.594147 13586 catalog_manager.cc:5697] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 2 to 3, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 3 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:27.596331 13586 catalog_manager.cc:5697] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 4 to 6, leader changed from ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 6 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:27.599711 13681 raft_consensus.cc:1275] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:10:27.530642 13582 rpcz_store.cc:269] 0709 12:10:14.590981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.596929 (+  5948us) service_pool.cc:224] Handling call
0709 12:10:15.582294 (+985365us) spinlock_profiling.cc:243] Waited 20.4 ms on lock 0x7b5400373cd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef7090 00007fa927f95f3a 00007fa92dd4be9c 00007fa92de4a04e 00007fa92c30b2a4 00007fa92c30b232 00007fa92c30b161 00007fa92c30b0dc 00007fa92c30a392 00007fa9262c848c 00007fa9262c78c6
0709 12:10:27.529723 (+11947429us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:21.672204 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:21.738922 (+ 66718us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:21.738963 (+    41us) write_op.cc:435] Acquired schema lock
0709 12:10:21.738980 (+    17us) tablet.cc:662] Decoding operations
0709 12:10:21.816190 (+ 77210us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:21.816254 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:21.816282 (+    28us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:10:21.817031 (+   749us) tablet.cc:701] Row locks acquired
0709 12:10:21.817052 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:10:21.817210 (+   158us) write_op.cc:270] Start()
0709 12:10:21.817344 (+   134us) write_op.cc:276] Timestamp: P: 1783599021817157 usec, L: 0
0709 12:10:21.817458 (+   114us) op_driver.cc:348] REPLICATION: starting
0709 12:10:21.818239 (+   781us) log.cc:844] Serialized 3699 byte log entry
0709 12:10:22.403633 (+585394us) op_driver.cc:464] REPLICATION: finished
0709 12:10:22.689809 (+286176us) write_op.cc:301] APPLY: starting
0709 12:10:22.693997 (+  4188us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:22.779319 (+ 85322us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:22.804745 (+ 25426us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:22.996142 (+191397us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:22.996450 (+   308us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 12:10:22.996504 (+    54us) write_op.cc:312] APPLY: finished
0709 12:10:22.996867 (+   363us) log.cc:844] Serialized 71 byte log entry
0709 12:10:22.997095 (+   228us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:22.997259 (+   164us) write_op.cc:454] Released schema lock
0709 12:10:23.039686 (+ 42427us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:23.102551 (+ 62865us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:23.112953 (+ 10402us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1666322,"reported_tablets":19,"spinlock_wait_cycles":46915968,"child_traces":[["op",{"apply.queue_time_us":248620,"apply.run_cpu_time_us":5344,"apply.run_wall_time_us":386205,"num_ops":9,"prepare.queue_time_us":497268,"prepare.run_cpu_time_us":6610,"prepare.run_wall_time_us":183415,"raft.queue_time_us":316587,"raft.run_cpu_time_us":31713,"raft.run_wall_time_us":225100,"replication_time_us":538027,"thread_start_us":510991,"threads_started":4,"wal-append.queue_time_us":22837,"wal-append.run_cpu_time_us":5095,"wal-append.run_wall_time_us":2157063}]]}
I20260709 12:10:27.603396 15934 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:27.564092 15812 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:27.608170 15812 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:27.608966 15812 raft_consensus.cc:2749] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:27.612092 15806 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:27.570451 15883 raft_consensus.cc:2804] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:27.629264 13756 raft_consensus.cc:2393] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 4: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:27.584460 15947 raft_consensus.cc:2804] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:10:27.637113 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 138742us
I20260709 12:10:27.625590 15643 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:27.617990 15938 raft_consensus.cc:2749] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:27.616669 15805 raft_consensus.cc:2804] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:27.628669 15883 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:27.654690 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:27.655997 15805 raft_consensus.cc:697] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 3 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:27.655670 15930 consensus_queue.cc:237] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:27.656563 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:27.657959 15908 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.658639 15908 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:27.659121 15806 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:27.659268 14412 raft_consensus.cc:1240] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 5 LEADER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:27.657393 15805 consensus_queue.cc:237] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:27.664242 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:10:27.670414 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:27.674726 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 191580us
W20260709 12:10:27.678109 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.669273 13757 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 5.
I20260709 12:10:27.647886 13586 catalog_manager.cc:5697] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 1 to 2, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 2 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:10:27.665869 15883 raft_consensus.cc:3060] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:27.698062 15947 raft_consensus.cc:697] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:27.698688 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:27.699350 15947 consensus_queue.cc:237] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:27.702209 15907 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:10:27.702633 13727 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:27.702131 15881 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:27.705264 15881 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:27.706172 15941 raft_consensus.cc:2749] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:27.706271 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:27.707187 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:27.707816 13832 raft_consensus.cc:1275] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:27.707969 13688 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:27.708206 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:27.709183 13726 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:27.711197 13761 raft_consensus.cc:2393] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 4: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:27.709501 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:27.707399 13758 raft_consensus.cc:1240] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:27.702129 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:27.726528 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:27.727355 13756 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:27.728935 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:10:27.739738 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 240401us
W20260709 12:10:27.692787 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 111892us
I20260709 12:10:27.652082 15925 consensus_queue.cc:260] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:27.735955 15941 raft_consensus.cc:2749] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:27.765092 13762 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:27.702581 15787 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.763873 13586 catalog_manager.cc:5697] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 4 to 5, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 5 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
W20260709 12:10:27.766757 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.767310 13831 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 3.
I20260709 12:10:27.780566 13652 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:10:27.785311 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 82820us
I20260709 12:10:27.787883 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:27.788906 13832 raft_consensus.cc:2393] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 5: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:27.790681 15999 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:27.788139 15990 log.cc:927] Time spent T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 12:10:27.791380 15999 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:27.793711 13755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 1904) took 1001 ms. Trace:
W20260709 12:10:27.793958 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 83356.9us
I20260709 12:10:27.795776 13726 leader_election.cc:304] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:27.794230 13755 rpcz_store.cc:276] 0709 12:10:26.792202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.976767 (+184565us) service_pool.cc:224] Handling call
0709 12:10:26.977167 (+   400us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:27.094892 (+117725us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:27.094953 (+    61us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:27.102115 (+  7162us) log.cc:844] Serialized 52 byte log entry
0709 12:10:27.391272 (+289157us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:27.408527 (+ 17255us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:27.422950 (+ 14423us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:27.793235 (+370285us) raft_consensus.cc:1685] finished
0709 12:10:27.793262 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:27.793473 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":117252,"raft.queue_time_us":118041,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":144,"thread_start_us":110982,"threads_started":1,"wal-append.queue_time_us":173477}
I20260709 12:10:27.796633 15900 raft_consensus.cc:2749] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:27.800076 15934 leader_election.cc:290] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:27.800830 15787 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:27.812484 13829 raft_consensus.cc:1240] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:27.814589 15953 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:27.816794 15953 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:27.822467 15945 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:27.824806 15945 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:27.825565 13754 raft_consensus.cc:1240] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 4. Current term is 6. Ops: []
W20260709 12:10:27.834331 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.842460 13727 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:27.783453 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:27.895124 13756 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 3.
W20260709 12:10:27.962118 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:27.845682 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 48503.5us
I20260709 12:10:27.912497 13762 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 4.
W20260709 12:10:27.925346 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 124036us
W20260709 12:10:27.912701 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 66544.1us
W20260709 12:10:27.895908 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:27.927251 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:27.975422 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 209274us
I20260709 12:10:28.072446 13688 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 7.
I20260709 12:10:27.994393 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:27.855621 13727 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:27.931031 13829 raft_consensus.cc:1275] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:27.995189 13586 catalog_manager.cc:5697] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 1 to 3, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 3 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:27.834254 15925 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:28.127519 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 272069us
I20260709 12:10:28.137281 14379 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
W20260709 12:10:28.138200 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.140327 15960 raft_consensus.cc:2764] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 12:10:28.140655 13586 catalog_manager.cc:5697] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 1 to 3, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 3 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:28.141875 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:28.142969 13586 catalog_manager.cc:5697] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 1 to 4, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 4 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:10:28.144493 13586 catalog_manager.cc:5697] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 1 to 2, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 2 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:10:28.146348 13586 catalog_manager.cc:5697] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 1 to 2, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 2 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:28.149974 13586 catalog_manager.cc:5697] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 3 to 4, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 4 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:10:28.151801 15908 leader_election.cc:290] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:10:28.153811 15750 consensus_meta.cc:287] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.606s	user 0.004s	sys 0.008s
I20260709 12:10:28.154292 15750 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:28.153158 13586 catalog_manager.cc:5697] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 1 to 3, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 3 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
W20260709 12:10:27.978317 15744 consensus_meta.cc:287] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.537s	user 0.010s	sys 0.003s
I20260709 12:10:28.157882 13651 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:28.136155 13726 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:28.156311 13586 catalog_manager.cc:5697] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 1 to 3, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 3 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:10:28.160615 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:10:28.001842 15967 consensus_meta.cc:287] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.627s	user 0.003s	sys 0.012s
W20260709 12:10:28.010422 16002 log.cc:927] Time spent T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:10:27.994132 15998 raft_consensus.cc:2749] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:27.855485 15941 raft_consensus.cc:2749] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:27.963557 15775 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.845384 15999 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:27.999809 15787 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:27.854642 15719 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:28.185123 15908 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.185617 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:28.186537 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:10:28.168433 15926 consensus_meta.cc:287] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.641s	user 0.012s	sys 0.000s
I20260709 12:10:28.188251 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:28.189845 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:28.190455 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:28.187522 13833 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:28.186266 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:28.206102 13761 raft_consensus.cc:2368] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 5. Current term is 6.
I20260709 12:10:28.195520 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:28.195631 13651 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:28.195905 15908 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:28.196710 15930 raft_consensus.cc:2804] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:28.195509 15945 raft_consensus.cc:2749] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:28.064848 15961 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:28.156782 15953 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:28.199679 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 93906.6us
I20260709 12:10:28.218894 13755 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:28.190201 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:10:28.203963 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.204035 13727 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:28.156541 15750 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:28.014341 15883 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:27.898839 15798 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:28.216192 13651 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:28.218456 13754 raft_consensus.cc:2393] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 8: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:28.165536 15806 consensus_queue.cc:1059] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:10:28.233144 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:10:28.235525 13800 connection.cc:256] RPC call timeout handler was delayed by -1.0613689439999234s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3153s for a response
I20260709 12:10:28.238125 15953 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:28.239042 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:10:28.239243 16009 log.cc:927] Time spent T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.098s	user 0.003s	sys 0.000s
W20260709 12:10:28.239971 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 54000.8us
I20260709 12:10:28.241653 15961 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:28.246423 15908 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:28.255897 13760 raft_consensus.cc:2376] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 4. Re-sending same reply.
W20260709 12:10:28.247171 16010 log.cc:927] Time spent T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
W20260709 12:10:28.248873 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 64126.3us
I20260709 12:10:28.226408 15508 raft_consensus.cc:2804] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:10:28.256666 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.256795 13833 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 8.
I20260709 12:10:28.212803 15930 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:28.258889 13755 raft_consensus.cc:2410] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 12:10:28.259016 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 127097us
I20260709 12:10:28.275719 13652 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:28.277567 13829 raft_consensus.cc:1240] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:28.229315 15744 raft_consensus.cc:2804] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:28.283921 15953 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:28.285645 15883 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:28.286475 15750 raft_consensus.cc:3055] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:28.287062 15806 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.288671 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:28.289548 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:28.289563 13682 raft_consensus.cc:1275] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:28.295723 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:28.289940 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:28.258289 15643 raft_consensus.cc:2804] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:28.296691 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:28.304961 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:28.304826 15806 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:28.306352 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:28.307209 15806 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:28.308039 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:10:28.292147 15907 consensus_meta.cc:287] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.589s	user 0.009s	sys 0.004s
I20260709 12:10:28.311664 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:28.312944 13755 raft_consensus.cc:2393] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 6: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:28.279556 15930 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:28.309821 13685 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 5.
I20260709 12:10:28.313097 13757 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 5.
I20260709 12:10:28.229702 15775 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:28.340297 15775 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:28.341254 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 65611.9us
I20260709 12:10:28.343007 13652 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:28.314335 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:28.308609 13687 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 4.
I20260709 12:10:28.344542 13652 leader_election.cc:400] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 2. Current term is 3.
I20260709 12:10:28.349486 13652 leader_election.cc:403] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:28.317646 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:28.310565 15719 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:28.315166 15938 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:28.310802 15908 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.322994 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:28.323824 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:28.368872 13800 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:28.329977 13688 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 4.
I20260709 12:10:28.295351 15750 raft_consensus.cc:740] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
W20260709 12:10:28.373073 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.373008 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:28.335531 15787 consensus_queue.cc:1048] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:28.336434 15643 raft_consensus.cc:697] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 4 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:28.297437 15508 raft_consensus.cc:697] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 3 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
W20260709 12:10:28.377543 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.316099 13684 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 7.
I20260709 12:10:28.337393 15798 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:28.293645 15744 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:28.277439 15941 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:28.385486 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:28.386113 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:28.366564 15961 raft_consensus.cc:2804] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:28.346153 13681 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 6.
I20260709 12:10:28.350416 15907 raft_consensus.cc:2749] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 2. Current term is 3.
I20260709 12:10:28.379045 13726 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:10:28.361626 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.387894 14413 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:28.388422 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:28.390496 13685 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 6.
I20260709 12:10:28.391541 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:28.395247 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:28.395998 13759 raft_consensus.cc:2393] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 4: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:28.397969 13831 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 4.
I20260709 12:10:28.382154 15929 raft_consensus.cc:2804] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:28.393257 13830 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:28.389218 15961 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:28.386443 15744 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:28.383222 15883 raft_consensus.cc:2749] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:10:28.407336 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 62975.7us
I20260709 12:10:28.419811 15802 consensus_queue.cc:1059] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 12:10:28.399840 13835 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 4.
I20260709 12:10:28.415336 13800 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:28.378793 15908 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:28.404491 15938 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:28.392026 15719 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:28.428030 15938 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:28.386191 15953 raft_consensus.cc:2749] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 2. Current term is 3.
I20260709 12:10:28.386191 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:28.417912 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:28.417706 15750 consensus_queue.cc:260] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:28.418895 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:28.378429 15926 consensus_queue.cc:1048] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:10:28.431376 13652 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:28.414638 15961 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:28.439627 14414 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:28.433502 13828 raft_consensus.cc:1275] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:10:28.435456 13727 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:28.436936 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:28.404598 15967 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:28.437842 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:10:28.439569 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 331342us
W20260709 12:10:28.441071 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 86802.8us
I20260709 12:10:28.408222 15929 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:28.453091 13726 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:28.442054 15747 consensus_queue.cc:1048] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:10:28.446815 15929 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:28.457659 15965 raft_consensus.cc:2804] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:28.458364 15965 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:28.458843 15965 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:28.450325 15643 consensus_queue.cc:237] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:28.457737 15999 raft_consensus.cc:2804] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:28.462116 15999 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:28.462581 15999 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:28.462141 14410 raft_consensus.cc:1275] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:28.452293 15508 consensus_queue.cc:237] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:28.467069 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:28.468012 13757 raft_consensus.cc:2410] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:10:28.449154 15907 raft_consensus.cc:2749] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:28.456931 14379 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:28.450523 14408 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:28.475167 13831 raft_consensus.cc:1275] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:28.478933 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:28.479877 13757 raft_consensus.cc:3060] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:28.454013 16007 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:28.471364 15719 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:28.485939 13727 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:28.474211 15775 raft_consensus.cc:2804] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:28.490713 13800 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:28.476262 15907 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.493580 15747 consensus_queue.cc:1048] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:10:28.497381 15941 consensus_queue.cc:1048] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:28.498523 16016 consensus_queue.cc:1059] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 12:10:28.499043 15787 raft_consensus.cc:2749] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:28.499733 16016 raft_consensus.cc:3055] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:28.500162 16016 raft_consensus.cc:740] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:28.492763 15775 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:28.502394 15775 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:28.505115 13758 raft_consensus.cc:1240] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:10:28.498123 15941 consensus_queue.cc:1243] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer b98d2519bb504dc6905ed2ede4571835 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:10:28.473151 15953 consensus_queue.cc:1048] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:10:28.513589 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:28.513639 13727 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:28.483844 15908 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:28.518296 14413 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 4.
I20260709 12:10:28.524955 15961 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:28.525583 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:28.529297 13651 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:10:28.530381 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 46663.7us
I20260709 12:10:28.504854 15963 raft_consensus.cc:3055] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:10:28.533761 16019 log.cc:927] Time spent T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:10:28.530303 15883 raft_consensus.cc:2804] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:28.535445 16001 log.cc:927] Time spent T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.308s	user 0.000s	sys 0.002s
I20260709 12:10:28.535797 14414 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 6.
I20260709 12:10:28.540493 15908 consensus_queue.cc:1048] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:28.484985 15848 consensus_queue.cc:1048] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:10:28.501195 16016 consensus_queue.cc:260] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:28.557941 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.560168 15750 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:28.557983 15798 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.563097 13828 raft_consensus.cc:1275] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:28.563102 14408 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 4.
W20260709 12:10:28.575294 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 98941.1us
I20260709 12:10:28.564476 13834 raft_consensus.cc:1275] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:28.504647 15907 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:28.568704 13837 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 3.
I20260709 12:10:28.572196 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:28.572291 13763 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 7.
I20260709 12:10:28.569607 15883 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:28.522599 15953 consensus_queue.cc:1243] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer 96701a74fdee481fb5f54aac841e17dd log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
W20260709 12:10:28.574188 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:28.577144 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 90096us
W20260709 12:10:28.575014 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 61462.2us
I20260709 12:10:28.531486 15926 raft_consensus.cc:2749] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:28.599153 13727 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:28.564284 15744 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:28.567653 15963 raft_consensus.cc:740] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:28.495425 16007 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:28.577970 15945 raft_consensus.cc:2804] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:28.600363 13727 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:28.604918 14413 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 3.
I20260709 12:10:28.608600 13756 raft_consensus.cc:1275] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:28.584438 15929 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:28.615796 13755 raft_consensus.cc:1275] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:10:28.617959 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:28.622197 13755 pending_rounds.cc:85] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting all ops after (but not including) 6
I20260709 12:10:28.622416 13760 raft_consensus.cc:2376] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 8. Re-sending same reply.
I20260709 12:10:28.583334 15802 raft_consensus.cc:2764] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:10:28.623410 13759 raft_consensus.cc:1240] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:28.623980 13800 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:28.599643 15883 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:28.634616 15926 raft_consensus.cc:2749] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:28.581950 15798 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:28.637969 13726 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:28.622205 13757 raft_consensus.cc:2468] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 4.
I20260709 12:10:28.622999 13755 pending_rounds.cc:107] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:10:28.638906 13755 raft_consensus.cc:2889] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:28.629891 15938 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.605369 15960 raft_consensus.cc:2804] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:28.630484 13754 raft_consensus.cc:1275] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:28.639737 13761 raft_consensus.cc:1240] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:28.631209 15963 consensus_queue.cc:260] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:28.632560 13800 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:28.650251 15938 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:28.642530 15960 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:28.651249 15960 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:28.653403 13836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 322) took 1075 ms. Trace:
I20260709 12:10:28.625728 16016 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:28.625491 15787 raft_consensus.cc:2804] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:28.654541 15963 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:28.646093 15925 consensus_queue.cc:1048] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:10:28.653824 13836 rpcz_store.cc:276] 0709 12:10:27.571132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.571282 (+   150us) service_pool.cc:224] Handling call
0709 12:10:27.586627 (+ 15345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:27.589230 (+  2603us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:27.589262 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:27.589924 (+   662us) log.cc:844] Serialized 26 byte log entry
0709 12:10:27.751170 (+161246us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:27.751279 (+   109us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:27.751528 (+   249us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:28.499356 (+747828us) spinlock_profiling.cc:243] Waited 23.7 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:10:28.638128 (+138772us) raft_consensus.cc:1685] finished
0709 12:10:28.638151 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:28.646385 (+  8234us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15295,"raft.queue_time_us":28817,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":5332,"spinlock_wait_cycles":54446464,"thread_start_us":153946,"threads_started":1,"wal-append.queue_time_us":568739}
I20260709 12:10:28.654582 15787 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:28.643023 15999 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:28.658955 15999 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:28.656914 15787 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:28.666940 16011 raft_consensus.cc:2749] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:28.666749 15930 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:28.667928 14412 raft_consensus.cc:1240] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:28.668628 15883 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:28.670225 13832 raft_consensus.cc:1240] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:28.637866 15798 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:28.675964 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:28.690508 13830 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 6.
W20260709 12:10:28.683692 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 51285.2us
I20260709 12:10:28.695482 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:28.714690 13754 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:28.690258 15883 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:28.718230 13801 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:10:28.720067 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 98095.5us
I20260709 12:10:28.660447 15947 consensus_queue.cc:1048] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 12:10:28.729622 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:28.696046 15744 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:28.738451 15941 consensus_queue.cc:1048] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:28.682559 16024 raft_consensus.cc:2764] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:10:28.730466 15798 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:28.750481 14379 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:28.745071 13652 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:28.722528 15945 raft_consensus.cc:697] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:28.757308 13800 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:28.762156 15929 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:10:28.762247 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.773959 13754 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 6.
I20260709 12:10:28.730602 16030 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.749624 15798 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:28.782711 16007 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:28.786950 15768 raft_consensus.cc:2749] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:28.788509 13837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54820 (request call id 1910) took 1092 ms. Trace:
I20260709 12:10:28.795902 13651 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:28.793529 13762 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 5.
I20260709 12:10:28.799878 13837 rpcz_store.cc:276] 0709 12:10:27.696010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.696165 (+   155us) service_pool.cc:224] Handling call
0709 12:10:28.788273 (+1092108us) spinlock_profiling.cc:243] Waited 711 ms on lock 0x7b5400363654. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:28.788420 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1634400128}
W20260709 12:10:28.807924 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 72848.7us
I20260709 12:10:28.811414 13685 raft_consensus.cc:1240] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 6. Current term is 7. Ops: []
W20260709 12:10:28.810694 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 185675us
W20260709 12:10:28.821884 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 71483.8us
W20260709 12:10:28.825822 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.826546 13651 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:28.853206 13652 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:28.799846 15929 raft_consensus.cc:2804] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:28.845073 13727 leader_election.cc:304] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:28.800266 15798 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:28.799060 15961 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:28.861109 14379 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:28.861815 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:28.812326 16031 consensus_queue.cc:1048] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:10:28.871694 13685 raft_consensus.cc:2410] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:10:28.860162 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 106742us
I20260709 12:10:28.852438 15812 raft_consensus.cc:2804] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:28.872299 13727 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:28.820855 15907 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:28.819875 15744 raft_consensus.cc:2749] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:28.826123 15508 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.881520 13836 raft_consensus.cc:1275] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:10:28.883706 16024 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:28.884274 16029 raft_consensus.cc:2749] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:28.884805 13652 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:10:28.886243 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.888689 15775 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:28.889029 15960 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:28.873016 15806 raft_consensus.cc:2749] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:28.889950 16015 consensus_queue.cc:1048] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 12:10:28.858968 15929 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:28.809804 15965 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:28.882759 13727 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:10:28.907383 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 159620us
I20260709 12:10:28.870754 15750 raft_consensus.cc:2804] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:10:28.912880 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 51853.3us
I20260709 12:10:28.803068 16030 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:28.927630 14379 leader_election.cc:304] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:10:28.928483 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 45808.8us
I20260709 12:10:28.925274 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:28.903888 15930 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 4 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:28.931741 15750 raft_consensus.cc:697] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 6 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:28.934465 13727 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:28.935055 13800 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:28.936050 13800 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:28.936580 15965 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:28.937383 15965 raft_consensus.cc:2804] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:28.937961 15907 raft_consensus.cc:2804] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:28.939023 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:28.934150 15750 consensus_queue.cc:237] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:28.910772 15812 raft_consensus.cc:697] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 4 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:28.937554 13800 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:28.918210 15848 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.862747 15945 consensus_queue.cc:237] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:28.938463 15768 raft_consensus.cc:2749] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:28.945075 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 76755.6us
I20260709 12:10:28.922627 15929 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:28.905948 15508 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:28.923187 16024 raft_consensus.cc:697] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:28.949838 13651 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:28.932462 15999 raft_consensus.cc:2749] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:28.973981 13684 raft_consensus.cc:1240] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:10:28.974684 15719 raft_consensus.cc:2804] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:28.975303 15719 raft_consensus.cc:697] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 5 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:28.976363 15719 consensus_queue.cc:237] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:28.980515 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:10:28.985345 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 100655us
I20260709 12:10:29.001461 13681 raft_consensus.cc:2410] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:29.008965 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:28.922530 16011 consensus_queue.cc:1059] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 12:10:29.014765 13686 raft_consensus.cc:1240] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:29.011551 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:29.008179 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:10:29.014097 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.969053 15965 raft_consensus.cc:697] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:29.032732 13685 raft_consensus.cc:2393] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 7: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:29.033973 13762 raft_consensus.cc:1275] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:28.948091 15747 consensus_queue.cc:1059] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 12:10:28.998545 15908 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:29.059492 16025 raft_consensus.cc:2804] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:10:29.061261 16032 log.cc:927] Time spent T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
W20260709 12:10:29.063179 16033 log.cc:927] Time spent T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 12:10:29.064019 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:29.123461 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.959831 15848 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:29.043110 16035 raft_consensus.cc:2804] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:10:29.132843 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 134391us
I20260709 12:10:29.151785 15643 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.178764 15907 raft_consensus.cc:697] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 4 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:29.212576 16030 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:29.212419 15907 consensus_queue.cc:237] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:29.221336 15960 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:29.222021 15775 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:29.222797 15848 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:29.224740 15938 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:29.227458 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:10:29.230541 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 293035us
W20260709 12:10:29.229668 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 80536.2us
I20260709 12:10:29.254060 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:29.171505 16035 raft_consensus.cc:697] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:10:29.243697 16037 log.cc:927] Time spent T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260709 12:10:29.265507 13800 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:29.254637 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:29.255834 14412 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 5.
I20260709 12:10:29.267987 13832 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:29.191759 15967 consensus_queue.cc:1048] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 12:10:29.278363 13727 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:29.171259 15812 consensus_queue.cc:237] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:29.280126 15960 raft_consensus.cc:2804] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:29.280660 15960 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:29.281070 15960 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:29.231400 15643 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:29.300626 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:29.303624 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:29.303536 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:29.305724 13688 raft_consensus.cc:2376] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 6. Re-sending same reply.
I20260709 12:10:29.307402 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:29.316787 16025 raft_consensus.cc:697] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:29.317760 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:29.318980 14413 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 4.
I20260709 12:10:29.215152 15965 consensus_queue.cc:237] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:29.325903 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:29.321386 13727 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:10:29.361294 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 74297.3us
W20260709 12:10:29.365634 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 44341.4us
I20260709 12:10:29.367179 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:29.181303 16024 consensus_queue.cc:237] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:29.373713 13681 raft_consensus.cc:2393] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 3: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:29.375850 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:29.377379 13688 raft_consensus.cc:1240] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:10:29.307332 16030 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:10:29.414921 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 48954.5us
I20260709 12:10:29.420730 13681 raft_consensus.cc:1275] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:29.424145 16015 consensus_queue.cc:1059] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:29.426374 16015 raft_consensus.cc:3055] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:29.426777 16015 raft_consensus.cc:740] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:29.427665 16015 consensus_queue.cc:260] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:29.428916 16015 raft_consensus.cc:3060] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:29.428809 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:29.429644 13833 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 4.
I20260709 12:10:29.430681 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:29.431201 13833 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:29.440593 15925 raft_consensus.cc:3055] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:29.441126 15925 raft_consensus.cc:740] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:29.442909 15508 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:29.449728 13833 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 5.
W20260709 12:10:29.451689 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:29.453946 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 72484.9us
I20260709 12:10:29.322512 16043 consensus_queue.cc:1048] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 12:10:29.456362 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:29.462811 13685 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:29.464553 13652 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:29.375197 16025 consensus_queue.cc:237] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:29.484829 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 228185us
I20260709 12:10:29.488598 13726 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:29.486712 13800 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:29.497061 13686 raft_consensus.cc:1240] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:29.451025 16031 consensus_queue.cc:1048] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:10:29.500635 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:29.501395 13688 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:29.502717 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:29.503052 13727 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:29.503538 13681 raft_consensus.cc:2393] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 4: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:29.506085 16056 raft_consensus.cc:2804] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:29.518105 13688 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 4.
I20260709 12:10:29.523547 13685 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 8.
I20260709 12:10:29.470649 16050 raft_consensus.cc:2804] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:29.508996 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:29.538014 13758 raft_consensus.cc:2393] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 4: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:29.539565 13832 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 4.
I20260709 12:10:29.488150 15945 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:29.543471 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 56878.9us
I20260709 12:10:29.459896 16030 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:29.554826 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 66319.7us
I20260709 12:10:29.555480 13685 raft_consensus.cc:1275] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:29.493999 15883 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:29.490784 15908 raft_consensus.cc:697] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 7 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:29.523178 16056 raft_consensus.cc:697] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:10:29.570228 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 105831us
I20260709 12:10:29.524474 16039 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:29.531692 16050 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:10:29.562685 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 72221.9us
I20260709 12:10:29.542913 16047 raft_consensus.cc:2749] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:29.541062 15508 raft_consensus.cc:2749] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:29.571151 13800 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:29.579187 13652 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:29.499526 15925 consensus_queue.cc:260] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:29.596436 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:29.578755 16050 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:29.585685 16007 raft_consensus.cc:2804] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:29.575143 15926 consensus_queue.cc:1048] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:10:29.460268 16035 consensus_queue.cc:237] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:29.570005 15883 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:29.593721 16042 raft_consensus.cc:2804] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:29.593701 16051 raft_consensus.cc:2804] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:29.575367 15945 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:29.600351 15999 raft_consensus.cc:2749] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:29.621443 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:29.625694 14413 raft_consensus.cc:2393] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 4: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
W20260709 12:10:29.616199 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 69663.8us
I20260709 12:10:29.621381 13686 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 4.
I20260709 12:10:29.606129 15643 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:29.599174 15750 consensus_queue.cc:1048] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:10:29.608946 16007 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:29.627880 13800 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:29.605271 15861 consensus_queue.cc:1048] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.179s
I20260709 12:10:29.594380 16039 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:29.640484 13680 raft_consensus.cc:1240] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:29.633229 15750 consensus_queue.cc:1243] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer 96701a74fdee481fb5f54aac841e17dd log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:10:29.744747 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:10:29.745436 16044 log.cc:927] Time spent T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.329s	user 0.003s	sys 0.000s
I20260709 12:10:29.746070 16065 raft_consensus.cc:2764] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 12:10:29.749023 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 121205us
W20260709 12:10:29.740949 16058 log.cc:927] Time spent T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 12:10:29.632797 13686 raft_consensus.cc:1275] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:10:29.758119 13800 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:29.700405 14379 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:29.753189 13686 pending_rounds.cc:85] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 1
I20260709 12:10:29.760439 13686 pending_rounds.cc:107] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:10:29.628811 16042 raft_consensus.cc:697] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:29.761318 13686 raft_consensus.cc:2889] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:29.767099 13682 raft_consensus.cc:1240] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 4 LEADER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:29.766790 13680 raft_consensus.cc:1275] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 12:10:29.753628 15929 consensus_meta.cc:287] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.804s	user 0.011s	sys 0.001s
I20260709 12:10:29.754521 16007 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:29.775354 13680 raft_consensus.cc:1240] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:29.771692 15768 consensus_queue.cc:1048] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 12:10:29.713212 15802 consensus_queue.cc:1059] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 12:10:29.781276 15883 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:10:29.781308 16048 log.cc:927] Time spent T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.312s	user 0.000s	sys 0.001s
I20260709 12:10:29.782153 15802 raft_consensus.cc:3055] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:29.782646 15802 raft_consensus.cc:740] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:29.783581 15802 consensus_queue.cc:260] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:29.785386 16042 consensus_queue.cc:237] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:29.773669 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 73377.5us
I20260709 12:10:29.705159 16056 consensus_queue.cc:237] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:29.711166 16060 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:29.791301 16060 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:29.793370 15798 consensus_meta.cc:287] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.894s	user 0.010s	sys 0.003s
I20260709 12:10:29.785902 16029 raft_consensus.cc:2804] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:29.794260 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:29.795794 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:29.797077 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:10:29.798259 16066 log.cc:927] Time spent T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
I20260709 12:10:29.798658 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:29.776937 13832 raft_consensus.cc:1275] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:29.726308 15908 consensus_queue.cc:237] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:29.800235 14412 raft_consensus.cc:1240] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:30.012873 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:30.013919 14412 raft_consensus.cc:2393] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 4: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:30.015077 14408 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 3.
I20260709 12:10:29.811872 15938 raft_consensus.cc:3055] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:10:30.017201 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.017315 15938 raft_consensus.cc:740] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
W20260709 12:10:30.018007 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 187561us
I20260709 12:10:30.019176 16047 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:30.019788 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:30.019701 16047 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:30.019986 15938 consensus_queue.cc:260] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:30.021245 15938 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:30.022907 16054 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:30.023487 16054 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:30.026463 16047 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:30.026742 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:29.825531 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:30.027531 13762 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 4.
I20260709 12:10:30.027232 15861 consensus_queue.cc:1048] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:30.028012 14411 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 3.
I20260709 12:10:30.031354 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:30.032171 13758 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 3.
W20260709 12:10:29.932338 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:29.804183 16060 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:30.034401 16047 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:30.035005 16047 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:30.036290 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:30.037302 16047 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:30.038084 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:30.041896 14379 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:10:29.800877 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.043453 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:29.852133 13686 raft_consensus.cc:1240] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:10:29.995357 13831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 347) took 1034 ms. Trace:
I20260709 12:10:29.802321 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:30.050472 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:30.059180 13761 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 8.
I20260709 12:10:30.056993 13681 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 4.
I20260709 12:10:30.061686 14416 raft_consensus.cc:2393] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 4: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:29.759624 15926 raft_consensus.cc:2804] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:30.054688 13831 rpcz_store.cc:276] 0709 12:10:28.960682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.051351 (+ 90669us) service_pool.cc:224] Handling call
0709 12:10:29.255835 (+204484us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:29.496277 (+240442us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:29.496325 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:29.545020 (+ 48695us) log.cc:844] Serialized 26 byte log entry
0709 12:10:29.737767 (+192747us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:29.737831 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:29.737917 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:29.995072 (+257155us) raft_consensus.cc:1685] finished
0709 12:10:29.995098 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:29.995264 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43053,"raft.queue_time_us":122306,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":26644,"thread_start_us":321498,"threads_started":2,"wal-append.queue_time_us":403796}
I20260709 12:10:30.065322 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:30.076785 13762 raft_consensus.cc:2393] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 3: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:30.078492 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
W20260709 12:10:29.972615 15787 consensus_meta.cc:287] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 1.289s	user 0.014s	sys 0.000s
I20260709 12:10:30.257716 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:30.258597 13685 raft_consensus.cc:2393] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 6: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:29.800091 15945 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:10:29.806025 16071 log.cc:927] Time spent T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:10:29.904239 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:30.265161 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:30.058523 15798 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:30.060242 15883 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:30.072670 15926 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:30.239032 15802 raft_consensus.cc:3060] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:30.116025 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:30.057880 15861 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:30.067399 16029 raft_consensus.cc:697] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 4 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:30.041180 16054 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:10:30.234619 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 186278us
I20260709 12:10:30.233166 13835 raft_consensus.cc:1275] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:30.241616 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:30.240820 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:10:30.233058 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:30.218502 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 315420us
I20260709 12:10:30.282387 15812 consensus_queue.cc:1048] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:30.283030 16065 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:30.283583 16065 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:30.285265 14415 raft_consensus.cc:2393] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 4: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:30.240844 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:10:30.270181 16050 consensus_meta.cc:287] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.647s	user 0.011s	sys 0.000s
I20260709 12:10:30.102478 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:30.289510 13688 raft_consensus.cc:2410] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:30.289691 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:30.290510 13686 raft_consensus.cc:2393] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 4: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
W20260709 12:10:30.227944 13652 connection.cc:256] RPC call timeout handler was delayed by -2.4799504949999118s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1574s for a response
I20260709 12:10:30.194831 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:29.905833 16016 consensus_queue.cc:1059] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.273s
I20260709 12:10:29.929733 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:30.137084 13687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 1828) took 1079 ms. Trace:
I20260709 12:10:30.065375 16011 raft_consensus.cc:2804] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:30.238202 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:30.255764 13828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 1930) took 1399 ms. Trace:
I20260709 12:10:30.079209 13727 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:29.776382 15929 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:29.815243 15998 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:30.321599 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 242486us
I20260709 12:10:30.264256 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:29.802289 16030 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:29.930469 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:30.266757 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:29.808393 16039 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:30.233060 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:10:30.254992 16048 log.cc:927] Time spent T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 12:10:30.099283 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:30.098796 16047 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:30.180887 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:30.193086 15719 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:30.274658 16078 log.cc:927] Time spent T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.357s	user 0.001s	sys 0.000s
I20260709 12:10:30.274806 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:30.339792 13833 raft_consensus.cc:2393] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 4: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
W20260709 12:10:30.275892 16046 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.006s	sys 0.009s
I20260709 12:10:30.273411 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:30.233493 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:30.341063 13681 raft_consensus.cc:2393] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 4: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:30.291977 13680 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:30.272620 15926 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:30.324672 13685 raft_consensus.cc:2410] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:10:30.289219 15960 consensus_meta.cc:287] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 1.008s	user 0.014s	sys 0.000s
I20260709 12:10:30.323154 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:30.327747 14414 raft_consensus.cc:2468] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 4.
I20260709 12:10:30.319671 13828 rpcz_store.cc:276] 0709 12:10:28.856774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.856919 (+   145us) service_pool.cc:224] Handling call
0709 12:10:28.870346 (+ 13427us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:28.881678 (+ 11332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:28.881710 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:28.911294 (+ 29584us) log.cc:844] Serialized 26 byte log entry
0709 12:10:29.266426 (+355132us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:29.266484 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:29.266582 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:29.744995 (+478413us) spinlock_profiling.cc:243] Waited 62.9 ms on lock 0x7b2400261f68. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924d269c4 00007fa924d24acb 00007fa924edfdc9 00007fa924edfa55 00007fa924edf09d 00007fa927b1110e 00007fa927b2888c 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221
0709 12:10:30.050404 (+305409us) raft_consensus.cc:1685] finished
0709 12:10:30.050424 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:30.255696 (+205272us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3356,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":24939,"spinlock_wait_cycles":144711552,"thread_start_us":319679,"threads_started":1,"wal-append.queue_time_us":378105}
I20260709 12:10:30.312170 13687 rpcz_store.cc:276] 0709 12:10:28.995193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.995458 (+   265us) service_pool.cc:224] Handling call
0709 12:10:29.002664 (+  7206us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:29.002973 (+   309us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:29.003013 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:29.307169 (+304156us) log.cc:844] Serialized 26 byte log entry
0709 12:10:29.751482 (+444313us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:29.751520 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:29.751586 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:30.074078 (+322492us) raft_consensus.cc:1685] finished
0709 12:10:30.074105 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:30.074241 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":343963,"threads_started":1,"wal-append.queue_time_us":485958}
I20260709 12:10:30.266444 15787 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:30.310797 16065 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:30.338178 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:30.341367 13836 raft_consensus.cc:1240] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:30.272360 15883 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:30.326980 15945 raft_consensus.cc:2804] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:30.368633 13685 pending_rounds.cc:85] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 1
I20260709 12:10:30.378711 13685 pending_rounds.cc:107] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:10:30.378589 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:10:30.367341 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 49200.2us
I20260709 12:10:30.379658 13685 raft_consensus.cc:2889] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:30.342823 16046 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.926s	user 0.007s	sys 0.010s
I20260709 12:10:30.380245 13652 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:30.386898 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:30.387619 13681 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 3.
I20260709 12:10:30.394883 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:30.399421 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:30.318746 16050 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:30.350773 13686 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 5.
I20260709 12:10:30.402324 13828 raft_consensus.cc:2393] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 6: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:30.402921 13681 raft_consensus.cc:1275] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:10:30.403370 13681 pending_rounds.cc:85] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 2
I20260709 12:10:30.403635 13681 pending_rounds.cc:107] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:10:30.403924 13681 raft_consensus.cc:2889] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:30.407573 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:30.408452 13835 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 5.
I20260709 12:10:30.428982 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:30.430150 13833 raft_consensus.cc:2393] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 5: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:30.385929 16051 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:30.398941 15806 raft_consensus.cc:2749] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:30.347150 16047 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:30.434962 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 54774.3us
I20260709 12:10:30.425680 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:30.438175 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:30.438242 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:30.353506 15719 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:30.393944 15945 raft_consensus.cc:697] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:30.376854 15960 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:30.445299 13681 raft_consensus.cc:1275] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:10:30.437736 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:30.448954 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:30.487311 13652 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:30.449044 13835 raft_consensus.cc:2393] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 3: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:30.488148 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:30.489212 13832 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:30.497511 13758 raft_consensus.cc:1275] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:30.500967 13837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 348) took 1034 ms. Trace:
W20260709 12:10:30.501766 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 51121.8us
I20260709 12:10:30.373490 15998 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:30.501509 13837 rpcz_store.cc:276] 0709 12:10:29.466949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.467902 (+   953us) service_pool.cc:224] Handling call
0709 12:10:29.488219 (+ 20317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:29.622565 (+134346us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:10:30.039961 (+417396us) log.cc:844] Serialized 14 byte log entry
0709 12:10:30.380653 (+340692us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:30.380710 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:30.380770 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:30.500660 (+119890us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b540002dd54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:30.500726 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:30.500889 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":444699,"prepare.queue_time_us":426119,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":115,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":3614,"spinlock_wait_cycles":308392192,"thread_start_us":338066,"threads_started":1}
I20260709 12:10:30.508637 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:10:30.509372 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 65986.3us
I20260709 12:10:30.514636 13726 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:30.408484 16029 consensus_queue.cc:237] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:30.515417 13836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 342) took 1603 ms. Trace:
W20260709 12:10:30.619295 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 281321us
W20260709 12:10:30.710139 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 195577us
I20260709 12:10:30.785818 13726 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:10:30.661023 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.529708 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:30.529480 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:30.786916 15798 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:30.753121 13832 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 6.
I20260709 12:10:30.787850 13828 raft_consensus.cc:2393] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 3: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:30.789546 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:30.528971 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:30.436343 16051 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:30.790859 13833 raft_consensus.cc:2410] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:30.783473 13836 rpcz_store.cc:276] 0709 12:10:28.912147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.929518 (+ 17371us) service_pool.cc:224] Handling call
0709 12:10:28.929834 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:30.378951 (+1449117us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:30.515126 (+136175us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b54003babd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:30.515341 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3236256640}
I20260709 12:10:30.747221 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:30.801822 13834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 1927) took 1959 ms. Trace:
W20260709 12:10:30.639524 16091 log.cc:927] Time spent T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.080s	user 0.006s	sys 0.000s
I20260709 12:10:30.836956 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:30.842871 13835 pending_rounds.cc:85] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 1
I20260709 12:10:30.843003 13837 raft_consensus.cc:2410] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:30.843290 13835 pending_rounds.cc:107] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 4.2
I20260709 12:10:30.843750 13835 raft_consensus.cc:2889] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:30.559818 16084 log.cc:927] Time spent T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.168s	user 0.000s	sys 0.000s
W20260709 12:10:30.709470 16088 log.cc:927] Time spent T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 12:10:30.709719 15938 consensus_meta.cc:287] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.688s	user 0.007s	sys 0.003s
I20260709 12:10:30.847128 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:30.801765 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:10:30.847976 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 62266.6us
I20260709 12:10:30.845674 13837 raft_consensus.cc:1240] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:30.848145 13836 raft_consensus.cc:2393] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 5: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:30.795254 13832 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:30.515547 15806 raft_consensus.cc:2749] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:30.528999 15929 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:30.857000 13681 raft_consensus.cc:1275] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:30.857290 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:30.530023 16024 raft_consensus.cc:2749] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:30.508684 15960 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:30.865142 13682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 1852) took 1064 ms. Trace:
I20260709 12:10:30.865581 13682 rpcz_store.cc:276] 0709 12:10:29.800485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.368823 (+568338us) service_pool.cc:224] Handling call
0709 12:10:30.396535 (+ 27712us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:30.402762 (+  6227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:30.402792 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:30.428776 (+ 25984us) log.cc:844] Serialized 26 byte log entry
0709 12:10:30.786981 (+358205us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:30.787033 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:30.787107 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:30.864853 (+ 77746us) raft_consensus.cc:1685] finished
0709 12:10:30.864874 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:30.865081 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10720,"spinlock_wait_cycles":54159616,"thread_start_us":285351,"threads_started":1,"wal-append.queue_time_us":406659}
I20260709 12:10:30.856649 13679 raft_consensus.cc:1240] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 3 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:10:30.708621 15719 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:30.841005 16039 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:30.615726 16065 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:30.859442 13828 raft_consensus.cc:1240] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:30.859925 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:10:30.847442 16086 log.cc:927] Time spent T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.410s	user 0.001s	sys 0.000s
I20260709 12:10:30.840513 13834 rpcz_store.cc:276] 0709 12:10:28.842875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.843818 (+   943us) service_pool.cc:224] Handling call
0709 12:10:28.861983 (+ 18165us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:28.876009 (+ 14026us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:28.933154 (+ 57145us) log.cc:844] Serialized 14 byte log entry
0709 12:10:29.420047 (+486893us) spinlock_profiling.cc:243] Waited 24.2 ms on lock 0x7b48001bd758. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92ceb6aa1 00007fa92ceadb37 00007fa92cead9ca 00007fa92cfa526f 00007fa92cfa4f37 00007fa92cfb955c 00007fa92cfb9508 00007fa92cfb9488 00007fa92cfb9443 00007fa92cfb86ec 00007fa92bee2a96
0709 12:10:30.039780 (+619733us) log.cc:844] Serialized 14 byte log entry
0709 12:10:30.039980 (+   200us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:30.040430 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 12:10:30.049245 (+  8815us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:30.049290 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:30.049388 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:30.795802 (+746414us) raft_consensus.cc:1685] finished
0709 12:10:30.795865 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:30.801715 (+  5850us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1686399,"prepare.queue_time_us":724813,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":88,"raft.queue_time_us":376840,"raft.run_cpu_time_us":2514,"raft.run_wall_time_us":561884,"spinlock_wait_cycles":55716736,"thread_start_us":225768,"threads_started":3,"wal-append.queue_time_us":361756}
I20260709 12:10:30.862376 13726 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
W20260709 12:10:30.864023 16089 log.cc:927] Time spent T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.362s	user 0.000s	sys 0.001s
I20260709 12:10:30.863899 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:30.896445 14416 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:30.898695 13682 raft_consensus.cc:1240] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 3. Current term is 4. Ops: [3.5-3.5]
W20260709 12:10:30.903177 16067 log.cc:927] Time spent T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 1.165s	user 0.003s	sys 0.018s
I20260709 12:10:30.846879 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:30.876348 13837 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Advancing to term 6
W20260709 12:10:30.886618 16041 log.cc:927] Time spent T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 1.094s	user 0.001s	sys 0.008s
I20260709 12:10:30.887022 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:10:30.887893 16094 log.cc:927] Time spent T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
I20260709 12:10:30.891734 15848 raft_consensus.cc:3055] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:10:30.893849 16083 log.cc:927] Time spent T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.407s	user 0.001s	sys 0.000s
I20260709 12:10:30.893998 16050 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:30.528432 15945 consensus_queue.cc:237] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:30.864504 16046 consensus_queue.cc:1059] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:30.903684 15998 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:10:30.904243 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.904419 16047 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:30.853817 16054 consensus_queue.cc:1048] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 12:10:30.856206 16042 raft_consensus.cc:2749] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:30.964629 13684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 321) took 1545 ms. Trace:
I20260709 12:10:30.851680 15787 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:30.918897 13758 raft_consensus.cc:1275] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:10:30.921547 13680 consensus_meta.cc:287] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.545s	user 0.011s	sys 0.000s
I20260709 12:10:30.965354 13755 raft_consensus.cc:1275] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:10:30.965852 13680 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 5.
I20260709 12:10:30.966357 13680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 1856) took 1164 ms. Trace:
I20260709 12:10:30.966663 13680 rpcz_store.cc:276] 0709 12:10:29.801709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.194484 (+392775us) service_pool.cc:224] Handling call
0709 12:10:30.966300 (+771816us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:30.966755 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:30.926851 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:30.967931 13758 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 6.
I20260709 12:10:30.968544 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:30.969292 13834 raft_consensus.cc:2393] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 6: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
W20260709 12:10:30.932390 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 70131.8us
I20260709 12:10:30.934121 15848 raft_consensus.cc:740] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:30.971863 15848 consensus_queue.cc:260] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:30.939245 13683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 329) took 1327 ms. Trace:
I20260709 12:10:30.972975 13683 rpcz_store.cc:276] 0709 12:10:29.608806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.632970 (+ 24164us) service_pool.cc:224] Handling call
0709 12:10:29.738490 (+105520us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:29.770767 (+ 32277us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:29.770795 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:29.770834 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:29.770948 (+   114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:30.935724 (+1164776us) spinlock_profiling.cc:243] Waited 32 ms on lock 0x7b5400311fd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:30.935785 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:30.935996 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":73679232}
I20260709 12:10:30.938608 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:30.935537 16029 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:30.915441 16065 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:30.962165 15719 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:30.905388 16039 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:30.948866 13832 raft_consensus.cc:2468] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 4.
I20260709 12:10:30.965198 13684 rpcz_store.cc:276] 0709 12:10:29.418740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.418975 (+   235us) service_pool.cc:224] Handling call
0709 12:10:29.419443 (+   468us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:10:29.420038 (+   595us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:29.420080 (+    42us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:10:29.420975 (+   895us) log.cc:844] Serialized 78 byte log entry
0709 12:10:29.541228 (+120253us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:29.595744 (+ 54516us) log.cc:844] Serialized 14 byte log entry
0709 12:10:29.600496 (+  4752us) log.cc:844] Serialized 14 byte log entry
0709 12:10:29.605762 (+  5266us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:29.605893 (+   131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:30.902445 (+1296552us) spinlock_profiling.cc:243] Waited 9.21 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:10:30.964377 (+ 61932us) raft_consensus.cc:1685] finished
0709 12:10:30.964401 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:30.964557 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6968,"prepare.queue_time_us":340867,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":80,"raft.queue_time_us":11753,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":4828,"spinlock_wait_cycles":37561984,"thread_start_us":141335,"threads_started":2,"wal-append.queue_time_us":203452}
I20260709 12:10:30.990804 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:30.945691 15883 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:31.010389 13834 raft_consensus.cc:2410] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:31.013005 13828 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 4.
I20260709 12:10:31.013757 16042 consensus_queue.cc:1048] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:10:31.032152 16099 consensus_queue.cc:1059] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:31.033218 16047 consensus_queue.cc:1059] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:10:31.015020 15861 consensus_meta.cc:287] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.735s	user 0.011s	sys 0.001s
I20260709 12:10:31.034409 15861 raft_consensus.cc:2749] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:31.034914 16047 raft_consensus.cc:3055] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:31.035363 16047 raft_consensus.cc:740] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:31.036283 16047 consensus_queue.cc:260] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:30.989760 16029 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:30.991586 15719 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:31.038537 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:31.039963 16029 leader_election.cc:290] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:31.041483 14410 raft_consensus.cc:1275] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:31.040041 15719 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:31.021647 14416 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 6.
I20260709 12:10:31.037529 16047 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:31.043032 13830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 356) took 1013 ms. Trace:
I20260709 12:10:31.043310 13837 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 6.
I20260709 12:10:31.012964 16050 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:31.048993 13829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 349) took 1581 ms. Trace:
I20260709 12:10:31.049846 13830 rpcz_store.cc:276] 0709 12:10:30.029751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.029962 (+   211us) service_pool.cc:224] Handling call
0709 12:10:30.030331 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:30.030699 (+   368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:30.030735 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:30.031269 (+   534us) log.cc:844] Serialized 26 byte log entry
0709 12:10:30.089289 (+ 58020us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:30.089345 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:30.089440 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:31.042785 (+953345us) raft_consensus.cc:1685] finished
0709 12:10:31.042811 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:31.042967 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1260,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":109,"thread_start_us":57496,"threads_started":1,"wal-append.queue_time_us":345764}
I20260709 12:10:31.011006 16046 consensus_queue.cc:1048] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 12:10:31.011219 15998 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:31.088817 13837 pending_rounds.cc:85] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 1
I20260709 12:10:31.089278 13837 pending_rounds.cc:107] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:10:31.089610 13837 raft_consensus.cc:2889] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:31.093582 13833 raft_consensus.cc:3055] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:31.094146 13833 raft_consensus.cc:740] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:31.056641 13829 rpcz_store.cc:276] 0709 12:10:29.467387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.540889 (+ 73502us) service_pool.cc:224] Handling call
0709 12:10:29.561478 (+ 20589us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:29.582804 (+ 21326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:29.582851 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:29.592147 (+  9296us) log.cc:844] Serialized 26 byte log entry
0709 12:10:30.032365 (+440218us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:30.032406 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:30.032468 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:31.048725 (+1016257us) raft_consensus.cc:1685] finished
0709 12:10:31.048756 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:31.048914 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21572,"raft.queue_time_us":24550,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":9445,"thread_start_us":418018,"threads_started":1,"wal-append.queue_time_us":790244}
I20260709 12:10:31.041060 16054 consensus_queue.cc:1048] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.074s
I20260709 12:10:31.103199 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:10:31.105242 15926 consensus_meta.cc:287] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.727s	user 0.010s	sys 0.001s
W20260709 12:10:31.093132 13652 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 1.503s (SENT) [suppressed 14 similar messages]
W20260709 12:10:31.093735 16007 consensus_meta.cc:287] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 1.133s	user 0.013s	sys 0.000s
I20260709 12:10:31.113061 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:31.108047 13829 raft_consensus.cc:2393] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 5: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:31.047509 15775 consensus_queue.cc:1048] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 12:10:31.110954 13800 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:31.118770 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:10:31.121835 16108 log.cc:927] Time spent T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:10:31.124747 16100 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:31.084053 16050 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:31.127808 15861 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.128134 16050 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:31.129062 16050 raft_consensus.cc:2749] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:31.128578 15861 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:31.131726 15861 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:31.105736 15926 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:31.134063 15926 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:31.134956 13836 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 6.
I20260709 12:10:31.134063 13835 raft_consensus.cc:1275] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:31.143067 13835 raft_consensus.cc:1275] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:31.144670 16116 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.052742 16035 consensus_queue.cc:1048] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:10:31.145311 16116 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:31.147718 16116 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:31.147776 16065 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:31.150182 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:31.164999 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:31.160712 16035 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.166960 16035 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:31.152401 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:31.085036 15998 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:31.162031 13833 consensus_queue.cc:260] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:31.116336 16060 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.169487 16035 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:31.197387 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.150180 16011 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:10:31.174947 16096 log.cc:927] Time spent T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.312s	user 0.001s	sys 0.000s
I20260709 12:10:31.217993 13833 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:31.157764 16007 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:31.204425 16060 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:31.302531 16105 log.cc:927] Time spent T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.217s	user 0.000s	sys 0.000s
I20260709 12:10:31.219868 16035 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.225984 16011 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:31.222223 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 129108us
I20260709 12:10:31.310925 13727 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:31.344731 13760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 310) took 1077 ms. Trace:
I20260709 12:10:31.347442 13685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 1851) took 1547 ms. Trace:
I20260709 12:10:31.352259 13832 raft_consensus.cc:1240] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:31.350669 13685 rpcz_store.cc:276] 0709 12:10:29.800175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.367733 (+567558us) service_pool.cc:224] Handling call
0709 12:10:30.368328 (+   595us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:10:30.403965 (+ 35637us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:30.404033 (+    68us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:10:30.404861 (+   828us) log.cc:844] Serialized 78 byte log entry
0709 12:10:30.706774 (+301913us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:30.939778 (+233004us) log.cc:844] Serialized 14 byte log entry
0709 12:10:30.940270 (+   492us) log.cc:844] Serialized 14 byte log entry
0709 12:10:30.940540 (+   270us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:30.940656 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:31.347192 (+406536us) raft_consensus.cc:1685] finished
0709 12:10:31.347216 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:31.347384 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3745,"prepare.queue_time_us":561191,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":7849,"raft.run_cpu_time_us":338,"raft.run_wall_time_us":21483,"thread_start_us":398024,"threads_started":2,"wal-append.queue_time_us":777354}
W20260709 12:10:31.359572 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.349306 13760 rpcz_store.cc:276] 0709 12:10:30.267447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.267586 (+   139us) service_pool.cc:224] Handling call
0709 12:10:30.270280 (+  2694us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:30.278238 (+  7958us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:30.278270 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:30.287115 (+  8845us) log.cc:844] Serialized 26 byte log entry
0709 12:10:30.443093 (+155978us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:30.443140 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:30.443218 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:30.890376 (+447158us) spinlock_profiling.cc:243] Waited 2.09 ms on lock 0x7b48001a01d8. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92ceb6aa1 00007fa92ceadb37 00007fa92cead9ca 00007fa92cfa526f 00007fa92cfa4f37 00007fa92cfb955c 00007fa92cfb9508 00007fa92cfb9488 00007fa92cfb9443 00007fa92cfb86ec 00007fa92bee2a96
0709 12:10:31.304348 (+413972us) raft_consensus.cc:1685] finished
0709 12:10:31.304371 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:31.344624 (+ 40253us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19425,"raft.queue_time_us":122,"raft.run_cpu_time_us":11076,"raft.run_wall_time_us":610973,"spinlock_wait_cycles":4796800,"thread_start_us":109477,"threads_started":1,"wal-append.queue_time_us":318945}
I20260709 12:10:31.303943 16060 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:10:31.362480 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 51675.3us
I20260709 12:10:31.363767 13727 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:31.310551 16100 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.345968 16116 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.345461 15848 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:31.382254 13833 raft_consensus.cc:1275] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:10:31.303989 16039 leader_election.cc:290] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:10:31.382845 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 282826us
I20260709 12:10:31.390882 13833 pending_rounds.cc:85] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 1
I20260709 12:10:31.391479 13833 pending_rounds.cc:107] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:10:31.391919 13833 raft_consensus.cc:2889] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:31.384637 13727 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:31.403478 13800 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:31.403525 13757 raft_consensus.cc:1240] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:31.382326 15775 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:31.351372 16035 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:31.389926 16060 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:10:31.432428 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 47855.6us
I20260709 12:10:31.423677 15775 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:31.416280 15998 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:31.419024 15945 raft_consensus.cc:2749] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:31.438628 13800 leader_election.cc:400] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 election: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 5. Current term is 6.
I20260709 12:10:31.446524 13800 leader_election.cc:403] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:10:31.423729 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:31.443207 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:31.448956 13833 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:31.402107 16116 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:31.436667 16126 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.445886 15775 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:31.426146 16121 raft_consensus.cc:2749] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:31.463481 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:31.468015 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:31.472570 13835 raft_consensus.cc:2410] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:31.472477 13833 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 5.
I20260709 12:10:31.443120 15787 raft_consensus.cc:2804] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:31.453943 16124 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.469797 14407 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 4.
W20260709 12:10:31.455623 16113 log.cc:927] Time spent T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
W20260709 12:10:31.466602 16117 log.cc:927] Time spent T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 12:10:31.482539 16051 consensus_meta.cc:287] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.633s	user 0.011s	sys 0.000s
I20260709 12:10:31.479025 14416 raft_consensus.cc:1275] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:31.392443 16100 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:31.477015 15787 raft_consensus.cc:697] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:31.491214 15787 consensus_queue.cc:237] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:31.474985 15976 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:31.497150 15976 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:31.475179 15929 raft_consensus.cc:2749] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 5. Current term is 6.
I20260709 12:10:31.499303 15976 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:31.500113 16035 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:31.502417 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 70749.4us
I20260709 12:10:31.503206 13800 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:31.483028 16051 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:31.510645 13800 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:31.458560 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:31.442101 16060 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:31.477586 16124 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:31.528954 16100 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:31.531503 16124 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:31.534024 16007 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:31.458160 16126 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:31.535643 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:31.536856 16126 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:31.529258 16116 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:10:31.542981 13652 leader_election.cc:336] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 1.938s (SENT)
I20260709 12:10:31.543954 16060 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:10:31.524904 15802 consensus_meta.cc:287] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 1.245s	user 0.009s	sys 0.005s
I20260709 12:10:31.525094 16121 raft_consensus.cc:2749] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:31.522681 15929 raft_consensus.cc:2749] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:31.558282 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 47764.8us
I20260709 12:10:31.559052 14413 raft_consensus.cc:2468] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 3.
I20260709 12:10:31.552130 16007 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:31.559595 16029 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.578249 13800 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:31.576682 13830 raft_consensus.cc:1275] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:10:31.576774 16007 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:31.582185 15929 raft_consensus.cc:2764] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 12:10:31.587037 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:31.587711 14415 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 3.
I20260709 12:10:31.588653 14408 raft_consensus.cc:1275] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:10:31.590047 16047 consensus_meta.cc:287] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.538s	user 0.009s	sys 0.002s
I20260709 12:10:31.591850 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:31.592475 13835 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 5.
I20260709 12:10:31.592602 13800 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:31.594396 13800 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:31.596887 13800 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:31.599368 13727 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:31.579872 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:31.602936 13800 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:31.604242 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:31.585613 16007 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:31.617857 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:31.618512 13830 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 3.
I20260709 12:10:31.618185 13800 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:31.599462 16121 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:31.600128 15929 raft_consensus.cc:2749] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:31.589488 15775 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:31.601997 16047 raft_consensus.cc:2804] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:31.580945 16029 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:31.605060 15926 raft_consensus.cc:2804] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:31.648653 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.617017 16065 raft_consensus.cc:2804] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:31.620380 16050 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.655493 13759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 1953) took 1260 ms. Trace:
I20260709 12:10:31.654672 15953 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:31.623430 16007 raft_consensus.cc:2749] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:31.623723 16047 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:31.669627 15953 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:31.665431 13759 rpcz_store.cc:276] 0709 12:10:30.395316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.443251 (+ 47935us) service_pool.cc:224] Handling call
0709 12:10:30.495890 (+ 52639us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:30.496381 (+   491us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:30.496428 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:30.507480 (+ 11052us) log.cc:844] Serialized 26 byte log entry
0709 12:10:31.346792 (+839312us) spinlock_profiling.cc:243] Waited 2.33 ms on lock 0x7b180036ee60. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e82e07 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9fc02 00007fa927b2720b 00007fa927b2cd23 00007fa927b2d0d1 00007fa927f48a0f
0709 12:10:31.485207 (+138415us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:31.485266 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:31.485372 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:31.655197 (+169825us) raft_consensus.cc:1685] finished
0709 12:10:31.655215 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:31.655432 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1944,"raft.queue_time_us":5823,"raft.run_cpu_time_us":326,"raft.run_wall_time_us":19254,"spinlock_wait_cycles":5362944,"thread_start_us":138178,"threads_started":1,"wal-append.queue_time_us":1058028}
I20260709 12:10:31.669871 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:31.605294 16126 consensus_queue.cc:1048] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 12:10:31.663762 15775 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:31.652350 16065 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:31.650272 15926 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:10:31.676246 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 58173.4us
I20260709 12:10:31.677474 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:31.668720 16050 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:31.678290 13829 raft_consensus.cc:2393] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 4: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:31.670609 16047 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:31.678431 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:31.676204 16065 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:31.676575 14409 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:31.687212 15775 consensus_queue.cc:1048] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:31.692034 16042 raft_consensus.cc:3055] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:31.692566 16042 raft_consensus.cc:740] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:31.678817 15926 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:31.696234 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.708297 13652 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:31.694916 16039 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:31.697634 15798 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.697595 15998 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.716660 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:31.718398 15998 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:31.719444 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.718847 15953 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:31.720621 15953 raft_consensus.cc:2749] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:31.721019 15998 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:31.723125 16114 log.cc:927] Time spent T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.616s	user 0.002s	sys 0.001s
I20260709 12:10:31.715494 16039 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:31.734638 13727 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:31.737923 16129 raft_consensus.cc:2749] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:31.739603 15775 consensus_queue.cc:1059] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:31.741564 16132 raft_consensus.cc:3055] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:31.745841 13727 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:31.747246 16130 raft_consensus.cc:2749] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:31.726377 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:31.726089 15798 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:31.758738 13829 raft_consensus.cc:1275] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:31.759765 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:31.693511 16042 consensus_queue.cc:260] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:31.760526 13837 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 6.
W20260709 12:10:31.762583 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 54372.1us
I20260709 12:10:31.761209 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:31.763682 13835 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 3.
I20260709 12:10:31.742219 16132 raft_consensus.cc:740] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:31.726018 16039 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:31.771049 13829 raft_consensus.cc:1240] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:31.778000 13652 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:31.781296 13727 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:31.787503 13727 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:31.800310 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:10:31.802228 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 79104.9us
I20260709 12:10:31.806478 13800 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:31.761132 16116 consensus_queue.cc:1059] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:10:31.789296 15945 raft_consensus.cc:2804] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:31.817386 13829 raft_consensus.cc:1275] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:10:31.799569 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:31.817907 13829 pending_rounds.cc:85] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 4
I20260709 12:10:31.818884 13800 leader_election.cc:304] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:31.819846 13829 pending_rounds.cc:107] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:10:31.820215 13829 raft_consensus.cc:2889] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:31.804548 16141 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:31.809680 16007 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.799588 15967 consensus_queue.cc:1048] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:10:31.790625 16011 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:31.830739 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 61925.7us
I20260709 12:10:31.822713 16035 raft_consensus.cc:2804] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:31.817637 16142 raft_consensus.cc:2749] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:31.819460 16121 raft_consensus.cc:2749] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:31.824044 15945 raft_consensus.cc:697] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:31.838271 16039 consensus_queue.cc:1059] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:10:31.839041 16111 log.cc:927] Time spent T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.736s	user 0.000s	sys 0.007s
I20260709 12:10:31.841180 16042 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:31.842540 14413 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 647) took 2041 ms (client timeout 1830 ms). Trace:
I20260709 12:10:31.841760 16065 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:31.843185 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:31.832103 16050 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:31.825863 14380 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:31.851863 13832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 1954) took 1005 ms. Trace:
I20260709 12:10:31.852864 13681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1199) took 1605 ms. Trace:
W20260709 12:10:31.889537 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 63794.8us
I20260709 12:10:31.844192 15938 raft_consensus.cc:2749] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:31.889355 13832 rpcz_store.cc:276] 0709 12:10:30.846415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.016518 (+170103us) service_pool.cc:224] Handling call
0709 12:10:31.073326 (+ 56808us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:31.352831 (+279505us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:31.851506 (+498675us) spinlock_profiling.cc:243] Waited 279 ms on lock 0x7b540002d354. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:31.851754 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":640850304}
W20260709 12:10:31.858107 14413 rpcz_store.cc:269] 0709 12:10:29.790869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.793963 (+  3094us) service_pool.cc:224] Handling call
0709 12:10:31.832091 (+2038128us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b54006d0e54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:31.832228 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3507988736}
I20260709 12:10:31.890389 14380 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:31.889722 13681 rpcz_store.cc:276] 0709 12:10:30.247400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.749792 (+502392us) service_pool.cc:224] Handling call
0709 12:10:30.840339 (+ 90547us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:30.857425 (+ 17086us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:31.852532 (+995107us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b540019a854. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:31.852779 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32961280}
I20260709 12:10:31.845134 16035 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:31.908885 14409 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 4.
I20260709 12:10:31.831014 16141 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:31.938864 15953 consensus_queue.cc:1048] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:31.832481 16007 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:31.915166 15802 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:10:31.946583 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 127758us
I20260709 12:10:31.916540 16035 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:31.915294 15998 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.947710 13800 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:31.956116 13800 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:31.957134 16121 raft_consensus.cc:2804] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:31.957404 16050 raft_consensus.cc:2749] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:31.957569 16121 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:31.933497 16133 raft_consensus.cc:2804] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:31.825969 16132 consensus_queue.cc:260] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:31.958689 13800 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
W20260709 12:10:31.964555 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:31.965545 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.966531 15967 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:31.967273 15967 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:31.970005 15967 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:31.988749 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 201342us
I20260709 12:10:31.947219 15802 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:31.998355 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:31.954417 15929 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.006186 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:32.008432 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:10:31.967300 16143 log.cc:927] Time spent T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:10:32.007683 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:32.009578 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:32.004345 13835 raft_consensus.cc:2376] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 6. Re-sending same reply.
I20260709 12:10:32.014750 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:31.960636 16133 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:31.960703 16121 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:32.026310 13836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54820 (request call id 1953) took 1180 ms. Trace:
W20260709 12:10:32.027060 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.019821 13831 raft_consensus.cc:2393] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 5: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:32.038892 13837 raft_consensus.cc:2393] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 6: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
W20260709 12:10:32.046171 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 155876us
I20260709 12:10:32.040706 13836 rpcz_store.cc:276] 0709 12:10:30.846081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.857042 (+ 10961us) service_pool.cc:224] Handling call
0709 12:10:32.026095 (+1169053us) spinlock_profiling.cc:243] Waited 277 ms on lock 0x7b54001676d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:32.026240 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":636738944}
I20260709 12:10:32.048236 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:32.049045 13836 raft_consensus.cc:2393] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 5: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:32.024217 16030 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:31.998548 16141 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:32.053884 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:32.059305 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:32.051442 16030 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:32.020642 16149 consensus_queue.cc:1048] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 12:10:32.035449 16031 raft_consensus.cc:3055] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:32.011703 15802 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:32.012967 16132 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:31.992463 16151 raft_consensus.cc:2804] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:32.023918 16133 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:32.041697 16039 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:32.102126 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:32.100036 13836 raft_consensus.cc:2393] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 3: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:32.100303 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:32.110138 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:32.110790 13829 raft_consensus.cc:2376] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 4. Re-sending same reply.
I20260709 12:10:32.111666 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:32.112389 13829 raft_consensus.cc:2393] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 7: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:32.113183 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:31.993765 15998 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:32.102057 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 114738us
I20260709 12:10:32.108703 13837 raft_consensus.cc:2376] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 6. Re-sending same reply.
I20260709 12:10:32.119072 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:32.029506 16142 raft_consensus.cc:3055] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:32.120776 16142 raft_consensus.cc:740] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:32.115916 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:32.016017 15929 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:32.127583 16030 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:31.996599 15945 consensus_queue.cc:237] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:32.116998 16039 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:32.104043 16031 raft_consensus.cc:740] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
W20260709 12:10:32.134313 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 281459us
I20260709 12:10:32.020910 16070 consensus_queue.cc:1059] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.095s
I20260709 12:10:32.130945 15802 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:32.146560 13686 raft_consensus.cc:1240] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:32.149847 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:32.107399 16151 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:32.142441 16051 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:32.152673 13685 raft_consensus.cc:2468] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 3.
I20260709 12:10:32.154989 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:32.155678 13686 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 4.
I20260709 12:10:32.155929 16031 consensus_queue.cc:260] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:32.157130 16031 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:32.158095 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:32.158905 13684 raft_consensus.cc:2410] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:32.159132 13687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 1853) took 2358 ms. Trace:
W20260709 12:10:32.160567 14380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.159484 13687 rpcz_store.cc:276] 0709 12:10:29.800807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.381167 (+580360us) service_pool.cc:224] Handling call
0709 12:10:30.405090 (+ 23923us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:30.405350 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:30.625308 (+219958us) log.cc:844] Serialized 14 byte log entry
0709 12:10:30.922448 (+297140us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:30.922512 (+    64us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:30.922580 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:30.922690 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:31.722562 (+799872us) spinlock_profiling.cc:243] Waited 7.49 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:10:32.158972 (+436410us) spinlock_profiling.cc:243] Waited 23.3 ms on lock 0x7b54002bf7d0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:32.159077 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":661156,"prepare.run_cpu_time_us":124,"prepare.run_wall_time_us":5027,"raft.queue_time_us":132,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":117,"spinlock_wait_cycles":70867200,"thread_start_us":422995,"threads_started":2,"wal-append.queue_time_us":465901}
I20260709 12:10:32.162523 16135 consensus_queue.cc:1048] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:32.163259 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:32.163470 16039 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:32.166257 14410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 660) took 1987 ms. Trace:
I20260709 12:10:32.166355 16155 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:32.166766 14410 rpcz_store.cc:276] 0709 12:10:30.179084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.189131 (+ 10047us) service_pool.cc:224] Handling call
0709 12:10:30.256655 (+ 67524us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:31.041934 (+785279us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:32.166008 (+1124074us) spinlock_profiling.cc:243] Waited 784 ms on lock 0x7b540016b7d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:32.166164 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1804059520}
I20260709 12:10:32.166953 16155 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:32.167161 16163 consensus_queue.cc:1048] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:32.168684 16157 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.169303 16163 consensus_queue.cc:1048] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:32.169246 16157 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:32.169329 16155 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:32.171516 16157 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:32.172979 16065 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:32.174065 16011 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:32.174880 13834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 1956) took 1327 ms. Trace:
I20260709 12:10:32.175457 15929 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:32.175781 15998 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:32.146756 16007 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:32.132931 16100 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:32.177358 16100 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:32.131995 16047 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:32.186688 13829 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 3.
I20260709 12:10:32.175338 13834 rpcz_store.cc:276] 0709 12:10:30.847002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.039599 (+192597us) service_pool.cc:224] Handling call
0709 12:10:31.039920 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:31.126894 (+ 86974us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:31.127229 (+   335us) log.cc:844] Serialized 14 byte log entry
0709 12:10:31.234607 (+107378us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:31.234668 (+    61us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:31.234720 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:32.174627 (+939907us) spinlock_profiling.cc:243] Waited 86.7 ms on lock 0x7b54000af5d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:32.174679 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:32.174813 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":608,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":543,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":6297,"spinlock_wait_cycles":199442816,"thread_start_us":106455,"threads_started":1,"wal-append.queue_time_us":312597}
I20260709 12:10:32.187490 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:32.194743 16133 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:32.197165 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:32.198871 15926 consensus_meta.cc:287] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.505s	user 0.008s	sys 0.004s
I20260709 12:10:32.199206 16133 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 4 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:32.199350 15926 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:32.200697 13834 raft_consensus.cc:1240] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:32.151106 13727 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:32.190793 13836 raft_consensus.cc:1240] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 8. Current term is 9. Ops: []
W20260709 12:10:32.215855 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.223227 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:32.224076 13829 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:32.224261 16131 consensus_queue.cc:1059] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:32.225215 15861 raft_consensus.cc:3055] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:32.225625 15861 raft_consensus.cc:740] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:32.226598 15861 consensus_queue.cc:260] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:32.226930 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 75899.7us
I20260709 12:10:32.227403 16126 raft_consensus.cc:2804] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:32.227830 16126 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:32.228302 16126 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:32.154047 16151 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:32.232961 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.227887 15861 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:32.233618 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.247766 13727 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:32.236562 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:32.244771 16030 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:32.245524 14408 raft_consensus.cc:1275] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:32.246274 15925 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:32.249709 13687 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 4.
I20260709 12:10:32.255079 15775 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:32.254940 16030 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:32.252290 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:32.267138 13829 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 4.
I20260709 12:10:32.270563 14380 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:32.273939 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:32.181924 16142 consensus_queue.cc:260] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:32.285102 14379 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
W20260709 12:10:32.281837 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 128184us
I20260709 12:10:32.251142 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:32.255762 15775 raft_consensus.cc:697] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:32.293056 13829 raft_consensus.cc:1275] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:10:32.293921 16159 log.cc:927] Time spent T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.227s	user 0.004s	sys 0.000s
I20260709 12:10:32.293521 15775 consensus_queue.cc:237] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:32.289196 14379 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:32.282359 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:32.298681 15848 raft_consensus.cc:2804] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:32.299232 15926 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:32.300998 14379 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:32.301950 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:32.302493 16015 raft_consensus.cc:2804] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:32.303088 16015 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:32.303539 16015 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:32.299255 15848 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:32.302625 16030 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:32.305807 15848 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:32.306526 16126 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:32.308519 16144 raft_consensus.cc:2804] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:32.309028 16144 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:32.309481 16144 raft_consensus.cc:3060] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:32.310416 13836 raft_consensus.cc:1240] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:32.311372 16126 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:32.312958 16015 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:32.313701 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.319864 13836 raft_consensus.cc:1275] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:10:32.326040 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 159317us
W20260709 12:10:32.320468 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 130017us
I20260709 12:10:32.328594 13651 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:32.281360 16133 raft_consensus.cc:2804] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:32.336946 13652 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:32.334784 13651 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:32.335980 16155 raft_consensus.cc:2749] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:32.340356 16047 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:32.297669 16121 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:32.342342 16133 raft_consensus.cc:697] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 4 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:32.348382 16142 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:32.400022 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 65350.1us
I20260709 12:10:32.405435 13828 raft_consensus.cc:1240] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:32.347397 16157 consensus_queue.cc:1048] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
W20260709 12:10:32.419196 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 82344.3us
I20260709 12:10:32.354372 16164 consensus_queue.cc:1048] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 12:10:32.432057 13652 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:32.380060 16035 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:32.440831 16167 raft_consensus.cc:2804] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:32.486200 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 54291.4us
I20260709 12:10:32.488405 13652 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:10:32.499030 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.485167 16167 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:32.441809 16100 leader_election.cc:290] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:32.495020 16165 log.cc:927] Time spent T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:10:32.509637 16155 raft_consensus.cc:2749] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:32.511300 16164 raft_consensus.cc:2749] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:32.510659 13652 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:32.506439 16167 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:32.514045 13652 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:10:32.516230 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 115084us
I20260709 12:10:32.502828 15960 raft_consensus.cc:3055] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:32.530113 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:32.530783 13687 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:32.532388 13835 raft_consensus.cc:1240] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:32.514202 16164 raft_consensus.cc:2749] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:32.524207 15960 raft_consensus.cc:740] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:32.501710 16133 consensus_queue.cc:237] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:32.647369 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:32.687556 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:32.649034 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:10:32.696841 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 182831us
I20260709 12:10:32.721913 13685 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:32.670035 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 71542.8us
I20260709 12:10:32.722918 13652 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:10:32.645119 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.647151 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:32.649511 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:32.647800 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:32.682996 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:32.731173 13683 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 7.
W20260709 12:10:32.556280 16171 log.cc:927] Time spent T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 12:10:32.561079 16042 consensus_meta.cc:287] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.674s	user 0.005s	sys 0.006s
W20260709 12:10:32.713284 16031 consensus_meta.cc:287] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.556s	user 0.010s	sys 0.003s
I20260709 12:10:32.527957 16015 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 5 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:32.754091 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:32.772503 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:32.772842 13686 raft_consensus.cc:2393] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 6: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:32.757956 13687 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 5.
I20260709 12:10:32.568656 16154 consensus_queue.cc:1059] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.195s
I20260709 12:10:32.668916 16051 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:32.590694 16174 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:32.573939 16173 raft_consensus.cc:2804] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:32.763818 15960 consensus_queue.cc:260] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:32.787489 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:32.764815 16134 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:32.712772 15938 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:32.711014 16175 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.563675 16054 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.769613 13685 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 5.
I20260709 12:10:32.528193 15926 consensus_queue.cc:1048] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.221s
I20260709 12:10:32.586932 16035 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:32.566358 16121 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:32.642901 16157 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:32.646322 15945 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:32.533578 15848 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:32.647356 15775 consensus_queue.cc:1059] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.127s
I20260709 12:10:32.643103 15941 consensus_queue.cc:1048] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.133s
I20260709 12:10:32.791592 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:32.679108 16144 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:32.644354 16130 consensus_queue.cc:1048] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.134s
I20260709 12:10:32.800733 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:32.826726 13687 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:32.803158 16134 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:32.804082 16185 raft_consensus.cc:2749] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:32.831740 13759 raft_consensus.cc:1275] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:32.782590 16051 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:32.822232 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.823310 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:32.835772 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:32.836508 13755 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 7.
I20260709 12:10:32.547607 16135 consensus_queue.cc:1059] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.260s
I20260709 12:10:32.838973 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:32.815115 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:32.800028 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:32.782145 16042 consensus_queue.cc:1059] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:10:32.788053 16174 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:32.805349 15960 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:32.831624 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:32.858136 13763 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 4.
I20260709 12:10:32.783864 16149 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:32.783325 16173 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:32.832563 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:10:32.838222 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.811161 15965 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:32.807353 16054 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:32.570042 16156 log.cc:927] Time spent T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.444s	user 0.001s	sys 0.011s
I20260709 12:10:32.814049 15787 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:32.843658 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:32.877211 13682 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 8.
I20260709 12:10:32.855410 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:32.823964 16035 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.856186 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:32.879207 13759 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 4.
I20260709 12:10:32.857517 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:32.853421 16121 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:32.855791 15925 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:32.842900 16179 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:32.870424 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:32.896785 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:32.896731 16179 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:32.804646 16175 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:32.898020 13681 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 2.
I20260709 12:10:32.873442 14379 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:32.843765 14411 raft_consensus.cc:1240] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:32.843318 15861 consensus_meta.cc:287] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.585s	user 0.007s	sys 0.005s
I20260709 12:10:32.883041 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:32.899276 16179 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:32.899513 16175 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:32.899709 13684 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:32.900139 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.899727 13683 raft_consensus.cc:2410] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:32.902282 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:32.903260 16177 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.903836 16177 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:32.906226 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:32.906785 16154 raft_consensus.cc:2804] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:32.907302 13682 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:32.907383 16154 raft_consensus.cc:697] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 5 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:32.908167 13684 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 5.
I20260709 12:10:32.887838 13687 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 7.
I20260709 12:10:32.821375 15945 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:32.908653 16154 consensus_queue.cc:237] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:32.909556 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:32.910857 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:32.911054 15945 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:32.888852 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:32.911861 16174 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:32.912037 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:32.912910 13687 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 3.
I20260709 12:10:32.914286 13687 raft_consensus.cc:1275] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:10:32.865250 16151 consensus_meta.cc:287] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.634s	user 0.014s	sys 0.000s
I20260709 12:10:32.918143 16151 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:32.890553 16035 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:32.802093 15938 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:32.893200 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:32.860375 14407 raft_consensus.cc:1240] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:32.922988 13760 raft_consensus.cc:2393] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 4: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:32.923794 15938 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:32.926724 13761 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 6.
I20260709 12:10:32.931432 16051 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:32.932950 16035 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:32.940590 16029 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199)
I20260709 12:10:32.956905 13682 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 4.
I20260709 12:10:32.870000 16173 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:32.961680 16029 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.961891 15925 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:32.963011 15848 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 5 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:32.964681 16134 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:32.869940 16149 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:32.966246 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:32.967034 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:32.975904 16126 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.978215 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:32.998494 13833 raft_consensus.cc:2393] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 4: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:10:32.979065 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:32.999555 13828 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 4.
I20260709 12:10:32.982599 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:33.000909 13836 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:32.958240 16132 consensus_meta.cc:287] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.843s	user 0.007s	sys 0.009s
I20260709 12:10:33.002399 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:33.003068 13831 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 5.
I20260709 12:10:33.003137 13829 raft_consensus.cc:1240] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:33.004142 16158 log.cc:927] Time spent T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.875s	user 0.004s	sys 0.000s
I20260709 12:10:33.004805 13829 raft_consensus.cc:1275] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:33.005930 13757 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 5.
I20260709 12:10:33.006989 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:33.007966 16015 raft_consensus.cc:3055] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:33.008189 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:33.008461 16015 raft_consensus.cc:740] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:32.875555 15965 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:33.009479 16015 consensus_queue.cc:260] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:33.011713 15965 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:33.011971 15976 consensus_queue.cc:1059] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:10:33.014019 16180 log.cc:927] Time spent T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:10:33.014636 16015 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:32.889844 15787 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:33.017292 15787 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:33.020236 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:33.021013 13681 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 7.
I20260709 12:10:33.009440 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:33.022310 13760 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 3.
I20260709 12:10:33.023295 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:33.023888 13760 raft_consensus.cc:2376] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 4. Re-sending same reply.
I20260709 12:10:33.025094 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:33.026473 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:33.028108 13760 raft_consensus.cc:1275] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:10:33.031936 13761 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48120 (request call id 1371) took 2964 ms (client timeout 2061 ms). Trace:
W20260709 12:10:33.032446 13761 rpcz_store.cc:269] 0709 12:10:30.067076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.067183 (+   107us) service_pool.cc:224] Handling call
0709 12:10:33.031702 (+2964519us) spinlock_profiling.cc:243] Waited 2.62 s on lock 0x7b540004fe54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:33.031817 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6025668352}
I20260709 12:10:32.994661 15925 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:33.038205 16051 consensus_queue.cc:1059] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:33.039168 15938 raft_consensus.cc:3055] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:33.039552 15938 raft_consensus.cc:740] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:33.040333 15938 consensus_queue.cc:260] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:33.041499 15938 raft_consensus.cc:3060] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:32.921216 16151 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:33.046101 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:33.052054 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:33.058842 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:33.059769 13834 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:33.062264 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 339429us
I20260709 12:10:33.029490 16054 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:33.076493 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:33.087158 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:33.109694 13830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 368) took 1292 ms. Trace:
I20260709 12:10:33.112831 13800 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:33.136719 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:33.137671 15798 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:33.138386 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:33.065392 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:33.140637 13761 raft_consensus.cc:2368] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 6. Current term is 7.
I20260709 12:10:33.074251 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:33.142467 13754 raft_consensus.cc:2393] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 4: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:33.143667 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:33.145788 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:33.147560 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:33.118750 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:10:33.118906 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.148990 13833 raft_consensus.cc:2468] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 4.
W20260709 12:10:33.149667 16148 log.cc:927] Time spent T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 1.234s	user 0.000s	sys 0.002s
I20260709 12:10:33.150611 13681 raft_consensus.cc:2376] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 5. Re-sending same reply.
I20260709 12:10:33.151993 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:33.123344 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:32.958602 16121 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:33.153108 13683 raft_consensus.cc:2393] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 3: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:33.154031 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:33.154491 16121 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:33.048552 16126 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:33.155179 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:33.156081 13683 raft_consensus.cc:2410] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:33.156754 16126 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:33.141701 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:33.157305 13683 raft_consensus.cc:1275] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:10:33.157639 13761 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 6.
I20260709 12:10:33.063598 13652 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:33.157683 13683 pending_rounds.cc:85] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 5
I20260709 12:10:33.158790 13683 pending_rounds.cc:107] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:10:33.159207 13683 raft_consensus.cc:2889] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:33.112208 13830 rpcz_store.cc:276] 0709 12:10:31.816863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.817312 (+   449us) service_pool.cc:224] Handling call
0709 12:10:31.826930 (+  9618us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:31.827167 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:10:31.855745 (+ 28578us) log.cc:844] Serialized 14 byte log entry
0709 12:10:32.589417 (+733672us) spinlock_profiling.cc:243] Waited 3.32 ms on lock 0x7b1800408be0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e82e07 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9fc02 00007fa927b2720b 00007fa927b2cd23 00007fa927b2d23a 00007fa927f97a2a
0709 12:10:33.107392 (+517975us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:33.107477 (+    85us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:33.107560 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.107669 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:33.109623 (+  1954us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":28488,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":48,"raft.queue_time_us":45603,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":5153,"spinlock_wait_cycles":7628544,"thread_start_us":517504,"threads_started":2,"wal-append.queue_time_us":967947}
I20260709 12:10:33.162765 13681 raft_consensus.cc:1240] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 12:10:33.166500 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 53768.8us
I20260709 12:10:33.167098 14410 raft_consensus.cc:1240] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:10:33.167573 13800 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:33.168854 16121 raft_consensus.cc:2749] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:10:33.169363 16142 consensus_meta.cc:287] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.768s	user 0.007s	sys 0.002s
I20260709 12:10:33.169896 16121 raft_consensus.cc:2804] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:33.170471 16121 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:33.170974 16121 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:33.174077 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 97872.8us
I20260709 12:10:33.175326 16144 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 4 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:33.176028 14380 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:33.179385 16186 consensus_queue.cc:1048] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:33.122401 16151 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:33.180495 16151 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:33.180655 13800 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:10:33.182297 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 118762us
I20260709 12:10:33.182708 15953 raft_consensus.cc:2804] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:33.183166 13652 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:33.184113 16149 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:33.185173 15798 raft_consensus.cc:2749] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:33.186515 16179 raft_consensus.cc:2749] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:33.183324 15953 raft_consensus.cc:697] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 4 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:33.179709 16157 raft_consensus.cc:2749] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:33.189214 13800 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:33.187721 13652 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:33.195749 13834 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 7.
I20260709 12:10:33.199092 13760 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 5.
I20260709 12:10:32.997648 16029 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:33.208092 13800 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:33.219076 13836 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 6.
I20260709 12:10:33.220105 13800 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:10:33.218168 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 68675.5us
I20260709 12:10:33.222368 13727 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:33.222647 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:33.221570 13686 raft_consensus.cc:2410] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:33.223503 13800 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:33.224748 13800 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:10:33.236972 14380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.124619 16177 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:33.258810 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:33.211243 16144 raft_consensus.cc:2804] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:33.182775 16151 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:33.271927 16144 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:33.272274 16151 raft_consensus.cc:2804] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:33.272356 16144 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:33.272806 16151 raft_consensus.cc:697] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 7 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:33.255357 15926 raft_consensus.cc:2749] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:33.273730 16151 consensus_queue.cc:237] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:33.274828 15926 raft_consensus.cc:2804] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:33.219511 16031 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:33.275369 15926 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:33.236681 15798 raft_consensus.cc:2804] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:33.275933 15926 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:33.276085 15798 raft_consensus.cc:697] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 5 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:33.277107 15798 consensus_queue.cc:237] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:33.277742 16167 consensus_meta.cc:287] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.754s	user 0.002s	sys 0.008s
I20260709 12:10:33.278175 16167 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:33.278314 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:33.258625 15941 consensus_queue.cc:1048] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:10:33.280268 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:33.281064 13682 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:33.257952 16051 raft_consensus.cc:2804] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:33.282704 16051 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:33.283241 16051 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:33.255977 16173 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:33.287928 13680 raft_consensus.cc:2368] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 6. Current term is 7.
I20260709 12:10:33.275677 16031 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:33.270885 15953 consensus_queue.cc:237] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:33.318486 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.322753 13679 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 5.
W20260709 12:10:33.325222 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:33.327708 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 105441us
I20260709 12:10:33.327852 16126 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:33.268805 16039 raft_consensus.cc:2749] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:10:33.325157 16143 log.cc:927] Time spent T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:10:33.350436 16191 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:33.363389 16191 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:33.329695 16015 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:33.378543 15967 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.351s	user 0.011s	sys 0.020s
I20260709 12:10:33.349844 16060 consensus_queue.cc:1059] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.090s
I20260709 12:10:33.331552 16121 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:33.338393 16193 consensus_queue.cc:1059] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.120s
W20260709 12:10:33.439101 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 108084us
I20260709 12:10:33.431949 16126 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.523198 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:33.480509 13757 raft_consensus.cc:1275] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:10:33.477111 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 252430us
W20260709 12:10:33.440050 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:33.519302 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.368901 13682 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 5.
I20260709 12:10:33.536665 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:33.540230 13755 raft_consensus.cc:2376] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 6. Re-sending same reply.
W20260709 12:10:33.528541 15967 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.499s	user 0.017s	sys 0.022s
I20260709 12:10:33.434370 16184 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.542541 14379 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:10:33.524827 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 337143us
I20260709 12:10:33.528086 16173 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:33.542893 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:33.541662 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:33.555646 13682 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 2.
I20260709 12:10:33.555065 14410 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 5.
I20260709 12:10:33.433346 16015 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:33.559255 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:33.559844 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:33.562178 14410 raft_consensus.cc:2468] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 4.
I20260709 12:10:33.563803 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:10:33.547557 16205 log.cc:927] Time spent T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 12:10:33.568125 13727 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:33.569279 13727 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:33.571210 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:33.544435 16167 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:10:33.575712 13652 connection.cc:256] RPC call timeout handler was delayed by -1.6570442800000365s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1545s for a response
I20260709 12:10:33.559449 16197 raft_consensus.cc:2804] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:10:33.578260 13652 connection.cc:256] RPC call timeout handler was delayed by -1.4830851730000632s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.27540000000000003s for a response
W20260709 12:10:33.581228 13652 connection.cc:256] RPC call timeout handler was delayed by -1.2115442799999983s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20400000000000001s for a response
I20260709 12:10:33.582695 13652 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:33.583290 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:33.584230 13682 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:33.592751 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:33.544857 16126 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:33.601398 13652 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:33.558997 16190 consensus_queue.cc:1048] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:10:33.612509 13652 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:33.581453 16173 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:33.582119 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:33.621331 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:33.656179 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:33.657087 13685 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 6.
I20260709 12:10:33.617928 14407 raft_consensus.cc:1275] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:33.616899 16039 raft_consensus.cc:2749] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:33.602003 16213 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:33.617950 16185 raft_consensus.cc:2749] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:33.664390 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 126065us
I20260709 12:10:33.618116 16167 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:33.621289 16029 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:33.673151 13800 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:33.676055 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:33.678030 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:33.674579 13800 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:10:33.696532 13726 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.011s	sys 0.022s
W20260709 12:10:33.697072 13726 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.011s	sys 0.022s
I20260709 12:10:33.642405 16031 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:10:33.697485 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 506510us
I20260709 12:10:33.678793 13652 leader_election.cc:304] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:33.706463 13682 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 6.
W20260709 12:10:33.707922 14380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.708324 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:10:33.709234 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:33.710700 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 87935.6us
I20260709 12:10:33.552837 16184 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:33.623219 16173 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:33.709687 14408 raft_consensus.cc:1275] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:33.788501 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:33.792153 13652 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:10:33.732442 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 57931.5us
I20260709 12:10:33.751240 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:33.752254 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:33.755270 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:33.795341 13682 raft_consensus.cc:3060] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:33.715935 16185 raft_consensus.cc:2804] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:33.670039 16213 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:33.804265 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:33.749888 16121 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:33.714789 16191 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:33.756197 15798 raft_consensus.cc:2804] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:10:33.785791 16195 log.cc:927] Time spent T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.245s	user 0.001s	sys 0.000s
I20260709 12:10:33.671041 13755 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:10:33.814007 13755 raft_consensus.cc:606] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:33.814546 13755 raft_consensus.cc:614] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:33.810014 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:33.784889 16197 raft_consensus.cc:697] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 5 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:33.820096 13685 raft_consensus.cc:2393] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 3: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:33.821357 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:33.822472 13685 raft_consensus.cc:2468] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 3.
I20260709 12:10:33.823858 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:33.825412 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:33.812227 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:33.827586 13761 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 3.
I20260709 12:10:33.827945 13687 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 6.
I20260709 12:10:33.802177 16185 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:33.807730 16203 log.cc:927] Time spent T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.276s	user 0.000s	sys 0.001s
I20260709 12:10:33.839076 13682 raft_consensus.cc:2468] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 4.
I20260709 12:10:33.840770 13761 raft_consensus.cc:1240] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:10:33.847625 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:33.848658 13685 raft_consensus.cc:1240] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:33.848893 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:33.849979 13685 raft_consensus.cc:1240] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:33.849653 13761 raft_consensus.cc:2393] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 7: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:33.850858 13687 raft_consensus.cc:1240] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:33.819716 16191 raft_consensus.cc:2804] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:33.852422 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:33.889905 13684 raft_consensus.cc:1240] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:33.897485 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.925130 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:33.925930 13754 raft_consensus.cc:2393] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 3: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:33.834353 16121 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:33.824934 15798 raft_consensus.cc:697] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 4 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
W20260709 12:10:33.844233 16206 log.cc:927] Time spent T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 12:10:33.845387 16157 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:33.853307 16208 log.cc:927] Time spent T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
W20260709 12:10:33.863304 16211 log.cc:927] Time spent T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 12:10:33.859107 16214 log.cc:927] Time spent T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 12:10:33.864401 16201 log.cc:927] Time spent T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
W20260709 12:10:33.955192 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.947968 13684 raft_consensus.cc:1275] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:33.834504 16185 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:33.863886 16207 log.cc:927] Time spent T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:10:33.924736 16191 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:33.863879 16227 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.995108 13684 raft_consensus.cc:1240] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:33.977450 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:33.850443 16015 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:33.995874 13757 raft_consensus.cc:2468] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 2.
I20260709 12:10:33.996098 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:10:33.976874 15938 consensus_meta.cc:287] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.911s	user 0.012s	sys 0.000s
I20260709 12:10:33.863219 16187 raft_consensus.cc:2749] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:34.001009 13754 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "b98d2519bb504dc6905ed2ede4571835"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:10:34.005343 13754 raft_consensus.cc:606] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 LEADER]: Received request to transfer leadership to TS b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:34.008306 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:10:33.993975 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 201919us
I20260709 12:10:34.010766 13685 raft_consensus.cc:1275] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:34.011432 13652 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:34.004218 13684 raft_consensus.cc:1275] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:10:34.000377 16191 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:34.014575 13685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 1882) took 1040 ms. Trace:
I20260709 12:10:34.016381 13685 rpcz_store.cc:276] 0709 12:10:32.986015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.948462 (+962447us) service_pool.cc:224] Handling call
0709 12:10:34.010273 (+ 61811us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:34.011170 (+   897us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:34.014499 (+  3329us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:34.015673 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 227006us
I20260709 12:10:34.019976 13834 raft_consensus.cc:2468] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 4.
I20260709 12:10:34.000206 16126 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:34.025852 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:33.986965 16157 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:34.048051 16157 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:34.035013 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:34.049988 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:10:34.055891 15861 raft_consensus.cc:3055] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:34.056565 15861 raft_consensus.cc:740] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
W20260709 12:10:34.056717 16215 log.cc:927] Time spent T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:10:34.058518 13683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 1870) took 1088 ms. Trace:
I20260709 12:10:34.058913 13683 rpcz_store.cc:276] 0709 12:10:32.970293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.160419 (+190126us) service_pool.cc:224] Handling call
0709 12:10:33.160770 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:33.184272 (+ 23502us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:33.184331 (+    59us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:33.186503 (+  2172us) log.cc:844] Serialized 26 byte log entry
0709 12:10:33.665301 (+478798us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:33.703967 (+ 38666us) log.cc:844] Serialized 14 byte log entry
0709 12:10:33.783122 (+ 79155us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.783214 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:34.058294 (+275080us) raft_consensus.cc:1685] finished
0709 12:10:34.058316 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:34.058454 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":82164,"prepare.queue_time_us":156263,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":106522,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":14300,"thread_start_us":477082,"threads_started":1,"wal-append.queue_time_us":656719}
W20260709 12:10:34.055958 16218 log.cc:927] Time spent T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 12:10:34.061215 15802 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:34.061403 13683 raft_consensus.cc:1240] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:34.036685 15798 consensus_queue.cc:237] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:34.037146 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:10:34.038877 15926 consensus_meta.cc:287] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.762s	user 0.013s	sys 0.000s
W20260709 12:10:34.040517 16051 consensus_meta.cc:287] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.757s	user 0.011s	sys 0.002s
I20260709 12:10:34.041249 16184 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:34.041443 16129 raft_consensus.cc:3055] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:10:34.043917 13680 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1212) took 1396 ms (client timeout 1845 ms). Trace:
I20260709 12:10:34.021679 15938 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:10:34.084616 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 73269.9us
I20260709 12:10:33.992048 16197 consensus_queue.cc:237] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:33.987557 16121 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:34.012945 16224 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.066093 13685 raft_consensus.cc:1275] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:34.071810 15802 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.076366 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
W20260709 12:10:34.081316 13680 rpcz_store.cc:269] 0709 12:10:32.647696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.649212 (+  1516us) service_pool.cc:224] Handling call
0709 12:10:34.043657 (+1394445us) spinlock_profiling.cc:243] Waited 563 ms on lock 0x7b54003f0cd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:34.043836 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1295675776}
I20260709 12:10:34.047871 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:34.113118 13832 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 6.
I20260709 12:10:34.081811 13684 raft_consensus.cc:1240] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 3. Current term is 4. Ops: [3.6-3.6]
W20260709 12:10:34.065948 16214 log.cc:927] Time spent T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:10:34.001910 16227 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:34.002923 16220 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:34.087168 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:34.084084 15926 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:34.088730 14411 raft_consensus.cc:2468] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 3.
I20260709 12:10:34.062326 15861 consensus_queue.cc:260] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:34.089609 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:34.084511 16129 raft_consensus.cc:740] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:34.084681 16051 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:34.092487 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:34.099666 16157 consensus_queue.cc:1048] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:10:34.101799 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:34.104259 13829 raft_consensus.cc:1240] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:34.108295 14410 raft_consensus.cc:1240] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 5 LEADER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:10:34.109659 13687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 1890) took 1089 ms. Trace:
I20260709 12:10:34.098218 16173 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:34.099689 16187 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:34.128542 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:34.130203 14379 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:34.106947 16230 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:34.105810 16236 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:34.096418 15938 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:34.133669 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:10:34.122829 16221 log.cc:927] Time spent T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 12:10:34.098788 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:34.136742 13831 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:34.140410 13687 rpcz_store.cc:276] 0709 12:10:33.020569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.948468 (+927899us) service_pool.cc:224] Handling call
0709 12:10:33.972052 (+ 23584us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:33.972270 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:33.991868 (+ 19598us) log.cc:844] Serialized 14 byte log entry
0709 12:10:34.109317 (+117449us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:34.109365 (+    48us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:34.109415 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:34.109475 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:34.109601 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":19302,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":2311,"raft.queue_time_us":2545,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":6965,"thread_start_us":117031,"threads_started":1}
W20260709 12:10:34.155295 16225 log.cc:927] Time spent T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 12:10:34.141870 13684 raft_consensus.cc:1275] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:10:34.145255 13679 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1214) took 1476 ms (client timeout 1697 ms). Trace:
I20260709 12:10:34.147956 13652 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:34.157341 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:10:34.157069 13679 rpcz_store.cc:269] 0709 12:10:32.668677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.669241 (+   564us) service_pool.cc:224] Handling call
0709 12:10:34.145057 (+1475816us) spinlock_profiling.cc:243] Waited 541 ms on lock 0x7b54002c2c54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:34.145188 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1244125568}
W20260709 12:10:34.148234 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.124378 16213 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:34.148800 14379 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:34.148849 13682 raft_consensus.cc:1240] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:34.169905 14379 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:34.151093 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:34.111323 15802 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:34.116966 16224 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:34.151937 13681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 1871) took 1181 ms. Trace:
I20260709 12:10:34.160437 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:34.164862 13763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 1969) took 1302 ms. Trace:
I20260709 12:10:34.174711 13762 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 4.
I20260709 12:10:34.130474 16220 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:34.153662 16222 raft_consensus.cc:2804] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:34.174604 13763 rpcz_store.cc:276] 0709 12:10:32.862977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.863938 (+   961us) service_pool.cc:224] Handling call
0709 12:10:32.864260 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:32.864636 (+   376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:32.864667 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:32.905947 (+ 41280us) log.cc:844] Serialized 26 byte log entry
0709 12:10:33.818101 (+912154us) spinlock_profiling.cc:243] Waited 39.1 ms on lock 0x7b1800287380. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e82e07 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9fc02 00007fa927b2720b 00007fa927b2cd23 00007fa927b2d0d1 00007fa927f48a0f
0709 12:10:34.004722 (+186621us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:34.004765 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:34.004840 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:34.164522 (+159682us) raft_consensus.cc:1685] finished
0709 12:10:34.164555 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:34.164792 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6393,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":15742,"spinlock_wait_cycles":90009472,"thread_start_us":186416,"threads_started":1,"wal-append.queue_time_us":1173742}
I20260709 12:10:34.172650 16177 raft_consensus.cc:2749] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:34.178678 14379 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:34.186218 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:34.187683 13754 raft_consensus.cc:3055] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:34.188045 13754 raft_consensus.cc:740] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:34.185338 16177 raft_consensus.cc:2804] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:34.173365 13681 rpcz_store.cc:276] 0709 12:10:32.970805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.164189 (+193384us) service_pool.cc:224] Handling call
0709 12:10:33.164580 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:33.194143 (+ 29563us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:33.194193 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:33.194799 (+   606us) log.cc:844] Serialized 26 byte log entry
0709 12:10:33.560620 (+365821us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:33.578303 (+ 17683us) log.cc:844] Serialized 14 byte log entry
0709 12:10:33.578826 (+   523us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.578974 (+   148us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:34.040895 (+461921us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b18003fd720. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924ea0522 00007fa924ea27c1 00007fa924ea2779 00007fa924ea2709 00007fa924ea26d1 00007fa924ea19cd 0000000000388634 0000000000388479 00007fa924e8383a
0709 12:10:34.146374 (+105479us) raft_consensus.cc:1685] finished
0709 12:10:34.151726 (+  5352us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:34.151878 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30070,"prepare.queue_time_us":16749,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":29230,"raft.run_cpu_time_us":305,"raft.run_wall_time_us":40028,"spinlock_wait_cycles":33232768,"thread_start_us":289697,"threads_started":1,"wal-append.queue_time_us":447453}
I20260709 12:10:34.185459 16129 consensus_queue.cc:260] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:34.198858 15926 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:34.199831 16227 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:34.200326 16196 consensus_queue.cc:1048] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:34.179468 16239 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.202348 16239 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:34.204710 16239 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:34.204789 14379 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:34.206497 16220 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:34.207521 16241 raft_consensus.cc:2804] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:34.208038 16241 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:34.198846 16129 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:34.180269 16222 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:34.213569 16222 raft_consensus.cc:3060] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:34.215349 15802 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:34.217263 13831 raft_consensus.cc:2410] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 12:10:34.219496 14380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:34.236642 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 110457us
I20260709 12:10:34.239362 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:34.241734 16177 raft_consensus.cc:697] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 4 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:34.242571 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:34.230651 13754 consensus_queue.cc:260] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:34.243227 16177 consensus_queue.cc:237] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:34.244628 13833 raft_consensus.cc:1240] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:10:34.249725 13754 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:34.250414 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:34.151890 16230 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:34.251521 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:34.262176 13833 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 5.
I20260709 12:10:34.263273 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:34.264251 13833 raft_consensus.cc:2393] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 7: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:34.245716 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:10:34.248705 16167 consensus_meta.cc:287] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.557s	user 0.003s	sys 0.008s
I20260709 12:10:34.253036 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:34.266568 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:34.266898 13832 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:34.257433 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:34.154186 16236 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:34.210810 16121 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:34.258975 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:10:34.268203 13800 leader_election.cc:336] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Timed out: RequestConsensusVote RPC to 127.12.56.194:39545 timed out after 1.925s (SENT)
I20260709 12:10:34.208415 16224 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:34.208437 16241 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:34.267135 13833 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 6.
I20260709 12:10:34.267602 13830 raft_consensus.cc:2393] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 6: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:34.268366 13829 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 4.
I20260709 12:10:34.272307 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:34.272428 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:34.257160 16222 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:34.272907 13833 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 9.
I20260709 12:10:34.260728 16191 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:34.274478 15938 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:10:34.251192 16144 consensus_meta.cc:287] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.978s	user 0.008s	sys 0.004s
I20260709 12:10:34.277961 13836 raft_consensus.cc:2468] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 2.
I20260709 12:10:34.278448 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:34.273473 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:34.269637 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:34.283676 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:34.285086 13800 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:34.408533 13833 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 4.
W20260709 12:10:34.408814 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 123802us
I20260709 12:10:34.409597 13800 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:34.409958 13832 raft_consensus.cc:2410] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:34.422683 13754 raft_consensus.cc:1275] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:10:34.424484 13754 pending_rounds.cc:85] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting all ops after (but not including) 5
I20260709 12:10:34.429927 16236 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:34.268210 16167 raft_consensus.cc:2749] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:34.579043 13685 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 6.
I20260709 12:10:34.442791 13831 raft_consensus.cc:2368] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 3. Current term is 4.
W20260709 12:10:34.405705 16244 log.cc:927] Time spent T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 12:10:34.497686 13754 pending_rounds.cc:107] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:10:34.582917 13754 raft_consensus.cc:2889] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:34.554152 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.568547 15798 raft_consensus.cc:2804] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:34.436985 15938 raft_consensus.cc:2804] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:34.610042 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:34.577790 16131 raft_consensus.cc:2749] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:34.701969 15798 raft_consensus.cc:697] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 6 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:34.414204 16144 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:34.608834 15938 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:34.713398 13800 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:34.719611 13800 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:34.733197 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:34.734091 13828 raft_consensus.cc:1275] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:10:34.734822 13688 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 1886) took 1715 ms (client timeout 2093 ms). Trace:
W20260709 12:10:34.735476 13688 rpcz_store.cc:269] 0709 12:10:33.019286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.139882 (+120596us) service_pool.cc:224] Handling call
0709 12:10:34.732955 (+1593073us) spinlock_profiling.cc:243] Waited 5.31 ms on lock 0x7b5800002798. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924e68b71 00007fa924e68a22 00007fa92dd818d9 00007fa92cedbee0 00007fa92cfa50ab 00007fa92cfa5131 00007fa92cf530a0 00007fa92cf52984 00007fa9264cd6d4 00007fa9264cd662
0709 12:10:34.734726 (+  1771us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12212992}
I20260709 12:10:34.738261 13759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 327) took 1774 ms. Trace:
I20260709 12:10:34.738986 13759 rpcz_store.cc:276] 0709 12:10:32.963338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.967508 (+  4170us) service_pool.cc:224] Handling call
0709 12:10:32.967827 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:32.968020 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:10:33.135720 (+167700us) log.cc:844] Serialized 14 byte log entry
0709 12:10:33.577673 (+441953us) log.cc:844] Serialized 14 byte log entry
0709 12:10:34.737436 (+1159763us) spinlock_profiling.cc:243] Waited 5.74 ms on lock 0x7b180017bae0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e1ac0a 00007fa92e55a219 00007fa924ea2a40 00007fa924e9d4e4 00007fa924e9d455 00007fa927f85060 00007fa927f97716 00007fa927fa8287 00007fa927fa8208
0709 12:10:34.737673 (+   237us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:34.737752 (+    79us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:34.737849 (+    97us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:34.737953 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:34.738163 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49413,"prepare.queue_time_us":303774,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":7316,"raft.queue_time_us":32720,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":15790,"spinlock_wait_cycles":40474368,"thread_start_us":574316,"threads_started":2,"wal-append.queue_time_us":571503}
I20260709 12:10:34.742976 16222 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 4 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199)
I20260709 12:10:34.750021 16227 consensus_queue.cc:1048] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:34.751260 16051 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:34.753413 14380 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:34.755425 15768 raft_consensus.cc:2749] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:34.732195 16236 raft_consensus.cc:2749] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:34.756031 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.718291 16213 consensus_queue.cc:1048] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 12:10:34.760406 13758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 317) took 1888 ms. Trace:
W20260709 12:10:34.760462 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 976104us
I20260709 12:10:34.761049 13758 rpcz_store.cc:276] 0709 12:10:32.871565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.872558 (+   993us) service_pool.cc:224] Handling call
0709 12:10:32.872856 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:33.076403 (+203547us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:33.076450 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:33.076504 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:33.076560 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:34.760067 (+1683507us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b54003ca354. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:34.760141 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:34.760326 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":465038208}
I20260709 12:10:34.715705 15938 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:34.765686 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 46218.1us
I20260709 12:10:34.766686 13800 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:34.769255 15775 consensus_queue.cc:1048] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:10:34.772212 16126 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:34.773048 16126 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:34.775964 16126 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:34.776849 16236 raft_consensus.cc:2804] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:34.777632 16236 raft_consensus.cc:697] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 6 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
W20260709 12:10:34.778801 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.758021 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:34.780390 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:34.782210 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:34.762463 16153 raft_consensus.cc:2804] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:34.769989 16213 raft_consensus.cc:2749] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:34.784776 13800 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
W20260709 12:10:34.788709 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:34.825224 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.790232 13726 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:34.827235 13726 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:34.804406 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:34.807600 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:34.810148 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:34.832151 13726 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:34.810847 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:34.815841 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:10:34.820708 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 65723us
I20260709 12:10:34.836790 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:34.837559 13828 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 6.
I20260709 12:10:34.786401 13754 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 8.
I20260709 12:10:34.840790 13726 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:34.835251 14380 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:34.866196 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:34.806833 16051 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.867117 13828 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 5.
I20260709 12:10:34.807607 16149 raft_consensus.cc:3055] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:34.841786 16227 raft_consensus.cc:2804] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:34.818602 16054 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:34.847399 15775 raft_consensus.cc:2749] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:34.849428 16194 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:34.879652 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:34.834816 16230 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:34.835088 16191 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:34.891963 13727 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:10:34.944268 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 52444.9us
W20260709 12:10:34.942966 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 107815us
I20260709 12:10:34.946261 14410 raft_consensus.cc:1240] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:10:34.872383 16213 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.847219 16126 raft_consensus.cc:2749] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:34.941601 13828 raft_consensus.cc:1240] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:34.949029 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:34.949602 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:34.985028 13835 raft_consensus.cc:2393] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 5: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:34.877573 13726 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:34.947881 14380 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:34.982347 13727 leader_election.cc:304] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
W20260709 12:10:34.986202 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 108631us
I20260709 12:10:34.874264 15925 raft_consensus.cc:2804] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:34.880882 16227 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:35.008409 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:10:35.012027 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 64247.8us
I20260709 12:10:35.013186 14380 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:35.011039 13726 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
W20260709 12:10:34.975167 16245 log.cc:927] Time spent T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260709 12:10:35.020185 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:34.943526 16194 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:35.017467 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:35.017689 13828 raft_consensus.cc:1240] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:34.975710 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:34.939011 16249 raft_consensus.cc:2804] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:34.944187 16060 raft_consensus.cc:2749] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:34.878477 16149 raft_consensus.cc:740] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:34.809425 15798 consensus_queue.cc:237] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:35.014206 15967 raft_consensus.cc:3060] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:34.943590 16054 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:35.093133 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 84579.1us
I20260709 12:10:34.883936 16051 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:35.014410 16134 consensus_queue.cc:1048] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 12:10:35.067217 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:34.874538 16236 consensus_queue.cc:237] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:35.069581 13755 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 5.
I20260709 12:10:34.945113 16220 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:35.028751 16194 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:35.016463 16131 raft_consensus.cc:2749] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:34.875452 16047 consensus_queue.cc:1048] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.152s
I20260709 12:10:35.015861 16227 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:35.015333 16144 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 5 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:35.094880 13828 raft_consensus.cc:1240] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:10:35.009883 16213 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:35.109968 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:35.022559 16151 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:35.007354 15775 raft_consensus.cc:2749] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:10:35.169243 13834 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35422 (request call id 384) took 1952 ms (client timeout 1750 ms). Trace:
I20260709 12:10:35.169963 16054 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:35.124315 16149 consensus_queue.cc:260] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:35.172137 16149 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:35.121295 16191 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:35.174328 16191 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:35.176288 16209 log.cc:927] Time spent T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 1.512s	user 0.020s	sys 0.003s
I20260709 12:10:35.176716 16191 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:35.178442 13833 raft_consensus.cc:1240] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 4 LEADER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:35.179569 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:10:35.157563 13760 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48120 (request call id 1381) took 2082 ms (client timeout 1697 ms). Trace:
W20260709 12:10:35.180559 13760 rpcz_store.cc:269] 0709 12:10:33.075445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.085622 (+ 10177us) service_pool.cc:224] Handling call
0709 12:10:35.157381 (+2071759us) spinlock_profiling.cc:243] Waited 69.3 ms on lock 0x7b54003a02d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:35.157471 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":159490432}
I20260709 12:10:35.181749 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:35.182507 13760 raft_consensus.cc:2376] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 5. Re-sending same reply.
I20260709 12:10:35.183557 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:35.115360 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:35.185112 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:35.065864 16249 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:35.117591 13757 raft_consensus.cc:2410] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:35.118430 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:10:35.118686 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 102665us
I20260709 12:10:35.187353 14379 leader_election.cc:304] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:10:35.169795 13834 rpcz_store.cc:269] 0709 12:10:33.216996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.222375 (+  5379us) service_pool.cc:224] Handling call
0709 12:10:35.168982 (+1946607us) spinlock_profiling.cc:243] Waited 788 ms on lock 0x7b54003241d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:35.169129 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1812495104}
I20260709 12:10:35.189332 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:35.190109 13763 raft_consensus.cc:2368] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 6. Current term is 7.
I20260709 12:10:35.190976 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:10:35.193411 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 1.04546e+06us
I20260709 12:10:35.193632 13828 raft_consensus.cc:1275] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:35.195153 13832 raft_consensus.cc:1275] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:35.196033 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:35.196828 13684 raft_consensus.cc:3060] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:35.185678 13755 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 6.
I20260709 12:10:35.202320 13756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 320) took 2315 ms. Trace:
I20260709 12:10:35.094249 13727 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:35.107753 16192 raft_consensus.cc:2804] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:35.108115 16060 raft_consensus.cc:2749] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:35.130256 16247 log.cc:927] Time spent T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
I20260709 12:10:35.227761 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:35.228973 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:35.121665 16220 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:35.134375 16248 log.cc:927] Time spent T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:10:35.139262 16051 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:10:35.142716 16185 consensus_meta.cc:287] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 1.142s	user 0.007s	sys 0.004s
I20260709 12:10:35.143365 16213 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:35.144861 16151 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:35.146121 16241 consensus_meta.cc:287] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.739s	user 0.004s	sys 0.007s
I20260709 12:10:35.147751 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:35.151153 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:35.151023 16194 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:35.201618 16223 raft_consensus.cc:2749] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:35.153041 16100 raft_consensus.cc:3055] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:10:35.154052 13686 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1220) took 2402 ms (client timeout 3012 ms). Trace:
I20260709 12:10:35.154265 13683 raft_consensus.cc:1275] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:10:35.155449 13761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 1979) took 1312 ms. Trace:
I20260709 12:10:35.260679 13683 pending_rounds.cc:85] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 2
I20260709 12:10:35.261082 13683 pending_rounds.cc:107] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:10:35.156097 16153 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:35.161816 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:35.261521 13683 raft_consensus.cc:2889] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:35.262658 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:35.161978 16227 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:35.264497 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:35.226994 16047 raft_consensus.cc:2804] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:35.165001 15938 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:35.185395 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 178474us
I20260709 12:10:35.268605 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:35.268770 13726 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:35.186435 13685 raft_consensus.cc:1240] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:35.031970 16255 raft_consensus.cc:2804] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:35.203470 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 109299us
W20260709 12:10:35.206014 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 192892us
I20260709 12:10:35.216413 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:35.273712 14380 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:35.273824 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:35.229616 13755 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 5.
I20260709 12:10:35.275846 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:35.277549 13726 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:35.279139 13727 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:35.280277 13726 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:35.280616 13727 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
W20260709 12:10:35.231545 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 978940us
I20260709 12:10:35.202840 13756 rpcz_store.cc:276] 0709 12:10:32.872370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.897301 (+ 24931us) service_pool.cc:224] Handling call
0709 12:10:32.897615 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:32.991369 (+ 93754us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:33.378179 (+386810us) log.cc:844] Serialized 14 byte log entry
0709 12:10:34.760103 (+1381924us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:34.760161 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:34.760214 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:35.187658 (+427444us) spinlock_profiling.cc:243] Waited 93.5 ms on lock 0x7b540035f2d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:35.187717 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:35.187865 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1116674,"prepare.queue_time_us":531153,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":1117750,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":3182,"spinlock_wait_cycles":214951808,"thread_start_us":652718,"threads_started":2,"wal-append.queue_time_us":446506,"wal-append.run_cpu_time_us":2067,"wal-append.run_wall_time_us":1222810}
I20260709 12:10:35.238363 13684 raft_consensus.cc:2468] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 4.
I20260709 12:10:35.282339 13651 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:35.242592 13763 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 3.
I20260709 12:10:35.192935 16187 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.152453 15925 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:35.188035 16249 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:35.300776 15925 raft_consensus.cc:3060] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:35.303416 15775 raft_consensus.cc:2804] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:35.303951 15775 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:35.304368 15775 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:35.305346 15967 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:35.205760 16192 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:35.205547 16231 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:35.162007 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.265033 16153 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:35.260840 13761 rpcz_store.cc:276] 0709 12:10:33.843446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.886040 (+ 42594us) service_pool.cc:224] Handling call
0709 12:10:33.886412 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:34.767352 (+880940us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:34.767395 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:34.773926 (+  6531us) log.cc:844] Serialized 26 byte log entry
0709 12:10:34.867074 (+ 93148us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:34.867114 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:34.867183 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:35.155239 (+288056us) raft_consensus.cc:1685] finished
0709 12:10:35.155260 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:35.155391 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":880533,"raft.queue_time_us":886751,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92,"thread_start_us":92756,"threads_started":1,"wal-append.queue_time_us":322576}
I20260709 12:10:35.162463 16193 raft_consensus.cc:3055] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:35.264633 16167 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:10:35.260603 13686 rpcz_store.cc:269] 0709 12:10:32.751842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.775883 (+ 24041us) service_pool.cc:224] Handling call
0709 12:10:35.153767 (+2377884us) spinlock_profiling.cc:243] Waited 433 ms on lock 0x7b5400199e54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:35.153964 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":994996480}
I20260709 12:10:35.237859 16116 consensus_queue.cc:1048] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:10:35.285116 13651 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:35.339351 13760 raft_consensus.cc:3060] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:35.339185 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 54160.6us
I20260709 12:10:35.278090 16255 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
W20260709 12:10:35.258344 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.306514 16024 raft_consensus.cc:2804] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:35.306828 16129 consensus_queue.cc:1048] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:35.307423 16054 consensus_queue.cc:1048] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:35.307999 16039 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:10:35.378343 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 62867.3us
I20260709 12:10:35.258847 16241 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:35.309806 16249 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:35.313289 13833 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 3.
I20260709 12:10:35.314574 13830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 1935) took 1068 ms. Trace:
I20260709 12:10:35.316958 14379 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:35.264328 16100 raft_consensus.cc:740] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:35.162922 13682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 1874) took 2191 ms. Trace:
I20260709 12:10:35.247227 16185 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:35.331547 13681 raft_consensus.cc:1275] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:10:35.268013 16047 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:35.335516 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:35.340875 13651 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:35.277884 13755 raft_consensus.cc:1240] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260709 12:10:35.390900 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 50175.7us
I20260709 12:10:35.391894 13651 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:35.343812 16230 raft_consensus.cc:2749] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:35.246889 16232 consensus_queue.cc:1048] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.080s
I20260709 12:10:35.313864 16060 raft_consensus.cc:2749] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:35.287860 16233 raft_consensus.cc:2764] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 12:10:35.400794 15976 consensus_queue.cc:1048] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:35.308208 16126 raft_consensus.cc:2804] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:35.401687 16126 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:35.402148 16126 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:35.322373 16192 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:35.405699 13801 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:35.408892 16194 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:35.321722 16253 raft_consensus.cc:2804] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:35.410081 16253 raft_consensus.cc:697] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:35.410830 15938 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:35.411163 16185 leader_election.cc:290] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:35.383780 13830 rpcz_store.cc:276] 0709 12:10:34.246564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.407880 (+161316us) service_pool.cc:224] Handling call
0709 12:10:34.425678 (+ 17798us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:34.426083 (+   405us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:34.426112 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:34.581759 (+155647us) log.cc:844] Serialized 26 byte log entry
0709 12:10:34.816290 (+234531us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:34.816325 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:34.816701 (+   376us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:35.314326 (+497625us) raft_consensus.cc:1685] finished
0709 12:10:35.314343 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:35.314504 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1673,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"thread_start_us":113959,"threads_started":1,"wal-append.queue_time_us":163302}
I20260709 12:10:35.411481 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:35.411121 16253 consensus_queue.cc:237] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:35.412084 13831 raft_consensus.cc:1275] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:10:35.412160 13828 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:35.328119 16193 raft_consensus.cc:740] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:35.413196 16151 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:35.384945 13682 rpcz_store.cc:276] 0709 12:10:32.971660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.850880 (+879220us) service_pool.cc:224] Handling call
0709 12:10:34.148666 (+297786us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:34.170121 (+ 21455us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:35.162722 (+992601us) spinlock_profiling.cc:243] Waited 261 ms on lock 0x7b54002c2c50. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:35.162859 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":600482560}
I20260709 12:10:35.331154 13837 raft_consensus.cc:1240] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 6 LEADER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:35.414593 16220 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:35.349126 16167 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:35.416831 16249 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:35.418299 16167 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:35.418919 16167 raft_consensus.cc:2749] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:35.419715 16241 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 5 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:35.381927 16039 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:35.379583 16255 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:35.320111 16187 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:35.328146 16154 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:35.422047 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 105149us
I20260709 12:10:35.398109 13755 raft_consensus.cc:1275] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:10:35.424721 14380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:35.442932 14380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.425175 16227 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:35.387902 16024 raft_consensus.cc:697] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:35.425846 16193 consensus_queue.cc:260] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:35.426683 15925 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:35.427372 13680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 357) took 2189 ms. Trace:
I20260709 12:10:35.425625 16039 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:35.403469 13760 raft_consensus.cc:2468] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 4.
I20260709 12:10:35.441252 14407 raft_consensus.cc:1240] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:10:35.395809 16047 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:35.404026 15953 raft_consensus.cc:2804] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:35.487557 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:35.411497 15938 raft_consensus.cc:2749] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:35.482661 13680 rpcz_store.cc:276] 0709 12:10:33.238161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.112431 (+874270us) service_pool.cc:224] Handling call
0709 12:10:34.112723 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:34.408893 (+296170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:34.408929 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:34.408971 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:34.409019 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:35.427126 (+1018107us) spinlock_profiling.cc:243] Waited 296 ms on lock 0x7b54002c3654. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:35.427176 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:35.427309 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":680694144}
W20260709 12:10:35.485329 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 311361us
I20260709 12:10:35.454840 16154 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:35.518918 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 237755us
W20260709 12:10:35.519634 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 127793us
I20260709 12:10:35.332253 16231 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:35.432765 16259 raft_consensus.cc:2804] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:35.520756 13651 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:35.519953 13800 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:35.522883 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:35.524375 13754 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:35.524971 13800 leader_election.cc:400] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 election: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 6. Current term is 7.
I20260709 12:10:35.525326 13800 leader_election.cc:403] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
W20260709 12:10:35.528734 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 248213us
I20260709 12:10:35.532709 13800 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:35.502444 16193 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:35.536424 13727 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:35.511983 15953 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:35.482417 16116 consensus_queue.cc:1059] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:10:35.552821 13800 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:35.521883 16154 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:35.557153 13758 raft_consensus.cc:1275] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:10:35.573490 13758 pending_rounds.cc:85] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting all ops after (but not including) 5
I20260709 12:10:35.574637 13758 pending_rounds.cc:107] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:10:35.561493 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:35.575517 13682 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:35.561600 13800 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:35.575001 13758 raft_consensus.cc:2889] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:35.537223 16232 raft_consensus.cc:2764] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:10:35.543212 16236 raft_consensus.cc:2804] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:35.443246 16100 consensus_queue.cc:260] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:35.543553 15938 raft_consensus.cc:2749] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 6. Current term is 7.
I20260709 12:10:35.542580 16259 raft_consensus.cc:697] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 4 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
W20260709 12:10:35.587458 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 44632.6us
I20260709 12:10:35.591810 13754 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 5.
I20260709 12:10:35.559572 15953 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:35.493546 16126 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:35.574815 16227 raft_consensus.cc:2764] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:10:35.607973 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:35.583752 16268 raft_consensus.cc:2804] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:35.620474 13682 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 7.
I20260709 12:10:35.560257 16060 consensus_queue.cc:1048] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 12:10:35.586572 16220 raft_consensus.cc:2804] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:35.494573 16260 consensus_queue.cc:1048] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 12:10:35.560067 16167 consensus_queue.cc:1059] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 12:10:35.644594 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:35.653126 14379 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:35.613448 16100 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:35.587121 16149 consensus_queue.cc:1048] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 12:10:35.652047 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:35.659579 13754 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 3.
I20260709 12:10:35.612316 16267 raft_consensus.cc:2749] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:10:35.648663 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 92472.7us
I20260709 12:10:35.613314 16232 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:35.623446 16236 raft_consensus.cc:697] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 5 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:35.620606 16268 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:35.666393 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:35.646106 16220 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:35.670039 16261 raft_consensus.cc:2804] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:35.635174 16258 consensus_queue.cc:1059] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
W20260709 12:10:35.678187 16263 log.cc:927] Time spent T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 12:10:35.587459 16024 consensus_queue.cc:237] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:35.716357 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:35.716903 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:35.717130 13833 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:35.718998 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:35.719619 13684 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:35.722775 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:10:35.694005 16264 log.cc:927] Time spent T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 12:10:35.723778 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:35.724509 13687 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 3.
I20260709 12:10:35.696302 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:35.725960 16187 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:35.611706 15967 consensus_queue.cc:1175] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b98d2519bb504dc6905ed2ede4571835" responder_term: 7 status { last_received { term: 6 index: 4 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 6. Current term is 7. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:10:35.727057 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:10:35.728042 16265 log.cc:927] Time spent T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 12:10:35.675276 16268 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:35.699327 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:35.700999 13800 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:35.708849 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:35.709416 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:35.737866 13684 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 8.
I20260709 12:10:35.725448 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:35.743242 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:35.673065 16185 raft_consensus.cc:3055] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:35.723150 16233 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.696184 15861 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:35.653672 16262 consensus_queue.cc:1059] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:10:35.672187 16232 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:35.743827 13687 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 6.
W20260709 12:10:35.748276 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.749176 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:35.750681 13684 raft_consensus.cc:2376] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 5. Re-sending same reply.
W20260709 12:10:35.751340 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 50456us
I20260709 12:10:35.688820 13828 raft_consensus.cc:2468] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 5.
I20260709 12:10:35.681840 16220 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:35.743362 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 136337us
I20260709 12:10:35.751259 15925 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:35.745666 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:35.765194 16227 raft_consensus.cc:2804] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:35.751873 16185 raft_consensus.cc:740] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:35.881896 13834 raft_consensus.cc:1240] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:35.766165 16249 consensus_queue.cc:1048] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.117s
I20260709 12:10:35.883520 13800 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
W20260709 12:10:35.850006 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 54655.1us
I20260709 12:10:35.884344 16051 raft_consensus.cc:2804] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:35.884836 16051 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:35.779191 16186 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.885413 16051 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:35.885324 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:35.789419 14379 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:35.886373 16256 consensus_queue.cc:1059] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:35.849792 13833 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 7.
I20260709 12:10:35.887297 16269 raft_consensus.cc:3055] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:35.884835 13800 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:35.889896 16269 raft_consensus.cc:740] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:35.890565 15938 raft_consensus.cc:2749] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:35.890830 16269 consensus_queue.cc:260] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:35.892134 16269 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:35.895746 16227 raft_consensus.cc:697] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 3 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:35.896991 16227 consensus_queue.cc:237] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:35.888556 13727 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:35.889251 14408 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 7.
I20260709 12:10:35.901412 16256 raft_consensus.cc:2749] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:35.886695 13652 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:35.755983 16135 consensus_queue.cc:1048] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.136s
W20260709 12:10:35.889411 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.902787 16256 consensus_queue.cc:1059] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:35.903633 13727 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:35.903424 16186 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:35.903870 15925 raft_consensus.cc:3055] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:35.904390 15925 raft_consensus.cc:740] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:35.905072 16060 raft_consensus.cc:2749] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:35.905417 16149 consensus_queue.cc:1059] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:35.906309 16149 raft_consensus.cc:3055] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:35.767782 16153 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:35.906694 16149 raft_consensus.cc:740] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:35.907402 13759 raft_consensus.cc:2393] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 5: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:35.907521 16149 consensus_queue.cc:260] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:35.908134 13727 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:35.907806 16256 consensus_queue.cc:1048] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:35.895581 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:35.791862 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:35.909862 13687 raft_consensus.cc:2368] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 6. Current term is 7.
I20260709 12:10:35.910068 13688 raft_consensus.cc:2468] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 3.
I20260709 12:10:35.883657 13754 raft_consensus.cc:1240] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:10:35.913077 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:35.913934 13682 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:35.915969 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:35.917409 13800 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:35.929023 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:35.929811 13754 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 5.
I20260709 12:10:35.908795 16149 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:35.954342 13651 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:35.957731 13833 raft_consensus.cc:1240] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 7 LEADER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 6. Current term is 7. Ops: []
W20260709 12:10:35.962039 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 365240us
I20260709 12:10:35.751694 16261 raft_consensus.cc:697] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 7 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:35.779060 16277 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.767012 16213 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.926671 15938 raft_consensus.cc:2804] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:35.975698 13833 raft_consensus.cc:1240] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:35.984927 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:35.979854 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:35.766162 16233 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:35.756331 15775 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:36.077248 13683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 1900) took 2885 ms. Trace:
I20260709 12:10:36.105863 13833 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 6.
I20260709 12:10:36.111909 13683 rpcz_store.cc:276] 0709 12:10:33.191579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.067558 (+875979us) service_pool.cc:224] Handling call
0709 12:10:35.153907 (+1086349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:35.267067 (+113160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:35.989907 (+722840us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b5400199e50. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:36.077147 (+ 87240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2497659264}
I20260709 12:10:35.961230 15941 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.961017 16129 raft_consensus.cc:2804] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:35.947938 16135 raft_consensus.cc:2804] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:36.071900 16187 raft_consensus.cc:2749] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:36.097718 16039 consensus_meta.cc:287] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.572s	user 0.012s	sys 0.000s
I20260709 12:10:35.971007 15938 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:35.948786 16194 consensus_queue.cc:1048] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.107s
W20260709 12:10:36.039166 16263 log.cc:927] Time spent T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:10:36.101045 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:36.128314 13831 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:36.096601 13832 raft_consensus.cc:1240] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:35.928491 16230 consensus_queue.cc:1059] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 12:10:35.906320 15925 consensus_queue.cc:260] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:36.037904 16153 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:35.686066 16259 consensus_queue.cc:237] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:35.911908 16192 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:35.973352 16277 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:36.118877 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:35.927553 16051 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:36.111445 16047 consensus_meta.cc:287] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.593s	user 0.015s	sys 0.004s
I20260709 12:10:36.125419 13761 raft_consensus.cc:1240] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:35.911216 16236 consensus_queue.cc:237] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:36.123941 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 237301us
W20260709 12:10:36.133018 16276 log.cc:927] Time spent T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 12:10:36.098169 16231 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:36.126483 15938 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:36.147068 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:10:36.140626 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.200030 13686 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:36.119468 16232 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:36.119415 16129 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:36.039618 16213 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:36.128315 16135 raft_consensus.cc:697] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 5 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:36.137050 16261 consensus_queue.cc:237] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:35.947484 16185 consensus_queue.cc:260] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:36.174844 13652 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:36.173277 13837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 1994) took 1371 ms. Trace:
W20260709 12:10:36.146593 16270 log.cc:927] Time spent T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.391s	user 0.000s	sys 0.001s
I20260709 12:10:36.198589 13831 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 7.
W20260709 12:10:36.223821 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 49092us
I20260709 12:10:36.225065 13652 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:36.141364 16230 raft_consensus.cc:2804] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:36.142096 14409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41700 (request call id 317) took 1254 ms. Trace:
I20260709 12:10:36.160007 16126 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:36.147008 16187 raft_consensus.cc:3055] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:36.127014 13682 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 9.
W20260709 12:10:36.247135 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 335995us
I20260709 12:10:36.247150 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:36.135694 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:36.122566 15941 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:36.252125 13652 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:36.253495 13652 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:36.253119 13833 raft_consensus.cc:2393] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 5: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:36.149257 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:36.155339 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:36.255293 13688 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:10:36.255364 13680 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 5.
I20260709 12:10:36.256421 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:36.257123 13680 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 4.
I20260709 12:10:36.157711 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:36.158182 13757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48120 (request call id 1403) took 1347 ms. Trace:
I20260709 12:10:36.258713 13757 rpcz_store.cc:276] 0709 12:10:34.810407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.810546 (+   139us) service_pool.cc:224] Handling call
0709 12:10:36.157952 (+1347406us) spinlock_profiling.cc:243] Waited 284 ms on lock 0x7b540038bdd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:36.158119 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":653690112}
W20260709 12:10:36.159204 13862 heartbeater.cc:646] Failed to heartbeat to 127.12.56.254:40645 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.12.56.254:40645 timed out after 15.000s (SENT)
I20260709 12:10:36.165231 13762 raft_consensus.cc:1240] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:36.259018 13682 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 3.
W20260709 12:10:36.172721 13759 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48120 (request call id 1411) took 1335 ms (client timeout 1611 ms). Trace:
I20260709 12:10:36.259735 14380 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:36.172660 13684 raft_consensus.cc:2393] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 3: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
W20260709 12:10:36.263737 13759 rpcz_store.cc:269] 0709 12:10:34.837762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.147425 (+309663us) service_pool.cc:224] Handling call
0709 12:10:36.172520 (+1025095us) spinlock_profiling.cc:243] Waited 660 ms on lock 0x7b540035f2d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:36.172654 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1517654400}
I20260709 12:10:36.264292 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:36.266084 13759 raft_consensus.cc:1240] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:10:36.266737 16116 raft_consensus.cc:2804] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:10:36.152657 13800 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.902s (SENT) [suppressed 38 similar messages]
I20260709 12:10:36.267484 16116 raft_consensus.cc:697] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 5 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
W20260709 12:10:36.267756 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 115113us
I20260709 12:10:36.170270 13683 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 5.
I20260709 12:10:36.268498 16116 consensus_queue.cc:237] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:36.216709 13837 rpcz_store.cc:276] 0709 12:10:34.802323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.969320 (+166997us) service_pool.cc:224] Handling call
0709 12:10:34.969681 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:35.414312 (+444631us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:36.173031 (+758719us) spinlock_profiling.cc:243] Waited 361 ms on lock 0x7b54000daf54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:36.173212 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":830654336}
W20260709 12:10:36.244215 16231 consensus_queue.cc:1175] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "96701a74fdee481fb5f54aac841e17dd" responder_term: 6 status { last_received { term: 4 index: 2 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 5. Current term is 6. Ops: [5.3-5.3]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:10:36.270267 16232 raft_consensus.cc:2804] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:36.270851 16255 consensus_meta.cc:287] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.788s	user 0.010s	sys 0.001s
I20260709 12:10:36.174469 16047 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:36.271332 16255 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:36.271978 13829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 1995) took 1469 ms. Trace:
I20260709 12:10:36.272984 16047 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:36.163110 16212 raft_consensus.cc:3055] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:36.273994 16212 raft_consensus.cc:740] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:36.272455 13829 rpcz_store.cc:276] 0709 12:10:34.802639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.975746 (+173107us) service_pool.cc:224] Handling call
0709 12:10:34.976125 (+   379us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:35.245802 (+269677us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:35.245840 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:35.287047 (+ 41207us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b2c0000bb28. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa926886a11 00007fa926896372 00007fa927fc8a01 00007fa927f8d43a 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2
0709 12:10:35.287673 (+   626us) log.cc:844] Serialized 52 byte log entry
0709 12:10:35.523375 (+235702us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:35.535771 (+ 12396us) log.cc:844] Serialized 14 byte log entry
0709 12:10:35.578381 (+ 42610us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:35.578499 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:36.271635 (+693136us) raft_consensus.cc:1685] finished
0709 12:10:36.271756 (+   121us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:36.271910 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55986,"prepare.queue_time_us":12088,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":82933,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":13504,"spinlock_wait_cycles":28335872,"thread_start_us":461840,"threads_started":2,"wal-append.queue_time_us":349371}
I20260709 12:10:36.275054 16212 consensus_queue.cc:260] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:36.275787 16233 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:36.126971 16039 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:36.172060 16267 raft_consensus.cc:3055] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:36.276623 16267 raft_consensus.cc:740] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:36.277577 16267 consensus_queue.cc:260] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:36.278314 16279 log.cc:927] Time spent T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.167s	user 0.000s	sys 0.000s
I20260709 12:10:36.278739 16267 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:36.280870 15941 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:36.281981 16290 raft_consensus.cc:2749] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:36.208912 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:36.282749 13681 raft_consensus.cc:1275] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:36.133394 16256 consensus_queue.cc:1048] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.074s
I20260709 12:10:36.172040 16277 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:36.172076 16051 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:10:36.200143 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:36.170868 13760 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38932 (request call id 345) took 1196 ms (client timeout 1565 ms). Trace:
W20260709 12:10:36.193610 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 239352us
W20260709 12:10:36.310459 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:36.311379 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:36.310266 13760 rpcz_store.cc:269] 0709 12:10:34.974213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.183256 (+209043us) service_pool.cc:224] Handling call
0709 12:10:36.170673 (+987417us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b5400139cd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:36.170801 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":356923776}
I20260709 12:10:36.266649 16236 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:36.265934 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:10:36.274484 16268 consensus_meta.cc:287] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.545s	user 0.007s	sys 0.003s
I20260709 12:10:36.171976 16192 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:36.278249 16039 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:36.251868 16157 raft_consensus.cc:2749] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:36.212327 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 249131us
I20260709 12:10:36.243702 16187 raft_consensus.cc:740] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
W20260709 12:10:36.219383 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 430085us
I20260709 12:10:36.287674 13683 raft_consensus.cc:1240] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:10:36.124984 14408 raft_consensus.cc:1240] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 5 LEADER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:10:36.289592 13762 raft_consensus.cc:1240] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:36.291029 13800 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:36.310897 16256 consensus_queue.cc:1243] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer b98d2519bb504dc6905ed2ede4571835 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:10:36.364012 13679 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:36.244084 16193 consensus_meta.cc:287] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.695s	user 0.007s	sys 0.004s
I20260709 12:10:36.208042 16129 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:36.239635 16230 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:36.345027 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:36.316989 13801 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:36.347760 13681 raft_consensus.cc:1275] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:36.283835 13687 raft_consensus.cc:1275] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:36.244011 16185 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:36.305449 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 52053.3us
I20260709 12:10:36.349463 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:36.251348 16280 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.350075 13834 raft_consensus.cc:1240] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:36.371930 13652 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:36.282403 16255 leader_election.cc:290] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:36.344254 16186 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:36.221511 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:36.329516 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:36.332906 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:36.270823 16232 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:36.354053 14380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:36.342730 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.321883 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:36.356001 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:10:36.337041 16100 consensus_meta.cc:287] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.670s	user 0.011s	sys 0.000s
I20260709 12:10:36.311292 16233 raft_consensus.cc:2804] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:10:36.393155 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.400825 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:36.401818 13760 raft_consensus.cc:2393] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 8: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:36.393483 13837 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:10:36.403673 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.300956 13759 raft_consensus.cc:1240] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:36.359710 13688 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 4.
I20260709 12:10:36.309672 16258 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:36.342136 16227 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:36.380159 13652 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:36.353547 16126 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:36.360109 16259 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.360335 15775 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:36.391614 16157 raft_consensus.cc:2804] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:36.449200 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 47350us
I20260709 12:10:36.427363 16275 consensus_queue.cc:1059] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:36.239066 14409 rpcz_store.cc:276] 0709 12:10:34.888009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.937635 (+ 49626us) service_pool.cc:224] Handling call
0709 12:10:35.018639 (+ 81004us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:35.113349 (+ 94710us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:35.116969 (+  3620us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:35.127487 (+ 10518us) log.cc:844] Serialized 52 byte log entry
0709 12:10:35.327486 (+199999us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:35.517410 (+189924us) log.cc:844] Serialized 14 byte log entry
0709 12:10:35.543413 (+ 26003us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:35.554044 (+ 10631us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:36.141832 (+587788us) raft_consensus.cc:1685] finished
0709 12:10:36.141859 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:36.142026 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":264839,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":6624,"raft.queue_time_us":22019,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":16589,"thread_start_us":299216,"threads_started":2,"wal-append.queue_time_us":387755}
I20260709 12:10:36.374928 16230 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:36.347277 16268 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:36.381218 16135 consensus_queue.cc:237] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:36.379853 16280 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:36.427235 16193 consensus_queue.cc:1048] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
W20260709 12:10:36.434912 16287 log.cc:927] Time spent T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 12:10:36.404026 16187 consensus_queue.cc:260] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:36.397097 16232 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:36.436275 13763 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 7.
I20260709 12:10:36.404429 16233 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:10:36.428069 16274 log.cc:927] Time spent T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.745s	user 0.002s	sys 0.003s
I20260709 12:10:36.397482 14411 raft_consensus.cc:3060] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:36.437132 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.348680 16236 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:36.468644 16191 raft_consensus.cc:2749] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:36.738380 16157 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:36.490761 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:36.787312 13760 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Advancing to term 10
W20260709 12:10:36.491976 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 201053us
I20260709 12:10:36.534303 13758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 348) took 1191 ms. Trace:
I20260709 12:10:36.789979 13758 rpcz_store.cc:276] 0709 12:10:35.384166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.384313 (+   147us) service_pool.cc:224] Handling call
0709 12:10:35.384690 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:35.579495 (+194805us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:36.534040 (+954545us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b540038ccd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:36.534236 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":391764864}
I20260709 12:10:36.548529 13837 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 10.
I20260709 12:10:36.549594 13679 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 3.
I20260709 12:10:36.562868 13686 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 4.
I20260709 12:10:36.505596 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:36.794279 13761 raft_consensus.cc:2410] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:10:36.527048 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:36.795483 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.551659 13727 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
W20260709 12:10:36.796598 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 245050us
I20260709 12:10:36.540478 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:10:36.485850 15953 consensus_meta.cc:287] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.861s	user 0.016s	sys 0.000s
W20260709 12:10:36.508883 16220 consensus_meta.cc:287] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.608s	user 0.008s	sys 0.000s
W20260709 12:10:36.525219 16154 consensus_meta.cc:287] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.935s	user 0.004s	sys 0.011s
I20260709 12:10:36.751637 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:36.804694 13762 raft_consensus.cc:2393] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 7: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:36.805559 13761 raft_consensus.cc:1240] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:36.809276 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:36.810190 13684 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:36.753892 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:36.810910 13681 raft_consensus.cc:2376] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 5. Re-sending same reply.
I20260709 12:10:36.811975 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:36.754956 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:36.756088 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:36.757531 13680 raft_consensus.cc:1240] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:10:36.814606 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:10:36.546989 15861 consensus_meta.cc:287] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.624s	user 0.015s	sys 0.000s
I20260709 12:10:36.752876 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:36.771854 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:36.787065 16277 raft_consensus.cc:2749] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:36.793547 16157 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:36.482827 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 157980us
I20260709 12:10:36.533828 16051 raft_consensus.cc:2749] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:36.523016 16213 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:10:36.784107 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.793634 13686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1234) took 1111 ms. Trace:
I20260709 12:10:36.866051 13686 rpcz_store.cc:276] 0709 12:10:35.681841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.146768 (+464927us) service_pool.cc:224] Handling call
0709 12:10:36.793567 (+646799us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:36.867475 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:36.868170 13686 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:36.745177 16292 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:36.870175 16292 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:36.871306 13760 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 10.
I20260709 12:10:36.872478 16292 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:36.803323 13800 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:36.776341 16233 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:36.873930 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 70714.4us
I20260709 12:10:36.874964 13800 leader_election.cc:400] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 election: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 6. Current term is 7.
I20260709 12:10:36.875960 13800 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:36.771464 16259 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:36.729805 15938 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:36.879137 16268 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:36.880054 15938 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:36.816833 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:36.881680 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:36.882229 16051 raft_consensus.cc:2804] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:36.882778 16051 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:36.882862 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:36.883361 16051 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:36.884153 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:36.806516 13727 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:36.818445 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:36.885305 13687 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:36.886153 16213 raft_consensus.cc:2804] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:36.886843 16213 raft_consensus.cc:697] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 9 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:36.888000 16213 consensus_queue.cc:237] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:36.820874 13680 raft_consensus.cc:2376] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 8. Re-sending same reply.
I20260709 12:10:36.824208 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:36.890686 13681 raft_consensus.cc:2393] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 8: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:36.890893 13680 raft_consensus.cc:1240] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:36.806844 16262 raft_consensus.cc:2804] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:36.891590 16262 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:36.892046 13681 raft_consensus.cc:1240] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:10:36.892364 16060 raft_consensus.cc:3055] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:36.892863 16060 raft_consensus.cc:740] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:36.641623 16129 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:36.893849 16060 consensus_queue.cc:260] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:36.894979 16060 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:36.895797 16129 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:36.746134 16227 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:36.897250 13757 raft_consensus.cc:2393] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 4: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:36.897941 13832 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:36.898881 16227 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:36.803821 16187 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:36.901091 16236 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:36.856935 16124 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:36.902521 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.903848 13756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 1420) took 2033 ms. Trace:
I20260709 12:10:36.771219 16126 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:36.904927 13800 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:36.637946 16258 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:36.906634 16304 raft_consensus.cc:2804] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:36.843124 13685 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 3.
I20260709 12:10:36.804862 16267 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.857987 13801 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:36.814699 15941 consensus_queue.cc:1059] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.078s
I20260709 12:10:36.904338 13756 rpcz_store.cc:276] 0709 12:10:34.870451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.282505 (+412054us) service_pool.cc:224] Handling call
0709 12:10:35.326731 (+ 44226us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:35.334629 (+  7898us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:35.334661 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:35.335144 (+   483us) log.cc:844] Serialized 26 byte log entry
0709 12:10:35.531563 (+196419us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:35.531610 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:35.531679 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:36.383168 (+851489us) spinlock_profiling.cc:243] Waited 6.61 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:10:36.903464 (+520296us) raft_consensus.cc:1685] finished
0709 12:10:36.903497 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:36.903768 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7465,"raft.queue_time_us":11703,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":37569,"spinlock_wait_cycles":15212928,"thread_start_us":133846,"threads_started":1,"wal-append.queue_time_us":229160}
W20260709 12:10:36.925240 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.925356 13835 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:36.925714 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 67874.2us
I20260709 12:10:36.907199 16304 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:36.929507 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 123097us
I20260709 12:10:36.931589 13832 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 5.
I20260709 12:10:36.935012 13687 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 4.
I20260709 12:10:36.860721 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:36.939038 13684 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 7.
I20260709 12:10:36.942772 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:36.943508 13687 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 5.
I20260709 12:10:36.944761 13687 raft_consensus.cc:1240] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:36.945963 13726 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:36.893621 13681 raft_consensus.cc:1240] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:36.948873 13681 raft_consensus.cc:1275] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:36.952862 13685 raft_consensus.cc:1240] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:36.804641 15953 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:36.814728 16220 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:36.892016 16262 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:36.777731 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 397594us
I20260709 12:10:36.840191 16154 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:36.955538 16255 raft_consensus.cc:2804] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:10:36.959885 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 55055.5us
I20260709 12:10:36.966846 13652 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:36.968084 13800 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
W20260709 12:10:36.951906 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 141505us
I20260709 12:10:36.962713 13726 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:36.966681 13681 raft_consensus.cc:1240] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:36.902390 16124 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:36.970427 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.969234 15941 consensus_queue.cc:1059] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:10:36.977641 13652 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:36.979132 13652 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:36.952499 16236 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:36.955034 16304 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:36.922566 16267 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:36.962599 13687 pending_rounds.cc:85] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 1
I20260709 12:10:36.961182 16306 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:36.999503 13682 raft_consensus.cc:1240] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:10:37.038200 13686 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 7.
I20260709 12:10:36.984714 16185 raft_consensus.cc:2749] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:37.042007 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 74002.1us
I20260709 12:10:37.090626 13800 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:37.057698 13687 pending_rounds.cc:107] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:10:37.091341 13687 raft_consensus.cc:2889] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:36.961117 16024 raft_consensus.cc:2749] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:37.083890 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 104836us
I20260709 12:10:34.848112 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:36.969851 16275 raft_consensus.cc:2749] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:37.108934 13800 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:37.117573 13800 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:10:37.125725 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 148387us
I20260709 12:10:37.011358 16236 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:37.140196 14407 raft_consensus.cc:1240] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:10:37.145428 16315 raft_consensus.cc:2749] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:37.088440 16191 raft_consensus.cc:2804] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:36.974404 16129 consensus_queue.cc:1059] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.150s
I20260709 12:10:37.104573 16186 raft_consensus.cc:2749] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:37.124032 16227 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:37.176582 13835 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 6.
I20260709 12:10:37.137447 15938 raft_consensus.cc:2804] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:37.138408 16126 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:37.149335 16236 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:37.183004 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 218672us
I20260709 12:10:37.185238 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:37.189193 13836 raft_consensus.cc:1275] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:10:37.193017 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:37.196607 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:37.197690 13830 raft_consensus.cc:2393] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 6: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:37.170872 16191 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:10:37.181265 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 218623us
I20260709 12:10:37.201726 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:37.203697 13831 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 5.
I20260709 12:10:37.142549 16293 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:10:37.207574 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.115940 16306 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:37.180796 16259 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:37.215510 13727 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:37.207597 16313 raft_consensus.cc:3055] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:37.216395 16313 raft_consensus.cc:740] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:37.217367 16313 consensus_queue.cc:260] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:37.218272 16269 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.218838 16269 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:37.219187 16313 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:37.210851 13726 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:37.181277 15938 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:37.224278 13834 raft_consensus.cc:1240] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:37.208352 16191 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:37.202698 16213 raft_consensus.cc:2749] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:37.235294 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 117809us
W20260709 12:10:37.213308 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 86691.2us
I20260709 12:10:37.237475 13800 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:37.205466 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:37.242328 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:37.221093 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:37.250352 16192 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:37.231293 15938 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:37.243917 16255 raft_consensus.cc:697] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:37.213335 16293 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:37.320117 13726 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:37.243122 16269 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:37.324774 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:37.332724 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:10:37.306694 16311 log.cc:927] Time spent T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
W20260709 12:10:37.304178 14411 consensus_meta.cc:287] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.511s	user 0.007s	sys 0.003s
I20260709 12:10:37.349427 13685 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:37.285425 16314 raft_consensus.cc:2804] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:37.358063 13727 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:10:37.316035 16310 log.cc:927] Time spent T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
W20260709 12:10:37.361361 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.251470 16258 leader_election.cc:290] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:37.362402 13681 raft_consensus.cc:2376] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 4. Re-sending same reply.
I20260709 12:10:37.272753 16312 consensus_queue.cc:1048] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.111s
I20260709 12:10:37.365952 14407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41700 (request call id 322) took 1156 ms. Trace:
I20260709 12:10:37.367823 16316 raft_consensus.cc:3055] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:37.428391 14379 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:37.371191 13585 catalog_manager.cc:5697] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 3 to 5, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 5 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:10:37.427330 16187 consensus_meta.cc:287] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.528s	user 0.009s	sys 0.002s
I20260709 12:10:37.243381 16227 consensus_queue.cc:1048] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.103s
I20260709 12:10:37.319664 16233 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:37.346683 16220 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:37.333621 16292 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:37.378129 13682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1230) took 1697 ms. Trace:
I20260709 12:10:37.490206 13682 rpcz_store.cc:276] 0709 12:10:35.680363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.284956 (+604593us) service_pool.cc:224] Handling call
0709 12:10:36.347228 (+ 62272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:37.090037 (+742809us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:37.377730 (+287693us) spinlock_profiling.cc:243] Waited 652 ms on lock 0x7b5400271854. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:37.378031 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1499247488}
W20260709 12:10:37.379015 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.381047 16212 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:37.381980 14410 consensus_meta.cc:287] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.504s	user 0.006s	sys 0.002s
I20260709 12:10:37.492761 14410 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 5.
I20260709 12:10:37.384845 16124 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:37.386855 16257 consensus_queue.cc:1048] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:37.391691 16149 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:37.395380 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:37.399916 13679 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1250) took 1714 ms (client timeout 2217 ms). Trace:
I20260709 12:10:37.451934 16261 raft_consensus.cc:2804] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:37.284444 16192 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:37.434290 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:37.440116 16277 consensus_queue.cc:1059] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 12:10:37.315853 15953 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:37.322486 16322 raft_consensus.cc:2749] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:37.345830 16154 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 5 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:37.441668 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 99040.5us
W20260709 12:10:37.435930 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 328763us
W20260709 12:10:37.442809 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 84863.8us
I20260709 12:10:37.325906 16194 consensus_queue.cc:1059] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.110s
I20260709 12:10:37.453322 13835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54820 (request call id 2024) took 1104 ms. Trace:
I20260709 12:10:37.559284 13685 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 4.
W20260709 12:10:37.454376 13586 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45620 (request call id 246) took 16343 ms (client timeout 15000 ms). Trace:
I20260709 12:10:37.423885 14411 raft_consensus.cc:2468] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 5.
W20260709 12:10:37.470067 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.435868 16267 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:37.432210 16269 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:37.348691 16321 raft_consensus.cc:2749] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:37.489444 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:37.578182 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.431200 16231 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.428611 16314 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:37.487329 13585 catalog_manager.cc:5697] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 2 to 3, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 3 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:37.440050 16316 raft_consensus.cc:740] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:37.588642 13829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 414) took 1273 ms. Trace:
I20260709 12:10:37.448939 15775 raft_consensus.cc:2749] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:37.589222 13829 rpcz_store.cc:276] 0709 12:10:36.315076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.317192 (+  2116us) service_pool.cc:224] Handling call
0709 12:10:36.317608 (+   416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:36.805468 (+487860us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:36.805499 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:36.805537 (+    38us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:36.805578 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:37.588370 (+782792us) spinlock_profiling.cc:243] Waited 488 ms on lock 0x7b54000d9654. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:37.588440 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:37.588578 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1121512320}
W20260709 12:10:37.509807 13679 rpcz_store.cc:269] 0709 12:10:35.685304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.157362 (+472058us) service_pool.cc:224] Handling call
0709 12:10:37.399726 (+1242364us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b540021f054. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:37.399852 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":242872064}
I20260709 12:10:37.402379 13684 raft_consensus.cc:1240] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:37.439005 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 194267us
I20260709 12:10:37.517737 13681 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 5.
I20260709 12:10:37.524391 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:37.511862 16313 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.562840 13685 raft_consensus.cc:1275] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 12:10:37.693958 13685 pending_rounds.cc:85] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 2
I20260709 12:10:37.694325 13685 pending_rounds.cc:107] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:10:37.694666 13685 raft_consensus.cc:2889] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:37.695048 13679 raft_consensus.cc:1240] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:37.560086 13835 rpcz_store.cc:276] 0709 12:10:36.348948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.349205 (+   257us) service_pool.cc:224] Handling call
0709 12:10:37.453049 (+1103844us) spinlock_profiling.cc:243] Waited 554 ms on lock 0x7b54003ba1d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:37.453229 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1274185984}
I20260709 12:10:37.512382 16220 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:37.573978 16177 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.519891 16149 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:37.530470 16261 raft_consensus.cc:697] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 10 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:37.457314 16255 consensus_queue.cc:237] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:37.575238 16060 consensus_meta.cc:287] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.673s	user 0.013s	sys 0.000s
I20260709 12:10:37.725015 13760 raft_consensus.cc:1275] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:37.724922 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:37.438606 14407 rpcz_store.cc:276] 0709 12:10:36.209270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.211547 (+  2277us) service_pool.cc:224] Handling call
0709 12:10:36.222289 (+ 10742us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:37.144367 (+922078us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:37.365613 (+221246us) spinlock_profiling.cc:243] Waited 834 ms on lock 0x7b54007c01d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:37.365871 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1919214848}
I20260709 12:10:37.681177 16314 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:37.688151 13800 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:37.699137 16277 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:37.737660 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 49575.5us
I20260709 12:10:37.594094 16231 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:37.691211 16317 log.cc:927] Time spent T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.329s	user 0.000s	sys 0.001s
I20260709 12:10:37.692128 16192 leader_election.cc:290] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:37.511435 16292 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:37.680480 16224 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:37.707167 16318 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:37.583627 14411 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41700 (request call id 323) took 1365 ms (client timeout 1701 ms). Trace:
I20260709 12:10:37.692796 16331 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:37.709722 16313 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:37.683254 16227 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:10:37.642930 16051 consensus_meta.cc:287] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.759s	user 0.012s	sys 0.000s
I20260709 12:10:37.588307 16269 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:37.693101 16129 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
W20260709 12:10:37.723809 16157 consensus_meta.cc:287] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.813s	user 0.008s	sys 0.003s
I20260709 12:10:37.525597 16319 consensus_queue.cc:1059] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.279s
I20260709 12:10:37.714895 16323 raft_consensus.cc:2804] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:10:37.792244 16232 consensus_meta.cc:287] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 1.015s	user 0.008s	sys 0.003s
I20260709 12:10:37.817036 16323 raft_consensus.cc:697] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:37.752959 16340 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.708464 16316 consensus_queue.cc:260] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:37.718327 16306 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:37.733399 16288 consensus_queue.cc:1048] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.335s
I20260709 12:10:37.718366 16177 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:37.827229 16340 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:37.765733 14411 rpcz_store.cc:269] 0709 12:10:36.211872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.216434 (+  4562us) service_pool.cc:224] Handling call
0709 12:10:37.577444 (+1361010us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:37.747900 16277 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:37.715040 16220 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:37.774734 16261 consensus_queue.cc:237] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:37.745489 16100 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.746881 16291 consensus_queue.cc:1059] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.338s
I20260709 12:10:37.792209 16292 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:37.792354 16318 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:37.795608 16051 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:37.860158 16051 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:37.867197 16187 raft_consensus.cc:3055] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:37.867393 16269 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:37.867921 16187 raft_consensus.cc:740] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:37.869303 16220 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:37.783289 16331 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:37.797997 16230 consensus_meta.cc:287] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 1.033s	user 0.010s	sys 0.003s
I20260709 12:10:37.750591 16293 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:10:37.810123 16325 log.cc:927] Time spent T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.379s	user 0.000s	sys 0.002s
I20260709 12:10:37.811511 16313 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:37.709908 16321 consensus_queue.cc:1048] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 12:10:37.746083 16267 raft_consensus.cc:2804] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:10:37.807586 16262 consensus_meta.cc:287] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.823s	user 0.008s	sys 0.001s
I20260709 12:10:37.817610 16232 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:37.766168 16224 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:37.844712 16328 log.cc:927] Time spent T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.279s	user 0.001s	sys 0.000s
I20260709 12:10:37.845716 16260 raft_consensus.cc:3055] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:37.834259 16256 consensus_queue.cc:1059] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:10:37.857654 16318 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:37.876253 16280 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:37.818468 16323 consensus_queue.cc:237] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:37.833711 16340 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:37.878753 16267 raft_consensus.cc:697] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 4 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
W20260709 12:10:37.904702 16337 log.cc:927] Time spent T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:10:37.916138 16329 raft_consensus.cc:3055] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:37.916836 16329 raft_consensus.cc:740] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:37.920965 16331 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:37.922446 16329 consensus_queue.cc:260] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:37.924621 16329 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:37.686874 13681 raft_consensus.cc:1240] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:37.967337 13687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 1924) took 1204 ms. Trace:
I20260709 12:10:37.686777 13682 raft_consensus.cc:2410] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:10:37.968025 13687 rpcz_store.cc:276] 0709 12:10:36.762285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.945515 (+183230us) service_pool.cc:224] Handling call
0709 12:10:36.962367 (+ 16852us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:37.183411 (+221044us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:37.183454 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:37.184003 (+   549us) log.cc:844] Serialized 52 byte log entry
0709 12:10:37.228728 (+ 44725us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:37.314217 (+ 85489us) log.cc:844] Serialized 14 byte log entry
0709 12:10:37.314494 (+   277us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:37.314599 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:37.966332 (+651733us) raft_consensus.cc:1685] finished
0709 12:10:37.966418 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:37.966982 (+   564us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4685,"prepare.queue_time_us":157488,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":52,"raft.queue_time_us":64085,"raft.run_cpu_time_us":306,"raft.run_wall_time_us":40312,"thread_start_us":167539,"threads_started":3,"wal-append.queue_time_us":61173}
W20260709 12:10:37.560911 13586 rpcz_store.cc:269] 0709 12:10:21.101577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.102085 (+   508us) service_pool.cc:224] Handling call
0709 12:10:37.444780 (+16342695us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:28.673265 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:28.765671 (+ 92406us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:28.765719 (+    48us) write_op.cc:435] Acquired schema lock
0709 12:10:28.765741 (+    22us) tablet.cc:662] Decoding operations
0709 12:10:28.868404 (+102663us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:28.879121 (+ 10717us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:28.881402 (+  2281us) tablet.cc:685] Acquiring locks for 15 operations
0709 12:10:29.372652 (+491250us) tablet.cc:701] Row locks acquired
0709 12:10:29.413455 (+ 40803us) write_op.cc:260] PREPARE: finished
0709 12:10:29.470323 (+ 56868us) write_op.cc:270] Start()
0709 12:10:29.505339 (+ 35016us) write_op.cc:276] Timestamp: P: 1783599029456266 usec, L: 0
0709 12:10:29.505370 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 12:10:29.506232 (+   862us) log.cc:844] Serialized 6002 byte log entry
0709 12:10:30.801382 (+1295150us) op_driver.cc:464] REPLICATION: finished
0709 12:10:31.171830 (+370448us) write_op.cc:301] APPLY: starting
0709 12:10:31.171948 (+   118us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:31.172274 (+   326us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:31.172571 (+   297us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:31.303077 (+130506us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:31.303518 (+   441us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=15
0709 12:10:31.303568 (+    50us) write_op.cc:312] APPLY: finished
0709 12:10:31.304026 (+   458us) log.cc:844] Serialized 107 byte log entry
0709 12:10:31.342890 (+ 38864us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:31.343107 (+   217us) write_op.cc:454] Released schema lock
0709 12:10:31.343210 (+   103us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:31.343819 (+   609us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:31.343864 (+    45us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1126,"reported_tablets":29,"child_traces":[["op",{"apply.queue_time_us":260441,"apply.run_cpu_time_us":6015,"apply.run_wall_time_us":183917,"num_ops":15,"prepare.queue_time_us":83327,"prepare.run_cpu_time_us":21385,"prepare.run_wall_time_us":1128814,"raft.queue_time_us":340309,"raft.run_cpu_time_us":24788,"raft.run_wall_time_us":373734,"replication_time_us":1184193,"thread_start_us":514955,"threads_started":4,"wal-append.queue_time_us":491605,"wal-append.run_cpu_time_us":22317,"wal-append.run_wall_time_us":2313101}]]}
I20260709 12:10:37.699813 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:37.738957 13800 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:37.981241 13757 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 5.
I20260709 12:10:37.813372 16129 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:37.842496 16100 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:37.816075 16149 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:37.794292 16227 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:37.827378 16047 raft_consensus.cc:3055] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:37.749747 16060 consensus_queue.cc:1059] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:10:37.734803 13762 raft_consensus.cc:1275] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:38.098358 16047 raft_consensus.cc:740] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:38.104362 16227 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:38.106634 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:38.107617 13756 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:37.820140 16157 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:38.110999 16129 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:38.112888 16157 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:37.815958 16167 raft_consensus.cc:3055] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:38.114233 16167 raft_consensus.cc:740] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:38.115201 16316 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:37.853292 16177 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:10:37.836948 16191 consensus_meta.cc:287] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.610s	user 0.012s	sys 0.000s
I20260709 12:10:37.837688 16233 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:37.965230 13585 catalog_manager.cc:5697] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 1 to 3, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 3 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:38.143499 13834 raft_consensus.cc:1240] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:38.144232 16232 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:38.144878 14410 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41700 (request call id 324) took 1800 ms (client timeout 1849 ms). Trace:
I20260709 12:10:37.983392 16126 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
W20260709 12:10:38.145879 13652 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.001s	sys 0.005s
W20260709 12:10:38.146378 13652 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.001s	sys 0.005s
I20260709 12:10:38.146327 16126 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:38.146994 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 585328us
W20260709 12:10:37.983652 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 244617us
I20260709 12:10:38.149207 16126 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:38.149695 13800 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
W20260709 12:10:38.032265 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 352137us
I20260709 12:10:37.869163 16187 consensus_queue.cc:260] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:38.038185 16282 log.cc:927] Time spent T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 1.465s	user 0.010s	sys 0.014s
I20260709 12:10:37.882781 16262 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:38.083164 16100 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:38.084712 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:38.086354 13761 raft_consensus.cc:1275] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:38.087386 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:38.089708 16267 consensus_queue.cc:237] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:38.091661 16231 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:38.068447 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:38.094318 13680 raft_consensus.cc:1240] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:10:38.164537 16187 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:37.884974 16260 raft_consensus.cc:740] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:38.105252 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:38.078899 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:38.166811 13762 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 5.
I20260709 12:10:38.167260 16260 consensus_queue.cc:260] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:38.168938 13762 raft_consensus.cc:1240] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:10:38.100615 16047 consensus_queue.cc:260] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:38.127050 13683 raft_consensus.cc:2393] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 5: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:38.116389 16167 consensus_queue.cc:260] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:38.170509 16047 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:38.171205 16167 raft_consensus.cc:3060] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:38.128948 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:37.838307 15938 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:38.130664 16329 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:10:38.127130 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.133878 16258 raft_consensus.cc:2749] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:38.145448 14410 rpcz_store.cc:269] 0709 12:10:36.344558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.344738 (+   180us) service_pool.cc:224] Handling call
0709 12:10:38.144408 (+1799670us) spinlock_profiling.cc:243] Waited 509 ms on lock 0x7b5400702954. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:38.144645 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1170446720}
I20260709 12:10:37.876058 16230 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:38.169513 16260 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:38.164557 13757 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 6.
I20260709 12:10:38.168944 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:38.194564 13837 raft_consensus.cc:1240] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:38.194684 16191 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:38.195724 16051 raft_consensus.cc:2804] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:38.196369 16051 raft_consensus.cc:697] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 8 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
W20260709 12:10:38.196914 13763 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48114 (request call id 1985) took 2488 ms (client timeout 1847 ms). Trace:
I20260709 12:10:38.191038 16321 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:38.197713 16051 consensus_queue.cc:237] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:38.198565 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.198716 13755 raft_consensus.cc:1275] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:38.207876 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:10:38.189497 13832 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54820 (request call id 2022) took 1860 ms (client timeout 1545 ms). Trace:
W20260709 12:10:38.221647 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 72113.1us
I20260709 12:10:38.199921 13688 raft_consensus.cc:2393] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 6: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
W20260709 12:10:38.220609 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.144913 13585 catalog_manager.cc:5697] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:38.201102 16230 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:38.228114 16124 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.003s	sys 0.003s
I20260709 12:10:38.203387 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:10:38.229352 16194 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.007s	sys 0.005s
W20260709 12:10:38.197436 13763 rpcz_store.cc:269] 0709 12:10:35.708697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.722520 (+ 13823us) service_pool.cc:224] Handling call
0709 12:10:38.196478 (+2473958us) spinlock_profiling.cc:243] Waited 712 ms on lock 0x7b5400393ad4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:38.196643 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1637657344}
I20260709 12:10:38.231767 14407 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 7.
W20260709 12:10:38.232102 16339 log.cc:927] Time spent T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.319s	user 0.006s	sys 0.000s
I20260709 12:10:38.232641 16262 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:38.233057 16224 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:38.221329 16024 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:38.234786 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.203751 16329 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:38.235767 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:38.238914 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.234114 16024 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:38.208189 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:10:38.245431 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.249537 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:38.250458 13685 raft_consensus.cc:1240] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:38.192080 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:10:38.226526 13832 rpcz_store.cc:269] 0709 12:10:36.328889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.329090 (+   201us) service_pool.cc:224] Handling call
0709 12:10:38.189135 (+1860045us) spinlock_profiling.cc:243] Waited 514 ms on lock 0x7b54000b40d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:38.189272 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1181351808}
I20260709 12:10:38.197570 16191 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:38.201768 15938 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:38.222350 16321 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:38.262908 13830 raft_consensus.cc:1240] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:38.263990 13800 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:10:38.256345 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 404947us
I20260709 12:10:38.264763 13652 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:38.276751 13726 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:38.278961 16329 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:38.278301 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:38.238694 16126 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:38.277722 13800 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:38.278206 16231 raft_consensus.cc:2804] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:38.314884 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:38.277988 16258 raft_consensus.cc:2804] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:10:38.278237 16236 consensus_meta.cc:287] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 1.076s	user 0.007s	sys 0.012s
I20260709 12:10:38.310388 13756 raft_consensus.cc:2410] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:38.309289 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:38.310906 13831 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 4.
I20260709 12:10:38.320374 13652 leader_election.cc:400] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 3. Current term is 4.
I20260709 12:10:38.338584 13652 leader_election.cc:403] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:38.344246 16322 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.345019 16322 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:38.346040 16329 raft_consensus.cc:2749] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 3. Current term is 4.
W20260709 12:10:38.345435 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 60459.7us
I20260709 12:10:38.348012 15925 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:38.349120 16314 consensus_meta.cc:287] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.565s	user 0.008s	sys 0.015s
I20260709 12:10:38.349745 16314 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:38.350328 16275 consensus_queue.cc:1059] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:38.351110 13652 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:38.351686 13679 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 5.
I20260709 12:10:38.352463 16329 raft_consensus.cc:2749] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:38.354755 16191 raft_consensus.cc:2804] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:38.354837 16194 raft_consensus.cc:2804] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:38.363350 16236 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:38.371811 13836 raft_consensus.cc:2393] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 8: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:38.367136 16258 raft_consensus.cc:697] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 4 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:38.375834 13652 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:38.378050 16329 raft_consensus.cc:2749] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:38.381755 16233 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.382799 16233 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:38.390398 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 113863us
I20260709 12:10:38.394151 16344 consensus_queue.cc:1048] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:38.395601 16262 consensus_queue.cc:1059] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:38.333675 16231 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:38.374378 16024 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:38.364852 16191 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:38.410854 16231 raft_consensus.cc:3060] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:38.456489 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:38.474716 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:38.479260 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:38.462911 16191 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:38.502013 13763 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 5.
I20260709 12:10:38.518337 13762 raft_consensus.cc:1240] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:38.518455 16342 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:38.519567 16342 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:38.522650 16258 consensus_queue.cc:237] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:38.525942 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 248351us
I20260709 12:10:38.527765 16213 consensus_queue.cc:1048] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:38.528142 16267 consensus_queue.cc:1059] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:38.528528 13800 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
W20260709 12:10:38.530526 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.531531 15938 raft_consensus.cc:2804] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:38.532459 15938 raft_consensus.cc:697] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 4 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:38.443840 16126 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:38.535269 16314 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:38.535974 16126 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:38.536882 13756 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 9.
I20260709 12:10:38.538511 13685 raft_consensus.cc:2393] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 5: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
W20260709 12:10:38.538780 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:38.539287 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.540163 16232 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.540617 16275 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:38.540954 16232 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:38.541616 16275 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:38.480171 16236 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:38.556910 16232 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:10:38.558091 16348 log.cc:927] Time spent T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.526s	user 0.000s	sys 0.004s
I20260709 12:10:38.484201 16344 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.566524 16344 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:38.568904 16344 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:38.484694 16194 raft_consensus.cc:697] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:10:38.593521 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 307693us
I20260709 12:10:38.499245 16233 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:38.561511 16167 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.611181 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:38.616114 13756 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 7.
I20260709 12:10:38.614681 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:10:38.680051 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.620431 13757 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:38.620610 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:38.687565 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:38.686966 13727 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:38.533669 15938 consensus_queue.cc:237] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:38.642190 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:10:38.696798 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 168515us
I20260709 12:10:38.697636 13754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 1986) took 2988 ms. Trace:
I20260709 12:10:38.698472 16233 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:10:38.699754 16304 consensus_meta.cc:287] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 1.585s	user 0.007s	sys 0.013s
I20260709 12:10:38.699419 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:10:38.700810 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.687601 13726 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:38.610203 16344 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:10:38.620283 16316 consensus_meta.cc:287] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.504s	user 0.012s	sys 0.004s
I20260709 12:10:38.719451 16186 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:38.719707 16233 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:38.720232 16186 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:38.719748 16167 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:38.693990 16100 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.732602 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:38.719457 16304 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:38.620275 16350 consensus_queue.cc:1059] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.099s
I20260709 12:10:38.730244 13685 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 5.
I20260709 12:10:38.745880 16344 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:38.748888 16344 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:38.750233 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:38.752099 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:38.745929 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:38.753715 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:10:38.761178 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:38.757308 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 69908us
I20260709 12:10:38.784789 13680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 1913) took 2025 ms. Trace:
I20260709 12:10:38.709676 13754 rpcz_store.cc:276] 0709 12:10:35.708942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.953448 (+244506us) service_pool.cc:224] Handling call
0709 12:10:36.160102 (+206654us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:36.160343 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:36.345567 (+185224us) log.cc:844] Serialized 14 byte log entry
0709 12:10:36.635214 (+289647us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:36.635386 (+   172us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:36.635458 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:36.635531 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:38.697227 (+2061696us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b540038bdd0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:38.697405 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":278363,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":61,"raft.queue_time_us":7218,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":90,"spinlock_wait_cycles":473952000,"thread_start_us":401036,"threads_started":2,"wal-append.queue_time_us":458778,"wal-append.run_cpu_time_us":1385,"wal-append.run_wall_time_us":1083317}
I20260709 12:10:38.800005 13680 rpcz_store.cc:276] 0709 12:10:36.759451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.891935 (+132484us) service_pool.cc:224] Handling call
0709 12:10:37.360327 (+468392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:38.164842 (+804515us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:38.784145 (+619303us) spinlock_profiling.cc:243] Waited 675 ms on lock 0x7b540021e154. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:38.784461 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1551610624}
I20260709 12:10:38.754456 16350 raft_consensus.cc:3055] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:38.785655 13755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 1424) took 3269 ms. Trace:
W20260709 12:10:38.775110 13688 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 1921) took 2013 ms (client timeout 1947 ms). Trace:
I20260709 12:10:38.685732 16231 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:38.805922 13759 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 4.
I20260709 12:10:38.823303 13757 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 6.
I20260709 12:10:38.816169 16350 raft_consensus.cc:740] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:38.811256 13755 rpcz_store.cc:276] 0709 12:10:35.516543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.729655 (+213112us) service_pool.cc:224] Handling call
0709 12:10:38.197937 (+2468282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:38.224030 (+ 26093us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:38.785308 (+561278us) spinlock_profiling.cc:243] Waited 2.47 s on lock 0x7b5400393ad0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:38.785501 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5675584896}
I20260709 12:10:38.824713 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:38.754596 13800 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:38.753865 16024 raft_consensus.cc:2804] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:10:38.812760 13688 rpcz_store.cc:269] 0709 12:10:36.761479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.860384 (+ 98905us) service_pool.cc:224] Handling call
0709 12:10:38.774760 (+1914376us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54002c2c54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:38.774974 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2903319296}
I20260709 12:10:38.776934 15775 raft_consensus.cc:3055] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:38.785401 15925 raft_consensus.cc:2749] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:38.807238 16342 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:38.758828 16277 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:38.773717 14409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41700 (request call id 328) took 1212 ms. Trace:
I20260709 12:10:38.841163 13682 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 9.
I20260709 12:10:38.785300 16186 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:38.862825 13679 raft_consensus.cc:1240] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:38.727288 16100 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:38.784766 16275 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:38.870286 13828 raft_consensus.cc:1240] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:10:38.878952 16304 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:10:38.881191 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 194328us
I20260709 12:10:38.849354 15775 raft_consensus.cc:740] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:38.880983 16350 consensus_queue.cc:260] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:38.882185 13727 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:38.883008 16185 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.882761 15775 consensus_queue.cc:260] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:38.866878 16233 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:38.883740 16185 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:38.884764 15775 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:38.849439 16187 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.886266 16187 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:38.889096 16187 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:38.754956 16267 consensus_queue.cc:1059] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.108s
I20260709 12:10:38.890223 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:38.883234 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:38.892060 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:38.896927 13680 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 4.
I20260709 12:10:38.874781 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:38.903134 13681 raft_consensus.cc:2410] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:38.861274 16024 raft_consensus.cc:697] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:38.867414 16227 raft_consensus.cc:2804] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:38.882805 16350 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:38.913995 13681 raft_consensus.cc:1275] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:38.911626 13651 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:10:38.902343 16260 consensus_meta.cc:287] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.675s	user 0.007s	sys 0.007s
I20260709 12:10:38.913892 13688 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 4.
I20260709 12:10:38.919088 16185 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:38.920289 13761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 1432) took 1205 ms. Trace:
I20260709 12:10:38.966600 16100 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:38.967008 13761 rpcz_store.cc:276] 0709 12:10:37.702395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.702698 (+   303us) service_pool.cc:224] Handling call
0709 12:10:37.703028 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:38.178456 (+475428us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:38.895109 (+716653us) spinlock_profiling.cc:243] Waited 315 ms on lock 0x7b540035edd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:38.907654 (+ 12545us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":725489408}
I20260709 12:10:38.920717 13837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 2032) took 1699 ms. Trace:
W20260709 12:10:38.922158 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 167711us
I20260709 12:10:38.968169 13837 rpcz_store.cc:276] 0709 12:10:37.212127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.213017 (+   890us) service_pool.cc:224] Handling call
0709 12:10:37.230420 (+ 17403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:38.195073 (+964653us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:38.894808 (+699735us) spinlock_profiling.cc:243] Waited 956 ms on lock 0x7b54000db454. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:38.911050 (+ 16242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2198768384}
I20260709 12:10:38.968742 13800 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:38.970561 16185 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:10:38.970443 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 102239us
I20260709 12:10:38.970814 16213 raft_consensus.cc:3055] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:38.971040 16185 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:38.971487 16213 raft_consensus.cc:740] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:38.971654 16185 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:38.922330 13682 raft_consensus.cc:1275] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:38.923707 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:38.972676 16213 consensus_queue.cc:260] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:38.924224 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:38.974582 16304 raft_consensus.cc:3055] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:38.975059 16304 raft_consensus.cc:740] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:38.975173 16372 raft_consensus.cc:2804] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:38.975631 16372 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:38.976063 16372 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:38.976195 16304 consensus_queue.cc:260] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:38.977437 13651 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:38.924866 16258 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.925302 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:38.925324 16227 raft_consensus.cc:697] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 3 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:38.925474 16236 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.926555 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:38.862859 14409 rpcz_store.cc:276] 0709 12:10:37.560731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.569910 (+  9179us) service_pool.cc:224] Handling call
0709 12:10:37.684943 (+115033us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:38.202557 (+517614us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:10:38.202991 (+   434us) log.cc:844] Serialized 14 byte log entry
0709 12:10:38.313086 (+110095us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:38.320640 (+  7554us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:38.336140 (+ 15500us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:38.773075 (+436935us) spinlock_profiling.cc:243] Waited 338 ms on lock 0x7b54007102d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:38.773142 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:38.773450 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48501,"prepare.queue_time_us":3102,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":65,"raft.queue_time_us":71366,"raft.run_cpu_time_us":375,"raft.run_wall_time_us":113329,"spinlock_wait_cycles":776454400,"thread_start_us":56710,"threads_started":1,"wal-append.queue_time_us":57213}
I20260709 12:10:38.931664 16267 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.985800 16191 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:39.003925 16220 consensus_queue.cc:1059] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:39.004258 16267 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:39.005137 16220 raft_consensus.cc:3055] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:39.005522 16220 raft_consensus.cc:740] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:39.006000 16191 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:39.006522 16220 consensus_queue.cc:260] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:38.979075 16231 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:39.007820 16231 raft_consensus.cc:2804] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:39.008184 16231 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:38.758419 16194 consensus_queue.cc:237] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:39.008510 16231 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:38.997874 16213 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:38.946521 16024 consensus_queue.cc:237] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:38.934340 15925 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:39.013221 15925 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:39.013700 15925 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:39.023628 16292 raft_consensus.cc:3055] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:39.024201 16292 raft_consensus.cc:740] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:38.980474 16167 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:38.951102 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:38.953197 16338 log.cc:927] Time spent T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 1.042s	user 0.000s	sys 0.003s
I20260709 12:10:38.961084 13683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1253) took 2161 ms. Trace:
I20260709 12:10:38.962327 13686 raft_consensus.cc:1240] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:10:38.962692 13828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 2033) took 1631 ms. Trace:
I20260709 12:10:39.074653 13828 rpcz_store.cc:276] 0709 12:10:37.331479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.341987 (+ 10508us) service_pool.cc:224] Handling call
0709 12:10:37.348724 (+  6737us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:38.906546 (+1557822us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:38.962372 (+ 55826us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b5400362c54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:38.962621 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3419101056}
I20260709 12:10:39.074005 13683 rpcz_store.cc:276] 0709 12:10:36.799369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.883902 (+ 84533us) service_pool.cc:224] Handling call
0709 12:10:38.960813 (+2076911us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b5400199e54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:38.960993 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2833289984}
W20260709 12:10:38.964489 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:38.983356 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 70152.5us
I20260709 12:10:39.077385 16306 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.078125 16306 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:38.983259 13684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 1918) took 2222 ms. Trace:
I20260709 12:10:38.937449 13835 raft_consensus.cc:1240] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:39.084422 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:39.084570 16185 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:39.086936 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:39.087823 13828 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 3.
I20260709 12:10:39.082067 13684 rpcz_store.cc:276] 0709 12:10:36.760726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.941643 (+180917us) service_pool.cc:224] Handling call
0709 12:10:37.402110 (+460467us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:37.592651 (+190541us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:38.982832 (+1390181us) spinlock_profiling.cc:243] Waited 442 ms on lock 0x7b540021f050. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:38.983070 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1016732032}
I20260709 12:10:39.090226 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:39.091023 13837 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 4.
I20260709 12:10:39.093066 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:39.093704 13837 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:39.100710 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.068941 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:39.025432 16292 consensus_queue.cc:260] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:38.977681 16304 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:39.014020 16258 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:39.013615 16236 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:39.014763 16227 consensus_queue.cc:237] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:39.073994 13727 leader_election.cc:304] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:39.104318 13685 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 6.
W20260709 12:10:39.122089 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.987358 16322 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:39.152820 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:39.183619 13759 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48120 (request call id 1433) took 1467 ms (client timeout 1711 ms). Trace:
I20260709 12:10:39.196060 13686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 1926) took 1878 ms. Trace:
W20260709 12:10:39.188702 13759 rpcz_store.cc:269] 0709 12:10:37.702697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.982982 (+280285us) service_pool.cc:224] Handling call
0709 12:10:39.169764 (+1186782us) spinlock_profiling.cc:243] Waited 560 ms on lock 0x7b54002b0cd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:39.169945 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1289143552}
I20260709 12:10:39.196657 13686 rpcz_store.cc:276] 0709 12:10:37.317592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.321938 (+  4346us) service_pool.cc:224] Handling call
0709 12:10:38.961635 (+1639697us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:39.074226 (+112591us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:39.168151 (+ 93925us) spinlock_profiling.cc:243] Waited 1.64 s on lock 0x7b5400199e50. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:39.195966 (+ 27815us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3769997184}
I20260709 12:10:39.223186 13837 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 7.
I20260709 12:10:39.232218 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:39.203907 16267 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:39.232542 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:39.235903 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:39.238437 13685 raft_consensus.cc:2468] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 5.
I20260709 12:10:39.239607 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:39.241004 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:39.214403 15775 raft_consensus.cc:2804] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:10:39.247764 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.239487 16322 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.250927 16322 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:39.251400 13831 raft_consensus.cc:1275] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:39.253361 16322 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:39.254041 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:39.255100 13829 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 2.
I20260709 12:10:39.258670 13651 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:10:39.261714 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:39.268747 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:39.274000 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 313014us
I20260709 12:10:39.219108 16231 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:39.279269 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 59318.6us
I20260709 12:10:39.281625 13834 raft_consensus.cc:1240] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:39.278301 16323 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.260470 16220 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:39.286170 13651 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:39.303025 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:39.301265 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:39.312286 13761 raft_consensus.cc:1240] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:39.325873 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:39.278766 15775 raft_consensus.cc:697] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:39.338055 13651 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:39.346637 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:39.347957 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:39.347371 13828 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 5.
I20260709 12:10:39.315860 16185 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:39.347225 13833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 2039) took 1051 ms. Trace:
I20260709 12:10:39.354990 13726 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:39.356741 13834 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 4.
I20260709 12:10:39.348963 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:39.358815 13754 raft_consensus.cc:2393] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 5: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:39.361438 13761 raft_consensus.cc:2393] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 6: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:39.371445 13726 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:39.377276 15953 raft_consensus.cc:2804] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:39.374336 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:39.355181 13833 rpcz_store.cc:276] 0709 12:10:38.139010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:38.141169 (+  2159us) service_pool.cc:224] Handling call
0709 12:10:38.185724 (+ 44555us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:38.333030 (+147306us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:38.333067 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:38.458193 (+125126us) log.cc:844] Serialized 26 byte log entry
0709 12:10:38.602351 (+144158us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:38.602410 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:38.604352 (+  1942us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:39.024547 (+420195us) raft_consensus.cc:1685] finished
0709 12:10:39.024567 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:39.189073 (+164506us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11972,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":65446,"thread_start_us":71483,"threads_started":1,"wal-append.queue_time_us":534258}
I20260709 12:10:39.377475 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:39.362730 16024 raft_consensus.cc:2749] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:39.330595 16323 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:39.354363 16230 raft_consensus.cc:2804] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:39.390362 13761 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 4.
I20260709 12:10:39.366339 16277 raft_consensus.cc:2804] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:39.377844 15953 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:39.378089 16233 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:39.432919 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 61595.9us
I20260709 12:10:39.452142 16321 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:39.397063 16230 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:39.397372 16236 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:39.408392 15953 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:39.405830 16277 raft_consensus.cc:697] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 6 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:39.444424 16258 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:39.451431 15775 consensus_queue.cc:237] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:39.505116 13680 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.040s	sys 0.072s
I20260709 12:10:39.404737 16322 raft_consensus.cc:2804] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:39.702826 16322 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:39.702996 16377 log.cc:927] Time spent T 00000000000000000000000000000000 P 17d79eae88f84be7a847d0cf544674cd: Append to log took a long time: real 0.395s	user 0.009s	sys 0.006s
I20260709 12:10:39.703343 16322 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:39.703967 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:39.705168 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:39.667878 13759 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 7.
I20260709 12:10:39.677783 13726 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:39.670607 16267 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:39.678932 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:10:39.702152 13680 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.042s	sys 0.085s
W20260709 12:10:39.680058 16194 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.054s	sys 0.102s
W20260709 12:10:39.671916 16344 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.761s	user 0.028s	sys 0.128s
I20260709 12:10:39.674918 16230 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:39.721158 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:39.726974 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:10:39.734337 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 65384.5us
I20260709 12:10:39.676836 16051 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:10:39.717415 16194 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.054s	sys 0.103s
W20260709 12:10:39.721060 16344 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.814s	user 0.029s	sys 0.131s
W20260709 12:10:39.725947 15925 consensus_meta.cc:287] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.703s	user 0.013s	sys 0.000s
I20260709 12:10:39.748004 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:39.719857 16231 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:39.717310 16187 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:39.750394 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:39.750922 13684 raft_consensus.cc:2393] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 7: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:39.672366 16233 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:39.752456 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:39.730157 16329 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.755570 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:39.763360 16241 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:39.763587 14380 thread.cc:641] server-negotiator [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.017s	sys 0.032s
W20260709 12:10:39.764005 14380 thread.cc:608] server-negotiator [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.017s	sys 0.032s
I20260709 12:10:39.717520 16024 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:39.758775 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:39.759689 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:39.737491 16350 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:39.756201 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:39.766491 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:39.768364 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:39.772161 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:39.732396 16267 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:39.777567 13679 raft_consensus.cc:1240] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:10:39.781363 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:39.781590 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:39.782421 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:39.785022 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:10:39.794310 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.808481 14413 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:39.783341 13687 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 6.
I20260709 12:10:39.783771 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:39.810986 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:39.811486 13761 raft_consensus.cc:1240] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:39.811743 16378 log.cc:927] Time spent T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:10:39.812915 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:39.834874 13830 raft_consensus.cc:2393] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 5: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:39.815090 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:39.776384 16329 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:39.823341 13756 raft_consensus.cc:1275] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:39.825914 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:39.827039 13686 raft_consensus.cc:2393] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 5: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:39.832121 13681 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:39.750829 15925 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:39.835358 13754 raft_consensus.cc:2468] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 5.
I20260709 12:10:39.857941 13687 raft_consensus.cc:1240] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 6. Current term is 7. Ops: [5.3-6.4]
I20260709 12:10:39.765455 16194 consensus_queue.cc:1059] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.068s
W20260709 12:10:39.862349 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.872905 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:39.878371 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:10:39.856252 15941 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.030s	sys 0.034s
I20260709 12:10:39.887121 16233 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:39.887600 16329 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:39.890537 16304 consensus_meta.cc:287] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.760s	user 0.010s	sys 0.003s
I20260709 12:10:39.892014 16267 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:10:39.892836 16372 consensus_meta.cc:287] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.916s	user 0.022s	sys 0.006s
I20260709 12:10:39.782613 16024 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:39.893188 16255 raft_consensus.cc:3055] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:10:39.904003 15941 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.031s	sys 0.035s
W20260709 12:10:39.926582 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 176946us
I20260709 12:10:39.860694 16323 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:39.897967 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:39.898809 14413 raft_consensus.cc:2410] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:39.845948 15953 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:39.900388 13685 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 5.
I20260709 12:10:39.783079 16187 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:39.903357 13763 raft_consensus.cc:2393] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 8: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:39.777652 16241 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:39.906280 14411 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 6.
I20260709 12:10:39.907074 13754 raft_consensus.cc:1275] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:10:39.907881 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:10:39.911399 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 489582us
W20260709 12:10:39.912460 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.893796 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:39.894940 16306 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:39.874241 16258 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:39.811074 16051 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:39.951709 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:39.928103 13726 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:39.903723 16167 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:39.936848 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.926342 16255 raft_consensus.cc:740] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:39.956681 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:39.966214 13681 raft_consensus.cc:2410] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:39.966770 13833 raft_consensus.cc:2410] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:10:39.967604 13687 raft_consensus.cc:1240] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:39.846978 16277 consensus_queue.cc:237] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:39.970932 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:39.926592 16372 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:39.973464 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:39.978482 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:10:39.981307 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:39.981865 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.983587 13836 raft_consensus.cc:1240] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:39.986063 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:39.987354 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:39.987725 15953 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:39.987959 13760 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 4.
I20260709 12:10:39.988695 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:39.988831 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:39.989351 13760 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 5.
I20260709 12:10:39.978679 16231 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:39.990121 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:39.991016 13828 raft_consensus.cc:2410] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:39.990705 16231 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:39.986233 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:39.993455 13651 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:39.957845 16258 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:40.023754 13681 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 5.
I20260709 12:10:39.979904 16390 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.036170 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:40.058787 16230 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:40.119328 16255 consensus_queue.cc:260] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:39.993739 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:10:40.376899 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 287586us
I20260709 12:10:40.418247 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:40.424865 16255 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:40.425738 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:40.427023 13828 raft_consensus.cc:2393] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 4: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:40.427299 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:40.128090 16241 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:39.992818 13754 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 5.
W20260709 12:10:40.418344 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 424980us
I20260709 12:10:40.001345 13833 raft_consensus.cc:1275] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:10:40.413090 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:40.428511 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:40.043329 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:40.038472 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:40.039004 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:40.042583 16397 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.032418 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:40.055588 15925 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:10:39.967042 14380 connection.cc:256] RPC call timeout handler was delayed by -1.2473190640000666s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1516s for a response
I20260709 12:10:40.414816 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:40.451653 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:40.056164 16051 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:40.023422 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:40.411370 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:40.121061 16393 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:40.350121 16304 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:40.057046 16384 log.cc:927] Time spent T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.197s	user 0.003s	sys 0.000s
I20260709 12:10:40.363233 15953 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:40.426101 16391 raft_consensus.cc:2804] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:40.428222 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:40.459388 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:40.459625 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:40.460139 13828 raft_consensus.cc:2393] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 4: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:40.460218 13756 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 4.
W20260709 12:10:40.409825 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 482148us
I20260709 12:10:40.287146 16322 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:39.975198 16329 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.418329 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:40.000202 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:40.036008 13837 raft_consensus.cc:2393] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 7: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
W20260709 12:10:40.360668 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.433513 13688 raft_consensus.cc:1240] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260709 12:10:40.434626 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 302194us
I20260709 12:10:40.466032 13829 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:40.457975 16220 consensus_meta.cc:287] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 1.141s	user 0.013s	sys 0.000s
I20260709 12:10:39.974395 16233 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:10:40.123942 16394 log.cc:927] Time spent T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
W20260709 12:10:39.995309 16213 consensus_meta.cc:287] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.985s	user 0.008s	sys 0.006s
I20260709 12:10:40.130411 16024 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:40.449249 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:40.452711 13833 raft_consensus.cc:2410] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:10:40.134263 16187 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:40.036495 15941 raft_consensus.cc:2749] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:40.480265 16230 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:40.480389 16213 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:40.480803 13835 raft_consensus.cc:2410] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:40.453912 14379 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:39.978904 16167 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:40.462007 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.462114 13726 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:40.461920 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:40.462168 16397 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:40.434202 13651 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:10:40.485040 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 53010.3us
I20260709 12:10:40.467636 13832 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 5.
I20260709 12:10:40.472803 13755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48120 (request call id 1439) took 1136 ms. Trace:
I20260709 12:10:40.473601 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:40.473483 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:40.475293 13831 raft_consensus.cc:2393] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 7: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:40.476425 16322 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:40.462392 16391 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:40.461918 16231 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:40.462280 16393 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:40.454246 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:40.482239 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:40.483379 13758 raft_consensus.cc:2393] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 6: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:40.484043 13836 raft_consensus.cc:2393] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 6: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:40.460716 16304 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:40.466019 15953 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:40.486088 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:10:40.637959 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.487692 13830 raft_consensus.cc:2410] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:40.557480 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:10:40.695988 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 162140us
I20260709 12:10:40.486824 14410 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 5.
W20260709 12:10:40.704185 13832 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35422 (request call id 421) took 1561 ms (client timeout 1866 ms). Trace:
I20260709 12:10:40.703758 13755 rpcz_store.cc:276] 0709 12:10:39.336297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:39.336480 (+   183us) service_pool.cc:224] Handling call
0709 12:10:40.418188 (+1081708us) spinlock_profiling.cc:243] Waited 2.46 ms on lock 0x7b58001e3f98. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924e68b71 00007fa924e68a22 00007fa92dd818d9 00007fa92cedbee0 00007fa92cfa50ab 00007fa92cfa5131 00007fa92cf530a0 00007fa92cf52984 00007fa9264cd6d4 00007fa9264cd662
0709 12:10:40.472717 (+ 54529us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5650816}
I20260709 12:10:40.704144 13828 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:40.530565 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:40.706619 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:40.705058 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:10:40.550420 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.486446 13651 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:10:40.708190 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 246096us
W20260709 12:10:40.707350 13832 rpcz_store.cc:269] 0709 12:10:39.143241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:39.143450 (+   209us) service_pool.cc:224] Handling call
0709 12:10:40.412913 (+1269463us) spinlock_profiling.cc:243] Waited 4.11 ms on lock 0x7b5800034898. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924e68b71 00007fa924e68a22 00007fa92dd818d9 00007fa92cedbee0 00007fa92cfa50ab 00007fa92cfa5131 00007fa92cf530a0 00007fa92cf52984 00007fa9264cd6d4 00007fa9264cd662
0709 12:10:40.704101 (+291188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9460096}
I20260709 12:10:40.708673 13831 raft_consensus.cc:3060] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:40.715279 13726 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:40.716879 16400 raft_consensus.cc:2804] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:40.717440 16400 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:40.718117 13683 raft_consensus.cc:1240] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 6 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:40.557952 16395 log.cc:927] Time spent T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
W20260709 12:10:40.530982 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 91558.9us
W20260709 12:10:40.720638 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 234264us
I20260709 12:10:40.572938 16241 raft_consensus.cc:2804] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:40.724421 16241 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:40.724289 13651 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:40.724999 16241 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:40.726285 16231 raft_consensus.cc:2804] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:40.726812 16231 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:40.727334 16231 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:40.573356 13682 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 8.
I20260709 12:10:40.728585 13761 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 5.
I20260709 12:10:40.530792 16397 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:40.469832 16390 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:40.730427 13679 raft_consensus.cc:2468] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 4.
I20260709 12:10:40.730669 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:40.478786 16329 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:40.573107 16024 raft_consensus.cc:2804] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:40.732993 16024 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:40.733256 13834 raft_consensus.cc:1240] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:40.733466 16024 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:40.734539 16260 consensus_queue.cc:1059] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:40.481256 16233 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:40.735183 16277 raft_consensus.cc:2804] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:40.735414 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:40.735675 16277 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:40.736073 16277 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:40.736320 13836 raft_consensus.cc:2410] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 8 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:40.736730 16397 raft_consensus.cc:3055] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:40.737159 16397 raft_consensus.cc:740] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:40.522536 16213 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:40.738601 16404 log.cc:927] Time spent T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.207s	user 0.000s	sys 0.000s
I20260709 12:10:40.738232 16397 consensus_queue.cc:260] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:40.723920 16391 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:40.728629 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:40.742040 15775 consensus_queue.cc:1048] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:40.698482 16258 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:40.707463 16220 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.525085 16230 raft_consensus.cc:2804] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:40.728763 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:40.571964 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:40.770135 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:40.770952 13757 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:40.484371 16372 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:40.717895 16400 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:40.776752 13726 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:10:40.767962 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 61136.6us
I20260709 12:10:40.768894 13833 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 7.
I20260709 12:10:40.782400 13829 raft_consensus.cc:2410] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:40.784682 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:40.787199 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:40.787698 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:40.769297 16230 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:40.789359 16230 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:40.790136 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:40.791994 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:40.792969 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:40.796046 13834 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 4.
I20260709 12:10:40.805495 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:40.779297 16213 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:40.807368 13829 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 7.
I20260709 12:10:40.808245 13651 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:40.783630 16322 raft_consensus.cc:2804] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:40.794006 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:40.771384 16220 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:40.816233 14414 raft_consensus.cc:2393] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 5: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:10:40.795185 16372 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.813326 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:40.786041 16304 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:40.818003 13833 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 5.
I20260709 12:10:40.824550 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:40.824791 16220 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:40.825409 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:40.826123 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:10:40.827833 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 50111.1us
I20260709 12:10:40.830892 13831 raft_consensus.cc:2468] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 3.
I20260709 12:10:40.794836 15941 consensus_queue.cc:1048] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:10:40.834249 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:40.813885 16322 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:40.807094 16258 consensus_queue.cc:1048] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 12:10:40.845956 13757 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 8.
I20260709 12:10:40.827422 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:40.850374 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:40.851421 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:10:40.855145 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 109711us
I20260709 12:10:40.834038 15953 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:40.852247 14412 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 6.
I20260709 12:10:40.836032 16322 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:40.850605 14407 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:40.850399 16220 consensus_queue.cc:1048] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 12:10:40.822276 16372 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:40.865985 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:40.886168 15953 raft_consensus.cc:2804] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:40.886642 15953 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:10:40.889215 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 81028.1us
I20260709 12:10:40.892388 13651 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:40.887084 16185 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.848011 16413 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:40.893240 13726 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:40.886996 15953 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:40.876075 16329 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:40.885149 16393 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:10:40.903245 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 77404.4us
W20260709 12:10:40.906016 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 49002.2us
I20260709 12:10:40.907298 14379 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:40.907945 13800 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:40.908569 13726 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:40.896706 16241 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:40.911242 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:40.911906 14413 raft_consensus.cc:2393] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 7: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:10:40.912642 13687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 1951) took 1053 ms. Trace:
I20260709 12:10:40.913108 16241 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:40.902056 16185 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:40.916262 16185 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:40.912992 13687 rpcz_store.cc:276] 0709 12:10:39.859586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:39.866845 (+  7259us) service_pool.cc:224] Handling call
0709 12:10:39.967430 (+100585us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:39.977181 (+  9751us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:40.912424 (+935243us) spinlock_profiling.cc:243] Waited 68.6 ms on lock 0x7b54002463d0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:40.912576 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":157787392}
I20260709 12:10:40.911885 13757 raft_consensus.cc:2468] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 4.
I20260709 12:10:40.892055 16304 consensus_queue.cc:1048] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:10:40.888412 16213 consensus_queue.cc:1048] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 12:10:40.900983 16415 raft_consensus.cc:2804] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:40.927997 13651 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:40.905014 16220 consensus_queue.cc:1059] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
W20260709 12:10:40.935261 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.934216 16390 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:40.925242 16100 raft_consensus.cc:2749] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:40.917734 16393 consensus_queue.cc:1059] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 12:10:40.925602 16415 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:40.937601 16220 raft_consensus.cc:3055] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:40.932207 16420 raft_consensus.cc:2804] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:40.943161 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:40.941424 16258 raft_consensus.cc:2804] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:40.905839 16413 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:40.970201 16258 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:40.971387 13683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1266) took 1232 ms. Trace:
I20260709 12:10:40.971524 16258 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:40.971786 13683 rpcz_store.cc:276] 0709 12:10:39.741191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:39.746645 (+  5454us) service_pool.cc:224] Handling call
0709 12:10:39.752978 (+  6333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:40.718698 (+965720us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:40.971130 (+252432us) spinlock_profiling.cc:243] Waited 965 ms on lock 0x7b54002c2c54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:40.971328 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2219117312}
I20260709 12:10:40.972599 16413 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:40.973394 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 64937.3us
I20260709 12:10:40.956339 16220 raft_consensus.cc:740] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:40.974191 13726 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:40.974504 13688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1274) took 1207 ms. Trace:
I20260709 12:10:40.974978 15775 raft_consensus.cc:2804] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:40.974742 16220 consensus_queue.cc:260] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:40.975440 15775 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:40.975912 15775 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:40.976049 16220 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:40.953930 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.961839 16230 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:40.979322 16230 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:40.961840 16372 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:40.979101 16024 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:40.981011 13763 raft_consensus.cc:2393] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 10: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:40.982499 13682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 1952) took 1088 ms. Trace:
I20260709 12:10:40.982626 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:10:40.983148 16255 consensus_meta.cc:287] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.558s	user 0.010s	sys 0.002s
I20260709 12:10:40.983448 13828 raft_consensus.cc:2410] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:40.983939 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:40.963380 13830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54830 (request call id 1952) took 1118 ms. Trace:
I20260709 12:10:40.985117 13763 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 3.
I20260709 12:10:40.985252 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:40.949234 14407 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 8.
I20260709 12:10:40.965355 16292 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:40.967613 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:40.974893 13688 rpcz_store.cc:276] 0709 12:10:39.769032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:39.824114 (+ 55082us) service_pool.cc:224] Handling call
0709 12:10:39.846736 (+ 22622us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:40.467875 (+621139us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:40.974260 (+506385us) spinlock_profiling.cc:243] Waited 586 ms on lock 0x7b540006fc54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:40.974443 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1348619520}
I20260709 12:10:40.951614 16417 raft_consensus.cc:2804] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:40.962719 16323 raft_consensus.cc:3055] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:40.963815 16277 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:40.987638 14416 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 6.
I20260709 12:10:40.982893 13682 rpcz_store.cc:276] 0709 12:10:39.894452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:39.897122 (+  2670us) service_pool.cc:224] Handling call
0709 12:10:40.982340 (+1085218us) spinlock_profiling.cc:243] Waited 645 ms on lock 0x7b54002bf2d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:40.982441 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1482434944}
I20260709 12:10:40.988300 13757 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 3.
I20260709 12:10:41.006745 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:10:41.094094 16376 log.cc:927] Time spent T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 1.317s	user 0.009s	sys 0.012s
I20260709 12:10:41.064821 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:41.124243 16255 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.060514 16422 raft_consensus.cc:2804] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:41.124776 13651 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:41.125310 16422 raft_consensus.cc:697] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 8 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:41.125568 16413 raft_consensus.cc:2804] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:40.985451 13830 rpcz_store.cc:276] 0709 12:10:39.844723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:39.844833 (+   110us) service_pool.cc:224] Handling call
0709 12:10:40.963158 (+1118325us) spinlock_profiling.cc:243] Waited 608 ms on lock 0x7b540002e754. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:40.963311 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1398193536}
I20260709 12:10:40.986001 16420 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:41.126221 16413 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:41.126678 16420 raft_consensus.cc:3060] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:41.126847 16413 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:41.124881 16255 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:41.046998 16393 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.129645 16255 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:41.129949 16393 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:41.130985 13763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2027) took 1142 ms. Trace:
I20260709 12:10:41.131381 13763 rpcz_store.cc:276] 0709 12:10:39.988113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.008817 (+1020704us) service_pool.cc:224] Handling call
0709 12:10:41.130459 (+121642us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:41.130632 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:41.130659 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:41.130701 (+    42us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:41.130734 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:41.130782 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:41.130900 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:41.132208 16393 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:41.129410 16323 raft_consensus.cc:740] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:41.133247 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:41.133420 16323 consensus_queue.cc:260] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:41.134729 16323 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:41.135306 16413 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:41.136029 13688 raft_consensus.cc:1275] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:41.137223 16413 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:40.943845 16415 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:41.126830 16417 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:41.138638 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.026474 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:10:41.036123 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 128222us
W20260709 12:10:41.069074 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:41.140174 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.140858 13684 raft_consensus.cc:2393] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 6: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:41.138451 16417 raft_consensus.cc:3060] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:41.116339 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 209134us
I20260709 12:10:41.141955 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:41.145375 13800 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:41.143364 13761 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 8.
I20260709 12:10:41.149688 14379 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:41.150372 16277 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:41.150907 14379 leader_election.cc:304] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:41.151149 16241 raft_consensus.cc:2804] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:41.151525 16241 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:41.151870 16241 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:41.151981 13761 raft_consensus.cc:1275] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:41.152922 16419 raft_consensus.cc:2764] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:10:41.148612 13682 raft_consensus.cc:1275] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:10:41.154659 13686 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1265) took 1425 ms (client timeout 1689 ms). Trace:
W20260709 12:10:41.155061 13686 rpcz_store.cc:269] 0709 12:10:39.730506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:39.744768 (+ 14262us) service_pool.cc:224] Handling call
0709 12:10:41.154483 (+1409715us) spinlock_profiling.cc:243] Waited 32.3 ms on lock 0x7b54002846d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:41.154603 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":74292480}
I20260709 12:10:41.156742 16231 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:41.159379 16379 log.cc:927] Time spent T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 1.252s	user 0.001s	sys 0.009s
I20260709 12:10:41.161011 13680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 1945) took 2475 ms. Trace:
W20260709 12:10:41.161530 13837 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35422 (request call id 424) took 1926 ms (client timeout 1594 ms). Trace:
W20260709 12:10:41.162245 13837 rpcz_store.cc:269] 0709 12:10:39.235215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:39.235591 (+   376us) service_pool.cc:224] Handling call
0709 12:10:41.161310 (+1925719us) spinlock_profiling.cc:243] Waited 797 ms on lock 0x7b540002dd54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:41.161452 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1833243008}
I20260709 12:10:41.163211 16417 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:41.164273 13679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 1956) took 1268 ms. Trace:
I20260709 12:10:41.164693 13679 rpcz_store.cc:276] 0709 12:10:39.895701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:40.428251 (+532550us) service_pool.cc:224] Handling call
0709 12:10:41.164093 (+735842us) spinlock_profiling.cc:243] Waited 301 ms on lock 0x7b54002841d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:41.164200 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":691279744}
I20260709 12:10:41.166018 16417 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:41.157683 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:41.171758 13760 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:41.149128 15953 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:41.181406 13683 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 8.
W20260709 12:10:41.189438 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 48499.5us
I20260709 12:10:41.023003 16194 consensus_queue.cc:1059] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.150s
W20260709 12:10:41.183427 13726 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.651s (SENT) [suppressed 21 similar messages]
I20260709 12:10:41.161444 13680 rpcz_store.cc:276] 0709 12:10:38.685134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:38.900933 (+215799us) service_pool.cc:224] Handling call
0709 12:10:38.901373 (+   440us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:38.903385 (+  2012us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:38.903418 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:38.930001 (+ 26583us) log.cc:844] Serialized 26 byte log entry
0709 12:10:39.714510 (+784509us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:39.714565 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:39.714669 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:41.158781 (+1444112us) spinlock_profiling.cc:243] Waited 3.03 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:10:41.160697 (+  1916us) raft_consensus.cc:1685] finished
0709 12:10:41.160718 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:41.160918 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1286,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":4882,"spinlock_wait_cycles":6975744,"thread_start_us":782122,"threads_started":1,"wal-append.queue_time_us":854176}
I20260709 12:10:41.203356 13757 raft_consensus.cc:1240] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:41.204254 13757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2029) took 1215 ms. Trace:
I20260709 12:10:41.197353 16427 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.209946 16427 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:41.183801 16400 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:41.204639 13757 rpcz_store.cc:276] 0709 12:10:39.988638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.172626 (+1183988us) service_pool.cc:224] Handling call
0709 12:10:41.197732 (+ 25106us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:41.203918 (+  6186us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:41.204181 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:41.129382 16422 consensus_queue.cc:237] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:41.225747 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:10:41.542456 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 1.86117e+06us
I20260709 12:10:41.543152 13686 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:41.392222 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 208794us
I20260709 12:10:41.201162 16372 raft_consensus.cc:2804] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:10:41.439662 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:41.241446 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 89314.5us
W20260709 12:10:41.549933 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.343950 13760 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 7.
W20260709 12:10:41.367175 13685 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1264) took 1648 ms (client timeout 1677 ms). Trace:
W20260709 12:10:41.452036 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:41.516731 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.370909 13755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2023) took 1383 ms. Trace:
I20260709 12:10:41.552031 13755 rpcz_store.cc:276] 0709 12:10:39.987028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:40.729958 (+742930us) service_pool.cc:224] Handling call
0709 12:10:40.730278 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:40.742770 (+ 12492us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:40.742817 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:40.742875 (+    58us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:40.742924 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:41.370591 (+627667us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b54000a0fd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:41.370654 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:41.370826 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28193024}
I20260709 12:10:41.358564 13835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54830 (request call id 1955) took 1395 ms. Trace:
W20260709 12:10:41.468281 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 761932us
W20260709 12:10:41.263797 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 357858us
I20260709 12:10:41.550665 13760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48114 (request call id 2024) took 1563 ms. Trace:
W20260709 12:10:41.550663 13685 rpcz_store.cc:269] 0709 12:10:39.719037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:39.725178 (+  6141us) service_pool.cc:224] Handling call
0709 12:10:41.366919 (+1641741us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b54001b03d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:41.367095 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":327918080}
I20260709 12:10:41.548231 13726 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:41.554368 13760 rpcz_store.cc:276] 0709 12:10:39.987306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:40.042098 (+ 54792us) service_pool.cc:224] Handling call
0709 12:10:41.157550 (+1115452us) spinlock_profiling.cc:243] Waited 3.31 ms on lock 0x7b58001e3f98. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924e68b71 00007fa924e68a22 00007fa92dd818d9 00007fa92cedbee0 00007fa92cfa50ab 00007fa92cfa5131 00007fa92cf530a0 00007fa92cf52984 00007fa9264cd6d4 00007fa9264cd662
0709 12:10:41.550578 (+393028us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7603456}
W20260709 12:10:41.420619 16322 consensus_meta.cc:287] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.528s	user 0.009s	sys 0.001s
I20260709 12:10:41.558034 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:41.557941 16322 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:41.559012 13680 raft_consensus.cc:2410] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:10:41.560364 16322 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:41.553320 13835 rpcz_store.cc:276] 0709 12:10:39.962940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:39.963201 (+   261us) service_pool.cc:224] Handling call
0709 12:10:41.358229 (+1395028us) spinlock_profiling.cc:243] Waited 501 ms on lock 0x7b5400363154. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:41.358473 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1153035520}
I20260709 12:10:41.560462 15953 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:41.508435 15941 raft_consensus.cc:3055] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:41.412778 14409 raft_consensus.cc:1240] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 5 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:41.359951 16386 log.cc:927] Time spent T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 1.468s	user 0.007s	sys 0.004s
W20260709 12:10:41.357347 16388 log.cc:927] Time spent T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 1.471s	user 0.000s	sys 0.012s
I20260709 12:10:41.564328 13726 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:41.544018 16231 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:41.582993 16233 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:10:41.587414 16220 consensus_meta.cc:287] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.610s	user 0.010s	sys 0.000s
I20260709 12:10:41.587926 16344 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:41.588469 16344 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:41.588840 16344 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:41.588973 14409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 678) took 2220 ms. Trace:
I20260709 12:10:41.589510 14409 rpcz_store.cc:276] 0709 12:10:39.391871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:39.432747 (+ 40876us) service_pool.cc:224] Handling call
0709 12:10:41.412242 (+1979495us) spinlock_profiling.cc:243] Waited 1.84 ms on lock 0x7b5800003c98. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924e68e9c 00007fa924e68a5b 00007fa92dd818d9 00007fa92cedbee0 00007fa92cfa50ab 00007fa92cfa5131 00007fa92cf66fc0 00007fa92cf51929 00007fa92cf513d2 00007fa9264c8bd4
0709 12:10:41.412508 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:41.588632 (+176124us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:41.588881 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4222848}
W20260709 12:10:41.590792 13758 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48114 (request call id 2026) took 1603 ms (client timeout 2046 ms). Trace:
W20260709 12:10:41.591317 13758 rpcz_store.cc:269] 0709 12:10:39.987808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:39.989716 (+  1908us) service_pool.cc:224] Handling call
0709 12:10:41.590592 (+1600876us) spinlock_profiling.cc:243] Waited 54.2 ms on lock 0x7b54003a07d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:41.590732 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":124626304}
I20260709 12:10:41.555171 15925 consensus_queue.cc:1048] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:10:41.575048 16194 raft_consensus.cc:2804] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:41.594172 16194 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:41.594630 16194 raft_consensus.cc:3060] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:41.226594 16391 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:41.574756 16241 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:41.400380 16258 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:41.575304 15941 raft_consensus.cc:740] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:41.419153 15775 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:41.274675 16024 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:41.604403 13652 connection.cc:256] RPC call timeout handler was delayed by -1.123513161000119s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2328s for a response
I20260709 12:10:41.411478 16167 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:41.606230 13686 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 6.
I20260709 12:10:41.606673 13759 raft_consensus.cc:1240] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:41.651507 13759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 1447) took 1886 ms. Trace:
I20260709 12:10:41.608974 16427 leader_election.cc:290] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:41.572268 16350 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.614284 16322 consensus_queue.cc:1059] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:10:41.617465 13800 connection.cc:256] RPC call timeout handler was delayed by -1.7073560139997426s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3012s for a response
I20260709 12:10:41.618068 16407 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:41.405231 16420 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:41.623044 16100 consensus_queue.cc:1059] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:41.624555 13727 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:41.626123 16434 consensus_queue.cc:1059] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:10:41.626937 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 48048.7us
I20260709 12:10:41.629969 16260 consensus_queue.cc:1059] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:41.631356 14380 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:41.575855 16372 raft_consensus.cc:697] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 7 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
W20260709 12:10:41.638883 16415 consensus_meta.cc:287] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.500s	user 0.010s	sys 0.000s
I20260709 12:10:41.639737 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:41.640831 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:41.641434 13681 raft_consensus.cc:1240] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:41.641729 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:41.642261 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:41.643164 13682 raft_consensus.cc:1240] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:41.645061 16231 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:41.382557 16400 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:41.374233 16397 raft_consensus.cc:3060] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:41.649580 13652 connection.cc:256] RPC call timeout handler was delayed by -1.0974131610000768s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23570000000000002s for a response
W20260709 12:10:41.668767 13652 connection.cc:256] RPC call timeout handler was delayed by -1.0821131610000521s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23740000000000003s for a response
W20260709 12:10:41.669174 13652 connection.cc:256] RPC call timeout handler was delayed by -1.0750353900000391s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1714s for a response
I20260709 12:10:41.669610 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:41.670331 13681 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 4.
I20260709 12:10:41.669981 16426 raft_consensus.cc:3055] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:41.671069 16426 raft_consensus.cc:740] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:41.671290 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:41.656518 13687 raft_consensus.cc:2393] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 5: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:41.657135 13800 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:41.672365 16423 raft_consensus.cc:3055] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:41.672513 16430 consensus_queue.cc:1048] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:10:41.672845 16423 raft_consensus.cc:740] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:41.673450 16220 raft_consensus.cc:2749] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:41.673898 13800 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:41.673877 16423 consensus_queue.cc:260] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:41.675042 16220 raft_consensus.cc:2749] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:41.675376 16423 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:41.675602 16267 consensus_queue.cc:1059] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:41.676018 16241 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 6 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:41.652174 13759 rpcz_store.cc:276] 0709 12:10:39.764876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:39.765038 (+   162us) service_pool.cc:224] Handling call
0709 12:10:41.606244 (+1841206us) spinlock_profiling.cc:243] Waited 1.25 ms on lock 0x7b58001e3f98. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924e68b71 00007fa924e68a22 00007fa92dd818d9 00007fa92cedbee0 00007fa92cfa50ab 00007fa92cfa5131 00007fa92cf66fc0 00007fa92cf51929 00007fa92cf513d2 00007fa9264c8bd4
0709 12:10:41.606462 (+   218us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:41.651226 (+ 44764us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:41.651432 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2880256}
I20260709 12:10:41.676760 16220 raft_consensus.cc:3055] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:41.676657 16231 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:41.677352 16220 raft_consensus.cc:740] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:41.671948 16426 consensus_queue.cc:260] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:41.678601 16426 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:41.678475 16220 consensus_queue.cc:260] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:41.658485 16051 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.676890 16233 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.679601 16051 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:41.679708 16233 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:41.681339 16372 consensus_queue.cc:237] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:41.682512 16051 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:41.661144 13727 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:41.657153 16322 raft_consensus.cc:3055] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:41.684180 16322 raft_consensus.cc:740] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:41.667140 13679 raft_consensus.cc:2393] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 6: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:41.685022 13800 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:41.667263 16415 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:41.686035 13679 raft_consensus.cc:1275] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:41.686138 16220 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:41.666981 13683 raft_consensus.cc:2468] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 4.
I20260709 12:10:41.687374 16415 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:41.669767 16260 consensus_queue.cc:1048] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:41.688465 13762 raft_consensus.cc:2393] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 7: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
W20260709 12:10:41.689404 13762 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48114 (request call id 2021) took 1703 ms (client timeout 2216 ms). Trace:
I20260709 12:10:41.689649 13727 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:41.668257 13685 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 8.
W20260709 12:10:41.689999 13762 rpcz_store.cc:269] 0709 12:10:39.986469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:40.352491 (+366022us) service_pool.cc:224] Handling call
0709 12:10:40.985102 (+632611us) spinlock_profiling.cc:243] Waited 1.73 ms on lock 0x7b58001e3f98. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924e68b71 00007fa924e68a22 00007fa92dd818d9 00007fa92cedbee0 00007fa92cfa50ab 00007fa92cfa5131 00007fa92cf530a0 00007fa92cf52984 00007fa9264cd6d4 00007fa9264cd662
0709 12:10:41.689243 (+704141us) spinlock_profiling.cc:243] Waited 702 ms on lock 0x7b54001d2c54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:41.689352 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1619237376}
I20260709 12:10:41.678997 16231 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:41.676775 16167 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:41.664126 13680 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 7.
I20260709 12:10:41.691200 16167 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:41.692588 16420 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 6 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:41.693387 16167 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:41.662835 16407 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:41.694825 13800 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:41.695770 16424 raft_consensus.cc:2749] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:41.695930 16407 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:41.696291 16267 raft_consensus.cc:2749] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:41.687397 16403 raft_consensus.cc:2804] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:41.697396 16403 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:41.697613 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:41.697853 16403 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:41.698390 13760 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:41.696825 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:41.707069 13758 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:41.660548 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:41.707819 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:41.708411 13763 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:41.698755 13652 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:41.651664 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:41.671890 13681 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:10:41.699905 13800 leader_election.cc:304] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:41.556089 16323 consensus_queue.cc:1048] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.102s
I20260709 12:10:41.703409 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:10:41.713153 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.711678 13651 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:10:41.720597 13801 leader_election.cc:336] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Timed out: RequestConsensusVote RPC to 127.12.56.196:46341 timed out after 1.689s (SENT)
I20260709 12:10:41.721719 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:41.722852 13761 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 10.
I20260709 12:10:41.664587 16024 raft_consensus.cc:2804] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:41.727133 13688 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 5.
I20260709 12:10:41.729799 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:41.733523 13727 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:41.736222 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:41.736330 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:41.736320 13680 raft_consensus.cc:1240] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:41.737901 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:41.738777 13757 raft_consensus.cc:2393] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 6: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:41.739176 13727 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:41.655553 16350 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:41.740597 13727 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:41.741631 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:41.741964 16231 raft_consensus.cc:2804] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:41.742632 16167 raft_consensus.cc:2749] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:41.743069 15925 raft_consensus.cc:2804] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:41.743984 16100 raft_consensus.cc:2804] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:41.743244 13583 catalog_manager.cc:5697] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:41.743831 15941 consensus_queue.cc:260] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:41.744839 15775 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:41.745460 16415 raft_consensus.cc:2804] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:41.746218 13651 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:41.737206 13685 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 5.
I20260709 12:10:41.747507 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:41.748420 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:41.772974 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:10:41.746235 13585 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53318 (request call id 141) took 14926 ms (client timeout 15000 ms). Trace:
I20260709 12:10:41.774448 13756 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:41.750689 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.780417 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:41.774438 13681 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 7.
I20260709 12:10:41.783424 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:41.826618 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:41.825630 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:41.826223 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:41.826231 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:41.825234 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:41.835295 14410 raft_consensus.cc:2368] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 6. Current term is 7.
I20260709 12:10:41.827769 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:41.837074 13759 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:41.837159 13757 raft_consensus.cc:2468] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 5.
I20260709 12:10:41.830194 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
W20260709 12:10:41.834095 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 134295us
I20260709 12:10:41.797492 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:41.839716 13800 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:10:41.840770 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 209491us
I20260709 12:10:41.841508 13760 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 6.
I20260709 12:10:41.841724 14380 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:41.784727 15925 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
W20260709 12:10:41.851250 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 105123us
I20260709 12:10:41.861480 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:41.740310 16024 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:41.826508 13583 catalog_manager.cc:5697] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 1 to 2, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 2 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
W20260709 12:10:41.867002 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 220068us
I20260709 12:10:41.863232 13800 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:41.863583 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:41.869020 13682 raft_consensus.cc:3060] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:41.871272 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:10:41.871621 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.826051 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:41.785012 16100 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:10:41.852542 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 157316us
I20260709 12:10:41.791154 16233 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:41.834403 15775 raft_consensus.cc:2804] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:41.778426 16430 raft_consensus.cc:2749] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:10:41.726688 16432 log.cc:927] Time spent T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 12:10:41.877820 13683 raft_consensus.cc:2393] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 7: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:41.882797 13652 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:41.909334 13652 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:41.877087 13762 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 5.
I20260709 12:10:41.881872 13583 catalog_manager.cc:5697] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 3 to 4, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 4 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:41.911594 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:41.911441 13583 catalog_manager.cc:5697] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 3 to 5, leader changed from ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 5 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:41.912703 13761 raft_consensus.cc:2393] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 5: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:41.865439 16424 raft_consensus.cc:2749] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:41.825383 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:41.905812 16420 consensus_queue.cc:1059] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:10:41.779917 16231 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:41.914259 15941 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:41.914731 16231 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:41.890599 16422 consensus_queue.cc:1059] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:41.920531 16391 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:41.861716 16419 raft_consensus.cc:2749] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:41.922536 16233 raft_consensus.cc:2749] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:41.836063 16194 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:41.923506 16231 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:41.892073 13651 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:41.875723 16167 consensus_queue.cc:1048] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:10:41.931324 16422 raft_consensus.cc:2749] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:41.886870 16100 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:41.932246 16422 raft_consensus.cc:3055] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:41.932698 16422 raft_consensus.cc:740] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:41.898859 14408 raft_consensus.cc:2410] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:10:41.933812 16428 log.cc:927] Time spent T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:10:41.866947 15953 raft_consensus.cc:2804] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:41.934314 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:41.934638 15953 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:41.935075 13760 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 6.
I20260709 12:10:41.935102 15953 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:41.838631 13585 rpcz_store.cc:269] 0709 12:10:26.820067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.820374 (+   307us) service_pool.cc:224] Handling call
0709 12:10:41.746126 (+14925752us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:38.603120 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:38.686549 (+ 83429us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:38.686609 (+    60us) write_op.cc:435] Acquired schema lock
0709 12:10:38.686638 (+    29us) tablet.cc:662] Decoding operations
0709 12:10:38.687441 (+   803us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:38.687557 (+   116us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:38.687585 (+    28us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:10:38.688225 (+   640us) tablet.cc:701] Row locks acquired
0709 12:10:38.688276 (+    51us) write_op.cc:260] PREPARE: finished
0709 12:10:38.688638 (+   362us) write_op.cc:270] Start()
0709 12:10:38.688842 (+   204us) write_op.cc:276] Timestamp: P: 1783599038688413 usec, L: 0
0709 12:10:38.688871 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 12:10:38.731974 (+ 43103us) log.cc:844] Serialized 1686 byte log entry
0709 12:10:40.087066 (+1355092us) op_driver.cc:464] REPLICATION: finished
0709 12:10:40.463590 (+376524us) write_op.cc:301] APPLY: starting
0709 12:10:40.463719 (+   129us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:40.463973 (+   254us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:40.464143 (+   170us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:40.467056 (+  2913us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:40.467351 (+   295us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:10:40.467406 (+    55us) write_op.cc:312] APPLY: finished
0709 12:10:40.526301 (+ 58895us) log.cc:844] Serialized 41 byte log entry
0709 12:10:40.526533 (+   232us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:40.526668 (+   135us) write_op.cc:454] Released schema lock
0709 12:10:40.526734 (+    66us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:40.527163 (+   429us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:40.527194 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4648158,"reported_tablets":16,"child_traces":[["op",{"apply.queue_time_us":337880,"apply.run_cpu_time_us":3628,"apply.run_wall_time_us":63566,"num_ops":4,"prepare.queue_time_us":248368,"prepare.run_cpu_time_us":46378,"prepare.run_wall_time_us":675125,"raft.queue_time_us":261023,"raft.run_cpu_time_us":23352,"raft.run_wall_time_us":478518,"replication_time_us":1305478,"thread_start_us":986900,"threads_started":4,"wal-append.queue_time_us":449402,"wal-append.run_cpu_time_us":30825,"wal-append.run_wall_time_us":2311043}]]}
I20260709 12:10:41.899006 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:41.889299 16220 raft_consensus.cc:2749] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:41.865765 15925 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:41.899680 16241 consensus_queue.cc:1048] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:41.900735 15775 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:41.854103 13687 raft_consensus.cc:1240] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:41.791540 16051 raft_consensus.cc:2764] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:10:41.915414 13583 catalog_manager.cc:5697] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 1 to 3, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 3 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:41.873423 16024 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:41.939356 16434 consensus_queue.cc:1048] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:41.940399 16350 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:41.943171 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.935915 13754 raft_consensus.cc:2393] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 5: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:41.945880 14379 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:10:41.951295 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 59521.4us
I20260709 12:10:41.951996 13801 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:41.958753 13651 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:41.954155 13652 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:41.966075 13651 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:41.967068 13651 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:41.973038 13800 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:41.977232 13759 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 6.
I20260709 12:10:41.978602 13758 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 4.
I20260709 12:10:41.979751 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:41.980960 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:41.920428 16322 consensus_queue.cc:260] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:41.968791 13583 catalog_manager.cc:5697] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 3 to 4, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 4 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:10:41.985093 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:41.985265 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:41.986145 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:41.986883 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:41.989394 13681 raft_consensus.cc:1240] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:41.989609 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:41.998917 13683 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:41.999528 13686 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 5.
I20260709 12:10:41.991806 13831 raft_consensus.cc:1240] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:41.993150 13756 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 6.
I20260709 12:10:42.000702 13828 raft_consensus.cc:2393] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 7: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:41.999181 13830 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 6.
I20260709 12:10:42.001309 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:42.002305 13756 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 6.
I20260709 12:10:41.950436 15775 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:42.003039 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:42.000118 13684 raft_consensus.cc:2393] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 10: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:41.959852 16292 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:41.951018 16415 raft_consensus.cc:697] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:42.006191 13837 raft_consensus.cc:1275] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:41.962126 16194 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:10:42.021673 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 244278us
I20260709 12:10:41.987912 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:42.015254 16241 consensus_queue.cc:1059] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:42.026039 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:42.020500 13683 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 5.
I20260709 12:10:42.024060 13759 raft_consensus.cc:2393] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 6: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:41.968030 16420 raft_consensus.cc:2804] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:41.982854 16167 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:42.018122 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 45231.9us
I20260709 12:10:42.034502 13800 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:42.036024 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:42.036883 13688 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:41.976770 16231 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:41.994483 16408 raft_consensus.cc:2804] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:42.023670 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:42.049032 13687 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:42.029052 13685 raft_consensus.cc:1240] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:41.997809 16417 raft_consensus.cc:2804] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:42.051738 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:42.052398 13835 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:42.053406 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:42.054164 13759 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:10:42.059942 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:10:42.060369 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 65846.2us
I20260709 12:10:42.061426 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:42.062414 13756 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:42.024758 16233 raft_consensus.cc:2804] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:42.072209 13834 raft_consensus.cc:1240] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:42.002095 16440 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:10:42.078428 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 44043.5us
I20260709 12:10:42.103624 13800 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:42.037973 16292 raft_consensus.cc:697] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 7 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:42.079504 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:42.107874 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:42.080226 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:41.982769 16424 consensus_queue.cc:1059] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.080s
I20260709 12:10:41.944439 16422 consensus_queue.cc:260] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:42.089939 16194 consensus_queue.cc:1059] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:42.059015 15925 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:42.091676 13583 catalog_manager.cc:5697] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 2 to 4, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 4 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:10:42.092934 16051 raft_consensus.cc:2764] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 12:10:42.093858 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:42.136317 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:42.096167 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:42.096895 16233 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:42.039031 16420 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:42.047916 16372 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:42.108862 13834 raft_consensus.cc:2410] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
W20260709 12:10:42.109862 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 155784us
I20260709 12:10:42.111503 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:42.111515 13759 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 5.
I20260709 12:10:42.122052 13756 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 5.
I20260709 12:10:42.123981 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:42.048625 16408 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:42.124801 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:42.116161 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:42.154421 13679 raft_consensus.cc:2393] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 5: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:42.128906 13726 leader_election.cc:304] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:42.089238 16100 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:42.126952 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 65540us
I20260709 12:10:42.006407 16258 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:42.102267 16417 raft_consensus.cc:697] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 6 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:42.133941 16391 consensus_queue.cc:1059] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:10:42.143014 16233 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:42.158721 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:42.159562 13831 raft_consensus.cc:2393] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 8: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:42.160593 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:42.144312 13829 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 5.
I20260709 12:10:42.144640 13652 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:42.146703 13583 catalog_manager.cc:5697] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:42.152365 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:42.156850 16417 consensus_queue.cc:237] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:42.137307 13754 raft_consensus.cc:3060] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:42.161298 13831 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 4.
I20260709 12:10:42.164220 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:42.147863 13756 raft_consensus.cc:1240] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:10:42.153576 13684 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 7.
I20260709 12:10:42.172765 13835 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 6.
I20260709 12:10:42.160151 16292 consensus_queue.cc:237] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:42.182233 13763 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 5.
I20260709 12:10:42.184294 13759 raft_consensus.cc:1240] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:42.187605 13652 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:42.193174 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:42.143471 16420 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:42.194231 13829 raft_consensus.cc:2410] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:10:42.194808 13756 raft_consensus.cc:1240] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:10:42.195467 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:42.185941 13833 raft_consensus.cc:2376] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 5. Re-sending same reply.
I20260709 12:10:42.198047 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:42.198905 14410 raft_consensus.cc:2368] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 5. Current term is 6.
I20260709 12:10:42.200572 13834 raft_consensus.cc:1275] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:10:42.201025 13834 pending_rounds.cc:85] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 3
I20260709 12:10:42.196193 13832 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 6.
I20260709 12:10:42.201709 13831 raft_consensus.cc:1240] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:42.202585 13832 raft_consensus.cc:1275] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:42.203769 13835 raft_consensus.cc:1275] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:42.162086 16408 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:42.114099 16440 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:42.231079 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 127535us
I20260709 12:10:42.201278 13834 pending_rounds.cc:107] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:10:42.244865 13834 raft_consensus.cc:2889] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:42.252593 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 123770us
I20260709 12:10:42.228615 16051 raft_consensus.cc:2804] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:42.262382 13829 raft_consensus.cc:1240] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:42.262527 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:42.263527 14415 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 1.
W20260709 12:10:42.254230 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 66440.2us
I20260709 12:10:42.254339 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:42.266355 13756 raft_consensus.cc:1240] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:10:42.258549 13726 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:42.265717 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:42.269028 14412 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 6.
I20260709 12:10:42.268260 13652 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:42.272639 13583 catalog_manager.cc:5697] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:42.177592 16415 consensus_queue.cc:237] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:42.283255 13652 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:10:42.288053 13727 connection.cc:256] RPC call timeout handler was delayed by -1.45179397600009s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18730000000000002s for a response
I20260709 12:10:42.261991 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:10:42.288772 13727 connection.cc:256] RPC call timeout handler was delayed by -1.3734939760001907s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.196s for a response
I20260709 12:10:42.290396 13756 raft_consensus.cc:1240] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:42.289012 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:10:42.295627 13727 connection.cc:256] RPC call timeout handler was delayed by -1.2456939759999841s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2102s for a response
W20260709 12:10:42.296303 13727 connection.cc:256] RPC call timeout handler was delayed by -1.1916939760001242s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2162s for a response
I20260709 12:10:42.297953 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:42.298898 13727 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:10:42.275471 16426 consensus_meta.cc:287] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.596s	user 0.003s	sys 0.009s
I20260709 12:10:42.275032 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:42.301258 15925 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:42.301635 14409 raft_consensus.cc:2393] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 8: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:42.301949 15925 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:42.270210 16051 raft_consensus.cc:697] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 6 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:42.273129 16267 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:42.311058 13583 catalog_manager.cc:5697] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 1 to 4, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 4 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:42.307433 14416 raft_consensus.cc:2468] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 4.
I20260709 12:10:42.313282 13688 raft_consensus.cc:2410] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:42.278594 16231 raft_consensus.cc:2804] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:42.315991 13682 raft_consensus.cc:2468] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 6.
W20260709 12:10:42.293510 16344 consensus_meta.cc:287] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.704s	user 0.012s	sys 0.001s
I20260709 12:10:42.320181 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:10:42.320372 16444 log.cc:927] Time spent T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 12:10:42.278451 16459 raft_consensus.cc:2749] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:42.302503 15925 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:42.341873 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:42.305352 13726 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:42.318964 16231 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:42.324630 16187 raft_consensus.cc:2764] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:10:42.341970 14407 raft_consensus.cc:1240] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:42.303342 16454 consensus_queue.cc:1059] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 12:10:42.369911 16460 raft_consensus.cc:2804] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:42.370643 16460 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:42.371203 16460 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:42.345157 16458 raft_consensus.cc:2804] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:42.376724 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:42.377391 13837 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:42.355585 16231 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:42.383316 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:42.327322 16344 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:42.392650 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:42.384694 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 140857us
I20260709 12:10:42.394703 13837 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 6.
I20260709 12:10:42.325502 16267 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:42.415374 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:42.413805 13800 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:42.376623 16442 raft_consensus.cc:2804] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:42.374835 16459 raft_consensus.cc:2749] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:10:42.376031 16260 raft_consensus.cc:3055] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:42.445326 13758 raft_consensus.cc:2393] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 9: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:42.436959 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:42.409721 16100 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:42.414712 16220 raft_consensus.cc:3055] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:42.383953 16458 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:42.447563 14415 raft_consensus.cc:2376] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 8. Re-sending same reply.
W20260709 12:10:42.530658 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 80918.5us
W20260709 12:10:42.531865 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:42.441160 16260 raft_consensus.cc:740] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:42.438006 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:42.437532 16469 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
W20260709 12:10:42.536197 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 152934us
I20260709 12:10:42.535637 14379 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:42.553480 13688 raft_consensus.cc:1240] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:42.533900 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:42.559588 16260 consensus_queue.cc:260] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:42.510260 16220 raft_consensus.cc:740] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
W20260709 12:10:42.575778 13801 leader_election.cc:336] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Timed out: RequestConsensusVote RPC to 127.12.56.196:46341 timed out after 1.599s (SENT)
I20260709 12:10:42.576423 13801 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:42.515822 16458 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:42.530750 16454 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.590960 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:42.592898 13754 raft_consensus.cc:2468] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 6.
W20260709 12:10:42.590920 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 307732us
W20260709 12:10:42.582319 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 46788.1us
I20260709 12:10:42.535068 16400 raft_consensus.cc:2749] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:42.594184 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 295450us
I20260709 12:10:42.410115 16051 consensus_queue.cc:237] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:42.538292 16100 consensus_queue.cc:1059] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 12:10:42.597159 13652 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:42.598419 13652 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:42.593010 14412 raft_consensus.cc:2376] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 6. Re-sending same reply.
I20260709 12:10:42.597479 13727 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:10:42.603905 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 55908.5us
I20260709 12:10:42.579893 16440 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:42.588807 16430 raft_consensus.cc:2804] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:10:42.599968 13687 consensus_meta.cc:287] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.548s	user 0.021s	sys 0.014s
I20260709 12:10:42.608263 13754 raft_consensus.cc:1240] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:10:42.612810 13687 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 6.
I20260709 12:10:42.611326 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:42.591162 16260 raft_consensus.cc:3060] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:42.614609 16473 raft_consensus.cc:2804] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:42.614621 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:10:42.626199 16403 consensus_meta.cc:287] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.900s	user 0.010s	sys 0.004s
W20260709 12:10:42.617435 15941 consensus_meta.cc:287] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.703s	user 0.013s	sys 0.008s
I20260709 12:10:42.614296 16442 raft_consensus.cc:697] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:42.614300 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:42.618181 16461 raft_consensus.cc:2804] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:42.618803 16167 consensus_meta.cc:287] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.554s	user 0.010s	sys 0.001s
W20260709 12:10:42.618991 16456 log.cc:927] Time spent T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.250s	user 0.001s	sys 0.000s
I20260709 12:10:42.619230 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:42.619923 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:42.620093 16267 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:42.585194 16470 raft_consensus.cc:2804] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:42.621115 15925 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:42.617898 16449 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.624881 16473 raft_consensus.cc:697] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 3 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:42.626787 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:42.628671 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:42.614805 16220 consensus_queue.cc:260] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:42.595455 16454 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:42.630352 16344 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:42.622030 16465 raft_consensus.cc:2749] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:42.634405 16100 raft_consensus.cc:3055] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:42.625854 14408 raft_consensus.cc:2393] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 5: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:10:42.636008 13726 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:10:42.636768 15953 consensus_meta.cc:287] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.700s	user 0.018s	sys 0.005s
I20260709 12:10:42.637375 16468 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.626994 13652 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:42.650568 16430 raft_consensus.cc:697] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 6 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:42.690527 16403 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:42.654152 15775 consensus_meta.cc:287] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.612s	user 0.021s	sys 0.003s
I20260709 12:10:42.737387 16344 raft_consensus.cc:2804] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:42.721318 16466 raft_consensus.cc:2749] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:42.723531 16442 consensus_queue.cc:237] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:42.758093 16344 raft_consensus.cc:697] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:42.737488 15953 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:42.742390 16430 consensus_queue.cc:237] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:42.759078 16344 consensus_queue.cc:237] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:42.726531 16267 consensus_queue.cc:1059] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:10:42.760318 16267 raft_consensus.cc:2749] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:42.760874 13685 raft_consensus.cc:2393] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 9: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:42.718050 16460 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:42.761060 16267 raft_consensus.cc:3055] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:42.760787 15775 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:42.736754 16100 raft_consensus.cc:740] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:42.726837 16470 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:42.762178 16470 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:42.762269 16100 consensus_queue.cc:260] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:42.737157 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 101262us
I20260709 12:10:42.581460 16469 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:42.761512 16267 raft_consensus.cc:740] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:42.878858 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:42.879711 13682 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:42.880519 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:42.758222 13687 raft_consensus.cc:1240] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 6 LEADER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:42.880991 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 305246us
I20260709 12:10:42.763571 13755 raft_consensus.cc:1240] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:42.882992 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 350355us
W20260709 12:10:42.880205 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 283042us
I20260709 12:10:42.884012 13800 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:10:42.896320 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:42.922227 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:42.698150 16461 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:42.730690 16220 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:42.877267 16024 consensus_meta.cc:287] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.910s	user 0.022s	sys 0.003s
W20260709 12:10:42.744508 16233 consensus_meta.cc:287] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.586s	user 0.024s	sys 0.000s
W20260709 12:10:42.928253 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 44363.2us
I20260709 12:10:42.936561 13800 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:42.938059 13800 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:42.921847 16417 raft_consensus.cc:2749] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:42.939347 16100 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:42.939427 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:10:42.940052 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 313125us
I20260709 12:10:42.940284 13760 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:42.880008 15953 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:42.798040 16397 consensus_meta.cc:287] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 1.091s	user 0.019s	sys 0.007s
W20260709 12:10:42.928537 13801 leader_election.cc:336] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Timed out: RequestConsensusVote RPC to 127.12.56.196:46341 timed out after 1.776s (SENT)
I20260709 12:10:42.944468 13801 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:10:42.876613 16431 log.cc:927] Time spent T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
W20260709 12:10:42.739764 16372 consensus_meta.cc:287] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.588s	user 0.014s	sys 0.009s
I20260709 12:10:42.954090 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:42.954658 16372 raft_consensus.cc:2749] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:42.955395 13836 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 5.
I20260709 12:10:42.948768 16233 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:42.875643 16420 consensus_meta.cc:287] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.622s	user 0.006s	sys 0.018s
I20260709 12:10:42.957912 16420 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:42.958452 16233 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:42.958949 16458 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:42.960013 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:42.960675 14413 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 5.
W20260709 12:10:42.874788 16408 consensus_meta.cc:287] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.620s	user 0.011s	sys 0.022s
I20260709 12:10:42.719998 16167 raft_consensus.cc:2749] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:42.762949 15775 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:42.948724 16443 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.974421 16443 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:42.732259 16051 consensus_queue.cc:1048] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.237s
I20260709 12:10:42.949654 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:42.960992 16420 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 6 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:42.978135 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:42.978994 13681 raft_consensus.cc:2410] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:10:42.969694 16233 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.722903 16231 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:42.762957 16460 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:42.988699 16267 consensus_queue.cc:260] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:42.990190 16267 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:42.990206 16231 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:42.996498 13758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48120 (request call id 1452) took 1292 ms. Trace:
I20260709 12:10:42.996989 13758 rpcz_store.cc:276] 0709 12:10:41.704095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.980730 (+276635us) service_pool.cc:224] Handling call
0709 12:10:42.996225 (+1015495us) spinlock_profiling.cc:243] Waited 463 ms on lock 0x7b54003c8a54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:42.996442 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1065717504}
I20260709 12:10:42.966756 13760 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 9.
I20260709 12:10:42.998294 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:42.998485 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:10:42.998308 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 60724.4us
I20260709 12:10:42.999145 13760 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 6.
I20260709 12:10:42.922945 16403 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:42.999661 13758 raft_consensus.cc:1240] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:42.932374 16461 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:42.897033 16415 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.971386 13682 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 9.
I20260709 12:10:42.972332 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:42.973073 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:42.978271 16443 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:42.951440 16469 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:42.961598 16408 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:42.979893 16233 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:42.966596 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 201968us
I20260709 12:10:42.968324 13800 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:42.999871 13727 leader_election.cc:400] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 election: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 5. Current term is 6.
I20260709 12:10:42.736331 16454 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:10:43.014161 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:43.003238 13652 connection.cc:256] RPC call timeout handler was delayed by -1.0051295009998285s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1633s for a response
W20260709 12:10:43.018278 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.014580 13727 leader_election.cc:403] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:10:43.023200 13652 leader_election.cc:400] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 6. Current term is 7.
I20260709 12:10:43.023648 13652 leader_election.cc:403] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:43.025202 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:42.988090 16458 leader_election.cc:290] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:42.727218 16449 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:43.013019 16051 raft_consensus.cc:2804] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:43.013991 16482 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:43.033576 16482 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:43.034047 16482 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:42.727772 16473 consensus_queue.cc:237] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:43.036482 13754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 379) took 1211 ms. Trace:
I20260709 12:10:43.036906 13754 rpcz_store.cc:276] 0709 12:10:41.825208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.594461 (+769253us) service_pool.cc:224] Handling call
0709 12:10:42.595074 (+   613us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:42.612913 (+ 17839us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:43.036181 (+423268us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b54000924d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:43.036415 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29582208}
I20260709 12:10:43.038286 16454 raft_consensus.cc:2764] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 12:10:43.031960 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 63797.8us
I20260709 12:10:43.039731 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:43.039896 13800 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:43.040376 13761 raft_consensus.cc:2376] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 6. Re-sending same reply.
I20260709 12:10:43.014166 16469 raft_consensus.cc:2804] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:43.042014 16454 raft_consensus.cc:2804] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:43.042338 13759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 1451) took 1338 ms. Trace:
I20260709 12:10:43.042963 16454 raft_consensus.cc:697] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 7 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:43.042841 13759 rpcz_store.cc:276] 0709 12:10:41.703854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.145542 (+441688us) service_pool.cc:224] Handling call
0709 12:10:42.183855 (+ 38313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:42.184990 (+  1135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:43.042135 (+857145us) spinlock_profiling.cc:243] Waited 37.9 ms on lock 0x7b54002b0cd0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:43.042275 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":87209856}
I20260709 12:10:43.010877 13760 raft_consensus.cc:1240] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:43.000370 13758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 381) took 1120 ms. Trace:
I20260709 12:10:43.044832 13758 rpcz_store.cc:276] 0709 12:10:41.879816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.999239 (+1119423us) service_pool.cc:224] Handling call
0709 12:10:42.999492 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:43.000118 (+   626us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:43.000314 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:43.044543 13759 raft_consensus.cc:1240] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:43.041647 13761 raft_consensus.cc:1240] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:43.025843 13726 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:42.944540 16024 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:43.016270 16422 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:43.059744 16024 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:42.738004 16468 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:43.004033 16415 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:43.029739 16419 raft_consensus.cc:3055] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:43.033048 16051 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:43.051347 13651 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:43.051980 13760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 382) took 1171 ms. Trace:
I20260709 12:10:43.013286 16372 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.060984 13758 raft_consensus.cc:1240] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:43.155555 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 104264us
I20260709 12:10:43.156829 13651 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:43.155357 13760 rpcz_store.cc:276] 0709 12:10:41.880221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.999922 (+1119701us) service_pool.cc:224] Handling call
0709 12:10:43.010705 (+ 10783us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:43.051636 (+ 40931us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:43.051904 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:43.017654 16233 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:43.133055 13681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 1975) took 1142 ms. Trace:
I20260709 12:10:43.120453 13763 raft_consensus.cc:1240] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260709 12:10:43.075371 16424 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.930s	user 0.004s	sys 0.020s
W20260709 12:10:43.074271 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 145834us
I20260709 12:10:43.163823 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:43.164927 13763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 1460) took 1421 ms. Trace:
W20260709 12:10:43.165102 13801 leader_election.cc:336] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Timed out: RequestConsensusVote RPC to 127.12.56.196:46341 timed out after 1.852s (SENT)
I20260709 12:10:43.127956 16486 raft_consensus.cc:2749] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:43.061036 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:43.166640 13687 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:43.044279 16454 consensus_queue.cc:237] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:43.094177 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 94421.1us
I20260709 12:10:43.067385 16167 raft_consensus.cc:2749] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 6. Current term is 7.
I20260709 12:10:43.065964 16323 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:43.042339 16469 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:43.060375 15925 raft_consensus.cc:2749] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 5. Current term is 6.
I20260709 12:10:43.111920 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:43.118561 13800 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:43.140341 16487 consensus_queue.cc:1059] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:10:43.143962 16468 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:43.144701 13679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 1973) took 1154 ms. Trace:
I20260709 12:10:43.171605 16233 raft_consensus.cc:2804] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:43.116652 16267 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.075253 13652 leader_election.cc:304] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:43.159354 13681 rpcz_store.cc:276] 0709 12:10:42.004536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.029887 (+ 25351us) service_pool.cc:224] Handling call
0709 12:10:43.132745 (+1102858us) spinlock_profiling.cc:243] Waited 918 ms on lock 0x7b54002bf7d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:43.132966 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2110990592}
I20260709 12:10:43.166795 13651 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:43.192546 13651 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:43.193490 13651 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:43.183954 13679 rpcz_store.cc:276] 0709 12:10:41.990365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.162915 (+172550us) service_pool.cc:224] Handling call
0709 12:10:42.163303 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:42.290564 (+127261us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:42.290593 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:42.298333 (+  7740us) log.cc:844] Serialized 26 byte log entry
0709 12:10:42.878723 (+580390us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:42.878760 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:42.878824 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:43.144428 (+265604us) raft_consensus.cc:1685] finished
0709 12:10:43.144452 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:43.144626 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13731,"raft.queue_time_us":169837,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":9653,"thread_start_us":397736,"threads_started":2,"wal-append.queue_time_us":696064}
I20260709 12:10:43.194196 13685 raft_consensus.cc:1275] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:43.194281 13651 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:43.165304 13763 rpcz_store.cc:276] 0709 12:10:41.743158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.183517 (+440359us) service_pool.cc:224] Handling call
0709 12:10:43.119883 (+936366us) spinlock_profiling.cc:243] Waited 1.24 ms on lock 0x7b58001e3f98. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924e68b71 00007fa924e68a22 00007fa92dd818d9 00007fa92cedbee0 00007fa92cfa50ab 00007fa92cfa5131 00007fa92cf66fc0 00007fa92cf51929 00007fa92cf513d2 00007fa9264c8bd4
0709 12:10:43.120143 (+   260us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:43.163016 (+ 42873us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:43.164869 (+  1853us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2862336}
W20260709 12:10:43.163703 16424 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.022s	user 0.019s	sys 0.031s
I20260709 12:10:43.168613 13727 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:43.169549 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:43.196457 13760 raft_consensus.cc:2393] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 5: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:43.156049 16051 raft_consensus.cc:3060] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:43.174279 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 55831.7us
I20260709 12:10:43.196748 13727 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:43.198060 13727 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:43.198947 13800 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:43.174954 13759 raft_consensus.cc:2393] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 3: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:43.155256 16419 raft_consensus.cc:740] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:43.164311 16460 raft_consensus.cc:2804] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:43.163915 16372 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:43.173535 16469 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:43.203985 13800 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:43.185477 16323 raft_consensus.cc:697] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:43.178159 16024 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.081741 13757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 378) took 1297 ms. Trace:
I20260709 12:10:43.208484 13687 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 6.
I20260709 12:10:43.185418 16492 raft_consensus.cc:2804] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:43.208691 13800 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:43.209141 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:43.210273 13837 raft_consensus.cc:1240] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:43.208731 13651 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:43.216908 13836 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:43.213475 13757 rpcz_store.cc:276] 0709 12:10:41.784858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.487325 (+702467us) service_pool.cc:224] Handling call
0709 12:10:42.487791 (+   466us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:42.638212 (+150421us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:42.638239 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:42.878750 (+240511us) log.cc:844] Serialized 26 byte log entry
0709 12:10:43.061073 (+182323us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:43.061140 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:43.061224 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:43.081485 (+ 20261us) raft_consensus.cc:1685] finished
0709 12:10:43.081514 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:43.081677 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52388,"raft.queue_time_us":45084,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":33504,"thread_start_us":89039,"threads_started":1,"wal-append.queue_time_us":154182}
I20260709 12:10:43.218242 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:43.221362 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:43.222169 13831 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:43.222513 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:43.223888 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:43.226567 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:43.227728 13835 raft_consensus.cc:2393] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 5: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:43.205157 16458 raft_consensus.cc:2804] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:43.204993 16403 raft_consensus.cc:2804] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:43.223193 13834 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 4.
I20260709 12:10:43.192030 16267 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:43.234809 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:43.206988 16487 raft_consensus.cc:2749] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:43.242565 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:43.243444 13832 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:43.210534 16468 raft_consensus.cc:2749] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:43.215689 16486 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:43.215006 16447 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:43.217686 16465 raft_consensus.cc:2804] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:10:43.252355 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 43745.3us
I20260709 12:10:43.225138 16231 raft_consensus.cc:2804] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:43.229827 16491 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.244405 13651 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:43.253436 13727 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:43.258771 13727 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:43.259016 13831 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 4.
I20260709 12:10:43.259307 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:43.219197 16492 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:43.254325 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 179149us
I20260709 12:10:43.218724 16408 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:43.253624 13800 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:43.259953 13727 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:43.218037 16417 raft_consensus.cc:2804] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:43.234485 16391 raft_consensus.cc:2749] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:43.260484 13652 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:43.236502 16458 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:43.231285 16233 raft_consensus.cc:697] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 6 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:43.300168 13727 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:43.260182 13828 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 5.
I20260709 12:10:43.264670 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:43.237375 16403 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:43.268537 16408 raft_consensus.cc:2764] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:10:43.259073 15925 raft_consensus.cc:2749] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:10:43.271638 16483 log.cc:927] Time spent T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.281s	user 0.003s	sys 0.000s
I20260709 12:10:43.273273 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:43.250828 16486 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:43.311867 16233 consensus_queue.cc:237] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:43.312896 16486 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:43.260577 16449 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:43.299480 16323 consensus_queue.cc:237] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:43.319669 14416 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 693) took 1541 ms (client timeout 1737 ms). Trace:
W20260709 12:10:43.320318 14416 rpcz_store.cc:269] 0709 12:10:41.778176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.780178 (+  2002us) service_pool.cc:224] Handling call
0709 12:10:43.319387 (+1539209us) spinlock_profiling.cc:243] Waited 471 ms on lock 0x7b54006df454. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:43.319579 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1083672960}
I20260709 12:10:43.321507 16372 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:43.322404 13755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2045) took 1625 ms. Trace:
I20260709 12:10:43.322348 16372 consensus_queue.cc:1059] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:43.254218 16419 consensus_queue.cc:260] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:43.325340 16419 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:43.326745 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 82401.9us
W20260709 12:10:43.327370 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 66923.9us
I20260709 12:10:43.328516 13652 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:43.329469 13679 raft_consensus.cc:1240] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:43.329833 13681 raft_consensus.cc:1240] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:43.238056 16460 raft_consensus.cc:697] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 4 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:43.330506 16391 consensus_queue.cc:1059] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:43.331758 16391 raft_consensus.cc:3055] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:43.331645 16460 consensus_queue.cc:237] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:43.252228 16167 raft_consensus.cc:2804] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:43.332870 16167 raft_consensus.cc:697] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 9 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:43.286001 16442 raft_consensus.cc:2749] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:43.218935 16024 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:43.336601 16024 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:43.262931 16492 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:43.308730 15941 raft_consensus.cc:2749] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:43.266577 16415 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:43.309054 16498 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:43.309605 16417 raft_consensus.cc:697] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 5 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:43.333904 16167 consensus_queue.cc:237] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:43.342799 16417 consensus_queue.cc:237] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:43.310370 16408 consensus_queue.cc:1059] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:43.305518 16403 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:43.323104 13755 rpcz_store.cc:276] 0709 12:10:41.696683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.708734 (+ 12051us) service_pool.cc:224] Handling call
0709 12:10:41.746948 (+ 38214us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:42.906670 (+1159722us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:43.322077 (+415407us) spinlock_profiling.cc:243] Waited 998 ms on lock 0x7b54003c8f54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:43.322321 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2294286720}
W20260709 12:10:43.346580 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.304935 16465 raft_consensus.cc:697] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 5 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:43.346843 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:43.354749 13755 raft_consensus.cc:1240] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:43.354996 16465 consensus_queue.cc:237] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:43.356236 13755 raft_consensus.cc:1240] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:43.356825 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:43.358445 13682 raft_consensus.cc:1240] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:43.264780 16491 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:43.327375 16447 raft_consensus.cc:2749] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:43.368505 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 68453.5us
I20260709 12:10:43.293378 16461 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:43.372555 16492 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:43.373956 16461 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:10:43.349064 16260 consensus_meta.cc:287] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.694s	user 0.004s	sys 0.008s
I20260709 12:10:43.376986 16498 raft_consensus.cc:2749] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:43.378926 16492 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:43.381923 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:43.332198 16391 raft_consensus.cc:740] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:43.386484 16391 consensus_queue.cc:260] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:43.387748 16391 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:43.255751 15775 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.390650 16415 raft_consensus.cc:2749] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:10:43.391052 15775 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:43.267472 16231 raft_consensus.cc:697] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 5 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:43.362075 16408 raft_consensus.cc:3055] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:43.291586 16267 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:43.232657 16470 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:43.277113 16393 raft_consensus.cc:3055] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:43.301925 16458 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:43.280949 13758 raft_consensus.cc:1240] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:43.358518 13679 raft_consensus.cc:1240] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:43.326907 16422 raft_consensus.cc:2804] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:43.452863 16422 raft_consensus.cc:697] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 6 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:43.432205 16393 raft_consensus.cc:740] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:43.454432 16422 consensus_queue.cc:237] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:43.455003 16393 consensus_queue.cc:260] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:43.456314 16393 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:43.357573 13755 raft_consensus.cc:1240] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:43.395141 16408 raft_consensus.cc:740] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:43.458487 13755 raft_consensus.cc:1240] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:43.458730 16408 consensus_queue.cc:260] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:43.365466 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:43.460140 16408 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:43.366446 16322 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:43.366961 13682 raft_consensus.cc:1275] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:43.367941 16491 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:43.378852 16220 raft_consensus.cc:3055] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:10:43.369478 13727 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:43.330598 15953 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:43.404520 14380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:43.397926 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.432476 13759 raft_consensus.cc:1275] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:43.433590 13832 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 5.
I20260709 12:10:43.433947 13763 raft_consensus.cc:1240] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:43.450945 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:43.451992 13758 raft_consensus.cc:1240] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:43.462500 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:10:43.465734 13801 leader_election.cc:336] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Timed out: RequestConsensusVote RPC to 127.12.56.196:46341 timed out after 1.947s (SENT)
I20260709 12:10:43.480861 13801 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:43.483886 16260 consensus_queue.cc:1059] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:10:43.484956 16457 log.cc:927] Time spent T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 1.109s	user 0.002s	sys 0.000s
I20260709 12:10:43.485239 16449 raft_consensus.cc:3055] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:43.485713 16449 raft_consensus.cc:740] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:43.486593 16449 consensus_queue.cc:260] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:43.487558 14416 consensus_queue.cc:237] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:43.488209 14380 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
W20260709 12:10:43.488684 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:43.489918 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.490140 16418 raft_consensus.cc:2749] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:43.490160 13681 raft_consensus.cc:1275] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:10:43.491019 13681 pending_rounds.cc:85] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 5
I20260709 12:10:43.491266 13681 pending_rounds.cc:107] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:10:43.491426 16470 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:43.491513 13681 raft_consensus.cc:2889] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:43.489491 14380 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:43.478983 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:10:43.497124 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:43.501112 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 131738us
I20260709 12:10:43.503149 14380 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
W20260709 12:10:43.510424 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.393754 15775 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:43.513624 13652 leader_election.cc:336] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 1.635s (SENT)
W20260709 12:10:43.515872 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 247111us
I20260709 12:10:43.516335 13687 raft_consensus.cc:1240] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 9 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 8. Current term is 9. Ops: []
W20260709 12:10:43.523729 13652 leader_election.cc:336] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 1.737s (SENT)
W20260709 12:10:43.524507 13652 leader_election.cc:336] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Timed out: RequestConsensusVote RPC to 127.12.56.196:46341 timed out after 1.737s (SENT)
I20260709 12:10:43.524936 13652 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:10:43.526496 13652 leader_election.cc:336] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 1.765s (SENT)
I20260709 12:10:43.527437 13652 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:43.531894 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:43.534368 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:43.535286 13834 raft_consensus.cc:2393] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 4: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:43.540086 15953 raft_consensus.cc:2749] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:10:43.542368 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:43.542681 16496 log.cc:927] Time spent T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.219s	user 0.002s	sys 0.000s
I20260709 12:10:43.548177 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:43.466537 16220 raft_consensus.cc:740] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
W20260709 12:10:43.555042 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 52958.5us
I20260709 12:10:43.533687 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:10:43.557248 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 55071.6us
I20260709 12:10:43.563727 13837 raft_consensus.cc:2410] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:10:43.394577 16469 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:43.509711 16418 raft_consensus.cc:2804] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:43.564229 13801 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:43.573832 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:43.528681 16427 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:43.535768 16167 raft_consensus.cc:2749] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:43.555699 13726 leader_election.cc:304] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:43.584219 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:43.534384 16491 raft_consensus.cc:2749] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:43.578778 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:43.594641 13834 raft_consensus.cc:1240] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:10:43.608781 13828 raft_consensus.cc:1240] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:10:43.610136 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:43.610960 13834 raft_consensus.cc:2410] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:43.596638 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:43.549721 16450 raft_consensus.cc:2804] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:43.607738 13680 raft_consensus.cc:2393] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 6: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:43.611469 13837 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 4.
I20260709 12:10:43.611959 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:43.615692 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:43.395469 16231 consensus_queue.cc:237] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:43.586746 16418 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:43.616905 13837 raft_consensus.cc:2410] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for term 9 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:43.617302 13831 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 6.
I20260709 12:10:43.586212 16498 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:43.616472 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 60876.5us
I20260709 12:10:43.517347 16430 consensus_queue.cc:1048] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.092s
I20260709 12:10:43.590867 16427 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:43.619772 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:43.627302 13831 raft_consensus.cc:1275] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 12:10:43.631716 13831 pending_rounds.cc:85] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 4
I20260709 12:10:43.632107 13831 pending_rounds.cc:107] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 12:10:43.632402 13831 raft_consensus.cc:2889] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:43.627127 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:43.634373 13832 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:43.553730 16267 consensus_queue.cc:1059] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 12:10:43.589890 16423 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.642261 16423 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:43.615168 15953 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.644438 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:10:43.631476 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 68582.9us
I20260709 12:10:43.649694 13832 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 6.
I20260709 12:10:43.623636 16194 raft_consensus.cc:2804] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:43.630468 16418 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:43.657111 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:43.637003 16427 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:43.647490 16482 consensus_meta.cc:287] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.613s	user 0.009s	sys 0.007s
I20260709 12:10:43.637894 16220 consensus_queue.cc:260] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:43.664264 16423 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:43.665040 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:43.730868 13832 raft_consensus.cc:2410] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:43.665977 16350 consensus_queue.cc:1048] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:43.666632 16322 consensus_queue.cc:1048] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:43.668757 13727 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
W20260709 12:10:43.740000 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 71327.6us
I20260709 12:10:43.740885 13727 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:43.670343 16344 consensus_queue.cc:1048] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:10:43.671389 16506 log.cc:927] Time spent T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:10:43.637550 16100 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.671639 16442 consensus_queue.cc:1059] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:43.672092 16497 raft_consensus.cc:2749] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:43.652894 15953 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:43.683647 16258 raft_consensus.cc:3055] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:43.686575 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:43.801849 13686 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 5.
I20260709 12:10:43.803328 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:43.804104 13686 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 6.
W20260709 12:10:43.805090 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.688854 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:10:43.701396 16494 log.cc:927] Time spent T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.380s	user 0.002s	sys 0.000s
I20260709 12:10:43.703670 16403 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:43.705711 16167 consensus_queue.cc:1059] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:43.708468 16187 consensus_queue.cc:1059] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:10:43.709715 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:43.711820 16489 log.cc:927] Time spent T 00000000000000000000000000000000 P 17d79eae88f84be7a847d0cf544674cd: Append to log took a long time: real 0.721s	user 0.002s	sys 0.000s
W20260709 12:10:43.833611 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.713027 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:10:43.714057 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:43.714280 13833 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54820 (request call id 2059) took 1656 ms (client timeout 1545 ms). Trace:
W20260709 12:10:43.837168 13833 rpcz_store.cc:269] 0709 12:10:42.057979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.058182 (+   203us) service_pool.cc:224] Handling call
0709 12:10:43.714068 (+1655886us) spinlock_profiling.cc:243] Waited 77.3 ms on lock 0x7b54000b40d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:43.714201 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":177692416}
W20260709 12:10:43.715958 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.638116 16450 raft_consensus.cc:697] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 6 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:43.721529 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:10:43.732507 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 194442us
W20260709 12:10:43.747112 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.747787 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:43.842085 14410 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:43.747689 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:43.638845 16498 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:43.846249 13757 raft_consensus.cc:1275] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:43.846590 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:43.745428 14380 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:43.786607 13681 raft_consensus.cc:1240] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 6 LEADER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:43.847734 13830 raft_consensus.cc:2393] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 4: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:43.799906 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:43.806398 13835 raft_consensus.cc:2410] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:43.810825 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:43.734230 16194 raft_consensus.cc:697] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:43.739188 16491 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.815852 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:10:43.854019 13652 leader_election.cc:336] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 1.847s (SENT)
I20260709 12:10:43.854490 13686 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:43.689141 16051 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:43.747689 15941 raft_consensus.cc:2749] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:43.827705 16233 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:43.794008 16100 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:43.733857 16443 consensus_queue.cc:1059] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 12:10:43.793661 16220 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:43.731775 16482 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:43.836586 14414 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 5.
I20260709 12:10:43.834708 13726 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:10:43.787752 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 46958us
I20260709 12:10:43.796680 16466 raft_consensus.cc:2749] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:10:43.850921 13801 leader_election.cc:336] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Timed out: RequestConsensusVote RPC to 127.12.56.196:46341 timed out after 2.173s (SENT)
I20260709 12:10:44.030830 13801 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:10:43.851926 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:44.024376 14414 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41700 (request call id 344) took 1770 ms (client timeout 2017 ms). Trace:
I20260709 12:10:43.857975 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:44.032385 14415 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:43.862313 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:43.863188 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:43.822669 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:10:43.911015 13836 consensus_meta.cc:287] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.678s	user 0.013s	sys 0.001s
I20260709 12:10:44.037866 13836 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 3.
I20260709 12:10:43.801381 16258 raft_consensus.cc:740] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:43.911553 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:43.911612 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:44.041702 13835 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:43.913694 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:10:44.045574 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 194680us
I20260709 12:10:44.053799 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:44.054538 13758 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 6.
I20260709 12:10:44.054792 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:44.056674 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:10:43.917199 13652 leader_election.cc:336] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 1.849s (SENT)
W20260709 12:10:43.838511 16486 consensus_meta.cc:287] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.525s	user 0.005s	sys 0.008s
I20260709 12:10:43.843336 16423 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.067706 13829 raft_consensus.cc:2393] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 9: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:43.925582 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:44.068444 13830 raft_consensus.cc:2393] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 5: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:44.068374 13757 raft_consensus.cc:1240] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:10:44.029752 13686 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 8.
W20260709 12:10:44.070559 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 153434us
W20260709 12:10:44.031924 14414 rpcz_store.cc:269] 0709 12:10:42.253888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.254027 (+   139us) service_pool.cc:224] Handling call
0709 12:10:43.712866 (+1458839us) spinlock_profiling.cc:243] Waited 1.23 ms on lock 0x7b5800003c98. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924e68b71 00007fa924e68a22 00007fa92dd818d9 00007fa92cedbee0 00007fa92cfa50ab 00007fa92cfa5131 00007fa92cf530a0 00007fa92cf52984 00007fa9264cd6d4 00007fa9264cd662
0709 12:10:43.925232 (+212366us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2822016}
W20260709 12:10:44.059084 13800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.073199 13686 raft_consensus.cc:1240] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 5 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:10:44.063635 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:44.064595 13727 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:44.059221 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:44.031639 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:44.078709 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:44.081513 13828 raft_consensus.cc:2468] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 5.
W20260709 12:10:44.081902 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.083518 13760 raft_consensus.cc:1240] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:10:44.083428 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:44.031018 16469 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:44.085702 13836 raft_consensus.cc:2393] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 6: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:10:44.083528 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:44.087110 13835 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 8.
I20260709 12:10:44.087549 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:44.088063 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:44.087466 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:44.092402 13828 raft_consensus.cc:2368] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 5. Current term is 6.
I20260709 12:10:43.921542 16491 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:43.919569 16447 consensus_queue.cc:1048] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.148s
I20260709 12:10:44.059548 16497 raft_consensus.cc:2749] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:44.108296 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:44.060818 16267 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.103603 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:44.110133 13835 raft_consensus.cc:2410] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:44.096768 13680 raft_consensus.cc:1240] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 7. Current term is 8. Ops: []
W20260709 12:10:44.107661 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 273028us
I20260709 12:10:44.096375 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:44.111608 13828 raft_consensus.cc:2393] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 8: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:44.114620 13828 raft_consensus.cc:1240] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:44.118904 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.924598 16233 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:44.111634 13726 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:44.109138 13652 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:44.123050 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:44.123807 13830 raft_consensus.cc:2468] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 3.
I20260709 12:10:44.084652 16454 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.124151 13828 raft_consensus.cc:1240] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:44.125067 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:44.130637 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:10:44.127239 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 62732.8us
I20260709 12:10:44.132196 13727 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:44.128852 13726 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:44.091579 16187 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:44.075161 16486 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:44.140684 13828 raft_consensus.cc:1240] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:44.081151 16423 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:44.113444 16498 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:44.113931 16466 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.089413 15925 consensus_queue.cc:1059] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 12:10:44.091969 16424 consensus_queue.cc:1059] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 12:10:44.138893 16442 raft_consensus.cc:2804] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:44.141376 16454 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:44.163533 16507 log.cc:927] Time spent T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.241s	user 0.001s	sys 0.000s
W20260709 12:10:44.164273 16503 log.cc:927] Time spent T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.309s	user 0.000s	sys 0.001s
W20260709 12:10:44.164959 16511 log.cc:927] Time spent T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 12:10:44.167938 16100 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:44.191109 16100 raft_consensus.cc:2804] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:44.191617 16100 raft_consensus.cc:697] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:44.192476 16100 consensus_queue.cc:237] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:44.193050 16408 consensus_meta.cc:287] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.732s	user 0.013s	sys 0.000s
I20260709 12:10:44.158087 16187 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:44.150338 16258 consensus_queue.cc:260] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:44.125134 16267 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:44.194643 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:44.157634 16522 consensus_queue.cc:1048] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:10:44.170840 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:44.202597 13681 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:44.172158 16491 leader_election.cc:290] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:44.139370 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:44.129509 16462 raft_consensus.cc:2804] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:44.095603 16194 consensus_queue.cc:237] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:44.186156 13832 raft_consensus.cc:2410] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:44.187404 14409 raft_consensus.cc:2468] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 3.
I20260709 12:10:44.188424 15953 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:44.197466 14415 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 6.
I20260709 12:10:44.199761 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:44.197825 13757 raft_consensus.cc:1275] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:44.201625 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:10:44.184902 16419 consensus_meta.cc:287] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.859s	user 0.007s	sys 0.005s
I20260709 12:10:44.096007 16450 consensus_queue.cc:237] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:44.216536 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:10:44.224071 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 144602us
I20260709 12:10:44.233086 13760 raft_consensus.cc:2410] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for term 9 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:44.233884 13800 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:10:44.238715 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 129648us
I20260709 12:10:44.226626 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:44.182574 16518 raft_consensus.cc:2804] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:44.195901 16468 raft_consensus.cc:2804] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:44.188432 16423 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:44.272264 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:44.213260 16417 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:44.278918 13680 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 6.
I20260709 12:10:44.245577 13800 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:44.253358 13684 raft_consensus.cc:2393] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 8: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:44.213222 16462 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:44.202631 16442 raft_consensus.cc:697] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:44.222314 16407 raft_consensus.cc:3055] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:44.283666 13800 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:44.303705 13681 raft_consensus.cc:2410] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:44.283062 13759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2059) took 1254 ms. Trace:
W20260709 12:10:44.312717 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 183886us
W20260709 12:10:44.245564 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 108376us
I20260709 12:10:44.243721 16187 leader_election.cc:290] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:44.329674 16187 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.330351 16187 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:44.243592 16408 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:44.174271 16466 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:44.317148 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:44.282446 16468 raft_consensus.cc:697] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:44.334379 16468 consensus_queue.cc:237] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:44.282843 14411 consensus_meta.cc:287] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.822s	user 0.010s	sys 0.011s
I20260709 12:10:44.320142 13684 raft_consensus.cc:1240] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:44.320094 13759 rpcz_store.cc:276] 0709 12:10:43.031072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.306557 (+275485us) service_pool.cc:224] Handling call
0709 12:10:43.310180 (+  3623us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:43.480367 (+170187us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:44.282751 (+802384us) spinlock_profiling.cc:243] Waited 87.4 ms on lock 0x7b5400393ad4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:44.282973 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":201000832}
I20260709 12:10:44.322882 13727 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:44.325973 16502 raft_consensus.cc:3055] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:10:44.327250 16509 log.cc:927] Time spent T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.196s	user 0.000s	sys 0.000s
I20260709 12:10:44.349890 14410 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 7.
I20260709 12:10:44.216735 16403 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:44.271400 16491 consensus_queue.cc:1059] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.089s
I20260709 12:10:44.303020 16497 raft_consensus.cc:2749] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:44.284809 16498 consensus_queue.cc:1048] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.083s
I20260709 12:10:44.335664 16442 consensus_queue.cc:237] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:44.362408 16502 raft_consensus.cc:740] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
W20260709 12:10:44.408910 16391 consensus_meta.cc:287] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 1.021s	user 0.012s	sys 0.001s
W20260709 12:10:44.391685 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.428839 13682 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 3.
I20260709 12:10:44.367602 16220 consensus_queue.cc:1059] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 12:10:44.410175 13836 raft_consensus.cc:2410] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:10:44.413933 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 91167us
W20260709 12:10:44.334383 16393 consensus_meta.cc:287] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.878s	user 0.007s	sys 0.011s
I20260709 12:10:44.431385 13727 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
W20260709 12:10:44.386359 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 275002us
W20260709 12:10:44.375759 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 53451.5us
I20260709 12:10:44.444020 13828 raft_consensus.cc:1240] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:44.445544 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:44.447870 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:44.448840 13828 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 6.
I20260709 12:10:44.450946 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:44.453389 13828 raft_consensus.cc:1240] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:10:44.316200 16462 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:44.280229 16518 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:44.319669 16407 raft_consensus.cc:740] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:44.383633 16408 raft_consensus.cc:2749] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:44.473810 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:44.465664 16403 raft_consensus.cc:2804] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:44.474967 16528 consensus_queue.cc:1059] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:44.467945 16533 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.350889 16482 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:44.386044 16267 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:44.477937 13828 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 4.
I20260709 12:10:44.477545 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:44.400106 16486 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:44.361730 14411 raft_consensus.cc:2468] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 4.
W20260709 12:10:44.482050 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 198546us
I20260709 12:10:44.430027 16220 consensus_queue.cc:1243] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer b98d2519bb504dc6905ed2ede4571835 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:10:44.407577 16530 raft_consensus.cc:2764] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 12:10:44.487795 16403 raft_consensus.cc:697] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:10:44.483070 16427 consensus_meta.cc:287] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.742s	user 0.007s	sys 0.004s
I20260709 12:10:44.493448 13800 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:44.429955 16502 consensus_queue.cc:260] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:44.472991 16100 consensus_queue.cc:1059] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:10:44.488674 13834 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 6.
I20260709 12:10:44.477104 16518 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:44.579032 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 85709.5us
I20260709 12:10:44.584120 13800 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:44.567682 16403 consensus_queue.cc:237] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:44.559155 14411 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41692 (request call id 490) took 2105 ms (client timeout 2173 ms). Trace:
I20260709 12:10:44.590013 16187 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:44.585378 16482 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:44.581270 16220 raft_consensus.cc:2749] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:44.615419 16408 consensus_queue.cc:1059] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:44.616101 13834 raft_consensus.cc:1275] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:44.616550 16408 raft_consensus.cc:3055] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:44.617041 16408 raft_consensus.cc:740] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:44.617988 16408 consensus_queue.cc:260] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:44.618209 16267 consensus_queue.cc:1059] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:44.619364 16408 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:44.619540 16267 raft_consensus.cc:3055] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:44.620141 16267 raft_consensus.cc:740] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:44.612814 13800 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:44.487370 16533 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:44.626116 13727 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:44.586234 16502 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:44.580227 16427 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:44.588109 16415 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.642819 13652 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:44.621289 16267 consensus_queue.cc:260] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:44.625566 16187 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.564867 16407 consensus_queue.cc:260] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:44.602687 16100 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.639207 16497 raft_consensus.cc:2804] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:44.623241 16482 consensus_queue.cc:1059] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 12:10:44.663625 13755 raft_consensus.cc:2393] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 6: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
W20260709 12:10:44.596807 14411 rpcz_store.cc:269] 0709 12:10:42.453395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.509149 (+ 55754us) service_pool.cc:224] Handling call
0709 12:10:43.365304 (+856155us) spinlock_profiling.cc:243] Waited 18.4 ms on lock 0x7b5800003c98. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924e68e9c 00007fa924e68a5b 00007fa92dd818d9 00007fa92cedbee0 00007fa92cfa50ab 00007fa92cfa5131 00007fa92cf530a0 00007fa92cf52984 00007fa9264cd6d4 00007fa9264cd662
0709 12:10:44.530857 (+1165553us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42396032}
I20260709 12:10:44.669154 13652 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:44.650195 16491 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.673118 13652 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:44.654922 16497 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:44.666086 16267 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:44.652376 16220 consensus_queue.cc:1059] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 12:10:44.680451 13800 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:44.678095 16532 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.687829 16546 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:44.688235 16532 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:44.688586 16546 consensus_queue.cc:1059] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:44.690775 16532 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:44.691408 16532 raft_consensus.cc:2804] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:44.691789 16532 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:44.692140 16532 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:44.651643 16187 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:44.655418 16100 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:44.695461 16187 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:44.696552 16531 log.cc:927] Time spent T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 12:10:44.696398 16100 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:44.698189 16418 consensus_meta.cc:287] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.964s	user 0.012s	sys 0.000s
I20260709 12:10:44.698737 16418 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:44.700567 16533 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:44.706670 16427 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:44.650779 16415 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:44.708039 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.707998 13758 raft_consensus.cc:1275] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:10:44.707814 13756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 376) took 2962 ms. Trace:
I20260709 12:10:44.711905 13756 rpcz_store.cc:276] 0709 12:10:41.747567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.305574 (+558007us) service_pool.cc:224] Handling call
0709 12:10:42.322756 (+ 17182us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:42.363176 (+ 40420us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:42.363232 (+    56us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:42.363297 (+    65us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:42.363351 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:44.707457 (+2344106us) spinlock_profiling.cc:243] Waited 40.1 ms on lock 0x7b54002ef754. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:44.707530 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:44.707728 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":92213632}
I20260709 12:10:44.710981 16482 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.713866 16482 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:44.716967 16482 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:44.718345 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:44.719683 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:44.727092 13687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1293) took 1398 ms. Trace:
I20260709 12:10:44.727596 13687 rpcz_store.cc:276] 0709 12:10:43.328351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.328503 (+   152us) service_pool.cc:224] Handling call
0709 12:10:43.328831 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:43.521714 (+192883us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:44.726819 (+1205105us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b54002bf2d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:44.727013 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":430638336}
W20260709 12:10:44.735317 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.679585 16547 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:44.681663 16497 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:44.753475 16473 raft_consensus.cc:3055] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:44.753971 16473 raft_consensus.cc:740] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:44.755496 16473 consensus_queue.cc:260] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:44.756635 16473 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:44.737656 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:44.758446 13683 raft_consensus.cc:2393] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 9: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:44.759425 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:44.760552 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:44.739867 16415 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:44.740491 16458 consensus_meta.cc:287] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 1.247s	user 0.011s	sys 0.001s
I20260709 12:10:44.740604 16527 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:44.741089 16543 raft_consensus.cc:3055] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:44.741187 16454 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:44.680529 16524 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:44.742607 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:44.742977 14409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41692 (request call id 497) took 1022 ms. Trace:
I20260709 12:10:44.744923 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:10:44.751314 16544 log.cc:927] Time spent T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:10:44.751870 16521 raft_consensus.cc:2749] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:44.719214 16487 raft_consensus.cc:2749] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:44.752585 16417 raft_consensus.cc:2749] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:44.770134 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 97106.1us
I20260709 12:10:44.814236 13652 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:44.815725 13652 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:44.677601 16491 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:44.805374 13683 raft_consensus.cc:1275] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:44.819007 13683 raft_consensus.cc:1240] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 8 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:10:44.773643 16543 raft_consensus.cc:740] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:10:44.820832 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 184402us
I20260709 12:10:44.821439 13652 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:44.826444 13685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 1989) took 1801 ms. Trace:
I20260709 12:10:44.826959 13685 rpcz_store.cc:276] 0709 12:10:43.025152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.025269 (+   117us) service_pool.cc:224] Handling call
0709 12:10:43.038407 (+ 13138us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:43.194990 (+156583us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:44.826166 (+1631176us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b540021e654. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:44.826373 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":356961664}
I20260709 12:10:44.828027 13683 raft_consensus.cc:1240] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:44.806658 14409 rpcz_store.cc:276] 0709 12:10:43.720144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.729903 (+  9759us) service_pool.cc:224] Handling call
0709 12:10:44.742740 (+1012837us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b54006b0dd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:44.742905 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":330210176}
W20260709 12:10:44.824062 16479 log.cc:927] Time spent T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 1.835s	user 0.000s	sys 0.004s
W20260709 12:10:44.826252 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.830919 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:44.831957 13836 raft_consensus.cc:2410] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
W20260709 12:10:44.829572 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 149316us
I20260709 12:10:44.833297 13687 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 4.
I20260709 12:10:44.833834 13800 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:44.836687 13837 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:44.843418 16454 consensus_queue.cc:1048] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:44.846457 13727 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:44.847615 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:44.847960 16543 consensus_queue.cc:260] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:44.820538 16231 raft_consensus.cc:2804] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:44.771059 16547 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:44.848860 13685 raft_consensus.cc:1275] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:44.850857 16462 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:44.853871 16455 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.297s	user 0.024s	sys 0.004s
W20260709 12:10:44.882555 16455 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.506s	user 0.025s	sys 0.004s
I20260709 12:10:44.882854 16323 raft_consensus.cc:3055] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:44.883332 16323 raft_consensus.cc:740] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:44.884424 16491 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:44.884264 16323 consensus_queue.cc:260] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:44.885171 16233 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:44.810503 16524 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:44.888311 16508 log.cc:927] Time spent T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 1.029s	user 0.002s	sys 0.001s
I20260709 12:10:44.888622 16524 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:44.840583 16521 raft_consensus.cc:2749] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:44.890504 13681 raft_consensus.cc:1275] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:10:44.890615 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:44.891841 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:44.893360 13681 raft_consensus.cc:1240] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:10:44.894088 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:44.895370 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:44.896188 13836 raft_consensus.cc:2410] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:44.835361 16418 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:44.854089 16468 consensus_queue.cc:1048] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:44.857398 16550 raft_consensus.cc:2749] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:44.795380 16458 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:44.846496 16454 consensus_queue.cc:1059] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:44.864038 13837 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 6.
I20260709 12:10:44.875373 15925 raft_consensus.cc:3055] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:45.061914 15925 raft_consensus.cc:740] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:45.063409 16462 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:45.063105 15925 consensus_queue.cc:260] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:45.065006 15925 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:44.875481 13686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2001) took 1208 ms. Trace:
I20260709 12:10:45.066603 13686 rpcz_store.cc:276] 0709 12:10:43.667380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.081200 (+413820us) service_pool.cc:224] Handling call
0709 12:10:44.126108 (+ 44908us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:44.196963 (+ 70855us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:44.467880 (+270917us) log.cc:844] Serialized 14 byte log entry
0709 12:10:44.562019 (+ 94139us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:44.562090 (+    71us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:44.562164 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:44.875183 (+313019us) spinlock_profiling.cc:243] Waited 70.5 ms on lock 0x7b54002c2754. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:44.875246 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:44.875408 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":290585,"prepare.run_cpu_time_us":7000,"prepare.run_wall_time_us":28956,"raft.queue_time_us":1085,"spinlock_wait_cycles":199153024,"thread_start_us":343063,"threads_started":2,"wal-append.queue_time_us":178884}
I20260709 12:10:44.877931 16231 raft_consensus.cc:697] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 8 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:45.071969 16547 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:44.878150 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:44.880575 16497 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:44.962798 13681 raft_consensus.cc:1275] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:10:45.034338 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.878497 16350 raft_consensus.cc:2749] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:44.858412 16487 raft_consensus.cc:2749] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:45.092546 16550 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.049436 16454 consensus_queue.cc:1243] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Peer b98d2519bb504dc6905ed2ede4571835 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:10:45.043646 16524 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.093304 16550 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:44.885661 16323 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:45.058128 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:45.096684 13836 raft_consensus.cc:2410] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:10:45.061151 16458 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:45.071385 16231 consensus_queue.cc:237] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:45.074223 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.044577 16521 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.092716 16497 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:45.093653 16524 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:45.221009 16532 consensus_meta.cc:287] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.528s	user 0.010s	sys 0.002s
I20260709 12:10:45.043363 16491 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.221446 16532 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:45.222113 16491 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:45.053958 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.048636 16552 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:45.136502 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.227415 16552 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:45.205503 13727 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:45.214929 16487 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:45.231777 16487 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:45.232144 16552 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:10:45.216090 16502 consensus_meta.cc:287] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.574s	user 0.006s	sys 0.003s
I20260709 12:10:45.216730 16233 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:45.219193 16550 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:45.192899 16543 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:45.219489 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:45.217240 16521 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:45.230336 13727 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:45.239296 13828 raft_consensus.cc:1275] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:45.240818 16322 raft_consensus.cc:2804] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:45.241254 16322 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
W20260709 12:10:45.234567 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.236821 13836 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 7.
I20260709 12:10:45.246176 16502 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.241641 16322 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:45.246426 16521 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:45.249564 16502 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:45.223558 16532 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:45.224213 16491 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:10:45.233403 16518 consensus_meta.cc:287] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.645s	user 0.011s	sys 0.000s
W20260709 12:10:45.255256 13832 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35422 (request call id 446) took 1529 ms (client timeout 1880 ms). Trace:
W20260709 12:10:45.257421 13832 rpcz_store.cc:269] 0709 12:10:43.726154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.748335 (+ 22181us) service_pool.cc:224] Handling call
0709 12:10:45.255050 (+1506715us) spinlock_profiling.cc:243] Waited 337 ms on lock 0x7b5400167bd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:45.255191 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":775871872}
I20260709 12:10:45.238377 16442 raft_consensus.cc:2804] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:45.258533 16552 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.240039 16550 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.261097 13835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 445) took 1539 ms. Trace:
I20260709 12:10:45.260246 16518 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:45.252624 16497 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:45.242334 16528 consensus_queue.cc:1048] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:10:45.263288 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:45.265663 13835 rpcz_store.cc:276] 0709 12:10:43.721376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.110707 (+389331us) service_pool.cc:224] Handling call
0709 12:10:44.122184 (+ 11477us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:44.135484 (+ 13300us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:44.135518 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:44.143537 (+  8019us) log.cc:844] Serialized 26 byte log entry
0709 12:10:44.431890 (+288353us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:44.431932 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:44.432232 (+   300us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:45.251418 (+819186us) spinlock_profiling.cc:243] Waited 1.7 ms on lock 0x7b2400261ff8. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924d269c4 00007fa924d24acb 00007fa924edfdc9 00007fa924edfa55 00007fa924edefb0 00007fa927b55488 00007fa927b55be8 00007fa927b2d398 00007fa927b2876a 00007fa927b27bb6
0709 12:10:45.252252 (+   834us) raft_consensus.cc:1685] finished
0709 12:10:45.252273 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:45.261032 (+  8759us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3212,"raft.queue_time_us":6817,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":7368,"spinlock_wait_cycles":3912960,"thread_start_us":235219,"threads_started":1,"wal-append.queue_time_us":313446}
W20260709 12:10:45.270609 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 453368us
I20260709 12:10:45.270923 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:45.271442 13652 leader_election.cc:400] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 election: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 5. Current term is 6.
I20260709 12:10:45.271733 13652 leader_election.cc:403] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:10:45.272042 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:45.272289 16532 raft_consensus.cc:2749] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 5. Current term is 6.
I20260709 12:10:45.272691 13652 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:45.251788 16502 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:45.273545 16532 raft_consensus.cc:2749] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:45.278540 13836 raft_consensus.cc:2410] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:45.274717 13652 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:45.267970 16323 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.269196 16552 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:45.282236 16323 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:45.283761 16552 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:45.284317 16475 raft_consensus.cc:3055] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:45.284747 16475 raft_consensus.cc:740] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:45.285002 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:45.286204 16524 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:45.290511 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:45.272644 13835 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 6.
I20260709 12:10:45.286263 13836 raft_consensus.cc:2393] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 11: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:45.261516 16442 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:45.268115 16403 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.020s	sys 0.028s
I20260709 12:10:45.240206 16233 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:45.285581 16475 consensus_queue.cc:260] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:45.298957 16518 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:45.301079 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:45.281610 16532 raft_consensus.cc:2804] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:45.305250 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:10:45.305755 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.306012 13835 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 6.
I20260709 12:10:45.305573 13832 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:45.298007 16442 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:45.280505 16497 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:45.278630 16550 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:45.317525 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:45.318354 13836 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:45.314574 13652 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:45.306968 16532 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:10:45.324437 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 454895us
I20260709 12:10:45.324551 13832 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 6.
W20260709 12:10:45.302182 16403 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.020s	sys 0.029s
I20260709 12:10:45.326947 13727 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:45.327993 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:45.329298 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:45.329165 13727 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:45.329813 13835 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:45.307425 16521 consensus_queue.cc:1059] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 12:10:45.331688 13681 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:45.336063 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:45.336171 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:45.336918 13832 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:45.343250 13754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2053) took 3343 ms. Trace:
I20260709 12:10:45.343703 13754 rpcz_store.cc:276] 0709 12:10:41.999997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.039682 (+1039685us) service_pool.cc:224] Handling call
0709 12:10:43.040006 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:43.101867 (+ 61861us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:43.101910 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:43.109011 (+  7101us) log.cc:844] Serialized 26 byte log entry
0709 12:10:43.517688 (+408677us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:43.517724 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.342842 (+1825118us) spinlock_profiling.cc:243] Waited 61.4 ms on lock 0x7b54003a02d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:45.342900 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:45.342956 (+    56us) raft_consensus.cc:1685] finished
0709 12:10:45.342967 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:45.343184 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":113,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":4201,"spinlock_wait_cycles":141133184,"thread_start_us":379596,"threads_started":1,"wal-append.queue_time_us":499731,"wal-append.run_cpu_time_us":2483,"wal-append.run_wall_time_us":1052794}
I20260709 12:10:45.326309 16532 raft_consensus.cc:3060] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:45.347491 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:45.348407 13685 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 7.
I20260709 12:10:45.348685 16465 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.349432 16465 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:45.329186 16524 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.330433 16487 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:45.330058 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:45.361054 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:45.353052 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:45.337252 16231 raft_consensus.cc:2749] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:45.364092 16550 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:45.333555 16518 raft_consensus.cc:2804] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:45.336649 16547 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:45.367053 13832 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 7.
W20260709 12:10:45.354250 16527 consensus_meta.cc:287] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.546s	user 0.008s	sys 0.003s
I20260709 12:10:45.385999 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:45.391443 13727 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:45.392103 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:45.392803 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:45.393754 13832 raft_consensus.cc:2410] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:10:45.369877 13681 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 7.
I20260709 12:10:45.367475 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:45.395169 13679 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 6.
I20260709 12:10:45.368271 16524 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:45.364907 16323 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:45.397616 15775 raft_consensus.cc:2804] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:45.397903 16524 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:45.353037 16322 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:45.398403 15775 raft_consensus.cc:697] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:45.391556 13687 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 4.
I20260709 12:10:45.355302 16233 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:45.365971 16497 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:45.404834 13836 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 6.
I20260709 12:10:45.413096 13727 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:45.413864 13835 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 7.
I20260709 12:10:45.400811 16527 raft_consensus.cc:2749] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:45.407826 16322 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:45.408478 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:45.408771 14408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41700 (request call id 349) took 1573 ms. Trace:
I20260709 12:10:45.409252 16547 raft_consensus.cc:697] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:10:45.368834 13831 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54830 (request call id 1997) took 1727 ms (client timeout 1904 ms). Trace:
I20260709 12:10:45.410252 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:45.367367 16403 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.427452 16403 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:45.429957 15925 raft_consensus.cc:2804] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:45.430610 15925 raft_consensus.cc:697] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:45.431509 15925 consensus_queue.cc:237] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:45.425362 13831 rpcz_store.cc:269] 0709 12:10:43.641638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.352319 (+1710681us) service_pool.cc:224] Handling call
0709 12:10:45.368772 (+ 16453us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:45.373366 16518 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:45.419832 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.422384 13687 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 10.
I20260709 12:10:45.365166 16465 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:45.424146 13727 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:45.438318 16462 raft_consensus.cc:2804] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:10:45.425493 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 111000us
I20260709 12:10:45.438841 16462 raft_consensus.cc:697] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:45.439743 16462 consensus_queue.cc:237] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:45.440727 13652 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:45.426497 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:45.429994 13833 raft_consensus.cc:1240] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:45.447542 13833 raft_consensus.cc:1275] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:10:45.447929 13833 pending_rounds.cc:85] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 2
I20260709 12:10:45.448163 13833 pending_rounds.cc:107] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:10:45.449407 13833 raft_consensus.cc:2889] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:45.450073 16521 raft_consensus.cc:2749] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:45.452853 13682 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1303) took 1974 ms (client timeout 1556 ms). Trace:
I20260709 12:10:45.451081 16449 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:45.453320 13682 rpcz_store.cc:269] 0709 12:10:43.478328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.478624 (+   296us) service_pool.cc:224] Handling call
0709 12:10:45.452679 (+1974055us) spinlock_profiling.cc:243] Waited 933 ms on lock 0x7b5400245ed4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:45.452785 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2146407680}
I20260709 12:10:45.450637 16465 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.455708 16465 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:45.455938 16547 consensus_queue.cc:237] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:45.448454 16518 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:45.457473 16051 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:45.423754 14408 rpcz_store.cc:276] 0709 12:10:43.835435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.843489 (+  8054us) service_pool.cc:224] Handling call
0709 12:10:45.323666 (+1480177us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b5800003c98. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924e68b71 00007fa924e68a22 00007fa92dd818d9 00007fa92cedbee0 00007fa92cfa50ab 00007fa92cfa5131 00007fa92cf530a0 00007fa92cf52984 00007fa9264cd6d4 00007fa9264cd662
0709 12:10:45.405339 (+ 81673us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":234100480}
I20260709 12:10:45.459338 13833 raft_consensus.cc:1275] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 12:10:45.459762 13833 pending_rounds.cc:85] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 6
I20260709 12:10:45.460078 13833 pending_rounds.cc:107] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 12:10:45.459586 15775 consensus_queue.cc:237] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:45.460321 13833 raft_consensus.cc:2889] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:45.448654 16403 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:45.461572 13755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38932 (request call id 390) took 1262 ms. Trace:
I20260709 12:10:45.462215 16465 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:45.462337 13833 raft_consensus.cc:1275] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:45.455005 13836 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:45.464351 13758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 391) took 1264 ms. Trace:
I20260709 12:10:45.464767 13758 rpcz_store.cc:276] 0709 12:10:44.200219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.200374 (+   155us) service_pool.cc:224] Handling call
0709 12:10:44.707694 (+507320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:44.711560 (+  3866us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.464174 (+752614us) spinlock_profiling.cc:243] Waited 507 ms on lock 0x7b54002ef750. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:45.464298 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1166067072}
I20260709 12:10:45.461993 13755 rpcz_store.cc:276] 0709 12:10:44.199296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.199501 (+   205us) service_pool.cc:224] Handling call
0709 12:10:45.461380 (+1261879us) spinlock_profiling.cc:243] Waited 441 ms on lock 0x7b540032ee54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:45.461509 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1014048640}
I20260709 12:10:45.454234 13652 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:10:45.467794 13837 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54830 (request call id 1993) took 1827 ms (client timeout 1775 ms). Trace:
I20260709 12:10:45.467877 13652 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:10:45.468288 13837 rpcz_store.cc:269] 0709 12:10:43.640215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.744632 (+1104417us) service_pool.cc:224] Handling call
0709 12:10:45.467596 (+722964us) spinlock_profiling.cc:243] Waited 31.9 ms on lock 0x7b54000b40d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:45.467718 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":73426304}
I20260709 12:10:45.469412 13833 raft_consensus.cc:1275] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:10:45.469815 13833 pending_rounds.cc:85] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 2
I20260709 12:10:45.470026 16560 raft_consensus.cc:2804] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:45.470486 16560 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:45.470772 13829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54820 (request call id 2084) took 2259 ms. Trace:
I20260709 12:10:45.470857 16560 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:45.471174 13829 rpcz_store.cc:276] 0709 12:10:43.211627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.211891 (+   264us) service_pool.cc:224] Handling call
0709 12:10:45.470553 (+2258662us) spinlock_profiling.cc:243] Waited 843 ms on lock 0x7b5400361d54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:45.470689 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1938475904}
I20260709 12:10:45.470058 13833 pending_rounds.cc:107] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:10:45.472332 13833 raft_consensus.cc:2889] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:45.472412 13834 raft_consensus.cc:1275] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:10:45.472748 13834 pending_rounds.cc:85] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 4
I20260709 12:10:45.472987 13834 pending_rounds.cc:107] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:10:45.473215 13834 raft_consensus.cc:2889] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:45.473536 13652 leader_election.cc:304] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:45.475627 13831 raft_consensus.cc:1275] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:45.482230 13836 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 7.
I20260709 12:10:45.483385 13837 raft_consensus.cc:1240] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:10:45.485110 13727 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:45.488350 13835 raft_consensus.cc:1275] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:45.489840 16485 raft_consensus.cc:2804] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:45.489450 16465 raft_consensus.cc:2804] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:45.490469 16485 raft_consensus.cc:697] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:45.490655 16465 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:45.491252 16465 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:45.491513 16485 consensus_queue.cc:237] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:45.489140 13835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 2100) took 1031 ms. Trace:
I20260709 12:10:45.503392 13835 rpcz_store.cc:276] 0709 12:10:44.457454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.414793 (+957339us) service_pool.cc:224] Handling call
0709 12:10:45.482403 (+ 67610us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:45.488875 (+  6472us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.489082 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:45.502347 16527 consensus_queue.cc:1048] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:10:45.505106 16322 consensus_queue.cc:1048] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:45.506467 16480 raft_consensus.cc:3055] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:45.506670 16460 consensus_queue.cc:1048] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:45.508445 13828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 2095) took 1063 ms. Trace:
I20260709 12:10:45.508857 13828 rpcz_store.cc:276] 0709 12:10:44.445343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.494391 (+ 49048us) service_pool.cc:224] Handling call
0709 12:10:44.494728 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:45.239667 (+744939us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.508207 (+268540us) spinlock_profiling.cc:243] Waited 743 ms on lock 0x7b5400363654. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:45.508378 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1709323648}
I20260709 12:10:45.493356 16521 consensus_queue.cc:1048] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:10:45.512192 16498 raft_consensus.cc:3055] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:45.512640 16498 raft_consensus.cc:740] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:45.506978 16480 raft_consensus.cc:740] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:45.519071 16480 consensus_queue.cc:260] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:45.521075 13836 raft_consensus.cc:1275] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:45.489050 16532 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:45.513484 16498 consensus_queue.cc:260] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:45.521453 16543 consensus_queue.cc:1048] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.007s
W20260709 12:10:45.523599 16292 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.665s	user 0.013s	sys 0.015s
I20260709 12:10:45.509434 16518 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:45.533903 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:45.502032 16442 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:45.534497 16543 consensus_queue.cc:1243] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer 96701a74fdee481fb5f54aac841e17dd log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:10:45.537465 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:45.539618 13835 raft_consensus.cc:2410] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:10:45.534814 16292 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.676s	user 0.013s	sys 0.015s
I20260709 12:10:45.541622 16460 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.542179 16527 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:45.542912 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 1.79763e+06us
I20260709 12:10:45.544803 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:10:45.554796 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.527421 16521 consensus_queue.cc:1048] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 12:10:45.556653 13688 raft_consensus.cc:1240] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 7 LEADER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:45.568262 16560 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:45.570649 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:45.571308 13835 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 7.
I20260709 12:10:45.557125 16430 raft_consensus.cc:2804] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:10:45.570211 16559 log.cc:927] Time spent T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.215s	user 0.003s	sys 0.000s
I20260709 12:10:45.577070 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:45.577764 13835 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 5.
I20260709 12:10:45.572796 14380 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:45.579123 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:45.580338 13835 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 4.
I20260709 12:10:45.582108 13652 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:45.589473 13652 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:45.592940 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:45.593968 16560 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:45.594202 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:45.594941 13835 raft_consensus.cc:2393] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 7: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:45.595718 14407 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 5.
I20260709 12:10:45.596163 13835 raft_consensus.cc:1275] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:45.597461 16231 raft_consensus.cc:2804] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:45.597918 16231 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:45.597700 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:45.598321 16231 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:45.598531 13836 raft_consensus.cc:3060] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:45.607237 16518 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:45.608668 16529 raft_consensus.cc:2804] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:45.609190 16529 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:45.609565 16529 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:45.556931 16527 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:45.621592 14380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.578872 16430 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:45.572752 16292 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:45.555387 16460 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:45.628904 13801 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
W20260709 12:10:45.634297 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.630551 16241 consensus_queue.cc:1048] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:10:45.633852 16430 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:45.610358 16449 raft_consensus.cc:2804] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:45.641129 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:45.639564 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
W20260709 12:10:45.640147 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:45.649324 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.650254 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:45.619585 16521 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:45.653074 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:45.654206 14415 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 5.
I20260709 12:10:45.611835 16260 consensus_queue.cc:1059] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:10:45.637977 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:45.631196 16532 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:45.645202 16469 raft_consensus.cc:2804] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:45.631501 16418 consensus_queue.cc:1059] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:10:45.632961 13836 raft_consensus.cc:2468] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 4.
I20260709 12:10:45.662520 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:45.670292 13652 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:10:45.663997 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.644244 16292 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:45.668527 14410 raft_consensus.cc:2468] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 3.
I20260709 12:10:45.675159 16418 consensus_queue.cc:1243] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer b98d2519bb504dc6905ed2ede4571835 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:10:45.666567 16449 raft_consensus.cc:697] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 6 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:45.677080 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:45.651543 16472 consensus_queue.cc:1059] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:10:45.679778 14415 raft_consensus.cc:1275] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:45.684774 16449 consensus_queue.cc:237] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:45.662212 16521 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:45.662245 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:45.690395 16521 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:45.669353 16568 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:45.691201 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:45.691331 16568 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:45.692070 14411 raft_consensus.cc:2393] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 7: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:10:45.696921 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:45.697930 13836 raft_consensus.cc:2393] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 7: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:45.699234 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:45.699966 13836 raft_consensus.cc:2393] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 4: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:45.700791 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:10:45.703613 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.721978 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:45.722666 14410 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:45.664814 16469 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:45.673957 16532 raft_consensus.cc:2804] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:45.693292 14411 raft_consensus.cc:1240] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 6 LEADER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:10:45.748152 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:45.762283 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:45.765094 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:45.765874 13680 raft_consensus.cc:1275] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:45.725689 16460 leader_election.cc:290] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:45.726769 13831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 2019) took 1064 ms. Trace:
I20260709 12:10:45.768973 13831 rpcz_store.cc:276] 0709 12:10:44.662714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.451365 (+788651us) service_pool.cc:224] Handling call
0709 12:10:45.475288 (+ 23923us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:45.475999 (+   711us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.726572 (+250573us) spinlock_profiling.cc:243] Waited 23.5 ms on lock 0x7b54000b40d0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:45.726721 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":54142848}
W20260709 12:10:45.728224 14407 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41700 (request call id 350) took 1892 ms (client timeout 2056 ms). Trace:
I20260709 12:10:45.721355 16241 consensus_queue.cc:1059] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
W20260709 12:10:45.774024 14407 rpcz_store.cc:269] 0709 12:10:43.835760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.843535 (+  7775us) service_pool.cc:224] Handling call
0709 12:10:45.728037 (+1884502us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b54005e1ad4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:45.728157 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3353482624}
I20260709 12:10:45.775542 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:45.774228 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:45.776682 13680 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:45.764374 16532 raft_consensus.cc:697] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 4 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:45.778584 16532 consensus_queue.cc:237] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:45.779232 16292 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:45.783519 16194 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.730204 16419 raft_consensus.cc:3055] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:10:45.732477 16475 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:45.734086 16560 consensus_queue.cc:1048] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:45.736418 16485 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.737990 16518 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.738745 15925 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:45.739984 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:45.740311 16466 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:45.741675 13755 raft_consensus.cc:1275] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:45.742630 13688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 407) took 3211 ms. Trace:
I20260709 12:10:45.742681 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:45.744207 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:45.744442 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:45.745463 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:45.746249 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:45.746323 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:45.747133 13760 raft_consensus.cc:1240] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 12:10:45.748148 13837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 2032) took 1069 ms. Trace:
I20260709 12:10:45.749260 13834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 2097) took 1292 ms. Trace:
I20260709 12:10:45.749758 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:45.749857 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:45.750666 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:45.752698 13684 raft_consensus.cc:1275] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:45.753644 16469 raft_consensus.cc:3060] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:45.768344 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:45.768493 13685 raft_consensus.cc:1275] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:45.753157 16442 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:45.761225 16568 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:45.784132 16194 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:45.797379 13680 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 6.
I20260709 12:10:46.031715 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:46.032450 13680 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:45.806561 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:46.031134 16518 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:46.047412 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:46.039809 13834 rpcz_store.cc:276] 0709 12:10:44.456687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.617445 (+160758us) service_pool.cc:224] Handling call
0709 12:10:45.472053 (+854608us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:45.477672 (+  5619us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.749071 (+271399us) spinlock_profiling.cc:243] Waited 849 ms on lock 0x7b5400361d50. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:45.749203 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1953066752}
I20260709 12:10:46.041700 13761 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 5.
I20260709 12:10:46.049683 13681 raft_consensus.cc:1240] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:10:46.036827 13679 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 6.
I20260709 12:10:45.765583 16472 consensus_queue.cc:1243] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer b98d2519bb504dc6905ed2ede4571835 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:10:45.918988 14410 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 6.
I20260709 12:10:45.862219 13757 raft_consensus.cc:2393] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 6: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:45.767551 16547 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.037933 13756 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 4.
W20260709 12:10:45.886667 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:45.944753 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.886303 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:46.038880 13754 raft_consensus.cc:2410] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:46.043176 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:46.041932 13688 rpcz_store.cc:276] 0709 12:10:42.531726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.586163 (+ 54437us) service_pool.cc:224] Handling call
0709 12:10:42.598428 (+ 12265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:45.558159 (+2959731us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.742405 (+184246us) spinlock_profiling.cc:243] Waited 2.96 s on lock 0x7b5400246dd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:45.742572 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6802729856}
I20260709 12:10:46.061728 13831 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:46.042411 13837 rpcz_store.cc:276] 0709 12:10:44.678353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.469173 (+790820us) service_pool.cc:224] Handling call
0709 12:10:45.483062 (+ 13889us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:45.483875 (+   813us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.747951 (+264076us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b540002d350. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:45.748088 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31082240}
I20260709 12:10:46.063246 13837 raft_consensus.cc:1240] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:46.040506 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:46.046173 14415 raft_consensus.cc:2376] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 6. Re-sending same reply.
I20260709 12:10:46.064667 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:45.767725 16051 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.052060 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:46.052610 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:46.048372 13687 raft_consensus.cc:2468] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 6.
I20260709 12:10:46.031091 16485 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:46.007117 16220 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:45.806036 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.072790 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
W20260709 12:10:45.826898 16548 log.cc:927] Time spent T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 1.159s	user 0.005s	sys 0.004s
I20260709 12:10:46.036983 16419 raft_consensus.cc:740] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
W20260709 12:10:45.885334 16570 log.cc:927] Time spent T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:10:46.064667 13837 raft_consensus.cc:1240] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:46.067260 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:46.085722 13754 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:46.068594 13759 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 7.
I20260709 12:10:45.770147 16443 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.813931 16487 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.087277 16443 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:46.099172 16487 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:46.100298 16485 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:46.101728 14407 raft_consensus.cc:2410] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:46.102622 16419 consensus_queue.cc:260] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:46.104023 16419 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:46.055615 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:46.104997 14410 raft_consensus.cc:2393] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 4: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:45.815148 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:45.883395 14409 raft_consensus.cc:3055] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:46.071549 13687 raft_consensus.cc:1275] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:45.823254 16527 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:46.008169 16454 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.806731 16524 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.078018 13680 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 7.
I20260709 12:10:46.082691 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:46.118798 13682 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:46.087927 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:46.088905 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:46.120828 13679 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:46.091801 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:46.122133 13754 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 7.
I20260709 12:10:46.090898 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:45.813161 16465 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:45.893796 16529 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:46.112386 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:45.892621 16231 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:46.101420 16487 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:46.123167 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:46.123401 13760 raft_consensus.cc:2393] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 6: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:46.052166 15925 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:46.101507 16443 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199)
I20260709 12:10:46.124941 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:46.158206 14410 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 5.
I20260709 12:10:46.159411 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:46.160099 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:46.160735 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:46.161161 13682 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 7.
I20260709 12:10:46.063948 16423 consensus_queue.cc:1059] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:10:46.081341 16051 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:46.127038 14379 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:10:46.177989 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 51072.7us
I20260709 12:10:46.179811 14379 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:46.110276 14409 raft_consensus.cc:740] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:46.071851 16547 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:46.144937 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:46.160738 13754 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 10.
I20260709 12:10:46.162802 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:46.189301 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:46.111058 16417 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.189592 14410 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 7.
I20260709 12:10:46.190373 14412 raft_consensus.cc:2376] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 5. Re-sending same reply.
I20260709 12:10:46.191427 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:46.129482 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:46.102551 16472 consensus_queue.cc:1059] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:10:46.083997 16220 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:46.116495 14411 raft_consensus.cc:2376] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 6. Re-sending same reply.
I20260709 12:10:46.193885 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:46.194145 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:46.108505 16575 consensus_queue.cc:1059] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 12:10:46.127960 16454 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:46.213902 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:46.214841 13754 raft_consensus.cc:2393] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 2: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:46.131485 16569 consensus_queue.cc:1059] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 12:10:46.206169 14412 raft_consensus.cc:1275] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:46.211508 16231 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:46.188875 16443 raft_consensus.cc:2749] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:46.224125 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:46.224967 13760 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 10.
I20260709 12:10:46.130664 16568 consensus_queue.cc:1048] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 12:10:46.219213 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:46.128892 16524 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:46.229579 13831 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 8.
I20260709 12:10:46.219915 13762 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 5.
I20260709 12:10:46.245919 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:46.248762 13682 raft_consensus.cc:1275] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:46.211546 16465 leader_election.cc:290] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:46.252381 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:46.261837 13754 raft_consensus.cc:2468] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 6.
I20260709 12:10:46.253368 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:46.195833 16417 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:46.227509 16051 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:10:46.256377 16430 consensus_meta.cc:287] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.619s	user 0.012s	sys 0.000s
I20260709 12:10:46.270829 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:46.222316 16423 consensus_queue.cc:1048] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:10:46.278673 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:46.279317 13760 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 5.
I20260709 12:10:46.275131 13754 raft_consensus.cc:2468] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 5.
W20260709 12:10:46.276460 13651 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.56.194:39545 timed out after 1.691s (SENT) [suppressed 35 similar messages]
W20260709 12:10:46.277719 16545 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.596s	user 0.024s	sys 0.048s
I20260709 12:10:46.281167 13754 raft_consensus.cc:1275] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:46.282392 13754 raft_consensus.cc:1275] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:46.249596 16577 raft_consensus.cc:2749] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:46.288705 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.291121 13760 raft_consensus.cc:1275] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:10:46.309321 13760 raft_consensus.cc:1275] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:10:46.287011 16545 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.613s	user 0.025s	sys 0.048s
I20260709 12:10:46.313648 16051 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.275755 16430 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:46.322399 13760 raft_consensus.cc:1240] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:46.323500 16051 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:46.306478 16194 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:46.341979 13760 raft_consensus.cc:1240] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:46.343750 13679 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 5.
I20260709 12:10:46.327378 16529 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:46.345214 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 55761.2us
I20260709 12:10:46.334327 15925 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:46.362677 16454 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:46.364329 16051 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:46.349422 16220 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:46.390623 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:46.391376 13759 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:46.366209 14416 raft_consensus.cc:3055] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:46.354104 16547 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:46.379051 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.395085 14416 raft_consensus.cc:740] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:46.400887 16524 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:46.364347 16430 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:46.419035 13835 raft_consensus.cc:1240] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:10:46.420538 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:46.402648 16417 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:46.403961 16469 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:46.408857 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.423388 13837 pending_rounds.cc:85] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 1
I20260709 12:10:46.432430 13837 pending_rounds.cc:107] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 4.2
I20260709 12:10:46.432816 13837 raft_consensus.cc:2889] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:46.423869 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:46.435422 13835 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:46.426617 13759 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 7.
I20260709 12:10:46.429585 16547 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.442355 14416 consensus_queue.cc:260] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:46.448238 14416 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:46.451543 13836 raft_consensus.cc:2393] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 4: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:46.456784 14416 raft_consensus.cc:1275] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:46.448830 13727 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:10:46.457916 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.438287 16442 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.442632 15925 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.458740 13687 raft_consensus.cc:1275] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:46.460036 13727 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:46.442426 16539 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.459438 16393 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:46.463680 13835 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 5.
I20260709 12:10:46.457505 16588 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.480947 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:46.481885 13837 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:46.485328 16588 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:46.490298 13837 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 7.
I20260709 12:10:46.491976 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:46.493036 13837 raft_consensus.cc:2410] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 12:10:46.494401 16582 log.cc:927] Time spent T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.206s	user 0.002s	sys 0.000s
W20260709 12:10:46.464979 16418 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 12:10:46.450371 16547 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:46.503610 13651 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:46.467361 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:46.462148 16442 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:46.505904 13835 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 5.
I20260709 12:10:46.509184 14379 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:46.525766 14379 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:10:46.510577 13652 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.815s	user 0.022s	sys 0.007s
W20260709 12:10:46.526573 13652 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.831s	user 0.023s	sys 0.007s
W20260709 12:10:46.526883 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 831207us
I20260709 12:10:46.527073 13835 raft_consensus.cc:1275] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:46.528316 13835 raft_consensus.cc:1275] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:10:46.512575 16442 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:46.463213 15925 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:46.519207 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:46.531162 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:46.531368 13758 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 7.
W20260709 12:10:46.519685 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 60621.1us
I20260709 12:10:46.532213 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:46.532754 13758 raft_consensus.cc:2468] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 5.
I20260709 12:10:46.532932 13727 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:10:46.530253 13652 leader_election.cc:336] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Timed out: RequestConsensusVote RPC to 127.12.56.196:46341 timed out after 1.945s (SENT)
W20260709 12:10:46.534675 13652 leader_election.cc:336] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Timed out: RequestConsensusVote RPC to 127.12.56.196:46341 timed out after 2.162s (SENT)
W20260709 12:10:46.535435 13652 leader_election.cc:336] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Timed out: RequestConsensusVote RPC to 127.12.56.196:46341 timed out after 2.195s (SENT)
I20260709 12:10:46.535385 13727 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:46.510854 16422 raft_consensus.cc:2804] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:46.530224 13679 raft_consensus.cc:1240] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:10:46.539919 13760 raft_consensus.cc:1275] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:46.514591 16485 raft_consensus.cc:2749] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:46.537637 13652 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:46.541195 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:46.507941 16258 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:46.543956 13683 raft_consensus.cc:1275] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:10:46.566337 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:46.544544 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:46.567653 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:46.568358 13679 raft_consensus.cc:2468] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 5.
I20260709 12:10:46.546630 13652 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:46.475898 14409 consensus_queue.cc:260] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:46.569517 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:46.510890 16469 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:46.573156 16522 raft_consensus.cc:2749] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:46.467392 16539 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:46.565248 16447 consensus_queue.cc:1048] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:10:46.540795 15941 raft_consensus.cc:2749] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:46.574105 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:46.540772 16422 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:46.575079 16547 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:46.575510 16322 consensus_queue.cc:1048] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:46.576829 16393 consensus_queue.cc:1059] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:10:46.582033 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.584887 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:46.610911 14407 raft_consensus.cc:2410] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 7 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:46.611254 13760 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:46.572300 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.590116 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:46.590811 13683 raft_consensus.cc:1240] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 4 LEADER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:46.566111 16466 consensus_queue.cc:1048] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 12:10:46.612694 13758 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 10.
I20260709 12:10:46.600438 13682 raft_consensus.cc:1240] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 6 LEADER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:46.544806 16529 raft_consensus.cc:2749] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:46.539160 16417 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:46.543793 16575 raft_consensus.cc:2804] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:46.594362 16241 consensus_queue.cc:1059] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:10:46.544502 16194 raft_consensus.cc:2749] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:46.605686 13727 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
W20260709 12:10:46.666548 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 66421.5us
I20260709 12:10:46.607810 13652 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:46.587369 14379 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:46.538439 16475 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.612521 13837 raft_consensus.cc:1275] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:10:46.542541 16430 raft_consensus.cc:2804] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:46.582665 16442 consensus_queue.cc:1048] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:10:46.610545 16422 raft_consensus.cc:3060] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:46.620231 16231 consensus_queue.cc:1048] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:46.621186 16465 consensus_queue.cc:1048] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:46.621949 16241 consensus_queue.cc:1243] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Peer b98d2519bb504dc6905ed2ede4571835 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:10:46.623351 16539 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:46.616649 16522 consensus_queue.cc:1048] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:10:46.615522 16469 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.638113 16417 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:46.645633 16473 consensus_queue.cc:1048] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:46.646322 15925 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:46.673235 16455 raft_consensus.cc:2804] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:46.649490 13651 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:46.650081 16512 raft_consensus.cc:3055] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:46.649969 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:46.650410 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:46.619580 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:46.668049 13837 pending_rounds.cc:85] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 4
I20260709 12:10:46.652323 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:46.730052 13837 pending_rounds.cc:107] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:10:46.730244 13755 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:46.598233 16592 consensus_queue.cc:1059] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:10:46.730389 13837 raft_consensus.cc:2889] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:46.679015 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:46.683382 13760 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 8.
W20260709 12:10:46.683689 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 96435.6us
I20260709 12:10:46.681120 16430 raft_consensus.cc:697] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 7 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:46.696766 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:46.698884 14413 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 709) took 1062 ms. Trace:
I20260709 12:10:46.757165 14416 raft_consensus.cc:2410] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:46.699657 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:46.702030 14412 raft_consensus.cc:1275] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:46.683115 16167 raft_consensus.cc:2749] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:46.670848 13727 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
W20260709 12:10:46.761410 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 90874.7us
I20260709 12:10:46.761991 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:46.762780 13835 raft_consensus.cc:2393] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 5: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:46.698089 16260 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:46.764758 13830 raft_consensus.cc:1275] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
W20260709 12:10:46.755918 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.765264 13830 pending_rounds.cc:85] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 4
I20260709 12:10:46.765578 13830 pending_rounds.cc:107] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:10:46.765857 13830 raft_consensus.cc:2889] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:46.767410 13727 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:46.769209 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:46.759159 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:46.755039 14408 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 11.
I20260709 12:10:46.756978 14413 rpcz_store.cc:276] 0709 12:10:45.636402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.638176 (+  1774us) service_pool.cc:224] Handling call
0709 12:10:46.698718 (+1060542us) spinlock_profiling.cc:243] Waited 627 ms on lock 0x7b54005e01d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:46.698830 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1442372352}
I20260709 12:10:46.746685 14415 raft_consensus.cc:1275] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:46.667984 16575 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:46.672344 16475 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:46.762590 16497 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.699272 16518 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:46.772840 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:46.777343 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:46.778048 13831 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:46.772954 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:46.705451 16512 raft_consensus.cc:740] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:46.775223 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:46.786908 13835 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 4.
I20260709 12:10:46.788223 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:46.788918 13835 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:46.790910 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:46.791803 13761 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 8.
I20260709 12:10:46.792917 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:46.796279 13761 raft_consensus.cc:2393] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 7: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:10:46.783326 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:46.797171 14416 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 8.
I20260709 12:10:46.775964 16575 raft_consensus.cc:3060] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:46.772547 16590 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.801968 16580 consensus_queue.cc:1059] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:10:46.802261 16590 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:46.777038 16393 raft_consensus.cc:2804] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:46.802347 16430 consensus_queue.cc:237] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:46.803174 16393 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:46.803618 16393 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:46.755285 14414 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25896261d1204b3d858fb5b478a89034"
dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
mode: GRACEFUL
new_leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
 from {username='slave'} at 127.0.0.1:46814
I20260709 12:10:46.804031 14411 raft_consensus.cc:1275] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:46.804492 14414 raft_consensus.cc:606] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Received request to transfer leadership to TS 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:46.804853 14414 raft_consensus.cc:614] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:46.755867 16455 raft_consensus.cc:697] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:46.763012 16539 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.698297 16469 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:46.803388 16592 consensus_queue.cc:1059] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:46.814611 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:46.769069 16194 raft_consensus.cc:2804] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:46.803826 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:46.837684 13757 raft_consensus.cc:1275] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:46.777343 14408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41700 (request call id 356) took 1082 ms. Trace:
I20260709 12:10:46.764551 16487 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:46.781487 13727 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:10:46.822669 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:46.862571 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.809860 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:46.840308 13835 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 6.
I20260709 12:10:46.859797 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:46.864300 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:46.774019 16423 consensus_queue.cc:1048] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
W20260709 12:10:46.891371 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 109991us
I20260709 12:10:46.828517 16465 raft_consensus.cc:2804] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:46.896409 13727 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:46.898108 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:10:46.946794 13801 leader_election.cc:336] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Timed out: RequestConsensusVote RPC to 127.12.56.196:46341 timed out after 1.537s (SENT)
I20260709 12:10:46.985368 13801 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:46.813051 16601 consensus_queue.cc:1048] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.176s
W20260709 12:10:47.007682 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 60954.9us
I20260709 12:10:46.838888 16522 raft_consensus.cc:2804] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:46.811694 16442 consensus_queue.cc:1048] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.085s
I20260709 12:10:46.860508 16592 consensus_queue.cc:1243] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer b98d2519bb504dc6905ed2ede4571835 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:10:46.806069 16497 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:46.896713 16580 consensus_queue.cc:1243] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer b98d2519bb504dc6905ed2ede4571835 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:10:46.984530 16518 raft_consensus.cc:2804] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:47.067548 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.916935 16194 raft_consensus.cc:697] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:46.983892 16465 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:47.021227 16258 raft_consensus.cc:2749] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:10:47.027316 16522 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:47.099903 13835 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 8.
I20260709 12:10:46.854480 14408 rpcz_store.cc:276] 0709 12:10:45.694337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.722068 (+ 27731us) service_pool.cc:224] Handling call
0709 12:10:46.649813 (+927745us) spinlock_profiling.cc:243] Waited 1.73 ms on lock 0x7b5800003c98. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924e68b71 00007fa924e68a22 00007fa92dd818d9 00007fa92cedbee0 00007fa92cfa50ab 00007fa92cfa5131 00007fa92cf530a0 00007fa92cf52984 00007fa9264cd6d4 00007fa9264cd662
0709 12:10:46.776408 (+126595us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3969408}
I20260709 12:10:46.894518 16487 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:47.097251 16465 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:47.062036 13829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 2045) took 1523 ms. Trace:
I20260709 12:10:47.131268 13829 rpcz_store.cc:276] 0709 12:10:45.538654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.047824 (+509170us) service_pool.cc:224] Handling call
0709 12:10:46.072463 (+ 24639us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:46.671109 (+598646us) spinlock_profiling.cc:243] Waited 1.19 ms on lock 0x7b18000867a0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa927b354bc 00007fa924e8348b 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9d455 00007fa927f85060 00007fa927f85bfb 00007fa927f9064b
0709 12:10:46.671245 (+   136us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:46.671271 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:46.671738 (+   467us) log.cc:844] Serialized 26 byte log entry
0709 12:10:46.763318 (+ 91580us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:46.763355 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:46.763418 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:47.056073 (+292655us) raft_consensus.cc:1685] finished
0709 12:10:47.056103 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:47.061939 (+  5836us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":201769,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":8761,"spinlock_wait_cycles":2736512,"thread_start_us":295501,"threads_started":2,"wal-append.queue_time_us":166311}
I20260709 12:10:46.830076 16539 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:47.051611 16547 raft_consensus.cc:2804] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:47.092262 16518 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:47.124619 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:47.126230 16606 log.cc:927] Time spent T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.321s	user 0.001s	sys 0.000s
W20260709 12:10:47.073647 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 296892us
I20260709 12:10:47.106199 16522 raft_consensus.cc:3060] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:47.112246 16258 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:47.167050 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:47.182265 13829 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 8.
I20260709 12:10:47.179924 13682 raft_consensus.cc:1275] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:47.074616 16447 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.095471 16455 consensus_queue.cc:237] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:47.163323 16518 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:47.221000 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.164812 16547 raft_consensus.cc:697] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:47.229378 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:47.230696 13829 raft_consensus.cc:2410] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:10:47.101135 16512 consensus_queue.cc:260] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:47.244674 13755 consensus_meta.cc:287] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.514s	user 0.008s	sys 0.000s
I20260709 12:10:47.245435 13755 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 6.
W20260709 12:10:46.809998 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 45745.3us
I20260709 12:10:47.251950 16469 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:47.226085 16475 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:47.274986 13832 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.007s	sys 0.007s
W20260709 12:10:47.304020 13832 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.007s	sys 0.007s
I20260709 12:10:47.275686 13831 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 8.
W20260709 12:10:47.281088 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.284523 13755 raft_consensus.cc:1275] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:47.307051 13755 raft_consensus.cc:1240] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:47.222747 16447 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:47.288894 13800 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:47.215690 16258 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:47.312458 13800 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:47.325340 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:47.314975 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:10:47.335923 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.227133 16194 consensus_queue.cc:237] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:47.256562 16393 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:47.358155 13651 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.015s	sys 0.056s
W20260709 12:10:47.359234 13651 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.016s	sys 0.056s
W20260709 12:10:47.359747 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 710266us
I20260709 12:10:47.363484 13651 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:47.366114 13651 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:47.314103 16512 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:47.370965 13652 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.703s	user 0.021s	sys 0.012s
I20260709 12:10:47.376269 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:10:47.377175 13652 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.021s	sys 0.012s
I20260709 12:10:47.377403 13682 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 4.
W20260709 12:10:47.371287 13653 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.720s	user 0.016s	sys 0.016s
W20260709 12:10:47.378784 13653 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.017s	sys 0.017s
I20260709 12:10:47.379269 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:47.380080 13682 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 5.
W20260709 12:10:47.380623 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 772842us
I20260709 12:10:47.382804 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:10:47.383508 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 71150.9us
I20260709 12:10:47.383661 13682 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 6.
I20260709 12:10:47.385679 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:47.386660 13682 raft_consensus.cc:2468] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 3.
W20260709 12:10:47.388244 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 491881us
I20260709 12:10:47.384245 13800 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:47.390678 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:47.391582 13831 raft_consensus.cc:2393] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 7: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:47.399119 13683 raft_consensus.cc:1240] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 4 LEADER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:47.316035 16430 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.005s	sys 0.018s
I20260709 12:10:47.402107 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:47.314400 16469 consensus_queue.cc:1048] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 12:10:47.404549 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:47.407604 13727 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:47.410319 13681 raft_consensus.cc:1240] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 6 LEADER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:47.413941 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:47.414691 13688 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 8.
W20260709 12:10:47.415740 13726 connection.cc:256] RPC call timeout handler was delayed by -1.1315451560001293s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2025s for a response
I20260709 12:10:47.415679 13682 raft_consensus.cc:1217] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 5 LEADER]: Deduplicated request from leader. Original: 1.1->[2.2-4.3]   Dedup: 2.2->[4.3-4.3]
I20260709 12:10:47.420812 13682 raft_consensus.cc:1240] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 5 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 12:10:47.382354 16473 raft_consensus.cc:2804] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:47.378360 16611 raft_consensus.cc:2804] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:10:47.406579 16430 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.005s	sys 0.019s
I20260709 12:10:47.431762 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:47.424172 13800 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:47.388801 16497 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:10:47.430785 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.406646 16423 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.372893 16475 consensus_queue.cc:1048] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 12:10:47.415395 16450 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.424243 16545 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:47.441283 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:10:47.443238 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 66931.6us
I20260709 12:10:47.429953 16485 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.450380 16622 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.431859 16611 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:47.374951 16547 consensus_queue.cc:237] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:47.426739 16466 consensus_queue.cc:1048] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:10:47.464406 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:47.452525 13680 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 5.
I20260709 12:10:47.420657 16322 consensus_queue.cc:1048] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:10:47.434715 16613 raft_consensus.cc:2764] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 12:10:47.453210 16609 log.cc:927] Time spent T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
I20260709 12:10:47.451103 16545 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:47.469409 16430 consensus_queue.cc:1059] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:10:47.484754 16608 consensus_queue.cc:1048] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:10:47.493299 16608 consensus_queue.cc:1243] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer ca9fbbc2c0a94897897d502d42f3951f log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:10:47.469632 16611 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:47.494907 16322 consensus_queue.cc:1048] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:47.495597 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:47.461094 16628 raft_consensus.cc:2804] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:47.503542 16628 raft_consensus.cc:697] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 7 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:47.504540 16628 consensus_queue.cc:237] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:47.440939 16423 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:47.506304 16258 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:10:47.506973 16616 log.cc:927] Time spent T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 12:10:47.507588 16447 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:47.446214 16569 consensus_queue.cc:1048] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:10:47.484050 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:47.461328 16497 raft_consensus.cc:2804] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:47.451512 16487 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:47.461902 16537 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.507872 16423 leader_election.cc:290] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:47.523885 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:47.454651 16450 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:47.532477 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:47.536839 13680 raft_consensus.cc:2410] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:47.535509 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:47.539315 13834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 2048) took 1928 ms. Trace:
I20260709 12:10:47.543102 13680 raft_consensus.cc:3055] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:47.543891 13680 raft_consensus.cc:740] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:47.466272 16485 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:47.444675 16602 consensus_queue.cc:1048] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.077s
I20260709 12:10:47.469281 16624 raft_consensus.cc:2804] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:47.512050 16545 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:47.540048 13834 rpcz_store.cc:276] 0709 12:10:45.611409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.054663 (+443254us) service_pool.cc:224] Handling call
0709 12:10:46.082880 (+ 28217us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:46.290890 (+208010us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:46.290919 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:46.291479 (+   560us) log.cc:844] Serialized 26 byte log entry
0709 12:10:47.299053 (+1007574us) spinlock_profiling.cc:243] Waited 4.48 ms on lock 0x7b180047cd40. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e82e07 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9fc02 00007fa927b2720b 00007fa927b2cd23 00007fa927b2d0d1 00007fa927f48a0f
0709 12:10:47.440185 (+141132us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:47.440232 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.440338 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:47.513192 (+ 72854us) raft_consensus.cc:1685] finished
0709 12:10:47.513226 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:47.539238 (+ 26012us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":207756,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":4691,"spinlock_wait_cycles":10293120,"thread_start_us":348526,"threads_started":2,"wal-append.queue_time_us":1184852}
W20260709 12:10:47.564553 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 121593us
I20260709 12:10:47.483052 15925 consensus_queue.cc:1048] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 12:10:47.522130 16497 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:47.533670 16430 consensus_queue.cc:1243] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer b98d2519bb504dc6905ed2ede4571835 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:10:47.583841 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:47.584617 13681 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 6.
I20260709 12:10:47.501412 16522 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:47.579818 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 167347us
I20260709 12:10:47.586790 13834 raft_consensus.cc:1275] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:47.590649 13688 raft_consensus.cc:1275] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:47.592114 13652 leader_election.cc:304] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:10:47.582669 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 141018us
I20260709 12:10:47.544960 13680 consensus_queue.cc:260] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:47.593537 13680 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:47.595276 13652 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:47.501288 16465 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:47.484109 16627 consensus_queue.cc:1048] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.100s
I20260709 12:10:47.561625 16624 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:47.474722 16622 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:47.611449 13652 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:47.598994 16447 raft_consensus.cc:2749] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:47.582537 16423 consensus_queue.cc:1059] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
W20260709 12:10:47.618769 13836 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35422 (request call id 447) took 1995 ms (client timeout 1938 ms). Trace:
I20260709 12:10:47.603492 13834 raft_consensus.cc:1275] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:10:47.607879 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.583433 16497 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:47.618907 13828 raft_consensus.cc:1240] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
W20260709 12:10:47.619259 13836 rpcz_store.cc:269] 0709 12:10:45.623201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.700549 (+ 77348us) service_pool.cc:224] Handling call
0709 12:10:47.618541 (+1917992us) spinlock_profiling.cc:243] Waited 750 ms on lock 0x7b54000b27d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:47.618696 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1724003200}
W20260709 12:10:47.612123 16632 log.cc:927] Time spent T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 12:10:47.530738 16537 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:47.601735 16475 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:47.601854 16450 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:47.644292 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 221633us
I20260709 12:10:47.613101 16624 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:47.609157 16473 raft_consensus.cc:697] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 8 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:47.609184 16619 consensus_queue.cc:1048] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
W20260709 12:10:47.643884 16422 consensus_meta.cc:287] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.958s	user 0.007s	sys 0.007s
I20260709 12:10:47.645751 16447 raft_consensus.cc:2804] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:10:47.603185 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 186171us
I20260709 12:10:47.708578 13727 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:47.643752 16423 consensus_queue.cc:1243] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer b98d2519bb504dc6905ed2ede4571835 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:10:47.686827 16473 consensus_queue.cc:237] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:47.647382 16620 log.cc:927] Time spent T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:10:47.647797 16634 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:47.694355 13800 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:47.696183 16636 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.623999 16530 consensus_queue.cc:1048] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:10:47.716009 13800 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:10:47.723798 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:47.720966 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 55283.1us
I20260709 12:10:47.727001 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:47.721165 13800 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:47.729410 13754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2068) took 1962 ms. Trace:
I20260709 12:10:47.726238 13726 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:47.699048 16522 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:47.709167 16450 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.729001 13800 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:47.729955 13754 rpcz_store.cc:276] 0709 12:10:45.766677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.282953 (+516276us) service_pool.cc:224] Handling call
0709 12:10:46.283166 (+   213us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:46.283475 (+   309us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:46.283498 (+    23us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:46.287589 (+  4091us) log.cc:844] Serialized 52 byte log entry
0709 12:10:47.448848 (+1161259us) spinlock_profiling.cc:243] Waited 1.17 ms on lock 0x7b180019c180. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e82e07 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9fc02 00007fa927b2720b 00007fa927b2cd23 00007fa927b2d0d1 00007fa927f48a0f
0709 12:10:47.468529 (+ 19681us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:47.468594 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.469048 (+   454us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:47.729083 (+260035us) raft_consensus.cc:1685] finished
0709 12:10:47.729101 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:47.729329 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3529,"raft.queue_time_us":1988,"raft.run_cpu_time_us":391,"raft.run_wall_time_us":30297,"spinlock_wait_cycles":2687872,"thread_start_us":19398,"threads_started":1,"wal-append.queue_time_us":1232329}
I20260709 12:10:47.735328 13800 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:47.735587 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:47.719614 16641 raft_consensus.cc:2749] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:47.716941 16455 raft_consensus.cc:2804] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:10:47.722551 16575 consensus_meta.cc:287] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.924s	user 0.012s	sys 0.000s
I20260709 12:10:47.774355 14413 raft_consensus.cc:1275] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:47.736413 13800 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:47.762856 13680 raft_consensus.cc:1275] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 12:10:47.721547 16617 log.cc:927] Time spent T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.256s	user 0.001s	sys 0.000s
I20260709 12:10:47.734742 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:47.767215 16466 raft_consensus.cc:2749] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:47.768723 16455 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:47.768885 16450 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:47.723058 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:47.771078 16622 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:47.737342 16645 raft_consensus.cc:2804] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:47.792953 16455 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:47.804119 16645 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:47.804244 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:47.804631 16645 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:47.805392 16625 log.cc:927] Time spent T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
I20260709 12:10:47.728415 16639 consensus_queue.cc:1048] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.083s
I20260709 12:10:47.761523 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:47.807619 13834 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:47.724913 16613 raft_consensus.cc:2804] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:47.809391 16613 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:47.774008 16487 raft_consensus.cc:2804] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:47.814283 16487 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:10:47.814415 16604 log.cc:927] Time spent T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 1.001s	user 0.012s	sys 0.009s
I20260709 12:10:47.814780 16487 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:47.815842 13686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1320) took 2948 ms. Trace:
I20260709 12:10:47.799957 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:47.816243 13686 rpcz_store.cc:276] 0709 12:10:44.867770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.069009 (+201239us) service_pool.cc:224] Handling call
0709 12:10:45.069541 (+   532us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:45.192616 (+123075us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:45.192646 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:46.522407 (+1329761us) spinlock_profiling.cc:243] Waited 15.1 ms on lock 0x7b2c000014c8. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa926886a11 00007fa926896372 00007fa927fc8a01 00007fa927f8d43a 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2
0709 12:10:46.531422 (+  9015us) log.cc:844] Serialized 26 byte log entry
0709 12:10:46.681535 (+150113us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:46.681586 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:46.681678 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:47.813827 (+1132149us) spinlock_profiling.cc:243] Waited 6.98 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:10:47.815597 (+  1770us) raft_consensus.cc:1685] finished
0709 12:10:47.815617 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:47.815781 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81358,"raft.queue_time_us":83057,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":8999,"spinlock_wait_cycles":50728704,"thread_start_us":75485,"threads_started":1,"wal-append.queue_time_us":146609}
I20260709 12:10:47.789397 16575 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:47.715754 16422 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:47.818701 15941 raft_consensus.cc:3055] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:47.819187 15941 raft_consensus.cc:740] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:47.820013 15941 consensus_queue.cc:260] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:47.805747 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:47.821570 13679 raft_consensus.cc:1240] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 6. Current term is 7. Ops: []
W20260709 12:10:47.788151 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 51815.8us
I20260709 12:10:47.790022 14412 raft_consensus.cc:2410] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:10:47.822603 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:47.823572 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:47.823854 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:47.773957 16469 raft_consensus.cc:2804] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:47.809798 16613 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:47.723961 16636 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:47.721092 16634 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:47.817878 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:47.820425 16422 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:47.800606 16641 raft_consensus.cc:2804] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:47.757378 16619 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:48.182432 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 456175us
I20260709 12:10:47.826503 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:47.848635 13834 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 6.
I20260709 12:10:47.828197 13830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 2015) took 3794 ms. Trace:
I20260709 12:10:47.828634 14410 raft_consensus.cc:3055] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:47.823611 13800 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:48.187143 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:48.208950 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:48.212204 13760 raft_consensus.cc:3060] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:48.208662 13726 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
W20260709 12:10:47.824013 13801 leader_election.cc:336] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Timed out: RequestConsensusVote RPC to 127.12.56.196:46341 timed out after 2.138s (SENT)
I20260709 12:10:48.216369 13801 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:48.210469 14410 raft_consensus.cc:740] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
W20260709 12:10:47.829748 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.210255 13830 rpcz_store.cc:276] 0709 12:10:44.033967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.124631 (+ 90664us) service_pool.cc:224] Handling call
0709 12:10:44.143287 (+ 18656us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:46.766476 (+2623189us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.827860 (+1061384us) spinlock_profiling.cc:243] Waited 2.62 s on lock 0x7b54000d9b54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:47.828054 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6024058624}
W20260709 12:10:48.220628 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:47.824838 16635 log.cc:927] Time spent T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.169s	user 0.000s	sys 0.000s
W20260709 12:10:48.172003 16497 consensus_meta.cc:287] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.528s	user 0.004s	sys 0.005s
I20260709 12:10:48.224599 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:10:48.179273 16518 consensus_meta.cc:287] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.947s	user 0.010s	sys 0.001s
I20260709 12:10:48.214133 15941 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:48.203873 16430 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.821588 16393 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:48.227540 16634 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:47.918856 16625 log.cc:927] Time spent T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:10:48.257723 13832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 2098) took 3800 ms. Trace:
W20260709 12:10:48.230975 13651 leader_election.cc:336] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Timed out: RequestConsensusVote RPC to 127.12.56.194:39545 timed out after 1.725s (SENT)
I20260709 12:10:48.241472 13652 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:48.258196 13832 rpcz_store.cc:276] 0709 12:10:44.456944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.398711 (+941767us) service_pool.cc:224] Handling call
0709 12:10:45.422542 (+ 23831us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:45.422930 (+   388us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:46.642997 (+1220067us) spinlock_profiling.cc:243] Waited 4.41 ms on lock 0x7b18002bcd80. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e82e07 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9d455 00007fa92b9853c7 00007fa927f979a7 00007fa927fa70bf 00007fa927fa7038
0709 12:10:47.304582 (+661585us) log.cc:844] Serialized 14 byte log entry
0709 12:10:47.464580 (+159998us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:47.465130 (+   550us) log.cc:844] Serialized 26 byte log entry
0709 12:10:47.465356 (+   226us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:47.468664 (+  3308us) log.cc:844] Serialized 14 byte log entry
0709 12:10:47.724509 (+255845us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.725338 (+   829us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:48.257525 (+532187us) raft_consensus.cc:1685] finished
0709 12:10:48.257547 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:48.257664 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6768,"prepare.queue_time_us":144195,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":74,"raft.queue_time_us":57980,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":36957,"spinlock_wait_cycles":87953792,"thread_start_us":999388,"threads_started":3,"wal-append.queue_time_us":247062}
I20260709 12:10:48.222534 14410 consensus_queue.cc:260] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:48.209985 14380 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:48.262321 13651 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:10:48.262466 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 52575us
W20260709 12:10:48.215508 16611 consensus_meta.cc:287] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.721s	user 0.012s	sys 0.000s
W20260709 12:10:48.200379 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.268103 14380 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:48.192786 14409 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:48.270327 16636 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:48.180665 16260 consensus_meta.cc:287] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 1.408s	user 0.013s	sys 0.000s
I20260709 12:10:47.811614 16485 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:47.831360 16450 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:47.893402 16449 raft_consensus.cc:3055] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:48.221515 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:48.297886 14412 raft_consensus.cc:2376] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 7. Re-sending same reply.
I20260709 12:10:48.299161 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:48.300184 14412 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 8.
I20260709 12:10:48.301292 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:48.207700 16641 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:48.265946 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:48.270424 16634 raft_consensus.cc:2749] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:48.224927 16575 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 6 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199)
I20260709 12:10:48.271498 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:48.332472 13763 raft_consensus.cc:2410] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:10:48.272436 16557 raft_consensus.cc:2749] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:48.207526 16469 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:47.975195 16465 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:10:48.280335 16624 consensus_meta.cc:287] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.590s	user 0.008s	sys 0.002s
I20260709 12:10:48.215942 13726 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
W20260709 12:10:48.283689 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.242358 13760 raft_consensus.cc:2468] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 6.
I20260709 12:10:48.303917 14413 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 5.
I20260709 12:10:48.222314 16622 raft_consensus.cc:2749] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:47.971933 16537 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:48.306989 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
W20260709 12:10:48.305433 16512 consensus_meta.cc:287] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.919s	user 0.006s	sys 0.006s
W20260709 12:10:48.305068 16447 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.016s	sys 0.029s
W20260709 12:10:48.360499 16447 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.016s	sys 0.030s
I20260709 12:10:48.360904 16447 raft_consensus.cc:697] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 8 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:48.362123 16447 consensus_queue.cc:237] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:48.368423 16545 consensus_meta.cc:287] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.786s	user 0.007s	sys 0.003s
I20260709 12:10:48.368930 16545 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:48.252703 16497 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:48.372088 16497 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:48.267902 16518 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:48.219751 16530 consensus_queue.cc:1048] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.087s
I20260709 12:10:48.306589 16260 raft_consensus.cc:2749] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:48.330173 16407 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:48.339814 16473 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.026s	sys 0.047s
I20260709 12:10:48.305299 16641 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:48.218595 16619 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:48.302281 16449 raft_consensus.cc:740] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:48.348560 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:48.273396 16418 raft_consensus.cc:2749] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:10:48.386672 13727 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.006s	sys 0.008s
W20260709 12:10:48.387153 13727 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.006s	sys 0.008s
W20260709 12:10:48.374892 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 159066us
I20260709 12:10:48.375376 13832 raft_consensus.cc:1240] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:48.376533 14412 raft_consensus.cc:2410] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 12:10:48.312034 14416 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.010s	sys 0.020s
W20260709 12:10:48.390837 14416 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.011s	sys 0.020s
I20260709 12:10:48.392823 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
W20260709 12:10:48.377897 14414 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.005s	sys 0.014s
I20260709 12:10:48.379123 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:10:48.382841 16473 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.028s	sys 0.047s
I20260709 12:10:48.374653 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:48.346124 16469 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:48.276211 16577 consensus_queue.cc:1059] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 12:10:48.372910 16497 raft_consensus.cc:2804] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:48.274470 16430 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:48.276420 16580 consensus_queue.cc:1059] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.098s
I20260709 12:10:48.385103 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:48.430073 13760 raft_consensus.cc:2393] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 6: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
W20260709 12:10:48.395912 14414 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.005s	sys 0.015s
I20260709 12:10:48.276842 16611 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:48.358081 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:10:48.402328 16637 log.cc:927] Time spent T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 12:10:48.411837 16545 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:10:48.412945 16455 consensus_meta.cc:287] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.609s	user 0.005s	sys 0.002s
I20260709 12:10:48.380712 16622 raft_consensus.cc:2749] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:48.413877 16475 consensus_meta.cc:287] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.733s	user 0.011s	sys 0.001s
I20260709 12:10:48.414217 14409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 710) took 2777 ms. Trace:
I20260709 12:10:48.382129 16518 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:48.383780 14411 raft_consensus.cc:1240] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 1. Current term is 2. Ops: []
W20260709 12:10:48.400707 16487 consensus_meta.cc:287] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.585s	user 0.003s	sys 0.008s
I20260709 12:10:48.356813 16624 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:48.431933 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
W20260709 12:10:48.423352 16443 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 12:10:48.435643 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
W20260709 12:10:48.427649 16194 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.017s	sys 0.015s
I20260709 12:10:48.423273 16497 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:48.427855 14408 raft_consensus.cc:2468] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 4.
I20260709 12:10:48.389611 13726 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:10:48.571369 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 303125us
I20260709 12:10:48.520098 14416 raft_consensus.cc:2393] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 6: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
W20260709 12:10:48.433631 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 610009us
I20260709 12:10:48.573596 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:48.616355 16663 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.617657 16663 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:48.618397 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:48.619326 13763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38932 (request call id 402) took 1028 ms. Trace:
I20260709 12:10:48.619729 13763 rpcz_store.cc:276] 0709 12:10:47.590473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.617972 (+1027499us) service_pool.cc:224] Handling call
0709 12:10:48.619239 (+  1267us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:48.616354 14416 raft_consensus.cc:3055] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:48.621364 14416 raft_consensus.cc:740] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:48.434942 16450 raft_consensus.cc:3060] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:48.444845 16455 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:48.625456 14416 consensus_queue.cc:260] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:48.646426 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:48.647449 13837 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 6.
I20260709 12:10:48.648981 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:48.650843 14416 raft_consensus.cc:3060] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:48.652388 13755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 400) took 1463 ms. Trace:
I20260709 12:10:48.533143 16641 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:48.576412 13685 raft_consensus.cc:2393] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 11: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:48.433467 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:10:48.530323 16645 consensus_meta.cc:287] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.725s	user 0.013s	sys 0.000s
I20260709 12:10:48.672717 16430 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:48.673468 16645 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:48.445902 16475 raft_consensus.cc:2749] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:48.434995 16628 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.785s	user 0.008s	sys 0.008s
I20260709 12:10:48.467805 16659 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.534580 16611 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:48.535615 16619 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:48.436842 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 612804us
I20260709 12:10:48.520540 16497 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:48.446998 16658 raft_consensus.cc:2749] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:48.537675 16624 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:48.533043 16613 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:48.473448 14413 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:48.435024 16627 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.001s	sys 0.014s
W20260709 12:10:48.519596 16194 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.017s	sys 0.022s
I20260709 12:10:48.474568 16487 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:48.468561 14409 rpcz_store.cc:276] 0709 12:10:45.636708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.642291 (+  5583us) service_pool.cc:224] Handling call
0709 12:10:45.882857 (+240566us) spinlock_profiling.cc:243] Waited 2.31 ms on lock 0x7b5800003c98. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924e68b71 00007fa924e68a22 00007fa92dd818d9 00007fa92cedbee0 00007fa92cfa50ab 00007fa92cfa5131 00007fa92cf66fc0 00007fa92cf51929 00007fa92cf513d2 00007fa9264c8bd4
0709 12:10:45.883168 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:46.475463 (+592295us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b54005e1620. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f0b06f 00007fa927f83f60 00007fa927f857de 00007fa927f8fb49 00007fa927f90416 00007fa927f8cd8f 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62
0709 12:10:47.817920 (+1342457us) spinlock_profiling.cc:243] Waited 94.1 ms on lock 0x7b54005e1620. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f02a1d 00007fa927ee91a4 00007fa927f6b447 00007fa927f83fe7 00007fa927f857de 00007fa927f8fb49 00007fa927f90416 00007fa927f8cd8f 00007fa927f8c83e 00007fa92cf51419
0709 12:10:48.412773 (+594853us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:48.412833 (+    60us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:48.412889 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:48.412937 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.413015 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:48.413160 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":137,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":103,"spinlock_wait_cycles":494201600}
I20260709 12:10:48.521097 16423 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:48.595950 14414 pending_rounds.cc:85] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f: Aborting all ops after (but not including) 5
I20260709 12:10:48.598515 13679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 423) took 2012 ms. Trace:
I20260709 12:10:48.602908 13687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2030) took 2358 ms. Trace:
I20260709 12:10:48.601514 13683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2031) took 1197 ms. Trace:
W20260709 12:10:48.604987 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 230095us
I20260709 12:10:48.605937 13761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2088) took 2062 ms. Trace:
I20260709 12:10:48.621158 13763 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:10:48.470340 16449 consensus_queue.cc:260] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:48.637494 13759 raft_consensus.cc:1240] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 12:10:48.650897 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.625324 16455 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:10:48.665853 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 276156us
I20260709 12:10:48.668480 16568 raft_consensus.cc:3055] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:10:48.678541 16628 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.030s	user 0.009s	sys 0.008s
I20260709 12:10:48.679289 16659 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:48.684473 14412 raft_consensus.cc:1240] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:48.685467 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:48.711081 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:48.744046 13687 rpcz_store.cc:276] 0709 12:10:46.244849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.245047 (+   198us) service_pool.cc:224] Handling call
0709 12:10:46.259198 (+ 14151us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:46.461762 (+202564us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.602272 (+2140510us) spinlock_profiling.cc:243] Waited 199 ms on lock 0x7b54002459d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:48.602695 (+   423us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":458147712}
I20260709 12:10:48.693308 16613 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:48.709342 13762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48114 (request call id 2087) took 2187 ms. Trace:
I20260709 12:10:48.712729 13837 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 6.
I20260709 12:10:48.691130 13834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 2136) took 1835 ms. Trace:
I20260709 12:10:48.713893 16487 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:48.677124 16645 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:48.714789 13830 raft_consensus.cc:1240] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:48.721084 16539 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:48.726958 16590 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:10:48.736740 15941 consensus_meta.cc:287] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.509s	user 0.014s	sys 0.004s
W20260709 12:10:48.698282 16627 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.807s	user 0.001s	sys 0.015s
I20260709 12:10:48.744608 13683 rpcz_store.cc:276] 0709 12:10:47.404135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.404294 (+   159us) service_pool.cc:224] Handling call
0709 12:10:48.600751 (+1196457us) spinlock_profiling.cc:243] Waited 999 ms on lock 0x7b54002bf7d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:48.601216 (+   465us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2296722304}
I20260709 12:10:48.743386 14414 pending_rounds.cc:107] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 12:10:48.755365 13759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2100) took 1336 ms. Trace:
I20260709 12:10:48.680971 16663 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:48.743462 13679 rpcz_store.cc:276] 0709 12:10:46.586141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.587031 (+   890us) service_pool.cc:224] Handling call
0709 12:10:46.587423 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:47.822012 (+1234589us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.597727 (+775715us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54002850d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:48.598189 (+   462us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2837842176}
I20260709 12:10:48.782780 16350 consensus_queue.cc:1048] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 12:10:48.755090 16568 raft_consensus.cc:740] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:48.776134 13762 rpcz_store.cc:276] 0709 12:10:46.521320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.828659 (+307339us) service_pool.cc:224] Handling call
0709 12:10:48.708853 (+1880194us) spinlock_profiling.cc:243] Waited 1.84 s on lock 0x7b54003930d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:48.709106 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4238289792}
I20260709 12:10:48.799998 13759 rpcz_store.cc:276] 0709 12:10:47.415005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.636403 (+1221398us) service_pool.cc:224] Handling call
0709 12:10:48.636967 (+   564us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:48.748245 (+111278us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.750907 (+  2662us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:48.785941 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:48.812212 14409 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:48.805011 16423 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:48.799825 14414 raft_consensus.cc:2889] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:48.786239 16624 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:48.802148 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 170468us
I20260709 12:10:48.797819 13763 raft_consensus.cc:606] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:48.824039 13763 raft_consensus.cc:614] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:48.652947 13755 rpcz_store.cc:276] 0709 12:10:47.189161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.322810 (+133649us) service_pool.cc:224] Handling call
0709 12:10:47.323197 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:47.323463 (+   266us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:10:47.352565 (+ 29102us) log.cc:844] Serialized 14 byte log entry
0709 12:10:47.360981 (+  8416us) log.cc:844] Serialized 14 byte log entry
0709 12:10:48.500997 (+1140016us) spinlock_profiling.cc:243] Waited 7.01 ms on lock 0x7b18004591c0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924ea0522 00007fa924ea27c1 00007fa924ea2779 00007fa924ea2709 00007fa924ea26d1 00007fa924ea19cd 0000000000388634 0000000000388479 00007fa924e8383a
0709 12:10:48.651000 (+150003us) spinlock_profiling.cc:243] Waited 6.22 ms on lock 0x7b18004591c0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e1ac0a 00007fa92e55a219 00007fa927b43d70 00007fa927b37293 00007fa927b2ccea 00007fa927b2d23a 00007fa927f97a2a 00007fa927fa70bf 00007fa927fa7038
0709 12:10:48.651518 (+   518us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:48.651623 (+   105us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:48.651724 (+   101us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.651835 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:48.652159 (+   324us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8491,"prepare.queue_time_us":1195821,"prepare.run_cpu_time_us":735,"prepare.run_wall_time_us":1606,"raft.queue_time_us":5248,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":8879,"spinlock_wait_cycles":30428416}
I20260709 12:10:48.801973 16636 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:48.848073 16641 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:48.848606 16640 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.849826 13756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2098) took 1469 ms. Trace:
I20260709 12:10:48.776934 13834 rpcz_store.cc:276] 0709 12:10:46.855812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.219719 (+1363907us) service_pool.cc:224] Handling call
0709 12:10:48.220066 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:48.425620 (+205554us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:48.425652 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:48.426292 (+   640us) log.cc:844] Serialized 26 byte log entry
0709 12:10:48.690394 (+264102us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:48.690489 (+    95us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.690619 (+   130us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:48.690667 (+    48us) raft_consensus.cc:1685] finished
0709 12:10:48.690686 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:48.690898 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":247086,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":124,"thread_start_us":450572,"threads_started":2,"wal-append.queue_time_us":103522}
I20260709 12:10:48.864437 16636 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:48.865859 13685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2032) took 1461 ms. Trace:
I20260709 12:10:48.866433 13685 rpcz_store.cc:276] 0709 12:10:47.404529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.404663 (+   134us) service_pool.cc:224] Handling call
0709 12:10:48.865554 (+1460891us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54003f11d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:48.865760 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2627418496}
I20260709 12:10:48.849584 16640 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:48.745524 13761 rpcz_store.cc:276] 0709 12:10:46.542074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.895861 (+353787us) service_pool.cc:224] Handling call
0709 12:10:46.896312 (+   451us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:47.025872 (+129560us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:47.025904 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:48.271947 (+1246043us) spinlock_profiling.cc:243] Waited 2.85 ms on lock 0x7b2c00010828. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa926886a11 00007fa926896372 00007fa927fc8a01 00007fa927f8d43a 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2
0709 12:10:48.272461 (+   514us) log.cc:844] Serialized 26 byte log entry
0709 12:10:48.434913 (+162452us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:48.434960 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.435043 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:48.602653 (+167610us) raft_consensus.cc:1685] finished
0709 12:10:48.602707 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:48.603226 (+   519us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":89224,"raft.queue_time_us":107386,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":2784,"spinlock_wait_cycles":6553472,"thread_start_us":162028,"threads_started":1,"wal-append.queue_time_us":197918}
I20260709 12:10:48.872287 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:48.849668 16659 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:48.886283 16403 raft_consensus.cc:2749] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:48.887348 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:48.890803 13837 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:48.892843 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:10:48.899871 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.850230 16518 consensus_queue.cc:1048] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.103s
I20260709 12:10:48.902521 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
W20260709 12:10:48.904349 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 53350us
W20260709 12:10:48.904629 13651 leader_election.cc:336] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Timed out: RequestConsensusVote RPC to 127.12.56.194:39545 timed out after 2.031s (SENT)
I20260709 12:10:48.906599 13800 leader_election.cc:304] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:48.907542 16608 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.908529 16608 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:48.909193 16529 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.910471 16480 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:48.911285 16450 raft_consensus.cc:2749] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:48.828151 16648 consensus_queue.cc:1048] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.090s
I20260709 12:10:48.914287 16529 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:48.916182 13762 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 5.
I20260709 12:10:48.917265 16529 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:48.917632 16498 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:48.918670 13762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 401) took 1483 ms. Trace:
I20260709 12:10:48.919150 13762 rpcz_store.cc:276] 0709 12:10:47.435227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.917109 (+1481882us) service_pool.cc:224] Handling call
0709 12:10:48.917526 (+   417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:48.918087 (+   561us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:48.918123 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:48.918220 (+    97us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:48.918291 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.918394 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:48.918586 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:48.931857 13755 raft_consensus.cc:2393] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 6: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:48.878966 16613 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:48.944566 13759 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:48.850240 13756 rpcz_store.cc:276] 0709 12:10:47.380695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.496550 (+115855us) service_pool.cc:224] Handling call
0709 12:10:47.496925 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:47.497282 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:47.497309 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:47.514236 (+ 16927us) log.cc:844] Serialized 26 byte log entry
0709 12:10:48.848714 (+1334478us) spinlock_profiling.cc:243] Waited 1.12 ms on lock 0x7b18003f9fa0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa927b354bc 00007fa924e8348b 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9fc02 00007fa927b2720b 00007fa927b2cd23 00007fa927b2d0d1
0709 12:10:48.849181 (+   467us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:48.849238 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.849357 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:48.849401 (+    44us) raft_consensus.cc:1685] finished
0709 12:10:48.849419 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:48.849638 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":25361,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":9342,"spinlock_wait_cycles":2578304,"thread_start_us":32796,"threads_started":1,"wal-append.queue_time_us":97919,"wal-append.run_cpu_time_us":4027,"wal-append.run_wall_time_us":1082010}
W20260709 12:10:48.947583 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 46131.9us
I20260709 12:10:48.956761 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:48.896251 16624 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:48.971894 16628 raft_consensus.cc:2749] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:48.972930 16469 consensus_meta.cc:287] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.544s	user 0.029s	sys 0.005s
I20260709 12:10:48.973510 16469 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:48.976626 16469 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:10:48.977576 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:48.978689 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:48.979444 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:48.980041 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:48.980716 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.984675 13760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2101) took 1563 ms. Trace:
I20260709 12:10:48.985520 13760 rpcz_store.cc:276] 0709 12:10:47.421008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.676222 (+1255214us) service_pool.cc:224] Handling call
0709 12:10:48.676703 (+   481us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:48.677324 (+   621us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:48.677355 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:48.710636 (+ 33281us) log.cc:844] Serialized 26 byte log entry
0709 12:10:48.837119 (+126483us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:48.837184 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.837296 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:48.984226 (+146930us) raft_consensus.cc:1685] finished
0709 12:10:48.984248 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:48.984443 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4052,"raft.run_cpu_time_us":351,"raft.run_wall_time_us":339,"thread_start_us":125694,"threads_started":1,"wal-append.queue_time_us":228857}
I20260709 12:10:48.987231 16640 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:48.987865 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:48.995594 13755 raft_consensus.cc:1275] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:48.996513 13755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2106) took 1414 ms. Trace:
I20260709 12:10:48.996891 13755 rpcz_store.cc:276] 0709 12:10:47.581767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.944248 (+1362481us) service_pool.cc:224] Handling call
0709 12:10:48.995008 (+ 50760us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:48.996143 (+  1135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.996415 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:49.000298 16659 consensus_queue.cc:1048] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:49.001230 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:49.011260 13837 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 7.
I20260709 12:10:49.014189 16468 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:49.014501 15941 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.015144 16468 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:49.016247 16518 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:49.017475 16642 log.cc:927] Time spent T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 1.332s	user 0.000s	sys 0.010s
I20260709 12:10:49.017059 16518 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:49.022311 13835 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54820 (request call id 2131) took 2242 ms (client timeout 2097 ms). Trace:
I20260709 12:10:49.023772 13831 raft_consensus.cc:1275] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:49.023927 16449 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:49.015187 15941 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:48.967057 16648 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.011075 13801 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:49.051800 13761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2102) took 1615 ms. Trace:
W20260709 12:10:49.056169 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 64718.7us
I20260709 12:10:49.057675 14413 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 8.
W20260709 12:10:49.031669 13835 rpcz_store.cc:269] 0709 12:10:46.779249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.897800 (+118551us) service_pool.cc:224] Handling call
0709 12:10:49.013722 (+2115922us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b54001676d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:49.022042 (+  8320us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":263786752}
I20260709 12:10:49.065008 13763 raft_consensus.cc:1240] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 1. Current term is 2. Ops: []
W20260709 12:10:49.066062 14380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.030838 16469 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.065184 13726 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:49.068099 13830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 2138) took 2095 ms. Trace:
I20260709 12:10:49.069075 13834 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 7.
I20260709 12:10:49.075861 16468 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:49.076028 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:49.076975 13835 raft_consensus.cc:1240] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:10:49.077399 13758 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "b98d2519bb504dc6905ed2ede4571835"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:10:49.077819 13835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 2141) took 1858 ms. Trace:
I20260709 12:10:49.078243 13835 rpcz_store.cc:276] 0709 12:10:47.220239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.076120 (+1855881us) service_pool.cc:224] Handling call
0709 12:10:49.076664 (+   544us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:49.077465 (+   801us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.077725 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:49.082862 16648 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:49.085942 16668 log.cc:927] Time spent T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.325s	user 0.002s	sys 0.000s
W20260709 12:10:49.086419 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 180056us
I20260709 12:10:49.071612 13830 rpcz_store.cc:276] 0709 12:10:46.966822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.223602 (+1256780us) service_pool.cc:224] Handling call
0709 12:10:48.262803 (+ 39201us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:48.805614 (+542811us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.038870 (+233256us) spinlock_profiling.cc:243] Waited 451 ms on lock 0x7b5400363654. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:49.062034 (+ 23164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1038245120}
I20260709 12:10:49.095106 16469 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:49.097833 16407 consensus_meta.cc:287] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.716s	user 0.017s	sys 0.021s
I20260709 12:10:49.099254 13829 raft_consensus.cc:2410] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:49.086400 16624 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:49.102398 16586 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.103155 16586 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:49.078147 13758 raft_consensus.cc:606] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 LEADER]: Received request to transfer leadership to TS b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:49.106513 16630 raft_consensus.cc:2804] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:49.107146 16630 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:49.107308 16648 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:49.107609 16630 raft_consensus.cc:3060] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:49.110633 13756 raft_consensus.cc:1275] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:10:49.111254 13756 pending_rounds.cc:85] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting all ops after (but not including) 6
I20260709 12:10:49.111543 13756 pending_rounds.cc:107] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:10:49.078276 16636 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:49.111791 13756 raft_consensus.cc:2889] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:49.113031 13755 raft_consensus.cc:1240] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:49.085943 13760 raft_consensus.cc:2376] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 6. Re-sending same reply.
I20260709 12:10:49.071940 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:49.132236 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:49.139842 14416 raft_consensus.cc:1275] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:49.052438 13761 rpcz_store.cc:276] 0709 12:10:47.427643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.910935 (+1483292us) service_pool.cc:224] Handling call
0709 12:10:48.911462 (+   527us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:48.911865 (+   403us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:10:48.912304 (+   439us) log.cc:844] Serialized 14 byte log entry
0709 12:10:49.011380 (+ 99076us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:49.011436 (+    56us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:49.042230 (+ 30794us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.042364 (+   134us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:49.042551 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5880,"prepare.queue_time_us":1430,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":57584,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":224,"thread_start_us":43012,"threads_started":1}
W20260709 12:10:49.143563 16472 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 12:10:49.143424 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:49.144078 16588 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:49.175329 14411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 732) took 1510 ms. Trace:
I20260709 12:10:49.175851 14413 raft_consensus.cc:1240] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:49.176204 14411 rpcz_store.cc:276] 0709 12:10:47.664814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.665899 (+  1085us) service_pool.cc:224] Handling call
0709 12:10:47.697013 (+ 31114us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:48.473422 (+776409us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.174482 (+701060us) spinlock_profiling.cc:243] Waited 680 ms on lock 0x7b5400554954. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:49.175021 (+   539us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1563934592}
I20260709 12:10:49.143962 13800 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:49.145171 15941 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:49.146384 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:49.150049 14410 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:49.152426 13757 raft_consensus.cc:1240] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:49.154002 13652 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:10:49.156517 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 209771us
I20260709 12:10:49.161279 13759 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 11.
W20260709 12:10:49.164672 13829 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54820 (request call id 2133) took 2352 ms (client timeout 2674 ms). Trace:
I20260709 12:10:49.139796 16641 consensus_queue.cc:1048] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:10:49.167588 13727 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:49.170603 16547 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.138440 16469 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:49.210108 13762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2105) took 1629 ms. Trace:
W20260709 12:10:49.194881 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 183921us
I20260709 12:10:49.195531 13831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 2051) took 2433 ms. Trace:
I20260709 12:10:49.196491 16636 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:49.222414 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:49.199039 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:49.223464 13755 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 7.
I20260709 12:10:49.197436 13834 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:49.225165 16618 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.438s	user 0.009s	sys 0.009s
W20260709 12:10:49.225642 16618 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.528s	user 0.009s	sys 0.009s
I20260709 12:10:49.226285 16241 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:49.226989 16241 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:49.227324 13726 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:49.229576 15941 raft_consensus.cc:2749] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:49.203964 16627 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.205078 13651 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:49.211033 16608 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:10:49.208959 13829 rpcz_store.cc:269] 0709 12:10:46.811913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.270254 (+458341us) service_pool.cc:224] Handling call
0709 12:10:49.164406 (+1894152us) spinlock_profiling.cc:243] Waited 1.77 s on lock 0x7b54002a7454. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:49.164589 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4072140032}
I20260709 12:10:49.217995 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:49.215962 13831 rpcz_store.cc:276] 0709 12:10:46.761947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.400302 (+638355us) service_pool.cc:224] Handling call
0709 12:10:49.022967 (+1622665us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:49.031785 (+  8818us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.195245 (+163460us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b54001676d0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:49.195417 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3682550528}
I20260709 12:10:49.220429 13757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2086) took 2699 ms. Trace:
I20260709 12:10:49.141014 16407 raft_consensus.cc:2749] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:49.071455 16613 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:49.222239 16636 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:49.202804 16568 consensus_queue.cc:260] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:49.155563 16497 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:49.237346 13757 rpcz_store.cc:276] 0709 12:10:46.521025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.916035 (+395010us) service_pool.cc:224] Handling call
0709 12:10:46.916493 (+   458us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:49.152052 (+2235559us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b54003c1520. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f04dc0 00007fa927f8f1c0 00007fa927f90231 00007fa927f8cd8f 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c
0709 12:10:49.220046 (+ 67994us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.220346 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":488309632}
I20260709 12:10:49.253639 13837 raft_consensus.cc:2393] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 11: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:49.244213 13834 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 9.
I20260709 12:10:49.246400 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:49.213450 13762 rpcz_store.cc:276] 0709 12:10:47.578659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.920427 (+1341768us) service_pool.cc:224] Handling call
0709 12:10:48.921026 (+   599us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:48.921695 (+   669us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:48.921720 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:48.955562 (+ 33842us) log.cc:844] Serialized 26 byte log entry
0709 12:10:49.059899 (+104337us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:49.059959 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.060071 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:49.181642 (+121571us) raft_consensus.cc:1685] finished
0709 12:10:49.182096 (+   454us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:49.207843 (+ 25747us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24499,"raft.queue_time_us":485,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":191,"thread_start_us":87709,"threads_started":1,"wal-append.queue_time_us":190629}
I20260709 12:10:49.252282 13833 raft_consensus.cc:1275] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:10:49.255787 13833 pending_rounds.cc:85] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 2
I20260709 12:10:49.256083 13833 pending_rounds.cc:107] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:10:49.256309 13833 raft_consensus.cc:2889] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:49.257221 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 124990us
I20260709 12:10:49.230662 16518 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:10:49.266409 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 133373us
I20260709 12:10:49.270195 14410 raft_consensus.cc:1275] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:49.278513 16403 raft_consensus.cc:2804] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:49.279225 16403 raft_consensus.cc:697] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:49.279585 16497 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:49.280534 16403 consensus_queue.cc:237] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:49.281271 16418 raft_consensus.cc:3055] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:49.268359 16568 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:49.263358 16624 raft_consensus.cc:2749] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:49.222232 16630 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:49.273670 13801 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:49.257948 16613 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:10:49.296454 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 152706us
I20260709 12:10:49.230401 16627 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:49.235384 16547 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:49.307451 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:49.272675 15941 consensus_queue.cc:1048] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 12:10:49.276420 16608 raft_consensus.cc:2804] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:49.317911 14410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 720) took 3579 ms. Trace:
I20260709 12:10:49.281816 16418 raft_consensus.cc:740] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:49.319505 14410 rpcz_store.cc:276] 0709 12:10:45.723982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.192583 (+468601us) service_pool.cc:224] Handling call
0709 12:10:46.192917 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:47.828522 (+1635605us) spinlock_profiling.cc:243] Waited 65 ms on lock 0x7b54007f0920. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f04dc0 00007fa927f8f1c0 00007fa927f90231 00007fa927f8cd8f 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c
0709 12:10:49.149521 (+1320999us) spinlock_profiling.cc:243] Waited 469 ms on lock 0x7b5800667dd0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927ee90aa 00007fa927f6b447 00007fa927f83fe7 00007fa927f857de 00007fa927f8fb49 00007fa927f90416 00007fa927f8cd8f 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4
0709 12:10:49.271651 (+122130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.303398 (+ 31747us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1227478144}
I20260709 12:10:49.325596 13828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 2044) took 3789 ms. Trace:
I20260709 12:10:49.293812 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:49.320569 13800 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:49.301334 14408 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 11.
W20260709 12:10:49.337013 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.331933 13727 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:49.326406 13828 rpcz_store.cc:276] 0709 12:10:45.536203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.036562 (+500359us) service_pool.cc:224] Handling call
0709 12:10:47.618668 (+1582106us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:47.619824 (+  1156us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.305699 (+1685875us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b54000b27d0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:49.325379 (+ 19680us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3637751040}
I20260709 12:10:49.318650 16473 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:49.349143 13754 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 7.
I20260709 12:10:49.349984 16526 consensus_queue.cc:1059] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:10:49.351032 16526 raft_consensus.cc:3055] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:49.351441 16526 raft_consensus.cc:740] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:49.352387 16526 consensus_queue.cc:260] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:49.354033 16610 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:49.345636 16571 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 12:10:49.354673 16610 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:49.357241 16610 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:49.337999 16608 raft_consensus.cc:697] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 8 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:49.361899 13727 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:49.320427 16618 consensus_queue.cc:1048] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:10:49.353624 16526 raft_consensus.cc:3060] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:49.368434 16344 raft_consensus.cc:2804] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:49.369006 13831 raft_consensus.cc:1240] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:49.369621 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 164733us
I20260709 12:10:49.369047 13829 raft_consensus.cc:1240] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:10:49.342269 16539 raft_consensus.cc:2749] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:49.380861 16624 raft_consensus.cc:2804] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:49.381067 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 54018.9us
I20260709 12:10:49.381332 13651 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:49.382157 16391 consensus_queue.cc:1048] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:49.384006 16391 raft_consensus.cc:2749] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:49.385121 16473 consensus_queue.cc:1059] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:49.386338 13831 raft_consensus.cc:1240] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:10:49.385185 13829 raft_consensus.cc:1275] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:49.381443 16624 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:49.373859 16344 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
W20260709 12:10:49.389478 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 130780us
I20260709 12:10:49.389665 16344 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:49.390121 13831 raft_consensus.cc:1240] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:49.391060 13801 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:49.391922 15941 raft_consensus.cc:2804] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:49.392494 15941 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:49.392920 15941 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:49.376533 16636 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:49.398082 13651 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:49.378005 16423 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:49.393963 16624 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:49.420076 16619 consensus_queue.cc:1048] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:10:49.425078 16608 consensus_queue.cc:237] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:49.426179 16633 log.cc:927] Time spent T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 1.731s	user 0.005s	sys 0.000s
I20260709 12:10:49.427994 13684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 430) took 2035 ms. Trace:
I20260709 12:10:49.430331 14379 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:10:49.431738 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:49.432261 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:49.432612 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.433272 13726 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:49.430437 13684 rpcz_store.cc:276] 0709 12:10:47.392772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.392927 (+   155us) service_pool.cc:224] Handling call
0709 12:10:47.393596 (+   669us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:47.394054 (+   458us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:47.394094 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:47.415859 (+ 21765us) log.cc:844] Serialized 501 byte log entry
0709 12:10:47.536737 (+120878us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:47.536788 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.536854 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:49.369143 (+1832289us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:10:49.427460 (+ 58317us) raft_consensus.cc:1685] finished
0709 12:10:49.427481 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:49.427819 (+   338us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27983616,"thread_start_us":92698,"threads_started":1,"wal-append.queue_time_us":184166}
I20260709 12:10:49.415112 16613 raft_consensus.cc:2749] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:49.444720 13727 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:49.444000 16592 raft_consensus.cc:2804] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:49.450138 16677 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:49.450740 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 46001.1us
I20260709 12:10:49.450877 16677 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:49.454097 16545 consensus_queue.cc:1048] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:10:49.461565 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 65668.9us
I20260709 12:10:49.453471 16677 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:49.435123 16636 raft_consensus.cc:2749] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:10:49.472230 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 151819us
I20260709 12:10:49.472517 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:10:49.478822 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 50199.2us
W20260709 12:10:49.462455 14409 consensus_meta.cc:287] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.649s	user 0.005s	sys 0.009s
I20260709 12:10:49.489984 13801 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:49.492328 13760 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 11.
I20260709 12:10:49.463209 16630 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:10:49.499572 13754 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38932 (request call id 403) took 1901 ms (client timeout 1817 ms). Trace:
W20260709 12:10:49.500171 13754 rpcz_store.cc:269] 0709 12:10:47.598026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.735348 (+137322us) service_pool.cc:224] Handling call
0709 12:10:49.496917 (+1761569us) spinlock_profiling.cc:243] Waited 1.59 s on lock 0x7b54000a0354. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:49.499467 (+  2550us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3662859008}
I20260709 12:10:49.505931 16601 raft_consensus.cc:2749] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:49.506847 13829 raft_consensus.cc:1275] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:49.508246 13651 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:49.509402 13829 raft_consensus.cc:1240] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:49.450173 16592 raft_consensus.cc:697] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 6 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:49.510875 16547 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:49.510831 16592 consensus_queue.cc:237] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:49.491919 16545 raft_consensus.cc:2804] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:49.487334 16627 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:49.530292 14413 raft_consensus.cc:2410] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:10:49.491063 16677 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:49.491261 14409 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 9.
I20260709 12:10:49.491729 16473 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.493739 16613 raft_consensus.cc:2764] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 12:10:49.532804 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 79169.2us
I20260709 12:10:49.536460 13800 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:49.542375 16677 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:49.545291 16677 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:49.545651 16417 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:49.525688 16518 consensus_queue.cc:1059] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:10:49.546936 16518 raft_consensus.cc:3055] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:49.547544 16518 raft_consensus.cc:740] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:49.547461 16473 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:49.552044 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:49.552608 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.525982 16480 consensus_queue.cc:1059] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:10:49.556241 16241 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:49.529188 16545 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:49.558193 16545 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:49.559360 16586 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:49.562196 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:49.565265 16601 raft_consensus.cc:3055] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:49.565742 16601 raft_consensus.cc:740] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:49.566927 16601 consensus_queue.cc:260] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:49.567867 13651 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:49.568318 16601 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:49.570389 13683 raft_consensus.cc:1240] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 6 LEADER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:49.572757 15941 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:49.575879 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 55756.6us
I20260709 12:10:49.576930 13727 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
W20260709 12:10:49.564798 16674 log.cc:927] Time spent T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 12:10:49.586146 13763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2108) took 1789 ms. Trace:
I20260709 12:10:49.586661 13763 rpcz_store.cc:276] 0709 12:10:47.785513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.948029 (+1162516us) service_pool.cc:224] Handling call
0709 12:10:49.046106 (+ 98077us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:49.067653 (+ 21547us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.574905 (+507252us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b54000a0fd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:49.575145 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37795200}
W20260709 12:10:49.606868 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 69223us
W20260709 12:10:49.610015 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 176864us
W20260709 12:10:49.611146 14380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.615578 13801 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:49.549279 16518 consensus_queue.cc:260] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:49.605367 14379 leader_election.cc:304] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:49.597052 16627 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:49.625512 13835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 2142) took 1913 ms. Trace:
I20260709 12:10:49.626309 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:49.629506 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:49.615303 16636 raft_consensus.cc:2804] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:49.646013 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 122773us
I20260709 12:10:49.647818 13800 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:49.648869 13684 raft_consensus.cc:1240] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 4 LEADER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:49.650329 16468 consensus_queue.cc:1048] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:49.623929 16630 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:49.626261 13835 rpcz_store.cc:276] 0709 12:10:47.712434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.133101 (+1420667us) service_pool.cc:224] Handling call
0709 12:10:49.269409 (+136308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:49.326274 (+ 56865us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:49.364182 (+ 37908us) log.cc:844] Serialized 14 byte log entry
0709 12:10:49.624760 (+260578us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:49.624818 (+    58us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:49.624911 (+    93us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.625341 (+   430us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:49.625451 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":27275,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"thread_start_us":226733,"threads_started":1}
I20260709 12:10:49.652981 16630 raft_consensus.cc:697] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:49.616319 16571 consensus_queue.cc:1048] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:10:49.654266 16630 consensus_queue.cc:237] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:49.655202 13726 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:49.655999 14409 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087"
dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
mode: GRACEFUL
new_leader_uuid: "b98d2519bb504dc6905ed2ede4571835"
 from {username='slave'} at 127.0.0.1:46814
I20260709 12:10:49.656437 13683 raft_consensus.cc:2393] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 6: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:49.657272 16442 raft_consensus.cc:2749] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:49.619678 16648 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:49.658273 16648 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:49.659838 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:49.660781 16648 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:49.662555 16473 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:49.598451 16344 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:49.646118 16636 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:49.652457 14380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.640501 13758 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 5.
W20260709 12:10:49.640734 16681 log.cc:927] Time spent T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:10:49.642889 13801 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:49.587976 16677 consensus_queue.cc:1059] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:10:49.622303 16586 raft_consensus.cc:2804] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:49.675737 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 85976us
I20260709 12:10:49.676666 13763 raft_consensus.cc:1275] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:10:49.683295 13763 pending_rounds.cc:85] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting all ops after (but not including) 4
I20260709 12:10:49.683669 13763 pending_rounds.cc:107] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:10:49.683985 13763 raft_consensus.cc:2889] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:49.694936 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:49.673681 16636 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:49.699779 13837 raft_consensus.cc:1240] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:10:49.702503 14410 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 2.
I20260709 12:10:49.676128 16610 raft_consensus.cc:2804] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:49.675596 16539 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:49.709549 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:49.712886 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.688175 16586 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
W20260709 12:10:49.715114 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 72327.9us
I20260709 12:10:49.719228 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:49.764446 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:49.717089 13754 raft_consensus.cc:2955] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 3 to 5, VOTER 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:10:49.767625 13832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 2140) took 2706 ms. Trace:
W20260709 12:10:49.768303 16687 log.cc:927] Time spent T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 12:10:49.768110 13832 rpcz_store.cc:276] 0709 12:10:47.060996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.260949 (+1199953us) service_pool.cc:224] Handling call
0709 12:10:48.307183 (+ 46234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:48.390111 (+ 82928us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.767142 (+1377031us) spinlock_profiling.cc:243] Waited 68 ms on lock 0x7b54000b2cd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:49.767413 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":156323200}
I20260709 12:10:49.704057 16613 raft_consensus.cc:2749] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:49.770998 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:49.698385 16658 raft_consensus.cc:2804] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:49.779402 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 209897us
I20260709 12:10:49.711200 16610 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:49.720516 16586 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:49.771109 16518 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:49.781926 13687 raft_consensus.cc:1240] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:10:49.794799 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:49.784235 13800 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:49.796847 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:49.797502 13801 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:49.800762 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:49.804236 16545 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:49.805763 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:49.807164 13837 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 6.
W20260709 12:10:49.807555 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:49.808321 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.775326 16658 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:49.712886 16624 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:49.809988 14410 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 7.
I20260709 12:10:49.792011 16610 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:49.792830 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:49.826118 14379 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:49.825523 13836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 2144) took 1952 ms. Trace:
I20260709 12:10:49.831475 13763 raft_consensus.cc:1240] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:10:49.826884 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:49.816782 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:49.833657 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:49.834316 13837 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 7.
I20260709 12:10:49.806282 15941 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:49.815219 16658 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:49.832854 13758 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 7.
I20260709 12:10:49.817610 16571 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.779636 16472 consensus_queue.cc:1059] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 12:10:49.795463 16677 consensus_queue.cc:1048] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:10:49.840735 13685 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 8.
I20260709 12:10:49.860245 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:49.854142 14379 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:49.834787 16423 raft_consensus.cc:2804] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:10:49.830710 13836 rpcz_store.cc:276] 0709 12:10:47.712945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.197033 (+1484088us) service_pool.cc:224] Handling call
0709 12:10:49.197590 (+   557us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:49.242935 (+ 45345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:49.242967 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:49.276635 (+ 33668us) log.cc:844] Serialized 52 byte log entry
0709 12:10:49.399128 (+122493us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:49.399181 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.399260 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:49.664860 (+265600us) raft_consensus.cc:1685] finished
0709 12:10:49.664889 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:49.665041 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16452,"raft.queue_time_us":46738,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":11077,"thread_start_us":80471,"threads_started":1,"wal-append.queue_time_us":228288}
I20260709 12:10:49.881330 16473 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.882102 16473 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:49.884262 16473 leader_election.cc:290] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:49.884063 16636 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:49.887208 13837 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 8.
W20260709 12:10:49.889288 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.840826 14411 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 6.
I20260709 12:10:49.833789 16497 raft_consensus.cc:2749] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:10:49.900547 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 54341us
I20260709 12:10:49.902673 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:49.898216 13651 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:49.907120 16636 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:49.908275 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 284604us
I20260709 12:10:49.909030 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:49.909219 13726 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:49.910869 13726 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:49.912649 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:49.913307 16588 raft_consensus.cc:2749] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:49.914731 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:49.915575 13834 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 11.
I20260709 12:10:49.917276 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:49.920797 14410 raft_consensus.cc:1275] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:49.846032 16526 consensus_queue.cc:1048] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
W20260709 12:10:49.906994 16686 log.cc:927] Time spent T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 12:10:49.877125 16423 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:49.886650 15941 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:49.923197 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.923313 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:49.941231 13837 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:49.950677 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
W20260709 12:10:49.950726 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 71495.7us
I20260709 12:10:49.953687 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:49.954928 13651 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:49.853093 16571 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:49.922230 16344 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:49.924371 16480 raft_consensus.cc:2749] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:49.929864 16497 raft_consensus.cc:2749] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:49.950608 16423 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:49.898231 16442 consensus_queue.cc:1059] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 12:10:50.002157 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:49.991690 13651 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:50.011689 13834 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:49.956923 16627 raft_consensus.cc:2804] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:10:49.921947 16648 consensus_queue.cc:1059] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.088s
W20260709 12:10:50.014864 16675 log.cc:927] Time spent T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:10:49.995148 16696 raft_consensus.cc:3055] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:49.954478 15941 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:50.029588 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 54357.5us
W20260709 12:10:50.031615 16694 log.cc:927] Time spent T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 12:10:50.033917 16602 consensus_queue.cc:1048] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:10:50.052717 13834 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 7.
W20260709 12:10:50.038964 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 234033us
W20260709 12:10:50.109478 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 58922.8us
W20260709 12:10:50.126710 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 214175us
I20260709 12:10:50.127465 14379 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:49.992249 16703 consensus_queue.cc:1048] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.074s
I20260709 12:10:50.131451 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:50.137840 13828 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:50.039462 16696 raft_consensus.cc:740] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:50.049569 16627 raft_consensus.cc:697] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 11 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
W20260709 12:10:50.152380 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 432820us
I20260709 12:10:50.129467 16702 raft_consensus.cc:2749] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:50.158090 14409 raft_consensus.cc:606] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Received request to transfer leadership to TS b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:50.177589 14409 raft_consensus.cc:614] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:50.132843 16624 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:50.173127 13726 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:50.174127 14379 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:10:50.161526 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.147881 16480 raft_consensus.cc:3055] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:50.146296 16592 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:50.193233 13837 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 7.
I20260709 12:10:50.108673 16472 consensus_queue.cc:1059] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
W20260709 12:10:50.215763 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 66773.4us
I20260709 12:10:50.187322 16449 raft_consensus.cc:2804] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:50.223218 13837 raft_consensus.cc:1240] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:50.181502 16473 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:50.153965 16497 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.223098 13651 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:50.204488 16480 raft_consensus.cc:740] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:10:50.229341 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:50.239809 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.240240 13754 raft_consensus.cc:1240] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 6. Current term is 7. Ops: []
W20260709 12:10:50.242053 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 95008.8us
I20260709 12:10:50.211100 16691 raft_consensus.cc:2804] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:50.225992 16449 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.271279 13726 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:50.272526 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:50.272341 16571 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:50.275388 16571 consensus_queue.cc:1059] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:50.255507 16691 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:50.276222 16701 log.cc:927] Time spent T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.239s	user 0.000s	sys 0.000s
I20260709 12:10:50.259552 16449 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:50.294159 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 94680.7us
I20260709 12:10:50.298472 13651 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:50.249569 16497 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:50.258015 16648 consensus_queue.cc:1048] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 12:10:50.298408 16529 raft_consensus.cc:2804] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:50.356822 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:50.295254 16691 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:50.358717 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:10:50.345633 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 157447us
I20260709 12:10:50.270505 16473 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:50.294145 13687 raft_consensus.cc:2955] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 3 to 5, VOTER 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:10:50.366204 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:50.346601 16417 raft_consensus.cc:2804] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:50.347021 16547 raft_consensus.cc:2749] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:50.370981 13754 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 6.
I20260709 12:10:50.341092 16526 consensus_queue.cc:1059] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:10:50.366263 16722 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:50.280123 16696 consensus_queue.cc:260] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:50.386196 16723 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.386613 16696 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:50.387012 16497 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:50.386950 16723 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:50.388473 16610 consensus_meta.cc:287] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.551s	user 0.006s	sys 0.005s
I20260709 12:10:50.388990 16610 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:50.391227 16610 leader_election.cc:290] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:50.373396 16417 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:50.391932 16417 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:50.338124 16627 consensus_queue.cc:237] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:50.393982 14414 raft_consensus.cc:1240] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:50.401914 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:50.380276 13800 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:50.382997 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:50.460383 13763 raft_consensus.cc:1240] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:10:50.385046 16722 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:50.495510 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 44318.8us
I20260709 12:10:50.496146 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:50.393275 16610 consensus_queue.cc:1048] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:10:50.521585 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:50.522850 13652 leader_election.cc:336] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 1.533s (SENT)
I20260709 12:10:50.401167 16648 raft_consensus.cc:2749] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:10:50.535760 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 163637us
I20260709 12:10:50.356580 16702 consensus_queue.cc:1048] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:10:50.498243 13651 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:10:50.519308 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.461083 13761 raft_consensus.cc:1240] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
W20260709 12:10:50.552004 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 173075us
I20260709 12:10:50.450809 16529 raft_consensus.cc:697] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 6 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
W20260709 12:10:50.496284 16680 log.cc:927] Time spent T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 12:10:50.523631 16497 raft_consensus.cc:2749] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:10:50.608108 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 336921us
W20260709 12:10:50.609577 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:50.620254 16725 log.cc:927] Time spent T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 12:10:50.621690 16715 log.cc:927] Time spent T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.247s	user 0.000s	sys 0.000s
I20260709 12:10:50.625268 14413 raft_consensus.cc:1275] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:10:50.598013 16539 consensus_meta.cc:287] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.878s	user 0.008s	sys 0.004s
I20260709 12:10:50.596364 16472 raft_consensus.cc:3055] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:50.648062 14380 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:50.658505 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:10:50.659550 13828 consensus_meta.cc:287] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.510s	user 0.010s	sys 0.000s
I20260709 12:10:50.659992 13828 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 9.
I20260709 12:10:50.524351 16480 consensus_queue.cc:260] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:50.642225 16539 raft_consensus.cc:2749] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:50.642835 16472 raft_consensus.cc:740] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:50.690943 14379 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:50.698498 14413 raft_consensus.cc:1275] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:10:50.699635 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 176816us
I20260709 12:10:50.706959 13828 raft_consensus.cc:1275] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
W20260709 12:10:50.717818 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 57923.8us
W20260709 12:10:50.719780 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 137433us
I20260709 12:10:50.700526 16723 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:50.729099 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:50.735882 13835 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 8.
W20260709 12:10:50.741827 16712 log.cc:927] Time spent T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.395s	user 0.000s	sys 0.001s
I20260709 12:10:50.742951 16738 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:50.743424 16722 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:50.743772 16738 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:50.747030 16518 consensus_meta.cc:287] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.942s	user 0.012s	sys 0.000s
I20260709 12:10:50.745944 16419 raft_consensus.cc:2955] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 3 to 5, VOTER 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:10:50.750931 16734 raft_consensus.cc:2804] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:50.751523 16734 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.751917 16734 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:50.749697 16716 raft_consensus.cc:3055] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:50.754339 16716 raft_consensus.cc:740] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:50.754937 16729 consensus_queue.cc:1059] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:50.755400 16716 consensus_queue.cc:260] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:50.756572 16716 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:50.757203 16658 consensus_meta.cc:287] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.880s	user 0.003s	sys 0.007s
W20260709 12:10:50.758203 16586 consensus_meta.cc:287] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.938s	user 0.004s	sys 0.008s
I20260709 12:10:50.758807 16586 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:50.759828 16740 log.cc:927] Time spent T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:10:50.761670 16472 consensus_queue.cc:260] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:50.762769 16473 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:50.765017 13760 raft_consensus.cc:1240] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:50.723155 16529 consensus_queue.cc:237] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:50.766299 16611 raft_consensus.cc:3055] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:10:50.766238 16698 log.cc:927] Time spent T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.406s	user 0.000s	sys 0.001s
W20260709 12:10:50.758342 16720 log.cc:927] Time spent T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.223s	user 0.000s	sys 0.000s
I20260709 12:10:50.768617 13800 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:50.758536 16418 consensus_queue.cc:260] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:50.766883 16611 raft_consensus.cc:740] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:50.762800 16472 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:50.730152 16728 raft_consensus.cc:2749] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:50.791637 16601 consensus_meta.cc:287] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 1.223s	user 0.014s	sys 0.003s
I20260709 12:10:50.757681 16658 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:50.795761 16733 log.cc:927] Time spent T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:10:50.796017 16417 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:50.796711 16736 consensus_queue.cc:1059] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:10:50.798480 16423 consensus_meta.cc:287] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.781s	user 0.012s	sys 0.000s
I20260709 12:10:50.761274 16586 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:50.801162 14414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41700 (request call id 380) took 1127 ms. Trace:
W20260709 12:10:50.802295 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.810437 13832 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 8.
I20260709 12:10:50.825241 14414 rpcz_store.cc:276] 0709 12:10:49.674028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.680459 (+  6431us) service_pool.cc:224] Handling call
0709 12:10:49.701963 (+ 21504us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:50.394434 (+692471us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:50.800885 (+406451us) spinlock_profiling.cc:243] Waited 692 ms on lock 0x7b54006301d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:50.801097 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1590996864}
I20260709 12:10:50.789906 16677 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.845485 13837 raft_consensus.cc:1240] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:50.837894 16423 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:50.851824 16423 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:50.851995 16449 consensus_meta.cc:287] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.508s	user 0.004s	sys 0.004s
I20260709 12:10:50.853506 16449 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:50.854131 16738 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:50.855387 16611 consensus_queue.cc:260] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:50.856312 16449 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 9 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:50.853521 16417 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:50.836383 16473 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.864118 16473 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:50.836414 16613 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:50.865739 16545 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:50.867915 16677 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:50.867115 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 130845us
I20260709 12:10:50.869655 13800 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:50.870544 16677 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:50.785180 16743 raft_consensus.cc:2804] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:50.871515 16743 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:50.871978 14415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 745) took 1071 ms. Trace:
I20260709 12:10:50.872174 16743 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:50.874146 16497 raft_consensus.cc:2764] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:10:50.875735 16450 raft_consensus.cc:2749] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:50.867667 16613 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:50.872453 14415 rpcz_store.cc:276] 0709 12:10:49.800469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.803706 (+  3237us) service_pool.cc:224] Handling call
0709 12:10:49.804020 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:49.804255 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:10:49.925976 (+121721us) log.cc:844] Serialized 14 byte log entry
0709 12:10:49.928039 (+  2063us) log.cc:844] Serialized 14 byte log entry
0709 12:10:50.871319 (+943280us) spinlock_profiling.cc:243] Waited 20.2 ms on lock 0x7b18003c0e20. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e1ac0a 00007fa92e55a219 00007fa927b43d70 00007fa927b37293 00007fa927b2ccea 00007fa927b2d23a 00007fa927f97a2a 00007fa927fa70bf 00007fa927fa7038
0709 12:10:50.871574 (+   255us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:50.871631 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:50.871691 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:50.871778 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:50.871910 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29867,"prepare.queue_time_us":729172,"prepare.run_cpu_time_us":107,"prepare.run_wall_time_us":2907,"raft.queue_time_us":1634,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":24172,"spinlock_wait_cycles":46559104,"thread_start_us":121364,"threads_started":1}
I20260709 12:10:50.878929 16658 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:50.839919 16539 raft_consensus.cc:2749] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:50.880287 16613 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:50.881016 13754 raft_consensus.cc:1275] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:50.881644 13834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 2165) took 1161 ms. Trace:
I20260709 12:10:50.882256 13834 rpcz_store.cc:276] 0709 12:10:49.719808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.073979 (+354171us) service_pool.cc:224] Handling call
0709 12:10:50.075833 (+  1854us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:50.241403 (+165570us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:50.241435 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:50.271400 (+ 29965us) log.cc:844] Serialized 26 byte log entry
0709 12:10:50.558828 (+287428us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:50.558871 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:50.558959 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:50.881378 (+322419us) raft_consensus.cc:1685] finished
0709 12:10:50.881399 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:50.881556 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1367,"raft.queue_time_us":49844,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":91,"thread_start_us":291616,"threads_started":2,"wal-append.queue_time_us":341743}
I20260709 12:10:50.873677 13800 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:50.825062 16618 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:50.931031 13652 leader_election.cc:336] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 1.655s (SENT)
W20260709 12:10:50.935652 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 216985us
W20260709 12:10:50.936429 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 62810.2us
I20260709 12:10:50.932777 13652 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:50.920538 16547 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:50.937525 13833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 2038) took 5404 ms. Trace:
I20260709 12:10:50.847299 16568 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.939693 13833 rpcz_store.cc:276] 0709 12:10:45.526697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.597049 (+ 70352us) service_pool.cc:224] Handling call
0709 12:10:45.597452 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:49.256805 (+3659353us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:50.918939 (+1662134us) spinlock_profiling.cc:243] Waited 3.65 s on lock 0x7b540002e254. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:50.931059 (+ 12120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8386529280}
W20260709 12:10:50.944391 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 446214us
I20260709 12:10:50.921255 16613 raft_consensus.cc:2749] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:50.952605 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:50.935369 16417 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.955096 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:10:50.955359 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.958640 14415 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:50.973757 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:50.974562 13763 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:50.951989 16691 consensus_meta.cc:287] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.577s	user 0.006s	sys 0.004s
I20260709 12:10:50.996562 16473 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:50.979882 16241 raft_consensus.cc:3055] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:50.942054 16618 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:50.998420 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:50.946224 16738 raft_consensus.cc:2749] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:50.981048 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.981853 15941 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:50.946858 16568 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:50.984380 14409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:46814 (request call id 1) took 1329 ms. Trace:
I20260709 12:10:50.985862 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:51.009922 13833 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 7.
I20260709 12:10:50.988704 16734 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:50.990027 14408 raft_consensus.cc:1240] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:10:50.990485 16721 raft_consensus.cc:3055] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:50.994105 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:50.994761 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:51.013813 14416 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:50.994448 16417 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:50.995467 13832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35422 (request call id 463) took 1173 ms. Trace:
W20260709 12:10:50.995615 16696 consensus_meta.cc:287] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.608s	user 0.011s	sys 0.001s
I20260709 12:10:50.996265 16691 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:50.981571 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:51.027046 13684 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:50.978602 13834 raft_consensus.cc:1240] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:10:51.002178 13837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 2166) took 1148 ms. Trace:
I20260709 12:10:50.975039 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
W20260709 12:10:51.030232 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:51.002020 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 299981us
I20260709 12:10:51.009660 14409 rpcz_store.cc:276] 0709 12:10:49.654838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.655781 (+   943us) service_pool.cc:224] Handling call
0709 12:10:50.984160 (+1328379us) spinlock_profiling.cc:243] Waited 501 ms on lock 0x7b54005e0e54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f87853 00007fa92cf5560a 00007fa9264db7d4 00007fa9264db762 00007fa9264db691 00007fa9264db60c 00007fa9264da8c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:50.984286 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1153228032}
I20260709 12:10:51.016906 16613 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:51.024922 13832 rpcz_store.cc:276] 0709 12:10:49.822652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.908695 (+ 86043us) service_pool.cc:224] Handling call
0709 12:10:50.995299 (+1086604us) spinlock_profiling.cc:243] Waited 900 ms on lock 0x7b54003babd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:50.995406 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2071116672}
I20260709 12:10:50.944119 16547 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:51.002589 16241 raft_consensus.cc:740] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:51.038796 14414 raft_consensus.cc:2410] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 12:10:51.014034 16689 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.371s	user 0.010s	sys 0.044s
I20260709 12:10:51.041196 14379 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:51.037146 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:51.037480 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:10:51.033296 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 102316us
I20260709 12:10:51.042692 13831 raft_consensus.cc:1240] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:51.028498 13837 rpcz_store.cc:276] 0709 12:10:49.853590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.234806 (+381216us) service_pool.cc:224] Handling call
0709 12:10:50.235197 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:50.846108 (+610911us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:50.997296 (+151188us) spinlock_profiling.cc:243] Waited 610 ms on lock 0x7b54000af0d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:51.002095 (+  4799us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1402938112}
I20260709 12:10:51.045513 13759 raft_consensus.cc:2393] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 9: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
W20260709 12:10:51.048153 13652 leader_election.cc:336] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 1.937s (SENT)
I20260709 12:10:51.048683 13652 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:51.012975 16721 raft_consensus.cc:740] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:51.054409 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:51.055068 13835 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:51.053673 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:51.063774 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:51.064673 13833 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:51.041204 16689 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.399s	user 0.010s	sys 0.045s
I20260709 12:10:51.068320 14415 raft_consensus.cc:2468] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 5.
W20260709 12:10:51.049430 16627 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.020s	sys 0.060s
W20260709 12:10:51.046686 16592 consensus_meta.cc:287] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.826s	user 0.011s	sys 0.002s
I20260709 12:10:51.078435 13682 raft_consensus.cc:1275] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:51.054032 16571 raft_consensus.cc:2749] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:10:51.073612 16627 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.020s	sys 0.060s
I20260709 12:10:51.101506 13763 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 6.
I20260709 12:10:51.042481 16613 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:51.103331 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 55216.4us
W20260709 12:10:51.105952 13652 leader_election.cc:336] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 1.992s (SENT)
W20260709 12:10:51.107056 13652 leader_election.cc:336] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 2.024s (SENT)
I20260709 12:10:51.107556 13652 leader_election.cc:304] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:51.074359 16696 raft_consensus.cc:2749] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:51.099095 14416 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 6.
W20260709 12:10:51.073570 16630 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.406s	user 0.014s	sys 0.018s
I20260709 12:10:51.077123 16592 raft_consensus.cc:2749] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:51.116214 13801 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:10:51.114648 16630 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.457s	user 0.018s	sys 0.018s
I20260709 12:10:51.178623 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:10:51.181883 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.182614 13801 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:10:51.183072 13683 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.003s	sys 0.017s
W20260709 12:10:51.183656 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 114020us
I20260709 12:10:51.111981 16472 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:51.184172 13683 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.003s	sys 0.017s
I20260709 12:10:51.186626 13685 raft_consensus.cc:2410] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:51.186825 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:51.183565 16497 raft_consensus.cc:2804] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:51.187799 13763 raft_consensus.cc:2410] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:10:51.192301 13755 raft_consensus.cc:1240] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:51.195453 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.197554 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:51.188262 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:51.206926 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:51.208195 13837 raft_consensus.cc:2393] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 6: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:51.205389 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:51.211031 13757 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:51.109459 16241 consensus_queue.cc:260] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:51.131584 16539 consensus_queue.cc:1059] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 12:10:51.201198 16754 raft_consensus.cc:2749] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:51.199807 16497 raft_consensus.cc:697] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 6 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:51.273331 13685 raft_consensus.cc:1275] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:51.257355 16571 consensus_queue.cc:1059] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:10:51.277382 13837 raft_consensus.cc:1275] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:51.281068 13682 raft_consensus.cc:1275] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:51.112927 16721 consensus_queue.cc:260] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:51.281984 16721 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:51.250710 16658 raft_consensus.cc:2804] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:51.286432 16658 raft_consensus.cc:697] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 5 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:51.287513 16658 consensus_queue.cc:237] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:51.281194 16749 log.cc:927] Time spent T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:10:51.292040 13829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 2158) took 1619 ms. Trace:
I20260709 12:10:51.292503 13829 rpcz_store.cc:276] 0709 12:10:49.672806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.762375 (+1089569us) service_pool.cc:224] Handling call
0709 12:10:50.762739 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:50.763176 (+   437us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:50.763205 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:50.763729 (+   524us) log.cc:844] Serialized 26 byte log entry
0709 12:10:50.959626 (+195897us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:50.959693 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:50.959789 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:51.291793 (+332004us) raft_consensus.cc:1685] finished
0709 12:10:51.291818 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:51.291970 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1181,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":108,"thread_start_us":194993,"threads_started":1,"wal-append.queue_time_us":318299}
I20260709 12:10:51.294482 16734 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:51.295710 13829 raft_consensus.cc:1240] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:51.196107 16472 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:51.298123 16691 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:51.267010 16683 log.cc:927] Time spent T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 1.844s	user 0.019s	sys 0.006s
I20260709 12:10:51.278052 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:51.279357 16677 consensus_queue.cc:1048] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:10:51.302225 16613 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:51.302863 16497 consensus_queue.cc:237] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:51.305874 16743 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:51.306493 16419 consensus_meta.cc:287] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.558s	user 0.011s	sys 0.002s
I20260709 12:10:51.307471 16417 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:51.308343 16746 log.cc:927] Time spent T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:10:51.308871 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:51.326514 13828 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:51.316152 13833 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 9.
I20260709 12:10:51.320585 13835 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 12.
I20260709 12:10:51.329198 14380 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:10:51.329717 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.330286 14380 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:10:51.333371 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 138841us
W20260709 12:10:51.334475 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 56390.3us
W20260709 12:10:51.340026 13652 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 1.856s (SENT) [suppressed 32 similar messages]
W20260709 12:10:51.342180 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.345005 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:51.324798 16703 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:10:51.348162 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.350630 13727 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:51.335436 16734 raft_consensus.cc:2804] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:10:51.333869 16423 raft_consensus.cc:2804] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:51.371948 13727 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:51.372864 13830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 2143) took 3660 ms. Trace:
I20260709 12:10:51.390027 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:51.373718 13828 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 8.
W20260709 12:10:51.390304 16751 log.cc:927] Time spent T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:10:51.333889 16547 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:51.395304 14380 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:51.342563 16630 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.382103 16545 raft_consensus.cc:2804] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:51.387974 13830 rpcz_store.cc:276] 0709 12:10:47.712708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.195003 (+1482295us) service_pool.cc:224] Handling call
0709 12:10:49.195463 (+   460us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:49.211459 (+ 15996us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:49.211505 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:49.216896 (+  5391us) log.cc:844] Serialized 26 byte log entry
0709 12:10:49.340412 (+123516us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:49.340449 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.340523 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:51.071221 (+1730698us) spinlock_profiling.cc:243] Waited 5.26 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:10:51.372518 (+301297us) raft_consensus.cc:1685] finished
0709 12:10:51.372540 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:51.372797 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35105,"raft.queue_time_us":16972,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":3582,"spinlock_wait_cycles":12108672,"thread_start_us":71084,"threads_started":1,"wal-append.queue_time_us":169545}
W20260709 12:10:51.401075 16716 consensus_meta.cc:287] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.644s	user 0.015s	sys 0.001s
I20260709 12:10:51.420770 13684 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 6.
I20260709 12:10:51.424045 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:51.425097 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:51.426003 13685 raft_consensus.cc:2393] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 7: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:51.427080 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:51.427680 16745 raft_consensus.cc:2804] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:51.428332 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:51.403069 16630 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:51.431893 13685 raft_consensus.cc:1240] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:51.432618 16630 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:51.403256 16423 raft_consensus.cc:697] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 9 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:51.434901 16423 consensus_queue.cc:237] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:51.444249 14416 raft_consensus.cc:1240] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 7. Current term is 8. Ops: [7.8-7.8]
W20260709 12:10:51.447890 16758 log.cc:927] Time spent T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
W20260709 12:10:51.449246 16756 log.cc:927] Time spent T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 12:10:51.451116 16418 raft_consensus.cc:3060] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:51.451390 16750 log.cc:927] Time spent T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:10:51.459093 16613 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.459833 16613 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:51.462417 16391 consensus_queue.cc:1048] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:51.398079 16618 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:51.422911 13727 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:51.474259 13685 raft_consensus.cc:1275] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:10:51.477994 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:51.478075 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:10:51.478667 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 55888.1us
I20260709 12:10:51.479247 13755 raft_consensus.cc:2393] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 11: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:51.480014 13727 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:51.481693 13758 raft_consensus.cc:2410] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:51.398788 16703 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:51.489895 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:51.490357 13727 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
W20260709 12:10:51.485952 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.489069 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:51.403256 16734 raft_consensus.cc:697] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 12 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:51.489015 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:51.419718 16547 raft_consensus.cc:2804] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:51.414878 16545 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:51.492830 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:51.501856 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:51.483112 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:51.500672 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:51.504626 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:51.505134 13758 raft_consensus.cc:1813] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Handling vote request from an unknown peer 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:51.505625 13758 raft_consensus.cc:2410] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:10:51.505633 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:10:51.519883 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.493275 16717 raft_consensus.cc:2804] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:51.493542 16442 raft_consensus.cc:2804] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:51.497385 16547 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:51.544730 16734 consensus_queue.cc:237] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:51.555795 16547 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:51.558113 13651 leader_election.cc:304] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:10:51.560204 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.497006 16419 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:36466 (request call id 0) took 8015 ms. Trace:
I20260709 12:10:51.563871 16419 rpcz_store.cc:276] 0709 12:10:43.481537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.481688 (+   151us) service_pool.cc:224] Handling call
0709 12:10:43.493764 (+ 12076us) log.cc:844] Serialized 501 byte log entry
0709 12:10:44.326367 (+832603us) spinlock_profiling.cc:243] Waited 5.05 ms on lock 0x7b18003fd9c0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924ea03f3 00007fa924ea27c1 00007fa924ea2779 00007fa924ea2709 00007fa924ea26d1 00007fa924ea19cd 0000000000388634 0000000000388479 00007fa924e8383a
0709 12:10:45.542694 (+1216327us) spinlock_profiling.cc:243] Waited 6.14 ms on lock 0x7b18003fd9c0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e1ac0a 00007fa92e55a219 00007fa924ea2a40 00007fa924e9d4e4 00007fa924e9d455 00007fa927ee6b0b 00007fa927f6bb63 00007fa927f93752 00007fa927f8b9fa
0709 12:10:51.496868 (+5954174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1485842,"raft.queue_time_us":1704029,"raft.run_cpu_time_us":1892,"raft.run_wall_time_us":282903,"spinlock_wait_cycles":25715712,"thread_start_us":270421,"threads_started":1,"wal-append.queue_time_us":550732,"wal-append.run_cpu_time_us":2104,"wal-append.run_wall_time_us":1064372}
I20260709 12:10:51.567278 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:51.481443 16539 consensus_queue.cc:1059] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
W20260709 12:10:51.552897 16753 log.cc:927] Time spent T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.289s	user 0.000s	sys 0.001s
I20260709 12:10:51.506223 16545 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:51.560124 16677 raft_consensus.cc:2749] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:51.548100 16630 raft_consensus.cc:2804] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:51.570448 13757 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 12.
I20260709 12:10:51.571557 16417 consensus_queue.cc:1059] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:51.594184 16417 raft_consensus.cc:3055] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:51.594583 16417 raft_consensus.cc:740] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:51.595516 16417 consensus_queue.cc:260] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:51.541884 16717 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:51.596709 16417 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:51.597577 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:51.550949 16618 consensus_queue.cc:1048] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 12:10:51.602784 16241 raft_consensus.cc:3060] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:51.603442 16691 consensus_queue.cc:1059] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:51.586041 16442 raft_consensus.cc:697] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:51.606146 16442 consensus_queue.cc:237] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:51.573139 16754 consensus_queue.cc:1048] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:51.618314 16630 raft_consensus.cc:697] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:51.583797 14416 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81"
dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
mode: GRACEFUL
new_leader_uuid: "b98d2519bb504dc6905ed2ede4571835"
 from {username='slave'} at 127.0.0.1:46814
I20260709 12:10:51.619418 16630 consensus_queue.cc:237] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:51.620452 13756 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:51.621313 13762 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 6.
I20260709 12:10:51.641758 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:51.643687 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:10:51.586591 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 102527us
I20260709 12:10:51.646687 16419 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.647462 16419 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:51.648557 13727 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:51.649416 16403 raft_consensus.cc:2804] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:51.591415 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:51.591632 13571 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a34b21ec197b4241a780a8ae562e4602 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 12)
I20260709 12:10:51.592159 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:10:51.654338 13571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 62890.2us
I20260709 12:10:51.592469 16658 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:51.654820 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:51.655220 16658 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:51.655793 13763 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 8.
I20260709 12:10:51.656942 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:51.596474 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:51.566617 16703 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:51.617236 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:51.617841 16717 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:51.658349 13837 raft_consensus.cc:2393] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 7: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:51.654860 14408 raft_consensus.cc:2410] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:51.659351 16658 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:51.596542 16468 consensus_queue.cc:1048] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 12:10:51.580873 16613 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:51.672216 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:51.675784 13831 raft_consensus.cc:2410] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:51.676848 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:51.679895 13829 raft_consensus.cc:1240] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:10:51.641963 16754 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.641484 16618 raft_consensus.cc:3055] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:51.681813 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:51.686967 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:51.687680 13763 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:51.682745 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:51.688314 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:51.685461 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:51.689616 13762 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:51.692402 13833 raft_consensus.cc:1275] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:51.671316 16691 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.681274 13727 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
W20260709 12:10:51.698487 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 106927us
I20260709 12:10:51.708428 13831 raft_consensus.cc:2393] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 11: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
W20260709 12:10:51.716431 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.723569 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:51.724197 13726 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:51.687831 16618 raft_consensus.cc:740] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:51.687431 16403 raft_consensus.cc:697] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:51.679283 16526 consensus_queue.cc:1048] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:10:51.678972 16703 consensus_queue.cc:1048] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:10:51.755950 13762 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 8.
I20260709 12:10:51.750319 13763 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 6.
I20260709 12:10:51.759563 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:51.760313 13837 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 5.
I20260709 12:10:51.693503 16754 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:51.739450 16588 raft_consensus.cc:2804] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:51.796196 13754 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 7.
I20260709 12:10:51.815220 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:51.815938 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:51.819042 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:51.701221 16691 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:51.835645 16588 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:51.830806 13831 raft_consensus.cc:2393] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 5: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
W20260709 12:10:51.862605 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 97568.7us
I20260709 12:10:51.867432 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:51.868327 13837 raft_consensus.cc:2393] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 5: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:51.870337 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:51.871084 13828 raft_consensus.cc:2468] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 4.
I20260709 12:10:51.874065 14380 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:51.876030 13757 raft_consensus.cc:1240] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:51.889250 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:51.890164 13833 raft_consensus.cc:2376] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 6. Re-sending same reply.
W20260709 12:10:51.923418 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.852800 16419 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:51.875203 16757 log.cc:927] Time spent T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.290s	user 0.003s	sys 0.000s
I20260709 12:10:51.867338 16736 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.868294 16588 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:51.862619 16734 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:10:51.935447 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 211410us
I20260709 12:10:51.982395 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:10:51.991523 16768 log.cc:927] Time spent T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
W20260709 12:10:52.004472 16776 log.cc:927] Time spent T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:10:52.004855 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:51.888753 16782 consensus_queue.cc:1059] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.135s
I20260709 12:10:52.009469 13679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2041) took 1048 ms. Trace:
W20260709 12:10:52.010027 16779 log.cc:927] Time spent T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 12:10:51.932401 16418 raft_consensus.cc:2804] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:51.900077 16658 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:10:52.016194 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.935582 16450 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:52.022225 13679 rpcz_store.cc:276] 0709 12:10:50.961446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.961587 (+   141us) service_pool.cc:224] Handling call
0709 12:10:50.979347 (+ 17760us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:50.979840 (+   493us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:50.979871 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:50.980553 (+   682us) log.cc:844] Serialized 52 byte log entry
0709 12:10:51.209891 (+229338us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:51.267759 (+ 57868us) log.cc:844] Serialized 14 byte log entry
0709 12:10:51.271506 (+  3747us) log.cc:844] Serialized 14 byte log entry
0709 12:10:51.271944 (+   438us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:51.272017 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:51.584797 (+312780us) spinlock_profiling.cc:243] Waited 9.21 ms on lock 0x7b18003177a0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924ea03f3 00007fa924ea27c1 00007fa924ea2779 00007fa924ea2709 00007fa924ea26d1 00007fa924ea19cd 0000000000388634 0000000000388479 00007fa924e8383a
0709 12:10:52.009109 (+424312us) raft_consensus.cc:1685] finished
0709 12:10:52.009135 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:52.009398 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2436,"prepare.queue_time_us":57709,"prepare.run_wall_time_us":19612,"raft.queue_time_us":16819,"raft.run_cpu_time_us":363,"raft.run_wall_time_us":48514,"spinlock_wait_cycles":35807744,"thread_start_us":228896,"threads_started":1,"wal-append.queue_time_us":318673}
I20260709 12:10:52.210423 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:52.137423 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:10:52.079161 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.118957 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:52.227576 13828 raft_consensus.cc:2410] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:10:52.119377 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:52.120205 13829 raft_consensus.cc:1275] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:52.189067 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:51.955415 16618 consensus_queue.cc:260] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:52.249185 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:52.252162 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:52.253234 13835 raft_consensus.cc:2410] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:10:52.253539 13684 raft_consensus.cc:2393] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 6: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:52.181823 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:51.981222 16403 consensus_queue.cc:237] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:52.118337 16547 consensus_meta.cc:287] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.562s	user 0.009s	sys 0.001s
I20260709 12:10:52.255317 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:52.263423 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:52.264411 13831 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:52.060084 16418 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:52.144963 14408 raft_consensus.cc:1275] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:52.268234 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:52.061287 16497 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:52.285279 16784 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:52.270073 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:52.270370 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:52.287493 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:52.287884 16782 raft_consensus.cc:3055] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:52.288180 13835 raft_consensus.cc:2468] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 4.
I20260709 12:10:52.288341 16782 raft_consensus.cc:740] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:52.289191 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:52.273023 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:52.273702 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:52.291149 16718 consensus_queue.cc:1048] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:52.292784 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:10:52.276728 16717 consensus_meta.cc:287] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.618s	user 0.005s	sys 0.004s
I20260709 12:10:52.016247 16736 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:52.267765 16547 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:52.298501 16717 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:52.292558 16497 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:52.281183 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 269770us
I20260709 12:10:52.301573 16703 consensus_queue.cc:1048] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:10:52.302529 16778 log.cc:927] Time spent T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
I20260709 12:10:52.302613 16717 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:52.304171 16780 log.cc:927] Time spent T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.311s	user 0.000s	sys 0.001s
I20260709 12:10:52.252825 16752 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.293838 13829 raft_consensus.cc:2410] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:52.294951 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:52.314199 13835 raft_consensus.cc:2393] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 9: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
W20260709 12:10:52.296342 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 311173us
I20260709 12:10:52.299340 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:52.315999 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:52.316633 13763 raft_consensus.cc:2410] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
W20260709 12:10:52.304288 16417 consensus_meta.cc:287] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.707s	user 0.009s	sys 0.001s
I20260709 12:10:52.285983 16784 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:52.035650 16734 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:52.320921 16734 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:52.322384 16754 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:52.322201 16691 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:52.323019 16618 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:52.324527 16497 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:52.279454 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:52.326758 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:52.327185 16736 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:52.322142 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:52.327607 13681 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:52.282080 16781 log.cc:927] Time spent T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.402s	user 0.001s	sys 0.000s
I20260709 12:10:52.300400 16547 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:52.332777 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:52.310034 13828 raft_consensus.cc:2393] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 5: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:52.344784 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:52.295598 16418 raft_consensus.cc:3060] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:52.104128 16450 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:52.340543 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:52.345645 13828 raft_consensus.cc:2393] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 6: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
W20260709 12:10:52.336850 13756 consensus_meta.cc:287] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.716s	user 0.011s	sys 0.000s
I20260709 12:10:52.271570 16788 raft_consensus.cc:2749] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:52.378408 13679 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:52.379078 13756 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 6.
I20260709 12:10:52.347030 13829 raft_consensus.cc:2393] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 11: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
W20260709 12:10:52.350172 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.104328 16658 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:52.352468 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:52.362323 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:52.362848 16784 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:52.372613 16775 log.cc:927] Time spent T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.184s	user 0.000s	sys 0.000s
I20260709 12:10:52.369335 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:52.385732 13835 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 7.
I20260709 12:10:52.390350 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:10:52.398829 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 509599us
I20260709 12:10:52.337996 16497 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:52.401089 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:10:52.384517 16241 consensus_meta.cc:287] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.778s	user 0.014s	sys 0.000s
I20260709 12:10:52.405140 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:52.406288 13835 raft_consensus.cc:2393] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 7: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:52.415920 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:52.417796 13833 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:52.424340 16744 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.998s	user 0.009s	sys 0.018s
W20260709 12:10:52.425038 16744 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.999s	user 0.009s	sys 0.018s
W20260709 12:10:52.394672 16545 consensus_meta.cc:287] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.774s	user 0.011s	sys 0.000s
I20260709 12:10:52.289304 16782 consensus_queue.cc:260] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:52.379783 16736 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.450165 14416 raft_consensus.cc:606] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Received request to transfer leadership to TS b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:52.573796 14416 raft_consensus.cc:614] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:52.451633 13828 raft_consensus.cc:3055] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:10:52.463164 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:52.492286 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 44308.4us
I20260709 12:10:52.574837 13828 raft_consensus.cc:740] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:52.339308 16752 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:52.499969 13829 raft_consensus.cc:1240] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:52.494940 13835 raft_consensus.cc:1240] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:52.525110 13727 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:52.493144 16545 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:52.527132 16796 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:52.448024 16497 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:52.534803 16764 log.cc:927] Time spent T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 1.082s	user 0.005s	sys 0.005s
I20260709 12:10:52.538033 16588 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:52.538204 13831 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 6.
I20260709 12:10:52.541460 14412 raft_consensus.cc:1240] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:52.543761 14414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41692 (request call id 524) took 1603 ms. Trace:
I20260709 12:10:52.612608 14414 rpcz_store.cc:276] 0709 12:10:50.941933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.946072 (+  4139us) service_pool.cc:224] Handling call
0709 12:10:52.543478 (+1597406us) spinlock_profiling.cc:243] Waited 8.57 ms on lock 0x7b54005e01d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:52.543652 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19719552}
I20260709 12:10:52.544003 16450 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:52.549733 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.491652 16784 consensus_queue.cc:1048] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 12:10:52.393484 16547 consensus_queue.cc:1059] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.126s
I20260709 12:10:52.553241 16658 leader_election.cc:290] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:52.399034 16703 consensus_queue.cc:1048] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.125s
I20260709 12:10:52.580466 13834 raft_consensus.cc:1275] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:10:52.582650 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.591012 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:10:52.591888 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 66879.9us
I20260709 12:10:52.592104 16718 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.577440 16734 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.592705 16423 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:52.592761 16717 raft_consensus.cc:2749] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:52.596439 13679 raft_consensus.cc:2468] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 5.
I20260709 12:10:52.607897 13828 consensus_queue.cc:260] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:52.626420 13755 raft_consensus.cc:2393] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 7: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:52.630967 13727 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:52.645088 13727 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:52.640513 13829 raft_consensus.cc:1240] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:10:52.650799 13727 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:52.655295 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:10:52.680416 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.680367 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:52.684346 14409 raft_consensus.cc:2410] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:52.627406 16782 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:52.631853 16658 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.688807 13828 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:52.654610 13833 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 7.
I20260709 12:10:52.686676 13681 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 9.
I20260709 12:10:52.691623 13681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48212 (request call id 453) took 1110 ms. Trace:
W20260709 12:10:52.694172 13800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.692056 13681 rpcz_store.cc:276] 0709 12:10:51.581362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.326474 (+745112us) service_pool.cc:224] Handling call
0709 12:10:52.691547 (+365073us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:52.701328 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:10:52.706753 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.708796 13679 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:52.659322 16788 raft_consensus.cc:2804] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:52.692868 16761 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.023s	sys 0.022s
I20260709 12:10:52.678268 16602 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:52.644685 14408 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 6.
I20260709 12:10:52.727490 13757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2147) took 1107 ms. Trace:
I20260709 12:10:52.729986 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:52.680202 16403 raft_consensus.cc:2804] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:52.609663 16736 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:52.738709 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:52.739545 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:52.759980 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:10:52.740425 16761 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.023s	sys 0.023s
I20260709 12:10:52.623184 16796 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:52.746399 13757 rpcz_store.cc:276] 0709 12:10:51.619897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:51.876922 (+257025us) service_pool.cc:224] Handling call
0709 12:10:51.940874 (+ 63952us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:51.941168 (+   294us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:52.015283 (+ 74115us) log.cc:844] Serialized 14 byte log entry
0709 12:10:52.291728 (+276445us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b180003b260. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e82e07 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9fc02 00007fa927b2720b 00007fa927b2cd23 00007fa927b2d23a 00007fa927f97a2a
0709 12:10:52.726980 (+435252us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:52.727063 (+    83us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:52.727141 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:52.727240 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:52.727412 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44716,"prepare.queue_time_us":69488,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":8302,"raft.queue_time_us":47098,"spinlock_wait_cycles":27319552,"thread_start_us":389995,"threads_started":1}
I20260709 12:10:52.760921 13834 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 6.
I20260709 12:10:52.754954 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:52.736919 16788 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:52.772359 16788 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:52.772709 13680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2044) took 1718 ms. Trace:
I20260709 12:10:52.649096 16734 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:52.773097 13680 rpcz_store.cc:276] 0709 12:10:51.048226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:51.078034 (+ 29808us) service_pool.cc:224] Handling call
0709 12:10:51.078451 (+   417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:51.103314 (+ 24863us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:51.103349 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:51.148408 (+ 45059us) log.cc:844] Serialized 26 byte log entry
0709 12:10:51.339499 (+191091us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:51.339540 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:51.339616 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:52.366288 (+1026672us) spinlock_profiling.cc:243] Waited 5.85 ms on lock 0x7b4800080358. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92ceb6aa1 00007fa92ceadb37 00007fa92cead9ca 00007fa92cfa526f 00007fa92cfa4f37 00007fa92cfb955c 00007fa92cfb9508 00007fa92cfb9488 00007fa92cfb9443 00007fa92cfb86ec 00007fa92bee2a96
0709 12:10:52.449847 (+ 83559us) spinlock_profiling.cc:243] Waited 27.2 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:10:52.766770 (+316923us) raft_consensus.cc:1685] finished
0709 12:10:52.766792 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:52.766920 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":564,"raft.queue_time_us":22267,"raft.run_cpu_time_us":3665,"raft.run_wall_time_us":1261550,"spinlock_wait_cycles":76068864,"thread_start_us":85295,"threads_started":1,"wal-append.queue_time_us":221541}
I20260709 12:10:52.775286 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:52.702534 16658 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:52.776415 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:52.777079 13680 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 5.
I20260709 12:10:52.777892 16658 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:52.778533 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:52.742507 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:52.746387 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:52.756067 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:52.784410 14407 raft_consensus.cc:2376] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 9. Re-sending same reply.
I20260709 12:10:52.784525 14414 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 6.
W20260709 12:10:52.784832 16747 log.cc:927] Time spent T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 1.444s	user 0.004s	sys 0.000s
I20260709 12:10:52.784529 16588 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:52.659646 16423 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:52.786299 13836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 2171) took 2758 ms. Trace:
I20260709 12:10:52.786690 13836 rpcz_store.cc:276] 0709 12:10:50.028149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.377706 (+349557us) service_pool.cc:224] Handling call
0709 12:10:50.508374 (+130668us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:50.518401 (+ 10027us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:50.518452 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:50.540141 (+ 21689us) log.cc:844] Serialized 26 byte log entry
0709 12:10:51.018670 (+478529us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:51.018724 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:51.018824 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:52.639924 (+1621100us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:10:52.786002 (+146078us) raft_consensus.cc:1685] finished
0709 12:10:52.786023 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:52.786237 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43630464,"thread_start_us":357513,"threads_started":1,"wal-append.queue_time_us":598843}
I20260709 12:10:52.788196 16423 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:52.781456 13684 raft_consensus.cc:2410] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:10:52.781567 13681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1345) took 1108 ms. Trace:
I20260709 12:10:52.777563 13680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1337) took 1116 ms. Trace:
I20260709 12:10:52.790851 13681 rpcz_store.cc:276] 0709 12:10:51.673472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.699286 (+1025814us) service_pool.cc:224] Handling call
0709 12:10:52.781506 (+ 82220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:52.790946 13680 rpcz_store.cc:276] 0709 12:10:51.670905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.776176 (+1105271us) service_pool.cc:224] Handling call
0709 12:10:52.777508 (+  1332us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:52.791260 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:52.797674 13834 raft_consensus.cc:2393] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 8: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:10:52.756173 16403 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:52.756062 16721 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.737493 16547 consensus_queue.cc:1059] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 12:10:52.809759 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:52.694072 16718 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:52.815673 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:52.803560 16403 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:52.810688 13680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1346) took 1137 ms. Trace:
I20260709 12:10:52.782776 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:52.801864 13828 raft_consensus.cc:1275] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:10:52.802564 16721 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:52.834000 13828 pending_rounds.cc:85] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 7
I20260709 12:10:52.834915 13828 pending_rounds.cc:107] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:10:52.789499 16418 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:52.824877 13680 rpcz_store.cc:276] 0709 12:10:51.673760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.791922 (+1118162us) service_pool.cc:224] Handling call
0709 12:10:52.810619 (+ 18697us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:52.835318 13681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1351) took 1127 ms. Trace:
W20260709 12:10:52.829689 13762 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.036s	sys 0.103s
W20260709 12:10:52.840054 13762 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.036s	sys 0.104s
I20260709 12:10:52.839865 13681 rpcz_store.cc:276] 0709 12:10:51.708107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.791715 (+1083608us) service_pool.cc:224] Handling call
0709 12:10:52.835219 (+ 43504us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:52.841694 13762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2140) took 1248 ms. Trace:
I20260709 12:10:52.840010 13828 raft_consensus.cc:2889] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:52.847016 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:52.838923 16618 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:52.820546 16792 consensus_queue.cc:1048] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.131s
W20260709 12:10:52.838235 16745 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.410s	user 0.019s	sys 0.019s
W20260709 12:10:52.883456 13830 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.011s	sys 0.021s
W20260709 12:10:52.883920 13830 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.011s	sys 0.021s
I20260709 12:10:52.854516 13679 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 5.
I20260709 12:10:52.838845 16545 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:52.868736 13762 rpcz_store.cc:276] 0709 12:10:51.593378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:51.759278 (+165900us) service_pool.cc:224] Handling call
0709 12:10:51.759578 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:51.759799 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:10:51.795028 (+ 35229us) log.cc:844] Serialized 14 byte log entry
0709 12:10:52.841199 (+1046171us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:52.841279 (+    80us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:52.841351 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:52.841444 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:52.841623 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":363770,"prepare.queue_time_us":34558,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":386927,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":111,"thread_start_us":681548,"threads_started":2,"wal-append.queue_time_us":523593}
I20260709 12:10:52.896138 16718 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:52.856150 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:52.867198 16497 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:52.849805 16752 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:52.865847 16808 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.900959 13679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1343) took 1228 ms. Trace:
I20260709 12:10:52.921263 13679 rpcz_store.cc:276] 0709 12:10:51.672840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.683892 (+1011052us) service_pool.cc:224] Handling call
0709 12:10:52.900716 (+216824us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:52.892948 16745 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.464s	user 0.019s	sys 0.019s
I20260709 12:10:52.904249 13680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1341) took 1232 ms. Trace:
I20260709 12:10:52.924628 13680 rpcz_store.cc:276] 0709 12:10:51.672219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.838040 (+1165821us) service_pool.cc:224] Handling call
0709 12:10:52.904166 (+ 66126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:52.927106 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:52.928630 13679 raft_consensus.cc:2393] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 7: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
W20260709 12:10:52.926569 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 287348us
I20260709 12:10:52.898047 16736 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:52.931445 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:52.932945 13679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2067) took 1372 ms. Trace:
W20260709 12:10:52.923262 16586 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 12:10:52.854092 16788 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:52.934536 13681 raft_consensus.cc:2393] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 6: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:52.933403 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:52.924008 16808 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:52.939836 16736 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:52.947815 13681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1357) took 1048 ms. Trace:
I20260709 12:10:52.973088 13681 rpcz_store.cc:276] 0709 12:10:51.899491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.921585 (+1022094us) service_pool.cc:224] Handling call
0709 12:10:52.947724 (+ 26139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:52.924324 16745 raft_consensus.cc:697] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 8 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:52.927819 16497 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.934340 13679 rpcz_store.cc:276] 0709 12:10:51.556408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.926807 (+1370399us) service_pool.cc:224] Handling call
0709 12:10:52.929066 (+  2259us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:52.935174 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 178367us
I20260709 12:10:52.978135 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:52.979135 13681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1344) took 1306 ms. Trace:
I20260709 12:10:52.979602 13681 rpcz_store.cc:276] 0709 12:10:51.673143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.977824 (+1304681us) service_pool.cc:224] Handling call
0709 12:10:52.979039 (+  1215us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:52.980618 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.980655 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:52.981433 13681 raft_consensus.cc:1813] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Handling vote request from an unknown peer 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:52.982203 13681 raft_consensus.cc:2410] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:10:52.974972 13828 raft_consensus.cc:1240] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:10:52.919864 16618 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:52.989253 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:52.993009 13681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1355) took 1177 ms. Trace:
I20260709 12:10:52.993511 13681 rpcz_store.cc:276] 0709 12:10:51.815437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.980377 (+1164940us) service_pool.cc:224] Handling call
0709 12:10:52.992944 (+ 12567us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:52.994725 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:52.995657 13681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1353) took 1267 ms. Trace:
I20260709 12:10:52.996801 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:52.997565 13828 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:52.996062 13681 rpcz_store.cc:276] 0709 12:10:51.727927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.994376 (+1266449us) service_pool.cc:224] Handling call
0709 12:10:52.995587 (+  1211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:53.003113 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:52.980343 16658 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:10:53.018146 16807 log.cc:927] Time spent T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 12:10:53.018746 13679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2070) took 1461 ms. Trace:
I20260709 12:10:53.019048 16788 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:53.003211 16497 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:53.021522 16800 log.cc:927] Time spent T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 12:10:53.022127 16497 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:52.933126 16809 consensus_queue.cc:1048] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 12:10:53.027217 13683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 446) took 2786 ms. Trace:
W20260709 12:10:53.001425 16744 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.009s	sys 0.057s
I20260709 12:10:53.021836 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:53.009032 16423 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.019176 13679 rpcz_store.cc:276] 0709 12:10:51.557188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.016079 (+1458891us) service_pool.cc:224] Handling call
0709 12:10:53.018176 (+  2097us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:53.018373 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:53.018409 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:53.018452 (+    43us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:53.018488 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:53.018542 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:53.018667 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:53.041536 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.014056 13727 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:53.018141 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:53.013021 13801 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:53.045732 13800 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:52.978751 16736 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:53.019361 16805 log.cc:927] Time spent T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:10:53.027823 13683 rpcz_store.cc:276] 0709 12:10:50.241091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.241235 (+   144us) service_pool.cc:224] Handling call
0709 12:10:50.254435 (+ 13200us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:50.531985 (+277550us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:10:50.610817 (+ 78832us) log.cc:844] Serialized 14 byte log entry
0709 12:10:51.208205 (+597388us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:51.208273 (+    68us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:51.244468 (+ 36195us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:53.026893 (+1782425us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b54002846d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:53.026959 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:53.027143 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27389,"prepare.queue_time_us":47370,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":27149,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":21445,"spinlock_wait_cycles":454174208,"thread_start_us":518993,"threads_started":1,"wal-append.queue_time_us":645233,"wal-append.run_cpu_time_us":2156,"wal-append.run_wall_time_us":1161032}
I20260709 12:10:53.016801 16814 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:53.053462 13727 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
W20260709 12:10:53.038582 16744 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.009s	sys 0.058s
I20260709 12:10:53.057873 13679 raft_consensus.cc:1240] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:10:53.058301 13837 raft_consensus.cc:2468] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 5.
I20260709 12:10:53.058729 13679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 451) took 1497 ms. Trace:
I20260709 12:10:53.059098 13679 rpcz_store.cc:276] 0709 12:10:51.561509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.041029 (+1479520us) service_pool.cc:224] Handling call
0709 12:10:53.057567 (+ 16538us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:53.058479 (+   912us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:53.058677 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:53.059216 13828 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 9.
I20260709 12:10:53.061436 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:53.062434 13828 raft_consensus.cc:2468] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 4.
I20260709 12:10:53.037264 16497 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.031388 16796 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:53.032246 16813 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:53.040007 16721 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:53.086876 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:53.023370 16450 consensus_queue.cc:1059] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:10:53.090443 14413 raft_consensus.cc:2410] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:10:53.088419 13679 raft_consensus.cc:1240] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 8 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 7. Current term is 8. Ops: [7.8-7.8]
W20260709 12:10:53.090764 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.096524 13679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1340) took 1424 ms. Trace:
I20260709 12:10:53.090727 13727 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:53.096992 14380 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:53.097069 13679 rpcz_store.cc:276] 0709 12:10:51.671947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.087859 (+1415912us) service_pool.cc:224] Handling call
0709 12:10:53.088193 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:53.096029 (+  7836us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:53.096463 (+   434us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:53.099964 13679 raft_consensus.cc:1240] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:53.103209 14380 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:53.062501 16792 raft_consensus.cc:2749] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:10:53.108510 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.102097 13683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 452) took 1526 ms. Trace:
I20260709 12:10:53.110265 13683 rpcz_store.cc:276] 0709 12:10:51.569715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.055089 (+1485374us) service_pool.cc:224] Handling call
0709 12:10:53.087327 (+ 32238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:53.087533 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:53.087555 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:53.087600 (+    45us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:53.087651 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:53.087711 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:53.087826 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:53.113595 13679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1350) took 1408 ms. Trace:
I20260709 12:10:53.114267 13679 rpcz_store.cc:276] 0709 12:10:51.697130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.099400 (+1402270us) service_pool.cc:224] Handling call
0709 12:10:53.099806 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:53.100445 (+   639us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:53.104716 (+  4271us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:53.073814 16588 raft_consensus.cc:2804] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:53.036643 16658 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:53.061105 16817 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.108060 16761 raft_consensus.cc:2804] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:53.119817 13727 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:53.119928 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:53.116876 16811 raft_consensus.cc:2804] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:53.125247 16658 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:53.141440 13837 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 7.
W20260709 12:10:53.064569 16759 log.cc:927] Time spent T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 1.635s	user 0.000s	sys 0.006s
I20260709 12:10:53.052021 16423 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:53.138052 13683 raft_consensus.cc:1240] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:53.161939 13683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1354) took 1403 ms. Trace:
I20260709 12:10:53.162452 13683 rpcz_store.cc:276] 0709 12:10:51.758283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.111473 (+1353190us) service_pool.cc:224] Handling call
0709 12:10:53.137818 (+ 26345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:53.161444 (+ 23626us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:53.161730 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:53.067226 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:53.062518 16745 consensus_queue.cc:237] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:53.155129 13800 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:53.089736 16497 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:53.118938 16588 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:53.142382 16811 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:53.146080 16761 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:53.157358 16806 log.cc:927] Time spent T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.273s	user 0.000s	sys 0.001s
I20260709 12:10:53.179605 13727 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:53.173944 13800 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:53.067938 16814 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:53.171484 16788 raft_consensus.cc:2804] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:53.177016 16809 raft_consensus.cc:2749] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:10:53.180694 13652 connection.cc:256] RPC call timeout handler was delayed by -1.0629795919999196s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3138s for a response
I20260709 12:10:53.181704 16588 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:53.182010 16811 raft_consensus.cc:3060] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:53.104341 16813 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:53.186470 16761 raft_consensus.cc:3060] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:53.209319 13652 connection.cc:256] RPC call timeout handler was delayed by -1.0440351989998362s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2864s for a response
I20260709 12:10:53.147533 16817 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:53.202952 16788 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:53.236330 16788 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:53.236514 16497 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:53.188851 14411 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 9.
I20260709 12:10:53.238024 16658 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:53.241879 16816 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:53.242727 16816 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:53.243242 16816 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:53.245896 16820 raft_consensus.cc:2749] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:53.203512 16547 raft_consensus.cc:2804] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:53.247131 16815 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.219200 16808 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:53.247903 16815 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:53.225047 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.225584 16391 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:53.254526 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:53.254689 16391 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:53.255476 14408 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 6.
I20260709 12:10:53.256968 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:53.257910 16818 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:53.259608 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.232748 16817 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:53.233923 16736 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:10:53.235697 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.274083 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:53.275173 13760 raft_consensus.cc:2393] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 8: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:53.281992 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:53.282943 13831 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 5.
I20260709 12:10:53.284039 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:53.284730 13831 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:53.287653 16423 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:53.288331 16423 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.288875 16423 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:53.223420 16636 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.291654 16636 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:53.272238 16547 raft_consensus.cc:697] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:53.294528 16450 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.295221 16547 consensus_queue.cc:237] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:53.295317 16450 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:53.257704 14408 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:53.220146 16618 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:53.318439 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:53.306365 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:53.354235 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:53.322786 13836 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 5.
I20260709 12:10:53.374814 13763 raft_consensus.cc:2393] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 3: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:53.343204 16636 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:53.312624 16812 log.cc:927] Time spent T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 12:10:53.333581 16782 consensus_meta.cc:287] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.633s	user 0.007s	sys 0.007s
W20260709 12:10:53.387709 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 213817us
I20260709 12:10:53.388577 13800 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:53.399130 13831 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 7.
I20260709 12:10:53.374372 16391 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:53.411439 13800 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:53.413955 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:53.420660 13800 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:53.421427 16813 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:53.421814 16658 raft_consensus.cc:2804] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:53.417788 16808 raft_consensus.cc:2804] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:53.450992 13800 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:53.458870 13727 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:53.420107 16817 raft_consensus.cc:2804] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:10:53.612381 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:53.619233 16830 log.cc:927] Time spent T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:10:53.554425 13832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 2097) took 1234 ms. Trace:
W20260709 12:10:53.571521 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 72474.9us
I20260709 12:10:53.640872 13836 raft_consensus.cc:1275] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:53.462394 13727 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:53.482848 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:10:53.525020 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.587052 14415 raft_consensus.cc:1240] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:53.713104 16588 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:53.713732 13831 raft_consensus.cc:1275] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 12:10:53.555100 16828 log.cc:927] Time spent T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 12:10:53.715623 16588 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:53.716591 14408 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 3.
I20260709 12:10:53.717363 16728 raft_consensus.cc:3055] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:53.684476 13681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2066) took 2128 ms. Trace:
W20260709 12:10:53.688721 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:53.720032 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.722283 13831 raft_consensus.cc:1240] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:10:53.721302 14379 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:10:53.681378 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 230445us
I20260709 12:10:53.721624 13681 rpcz_store.cc:276] 0709 12:10:51.556100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.001690 (+1445590us) service_pool.cc:224] Handling call
0709 12:10:53.002525 (+   835us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:53.020092 (+ 17567us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:53.020131 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:53.020833 (+   702us) log.cc:844] Serialized 26 byte log entry
0709 12:10:53.340295 (+319462us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:53.524037 (+183742us) log.cc:844] Serialized 14 byte log entry
0709 12:10:53.627523 (+103486us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:53.627640 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:53.684129 (+ 56489us) raft_consensus.cc:1685] finished
0709 12:10:53.684163 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:53.684383 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":291570,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":9118,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92,"thread_start_us":561560,"threads_started":3,"wal-append.queue_time_us":444150}
I20260709 12:10:53.725630 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:53.462795 16802 raft_consensus.cc:2804] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:53.728649 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:10:53.618549 16829 log.cc:927] Time spent T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 12:10:53.730683 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:53.449447 16820 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:53.471232 16636 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:53.734047 13800 connection.cc:256] RPC call timeout handler was delayed by -1.2077739260000726s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1706s for a response
W20260709 12:10:53.736517 13800 connection.cc:256] RPC call timeout handler was delayed by -1.1897739260000435s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1726s for a response
W20260709 12:10:53.737013 13800 connection.cc:256] RPC call timeout handler was delayed by -1.1528739259999838s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1767s for a response
W20260709 12:10:53.729015 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 266718us
I20260709 12:10:53.463719 16480 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:53.737465 13800 connection.cc:256] RPC call timeout handler was delayed by -1.1006739260001268s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1825s for a response
I20260709 12:10:53.470920 16391 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.720410 16728 raft_consensus.cc:740] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:53.553463 16472 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:53.726265 13829 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 8.
I20260709 12:10:53.599850 16423 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:53.477183 16808 raft_consensus.cc:697] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 6 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:53.492272 16658 raft_consensus.cc:697] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 6 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
W20260709 12:10:53.738528 13800 connection.cc:256] RPC call timeout handler was delayed by -1.0943739260001166s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18320000000000003s for a response
I20260709 12:10:53.740085 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:53.738834 13727 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:10:53.759199 13800 connection.cc:256] RPC call timeout handler was delayed by -1.0943739260001166s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18320000000000003s for a response
I20260709 12:10:53.519279 16814 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:53.576043 16841 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.732441 16802 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:53.460489 16450 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:53.771394 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 244883us
I20260709 12:10:53.498751 16815 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:53.719815 16809 raft_consensus.cc:2804] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:53.778398 16809 raft_consensus.cc:697] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 7 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:53.779089 13762 raft_consensus.cc:1275] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:53.779335 16809 consensus_queue.cc:237] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:53.780228 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:10:53.780998 16818 consensus_meta.cc:287] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.522s	user 0.009s	sys 0.004s
I20260709 12:10:53.781426 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:53.735802 16838 raft_consensus.cc:2804] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:53.789433 16838 raft_consensus.cc:697] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:53.789103 16658 consensus_queue.cc:237] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:53.790372 16838 consensus_queue.cc:237] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:53.642940 16834 consensus_queue.cc:1059] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.100s
I20260709 12:10:53.792670 16834 raft_consensus.cc:3055] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:53.793018 16834 raft_consensus.cc:740] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:53.793530 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:53.793973 16834 consensus_queue.cc:260] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:53.795250 16834 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:53.795344 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:53.795956 13762 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 7.
I20260709 12:10:53.730680 16761 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:53.730834 16729 raft_consensus.cc:2749] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:53.767148 14412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 747) took 3133 ms. Trace:
I20260709 12:10:53.677553 16817 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:53.515232 16568 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:53.674010 16811 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:53.771677 16802 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:53.773396 16841 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:53.775207 16391 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:53.776430 16418 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 5 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:53.771799 16545 consensus_queue.cc:1048] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:10:53.721207 13832 rpcz_store.cc:276] 0709 12:10:52.320040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.550261 (+230221us) service_pool.cc:224] Handling call
0709 12:10:52.550693 (+   432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:52.850203 (+299510us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:53.160405 (+310202us) log.cc:844] Serialized 14 byte log entry
0709 12:10:53.492477 (+332072us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:53.521996 (+ 29519us) log.cc:844] Serialized 26 byte log entry
0709 12:10:53.522196 (+   200us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:53.522520 (+   324us) log.cc:844] Serialized 14 byte log entry
0709 12:10:53.548395 (+ 25875us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:53.548477 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:53.554180 (+  5703us) raft_consensus.cc:1685] finished
0709 12:10:53.554202 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:53.554354 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":98627,"prepare.queue_time_us":334614,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":374360,"raft.run_cpu_time_us":498,"raft.run_wall_time_us":20649,"spinlock_wait_cycles":6993664,"thread_start_us":765589,"threads_started":3,"wal-append.queue_time_us":347260}
I20260709 12:10:53.799162 14412 rpcz_store.cc:276] 0709 12:10:50.633629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.633745 (+   116us) service_pool.cc:224] Handling call
0709 12:10:50.653027 (+ 19282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:52.622780 (+1969753us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:53.766906 (+1144126us) spinlock_profiling.cc:243] Waited 1.89 s on lock 0x7b54006400d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:53.767087 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4342402944}
I20260709 12:10:53.818291 14413 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 7.
I20260709 12:10:53.770233 16773 raft_consensus.cc:2804] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:53.818897 16773 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:53.819290 16773 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:53.819810 16344 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.820513 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:53.808524 16808 consensus_queue.cc:237] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:53.752622 16820 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:53.807265 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:53.803158 16846 consensus_queue.cc:1048] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:10:53.821993 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:53.822932 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:53.788148 16818 raft_consensus.cc:2749] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:53.823490 13829 raft_consensus.cc:2376] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 6. Re-sending same reply.
I20260709 12:10:53.742726 16636 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:53.823943 16761 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 6 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:53.824381 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:53.824946 14416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:46814 (request call id 2) took 2254 ms. Trace:
W20260709 12:10:53.799474 16816 consensus_meta.cc:287] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.556s	user 0.013s	sys 0.005s
I20260709 12:10:53.812937 13800 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:53.818584 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:53.814165 13680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2069) took 2257 ms. Trace:
I20260709 12:10:53.837675 16818 raft_consensus.cc:2804] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:10:53.838140 16788 consensus_meta.cc:287] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.601s	user 0.011s	sys 0.005s
I20260709 12:10:53.838200 16818 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:53.805209 16817 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:53.837996 13680 rpcz_store.cc:276] 0709 12:10:51.556921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.001721 (+1444800us) service_pool.cc:224] Handling call
0709 12:10:53.018444 (+ 16723us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:53.018866 (+   422us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:53.018898 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:53.019841 (+   943us) log.cc:844] Serialized 26 byte log entry
0709 12:10:53.199316 (+179475us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:53.199359 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:53.199422 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:53.813958 (+614536us) raft_consensus.cc:1685] finished
0709 12:10:53.813977 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:53.814105 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11350,"raft.run_cpu_time_us":287,"raft.run_wall_time_us":6805,"thread_start_us":178978,"threads_started":1,"wal-append.queue_time_us":395936}
I20260709 12:10:53.825357 14416 rpcz_store.cc:276] 0709 12:10:51.570029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:51.570295 (+   266us) service_pool.cc:224] Handling call
0709 12:10:53.824745 (+2254450us) spinlock_profiling.cc:243] Waited 830 ms on lock 0x7b54004d6054. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f87853 00007fa92cf5560a 00007fa9264db7d4 00007fa9264db762 00007fa9264db691 00007fa9264db60c 00007fa9264da8c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:53.824860 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1910119168}
I20260709 12:10:53.828500 13834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 2189) took 1097 ms. Trace:
I20260709 12:10:53.839296 14412 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 6.
I20260709 12:10:53.815867 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:53.816917 16391 leader_election.cc:290] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:53.820369 16344 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:53.809796 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:53.825497 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:53.778419 16728 consensus_queue.cc:260] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:53.847867 14407 raft_consensus.cc:2393] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 5: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
W20260709 12:10:53.821593 16403 consensus_meta.cc:287] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.973s	user 0.012s	sys 0.003s
I20260709 12:10:53.848757 16403 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:53.825565 16636 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:53.826176 13763 raft_consensus.cc:2410] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:53.850878 13758 raft_consensus.cc:2410] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:10:53.853475 13829 raft_consensus.cc:2393] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 5: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:53.823549 16820 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:53.847788 16728 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:53.849186 14407 raft_consensus.cc:1240] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:53.817704 16841 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:53.838687 16788 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:53.838827 16818 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:53.843272 13834 rpcz_store.cc:276] 0709 12:10:52.730780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.798592 (+ 67812us) service_pool.cc:224] Handling call
0709 12:10:52.799026 (+   434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:52.799291 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:53.059750 (+260459us) log.cc:844] Serialized 14 byte log entry
0709 12:10:53.827846 (+768096us) spinlock_profiling.cc:243] Waited 1.24 ms on lock 0x7b18003df840. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa927b354bc 00007fa924e8348b 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9fc02 00007fa927b2720b 00007fa927b2cd23 00007fa927b2d23a
0709 12:10:53.828092 (+   246us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:53.828156 (+    64us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:53.828213 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:53.828301 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:53.828435 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":359131,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":6404,"raft.queue_time_us":8466,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":90,"spinlock_wait_cycles":2863488,"thread_start_us":369111,"threads_started":2,"wal-append.queue_time_us":328178}
I20260709 12:10:53.840409 16468 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.873881 16811 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 5 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:53.881104 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:53.814613 14379 leader_election.cc:304] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:53.841351 16480 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.840612 16816 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:53.842648 16545 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:53.866779 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:53.865854 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:10:53.843137 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 70693.7us
I20260709 12:10:53.920939 16442 raft_consensus.cc:3055] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:10:53.918226 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.927592 16811 raft_consensus.cc:2749] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:53.927968 16442 raft_consensus.cc:740] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:53.882220 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:10:53.928838 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 114335us
I20260709 12:10:53.929679 13762 raft_consensus.cc:1240] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:53.931995 16442 consensus_queue.cc:260] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:53.919797 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:53.934351 13831 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 5.
I20260709 12:10:53.891681 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:53.936112 14416 raft_consensus.cc:2410] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:10:53.934798 13757 raft_consensus.cc:2393] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 7: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:53.937613 16480 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:53.934427 13652 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:53.933284 16442 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:53.940847 13836 raft_consensus.cc:1240] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:53.872640 16468 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:53.882563 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:53.947140 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:53.948457 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:53.958036 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:10:53.956077 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 59951.6us
W20260709 12:10:53.968502 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.970955 13762 raft_consensus.cc:1275] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:10:53.971462 13762 pending_rounds.cc:85] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting all ops after (but not including) 6
I20260709 12:10:53.971701 13762 pending_rounds.cc:107] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:10:53.971966 13762 raft_consensus.cc:2889] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:53.975382 16619 consensus_queue.cc:1048] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:53.958212 16545 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:53.982666 13652 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:53.990119 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:53.991685 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:53.991500 16817 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:53.993238 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:53.996011 16403 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:10:54.010336 16851 log.cc:927] Time spent T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 12:10:54.006054 16718 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:54.012490 16788 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:53.981600 16811 consensus_queue.cc:1048] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:10:53.963430 16777 raft_consensus.cc:2749] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:54.012205 16718 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:54.019670 13828 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 8.
I20260709 12:10:53.995472 16480 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:54.014758 13682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2050) took 2701 ms. Trace:
W20260709 12:10:54.022722 13684 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1338) took 2351 ms (client timeout 1726 ms). Trace:
W20260709 12:10:54.023237 13684 rpcz_store.cc:269] 0709 12:10:51.671337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.256686 (+585349us) service_pool.cc:224] Handling call
0709 12:10:54.022479 (+1765793us) spinlock_profiling.cc:243] Waited 494 ms on lock 0x7b54003f0cd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:54.022645 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1137333888}
I20260709 12:10:54.014223 16817 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:54.015054 16619 raft_consensus.cc:2749] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:54.024351 16743 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:54.021791 13682 rpcz_store.cc:276] 0709 12:10:51.313229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:51.323030 (+  9801us) service_pool.cc:224] Handling call
0709 12:10:51.337840 (+ 14810us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:51.338309 (+   469us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:51.338352 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:51.619607 (+281255us) spinlock_profiling.cc:243] Waited 4.13 ms on lock 0x7b1800313cc0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924ea03f3 00007fa924ea27c1 00007fa924ea2779 00007fa924ea2709 00007fa924ea26d1 00007fa924ea19cd 0000000000388634 0000000000388479 00007fa924e8383a
0709 12:10:53.517944 (+1898337us) spinlock_profiling.cc:243] Waited 1.43 ms on lock 0x7b2c000014c8. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa926886a11 00007fa926896372 00007fa927fc8a01 00007fa927f8d43a 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2
0709 12:10:53.555158 (+ 37214us) log.cc:844] Serialized 26 byte log entry
0709 12:10:53.765829 (+210671us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:53.765874 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:53.765942 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:54.014500 (+248558us) raft_consensus.cc:1685] finished
0709 12:10:54.014521 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:54.014675 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23006,"raft.queue_time_us":2623,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"spinlock_wait_cycles":12790400,"thread_start_us":156676,"threads_started":1,"wal-append.queue_time_us":243886}
W20260709 12:10:54.024494 16765 log.cc:927] Time spent T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 2.586s	user 0.008s	sys 0.000s
W20260709 12:10:54.036717 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.030977 13835 raft_consensus.cc:1240] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:54.029685 13652 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:10:54.030372 13833 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54830 (request call id 2072) took 2127 ms (client timeout 2024 ms). Trace:
W20260709 12:10:54.045919 13833 rpcz_store.cc:269] 0709 12:10:51.903172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:51.981980 (+ 78808us) service_pool.cc:224] Handling call
0709 12:10:54.030177 (+2048197us) spinlock_profiling.cc:243] Waited 406 ms on lock 0x7b54003ba1d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:54.030304 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":933099776}
I20260709 12:10:54.047349 13652 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:54.049187 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:54.049959 13681 raft_consensus.cc:2468] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 4.
I20260709 12:10:54.051764 16545 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:54.052424 13687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2047) took 2875 ms. Trace:
I20260709 12:10:54.052426 16545 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:54.055564 16545 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:54.056509 13684 raft_consensus.cc:1240] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:54.052906 13687 rpcz_store.cc:276] 0709 12:10:51.177494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:51.177644 (+   150us) service_pool.cc:224] Handling call
0709 12:10:51.178064 (+   420us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:51.243937 (+ 65873us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:51.243977 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:51.265752 (+ 21775us) log.cc:844] Serialized 52 byte log entry
0709 12:10:51.411039 (+145287us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:51.541928 (+130889us) log.cc:844] Serialized 14 byte log entry
0709 12:10:51.548559 (+  6631us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:51.548677 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:54.018251 (+2469574us) spinlock_profiling.cc:243] Waited 41.4 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:10:54.052131 (+ 33880us) raft_consensus.cc:1685] finished
0709 12:10:54.052232 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:54.052364 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28177,"prepare.queue_time_us":135043,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":29493,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":7996,"spinlock_wait_cycles":95120256,"thread_start_us":190901,"threads_started":2,"wal-append.queue_time_us":156636}
I20260709 12:10:54.059240 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:54.061107 13652 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:54.061291 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:54.062099 13682 raft_consensus.cc:2468] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 6.
I20260709 12:10:54.065909 16468 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:54.045047 15941 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:54.066891 16545 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:54.066989 16718 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:54.067349 15941 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:54.068109 16856 log.cc:927] Time spent T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:10:54.059952 16743 raft_consensus.cc:2749] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:54.055569 16862 log.cc:927] Time spent T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 12:10:54.072633 13652 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:54.073421 13683 raft_consensus.cc:1275] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:10:54.078253 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:54.081697 16743 raft_consensus.cc:2749] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:54.080924 15941 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:54.088936 14380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.100518 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:54.090181 13801 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
W20260709 12:10:54.092785 13756 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48114 (request call id 2130) took 3722 ms (client timeout 2914 ms). Trace:
I20260709 12:10:54.100183 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:54.099843 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:10:54.091907 13758 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48120 (request call id 1518) took 2549 ms (client timeout 1966 ms). Trace:
W20260709 12:10:54.102906 13756 rpcz_store.cc:269] 0709 12:10:50.370335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.382452 (+ 12117us) service_pool.cc:224] Handling call
0709 12:10:54.092608 (+3710156us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b540035edd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:54.092711 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2794709760}
I20260709 12:10:54.104790 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:54.105370 13679 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 6.
W20260709 12:10:54.103358 13758 rpcz_store.cc:269] 0709 12:10:51.542156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:51.557860 (+ 15704us) service_pool.cc:224] Handling call
0709 12:10:54.091662 (+2533802us) spinlock_profiling.cc:243] Waited 2.28 s on lock 0x7b54003336d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:54.091802 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5249575680}
I20260709 12:10:54.108232 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:54.059752 16853 raft_consensus.cc:2804] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:54.111038 13684 raft_consensus.cc:3060] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:54.063249 16777 raft_consensus.cc:2804] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:54.112317 16777 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:54.107426 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:54.028620 16773 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:54.117640 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 45098.7us
I20260709 12:10:54.115272 13687 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 5.
I20260709 12:10:54.121117 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:54.129074 13760 raft_consensus.cc:2393] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 7: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:54.128717 16608 consensus_queue.cc:1059] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:54.135481 16473 consensus_queue.cc:1059] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:54.135824 16608 raft_consensus.cc:3055] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:54.136302 16608 raft_consensus.cc:740] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:54.136394 16473 raft_consensus.cc:3055] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:54.136870 16473 raft_consensus.cc:740] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:54.137660 16473 consensus_queue.cc:260] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:54.124851 16808 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:10:54.138729 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.138614 13727 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:54.139135 16473 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:54.140542 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:54.140370 16545 consensus_queue.cc:1059] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:54.141219 15941 raft_consensus.cc:2804] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:54.141762 15941 raft_consensus.cc:697] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:54.138763 16808 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:54.142563 16808 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:54.142773 15941 consensus_queue.cc:237] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:54.143805 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:54.145066 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:10:54.133859 13652 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:54.147269 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:54.147624 16842 raft_consensus.cc:2804] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:54.148013 14407 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:54.148229 16842 raft_consensus.cc:697] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 6 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:54.148725 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:54.149441 13837 raft_consensus.cc:2468] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 6.
I20260709 12:10:54.149180 16842 consensus_queue.cc:237] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:54.150461 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:54.135269 13684 raft_consensus.cc:2468] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 5.
I20260709 12:10:54.105624 16734 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:54.156031 16848 consensus_queue.cc:1048] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:54.168176 16743 consensus_queue.cc:1048] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:54.177867 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:54.178936 16848 consensus_queue.cc:1243] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer 96701a74fdee481fb5f54aac841e17dd log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:10:54.168676 16344 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:54.170998 13652 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:54.118606 16777 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:54.180092 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:54.176345 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:10:54.181520 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.181535 14414 raft_consensus.cc:2393] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 6: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:10:54.182637 14409 raft_consensus.cc:1275] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:10:54.183054 14409 pending_rounds.cc:85] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f: Aborting all ops after (but not including) 6
I20260709 12:10:54.183283 14409 pending_rounds.cc:107] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:10:54.183511 14409 raft_consensus.cc:2889] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:54.185348 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:54.185997 14416 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 7.
I20260709 12:10:54.188127 16777 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:54.189250 16848 raft_consensus.cc:2749] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:54.187054 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:54.197887 14414 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 6.
I20260709 12:10:54.190879 13759 raft_consensus.cc:1240] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 LEADER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:10:54.192234 13652 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:54.208176 14380 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:54.209949 14380 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:54.211225 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:54.212734 13652 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:54.213505 14380 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:54.213914 13652 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:54.215471 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:54.217059 13830 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 6.
I20260709 12:10:54.216071 13727 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:54.217724 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:54.218586 13837 raft_consensus.cc:3060] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:54.219823 16716 raft_consensus.cc:2804] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:54.225277 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:54.225958 13833 raft_consensus.cc:3060] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:54.097710 16802 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:54.220322 16716 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:54.240911 14414 raft_consensus.cc:1275] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:10:54.242146 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.217868 16734 raft_consensus.cc:2804] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:54.236711 13727 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:54.237049 13652 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:54.238024 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:54.251266 13830 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 7.
I20260709 12:10:54.218778 16473 raft_consensus.cc:2749] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:54.245662 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:54.219303 16811 raft_consensus.cc:2804] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:54.231654 16391 raft_consensus.cc:2749] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:54.244500 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:54.262820 13832 raft_consensus.cc:3060] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:54.249185 16468 raft_consensus.cc:2804] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:54.137307 16608 consensus_queue.cc:260] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:54.234090 13833 raft_consensus.cc:2468] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 5.
I20260709 12:10:54.217660 16834 consensus_queue.cc:1048] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:10:54.255300 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:54.248124 16734 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:54.256669 16473 raft_consensus.cc:2749] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:54.259033 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:54.359262 13683 raft_consensus.cc:2468] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 7.
I20260709 12:10:54.232892 16619 raft_consensus.cc:2749] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:54.245072 16716 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:54.264813 13652 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:54.216315 16344 consensus_queue.cc:1048] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:10:54.265872 16468 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:54.222470 16718 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:54.250201 16848 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:54.265614 16811 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:54.381974 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 117224us
I20260709 12:10:54.398551 13652 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:54.254181 14380 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:10:54.350140 16825 log.cc:927] Time spent T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:10:54.356495 16734 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:54.413317 13652 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:54.393975 16468 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:54.386358 16391 raft_consensus.cc:2749] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:54.391299 16718 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:54.403860 16811 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:54.423192 16619 raft_consensus.cc:2749] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:54.427029 16834 consensus_queue.cc:1048] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:54.427765 16718 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:54.428565 16761 raft_consensus.cc:2804] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:54.407526 16842 raft_consensus.cc:2749] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:10:54.434836 16818 consensus_meta.cc:287] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.563s	user 0.011s	sys 0.000s
I20260709 12:10:54.441118 14407 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 7.
I20260709 12:10:54.425679 16560 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.403352 16848 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:54.444203 13837 raft_consensus.cc:2468] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 6.
I20260709 12:10:54.437070 16808 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:54.432863 16547 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:54.461372 13652 connection.cc:256] RPC call timeout handler was delayed by -1.2507450359998984s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1786s for a response
I20260709 12:10:54.473075 13837 raft_consensus.cc:1275] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:10:54.467788 13727 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:54.451484 16761 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:54.498944 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:54.500139 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 119021us
I20260709 12:10:54.501986 14379 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:54.502908 16841 raft_consensus.cc:2804] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:54.503314 16841 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:54.503660 16841 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:54.515520 14379 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:54.520854 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:54.489020 16545 raft_consensus.cc:2804] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:54.489283 16761 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:54.468346 16818 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:54.522650 16602 raft_consensus.cc:3055] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:54.477908 16560 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:54.547662 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 325298us
I20260709 12:10:54.482359 16547 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:54.549000 14380 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:10:54.539551 14411 consensus_meta.cc:287] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.518s	user 0.008s	sys 0.004s
I20260709 12:10:54.554459 13833 raft_consensus.cc:1240] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:54.556828 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:54.561210 13835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 2186) took 1831 ms. Trace:
I20260709 12:10:54.561719 13835 rpcz_store.cc:276] 0709 12:10:52.729892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.743513 (+ 13621us) service_pool.cc:224] Handling call
0709 12:10:54.030774 (+1287261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:54.044737 (+ 13963us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.560972 (+516235us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54003ba1d0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:54.561135 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2933071104}
I20260709 12:10:54.563732 16560 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:54.567131 16816 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:54.570796 16876 raft_consensus.cc:2804] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:54.539898 16545 raft_consensus.cc:697] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:54.546999 16602 raft_consensus.cc:740] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:54.579286 16808 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:54.579762 13836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 2204) took 1175 ms. Trace:
I20260709 12:10:54.591751 13836 rpcz_store.cc:276] 0709 12:10:53.404258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.736646 (+332388us) service_pool.cc:224] Handling call
0709 12:10:53.736980 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:53.955246 (+218266us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.579490 (+624244us) spinlock_profiling.cc:243] Waited 204 ms on lock 0x7b5400167bd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:54.579695 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":468231424}
I20260709 12:10:54.580348 13727 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:54.580895 16802 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:54.565485 16874 log.cc:927] Time spent T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:10:54.595201 13582 catalog_manager.cc:5697] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 4 to 6, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 6 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:10:54.588056 13832 raft_consensus.cc:2468] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 5.
I20260709 12:10:54.540298 16777 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:54.582682 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:54.597715 13582 catalog_manager.cc:5697] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 2 to 3, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 3 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
W20260709 12:10:54.626259 13583 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45618 (request call id 232) took 31782 ms (client timeout 15000 ms). Trace:
I20260709 12:10:54.631528 16592 raft_consensus.cc:2764] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:10:54.630851 13582 catalog_manager.cc:5697] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:10:54.634267 13760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38932 (request call id 427) took 1365 ms. Trace:
I20260709 12:10:54.634141 13582 catalog_manager.cc:5697] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 4 to 5, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 5 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:54.634667 13760 rpcz_store.cc:276] 0709 12:10:53.268764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.275885 (+  7121us) service_pool.cc:224] Handling call
0709 12:10:53.946998 (+671113us) spinlock_profiling.cc:243] Waited 6.58 ms on lock 0x7b58001e3f98. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924e68e9c 00007fa924e68a5b 00007fa92dd818d9 00007fa92cedbee0 00007fa92cfa50ab 00007fa92cfa5131 00007fa92cf530a0 00007fa92cf52984 00007fa9264cd6d4 00007fa9264cd662
0709 12:10:54.634055 (+687057us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b54000924d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:54.634207 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":410936576}
I20260709 12:10:54.636052 13582 catalog_manager.cc:5697] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
W20260709 12:10:54.637038 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.637989 13582 catalog_manager.cc:5697] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 3 to 4, leader changed from ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 4 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:10:54.626855 13583 rpcz_store.cc:269] 0709 12:10:22.849589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.899931 (+ 50342us) service_pool.cc:224] Handling call
0709 12:10:54.625961 (+31726030us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:42.610609 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:42.615060 (+  4451us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:42.615093 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:10:42.615108 (+    15us) tablet.cc:662] Decoding operations
0709 12:10:42.616161 (+  1053us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:42.616218 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:42.616246 (+    28us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:10:42.617023 (+   777us) tablet.cc:701] Row locks acquired
0709 12:10:42.617042 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:10:42.617186 (+   144us) write_op.cc:270] Start()
0709 12:10:42.617308 (+   122us) write_op.cc:276] Timestamp: P: 1783599042617140 usec, L: 0
0709 12:10:42.617328 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:10:42.719284 (+101956us) log.cc:844] Serialized 4020 byte log entry
0709 12:10:43.710510 (+991226us) spinlock_profiling.cc:243] Waited 6.54 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:10:44.391084 (+680574us) op_driver.cc:464] REPLICATION: finished
0709 12:10:44.567551 (+176467us) write_op.cc:301] APPLY: starting
0709 12:10:44.567643 (+    92us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:44.567889 (+   246us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:44.567907 (+    18us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:44.734960 (+167053us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:44.742115 (+  7155us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 12:10:44.742190 (+    75us) write_op.cc:312] APPLY: finished
0709 12:10:44.742530 (+   340us) log.cc:844] Serialized 77 byte log entry
0709 12:10:44.742736 (+   206us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:44.742877 (+   141us) write_op.cc:454] Released schema lock
0709 12:10:44.742933 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:44.743431 (+   498us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:44.743468 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":979279,"reported_tablets":30,"spinlock_wait_cycles":8576,"child_traces":[["op",{"apply.queue_time_us":175703,"apply.run_cpu_time_us":4916,"apply.run_wall_time_us":175827,"num_ops":10,"prepare.queue_time_us":218971,"prepare.run_cpu_time_us":18113,"prepare.run_wall_time_us":337339,"raft.queue_time_us":254325,"raft.run_cpu_time_us":18234,"raft.run_wall_time_us":171739,"replication_time_us":1750708,"spinlock_wait_cycles":15032576,"thread_start_us":481178,"threads_started":4,"wal-append.queue_time_us":269764,"wal-append.run_cpu_time_us":9525,"wal-append.run_wall_time_us":2753980}]]}
I20260709 12:10:54.553066 14411 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 6.
I20260709 12:10:54.591157 16876 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:54.650732 13755 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48120 (request call id 1514) took 3174 ms (client timeout 1832 ms). Trace:
I20260709 12:10:54.650892 13754 raft_consensus.cc:1240] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 6. Current term is 7. Ops: []
W20260709 12:10:54.651412 13755 rpcz_store.cc:269] 0709 12:10:51.476765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:51.482847 (+  6082us) service_pool.cc:224] Handling call
0709 12:10:54.650450 (+3167603us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54000898d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:54.650646 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2577593600}
I20260709 12:10:54.610865 16838 raft_consensus.cc:2749] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:10:54.658937 13726 leader_election.cc:336] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.679s (SENT)
W20260709 12:10:54.661142 16863 log.cc:927] Time spent T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:10:54.660841 13582 catalog_manager.cc:5697] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 4 to 5, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 5 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:10:54.666739 16547 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:54.667303 16818 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:54.677920 13582 catalog_manager.cc:5697] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 2 to 4, leader changed from ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 4 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:54.653162 16876 raft_consensus.cc:3060] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:54.682353 16602 consensus_queue.cc:260] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:54.683822 16602 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:54.686074 16848 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:54.687322 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:54.689116 16716 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:54.689116 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:54.694739 16716 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 9 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:54.695549 16545 consensus_queue.cc:237] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:54.697906 13680 raft_consensus.cc:1275] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:10:54.700158 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:54.701242 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 223695us
I20260709 12:10:54.698006 13582 catalog_manager.cc:5697] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 3 to 4, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 4 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:54.706692 13652 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:54.711742 13652 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:10:54.715399 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 166481us
I20260709 12:10:54.716921 14380 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:54.672940 16734 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:54.708065 13582 catalog_manager.cc:5697] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 4 to 5, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 5 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:54.698612 16841 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:54.736835 14414 raft_consensus.cc:1240] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:54.731381 14380 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:54.713466 16846 raft_consensus.cc:2749] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:54.716809 16777 raft_consensus.cc:2804] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:10:54.739651 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 221212us
I20260709 12:10:54.743340 13652 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:54.745223 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:54.745332 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:54.747047 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:10:54.749461 14380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.737145 16716 raft_consensus.cc:2804] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:54.752398 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:54.752306 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:54.754247 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:54.754958 13683 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 5.
I20260709 12:10:54.755266 14380 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:54.756888 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:54.758047 16817 consensus_queue.cc:1048] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:54.759459 14379 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:54.760366 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:54.760667 13582 catalog_manager.cc:5697] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 4 to 5, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 5 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:10:54.761339 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:54.762064 13688 raft_consensus.cc:2468] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 6.
I20260709 12:10:54.762861 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:54.765077 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:54.736707 16702 consensus_queue.cc:1059] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:10:54.762472 13582 catalog_manager.cc:5697] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:54.764796 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:54.779093 13829 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:54.782786 14411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 752) took 1019 ms. Trace:
I20260709 12:10:54.783254 14411 rpcz_store.cc:276] 0709 12:10:53.763574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.821689 (+ 58115us) service_pool.cc:224] Handling call
0709 12:10:54.782579 (+960890us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b540059e554. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:54.782717 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":365323520}
I20260709 12:10:54.752907 16818 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.787050 16818 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:54.787827 14410 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41700 (request call id 394) took 2079 ms (client timeout 1806 ms). Trace:
W20260709 12:10:54.788250 14410 rpcz_store.cc:269] 0709 12:10:52.708182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.708363 (+   181us) service_pool.cc:224] Handling call
0709 12:10:54.787617 (+2079254us) spinlock_profiling.cc:243] Waited 973 ms on lock 0x7b54007102d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:54.787760 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2237387008}
I20260709 12:10:54.789227 16818 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:54.789326 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:54.791065 16718 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:54.791592 16773 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:54.793090 16468 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:54.749528 16419 raft_consensus.cc:2804] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:54.750663 16689 raft_consensus.cc:2804] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:54.804883 16689 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:54.804998 16883 consensus_queue.cc:1048] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:54.805374 16689 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:54.806967 16883 raft_consensus.cc:2804] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:54.807540 16883 raft_consensus.cc:697] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 5 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:54.808410 16883 consensus_queue.cc:237] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:54.745051 16777 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:54.799049 13829 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 9.
I20260709 12:10:54.799767 13830 raft_consensus.cc:1275] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:54.800312 14408 raft_consensus.cc:1240] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 1. Current term is 3. Ops: []
I20260709 12:10:54.801425 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:54.811792 14410 raft_consensus.cc:1275] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:54.784962 16761 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:54.793824 13754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2151) took 2508 ms. Trace:
I20260709 12:10:54.815095 13754 rpcz_store.cc:276] 0709 12:10:52.285084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.395876 (+110792us) service_pool.cc:224] Handling call
0709 12:10:54.650632 (+2254756us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:54.651999 (+  1367us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.793574 (+141575us) spinlock_profiling.cc:243] Waited 2.2 s on lock 0x7b54000898d0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:54.793729 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5057696512}
W20260709 12:10:54.815855 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.750415 16592 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:54.824522 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:54.824852 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:54.825570 13756 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 7.
I20260709 12:10:54.827677 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:54.827863 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:54.809808 16738 raft_consensus.cc:3055] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:54.830675 13760 raft_consensus.cc:2368] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 6. Current term is 7.
I20260709 12:10:54.831898 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:54.814126 16777 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:54.832499 13754 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 6.
I20260709 12:10:54.762916 16877 consensus_queue.cc:1048] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 12:10:54.833253 13762 raft_consensus.cc:1240] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:54.818547 16838 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.818389 16547 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:54.828088 16588 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.843757 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:54.828836 16602 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.818039 16773 consensus_queue.cc:1059] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 12:10:54.831508 16738 raft_consensus.cc:740] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:54.833033 16716 raft_consensus.cc:697] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 5 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:54.829607 16802 consensus_queue.cc:1048] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:10:54.858260 16738 consensus_queue.cc:260] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:54.859663 16738 raft_consensus.cc:3060] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:54.826624 16592 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:54.862732 16718 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:54.834228 16882 consensus_queue.cc:1059] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:10:54.863734 16592 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:54.864382 16592 raft_consensus.cc:2749] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:54.865152 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:54.865535 16773 raft_consensus.cc:3055] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:54.866055 16773 raft_consensus.cc:740] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:54.866441 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:54.867027 16773 consensus_queue.cc:260] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:54.868387 16773 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:54.868732 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:54.869602 13763 raft_consensus.cc:2393] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 7: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:54.843596 16547 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:54.870185 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:54.842499 16838 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:54.870908 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:54.873839 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:54.880015 13762 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:54.872418 13758 raft_consensus.cc:2468] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 7.
W20260709 12:10:54.881393 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.881922 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:54.883039 13758 raft_consensus.cc:2393] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 7: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:54.884660 13763 raft_consensus.cc:1275] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:54.886837 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:10:54.888778 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.891526 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:54.893184 13760 raft_consensus.cc:2393] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 8: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
W20260709 12:10:54.893507 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 134105us
I20260709 12:10:54.855820 16611 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:54.900923 13759 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 4.
I20260709 12:10:54.910810 13762 raft_consensus.cc:2410] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:10:54.913318 16689 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:54.915396 16689 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:10:54.919014 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 162508us
I20260709 12:10:54.920547 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:54.853343 16602 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:54.921754 14379 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:54.924700 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:54.856164 16588 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:54.895815 16419 raft_consensus.cc:697] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 6 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:54.928746 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:54.929388 13834 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:54.929908 14380 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:54.900338 16841 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:54.939982 14379 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:54.942143 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:54.948211 16887 raft_consensus.cc:2749] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:54.956306 16891 raft_consensus.cc:2804] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:54.962517 14379 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:54.972695 13834 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 8.
I20260709 12:10:54.930011 16876 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:54.980104 14379 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:54.962333 16891 raft_consensus.cc:697] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 9 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:54.982874 14380 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:10:54.986588 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.988317 16882 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:55.005955 16886 log.cc:927] Time spent T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:10:54.955413 16716 consensus_queue.cc:237] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:55.014158 16761 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:55.014947 16602 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:55.015561 16547 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:55.023089 16588 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:54.988690 16468 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:54.988966 16887 consensus_queue.cc:1048] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:10:55.025743 16876 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:55.000258 16419 consensus_queue.cc:237] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:55.032778 13754 raft_consensus.cc:1240] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 1. Current term is 3. Ops: []
W20260709 12:10:55.035086 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 55060.3us
W20260709 12:10:55.035967 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.038522 14409 raft_consensus.cc:2393] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 8: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
W20260709 12:10:55.039129 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 56384.8us
I20260709 12:10:55.043553 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:55.044239 13831 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:55.042204 16890 raft_consensus.cc:2804] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:55.046104 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:55.046365 16890 raft_consensus.cc:697] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 8 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:55.046763 14414 raft_consensus.cc:2376] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 6. Re-sending same reply.
I20260709 12:10:55.047778 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
W20260709 12:10:55.051981 16811 consensus_meta.cc:287] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.589s	user 0.008s	sys 0.002s
I20260709 12:10:55.052513 16811 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:55.054610 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:55.047358 16890 consensus_queue.cc:237] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:55.059736 13763 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 8.
I20260709 12:10:55.041520 16610 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:55.091403 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:55.092088 13757 raft_consensus.cc:3060] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:55.092504 13831 raft_consensus.cc:2468] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 7.
I20260709 12:10:55.083099 13652 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:55.094082 14380 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:55.104786 16883 raft_consensus.cc:2804] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:55.100221 16841 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:55.034476 16891 consensus_queue.cc:237] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:55.176090 13757 raft_consensus.cc:2468] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 8.
I20260709 12:10:55.101608 16705 raft_consensus.cc:2804] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:55.079139 16777 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:55.220778 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.241922 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:55.242830 13831 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:55.183799 16883 raft_consensus.cc:697] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 7 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
W20260709 12:10:55.244613 16894 log.cc:927] Time spent T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 12:10:55.238291 16705 raft_consensus.cc:697] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 6 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:55.270485 13831 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 6.
I20260709 12:10:55.271978 14380 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:55.233067 16811 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 6 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:55.273418 13686 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 2.
I20260709 12:10:55.285215 16876 raft_consensus.cc:2804] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:55.286361 16636 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:55.302382 13651 connection.cc:256] RPC call timeout handler was delayed by -1.2648156499999459s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2237s for a response
W20260709 12:10:55.302888 13651 connection.cc:256] RPC call timeout handler was delayed by -1.2533621370000674s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.29140000000000005s for a response
W20260709 12:10:55.303248 13651 connection.cc:256] RPC call timeout handler was delayed by -1.1821879569997691s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1622s for a response
I20260709 12:10:55.308835 13651 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:10:55.317582 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:55.325836 16896 log.cc:927] Time spent T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 12:10:55.316802 16689 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:55.327035 16897 log.cc:927] Time spent T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:10:55.326812 16689 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:55.330814 13651 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:55.319483 16876 raft_consensus.cc:697] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 6 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:55.339196 13651 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:55.339368 16741 raft_consensus.cc:2749] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:55.333199 16560 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:55.340831 13651 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:55.317123 16636 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:55.295444 16883 consensus_queue.cc:237] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:55.342643 16618 raft_consensus.cc:2749] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:10:55.349143 13686 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2053) took 3937 ms (client timeout 1679 ms). Trace:
W20260709 12:10:55.349598 13686 rpcz_store.cc:269] 0709 12:10:51.412111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:51.412256 (+   145us) service_pool.cc:224] Handling call
0709 12:10:55.348937 (+3936681us) spinlock_profiling.cc:243] Waited 3.85 s on lock 0x7b54002c4054. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:55.349045 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8851020032}
I20260709 12:10:55.350849 16610 raft_consensus.cc:2749] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:55.318382 16705 consensus_queue.cc:237] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:55.344236 16702 raft_consensus.cc:2804] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:55.357765 16702 raft_consensus.cc:697] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 8 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:55.359349 16689 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:55.360790 16702 consensus_queue.cc:237] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:55.343654 16777 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:55.356405 16882 raft_consensus.cc:2749] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:55.402408 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:55.409366 14412 raft_consensus.cc:1240] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:55.415380 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:55.416056 13831 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:55.417523 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 72775.7us
I20260709 12:10:55.418954 13651 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:55.390377 16876 consensus_queue.cc:237] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:55.426560 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:55.426731 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:55.428396 13829 raft_consensus.cc:2393] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 9: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:55.431877 13831 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 7.
W20260709 12:10:55.432085 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.436067 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:55.436952 13651 leader_election.cc:304] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:55.438174 13834 raft_consensus.cc:2410] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 12 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:10:55.440016 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:55.440954 13831 raft_consensus.cc:2393] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 5: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:55.433041 16738 raft_consensus.cc:2749] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:55.446450 16689 raft_consensus.cc:2804] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:55.447014 16689 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:55.447500 16689 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:55.448380 16910 consensus_queue.cc:1059] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:55.452116 13834 raft_consensus.cc:1275] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:10:55.454835 13800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.457401 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:55.458393 13761 raft_consensus.cc:2410] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:10:55.459270 13834 raft_consensus.cc:1275] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:10:55.477728 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:55.457665 16910 consensus_queue.cc:1243] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer 3f37c9cc9dda46b4be21dd675ba78fb7 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:10:55.484483 16689 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:55.485329 16734 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:55.487880 16689 leader_election.cc:290] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:55.492887 16636 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:55.500450 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:55.500952 16832 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:55.501639 16832 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:55.504554 16832 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:55.506996 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:55.507705 13831 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 9.
I20260709 12:10:55.508097 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:55.508666 13833 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:55.508937 13832 raft_consensus.cc:1275] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:55.510031 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:10:55.514216 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.524854 13834 raft_consensus.cc:1275] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:55.526582 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:55.527282 13684 raft_consensus.cc:2468] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 5.
I20260709 12:10:55.536496 13833 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 6.
I20260709 12:10:55.544159 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:55.545228 13834 raft_consensus.cc:1275] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:55.545346 14379 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
W20260709 12:10:55.547539 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.549352 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:55.549319 14415 raft_consensus.cc:1240] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 9 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:55.549288 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:55.551044 13686 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:55.550243 13688 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:55.552345 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:55.553013 13684 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:55.558205 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:55.558993 13680 raft_consensus.cc:3060] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:55.572484 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:55.573381 13757 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:55.593605 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:55.594617 13761 raft_consensus.cc:1275] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:55.552371 16887 raft_consensus.cc:2804] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:55.617753 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:10:55.623847 13800 connection.cc:256] RPC call timeout handler was delayed by -1.1124839270000848s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3735s for a response
W20260709 12:10:55.624543 13800 connection.cc:256] RPC call timeout handler was delayed by -1.0193144540000958s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23500000000000001s for a response
I20260709 12:10:55.586666 16560 raft_consensus.cc:2749] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:55.577910 16705 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:55.565330 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:55.629061 13759 raft_consensus.cc:1275] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:55.552428 16734 consensus_queue.cc:1048] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
W20260709 12:10:55.636011 16912 log.cc:927] Time spent T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:10:55.616858 16887 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:55.642338 16887 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:55.551955 16610 consensus_queue.cc:1048] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 12:10:55.611676 16832 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:55.650825 13688 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 6.
I20260709 12:10:55.628460 16841 raft_consensus.cc:2749] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:55.661614 14410 raft_consensus.cc:1240] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:55.666924 13757 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 8.
I20260709 12:10:55.676658 13680 raft_consensus.cc:2468] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 8.
I20260709 12:10:55.670571 13684 raft_consensus.cc:2468] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 7.
I20260709 12:10:55.652421 16705 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:55.656895 16832 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:55.689558 16853 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:55.695793 13686 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 8.
W20260709 12:10:55.696647 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:55.704007 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 267123us
I20260709 12:10:55.705349 16919 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:55.706205 16919 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:55.709177 16919 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:55.710248 16705 leader_election.cc:290] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:55.701517 16853 raft_consensus.cc:3060] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:55.728644 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:55.731047 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:55.731969 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:55.734189 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:55.735888 14408 raft_consensus.cc:1275] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:55.736039 13832 raft_consensus.cc:1275] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:55.737283 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:55.737957 14409 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:55.743516 16741 raft_consensus.cc:3055] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:55.744122 16741 raft_consensus.cc:740] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:55.744374 16877 raft_consensus.cc:3055] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:55.745052 16877 raft_consensus.cc:740] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:55.747989 16832 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:55.733318 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:55.757380 13684 raft_consensus.cc:1275] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:55.758248 16877 consensus_queue.cc:260] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:55.759809 16877 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:55.765436 13763 raft_consensus.cc:1275] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:10:55.767448 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:55.768321 14416 raft_consensus.cc:2393] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 8: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:10:55.765561 14413 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41692 (request call id 540) took 1014 ms. Trace:
I20260709 12:10:55.770032 14379 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:10:55.771343 13726 leader_election.cc:336] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.798s (SENT)
I20260709 12:10:55.771848 13726 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:55.772653 16442 raft_consensus.cc:2749] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:55.769475 14413 rpcz_store.cc:276] 0709 12:10:54.750989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.751115 (+   126us) service_pool.cc:224] Handling call
0709 12:10:54.751411 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:54.862871 (+111460us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:54.904929 (+ 42058us) log.cc:844] Serialized 14 byte log entry
0709 12:10:55.295963 (+391034us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:55.296021 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:55.296114 (+    93us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:55.763994 (+467880us) spinlock_profiling.cc:243] Waited 912 us on lock 0x7b18004436e0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e6e2a6 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419
0709 12:10:55.765340 (+  1346us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b54006df454. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:55.765381 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:55.765505 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4465,"prepare.queue_time_us":65543,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":32,"raft.queue_time_us":3864,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":3717,"spinlock_wait_cycles":257927168,"thread_start_us":428548,"threads_started":2,"wal-append.queue_time_us":442093}
I20260709 12:10:55.775997 16608 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:55.778175 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.793448 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:55.794795 14408 raft_consensus.cc:2393] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 7: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:10:55.798439 14409 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 7.
I20260709 12:10:55.781306 13727 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
W20260709 12:10:55.800091 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.808810 13651 leader_election.cc:400] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 6. Current term is 7.
I20260709 12:10:55.809425 13651 leader_election.cc:403] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:55.816044 13652 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:55.824512 14379 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:55.807574 16761 raft_consensus.cc:2804] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:55.835713 13651 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:55.814924 16545 raft_consensus.cc:2804] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:55.814577 16705 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:10:55.863644 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:55.863631 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:55.827270 16702 raft_consensus.cc:2804] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:55.745237 16741 consensus_queue.cc:260] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:55.873261 14409 raft_consensus.cc:1275] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:55.796478 16884 consensus_queue.cc:1059] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:10:55.815121 16841 consensus_queue.cc:1048] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:10:55.893713 13800 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:55.894841 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:10:55.897595 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.838969 16811 raft_consensus.cc:2804] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:55.904950 13800 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:55.911527 13683 raft_consensus.cc:1240] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 6. Current term is 8. Ops: []
I20260709 12:10:55.869261 16761 raft_consensus.cc:697] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 8 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:55.866080 16910 raft_consensus.cc:2804] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:55.898802 16741 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:55.931143 16910 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:55.931811 16910 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:55.837958 16592 consensus_queue.cc:1048] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 12:10:55.822232 16743 consensus_queue.cc:1059] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 12:10:55.935658 16743 consensus_queue.cc:1243] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer ca9fbbc2c0a94897897d502d42f3951f log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:10:55.907784 16884 raft_consensus.cc:2749] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:55.921861 16811 raft_consensus.cc:697] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 8 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:55.926496 13681 raft_consensus.cc:3060] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:10:55.930230 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:55.930701 16838 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:55.936817 13687 raft_consensus.cc:1275] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:55.891911 16919 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:55.902761 16832 consensus_queue.cc:1059] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:10:55.920172 16925 raft_consensus.cc:2749] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:55.882539 16545 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:55.884768 16818 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:55.945293 13800 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:55.940102 13830 raft_consensus.cc:1275] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:55.828156 16915 consensus_queue.cc:1059] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.094s
W20260709 12:10:55.973645 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.999581 13681 raft_consensus.cc:1275] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:10:55.978657 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 177617us
I20260709 12:10:55.908360 16618 consensus_queue.cc:1048] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 12:10:55.898988 16702 raft_consensus.cc:697] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 7 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:56.003981 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:55.986480 16545 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:56.008116 16560 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.915794 16920 consensus_queue.cc:1048] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.088s
I20260709 12:10:56.013463 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:10:56.021087 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 75936.4us
I20260709 12:10:56.010111 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:56.038192 13800 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:56.038645 13682 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 4.
I20260709 12:10:56.002267 16818 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:55.975755 16926 consensus_queue.cc:1048] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 12:10:56.048833 13800 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:56.052736 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:56.054293 13682 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:56.036892 16752 consensus_queue.cc:1048] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:10:55.983948 16919 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:56.058521 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:56.060673 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:56.067735 13832 raft_consensus.cc:2410] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:10:56.069638 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:56.071014 13830 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 7.
I20260709 12:10:56.074013 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:56.075032 13830 raft_consensus.cc:1240] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:10:56.074661 13836 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 9.
I20260709 12:10:56.014647 16610 consensus_queue.cc:1048] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:10:56.086869 13829 raft_consensus.cc:1240] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:10:56.050118 16925 raft_consensus.cc:2749] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:10:56.053666 16924 raft_consensus.cc:3055] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:56.100240 13683 raft_consensus.cc:3055] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:56.053349 16809 raft_consensus.cc:2749] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:56.110004 13832 raft_consensus.cc:1240] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:10:56.116092 13683 raft_consensus.cc:740] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
W20260709 12:10:56.242492 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.158988 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:56.060876 16922 raft_consensus.cc:2804] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:56.292541 13685 raft_consensus.cc:1240] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:56.150828 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:56.045157 16560 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:56.052528 16832 consensus_queue.cc:1048] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 12:10:56.288275 13683 consensus_queue.cc:260] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:56.037333 16761 consensus_queue.cc:237] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:56.051824 16702 consensus_queue.cc:237] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:56.291756 13837 raft_consensus.cc:1275] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:56.289518 13828 raft_consensus.cc:2368] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 5. Current term is 6.
I20260709 12:10:56.323050 13831 raft_consensus.cc:1240] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:10:56.301421 13800 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:10:56.296211 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:56.401937 13726 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.505s (SENT) [suppressed 60 similar messages]
I20260709 12:10:56.055819 16811 consensus_queue.cc:237] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:56.501751 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:56.519057 13837 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:56.291805 13836 raft_consensus.cc:1240] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 6. Current term is 7. Ops: [4.3-6.4]
W20260709 12:10:56.504504 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 203224us
I20260709 12:10:56.502329 13830 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:56.503594 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 101714us
W20260709 12:10:56.525664 13726 leader_election.cc:336] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.621s (SENT)
I20260709 12:10:56.502629 13683 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:56.509545 16526 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:10:56.549326 13726 leader_election.cc:336] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.560s (SENT)
I20260709 12:10:56.448980 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:10:56.480087 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 476477us
W20260709 12:10:56.550489 13726 leader_election.cc:336] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.674s (SENT)
W20260709 12:10:56.517237 16894 log.cc:927] Time spent T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:10:56.523890 16926 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:56.535744 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:56.555653 13726 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
W20260709 12:10:56.228473 16902 log.cc:927] Time spent T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 12:10:56.527215 16922 raft_consensus.cc:697] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 8 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:56.115531 16924 raft_consensus.cc:740] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:56.408394 16915 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:56.418339 16743 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:56.551546 13652 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
W20260709 12:10:56.551988 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.551419 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:56.103575 16608 consensus_queue.cc:1059] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.423s
I20260709 12:10:56.555794 13832 raft_consensus.cc:1275] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:56.556150 13831 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 7.
W20260709 12:10:56.495529 16741 consensus_meta.cc:287] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.564s	user 0.008s	sys 0.002s
I20260709 12:10:56.098485 16841 consensus_queue.cc:1048] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.439s
I20260709 12:10:56.558703 16526 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:56.578784 16919 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:56.559226 16920 consensus_queue.cc:1059] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 12:10:56.580231 16920 raft_consensus.cc:3055] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:56.580613 16920 raft_consensus.cc:740] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
W20260709 12:10:56.563109 16928 log.cc:927] Time spent T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.469s	user 0.001s	sys 0.000s
I20260709 12:10:56.581897 16608 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:10:56.564231 16930 log.cc:927] Time spent T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.251s	user 0.001s	sys 0.000s
I20260709 12:10:56.582561 16608 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:56.585067 16608 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:56.462570 16956 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:56.305011 16952 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:56.562070 13800 connection.cc:256] RPC call timeout handler was delayed by -1.0717155529998763s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1947s for a response
I20260709 12:10:56.603435 13835 raft_consensus.cc:1275] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:10:56.565656 13828 raft_consensus.cc:1275] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 12:10:56.548938 16935 log.cc:927] Time spent T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.472s	user 0.000s	sys 0.001s
I20260709 12:10:56.568288 16925 consensus_queue.cc:1059] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:10:56.586449 13684 raft_consensus.cc:2410] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:56.586200 14407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41700 (request call id 410) took 2095 ms. Trace:
W20260709 12:10:56.567471 16887 consensus_meta.cc:287] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.925s	user 0.016s	sys 0.000s
I20260709 12:10:56.587242 16741 raft_consensus.cc:2804] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:56.621559 16741 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:56.622210 16741 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:56.615034 14407 rpcz_store.cc:276] 0709 12:10:54.490739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.499600 (+  8861us) service_pool.cc:224] Handling call
0709 12:10:54.518508 (+ 18908us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:54.753653 (+235145us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:54.764307 (+ 10654us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:55.748680 (+984373us) spinlock_profiling.cc:243] Waited 2.36 ms on lock 0x7b2c000472a8. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa926886a11 00007fa926896372 00007fa927fc8a01 00007fa927f8d43a 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2
0709 12:10:55.749234 (+   554us) log.cc:844] Serialized 26 byte log entry
0709 12:10:55.981309 (+232075us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:55.990478 (+  9169us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:56.001692 (+ 11214us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:56.585859 (+584167us) raft_consensus.cc:1685] finished
0709 12:10:56.585882 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:56.586130 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":112374,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"spinlock_wait_cycles":5439360,"thread_start_us":452375,"threads_started":2,"wal-append.queue_time_us":275039}
W20260709 12:10:56.623158 16545 consensus_meta.cc:287] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.578s	user 0.005s	sys 0.005s
I20260709 12:10:56.623574 16545 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:56.587702 13836 raft_consensus.cc:1275] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:56.590240 16883 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:56.626413 16922 consensus_queue.cc:237] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:56.626839 16883 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:56.628995 16883 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:56.629968 16943 consensus_queue.cc:1048] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:10:56.631014 16939 log.cc:927] Time spent T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:10:56.599045 16915 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:56.634693 16915 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:56.634979 16777 raft_consensus.cc:3055] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:56.635385 16777 raft_consensus.cc:740] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:56.616755 16952 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:56.636384 16777 consensus_queue.cc:260] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:56.581427 16920 consensus_queue.cc:260] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:56.591507 16841 consensus_queue.cc:1048] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:56.593652 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:10:56.564360 16932 log.cc:927] Time spent T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.235s	user 0.001s	sys 0.000s
I20260709 12:10:56.560652 13830 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 8.
W20260709 12:10:56.599809 13682 consensus_meta.cc:287] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.544s	user 0.011s	sys 0.001s
W20260709 12:10:56.604805 13800 connection.cc:256] RPC call timeout handler was delayed by -1.043051337000179s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1706s for a response
I20260709 12:10:56.607749 13683 raft_consensus.cc:1275] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:10:56.639201 16705 consensus_meta.cc:287] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.755s	user 0.011s	sys 0.000s
I20260709 12:10:56.677019 16705 raft_consensus.cc:2749] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 6. Current term is 7.
I20260709 12:10:56.620573 16887 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:56.614988 16956 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:56.590710 16818 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:10:56.594203 16910 consensus_meta.cc:287] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.662s	user 0.011s	sys 0.000s
W20260709 12:10:56.656198 13727 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.010s	sys 0.006s
W20260709 12:10:56.691962 13727 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.011s	sys 0.007s
W20260709 12:10:56.692435 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 691117us
W20260709 12:10:56.675153 16677 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
W20260709 12:10:56.676206 16877 consensus_meta.cc:287] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.916s	user 0.015s	sys 0.000s
I20260709 12:10:56.580235 16526 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:56.615648 16728 consensus_queue.cc:1048] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
W20260709 12:10:56.679116 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.669147 13682 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 3.
I20260709 12:10:56.625648 16545 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:56.595116 16743 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:56.629544 16883 consensus_queue.cc:1048] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:10:56.637684 16952 leader_election.cc:290] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:56.629007 16560 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:56.689687 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:56.737550 13683 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Advancing to term 6
W20260709 12:10:56.646176 16901 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.005s	user 0.006s	sys 0.013s
I20260709 12:10:56.558274 13837 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 8.
W20260709 12:10:56.678916 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 127392us
I20260709 12:10:56.678361 16832 raft_consensus.cc:3055] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:56.714639 14412 raft_consensus.cc:1240] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:56.724149 16741 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:56.696347 16890 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.350s	user 0.016s	sys 0.015s
I20260709 12:10:56.726012 16887 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 6 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:56.726275 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:56.728580 16743 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:56.730778 16956 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:56.761273 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:56.762036 13680 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 9.
I20260709 12:10:56.694981 16920 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:56.733733 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:56.735203 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:10:56.686000 16838 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.000s	sys 0.022s
I20260709 12:10:56.705996 16777 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:56.744968 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:56.744413 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:56.757598 13683 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 6.
W20260709 12:10:56.746347 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 79210us
W20260709 12:10:56.752226 16890 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.409s	user 0.016s	sys 0.015s
I20260709 12:10:56.763382 13834 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 7.
I20260709 12:10:56.746534 13652 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:10:56.750042 16901 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.102s	user 0.006s	sys 0.015s
I20260709 12:10:56.745899 16953 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.705204 16910 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:56.834411 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:10:56.751574 16820 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.887s	user 0.019s	sys 0.022s
W20260709 12:10:56.843245 16820 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.005s	user 0.019s	sys 0.023s
W20260709 12:10:56.764402 16959 log.cc:927] Time spent T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:10:56.752445 16560 consensus_queue.cc:1059] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.078s
I20260709 12:10:56.750381 16832 raft_consensus.cc:740] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
W20260709 12:10:56.825682 16853 consensus_meta.cc:287] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 1.101s	user 0.010s	sys 0.003s
W20260709 12:10:56.844889 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 98508.5us
I20260709 12:10:56.872529 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:56.833377 14380 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:56.845811 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:56.850023 16832 consensus_queue.cc:260] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:56.851207 16936 log.cc:927] Time spent T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.393s	user 0.003s	sys 0.000s
I20260709 12:10:56.855006 16890 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.856920 13682 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 7.
I20260709 12:10:56.834434 16743 raft_consensus.cc:2749] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:56.859881 16702 raft_consensus.cc:3055] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:10:56.864271 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:56.774490 16838 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.000s	sys 0.023s
W20260709 12:10:56.870890 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:56.877424 13800 leader_election.cc:336] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.706s (SENT)
I20260709 12:10:56.903050 13800 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:10:56.904116 13800 leader_election.cc:336] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.726s (SENT)
I20260709 12:10:56.904507 13800 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:56.873346 13681 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 6.
I20260709 12:10:56.905607 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:56.905943 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:56.906733 13761 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 7.
I20260709 12:10:56.907392 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:56.908120 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:56.908453 13758 raft_consensus.cc:2393] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 8: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:10:56.908852 13755 raft_consensus.cc:1813] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Handling vote request from an unknown peer 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:56.909613 13755 raft_consensus.cc:2410] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:10:56.898288 13652 leader_election.cc:400] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 5. Current term is 6.
I20260709 12:10:56.910028 13652 leader_election.cc:403] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:56.911012 13758 raft_consensus.cc:1240] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:10:56.911559 13652 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:56.912983 13652 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:56.897049 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:56.915252 13652 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:56.913791 14379 leader_election.cc:304] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:56.950985 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:56.953076 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:56.953577 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:56.956305 13652 leader_election.cc:304] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:56.951320 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:56.959455 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:10:56.959371 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 55284.9us
W20260709 12:10:56.978440 13800 leader_election.cc:336] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.767s (SENT)
W20260709 12:10:56.979683 13800 leader_election.cc:336] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.825s (SENT)
I20260709 12:10:56.980342 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:56.980489 13800 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:56.918485 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:56.984066 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:56.890998 16809 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.012071 13800 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:57.012750 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:57.023378 13837 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 7.
I20260709 12:10:56.989971 13760 raft_consensus.cc:1240] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 7. Current term is 8. Ops: [5.3-7.4]
I20260709 12:10:56.995618 13756 raft_consensus.cc:1240] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:57.011449 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:57.024935 13828 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 5.
I20260709 12:10:57.008518 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:57.026889 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:57.011073 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:56.884148 16734 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:56.988622 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 74937.3us
W20260709 12:10:57.018869 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.950722 16818 raft_consensus.cc:2749] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:56.896675 16677 consensus_queue.cc:1048] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.130s
I20260709 12:10:56.986157 16689 raft_consensus.cc:2804] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:56.891187 16841 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:56.846597 16953 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:57.027908 13835 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 9.
I20260709 12:10:57.061388 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:57.032832 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:57.033834 13800 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:10:57.007107 16848 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.879s	user 0.030s	sys 0.038s
I20260709 12:10:56.901503 16702 raft_consensus.cc:740] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:56.893530 16853 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:57.037570 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:57.039873 16926 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:57.039086 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:56.986099 16526 raft_consensus.cc:2804] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:56.890820 16950 raft_consensus.cc:2804] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:56.990594 16925 raft_consensus.cc:2749] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:57.005380 16817 raft_consensus.cc:2749] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:56.958928 16964 raft_consensus.cc:2749] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:57.047658 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:57.080138 13681 raft_consensus.cc:2410] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:57.022588 16883 raft_consensus.cc:2804] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:56.986024 16957 raft_consensus.cc:2804] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:56.900738 16887 consensus_queue.cc:1048] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.136s
I20260709 12:10:56.897137 16777 consensus_queue.cc:1059] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.144s
I20260709 12:10:57.044250 16910 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:57.098522 13686 raft_consensus.cc:1240] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:57.031584 16809 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:57.073606 13837 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 6.
I20260709 12:10:56.959739 16915 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:57.069703 16848 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.939s	user 0.030s	sys 0.039s
I20260709 12:10:56.951458 16705 raft_consensus.cc:2749] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 5. Current term is 6.
I20260709 12:10:57.040174 16919 consensus_queue.cc:1059] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:10:56.916885 16890 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:57.069161 16689 raft_consensus.cc:697] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 8 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:57.078707 16526 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:57.048779 16734 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:57.083930 16883 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:57.084671 16950 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:57.072036 16841 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:57.177106 13800 leader_election.cc:336] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.670s (SENT)
I20260709 12:10:57.179282 13685 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 7.
I20260709 12:10:57.179723 13800 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:10:57.180347 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:57.181243 13800 leader_election.cc:336] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.681s (SENT)
I20260709 12:10:57.152369 16818 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:57.166477 16526 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:57.182739 16818 raft_consensus.cc:2749] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:10:57.185286 13651 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:48212 dropped due to backpressure: service queue is full with 50 items
I20260709 12:10:57.170863 16950 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:57.170063 16883 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:57.187016 16734 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:57.188084 13800 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:57.207718 16890 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:57.192085 16925 raft_consensus.cc:2749] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:57.185616 13651 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:48212 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2129)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2125)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2116)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48212 (request call id 503)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1362)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2102)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2132)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2133)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1364)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1367)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2130)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2124)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2123)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2131)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1373)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1370)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1374)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1376)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1377)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2114)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2095)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1366)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2126)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1369)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48212 (request call id 501)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1372)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2127)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1363)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1368)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1375)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48212 (request call id 502)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1371)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2092)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2099)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2107)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2109)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2110)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2112)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2113)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2119)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2120)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2122)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 496)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 498)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 499)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 500)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 504)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 505)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 506)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1365)
I20260709 12:10:57.216058 16853 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:57.213383 13651 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:41702 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2129)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2125)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2116)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48212 (request call id 503)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1362)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2102)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2132)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2133)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1364)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1367)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2130)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2124)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2123)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2131)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1373)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1370)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1374)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1376)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1377)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2114)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2095)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1366)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2126)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1369)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48212 (request call id 501)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1372)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2127)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1363)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1368)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1375)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48212 (request call id 502)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1371)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2092)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2099)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2107)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2109)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2110)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2112)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2113)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2119)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2120)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2122)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 496)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 498)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 499)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 500)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 504)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 505)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 506)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1365)
I20260709 12:10:57.173574 16702 consensus_queue.cc:260] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:57.154757 16915 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:57.217868 16689 consensus_queue.cc:237] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:57.226681 16702 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:57.228029 16915 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:57.216862 16883 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:57.220055 16841 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:10:57.248389 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 58796.3us
I20260709 12:10:57.233816 13651 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:41702 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2129)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2125)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2116)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48212 (request call id 503)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1362)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2102)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2132)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2133)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1364)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1367)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2130)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2124)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2123)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2131)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1373)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1370)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1374)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1376)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1377)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2114)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2095)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1366)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2126)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1369)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48212 (request call id 501)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1372)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2127)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1363)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1368)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1375)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48212 (request call id 502)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1371)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2092)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2099)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2107)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2109)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2110)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2112)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2113)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2119)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2120)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2122)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 496)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 498)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 499)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 500)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 504)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 505)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 506)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1365)
W20260709 12:10:57.245600 16962 log.cc:927] Time spent T 00000000000000000000000000000000 P 17d79eae88f84be7a847d0cf544674cd: Append to log took a long time: real 0.081s	user 0.001s	sys 0.003s
I20260709 12:10:57.261234 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:57.279086 16924 consensus_queue.cc:260] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:57.280243 16924 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:57.282666 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:57.286401 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:10:57.289374 13800 leader_election.cc:336] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.832s (SENT)
I20260709 12:10:57.290072 13800 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:57.306128 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:57.307057 13683 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:57.317767 16883 leader_election.cc:290] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:57.318082 16979 raft_consensus.cc:2749] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:57.328096 13684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2080) took 1423 ms. Trace:
I20260709 12:10:57.328598 13684 rpcz_store.cc:276] 0709 12:10:55.905210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.905393 (+   183us) service_pool.cc:224] Handling call
0709 12:10:57.327865 (+1422472us) spinlock_profiling.cc:243] Waited 624 ms on lock 0x7b5400312ed4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:57.328028 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1435179776}
I20260709 12:10:57.308341 16841 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:57.330428 16841 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:57.334144 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:57.334867 13684 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 7.
W20260709 12:10:57.324028 16920 consensus_meta.cc:287] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.553s	user 0.010s	sys 0.000s
I20260709 12:10:57.340407 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:57.341200 13684 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 5.
I20260709 12:10:57.342186 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:57.342878 13684 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 9.
I20260709 12:10:57.343756 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:57.344537 13684 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 6.
I20260709 12:10:57.345471 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:57.345959 13683 raft_consensus.cc:2468] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 6.
I20260709 12:10:57.284487 16926 raft_consensus.cc:2749] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:57.347302 14379 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:57.349820 16883 raft_consensus.cc:2804] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:57.350689 16883 raft_consensus.cc:697] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 6 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:57.351797 16883 consensus_queue.cc:237] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:57.352995 16949 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:57.353808 16949 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:57.348381 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:57.355788 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:57.355999 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:57.356906 13683 raft_consensus.cc:2393] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 5: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:57.357028 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:57.362141 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:57.359764 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:57.363916 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:57.366942 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:57.374846 13688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2077) took 1509 ms. Trace:
W20260709 12:10:57.376380 16933 log.cc:927] Time spent T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 1.148s	user 0.005s	sys 0.000s
I20260709 12:10:57.375380 13688 rpcz_store.cc:276] 0709 12:10:55.865692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.866165 (+   473us) service_pool.cc:224] Handling call
0709 12:10:55.892440 (+ 26275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:55.907724 (+ 15284us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:55.907779 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:55.908278 (+   499us) log.cc:844] Serialized 26 byte log entry
0709 12:10:56.622550 (+714272us) spinlock_profiling.cc:243] Waited 6.75 ms on lock 0x7b4800080358. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92ceb6aa1 00007fa92ceadb37 00007fa92cead9ca 00007fa92cfa526f 00007fa92cfa4f37 00007fa92cfb955c 00007fa92cfb9508 00007fa92cfb9488 00007fa92cfb9443 00007fa92cfb86ec 00007fa92bee2a96
0709 12:10:57.237013 (+614463us) spinlock_profiling.cc:243] Waited 956 us on lock 0x7b1800477820. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e82e07 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9fc02 00007fa927b2720b 00007fa927b2cd23 00007fa927b2d0d1 00007fa927f48a0f
0709 12:10:57.282679 (+ 45666us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:57.359094 (+ 76415us) log.cc:844] Serialized 14 byte log entry
0709 12:10:57.359349 (+   255us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:57.359440 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:57.374560 (+ 15120us) raft_consensus.cc:1685] finished
0709 12:10:57.374582 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:57.374758 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6336,"raft.queue_time_us":7042,"raft.run_cpu_time_us":3450,"raft.run_wall_time_us":725350,"spinlock_wait_cycles":17734784,"thread_start_us":65509,"threads_started":2,"wal-append.queue_time_us":1441771}
I20260709 12:10:57.377842 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:57.378255 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:57.378474 13688 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:57.379041 13680 raft_consensus.cc:2393] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 8: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:10:57.379441 13833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 508) took 1699 ms. Trace:
I20260709 12:10:57.379935 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:57.380796 13680 raft_consensus.cc:2393] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 7: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:57.379853 13833 rpcz_store.cc:276] 0709 12:10:55.679652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.680093 (+   441us) service_pool.cc:224] Handling call
0709 12:10:55.680543 (+   450us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:55.883548 (+203005us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:55.883581 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:55.888978 (+  5397us) log.cc:844] Serialized 26 byte log entry
0709 12:10:55.980723 (+ 91745us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:55.980785 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:55.980884 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:57.375761 (+1394877us) spinlock_profiling.cc:243] Waited 14.6 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:10:57.379084 (+  3323us) raft_consensus.cc:1685] finished
0709 12:10:57.379107 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:57.379373 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":415,"raft.queue_time_us":43790,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":18269,"spinlock_wait_cycles":33522944,"thread_start_us":262809,"threads_started":2,"wal-append.queue_time_us":127884}
I20260709 12:10:57.382037 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:57.383848 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:57.385066 13680 raft_consensus.cc:2410] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:57.390974 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:57.394347 13683 raft_consensus.cc:2368] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 9. Current term is 10.
I20260709 12:10:57.398545 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:57.399688 16915 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:57.401289 16949 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:57.401520 14411 raft_consensus.cc:1217] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 9 LEADER]: Deduplicated request from leader. Original: 5.7->[8.8-8.8]   Dedup: 8.8->[]
I20260709 12:10:57.402356 16526 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:57.404894 13829 pending_rounds.cc:85] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 7
I20260709 12:10:57.408720 13829 pending_rounds.cc:107] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 12:10:57.409125 13829 raft_consensus.cc:2889] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:57.357517 16979 consensus_queue.cc:1059] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 12:10:57.408644 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:57.395259 16841 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:57.406075 13652 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:57.411736 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:57.412361 13680 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 6.
I20260709 12:10:57.412494 13652 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:57.413419 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:57.416533 13684 raft_consensus.cc:2393] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 8: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:57.417151 13688 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 7.
I20260709 12:10:57.395831 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:57.418226 13683 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 7.
I20260709 12:10:57.419091 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:57.409473 16915 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:57.420009 16702 raft_consensus.cc:2804] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:57.420135 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:57.420569 16702 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:57.420967 16702 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:57.421434 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:57.421695 16915 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:57.422021 13756 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:57.422442 16526 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:57.422693 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:10:57.422442 13800 leader_election.cc:336] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.966s (SENT)
I20260709 12:10:57.423373 13760 raft_consensus.cc:2368] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 5. Current term is 6.
I20260709 12:10:57.423422 13800 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:57.424229 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:57.424640 16979 raft_consensus.cc:2749] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:57.413794 13652 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:57.425235 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:57.427215 16526 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:57.427629 16526 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:57.428422 16526 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:57.432034 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:57.432714 13681 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 9.
I20260709 12:10:57.433338 13756 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 7.
I20260709 12:10:57.403777 16950 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:57.433584 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:57.490773 13681 raft_consensus.cc:2376] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 6. Re-sending same reply.
I20260709 12:10:57.491946 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:57.492725 13681 raft_consensus.cc:2368] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 5. Current term is 6.
W20260709 12:10:57.447629 13800 leader_election.cc:336] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.990s (SENT)
I20260709 12:10:57.497763 16929 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:57.498765 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 51166.9us
I20260709 12:10:57.498703 16929 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:57.501173 13800 leader_election.cc:336] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.992s (SENT)
I20260709 12:10:57.501282 16929 leader_election.cc:290] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:57.448086 16689 raft_consensus.cc:2804] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:57.502246 16689 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:57.502688 16689 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:57.502919 16809 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:10:57.504046 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.504982 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:57.505695 13763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 443) took 1566 ms. Trace:
I20260709 12:10:57.493556 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:57.447628 13680 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 5.
I20260709 12:10:57.461071 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:57.507962 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:57.515609 13683 raft_consensus.cc:2410] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:10:57.505710 13835 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 5.
I20260709 12:10:57.514706 13681 raft_consensus.cc:2410] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:57.459901 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:57.456859 13759 raft_consensus.cc:1240] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:57.459890 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:57.518720 13688 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 3.
I20260709 12:10:57.501720 13800 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:57.522054 13759 raft_consensus.cc:1240] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:57.522534 13832 raft_consensus.cc:1275] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 3. (term mismatch)
I20260709 12:10:57.523012 13832 pending_rounds.cc:85] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 2
I20260709 12:10:57.523355 13832 pending_rounds.cc:107] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:10:57.523641 13832 raft_consensus.cc:2889] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:57.524029 13832 pending_rounds.cc:107] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 12:10:57.523721 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:57.524360 13832 raft_consensus.cc:2889] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:57.524899 13759 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 7.
I20260709 12:10:57.513881 16890 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.527235 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:57.528070 13760 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:57.517691 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:57.528807 13835 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:57.530130 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:57.531049 13683 raft_consensus.cc:2368] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 5. Current term is 6.
I20260709 12:10:57.506158 13763 rpcz_store.cc:276] 0709 12:10:55.939369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.939528 (+   159us) service_pool.cc:224] Handling call
0709 12:10:55.939811 (+   283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:55.940117 (+   306us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:10:56.018657 (+ 78540us) log.cc:844] Serialized 14 byte log entry
0709 12:10:57.495986 (+1477329us) spinlock_profiling.cc:243] Waited 28.1 ms on lock 0x7b18002ab320. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e1ac0a 00007fa92e55a219 00007fa924ea2a40 00007fa924e9d4e4 00007fa924e9d455 00007fa927f85060 00007fa927f97716 00007fa927fa8287 00007fa927fa8208
0709 12:10:57.496203 (+   217us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:57.496803 (+   600us) log.cc:844] Serialized 26 byte log entry
0709 12:10:57.496996 (+   193us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:10:57.497256 (+   260us) log.cc:844] Serialized 14 byte log entry
0709 12:10:57.497430 (+   174us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:57.497520 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:57.505446 (+  7926us) raft_consensus.cc:1685] finished
0709 12:10:57.505481 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:57.505630 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76478,"prepare.queue_time_us":179518,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":88,"raft.queue_time_us":1409497,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":141864,"spinlock_wait_cycles":202330880,"thread_start_us":198005,"threads_started":2,"wal-append.queue_time_us":1159647}
I20260709 12:10:57.532028 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:57.410560 14411 raft_consensus.cc:1240] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 9 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:10:57.519671 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:57.520138 14379 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:57.436218 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:57.519105 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:57.541352 13681 raft_consensus.cc:2410] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:10:57.527729 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:57.542431 13759 raft_consensus.cc:1240] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:10:57.526644 16442 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.544624 16442 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:57.547155 16442 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:57.543052 16809 raft_consensus.cc:2749] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:57.543232 16545 raft_consensus.cc:2749] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:10:57.553292 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.554818 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:57.555989 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:57.556613 13759 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 4.
W20260709 12:10:57.557981 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.561195 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:57.557494 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:57.533910 13763 raft_consensus.cc:1240] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:57.564047 13760 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 8.
I20260709 12:10:57.565588 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:57.542892 13836 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 7.
I20260709 12:10:57.535379 13683 raft_consensus.cc:2410] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 5 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 12:10:57.536082 13800 leader_election.cc:336] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 2.001s (SENT)
I20260709 12:10:57.567416 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:10:57.568109 13800 leader_election.cc:336] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 2.042s (SENT)
I20260709 12:10:57.568850 13800 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:10:57.571926 13800 leader_election.cc:336] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 2.056s (SENT)
W20260709 12:10:57.573122 13800 leader_election.cc:336] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 2.101s (SENT)
I20260709 12:10:57.526473 16890 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:57.576059 16890 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:57.579177 16809 raft_consensus.cc:2749] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:10:57.585796 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:57.586990 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 893434us
I20260709 12:10:57.598042 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:57.598505 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:57.600211 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:57.603030 13760 raft_consensus.cc:1240] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:57.603091 16689 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:57.610083 16915 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:57.597343 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:57.614480 13681 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 6.
I20260709 12:10:57.620342 13759 raft_consensus.cc:1275] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 8 index: 3. (index mismatch)
I20260709 12:10:57.621717 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:57.614732 13688 raft_consensus.cc:2410] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:10:57.573657 13800 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:10:57.625561 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 52474.5us
I20260709 12:10:57.627359 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:57.580359 16949 raft_consensus.cc:2804] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:57.635501 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:10:57.661123 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 65001.1us
I20260709 12:10:57.661087 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:57.665136 13651 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:57.644263 13835 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 8.
I20260709 12:10:57.663748 13760 raft_consensus.cc:1240] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:57.666692 13651 leader_election.cc:400] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 5. Current term is 6.
I20260709 12:10:57.636360 13763 raft_consensus.cc:1275] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:57.667589 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:57.668794 13688 raft_consensus.cc:2368] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 7. Current term is 8.
I20260709 12:10:57.669070 13651 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:57.669683 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:57.671156 13688 raft_consensus.cc:2410] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:57.632557 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:57.670426 13800 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:57.530894 16702 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:57.672785 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:10:57.674297 13800 leader_election.cc:336] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 2.139s (SENT)
W20260709 12:10:57.705569 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 1.15499e+06us
I20260709 12:10:57.629024 16809 raft_consensus.cc:2749] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:10:57.737605 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 72375.1us
I20260709 12:10:57.689400 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:57.740862 13836 raft_consensus.cc:1240] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:10:57.661156 16705 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.664397 16949 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:57.750562 16949 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:57.753173 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.672746 16964 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.755985 16991 raft_consensus.cc:2749] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:57.756870 16991 consensus_queue.cc:1059] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:57.757666 16991 consensus_queue.cc:1243] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer 3f37c9cc9dda46b4be21dd675ba78fb7 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:10:57.760562 14412 raft_consensus.cc:1240] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:57.674374 16957 raft_consensus.cc:697] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 8 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:57.631732 16915 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:57.619320 16618 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:57.622921 16848 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:57.629215 16777 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:57.742951 13800 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:10:57.763823 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 92520.2us
I20260709 12:10:57.779374 13651 leader_election.cc:304] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:57.765055 13688 raft_consensus.cc:2368] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 5. Current term is 6.
I20260709 12:10:57.678344 16919 raft_consensus.cc:2749] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:57.741760 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:57.673085 16975 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:57.762409 14411 raft_consensus.cc:1275] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:57.744259 16841 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.759501 16741 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:57.786397 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 112159us
W20260709 12:10:57.787106 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:57.794822 13800 leader_election.cc:336] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 2.175s (SENT)
I20260709 12:10:57.795385 13800 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:10:57.797040 13800 leader_election.cc:336] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 2.177s (SENT)
I20260709 12:10:57.797624 13800 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:57.788695 16809 raft_consensus.cc:2749] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:57.785790 16853 raft_consensus.cc:2804] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:57.802635 16853 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:57.803023 16853 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:57.778695 16848 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:57.806416 16949 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:57.807404 16702 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:57.793309 13651 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:57.810289 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:57.760576 16705 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:57.816392 13800 leader_election.cc:336] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 2.217s (SENT)
W20260709 12:10:57.819882 13800 leader_election.cc:336] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 2.220s (SENT)
I20260709 12:10:57.786974 16992 consensus_queue.cc:1059] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:10:57.822394 13800 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:57.820804 16741 raft_consensus.cc:2749] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:57.850752 13651 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:57.827399 16910 raft_consensus.cc:3055] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:57.830156 16848 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:57.810379 16841 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:57.794503 16560 consensus_queue.cc:1059] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
W20260709 12:10:57.835902 16973 log.cc:927] Time spent T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.626s	user 0.000s	sys 0.002s
I20260709 12:10:57.838161 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:57.817272 16817 raft_consensus.cc:2749] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:57.812824 16919 raft_consensus.cc:2749] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:10:57.841550 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 103012us
I20260709 12:10:57.776062 16618 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:57.756778 16964 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:57.784526 16777 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:57.829213 16853 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:57.845343 16999 consensus_queue.cc:1059] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:57.819552 16809 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:57.849840 13800 leader_election.cc:336] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 2.249s (SENT)
I20260709 12:10:57.951965 13800 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:57.822968 16975 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.852154 13727 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:57.869320 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:57.841840 16950 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:57.852684 16949 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 4 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:10:57.917999 13726 leader_election.cc:336] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.937s (SENT)
I20260709 12:10:57.843736 16526 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:57.961678 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 43710.3us
I20260709 12:10:57.963488 16526 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:57.852962 16955 raft_consensus.cc:2749] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:10:57.965803 13726 connection.cc:256] RPC call timeout handler was delayed by -1.4137896810000257s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16670000000000001s for a response
I20260709 12:10:57.844276 16957 consensus_queue.cc:237] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:57.931249 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.853865 16910 raft_consensus.cc:740] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
W20260709 12:10:57.966820 16987 log.cc:927] Time spent T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 12:10:57.933961 13683 raft_consensus.cc:2468] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 6.
I20260709 12:10:57.935199 16964 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:57.936656 13686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 489) took 2180 ms. Trace:
I20260709 12:10:57.971398 13686 rpcz_store.cc:276] 0709 12:10:55.756156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.756302 (+   146us) service_pool.cc:224] Handling call
0709 12:10:55.756666 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:57.099058 (+1342392us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:57.936352 (+837294us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b5400284bd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:57.936575 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3085351296}
I20260709 12:10:57.856563 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:57.917085 16848 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:57.853523 16838 consensus_queue.cc:1048] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.078s
W20260709 12:10:57.953140 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 101068us
I20260709 12:10:57.953161 13687 raft_consensus.cc:2376] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 3. Re-sending same reply.
W20260709 12:10:57.980238 13687 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2089) took 1742 ms (client timeout 1679 ms). Trace:
W20260709 12:10:57.954630 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 104837us
W20260709 12:10:57.980739 13687 rpcz_store.cc:269] 0709 12:10:56.237475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.237857 (+   382us) service_pool.cc:224] Handling call
0709 12:10:57.863215 (+1625358us) spinlock_profiling.cc:243] Waited 5.19 ms on lock 0x7b5800002798. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924e68b71 00007fa924e68a22 00007fa92dd818d9 00007fa92cedbee0 00007fa92cfa50ab 00007fa92cfa5131 00007fa92cf530a0 00007fa92cf52984 00007fa9264cd6d4 00007fa9264cd662
0709 12:10:57.980166 (+116951us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11926400}
I20260709 12:10:57.955164 16442 raft_consensus.cc:2804] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:57.955736 16884 raft_consensus.cc:2749] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:57.956231 16975 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:57.960781 13761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 1554) took 1049 ms. Trace:
I20260709 12:10:57.982064 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:57.845916 16938 consensus_queue.cc:1048] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 12:10:57.927541 16689 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:57.968067 13726 connection.cc:256] RPC call timeout handler was delayed by -1.409027530000003s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2026s for a response
W20260709 12:10:57.988512 13726 leader_election.cc:336] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.694s (SENT)
W20260709 12:10:57.942587 16994 log.cc:927] Time spent T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 12:10:57.990265 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:57.990901 13835 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:57.973683 13681 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 7.
I20260709 12:10:57.983841 16442 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:57.985167 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:58.015897 13833 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:57.985584 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:57.980931 13727 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
W20260709 12:10:57.986960 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 141779us
I20260709 12:10:57.982241 13761 rpcz_store.cc:276] 0709 12:10:56.911904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.952046 (+ 40142us) service_pool.cc:224] Handling call
0709 12:10:56.952436 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:57.579149 (+626713us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:57.579180 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:57.579659 (+   479us) log.cc:844] Serialized 26 byte log entry
0709 12:10:57.662086 (+ 82427us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:57.662127 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:57.662202 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:57.960536 (+298334us) raft_consensus.cc:1685] finished
0709 12:10:57.960566 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:57.960717 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":626274,"raft.queue_time_us":652264,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":98,"thread_start_us":82048,"threads_started":1,"wal-append.queue_time_us":243174}
I20260709 12:10:57.989323 13831 raft_consensus.cc:1275] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:10:57.989363 13726 leader_election.cc:336] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.779s (SENT)
I20260709 12:10:58.017992 13726 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:58.018468 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:58.019085 13831 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:58.019742 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:10:58.019972 13726 connection.cc:256] RPC call timeout handler was delayed by -1.223889680999946s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1878s for a response
W20260709 12:10:58.020372 13726 connection.cc:256] RPC call timeout handler was delayed by -1.1914896809998936s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19140000000000001s for a response
I20260709 12:10:58.020480 13686 raft_consensus.cc:2368] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 5. Current term is 6.
W20260709 12:10:58.020884 13726 leader_election.cc:336] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 2.508s (SENT)
I20260709 12:10:57.994510 16926 raft_consensus.cc:3055] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:57.988109 16929 consensus_queue.cc:1048] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 12:10:57.998536 16545 raft_consensus.cc:3055] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:10:58.003851 16967 log.cc:927] Time spent T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.826s	user 0.002s	sys 0.002s
I20260709 12:10:58.005141 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:10:58.008353 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.008481 16832 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:58.035045 16996 log.cc:927] Time spent T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:10:58.009588 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:10:58.042842 16976 log.cc:927] Time spent T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.828s	user 0.000s	sys 0.003s
I20260709 12:10:57.991209 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:58.021281 13726 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
W20260709 12:10:58.044507 13726 connection.cc:256] RPC call timeout handler was delayed by -1.1434008129999711s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23809999999999998s for a response
I20260709 12:10:58.045737 13830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 520) took 1313 ms. Trace:
I20260709 12:10:58.046748 16992 raft_consensus.cc:2749] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:58.047926 16677 raft_consensus.cc:3055] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:58.048341 16677 raft_consensus.cc:740] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:57.992296 16964 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.027647 13727 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:57.983093 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:57.969695 16809 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:58.042990 13679 raft_consensus.cc:1240] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:58.053165 13679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2107) took 1487 ms. Trace:
I20260709 12:10:58.053534 13679 rpcz_store.cc:276] 0709 12:10:56.565830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.042497 (+1476667us) service_pool.cc:224] Handling call
0709 12:10:58.042819 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:58.052929 (+ 10110us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.053112 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:58.054234 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:58.046218 13830 rpcz_store.cc:276] 0709 12:10:56.732779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.735831 (+  3052us) service_pool.cc:224] Handling call
0709 12:10:56.736284 (+   453us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:56.745100 (+  8816us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:56.745133 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:56.745755 (+   622us) log.cc:844] Serialized 26 byte log entry
0709 12:10:57.067334 (+321579us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:57.067375 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:57.067441 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:58.042331 (+974890us) spinlock_profiling.cc:243] Waited 7.45 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:10:58.045448 (+  3117us) raft_consensus.cc:1685] finished
0709 12:10:58.045467 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:58.045676 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8710,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":3538,"spinlock_wait_cycles":17133440,"thread_start_us":234037,"threads_started":1,"wal-append.queue_time_us":433599}
I20260709 12:10:58.055401 13800 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:58.027587 13835 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 8.
I20260709 12:10:58.057979 13761 raft_consensus.cc:1240] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:58.058061 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:58.059185 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:58.059788 13754 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:10:58.060523 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:58.061249 14411 raft_consensus.cc:2393] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 8: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:10:58.061612 13831 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 10.
I20260709 12:10:58.064916 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:58.068578 14411 raft_consensus.cc:1240] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:58.069595 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:58.071933 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:58.073822 13754 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 6.
I20260709 12:10:58.075241 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:58.077431 13830 raft_consensus.cc:1240] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:58.077658 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:58.078440 16992 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.078800 13727 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:58.079838 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:58.123462 13835 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 8.
I20260709 12:10:58.128504 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:58.080726 13831 raft_consensus.cc:1240] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:58.032162 16993 consensus_queue.cc:1048] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:10:58.081507 16705 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:58.083729 16777 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:58.084961 16853 leader_election.cc:290] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:57.983589 16820 consensus_queue.cc:1048] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 12:10:58.049118 16677 consensus_queue.cc:260] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:58.021929 16442 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:57.991716 16949 consensus_queue.cc:1059] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 12:10:58.031291 16938 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:58.024652 16963 raft_consensus.cc:2804] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:58.096413 13833 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 10.
I20260709 12:10:57.971050 16910 consensus_queue.cc:260] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:58.099980 16922 raft_consensus.cc:2749] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:58.100219 17002 consensus_queue.cc:1048] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 12:10:58.033133 16929 consensus_queue.cc:1243] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer 96701a74fdee481fb5f54aac841e17dd log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:10:58.032416 16915 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:58.025542 16926 raft_consensus.cc:740] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:58.086355 16970 raft_consensus.cc:2749] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:10:58.088447 16964 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:58.088310 16608 consensus_queue.cc:1059] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
W20260709 12:10:58.103346 16974 log.cc:927] Time spent T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.187s	user 0.003s	sys 0.000s
I20260709 12:10:58.106140 13800 leader_election.cc:400] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 election: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 5. Current term is 6.
I20260709 12:10:58.086724 16636 consensus_queue.cc:1048] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 12:10:58.031584 16545 raft_consensus.cc:740] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:58.121500 16887 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.082580 16841 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:58.130504 13763 raft_consensus.cc:1275] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:58.132185 13755 raft_consensus.cc:1275] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:58.145443 13832 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:58.150882 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:58.165236 13831 raft_consensus.cc:2393] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 7: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
W20260709 12:10:58.151417 13685 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2098) took 1694 ms (client timeout 1544 ms). Trace:
W20260709 12:10:58.165673 13685 rpcz_store.cc:269] 0709 12:10:56.456778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.593355 (+136577us) service_pool.cc:224] Handling call
0709 12:10:58.151216 (+1557861us) spinlock_profiling.cc:243] Waited 28.8 ms on lock 0x7b540021fa54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:58.151332 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":66335616}
I20260709 12:10:58.167160 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:58.138999 13688 raft_consensus.cc:1240] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:58.137269 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:58.152011 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:58.128713 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:58.154001 16884 consensus_queue.cc:1059] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:58.154174 16545 consensus_queue.cc:260] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:58.155331 13682 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2115) took 1577 ms (client timeout 1560 ms). Trace:
W20260709 12:10:58.171892 13682 rpcz_store.cc:269] 0709 12:10:56.577577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.744070 (+166493us) service_pool.cc:224] Handling call
0709 12:10:58.155091 (+1411021us) spinlock_profiling.cc:243] Waited 80.2 ms on lock 0x7b5400272754. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:58.155243 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":184446208}
I20260709 12:10:58.158943 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:58.159274 13836 raft_consensus.cc:1240] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:10:58.159986 13800 leader_election.cc:403] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:10:58.142834 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:58.168752 13684 raft_consensus.cc:2376] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 6. Re-sending same reply.
I20260709 12:10:58.173087 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:58.177340 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:58.177945 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:58.130638 16832 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:58.182054 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:58.192268 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:58.194216 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:58.195173 13755 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 6.
I20260709 12:10:58.130504 16838 raft_consensus.cc:2749] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:58.198473 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:58.209857 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:58.210726 13830 raft_consensus.cc:2393] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 10: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:58.201412 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:58.211591 13763 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 8.
I20260709 12:10:58.202343 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:58.213881 13684 raft_consensus.cc:1240] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:58.150472 16953 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:58.217883 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:58.218757 13680 raft_consensus.cc:2376] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 3. Re-sending same reply.
I20260709 12:10:58.171360 16752 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.136353 16999 consensus_queue.cc:1059] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.075s
I20260709 12:10:58.138288 16993 consensus_queue.cc:1048] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 12:10:58.179350 13651 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:58.214603 13684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2110) took 1638 ms. Trace:
I20260709 12:10:58.206946 13754 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 7.
I20260709 12:10:58.214969 13682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2112) took 1638 ms. Trace:
I20260709 12:10:58.232787 13684 rpcz_store.cc:276] 0709 12:10:56.576200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.210881 (+1634681us) service_pool.cc:224] Handling call
0709 12:10:58.213675 (+  2794us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:58.214359 (+   684us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.214549 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:58.234977 13684 raft_consensus.cc:1240] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:58.204480 13832 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 6.
I20260709 12:10:58.221125 13763 raft_consensus.cc:1275] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:10:58.222266 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:58.223721 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:58.149032 16618 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:58.225884 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:58.214068 16922 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.131739 16992 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:58.170436 16887 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:58.196322 16817 raft_consensus.cc:3055] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:58.236225 13758 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:58.225047 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:10:58.235980 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 56761.6us
I20260709 12:10:58.232983 13682 rpcz_store.cc:276] 0709 12:10:56.576753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.214027 (+1637274us) service_pool.cc:224] Handling call
0709 12:10:58.214426 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:58.214599 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:58.214627 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:58.214677 (+    50us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:58.214720 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.214775 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:58.214911 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:58.236783 13680 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:58.237732 16608 raft_consensus.cc:3055] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:58.162106 16955 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.239699 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:58.237632 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:58.301690 13763 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 8.
I20260709 12:10:58.242473 13684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2113) took 1665 ms. Trace:
I20260709 12:10:58.302292 13651 leader_election.cc:304] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:10:58.302772 13684 rpcz_store.cc:276] 0709 12:10:56.577015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.234421 (+1657406us) service_pool.cc:224] Handling call
0709 12:10:58.234780 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:58.242031 (+  7251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.242377 (+   346us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:58.304333 13758 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 8.
I20260709 12:10:58.304486 13684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2120) took 1568 ms. Trace:
I20260709 12:10:58.304848 13684 rpcz_store.cc:276] 0709 12:10:56.739588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.303602 (+1564014us) service_pool.cc:224] Handling call
0709 12:10:58.303915 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:58.304103 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:58.304151 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:58.304202 (+    51us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:58.304237 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.304299 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:58.304433 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:58.212539 16884 raft_consensus.cc:2749] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 5. Current term is 6.
I20260709 12:10:58.225929 16545 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:58.212395 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:58.260958 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:58.313711 13755 raft_consensus.cc:2393] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 7: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:58.314009 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:58.315102 13835 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 7.
I20260709 12:10:58.315541 13758 raft_consensus.cc:1275] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:58.316618 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:58.262681 14379 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:58.262562 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:10:58.267156 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 144414us
I20260709 12:10:58.290215 16608 raft_consensus.cc:740] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:58.298635 14407 raft_consensus.cc:1275] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:10:58.290459 16817 raft_consensus.cc:740] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:10:58.212620 16832 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:58.255892 16743 raft_consensus.cc:2804] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:58.317571 13684 raft_consensus.cc:1275] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
W20260709 12:10:58.319018 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 59199.3us
I20260709 12:10:58.350211 13684 pending_rounds.cc:85] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 3
I20260709 12:10:58.350553 13684 pending_rounds.cc:107] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:10:58.350924 13684 raft_consensus.cc:2889] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:58.319130 13757 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 7.
I20260709 12:10:58.351751 13684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2122) took 1554 ms. Trace:
I20260709 12:10:58.352118 13684 rpcz_store.cc:276] 0709 12:10:56.799305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.314408 (+1515103us) service_pool.cc:224] Handling call
0709 12:10:58.317242 (+  2834us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:58.351521 (+ 34279us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.351705 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:58.334570 16974 log.cc:927] Time spent T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:10:58.321939 14380 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:58.317610 13835 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 7.
I20260709 12:10:58.285058 16924 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:58.339854 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 233821us
I20260709 12:10:58.359082 13800 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
W20260709 12:10:58.343413 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 80828.3us
I20260709 12:10:58.333962 16963 raft_consensus.cc:697] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:58.230049 16752 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:58.344447 13680 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 4.
I20260709 12:10:58.362923 13682 raft_consensus.cc:1240] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:58.364077 16752 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:58.335057 17002 raft_consensus.cc:2804] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:58.370859 14379 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:58.284484 16922 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:58.384387 14379 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:58.308648 16636 consensus_queue.cc:1048] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 12:10:58.352164 16736 raft_consensus.cc:2804] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:58.395871 14379 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:58.397169 14379 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:58.402218 16951 raft_consensus.cc:2804] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:58.402806 16951 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:58.403160 16951 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:58.337473 16702 consensus_queue.cc:1048] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 12:10:58.393985 16877 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:58.405944 16877 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:58.406416 16877 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:58.398897 16736 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:58.407307 16736 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:58.314070 16955 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:58.374059 16924 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:58.411149 16964 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:58.411563 16975 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:58.396445 17002 raft_consensus.cc:697] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 7 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:58.412940 16560 raft_consensus.cc:3055] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:58.413609 16560 raft_consensus.cc:740] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:58.413087 17002 consensus_queue.cc:237] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:58.414433 16560 consensus_queue.cc:260] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:58.415620 16560 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:58.368113 16755 raft_consensus.cc:2804] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:58.405383 16992 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:58.374027 16743 raft_consensus.cc:697] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 6 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:58.349695 16777 consensus_queue.cc:1048] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.047s
W20260709 12:10:58.440595 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.427454 13830 raft_consensus.cc:1275] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:58.365212 16963 consensus_queue.cc:237] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:58.442972 16832 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:58.443970 13834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 522) took 1610 ms. Trace:
I20260709 12:10:58.443605 16832 raft_consensus.cc:2804] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:58.446777 16832 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:58.447220 16832 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:58.447559 16922 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:58.448499 16922 consensus_queue.cc:1048] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:10:58.450546 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 54427.4us
I20260709 12:10:58.399417 16841 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:58.417490 16956 raft_consensus.cc:2749] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:58.427850 16755 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:58.428077 16809 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:58.444438 13834 rpcz_store.cc:276] 0709 12:10:56.833551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.841946 (+  8395us) service_pool.cc:224] Handling call
0709 12:10:56.843442 (+  1496us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:56.848495 (+  5053us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:56.848523 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:56.857613 (+  9090us) log.cc:844] Serialized 52 byte log entry
0709 12:10:57.017317 (+159704us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:57.064474 (+ 47157us) log.cc:844] Serialized 14 byte log entry
0709 12:10:57.191617 (+127143us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:57.191726 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:57.845885 (+654159us) spinlock_profiling.cc:243] Waited 2.65 ms on lock 0x7b180015dc00. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924ea03f3 00007fa924ea27c1 00007fa924ea2779 00007fa924ea2709 00007fa924ea26d1 00007fa924ea19cd 0000000000388634 0000000000388479 00007fa924e8383a
0709 12:10:58.102605 (+256720us) spinlock_profiling.cc:243] Waited 9.73 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:10:58.443752 (+341147us) raft_consensus.cc:1685] finished
0709 12:10:58.443775 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:58.443911 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6555,"prepare.queue_time_us":32696,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":95735,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":9661,"spinlock_wait_cycles":28487808,"thread_start_us":275700,"threads_started":2,"wal-append.queue_time_us":314895}
I20260709 12:10:58.417670 16949 consensus_queue.cc:1048] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 12:10:58.399626 16608 consensus_queue.cc:260] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:58.479512 16743 consensus_queue.cc:237] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:58.436265 16970 consensus_queue.cc:1059] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:10:58.440641 17004 consensus_queue.cc:1059] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
W20260709 12:10:58.518323 17007 log.cc:927] Time spent T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:10:58.518448 16442 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:58.518991 16993 raft_consensus.cc:3055] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:58.519582 16993 raft_consensus.cc:740] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:58.520864 16442 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:58.520598 16993 consensus_queue.cc:260] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:58.522372 16955 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:58.522506 16736 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:58.526738 16736 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:58.456009 16820 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:58.466439 16924 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:58.527438 16820 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:58.527942 16887 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:58.529520 16820 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:58.464781 16755 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:58.541474 16964 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:58.542160 16964 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:58.542973 16777 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.543522 16777 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:58.544497 16964 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:58.545710 16777 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:58.547816 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:58.549530 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:58.550514 13755 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 6.
I20260709 12:10:58.552130 13651 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:10:58.553437 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 176236us
I20260709 12:10:58.553061 16777 raft_consensus.cc:2804] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:10:58.555495 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 189588us
I20260709 12:10:58.426910 16817 consensus_queue.cc:260] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:58.557601 16992 raft_consensus.cc:3055] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:58.567577 16992 raft_consensus.cc:740] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:58.568558 16992 consensus_queue.cc:260] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:58.571802 13755 raft_consensus.cc:1240] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:58.558074 16777 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:58.624024 14407 raft_consensus.cc:1240] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:58.625193 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:58.626484 13762 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 7.
W20260709 12:10:58.647737 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 74616us
I20260709 12:10:58.597492 16992 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:58.648778 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.605438 16777 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:58.650426 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 291396us
I20260709 12:10:58.655037 13680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 498) took 1796 ms. Trace:
I20260709 12:10:58.655658 13680 rpcz_store.cc:276] 0709 12:10:56.858864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.363785 (+1504921us) service_pool.cc:224] Handling call
0709 12:10:58.364146 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:58.364665 (+   519us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:10:58.538185 (+173520us) log.cc:844] Serialized 14 byte log entry
0709 12:10:58.654554 (+116369us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:58.654617 (+    63us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:58.654746 (+   129us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.654825 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:58.654974 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45194,"prepare.queue_time_us":114265,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"thread_start_us":243393,"threads_started":2}
I20260709 12:10:58.574951 16832 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:58.671175 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 112350us
I20260709 12:10:58.701603 13684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 496) took 1843 ms. Trace:
W20260709 12:10:58.695676 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.702230 13684 rpcz_store.cc:276] 0709 12:10:56.858300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.352991 (+1494691us) service_pool.cc:224] Handling call
0709 12:10:58.353301 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:58.353494 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:10:58.483659 (+130165us) log.cc:844] Serialized 14 byte log entry
0709 12:10:58.700911 (+217252us) log.cc:844] Serialized 14 byte log entry
0709 12:10:58.701150 (+   239us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:58.701205 (+    55us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:58.701265 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.701344 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:58.701489 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":138256,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":13491,"thread_start_us":284187,"threads_started":2}
I20260709 12:10:58.706350 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:10:58.708745 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 311626us
I20260709 12:10:58.709930 14379 leader_election.cc:304] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:58.713531 16887 raft_consensus.cc:2804] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:58.714118 16887 raft_consensus.cc:697] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 8 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:10:58.715027 16887 consensus_queue.cc:237] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:58.715780 16951 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:58.652494 16991 consensus_queue.cc:1059] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 12:10:58.725760 13683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1371) took 1542 ms. Trace:
I20260709 12:10:58.726212 13683 rpcz_store.cc:276] 0709 12:10:57.182961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.837805 (+654844us) service_pool.cc:224] Handling call
0709 12:10:58.725576 (+887771us) spinlock_profiling.cc:243] Waited 22.3 ms on lock 0x7b540019a854. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:58.725694 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":51372416}
I20260709 12:10:58.726923 13682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2119) took 2044 ms. Trace:
I20260709 12:10:58.727530 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:58.728216 13683 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 7.
I20260709 12:10:58.729249 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:10:58.730007 16988 log.cc:927] Time spent T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.936s	user 0.006s	sys 0.004s
W20260709 12:10:58.732064 17003 log.cc:927] Time spent T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.309s	user 0.000s	sys 0.001s
I20260709 12:10:58.708225 17012 consensus_queue.cc:1059] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:10:58.734025 16926 consensus_queue.cc:260] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:58.735378 16926 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:58.736060 16832 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:58.736832 16817 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:58.741195 13829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 2122) took 2652 ms. Trace:
I20260709 12:10:58.741636 13829 rpcz_store.cc:276] 0709 12:10:56.089563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.089879 (+   316us) service_pool.cc:224] Handling call
0709 12:10:57.404376 (+1314497us) spinlock_profiling.cc:243] Waited 1.47 ms on lock 0x7b5800034898. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924e68b71 00007fa924e68a22 00007fa92dd818d9 00007fa92cedbee0 00007fa92cfa50ab 00007fa92cfa5131 00007fa92cf66fc0 00007fa92cf51929 00007fa92cf513d2 00007fa9264c8bd4
0709 12:10:57.404642 (+   266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:57.410928 (+  6286us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:57.410958 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:57.411819 (+   861us) log.cc:844] Serialized 26 byte log entry
0709 12:10:57.478076 (+ 66257us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:57.478116 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:57.478194 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:58.729368 (+1251174us) spinlock_profiling.cc:243] Waited 5.73 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:10:58.741004 (+ 11636us) raft_consensus.cc:1685] finished
0709 12:10:58.741024 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:58.741139 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16547840,"thread_start_us":56957,"threads_started":1,"wal-append.queue_time_us":208777}
I20260709 12:10:58.743587 16841 raft_consensus.cc:2749] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:58.744441 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:58.745890 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:58.727301 13682 rpcz_store.cc:276] 0709 12:10:56.684024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.286570 (+1602546us) service_pool.cc:224] Handling call
0709 12:10:58.362747 (+ 76177us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:58.363320 (+   573us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.726723 (+363403us) spinlock_profiling.cc:243] Waited 75.7 ms on lock 0x7b54002c4050. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:58.726869 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":174197120}
I20260709 12:10:58.747192 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:58.747474 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:58.747819 14408 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 6.
I20260709 12:10:58.748211 13682 raft_consensus.cc:2410] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:10:58.749059 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:58.749315 14409 raft_consensus.cc:1240] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:58.743505 14380 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:10:58.751873 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.753974 16736 raft_consensus.cc:2804] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:58.754419 16736 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:58.754779 16736 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:58.760325 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:58.761188 13683 raft_consensus.cc:2393] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 8: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:58.763187 13800 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:58.772168 16952 consensus_queue.cc:1048] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:58.778030 16979 raft_consensus.cc:2804] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:58.778522 16979 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:58.778882 16979 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:58.779093 16951 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 9 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:58.749687 16755 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:58.781121 14411 raft_consensus.cc:1240] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:10:58.780916 16877 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:58.783772 13755 raft_consensus.cc:1275] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:10:58.784413 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.784847 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:58.786492 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:10:58.786837 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 75841.5us
I20260709 12:10:58.786952 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:58.788208 13683 raft_consensus.cc:2410] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:58.789242 13800 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:58.788261 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:58.791860 13832 raft_consensus.cc:1240] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 7. Current term is 8. Ops: [6.4-7.5]
I20260709 12:10:58.793869 13832 pending_rounds.cc:85] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 2
I20260709 12:10:58.794158 13832 pending_rounds.cc:107] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:10:58.794394 13832 raft_consensus.cc:2889] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:58.795863 13828 raft_consensus.cc:1240] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:58.797344 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:58.805907 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:58.818089 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:58.806850 13759 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 6.
W20260709 12:10:58.851810 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 55515.5us
I20260709 12:10:58.867004 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:58.867913 13683 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:58.868122 13801 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:58.871063 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:58.871567 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:10:58.872488 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.872546 13831 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:58.882511 13831 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 10.
W20260709 12:10:58.866120 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 76987.9us
I20260709 12:10:58.883798 13800 leader_election.cc:304] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:58.884096 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:58.894968 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:58.895867 13759 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 7.
I20260709 12:10:58.895169 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:58.897342 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:58.901722 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:58.902245 13830 raft_consensus.cc:1275] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:58.902478 13755 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:58.902750 13800 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:58.795171 16777 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:58.915448 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 201000us
I20260709 12:10:58.888048 16924 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:58.920692 13800 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:58.928550 13800 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:58.908777 16817 raft_consensus.cc:2749] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:58.927361 17021 raft_consensus.cc:2749] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:58.930999 16945 raft_consensus.cc:2749] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:58.936290 13800 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
W20260709 12:10:58.936970 17035 log.cc:927] Time spent T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:10:58.937330 16945 raft_consensus.cc:2804] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:58.938025 16945 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:58.938437 16945 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:58.923527 16884 raft_consensus.cc:2749] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:58.939703 17020 consensus_queue.cc:1048] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:10:58.941031 16877 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 9 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:10:58.942022 17030 log.cc:927] Time spent T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
W20260709 12:10:58.946499 17028 log.cc:927] Time spent T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:10:58.947682 17010 raft_consensus.cc:2749] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:10:58.948980 16945 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:58.952381 16945 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:58.926225 16924 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:58.954411 16924 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:58.956738 17009 raft_consensus.cc:3055] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:58.937206 16979 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:58.957453 17009 raft_consensus.cc:740] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:58.963207 16945 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:58.985018 16945 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:59.001477 16945 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:58.992607 16979 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:59.009224 17009 consensus_queue.cc:260] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:59.028558 17009 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:59.068373 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:59.082497 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:59.084498 13682 raft_consensus.cc:2393] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 8: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
W20260709 12:10:59.076510 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:59.073123 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:59.092914 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:59.093411 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:59.093731 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.075342 13726 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:59.096655 13726 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:59.098707 16743 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:59.100111 16743 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:59.103837 16743 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:59.105567 16736 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:59.111330 16945 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:59.112205 16992 raft_consensus.cc:2749] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:59.112715 16945 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:59.120703 16945 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:59.123292 16926 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.124202 16926 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:59.124768 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:59.125766 13759 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:10:59.127686 16926 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:59.132113 16992 consensus_queue.cc:1059] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:59.134934 13680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 499) took 2275 ms. Trace:
I20260709 12:10:59.135566 13680 rpcz_store.cc:276] 0709 12:10:56.859151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.672931 (+1813780us) service_pool.cc:224] Handling call
0709 12:10:58.733579 (+ 60648us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:58.743831 (+ 10252us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:58.743860 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:58.744358 (+   498us) log.cc:844] Serialized 26 byte log entry
0709 12:10:58.883375 (+139017us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:58.883437 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.883542 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:59.066127 (+182585us) raft_consensus.cc:1685] finished
0709 12:10:59.066215 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:59.134425 (+ 68210us) spinlock_profiling.cc:243] Waited 31.7 ms on lock 0x7b540019a850. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:59.134714 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":732,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":92,"spinlock_wait_cycles":72841856,"thread_start_us":138495,"threads_started":1,"wal-append.queue_time_us":245915}
I20260709 12:10:59.138685 16992 raft_consensus.cc:3055] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:10:59.139038 13681 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48212 (request call id 502) took 2229 ms (client timeout 2876 ms). Trace:
I20260709 12:10:59.139304 16992 raft_consensus.cc:740] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:10:59.139531 13681 rpcz_store.cc:269] 0709 12:10:56.909920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.810016 (+900096us) service_pool.cc:224] Handling call
0709 12:10:59.138649 (+1328633us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b540031d8d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:59.138840 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":372456320}
I20260709 12:10:59.141158 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:59.142148 13727 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:59.148495 16926 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:59.170141 17004 consensus_queue.cc:1059] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:59.149497 16926 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:59.185393 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:59.140795 16992 consensus_queue.cc:260] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:59.175491 16736 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:59.181133 13681 raft_consensus.cc:2410] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:10:59.183465 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:59.186616 13679 raft_consensus.cc:1240] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 7 LEADER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:59.187080 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:59.196141 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:59.241022 13759 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 8.
W20260709 12:10:59.549590 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:59.328590 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.200734 13833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 526) took 1053 ms. Trace:
I20260709 12:10:59.451241 13688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2099) took 2994 ms. Trace:
I20260709 12:10:59.602633 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:59.607223 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:10:59.569756 13755 consensus_meta.cc:287] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.666s	user 0.010s	sys 0.009s
I20260709 12:10:59.226877 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:10:59.633889 13833 rpcz_store.cc:276] 0709 12:10:58.147291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.198012 (+ 50721us) service_pool.cc:224] Handling call
0709 12:10:58.221816 (+ 23804us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:58.375557 (+153741us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:58.375589 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:58.375632 (+    43us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:10:58.375676 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.200024 (+824348us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b540035d4d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:59.200136 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:59.200502 (+   366us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":353060096}
W20260709 12:10:59.518842 13683 consensus_meta.cc:287] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.650s	user 0.015s	sys 0.000s
W20260709 12:10:59.597884 17058 log.cc:927] Time spent T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 12:10:59.212862 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:59.621750 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:59.639660 13834 raft_consensus.cc:2393] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 8: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
W20260709 12:10:59.195546 17054 log.cc:927] Time spent T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
W20260709 12:10:59.602392 16924 consensus_meta.cc:287] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.589s	user 0.013s	sys 0.012s
I20260709 12:10:59.328297 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:59.227341 16777 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:10:59.569237 17009 consensus_meta.cc:287] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.538s	user 0.016s	sys 0.000s
I20260709 12:10:59.194234 17014 raft_consensus.cc:2804] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:59.193025 17022 raft_consensus.cc:3055] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:59.648496 13835 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 6.
I20260709 12:10:59.621829 16964 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:59.650087 16964 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:10:59.632073 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 170875us
W20260709 12:10:59.191159 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 94752.8us
I20260709 12:10:59.645165 13755 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 9.
I20260709 12:10:59.633546 13688 rpcz_store.cc:276] 0709 12:10:56.457053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.039713 (+1582660us) service_pool.cc:224] Handling call
0709 12:10:58.138820 (+ 99107us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:58.168244 (+ 29424us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.450467 (+1282223us) spinlock_profiling.cc:243] Waited 98.8 ms on lock 0x7b54001b03d0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:59.450958 (+   491us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":227151744}
I20260709 12:10:59.221578 16608 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:59.655678 13683 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 6.
I20260709 12:10:59.663661 16743 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:59.664512 16743 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:59.665261 16755 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:59.666290 16689 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.667083 16689 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:59.648132 17022 raft_consensus.cc:740] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:10:59.647881 17014 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:10:59.663153 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:59.672524 16677 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:59.673658 13757 raft_consensus.cc:1240] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:10:59.674412 13756 raft_consensus.cc:2393] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 9: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:10:59.681128 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:59.677398 13680 raft_consensus.cc:2468] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 7.
I20260709 12:10:59.684890 13829 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:59.686290 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.654950 16924 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:59.690380 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:10:59.691787 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 550039us
I20260709 12:10:59.676707 17014 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:59.692499 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:59.700116 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:59.703140 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:59.705883 13756 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:59.708020 17029 log.cc:927] Time spent T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 1.166s	user 0.005s	sys 0.000s
I20260709 12:10:59.710090 13761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2205) took 1291 ms. Trace:
I20260709 12:10:59.710566 16955 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:10:59.711301 17043 log.cc:927] Time spent T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.712s	user 0.000s	sys 0.001s
I20260709 12:10:59.711520 16955 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:59.710579 13761 rpcz_store.cc:276] 0709 12:10:58.418721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.420482 (+  1761us) service_pool.cc:224] Handling call
0709 12:10:58.420882 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:58.470106 (+ 49224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:58.470154 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:58.529927 (+ 59773us) log.cc:844] Serialized 26 byte log entry
0709 12:10:58.546469 (+ 16542us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:58.546530 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.546629 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:58.712954 (+166325us) spinlock_profiling.cc:243] Waited 3.28 ms on lock 0x7b48001a01d8. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92ceb6aa1 00007fa92ceadb37 00007fa92cead9ca 00007fa92cfa526f 00007fa92cfa4f37 00007fa92cfb955c 00007fa92cfb9508 00007fa92cfb9488 00007fa92cfb9443 00007fa92cfb86ec 00007fa92bee2a96
0709 12:10:59.706930 (+993976us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:10:59.709513 (+  2583us) raft_consensus.cc:1685] finished
0709 12:10:59.709534 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:59.709740 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":82503,"raft.queue_time_us":83408,"raft.run_cpu_time_us":2300,"raft.run_wall_time_us":206046,"spinlock_wait_cycles":36480768,"thread_start_us":16119,"threads_started":1,"wal-append.queue_time_us":11419}
I20260709 12:10:59.715533 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:59.716146 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:59.717036 16922 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.717731 16922 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:59.718961 13762 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38932 (request call id 456) took 1493 ms (client timeout 1776 ms). Trace:
W20260709 12:10:59.719391 13762 rpcz_store.cc:269] 0709 12:10:58.224979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.225563 (+   584us) service_pool.cc:224] Handling call
0709 12:10:59.718603 (+1493040us) spinlock_profiling.cc:243] Waited 388 ms on lock 0x7b540032ee54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:59.718782 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":891798912}
I20260709 12:10:59.720069 16922 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:59.708936 17022 consensus_queue.cc:260] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:59.722093 13830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 534) took 1572 ms. Trace:
I20260709 12:10:59.722563 13830 rpcz_store.cc:276] 0709 12:10:58.149441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.441932 (+292491us) service_pool.cc:224] Handling call
0709 12:10:58.454942 (+ 13010us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:58.902906 (+447964us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.721569 (+818663us) spinlock_profiling.cc:243] Waited 447 ms on lock 0x7b540002ce54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:59.721888 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1027454336}
I20260709 12:10:59.723908 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:10:59.728543 14379 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:10:59.731156 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:59.733155 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:10:59.735971 16943 raft_consensus.cc:3055] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:59.736593 16943 raft_consensus.cc:740] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
W20260709 12:10:59.750837 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:59.738967 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:59.751559 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:59.751925 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.750489 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:10:59.703342 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:10:59.754846 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:59.757299 13726 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:59.764010 16832 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:59.738821 16743 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:59.748353 16915 raft_consensus.cc:3055] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:59.754359 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:59.768020 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:10:59.689265 16993 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:59.746662 16964 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:59.731160 16952 raft_consensus.cc:2804] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:59.772327 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:10:59.770361 13755 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:59.772516 13682 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 7.
I20260709 12:10:59.778559 17004 raft_consensus.cc:2749] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:59.775717 16952 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:59.780228 13688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1415) took 1116 ms. Trace:
I20260709 12:10:59.748489 16752 consensus_queue.cc:1048] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:10:59.781724 13688 rpcz_store.cc:276] 0709 12:10:58.663699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.680733 (+1017034us) service_pool.cc:224] Handling call
0709 12:10:59.780161 (+ 99428us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:59.784016 13681 raft_consensus.cc:2368] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 5. Current term is 6.
I20260709 12:10:59.771651 16915 raft_consensus.cc:740] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:10:59.782907 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:59.778581 16560 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.773720 16922 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.764763 16832 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:59.802026 13837 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 7.
I20260709 12:10:59.803483 16832 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:59.795748 13679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2109) took 3219 ms. Trace:
I20260709 12:10:59.792366 16560 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:59.737747 16943 consensus_queue.cc:260] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:59.804549 13679 rpcz_store.cc:276] 0709 12:10:56.575885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.054344 (+1478459us) service_pool.cc:224] Handling call
0709 12:10:59.172280 (+1117936us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.638428 (+466148us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.795480 (+157052us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b540031d8d0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:10:59.795652 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2502760320}
I20260709 12:10:59.800789 16915 consensus_queue.cc:260] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:59.782634 16952 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:59.778916 16689 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:59.814337 16560 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:59.806849 13681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1411) took 1130 ms. Trace:
I20260709 12:10:59.815267 13681 rpcz_store.cc:276] 0709 12:10:58.662378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.644328 (+981950us) service_pool.cc:224] Handling call
0709 12:10:59.792936 (+148608us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:59.813051 16943 raft_consensus.cc:3060] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:59.804690 13831 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 3.
I20260709 12:10:59.790786 17009 raft_consensus.cc:2749] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:59.810456 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:59.807608 16922 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:59.823938 13652 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:59.825182 13830 raft_consensus.cc:2393] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 8: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:10:59.826175 13687 raft_consensus.cc:1813] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Handling vote request from an unknown peer 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:59.828591 13687 raft_consensus.cc:2393] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 5: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:10:59.831480 16848 raft_consensus.cc:2804] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:59.832068 16848 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:59.832535 16848 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:59.836846 13652 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:59.838727 16915 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:59.842525 13681 raft_consensus.cc:1240] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:59.847929 13685 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 8.
I20260709 12:10:59.851184 13755 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 8.
I20260709 12:10:59.852228 13681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1365) took 2778 ms. Trace:
I20260709 12:10:59.854027 13681 rpcz_store.cc:276] 0709 12:10:57.072600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.818257 (+2745657us) service_pool.cc:224] Handling call
0709 12:10:59.842250 (+ 23993us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.850090 (+  7840us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.850344 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:59.854198 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:10:59.851344 17022 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:59.859766 16560 raft_consensus.cc:2764] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:10:59.860957 13679 raft_consensus.cc:1275] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:59.869809 13830 raft_consensus.cc:1275] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:59.870067 13679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1397) took 2495 ms. Trace:
I20260709 12:10:59.870498 13679 rpcz_store.cc:276] 0709 12:10:57.370923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.821247 (+2450324us) service_pool.cc:224] Handling call
0709 12:10:59.822037 (+   790us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.864130 (+ 42093us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.866659 (+  2529us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:59.871600 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 212346us
I20260709 12:10:59.872212 13836 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 7.
I20260709 12:10:59.881601 13681 raft_consensus.cc:1240] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:59.885492 13681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1398) took 2514 ms. Trace:
I20260709 12:10:59.885933 13681 rpcz_store.cc:276] 0709 12:10:57.381347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.855826 (+2474479us) service_pool.cc:224] Handling call
0709 12:10:59.859889 (+  4063us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.882288 (+ 22399us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.885391 (+  3103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:59.892472 13684 raft_consensus.cc:2410] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:10:59.895988 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:59.898172 17031 log.cc:927] Time spent T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 1.023s	user 0.000s	sys 0.005s
I20260709 12:10:59.880270 16926 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:10:59.915885 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 79291us
I20260709 12:10:59.918633 16910 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:59.924700 13756 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 9.
I20260709 12:10:59.930554 13681 raft_consensus.cc:1240] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 8 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 7. Current term is 8. Ops: [5.3-7.4]
W20260709 12:10:59.929389 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 181386us
I20260709 12:10:59.937642 13681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1404) took 2524 ms. Trace:
I20260709 12:10:59.942170 13681 rpcz_store.cc:276] 0709 12:10:57.413559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.887195 (+2473636us) service_pool.cc:224] Handling call
0709 12:10:59.904876 (+ 17681us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:59.937229 (+ 32353us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.937561 (+   332us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:59.943432 13679 raft_consensus.cc:1275] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:10:59.945890 17059 log.cc:927] Time spent T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 12:10:59.947757 13754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2203) took 1636 ms. Trace:
I20260709 12:10:59.950716 13754 rpcz_store.cc:276] 0709 12:10:58.311218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.311693 (+   475us) service_pool.cc:224] Handling call
0709 12:10:58.312014 (+   321us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:58.341582 (+ 29568us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:58.341621 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:59.123073 (+781452us) spinlock_profiling.cc:243] Waited 2.6 ms on lock 0x7b2c00010828. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa926886a11 00007fa926896372 00007fa927fc8a01 00007fa927f8d43a 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2
0709 12:10:59.124063 (+   990us) log.cc:844] Serialized 52 byte log entry
0709 12:10:59.391784 (+267721us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:59.391820 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.744593 (+352773us) spinlock_profiling.cc:243] Waited 2.83 ms on lock 0x7b540035edd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:10:59.744657 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:59.947212 (+202555us) raft_consensus.cc:1685] finished
0709 12:10:59.947245 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:59.947512 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46491,"raft.queue_time_us":51331,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":20948,"spinlock_wait_cycles":12488960,"thread_start_us":267233,"threads_started":1,"wal-append.queue_time_us":535241}
I20260709 12:10:59.958258 16970 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:10:59.959010 16970 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:10:59.960790 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 63949.4us
I20260709 12:10:59.961458 16970 leader_election.cc:290] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:10:59.961711 13726 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:10:59.962783 16970 raft_consensus.cc:2804] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:59.963264 16970 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:10:59.963467 13726 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:10:59.963754 16970 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:59.968691 17061 log.cc:927] Time spent T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 12:10:59.996026 14408 raft_consensus.cc:1240] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 8 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:59.996675 16832 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.969581 17011 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:10:59.998159 17011 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:10:59.999270 13763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2202) took 1688 ms. Trace:
I20260709 12:11:00.000641 17011 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:10:59.972082 13800 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:10:59.999747 13763 rpcz_store.cc:276] 0709 12:10:58.310898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.311914 (+  1016us) service_pool.cc:224] Handling call
0709 12:10:58.312211 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:58.342098 (+ 29887us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:58.342126 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:59.650918 (+1308792us) spinlock_profiling.cc:243] Waited 2.27 ms on lock 0x7b2c00010828. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa926886a11 00007fa926896372 00007fa927fc8a01 00007fa927f8d43a 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2
0709 12:10:59.663896 (+ 12978us) log.cc:844] Serialized 26 byte log entry
0709 12:10:59.771152 (+107256us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:59.776661 (+  5509us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.777441 (+   780us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:59.998782 (+221341us) raft_consensus.cc:1685] finished
0709 12:10:59.998806 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:59.999081 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63900,"raft.queue_time_us":81299,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":13724,"spinlock_wait_cycles":5223168,"thread_start_us":92425,"threads_started":1,"wal-append.queue_time_us":148125}
I20260709 12:11:00.004228 13800 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:10:59.978238 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.981297 13680 raft_consensus.cc:1275] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 12:10:59.982632 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:59.987753 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 49521.9us
I20260709 12:10:59.988108 14411 raft_consensus.cc:1240] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:10:59.990933 16955 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:10:59.983901 14379 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:10:59.992410 16922 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:10:59.994148 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.006409 13680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 500) took 3114 ms. Trace:
I20260709 12:10:59.994808 13652 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:10:59.983783 13679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1399) took 2562 ms. Trace:
I20260709 12:11:00.009039 13680 rpcz_store.cc:276] 0709 12:10:56.892476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.980221 (+3087745us) service_pool.cc:224] Handling call
0709 12:10:59.980780 (+   559us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:00.006087 (+ 25307us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.006339 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:00.009699 13679 rpcz_store.cc:276] 0709 12:10:57.381748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.871363 (+2489615us) service_pool.cc:224] Handling call
0709 12:10:59.917201 (+ 45838us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.943988 (+ 26787us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.944245 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:00.037292 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.931600 17014 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:10:59.997583 16832 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:00.006615 16926 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:00.084758 13683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 504) took 3102 ms. Trace:
I20260709 12:11:00.064007 17011 raft_consensus.cc:2749] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:00.101627 13681 raft_consensus.cc:1275] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:00.086210 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:00.016290 16952 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:00.085645 13683 rpcz_store.cc:276] 0709 12:10:56.982353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.762411 (+2780058us) service_pool.cc:224] Handling call
0709 12:10:59.817856 (+ 55445us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.843109 (+ 25253us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:10:59.877239 (+ 34130us) log.cc:844] Serialized 14 byte log entry
0709 12:11:00.079615 (+202376us) log.cc:844] Serialized 14 byte log entry
0709 12:11:00.084311 (+  4696us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:00.084381 (+    70us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:00.084456 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.084544 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:00.084691 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3885,"prepare.queue_time_us":116705,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":97,"raft.queue_time_us":7096,"spinlock_wait_cycles":18987136,"thread_start_us":218688,"threads_started":2}
I20260709 12:11:00.108260 17024 raft_consensus.cc:2804] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:00.108940 17024 raft_consensus.cc:697] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 8 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:00.109421 13683 raft_consensus.cc:1240] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:11:00.109998 14408 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 10.
I20260709 12:11:00.110180 13683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 516) took 1029 ms. Trace:
I20260709 12:11:00.110632 13683 rpcz_store.cc:276] 0709 12:10:59.081188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.108798 (+1027610us) service_pool.cc:224] Handling call
0709 12:11:00.109178 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:00.109888 (+   710us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.110102 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:00.111210 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 147852us
I20260709 12:11:00.112154 13683 raft_consensus.cc:1275] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:11:00.112093 13726 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:00.116940 13681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 507) took 1949 ms. Trace:
I20260709 12:11:00.117318 13681 rpcz_store.cc:276] 0709 12:10:58.156159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.984183 (+1828024us) service_pool.cc:224] Handling call
0709 12:11:00.073767 (+ 89584us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:00.102297 (+ 28530us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.105625 (+  3328us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:00.117995 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.114387 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:00.120891 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:00.017621 17004 consensus_queue.cc:1059] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.087s
I20260709 12:11:00.121616 13680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 513) took 1944 ms. Trace:
I20260709 12:11:00.124455 13680 rpcz_store.cc:276] 0709 12:10:58.176892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.064924 (+1888032us) service_pool.cc:224] Handling call
0709 12:11:00.096061 (+ 31137us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:00.105025 (+  8964us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:00.105074 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:00.116350 (+ 11276us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:00.121354 (+  5004us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.121429 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:00.121557 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":206,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":18895}
W20260709 12:11:00.123644 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 205697us
I20260709 12:11:00.099834 16777 raft_consensus.cc:2804] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:11:00.128841 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 47402.7us
W20260709 12:11:00.131174 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 127052us
I20260709 12:11:00.122874 16992 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:00.139782 16832 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:00.147328 16955 consensus_queue.cc:1059] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:00.148339 16955 raft_consensus.cc:3055] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:00.148432 13801 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:00.148748 16955 raft_consensus.cc:740] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:00.149672 17011 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:00.150130 17011 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.150514 17011 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:00.152325 16926 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:00.145064 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.154829 16926 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:00.160140 16689 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:00.160421 16955 consensus_queue.cc:260] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:00.160791 16689 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:00.161911 16955 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:00.170102 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:00.139433 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 144760us
I20260709 12:11:00.166023 17071 consensus_queue.cc:1059] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:11:00.144949 16970 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:00.129458 16777 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.167949 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:00.161912 14411 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:11:00.134944 16953 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:00.196637 13760 raft_consensus.cc:2410] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:11:00.196841 13652 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:00.121811 16848 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:00.135107 16545 raft_consensus.cc:2749] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:00.187724 16777 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:00.203336 14408 raft_consensus.cc:2393] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 8: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
W20260709 12:11:00.213644 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.214836 13800 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:00.218045 16926 raft_consensus.cc:2749] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:00.221376 13682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 505) took 3215 ms. Trace:
I20260709 12:11:00.222185 16560 raft_consensus.cc:2804] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:00.222863 16560 raft_consensus.cc:697] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 8 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:00.223984 16560 consensus_queue.cc:237] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:00.110055 17024 consensus_queue.cc:237] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:00.226361 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 62790.2us
I20260709 12:11:00.227313 16970 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:00.228351 14379 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:00.238549 17014 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:00.240373 16952 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:00.241041 16689 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:00.217619 13800 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:11:00.245689 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.247314 13688 raft_consensus.cc:1240] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 4. Current term is 5. Ops: []
W20260709 12:11:00.248936 13829 consensus_meta.cc:287] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.550s	user 0.010s	sys 0.000s
I20260709 12:11:00.249279 13829 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 8.
I20260709 12:11:00.249719 13829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35422 (request call id 549) took 1023 ms. Trace:
W20260709 12:11:00.247848 13687 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1400) took 2856 ms (client timeout 2589 ms). Trace:
W20260709 12:11:00.246891 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 134933us
I20260709 12:11:00.250104 13829 rpcz_store.cc:276] 0709 12:10:59.226540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.503372 (+276832us) service_pool.cc:224] Handling call
0709 12:11:00.249675 (+746303us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:00.221844 13682 rpcz_store.cc:276] 0709 12:10:57.006360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.792106 (+2785746us) service_pool.cc:224] Handling call
0709 12:10:59.849818 (+ 57712us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:59.858243 (+  8425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:59.858279 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:59.873877 (+ 15598us) log.cc:844] Serialized 52 byte log entry
0709 12:11:00.093500 (+219623us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:00.099683 (+  6183us) log.cc:844] Serialized 14 byte log entry
0709 12:11:00.100004 (+   321us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.100087 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:00.221109 (+121022us) raft_consensus.cc:1685] finished
0709 12:11:00.221128 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:00.221307 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2770,"prepare.queue_time_us":7087,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":7107,"raft.run_cpu_time_us":562,"raft.run_wall_time_us":20988,"thread_start_us":191420,"threads_started":1,"wal-append.queue_time_us":289716}
W20260709 12:11:00.251125 13687 rpcz_store.cc:269] 0709 12:10:57.386183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.981828 (+595645us) service_pool.cc:224] Handling call
0709 12:11:00.242049 (+2260221us) spinlock_profiling.cc:243] Waited 1.84 s on lock 0x7b540021eb54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:00.242233 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4238812928}
I20260709 12:11:00.268368 16752 raft_consensus.cc:2804] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:11:00.284475 13727 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:00.288080 13835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54830 (request call id 2156) took 1097 ms. Trace:
I20260709 12:11:00.292459 14411 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 8.
W20260709 12:11:00.294736 16999 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.006s	sys 0.010s
W20260709 12:11:00.295256 16999 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.006s	sys 0.010s
W20260709 12:11:00.296259 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.264319 16545 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:00.288614 13835 rpcz_store.cc:276] 0709 12:10:59.176088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.184664 (+  8576us) service_pool.cc:224] Handling call
0709 12:11:00.273143 (+1088479us) spinlock_profiling.cc:243] Waited 20.4 ms on lock 0x7b54001671d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:00.273285 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":46863232}
I20260709 12:11:00.266712 16848 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:00.282011 16832 raft_consensus.cc:2749] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:11:00.322180 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 55574.4us
I20260709 12:11:00.325652 16922 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:00.334987 13727 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:00.335233 16922 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:00.339999 16992 raft_consensus.cc:3055] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:00.340622 16992 raft_consensus.cc:740] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:11:00.342026 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 148661us
I20260709 12:11:00.346133 13801 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:11:00.346814 17070 log.cc:927] Time spent T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.144s	user 0.002s	sys 0.000s
I20260709 12:11:00.302397 16752 raft_consensus.cc:697] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 4 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:00.350257 17009 raft_consensus.cc:2749] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:00.350535 13684 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1405) took 1692 ms (client timeout 1663 ms). Trace:
W20260709 12:11:00.351634 13685 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48212 (request call id 510) took 2194 ms (client timeout 1527 ms). Trace:
I20260709 12:11:00.351091 16752 consensus_queue.cc:237] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:00.319829 16993 consensus_meta.cc:287] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.544s	user 0.012s	sys 0.000s
I20260709 12:11:00.354321 13726 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:11:00.354789 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 137327us
I20260709 12:11:00.300953 17064 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:00.355568 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 127394us
W20260709 12:11:00.352065 13685 rpcz_store.cc:269] 0709 12:10:58.157110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.166810 (+  9700us) service_pool.cc:224] Handling call
0709 12:11:00.351438 (+2184628us) spinlock_profiling.cc:243] Waited 1.68 s on lock 0x7b5400246dd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:00.351567 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3863040768}
W20260709 12:11:00.351029 13684 rpcz_store.cc:269] 0709 12:10:58.657845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.706102 (+ 48257us) service_pool.cc:224] Handling call
0709 12:11:00.350266 (+1644164us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b5400285ad4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:00.350464 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2711593728}
I20260709 12:11:00.269445 17014 consensus_queue.cc:1059] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:11:00.361249 17014 raft_consensus.cc:3055] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:00.363260 17014 raft_consensus.cc:740] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:00.364264 14379 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:11:00.365105 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:00.366320 17022 consensus_meta.cc:287] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.503s	user 0.012s	sys 0.000s
I20260709 12:11:00.362288 16955 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:00.369700 16955 raft_consensus.cc:697] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 8 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:00.373382 16924 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:00.374218 13679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 509) took 2217 ms. Trace:
I20260709 12:11:00.375962 13679 rpcz_store.cc:276] 0709 12:10:58.156813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.014123 (+1857310us) service_pool.cc:224] Handling call
0709 12:11:00.094112 (+ 79989us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:00.166919 (+ 72807us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:00.166955 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:00.172273 (+  5318us) log.cc:844] Serialized 26 byte log entry
0709 12:11:00.282538 (+110265us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:00.282610 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.282723 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:00.373873 (+ 91150us) raft_consensus.cc:1685] finished
0709 12:11:00.373906 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:00.374136 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11008,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":10817,"thread_start_us":73085,"threads_started":1,"wal-append.queue_time_us":164415}
I20260709 12:11:00.374595 17064 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:00.374804 13833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 548) took 1148 ms. Trace:
W20260709 12:11:00.365721 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.374277 16924 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:00.382329 16924 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:00.357618 16992 consensus_queue.cc:260] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:00.382997 13800 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:00.385057 16924 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:11:00.378575 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.385664 16924 raft_consensus.cc:2749] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:00.391255 16848 consensus_queue.cc:1048] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:11:00.385571 13800 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:00.378255 13833 rpcz_store.cc:276] 0709 12:10:59.226089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.683593 (+457504us) service_pool.cc:224] Handling call
0709 12:10:59.701955 (+ 18362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.715461 (+ 13506us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:10:59.928536 (+213075us) log.cc:844] Serialized 14 byte log entry
0709 12:11:00.105404 (+176868us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:00.105458 (+    54us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:00.105496 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.345957 (+240461us) spinlock_profiling.cc:243] Waited 1.87 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:11:00.374548 (+ 28591us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b54000d9654. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:00.374606 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:00.374744 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":219339,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":1279,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":116,"spinlock_wait_cycles":34519040,"thread_start_us":361101,"threads_started":2,"wal-append.queue_time_us":205941}
I20260709 12:11:00.391098 13688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 506) took 3341 ms. Trace:
I20260709 12:11:00.405748 13688 rpcz_store.cc:276] 0709 12:10:57.049421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.811852 (+2762431us) service_pool.cc:224] Handling call
0709 12:11:00.245046 (+433194us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:00.251452 (+  6406us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.390801 (+139349us) spinlock_profiling.cc:243] Waited 407 ms on lock 0x7b540021eb50. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:00.390974 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":937051392}
I20260709 12:11:00.389187 13760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38932 (request call id 471) took 1183 ms. Trace:
I20260709 12:11:00.404663 16677 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.392246 13652 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:00.409235 16689 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.409399 16677 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:00.410208 16689 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:00.412118 16677 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:00.412482 16689 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:00.412716 16677 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.414060 16887 raft_consensus.cc:2749] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:11:00.415561 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 51404.3us
I20260709 12:11:00.416494 14379 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:00.393306 16608 consensus_queue.cc:1048] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:11:00.389470 17064 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:00.418603 17064 raft_consensus.cc:2749] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:00.420356 16970 raft_consensus.cc:3055] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:00.420882 16970 raft_consensus.cc:740] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:00.421521 16608 raft_consensus.cc:2804] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:00.399233 16953 raft_consensus.cc:2749] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:00.422112 16970 consensus_queue.cc:260] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:00.422780 16964 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.422967 17001 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.399964 13686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2092) took 3944 ms. Trace:
I20260709 12:11:00.368060 17014 consensus_queue.cc:260] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:00.407644 13760 rpcz_store.cc:276] 0709 12:10:59.205439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.675447 (+470008us) service_pool.cc:224] Handling call
0709 12:11:00.388970 (+713523us) spinlock_profiling.cc:243] Waited 493 ms on lock 0x7b540032e954. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:00.389124 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1134336256}
I20260709 12:11:00.413283 16677 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:00.434273 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 48818.2us
I20260709 12:11:00.423555 13686 rpcz_store.cc:276] 0709 12:10:56.455017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.021094 (+1566077us) service_pool.cc:224] Handling call
0709 12:10:58.056082 (+ 34988us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:00.158443 (+2102361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:00.158507 (+    64us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:00.158560 (+    53us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:00.158613 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.399458 (+240845us) spinlock_profiling.cc:243] Waited 2.1 s on lock 0x7b540021e654. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:00.399527 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:00.399713 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1919,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":110,"spinlock_wait_cycles":4833900800}
I20260709 12:11:00.423360 16964 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:00.432185 16545 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:00.432785 16970 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:00.433341 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.422250 16608 raft_consensus.cc:697] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 8 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:00.396840 16992 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:00.444291 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 52214.4us
W20260709 12:11:00.445765 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.434283 17001 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:00.446635 17075 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:11:00.448137 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 146512us
I20260709 12:11:00.450150 17073 raft_consensus.cc:2749] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:00.450315 16964 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:00.455466 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 113033us
I20260709 12:11:00.437486 17071 raft_consensus.cc:2804] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:00.438810 16848 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:00.442327 16922 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:00.470229 13829 raft_consensus.cc:1240] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:00.477223 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:00.477734 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:00.439517 17064 consensus_queue.cc:1048] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:11:00.482151 13800 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:00.482899 13760 raft_consensus.cc:2393] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 8: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:00.467463 16915 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.468391 16832 raft_consensus.cc:2804] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:11:00.490432 13652 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:00.460762 16545 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:00.439417 16955 consensus_queue.cc:237] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:00.499018 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:00.473173 16924 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:00.500689 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:00.506428 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:00.513027 13829 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 7.
I20260709 12:11:00.475574 17004 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.514237 17004 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:00.516584 17004 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:00.518435 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:00.490015 17071 raft_consensus.cc:697] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:00.519085 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:00.471736 17011 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:00.526268 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 55558.9us
I20260709 12:11:00.498975 16545 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:00.535432 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:00.528061 13756 raft_consensus.cc:1240] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 5. Current term is 6. Ops: []
W20260709 12:11:00.538723 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 65620.4us
I20260709 12:11:00.539602 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:00.544632 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:00.545332 13688 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 9.
I20260709 12:11:00.499816 17073 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:00.533401 13757 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 7.
I20260709 12:11:00.496871 16943 consensus_queue.cc:1048] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:11:00.494976 16848 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:00.531073 17014 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:00.555380 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:11:00.552042 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.529084 16832 raft_consensus.cc:697] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 6 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:00.555223 13830 raft_consensus.cc:1240] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 9. Current term is 11. Ops: []
I20260709 12:11:00.549674 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:00.502018 16915 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:00.556288 13652 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
W20260709 12:11:00.557114 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 93458.3us
I20260709 12:11:00.549316 13837 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 8.
I20260709 12:11:00.559010 13684 raft_consensus.cc:1813] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Handling vote request from an unknown peer 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:00.552009 13679 raft_consensus.cc:2393] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 8: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
W20260709 12:11:00.561435 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.570099 13684 raft_consensus.cc:2393] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 5: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:00.499468 17075 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:00.517889 16777 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:00.561929 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:00.574805 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:00.575848 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:00.573845 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:00.573644 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:00.578437 13829 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 7.
I20260709 12:11:00.550237 17022 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.580175 13681 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 5.
I20260709 12:11:00.579623 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:00.583628 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:00.574175 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:00.573230 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:00.587837 17011 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:00.588968 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 46879.4us
I20260709 12:11:00.589885 17081 raft_consensus.cc:2804] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:00.549821 16953 consensus_queue.cc:1048] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:11:00.594180 13686 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:00.584918 13726 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:11:00.592581 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.590411 17081 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:00.598220 13800 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:00.600320 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:00.605319 13756 raft_consensus.cc:1240] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:11:00.603961 13688 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 6.
I20260709 12:11:00.577111 17004 consensus_queue.cc:1059] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:11:00.612460 13679 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 7.
I20260709 12:11:00.556443 16608 consensus_queue.cc:237] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:00.617913 17011 raft_consensus.cc:2749] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:00.610467 17071 consensus_queue.cc:237] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:00.604189 17081 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:00.631336 14380 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:00.606501 16677 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:00.559113 16924 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:00.634303 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 63252.2us
W20260709 12:11:00.640467 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 50014us
I20260709 12:11:00.591925 17022 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:00.642509 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:00.655313 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.647253 17086 raft_consensus.cc:2804] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:11:00.680335 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 96633.5us
I20260709 12:11:00.576447 17073 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:00.683455 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 90912.4us
I20260709 12:11:00.691181 13652 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:11:00.695334 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 110502us
I20260709 12:11:00.690915 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:00.697543 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:00.698439 14411 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:00.700371 13756 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 8.
I20260709 12:11:00.705699 16545 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:00.706434 16877 raft_consensus.cc:2804] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:00.707099 16877 raft_consensus.cc:697] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 8 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:00.708093 16877 consensus_queue.cc:237] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:00.711948 13760 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 6.
I20260709 12:11:00.715760 16915 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:00.716627 17090 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:11:00.716677 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 71496us
I20260709 12:11:00.717283 17090 raft_consensus.cc:697] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 10 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:00.719054 13652 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:00.681938 17093 raft_consensus.cc:2749] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:00.719844 14411 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 11.
I20260709 12:11:00.715624 13726 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:00.738543 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:00.740091 14380 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:00.747798 13652 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:00.749266 13652 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:00.758026 13652 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:00.755674 16736 consensus_queue.cc:1059] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:11:00.762769 16910 raft_consensus.cc:2804] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:11:00.762315 16677 raft_consensus.cc:2804] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:00.710952 17086 raft_consensus.cc:697] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 10 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:00.768169 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:00.768117 13686 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 8.
I20260709 12:11:00.702543 17001 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:00.775079 13800 leader_election.cc:400] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 5. Current term is 6.
I20260709 12:11:00.775553 13800 leader_election.cc:403] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:00.776180 13758 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:00.768399 16953 raft_consensus.cc:2804] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:00.763291 16848 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:00.763267 16910 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:00.763329 17022 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:00.773483 16677 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:00.771924 16915 raft_consensus.cc:2749] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:00.803790 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:00.800969 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:00.810282 13686 raft_consensus.cc:3055] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:00.830463 13686 raft_consensus.cc:740] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:00.825641 16689 raft_consensus.cc:2749] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:11:00.853400 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:00.859227 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 143702us
I20260709 12:11:00.788470 17001 raft_consensus.cc:2804] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:11:00.866146 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.864337 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:00.735446 16832 consensus_queue.cc:237] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:00.861277 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.863639 13755 raft_consensus.cc:1275] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:00.830570 13836 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 8.
I20260709 12:11:00.826756 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:00.795658 16953 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.872238 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:00.894133 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:00.896060 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:00.896339 13680 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:00.896569 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 135427us
I20260709 12:11:00.896963 13761 raft_consensus.cc:2393] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 8: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:00.802134 17011 raft_consensus.cc:3060] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:11:00.905754 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 186262us
W20260709 12:11:00.905959 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 154021us
W20260709 12:11:00.894793 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 88597us
I20260709 12:11:00.908105 13801 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:00.908408 13651 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:00.897743 13757 raft_consensus.cc:1275] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:11:00.894490 13760 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 7.
I20260709 12:11:00.786199 17004 raft_consensus.cc:2764] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:11:00.900887 13686 consensus_queue.cc:260] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:00.901939 17075 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:00.903597 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:00.860738 17094 consensus_queue.cc:1048] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.089s
I20260709 12:11:00.869895 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:00.807265 16910 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:11:00.917141 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:00.919310 13763 raft_consensus.cc:1240] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:00.826164 16743 consensus_queue.cc:1048] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.094s
I20260709 12:11:00.809480 16924 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:00.827454 16677 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:00.922952 13686 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:00.924217 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 161271us
I20260709 12:11:00.914499 16955 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:00.947078 16955 raft_consensus.cc:697] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 11 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:00.948253 16955 consensus_queue.cc:237] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:00.950201 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:00.951546 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:00.952697 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:00.954255 14379 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:00.859073 17093 consensus_queue.cc:1059] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.129s
I20260709 12:11:00.955348 16887 raft_consensus.cc:2804] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:00.956001 16887 raft_consensus.cc:697] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 9 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:00.956189 17093 raft_consensus.cc:3055] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:00.956667 17093 raft_consensus.cc:740] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:00.956842 14379 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:00.956911 16887 consensus_queue.cc:237] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:00.958467 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:00.962365 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 46960.1us
W20260709 12:11:00.963938 17100 log.cc:927] Time spent T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:11:00.970081 17092 raft_consensus.cc:3055] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:00.970662 17092 raft_consensus.cc:740] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:00.971772 17092 consensus_queue.cc:260] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:00.972544 17086 consensus_queue.cc:237] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:00.973276 17092 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:00.975935 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:00.903261 16953 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:00.895293 16926 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
W20260709 12:11:00.938922 17067 log.cc:927] Time spent T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:11:00.948900 13726 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:00.871197 17001 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:00.975565 13756 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 9.
I20260709 12:11:00.870492 16777 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:00.976745 13762 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:00.981279 13686 raft_consensus.cc:1275] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:11:00.984194 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:00.987720 13686 pending_rounds.cc:85] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 7
I20260709 12:11:00.997146 13758 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 8.
I20260709 12:11:00.987275 13760 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 9.
I20260709 12:11:01.000089 13652 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:11:01.043952 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.055326 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:00.984862 17024 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.997757 17001 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:00.988157 13686 pending_rounds.cc:107] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:11:01.064508 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:01.064791 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 101539us
I20260709 12:11:01.014918 16752 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:01.016746 17091 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:01.066596 16970 consensus_meta.cc:287] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.609s	user 0.006s	sys 0.006s
I20260709 12:11:01.072652 13686 raft_consensus.cc:2889] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:01.084823 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 136110us
I20260709 12:11:01.061504 16926 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:01.087497 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 87724.8us
I20260709 12:11:01.061344 16743 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.065892 17004 raft_consensus.cc:2749] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:11:01.114331 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:01.122754 13760 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 8.
W20260709 12:11:01.135092 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 64737.9us
I20260709 12:11:01.137877 13651 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:01.152285 13652 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:01.158215 13680 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 8.
W20260709 12:11:01.162781 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 89701.8us
W20260709 12:11:01.164806 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:01.188724 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 50933.3us
I20260709 12:11:00.981861 17090 consensus_queue.cc:237] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:01.140867 16992 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.123003 17073 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:01.160429 16608 raft_consensus.cc:2764] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:11:01.083830 17024 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:01.142748 17105 raft_consensus.cc:2749] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:01.145498 16743 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:01.150986 17098 consensus_queue.cc:1048] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.106s
I20260709 12:11:01.187650 16922 consensus_queue.cc:1048] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.096s
I20260709 12:11:01.232810 16992 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:01.287358 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:01.332353 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 180161us
I20260709 12:11:01.095759 17091 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:01.091135 17093 consensus_queue.cc:260] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:01.334920 13800 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:11:01.335753 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 183613us
I20260709 12:11:01.277140 16689 raft_consensus.cc:2749] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:01.329504 16752 raft_consensus.cc:697] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 9 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
W20260709 12:11:01.341210 17081 consensus_meta.cc:287] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.696s	user 0.012s	sys 0.003s
I20260709 12:11:01.331936 17107 raft_consensus.cc:2804] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:01.364050 13652 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:01.339340 16777 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.394583 13726 leader_election.cc:304] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:01.372337 17107 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:01.393757 17110 log.cc:927] Time spent T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
W20260709 12:11:01.404436 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 44607us
W20260709 12:11:01.413466 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 78623.5us
I20260709 12:11:01.414297 13800 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:01.397907 17093 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:01.427104 13800 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:01.433826 17120 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:01.434736 17114 log.cc:927] Time spent T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 12:11:01.434602 17120 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:01.435921 16924 raft_consensus.cc:2804] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:01.436571 16924 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:01.437088 16924 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:01.403245 17107 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:01.442570 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 485775us
I20260709 12:11:01.373387 17081 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:01.443945 14379 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:01.445021 17124 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:01.445472 17121 consensus_queue.cc:1048] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.086s
I20260709 12:11:01.445638 13762 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 8.
I20260709 12:11:01.447919 16910 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:01.401557 16777 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:01.453691 17118 log.cc:927] Time spent T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
W20260709 12:11:01.454509 17116 log.cc:927] Time spent T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
W20260709 12:11:01.460722 17096 log.cc:927] Time spent T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.396s	user 0.000s	sys 0.002s
W20260709 12:11:01.474069 17111 log.cc:927] Time spent T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.328s	user 0.000s	sys 0.001s
I20260709 12:11:01.475286 16992 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:01.476387 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 69697.7us
I20260709 12:11:01.511049 13652 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:11:01.433892 17112 log.cc:927] Time spent T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.308s	user 0.001s	sys 0.000s
I20260709 12:11:01.422569 17073 raft_consensus.cc:2749] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:01.437736 17120 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:11:01.495311 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.519670 13727 leader_election.cc:304] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
W20260709 12:11:01.499142 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 136788us
I20260709 12:11:01.504527 17091 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:01.438475 16926 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:01.506443 13836 raft_consensus.cc:1240] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:01.523689 13652 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:01.442795 16689 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.496842 16993 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.509085 16752 consensus_queue.cc:237] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:01.526016 16743 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:01.526429 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 82631.3us
W20260709 12:11:01.518213 17113 log.cc:927] Time spent T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.258s	user 0.001s	sys 0.000s
I20260709 12:11:01.515491 16964 raft_consensus.cc:2749] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:11:01.518769 17089 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.005s	sys 0.007s
W20260709 12:11:01.533814 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 106733us
I20260709 12:11:01.534544 13762 raft_consensus.cc:1275] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:01.534752 13726 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:01.532878 14379 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:01.540959 17117 raft_consensus.cc:2804] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:01.536921 13727 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:01.541332 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:11:01.544440 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.539814 13800 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:01.523204 17098 raft_consensus.cc:2749] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:01.522765 17024 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:01.548369 13727 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:01.527335 17120 raft_consensus.cc:2749] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:01.541429 16910 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:01.553170 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:01.531297 17091 raft_consensus.cc:2749] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:01.562229 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:01.547027 17089 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.005s	sys 0.007s
I20260709 12:11:01.563995 13760 raft_consensus.cc:2368] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for earlier term 7. Current term is 8.
W20260709 12:11:01.547807 17011 consensus_meta.cc:287] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.633s	user 0.008s	sys 0.003s
I20260709 12:11:01.567049 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:01.567646 13800 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:01.541580 17117 raft_consensus.cc:697] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 8 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:01.571964 13682 raft_consensus.cc:1275] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:11:01.551623 16992 raft_consensus.cc:2804] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:01.583140 13688 raft_consensus.cc:1240] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 4. Current term is 5. Ops: []
I20260709 12:11:01.583495 16777 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:01.584357 16953 consensus_meta.cc:287] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.578s	user 0.010s	sys 0.000s
I20260709 12:11:01.584841 16953 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:01.586017 17115 log.cc:927] Time spent T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.321s	user 0.000s	sys 0.001s
I20260709 12:11:01.586163 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:01.586855 14409 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 7.
I20260709 12:11:01.553023 16877 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.587837 14411 raft_consensus.cc:2393] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 9: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:11:01.588241 16877 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:01.590364 16953 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 9 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:01.591151 16877 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:01.553575 17081 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:01.574276 17011 raft_consensus.cc:2749] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 5. Current term is 6.
I20260709 12:11:01.543852 17125 consensus_queue.cc:1059] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
W20260709 12:11:01.593104 16677 consensus_meta.cc:287] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.596s	user 0.009s	sys 0.002s
I20260709 12:11:01.531102 16689 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:01.704303 13760 raft_consensus.cc:1240] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 4. Current term is 5. Ops: []
I20260709 12:11:01.672134 17073 raft_consensus.cc:2749] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:11:01.704854 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 127411us
I20260709 12:11:01.725571 17117 consensus_queue.cc:237] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:01.735441 17139 log.cc:927] Time spent T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:11:01.735947 16689 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:01.736191 14379 leader_election.cc:400] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 pre-election: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for earlier term 7. Current term is 8.
I20260709 12:11:01.736697 14379 leader_election.cc:403] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:11:01.672569 17118 log.cc:927] Time spent T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:11:01.739784 17134 raft_consensus.cc:2749] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for earlier term 7. Current term is 8.
I20260709 12:11:01.583168 17123 raft_consensus.cc:2749] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:01.534327 16993 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:01.641211 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 73629.9us
I20260709 12:11:01.741683 13800 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:01.742786 16993 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:01.743089 13800 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:01.743335 17121 raft_consensus.cc:2804] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:01.744046 17011 raft_consensus.cc:2804] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:11:01.646682 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.744488 17011 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:01.744911 17011 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:01.754707 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:01.756546 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:01.757057 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:01.757155 17123 consensus_queue.cc:1059] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:01.753437 17011 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:01.758374 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:01.760068 17011 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:11:01.761453 17001 consensus_meta.cc:287] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.667s	user 0.001s	sys 0.007s
I20260709 12:11:01.678581 17092 raft_consensus.cc:2749] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:01.565176 16955 raft_consensus.cc:2804] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:01.570400 16743 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.591843 16877 consensus_queue.cc:1048] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.090s
I20260709 12:11:01.723021 16677 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:01.723531 17129 log.cc:927] Time spent T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
W20260709 12:11:01.724247 17131 log.cc:927] Time spent T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.254s	user 0.001s	sys 0.000s
I20260709 12:11:01.725143 17125 raft_consensus.cc:3055] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:01.682365 17137 raft_consensus.cc:2804] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:11:01.729609 13652 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 1.699s (SENT) [suppressed 18 similar messages]
I20260709 12:11:01.744041 17121 raft_consensus.cc:697] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 8 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:01.763449 17146 raft_consensus.cc:2804] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:01.764189 16993 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:01.683012 16777 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.765527 17093 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.767247 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:01.767434 17081 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:01.768071 17120 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.768092 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:01.768821 17011 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:01.768955 16926 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:01.868449 17120 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:01.871131 13681 raft_consensus.cc:2393] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 8: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:01.770246 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:01.773627 14413 raft_consensus.cc:1240] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:01.829895 17125 raft_consensus.cc:740] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:01.775066 16992 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:01.775617 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:01.776043 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:01.877286 13680 raft_consensus.cc:1813] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Handling vote request from an unknown peer 96701a74fdee481fb5f54aac841e17dd
W20260709 12:11:01.877336 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 348241us
I20260709 12:11:01.877911 13680 raft_consensus.cc:2393] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 5: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:01.776859 13683 raft_consensus.cc:1275] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:01.778612 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:01.785522 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:01.882501 13684 raft_consensus.cc:2410] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 12:11:01.761457 17014 consensus_meta.cc:287] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 1.199s	user 0.014s	sys 0.000s
I20260709 12:11:01.786475 17145 consensus_queue.cc:1048] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 12:11:01.789184 17107 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:01.791069 16924 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:01.813796 17001 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:01.802259 17144 consensus_queue.cc:1059] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:01.814913 17024 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.827575 16677 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:01.772017 17124 raft_consensus.cc:2749] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:01.778705 17141 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.903298 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:11:01.841967 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:01.859314 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 311007us
I20260709 12:11:01.811121 16955 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:01.865248 13679 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 9.
I20260709 12:11:01.904695 13727 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:01.868659 16926 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:01.769448 13800 connection.cc:256] RPC call timeout handler was delayed by -1.2367575589998978s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15880000000000002s for a response
W20260709 12:11:01.871963 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.875579 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:01.874346 13685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 527) took 1073 ms. Trace:
I20260709 12:11:01.886569 16992 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:01.832046 17137 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:01.887444 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:01.819434 16743 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:01.858814 17146 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:01.895057 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:01.897429 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:01.897578 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:01.899538 16949 raft_consensus.cc:3055] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:11:01.900908 17120 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:01.865193 16777 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:01.911772 13760 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:01.861438 16993 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:01.918957 13683 raft_consensus.cc:2468] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 6.
I20260709 12:11:01.919494 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:01.915324 17137 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:01.919533 17077 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.920272 17075 raft_consensus.cc:2804] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:01.872189 17093 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:01.875108 17081 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:01.921751 13756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48114 (request call id 2227) took 1103 ms. Trace:
I20260709 12:11:01.900805 17121 consensus_queue.cc:237] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:01.906487 16955 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:01.921320 17142 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.953828 16993 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:01.895658 17011 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:01.956347 13756 rpcz_store.cc:276] 0709 12:11:00.818098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.860660 (+ 42562us) service_pool.cc:224] Handling call
0709 12:11:01.921570 (+1060910us) spinlock_profiling.cc:243] Waited 58.7 ms on lock 0x7b54001d2c54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:01.921684 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":134916480}
W20260709 12:11:01.933924 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 204356us
I20260709 12:11:01.951180 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:01.910998 13685 rpcz_store.cc:276] 0709 12:11:00.801239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.801359 (+   120us) service_pool.cc:224] Handling call
0709 12:11:00.860196 (+ 58837us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:00.860422 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:00.860444 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:00.943544 (+ 83100us) log.cc:844] Serialized 26 byte log entry
0709 12:11:01.350633 (+407089us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:01.395381 (+ 44748us) log.cc:844] Serialized 14 byte log entry
0709 12:11:01.395746 (+   365us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.396036 (+   290us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:01.747931 (+351895us) spinlock_profiling.cc:243] Waited 5.74 ms on lock 0x7b1800082d80. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924ea03f3 00007fa924ea27c1 00007fa924ea2779 00007fa924ea2709 00007fa924ea26d1 00007fa924ea19cd 0000000000388634 0000000000388479 00007fa924e8383a
0709 12:11:01.827346 (+ 79415us) spinlock_profiling.cc:243] Waited 4.36 ms on lock 0x7b1800082d80. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e6e2a6 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924ea0522 00007fa924ea27c1
0709 12:11:01.827859 (+   513us) spinlock_profiling.cc:243] Waited 3.96 ms on lock 0x7b1800082d80. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924ea0522 00007fa924ea27c1 00007fa924ea2779 00007fa924ea2709 00007fa924ea26d1 00007fa924ea19cd 0000000000388634 0000000000388479 00007fa924e8383a
0709 12:11:01.871235 (+ 43376us) raft_consensus.cc:1685] finished
0709 12:11:01.871258 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:01.874270 (+  3012us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1458,"prepare.queue_time_us":39891,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":2289,"raft.queue_time_us":1765,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":3189,"spinlock_wait_cycles":32338944,"thread_start_us":339149,"threads_started":1,"wal-append.queue_time_us":427637}
I20260709 12:11:01.951406 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:01.960845 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:01.961591 14407 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 8.
I20260709 12:11:01.962319 13834 raft_consensus.cc:1240] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:01.963436 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:01.963943 16926 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:01.964090 13829 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 8.
I20260709 12:11:01.964268 16743 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:01.935204 14379 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:01.921324 16922 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:01.923911 16949 raft_consensus.cc:740] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:01.911413 17024 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:01.926139 17146 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:01.987454 13651 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:01.987450 13830 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 7.
I20260709 12:11:01.931855 17075 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:01.992170 13652 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:01.988709 13727 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:01.993673 13727 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:01.996167 13727 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:02.000275 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:02.000905 13756 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 8.
I20260709 12:11:01.974690 16877 raft_consensus.cc:2804] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:01.952566 16924 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:01.915926 17141 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:01.977245 17014 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.010118 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:02.012153 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:01.996356 17075 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:01.991370 17095 raft_consensus.cc:2804] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:02.024201 13831 raft_consensus.cc:1275] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:01.928582 17125 consensus_queue.cc:260] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:01.994359 16926 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:02.017843 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:02.057189 13833 raft_consensus.cc:2410] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:11:02.012799 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:01.994655 16743 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:01.997382 17073 raft_consensus.cc:2749] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:01.964896 17142 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:02.082820 17150 log.cc:927] Time spent T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:11:02.084951 17142 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:02.007697 16877 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:02.005409 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:02.008352 17001 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:02.085729 16877 raft_consensus.cc:3060] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:02.001520 17004 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:02.086488 17004 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:02.024612 17095 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:02.085436 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:02.087423 17095 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:02.088472 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:02.088609 17004 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:01.988493 16922 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:02.090839 16922 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:02.011148 17071 raft_consensus.cc:2804] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:02.091516 17071 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:02.091935 17071 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:02.089110 13830 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 9.
I20260709 12:11:02.060056 16949 consensus_queue.cc:260] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:02.063174 17011 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:02.055718 16924 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:02.067095 16777 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:02.067754 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:02.068511 17087 consensus_queue.cc:1059] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 12:11:02.070451 17133 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.071188 17143 raft_consensus.cc:2804] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:02.077907 16993 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:02.079088 17024 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:02.059964 16926 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:02.124678 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:01.935369 17077 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:02.070616 17107 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:02.118184 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 122073us
I20260709 12:11:02.102147 17145 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:02.123615 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:02.094236 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 76870.2us
I20260709 12:11:02.125860 13829 raft_consensus.cc:2393] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 6: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:02.126442 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:02.136452 13834 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 9.
I20260709 12:11:02.128222 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:02.137084 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:02.111487 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:02.137853 13829 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 6.
I20260709 12:11:02.118527 13758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2236) took 1204 ms. Trace:
I20260709 12:11:02.130427 16777 raft_consensus.cc:3055] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:02.022846 17014 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:02.137929 13830 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:02.130862 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:02.139762 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:02.149020 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:02.150055 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:02.150723 13756 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 11.
I20260709 12:11:02.122195 17143 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:02.151407 13727 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:02.160113 13829 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 6.
I20260709 12:11:02.160893 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:11:02.149039 17127 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.008s	sys 0.011s
I20260709 12:11:02.167544 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:02.213884 13831 raft_consensus.cc:2393] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 10: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:02.215024 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:02.166421 17146 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:02.216329 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:02.217924 17146 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:02.218456 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:02.128762 17133 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:02.220216 13757 raft_consensus.cc:2368] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 8. Current term is 9.
I20260709 12:11:02.127708 16993 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:02.222426 17133 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:02.168074 13836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 568) took 1245 ms. Trace:
I20260709 12:11:02.122735 16924 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:02.223999 16993 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:02.161473 13833 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 10.
I20260709 12:11:02.226404 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:02.227209 13763 raft_consensus.cc:1813] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Handling vote request from an unknown peer 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:02.227708 13763 raft_consensus.cc:2410] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:11:02.140882 16777 raft_consensus.cc:740] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:02.229809 16924 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:02.224115 13836 rpcz_store.cc:276] 0709 12:11:00.922955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.946387 (+ 23432us) service_pool.cc:224] Handling call
0709 12:11:00.982695 (+ 36308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:01.527999 (+545304us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:02.167605 (+639606us) spinlock_profiling.cc:243] Waited 523 ms on lock 0x7b54000b22d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:02.168012 (+   407us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1203842304}
I20260709 12:11:02.238583 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:02.156333 16949 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:02.238255 17146 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.157624 17143 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:02.250986 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:02.252415 13756 raft_consensus.cc:2410] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 12:11:02.227205 17127 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.833s	user 0.008s	sys 0.012s
I20260709 12:11:02.256371 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:02.256950 13685 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 7.
I20260709 12:11:02.160296 17004 consensus_queue.cc:1059] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.091s
I20260709 12:11:02.238348 17093 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:02.232259 17161 raft_consensus.cc:2804] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:02.142343 17145 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:02.268738 13755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2220) took 1453 ms. Trace:
I20260709 12:11:02.270197 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:02.274019 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:02.246366 14407 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 7.
I20260709 12:11:02.275800 13755 rpcz_store.cc:276] 0709 12:11:00.815098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.815251 (+   153us) service_pool.cc:224] Handling call
0709 12:11:00.861183 (+ 45932us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:00.896217 (+ 35034us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:02.268490 (+1372273us) spinlock_profiling.cc:243] Waited 35.1 ms on lock 0x7b5400087fd0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:02.268653 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":80652160}
I20260709 12:11:02.274734 17081 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:02.290513 17141 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:02.294200 16777 consensus_queue.cc:260] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:02.295683 16777 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:02.298512 16926 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:02.299213 13800 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:02.300192 13760 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 11.
I20260709 12:11:02.254406 17146 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:02.301385 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 71045.2us
I20260709 12:11:02.262537 17075 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:02.308189 13763 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 7.
I20260709 12:11:02.273391 17161 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:02.313265 13754 raft_consensus.cc:1275] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:02.317822 13756 raft_consensus.cc:1275] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:11:02.322582 13755 raft_consensus.cc:1240] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:02.321560 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:02.303694 16926 raft_consensus.cc:2749] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:02.339588 14412 raft_consensus.cc:2393] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 9: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:11:02.339823 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:02.342216 13800 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:02.344976 13800 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:02.350660 16924 raft_consensus.cc:2804] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:02.351137 16924 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:02.351485 16924 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:02.302134 17137 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:02.330869 17161 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:02.356101 13763 raft_consensus.cc:1275] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:02.359730 13800 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:02.340896 17077 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:02.311630 17001 consensus_queue.cc:1048] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:11:02.361415 13830 raft_consensus.cc:2410] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:11:02.363353 13800 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:02.370376 13754 raft_consensus.cc:1275] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:02.372578 13800 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:02.374539 13800 leader_election.cc:400] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 8. Current term is 9.
I20260709 12:11:02.375012 13800 leader_election.cc:403] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:02.378566 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:02.379251 13830 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:02.380851 13652 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:02.340639 17142 consensus_queue.cc:1048] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:11:02.394254 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:02.394999 13688 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:02.395227 17137 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:02.384850 13652 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:02.385442 16964 raft_consensus.cc:2749] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:02.385869 17011 consensus_queue.cc:1048] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:02.386673 17145 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:02.390242 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:02.394038 17121 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:11:02.396663 13652 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:02.373529 17081 raft_consensus.cc:2804] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:02.407909 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:02.411726 13652 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:02.413615 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:02.414692 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:02.373162 17014 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:02.436357 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.431973 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:02.429538 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:02.381695 17024 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:02.393389 16992 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:02.439664 13683 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 6.
I20260709 12:11:02.440671 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:02.433727 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:02.442529 13679 raft_consensus.cc:2368] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 9. Current term is 10.
I20260709 12:11:02.408733 17107 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:02.431387 17081 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:02.406176 13761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2238) took 1045 ms. Trace:
I20260709 12:11:02.434835 16743 raft_consensus.cc:2749] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:02.469259 17071 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:02.471544 16992 leader_election.cc:290] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:02.471613 16877 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:02.450152 16964 raft_consensus.cc:2749] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:02.473829 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:02.474709 13684 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:02.453101 13652 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:02.476281 13830 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 10.
I20260709 12:11:02.478252 13681 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 6.
I20260709 12:11:02.462507 13761 rpcz_store.cc:276] 0709 12:11:01.361179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.265077 (+903898us) service_pool.cc:224] Handling call
0709 12:11:02.275787 (+ 10710us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:02.302962 (+ 27175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:02.302999 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:02.310015 (+  7016us) log.cc:844] Serialized 26 byte log entry
0709 12:11:02.404098 (+ 94083us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:11:02.404163 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:02.404275 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:02.405835 (+  1560us) raft_consensus.cc:1685] finished
0709 12:11:02.405871 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:02.406086 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21672,"raft.queue_time_us":13173,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":4145,"thread_start_us":56116,"threads_started":1,"wal-append.queue_time_us":67101}
I20260709 12:11:02.464637 17081 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:02.484463 13652 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:02.440173 17095 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:02.477504 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:02.440682 17105 consensus_queue.cc:1048] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:11:02.489004 13652 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:02.491958 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:02.492563 14412 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:02.493534 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:02.494200 13830 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:02.495755 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:02.496376 13761 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 12.
I20260709 12:11:02.497349 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:02.498078 13680 raft_consensus.cc:2368] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 7. Current term is 8.
I20260709 12:11:02.500141 16964 raft_consensus.cc:2749] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:02.506150 17125 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:02.499555 17143 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:02.507688 17095 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:02.486163 17071 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:02.499459 13652 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:02.510193 16924 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:02.514942 17161 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:02.516674 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:02.519527 16924 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:02.488107 17001 raft_consensus.cc:2804] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:02.526599 13652 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:02.530508 13652 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:02.529906 13830 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 8.
I20260709 12:11:02.532126 13652 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:02.533840 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:02.534379 13652 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:02.499131 17075 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:02.534811 16777 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:02.538287 16955 consensus_meta.cc:287] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.584s	user 0.008s	sys 0.004s
I20260709 12:11:02.536381 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:02.534543 13761 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 10.
I20260709 12:11:02.540410 13652 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:02.541045 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:02.532552 17095 raft_consensus.cc:2804] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:02.529227 17001 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:02.536070 17090 raft_consensus.cc:2749] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:02.552359 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:02.550660 13830 raft_consensus.cc:1240] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:02.556102 13830 raft_consensus.cc:1275] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:02.533360 16964 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:02.557986 13830 raft_consensus.cc:1275] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:02.544134 17087 raft_consensus.cc:2804] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:02.559657 17087 raft_consensus.cc:697] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 10 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:02.560667 17087 consensus_queue.cc:237] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:02.543403 13652 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:02.529073 16677 raft_consensus.cc:2749] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:02.538707 16955 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:02.564996 13800 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:02.569358 13833 raft_consensus.cc:2393] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 7: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
W20260709 12:11:02.570591 17157 log.cc:927] Time spent T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.501s	user 0.003s	sys 0.000s
I20260709 12:11:02.572659 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:02.566728 13685 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 8.
I20260709 12:11:02.561728 17001 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:02.574079 13761 raft_consensus.cc:2368] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 8. Current term is 9.
I20260709 12:11:02.543879 17095 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:02.568225 17090 raft_consensus.cc:2804] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:02.577361 16848 consensus_queue.cc:1048] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:02.583557 17024 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:02.585151 16955 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:02.586807 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:02.594091 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:02.594915 14412 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 9.
I20260709 12:11:02.598538 17090 raft_consensus.cc:697] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 8 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:02.599923 13761 raft_consensus.cc:2393] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 9: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:02.601001 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:02.601946 13685 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 7.
I20260709 12:11:02.595364 17095 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:02.608142 17090 consensus_queue.cc:237] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:02.598944 16848 consensus_queue.cc:1048] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:11:02.609611 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:02.612439 16964 raft_consensus.cc:2749] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:02.622824 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.626474 17093 raft_consensus.cc:3055] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:02.644047 13688 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 6.
I20260709 12:11:02.645485 16743 raft_consensus.cc:2749] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:02.646881 16777 raft_consensus.cc:2749] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:11:02.652547 17155 log.cc:927] Time spent T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.655s	user 0.001s	sys 0.000s
I20260709 12:11:02.654098 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:02.624739 17001 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:02.654776 13761 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 7.
I20260709 12:11:02.664462 13683 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 10.
I20260709 12:11:02.666242 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:02.635982 13684 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 8.
I20260709 12:11:02.676505 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:02.677029 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:02.677742 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:02.678979 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:02.679291 13837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 2268) took 1879 ms. Trace:
I20260709 12:11:02.681993 13761 raft_consensus.cc:2393] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 9: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:02.682061 13759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 483) took 1132 ms. Trace:
I20260709 12:11:02.682066 13837 rpcz_store.cc:276] 0709 12:11:00.799926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.800051 (+   125us) service_pool.cc:224] Handling call
0709 12:11:00.800382 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:00.800588 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:00.800889 (+   301us) log.cc:844] Serialized 14 byte log entry
0709 12:11:01.077086 (+276197us) log.cc:844] Serialized 14 byte log entry
0709 12:11:02.670115 (+1593029us) spinlock_profiling.cc:243] Waited 1.53 ms on lock 0x7b1800425fe0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa927b354bc 00007fa924e8348b 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9d455 00007fa927f85060 00007fa927f97716 00007fa927fa8287
0709 12:11:02.675268 (+  5153us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:02.675357 (+    89us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:02.675427 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:02.675522 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:02.679209 (+  3687us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11119,"prepare.queue_time_us":10674,"prepare.run_cpu_time_us":118,"prepare.run_wall_time_us":6717,"raft.queue_time_us":45115,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":23255,"spinlock_wait_cycles":3512576,"thread_start_us":335116,"threads_started":2,"wal-append.queue_time_us":355051,"wal-append.run_cpu_time_us":2916,"wal-append.run_wall_time_us":1336685}
I20260709 12:11:02.656316 17093 raft_consensus.cc:740] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:02.686949 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:02.687342 17093 consensus_queue.cc:260] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:02.685487 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:02.688624 13685 raft_consensus.cc:1275] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:02.688939 13761 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 6.
I20260709 12:11:02.689797 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:02.690442 13761 raft_consensus.cc:2393] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 9: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
W20260709 12:11:02.690497 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 114910us
I20260709 12:11:02.690794 13759 rpcz_store.cc:276] 0709 12:11:01.549344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.259560 (+710216us) service_pool.cc:224] Handling call
0709 12:11:02.271308 (+ 11748us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:02.276874 (+  5566us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:11:02.300616 (+ 23742us) log.cc:844] Serialized 14 byte log entry
0709 12:11:02.650372 (+349756us) spinlock_profiling.cc:243] Waited 1.78 ms on lock 0x7b18001fdd40. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e82e07 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9fc02 00007fa927b2720b 00007fa927b2cd23 00007fa927b2d23a 00007fa927f97a2a
0709 12:11:02.681685 (+ 31313us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:02.681762 (+    77us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:02.681836 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:02.681898 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:02.682008 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6153,"prepare.queue_time_us":23504,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":6452,"spinlock_wait_cycles":4102400,"thread_start_us":22562,"threads_started":1,"wal-append.queue_time_us":386317}
I20260709 12:11:02.693121 13685 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:02.698521 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:02.699492 13726 leader_election.cc:400] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 election: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 7. Current term is 8.
I20260709 12:11:02.699829 13726 leader_election.cc:403] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:11:02.702052 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:02.701864 16677 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.703176 16677 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:02.703482 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:02.704641 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:02.705173 13759 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:02.705420 16677 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:02.706192 17001 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:02.706398 13762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 478) took 1806 ms. Trace:
I20260709 12:11:02.714660 13762 rpcz_store.cc:276] 0709 12:11:00.899548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.490648 (+591100us) service_pool.cc:224] Handling call
0709 12:11:01.496955 (+  6307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:01.539442 (+ 42487us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:02.706167 (+1166725us) spinlock_profiling.cc:243] Waited 32.3 ms on lock 0x7b540032e454. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:02.706339 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":74393984}
I20260709 12:11:02.707175 17081 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:02.710027 17095 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:02.710345 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:02.717420 17004 raft_consensus.cc:2749] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 7. Current term is 8.
I20260709 12:11:02.713183 13759 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 8.
I20260709 12:11:02.718444 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:02.719082 13761 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:02.719266 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:02.720481 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:02.720660 17179 log.cc:927] Time spent T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.250s	user 0.001s	sys 0.000s
I20260709 12:11:02.713546 17161 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:02.688655 17093 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:02.721544 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:02.716499 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:02.723026 13759 raft_consensus.cc:2393] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 9: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:02.723074 13762 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:02.726089 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:02.727562 17121 raft_consensus.cc:2749] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 8. Current term is 9.
I20260709 12:11:02.729285 14379 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:11:02.732793 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.733896 13652 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:02.734829 17127 raft_consensus.cc:2804] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:02.735262 17127 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:02.735605 17127 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:02.740020 13685 raft_consensus.cc:1275] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:02.739261 14379 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:02.741711 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:02.741863 17117 raft_consensus.cc:2804] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:11:02.744227 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 51820.6us
I20260709 12:11:02.746150 17144 consensus_queue.cc:1048] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:02.746994 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:02.747558 17095 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:02.747006 13762 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 10.
I20260709 12:11:02.751673 13759 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 5.
I20260709 12:11:02.754770 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:02.755489 13682 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 8.
I20260709 12:11:02.756361 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:02.756937 13682 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 5.
I20260709 12:11:02.748337 17117 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:02.749467 16949 consensus_queue.cc:1048] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 12:11:02.758442 17117 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:02.759835 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:02.760073 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:02.761035 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:02.761549 13682 raft_consensus.cc:1240] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 7. Current term is 8. Ops: []
W20260709 12:11:02.762765 17171 log.cc:927] Time spent T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.317s	user 0.001s	sys 0.000s
I20260709 12:11:02.763810 13682 raft_consensus.cc:1240] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 3. Current term is 4. Ops: []
I20260709 12:11:02.764230 17143 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:02.768308 13760 raft_consensus.cc:1275] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:02.770571 13726 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:02.770774 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:02.758446 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:02.771412 13682 raft_consensus.cc:1240] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:02.761595 13681 raft_consensus.cc:3060] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:02.771755 13755 raft_consensus.cc:2410] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:11:02.753556 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:02.780334 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:02.780378 13762 raft_consensus.cc:1240] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:02.781262 13759 raft_consensus.cc:2410] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:11:02.782119 13685 raft_consensus.cc:1240] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:02.784875 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:02.786798 13762 raft_consensus.cc:1275] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:11:02.788208 13685 raft_consensus.cc:1240] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:02.789346 17117 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:02.789897 16877 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:02.790868 13755 raft_consensus.cc:1275] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:02.778733 17073 raft_consensus.cc:2749] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:02.791463 13835 raft_consensus.cc:1240] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 6 LEADER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:02.785681 17081 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:02.797626 16926 raft_consensus.cc:2804] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:02.801524 13755 raft_consensus.cc:1240] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:11:02.801934 14407 raft_consensus.cc:1275] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:02.805207 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:02.802629 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:02.803853 14413 raft_consensus.cc:1275] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:02.804499 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:02.806555 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:02.807601 13688 raft_consensus.cc:1240] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 8 LEADER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:02.804661 13761 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 10.
I20260709 12:11:02.787325 13762 pending_rounds.cc:85] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting all ops after (but not including) 4
W20260709 12:11:02.809391 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 244497us
I20260709 12:11:02.809806 13762 pending_rounds.cc:107] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:11:02.810184 13762 raft_consensus.cc:2889] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:02.808863 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:02.815109 13759 raft_consensus.cc:1275] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:02.908797 13762 raft_consensus.cc:1275] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:02.910373 13762 raft_consensus.cc:1275] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:02.909523 13681 raft_consensus.cc:2468] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 7.
I20260709 12:11:02.918398 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:02.918978 13762 raft_consensus.cc:1240] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:02.919291 13755 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:02.813854 16922 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.922165 16922 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:02.922180 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 173353us
I20260709 12:11:02.918512 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:02.929175 14411 raft_consensus.cc:2368] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 8. Current term is 9.
I20260709 12:11:02.930922 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:02.933842 13726 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:02.933912 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:02.935532 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:02.936170 13761 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 8.
I20260709 12:11:02.814136 16955 raft_consensus.cc:2749] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:02.919287 17149 raft_consensus.cc:2804] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:02.940037 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:02.926052 17011 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.945060 13762 raft_consensus.cc:1275] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:02.938948 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:02.934839 14413 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 9.
I20260709 12:11:02.931910 16924 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:02.946635 16887 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.956475 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:02.941605 17081 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:02.954660 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:02.971846 13829 raft_consensus.cc:2468] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 6.
I20260709 12:11:02.968487 13830 raft_consensus.cc:1275] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:02.963431 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:02.975054 13837 raft_consensus.cc:3060] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:02.944666 17117 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:02.933545 16952 consensus_queue.cc:1059] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:11:02.976611 16887 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:02.983687 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:02.985924 13761 raft_consensus.cc:2393] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 9: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:02.983661 13681 raft_consensus.cc:1240] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:11:02.986976 16887 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:02.952486 17073 raft_consensus.cc:2764] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
W20260709 12:11:02.988444 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.989230 13727 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:02.989847 17081 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:02.992393 17081 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:02.993888 17146 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:02.994202 16952 raft_consensus.cc:3055] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:02.994673 16952 raft_consensus.cc:740] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:02.995705 16952 consensus_queue.cc:260] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:02.997180 16952 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:02.999811 17119 consensus_queue.cc:1048] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:03.001523 17119 consensus_queue.cc:1048] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:03.004602 16922 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:03.004740 13586 catalog_manager.cc:5697] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 1 to 4, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 4 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:03.007504 13586 catalog_manager.cc:5697] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 5 to 7, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 7 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:11:03.009374 13586 catalog_manager.cc:5697] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:03.011322 13586 catalog_manager.cc:5697] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 5 to 8, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 8 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:02.983429 17024 consensus_queue.cc:1048] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:11:03.015306 17024 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:03.015899 17024 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:03.020310 13835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 2261) took 2578 ms. Trace:
I20260709 12:11:03.020524 13651 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:03.020851 13835 rpcz_store.cc:276] 0709 12:11:00.442064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.442231 (+   167us) service_pool.cc:224] Handling call
0709 12:11:00.446064 (+  3833us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:02.798913 (+2352849us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:03.020008 (+221095us) spinlock_profiling.cc:243] Waited 2.34 s on lock 0x7b54000db454. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:03.020194 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5393437952}
I20260709 12:11:03.022728 17149 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:03.023274 17149 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:03.023454 13651 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:03.024382 14379 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:03.026049 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:03.026659 13684 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:03.021119 13755 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 7.
I20260709 12:11:02.138491 13758 rpcz_store.cc:276] 0709 12:11:00.913806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.722150 (+808344us) service_pool.cc:224] Handling call
0709 12:11:01.791364 (+ 69214us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:01.791647 (+   283us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:11:01.792251 (+   604us) log.cc:844] Serialized 14 byte log entry
0709 12:11:02.118058 (+325807us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:02.118131 (+    73us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:02.118196 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:02.118280 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:02.118432 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2131,"prepare.queue_time_us":179,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":3429,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":5995,"thread_start_us":325279,"threads_started":1}
I20260709 12:11:03.029838 17137 consensus_queue.cc:1048] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:03.032658 13801 leader_election.cc:400] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 8. Current term is 9.
I20260709 12:11:03.033036 13801 leader_election.cc:403] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:03.033694 17137 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:11:03.034987 13686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 529) took 1491 ms. Trace:
I20260709 12:11:03.035403 13686 rpcz_store.cc:276] 0709 12:11:01.543544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.551297 (+  7753us) service_pool.cc:224] Handling call
0709 12:11:01.570509 (+ 19212us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:02.616599 (+1046090us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:11:02.616936 (+   337us) log.cc:844] Serialized 14 byte log entry
0709 12:11:02.670011 (+ 53075us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:02.670068 (+    57us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:02.670111 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:03.034779 (+364668us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b5400271d54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:03.034825 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:03.034932 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":480,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":84,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":3867,"spinlock_wait_cycles":2405202816,"thread_start_us":52648,"threads_started":1,"wal-append.queue_time_us":49437}
W20260709 12:11:03.038218 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 112929us
I20260709 12:11:02.957247 17011 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:03.039175 13726 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:03.040653 17011 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:03.041201 13726 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:03.042336 17075 raft_consensus.cc:2749] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:03.026078 16951 raft_consensus.cc:2804] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:03.041606 13828 raft_consensus.cc:1275] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 12:11:03.048542 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:03.038290 13801 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:03.051537 13684 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 8.
I20260709 12:11:03.049311 13830 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 8.
I20260709 12:11:03.047312 13828 pending_rounds.cc:85] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 8
I20260709 12:11:03.066890 13828 pending_rounds.cc:107] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:11:03.067283 13828 raft_consensus.cc:2889] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:03.068075 13726 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:03.069677 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:11:03.071353 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 337539us
I20260709 12:11:03.075969 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:11:03.056228 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 67079.2us
I20260709 12:11:03.084405 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:03.085564 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:03.086398 14413 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 5.
I20260709 12:11:03.076459 13726 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:03.088124 13726 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:03.093307 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:03.094475 13830 raft_consensus.cc:2410] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 9 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:11:03.086100 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:03.046641 17075 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.101141 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:03.101476 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:03.108206 13586 catalog_manager.cc:5697] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 5 to 6, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 6 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:11:03.066027 16922 raft_consensus.cc:2804] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:03.046766 16926 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
W20260709 12:11:03.117121 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 93743.9us
I20260709 12:11:03.118561 17094 raft_consensus.cc:2749] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:11:03.125062 13651 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:03.078456 17146 raft_consensus.cc:2804] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:03.084309 17161 raft_consensus.cc:2749] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:03.083210 17143 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:03.131537 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:03.132048 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:03.128482 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:03.064193 13831 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 9.
I20260709 12:11:03.097410 17073 raft_consensus.cc:2804] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:03.100589 17004 raft_consensus.cc:2804] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:03.112138 17087 raft_consensus.cc:2804] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:03.128028 14379 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:03.143122 17087 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:03.143682 17087 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:03.122861 16922 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:03.145046 16922 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:03.134161 13586 catalog_manager.cc:5697] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 4 to 5, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 5 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:11:03.134251 13727 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:03.129259 17024 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:03.122332 16926 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:03.151649 16743 raft_consensus.cc:2749] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:03.148267 13651 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:03.155150 13837 raft_consensus.cc:2468] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 7.
I20260709 12:11:03.124285 16951 raft_consensus.cc:697] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 7 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:03.156394 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:02.973966 16924 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:03.138703 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:03.114795 16993 consensus_queue.cc:1059] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 12:11:03.137910 17073 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:03.160784 13727 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:03.162037 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:03.147374 17004 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:03.115926 17075 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:03.164212 13586 catalog_manager.cc:5697] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 5 to 6, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 6 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:03.168807 13755 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 11.
I20260709 12:11:03.154874 17146 raft_consensus.cc:697] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:03.157867 17143 raft_consensus.cc:2749] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:03.161453 13651 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:03.175760 13757 raft_consensus.cc:1275] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:03.181252 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:03.131088 17127 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:03.177966 13586 catalog_manager.cc:5697] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 6 to 7, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 7 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:03.170476 17073 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:03.182824 13651 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:03.186954 13651 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:03.187860 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:03.191103 13586 catalog_manager.cc:5697] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 2 to 3, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 3 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:03.166875 16999 raft_consensus.cc:2749] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:03.166931 17117 raft_consensus.cc:2804] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:03.169589 17004 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:03.197422 16949 consensus_queue.cc:1048] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 12:11:03.209496 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:03.239699 13586 catalog_manager.cc:5697] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:11:03.193830 17094 raft_consensus.cc:2804] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:03.193965 16777 raft_consensus.cc:2804] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:11:03.205325 17190 log.cc:927] Time spent T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:11:03.242226 17117 raft_consensus.cc:697] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 8 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:03.307729 17117 consensus_queue.cc:237] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:03.276539 17187 log.cc:927] Time spent T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
W20260709 12:11:03.276750 13582 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45610 (request call id 254) took 30720 ms (client timeout 15000 ms). Trace:
I20260709 12:11:03.276165 13586 catalog_manager.cc:5697] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 2 to 6, leader changed from ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 6 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
W20260709 12:11:03.277182 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 82418.1us
I20260709 12:11:03.258461 16993 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:03.294710 17075 leader_election.cc:290] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:03.296188 17127 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:03.198267 16677 raft_consensus.cc:2749] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:03.298158 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:03.313514 13586 catalog_manager.cc:5697] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:03.314275 13831 raft_consensus.cc:2393] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 9: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:03.313263 16993 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:03.317306 14379 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:03.320178 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:03.210772 17105 consensus_queue.cc:1048] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.096s
I20260709 12:11:03.204452 16848 consensus_queue.cc:1059] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.102s
I20260709 12:11:03.316473 16993 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:03.301064 17143 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:03.301828 17094 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:03.318591 16877 consensus_queue.cc:1048] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 12:11:03.321141 13831 raft_consensus.cc:2393] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 9: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:03.330672 13586 catalog_manager.cc:5697] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 1 to 4, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 4 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
W20260709 12:11:03.345392 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.313279 16777 raft_consensus.cc:697] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 10 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:03.347437 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:03.348161 13755 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:03.332567 17137 raft_consensus.cc:2749] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 8. Current term is 9.
I20260709 12:11:03.358783 16777 consensus_queue.cc:237] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:03.325556 16832 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:03.206902 16951 consensus_queue.cc:237] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:03.367303 13800 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:11:03.370632 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.343533 17094 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:03.317337 16736 consensus_queue.cc:1048] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 12:11:03.378916 13800 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:03.325726 17104 consensus_queue.cc:1048] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:11:03.392017 13800 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:03.305156 17146 consensus_queue.cc:237] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:03.407433 13837 raft_consensus.cc:1240] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:03.399394 13586 catalog_manager.cc:5697] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 2 to 4, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 4 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:11:03.400148 13800 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:03.360867 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:03.409581 13831 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:03.415355 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 287411us
I20260709 12:11:03.414382 13586 catalog_manager.cc:5697] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 4 to 5, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 5 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:03.350780 17143 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:03.397154 17075 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.399866 17081 raft_consensus.cc:2804] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:03.440371 17081 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:03.421459 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:03.441567 13837 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:03.400657 17024 raft_consensus.cc:2749] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:03.417207 17158 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:03.411522 17121 raft_consensus.cc:2749] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:03.384461 17137 consensus_queue.cc:1048] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:11:03.442958 13831 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 10.
I20260709 12:11:03.415279 17011 raft_consensus.cc:2749] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:03.390694 16832 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:03.440889 17081 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:03.510715 13837 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 7.
W20260709 12:11:03.520274 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 417729us
I20260709 12:11:03.513278 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:11:03.513993 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 62922us
I20260709 12:11:03.492147 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:03.523337 13835 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:03.524237 14380 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:03.512101 13755 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 8.
I20260709 12:11:03.521195 13837 raft_consensus.cc:1240] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:11:03.530161 13834 raft_consensus.cc:1275] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:03.533634 13837 raft_consensus.cc:1275] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:03.526203 14379 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:11:03.522579 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 367138us
I20260709 12:11:03.531874 16949 raft_consensus.cc:2804] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:03.423681 17149 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:03.571369 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 43604.2us
I20260709 12:11:03.495935 17001 raft_consensus.cc:2749] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:03.503087 16924 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:03.577849 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 51763.6us
I20260709 12:11:03.446377 17075 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:03.599040 13586 catalog_manager.cc:5697] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 1 to 4, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 4 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:11:03.502661 16952 consensus_queue.cc:1048] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.086s
I20260709 12:11:03.623102 13831 raft_consensus.cc:1275] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:03.624392 13831 raft_consensus.cc:1240] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:03.461966 17158 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:03.625690 13831 raft_consensus.cc:1240] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:03.599224 17133 raft_consensus.cc:2804] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:03.606181 17127 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:03.629108 13586 catalog_manager.cc:5697] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 3 to 7, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 7 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:03.606027 16949 raft_consensus.cc:697] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 9 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
W20260709 12:11:03.310492 13582 rpcz_store.cc:269] 0709 12:10:32.439802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.504717 (+ 64915us) service_pool.cc:224] Handling call
0709 12:11:03.158459 (+30653742us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:55.352372 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:55.417343 (+ 64971us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:55.423231 (+  5888us) write_op.cc:435] Acquired schema lock
0709 12:10:55.424211 (+   980us) tablet.cc:662] Decoding operations
0709 12:10:55.522630 (+ 98419us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:55.522710 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:55.522747 (+    37us) tablet.cc:685] Acquiring locks for 12 operations
0709 12:10:55.639901 (+117154us) tablet.cc:701] Row locks acquired
0709 12:10:55.639954 (+    53us) write_op.cc:260] PREPARE: finished
0709 12:10:55.640112 (+   158us) write_op.cc:270] Start()
0709 12:10:55.640276 (+   164us) write_op.cc:276] Timestamp: P: 1783599055640049 usec, L: 0
0709 12:10:55.640298 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:10:55.640992 (+   694us) log.cc:844] Serialized 4795 byte log entry
0709 12:10:56.063590 (+422598us) spinlock_profiling.cc:243] Waited 4.42 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa924e830ac 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9fc02 00007fa927b2720b
0709 12:10:57.220400 (+1156810us) spinlock_profiling.cc:243] Waited 47.8 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:10:57.448384 (+227984us) op_driver.cc:464] REPLICATION: finished
0709 12:10:57.747697 (+299313us) write_op.cc:301] APPLY: starting
0709 12:10:57.758496 (+ 10799us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:57.758817 (+   321us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:57.758858 (+    41us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:58.008986 (+250128us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:58.009406 (+   420us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 12:10:58.009472 (+    66us) write_op.cc:312] APPLY: finished
0709 12:10:58.009977 (+   505us) log.cc:844] Serialized 89 byte log entry
0709 12:10:58.010187 (+   210us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:58.010358 (+   171us) write_op.cc:454] Released schema lock
0709 12:10:58.010436 (+    78us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:58.010903 (+   467us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:58.010929 (+    26us) write_op.cc:454] Released schema lock
0709 12:10:58.137704 (+126775us) spinlock_profiling.cc:243] Waited 5.74 ms on lock 0x7b5400373cd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8a32a 00007fa927f0ff14 00007fa927f0fec3 00007fa927f0fe38 00007fa927f0fdf3 00007fa927f0f0dc 00007fa927f38e16 00007fa927f20cbb 00007fa927f0b39d 00007fa927f0ed75
Metrics: {"mutex_wait_us":2499844,"reported_tablets":39,"child_traces":[["op",{"apply.queue_time_us":202672,"apply.run_cpu_time_us":5927,"apply.run_wall_time_us":332710,"num_ops":12,"prepare.queue_time_us":373038,"prepare.run_cpu_time_us":49703,"prepare.run_wall_time_us":1544779,"raft.queue_time_us":69885,"raft.run_cpu_time_us":31888,"raft.run_wall_time_us":737852,"replication_time_us":1769265,"spinlock_wait_cycles":133287552,"thread_start_us":1625966,"threads_started":4,"wal-append.queue_time_us":1432250,"wal-append.run_cpu_time_us":40038,"wal-append.run_wall_time_us":1939755}]]}
W20260709 12:11:03.648608 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 239662us
I20260709 12:11:03.651525 13800 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:11:03.650617 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 456126us
W20260709 12:11:03.657186 13681 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.017s	sys 0.110s
W20260709 12:11:03.657606 13681 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.017s	sys 0.111s
I20260709 12:11:03.617285 16877 consensus_queue.cc:1048] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 12:11:03.660019 13800 leader_election.cc:400] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 election: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 9. Current term is 10.
I20260709 12:11:03.659765 13586 catalog_manager.cc:5697] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 3 to 5, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 5 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:11:03.664391 13800 leader_election.cc:403] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:11:03.664300 13586 catalog_manager.cc:5697] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 3 to 4, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 4 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:03.668046 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:03.648217 17101 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:03.658761 17121 raft_consensus.cc:2804] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:03.666743 13800 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:03.674664 16999 consensus_queue.cc:1048] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:11:03.675268 13651 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:03.675362 17182 consensus_queue.cc:1059] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:03.678218 13836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 2185) took 1612 ms. Trace:
I20260709 12:11:03.678428 17203 consensus_queue.cc:1059] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:11:03.681807 17101 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:03.660259 17133 raft_consensus.cc:697] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 8 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:03.667881 17093 raft_consensus.cc:3055] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:03.719388 13651 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:03.683377 16832 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:03.669997 17137 raft_consensus.cc:2749] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 9. Current term is 10.
I20260709 12:11:03.691043 13836 rpcz_store.cc:276] 0709 12:11:02.065683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.523566 (+457883us) service_pool.cc:224] Handling call
0709 12:11:02.523899 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:02.909544 (+385645us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:11:02.938944 (+ 29400us) log.cc:844] Serialized 14 byte log entry
0709 12:11:03.197541 (+258597us) spinlock_profiling.cc:243] Waited 7.56 ms on lock 0x7b18003a9420. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924ea03f3 00007fa924ea27c1 00007fa924ea2779 00007fa924ea2709 00007fa924ea26d1 00007fa924ea19cd 0000000000388634 0000000000388479 00007fa924e8383a
0709 12:11:03.392282 (+194741us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:03.414805 (+ 22523us) log.cc:844] Serialized 26 byte log entry
0709 12:11:03.414965 (+   160us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:11:03.415009 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:03.415097 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:03.677907 (+262810us) raft_consensus.cc:1685] finished
0709 12:11:03.678028 (+   121us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:03.678155 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":385744,"prepare.queue_time_us":24497,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":3675,"raft.queue_time_us":387932,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":24628,"spinlock_wait_cycles":17388416,"thread_start_us":421704,"threads_started":1,"wal-append.queue_time_us":688958}
I20260709 12:11:03.661829 16743 consensus_queue.cc:1059] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 12:11:03.687709 17121 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:11:03.744059 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 113801us
I20260709 12:11:03.721276 17105 raft_consensus.cc:2804] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:03.673461 17095 consensus_queue.cc:1048] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 12:11:03.730685 17024 raft_consensus.cc:2749] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:03.727046 17093 raft_consensus.cc:740] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:11:03.783771 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 226456us
I20260709 12:11:03.758962 17121 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:03.810953 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 203866us
I20260709 12:11:03.826236 13757 raft_consensus.cc:1240] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:03.826521 13726 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:03.763249 17182 raft_consensus.cc:2804] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:03.760923 17143 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:03.766520 17105 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:03.777390 17095 consensus_queue.cc:1243] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer 3f37c9cc9dda46b4be21dd675ba78fb7 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:11:03.845141 13833 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 9.
W20260709 12:11:03.842912 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:03.839767 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 153068us
I20260709 12:11:03.847517 17143 raft_consensus.cc:3055] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:11:03.847915 17215 raft_consensus.cc:2749] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:03.869938 13727 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:03.876214 13800 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:03.885723 13800 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:03.891340 13800 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:03.775882 17091 consensus_queue.cc:1048] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 12:11:03.897301 13727 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:11:03.898983 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 72593.6us
I20260709 12:11:03.837671 17105 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:03.741751 16949 consensus_queue.cc:237] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:03.841670 17149 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:03.806172 17199 consensus_queue.cc:1059] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.126s
I20260709 12:11:03.878369 17143 raft_consensus.cc:740] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:03.915956 13727 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:03.891047 17206 raft_consensus.cc:3055] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:03.898607 17024 raft_consensus.cc:2804] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:11:03.904937 16832 raft_consensus.cc:2804] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:03.885803 17075 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:03.890766 17182 raft_consensus.cc:697] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 7 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:03.821640 17204 consensus_queue.cc:1059] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.076s
I20260709 12:11:03.909533 17137 raft_consensus.cc:2804] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:03.893149 17203 consensus_queue.cc:1059] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 12:11:03.927088 17215 raft_consensus.cc:2804] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:03.952702 13835 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 7.
I20260709 12:11:03.954011 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:03.955608 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:03.957422 17215 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:03.933271 17093 consensus_queue.cc:260] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:03.962286 17215 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:03.963394 17093 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:03.967443 17073 consensus_meta.cc:287] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.762s	user 0.003s	sys 0.007s
I20260709 12:11:03.967962 17073 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:03.971544 16922 consensus_meta.cc:287] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.826s	user 0.006s	sys 0.006s
I20260709 12:11:03.972023 16922 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:03.933429 17206 raft_consensus.cc:740] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:03.938006 17229 raft_consensus.cc:2749] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:03.874864 17133 consensus_queue.cc:237] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:03.954931 17196 log.cc:927] Time spent T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.284s	user 0.001s	sys 0.000s
I20260709 12:11:03.945849 17137 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:03.946862 17149 consensus_queue.cc:1059] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
W20260709 12:11:03.987807 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 52666us
I20260709 12:11:04.046789 17137 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:03.988531 17204 raft_consensus.cc:3055] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:04.012871 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:03.994663 17073 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:03.974242 17214 raft_consensus.cc:2749] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:03.987004 17210 log.cc:927] Time spent T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:11:04.018326 17143 consensus_queue.cc:260] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:04.092398 17199 consensus_queue.cc:1175] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "96701a74fdee481fb5f54aac841e17dd" responder_term: 3 status { last_received { term: 3 index: 3 } last_committed_idx: 3 last_received_current_leader { term: 3 index: 3 } }
W20260709 12:11:03.998489 17200 log.cc:927] Time spent T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.254s	user 0.000s	sys 0.001s
I20260709 12:11:04.014822 17127 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:04.094641 16848 raft_consensus.cc:3055] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:04.094367 17206 consensus_queue.cc:260] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:04.095082 16848 raft_consensus.cc:740] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:04.095844 17206 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:04.095943 16848 consensus_queue.cc:260] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:04.097246 16848 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:04.099480 17143 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:11:04.016340 17004 consensus_meta.cc:287] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.695s	user 0.009s	sys 0.003s
I20260709 12:11:03.994794 13679 raft_consensus.cc:1275] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:11:03.987583 17202 log.cc:927] Time spent T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
W20260709 12:11:03.993208 16926 consensus_meta.cc:287] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.842s	user 0.008s	sys 0.003s
I20260709 12:11:03.991164 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:04.078785 13727 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:03.988483 17203 consensus_queue.cc:1243] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer 96701a74fdee481fb5f54aac841e17dd log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 12:11:03.995424 17087 consensus_meta.cc:287] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.851s	user 0.005s	sys 0.006s
W20260709 12:11:03.983032 17212 log.cc:927] Time spent T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
W20260709 12:11:04.015496 16993 consensus_meta.cc:287] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.672s	user 0.010s	sys 0.000s
I20260709 12:11:04.089653 14409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41692 (request call id 572) took 1014 ms. Trace:
I20260709 12:11:04.056855 17215 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:04.100756 17081 consensus_meta.cc:287] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.527s	user 0.004s	sys 0.004s
I20260709 12:11:04.101528 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:04.067065 17229 consensus_queue.cc:1059] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:11:04.082484 16677 raft_consensus.cc:3055] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:04.093618 17101 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:03.990584 17224 consensus_queue.cc:1048] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.092s
I20260709 12:11:04.168103 16677 raft_consensus.cc:740] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:03.983923 17182 consensus_queue.cc:237] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:03.955188 17207 raft_consensus.cc:3055] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:11:04.146944 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 68244.6us
I20260709 12:11:04.182843 13727 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:04.168322 17234 raft_consensus.cc:3055] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:11:04.149612 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 241891us
I20260709 12:11:04.082058 17204 raft_consensus.cc:740] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:04.106071 16832 raft_consensus.cc:697] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 8 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:04.102861 17127 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:04.147243 17214 raft_consensus.cc:2749] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:04.155097 17094 consensus_meta.cc:287] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.743s	user 0.010s	sys 0.001s
I20260709 12:11:04.151659 17087 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:04.143725 17024 raft_consensus.cc:697] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 6 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:04.152009 14409 rpcz_store.cc:276] 0709 12:11:03.075412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.077434 (+  2022us) service_pool.cc:224] Handling call
0709 12:11:03.077864 (+   430us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:03.093218 (+ 15354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:03.093262 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:03.097996 (+  4734us) log.cc:844] Serialized 26 byte log entry
0709 12:11:03.421858 (+323862us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:03.421901 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:03.421969 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:04.089440 (+667471us) raft_consensus.cc:1685] finished
0709 12:11:04.089465 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:04.089595 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38054,"raft.queue_time_us":15566,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":12971,"thread_start_us":291765,"threads_started":1,"wal-append.queue_time_us":521289}
I20260709 12:11:04.145131 17091 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:04.148296 17004 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:04.185212 13727 leader_election.cc:304] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
W20260709 12:11:04.148526 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 46520.9us
W20260709 12:11:04.187851 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.189193 13800 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:04.203143 17091 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:04.203716 13800 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:04.204896 17191 raft_consensus.cc:2804] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:04.205019 13800 leader_election.cc:400] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 8. Current term is 9.
I20260709 12:11:04.205350 17191 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:04.206840 17149 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:04.206656 17024 consensus_queue.cc:237] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:04.207252 17149 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:04.207675 17149 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:04.210326 17158 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:04.211448 16832 consensus_queue.cc:237] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:04.212620 17087 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:04.213424 13682 raft_consensus.cc:2393] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 8: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:04.189966 17075 raft_consensus.cc:2749] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:04.201056 16743 consensus_queue.cc:1059] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:11:04.217346 16743 raft_consensus.cc:3055] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:04.190299 17101 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.217748 16743 raft_consensus.cc:740] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:04.218148 17101 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:04.200152 16677 consensus_queue.cc:260] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:04.200459 17094 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:04.192126 17204 consensus_queue.cc:260] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:04.194473 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:04.219429 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:04.224244 17215 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:04.160866 17216 consensus_queue.cc:1059] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:11:04.197947 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:04.205364 17091 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:04.228709 17004 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:04.222712 16677 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:04.216801 17121 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:04.160565 16993 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:04.232355 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.246507 13761 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 8.
I20260709 12:11:04.248462 13800 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:04.146747 16926 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:04.181043 17229 consensus_queue.cc:1243] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer b98d2519bb504dc6905ed2ede4571835 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:11:04.179219 16922 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:04.199340 13757 raft_consensus.cc:1275] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:04.197793 13687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 559) took 1182 ms. Trace:
I20260709 12:11:04.168583 17081 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:04.199816 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 146398us
I20260709 12:11:04.201316 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:04.251817 13800 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:04.249178 17191 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:04.188740 17234 raft_consensus.cc:740] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:04.260032 17238 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.189064 17207 raft_consensus.cc:740] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:11:04.258109 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 56306us
I20260709 12:11:04.224018 13684 raft_consensus.cc:2393] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 8: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:04.269508 13755 raft_consensus.cc:3055] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:04.289809 13755 raft_consensus.cc:740] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:04.279320 13685 raft_consensus.cc:1275] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:11:04.271247 13687 rpcz_store.cc:276] 0709 12:11:03.015489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.022412 (+  6923us) service_pool.cc:224] Handling call
0709 12:11:03.022747 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:03.131123 (+108376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:03.131153 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:03.131627 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 12:11:03.645632 (+514005us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:03.645680 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:03.648400 (+  2720us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:04.197536 (+549136us) raft_consensus.cc:1685] finished
0709 12:11:04.197565 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:04.197718 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":118223,"raft.queue_time_us":108752,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":8191,"thread_start_us":486180,"threads_started":1,"wal-append.queue_time_us":585097}
I20260709 12:11:04.282445 13759 raft_consensus.cc:1240] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:11:04.223445 17204 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:04.252985 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 67867us
I20260709 12:11:04.294871 13727 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:04.224043 17094 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:04.286156 13800 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:04.260701 17215 raft_consensus.cc:2749] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:04.220240 17101 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:04.206660 17125 consensus_queue.cc:1048] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.079s
I20260709 12:11:04.298321 13800 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:04.302294 13727 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:04.266670 17235 raft_consensus.cc:2749] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:04.304561 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:04.304733 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:04.316839 13684 raft_consensus.cc:2368] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 7. Current term is 8.
I20260709 12:11:04.306499 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:04.319383 17224 raft_consensus.cc:2749] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:04.244314 17127 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:04.327521 17127 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:04.327953 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:04.297113 17238 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:04.330000 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:04.330277 17234 consensus_queue.cc:260] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:04.331341 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:04.331638 17234 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:04.334311 17238 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:04.336669 17246 raft_consensus.cc:2749] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:04.337260 13760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 499) took 1011 ms. Trace:
I20260709 12:11:04.337663 13760 rpcz_store.cc:276] 0709 12:11:03.326360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.326530 (+   170us) service_pool.cc:224] Handling call
0709 12:11:03.328047 (+  1517us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:03.328492 (+   445us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:03.328528 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:03.332724 (+  4196us) log.cc:844] Serialized 26 byte log entry
0709 12:11:03.637989 (+305265us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:03.768749 (+130760us) log.cc:844] Serialized 14 byte log entry
0709 12:11:03.813128 (+ 44379us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:03.813203 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:04.337043 (+523840us) raft_consensus.cc:1685] finished
0709 12:11:04.337062 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:04.337205 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44101,"prepare.queue_time_us":234788,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":78759,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":6172,"thread_start_us":355069,"threads_started":2,"wal-append.queue_time_us":925233}
W20260709 12:11:04.342736 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 44464.6us
I20260709 12:11:04.297196 16922 raft_consensus.cc:2749] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:04.293494 17206 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:11:04.353251 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 51042.2us
I20260709 12:11:04.306545 13755 consensus_queue.cc:260] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:04.345923 17214 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.350143 17073 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:04.351145 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:04.360761 14411 raft_consensus.cc:1240] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:04.343400 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:04.288880 17229 consensus_queue.cc:1059] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 12:11:04.307195 17240 raft_consensus.cc:2749] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:04.354847 13755 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:04.367022 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:04.367939 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:04.370296 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:04.371016 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:04.271427 16743 consensus_queue.cc:260] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:04.363976 17146 raft_consensus.cc:2749] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:04.374472 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:04.374835 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:04.379799 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:11:04.396019 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.407279 13831 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:04.359462 17206 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:04.318679 17105 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:04.437343 17226 log.cc:927] Time spent T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.335s	user 0.000s	sys 0.003s
I20260709 12:11:04.455853 17229 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.465566 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:04.382107 13683 raft_consensus.cc:2393] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 6: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:04.361559 17093 consensus_queue.cc:1059] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 12:11:04.314054 16832 consensus_queue.cc:1048] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
W20260709 12:11:04.492865 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 124888us
I20260709 12:11:04.367156 17075 consensus_queue.cc:1048] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.086s
I20260709 12:11:04.353890 16951 consensus_queue.cc:1048] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.084s
I20260709 12:11:04.469488 13829 raft_consensus.cc:1240] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:04.505802 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:04.470520 13727 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:04.372606 17182 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.473495 13755 raft_consensus.cc:1275] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:11:04.508873 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:04.509634 14412 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:04.484256 14413 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 9.
I20260709 12:11:04.492931 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:11:04.467476 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.502471 13835 raft_consensus.cc:1240] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:04.503511 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 126487us
I20260709 12:11:04.495087 16743 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:04.514904 13679 raft_consensus.cc:1240] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:04.491041 17146 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.470459 17237 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.367911 17073 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:04.518873 13801 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:04.531445 17149 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:04.532431 17101 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:04.561996 13831 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 9.
W20260709 12:11:04.563704 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 44915.6us
I20260709 12:11:04.547919 14412 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 6.
I20260709 12:11:04.568780 16922 raft_consensus.cc:2804] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:04.519634 17182 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:04.578943 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:04.583707 16926 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:04.505872 17229 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:04.568912 17257 raft_consensus.cc:3055] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:04.569990 17215 raft_consensus.cc:2749] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:04.570523 16993 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:04.573879 17081 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:04.605325 13687 raft_consensus.cc:1240] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:04.556217 17146 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:04.524804 17235 consensus_queue.cc:1059] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.075s
I20260709 12:11:04.579216 17121 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:04.609256 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.611743 13758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 497) took 1448 ms. Trace:
I20260709 12:11:04.614600 13758 rpcz_store.cc:276] 0709 12:11:03.163347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.163469 (+   122us) service_pool.cc:224] Handling call
0709 12:11:03.180199 (+ 16730us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:03.690326 (+510127us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:03.690374 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:03.718862 (+ 28488us) log.cc:844] Serialized 26 byte log entry
0709 12:11:03.875794 (+156932us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:04.086551 (+210757us) log.cc:844] Serialized 14 byte log entry
0709 12:11:04.087361 (+   810us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:04.087529 (+   168us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:04.207895 (+120366us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b1800473b60. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924ea03f3 00007fa924ea27c1 00007fa924ea2779 00007fa924ea2709 00007fa924ea26d1 00007fa924ea19cd 0000000000388634 0000000000388479 00007fa924e8383a
0709 12:11:04.378891 (+170996us) spinlock_profiling.cc:243] Waited 42.2 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:11:04.611502 (+232611us) raft_consensus.cc:1685] finished
0709 12:11:04.611527 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:04.611681 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3153,"prepare.queue_time_us":79995,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":2651,"raft.queue_time_us":92162,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":150,"spinlock_wait_cycles":125039360,"thread_start_us":763286,"threads_started":3,"wal-append.queue_time_us":344120}
I20260709 12:11:04.594455 16922 raft_consensus.cc:697] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 9 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:04.602308 17257 raft_consensus.cc:740] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:04.365181 17214 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:04.570628 17101 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:04.619831 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 149406us
I20260709 12:11:04.557669 17237 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:04.607048 17094 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:04.651646 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 143455us
I20260709 12:11:04.662925 13726 leader_election.cc:304] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:04.621750 17075 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:04.666684 13726 leader_election.cc:400] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 7. Current term is 8.
I20260709 12:11:04.667219 13726 leader_election.cc:403] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:11:04.685896 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.697713 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:11:04.678104 17137 consensus_meta.cc:287] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.588s	user 0.007s	sys 0.004s
W20260709 12:11:04.680747 17248 log.cc:927] Time spent T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.265s	user 0.000s	sys 0.001s
I20260709 12:11:04.677928 17143 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Advancing to term 8
W20260709 12:11:04.697966 17251 log.cc:927] Time spent T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 12:11:04.670805 17259 raft_consensus.cc:2749] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:04.655104 17094 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:04.693264 17206 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:04.787828 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 158057us
I20260709 12:11:04.706028 17105 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:04.789033 13727 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:04.790472 13727 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:04.678181 17075 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:04.785871 17252 log.cc:927] Time spent T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
W20260709 12:11:04.785540 17024 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.028s	sys 0.039s
I20260709 12:11:04.790026 17246 raft_consensus.cc:2749] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:04.804476 17229 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:04.781817 16922 consensus_queue.cc:237] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:04.776742 17137 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:04.785907 17257 consensus_queue.cc:260] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:04.792640 17204 raft_consensus.cc:2749] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:04.845427 13833 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54820 (request call id 2289) took 1669 ms (client timeout 1524 ms). Trace:
I20260709 12:11:04.817919 13756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 501) took 1453 ms. Trace:
W20260709 12:11:04.846040 13833 rpcz_store.cc:269] 0709 12:11:03.176314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.187615 (+ 11301us) service_pool.cc:224] Handling call
0709 12:11:04.845256 (+1657641us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b540020e254. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:04.845360 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":411986688}
I20260709 12:11:04.846273 13756 rpcz_store.cc:276] 0709 12:11:03.364045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.364171 (+   126us) service_pool.cc:224] Handling call
0709 12:11:03.409029 (+ 44858us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:03.409361 (+   332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:03.409391 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:04.533058 (+1123667us) spinlock_profiling.cc:243] Waited 3.29 ms on lock 0x7b2c00010828. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa926886a11 00007fa926896372 00007fa927fc8a01 00007fa927f8d43a 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2
0709 12:11:04.533531 (+   473us) log.cc:844] Serialized 26 byte log entry
0709 12:11:04.607740 (+ 74209us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:04.607780 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:04.607842 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:04.817455 (+209613us) raft_consensus.cc:1685] finished
0709 12:11:04.817485 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:04.817827 (+   342us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":268824,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":109,"spinlock_wait_cycles":7556864,"thread_start_us":53730,"threads_started":1,"wal-append.queue_time_us":99975}
W20260709 12:11:04.848156 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.833953 17149 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:11:04.856889 13652 connection.cc:256] RPC call timeout handler was delayed by -1.2582889099999193s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16990000000000002s for a response
W20260709 12:11:04.835390 16677 consensus_meta.cc:287] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.592s	user 0.009s	sys 0.000s
I20260709 12:11:04.824004 17075 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:04.840201 17203 raft_consensus.cc:3055] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:04.842825 17214 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:04.843958 17146 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:04.809438 16848 consensus_meta.cc:287] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.712s	user 0.013s	sys 0.000s
I20260709 12:11:04.800035 17073 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:04.802735 17182 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:04.861467 17257 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:04.862195 17201 log.cc:927] Time spent T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.978s	user 0.006s	sys 0.000s
I20260709 12:11:04.858965 17203 raft_consensus.cc:740] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:04.863245 13800 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:04.798637 17259 consensus_queue.cc:1059] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
W20260709 12:11:04.866159 17234 consensus_meta.cc:287] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.534s	user 0.012s	sys 0.000s
I20260709 12:11:04.866744 17149 raft_consensus.cc:2749] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:04.867260 13759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2266) took 1115 ms. Trace:
I20260709 12:11:04.867830 13759 rpcz_store.cc:276] 0709 12:11:03.751376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.769845 (+ 18469us) service_pool.cc:224] Handling call
0709 12:11:03.824707 (+ 54862us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:04.292709 (+468002us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:04.866963 (+574254us) spinlock_profiling.cc:243] Waited 457 ms on lock 0x7b54003c8a54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:04.867180 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1052053248}
I20260709 12:11:04.874130 13832 raft_consensus.cc:2468] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 8.
I20260709 12:11:04.847636 13837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 2204) took 1482 ms. Trace:
I20260709 12:11:04.875468 13837 rpcz_store.cc:276] 0709 12:11:03.365455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.537510 (+172055us) service_pool.cc:224] Handling call
0709 12:11:03.563100 (+ 25590us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:03.595506 (+ 32406us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:11:03.634955 (+ 39449us) log.cc:844] Serialized 14 byte log entry
0709 12:11:03.769557 (+134602us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:03.788375 (+ 18818us) log.cc:844] Serialized 52 byte log entry
0709 12:11:03.788553 (+   178us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:03.788594 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:04.847259 (+1058665us) spinlock_profiling.cc:243] Waited 2.29 ms on lock 0x7b54001676d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:04.847304 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:04.847351 (+    47us) raft_consensus.cc:1685] finished
0709 12:11:04.847444 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:04.847582 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53473,"prepare.queue_time_us":42104,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":38409,"raft.run_cpu_time_us":308,"raft.run_wall_time_us":45424,"spinlock_wait_cycles":5265792,"thread_start_us":110482,"threads_started":1,"wal-append.queue_time_us":283335}
I20260709 12:11:04.832351 17101 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:04.854669 17001 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.878335 17001 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:04.880723 17001 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:04.812541 17024 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.028s	sys 0.039s
I20260709 12:11:04.855769 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:11:04.887058 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.893126 17205 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.893826 17205 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:04.896214 17205 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:04.838702 16924 raft_consensus.cc:3055] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:04.902225 16924 raft_consensus.cc:740] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:04.903218 16924 consensus_queue.cc:260] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:04.904323 16924 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:04.858291 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.907127 13652 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:11:04.856705 17191 consensus_meta.cc:287] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.562s	user 0.009s	sys 0.002s
I20260709 12:11:04.910099 17191 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:04.912395 13830 raft_consensus.cc:1240] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:04.912576 17191 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:04.913718 17182 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:04.914319 17182 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:04.916474 17182 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:04.922668 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:04.923830 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.923861 17235 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.924657 17235 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:04.925330 16848 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.925849 16848 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:04.926622 13830 raft_consensus.cc:1240] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:04.926764 17235 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:04.927802 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:04.928620 13837 raft_consensus.cc:2393] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 11: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:04.927975 17161 consensus_queue.cc:1059] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:04.927762 16848 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:04.929370 17257 raft_consensus.cc:3055] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:04.929735 17257 raft_consensus.cc:740] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:04.930540 17257 consensus_queue.cc:260] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:04.860137 17258 log.cc:927] Time spent T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
W20260709 12:11:04.858662 17256 log.cc:927] Time spent T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 12:11:04.983747 17257 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:04.860602 17230 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 12:11:04.866060 17143 raft_consensus.cc:2749] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 7. Current term is 8.
I20260709 12:11:04.815590 17237 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:04.985152 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:04.985900 13762 raft_consensus.cc:1275] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:11:04.860226 17266 log.cc:927] Time spent T 00000000000000000000000000000000 P 17d79eae88f84be7a847d0cf544674cd: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 12:11:04.815857 17094 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:04.855460 17137 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:04.866103 13800 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:04.969722 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:05.004457 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:11:05.005446 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 140730us
I20260709 12:11:05.005568 13652 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:05.007755 17105 consensus_queue.cc:1048] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:04.971071 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:05.009150 13829 raft_consensus.cc:2376] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 9. Re-sending same reply.
I20260709 12:11:05.009526 17101 raft_consensus.cc:2804] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:05.010058 17235 raft_consensus.cc:2749] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:05.010226 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:04.962579 13833 raft_consensus.cc:1240] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:04.987905 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:04.985896 13828 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 10.
I20260709 12:11:05.002828 13760 raft_consensus.cc:1240] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:04.917629 17182 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:05.023893 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:05.024749 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:05.027603 13686 raft_consensus.cc:1275] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:05.027906 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:05.030206 13683 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:05.028165 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:11:05.030943 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.032603 13754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2264) took 1282 ms. Trace:
I20260709 12:11:04.987138 17161 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:05.046561 13800 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:05.046593 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:05.035482 13727 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:05.034461 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:05.032989 13754 rpcz_store.cc:276] 0709 12:11:03.750220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.769607 (+ 19387us) service_pool.cc:224] Handling call
0709 12:11:03.814784 (+ 45177us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:03.815032 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:11:04.887120 (+1072088us) spinlock_profiling.cc:243] Waited 2.55 ms on lock 0x7b18004737a0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa927b354bc 00007fa924e8348b 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9d455 00007fa92b9853c7 00007fa927f979a7 00007fa927fa70bf
0709 12:11:04.887293 (+   173us) log.cc:844] Serialized 14 byte log entry
0709 12:11:05.032343 (+145050us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:05.032394 (+    51us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:05.032439 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.032486 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:05.032561 (+    75us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10095,"prepare.queue_time_us":110932,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"spinlock_wait_cycles":5859072,"thread_start_us":218883,"threads_started":2}
I20260709 12:11:04.993362 17259 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:05.049124 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:05.051273 13761 raft_consensus.cc:1240] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:11:05.051916 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:05.052419 13684 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 8.
I20260709 12:11:05.053381 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:05.056279 13756 raft_consensus.cc:2393] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 9: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:05.010174 17101 raft_consensus.cc:697] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 7 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:05.058343 13800 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:05.048398 17246 consensus_queue.cc:1059] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 12:11:05.058985 17011 raft_consensus.cc:2749] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:05.059983 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:05.063364 17203 consensus_queue.cc:260] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:05.031744 17204 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:04.993175 17001 consensus_queue.cc:1059] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 12:11:05.081615 13759 raft_consensus.cc:2393] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 6: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:05.004456 17237 consensus_queue.cc:1048] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 12:11:05.092669 13726 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:04.995596 17230 consensus_queue.cc:1059] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.082s
I20260709 12:11:05.086535 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:05.099077 13761 raft_consensus.cc:2393] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 8: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:11:05.055505 16993 raft_consensus.cc:2804] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:05.077509 13683 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 7.
I20260709 12:11:05.048753 17137 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:05.055505 17024 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:05.108171 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:05.109480 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:05.119695 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:05.055872 17161 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:05.099939 17203 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:05.119385 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:05.096839 17011 raft_consensus.cc:2749] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:05.109072 16993 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:05.128109 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:11:05.128744 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 69949.2us
I20260709 12:11:05.110855 17214 raft_consensus.cc:2749] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:05.069156 17259 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:05.097085 17204 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:05.144549 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:05.135654 16993 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:05.150456 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.133750 13800 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:05.157297 13756 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 10.
I20260709 12:11:05.115471 17137 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:05.157893 13760 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 8.
I20260709 12:11:05.161636 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:05.164367 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:05.168258 17193 log.cc:927] Time spent T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 1.067s	user 0.008s	sys 0.002s
I20260709 12:11:05.163932 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:05.120189 17024 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:05.154003 17240 raft_consensus.cc:2749] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:05.180912 13681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2168) took 2383 ms. Trace:
I20260709 12:11:05.181216 17257 raft_consensus.cc:3055] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:05.182001 17257 raft_consensus.cc:740] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:05.184125 17262 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:05.183346 17257 consensus_queue.cc:260] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:05.184719 17262 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:05.185559 17257 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:05.187104 17262 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:05.187925 17205 raft_consensus.cc:3055] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:05.188390 17205 raft_consensus.cc:740] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:05.196761 16949 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:05.197598 16949 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:05.198596 14415 raft_consensus.cc:1240] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:05.199965 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:05.200400 16949 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:05.208495 16993 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:05.212196 13756 raft_consensus.cc:2468] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 8.
I20260709 12:11:05.212313 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:05.150653 13754 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 8.
I20260709 12:11:05.181324 13681 rpcz_store.cc:276] 0709 12:11:02.798022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.987443 (+189421us) service_pool.cc:224] Handling call
0709 12:11:02.987790 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:02.988003 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:02.988027 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:02.988538 (+   511us) log.cc:844] Serialized 26 byte log entry
0709 12:11:03.658035 (+669497us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:03.928886 (+270851us) log.cc:844] Serialized 14 byte log entry
0709 12:11:03.929149 (+   263us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:03.929225 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:05.167632 (+1238407us) spinlock_profiling.cc:243] Waited 43.8 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:11:05.169739 (+  2107us) raft_consensus.cc:1685] finished
0709 12:11:05.180708 (+ 10969us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:05.180849 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":443372,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":3841,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":3813,"spinlock_wait_cycles":100668672,"thread_start_us":931994,"threads_started":2,"wal-append.queue_time_us":1112146}
I20260709 12:11:05.213333 13763 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:05.216934 13727 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:05.217257 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:05.217880 13830 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 10.
I20260709 12:11:05.216958 13835 raft_consensus.cc:1275] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:05.222051 13800 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:05.221050 13727 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:05.227525 16951 consensus_queue.cc:1059] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:05.228695 17262 raft_consensus.cc:2804] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:05.231387 17257 consensus_queue.cc:1048] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:05.233103 17262 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:05.234354 17259 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:05.233660 17262 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:05.235316 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:05.239876 17161 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:05.240960 14379 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:05.244222 17117 raft_consensus.cc:2749] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:05.246090 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:05.248221 13759 raft_consensus.cc:2393] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 11: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:05.249202 13727 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:05.149732 17101 consensus_queue.cc:237] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:05.250778 17214 raft_consensus.cc:2749] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:05.252523 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:05.253191 13759 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 8.
I20260709 12:11:05.257184 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:05.258194 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:05.258822 17024 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:05.230270 17073 raft_consensus.cc:2804] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:11:05.259826 17073 raft_consensus.cc:697] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:05.259841 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:05.260846 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:05.262594 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:05.262912 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:05.263263 14412 raft_consensus.cc:2468] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 8.
I20260709 12:11:05.262679 14415 raft_consensus.cc:1275] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:05.263765 17125 raft_consensus.cc:3055] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:05.264214 17125 raft_consensus.cc:740] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:05.265206 17125 consensus_queue.cc:260] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:05.266398 17125 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:05.266508 13828 raft_consensus.cc:1275] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:05.267966 13763 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 9.
I20260709 12:11:05.268884 13829 raft_consensus.cc:1275] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:05.269034 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:05.270174 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:05.271133 17224 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:05.271668 17224 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:05.269726 13763 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 6.
I20260709 12:11:05.276655 13679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1454) took 1083 ms. Trace:
I20260709 12:11:05.259861 13651 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:05.285670 13679 rpcz_store.cc:276] 0709 12:11:04.192820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.199135 (+  6315us) service_pool.cc:224] Handling call
0709 12:11:04.199430 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:04.530303 (+330873us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.276432 (+746129us) spinlock_profiling.cc:243] Waited 315 ms on lock 0x7b54003f07d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:05.276589 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":724559232}
I20260709 12:11:05.284061 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:05.284276 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:05.290874 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:05.296977 13652 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:05.294416 13763 raft_consensus.cc:2393] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 8: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:05.284788 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:05.302304 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:05.302203 17143 consensus_queue.cc:1048] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:05.304040 17091 raft_consensus.cc:2804] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:05.304534 17091 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:05.304927 17091 raft_consensus.cc:3060] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:05.273766 17224 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:05.307968 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:05.274576 17237 consensus_queue.cc:1059] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:11:05.309196 17237 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:05.311252 13652 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:05.292908 13651 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:05.260913 17073 consensus_queue.cc:237] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:05.291122 13761 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 7.
I20260709 12:11:05.319978 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:05.321852 13828 raft_consensus.cc:1240] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:05.323311 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:05.327737 13756 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 4.
I20260709 12:11:05.328744 17094 raft_consensus.cc:2804] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:05.329252 17094 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:05.329159 16877 consensus_queue.cc:1048] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:05.329794 17094 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:05.309727 17237 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:05.332739 17262 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:05.326462 17107 raft_consensus.cc:3055] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:05.333628 17107 raft_consensus.cc:740] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:05.334873 17237 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:05.325562 17075 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:05.335934 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:05.336655 13684 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 8.
I20260709 12:11:05.336324 17075 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:05.309902 17149 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:05.338153 17149 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:05.340361 17149 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:05.334528 17107 consensus_queue.cc:260] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:05.341082 17233 consensus_queue.cc:1048] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:05.309199 13763 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:11:05.341841 17107 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:05.342156 13763 raft_consensus.cc:606] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:05.342586 13763 raft_consensus.cc:614] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:05.344697 17207 consensus_queue.cc:260] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:05.346215 13763 pending_rounds.cc:85] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting all ops after (but not including) 5
I20260709 12:11:05.346555 13763 pending_rounds.cc:107] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:11:05.346807 13763 raft_consensus.cc:2889] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:05.347272 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 54503us
I20260709 12:11:05.348198 13651 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:05.349082 14408 raft_consensus.cc:2393] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 6: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:05.349313 13727 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
W20260709 12:11:05.279186 17273 log.cc:927] Time spent T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.163s	user 0.002s	sys 0.000s
I20260709 12:11:05.358568 17237 raft_consensus.cc:2804] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:05.359858 13652 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:05.360708 14379 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:05.360708 13651 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:05.364858 13832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35422 (request call id 594) took 1010 ms. Trace:
I20260709 12:11:05.274703 17204 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:05.373227 13651 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:05.365445 13832 rpcz_store.cc:276] 0709 12:11:04.354403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.354920 (+   517us) service_pool.cc:224] Handling call
0709 12:11:05.364644 (+1009724us) spinlock_profiling.cc:243] Waited 505 ms on lock 0x7b54000b22d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:05.364789 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1162274688}
I20260709 12:11:05.189319 17205 consensus_queue.cc:260] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:05.378208 13760 raft_consensus.cc:1240] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:11:05.378216 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:05.397626 13828 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:05.381153 13762 raft_consensus.cc:1240] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:11:05.402388 13754 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:39554
W20260709 12:11:05.390859 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 238999us
I20260709 12:11:05.348816 16743 raft_consensus.cc:2749] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:05.322877 17143 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:05.417354 13760 raft_consensus.cc:1240] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:11:05.419674 13762 raft_consensus.cc:1275] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:05.373090 17207 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:05.373288 16677 raft_consensus.cc:2804] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:05.392027 17001 raft_consensus.cc:2804] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:05.364131 17237 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:05.444885 13756 raft_consensus.cc:1240] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:05.447187 13760 raft_consensus.cc:1275] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:05.451977 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:05.375679 16848 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:11:05.458452 13688 raft_consensus.cc:1275] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:05.452987 13836 raft_consensus.cc:2393] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 7: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
W20260709 12:11:05.454514 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 49785.8us
I20260709 12:11:05.405810 17214 raft_consensus.cc:2804] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:05.406987 17238 raft_consensus.cc:2804] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:05.375470 17075 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:05.460893 13800 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:05.407430 16924 raft_consensus.cc:2749] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:05.392513 17229 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:05.379639 17133 consensus_queue.cc:1059] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 12:11:05.440757 17081 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:05.453552 17237 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:05.453284 16677 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:05.502280 13800 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:11:05.503952 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.432339 17119 consensus_queue.cc:1048] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 12:11:05.509393 13800 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:05.512965 13800 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:05.481758 16848 raft_consensus.cc:2804] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:05.464120 17238 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:05.449280 17143 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:05.477386 17235 raft_consensus.cc:2804] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:11:05.530578 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.478725 17214 raft_consensus.cc:697] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:05.465281 17121 consensus_queue.cc:1048] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:11:05.508638 16924 raft_consensus.cc:2749] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:05.507416 16677 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:05.499372 17229 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:05.508724 17204 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:05.525233 17011 raft_consensus.cc:2749] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:05.477515 16922 consensus_queue.cc:1048] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 12:11:05.528725 16848 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:05.532092 17238 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:05.552677 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:05.533489 17191 raft_consensus.cc:2804] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:05.508530 17081 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:05.568189 13837 raft_consensus.cc:1240] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:05.534204 17235 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:05.533097 16993 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:05.577421 13836 raft_consensus.cc:1275] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:05.579321 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:05.582868 13832 raft_consensus.cc:1275] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:05.624567 13832 raft_consensus.cc:1275] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:11:05.563926 16848 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:05.543287 17234 consensus_queue.cc:1048] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.069s
I20260709 12:11:05.611708 17235 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:05.558970 17204 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:05.569655 17024 consensus_queue.cc:1059] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 12:11:05.613533 17191 raft_consensus.cc:697] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 10 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
W20260709 12:11:05.674741 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 301599us
I20260709 12:11:05.676693 13651 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:05.687728 13651 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:05.696902 13651 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:05.681383 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:05.706490 13832 raft_consensus.cc:2393] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 7: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
W20260709 12:11:05.685444 17275 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.009s	sys 0.036s
W20260709 12:11:05.732054 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:05.734759 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.736369 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:11:05.704674 17263 log.cc:927] Time spent T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:11:05.692559 16922 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:05.734575 17275 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.010s	sys 0.036s
I20260709 12:11:05.695312 16993 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:05.743330 13761 raft_consensus.cc:1275] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:05.690177 17146 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:05.705014 17206 raft_consensus.cc:2804] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:11:05.760812 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:05.635735 17214 consensus_queue.cc:237] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:05.770414 17279 log.cc:927] Time spent T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 12:11:05.770911 13755 raft_consensus.cc:1275] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:11:05.772589 17107 raft_consensus.cc:2804] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:05.773048 17107 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:05.775202 17204 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:05.737422 16743 raft_consensus.cc:2764] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:11:05.779634 16743 consensus_queue.cc:1059] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:11:05.781313 17278 log.cc:927] Time spent T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 12:11:05.770236 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:05.807359 13828 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 11.
I20260709 12:11:05.818140 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:05.766613 17206 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:05.773564 17107 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:05.830379 13828 raft_consensus.cc:2410] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:11:05.782038 17075 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:05.791275 17204 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:05.781505 17091 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:05.760003 16922 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:05.891517 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:05.766134 16993 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:05.765793 17146 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:05.862818 17182 consensus_meta.cc:287] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.827s	user 0.008s	sys 0.004s
I20260709 12:11:05.903415 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:05.911608 13834 raft_consensus.cc:2393] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 8: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:05.862267 17288 raft_consensus.cc:3055] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:05.891424 17204 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:05.921934 17182 raft_consensus.cc:2749] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:05.927940 17262 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:05.935303 16922 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:05.941805 13832 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 8.
I20260709 12:11:05.946988 17121 raft_consensus.cc:3055] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:05.861001 17143 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:05.812709 17161 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:05.950661 16848 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:05.907806 17011 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:05.838357 17206 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:05.979496 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:05.864562 17075 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:05.984644 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:06.022176 13828 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 3.
I20260709 12:11:05.954198 17081 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:05.953936 17288 raft_consensus.cc:740] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:05.836330 17191 consensus_queue.cc:237] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:05.981681 17121 raft_consensus.cc:740] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
W20260709 12:11:06.012970 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 297550us
W20260709 12:11:05.975816 17260 log.cc:927] Time spent T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
W20260709 12:11:06.024276 13654 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.002s	sys 0.011s
I20260709 12:11:05.986114 17143 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:06.037696 13654 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.002s	sys 0.011s
W20260709 12:11:05.975587 17246 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.750s	user 0.017s	sys 0.021s
I20260709 12:11:06.054153 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:06.039527 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:06.041383 13679 raft_consensus.cc:1240] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:06.043494 13682 raft_consensus.cc:1240] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:06.045228 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:11:06.024160 17094 consensus_meta.cc:287] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.692s	user 0.011s	sys 0.002s
W20260709 12:11:06.063869 13830 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.012s	sys 0.008s
I20260709 12:11:06.065366 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:11:06.064538 13830 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.012s	sys 0.008s
I20260709 12:11:05.977262 16677 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:06.080104 13687 raft_consensus.cc:1217] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 8 LEADER]: Deduplicated request from leader. Original: 5.3->[7.4-7.4]   Dedup: 7.4->[]
I20260709 12:11:06.099502 13687 raft_consensus.cc:1240] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 8 LEADER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:11:06.036378 17293 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.070194 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:06.076668 13763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2270) took 1078 ms. Trace:
I20260709 12:11:06.069136 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:06.105170 13763 rpcz_store.cc:276] 0709 12:11:04.998570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.345427 (+346857us) service_pool.cc:224] Handling call
0709 12:11:05.345801 (+   374us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:05.350360 (+  4559us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:05.350406 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:05.350959 (+   553us) log.cc:844] Serialized 52 byte log entry
0709 12:11:05.837738 (+486779us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:05.837815 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.837955 (+   140us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:06.076297 (+238342us) raft_consensus.cc:1685] finished
0709 12:11:06.076330 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:06.076575 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14270,"raft.queue_time_us":2877,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":81,"thread_start_us":401804,"threads_started":1,"wal-append.queue_time_us":683055}
I20260709 12:11:06.110749 13836 raft_consensus.cc:1240] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:11:06.100895 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:11:06.053680 17246 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.832s	user 0.017s	sys 0.023s
I20260709 12:11:06.021512 17011 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:06.014297 17161 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:06.156304 17204 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:06.156934 17075 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:06.073751 17091 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:06.158303 17091 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:06.159240 17091 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:06.163890 17284 log.cc:927] Time spent T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.254s	user 0.000s	sys 0.001s
W20260709 12:11:06.166699 17203 consensus_meta.cc:287] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 1.039s	user 0.013s	sys 0.000s
W20260709 12:11:06.167136 17289 log.cc:927] Time spent T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 12:11:06.167923 13757 raft_consensus.cc:1275] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:11:06.169239 17285 log.cc:927] Time spent T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.196s	user 0.000s	sys 0.000s
W20260709 12:11:06.170336 17290 log.cc:927] Time spent T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.189s	user 0.000s	sys 0.000s
W20260709 12:11:06.171453 17287 log.cc:927] Time spent T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.308s	user 0.000s	sys 0.001s
I20260709 12:11:06.174067 17011 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:06.174067 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:06.175230 13680 raft_consensus.cc:2393] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 7: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:06.176214 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:06.100026 17182 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.061841 17143 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:06.181659 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:06.186012 13831 raft_consensus.cc:1240] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 8. Current term is 9. Ops: [6.4-8.5]
I20260709 12:11:06.193478 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:06.070990 17094 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:06.197563 13835 raft_consensus.cc:1240] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:06.194492 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:06.194751 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:06.203948 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:06.204622 13763 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 8.
I20260709 12:11:06.206462 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:06.208863 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:06.191256 17203 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.138742 17293 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:06.219836 13763 raft_consensus.cc:1275] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:06.223037 13831 raft_consensus.cc:1275] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:11:06.225010 13763 raft_consensus.cc:1240] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:11:06.229895 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:06.235271 13800 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:06.239229 13800 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:06.240952 13687 raft_consensus.cc:1240] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:11:06.251204 13800 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:06.210258 16848 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:06.229509 17001 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.749s	user 0.040s	sys 0.025s
I20260709 12:11:06.222446 17011 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.192641 17182 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:06.222007 17306 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.258237 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:06.281742 13761 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 8.
I20260709 12:11:06.226145 17081 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:06.149380 17288 consensus_queue.cc:260] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:06.225342 17298 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:06.237620 17234 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.229206 17091 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:06.240165 16922 raft_consensus.cc:2749] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:11:06.306378 17300 log.cc:927] Time spent T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 12:11:06.306677 16922 raft_consensus.cc:2749] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:06.194312 17121 consensus_queue.cc:260] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:06.308282 17121 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:06.308514 17309 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:06.274966 17001 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.801s	user 0.041s	sys 0.026s
I20260709 12:11:06.310114 17001 raft_consensus.cc:697] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 9 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:06.311493 17001 consensus_queue.cc:237] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:06.316850 17161 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:06.318792 17143 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:06.319514 17143 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:06.253156 17125 consensus_meta.cc:287] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.982s	user 0.008s	sys 0.005s
I20260709 12:11:06.291736 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:06.324831 13761 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 7.
I20260709 12:11:06.253046 17297 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
W20260709 12:11:06.322073 17101 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.069s	user 0.024s	sys 0.007s
W20260709 12:11:06.326143 17101 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.073s	user 0.024s	sys 0.007s
I20260709 12:11:06.326010 17297 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:06.328926 17297 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:06.232254 17203 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:06.309242 17309 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:06.301928 17274 log.cc:927] Time spent T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.792s	user 0.005s	sys 0.005s
I20260709 12:11:06.302882 17094 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:06.284233 17011 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:06.360466 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:06.322906 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:06.325448 17238 consensus_meta.cc:287] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.738s	user 0.011s	sys 0.003s
I20260709 12:11:06.252888 17024 raft_consensus.cc:2749] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:06.256032 17149 consensus_queue.cc:1048] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 12:11:06.240080 17303 consensus_queue.cc:1059] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.084s
I20260709 12:11:06.338500 17091 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:06.362219 13726 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
W20260709 12:11:06.362689 17235 consensus_meta.cc:287] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.710s	user 0.012s	sys 0.000s
I20260709 12:11:06.364087 13652 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:06.320096 17143 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:06.295586 17081 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:06.323230 17288 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:06.373744 13754 raft_consensus.cc:606] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 LEADER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
W20260709 12:11:06.374688 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 123565us
I20260709 12:11:06.398550 14408 raft_consensus.cc:1275] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:06.380718 13726 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:06.322782 17234 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:06.360046 17182 leader_election.cc:290] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:06.398422 13800 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:06.406363 13800 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:06.377869 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:06.363731 17313 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:06.400473 13726 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
W20260709 12:11:06.386407 17294 log.cc:927] Time spent T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.234s	user 0.001s	sys 0.001s
I20260709 12:11:06.290938 17306 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:06.419757 13688 raft_consensus.cc:1240] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:06.421095 14380 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:06.381712 17246 raft_consensus.cc:2749] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:06.404017 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:06.403339 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:11:06.413426 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 49439.5us
I20260709 12:11:06.416128 13726 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:06.321445 17298 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:06.379225 16677 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:06.421409 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:06.423864 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:06.462621 13726 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:06.452781 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:06.369931 17238 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:06.469586 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:06.403705 17308 raft_consensus.cc:2749] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:06.450058 17300 log.cc:927] Time spent T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:11:06.415256 17240 raft_consensus.cc:2804] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:06.491578 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:06.447742 17075 raft_consensus.cc:2749] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:06.415201 16922 raft_consensus.cc:2804] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:06.411520 17094 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:06.378721 17091 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:06.397890 17161 consensus_queue.cc:1059] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 12:11:06.381484 17235 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:06.454517 16736 raft_consensus.cc:2804] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:06.501148 13652 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:11:06.505301 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 100408us
I20260709 12:11:06.488057 17191 consensus_queue.cc:1048] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:06.460155 17307 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:06.423063 17024 consensus_queue.cc:1059] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 12:11:06.494509 17101 raft_consensus.cc:2749] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:06.497893 17214 raft_consensus.cc:2749] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:06.497654 17240 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:06.424297 17313 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:06.517653 16922 raft_consensus.cc:697] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 7 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:06.508495 17303 consensus_queue.cc:1059] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
W20260709 12:11:06.558171 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:06.523667 16736 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:06.544657 13834 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 8.
I20260709 12:11:06.524600 17293 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:06.561203 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 100175us
I20260709 12:11:06.523667 17094 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:06.555724 17304 log.cc:927] Time spent T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.235s	user 0.001s	sys 0.000s
I20260709 12:11:06.539296 17214 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.539963 17240 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:06.552907 17316 raft_consensus.cc:3055] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:06.524894 17310 raft_consensus.cc:2749] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:06.563058 16736 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:06.579550 16922 consensus_queue.cc:237] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:06.586567 17143 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:06.581588 17137 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:11:06.589905 17107 consensus_meta.cc:287] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.692s	user 0.011s	sys 0.002s
I20260709 12:11:06.616955 17107 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:06.535487 17327 consensus_queue.cc:1048] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 12:11:06.591080 17214 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:06.592722 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:06.618839 13760 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 9.
I20260709 12:11:06.571336 17075 raft_consensus.cc:3055] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:06.620016 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:11:06.621371 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 206629us
I20260709 12:11:06.592836 17234 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:11:06.594926 17237 consensus_meta.cc:287] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 1.069s	user 0.014s	sys 0.000s
I20260709 12:11:06.595230 17306 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:06.563567 16677 consensus_queue.cc:1048] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 12:11:06.597136 17011 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:06.572898 17203 leader_election.cc:290] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:06.597815 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:06.627758 13755 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:06.599416 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:06.605019 17330 consensus_queue.cc:1048] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:11:06.551151 17298 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:06.607092 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:06.607329 17235 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:06.608666 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:11:06.581466 17207 consensus_meta.cc:287] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 1.124s	user 0.009s	sys 0.003s
I20260709 12:11:06.526072 13652 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:06.617508 17313 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:06.593624 17309 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:06.624310 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:06.650565 14408 raft_consensus.cc:1813] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Handling vote request from an unknown peer 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:06.625579 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:06.622641 17075 raft_consensus.cc:740] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:06.610723 17316 raft_consensus.cc:740] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:06.686692 13800 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:06.651221 14408 raft_consensus.cc:2393] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 6: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
W20260709 12:11:06.650921 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 124949us
I20260709 12:11:06.683095 13759 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 8.
I20260709 12:11:06.695190 13652 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:06.625700 17094 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:06.672312 17117 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.017s	sys 0.045s
I20260709 12:11:06.652441 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:06.694358 13800 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
W20260709 12:11:06.748273 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 54025.4us
W20260709 12:11:06.699625 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 177395us
I20260709 12:11:06.752956 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:06.678880 17107 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:06.627599 17237 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:06.647558 17234 consensus_queue.cc:1048] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.129s
I20260709 12:11:06.651129 17101 consensus_queue.cc:1048] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.129s
I20260709 12:11:06.741317 13755 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 9.
W20260709 12:11:06.904875 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:06.914343 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 164052us
I20260709 12:11:06.848815 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:11:06.900863 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 182673us
I20260709 12:11:06.936247 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:06.772760 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:06.937804 13760 raft_consensus.cc:2393] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 9: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
W20260709 12:11:06.928903 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 233807us
I20260709 12:11:06.692873 17011 consensus_queue.cc:1059] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.212s
I20260709 12:11:06.941476 13763 raft_consensus.cc:2368] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 8. Current term is 9.
I20260709 12:11:06.691736 17313 raft_consensus.cc:2749] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:11:06.710311 17117 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.017s	sys 0.049s
I20260709 12:11:06.848168 17326 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:06.699239 17235 raft_consensus.cc:2804] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:11:06.908823 17206 consensus_meta.cc:287] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.881s	user 0.010s	sys 0.003s
I20260709 12:11:07.020937 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:07.036273 13688 raft_consensus.cc:2393] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 9: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:06.900894 17094 raft_consensus.cc:2749] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:06.914049 17331 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.941320 17238 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:06.847683 17207 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.029248 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:07.054557 13835 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 10.
W20260709 12:11:07.035171 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 94077.3us
I20260709 12:11:07.054670 17207 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:06.897575 17203 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.035919 17235 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:07.037575 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 101121us
I20260709 12:11:06.900707 17336 raft_consensus.cc:2804] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:06.900538 17161 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.949666 17224 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:06.709467 17298 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:06.999979 17306 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:07.041378 17313 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:07.053052 17091 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:07.066409 17288 consensus_meta.cc:287] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.659s	user 0.008s	sys 0.004s
I20260709 12:11:07.065356 17235 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:07.100931 16736 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:07.039356 17326 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:06.933764 17316 consensus_queue.cc:260] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:07.050513 17331 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:07.066728 17336 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:06.918087 17075 consensus_queue.cc:260] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:07.102486 17081 leader_election.cc:290] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:07.070278 13651 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:07.106269 13680 raft_consensus.cc:2410] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:11:07.043630 17206 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:07.069319 17011 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.080950 17214 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:07.072734 17346 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:07.074344 17306 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:07.121187 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 65021.1us
I20260709 12:11:07.067050 17203 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:07.123782 17011 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:07.128176 13726 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 2.035s (SENT) [suppressed 1 similar messages]
W20260709 12:11:07.118816 17240 consensus_meta.cc:287] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.520s	user 0.013s	sys 0.000s
I20260709 12:11:07.075148 17161 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:07.138873 17332 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.139477 17332 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:07.121652 16848 raft_consensus.cc:2804] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:07.142174 16848 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:07.142323 17081 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:07.142720 16848 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:07.143060 17326 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:07.139048 17237 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:07.115219 17336 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:07.081406 17224 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:07.074119 17298 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:07.137991 13652 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:07.145859 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:07.104213 17313 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:07.164402 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:07.164669 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:07.164719 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:07.166728 13832 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 9.
I20260709 12:11:07.165475 13835 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 8.
W20260709 12:11:07.117749 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 47596us
I20260709 12:11:07.170068 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:07.170385 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:07.172520 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:07.173302 13832 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 9.
W20260709 12:11:07.163748 17307 consensus_meta.cc:287] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.620s	user 0.009s	sys 0.002s
I20260709 12:11:07.184145 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:07.185302 13832 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 9.
I20260709 12:11:07.184140 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:07.186035 13763 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 9.
I20260709 12:11:07.187768 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:07.193868 17307 raft_consensus.cc:2749] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:07.194176 17207 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:07.195106 17332 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:07.197310 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.136987 17107 consensus_queue.cc:1059] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:11:07.200266 13756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 514) took 1918 ms. Trace:
I20260709 12:11:07.165961 17075 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:07.205250 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:07.206493 13759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48120 (request call id 1626) took 2099 ms. Trace:
I20260709 12:11:07.206759 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:07.207149 17206 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:07.207442 13763 raft_consensus.cc:2468] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 6.
I20260709 12:11:07.168846 17237 raft_consensus.cc:2804] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:07.208083 17237 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:07.208439 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:07.208582 17237 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:07.209300 13763 raft_consensus.cc:2393] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 9: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:07.143796 17288 consensus_queue.cc:1048] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:11:07.142974 17081 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:07.190979 17224 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:07.166214 17310 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:07.200875 13829 raft_consensus.cc:3055] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:07.210137 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:07.212004 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:07.188170 17331 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:07.206934 13759 rpcz_store.cc:276] 0709 12:11:05.109470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.253796 (+144326us) service_pool.cc:224] Handling call
0709 12:11:07.206342 (+1952546us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b54000898d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:07.206438 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3276045696}
I20260709 12:11:07.189963 17313 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:07.134208 17346 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:07.211619 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:07.200736 13756 rpcz_store.cc:276] 0709 12:11:05.282095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.475273 (+193178us) service_pool.cc:224] Handling call
0709 12:11:05.509091 (+ 33818us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:05.583680 (+ 74589us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:11:05.623602 (+ 39922us) log.cc:844] Serialized 14 byte log entry
0709 12:11:06.251337 (+627735us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:06.251396 (+    59us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:06.251449 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.200025 (+948576us) spinlock_profiling.cc:243] Waited 74.3 ms on lock 0x7b54000a0ad4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:07.200074 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:07.200204 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":44032,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":155747,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"spinlock_wait_cycles":170797952,"thread_start_us":568085,"threads_started":2,"wal-append.queue_time_us":445927}
I20260709 12:11:07.214519 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:07.424854 13835 raft_consensus.cc:1240] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 11. Current term is 12. Ops: []
W20260709 12:11:07.403556 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.143889 17240 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:07.429546 13760 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 9.
I20260709 12:11:07.430869 13829 raft_consensus.cc:740] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:07.431950 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:07.433314 13835 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:07.433765 13755 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:07.427348 13762 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:07.280843 17206 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:07.174582 17340 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:07.432062 13829 consensus_queue.cc:260] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:07.447674 13829 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:07.445094 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 234608us
I20260709 12:11:07.450186 13800 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:07.260641 16951 raft_consensus.cc:3055] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:07.250175 16736 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 9 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:07.402055 17073 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:11:07.463798 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 335619us
I20260709 12:11:07.402848 17091 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:07.490208 17091 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:07.430318 17262 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.494927 17262 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:07.426764 17149 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.498279 17149 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:07.501117 17149 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:07.442529 17117 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.502393 17117 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:07.470189 13800 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:07.504860 13800 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:07.438611 17161 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:07.263610 17349 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:07.474407 13755 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 9.
I20260709 12:11:07.474565 17011 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:07.478078 16922 raft_consensus.cc:2749] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:07.480996 17346 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:07.487253 17298 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:07.506378 17349 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:07.508389 17298 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.508903 17298 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:07.510578 17349 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:07.510993 17240 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:07.487476 16848 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:07.513878 16848 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:07.460417 16951 raft_consensus.cc:740] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:07.514706 17146 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:07.515658 16951 consensus_queue.cc:260] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:07.488904 17073 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:07.543095 17073 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:07.440833 17310 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:07.456162 17224 consensus_queue.cc:1059] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 12:11:07.517437 17262 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:07.518038 17350 raft_consensus.cc:2749] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:07.518385 13757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2269) took 2520 ms. Trace:
I20260709 12:11:07.518535 17347 raft_consensus.cc:2749] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:07.461584 17340 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:07.520622 13800 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:07.493476 17091 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:07.528872 13762 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 9.
I20260709 12:11:07.535188 13835 raft_consensus.cc:2468] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 9.
I20260709 12:11:07.496793 17336 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:07.505473 17117 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:07.551059 13757 rpcz_store.cc:276] 0709 12:11:04.998213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.003556 (+  5343us) service_pool.cc:224] Handling call
0709 12:11:05.032075 (+ 28519us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:06.168355 (+1136280us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.518096 (+1349741us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54000efe54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:07.518293 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2611172096}
I20260709 12:11:07.437232 17206 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:07.572820 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:07.574522 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:07.587150 14415 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 12.
I20260709 12:11:07.582615 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:07.588253 13683 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 9.
I20260709 12:11:07.582733 13686 raft_consensus.cc:1240] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 8. Current term is 9. Ops: [6.4-8.5]
I20260709 12:11:07.589438 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:07.590139 13683 raft_consensus.cc:2368] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 8. Current term is 9.
I20260709 12:11:07.590071 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:07.590761 13686 raft_consensus.cc:1813] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Handling vote request from an unknown peer 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:07.510998 17298 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:07.587563 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:11:07.586201 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 65665.2us
I20260709 12:11:07.596438 13800 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:07.600613 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:07.601227 13762 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:07.602175 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:07.604607 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:07.605065 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:07.605224 13755 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 8.
I20260709 12:11:07.605615 13829 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:07.592317 13686 raft_consensus.cc:2393] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 6: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:07.609941 13800 leader_election.cc:304] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:07.600111 13652 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:07.611948 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:07.611706 13651 leader_election.cc:304] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:07.624573 13651 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:07.627048 13800 leader_election.cc:400] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 election: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 8. Current term is 9.
I20260709 12:11:07.627422 13800 leader_election.cc:403] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:11:07.628847 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:07.629519 14413 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 8.
I20260709 12:11:07.623473 13652 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:07.630564 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:07.577521 17288 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:07.635900 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:07.631170 13686 raft_consensus.cc:2468] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 7.
I20260709 12:11:07.591822 17091 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.585561 16848 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:07.631110 13652 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:07.639390 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:07.594996 17224 raft_consensus.cc:2749] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:07.565377 17235 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:07.637522 13800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.632650 17149 raft_consensus.cc:2749] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:07.640707 17350 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:07.636898 13651 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:07.643082 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:07.654026 14409 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 13.
I20260709 12:11:07.654953 13651 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:07.639288 17121 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.645078 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:07.633173 17349 raft_consensus.cc:2804] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:07.639093 17345 raft_consensus.cc:2804] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:07.623522 17262 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:07.633296 17320 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 12:11:07.634184 17107 raft_consensus.cc:2804] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:07.667012 17107 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:07.667587 17107 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:07.663085 17345 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:07.668586 17345 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:07.649412 16848 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:07.672021 16848 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:07.672641 16848 raft_consensus.cc:2749] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:07.646000 17091 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:07.675714 17091 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:07.664505 17121 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:07.678719 17121 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:07.622325 17146 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:07.679828 17146 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:07.679958 17107 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:07.656759 13727 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:11:07.714551 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 57848.3us
I20260709 12:11:07.715667 17308 raft_consensus.cc:2804] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:07.660374 13800 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:07.716341 17308 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:07.716866 17308 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:07.716954 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 56647.9us
I20260709 12:11:07.646294 17344 consensus_queue.cc:1059] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 12:11:07.639475 17347 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.719929 13800 leader_election.cc:400] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 election: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 8. Current term is 9.
I20260709 12:11:07.721148 13800 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:07.648921 17331 raft_consensus.cc:2804] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:07.639945 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:07.663120 17349 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:07.682073 17146 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:07.650553 17073 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:07.686138 16848 raft_consensus.cc:2804] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:07.684337 17262 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:07.688514 17091 consensus_queue.cc:1059] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:07.694476 17359 raft_consensus.cc:2804] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:07.642838 17288 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:07.642048 13762 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 5.
I20260709 12:11:07.711102 13829 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 11.
I20260709 12:11:07.715620 13727 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:07.640468 17348 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:07.648698 17204 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.699867 17298 raft_consensus.cc:2749] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:07.756613 17146 raft_consensus.cc:2804] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:07.760201 17146 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:07.760805 17146 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:07.762115 17204 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:07.765936 17348 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:07.766765 17235 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:07.725734 17224 raft_consensus.cc:2749] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:07.716233 17107 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:07.729257 14411 raft_consensus.cc:2393] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 12: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:11:07.768939 17348 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:07.704188 17081 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:07.718485 17344 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:07.741052 17351 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:07.742003 13686 raft_consensus.cc:1240] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:07.750308 17310 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:07.742669 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:07.775435 13829 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 12.
I20260709 12:11:07.736501 16848 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:07.776584 16848 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:07.780999 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:07.781898 13829 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 12.
I20260709 12:11:07.765491 17204 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:07.759090 16736 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.724442 17331 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:07.729182 17347 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:07.729425 17349 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:07.742820 13727 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:07.768987 17262 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:07.772928 17359 raft_consensus.cc:697] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 9 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:07.752506 13681 raft_consensus.cc:1240] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:07.769302 17336 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:07.794984 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:07.805084 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:07.788223 17345 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:07.798478 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 143592us
I20260709 12:11:07.773694 17145 consensus_queue.cc:1048] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:11:07.738257 17073 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:07.773576 17134 consensus_queue.cc:1048] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:11:07.798043 17331 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:07.788532 17206 leader_election.cc:290] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:07.798462 17340 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:07.808498 13651 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:07.780365 17351 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:07.815405 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 173006us
I20260709 12:11:07.808037 17262 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:07.818033 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:07.821795 13651 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:07.800077 16736 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:07.824399 13651 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:11:07.831043 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 88375.8us
I20260709 12:11:07.833729 13686 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 8.
I20260709 12:11:07.834245 13727 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:07.836337 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:07.837574 13681 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:07.838217 13800 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:07.840447 13800 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:07.825668 17206 raft_consensus.cc:2804] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:07.843612 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:07.844856 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:07.847548 13829 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 9.
I20260709 12:11:07.847621 17370 raft_consensus.cc:2804] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:07.845999 17240 raft_consensus.cc:2749] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:07.853471 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:07.835788 17366 raft_consensus.cc:2804] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:07.854796 16736 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:07.893522 13829 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:07.856573 17237 consensus_meta.cc:287] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.647s	user 0.012s	sys 0.001s
I20260709 12:11:07.857457 17359 consensus_queue.cc:237] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:07.859169 17073 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:07.861923 17351 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:07.846704 17206 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:07.846254 17107 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:07.853535 17361 consensus_queue.cc:1048] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:11:07.864974 17350 raft_consensus.cc:2749] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 8. Current term is 9.
I20260709 12:11:07.853400 13727 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
W20260709 12:11:07.949522 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 96237.2us
I20260709 12:11:07.950326 13727 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:07.867715 17347 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:07.868449 17356 log.cc:927] Time spent T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.131s	user 0.001s	sys 0.001s
I20260709 12:11:07.842806 17355 raft_consensus.cc:2804] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:07.870731 17288 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:07.879781 17345 leader_election.cc:290] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:07.883006 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:07.886669 13651 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:07.889729 13684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1471) took 1497 ms. Trace:
I20260709 12:11:07.889767 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:07.929215 17237 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:07.903431 13681 raft_consensus.cc:2468] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 9.
I20260709 12:11:07.908209 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:07.908972 17366 raft_consensus.cc:697] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 9 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:07.909340 17364 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.910023 16848 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:07.912207 17146 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:07.972193 17310 raft_consensus.cc:2804] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:07.978355 17310 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:07.978909 17310 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:07.979477 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:07.979719 17146 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:07.914975 17224 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.980952 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:07.981055 17224 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:07.983170 17355 raft_consensus.cc:697] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 9 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:07.983637 17224 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:07.935194 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:07.984321 17355 consensus_queue.cc:237] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:07.985102 13757 raft_consensus.cc:2393] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 10: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:07.981413 17364 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:07.935515 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:07.986522 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:07.978390 17229 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:07.987152 13757 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:07.987048 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:07.988621 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:07.940353 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:07.935081 17344 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:11:08.003490 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 53246.4us
I20260709 12:11:07.911367 17205 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:08.015642 13754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:39554 (request call id 33) took 2663 ms. Trace:
I20260709 12:11:08.015812 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:08.016846 13832 raft_consensus.cc:2410] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:11:07.955509 13829 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 10.
I20260709 12:11:07.958736 13762 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:07.958840 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 128529us
I20260709 12:11:08.016260 13754 rpcz_store.cc:276] 0709 12:11:05.345631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.363619 (+ 17988us) service_pool.cc:224] Handling call
0709 12:11:08.009209 (+2645590us) spinlock_profiling.cc:243] Waited 970 ms on lock 0x7b54003336d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f87853 00007fa92cf5560a 00007fa9264db7d4 00007fa9264db762 00007fa9264db691 00007fa9264db60c 00007fa9264da8c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:08.009302 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2231260032}
I20260709 12:11:07.891000 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:08.018242 13760 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 9.
I20260709 12:11:07.963044 17373 raft_consensus.cc:2804] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:07.963577 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:11:07.958142 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 71847.8us
W20260709 12:11:07.965646 13688 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1480) took 1561 ms (client timeout 2055 ms). Trace:
I20260709 12:11:07.942348 17206 raft_consensus.cc:3060] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:07.971092 13759 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 11.
I20260709 12:11:07.957999 13684 rpcz_store.cc:276] 0709 12:11:06.392367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.401381 (+  9014us) service_pool.cc:224] Handling call
0709 12:11:06.429230 (+ 27849us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:06.484949 (+ 55719us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:11:06.505857 (+ 20908us) log.cc:844] Serialized 14 byte log entry
0709 12:11:07.046833 (+540976us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:07.046918 (+    85us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:07.047015 (+    97us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.885668 (+838653us) spinlock_profiling.cc:243] Waited 55.4 ms on lock 0x7b5400040bd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:07.889271 (+  3603us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:07.889633 (+   362us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44395,"prepare.queue_time_us":23446,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":2457,"raft.queue_time_us":45310,"raft.run_wall_time_us":2131,"spinlock_wait_cycles":135931904,"thread_start_us":495929,"threads_started":1,"wal-append.queue_time_us":550480}
I20260709 12:11:08.023955 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:08.024770 13684 raft_consensus.cc:2393] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 7: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:07.977100 16848 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:07.919355 13652 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:07.991245 13682 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 7.
I20260709 12:11:08.027853 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:07.949164 17336 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:08.029237 17336 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:08.016410 17349 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:08.030858 13651 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:08.031603 17336 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:08.032619 17091 raft_consensus.cc:2804] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:11:08.033170 17091 raft_consensus.cc:697] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 5 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:08.034538 17364 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:08.031751 17349 leader_election.cc:290] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:08.035691 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 116440us
I20260709 12:11:08.002580 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:08.037756 13681 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:08.037995 17340 raft_consensus.cc:2804] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:08.038642 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:08.004997 13727 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:08.039744 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:08.040613 13760 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 7.
I20260709 12:11:08.021013 13837 raft_consensus.cc:2368] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 8. Current term is 9.
W20260709 12:11:08.042124 13837 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54830 (request call id 2234) took 1283 ms (client timeout 1624 ms). Trace:
I20260709 12:11:08.001817 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:08.042472 13837 rpcz_store.cc:269] 0709 12:11:06.758651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.928504 (+169853us) service_pool.cc:224] Handling call
0709 12:11:07.963357 (+1034853us) spinlock_profiling.cc:243] Waited 1.9 ms on lock 0x7b5800034898. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924e68b71 00007fa924e68a22 00007fa92dd818d9 00007fa92cedbee0 00007fa92cfa50ab 00007fa92cfa5131 00007fa92cf530a0 00007fa92cf52984 00007fa9264cd6d4 00007fa9264cd662
0709 12:11:08.042067 (+ 78710us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4365184}
I20260709 12:11:08.043350 13755 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 8.
W20260709 12:11:08.021028 13688 rpcz_store.cc:269] 0709 12:11:06.404327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.491165 (+ 86838us) service_pool.cc:224] Handling call
0709 12:11:07.965386 (+1474221us) spinlock_profiling.cc:243] Waited 530 ms on lock 0x7b5400271854. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:07.965574 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1219373952}
I20260709 12:11:07.948925 17107 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:08.025732 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:08.029599 13757 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 9.
I20260709 12:11:08.034169 17091 consensus_queue.cc:237] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:08.038450 17340 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:08.007753 17366 consensus_queue.cc:237] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:08.050835 13762 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 10.
I20260709 12:11:08.062453 13681 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 9.
I20260709 12:11:08.067175 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:08.055761 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:08.075949 14408 raft_consensus.cc:2368] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 8. Current term is 9.
I20260709 12:11:08.018988 17024 raft_consensus.cc:3055] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:08.078881 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:08.079764 13837 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 9.
I20260709 12:11:08.054102 17246 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:08.053362 17288 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.086573 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:08.054248 17373 raft_consensus.cc:697] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:08.066772 17340 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:08.091236 13837 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 7.
I20260709 12:11:08.087222 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:08.093641 13832 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 9.
I20260709 12:11:08.066910 16922 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.098366 16922 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:08.022413 17370 raft_consensus.cc:697] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:08.080773 17024 raft_consensus.cc:740] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:08.134086 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:08.135450 13837 raft_consensus.cc:2393] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 7: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
W20260709 12:11:08.136045 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 131107us
I20260709 12:11:08.084735 17377 raft_consensus.cc:2749] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:08.139242 13800 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:08.140187 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:08.120301 17359 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:08.141645 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:08.140956 13681 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 9.
I20260709 12:11:08.136981 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:08.144527 13832 raft_consensus.cc:2393] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 13: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:08.144505 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:08.131531 16922 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:08.146350 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:08.147107 17293 raft_consensus.cc:3055] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:08.147378 13681 raft_consensus.cc:2410] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:11:08.147554 17293 raft_consensus.cc:740] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:08.148429 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:08.148576 17293 consensus_queue.cc:260] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:08.149260 13681 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 6.
I20260709 12:11:08.150556 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:08.151485 13681 raft_consensus.cc:2393] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 10: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:08.143205 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:08.152799 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:08.158663 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:08.159590 14408 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 8.
I20260709 12:11:08.165813 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:11:08.166975 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 129290us
I20260709 12:11:08.167757 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:08.168529 13755 raft_consensus.cc:2393] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 9: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:08.169957 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:08.081000 17308 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:08.101061 17288 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:08.148377 17331 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:08.141502 17359 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:08.139024 17336 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:08.177421 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:08.337822 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
W20260709 12:11:08.206207 13800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.177192 13679 raft_consensus.cc:2393] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 9: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:08.190433 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:08.408277 13681 raft_consensus.cc:2393] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 10: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:08.291679 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:08.236171 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:08.411063 13837 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:08.200515 13652 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:08.412580 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:08.378695 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:08.437067 13755 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:08.436785 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 236414us
I20260709 12:11:08.439308 13652 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:08.165215 17011 raft_consensus.cc:2804] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:08.297525 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:08.447777 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:08.448307 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:08.456075 13679 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 8.
W20260709 12:11:08.457564 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.457499 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:08.169692 17293 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:08.471233 13763 raft_consensus.cc:2393] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 9: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:08.459825 13679 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 7.
I20260709 12:11:08.479043 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:08.480680 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:08.483093 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:11:08.409432 17262 consensus_meta.cc:287] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.585s	user 0.009s	sys 0.003s
I20260709 12:11:08.222002 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:08.287177 17314 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.437031 17346 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.318190 17107 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:08.222648 16922 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:08.377697 17377 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.286187 16993 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:08.448661 17205 raft_consensus.cc:2804] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:08.507462 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:08.187558 17024 consensus_queue.cc:260] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:08.512733 17346 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:08.521730 17024 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:08.470783 17075 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.336203 17310 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:08.455483 16848 raft_consensus.cc:2804] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:08.453979 17011 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:08.454515 17182 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.454746 17345 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:08.330817 17206 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:08.525260 17075 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:08.481490 13679 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 7.
I20260709 12:11:08.535355 13755 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 8.
I20260709 12:11:08.502221 17262 raft_consensus.cc:2749] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:08.446417 17336 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:08.567600 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:11:08.542491 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 95660.7us
I20260709 12:11:08.545495 14414 raft_consensus.cc:1275] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:11:08.527697 17377 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:08.519420 16922 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:08.295938 17370 consensus_queue.cc:237] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:08.555573 17331 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:08.557742 17288 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:08.537204 16848 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:08.558293 17345 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:08.559701 17308 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:08.535385 13837 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 10.
I20260709 12:11:08.566941 13682 raft_consensus.cc:2393] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 9: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
W20260709 12:11:08.573865 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.506250 17314 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:08.310190 17373 consensus_queue.cc:237] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:08.539491 17011 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:08.574600 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:08.600581 13679 raft_consensus.cc:2368] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 9. Current term is 10.
I20260709 12:11:08.577364 13800 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:08.536715 17205 raft_consensus.cc:697] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 10 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:08.600840 17344 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.632834 17344 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:08.635041 17344 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:08.611107 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:08.635637 13755 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:08.637626 13681 raft_consensus.cc:2410] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
W20260709 12:11:08.620513 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.623270 13830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 612) took 1938 ms. Trace:
I20260709 12:11:08.509279 17237 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:08.619287 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:08.638660 13830 rpcz_store.cc:276] 0709 12:11:06.685505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.685861 (+   356us) service_pool.cc:224] Handling call
0709 12:11:08.622572 (+1936711us) spinlock_profiling.cc:243] Waited 14.5 ms on lock 0x7b5800034898. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924e68b71 00007fa924e68a22 00007fa92dd818d9 00007fa92cedbee0 00007fa92cfa50ab 00007fa92cfa5131 00007fa92cf66fc0 00007fa92cf51929 00007fa92cf513d2 00007fa9264c8bd4
0709 12:11:08.622775 (+   203us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:08.622954 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:08.622980 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:08.623022 (+    42us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:08.623056 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.623115 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:08.623217 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":33463168}
I20260709 12:11:08.640225 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:08.626751 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:08.641165 13837 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 9.
I20260709 12:11:08.606583 17346 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:08.610533 16848 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:08.623624 17336 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:08.650264 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:08.544314 17182 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:08.643482 14414 raft_consensus.cc:2368] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 8. Current term is 9.
I20260709 12:11:08.644637 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:08.659039 13755 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 10.
I20260709 12:11:08.660756 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:08.662084 13679 raft_consensus.cc:2410] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:11:08.663100 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:08.629096 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:08.664583 13832 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 9.
I20260709 12:11:08.664829 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:08.669131 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:08.669304 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:08.670689 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:08.671401 14409 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:08.672256 13832 raft_consensus.cc:2468] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 6.
I20260709 12:11:08.654203 17326 raft_consensus.cc:2804] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:08.676311 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:08.687500 13755 raft_consensus.cc:2393] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 9: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:08.676929 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:08.688608 13830 raft_consensus.cc:2393] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 9: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:08.689188 13830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54830 (request call id 2245) took 1490 ms. Trace:
I20260709 12:11:08.689251 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:08.677286 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:08.653285 17308 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.691407 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:08.690553 13837 raft_consensus.cc:2410] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:11:08.691373 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:08.689728 13830 rpcz_store.cc:276] 0709 12:11:07.198362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.676700 (+1478338us) service_pool.cc:224] Handling call
0709 12:11:08.689111 (+ 12411us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:08.694052 13832 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:11:08.660724 17262 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:08.695755 13837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54820 (request call id 2331) took 1070 ms. Trace:
I20260709 12:11:08.702239 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:08.703692 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:11:08.705698 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 113134us
I20260709 12:11:08.711167 13679 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 8.
I20260709 12:11:08.695650 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:08.712690 13755 raft_consensus.cc:2368] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 4. Current term is 5.
W20260709 12:11:08.707401 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 130130us
I20260709 12:11:08.710397 13837 rpcz_store.cc:276] 0709 12:11:07.625755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.671804 (+1046049us) service_pool.cc:224] Handling call
0709 12:11:08.695691 (+ 23887us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:08.714097 13800 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:08.714327 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:08.686254 17376 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.715979 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:08.712507 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:08.717231 13830 raft_consensus.cc:2393] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 10: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:08.698069 17326 raft_consensus.cc:697] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 9 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:08.719731 13837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54820 (request call id 2325) took 1111 ms. Trace:
I20260709 12:11:08.720130 13837 rpcz_store.cc:276] 0709 12:11:07.603430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.714093 (+1110663us) service_pool.cc:224] Handling call
0709 12:11:08.715049 (+   956us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:08.717734 13830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54820 (request call id 2327) took 1113 ms. Trace:
I20260709 12:11:08.720855 13830 rpcz_store.cc:276] 0709 12:11:07.603886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.712239 (+1108353us) service_pool.cc:224] Handling call
0709 12:11:08.717678 (+  5439us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:08.721887 13726 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:08.721045 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:08.722985 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:08.734055 13651 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:08.735566 13651 leader_election.cc:304] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:08.736505 13837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54830 (request call id 2254) took 1077 ms. Trace:
I20260709 12:11:08.730386 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:08.736908 13837 rpcz_store.cc:276] 0709 12:11:07.659005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.720802 (+1061797us) service_pool.cc:224] Handling call
0709 12:11:08.736438 (+ 15636us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:08.738013 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:08.739302 13837 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:08.694639 17205 consensus_queue.cc:237] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:08.741344 13726 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:08.744105 13832 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 5.
I20260709 12:11:08.741636 13830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54820 (request call id 2329) took 1127 ms. Trace:
I20260709 12:11:08.744755 13832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54830 (request call id 2248) took 1087 ms. Trace:
I20260709 12:11:08.745196 13832 rpcz_store.cc:276] 0709 12:11:07.657640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.673515 (+1015875us) service_pool.cc:224] Handling call
0709 12:11:08.744701 (+ 71186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:08.744884 13830 rpcz_store.cc:276] 0709 12:11:07.614485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.727080 (+1112595us) service_pool.cc:224] Handling call
0709 12:11:08.741574 (+ 14494us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:08.716079 17359 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:08.715478 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:08.750407 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:08.751099 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:08.724443 17346 raft_consensus.cc:2804] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:08.718115 17206 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:08.715502 17336 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:08.746284 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:08.759568 13682 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 6.
I20260709 12:11:08.791810 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:08.793295 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:08.760460 17326 consensus_queue.cc:237] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:08.754078 17288 raft_consensus.cc:2804] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:11:08.767148 13680 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2192) took 2719 ms (client timeout 2613 ms). Trace:
I20260709 12:11:08.743340 16993 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:08.770613 17314 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:08.770925 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:08.771963 17204 raft_consensus.cc:2749] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:08.774010 16922 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:08.774482 14416 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 13.
I20260709 12:11:08.774722 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:08.832211 13761 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:08.794787 13832 raft_consensus.cc:2368] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 8. Current term is 9.
I20260709 12:11:08.831355 16993 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:08.834532 16993 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:08.776636 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:08.778676 13652 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:08.835379 13688 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:08.835623 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 57014us
I20260709 12:11:08.779062 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:08.775521 16848 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:08.713169 17262 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:08.782975 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:08.785688 13800 leader_election.cc:400] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 election: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 9. Current term is 10.
I20260709 12:11:08.788674 14409 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 9.
I20260709 12:11:08.841135 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:08.789966 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:08.842566 13830 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:08.740497 17310 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:08.701386 17308 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:08.795202 13837 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 11.
I20260709 12:11:08.749516 16677 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:08.748646 17075 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:08.797742 13680 rpcz_store.cc:269] 0709 12:11:06.047789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.178961 (+131172us) service_pool.cc:224] Handling call
0709 12:11:08.766895 (+2587934us) spinlock_profiling.cc:243] Waited 911 ms on lock 0x7b540006fc54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:08.767059 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2096393600}
I20260709 12:11:08.849956 13761 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 10.
I20260709 12:11:08.753876 17345 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:08.852314 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:08.834419 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:08.781235 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:08.853066 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:08.853245 13832 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 9.
I20260709 12:11:08.853386 14416 raft_consensus.cc:2393] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 9: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:08.837361 13652 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:08.853792 13837 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 11.
I20260709 12:11:08.851467 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:08.837496 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:08.839665 13800 leader_election.cc:403] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:11:08.839725 13763 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 4.
I20260709 12:11:08.795373 17346 raft_consensus.cc:697] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 8 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:08.854929 13761 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 7.
I20260709 12:11:08.853431 13681 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 9.
I20260709 12:11:08.800740 13801 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:08.856225 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:08.857976 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 116766us
I20260709 12:11:08.859486 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:08.859527 13726 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:08.860688 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:08.724843 17376 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:08.835312 17288 raft_consensus.cc:697] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 10 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:08.862087 13726 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:08.794723 17336 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:08.839205 17382 raft_consensus.cc:2804] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:08.850070 16677 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:08.863255 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:08.862550 13837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 622) took 1323 ms. Trace:
I20260709 12:11:08.864053 13681 raft_consensus.cc:1275] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:11:08.873412 13680 raft_consensus.cc:2410] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:11:08.857487 13652 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
W20260709 12:11:08.862254 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 61656.8us
I20260709 12:11:08.868655 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:08.870280 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 84719.6us
I20260709 12:11:08.871112 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:08.873418 13830 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 10.
I20260709 12:11:08.883133 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:08.883704 17182 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:08.863971 17237 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:08.864681 17024 raft_consensus.cc:2749] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 9. Current term is 10.
I20260709 12:11:08.884722 13688 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 9.
I20260709 12:11:08.866484 17345 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:08.871158 13726 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:08.873112 13837 rpcz_store.cc:276] 0709 12:11:07.539650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.861630 (+1321980us) service_pool.cc:224] Handling call
0709 12:11:08.862005 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:08.862205 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:08.862234 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:08.862281 (+    47us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:08.862321 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.862380 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:08.862488 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:08.890137 13688 raft_consensus.cc:1240] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:08.891780 16848 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:08.899755 17206 raft_consensus.cc:2804] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:08.900761 17206 raft_consensus.cc:697] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 9 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:08.900906 17308 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:08.891064 13837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 624) took 1261 ms. Trace:
I20260709 12:11:08.885582 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:08.866993 17340 consensus_meta.cc:287] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.746s	user 0.014s	sys 0.000s
I20260709 12:11:08.887113 13832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 620) took 1357 ms. Trace:
I20260709 12:11:08.887595 13681 raft_consensus.cc:1275] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:11:08.888306 13763 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 9.
I20260709 12:11:08.887259 13652 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:08.888621 13830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 623) took 1312 ms. Trace:
I20260709 12:11:08.883195 13800 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:08.865633 17370 raft_consensus.cc:2804] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:08.872397 17382 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:08.891777 13688 raft_consensus.cc:1240] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:08.907368 13761 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 11.
I20260709 12:11:08.885130 17373 raft_consensus.cc:2804] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:08.907218 17340 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:08.874531 16677 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:08.906647 13837 rpcz_store.cc:276] 0709 12:11:07.630032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.890265 (+1260233us) service_pool.cc:224] Handling call
0709 12:11:08.890543 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:08.890715 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:08.890741 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:08.890791 (+    50us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:08.890851 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.890906 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:08.891010 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:08.948824 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 61637.3us
I20260709 12:11:08.913795 13726 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:08.956187 13652 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:08.954348 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:08.950551 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 67421.8us
I20260709 12:11:08.951025 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:08.949895 16922 raft_consensus.cc:2804] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:08.956838 13726 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:08.958042 13800 leader_election.cc:400] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 pre-election: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 4. Current term is 5.
I20260709 12:11:08.958441 13800 leader_election.cc:403] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:11:08.911599 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.906982 13832 rpcz_store.cc:276] 0709 12:11:07.530158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.869106 (+1338948us) service_pool.cc:224] Handling call
0709 12:11:08.886641 (+ 17535us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:08.886814 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:08.886838 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:08.886879 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:08.886910 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.886972 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:08.887061 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:08.960460 13726 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:08.961897 13830 rpcz_store.cc:276] 0709 12:11:07.576029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.887858 (+1311829us) service_pool.cc:224] Handling call
0709 12:11:08.888129 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:08.888295 (+   166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:08.888321 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:08.888362 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:08.888396 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.888462 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:08.888565 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:08.965505 13800 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:08.968642 17204 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:08.962031 17396 raft_consensus.cc:2804] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:08.905601 17336 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:08.902158 17346 consensus_queue.cc:237] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:08.894251 17288 consensus_queue.cc:237] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:08.957793 17380 log.cc:927] Time spent T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.818s	user 0.003s	sys 0.000s
I20260709 12:11:08.903190 17376 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:08.970700 13830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 2255) took 1311 ms. Trace:
I20260709 12:11:08.964042 17075 raft_consensus.cc:2749] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:08.965922 17024 raft_consensus.cc:2749] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 4. Current term is 5.
I20260709 12:11:08.973402 13652 leader_election.cc:400] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 election: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 8. Current term is 9.
I20260709 12:11:08.904258 17262 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:08.949046 17370 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:08.957455 17382 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:08.950536 17308 raft_consensus.cc:2804] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:11:08.974648 13800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.956533 16848 raft_consensus.cc:2804] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:08.911203 16993 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:08.974074 17313 raft_consensus.cc:2749] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:08.957175 13761 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 8.
I20260709 12:11:08.981231 17396 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:09.001132 17011 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:08.957154 17373 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:08.990996 13679 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 12.
I20260709 12:11:08.962826 16922 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:08.993152 13830 rpcz_store.cc:276] 0709 12:11:07.659222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.966705 (+1307483us) service_pool.cc:224] Handling call
0709 12:11:08.967146 (+   441us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:08.967398 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:08.967433 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:08.970366 (+  2933us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:08.970427 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.970545 (+   118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:08.970644 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:09.021198 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:09.022022 13830 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:08.987396 17340 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:08.970544 13832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 2252) took 1312 ms. Trace:
I20260709 12:11:08.966327 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:08.994983 13652 leader_election.cc:403] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
W20260709 12:11:09.025853 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 52602.3us
I20260709 12:11:09.026612 13652 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:09.027575 13652 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:08.996479 17370 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:08.985076 17204 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:08.992013 17320 raft_consensus.cc:2804] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:08.906371 17345 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:09.018766 13800 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:09.018221 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:08.901742 17206 consensus_queue.cc:237] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:09.019881 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 59512.4us
I20260709 12:11:09.033176 13830 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 10.
I20260709 12:11:09.025182 13832 rpcz_store.cc:276] 0709 12:11:07.658570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.960804 (+1302234us) service_pool.cc:224] Handling call
0709 12:11:08.969882 (+  9078us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:08.970076 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:08.970102 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:08.970150 (+    48us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:08.970208 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.970295 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:08.970461 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:09.035204 13652 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:09.009650 17376 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:09.015642 17024 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.015146 17308 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:09.014608 16848 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:09.060467 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:09.040498 13761 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 7.
I20260709 12:11:09.062902 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:09.063645 13761 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 13.
I20260709 12:11:09.064529 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:09.021265 16922 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:09.024217 17373 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:09.043733 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.034690 17313 raft_consensus.cc:2749] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 8. Current term is 9.
I20260709 12:11:09.066668 13761 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 11.
I20260709 12:11:09.062027 13832 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:09.071727 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:09.019870 17396 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:09.067637 13800 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:09.036988 17320 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:09.038304 17310 raft_consensus.cc:2804] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:09.041908 17345 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:09.070529 13652 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:09.059782 17075 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:09.066145 16848 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:09.079077 16993 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:09.081089 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:09.066663 17024 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:09.082686 17346 raft_consensus.cc:2804] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:09.082810 17204 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:09.076037 13800 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:09.086314 17310 raft_consensus.cc:697] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 11 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:09.086409 17399 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.060817 17340 raft_consensus.cc:2804] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:09.060669 17308 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:09.061987 17237 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:09.078346 17011 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:09.039710 17391 raft_consensus.cc:2804] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:09.043145 17336 raft_consensus.cc:2804] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:09.089443 17320 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:09.097280 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:09.118657 13727 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:11:09.174208 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 55661.2us
I20260709 12:11:09.175612 13727 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:11:09.127324 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:09.139628 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 63673.7us
I20260709 12:11:09.177369 13800 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:09.144567 13832 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 10.
I20260709 12:11:09.171090 13680 raft_consensus.cc:1275] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:09.177386 17262 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:09.124543 17288 raft_consensus.cc:2804] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:09.178228 17262 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:09.178326 17011 raft_consensus.cc:2804] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:09.178577 17288 raft_consensus.cc:697] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 10 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:09.178797 17262 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:09.178865 17011 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:09.179441 17011 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:09.179657 17288 consensus_queue.cc:237] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:09.140736 13758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2295) took 2763 ms. Trace:
I20260709 12:11:09.182533 13758 rpcz_store.cc:276] 0709 12:11:06.377408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.378456 (+  1048us) service_pool.cc:224] Handling call
0709 12:11:06.410805 (+ 32349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:06.524770 (+113965us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:11:06.524817 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:06.524880 (+    63us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:11:06.524932 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:09.140506 (+2615574us) spinlock_profiling.cc:243] Waited 62.3 ms on lock 0x7b54003c9954. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:09.140553 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:09.140677 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":57207,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":4574,"spinlock_wait_cycles":143368960,"thread_start_us":49772,"threads_started":1}
I20260709 12:11:09.184489 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:09.187003 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:09.187670 13832 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 11.
I20260709 12:11:09.189661 13832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 2256) took 1367 ms. Trace:
I20260709 12:11:09.190088 13832 rpcz_store.cc:276] 0709 12:11:07.822154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.188842 (+1366688us) service_pool.cc:224] Handling call
0709 12:11:09.189168 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:09.189344 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:09.189369 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:09.189413 (+    44us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:11:09.189452 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:09.189505 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:09.189606 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:09.177471 17406 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:09.192898 17406 consensus_queue.cc:1048] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:09.197045 13727 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:09.198135 17407 raft_consensus.cc:2804] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:09.198328 13727 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:09.198516 17011 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:09.199333 17262 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:09.201623 17011 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:09.201740 17262 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:09.139248 17346 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:09.163224 17344 raft_consensus.cc:2804] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:09.171186 17391 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:09.140169 16677 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:09.173610 17336 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:09.224910 17391 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:09.234515 17024 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:09.234959 13837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 2249) took 1577 ms. Trace:
I20260709 12:11:09.235267 17024 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:09.235380 17353 log.cc:927] Time spent T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 1.660s	user 0.001s	sys 0.006s
I20260709 12:11:09.235901 17024 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:09.216116 17344 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:09.238023 17344 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:09.215130 17346 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:09.241670 17310 consensus_queue.cc:237] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:09.166033 17399 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:09.140900 17345 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:09.252863 17336 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:09.255445 17345 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:09.235401 13837 rpcz_store.cc:276] 0709 12:11:07.657902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.954513 (+1296611us) service_pool.cc:224] Handling call
0709 12:11:08.954985 (+   472us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:08.963147 (+  8162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:08.963194 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:08.990201 (+ 27007us) log.cc:844] Serialized 52 byte log entry
0709 12:11:09.139148 (+148947us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:11:09.139190 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:09.139269 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:09.234666 (+ 95397us) raft_consensus.cc:1685] finished
0709 12:11:09.234689 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:09.234883 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8547,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":1961,"thread_start_us":115731,"threads_started":1,"wal-append.queue_time_us":214303}
I20260709 12:11:09.212170 17340 raft_consensus.cc:697] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 10 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:09.258837 17340 consensus_queue.cc:237] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:09.262998 17399 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:09.265576 17024 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:09.119791 17075 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:09.275713 17075 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:09.280180 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:09.282141 16677 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:09.281535 14410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 808) took 1009 ms. Trace:
I20260709 12:11:09.285337 13837 pending_rounds.cc:85] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 4
I20260709 12:11:09.290239 13837 pending_rounds.cc:107] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:11:09.291275 13837 raft_consensus.cc:2889] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:09.216034 17262 raft_consensus.cc:2804] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:09.285317 14410 rpcz_store.cc:276] 0709 12:11:08.271987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.487399 (+215412us) service_pool.cc:224] Handling call
0709 12:11:09.279810 (+792411us) spinlock_profiling.cc:243] Waited 7.88 ms on lock 0x7b5800003c98. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924e68b71 00007fa924e68a22 00007fa92dd818d9 00007fa92cedbee0 00007fa92cfa50ab 00007fa92cfa5131 00007fa92cf530a0 00007fa92cf52984 00007fa9264cd6d4 00007fa9264cd662
0709 12:11:09.281440 (+  1630us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18129280}
I20260709 12:11:09.263962 16922 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:09.312121 17407 raft_consensus.cc:697] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:09.313410 17407 consensus_queue.cc:237] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:09.314793 16848 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:09.305311 17262 raft_consensus.cc:697] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:09.281520 17344 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:09.318002 17366 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.167s	user 0.010s	sys 0.006s
W20260709 12:11:09.334107 17366 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.182s	user 0.010s	sys 0.007s
I20260709 12:11:09.339783 17396 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:09.343288 17396 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:09.344897 17376 raft_consensus.cc:2749] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:09.346997 17344 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:09.347489 17308 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:09.350414 17308 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:09.355852 17346 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:09.357764 17370 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:09.360555 17370 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:09.348986 17382 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:09.363224 17382 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:09.363458 17373 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:09.373905 17373 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:09.374140 17391 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:09.413358 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:09.414593 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 216211us
W20260709 12:11:09.415063 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 246887us
I20260709 12:11:09.417024 13832 raft_consensus.cc:1240] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 6. Current term is 8. Ops: []
I20260709 12:11:09.420171 13758 raft_consensus.cc:2393] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 8: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
W20260709 12:11:09.422267 13834 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54830 (request call id 2221) took 3353 ms (client timeout 2963 ms). Trace:
W20260709 12:11:09.422945 13834 rpcz_store.cc:269] 0709 12:11:05.963486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.963784 (+   298us) service_pool.cc:224] Handling call
0709 12:11:09.316246 (+3352462us) spinlock_profiling.cc:243] Waited 526 ms on lock 0x7b54000d9154. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:09.316435 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1209750912}
I20260709 12:11:09.426782 13763 raft_consensus.cc:2393] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 9: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
W20260709 12:11:09.429004 13800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.443329 16848 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:09.447644 16922 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:09.445294 13652 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:09.457690 17340 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:09.369331 17336 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:09.459409 17340 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:09.462667 17336 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:09.462893 17346 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:09.457214 17262 consensus_queue.cc:237] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:09.467422 17340 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:09.481331 17370 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:09.489171 17370 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:09.493021 17370 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:09.453006 17373 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:09.496274 17373 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:09.498008 13685 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2181) took 3460 ms (client timeout 2035 ms). Trace:
W20260709 12:11:09.498603 13685 rpcz_store.cc:269] 0709 12:11:06.037629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.040149 (+  2520us) service_pool.cc:224] Handling call
0709 12:11:09.497323 (+3457174us) spinlock_profiling.cc:243] Waited 895 ms on lock 0x7b54003f07d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:09.497660 (+   337us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2059023616}
I20260709 12:11:09.500380 13726 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:09.502395 13757 raft_consensus.cc:1240] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:11:09.503573 13757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 1643) took 1607 ms. Trace:
I20260709 12:11:09.504070 13757 rpcz_store.cc:276] 0709 12:11:07.895917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.048954 (+153037us) service_pool.cc:224] Handling call
0709 12:11:09.501128 (+1452174us) spinlock_profiling.cc:243] Waited 7.68 ms on lock 0x7b58001e3f98. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924e68b71 00007fa924e68a22 00007fa92dd818d9 00007fa92cedbee0 00007fa92cfa50ab 00007fa92cfa5131 00007fa92cf66fc0 00007fa92cf51929 00007fa92cf513d2 00007fa9264c8bd4
0709 12:11:09.501683 (+   555us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:09.503079 (+  1396us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:09.503375 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17671040}
I20260709 12:11:09.508780 13800 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:09.509122 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:09.511852 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:09.512111 13685 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f"
dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:58662
I20260709 12:11:09.513026 13759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48120 (request call id 1645) took 1570 ms. Trace:
I20260709 12:11:09.510388 13683 raft_consensus.cc:1240] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 9 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:11:09.512480 13830 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:09.514578 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 69616us
I20260709 12:11:09.515725 13652 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:09.516227 13683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1487) took 1923 ms. Trace:
I20260709 12:11:09.513456 13759 rpcz_store.cc:276] 0709 12:11:07.942814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.023159 (+ 80345us) service_pool.cc:224] Handling call
0709 12:11:09.511472 (+1488313us) spinlock_profiling.cc:243] Waited 17.6 ms on lock 0x7b58001e3f98. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924e68b71 00007fa924e68a22 00007fa92dd818d9 00007fa92cedbee0 00007fa92cfa50ab 00007fa92cfa5131 00007fa92cf530a0 00007fa92cf52984 00007fa9264cd6d4 00007fa9264cd662
0709 12:11:09.512912 (+  1440us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40481664}
I20260709 12:11:09.516703 13683 rpcz_store.cc:276] 0709 12:11:07.592778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.593054 (+   276us) service_pool.cc:224] Handling call
0709 12:11:09.509543 (+1916489us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:09.513613 (+  4070us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:09.515915 (+  2302us) spinlock_profiling.cc:243] Waited 1.92 s on lock 0x7b54003f07d0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:09.516137 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4406335744}
I20260709 12:11:09.518319 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:09.520119 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:09.521095 13759 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:11:09.521759 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:09.523195 13760 raft_consensus.cc:2393] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 9: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
W20260709 12:11:09.523855 13760 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48120 (request call id 1651) took 1444 ms (client timeout 1807 ms). Trace:
I20260709 12:11:09.524155 17382 raft_consensus.cc:2804] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:09.525280 17382 raft_consensus.cc:697] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 10 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:09.527209 17382 consensus_queue.cc:237] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:09.530098 17391 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:09.530843 13831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 618) took 2370 ms. Trace:
I20260709 12:11:09.531652 17391 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:09.532205 17391 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:09.532617 17391 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:09.520192 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:09.502439 17310 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:09.550382 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 50566.5us
I20260709 12:11:09.550581 17346 raft_consensus.cc:2749] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:09.552609 13836 raft_consensus.cc:1240] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:09.553584 17407 raft_consensus.cc:2804] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:09.554266 17407 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:09.555152 17407 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:09.555387 13828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 2223) took 3529 ms. Trace:
I20260709 12:11:09.531335 13831 rpcz_store.cc:276] 0709 12:11:07.160845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.160979 (+   134us) service_pool.cc:224] Handling call
0709 12:11:07.161274 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:07.457091 (+295817us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:11:07.712645 (+255554us) log.cc:844] Serialized 14 byte log entry
0709 12:11:07.826393 (+113748us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:07.826454 (+    61us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:07.826502 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:09.530243 (+1703741us) spinlock_profiling.cc:243] Waited 296 ms on lock 0x7b540020ce54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:09.530345 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:09.530623 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2971,"prepare.queue_time_us":338927,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":52,"raft.queue_time_us":120,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":3805,"spinlock_wait_cycles":679710976,"thread_start_us":333998,"threads_started":2,"wal-append.queue_time_us":140676,"wal-append.run_cpu_time_us":1096,"wal-append.run_wall_time_us":1003913}
I20260709 12:11:09.564194 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:09.564790 17370 consensus_queue.cc:1048] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:09.566524 17137 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:09.529523 13829 raft_consensus.cc:1275] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:11:09.513188 13685 raft_consensus.cc:606] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:09.553498 13836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 613) took 2861 ms. Trace:
I20260709 12:11:09.570508 13685 raft_consensus.cc:614] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:09.574120 13758 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:09.575094 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:09.576064 13757 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:11:09.576144 17073 raft_consensus.cc:993] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7: : Instructing follower 96701a74fdee481fb5f54aac841e17dd to start an election
I20260709 12:11:09.577004 17073 raft_consensus.cc:1081] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 LEADER]: Signalling peer 96701a74fdee481fb5f54aac841e17dd to start an election
I20260709 12:11:09.555860 13828 rpcz_store.cc:276] 0709 12:11:06.025583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.025888 (+   305us) service_pool.cc:224] Handling call
0709 12:11:06.026313 (+   425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:06.026589 (+   276us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:11:06.252007 (+225418us) log.cc:844] Serialized 14 byte log entry
0709 12:11:09.526360 (+3274353us) spinlock_profiling.cc:243] Waited 60.4 ms on lock 0x7b180032e6c0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa927b354bc 00007fa924e8348b 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9fc02 00007fa927b2720b 00007fa927b2cd23 00007fa927b2d23a
0709 12:11:09.554118 (+ 27758us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:09.554277 (+   159us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:09.554666 (+   389us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:09.555010 (+   344us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:09.555193 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9324,"prepare.queue_time_us":373866,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"spinlock_wait_cycles":138872576,"thread_start_us":382841,"threads_started":2,"wal-append.queue_time_us":266697,"wal-append.run_cpu_time_us":1771,"wal-append.run_wall_time_us":1039695}
I20260709 12:11:09.579751 13829 raft_consensus.cc:1240] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 10. Current term is 11. Ops: [8.6-10.7]
I20260709 12:11:09.580973 17121 raft_consensus.cc:3055] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:09.581472 17121 raft_consensus.cc:740] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:09.582098 17310 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:09.582764 17121 consensus_queue.cc:260] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:09.584930 17121 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:09.585093 17310 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:09.567384 17137 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:09.524432 13760 rpcz_store.cc:269] 0709 12:11:08.079828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.132088 (+ 52260us) service_pool.cc:224] Handling call
0709 12:11:09.521261 (+1389173us) spinlock_profiling.cc:243] Waited 26.4 ms on lock 0x7b58001e3f98. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924e68b71 00007fa924e68a22 00007fa92dd818d9 00007fa92cedbee0 00007fa92cfa50ab 00007fa92cfa5131 00007fa92cf530a0 00007fa92cf52984 00007fa9264cd6d4 00007fa9264cd662
0709 12:11:09.523774 (+  2513us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":60772096}
I20260709 12:11:09.587607 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:09.588049 17203 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:09.588737 13761 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 9.
I20260709 12:11:09.511327 17373 leader_election.cc:290] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:09.569408 13836 rpcz_store.cc:276] 0709 12:11:06.692135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.692423 (+   288us) service_pool.cc:224] Handling call
0709 12:11:09.551751 (+2859328us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b5800034898. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924e68b71 00007fa924e68a22 00007fa92dd818d9 00007fa92cedbee0 00007fa92cfa50ab 00007fa92cfa5131 00007fa92cf66fc0 00007fa92cf51929 00007fa92cf513d2 00007fa9264c8bd4
0709 12:11:09.552160 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:09.553130 (+   970us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:09.553410 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36138240}
I20260709 12:11:09.568818 13831 raft_consensus.cc:1240] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 8 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:11:09.569293 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:09.589387 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:09.593462 13831 raft_consensus.cc:1240] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 6. Current term is 8. Ops: []
W20260709 12:11:09.607803 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.611370 13760 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 11.
I20260709 12:11:09.612665 13760 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:11:09.613353 13760 raft_consensus.cc:606] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:09.613765 13760 raft_consensus.cc:614] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:11:09.636368 17315 log.cc:927] Time spent T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 3.121s	user 0.011s	sys 0.011s
I20260709 12:11:09.638685 13758 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 9.
I20260709 12:11:09.641842 13757 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 13.
I20260709 12:11:09.647528 13763 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:09.652614 13758 raft_consensus.cc:1240] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:09.653556 13758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 1648) took 1681 ms. Trace:
I20260709 12:11:09.654155 17316 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:09.654260 13758 rpcz_store.cc:276] 0709 12:11:07.972427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.647006 (+1674579us) service_pool.cc:224] Handling call
0709 12:11:09.652332 (+  5326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:09.653243 (+   911us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:09.653458 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:09.640304 17407 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:09.682237 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 173809us
I20260709 12:11:09.663477 17262 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:09.694710 17262 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:09.696796 17361 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:09.707054 13760 raft_consensus.cc:1240] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:09.708194 13760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 1659) took 1304 ms. Trace:
I20260709 12:11:09.708664 13760 rpcz_store.cc:276] 0709 12:11:08.403998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.667293 (+1263295us) service_pool.cc:224] Handling call
0709 12:11:09.685430 (+ 18137us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:09.707807 (+ 22377us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:09.708093 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:09.711786 13830 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 10.
I20260709 12:11:09.712723 13836 raft_consensus.cc:1240] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:09.719343 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 91493.7us
I20260709 12:11:09.689100 17320 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:09.708220 17378 log.cc:927] Time spent T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 1.587s	user 0.000s	sys 0.018s
I20260709 12:11:09.709911 17377 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:09.728652 13757 raft_consensus.cc:1240] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:09.698374 17361 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:09.738229 13828 raft_consensus.cc:1240] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:09.739135 13757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 1653) took 1614 ms. Trace:
I20260709 12:11:09.739555 13757 rpcz_store.cc:276] 0709 12:11:08.119735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.660998 (+1541263us) service_pool.cc:224] Handling call
0709 12:11:09.684433 (+ 23435us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:09.734202 (+ 49769us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:09.734453 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:09.744758 17361 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:09.746600 17418 log.cc:927] Time spent T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:11:09.756101 13680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1500) took 1079 ms. Trace:
I20260709 12:11:09.752700 17073 consensus_queue.cc:1059] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:09.768950 13680 rpcz_store.cc:276] 0709 12:11:08.676834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.878618 (+201784us) service_pool.cc:224] Handling call
0709 12:11:08.906908 (+ 28290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:09.178128 (+271220us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:09.755342 (+577214us) spinlock_profiling.cc:243] Waited 264 ms on lock 0x7b540021e654. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:09.755817 (+   475us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":606673152}
I20260709 12:11:09.775813 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:09.780532 13683 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 7.
I20260709 12:11:09.781937 13759 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 13.
I20260709 12:11:09.791280 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:09.793859 13760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 1661) took 1339 ms. Trace:
I20260709 12:11:09.794334 13760 rpcz_store.cc:276] 0709 12:11:08.454210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.709700 (+1255490us) service_pool.cc:224] Handling call
0709 12:11:09.738664 (+ 28964us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:09.790726 (+ 52062us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:09.790754 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:09.793533 (+  2779us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:09.793584 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:09.793650 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:09.793798 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:09.796749 13763 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 8.
I20260709 12:11:09.797871 17394 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:09.798730 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.798863 17081 raft_consensus.cc:2804] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:09.795995 13837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 2265) took 1059 ms. Trace:
I20260709 12:11:09.802314 13760 raft_consensus.cc:1240] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:09.796432 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:09.805226 13760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 1663) took 1332 ms. Trace:
I20260709 12:11:09.805878 13760 rpcz_store.cc:276] 0709 12:11:08.473277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.795444 (+1322167us) service_pool.cc:224] Handling call
0709 12:11:09.795838 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:09.804917 (+  9079us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:09.805163 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:09.807898 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:09.808182 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:09.808346 13756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2323) took 1916 ms. Trace:
I20260709 12:11:09.809476 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:09.809592 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:09.809924 17246 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:09.812075 13800 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:09.815582 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:09.816779 13679 raft_consensus.cc:2393] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 10: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:09.817183 13800 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:09.801613 13837 rpcz_store.cc:276] 0709 12:11:08.717274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.257761 (+540487us) service_pool.cc:224] Handling call
0709 12:11:09.273042 (+ 15281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:09.292666 (+ 19624us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:09.292714 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:09.293302 (+   588us) log.cc:844] Serialized 26 byte log entry
0709 12:11:09.664051 (+370749us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:09.666248 (+  2197us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:09.668469 (+  2221us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:09.762378 (+ 93909us) raft_consensus.cc:1685] finished
0709 12:11:09.762472 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:09.776793 (+ 14321us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":331355,"threads_started":1,"wal-append.queue_time_us":389627}
I20260709 12:11:09.822019 13757 raft_consensus.cc:2393] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 10: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:09.817740 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:09.825627 13680 raft_consensus.cc:1240] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:09.826694 17262 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:09.827203 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:09.827720 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:09.828480 13685 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:09.828783 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:09.812443 17073 consensus_queue.cc:1243] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer b98d2519bb504dc6905ed2ede4571835 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:11:09.831375 13754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48120 (request call id 1646) took 1884 ms. Trace:
I20260709 12:11:09.804498 17370 consensus_queue.cc:1059] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:11:09.831871 13754 rpcz_store.cc:276] 0709 12:11:07.946935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.038308 (+ 91373us) service_pool.cc:224] Handling call
0709 12:11:09.830971 (+1792663us) spinlock_profiling.cc:243] Waited 819 ms on lock 0x7b54001d2c54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:09.831193 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1883322624}
I20260709 12:11:09.831164 13757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2328) took 1111 ms. Trace:
I20260709 12:11:09.833310 13757 rpcz_store.cc:276] 0709 12:11:08.720090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.829959 (+1109869us) service_pool.cc:224] Handling call
0709 12:11:09.830455 (+   496us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:09.830756 (+   301us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:09.830787 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:09.830848 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:09.830887 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:09.830953 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:09.831082 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:09.808862 13756 rpcz_store.cc:276] 0709 12:11:07.891769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.891903 (+   134us) service_pool.cc:224] Handling call
0709 12:11:07.892266 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:07.892936 (+   670us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:07.892974 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:07.921740 (+ 28766us) log.cc:844] Serialized 26 byte log entry
0709 12:11:08.020234 (+ 98494us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:08.020273 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.020343 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:09.707124 (+1686781us) spinlock_profiling.cc:243] Waited 70.8 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:11:09.807864 (+100740us) raft_consensus.cc:1685] finished
0709 12:11:09.807887 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:09.808171 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":162856832,"thread_start_us":65887,"threads_started":1,"wal-append.queue_time_us":137380}
I20260709 12:11:09.832696 17406 raft_consensus.cc:3055] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:09.850545 17406 raft_consensus.cc:740] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:09.839545 13800 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:09.832577 17370 raft_consensus.cc:3055] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:09.829619 13680 raft_consensus.cc:2468] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 9.
I20260709 12:11:09.852608 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:09.853219 13687 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:09.853739 13679 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:09.812144 17246 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:09.860316 17327 raft_consensus.cc:3055] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:09.818879 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:09.870709 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:09.798734 17394 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:10.155910 13761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48114 (request call id 2339) took 1426 ms. Trace:
I20260709 12:11:09.940485 13685 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 8.
I20260709 12:11:10.154584 13832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 2264) took 1437 ms. Trace:
W20260709 12:11:09.881283 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 68148.9us
W20260709 12:11:09.951869 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 112449us
W20260709 12:11:10.114468 17121 consensus_meta.cc:287] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.529s	user 0.005s	sys 0.013s
I20260709 12:11:10.165254 17121 consensus_queue.cc:1059] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:09.897248 13681 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:10.166512 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 298361us
I20260709 12:11:10.012809 13679 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 13.
I20260709 12:11:10.167207 17394 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:10.167536 13651 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:11:10.168509 17316 consensus_meta.cc:287] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.513s	user 0.008s	sys 0.008s
I20260709 12:11:10.116829 17191 raft_consensus.cc:2804] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:10.169365 17191 raft_consensus.cc:697] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 9 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:10.169790 13686 raft_consensus.cc:2410] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:11:10.173202 17330 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.173441 17191 consensus_queue.cc:237] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:10.173758 17330 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:09.997707 13755 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:11:10.175323 13755 raft_consensus.cc:606] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:10.030390 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:10.175870 13755 raft_consensus.cc:614] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:10.176846 13681 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 8.
I20260709 12:11:10.176966 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:10.172137 13687 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 9.
I20260709 12:11:10.178334 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:10.180716 13687 raft_consensus.cc:2393] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 8: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:10.168360 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:09.996968 13727 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:09.818078 17346 raft_consensus.cc:2749] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:09.982584 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:10.161752 13761 rpcz_store.cc:276] 0709 12:11:08.729279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.071473 (+342194us) service_pool.cc:224] Handling call
0709 12:11:10.155710 (+1084237us) spinlock_profiling.cc:243] Waited 348 ms on lock 0x7b54002ef254. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:10.155832 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":801335680}
I20260709 12:11:10.036315 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:10.152081 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:09.824398 17377 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.195178 13682 raft_consensus.cc:2393] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 9: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:10.146476 17306 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:10.192370 13684 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 8.
I20260709 12:11:09.867870 17320 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:10.195005 17377 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:09.905762 17315 log.cc:927] Time spent T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:11:10.195439 13679 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:11:10.196390 13680 raft_consensus.cc:2468] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 6.
I20260709 12:11:10.196976 13757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2330) took 1475 ms. Trace:
I20260709 12:11:10.215325 13757 rpcz_store.cc:276] 0709 12:11:08.721508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.186255 (+1464747us) service_pool.cc:224] Handling call
0709 12:11:10.196201 (+  9946us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:10.196500 (+   299us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:10.196539 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:10.196622 (+    83us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:10.196664 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.196742 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:10.196907 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:09.997474 17336 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:11:10.197363 17379 log.cc:927] Time spent T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 2.057s	user 0.006s	sys 0.000s
I20260709 12:11:10.090691 16951 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:10.183317 17407 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:10.193835 13836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 628) took 1393 ms. Trace:
I20260709 12:11:10.221395 13836 rpcz_store.cc:276] 0709 12:11:08.800342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.591336 (+790994us) service_pool.cc:224] Handling call
0709 12:11:09.712526 (+121190us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:09.714032 (+  1506us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.193562 (+479530us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b540002dd50. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:10.193722 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":277653248}
I20260709 12:11:10.199026 13755 raft_consensus.cc:1275] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:11:09.898211 13683 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 7.
I20260709 12:11:10.162628 13832 rpcz_store.cc:276] 0709 12:11:08.717009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.191653 (+474644us) service_pool.cc:224] Handling call
0709 12:11:09.191962 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:09.418384 (+226422us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.154167 (+735783us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b54002a7454. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:10.154479 (+   312us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":515504512}
I20260709 12:11:10.200831 17073 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:10.148680 13833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 615) took 3113 ms. Trace:
I20260709 12:11:10.201376 13828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 625) took 1407 ms. Trace:
W20260709 12:11:10.212569 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 45176us
I20260709 12:11:09.865201 17370 raft_consensus.cc:740] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:09.899833 17410 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:10.207974 17391 consensus_meta.cc:287] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.671s	user 0.023s	sys 0.012s
I20260709 12:11:09.871747 17327 raft_consensus.cc:740] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:10.218155 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:10.208592 17346 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.217082 17336 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:10.223531 13755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2341) took 1436 ms. Trace:
I20260709 12:11:10.239207 13754 raft_consensus.cc:1240] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 11. Current term is 13. Ops: []
I20260709 12:11:10.225129 13828 rpcz_store.cc:276] 0709 12:11:08.794259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.579452 (+785193us) service_pool.cc:224] Handling call
0709 12:11:09.579877 (+   425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:09.741818 (+161941us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.201143 (+459325us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b54000afad4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:10.201314 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":363660032}
W20260709 12:11:10.244024 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 79028us
I20260709 12:11:10.243043 13755 rpcz_store.cc:276] 0709 12:11:08.787386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.177104 (+1389718us) service_pool.cc:224] Handling call
0709 12:11:10.198539 (+ 21435us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:10.222517 (+ 23978us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.223444 (+   927us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:10.248286 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 48116.7us
W20260709 12:11:10.249305 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.252388 13754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2329) took 1531 ms. Trace:
I20260709 12:11:10.252983 13754 rpcz_store.cc:276] 0709 12:11:08.721184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.185936 (+1464752us) service_pool.cc:224] Handling call
0709 12:11:10.235205 (+ 49269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:10.248733 (+ 13528us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.252306 (+  3573us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:10.238222 17262 raft_consensus.cc:2749] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:10.039310 17406 consensus_queue.cc:260] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:10.258378 13762 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 7.
I20260709 12:11:10.245028 17336 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:10.280897 17360 consensus_queue.cc:1059] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 12:11:10.225039 13833 rpcz_store.cc:276] 0709 12:11:07.034939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.035102 (+   163us) service_pool.cc:224] Handling call
0709 12:11:07.035427 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:07.181118 (+145691us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:07.214446 (+ 33328us) log.cc:844] Serialized 14 byte log entry
0709 12:11:07.886920 (+672474us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b18002cd220. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924ea03f3 00007fa924ea27c1 00007fa924ea2779 00007fa924ea2709 00007fa924ea26d1 00007fa924ea19cd 0000000000388634 0000000000388479 00007fa924e8383a
0709 12:11:09.533264 (+1646344us) spinlock_profiling.cc:243] Waited 1.77 ms on lock 0x7b18002cd220. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e82e07 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9fc02 00007fa927b2720b 00007fa927b2cd23 00007fa927b2d23a 00007fa927f97a2a
0709 12:11:09.678068 (+144804us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:09.680631 (+  2563us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:09.686281 (+  5650us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.148130 (+461849us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b54000b27d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:10.148204 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:10.148472 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":779,"prepare.queue_time_us":35335,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":58,"raft.queue_time_us":1957,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":11362,"spinlock_wait_cycles":816502016,"thread_start_us":113774,"threads_started":1,"wal-append.queue_time_us":2532110}
I20260709 12:11:10.281868 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:10.282670 13828 raft_consensus.cc:2393] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 10: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:10.282603 17309 raft_consensus.cc:2804] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:11:10.283169 17309 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:10.283583 17309 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:10.243955 17410 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:10.237689 17391 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:10.246299 17346 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:10.259081 17073 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:10.237869 17382 consensus_queue.cc:1048] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 12:11:10.285984 13800 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:10.308693 17137 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:10.308993 17410 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:10.310602 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:10.311491 13832 raft_consensus.cc:2393] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 8: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:10.312718 17431 consensus_queue.cc:1059] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:10.314100 17431 raft_consensus.cc:3055] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:10.314515 17431 raft_consensus.cc:740] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
W20260709 12:11:10.286509 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 419586us
I20260709 12:11:10.317013 17081 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:10.317657 17081 raft_consensus.cc:3060] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:10.290278 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:10.290791 13681 raft_consensus.cc:2393] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 12: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:10.281221 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:10.292814 13758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 1657) took 2137 ms. Trace:
I20260709 12:11:10.299417 13837 raft_consensus.cc:1240] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:10.300073 13830 raft_consensus.cc:1240] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:10.303881 13651 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:10.304970 13756 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:11:10.327543 13756 raft_consensus.cc:606] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:10.327976 13756 raft_consensus.cc:614] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:10.321751 13758 rpcz_store.cc:276] 0709 12:11:08.155795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.665101 (+1509306us) service_pool.cc:224] Handling call
0709 12:11:09.686515 (+ 21414us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:09.774763 (+ 88248us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:09.774795 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:09.783451 (+  8656us) log.cc:844] Serialized 52 byte log entry
0709 12:11:10.168502 (+385051us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:10.206480 (+ 37978us) log.cc:844] Serialized 14 byte log entry
0709 12:11:10.206739 (+   259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.206838 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:10.292563 (+ 85725us) raft_consensus.cc:1685] finished
0709 12:11:10.292583 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:10.292728 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32739,"prepare.queue_time_us":113347,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":34035,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":13671,"thread_start_us":383590,"threads_started":2,"wal-append.queue_time_us":457959}
I20260709 12:11:10.303098 17377 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:10.300477 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:10.291827 17391 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:10.293037 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:10.335529 13835 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 9.
I20260709 12:11:10.319762 13831 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 9.
W20260709 12:11:10.330888 13762 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48120 (request call id 1650) took 2225 ms (client timeout 1776 ms). Trace:
I20260709 12:11:10.300800 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:10.347136 13758 raft_consensus.cc:1240] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 6. Current term is 8. Ops: []
I20260709 12:11:10.341171 13834 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 6.
W20260709 12:11:10.338677 13762 rpcz_store.cc:269] 0709 12:11:08.053831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.071256 (+ 17425us) service_pool.cc:224] Handling call
0709 12:11:10.035928 (+1964672us) spinlock_profiling.cc:243] Waited 19.2 ms on lock 0x7b58001e3f98. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924e68b71 00007fa924e68a22 00007fa92dd818d9 00007fa92cedbee0 00007fa92cfa50ab 00007fa92cfa5131 00007fa92cf530a0 00007fa92cf52984 00007fa9264cd6d4 00007fa9264cd662
0709 12:11:10.278849 (+242921us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44163328}
W20260709 12:11:10.305495 17426 log.cc:927] Time spent T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:11:10.309653 17137 raft_consensus.cc:2804] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:10.371176 13679 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 8.
I20260709 12:11:10.287099 17406 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:10.296773 17262 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.248144 17246 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:10.304637 17346 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:10.381922 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:10.377694 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:10.308111 17073 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:10.396324 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 150029us
I20260709 12:11:10.397374 13759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2335) took 1669 ms. Trace:
I20260709 12:11:10.397934 13759 rpcz_store.cc:276] 0709 12:11:08.728176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.396082 (+1667906us) service_pool.cc:224] Handling call
0709 12:11:10.396682 (+   600us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:10.396960 (+   278us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:10.396991 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:10.397041 (+    50us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:10.397093 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.397157 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:10.397306 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:10.400180 14411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41700 (request call id 460) took 2254 ms. Trace:
I20260709 12:11:10.403609 13833 raft_consensus.cc:2368] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 13. Current term is 14.
I20260709 12:11:10.404594 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:10.409173 13651 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:10.368040 17391 raft_consensus.cc:2764] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:11:10.421186 14414 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 7.
I20260709 12:11:10.458626 13834 raft_consensus.cc:1275] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:10.460880 17309 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:10.462009 16951 consensus_queue.cc:1048] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:10.464066 17262 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:10.476177 13760 raft_consensus.cc:1275] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:10.294227 17370 consensus_queue.cc:260] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:10.294912 17327 consensus_queue.cc:260] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:10.400720 14411 rpcz_store.cc:276] 0709 12:11:08.145226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.145676 (+   450us) service_pool.cc:224] Handling call
0709 12:11:08.146046 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:08.146309 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:08.456920 (+310611us) log.cc:844] Serialized 14 byte log entry
0709 12:11:08.675482 (+218562us) log.cc:844] Serialized 14 byte log entry
0709 12:11:09.998105 (+1322623us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b180044f5c0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924ea03f3 00007fa924ea27c1 00007fa924ea2779 00007fa924ea2709 00007fa924ea26d1 00007fa924ea19cd 0000000000388634 0000000000388479 00007fa924e8383a
0709 12:11:10.367261 (+369156us) spinlock_profiling.cc:243] Waited 5.32 ms on lock 0x7b180044f5c0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e1ac0a 00007fa92e55a219 00007fa924ea2a40 00007fa924e9d4e4 00007fa924e9d455 00007fa927f85060 00007fa927f97716 00007fa927fa8287 00007fa927fa8208
0709 12:11:10.399403 (+ 32142us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:10.399503 (+   100us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:10.399586 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.399748 (+   162us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:10.399924 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6491,"prepare.queue_time_us":473871,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":78,"raft.queue_time_us":855,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":5896,"spinlock_wait_cycles":36517120,"thread_start_us":528072,"threads_started":2,"wal-append.queue_time_us":250306,"wal-append.run_cpu_time_us":1803,"wal-append.run_wall_time_us":1075264}
I20260709 12:11:10.378684 17320 consensus_queue.cc:1059] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.101s
W20260709 12:11:10.487738 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 77305.8us
I20260709 12:11:10.498509 13756 raft_consensus.cc:1275] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:11:10.474452 17137 raft_consensus.cc:697] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 13 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:10.485061 17360 consensus_queue.cc:1243] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer 96701a74fdee481fb5f54aac841e17dd log is divergent from this leader: its last log entry 8.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:11:10.528370 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:10.532935 17314 raft_consensus.cc:2804] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:10.389171 17431 consensus_queue.cc:260] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:10.522225 17370 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:10.477485 17391 consensus_queue.cc:1048] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:11:10.539785 13754 raft_consensus.cc:1240] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:11:10.536859 13800 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:10.538944 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:10.542529 13758 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 7.
I20260709 12:11:10.538100 17121 raft_consensus.cc:3055] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:10.544028 17430 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:11:10.544584 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.544734 17430 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:10.545840 13834 raft_consensus.cc:2410] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:11:10.538359 13727 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
W20260709 12:11:10.555397 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 63352.5us
I20260709 12:11:10.556413 17430 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:10.557514 17431 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:10.556157 17429 raft_consensus.cc:2804] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:10.555581 13726 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:10.560319 13726 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:10.561305 17410 raft_consensus.cc:2804] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:10.561705 17410 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:10.562077 17410 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:10.562352 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:10.562573 13756 raft_consensus.cc:1275] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:10.563030 13833 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 9.
I20260709 12:11:10.564610 17314 raft_consensus.cc:697] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 9 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:10.565984 17073 raft_consensus.cc:2749] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:10.565723 17314 consensus_queue.cc:237] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:10.566910 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:10.567152 17430 consensus_queue.cc:1059] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:10.568603 17073 consensus_queue.cc:1059] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:10.570076 13726 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:10.575207 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:10.576349 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:10.557582 13800 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:10.516846 17316 consensus_queue.cc:1059] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:11:10.583278 13834 raft_consensus.cc:2393] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 8: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:10.541180 17262 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:10.544019 17121 raft_consensus.cc:740] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:10.598963 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:10.597051 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:10.599745 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:10.601132 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:10.575548 17410 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:10.613557 13683 raft_consensus.cc:1275] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:10.607307 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:11:10.612020 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 1.89825e+06us
I20260709 12:11:10.610442 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:10.615701 13831 raft_consensus.cc:2393] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 5: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:10.616603 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:10.619581 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:10.625535 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:10.622826 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:10.626251 13758 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:10.628257 13679 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:10.628669 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:10.630862 13837 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 8.
I20260709 12:11:10.632407 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:10.625761 13726 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:10.637069 13836 raft_consensus.cc:1275] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:11:10.638736 13684 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 9.
I20260709 12:11:10.618134 17407 raft_consensus.cc:2804] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:10.612900 13835 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379"
dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:54820
I20260709 12:11:10.640638 13835 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:10.641077 13835 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:10.643330 13651 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:10.645073 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:11:10.646180 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 88706.7us
I20260709 12:11:10.651744 13833 raft_consensus.cc:2393] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 10: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:10.653163 13680 raft_consensus.cc:1240] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 11 LEADER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:10.655611 17306 raft_consensus.cc:2804] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:10.656205 17306 raft_consensus.cc:697] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:11:10.657438 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 121829us
I20260709 12:11:10.658550 13727 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:10.660071 13727 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:10.660547 13754 raft_consensus.cc:1275] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:11:10.625142 17360 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
W20260709 12:11:10.657339 17433 log.cc:927] Time spent T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 12:11:10.681586 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:10.661173 17073 consensus_queue.cc:1243] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer b98d2519bb504dc6905ed2ede4571835 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:11:10.653617 17436 raft_consensus.cc:2804] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:10.652966 17346 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:10.685932 17429 raft_consensus.cc:697] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 8 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:10.694142 17429 consensus_queue.cc:237] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:10.657338 17306 consensus_queue.cc:237] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:10.648288 17391 consensus_queue.cc:1048] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:11:10.705394 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:10.706560 13833 raft_consensus.cc:2368] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 13. Current term is 14.
I20260709 12:11:10.679885 17309 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:10.689313 17436 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:10.719283 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:10.716650 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:10.725381 13758 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 12.
I20260709 12:11:10.727068 13758 raft_consensus.cc:1275] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:11:10.721671 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 107715us
I20260709 12:11:10.731178 13836 raft_consensus.cc:2410] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:11:10.733485 17438 consensus_queue.cc:1059] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.072s
I20260709 12:11:10.734862 17081 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:10.680325 17360 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:10.739019 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.739529 17360 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:10.741003 17081 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:10.753144 17430 consensus_queue.cc:1048] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:11:10.729324 17346 raft_consensus.cc:697] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 13 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:10.757028 17081 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:10.756784 17346 consensus_queue.cc:237] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:10.757911 13754 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:10.757606 17081 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:10.759289 14411 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07"
dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:46814
I20260709 12:11:10.760068 14411 raft_consensus.cc:606] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 7 LEADER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:10.761703 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:10.762614 14410 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:10.765034 17081 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:10.770380 13832 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 7.
I20260709 12:11:10.777942 13726 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:10.786247 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:11:10.792289 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 129468us
I20260709 12:11:10.787276 13833 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 9.
W20260709 12:11:10.840194 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 86805.5us
I20260709 12:11:10.664456 17137 consensus_queue.cc:237] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:10.844945 13758 raft_consensus.cc:1275] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:10.845661 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:10.850742 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:10.729027 17436 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:10.851660 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
W20260709 12:11:10.851169 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 85434.9us
I20260709 12:11:10.852358 13688 raft_consensus.cc:1275] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 12:11:10.925230 13688 pending_rounds.cc:85] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 6
I20260709 12:11:10.846393 13833 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 6.
I20260709 12:11:10.732089 17073 raft_consensus.cc:2749] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:10.846843 13686 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1489) took 3007 ms (client timeout 3049 ms). Trace:
I20260709 12:11:10.854749 13828 raft_consensus.cc:1240] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:10.852190 17429 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
W20260709 12:11:10.926913 13686 rpcz_store.cc:269] 0709 12:11:07.840107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.841955 (+  1848us) service_pool.cc:224] Handling call
0709 12:11:10.766513 (+2924558us) spinlock_profiling.cc:243] Waited 2.32 s on lock 0x7b54002bf7d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:10.846768 (+ 80255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5339731200}
I20260709 12:11:10.859992 17081 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.862597 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:10.866555 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:10.867781 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:11:10.869506 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 141388us
I20260709 12:11:10.784044 17456 raft_consensus.cc:2749] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:10.887743 17410 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:10.925640 13688 pending_rounds.cc:107] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:11:10.936406 13835 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:10.859012 17446 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
W20260709 12:11:10.926218 17336 consensus_meta.cc:287] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.629s	user 0.010s	sys 0.003s
I20260709 12:11:10.924340 13679 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 11.
I20260709 12:11:10.778115 17121 consensus_queue.cc:260] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:10.933614 13726 leader_election.cc:304] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:10.797734 17407 raft_consensus.cc:697] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:10.952270 13758 raft_consensus.cc:1275] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:11:10.952909 17406 consensus_meta.cc:287] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.563s	user 0.013s	sys 0.000s
I20260709 12:11:10.952801 17407 consensus_queue.cc:237] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:10.941900 17081 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:10.940390 13755 pending_rounds.cc:85] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting all ops after (but not including) 3
I20260709 12:11:10.957865 13755 pending_rounds.cc:107] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:11:10.936733 14410 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 9.
I20260709 12:11:10.958401 13755 raft_consensus.cc:2889] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:10.940734 13688 raft_consensus.cc:2889] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:10.931721 13754 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 5.
I20260709 12:11:10.944905 17446 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:10.945544 14415 raft_consensus.cc:1275] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:10.946404 17121 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:10.946803 17430 consensus_queue.cc:1175] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b98d2519bb504dc6905ed2ede4571835" responder_term: 7 status { last_received { term: 6 index: 3 } last_committed_idx: 3 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:11:10.949718 17336 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:10.950845 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:10.931025 17361 raft_consensus.cc:3055] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:10.921988 17394 raft_consensus.cc:3055] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:10.934330 17262 raft_consensus.cc:3055] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:10.962015 17450 raft_consensus.cc:2804] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:11:10.981597 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 321567us
I20260709 12:11:10.982196 17446 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:11:10.987871 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 53911.5us
I20260709 12:11:10.956190 17081 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:10.995129 13835 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:10.998513 13830 raft_consensus.cc:2393] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 12: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:10.934711 17429 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:10.978075 17406 raft_consensus.cc:2804] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:11:10.999480 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.004647 13726 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:11:11.004122 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 68742.9us
I20260709 12:11:10.988811 17361 raft_consensus.cc:740] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:10.990356 17394 raft_consensus.cc:740] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:10.990648 17262 raft_consensus.cc:740] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:11.020143 17262 consensus_queue.cc:260] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:11.021515 17262 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:11.021965 17452 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.022775 17452 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:11.026003 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.009754 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:11.026867 13833 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:11:11.012043 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:11.010470 13800 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:11.011744 14416 raft_consensus.cc:1275] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:11.030898 13681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1509) took 1214 ms. Trace:
I20260709 12:11:11.031903 13800 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:11.032195 17336 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:11.032874 17336 raft_consensus.cc:2804] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:11.033273 13800 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:11.010134 17446 consensus_queue.cc:1048] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:11:11.017375 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 7
W20260709 12:11:11.042284 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.018307 17394 consensus_queue.cc:260] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:11.043555 17394 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:11.011618 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:11.034094 17447 raft_consensus.cc:2749] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:11.031508 13681 rpcz_store.cc:276] 0709 12:11:09.816514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.177618 (+361104us) service_pool.cc:224] Handling call
0709 12:11:11.030530 (+852912us) spinlock_profiling.cc:243] Waited 49.5 ms on lock 0x7b5400270e54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:11.030750 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":113739008}
I20260709 12:11:11.046737 13651 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:11.033286 17336 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:11.047322 14379 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:11.047820 17336 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:11.048949 14379 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:11.037045 17246 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:11.050704 13651 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:11.001904 17406 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:11.017524 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:11.029356 13727 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:11.041160 13833 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 8.
I20260709 12:11:11.049558 16952 consensus_queue.cc:1059] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 12:11:11.057153 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:11.058210 13828 raft_consensus.cc:2393] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 8: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:11.057881 17438 consensus_queue.cc:1048] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:11:11.061703 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 68409.1us
I20260709 12:11:11.061919 17369 consensus_queue.cc:1059] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:11.062103 17448 raft_consensus.cc:2804] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:11.062137 13800 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:11.062680 17440 raft_consensus.cc:2804] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:11.016132 17450 raft_consensus.cc:697] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:11.062826 17233 raft_consensus.cc:2764] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 12:11:11.078963 17366 consensus_queue.cc:1048] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 12:11:11.080084 13726 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:11.059520 17306 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:11.081836 17246 consensus_queue.cc:1048] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:11.082419 17191 raft_consensus.cc:3055] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:11.082882 17191 raft_consensus.cc:740] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:11.083595 17246 raft_consensus.cc:2804] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:11.084146 17246 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:11.083741 17191 consensus_queue.cc:260] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:11.084579 17246 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:11.084928 17191 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:11.009188 17081 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.072798 17429 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:11.074084 17431 raft_consensus.cc:2804] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:11.074339 13800 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:11.067600 17310 raft_consensus.cc:2804] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:11:11.075062 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 239108us
I20260709 12:11:11.063792 17316 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:11.054340 17456 raft_consensus.cc:3060] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:11.096662 17081 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:11.104584 17081 leader_election.cc:290] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:11.070444 17073 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:11.105700 17073 raft_consensus.cc:697] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:11.107415 17073 consensus_queue.cc:237] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:11.109906 13652 leader_election.cc:336] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Timed out: RequestConsensusVote RPC to 127.12.56.196:46341 timed out after 1.624s (SENT)
I20260709 12:11:11.112629 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:11.114169 17429 raft_consensus.cc:2749] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:11.078886 17450 consensus_queue.cc:237] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:11.071770 13727 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:11.058722 16743 consensus_queue.cc:1048] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:11:11.117878 17262 consensus_queue.cc:1048] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:11.118937 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:11.120204 13685 raft_consensus.cc:1275] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:11:11.120311 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:11.057703 17442 raft_consensus.cc:3055] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:11.055038 17406 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:11.121212 17442 raft_consensus.cc:740] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:11.121626 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:11.122129 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:11.122735 13683 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 8.
I20260709 12:11:11.100112 17440 raft_consensus.cc:697] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 9 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:11.124382 17440 consensus_queue.cc:237] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:11.126425 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:11.127147 14416 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 13.
I20260709 12:11:11.128542 14413 raft_consensus.cc:1240] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:11.129973 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:11.131063 17406 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:11.122725 17182 consensus_queue.cc:1048] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 12:11:11.119108 17452 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:11.122864 13684 raft_consensus.cc:3060] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:11.145154 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:11:11.100380 17370 consensus_meta.cc:287] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.546s	user 0.011s	sys 0.002s
I20260709 12:11:11.070403 17448 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:11.081319 17306 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:11.146154 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:11.126448 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:11.149313 13652 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:11.159103 13761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 1667) took 2185 ms. Trace:
W20260709 12:11:11.162130 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 80683.2us
I20260709 12:11:11.163168 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:11.163177 13726 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:11.169341 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:11.137076 17431 raft_consensus.cc:697] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 8 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:11.136374 17310 raft_consensus.cc:697] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 5 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:11.071063 17410 consensus_queue.cc:1048] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.083s
I20260709 12:11:11.147599 17316 raft_consensus.cc:697] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 12 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:11.174337 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:11.174824 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:11.155803 17448 raft_consensus.cc:3060] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:11.159569 13761 rpcz_store.cc:276] 0709 12:11:08.973989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.186765 (+1212776us) service_pool.cc:224] Handling call
0709 12:11:10.199229 (+ 12464us) spinlock_profiling.cc:243] Waited 1.27 ms on lock 0x7b58001e3f98. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924e68b71 00007fa924e68a22 00007fa92dd818d9 00007fa92cedbee0 00007fa92cfa50ab 00007fa92cfa5131 00007fa92cf66fc0 00007fa92cf51929 00007fa92cf513d2 00007fa9264c8bd4
0709 12:11:10.199498 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:10.199825 (+   327us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:11:10.344610 (+144785us) log.cc:844] Serialized 14 byte log entry
0709 12:11:10.639160 (+294550us) log.cc:844] Serialized 14 byte log entry
0709 12:11:11.079594 (+440434us) spinlock_profiling.cc:243] Waited 4.96 ms on lock 0x7b1800281da0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e82e07 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9d455 00007fa927f85060 00007fa927f97716 00007fa927fa8287 00007fa927fa8208
0709 12:11:11.158732 (+ 79138us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:11.158786 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:11.158840 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:11.158929 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:11.159046 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":390,"prepare.queue_time_us":84328,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":18750,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":4940,"spinlock_wait_cycles":53023616,"thread_start_us":446858,"threads_started":3,"wal-append.queue_time_us":349057}
I20260709 12:11:11.160813 17081 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.179490 17311 raft_consensus.cc:3055] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:11.180024 17311 raft_consensus.cc:740] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:11.179688 17081 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:11.162813 17370 raft_consensus.cc:2749] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:11.178975 13726 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:11.183974 13683 raft_consensus.cc:3055] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:11.188298 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:11.161568 17377 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:11.189306 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:11.186175 13683 raft_consensus.cc:740] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:11.171856 17452 raft_consensus.cc:2804] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:11.192317 13686 raft_consensus.cc:1240] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:11:11.195145 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:11.182060 16743 raft_consensus.cc:2804] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:11:11.198489 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:11.201027 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.181130 17311 consensus_queue.cc:260] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:11.216260 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:11.212899 13683 consensus_queue.cc:260] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:11.228992 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:11.122182 17442 consensus_queue.cc:260] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:11.234269 13683 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:11.236768 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 167246us
I20260709 12:11:11.199084 17452 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:11.239271 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:11.254838 13761 raft_consensus.cc:2393] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 7: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:11.252555 13684 raft_consensus.cc:2468] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 8.
I20260709 12:11:11.213155 17346 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.256471 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:11.207005 17320 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:11.258208 13684 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:11.260099 13727 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:11.261407 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:11.263459 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:11.231835 16743 raft_consensus.cc:697] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 10 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:11.268802 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:11.232023 17429 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.275889 13835 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:11.256382 17452 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:11.254614 17406 leader_election.cc:290] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:11.281657 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:11.273278 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:11.282721 13828 raft_consensus.cc:2393] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 8: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
W20260709 12:11:11.284703 13652 leader_election.cc:336] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Timed out: RequestConsensusVote RPC to 127.12.56.196:46341 timed out after 2.030s (SENT)
I20260709 12:11:11.285205 13652 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:11.270725 17081 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:11.311355 13828 raft_consensus.cc:1275] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:11:11.312484 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.276230 17446 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:11.318655 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:11.320556 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:11.321731 13833 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:11.329205 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:11.330992 13761 raft_consensus.cc:2368] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 7. Current term is 8.
I20260709 12:11:11.292090 17442 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:11.297139 17391 raft_consensus.cc:2749] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:11.350680 14415 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:11.278295 17320 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:11.355808 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:11:11.356330 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 103994us
I20260709 12:11:11.357213 13828 raft_consensus.cc:2393] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 8: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:11.277313 17346 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:11.285006 17429 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:11.297248 17463 raft_consensus.cc:2804] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:11.327399 17410 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:11.322235 17081 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:11.395838 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:11.396610 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:11.325155 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:11.417886 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:11.420771 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:11.271418 17310 consensus_queue.cc:237] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:11.430053 13684 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 9.
I20260709 12:11:11.341922 17447 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.283885 17431 consensus_queue.cc:237] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:11.435655 17447 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:11.430773 13652 leader_election.cc:336] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Timed out: RequestConsensusVote RPC to 127.12.56.196:46341 timed out after 1.616s (SENT)
I20260709 12:11:11.283699 17316 consensus_queue.cc:237] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:11.447304 13835 raft_consensus.cc:2468] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 7.
I20260709 12:11:11.337836 17446 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:11.493119 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:11.493638 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:11.493973 14410 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:11.498267 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 43499.7us
I20260709 12:11:11.498538 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:11.499454 13761 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 10.
I20260709 12:11:11.434367 17311 raft_consensus.cc:3060] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:11.434355 17306 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:11.438155 17447 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:11.497473 13835 raft_consensus.cc:1240] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 11. Current term is 12. Ops: []
W20260709 12:11:11.513375 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.515424 13833 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 12.
I20260709 12:11:11.447052 17463 raft_consensus.cc:697] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:11.449466 17137 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:11.504987 17467 log.cc:927] Time spent T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
W20260709 12:11:11.526614 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 109600us
W20260709 12:11:11.527858 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.530617 13833 raft_consensus.cc:1275] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:11:11.440009 17081 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:11.540143 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:11.541565 13652 leader_election.cc:336] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Timed out: RequestConsensusVote RPC to 127.12.56.196:46341 timed out after 1.920s (SENT)
I20260709 12:11:11.448915 17436 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:11.552971 13727 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:11.555311 14410 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 14.
I20260709 12:11:11.558199 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
W20260709 12:11:11.551096 17460 log.cc:927] Time spent T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:11:11.532487 17394 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.564651 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:11.578315 13686 raft_consensus.cc:2393] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 8: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:11.500200 16743 consensus_queue.cc:237] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:11.526203 17137 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:11.564654 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
W20260709 12:11:11.587081 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.571637 17370 raft_consensus.cc:2804] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:11.590049 17476 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.603518 17407 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.610491 17476 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:11.605320 17370 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
W20260709 12:11:11.611545 17456 consensus_meta.cc:287] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.510s	user 0.013s	sys 0.000s
I20260709 12:11:11.611801 17370 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:11.612108 17456 raft_consensus.cc:2749] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:11.602962 17391 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.614032 17446 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:11:11.591470 17468 log.cc:927] Time spent T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 12:11:11.592994 17463 consensus_queue.cc:237] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:11.594889 17462 log.cc:927] Time spent T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.283s	user 0.000s	sys 0.001s
I20260709 12:11:11.587845 17394 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:11.598584 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:11.619438 13832 raft_consensus.cc:2393] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 12: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
W20260709 12:11:11.592514 17336 consensus_meta.cc:287] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.544s	user 0.012s	sys 0.000s
I20260709 12:11:11.623860 17336 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:11.610766 17407 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:11.626938 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.627239 13754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2360) took 1015 ms. Trace:
W20260709 12:11:11.627521 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:11.627909 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:11.628322 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.628049 17407 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:11.614310 17391 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:11.627636 13754 rpcz_store.cc:276] 0709 12:11:10.611667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.987586 (+375919us) service_pool.cc:224] Handling call
0709 12:11:10.987938 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:10.988179 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:10.988203 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:10.995208 (+  7005us) log.cc:844] Serialized 26 byte log entry
0709 12:11:11.183925 (+188717us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:11.183982 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:11.184071 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:11.627017 (+442946us) raft_consensus.cc:1685] finished
0709 12:11:11.627035 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:11.627176 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":131289,"threads_started":1,"wal-append.queue_time_us":250211}
I20260709 12:11:11.630347 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:11.631049 13754 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:11.631222 17391 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:11.592468 17466 log.cc:927] Time spent T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:11:11.616098 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:11.616778 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:11.621085 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
W20260709 12:11:11.622572 17469 log.cc:927] Time spent T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 12:11:11.622747 13683 raft_consensus.cc:2410] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:11:11.622838 17330 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:11.602413 17470 log.cc:927] Time spent T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
W20260709 12:11:11.644665 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 116134us
I20260709 12:11:11.651727 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:11.654740 13754 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 12.
W20260709 12:11:11.621892 17121 consensus_meta.cc:287] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.638s	user 0.005s	sys 0.006s
I20260709 12:11:11.656697 13761 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 9.
I20260709 12:11:11.685353 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:11.686736 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:11.690201 17346 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:11.690944 17320 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:11.695035 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 43545us
I20260709 12:11:11.613605 17476 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:11.696714 13832 raft_consensus.cc:1275] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:11.697762 13837 raft_consensus.cc:2410] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
W20260709 12:11:11.698187 13652 leader_election.cc:336] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Timed out: RequestConsensusVote RPC to 127.12.56.196:46341 timed out after 1.750s (SENT)
I20260709 12:11:11.703577 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:11.704221 13754 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 10.
I20260709 12:11:11.705101 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:11.705688 13754 raft_consensus.cc:2393] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 12: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:11.706732 14408 raft_consensus.cc:3055] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:11.706924 13727 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:11.707664 13754 raft_consensus.cc:1275] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:11.707197 14408 raft_consensus.cc:740] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:11.712162 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:11.713402 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:11.716606 13758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2359) took 1105 ms. Trace:
I20260709 12:11:11.716332 14408 consensus_queue.cc:260] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:11.717670 14408 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:11.717016 13758 rpcz_store.cc:276] 0709 12:11:10.611333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.953246 (+341913us) service_pool.cc:224] Handling call
0709 12:11:10.953638 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:11.002096 (+ 48458us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:11.002125 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:11.017000 (+ 14875us) log.cc:844] Serialized 26 byte log entry
0709 12:11:11.230976 (+213976us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:11:11.231015 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:11.231088 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:11.716352 (+485264us) raft_consensus.cc:1685] finished
0709 12:11:11.716370 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:11.716536 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18854,"raft.queue_time_us":5115,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":8019,"thread_start_us":80240,"threads_started":1,"wal-append.queue_time_us":220777}
I20260709 12:11:11.719518 13758 raft_consensus.cc:1240] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:11.722605 13832 raft_consensus.cc:1275] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:11.721681 13758 raft_consensus.cc:1240] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:11:11.729352 13688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2234) took 1917 ms. Trace:
I20260709 12:11:11.729337 17436 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:11.733825 17456 raft_consensus.cc:2749] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:11.741989 13829 raft_consensus.cc:1240] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 8 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
W20260709 12:11:11.742604 17191 consensus_meta.cc:287] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.657s	user 0.014s	sys 0.000s
I20260709 12:11:11.744745 13831 raft_consensus.cc:1275] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:11:11.744745 13828 raft_consensus.cc:1275] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:11.746757 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:11.747859 13834 raft_consensus.cc:2393] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 7: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:11.749079 17436 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.708428 17429 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:11.749688 17436 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:11.752168 17436 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:11.752530 13832 raft_consensus.cc:1275] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:11.755199 14380 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:11.756350 17311 raft_consensus.cc:2804] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:11.756956 17311 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:11.714732 17327 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:11.758162 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:11.758831 17311 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:11.762641 17246 consensus_meta.cc:287] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.677s	user 0.012s	sys 0.000s
I20260709 12:11:11.763145 17246 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:11.734949 13688 rpcz_store.cc:276] 0709 12:11:09.812153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.188150 (+375997us) service_pool.cc:224] Handling call
0709 12:11:10.791568 (+603418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:10.996311 (+204743us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:11.729088 (+732777us) spinlock_profiling.cc:243] Waited 562 ms on lock 0x7b54002bf7d0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:11.729268 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1292805376}
I20260709 12:11:12.316669 17073 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:11.914477 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 73026.6us
W20260709 12:11:12.403448 14379 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.706s	user 0.013s	sys 0.042s
I20260709 12:11:11.839468 13755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2358) took 1260 ms. Trace:
I20260709 12:11:12.404114 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:11.981267 14408 raft_consensus.cc:1275] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:12.404179 13755 rpcz_store.cc:276] 0709 12:11:10.579538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.887630 (+308092us) service_pool.cc:224] Handling call
0709 12:11:10.927717 (+ 40087us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:10.982491 (+ 54774us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:11:11.134159 (+151668us) log.cc:844] Serialized 14 byte log entry
0709 12:11:11.825031 (+690872us) spinlock_profiling.cc:243] Waited 4.98 ms on lock 0x7b1800281aa0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa927b354bc 00007fa924e8348b 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9fc02 00007fa927b2720b 00007fa927b2cd23 00007fa927b2d23a
0709 12:11:11.825149 (+   118us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:11.825692 (+   543us) log.cc:844] Serialized 26 byte log entry
0709 12:11:11.831119 (+  5427us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:11.838797 (+  7678us) log.cc:844] Serialized 14 byte log entry
0709 12:11:11.839064 (+   267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:11.839145 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:11.839252 (+   107us) raft_consensus.cc:1685] finished
0709 12:11:11.839267 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:11.839410 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":232592,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":69,"raft.queue_time_us":334,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":107,"spinlock_wait_cycles":11453696,"thread_start_us":243155,"threads_started":2,"wal-append.queue_time_us":242778}
I20260709 12:11:12.406634 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:11:11.821059 17435 log.cc:927] Time spent T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 1.197s	user 0.001s	sys 0.001s
W20260709 12:11:11.822798 17377 consensus_meta.cc:287] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.623s	user 0.006s	sys 0.005s
I20260709 12:11:12.407428 13686 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 13.
I20260709 12:11:12.407809 17377 raft_consensus.cc:2749] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:12.408931 13763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2327) took 3689 ms. Trace:
I20260709 12:11:12.409754 13686 raft_consensus.cc:1275] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:11.817893 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:11.842319 13679 raft_consensus.cc:1240] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:12.411387 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 645350us
I20260709 12:11:12.411741 13679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 621) took 1295 ms. Trace:
W20260709 12:11:12.403851 14379 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.013s	sys 0.042s
W20260709 12:11:12.412408 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 752007us
I20260709 12:11:12.412281 13679 rpcz_store.cc:276] 0709 12:11:11.115996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.841803 (+725807us) service_pool.cc:224] Handling call
0709 12:11:11.842147 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:12.411509 (+569362us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:12.411691 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:11.774258 14415 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 13.
W20260709 12:11:12.413394 14379 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.56.194:39545 timed out after 1.811s (SENT) [suppressed 44 similar messages]
I20260709 12:11:12.413858 14415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41692 (request call id 602) took 1123 ms. Trace:
I20260709 12:11:12.414227 14415 rpcz_store.cc:276] 0709 12:11:11.290691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.290869 (+   178us) service_pool.cc:224] Handling call
0709 12:11:12.413753 (+1122884us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:11.841552 16848 consensus_queue.cc:1048] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.574s
I20260709 12:11:11.835984 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:12.415652 16848 consensus_queue.cc:1243] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer 3f37c9cc9dda46b4be21dd675ba78fb7 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:11:12.416338 13828 raft_consensus.cc:2393] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 8: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:12.416586 17246 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:12.398864 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:12.409547 13763 rpcz_store.cc:276] 0709 12:11:08.719669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.804226 (+1084557us) service_pool.cc:224] Handling call
0709 12:11:09.897494 (+ 93268us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:10.180102 (+282608us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:10.180225 (+   123us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:10.204456 (+ 24231us) log.cc:844] Serialized 26 byte log entry
0709 12:11:10.467874 (+263418us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:11:10.467907 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.467985 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:11.820201 (+1352216us) spinlock_profiling.cc:243] Waited 2.69 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:11:12.408515 (+588314us) raft_consensus.cc:1685] finished
0709 12:11:12.408543 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:12.408830 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":87082,"raft.queue_time_us":273917,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":132,"spinlock_wait_cycles":6178560,"thread_start_us":220422,"threads_started":1,"wal-append.queue_time_us":354439}
W20260709 12:11:11.826423 17452 consensus_meta.cc:287] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.527s	user 0.011s	sys 0.000s
I20260709 12:11:12.417303 17246 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.417871 17452 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:12.419729 13831 raft_consensus.cc:2393] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 10: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:12.420734 17452 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:11.854493 17440 consensus_queue.cc:1059] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.567s
I20260709 12:11:12.138562 17446 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:12.423758 13832 raft_consensus.cc:2376] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 7. Re-sending same reply.
W20260709 12:11:12.400915 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:11.852258 13652 leader_election.cc:336] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Timed out: RequestConsensusVote RPC to 127.12.56.196:46341 timed out after 2.020s (SENT)
I20260709 12:11:11.837572 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:11.824836 17410 raft_consensus.cc:2749] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:11.769111 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.838533 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:12.445257 13834 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 11.
W20260709 12:11:11.880623 17448 consensus_meta.cc:287] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.673s	user 0.014s	sys 0.000s
I20260709 12:11:12.406940 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:12.432592 13754 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.010s	sys 0.001s
W20260709 12:11:12.453271 13754 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.010s	sys 0.001s
W20260709 12:11:12.453521 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 579774us
I20260709 12:11:12.417958 17246 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:12.402387 17073 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:12.199236 17370 consensus_meta.cc:287] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.583s	user 0.013s	sys 0.000s
W20260709 12:11:12.312312 17310 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.008s	sys 0.003s
I20260709 12:11:12.441092 13835 raft_consensus.cc:2376] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 12. Re-sending same reply.
W20260709 12:11:12.055619 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:12.467865 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:12.468534 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:12.468987 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.839062 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:12.447207 13652 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:12.452731 13755 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 10.
I20260709 12:11:12.470218 17495 raft_consensus.cc:3055] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:12.470405 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:12.445329 17309 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.005s	sys 0.015s
I20260709 12:11:12.462652 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:12.471177 13755 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 9.
I20260709 12:11:12.471987 13760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2336) took 3743 ms. Trace:
I20260709 12:11:12.475705 13760 rpcz_store.cc:276] 0709 12:11:08.728422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.306005 (+1577583us) service_pool.cc:224] Handling call
0709 12:11:10.306436 (+   431us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:10.476758 (+170322us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:12.471756 (+1994998us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b54000924d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:12.471932 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":373580672}
I20260709 12:11:12.473451 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:12.476784 13754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2365) took 1408 ms. Trace:
W20260709 12:11:12.474496 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 622253us
W20260709 12:11:12.477926 13652 leader_election.cc:336] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Timed out: RequestConsensusVote RPC to 127.12.56.196:46341 timed out after 2.124s (SENT)
W20260709 12:11:12.467339 17310 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.725s	user 0.008s	sys 0.003s
I20260709 12:11:12.477111 13682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1513) took 1359 ms. Trace:
I20260709 12:11:12.477242 13754 rpcz_store.cc:276] 0709 12:11:11.068156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.708719 (+640563us) service_pool.cc:224] Handling call
0709 12:11:11.709087 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:11.733239 (+ 24152us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:11.733270 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:11.768431 (+ 35161us) log.cc:844] Serialized 26 byte log entry
0709 12:11:12.453842 (+685411us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:12.453884 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:12.453958 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:12.476588 (+ 22630us) raft_consensus.cc:1685] finished
0709 12:11:12.476608 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:12.476725 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4944,"raft.queue_time_us":23986,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":146,"thread_start_us":647406,"threads_started":1,"wal-append.queue_time_us":663137}
I20260709 12:11:12.479439 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:12.480377 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:12.466399 17370 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:12.445945 17446 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:12.453339 17452 consensus_queue.cc:1048] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:11:12.478861 13682 rpcz_store.cc:276] 0709 12:11:11.118204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.473147 (+1354943us) service_pool.cc:224] Handling call
0709 12:11:12.477052 (+  3905us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:12.475327 17309 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.006s	sys 0.016s
I20260709 12:11:12.492836 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:12.470894 17495 raft_consensus.cc:740] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:12.495813 13755 raft_consensus.cc:1240] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:11:12.496688 13760 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 5.
I20260709 12:11:12.498255 17473 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:12.498564 17246 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:12.498873 17473 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:12.499792 17370 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:12.500327 17361 consensus_queue.cc:260] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:12.501371 17473 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:12.488750 17476 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.502665 17476 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:12.504753 17476 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:12.504859 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:12.505800 13679 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 9.
I20260709 12:11:12.506855 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:12.494226 17382 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.507695 17081 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:12.455806 17448 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:12.513315 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:12.501647 17073 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:12.508473 17446 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:12.516933 16952 consensus_queue.cc:1059] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:12.518030 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:12.518172 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:12.518679 13684 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:12.519480 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:12.519553 17495 consensus_queue.cc:260] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:12.521008 17495 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:12.517530 17382 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:12.523499 17382 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:12.527014 17448 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:12.529675 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:12.530061 13800 leader_election.cc:400] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 7. Current term is 8.
I20260709 12:11:12.530366 13800 leader_election.cc:403] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:12.530433 13687 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 7.
I20260709 12:11:12.531417 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:11:12.527223 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:12.533952 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:12.517382 17311 consensus_meta.cc:287] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.758s	user 0.010s	sys 0.003s
I20260709 12:11:12.492079 16848 raft_consensus.cc:2749] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:12.539022 13762 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 10.
I20260709 12:11:12.556190 13726 leader_election.cc:304] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:12.539605 13684 raft_consensus.cc:2468] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 10.
I20260709 12:11:12.558166 13761 raft_consensus.cc:1240] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:12.558823 13760 raft_consensus.cc:1275] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:12.560024 13680 raft_consensus.cc:1240] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 6. Current term is 8. Ops: []
W20260709 12:11:12.557276 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 141554us
I20260709 12:11:12.501426 17361 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:12.565541 13684 raft_consensus.cc:1240] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:12.574397 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:12.575518 13684 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:12.576752 13726 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:11:12.564903 17327 consensus_meta.cc:287] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.807s	user 0.006s	sys 0.008s
I20260709 12:11:12.583575 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:12.586447 13682 raft_consensus.cc:2468] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 5.
I20260709 12:11:12.586891 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:11:12.590168 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 98114.6us
I20260709 12:11:12.591621 13680 raft_consensus.cc:1275] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:12.591490 13800 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:12.592793 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:12.558801 17429 raft_consensus.cc:2749] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 7. Current term is 8.
I20260709 12:11:12.586480 17499 consensus_queue.cc:1059] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 12:11:12.595288 17499 raft_consensus.cc:3055] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:12.595649 17499 raft_consensus.cc:740] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:12.597287 13757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2362) took 1554 ms. Trace:
I20260709 12:11:12.594241 17429 raft_consensus.cc:2749] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:12.596876 17499 consensus_queue.cc:260] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:12.598713 14414 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 812) took 4044 ms (client timeout 1892 ms). Trace:
I20260709 12:11:12.599318 17499 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:12.599138 14414 rpcz_store.cc:269] 0709 12:11:08.554642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.703449 (+148807us) service_pool.cc:224] Handling call
0709 12:11:12.598517 (+3895068us) spinlock_profiling.cc:243] Waited 1.71 s on lock 0x7b54006adbd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:12.598628 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3932041472}
I20260709 12:11:12.600443 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:12.598136 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:12.601819 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:12.602177 13835 raft_consensus.cc:2368] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for earlier term 9. Current term is 10.
I20260709 12:11:12.593489 13800 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:12.606391 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:12.609402 13683 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:12.610463 13687 raft_consensus.cc:1240] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:12.548997 17311 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:12.565945 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 153783us
I20260709 12:11:12.602402 13760 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 13.
I20260709 12:11:12.582660 17370 raft_consensus.cc:2804] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:12.597690 13757 rpcz_store.cc:276] 0709 12:11:11.043326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.059958 (+ 16632us) service_pool.cc:224] Handling call
0709 12:11:11.078188 (+ 18230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:11.173179 (+ 94991us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:11:11.270431 (+ 97252us) log.cc:844] Serialized 14 byte log entry
0709 12:11:11.450372 (+179941us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:11.450430 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:11.450487 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:12.595917 (+1145430us) spinlock_profiling.cc:243] Waited 6.11 ms on lock 0x7b1800161980. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e6e2a6 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419
0709 12:11:12.596904 (+   987us) spinlock_profiling.cc:243] Waited 94.7 ms on lock 0x7b540004fe54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:12.597098 (+   194us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:12.597231 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1569,"prepare.queue_time_us":95574,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":1702,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":51057,"spinlock_wait_cycles":231908608,"thread_start_us":234400,"threads_started":2,"wal-append.queue_time_us":273072,"wal-append.run_cpu_time_us":1393,"wal-append.run_wall_time_us":1042025}
I20260709 12:11:12.611120 13800 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:12.618647 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:12.618793 13834 raft_consensus.cc:1240] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:12.619654 13760 raft_consensus.cc:2393] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 8: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:12.620745 13684 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 8.
I20260709 12:11:12.621025 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:12.619720 13800 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:12.621402 13727 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:12.623337 13684 raft_consensus.cc:1240] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 9 LEADER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:11:12.622448 13680 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 10.
I20260709 12:11:12.623878 13651 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:12.625963 17448 raft_consensus.cc:2804] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:12.623813 13800 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:12.628290 13800 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:12.612550 17429 raft_consensus.cc:2804] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:12.616865 17246 raft_consensus.cc:2804] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:12.632064 13726 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:12.633878 17429 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:12.633338 13800 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:12.632931 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:12.630343 17370 raft_consensus.cc:697] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:12.611497 17262 consensus_queue.cc:1048] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 12:11:12.609324 17410 consensus_queue.cc:1048] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:11:12.637960 13680 raft_consensus.cc:1240] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 10 LEADER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:12.626343 17355 raft_consensus.cc:2804] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:12.640183 13683 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 10.
I20260709 12:11:12.627089 17473 raft_consensus.cc:2804] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:12.620373 17327 consensus_queue.cc:1048] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 12:11:12.642746 13726 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:12.644500 13800 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:12.645138 13760 raft_consensus.cc:1240] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:12.634529 17446 raft_consensus.cc:2804] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:12.643317 17476 raft_consensus.cc:2804] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:12.637732 17191 raft_consensus.cc:2804] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:12.648572 13760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 532) took 1027 ms. Trace:
I20260709 12:11:12.636169 17448 raft_consensus.cc:697] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 12 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:12.656334 17370 consensus_queue.cc:237] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:12.656883 13837 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54820 (request call id 2365) took 1971 ms (client timeout 1947 ms). Trace:
W20260709 12:11:12.657356 13837 rpcz_store.cc:269] 0709 12:11:10.691998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.701896 (+  9898us) service_pool.cc:224] Handling call
0709 12:11:12.656617 (+1954721us) spinlock_profiling.cc:243] Waited 975 ms on lock 0x7b540020d854. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:12.656778 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2242546432}
I20260709 12:11:12.646082 16952 consensus_queue.cc:1059] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 12:11:12.658104 13763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 1682) took 1158 ms. Trace:
I20260709 12:11:12.634853 17377 consensus_queue.cc:1048] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:11:12.659143 17262 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:12.659600 17262 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:12.659972 17262 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:12.660339 17495 raft_consensus.cc:3055] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:12.641893 17073 raft_consensus.cc:2804] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:12.660753 17246 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:12.661099 17073 raft_consensus.cc:697] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:12.661278 17246 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:12.651124 17191 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:12.658519 13763 rpcz_store.cc:276] 0709 12:11:11.499710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.417506 (+917796us) service_pool.cc:224] Handling call
0709 12:11:12.417897 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:12.418239 (+   342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:12.418270 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:12.418830 (+   560us) log.cc:844] Serialized 26 byte log entry
0709 12:11:12.602226 (+183396us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:11:12.602268 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:12.602340 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:12.657851 (+ 55511us) raft_consensus.cc:1685] finished
0709 12:11:12.657883 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:12.658014 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":49364,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":6787,"thread_start_us":182964,"threads_started":1,"wal-append.queue_time_us":216032}
I20260709 12:11:12.662164 17073 consensus_queue.cc:237] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:12.649449 17446 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:12.663584 17446 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:12.664091 13763 raft_consensus.cc:1240] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:12.664740 13763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 533) took 1020 ms. Trace:
I20260709 12:11:12.665055 13763 rpcz_store.cc:276] 0709 12:11:11.644295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.663402 (+1019107us) service_pool.cc:224] Handling call
0709 12:11:12.663730 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:12.664495 (+   765us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:12.664683 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:12.662192 17191 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:12.669602 17336 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:12.676997 13801 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:12.677484 13680 raft_consensus.cc:1240] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 5 LEADER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 4. Current term is 5. Ops: []
I20260709 12:11:12.645905 17355 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:12.648069 17473 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:12.679579 17336 consensus_queue.cc:1048] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:12.650324 17081 raft_consensus.cc:2804] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:12.682415 17081 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:12.682857 17081 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:12.684079 17137 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:12.687616 13763 raft_consensus.cc:1240] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 4. Current term is 5. Ops: []
I20260709 12:11:12.688318 13763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 534) took 1043 ms. Trace:
I20260709 12:11:12.688652 13763 rpcz_store.cc:276] 0709 12:11:11.644682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.671240 (+1026558us) service_pool.cc:224] Handling call
0709 12:11:12.687434 (+ 16194us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:12.688070 (+   636us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:12.688263 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:12.651501 17476 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:12.651347 13760 rpcz_store.cc:276] 0709 12:11:11.620722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.644758 (+1024036us) service_pool.cc:224] Handling call
0709 12:11:12.645024 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:12.648297 (+  3273us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:12.648497 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:12.640367 17429 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:12.642632 17498 raft_consensus.cc:2804] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:12.680240 17311 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:12.671295 13727 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:12.660776 17495 raft_consensus.cc:740] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:12.705387 17476 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:12.710603 13801 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:12.710767 17394 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:12.711660 17394 raft_consensus.cc:2749] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:12.705005 17137 raft_consensus.cc:2749] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:12.716029 17448 consensus_queue.cc:237] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:12.719594 13801 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:12.719823 13756 raft_consensus.cc:1240] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:12.678947 17355 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:12.721478 13761 raft_consensus.cc:1240] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:11:12.721553 17137 raft_consensus.cc:2804] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:12.748163 17137 raft_consensus.cc:697] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 14 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:12.749225 17137 consensus_queue.cc:237] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:12.750571 17446 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:12.724320 17486 log.cc:927] Time spent T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.949s	user 0.013s	sys 0.000s
I20260709 12:11:12.724591 13801 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:12.725917 13686 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:12.755136 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 83847.8us
I20260709 12:11:12.755566 13758 raft_consensus.cc:1240] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:11:12.734313 13685 raft_consensus.cc:1275] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 12:11:12.756350 13685 pending_rounds.cc:85] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 3
I20260709 12:11:12.756147 13727 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:12.756685 13685 pending_rounds.cc:107] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 12:11:12.757046 13685 raft_consensus.cc:2889] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:12.686753 17473 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:12.708015 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 95963.4us
I20260709 12:11:12.746016 17191 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:12.706984 17498 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:12.759896 17430 consensus_queue.cc:1048] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:12.758790 17410 raft_consensus.cc:2749] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:12.766413 13757 raft_consensus.cc:1240] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 LEADER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:12.762594 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:12.755167 13762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48120 (request call id 1676) took 1498 ms. Trace:
I20260709 12:11:12.793277 13762 rpcz_store.cc:276] 0709 12:11:11.257315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.358111 (+100796us) service_pool.cc:224] Handling call
0709 12:11:12.754976 (+1396865us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b540035f2d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:12.755100 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2396407040}
I20260709 12:11:12.794860 13757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 531) took 1190 ms. Trace:
I20260709 12:11:12.795065 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:12.795475 13757 rpcz_store.cc:276] 0709 12:11:11.604443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.619247 (+1014804us) service_pool.cc:224] Handling call
0709 12:11:12.636597 (+ 17350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:12.766185 (+129588us) spinlock_profiling.cc:243] Waited 7.83 ms on lock 0x7b54003c0b20. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f04dc0 00007fa927f8f1c0 00007fa927f90231 00007fa927f8cd8f 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c
0709 12:11:12.794521 (+ 28336us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:12.794778 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18010368}
I20260709 12:11:12.801803 14414 raft_consensus.cc:1275] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:12.760654 17394 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:11:12.802651 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 47225.9us
I20260709 12:11:12.767406 16952 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:12.806890 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 50858.2us
I20260709 12:11:12.807833 13758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 529) took 1600 ms. Trace:
I20260709 12:11:12.807943 13727 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:12.808471 13758 rpcz_store.cc:276] 0709 12:11:11.207506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.769260 (+561754us) service_pool.cc:224] Handling call
0709 12:11:12.755260 (+986000us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:12.760602 (+  5342us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:12.807551 (+ 46949us) spinlock_profiling.cc:243] Waited 985 ms on lock 0x7b540035f2d0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:12.807757 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2266486144}
I20260709 12:11:12.782500 17498 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:12.815364 13727 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:12.816785 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:12.783172 17382 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.828974 17382 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:12.818377 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
W20260709 12:11:12.824040 14380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:12.834677 14380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:12.836159 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 195639us
I20260709 12:11:12.822638 17452 raft_consensus.cc:2749] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:12.839484 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:12.842721 13652 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:12.845134 14414 raft_consensus.cc:2410] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
W20260709 12:11:12.845395 14380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.847113 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:12.848035 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:12.837357 17394 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.835640 17446 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:11:12.853188 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.816305 16952 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:12.857065 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 185405us
I20260709 12:11:12.859452 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:12.844187 17410 raft_consensus.cc:2804] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:12.870700 13754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 1683) took 1334 ms. Trace:
I20260709 12:11:12.870751 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:12.871680 13834 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:12.872658 14380 leader_election.cc:400] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 9 election: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for earlier term 9. Current term is 10.
I20260709 12:11:12.875844 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:12.848943 17314 raft_consensus.cc:2749] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:12.875955 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:12.882385 14416 raft_consensus.cc:2393] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 10: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:11:12.883471 13837 raft_consensus.cc:1240] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:12.878328 14410 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:12.879997 14414 raft_consensus.cc:1275] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:11:12.888319 13726 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:12.843851 17309 consensus_queue.cc:1048] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:11:12.875453 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:12.896878 13836 raft_consensus.cc:1240] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:12.882597 17377 raft_consensus.cc:2749] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:12.869190 17410 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:12.906312 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:12.908517 16952 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:12.909722 13762 raft_consensus.cc:1275] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:12.857223 17327 consensus_queue.cc:1048] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:11:12.909643 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:12.911280 13685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1526) took 1725 ms. Trace:
I20260709 12:11:12.924947 13685 rpcz_store.cc:276] 0709 12:11:11.185531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.187953 (+  2422us) service_pool.cc:224] Handling call
0709 12:11:11.206610 (+ 18657us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:12.771886 (+1565276us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:12.911045 (+139159us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b5400285ad4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:12.911220 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3512530688}
I20260709 12:11:12.872694 17081 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:12.894852 17361 consensus_queue.cc:1048] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 12:11:12.914675 17506 consensus_queue.cc:1059] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:12.858165 17438 consensus_queue.cc:1048] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:11:12.850917 17437 consensus_queue.cc:1048] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:11:12.909422 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:12.923106 17410 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:12.923434 14415 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 10.
I20260709 12:11:12.869460 16848 consensus_queue.cc:1048] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:11:12.859654 17394 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:12.930644 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:12.875636 17448 consensus_queue.cc:1059] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:11:12.902128 17452 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.927930 17382 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:12.952685 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:11:13.011782 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 142554us
I20260709 12:11:12.942857 14410 raft_consensus.cc:1275] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:11:12.942924 13760 raft_consensus.cc:1217] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Deduplicated request from leader. Original: 4.3->[6.4-10.6]   Dedup: 6.4->[8.5-10.6]
I20260709 12:11:13.014830 13760 pending_rounds.cc:85] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting all ops after (but not including) 4
I20260709 12:11:13.015192 13760 pending_rounds.cc:107] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 12:11:13.015481 13760 raft_consensus.cc:2889] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:12.948367 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
W20260709 12:11:12.921120 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 105873us
I20260709 12:11:13.018633 13727 leader_election.cc:304] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:12.953167 13759 raft_consensus.cc:1240] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:13.019511 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:12.932420 17508 raft_consensus.cc:2804] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:11:13.030700 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.871273 13754 rpcz_store.cc:276] 0709 12:11:11.524588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.490268 (+965680us) service_pool.cc:224] Handling call
0709 12:11:12.490587 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:12.490749 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:11:12.735384 (+244635us) log.cc:844] Serialized 14 byte log entry
0709 12:11:12.858304 (+122920us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:12.858355 (+    51us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:12.858402 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:12.858473 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:12.858585 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":344767,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":1441,"thread_start_us":366964,"threads_started":2}
I20260709 12:11:13.037232 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:11:13.036192 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 162802us
I20260709 12:11:12.958331 17191 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:13.042603 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:12.928256 17262 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:13.017302 17497 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.048774 17497 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:13.049435 17511 log.cc:927] Time spent T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:11:13.032768 17452 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:13.051178 17497 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:13.051715 17452 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:13.052301 17452 raft_consensus.cc:2749] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:13.043509 13652 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:13.056543 13686 raft_consensus.cc:1275] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:13.053668 13800 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:13.065841 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:12.954700 17476 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:12.955619 17429 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:13.066716 14411 raft_consensus.cc:2376] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 10. Re-sending same reply.
I20260709 12:11:13.089253 17531 consensus_queue.cc:1048] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:13.092754 13763 raft_consensus.cc:1240] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 9. Current term is 11. Ops: []
I20260709 12:11:13.042085 17137 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:13.100740 14410 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 9.
I20260709 12:11:13.060670 16743 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.101646 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:13.107324 14414 raft_consensus.cc:2368] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 7. Current term is 8.
W20260709 12:11:13.104034 13652 leader_election.cc:336] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Timed out: RequestConsensusVote RPC to 127.12.56.196:46341 timed out after 1.892s (SENT)
I20260709 12:11:13.108301 13652 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:13.068415 17440 raft_consensus.cc:3055] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:13.109545 17440 raft_consensus.cc:740] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:13.114480 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:13.106070 16743 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:13.122679 13834 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 10.
W20260709 12:11:13.138355 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.141327 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:13.069631 17355 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:13.110611 17309 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:13.110517 17448 raft_consensus.cc:2804] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:11:13.123596 17510 log.cc:927] Time spent T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
W20260709 12:11:13.148159 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 129632us
I20260709 12:11:13.123137 17497 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.101617 17310 consensus_queue.cc:1048] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:11:13.114142 17246 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:13.159518 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 55529us
I20260709 12:11:13.105036 17137 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:13.157460 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:13.163938 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:13.148137 17437 raft_consensus.cc:2749] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:13.167109 13727 leader_election.cc:400] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 13. Current term is 14.
I20260709 12:11:13.180053 17081 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:13.145193 17508 raft_consensus.cc:697] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:13.160452 17448 raft_consensus.cc:697] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 10 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:13.179069 13727 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:13.218544 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:13.159605 17497 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:13.228152 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 49179us
I20260709 12:11:13.228974 13727 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:13.242093 17509 consensus_queue.cc:1059] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.137s
I20260709 12:11:13.243219 17509 raft_consensus.cc:3055] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:13.243618 17509 raft_consensus.cc:740] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:13.244503 17509 consensus_queue.cc:260] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:13.247184 17495 consensus_queue.cc:260] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:13.248386 17495 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:13.253168 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.254673 16951 raft_consensus.cc:3055] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:13.255172 16951 raft_consensus.cc:740] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
W20260709 12:11:13.261063 17523 log.cc:927] Time spent T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 12:11:13.261122 17429 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:13.180684 17440 consensus_queue.cc:260] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:13.261883 17512 log.cc:927] Time spent T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.220s	user 0.000s	sys 0.001s
I20260709 12:11:13.262384 17440 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:13.263010 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:13.263577 17524 log.cc:927] Time spent T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:11:13.263790 17262 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:13.265077 17518 log.cc:927] Time spent T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 12:11:13.265234 17355 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:13.219483 17527 raft_consensus.cc:2749] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:13.260507 17394 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:13.269505 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:13.269805 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:13.270480 14414 raft_consensus.cc:2393] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 9: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
W20260709 12:11:13.271179 17513 log.cc:927] Time spent T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.236s	user 0.003s	sys 0.000s
I20260709 12:11:13.272274 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:13.272864 14415 raft_consensus.cc:2376] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 10. Re-sending same reply.
I20260709 12:11:13.276093 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:13.277228 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:13.278334 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:13.279780 13763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 535) took 1626 ms. Trace:
I20260709 12:11:13.280330 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:13.283056 17246 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:13.280391 13763 rpcz_store.cc:276] 0709 12:11:11.653713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.708961 (+1055248us) service_pool.cc:224] Handling call
0709 12:11:12.730174 (+ 21213us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:13.094673 (+364499us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:13.279376 (+184703us) spinlock_profiling.cc:243] Waited 362 ms on lock 0x7b54000a0ad4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:13.279678 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":833256192}
I20260709 12:11:13.287300 17137 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:13.290272 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:13.291767 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:13.293478 14412 raft_consensus.cc:1275] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:13.298935 17528 raft_consensus.cc:2804] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:13.283185 17497 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:13.300578 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 71673.5us
I20260709 12:11:13.321142 13727 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
W20260709 12:11:13.329800 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 402581us
I20260709 12:11:13.331918 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:13.332633 13755 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 12.
I20260709 12:11:13.296507 17448 consensus_queue.cc:237] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:13.340167 17410 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:13.343235 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 289641us
W20260709 12:11:13.330452 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 166624us
I20260709 12:11:13.319397 17528 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:13.355391 17436 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:13.356921 17498 consensus_meta.cc:287] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.546s	user 0.005s	sys 0.006s
I20260709 12:11:13.365360 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:13.356832 13755 raft_consensus.cc:1275] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:11:13.366411 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 45358.7us
W20260709 12:11:13.364251 14380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:13.368224 17473 consensus_meta.cc:287] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.569s	user 0.009s	sys 0.001s
I20260709 12:11:13.369745 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:13.370136 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:13.372044 17410 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:13.373085 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:13.373848 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:13.375556 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:13.376194 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:13.376338 17191 raft_consensus.cc:3055] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:13.376734 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:13.377522 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:13.576913 13755 raft_consensus.cc:2393] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 14: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:13.379070 13681 raft_consensus.cc:1240] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 8. Current term is 9. Ops: []
W20260709 12:11:13.380488 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.381520 13684 raft_consensus.cc:1240] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 10 LEADER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:13.261399 16951 consensus_queue.cc:260] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:13.383754 13758 raft_consensus.cc:1275] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:13.387008 13687 raft_consensus.cc:1240] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:13.362701 17246 raft_consensus.cc:2804] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:13.577042 17182 consensus_queue.cc:1059] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 12:11:13.583657 17246 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:13.584259 17246 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:13.382257 17508 consensus_queue.cc:237] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:13.584967 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.578073 17410 consensus_queue.cc:1059] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 12:11:13.584280 13583 catalog_manager.cc:5697] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: config changed from index 3 to 5, VOTER 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) evicted. New cstate: current_term: 4 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:13.379743 17498 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:13.379930 17436 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:13.392707 16743 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:13.394461 13652 leader_election.cc:336] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 1.566s (SENT)
W20260709 12:11:13.612663 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 218217us
W20260709 12:11:13.613291 13652 leader_election.cc:336] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Timed out: RequestConsensusVote RPC to 127.12.56.196:46341 timed out after 1.566s (SENT)
I20260709 12:11:13.613690 13652 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:13.394326 17355 consensus_queue.cc:1048] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:13.395422 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:13.395748 17535 log.cc:927] Time spent T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 12:11:13.394229 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:13.364691 17528 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:13.545895 17473 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:13.559760 13685 raft_consensus.cc:2393] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 14: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:13.561810 13679 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 12.
I20260709 12:11:13.564585 14412 raft_consensus.cc:2410] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:11:13.558475 13686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1531) took 1086 ms. Trace:
I20260709 12:11:13.630453 13686 rpcz_store.cc:276] 0709 12:11:12.472011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.472159 (+   148us) service_pool.cc:224] Handling call
0709 12:11:12.486444 (+ 14285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:12.725806 (+239362us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b5400154120. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f04dc0 00007fa927f8f1c0 00007fa927f90231 00007fa927f8cd8f 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c
0709 12:11:13.060533 (+334727us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:13.402907 (+342374us) spinlock_profiling.cc:243] Waited 93.9 ms on lock 0x7b5400285fd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:13.558389 (+155482us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":253573760}
I20260709 12:11:13.567902 13761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2372) took 1037 ms. Trace:
I20260709 12:11:13.631947 13761 rpcz_store.cc:276] 0709 12:11:12.530763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.759570 (+228807us) service_pool.cc:224] Handling call
0709 12:11:12.759885 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:12.806024 (+ 46139us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:12.806069 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:12.806117 (+    48us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:11:12.806163 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:13.435793 (+629630us) spinlock_profiling.cc:243] Waited 45.9 ms on lock 0x7b54003a07d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:13.567642 (+131849us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:13.567822 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":105561472}
I20260709 12:11:13.568352 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:13.569480 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 171953us
I20260709 12:11:13.570580 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:13.571359 13727 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:13.567137 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:13.557977 13688 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:13.580461 14380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:13.634474 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 63212.5us
W20260709 12:11:13.634691 14380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.635283 13727 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:13.636173 17538 raft_consensus.cc:2804] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:13.636247 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:13.636586 13727 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:13.636803 17538 raft_consensus.cc:697] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:13.637842 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:13.637399 13583 catalog_manager.cc:5697] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 1 to 6, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 6 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:11:13.637753 17538 consensus_queue.cc:237] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:13.582428 13834 raft_consensus.cc:1240] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:13.587996 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:13.604400 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:13.640213 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:13.640347 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.577479 17191 raft_consensus.cc:740] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:13.617810 13760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2382) took 1005 ms. Trace:
I20260709 12:11:13.619511 17498 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:13.621976 13756 raft_consensus.cc:1240] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:13.623171 13757 raft_consensus.cc:2368] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for earlier term 13. Current term is 14.
I20260709 12:11:13.623011 17509 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:13.581753 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:13.651424 13760 rpcz_store.cc:276] 0709 12:11:12.612307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.942335 (+330028us) service_pool.cc:224] Handling call
0709 12:11:12.942718 (+   383us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:11:13.100013 (+157295us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:11:13.230360 (+130347us) log.cc:844] Serialized 14 byte log entry
0709 12:11:13.353840 (+123480us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:13.364627 (+ 10787us) log.cc:844] Serialized 52 byte log entry
0709 12:11:13.364783 (+   156us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:13.364820 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:13.364889 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:13.617554 (+252665us) raft_consensus.cc:1685] finished
0709 12:11:13.617574 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:13.617730 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":76806,"prepare.run_cpu_time_us":2053,"prepare.run_wall_time_us":13526,"raft.queue_time_us":39898,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":153,"thread_start_us":287719,"threads_started":3,"wal-append.queue_time_us":350732}
I20260709 12:11:13.657202 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:13.614312 17410 raft_consensus.cc:3055] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:13.647274 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:13.649441 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:13.653465 14410 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 10.
I20260709 12:11:13.654896 13727 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:13.639154 13583 catalog_manager.cc:5697] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:11:13.626271 13652 leader_election.cc:336] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Timed out: RequestConsensusVote RPC to 127.12.56.196:46341 timed out after 1.729s (SENT)
I20260709 12:11:13.659636 17430 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.661195 17533 raft_consensus.cc:2804] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:13.679185 17533 raft_consensus.cc:697] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:13.680084 17498 raft_consensus.cc:2749] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:13.628125 17361 raft_consensus.cc:2749] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:13.628134 17476 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:13.668905 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:13.672811 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:13.682818 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:13.675769 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:13.676652 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:13.677249 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:13.689642 13688 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 11.
I20260709 12:11:13.639678 17073 raft_consensus.cc:2749] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:13.706946 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:13.708567 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:13.709249 14412 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:13.709278 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:13.711251 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:13.709975 14416 raft_consensus.cc:1240] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:11:13.713250 13756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2368) took 1183 ms. Trace:
W20260709 12:11:13.678344 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 52104.6us
I20260709 12:11:13.694747 17448 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.721911 13800 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:13.722970 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:13.694825 13762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2387) took 1005 ms. Trace:
I20260709 12:11:13.695657 13754 raft_consensus.cc:1240] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 LEADER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 8. Current term is 9. Ops: []
W20260709 12:11:13.697577 13727 connection.cc:256] RPC call timeout handler was delayed by -1.1094840900000236s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17410000000000003s for a response
I20260709 12:11:13.725683 13727 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:13.724789 13762 rpcz_store.cc:276] 0709 12:11:12.689577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.047096 (+357519us) service_pool.cc:224] Handling call
0709 12:11:13.055004 (+  7908us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:13.101867 (+ 46863us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:13.101898 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:13.122084 (+ 20186us) log.cc:844] Serialized 26 byte log entry
0709 12:11:13.217538 (+ 95454us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:13.217578 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:13.217648 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:13.395158 (+177510us) spinlock_profiling.cc:243] Waited 25.3 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:11:13.694483 (+299325us) raft_consensus.cc:1685] finished
0709 12:11:13.694508 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:13.694762 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5408,"raft.queue_time_us":8528,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":12591,"spinlock_wait_cycles":58075904,"thread_start_us":55786,"threads_started":1,"wal-append.queue_time_us":94043}
I20260709 12:11:13.698076 17522 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.698640 17531 consensus_queue.cc:1048] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:13.700425 13759 raft_consensus.cc:1240] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:11:13.701102 17440 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.701853 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:13.780102 13831 raft_consensus.cc:2410] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:11:13.702131 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:13.780726 13834 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 9.
I20260709 12:11:13.781700 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:13.783077 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:13.783747 13834 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:13.702872 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:13.741634 13800 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:13.691071 17446 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.703670 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:13.704933 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:13.814486 13832 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 9.
I20260709 12:11:13.814683 13835 raft_consensus.cc:2410] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:11:13.713655 13756 rpcz_store.cc:276] 0709 12:11:12.529613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.720628 (+191015us) service_pool.cc:224] Handling call
0709 12:11:12.720922 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:13.659945 (+939023us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:13.713021 (+ 53076us) spinlock_profiling.cc:243] Waited 901 ms on lock 0x7b5400088ed4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:13.713195 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2071806336}
I20260709 12:11:13.694839 14411 raft_consensus.cc:1240] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:13.720445 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.721699 13761 raft_consensus.cc:1275] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:11:13.714376 13652 leader_election.cc:336] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Timed out: RequestConsensusVote RPC to 127.12.56.196:46341 timed out after 1.841s (SENT)
I20260709 12:11:13.817359 13652 leader_election.cc:304] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:11:13.818493 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 104168us
W20260709 12:11:13.819463 13652 leader_election.cc:336] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Timed out: RequestConsensusVote RPC to 127.12.56.196:46341 timed out after 1.907s (SENT)
W20260709 12:11:13.693248 17309 consensus_meta.cc:287] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.534s	user 0.009s	sys 0.001s
I20260709 12:11:13.723913 13833 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 12.
I20260709 12:11:13.740991 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:13.741043 17073 raft_consensus.cc:2749] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:13.662060 17410 raft_consensus.cc:740] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:13.758414 13758 raft_consensus.cc:1240] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:13.740994 17539 raft_consensus.cc:2749] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:13.760924 14408 raft_consensus.cc:2410] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:11:13.765545 14412 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 14.
I20260709 12:11:13.850584 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:13.851084 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:13.852185 14412 raft_consensus.cc:1275] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:13.852617 14407 raft_consensus.cc:3055] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:13.703233 17436 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:13.754287 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:13.853004 14407 raft_consensus.cc:740] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:13.792282 17476 raft_consensus.cc:2749] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:11:13.793084 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 51600us
I20260709 12:11:13.799764 17262 consensus_queue.cc:1059] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:13.827005 17446 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:13.854348 13800 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:13.802639 13583 catalog_manager.cc:5697] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:13.804080 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:13.742461 17448 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:13.855742 13800 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:13.855955 17446 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:13.805934 16951 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:13.856537 17246 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:13.857681 17448 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:13.858377 17448 raft_consensus.cc:2804] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:11:13.858649 17546 log.cc:927] Time spent T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:11:13.859079 17509 raft_consensus.cc:2749] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:13.858817 17448 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:13.861270 17448 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:13.806197 14415 raft_consensus.cc:1275] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:13.808295 17440 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:13.862840 13727 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:13.863485 17440 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:13.778657 17522 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:13.864081 13727 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:13.865237 13727 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
W20260709 12:11:13.866940 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 47499.3us
W20260709 12:11:13.867851 13652 leader_election.cc:336] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Timed out: RequestConsensusVote RPC to 127.12.56.196:46341 timed out after 1.992s (SENT)
I20260709 12:11:13.866122 14416 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 9.
I20260709 12:11:13.825688 13834 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 10.
I20260709 12:11:13.675406 17430 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:13.875666 13828 raft_consensus.cc:1275] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:13.876688 17430 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:13.833592 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:13.836221 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:13.878782 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:13.836355 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:13.842718 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:13.680210 17533 consensus_queue.cc:237] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:13.847671 14380 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:13.807340 17528 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:13.848661 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:13.850343 17233 consensus_queue.cc:1059] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:11:13.799605 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.865566 17522 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:13.874608 17498 raft_consensus.cc:2804] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:13.901700 17498 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:13.901794 17233 raft_consensus.cc:3055] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:13.818825 17191 consensus_queue.cc:260] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:13.868314 13652 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:13.832516 17309 raft_consensus.cc:2749] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:13.832013 17361 raft_consensus.cc:2749] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:13.893630 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 46061us
I20260709 12:11:13.895092 13800 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:13.907361 13800 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:13.875111 14407 consensus_queue.cc:260] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:13.907627 13727 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:13.909701 13800 leader_election.cc:304] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:13.891439 17508 raft_consensus.cc:2804] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:13.899642 17246 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:13.903156 14414 raft_consensus.cc:2410] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:11:13.902282 17498 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:13.914577 13832 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:13.917927 13760 raft_consensus.cc:1240] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:13.918290 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:13.927373 13800 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:13.932222 14410 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 9.
I20260709 12:11:13.902407 17233 raft_consensus.cc:740] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
W20260709 12:11:13.934490 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 259076us
I20260709 12:11:13.963055 13651 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:13.939538 13801 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:13.904623 17505 raft_consensus.cc:2804] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:13.969177 13800 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:13.973822 14412 raft_consensus.cc:1275] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:13.916846 17531 raft_consensus.cc:2749] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:13.916620 17522 raft_consensus.cc:2749] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:13.993505 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:13.972016 17476 raft_consensus.cc:2804] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:14.036360 13688 raft_consensus.cc:1275] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:11:13.960297 14407 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:13.997263 17446 consensus_queue.cc:1048] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:13.997807 16951 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:13.935346 17554 consensus_queue.cc:1059] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 12:11:13.933385 17508 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:14.065304 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:13.975734 17355 raft_consensus.cc:2804] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:13.978222 17246 consensus_queue.cc:1048] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:11:14.002470 17361 consensus_queue.cc:1048] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:14.003849 17438 consensus_queue.cc:1048] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:14.005921 13726 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:14.070509 13685 raft_consensus.cc:1240] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:14.007238 16743 consensus_queue.cc:1059] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:14.010264 13832 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 10.
W20260709 12:11:14.011363 14380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:14.076805 14380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.031654 17473 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:14.051772 17520 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.906534 17137 consensus_queue.cc:1048] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.074s
W20260709 12:11:14.023569 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 54511.5us
W20260709 12:11:14.042294 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.976408 17430 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:14.054379 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:14.056300 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:14.060068 17531 raft_consensus.cc:2749] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:14.063192 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:14.120021 13683 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 8.
I20260709 12:11:14.064188 13759 raft_consensus.cc:1240] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:14.058869 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:14.121106 13756 raft_consensus.cc:2468] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 9.
I20260709 12:11:14.067579 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:14.121904 13682 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:14.071203 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:14.122920 13679 raft_consensus.cc:2468] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 7.
I20260709 12:11:14.072016 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:13.930481 17073 consensus_queue.cc:1059] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.121s
W20260709 12:11:14.075202 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 69367.1us
I20260709 12:11:14.125193 13726 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:11:14.114617 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 49647.2us
W20260709 12:11:13.987825 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 120034us
W20260709 12:11:14.128285 13652 leader_election.cc:336] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Timed out: RequestConsensusVote RPC to 127.12.56.196:46341 timed out after 2.114s (SENT)
I20260709 12:11:13.929719 17314 raft_consensus.cc:2749] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:11:14.094775 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.051491 17310 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.971655 17452 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:14.135210 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:14.136088 13830 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:14.099362 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:14.060104 17440 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.110503 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:14.062390 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:14.060212 17262 raft_consensus.cc:2749] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:14.110003 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:14.113030 17430 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:14.114506 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:14.100255 17370 raft_consensus.cc:2749] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:13.935739 17410 consensus_queue.cc:260] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:14.062631 17476 raft_consensus.cc:697] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 8 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
W20260709 12:11:14.130914 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.068348 17539 raft_consensus.cc:2749] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:14.133832 13652 leader_election.cc:336] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Timed out: RequestConsensusVote RPC to 127.12.56.196:46341 timed out after 2.138s (SENT)
I20260709 12:11:14.070822 17355 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:14.070570 17508 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:14.115445 13800 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:14.065362 16951 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:14.136307 17497 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:14.168021 13684 raft_consensus.cc:1275] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:11:14.169557 13831 raft_consensus.cc:1240] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 12:11:14.170640 17555 log.cc:927] Time spent T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:11:14.099887 17233 consensus_queue.cc:260] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:14.171170 13831 raft_consensus.cc:1240] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 10. Current term is 11. Ops: [8.5-10.6]
I20260709 12:11:14.172016 13680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2260) took 1286 ms. Trace:
I20260709 12:11:14.174506 13833 raft_consensus.cc:1240] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:14.169298 14407 raft_consensus.cc:1275] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:11:14.176429 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.176744 13829 raft_consensus.cc:1240] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:14.177035 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.170984 17503 raft_consensus.cc:3055] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:14.157114 13652 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:14.182530 14408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 825) took 1365 ms. Trace:
I20260709 12:11:14.185259 13833 raft_consensus.cc:1275] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:14.186455 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:14.172740 13831 raft_consensus.cc:1240] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 10. Current term is 11. Ops: [8.7-10.8]
I20260709 12:11:14.183060 14408 rpcz_store.cc:276] 0709 12:11:12.817615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.818021 (+   406us) service_pool.cc:224] Handling call
0709 12:11:14.182275 (+1364254us) spinlock_profiling.cc:243] Waited 929 ms on lock 0x7b54007f0154. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:14.182456 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2135810816}
W20260709 12:11:14.188459 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 73099.6us
I20260709 12:11:14.143348 17430 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:14.188673 13829 raft_consensus.cc:1240] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 12:11:14.212777 14380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.118659 17520 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:14.222724 14409 raft_consensus.cc:1275] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:11:14.223223 14409 pending_rounds.cc:85] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f: Aborting all ops after (but not including) 7
I20260709 12:11:14.223505 14409 pending_rounds.cc:107] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:11:14.223803 14409 raft_consensus.cc:2889] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:14.165225 17355 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:14.226265 13831 raft_consensus.cc:1275] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 12:11:14.226758 13831 pending_rounds.cc:85] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 6
I20260709 12:11:14.227051 13831 pending_rounds.cc:107] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:11:14.172453 13680 rpcz_store.cc:276] 0709 12:11:12.885218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.885351 (+   133us) service_pool.cc:224] Handling call
0709 12:11:12.885706 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:12.936487 (+ 50781us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:12.936536 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:12.937146 (+   610us) log.cc:844] Serialized 26 byte log entry
0709 12:11:13.378606 (+441460us) spinlock_profiling.cc:243] Waited 1.08 ms on lock 0x7b1800156dc0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e82e07 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9fc02 00007fa927b2720b 00007fa927b2cd23 00007fa927b2d0d1 00007fa927f48a0f
0709 12:11:13.819502 (+440896us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:13.819549 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:13.819624 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:14.171711 (+352087us) raft_consensus.cc:1685] finished
0709 12:11:14.171734 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:14.171953 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85350,"raft.queue_time_us":58800,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":5571,"spinlock_wait_cycles":2480384,"thread_start_us":440698,"threads_started":1,"wal-append.queue_time_us":1021097}
I20260709 12:11:14.227366 13831 raft_consensus.cc:2889] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:14.228137 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 294803us
I20260709 12:11:14.228928 13727 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:14.222545 13800 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:14.230345 13727 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:14.225740 14379 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:11:14.237766 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.242336 13830 raft_consensus.cc:2410] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:11:14.187849 17505 raft_consensus.cc:697] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 10 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:14.217639 17473 raft_consensus.cc:2749] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:14.145187 17440 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:14.142057 17310 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:14.189662 17497 raft_consensus.cc:697] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:14.187620 17503 raft_consensus.cc:740] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:14.259958 13833 raft_consensus.cc:1275] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 12:11:14.277932 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:14.260648 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 126857us
W20260709 12:11:14.271639 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 49152.7us
I20260709 12:11:14.287180 13800 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:14.221915 17314 raft_consensus.cc:2749] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:14.260851 14380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.289527 13652 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:14.290941 17361 raft_consensus.cc:2749] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:14.291565 13652 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:14.292752 17314 raft_consensus.cc:2804] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:14.291742 17073 raft_consensus.cc:2749] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:14.231659 17557 raft_consensus.cc:3055] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:14.297118 13800 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:14.293646 17314 raft_consensus.cc:697] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 12 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:14.255003 17528 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:14.284360 17524 log.cc:927] Time spent T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
W20260709 12:11:14.304517 13652 leader_election.cc:336] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Timed out: RequestConsensusVote RPC to 127.12.56.196:46341 timed out after 1.851s (SENT)
I20260709 12:11:14.248848 17552 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:11:14.313166 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 82852.4us
I20260709 12:11:14.254262 17522 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.322896 13688 raft_consensus.cc:1275] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:14.284816 17509 raft_consensus.cc:2764] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:11:14.302685 17452 raft_consensus.cc:697] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:14.313349 17370 raft_consensus.cc:2804] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:11:14.365000 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 57926.7us
I20260709 12:11:14.307843 17394 raft_consensus.cc:2804] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:14.306911 17557 raft_consensus.cc:740] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:14.358815 13652 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:14.394124 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
W20260709 12:11:14.401655 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 104652us
I20260709 12:11:14.300645 17498 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:14.417320 13682 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 10.
I20260709 12:11:14.338160 17473 raft_consensus.cc:2804] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:14.389467 17370 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:14.356223 17568 consensus_queue.cc:1059] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.105s
I20260709 12:11:14.399268 17531 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.363152 17522 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:14.408896 17394 raft_consensus.cc:697] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 10 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
W20260709 12:11:14.455906 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 72857.1us
I20260709 12:11:14.429526 17316 raft_consensus.cc:2749] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:14.460381 13760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 540) took 1063 ms. Trace:
I20260709 12:11:14.463757 13760 rpcz_store.cc:276] 0709 12:11:13.397289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.657055 (+259766us) service_pool.cc:224] Handling call
0709 12:11:13.657329 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:13.931889 (+274560us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:14.460077 (+528188us) spinlock_profiling.cc:243] Waited 260 ms on lock 0x7b54002ee854. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:14.460296 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":598843648}
I20260709 12:11:14.304494 17314 consensus_queue.cc:237] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:14.429733 17473 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:14.441465 17370 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:14.400276 17073 consensus_queue.cc:1048] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 12:11:14.314358 17476 consensus_queue.cc:237] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:14.474344 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 61679.2us
I20260709 12:11:14.420756 17552 consensus_queue.cc:1059] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:11:14.429529 17509 consensus_queue.cc:1048] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 12:11:14.480721 13800 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:14.473479 17564 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:14.490554 17550 log.cc:927] Time spent T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.276s	user 0.000s	sys 0.001s
I20260709 12:11:14.476699 17473 raft_consensus.cc:3060] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:11:14.490644 17559 log.cc:927] Time spent T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.264s	user 0.001s	sys 0.000s
I20260709 12:11:14.503077 13800 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:11:14.481349 17562 log.cc:927] Time spent T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 12:11:14.430156 17497 consensus_queue.cc:237] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:14.459009 17531 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:14.426438 17505 consensus_queue.cc:237] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:14.525449 14380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.416404 17503 consensus_queue.cc:260] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:14.531809 17522 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:14.532351 17589 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.496521 17557 consensus_queue.cc:260] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:14.534848 17580 raft_consensus.cc:3055] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:14.503010 16951 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:14.486150 17567 consensus_queue.cc:1059] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
W20260709 12:11:14.518657 17558 log.cc:927] Time spent T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.270s	user 0.001s	sys 0.000s
I20260709 12:11:14.511170 17520 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:14.552985 17440 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:14.560524 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:11:14.560770 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 82402us
I20260709 12:11:14.561292 14413 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 10.
I20260709 12:11:14.494869 17584 consensus_queue.cc:1048] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 12:11:14.573002 13727 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:14.574844 13727 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:14.571745 13801 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:14.578450 13727 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
W20260709 12:11:14.553954 17579 log.cc:927] Time spent T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:11:14.506727 17583 consensus_queue.cc:1048] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 12:11:14.546375 17310 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:14.480818 17452 consensus_queue.cc:237] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:14.552932 17448 consensus_meta.cc:287] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.691s	user 0.012s	sys 0.000s
I20260709 12:11:14.591908 17503 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:14.551767 17531 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:14.553725 17498 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:14.597061 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 292611us
I20260709 12:11:14.594518 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:11:14.611815 13652 leader_election.cc:336] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Timed out: RequestConsensusVote RPC to 127.12.56.196:46341 timed out after 2.209s (SENT)
I20260709 12:11:14.556155 17580 raft_consensus.cc:740] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:14.572441 17073 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:14.612586 13652 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:11:14.598605 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:14.613741 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.617271 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:14.618439 13829 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:14.601688 17509 raft_consensus.cc:2749] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:14.621923 17498 raft_consensus.cc:2804] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:11:14.619920 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 50774.7us
I20260709 12:11:14.622538 17498 raft_consensus.cc:697] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:14.623546 17498 consensus_queue.cc:237] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:14.572537 17522 consensus_queue.cc:1059] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
W20260709 12:11:14.625597 14380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.602453 17567 consensus_queue.cc:1243] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer b98d2519bb504dc6905ed2ede4571835 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:11:14.627790 17590 raft_consensus.cc:2804] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:14.628340 17590 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:14.628731 17590 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:14.631945 17602 raft_consensus.cc:2749] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:14.516397 17564 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:14.637514 17578 consensus_queue.cc:1048] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:14.639925 17522 raft_consensus.cc:3055] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:14.640381 17522 raft_consensus.cc:740] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:14.642086 17568 consensus_queue.cc:1059] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:14.643206 17073 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:14.644755 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:14.646602 17580 consensus_queue.cc:260] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:14.549664 17394 consensus_queue.cc:237] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:14.649587 17570 log.cc:927] Time spent T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.198s	user 0.001s	sys 0.002s
I20260709 12:11:14.651139 17563 raft_consensus.cc:2749] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:14.652602 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:14.653271 13754 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 8.
W20260709 12:11:14.714591 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 91697.8us
W20260709 12:11:14.715704 17569 log.cc:927] Time spent T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 12:11:14.716780 17262 raft_consensus.cc:3055] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:14.716499 17563 consensus_queue.cc:1048] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:14.717278 17262 raft_consensus.cc:740] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:14.717900 17588 raft_consensus.cc:3055] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:11:14.718324 17588 raft_consensus.cc:740] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:14.719319 17588 consensus_queue.cc:260] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:14.625499 17310 raft_consensus.cc:2749] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:14.568945 17589 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:14.607795 17448 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:14.730195 13835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 2316) took 1026 ms. Trace:
W20260709 12:11:14.732156 17508 consensus_meta.cc:287] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.545s	user 0.008s	sys 0.004s
I20260709 12:11:14.730825 13835 rpcz_store.cc:276] 0709 12:11:13.703295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:14.154152 (+450857us) service_pool.cc:224] Handling call
0709 12:11:14.154588 (+   436us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:11:14.155077 (+   489us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:14.155112 (+    35us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:11:14.155832 (+   720us) log.cc:844] Serialized 78 byte log entry
0709 12:11:14.295560 (+139728us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:14.310643 (+ 15083us) log.cc:844] Serialized 14 byte log entry
0709 12:11:14.436594 (+125951us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:14.436706 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:14.729862 (+293156us) raft_consensus.cc:1685] finished
0709 12:11:14.729894 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:14.730111 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":978,"prepare.queue_time_us":14712,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":55004,"raft.run_cpu_time_us":345,"raft.run_wall_time_us":32785,"thread_start_us":263237,"threads_started":2,"wal-append.queue_time_us":566911}
I20260709 12:11:14.732642 17508 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:14.734411 17544 log.cc:927] Time spent T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.926s	user 0.004s	sys 0.002s
I20260709 12:11:14.617216 17531 raft_consensus.cc:2804] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:14.741293 17531 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:14.736814 17593 consensus_queue.cc:1059] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:11:14.742774 17531 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:14.741487 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 84778.3us
I20260709 12:11:14.803347 14409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 846) took 1479 ms. Trace:
I20260709 12:11:14.803845 14409 rpcz_store.cc:276] 0709 12:11:13.268759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.271245 (+  2486us) service_pool.cc:224] Handling call
0709 12:11:14.186511 (+915266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:14.231577 (+ 45066us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:14.720181 (+488604us) spinlock_profiling.cc:243] Waited 912 ms on lock 0x7b54007f0150. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:14.720346 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2097769728}
I20260709 12:11:14.811074 17568 raft_consensus.cc:3055] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:14.817041 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:14.814335 13836 raft_consensus.cc:1275] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
W20260709 12:11:14.819063 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 207422us
I20260709 12:11:14.819384 13836 pending_rounds.cc:85] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 4
I20260709 12:11:14.819893 13836 pending_rounds.cc:107] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:11:14.820443 13836 raft_consensus.cc:2889] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:14.819948 13652 leader_election.cc:336] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Timed out: RequestConsensusVote RPC to 127.12.56.196:46341 timed out after 2.248s (SENT)
I20260709 12:11:14.816107 17568 raft_consensus.cc:740] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:14.834991 17568 consensus_queue.cc:260] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:14.836529 17568 raft_consensus.cc:3060] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:14.847828 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.851732 13835 raft_consensus.cc:1240] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:14.641335 17522 consensus_queue.cc:260] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:14.855602 13829 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 10.
W20260709 12:11:14.859946 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.870841 13836 raft_consensus.cc:1240] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:14.874794 13836 raft_consensus.cc:1240] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:14.816485 17448 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:14.829376 17580 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:14.886379 13652 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:14.859133 17588 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:14.854508 17533 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:14.870301 17564 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:11:14.889828 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 291251us
I20260709 12:11:14.903472 13833 raft_consensus.cc:1240] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 8 LEADER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:14.718340 17262 consensus_queue.cc:260] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:14.907045 14379 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:11:14.890544 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 387530us
I20260709 12:11:14.909587 13800 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:11:14.894183 17355 consensus_meta.cc:287] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.646s	user 0.006s	sys 0.006s
W20260709 12:11:14.912325 14380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.890774 17522 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:14.888615 17073 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:14.934177 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 47892.6us
I20260709 12:11:14.935017 17597 consensus_queue.cc:1059] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 12:11:14.914881 17476 raft_consensus.cc:2804] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:14.936280 17073 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.937077 17073 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:14.939891 17073 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:14.939659 17590 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:14.941715 17073 consensus_queue.cc:1048] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:11:14.916065 17430 consensus_meta.cc:287] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.688s	user 0.007s	sys 0.006s
I20260709 12:11:14.942016 17262 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:14.907579 17310 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:14.945421 14379 leader_election.cc:400] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 pre-election: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for earlier term 13. Current term is 14.
I20260709 12:11:14.946939 14379 leader_election.cc:403] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:14.935302 13652 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:14.906785 17497 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
W20260709 12:11:14.964850 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 57775.6us
I20260709 12:11:14.969401 14379 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:14.971091 13727 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:14.907070 17533 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:14.943796 17476 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:14.950770 17564 raft_consensus.cc:2749] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:14.983986 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 48758.9us
W20260709 12:11:14.989346 13800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:15.020867 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 51622.3us
I20260709 12:11:14.916954 17355 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:15.022838 13800 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:14.966446 17314 raft_consensus.cc:2749] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:14.975708 17508 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:14.987797 17452 raft_consensus.cc:2804] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:14.949986 17430 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:14.991961 17476 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:15.036203 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 47369.4us
W20260709 12:11:15.036243 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.963192 17497 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:15.047854 13686 raft_consensus.cc:1240] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:15.023244 17552 raft_consensus.cc:2749] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for earlier term 13. Current term is 14.
I20260709 12:11:15.048962 14408 raft_consensus.cc:3055] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:15.056681 14408 raft_consensus.cc:740] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:15.057740 14408 consensus_queue.cc:260] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:15.058842 14408 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:15.023691 17597 raft_consensus.cc:2749] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:15.066594 14408 raft_consensus.cc:1275] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:15.033108 17600 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:15.025866 17598 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:15.083731 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:15.115963 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 93190.5us
W20260709 12:11:15.085103 17609 log.cc:927] Time spent T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 12:11:15.082707 17613 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:15.120229 13800 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:15.039187 17394 raft_consensus.cc:2749] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:15.150811 17610 log.cc:927] Time spent T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.125s	user 0.000s	sys 0.005s
I20260709 12:11:15.148901 17598 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:15.117623 17590 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:15.048588 17530 consensus_queue.cc:1048] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.271s
I20260709 12:11:15.169055 14408 raft_consensus.cc:1275] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:15.162544 13800 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:11:15.162941 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 94174us
W20260709 12:11:15.178689 13652 leader_election.cc:336] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Timed out: RequestConsensusVote RPC to 127.12.56.196:46341 timed out after 2.552s (SENT)
I20260709 12:11:15.179226 13652 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:15.177870 13800 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:15.155814 17600 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:15.189873 17497 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:15.191299 17600 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:15.194875 13800 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:11:15.169498 17370 consensus_meta.cc:287] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.678s	user 0.012s	sys 0.000s
I20260709 12:11:15.092257 17310 consensus_queue.cc:1048] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.092s
I20260709 12:11:15.168526 17314 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.071015 17599 consensus_queue.cc:1059] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.284s
W20260709 12:11:15.210824 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 154783us
W20260709 12:11:15.162671 17505 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.021s	sys 0.001s
I20260709 12:11:15.211586 13652 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:15.192023 17590 raft_consensus.cc:2749] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:15.218200 13800 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:15.220510 14408 raft_consensus.cc:1275] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 12:11:15.231451 14408 pending_rounds.cc:85] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f: Aborting all ops after (but not including) 7
I20260709 12:11:15.231741 14408 pending_rounds.cc:107] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 12:11:15.207448 17614 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:15.233942 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:15.234664 14413 raft_consensus.cc:2468] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 9.
I20260709 12:11:15.232044 14408 raft_consensus.cc:2889] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:15.208462 17600 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:11:15.223925 17603 log.cc:927] Time spent T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.309s	user 0.000s	sys 0.002s
I20260709 12:11:15.236397 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:15.218475 17618 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:15.216979 17370 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:15.242359 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:11:15.226871 17505 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.021s	sys 0.002s
I20260709 12:11:15.228538 17617 raft_consensus.cc:2749] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:15.253734 14408 raft_consensus.cc:3055] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:15.256314 14408 raft_consensus.cc:740] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:15.239024 17594 consensus_queue.cc:1059] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.151s
I20260709 12:11:15.167949 17613 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:15.226224 17314 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:15.248612 17394 raft_consensus.cc:2749] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:15.239677 17614 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:15.270432 17394 raft_consensus.cc:2749] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:11:15.271368 17607 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.271670 17394 raft_consensus.cc:2749] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:15.217218 17452 raft_consensus.cc:697] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:15.271982 17607 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:15.246562 17618 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:15.273620 17611 log.cc:927] Time spent T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 12:11:15.273347 17452 consensus_queue.cc:237] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:15.274786 17612 log.cc:927] Time spent T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
W20260709 12:11:15.279031 17560 log.cc:927] Time spent T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 1.046s	user 0.003s	sys 0.001s
I20260709 12:11:15.280365 14408 consensus_queue.cc:260] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:15.253330 17619 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:15.281903 14408 raft_consensus.cc:3060] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:15.282245 17619 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:15.284019 13686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1551) took 1229 ms. Trace:
I20260709 12:11:15.284438 13686 rpcz_store.cc:276] 0709 12:11:14.054689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:14.113803 (+ 59114us) service_pool.cc:224] Handling call
0709 12:11:14.114136 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:15.052972 (+938836us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:15.283726 (+230754us) spinlock_profiling.cc:243] Waited 933 ms on lock 0x7b540021f554. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:15.283941 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2146917632}
I20260709 12:11:15.285530 17497 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.286063 17497 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:15.290081 14408 raft_consensus.cc:1275] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:15.231434 17564 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.291374 17551 raft_consensus.cc:2749] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:15.294273 17625 consensus_queue.cc:1048] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:11:15.294891 17531 consensus_meta.cc:287] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.552s	user 0.010s	sys 0.000s
I20260709 12:11:15.286350 17620 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:15.319579 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 64284.2us
I20260709 12:11:15.323151 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:15.298256 17355 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:15.297407 17533 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:15.304803 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 93379.6us
I20260709 12:11:15.328147 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:15.335315 14408 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:15.334502 13583 catalog_manager.cc:5697] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:15.338239 13652 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:15.340296 17355 raft_consensus.cc:2749] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:11:15.340940 17608 log.cc:927] Time spent T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.287s	user 0.000s	sys 0.002s
W20260709 12:11:15.341197 17473 consensus_meta.cc:287] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.800s	user 0.012s	sys 0.000s
W20260709 12:11:15.342705 17503 consensus_meta.cc:287] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.726s	user 0.010s	sys 0.000s
W20260709 12:11:15.344435 13832 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54820 (request call id 2383) took 1634 ms (client timeout 2051 ms). Trace:
W20260709 12:11:15.344909 13832 rpcz_store.cc:269] 0709 12:11:13.710492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.827691 (+117199us) service_pool.cc:224] Handling call
0709 12:11:15.344246 (+1516555us) spinlock_profiling.cc:243] Waited 22.7 ms on lock 0x7b54000d9154. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:15.344369 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":52312960}
W20260709 12:11:15.345919 17568 consensus_meta.cc:287] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.509s	user 0.014s	sys 0.001s
I20260709 12:11:15.347175 17593 raft_consensus.cc:3055] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:15.347657 17593 raft_consensus.cc:740] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:15.348601 17593 consensus_queue.cc:260] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:15.350375 17314 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:15.324266 17430 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:15.320422 17531 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:15.354691 13726 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:15.356354 17361 consensus_queue.cc:1059] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:11:15.369566 17633 raft_consensus.cc:2749] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:15.370198 17497 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:15.315634 17564 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:15.358426 17598 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:15.360219 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:15.369613 17614 leader_election.cc:290] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:15.373308 14411 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 14.
I20260709 12:11:15.375723 17564 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:15.372442 17314 consensus_queue.cc:1059] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
W20260709 12:11:15.377483 16951 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 12:11:15.378613 14408 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 10.
I20260709 12:11:15.379501 14407 raft_consensus.cc:1240] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
W20260709 12:11:15.384279 17592 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 12:11:15.389707 17557 raft_consensus.cc:3060] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:15.393184 17410 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:15.393639 17626 consensus_queue.cc:1048] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:11:15.395637 17497 consensus_queue.cc:1048] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:15.368043 17503 consensus_queue.cc:1059] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
W20260709 12:11:15.406526 17588 consensus_meta.cc:287] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.514s	user 0.009s	sys 0.002s
I20260709 12:11:15.415959 17476 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:15.416673 14413 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 5.
I20260709 12:11:15.341702 17473 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:15.324424 17620 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:15.424882 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.431303 14414 raft_consensus.cc:1275] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:11:15.433806 17577 consensus_queue.cc:1048] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:11:15.434932 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.443447 17182 raft_consensus.cc:3055] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:15.444090 17182 raft_consensus.cc:740] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
W20260709 12:11:15.435431 17565 log.cc:927] Time spent T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.902s	user 0.004s	sys 0.000s
I20260709 12:11:15.444965 17182 consensus_queue.cc:260] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:15.446095 17182 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:15.449692 17618 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:15.451282 17619 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:15.463608 17370 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:15.473701 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:15.475579 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:15.476356 14415 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:15.491454 17613 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:15.373112 17593 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:15.498345 13833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 645) took 1499 ms. Trace:
I20260709 12:11:15.498845 13833 rpcz_store.cc:276] 0709 12:11:13.999391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:14.287047 (+287656us) service_pool.cc:224] Handling call
0709 12:11:14.287587 (+   540us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:14.905860 (+618273us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:15.498045 (+592185us) spinlock_profiling.cc:243] Waited 616 ms on lock 0x7b54000b27d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:15.498246 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1415685376}
I20260709 12:11:15.500057 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:15.508291 17620 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:15.421406 17473 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:15.511528 17604 log.cc:927] Time spent T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.673s	user 0.000s	sys 0.002s
I20260709 12:11:15.518923 14409 raft_consensus.cc:1275] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:11:15.514341 14416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41692 (request call id 626) took 1345 ms. Trace:
I20260709 12:11:15.538710 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:15.543205 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:15.548285 13801 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:11:15.513667 17580 consensus_meta.cc:287] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.625s	user 0.010s	sys 0.000s
I20260709 12:11:15.558429 13801 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:15.565495 13754 raft_consensus.cc:1240] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:15.434491 17531 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:15.567329 14411 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:15.521209 17589 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:15.540203 14416 rpcz_store.cc:276] 0709 12:11:14.169471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:14.174068 (+  4597us) service_pool.cc:224] Handling call
0709 12:11:14.174334 (+   266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:14.428515 (+254181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:14.428562 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:14.452052 (+ 23490us) log.cc:844] Serialized 26 byte log entry
0709 12:11:14.601208 (+149156us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:14.601255 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:15.350558 (+749303us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b540068ced4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:15.350611 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:15.510597 (+159986us) spinlock_profiling.cc:243] Waited 8.78 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:11:15.514071 (+  3474us) raft_consensus.cc:1685] finished
0709 12:11:15.514100 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:15.514273 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1351,"raft.queue_time_us":162683,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":8843,"spinlock_wait_cycles":358898816,"thread_start_us":175112,"threads_started":2,"wal-append.queue_time_us":237515}
W20260709 12:11:15.569435 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.516942 17476 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:15.571687 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.572578 13829 raft_consensus.cc:1240] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:15.573000 13832 raft_consensus.cc:1240] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:15.573231 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:15.574309 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:15.574896 17182 raft_consensus.cc:3055] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:15.522894 17552 raft_consensus.cc:3055] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:15.542146 17355 raft_consensus.cc:3055] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:15.582420 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:15.584304 14415 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 11.
I20260709 12:11:15.592628 13756 raft_consensus.cc:2410] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:11:15.597090 13680 raft_consensus.cc:1240] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 6. Current term is 7. Ops: []
W20260709 12:11:15.597806 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:15.601944 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 394831us
I20260709 12:11:15.560701 17583 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:15.608079 13831 raft_consensus.cc:1275] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:15.591511 17182 raft_consensus.cc:740] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:15.612762 17182 consensus_queue.cc:260] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:15.614187 17182 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:15.616255 13686 raft_consensus.cc:1240] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:15.575502 17539 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:15.617179 17539 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:15.617717 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:15.619675 17539 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:15.607589 17582 consensus_queue.cc:1059] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 12:11:15.622154 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:15.622870 13759 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:15.624450 17430 consensus_queue.cc:1048] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:15.592113 17613 consensus_queue.cc:1059] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 12:11:15.630630 17613 raft_consensus.cc:3055] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:15.630999 17613 raft_consensus.cc:740] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:15.631786 17613 consensus_queue.cc:260] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:15.632939 17613 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:15.633548 13763 raft_consensus.cc:1275] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 12:11:15.633986 13763 pending_rounds.cc:85] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting all ops after (but not including) 10
I20260709 12:11:15.634250 13763 pending_rounds.cc:107] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 12:11:15.634473 13763 raft_consensus.cc:2889] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:15.635155 14412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41692 (request call id 625) took 1698 ms. Trace:
I20260709 12:11:15.635542 14412 rpcz_store.cc:276] 0709 12:11:13.937086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:14.007757 (+ 70671us) service_pool.cc:224] Handling call
0709 12:11:14.008327 (+   570us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:14.219336 (+211009us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:14.219379 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:14.219435 (+    56us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:14.219480 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:15.634917 (+1415437us) spinlock_profiling.cc:243] Waited 211 ms on lock 0x7b54006b0154. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:15.634963 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:15.635095 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":484712704}
I20260709 12:11:15.636152 13763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 1716) took 1969 ms. Trace:
I20260709 12:11:15.636505 13763 rpcz_store.cc:276] 0709 12:11:13.666623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.755719 (+ 89096us) service_pool.cc:224] Handling call
0709 12:11:13.756030 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:15.634882 (+1878852us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:15.635893 (+  1011us) spinlock_profiling.cc:243] Waited 1.88 s on lock 0x7b54000a00d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:15.636095 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4317118336}
I20260709 12:11:15.637960 17578 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.638551 17578 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:15.563964 17508 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:15.569621 17522 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:15.647050 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:15.550534 17137 consensus_queue.cc:1048] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 12:11:15.559455 17473 consensus_queue.cc:1048] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 12:11:15.562451 17448 consensus_queue.cc:1048] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 12:11:15.606839 17361 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.657054 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:15.593416 17552 raft_consensus.cc:740] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:15.607996 17580 consensus_queue.cc:1059] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 12:11:15.666337 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:15.717605 13682 raft_consensus.cc:2468] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 9.
I20260709 12:11:15.644701 17583 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:15.657217 17508 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:15.593961 17355 raft_consensus.cc:740] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:15.670372 17607 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:15.605168 17314 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:15.671753 17551 raft_consensus.cc:3055] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:15.671834 17522 raft_consensus.cc:697] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 10 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:15.654320 17563 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:15.722906 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:15.734869 13763 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 9.
W20260709 12:11:15.730377 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.716487 17509 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:15.739995 14379 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:15.720091 17583 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:15.742636 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:15.723595 17191 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:15.752045 13680 raft_consensus.cc:2410] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:11:15.749603 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:15.752200 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:11:15.736562 17498 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.924s	user 0.002s	sys 0.008s
I20260709 12:11:15.758351 14379 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:15.724200 17551 raft_consensus.cc:740] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
W20260709 12:11:15.762748 13803 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.019s	sys 0.033s
W20260709 12:11:15.791522 13803 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.019s	sys 0.033s
I20260709 12:11:15.735857 13759 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 13.
I20260709 12:11:15.659044 13801 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:15.777657 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:15.792836 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:15.717518 17361 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:15.801235 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:15.793551 13686 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 8.
I20260709 12:11:15.794137 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:15.803342 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:15.794799 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:15.804065 13834 raft_consensus.cc:2393] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 10: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:15.804406 13682 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 7.
I20260709 12:11:15.795070 13831 raft_consensus.cc:1240] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:15.795429 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:15.797461 14379 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:11:15.780978 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 409164us
I20260709 12:11:15.798182 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:15.806407 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:15.806742 13830 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:15.801993 13685 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 8.
I20260709 12:11:15.813846 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:15.814244 13685 raft_consensus.cc:1275] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:11:15.805830 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:15.826459 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:15.815320 13688 raft_consensus.cc:1275] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:11:15.815689 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 163407us
I20260709 12:11:15.828974 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:15.829917 13836 raft_consensus.cc:2393] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 11: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:15.830147 13835 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:15.827817 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:15.831378 13831 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 8.
I20260709 12:11:15.752202 17593 raft_consensus.cc:2804] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:15.838878 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:11:15.843228 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 184273us
W20260709 12:11:15.796236 17498 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.967s	user 0.002s	sys 0.009s
I20260709 12:11:15.848037 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:15.844635 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:15.845453 13761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2395) took 1839 ms. Trace:
I20260709 12:11:15.850468 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:15.850524 13831 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 10.
I20260709 12:11:15.852818 13831 raft_consensus.cc:1275] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:11:15.856351 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:15.857597 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:15.732755 17314 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:15.802347 17582 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.850715 13761 rpcz_store.cc:276] 0709 12:11:14.005809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:14.005977 (+   168us) service_pool.cc:224] Handling call
0709 12:11:14.006493 (+   516us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:14.006709 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:14.007041 (+   332us) log.cc:844] Serialized 14 byte log entry
0709 12:11:14.218817 (+211776us) log.cc:844] Serialized 14 byte log entry
0709 12:11:15.381681 (+1162864us) spinlock_profiling.cc:243] Waited 2.04 ms on lock 0x7b180041bcc0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e82e07 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9d455 00007fa927f85060 00007fa927f97716 00007fa927fa8287 00007fa927fa8208
0709 12:11:15.845078 (+463397us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:15.845124 (+    46us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:15.845172 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:15.845237 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:15.845385 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":4050,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":91,"raft.queue_time_us":110667,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":6278,"spinlock_wait_cycles":4686720,"thread_start_us":670963,"threads_started":2,"wal-append.queue_time_us":287725,"wal-append.run_cpu_time_us":3415,"wal-append.run_wall_time_us":1298371}
I20260709 12:11:15.869699 13755 raft_consensus.cc:1240] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:15.858326 13763 raft_consensus.cc:2468] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 9.
I20260709 12:11:15.859627 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:15.861685 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:15.862475 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:15.873692 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:15.862952 13681 raft_consensus.cc:2393] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 10: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:15.856617 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:15.865469 13800 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:15.867069 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:15.802557 17564 raft_consensus.cc:2749] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:15.868470 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.740846 17509 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:15.873723 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:15.877336 13686 raft_consensus.cc:2468] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 10.
I20260709 12:11:15.878077 13800 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:15.834275 17557 raft_consensus.cc:2804] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:15.876202 13836 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 8.
I20260709 12:11:15.895869 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:15.895977 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:15.897128 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:15.897961 13830 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 10.
I20260709 12:11:15.880335 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:15.904119 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:15.907498 13800 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:15.845693 17593 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:15.914630 13685 raft_consensus.cc:2393] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 13: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:15.916256 13685 raft_consensus.cc:1275] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:15.738839 17563 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:15.927096 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:15.930104 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:15.872675 17590 raft_consensus.cc:2804] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:15.934475 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:15.894228 17473 raft_consensus.cc:2749] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:15.846746 17632 consensus_queue.cc:1048] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.079s
I20260709 12:11:15.938908 13835 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 13.
I20260709 12:11:15.940872 13682 raft_consensus.cc:1275] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:15.899709 13575 maintenance_manager.cc:419] P 17d79eae88f84be7a847d0cf544674cd: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033396
I20260709 12:11:15.923285 17476 raft_consensus.cc:2749] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:15.868064 17577 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
W20260709 12:11:15.876395 17606 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.891s	user 0.019s	sys 0.029s
I20260709 12:11:15.942219 14379 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:15.950284 13831 raft_consensus.cc:1240] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:15.953830 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:15.936969 13651 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:15.870343 17503 consensus_queue.cc:1059] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 12:11:15.958985 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:15.901407 17557 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:15.894760 17567 consensus_queue.cc:1048] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 12:11:15.880211 17539 consensus_queue.cc:1048] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.074s
I20260709 12:11:15.813140 17355 consensus_queue.cc:260] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:15.925531 17593 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:15.971762 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.972536 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:15.875972 17600 consensus_queue.cc:1059] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 12:11:15.843070 17522 consensus_queue.cc:237] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:15.978928 14411 raft_consensus.cc:1275] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:11:15.989092 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 52217.1us
I20260709 12:11:16.074769 17598 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:16.143404 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:16.144332 13835 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 10.
I20260709 12:11:15.904060 17551 consensus_queue.cc:260] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:16.101672 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.081267 17430 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.073350 13830 raft_consensus.cc:1240] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:15.949576 17636 raft_consensus.cc:2804] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:15.990419 17530 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.986820 17577 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:16.070811 17639 log.cc:927] Time spent T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 12:11:16.072263 17473 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
W20260709 12:11:15.988077 17606 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.009s	user 0.020s	sys 0.029s
W20260709 12:11:16.067301 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 125162us
I20260709 12:11:16.067013 17508 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:16.066186 17634 log.cc:927] Time spent T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.273s	user 0.000s	sys 0.001s
W20260709 12:11:16.074781 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 237978us
I20260709 12:11:15.895714 17582 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:16.058840 13831 raft_consensus.cc:1240] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:16.086711 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:15.964784 17590 raft_consensus.cc:697] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 11 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:15.960541 17137 consensus_queue.cc:1059] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.105s
I20260709 12:11:16.058089 13686 raft_consensus.cc:1275] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
W20260709 12:11:16.125922 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.171639 17528 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:16.104750 17587 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:16.156914 17598 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:16.122581 17448 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.156263 13651 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:16.121423 17361 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:16.165246 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:16.230020 13756 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 14.
I20260709 12:11:16.169068 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:16.231392 13759 raft_consensus.cc:2410] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:11:16.172283 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:16.131532 17645 raft_consensus.cc:2804] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:11:16.183059 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.232338 13763 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:16.191084 13754 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 10.
I20260709 12:11:16.188623 17314 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:16.191797 13836 raft_consensus.cc:1275] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:11:16.173409 17509 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:16.127303 17557 raft_consensus.cc:3060] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:16.212275 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:16.213106 17182 consensus_meta.cc:287] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.598s	user 0.013s	sys 0.000s
I20260709 12:11:16.225011 17508 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.249992 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:16.201800 17644 raft_consensus.cc:3055] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:16.180560 17430 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:16.195695 17563 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:16.245114 13760 raft_consensus.cc:2393] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 10: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:16.271781 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:16.181041 17530 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:16.246318 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:16.235321 17645 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:16.171255 17355 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:16.185498 17473 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:16.235505 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 79393.5us
I20260709 12:11:16.258571 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:16.232247 17531 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.011s	sys 0.006s
I20260709 12:11:16.239949 17137 consensus_queue.cc:1243] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer b98d2519bb504dc6905ed2ede4571835 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:11:16.286032 13754 raft_consensus.cc:2393] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 10: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:16.285715 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:16.262939 17638 log.cc:927] Time spent T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
I20260709 12:11:16.296442 13756 raft_consensus.cc:1240] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:16.298023 13756 raft_consensus.cc:1275] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:16.227504 17528 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:16.258625 17644 raft_consensus.cc:740] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:16.232461 17587 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:16.244760 17361 consensus_queue.cc:1059] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:11:16.235692 17448 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:16.337078 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:16.337818 14409 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 9.
I20260709 12:11:16.295563 17233 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:16.324707 17582 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:16.327016 17598 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:16.282766 17588 raft_consensus.cc:2804] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:11:16.286538 17531 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.012s	sys 0.006s
I20260709 12:11:16.284058 17645 raft_consensus.cc:3060] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:16.338863 13760 raft_consensus.cc:1240] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:16.309439 13763 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 10.
I20260709 12:11:16.262676 17314 consensus_queue.cc:1048] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 12:11:16.365116 17589 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.371404 17361 raft_consensus.cc:2804] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:11:16.638664 17650 log.cc:927] Time spent T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.378s	user 0.000s	sys 0.001s
I20260709 12:11:16.632297 17430 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:16.496301 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 304377us
W20260709 12:11:16.636950 17613 consensus_meta.cc:287] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 1.004s	user 0.011s	sys 0.003s
I20260709 12:11:16.262297 17508 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:16.633069 17664 log.cc:927] Time spent T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:11:16.367569 17567 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:16.634023 17648 log.cc:927] Time spent T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 12:11:16.442775 14408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41700 (request call id 499) took 1054 ms. Trace:
I20260709 12:11:16.636107 17552 consensus_queue.cc:260] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:16.639067 17448 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:11:16.567952 17656 log.cc:927] Time spent T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
W20260709 12:11:16.593514 17583 consensus_meta.cc:287] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.814s	user 0.010s	sys 0.004s
I20260709 12:11:16.363690 17590 consensus_queue.cc:237] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:16.443921 17640 log.cc:927] Time spent T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.264s	user 0.000s	sys 0.001s
I20260709 12:11:16.364759 17182 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:16.667845 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 303258us
I20260709 12:11:16.820425 13651 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:16.818392 14408 rpcz_store.cc:276] 0709 12:11:15.388804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.389550 (+   746us) service_pool.cc:224] Handling call
0709 12:11:15.389959 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:15.390343 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:15.390406 (+    63us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:15.401769 (+ 11363us) log.cc:844] Serialized 26 byte log entry
0709 12:11:15.844401 (+442632us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:15.844667 (+   266us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:15.844738 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:16.377508 (+532770us) raft_consensus.cc:1685] finished
0709 12:11:16.442519 (+ 65011us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:16.442704 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17573,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":85,"thread_start_us":441980,"threads_started":1,"wal-append.queue_time_us":542496}
W20260709 12:11:16.669405 13679 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.774s	user 0.007s	sys 0.044s
W20260709 12:11:16.822824 13679 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.942s	user 0.008s	sys 0.045s
I20260709 12:11:16.673161 13763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48120 (request call id 1718) took 1059 ms. Trace:
I20260709 12:11:16.689286 13652 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:16.612152 17554 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.577476 17644 consensus_queue.cc:260] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:16.693199 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 364949us
W20260709 12:11:16.829810 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:16.733222 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.823800 13763 rpcz_store.cc:276] 0709 12:11:15.614017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.137321 (+523304us) service_pool.cc:224] Handling call
0709 12:11:16.673093 (+535772us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:16.826251 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 137109us
I20260709 12:11:16.828022 13759 raft_consensus.cc:2410] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 12:11:16.761811 17662 log.cc:927] Time spent T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.179s	user 0.000s	sys 0.000s
I20260709 12:11:16.833678 13652 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:16.831401 17554 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:16.732465 17667 raft_consensus.cc:3055] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:11:16.820567 17191 consensus_meta.cc:287] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 1.037s	user 0.013s	sys 0.002s
I20260709 12:11:16.844003 17633 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:16.746517 17587 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:16.845920 13687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1562) took 1091 ms. Trace:
I20260709 12:11:16.843137 17552 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:16.745872 17607 raft_consensus.cc:3055] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:16.664731 17577 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:16.826560 17583 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:16.792418 17530 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:16.684334 17361 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:16.739966 17665 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.780149 17602 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:16.888836 13687 rpcz_store.cc:276] 0709 12:11:15.754930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.755146 (+   216us) service_pool.cc:224] Handling call
0709 12:11:16.164743 (+409597us) spinlock_profiling.cc:243] Waited 2.09 ms on lock 0x7b5800002798. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924e68b71 00007fa924e68a22 00007fa92dd818d9 00007fa92cedbee0 00007fa92cfa50ab 00007fa92cfa5131 00007fa92cf66fc0 00007fa92cf51929 00007fa92cf513d2 00007fa9264c8bd4
0709 12:11:16.164995 (+   252us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:16.165592 (+   597us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:16.165629 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:16.183132 (+ 17503us) log.cc:844] Serialized 26 byte log entry
0709 12:11:16.532642 (+349510us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:16.532692 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.532787 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:16.836915 (+304128us) raft_consensus.cc:1685] finished
0709 12:11:16.836935 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:16.845826 (+  8891us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19515,"raft.queue_time_us":84932,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":23530,"spinlock_wait_cycles":4803840,"thread_start_us":291728,"threads_started":1,"wal-append.queue_time_us":562645}
W20260709 12:11:16.889601 13684 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.025s	sys 0.068s
W20260709 12:11:16.915172 13684 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.025s	sys 0.069s
I20260709 12:11:16.733609 17663 consensus_queue.cc:1059] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.151s
I20260709 12:11:16.829514 17182 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:16.692227 17589 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:16.888446 17541 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.882825 17667 raft_consensus.cc:740] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:16.926177 14414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41692 (request call id 642) took 1067 ms. Trace:
I20260709 12:11:16.905601 17607 raft_consensus.cc:740] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:16.928234 13829 raft_consensus.cc:1240] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:16.929021 14414 rpcz_store.cc:276] 0709 12:11:15.859059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.859185 (+   126us) service_pool.cc:224] Handling call
0709 12:11:15.900791 (+ 41606us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:15.959273 (+ 58482us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:15.959307 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:15.959907 (+   600us) log.cc:844] Serialized 26 byte log entry
0709 12:11:16.238172 (+278265us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:16.238228 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.238324 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:16.925939 (+687615us) raft_consensus.cc:1685] finished
0709 12:11:16.925960 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:16.926105 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":142051,"raft.queue_time_us":58165,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":9708,"thread_start_us":277851,"threads_started":1,"wal-append.queue_time_us":561200}
I20260709 12:11:16.915040 17361 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:16.918471 17314 raft_consensus.cc:2749] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:16.914038 17577 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:16.944926 13833 raft_consensus.cc:1240] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 10 LEADER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:16.827313 17567 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:16.961088 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.905123 17633 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:16.964531 13680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1557) took 1213 ms. Trace:
I20260709 12:11:16.965025 13680 rpcz_store.cc:276] 0709 12:11:15.752747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.782306 (+ 29559us) service_pool.cc:224] Handling call
0709 12:11:15.782733 (+   427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:15.924534 (+141801us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:15.924583 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:15.924641 (+    58us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:15.924686 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.964249 (+1039563us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b5400040bd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:16.964297 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:16.964461 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":325498112}
W20260709 12:11:16.956389 17593 consensus_meta.cc:287] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.796s	user 0.014s	sys 0.000s
I20260709 12:11:16.918812 17602 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:16.968525 17355 consensus_meta.cc:287] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.678s	user 0.008s	sys 0.006s
I20260709 12:11:16.931138 17541 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:16.991400 13837 raft_consensus.cc:2410] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260709 12:11:16.981154 17233 consensus_meta.cc:287] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.608s	user 0.005s	sys 0.005s
I20260709 12:11:16.994431 14413 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:16.983484 17508 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:16.985409 17567 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:16.995755 17567 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:16.981980 17554 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199)
I20260709 12:11:16.995935 17645 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:16.996218 17567 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:16.998775 17567 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:16.994524 17589 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:16.994450 17233 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:11:17.002611 17557 consensus_meta.cc:287] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.743s	user 0.012s	sys 0.000s
W20260709 12:11:17.003417 17646 log.cc:927] Time spent T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.635s	user 0.003s	sys 0.000s
I20260709 12:11:17.002722 17233 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:17.003186 17557 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:17.004899 13758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2403) took 1441 ms. Trace:
I20260709 12:11:17.005360 13758 rpcz_store.cc:276] 0709 12:11:15.563404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.563549 (+   145us) service_pool.cc:224] Handling call
0709 12:11:15.563857 (+   308us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:15.569205 (+  5348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:15.569254 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:15.586866 (+ 17612us) log.cc:844] Serialized 52 byte log entry
0709 12:11:15.960743 (+373877us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:15.960890 (+   147us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:15.961346 (+   456us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:17.002823 (+1041477us) spinlock_profiling.cc:243] Waited 5.62 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:11:17.004438 (+  1615us) raft_consensus.cc:1685] finished
0709 12:11:17.004481 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:17.004816 (+   335us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":147,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":8791,"spinlock_wait_cycles":12929280,"thread_start_us":329461,"threads_started":1,"wal-append.queue_time_us":663030}
I20260709 12:11:17.008623 14413 raft_consensus.cc:2468] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 8.
I20260709 12:11:16.981918 13830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 2415) took 1081 ms. Trace:
I20260709 12:11:16.926687 17665 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:17.009634 13830 rpcz_store.cc:276] 0709 12:11:15.901678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.161561 (+259883us) service_pool.cc:224] Handling call
0709 12:11:16.161975 (+   414us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:16.323943 (+161968us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b48001bd758. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92ceb6aa1 00007fa92ceadb37 00007fa92cead9ca 00007fa92cfa526f 00007fa92cfa4f37 00007fa92cfb955c 00007fa92cfb9508 00007fa92cfb9488 00007fa92cfb9443 00007fa92cfb86ec 00007fa92bee2a96
0709 12:11:16.372048 (+ 48105us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:16.372081 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:16.466711 (+ 94630us) log.cc:844] Serialized 26 byte log entry
0709 12:11:16.818081 (+351370us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:16.843485 (+ 25404us) log.cc:844] Serialized 14 byte log entry
0709 12:11:16.844447 (+   962us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.844537 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:16.981508 (+136971us) raft_consensus.cc:1685] finished
0709 12:11:16.981627 (+   119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:16.981840 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":26754,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":59,"raft.queue_time_us":98004,"raft.run_cpu_time_us":1916,"raft.run_wall_time_us":78029,"spinlock_wait_cycles":49598208,"thread_start_us":546616,"threads_started":2,"wal-append.queue_time_us":437300}
W20260709 12:11:16.978881 17672 log.cc:927] Time spent T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 12:11:16.979233 17659 log.cc:927] Time spent T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.249s	user 0.000s	sys 0.001s
I20260709 12:11:17.029819 13727 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:16.952212 17577 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:16.974021 17583 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:17.011991 17620 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:17.062260 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 188351us
I20260709 12:11:17.034439 13727 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:17.028213 17508 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.028257 17533 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:17.009475 17593 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:17.085239 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 262758us
I20260709 12:11:17.093370 13651 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:11:17.121038 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 56069.4us
I20260709 12:11:17.033479 17613 consensus_queue.cc:1059] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 12:11:17.125860 13685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2288) took 1191 ms. Trace:
I20260709 12:11:17.126322 13685 rpcz_store.cc:276] 0709 12:11:15.934503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.937528 (+  3025us) service_pool.cc:224] Handling call
0709 12:11:15.937900 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:15.938161 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:15.938198 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:15.938790 (+   592us) log.cc:844] Serialized 26 byte log entry
0709 12:11:16.229117 (+290327us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:16.229155 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.229225 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:17.125619 (+896394us) raft_consensus.cc:1685] finished
0709 12:11:17.125639 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:17.125796 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":289902,"threads_started":1,"wal-append.queue_time_us":688252}
I20260709 12:11:17.081697 17645 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:17.129148 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 94781.5us
I20260709 12:11:17.130293 13727 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:17.094287 17589 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:17.007424 17667 consensus_queue.cc:260] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:17.140983 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:17.094081 17683 raft_consensus.cc:2749] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:17.144982 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:17.146087 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:17.162492 14407 raft_consensus.cc:2393] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 10: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
W20260709 12:11:17.154352 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.079416 17620 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:17.157272 13652 connection.cc:256] RPC call timeout handler was delayed by -1.1583011180002813s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2898s for a response
W20260709 12:11:17.165843 13652 connection.cc:256] RPC call timeout handler was delayed by -1.1416969140000219s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1874s for a response
I20260709 12:11:17.157382 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:17.114677 17653 consensus_queue.cc:1059] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:11:17.093466 17508 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:17.025373 17607 consensus_queue.cc:260] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:17.202996 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:17.144874 17691 raft_consensus.cc:3055] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:11:17.195230 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 65001us
W20260709 12:11:17.197963 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 104667us
I20260709 12:11:17.201702 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:17.102030 17533 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:17.203761 13685 raft_consensus.cc:2468] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 7.
I20260709 12:11:17.196035 14410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41700 (request call id 497) took 1864 ms. Trace:
I20260709 12:11:17.154909 17182 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:17.208042 13727 leader_election.cc:304] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:17.210371 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:11:17.229748 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.235033 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:17.236949 13680 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 11.
I20260709 12:11:17.237418 13684 raft_consensus.cc:2468] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 6.
I20260709 12:11:17.232785 14410 rpcz_store.cc:276] 0709 12:11:15.331699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.331868 (+   169us) service_pool.cc:224] Handling call
0709 12:11:15.339816 (+  7948us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:15.639994 (+300178us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:11:15.641980 (+  1986us) log.cc:844] Serialized 14 byte log entry
0709 12:11:15.900675 (+258695us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:15.900735 (+    60us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:15.900789 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:17.195647 (+1294858us) spinlock_profiling.cc:243] Waited 300 ms on lock 0x7b54006400d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:17.195721 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:17.195924 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17117,"prepare.queue_time_us":767,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":47,"raft.queue_time_us":21121,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":19255,"spinlock_wait_cycles":689788800,"thread_start_us":237464,"threads_started":1,"wal-append.queue_time_us":653610}
I20260709 12:11:17.241921 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:17.242594 13684 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 9.
I20260709 12:11:17.205368 17691 raft_consensus.cc:740] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
W20260709 12:11:17.250438 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.155311 17589 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:17.230592 17557 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:17.207592 17233 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:17.259944 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:11:17.283954 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:17.286230 17678 log.cc:927] Time spent T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.252s	user 0.001s	sys 0.000s
I20260709 12:11:17.241460 17607 raft_consensus.cc:3060] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:17.237205 17698 raft_consensus.cc:2749] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:17.381361 17685 log.cc:927] Time spent T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.176s	user 0.000s	sys 0.000s
W20260709 12:11:17.382839 17684 log.cc:927] Time spent T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.252s	user 0.001s	sys 0.000s
W20260709 12:11:17.384995 17682 log.cc:927] Time spent T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.257s	user 0.000s	sys 0.001s
W20260709 12:11:17.386411 17681 log.cc:927] Time spent T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.261s	user 0.001s	sys 0.000s
I20260709 12:11:17.391569 17593 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:17.254119 17699 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
W20260709 12:11:17.927171 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:17.729869 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 521883us
W20260709 12:11:17.802372 14416 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.007s	sys 0.002s
W20260709 12:11:17.482867 13726 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.766s (SENT) [suppressed 8 similar messages]
W20260709 12:11:17.614281 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:17.935490 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:17.935999 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.553896 14415 raft_consensus.cc:2410] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:11:17.729172 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:17.937249 13684 raft_consensus.cc:2393] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 10: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:17.924968 13756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 1732) took 2006 ms. Trace:
I20260709 12:11:17.938467 13756 rpcz_store.cc:276] 0709 12:11:15.918874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.299917 (+381043us) service_pool.cc:224] Handling call
0709 12:11:16.300291 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:16.300736 (+   445us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:16.300780 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:16.315827 (+ 15047us) log.cc:844] Serialized 26 byte log entry
0709 12:11:16.858304 (+542477us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:16.858368 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.858475 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:17.924599 (+1066124us) raft_consensus.cc:1685] finished
0709 12:11:17.924637 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:17.924862 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":114,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":11453,"thread_start_us":377476,"threads_started":1,"wal-append.queue_time_us":525221}
W20260709 12:11:17.934286 14416 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.016s	sys 0.003s
I20260709 12:11:17.934788 13727 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:17.238435 17578 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:17.960855 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 478007us
I20260709 12:11:17.398209 17665 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:17.346519 17633 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:17.955020 17613 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.801s	user 0.005s	sys 0.017s
I20260709 12:11:17.366079 17688 raft_consensus.cc:2804] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:17.397954 17508 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:17.396087 17602 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:17.399454 17577 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:17.984941 17633 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:17.989398 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 54677.6us
W20260709 12:11:17.983043 17613 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.839s	user 0.006s	sys 0.018s
I20260709 12:11:17.399073 17361 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:18.008634 17508 consensus_queue.cc:1048] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:11:17.731767 17691 consensus_queue.cc:260] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:18.033077 17691 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:18.038075 17600 raft_consensus.cc:3055] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:18.038710 17600 raft_consensus.cc:740] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:18.039786 17600 consensus_queue.cc:260] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:18.043097 13760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 545) took 2434 ms. Trace:
I20260709 12:11:17.981433 17688 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:18.044329 17688 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:18.047079 17675 log.cc:927] Time spent T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 1.099s	user 0.007s	sys 0.007s
I20260709 12:11:18.049124 13682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2292) took 2113 ms. Trace:
I20260709 12:11:18.043581 13760 rpcz_store.cc:276] 0709 12:11:15.608634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.272726 (+664092us) service_pool.cc:224] Handling call
0709 12:11:16.273070 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:16.672815 (+399745us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:18.042822 (+1370007us) spinlock_profiling.cc:243] Waited 48.5 ms on lock 0x7b54000a0354. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:18.043023 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":111566592}
I20260709 12:11:18.049587 13682 rpcz_store.cc:276] 0709 12:11:15.935880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.965591 (+ 29711us) service_pool.cc:224] Handling call
0709 12:11:15.965995 (+   404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:16.248874 (+282879us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:16.248922 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:16.249547 (+   625us) log.cc:844] Serialized 26 byte log entry
0709 12:11:16.687914 (+438367us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:16.687971 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.688069 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:18.046318 (+1358249us) spinlock_profiling.cc:243] Waited 4.44 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:11:18.048788 (+  2470us) raft_consensus.cc:1685] finished
0709 12:11:18.048811 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:18.049047 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7529,"raft.queue_time_us":146088,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":9818,"spinlock_wait_cycles":10214144,"thread_start_us":632705,"threads_started":2,"wal-append.queue_time_us":623313}
I20260709 12:11:18.016638 13727 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:18.054977 13727 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:17.945267 17699 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:17.998895 17578 raft_consensus.cc:2804] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:17.989339 17706 raft_consensus.cc:2749] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:18.015265 17602 raft_consensus.cc:2804] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:18.020903 17613 consensus_queue.cc:1243] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer 96701a74fdee481fb5f54aac841e17dd log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:11:18.027243 17533 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:18.076159 17394 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.080318 17394 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:18.066205 17703 raft_consensus.cc:2804] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:18.083074 17394 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:18.084898 17688 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:18.076666 17710 raft_consensus.cc:2804] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:18.078271 17617 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.078867 17476 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:11:18.074910 17607 consensus_meta.cc:287] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.695s	user 0.012s	sys 0.000s
I20260709 12:11:18.083887 17539 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.084312 17668 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.076344 17589 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:18.079780 13830 raft_consensus.cc:1240] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:18.072751 17602 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:18.095525 13727 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:18.021252 17633 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:18.119122 14414 raft_consensus.cc:2468] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 6.
I20260709 12:11:18.069976 17578 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:18.122563 17668 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:18.117008 17539 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:18.090108 17703 raft_consensus.cc:697] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:18.129840 17588 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:18.130435 17588 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:18.131464 17668 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:18.130865 17703 consensus_queue.cc:237] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:18.131685 17539 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:18.132779 14410 raft_consensus.cc:1275] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:18.136032 17633 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:18.136914 17688 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:18.088838 17617 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:18.140095 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:18.083335 17361 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:18.140336 13727 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:18.140897 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:18.148108 14408 raft_consensus.cc:2410] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:11:18.124449 17602 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:18.143827 17708 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.144366 17613 consensus_queue.cc:1048] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:18.127704 17710 raft_consensus.cc:697] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:18.144526 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:18.144585 17617 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:18.146677 17541 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:16.332136 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:18.152366 14416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 865) took 1010 ms. Trace:
I20260709 12:11:18.093964 17476 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:18.127959 17578 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:18.099346 17620 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:18.155911 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 230252us
I20260709 12:11:18.143006 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:18.146020 13835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 2414) took 2259 ms. Trace:
I20260709 12:11:18.179881 13835 rpcz_store.cc:276] 0709 12:11:15.886683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.145162 (+258479us) service_pool.cc:224] Handling call
0709 12:11:16.161948 (+ 16786us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:16.672530 (+510582us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:16.672621 (+    91us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:16.694023 (+ 21402us) log.cc:844] Serialized 26 byte log entry
0709 12:11:16.937913 (+243890us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:16.937994 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:18.145585 (+1207591us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b5400166cd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:18.145632 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:18.145683 (+    51us) raft_consensus.cc:1685] finished
0709 12:11:18.145697 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:18.145951 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3838,"raft.queue_time_us":3195,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":147,"spinlock_wait_cycles":486510464,"thread_start_us":199380,"threads_started":1,"wal-append.queue_time_us":320511}
I20260709 12:11:18.172144 14416 rpcz_store.cc:276] 0709 12:11:17.142579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.142803 (+   224us) service_pool.cc:224] Handling call
0709 12:11:17.192816 (+ 50013us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:17.201071 (+  8255us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:17.201112 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:17.205190 (+  4078us) log.cc:844] Serialized 26 byte log entry
0709 12:11:17.941384 (+736194us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:18.151167 (+209783us) log.cc:844] Serialized 14 byte log entry
0709 12:11:18.152067 (+   900us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:18.152144 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:18.152183 (+    39us) raft_consensus.cc:1685] finished
0709 12:11:18.152196 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:18.152313 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11724,"raft.queue_time_us":12762,"raft.run_cpu_time_us":319,"raft.run_wall_time_us":31715,"thread_start_us":883158,"threads_started":2,"wal-append.queue_time_us":751494}
I20260709 12:11:18.150451 13583 catalog_manager.cc:5697] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 6 to 12, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 12 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:18.171205 14409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 866) took 1027 ms. Trace:
I20260709 12:11:18.179437 14407 raft_consensus.cc:2468] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 7.
I20260709 12:11:18.174335 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:18.183413 13727 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:18.183527 14410 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 10.
I20260709 12:11:18.167047 17698 raft_consensus.cc:3055] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:18.193481 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:18.165933 17509 raft_consensus.cc:3055] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:18.163367 17473 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:18.193845 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:18.195025 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:18.182191 14409 rpcz_store.cc:276] 0709 12:11:17.143707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.143981 (+   274us) service_pool.cc:224] Handling call
0709 12:11:17.188464 (+ 44483us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:17.200908 (+ 12444us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:17.200943 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:17.204775 (+  3832us) log.cc:844] Serialized 26 byte log entry
0709 12:11:17.699774 (+494999us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:17.699846 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:17.699962 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:18.170935 (+470973us) raft_consensus.cc:1685] finished
0709 12:11:18.170959 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:18.171132 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14976,"raft.queue_time_us":12307,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":28820,"thread_start_us":460789,"threads_started":1,"wal-append.queue_time_us":920580}
I20260709 12:11:18.196713 13830 raft_consensus.cc:1240] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 11 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:11:18.200089 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:18.196600 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:18.201192 13835 raft_consensus.cc:2393] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 6: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:18.160010 17707 raft_consensus.cc:2804] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:18.193475 17698 raft_consensus.cc:740] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:18.184594 17577 consensus_queue.cc:1048] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 12:11:18.212612 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:18.213761 13834 raft_consensus.cc:2410] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:11:18.207358 17473 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:18.199023 17541 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.215173 17541 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:18.215586 17588 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:18.194873 17668 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:18.199586 17539 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.197573 17617 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.210412 17508 raft_consensus.cc:2804] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:18.212355 17476 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:18.214599 13836 raft_consensus.cc:1240] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 10. Current term is 11. Ops: [8.7-10.8]
I20260709 12:11:18.195904 17509 raft_consensus.cc:740] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:18.159400 17708 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:18.228103 17668 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:18.199343 17522 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:18.204655 17707 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:18.232616 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:18.240945 13760 raft_consensus.cc:2410] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:11:18.236158 13762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2402) took 2673 ms. Trace:
I20260709 12:11:18.231146 17688 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.243991 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:18.217808 17541 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:18.246236 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:18.247085 13755 raft_consensus.cc:1240] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:18.243965 17707 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:18.231374 17539 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:18.244239 17620 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:18.252199 17620 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:18.254225 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:18.228581 17698 consensus_queue.cc:260] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:18.235361 17508 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:18.238178 17577 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:18.237819 17706 raft_consensus.cc:2804] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:18.236581 17588 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:18.231259 17613 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:18.255642 17620 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:18.241418 13762 rpcz_store.cc:276] 0709 12:11:15.562800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.562948 (+   148us) service_pool.cc:224] Handling call
0709 12:11:15.563292 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:15.563516 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:15.724270 (+160754us) log.cc:844] Serialized 14 byte log entry
0709 12:11:18.034141 (+2309871us) spinlock_profiling.cc:243] Waited 14.6 ms on lock 0x7b1800407380. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e1ac0a 00007fa92e55a219 00007fa924ea2a40 00007fa924e9d4e4 00007fa924e9d455 00007fa92b9853c7 00007fa927f979a7 00007fa927fa70bf 00007fa927fa7038
0709 12:11:18.034398 (+   257us) log.cc:844] Serialized 14 byte log entry
0709 12:11:18.235419 (+201021us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:18.235485 (+    66us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:18.235536 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:18.235617 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:18.236093 (+   476us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4637,"prepare.queue_time_us":2249099,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":78,"raft.queue_time_us":6114,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":4475,"spinlock_wait_cycles":33688320,"thread_start_us":774696,"threads_started":3,"wal-append.queue_time_us":480243,"wal-append.run_cpu_time_us":9227,"wal-append.run_wall_time_us":1547212}
I20260709 12:11:18.225957 17473 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:18.277016 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:18.280776 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:18.289337 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:18.290189 13755 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 7.
I20260709 12:11:18.236972 17617 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:18.289701 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:18.223917 17710 consensus_queue.cc:237] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:18.304139 13757 raft_consensus.cc:2393] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 7: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:18.298156 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:18.269322 17508 raft_consensus.cc:3060] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:18.257442 17688 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:18.344475 13761 raft_consensus.cc:1275] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:18.307119 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:18.278807 17698 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:18.299222 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:18.350306 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:18.351691 13755 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 10.
I20260709 12:11:18.367209 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:18.312788 17690 log.cc:927] Time spent T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.922s	user 0.000s	sys 0.007s
I20260709 12:11:18.303411 17541 consensus_queue.cc:1059] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 12:11:18.303610 17476 consensus_queue.cc:1048] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 12:11:18.314822 17473 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:11:18.314870 13759 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48120 (request call id 1728) took 2451 ms (client timeout 2169 ms). Trace:
I20260709 12:11:18.312808 17617 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:18.318452 17715 log.cc:927] Time spent T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:11:18.319128 17503 raft_consensus.cc:2804] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:18.320055 17645 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:18.328369 13833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 2397) took 2529 ms. Trace:
W20260709 12:11:18.329619 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.419808 13679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1560) took 2649 ms. Trace:
W20260709 12:11:18.420186 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:18.330317 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 1.12625e+06us
I20260709 12:11:18.422049 13652 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:18.331236 17683 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:18.331665 17708 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:18.331784 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 1.12431e+06us
I20260709 12:11:18.332437 17182 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.333166 17687 raft_consensus.cc:3055] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:18.333691 17697 consensus_queue.cc:1048] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:11:18.335237 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:18.436174 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:18.436800 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:18.437531 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.335717 17694 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:18.336486 17701 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:18.336596 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:18.445813 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.248485 17522 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:18.427765 17644 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:18.286798 17613 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:18.449327 17522 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:18.340188 17528 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:18.341385 17668 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:18.450471 17689 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.383675 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:18.384802 13755 raft_consensus.cc:2410] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
W20260709 12:11:18.389344 13759 rpcz_store.cc:269] 0709 12:11:15.862954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.232057 (+369103us) service_pool.cc:224] Handling call
0709 12:11:18.314625 (+2082568us) spinlock_profiling.cc:243] Waited 577 ms on lock 0x7b540032ee54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:18.314789 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1326045056}
I20260709 12:11:18.390673 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:18.405462 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:18.453471 13754 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 14.
I20260709 12:11:18.417593 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:18.454401 13836 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 7.
I20260709 12:11:18.455317 17310 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.455438 17686 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.455585 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:18.455888 17310 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:18.456418 13836 raft_consensus.cc:2393] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 11: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:18.456081 17686 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:18.457283 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:18.426841 17653 raft_consensus.cc:2749] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:18.366833 17394 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.366513 17670 raft_consensus.cc:2749] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:18.420217 13679 rpcz_store.cc:276] 0709 12:11:15.754155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.754283 (+   128us) service_pool.cc:224] Handling call
0709 12:11:15.800811 (+ 46528us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:15.817174 (+ 16363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:15.817221 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:15.817838 (+   617us) log.cc:844] Serialized 26 byte log entry
0709 12:11:16.823393 (+1005555us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:16.853282 (+ 29889us) log.cc:844] Serialized 14 byte log entry
0709 12:11:18.138597 (+1285315us) spinlock_profiling.cc:243] Waited 8.65 ms on lock 0x7b180039e320. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e82e07 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9d455 00007fa927f85060 00007fa927f97716 00007fa927fa8287 00007fa927fa8208
0709 12:11:18.349638 (+211041us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:18.349797 (+   159us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:18.349859 (+    62us) raft_consensus.cc:1685] finished
0709 12:11:18.403637 (+ 53778us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:18.403856 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25647,"prepare.queue_time_us":29307,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":60,"raft.queue_time_us":235649,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":23065,"spinlock_wait_cycles":19902336,"thread_start_us":1153226,"threads_started":2,"wal-append.queue_time_us":982219,"wal-append.run_cpu_time_us":4816,"wal-append.run_wall_time_us":1396673}
I20260709 12:11:18.458803 13762 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 9.
I20260709 12:11:18.428346 13652 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:11:18.430228 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 246892us
I20260709 12:11:18.451053 17689 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:18.276386 17577 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:18.419778 13833 rpcz_store.cc:276] 0709 12:11:15.798919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.799052 (+   133us) service_pool.cc:224] Handling call
0709 12:11:15.799361 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:16.948430 (+1149069us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:18.328065 (+1379635us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b5400167bd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:18.328284 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2633926528}
I20260709 12:11:18.419596 17617 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:18.428017 17503 raft_consensus.cc:697] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 13 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
W20260709 12:11:18.475435 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 47148.6us
I20260709 12:11:18.484644 17663 raft_consensus.cc:2749] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:18.487535 13681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2290) took 2552 ms. Trace:
W20260709 12:11:18.496579 13586 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45620 (request call id 247) took 35332 ms (client timeout 15000 ms). Trace:
I20260709 12:11:18.499230 17578 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:18.500336 17509 consensus_queue.cc:260] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:18.502242 13583 catalog_manager.cc:5697] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:18.504379 13583 catalog_manager.cc:5697] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:11:18.505911 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:18.510846 14413 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41692 (request call id 638) took 2991 ms (client timeout 1826 ms). Trace:
W20260709 12:11:18.511373 14413 rpcz_store.cc:269] 0709 12:11:15.519340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.542938 (+ 23598us) service_pool.cc:224] Handling call
0709 12:11:18.510446 (+2967508us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b54006df454. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:18.510742 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3335728512}
I20260709 12:11:18.514107 17314 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.514748 17314 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:18.522681 13829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 2405) took 2716 ms. Trace:
I20260709 12:11:18.523295 13829 rpcz_store.cc:276] 0709 12:11:15.806047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.871905 (+ 65858us) service_pool.cc:224] Handling call
0709 12:11:15.906668 (+ 34763us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:16.932372 (+1025704us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:18.522413 (+1590041us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54000da054. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:18.522613 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2348743936}
I20260709 12:11:18.527316 14414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 863) took 1397 ms. Trace:
I20260709 12:11:18.433334 17687 raft_consensus.cc:740] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:18.488106 13681 rpcz_store.cc:276] 0709 12:11:15.935283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.935407 (+   124us) service_pool.cc:224] Handling call
0709 12:11:15.935801 (+   394us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:16.285953 (+350152us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:11:16.813822 (+527869us) log.cc:844] Serialized 14 byte log entry
0709 12:11:17.034222 (+220400us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:17.078374 (+ 44152us) log.cc:844] Serialized 52 byte log entry
0709 12:11:17.078658 (+   284us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:17.081147 (+  2489us) log.cc:844] Serialized 14 byte log entry
0709 12:11:17.094728 (+ 13581us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:17.094844 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:18.311967 (+1217123us) spinlock_profiling.cc:243] Waited 176 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:11:18.316960 (+  4993us) spinlock_profiling.cc:243] Waited 25.1 ms on lock 0x7b18001259e0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e1ac0a 00007fa92e55a219 00007fa92be6158f 00007fa924ea0571 00007fa924ea27c1 00007fa924ea2779 00007fa924ea2709 00007fa924ea26d1 00007fa924ea19cd
0709 12:11:18.487239 (+170279us) raft_consensus.cc:1685] finished
0709 12:11:18.487270 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:18.487447 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1118255,"prepare.queue_time_us":307310,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":83,"raft.queue_time_us":404996,"raft.run_cpu_time_us":576,"raft.run_wall_time_us":35623,"spinlock_wait_cycles":463372416,"thread_start_us":1024050,"threads_started":3,"wal-append.queue_time_us":382048}
I20260709 12:11:18.427700 17541 consensus_queue.cc:1059] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 12:11:18.471331 17528 consensus_queue.cc:1048] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.073s
I20260709 12:11:18.470747 17394 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:18.544984 17653 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:18.545611 17653 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:18.546859 17394 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:18.547500 17394 raft_consensus.cc:3055] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:18.474489 17617 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:18.527773 14414 rpcz_store.cc:276] 0709 12:11:17.131506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.132032 (+   526us) service_pool.cc:224] Handling call
0709 12:11:18.527121 (+1395089us) spinlock_profiling.cc:243] Waited 952 ms on lock 0x7b54005fee54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:18.527254 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2190144896}
I20260709 12:11:18.427726 17355 consensus_queue.cc:1048] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:11:18.553892 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:18.566075 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 98349.6us
I20260709 12:11:18.571820 13680 raft_consensus.cc:1275] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:18.573945 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:18.574865 13685 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:18.578344 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:18.579149 13760 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 6.
I20260709 12:11:18.580309 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:18.439437 17182 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:18.583355 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:18.587786 13727 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:18.590051 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:18.433847 17695 consensus_queue.cc:1048] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.113s
I20260709 12:11:18.432252 17645 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:18.592818 13836 raft_consensus.cc:2393] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 6: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:18.547853 17394 raft_consensus.cc:740] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:18.599509 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:18.600227 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:18.600581 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:18.601351 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:18.600293 13687 raft_consensus.cc:3060] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:18.602082 13682 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:18.605199 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:18.592046 13727 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:18.525230 17707 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:18.530828 17688 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:18.594326 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:18.632704 13759 raft_consensus.cc:2393] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 9: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:18.629915 13754 raft_consensus.cc:2393] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 9: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:18.594309 13583 catalog_manager.cc:5697] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:18.631378 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:18.634802 13686 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 10.
I20260709 12:11:18.553977 17509 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:18.645296 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:18.653210 13685 raft_consensus.cc:2468] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 8.
I20260709 12:11:18.654937 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:18.644367 13583 catalog_manager.cc:5697] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 4 to 8, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 8 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:18.462594 17701 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:18.658404 13760 raft_consensus.cc:1240] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:18.657012 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 285927us
I20260709 12:11:18.665527 13760 raft_consensus.cc:1240] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:18.656873 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:18.459645 17694 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:18.461380 17683 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:18.657871 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:18.657043 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:18.654476 17606 raft_consensus.cc:2804] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:18.665745 13800 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:18.672181 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:18.678164 13828 raft_consensus.cc:1275] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 12:11:18.694434 13828 pending_rounds.cc:85] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 4
I20260709 12:11:18.694782 13828 pending_rounds.cc:107] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 12:11:18.695096 13828 raft_consensus.cc:2889] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:18.685415 13682 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 9.
I20260709 12:11:18.697099 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:18.698029 13682 raft_consensus.cc:2468] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 6.
W20260709 12:11:18.699096 13837 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54820 (request call id 2381) took 4977 ms (client timeout 2175 ms). Trace:
W20260709 12:11:18.699527 13837 rpcz_store.cc:269] 0709 12:11:13.709832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.833239 (+123407us) service_pool.cc:224] Handling call
0709 12:11:18.677578 (+4844339us) spinlock_profiling.cc:243] Waited 3.11 s on lock 0x7b540002e754. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:18.687265 (+  9687us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7160049920}
I20260709 12:11:18.700971 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:18.702109 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:18.670014 13759 raft_consensus.cc:3060] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:18.691982 13687 raft_consensus.cc:2468] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 6.
I20260709 12:11:18.673101 13760 raft_consensus.cc:1240] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:18.709748 13583 catalog_manager.cc:5697] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 6 to 8, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 8 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:18.667001 13683 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 8.
I20260709 12:11:18.712355 13836 raft_consensus.cc:2393] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 11: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:18.701665 13837 raft_consensus.cc:2376] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 10. Re-sending same reply.
I20260709 12:11:18.713744 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:18.717985 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:18.720268 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:18.726819 13759 raft_consensus.cc:2468] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 10.
I20260709 12:11:18.718665 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:18.729707 13836 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 8.
I20260709 12:11:18.730862 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:18.733227 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:18.736274 13832 raft_consensus.cc:2410] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:11:18.744082 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:18.744216 13652 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:18.735044 13800 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:18.694344 17606 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:18.750181 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:11:18.795156 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 51043.4us
W20260709 12:11:18.794085 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.795743 13835 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 10.
I20260709 12:11:18.750852 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:11:18.692258 17636 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.464s	user 0.009s	sys 0.017s
I20260709 12:11:18.715261 17476 raft_consensus.cc:2804] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:18.708498 17613 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:18.659134 17503 consensus_queue.cc:237] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:18.829766 17661 log.cc:927] Time spent T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 1.967s	user 0.006s	sys 0.015s
I20260709 12:11:18.807269 13800 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:18.819378 13583 catalog_manager.cc:5697] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 3 to 7, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 7 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:11:18.819975 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:18.837610 13687 raft_consensus.cc:1813] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Handling vote request from an unknown peer 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:18.838243 13687 raft_consensus.cc:2410] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:11:18.839136 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:18.688921 17719 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:18.840724 17719 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:18.841183 17719 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:18.842021 17668 raft_consensus.cc:2804] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:18.842396 13583 catalog_manager.cc:5697] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 4 to 8, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 8 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:18.844053 13583 catalog_manager.cc:5697] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:18.820631 17665 raft_consensus.cc:2749] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:18.799435 17606 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:18.656217 17687 consensus_queue.cc:260] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:18.845741 13583 catalog_manager.cc:5697] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:18.799445 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:18.826646 17667 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:18.832635 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.831317 13755 raft_consensus.cc:1240] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:18.831931 17702 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:18.833848 17355 consensus_queue.cc:1059] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:11:18.800297 17636 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.594s	user 0.009s	sys 0.018s
I20260709 12:11:18.817130 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:18.869480 13682 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 14.
I20260709 12:11:18.868211 13583 catalog_manager.cc:5697] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:11:18.873716 13583 catalog_manager.cc:5697] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:11:18.883200 17597 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:18.821835 17476 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
W20260709 12:11:18.885203 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 295576us
I20260709 12:11:18.891647 13800 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:18.850160 17687 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:18.497200 13586 rpcz_store.cc:269] 0709 12:10:43.189469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.213937 (+ 24468us) service_pool.cc:224] Handling call
0709 12:11:18.496201 (+35282264us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:04.182693 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:04.183448 (+   755us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:04.183498 (+    50us) write_op.cc:435] Acquired schema lock
0709 12:11:04.183517 (+    19us) tablet.cc:662] Decoding operations
0709 12:11:04.240459 (+ 56942us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:04.240553 (+    94us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:04.240592 (+    39us) tablet.cc:685] Acquiring locks for 19 operations
0709 12:11:04.242339 (+  1747us) tablet.cc:701] Row locks acquired
0709 12:11:04.242389 (+    50us) write_op.cc:260] PREPARE: finished
0709 12:11:04.242571 (+   182us) write_op.cc:270] Start()
0709 12:11:04.242739 (+   168us) write_op.cc:276] Timestamp: P: 1783599064242505 usec, L: 0
0709 12:11:04.242756 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 12:11:04.245713 (+  2957us) log.cc:844] Serialized 7496 byte log entry
0709 12:11:05.165899 (+920186us) op_driver.cc:464] REPLICATION: finished
0709 12:11:06.318463 (+1152564us) spinlock_profiling.cc:243] Waited 22 ms on lock 0x7b1800276340. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924ea03f3 00007fa924ea27c1 00007fa924ea2779 00007fa924ea2709 00007fa924ea26d1 00007fa924ea19cd 0000000000388634 0000000000388479 00007fa924e8383a
0709 12:11:06.318674 (+   211us) write_op.cc:301] APPLY: starting
0709 12:11:06.318786 (+   112us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:06.319222 (+   436us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:06.319264 (+    42us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:06.531220 (+211956us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:06.678208 (+146988us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=19
0709 12:11:06.678257 (+    49us) write_op.cc:312] APPLY: finished
0709 12:11:06.678812 (+   555us) log.cc:844] Serialized 132 byte log entry
0709 12:11:07.040181 (+361369us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:07.059262 (+ 19081us) write_op.cc:454] Released schema lock
0709 12:11:07.072619 (+ 13357us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:07.078146 (+  5527us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:07.078176 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":214827,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":593866,"apply.run_cpu_time_us":28919,"apply.run_wall_time_us":759404,"num_ops":19,"prepare.queue_time_us":100473,"prepare.run_cpu_time_us":21824,"prepare.run_wall_time_us":596340,"raft.queue_time_us":99348,"raft.run_cpu_time_us":47192,"raft.run_wall_time_us":593802,"replication_time_us":922930,"spinlock_wait_cycles":50683776,"thread_start_us":1391599,"threads_started":5,"wal-append.queue_time_us":834932,"wal-append.run_cpu_time_us":14835,"wal-append.run_wall_time_us":2449807}]]}
I20260709 12:11:18.818351 17522 raft_consensus.cc:2804] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:18.842438 17668 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:18.854650 17645 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:18.901160 13800 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:18.903074 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:11:18.903959 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.846918 17701 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:18.846941 17694 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:18.847858 17182 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:18.907810 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.686515 17394 consensus_queue.cc:260] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:18.895500 17476 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:18.932351 17394 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:18.935163 17508 consensus_meta.cc:287] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.593s	user 0.010s	sys 0.001s
I20260709 12:11:18.935693 17508 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:18.867939 17636 raft_consensus.cc:697] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 10 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:18.910606 13682 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 10.
I20260709 12:11:18.848891 17683 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:18.894393 17698 consensus_meta.cc:287] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.528s	user 0.008s	sys 0.002s
I20260709 12:11:18.917586 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:18.907984 17448 raft_consensus.cc:2749] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:18.892947 17355 consensus_queue.cc:1243] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer 96701a74fdee481fb5f54aac841e17dd log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 12:11:18.936172 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.939452 13756 raft_consensus.cc:2468] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 7.
W20260709 12:11:18.911669 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.945320 13837 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 10.
I20260709 12:11:18.889714 17617 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:11:18.948565 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 47528.6us
I20260709 12:11:18.951191 13834 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 10.
W20260709 12:11:18.966362 17723 log.cc:927] Time spent T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260709 12:11:18.967137 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:18.967941 13834 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 11.
I20260709 12:11:18.969233 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:18.910586 17668 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:18.902395 17522 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:18.957419 17727 raft_consensus.cc:2804] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:11:18.961170 17720 log.cc:927] Time spent T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
I20260709 12:11:18.961512 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:18.963846 14409 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3f29dda715314a93a03981264972c4c3"
dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
mode: GRACEFUL
new_leader_uuid: "b98d2519bb504dc6905ed2ede4571835"
 from {username='slave'} at 127.0.0.1:46814
I20260709 12:11:18.892928 17597 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:18.990653 14409 raft_consensus.cc:606] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Received request to transfer leadership to TS b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:18.914660 17689 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:18.872453 17702 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:18.897747 17577 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:19.013918 17508 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:19.015166 17730 log.cc:927] Time spent T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 12:11:19.002935 14380 connection.cc:256] RPC call timeout handler was delayed by -1.3062350529999094s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2106s for a response
I20260709 12:11:19.019130 14414 raft_consensus.cc:1240] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:19.004412 13834 raft_consensus.cc:1240] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 12. Current term is 13. Ops: [10.6-12.7]
W20260709 12:11:19.005102 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 87648.2us
W20260709 12:11:18.988616 17644 consensus_meta.cc:287] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.540s	user 0.008s	sys 0.004s
I20260709 12:11:19.020702 17539 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:19.021070 17632 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.021659 17632 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:19.022154 13828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 2400) took 3219 ms. Trace:
I20260709 12:11:19.022680 13828 rpcz_store.cc:276] 0709 12:11:15.802718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.803066 (+   348us) service_pool.cc:224] Handling call
0709 12:11:18.677746 (+2874680us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:18.695600 (+ 17854us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:19.021954 (+326354us) spinlock_profiling.cc:243] Waited 2.82 s on lock 0x7b540002e750. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:19.022097 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6488797568}
I20260709 12:11:19.023718 17636 consensus_queue.cc:237] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:18.986783 17727 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:19.026953 17727 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:19.025533 17632 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:19.029477 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:19.029973 17686 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:19.030248 14413 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 10.
I20260709 12:11:18.987712 17522 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:19.031903 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:11:19.032635 17655 log.cc:927] Time spent T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 2.340s	user 0.010s	sys 0.012s
I20260709 12:11:19.033569 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:19.012372 17707 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:19.035815 14412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41692 (request call id 639) took 3177 ms. Trace:
I20260709 12:11:19.036222 14412 rpcz_store.cc:276] 0709 12:11:15.858092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.858243 (+   151us) service_pool.cc:224] Handling call
0709 12:11:15.858585 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:15.869834 (+ 11249us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:15.869865 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:15.870305 (+   440us) log.cc:844] Serialized 26 byte log entry
0709 12:11:16.273986 (+403681us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:16.274036 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.274129 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:19.032087 (+2757958us) spinlock_profiling.cc:243] Waited 27.1 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:11:19.035528 (+  3441us) raft_consensus.cc:1685] finished
0709 12:11:19.035550 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:19.035759 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10791,"raft.queue_time_us":14586,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":14564,"spinlock_wait_cycles":62223744,"thread_start_us":403177,"threads_started":1,"wal-append.queue_time_us":737714}
W20260709 12:11:19.035449 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.038272 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:19.038851 14408 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:19.039278 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:19.019233 17680 log.cc:927] Time spent T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 1.621s	user 0.001s	sys 0.005s
I20260709 12:11:19.027101 17600 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:19.037765 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:19.045604 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:19.046311 13682 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 7.
I20260709 12:11:19.043341 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:19.003818 14409 raft_consensus.cc:614] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:19.036396 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:19.046033 14416 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 5.
I20260709 12:11:19.049408 14408 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 10.
W20260709 12:11:19.051717 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:19.025638 17602 consensus_meta.cc:287] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.866s	user 0.004s	sys 0.004s
I20260709 12:11:19.053194 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:19.035450 17551 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:19.054909 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:19.031558 17653 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:19.061030 14412 raft_consensus.cc:2468] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 7.
W20260709 12:11:19.075520 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.062649 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:19.081295 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:19.074939 14411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41700 (request call id 505) took 2744 ms. Trace:
W20260709 12:11:19.088069 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 222725us
I20260709 12:11:19.142287 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:19.144021 13687 raft_consensus.cc:1240] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 13 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:11:19.147302 14411 rpcz_store.cc:276] 0709 12:11:16.330746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.333499 (+  2753us) service_pool.cc:224] Handling call
0709 12:11:16.365153 (+ 31654us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:16.365647 (+   494us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:16.365692 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:16.445757 (+ 80065us) log.cc:844] Serialized 26 byte log entry
0709 12:11:17.013434 (+567677us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:17.013477 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:17.013547 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:19.018697 (+2005150us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:11:19.074026 (+ 55329us) raft_consensus.cc:1685] finished
0709 12:11:19.074053 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:19.074831 (+   778us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":92,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":74489,"spinlock_wait_cycles":392749824,"thread_start_us":488988,"threads_started":1,"wal-append.queue_time_us":854828}
I20260709 12:11:19.148737 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:19.146206 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:11:19.072009 17654 log.cc:927] Time spent T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 2.381s	user 0.016s	sys 0.058s
I20260709 12:11:19.147639 14416 raft_consensus.cc:2468] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 7.
I20260709 12:11:19.076730 17748 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.155263 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:19.155938 13682 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 6.
I20260709 12:11:19.152148 14412 raft_consensus.cc:1275] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:19.158764 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:19.070454 17736 consensus_queue.cc:1048] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.088s
I20260709 12:11:19.058929 17602 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:19.142845 17503 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:19.173928 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:19.174989 13682 raft_consensus.cc:2410] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:11:19.072350 17698 consensus_queue.cc:1048] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.083s
I20260709 12:11:19.071223 17533 consensus_queue.cc:1048] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.085s
I20260709 12:11:19.179175 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:19.153146 17577 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
W20260709 12:11:19.171839 13726 leader_election.cc:336] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.599s (SENT)
I20260709 12:11:19.145169 17741 consensus_queue.cc:1048] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:11:19.192016 13726 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:19.195604 13763 raft_consensus.cc:1240] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:19.193579 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:19.135986 17719 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:19.196514 13682 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 6.
I20260709 12:11:19.200351 13830 raft_consensus.cc:1275] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:11:19.204932 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:19.212368 17668 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:19.197578 17577 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:19.214532 17668 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:19.215420 17597 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:19.215965 17577 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:19.217427 17719 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:19.218852 17706 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:19.199318 17742 raft_consensus.cc:2749] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:19.219455 17706 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:19.222174 17707 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.222801 17707 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:19.225207 17707 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:19.226310 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:19.227192 13682 raft_consensus.cc:2410] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:11:19.228080 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:19.228964 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:19.240084 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:19.242343 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:19.244326 17706 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:19.246158 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:19.247057 13682 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 8.
I20260709 12:11:19.248238 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:19.248337 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:19.249890 13685 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 7.
I20260709 12:11:19.250648 17716 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.251307 17716 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:19.252452 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:19.253849 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:19.254230 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:19.254936 13685 raft_consensus.cc:2393] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 7: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:19.256050 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:19.255820 17716 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:19.259279 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:19.256749 13685 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 11.
I20260709 12:11:19.267086 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:19.267944 17602 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:19.206411 17702 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:19.269300 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:19.270036 13835 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:19.159709 17748 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:19.272976 14415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 867) took 2128 ms. Trace:
I20260709 12:11:19.273483 14415 rpcz_store.cc:276] 0709 12:11:17.144604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.144729 (+   125us) service_pool.cc:224] Handling call
0709 12:11:19.272706 (+2127977us) spinlock_profiling.cc:243] Waited 391 ms on lock 0x7b54006adbd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:19.272909 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":899585792}
I20260709 12:11:19.276177 13686 raft_consensus.cc:3055] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:19.276630 13686 raft_consensus.cc:740] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:19.187160 17503 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:19.291097 13685 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 10.
I20260709 12:11:19.292608 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:19.293759 13685 raft_consensus.cc:2410] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 12:11:19.303159 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.256422 17706 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:19.284984 13686 consensus_queue.cc:260] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:19.307209 13835 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 9.
I20260709 12:11:19.310539 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:19.311936 13685 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 8.
I20260709 12:11:19.313372 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:19.315135 13682 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 11.
I20260709 12:11:19.315438 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:19.201866 17606 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:19.316637 13685 raft_consensus.cc:2410] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:11:19.321660 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:19.323414 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:19.324112 13685 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 14.
I20260709 12:11:19.325064 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:19.325901 17748 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:19.326064 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:19.326346 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:19.326794 13680 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 10.
I20260709 12:11:19.326953 13685 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 10.
I20260709 12:11:19.327908 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:19.330566 13684 raft_consensus.cc:1275] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:11:19.334481 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:11:19.336956 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.309360 17476 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:19.340867 17522 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:19.343533 17476 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:19.344362 13836 raft_consensus.cc:1240] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:19.346953 17727 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:19.348181 13683 raft_consensus.cc:2410] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:11:19.349822 17606 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:19.345485 17503 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:19.343549 17522 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:19.353106 17578 leader_election.cc:290] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:19.352974 17606 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:19.354032 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:19.354241 17606 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:19.354911 13836 raft_consensus.cc:2393] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 8: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:19.357182 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:19.357424 13837 raft_consensus.cc:1240] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:19.358098 13835 raft_consensus.cc:2393] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 15: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
W20260709 12:11:19.358316 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.359083 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:19.359273 17727 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:19.359694 13756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38932 (request call id 554) took 1116 ms. Trace:
I20260709 12:11:19.360464 13756 rpcz_store.cc:276] 0709 12:11:18.243583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.243735 (+   152us) service_pool.cc:224] Handling call
0709 12:11:19.359460 (+1115725us) spinlock_profiling.cc:243] Waited 694 ms on lock 0x7b5400139cd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:19.359611 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1596166400}
I20260709 12:11:19.365247 17606 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:19.366376 13831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 2347) took 1161 ms. Trace:
I20260709 12:11:19.366801 13831 rpcz_store.cc:276] 0709 12:11:18.205388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.205562 (+   174us) service_pool.cc:224] Handling call
0709 12:11:18.206018 (+   456us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:18.310061 (+104043us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:18.310114 (+    53us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:18.310176 (+    62us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:11:18.310224 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:19.366063 (+1055839us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b54001667d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:19.366127 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:19.366308 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":238636800}
I20260709 12:11:19.368291 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:19.368852 13688 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 11.
I20260709 12:11:19.369050 13834 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 10.
I20260709 12:11:19.371076 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:19.371639 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:11:19.372228 13688 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2280) took 3528 ms (client timeout 1992 ms). Trace:
W20260709 12:11:19.372684 13688 rpcz_store.cc:269] 0709 12:11:15.844137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.855851 (+ 11714us) service_pool.cc:224] Handling call
0709 12:11:19.372058 (+3516207us) spinlock_profiling.cc:243] Waited 3.51 s on lock 0x7b54003f0cd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:19.372159 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8075280768}
I20260709 12:11:19.373385 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:19.371721 14415 raft_consensus.cc:2376] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 8. Re-sending same reply.
I20260709 12:11:19.375017 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:11:19.369613 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.358119 13686 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:19.376883 13801 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:19.379901 17668 consensus_queue.cc:1059] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:19.381078 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:19.381953 17394 raft_consensus.cc:3055] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:19.382144 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:19.382416 17394 raft_consensus.cc:740] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:19.382759 13761 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:19.381131 17668 raft_consensus.cc:2804] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:19.383854 17668 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:19.384336 17668 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:19.383298 17394 consensus_queue.cc:260] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:19.386694 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:19.388154 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:19.389941 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:19.390717 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:19.391261 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:19.392458 14407 raft_consensus.cc:1275] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:19.392561 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:19.382011 13755 raft_consensus.cc:2393] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 10: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
W20260709 12:11:19.348611 14379 connection.cc:256] RPC call timeout handler was delayed by -2.0993148860000019s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22480000000000003s for a response
I20260709 12:11:19.395083 17314 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:19.395860 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:19.397006 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:19.397131 17310 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:19.397423 17748 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.402084 17748 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:19.402612 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:19.403728 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:19.404273 13688 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 6.
I20260709 12:11:19.400152 17578 consensus_queue.cc:1059] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:19.445015 17578 consensus_queue.cc:1243] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer 96701a74fdee481fb5f54aac841e17dd log is divergent from this leader: its last log entry 13.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:11:19.445832 17578 raft_consensus.cc:3055] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:19.446595 17578 raft_consensus.cc:740] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:19.447829 17578 consensus_queue.cc:260] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:19.406968 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:19.408826 13757 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:11:19.409286 17748 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:19.449187 13758 raft_consensus.cc:2393] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 9: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:19.450356 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:19.450487 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:19.451840 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:19.452009 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:19.452637 13760 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:19.453229 13758 raft_consensus.cc:2410] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:11:19.409907 17583 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.455385 17583 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:19.458228 17583 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:19.414376 13756 raft_consensus.cc:1240] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:19.459730 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:19.460285 17748 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.460597 13756 raft_consensus.cc:2410] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:11:19.412720 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:19.462752 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:19.463480 13687 raft_consensus.cc:2393] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 7: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:19.418545 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:19.464095 13759 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 10.
I20260709 12:11:19.412012 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:19.465211 14411 raft_consensus.cc:2410] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:11:19.466574 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:19.467774 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:19.409376 17394 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:19.475147 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:19.476807 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:19.423280 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:19.424383 17699 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:19.424863 13801 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:19.425076 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:19.479621 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:19.480715 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:19.481580 13679 raft_consensus.cc:2393] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 10: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:19.483685 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:19.484611 13762 raft_consensus.cc:2410] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:11:19.426417 13761 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 10.
I20260709 12:11:19.426527 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:19.485977 17733 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:19.486783 14414 raft_consensus.cc:2393] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 10: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:11:19.486860 17733 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:19.427241 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:19.489224 17733 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:19.429317 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.429502 13834 raft_consensus.cc:2393] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 9: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:19.429841 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:19.391350 13680 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 8.
I20260709 12:11:19.454553 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:19.438195 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:19.444084 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.406195 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:19.448369 13686 raft_consensus.cc:1275] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 12:11:19.496097 13686 pending_rounds.cc:85] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 9
I20260709 12:11:19.496215 13682 raft_consensus.cc:2468] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 8.
I20260709 12:11:19.496410 13686 pending_rounds.cc:107] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 12:11:19.399585 13727 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:19.409600 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:19.496830 13754 raft_consensus.cc:1240] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:19.416610 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:19.497540 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 98037.1us
I20260709 12:11:19.498082 13755 raft_consensus.cc:2410] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:11:19.498381 13727 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
W20260709 12:11:19.498829 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:19.499377 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.466586 17748 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:19.468986 13726 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:19.422045 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
W20260709 12:11:19.473888 14379 connection.cc:256] RPC call timeout handler was delayed by -1.3551961959999517s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1849s for a response
I20260709 12:11:19.500650 14415 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:19.500712 14379 connection.cc:256] RPC call timeout handler was delayed by -1.3551961959999517s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1849s for a response
W20260709 12:11:19.502673 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 124926us
I20260709 12:11:19.503240 13801 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:19.503311 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:19.504043 14408 raft_consensus.cc:1240] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:11:19.504668 13727 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:19.496781 13686 raft_consensus.cc:2889] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:19.508814 13760 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 15.
I20260709 12:11:19.510176 13726 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:19.511955 13726 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:19.514009 13651 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:19.477494 13687 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 7.
I20260709 12:11:19.436363 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:19.494676 13680 raft_consensus.cc:1275] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 12:11:19.468711 17668 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:19.520642 14415 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 11.
I20260709 12:11:19.498502 13758 raft_consensus.cc:2376] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 10. Re-sending same reply.
W20260709 12:11:19.507836 17665 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 12:11:19.541292 13726 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:19.521730 13757 raft_consensus.cc:606] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:19.523358 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:19.517009 13651 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:19.541888 14409 raft_consensus.cc:1240] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:11:19.541931 13757 raft_consensus.cc:614] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:19.517274 13680 pending_rounds.cc:85] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 6
I20260709 12:11:19.517136 13681 raft_consensus.cc:2468] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 8.
I20260709 12:11:19.543883 13680 pending_rounds.cc:107] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 12:11:19.544198 13680 raft_consensus.cc:2889] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:19.524896 13727 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:19.537961 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:19.545837 14411 raft_consensus.cc:2468] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 7.
I20260709 12:11:19.547555 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:19.551002 13801 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:19.555685 13726 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:19.559870 13726 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:19.571873 17577 consensus_queue.cc:1048] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:19.572640 17670 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.573475 17670 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:19.576640 17670 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:19.588748 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 83881.3us
I20260709 12:11:19.589223 13651 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:19.511703 17606 raft_consensus.cc:2749] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:19.514595 17617 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:19.508291 17727 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:19.592795 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 79144.2us
I20260709 12:11:19.604858 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:19.594369 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:19.542932 17702 raft_consensus.cc:2804] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:11:19.593369 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.540958 17522 raft_consensus.cc:2749] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:19.604084 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:19.538101 17706 raft_consensus.cc:2749] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:19.595220 13727 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:19.621614 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:19.606351 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 55449.9us
I20260709 12:11:19.624920 13801 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:19.537878 17703 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:19.515290 17710 raft_consensus.cc:2804] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:19.716209 14379 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:19.594013 17602 raft_consensus.cc:2804] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:19.609963 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:19.610618 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:19.610548 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:19.591958 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:19.724244 13755 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 10.
I20260709 12:11:19.725615 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:19.606915 14407 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 9.
I20260709 12:11:19.726387 13683 raft_consensus.cc:2376] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 9. Re-sending same reply.
W20260709 12:11:19.702540 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.619107 13726 leader_election.cc:304] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
W20260709 12:11:19.703033 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 79853.7us
I20260709 12:11:19.728161 13652 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:11:19.626222 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:19.557627 17530 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.103s	user 0.012s	sys 0.018s
I20260709 12:11:19.594612 17698 raft_consensus.cc:2804] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:19.723733 13680 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:19.725729 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:19.609691 13800 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:19.718441 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:19.734437 13834 raft_consensus.cc:2393] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 10: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:19.731771 13652 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:19.740311 13757 raft_consensus.cc:1240] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:19.742268 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:19.743745 13755 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 7.
W20260709 12:11:19.747296 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.739889 13652 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:19.749063 13652 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:19.749248 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:19.750216 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 131250us
I20260709 12:11:19.549119 17635 raft_consensus.cc:2804] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:19.593890 17741 consensus_queue.cc:1048] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.134s
I20260709 12:11:19.590739 17695 consensus_queue.cc:1059] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.138s
I20260709 12:11:19.589223 17310 consensus_queue.cc:1059] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.140s
I20260709 12:11:19.700966 17742 raft_consensus.cc:2804] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:19.553038 17719 raft_consensus.cc:2804] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:19.555095 17578 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:19.752961 13652 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:11:19.732218 17530 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.278s	user 0.012s	sys 0.019s
I20260709 12:11:19.589148 17699 raft_consensus.cc:2764] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:11:19.720778 17522 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:19.723320 17602 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:19.608466 17446 raft_consensus.cc:2749] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:19.594133 17707 raft_consensus.cc:2749] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:19.623107 17702 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:19.606109 17691 consensus_queue.cc:1059] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 8.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.144s
I20260709 12:11:19.622633 17683 consensus_queue.cc:1059] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.127s
I20260709 12:11:19.788233 13761 raft_consensus.cc:1240] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:19.603896 17541 consensus_queue.cc:1048] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.129s
I20260709 12:11:19.612406 17733 raft_consensus.cc:2804] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:11:19.792492 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 182915us
I20260709 12:11:19.821041 13800 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:19.741422 17698 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:19.823300 17698 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:19.797977 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.714311 17736 consensus_queue.cc:1059] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 12:11:19.763381 17551 raft_consensus.cc:2804] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:19.825943 17551 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:19.826066 17736 raft_consensus.cc:3055] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:19.775244 17635 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:19.826522 17551 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:19.827018 17635 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:19.769954 17597 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:19.776180 17719 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:19.770844 17704 raft_consensus.cc:2749] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:19.799182 17476 raft_consensus.cc:2804] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:19.830506 17476 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:19.830997 17476 raft_consensus.cc:3060] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:19.771365 17706 raft_consensus.cc:2749] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:19.833211 17728 raft_consensus.cc:2749] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:19.769073 17663 raft_consensus.cc:2804] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:19.834005 17663 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:19.834561 17663 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:19.626605 17727 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:19.839931 17727 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:19.841243 17719 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:19.826673 17736 raft_consensus.cc:740] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:19.845732 17736 consensus_queue.cc:260] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:19.847205 17736 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:19.858791 17748 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:19.796061 17602 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:19.862778 17751 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.014s	sys 0.063s
W20260709 12:11:19.863250 17751 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.014s	sys 0.063s
I20260709 12:11:19.864233 17733 raft_consensus.cc:697] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 10 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
W20260709 12:11:19.864444 17767 log.cc:927] Time spent T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 12:11:19.820796 17742 raft_consensus.cc:697] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:19.866032 17742 consensus_queue.cc:237] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:19.866385 17733 consensus_queue.cc:237] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:19.785356 17533 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.790398 17710 raft_consensus.cc:697] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:19.808442 17702 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:19.784111 17503 consensus_queue.cc:1059] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.088s
I20260709 12:11:19.807379 17613 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.875156 17657 raft_consensus.cc:3055] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:19.878262 17533 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:19.932744 17670 raft_consensus.cc:3055] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:19.932562 17551 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:19.902675 17663 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:19.898321 17657 raft_consensus.cc:740] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:19.898512 17613 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:19.934865 17668 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:19.958436 17663 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:19.959432 17665 raft_consensus.cc:3055] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:19.959972 17665 raft_consensus.cc:740] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:19.960171 17613 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:19.935930 17670 raft_consensus.cc:740] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
W20260709 12:11:19.958487 17768 log.cc:927] Time spent T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:11:19.961812 17670 consensus_queue.cc:260] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:19.963313 17670 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:19.961131 17665 consensus_queue.cc:260] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:19.966148 17710 consensus_queue.cc:237] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:19.967276 17665 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:19.968204 17761 log.cc:927] Time spent T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 12:11:19.969441 17657 consensus_queue.cc:260] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:19.972716 17657 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:19.975466 17597 raft_consensus.cc:2749] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:19.980443 17698 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:20.036037 17703 raft_consensus.cc:2749] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:20.038506 17698 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:20.042137 17702 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:20.081215 17702 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:20.067595 17719 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:20.164320 17719 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:20.277241 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 524083us
W20260709 12:11:20.281450 13681 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.004s	sys 0.003s
W20260709 12:11:20.282152 13681 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.005s	sys 0.004s
I20260709 12:11:20.283851 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:11:20.287431 13682 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.003s	sys 0.004s
I20260709 12:11:20.288048 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:11:20.288808 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.289269 13683 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:20.288048 13682 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.004s	sys 0.004s
I20260709 12:11:20.296233 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:20.297139 13682 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:20.302268 13680 consensus_meta.cc:287] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.568s	user 0.004s	sys 0.013s
W20260709 12:11:20.293850 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.312026 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:19.781909 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:19.777209 13727 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:20.314383 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:11:20.315246 13685 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.807s	user 0.036s	sys 0.040s
I20260709 12:11:19.797115 13754 raft_consensus.cc:2393] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 15: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:19.795899 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:19.795509 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:20.323014 13651 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:20.324968 13758 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 10.
I20260709 12:11:20.326344 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:19.869417 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 244559us
W20260709 12:11:20.336225 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 513409us
W20260709 12:11:20.337937 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:20.338294 13833 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.002s	sys 0.000s
W20260709 12:11:20.338006 13831 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.000s	sys 0.002s
W20260709 12:11:20.346551 14379 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.011s	sys 0.027s
W20260709 12:11:20.349360 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:20.350571 14411 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.006s	sys 0.003s
I20260709 12:11:20.351531 14414 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb"
dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
mode: GRACEFUL
new_leader_uuid: "b98d2519bb504dc6905ed2ede4571835"
 from {username='slave'} at 127.0.0.1:46814
I20260709 12:11:20.353547 17314 raft_consensus.cc:3055] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:19.964895 17602 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:20.361888 13683 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 12.
W20260709 12:11:20.364027 13837 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.000s	sys 0.009s
I20260709 12:11:20.376047 13682 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 15.
W20260709 12:11:20.384012 17635 consensus_meta.cc:287] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.556s	user 0.011s	sys 0.000s
I20260709 12:11:20.390735 13680 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 9.
W20260709 12:11:20.438448 13837 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.001s	sys 0.009s
I20260709 12:11:20.387259 17533 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:20.403069 13685 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.895s	user 0.036s	sys 0.041s
W20260709 12:11:20.399331 17578 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.000s	sys 0.012s
W20260709 12:11:20.412531 17691 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.500s	user 0.006s	sys 0.004s
W20260709 12:11:20.441015 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.420284 17361 raft_consensus.cc:2749] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:20.412320 17617 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.000s	sys 0.001s
W20260709 12:11:20.427940 13687 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.005s	sys 0.007s
W20260709 12:11:20.434527 14379 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.011s	sys 0.027s
W20260709 12:11:20.421514 17577 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.002s	sys 0.013s
W20260709 12:11:20.438776 13831 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.000s	sys 0.002s
W20260709 12:11:20.415299 13688 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.000s	sys 0.011s
W20260709 12:11:20.438520 13833 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.003s	sys 0.001s
W20260709 12:11:20.438445 14411 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.006s	sys 0.003s
W20260709 12:11:20.440717 17578 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.000s	sys 0.014s
W20260709 12:11:20.436430 13755 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.004s	sys 0.004s
W20260709 12:11:20.454095 13687 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.006s	sys 0.007s
I20260709 12:11:20.455641 17779 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:20.456660 17683 raft_consensus.cc:2804] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:20.457419 17683 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:20.457978 13685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2330) took 1096 ms. Trace:
I20260709 12:11:20.464268 13800 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
W20260709 12:11:20.466279 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 143509us
I20260709 12:11:20.467723 13651 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:20.469846 17733 raft_consensus.cc:2749] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:20.470955 17733 raft_consensus.cc:2749] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:20.456715 17779 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:20.475073 17704 raft_consensus.cc:3055] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:20.475639 17704 raft_consensus.cc:740] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:20.476867 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:20.477864 13683 raft_consensus.cc:2376] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 8. Re-sending same reply.
I20260709 12:11:20.479287 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:11:20.478029 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.458076 17683 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:20.449092 13761 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 10.
I20260709 12:11:20.477072 17779 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:11:20.486322 13688 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.000s	sys 0.012s
W20260709 12:11:20.481441 13755 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.005s	sys 0.005s
W20260709 12:11:20.482034 13726 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.008s	sys 0.006s
I20260709 12:11:20.435242 17314 raft_consensus.cc:740] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:20.429955 17597 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:11:20.479826 17577 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.002s	sys 0.014s
W20260709 12:11:20.470233 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 692968us
W20260709 12:11:20.503772 13726 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.753s	user 0.009s	sys 0.007s
I20260709 12:11:20.486606 14414 raft_consensus.cc:606] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Received request to transfer leadership to TS b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:20.473627 17602 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:20.514755 14414 raft_consensus.cc:614] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:20.522230 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:20.525451 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:20.530614 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:20.530992 13683 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 7.
I20260709 12:11:20.532330 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:20.533224 13683 raft_consensus.cc:2376] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 6. Re-sending same reply.
I20260709 12:11:20.532572 17635 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:20.536134 17635 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:20.536875 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 820692us
I20260709 12:11:20.538586 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:20.539863 13756 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:20.540717 17778 consensus_queue.cc:1059] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:20.542286 17597 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:20.545112 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 81017.6us
I20260709 12:11:20.546343 17704 consensus_queue.cc:260] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.3, Last appended by leader: 3, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:20.547753 13800 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:20.547433 17314 consensus_queue.cc:260] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:20.548812 17704 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:20.549152 17314 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:20.550220 17551 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:20.458881 13685 rpcz_store.cc:276] 0709 12:11:19.361895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:19.491637 (+129742us) service_pool.cc:224] Handling call
0709 12:11:19.494407 (+  2770us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:19.494615 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:11:19.507786 (+ 13171us) log.cc:844] Serialized 14 byte log entry
0709 12:11:20.457195 (+949409us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:20.457319 (+   124us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:20.457455 (+   136us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:20.457595 (+   140us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:20.457886 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":124080,"prepare.queue_time_us":13693,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":21759,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":184,"spinlock_wait_cycles":151680,"thread_start_us":932399,"threads_started":1,"wal-append.queue_time_us":856768}
I20260709 12:11:20.554025 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:20.555365 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:20.556641 13685 raft_consensus.cc:1240] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:20.555471 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:11:20.563135 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 92932.1us
I20260709 12:11:20.563040 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:20.573572 13761 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Advancing to term 12
W20260709 12:11:20.578577 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 65642.1us
I20260709 12:11:20.584327 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:20.607230 13682 raft_consensus.cc:2368] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 11. Current term is 12.
I20260709 12:11:20.626912 13762 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 9.
I20260709 12:11:20.618949 17597 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:20.633761 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:20.632655 17779 raft_consensus.cc:2804] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:11:20.640240 17791 log.cc:927] Time spent T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 12:11:20.657362 13756 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 12.
I20260709 12:11:20.651389 17779 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:20.663527 13726 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:20.671623 13684 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 11.
I20260709 12:11:20.677357 13684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1598) took 1062 ms. Trace:
I20260709 12:11:20.666026 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:20.676455 13685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2347) took 1052 ms. Trace:
I20260709 12:11:20.681205 13685 rpcz_store.cc:276] 0709 12:11:19.618192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.564480 (+946288us) service_pool.cc:224] Handling call
0709 12:11:20.637383 (+ 72903us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:20.670532 (+ 33149us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:20.670576 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:20.670640 (+    64us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:20.670698 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:20.670786 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:20.670943 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:20.679335 13684 rpcz_store.cc:276] 0709 12:11:19.611364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.313703 (+702339us) service_pool.cc:224] Handling call
0709 12:11:20.674097 (+360394us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:20.667569 17606 raft_consensus.cc:2804] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:11:20.688970 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 141388us
I20260709 12:11:20.676919 17779 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:20.693715 17799 raft_consensus.cc:2749] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:20.698815 13760 raft_consensus.cc:2393] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 8: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:20.698004 14414 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c"
dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
mode: GRACEFUL
new_leader_uuid: "b98d2519bb504dc6905ed2ede4571835"
 from {username='slave'} at 127.0.0.1:46814
I20260709 12:11:20.706120 13686 raft_consensus.cc:2393] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 7: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:20.706595 13686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2344) took 1089 ms. Trace:
I20260709 12:11:20.708734 14414 raft_consensus.cc:606] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Received request to transfer leadership to TS b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:20.698021 17355 raft_consensus.cc:2749] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:20.716431 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.709530 13686 rpcz_store.cc:276] 0709 12:11:19.617298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.450438 (+833140us) service_pool.cc:224] Handling call
0709 12:11:20.706548 (+256110us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:20.718391 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 178272us
I20260709 12:11:20.719731 14414 raft_consensus.cc:614] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:11:20.727916 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 193534us
I20260709 12:11:20.731642 13800 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:20.735144 13683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2348) took 1113 ms. Trace:
I20260709 12:11:20.739209 17800 raft_consensus.cc:2804] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:20.735752 13683 rpcz_store.cc:276] 0709 12:11:19.618471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.570443 (+951972us) service_pool.cc:224] Handling call
0709 12:11:20.590245 (+ 19802us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:20.590637 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:11:20.591304 (+   667us) log.cc:844] Serialized 14 byte log entry
0709 12:11:20.731196 (+139892us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:20.731260 (+    64us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:20.731297 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:20.731343 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:20.731443 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":172,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":4665,"thread_start_us":134826,"threads_started":1}
I20260709 12:11:20.736891 14379 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:20.738463 13831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 2455) took 1035 ms. Trace:
W20260709 12:11:20.741302 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 112717us
W20260709 12:11:20.742419 17801 log.cc:927] Time spent T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:11:20.742522 17804 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:20.741658 13831 rpcz_store.cc:276] 0709 12:11:19.702669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:19.705887 (+  3218us) service_pool.cc:224] Handling call
0709 12:11:19.706250 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:19.706487 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:20.455966 (+749479us) log.cc:844] Serialized 14 byte log entry
0709 12:11:20.707215 (+251249us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:20.716460 (+  9245us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:20.726329 (+  9869us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:20.730670 (+  4341us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:20.738416 (+  7746us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26173,"prepare.queue_time_us":69872,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":3109,"raft.queue_time_us":1877,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":17054,"thread_start_us":916542,"threads_started":2,"wal-append.queue_time_us":278151}
I20260709 12:11:20.749469 13760 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "b98d2519bb504dc6905ed2ede4571835"
 from {username='slave'} at 127.0.0.1:39554
W20260709 12:11:20.747303 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 210638us
I20260709 12:11:20.750216 13687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2342) took 1384 ms. Trace:
I20260709 12:11:20.753741 13687 rpcz_store.cc:276] 0709 12:11:19.365696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:19.543030 (+177334us) service_pool.cc:224] Handling call
0709 12:11:19.543349 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:19.556776 (+ 13427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:19.556808 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:19.622976 (+ 66168us) log.cc:844] Serialized 26 byte log entry
0709 12:11:20.631954 (+1008978us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:20.682774 (+ 50820us) log.cc:844] Serialized 14 byte log entry
0709 12:11:20.690965 (+  8191us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:20.696052 (+  5087us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:20.749857 (+ 53805us) raft_consensus.cc:1685] finished
0709 12:11:20.749881 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:20.750100 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16156,"prepare.queue_time_us":15729,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":58,"raft.queue_time_us":22206,"raft.run_cpu_time_us":390,"raft.run_wall_time_us":48540,"thread_start_us":718198,"threads_started":1,"wal-append.queue_time_us":922367}
W20260709 12:11:20.756317 17783 log.cc:927] Time spent T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.218s	user 0.000s	sys 0.002s
I20260709 12:11:20.756762 17606 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:20.757334 17606 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:11:20.763990 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 60347.9us
I20260709 12:11:20.763324 13760 raft_consensus.cc:606] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Received request to transfer leadership to TS b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:20.770089 13760 raft_consensus.cc:614] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:11:20.772406 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 135967us
I20260709 12:11:20.773854 13726 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:20.774931 17533 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:20.779024 14411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 877) took 1031 ms. Trace:
I20260709 12:11:20.786044 17583 consensus_queue.cc:1048] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:11:20.787036 17476 consensus_meta.cc:287] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.955s	user 0.009s	sys 0.010s
I20260709 12:11:20.787587 17476 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:20.788578 17657 consensus_meta.cc:287] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.815s	user 0.006s	sys 0.013s
W20260709 12:11:20.776403 17771 log.cc:927] Time spent T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.232s	user 0.000s	sys 0.003s
W20260709 12:11:20.790236 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 60391.8us
I20260709 12:11:20.801949 13727 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:20.802796 13801 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:20.775286 17809 consensus_queue.cc:1048] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 12:11:20.780992 17617 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:20.791821 17804 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:20.778045 17800 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:11:20.806310 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 91076.1us
I20260709 12:11:20.806746 13651 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:20.812129 13761 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 12.
I20260709 12:11:20.780831 14411 rpcz_store.cc:276] 0709 12:11:19.715647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:19.715813 (+   166us) service_pool.cc:224] Handling call
0709 12:11:19.716148 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:19.716497 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:19.716523 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:19.732451 (+ 15928us) log.cc:844] Serialized 26 byte log entry
0709 12:11:20.552855 (+820404us) spinlock_profiling.cc:243] Waited 7.27 ms on lock 0x7b5400555120. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef7090 00007fa927f046b8 00007fa927f8d92b 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c
0709 12:11:20.552954 (+    99us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:20.717424 (+164470us) log.cc:844] Serialized 14 byte log entry
0709 12:11:20.729683 (+ 12259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:20.734930 (+  5247us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:20.734967 (+    37us) raft_consensus.cc:1685] finished
0709 12:11:20.738346 (+  3379us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:20.746819 (+  8473us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6363,"prepare.queue_time_us":212311,"raft.queue_time_us":4237,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":4247,"spinlock_wait_cycles":16721152,"thread_start_us":820488,"threads_started":2,"wal-append.queue_time_us":600175}
I20260709 12:11:20.810472 13829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 2454) took 1108 ms. Trace:
W20260709 12:11:20.824661 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 43957.4us
I20260709 12:11:20.824085 17800 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:20.811980 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:11:20.811693 17476 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:20.829686 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 45314.2us
I20260709 12:11:20.824002 13829 rpcz_store.cc:276] 0709 12:11:19.702387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:19.703602 (+  1215us) service_pool.cc:224] Handling call
0709 12:11:19.731592 (+ 27990us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:19.777624 (+ 46032us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:19.777653 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:19.804199 (+ 26546us) log.cc:844] Serialized 52 byte log entry
0709 12:11:20.341506 (+537307us) spinlock_profiling.cc:243] Waited 480 ms on lock 0x7b18000bc920. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e82e07 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9fc02 00007fa927b2720b 00007fa927b2cd23 00007fa927b2d0d1 00007fa927f48a0f
0709 12:11:20.433550 (+ 92044us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:20.441337 (+  7787us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:20.449955 (+  8618us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:20.809866 (+359911us) raft_consensus.cc:1685] finished
0709 12:11:20.809888 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:20.810270 (+   382us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34604,"raft.queue_time_us":60874,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":25113,"spinlock_wait_cycles":1103919872,"thread_start_us":53239,"threads_started":1,"wal-append.queue_time_us":776169}
I20260709 12:11:20.830217 13800 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:20.830835 17583 raft_consensus.cc:2749] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:20.829807 17657 raft_consensus.cc:2804] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:20.831468 13801 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:20.839887 17476 raft_consensus.cc:2804] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:11:20.840106 17782 log.cc:927] Time spent T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.309s	user 0.002s	sys 0.001s
W20260709 12:11:20.840793 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.842427 17799 raft_consensus.cc:2804] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:20.847400 17355 consensus_queue.cc:1059] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:20.848846 17355 raft_consensus.cc:3055] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:20.849253 17355 raft_consensus.cc:740] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:20.850903 17355 consensus_queue.cc:260] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:20.852615 17355 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:20.856004 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 53141.2us
I20260709 12:11:20.858210 17583 raft_consensus.cc:2749] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:20.862747 13800 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:20.864632 13800 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:20.867352 17597 raft_consensus.cc:3055] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:20.867892 17597 raft_consensus.cc:740] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:20.849416 17799 raft_consensus.cc:697] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:20.869313 17799 consensus_queue.cc:237] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:20.870260 17583 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:20.871233 17583 raft_consensus.cc:2804] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:20.871628 17583 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:20.872116 17583 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:20.873474 13688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2335) took 1510 ms. Trace:
I20260709 12:11:20.874814 17533 raft_consensus.cc:2749] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:20.873937 13688 rpcz_store.cc:276] 0709 12:11:19.363471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:19.495163 (+131692us) service_pool.cc:224] Handling call
0709 12:11:19.543500 (+ 48337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:19.558121 (+ 14621us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:19.558170 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:19.609962 (+ 51792us) log.cc:844] Serialized 26 byte log entry
0709 12:11:20.772218 (+1162256us) spinlock_profiling.cc:243] Waited 17.3 ms on lock 0x7b180047a640. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa927b354bc 00007fa924e8348b 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9fc02 00007fa927b2720b 00007fa927b2cd23 00007fa927b2d0d1
0709 12:11:20.772524 (+   306us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:11:20.772575 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:20.772680 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:20.839196 (+ 66516us) spinlock_profiling.cc:243] Waited 27.8 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:11:20.868301 (+ 29105us) raft_consensus.cc:1685] finished
0709 12:11:20.868327 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:20.873403 (+  5076us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32237,"raft.queue_time_us":14340,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":33694,"spinlock_wait_cycles":103650944,"thread_start_us":724815,"threads_started":1,"wal-append.queue_time_us":751159}
I20260709 12:11:20.837551 17657 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:20.869585 17597 consensus_queue.cc:260] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:20.880642 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:20.805727 17683 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:20.881501 17804 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:20.882162 17476 raft_consensus.cc:697] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 8 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
W20260709 12:11:20.882380 17665 consensus_meta.cc:287] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.914s	user 0.015s	sys 0.005s
I20260709 12:11:20.882187 13727 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:20.890605 17811 raft_consensus.cc:2804] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:11:20.896199 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 61017us
I20260709 12:11:20.901921 17657 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:20.909307 13651 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:20.919277 13800 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:11:20.921123 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 89735.2us
I20260709 12:11:20.907444 17811 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:20.909754 17522 consensus_meta.cc:287] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 1.100s	user 0.008s	sys 0.004s
I20260709 12:11:20.899475 17606 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:20.928421 17665 raft_consensus.cc:2804] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:20.928996 17665 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:20.929378 17665 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:20.930869 13727 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:20.932731 13727 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:20.934032 17698 raft_consensus.cc:2749] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:20.934129 17635 raft_consensus.cc:2749] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:20.935585 17476 consensus_queue.cc:237] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:20.934523 13651 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:20.941325 17704 raft_consensus.cc:2749] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:20.944074 17597 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:20.941500 13651 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:20.946506 14379 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:20.946622 17665 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:20.948467 17670 raft_consensus.cc:2804] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:20.948957 14379 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:20.949136 17670 raft_consensus.cc:697] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 12 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:20.949234 17665 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:20.950212 17812 raft_consensus.cc:2804] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:20.950920 17812 raft_consensus.cc:697] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 10 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:20.952334 17812 consensus_queue.cc:237] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:20.954083 17778 raft_consensus.cc:2749] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:20.955067 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:20.956980 13761 raft_consensus.cc:1275] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:20.958163 13760 raft_consensus.cc:1240] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:20.958213 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:11:20.935758 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 78433.5us
I20260709 12:11:20.925753 17811 raft_consensus.cc:3060] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:20.954123 17633 raft_consensus.cc:2804] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:20.972818 17683 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:20.983150 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.967458 17522 raft_consensus.cc:2749] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:20.994524 13726 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:20.982704 17633 raft_consensus.cc:697] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:21.003007 13727 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
W20260709 12:11:21.009570 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 48327.6us
I20260709 12:11:20.999439 17606 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:21.000353 17683 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:11:21.017376 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:21.018985 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:21.019587 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:21.019802 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:21.018980 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 105124us
I20260709 12:11:21.025812 13726 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:21.028851 13726 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:21.030042 17796 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.030221 14379 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:21.030619 17796 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:21.031103 17804 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:21.031603 14379 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:21.031635 17804 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:21.032433 17804 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:21.032732 14379 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:21.033048 17796 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:21.018456 17799 raft_consensus.cc:2749] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:21.033808 17778 raft_consensus.cc:2804] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:21.033613 17578 raft_consensus.cc:2749] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:21.034011 17809 raft_consensus.cc:2804] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:21.021376 13756 raft_consensus.cc:1275] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:21.022449 13679 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 8.
I20260709 12:11:21.034459 17778 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:21.041965 17665 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:21.047675 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:21.029119 17657 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:21.034482 17799 raft_consensus.cc:2749] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:21.050659 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:11:21.050971 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 67166.6us
I20260709 12:11:21.051332 13761 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:21.053014 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:21.053618 13755 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:21.038542 17809 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:21.063055 13755 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 11.
I20260709 12:11:21.040220 17522 raft_consensus.cc:2804] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:21.044727 17778 raft_consensus.cc:3060] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:21.068076 14379 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:21.050750 17314 consensus_queue.cc:1048] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:11:21.047186 17813 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:21.071478 17813 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:21.065981 17361 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:21.074338 17361 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:21.077286 17816 log.cc:927] Time spent T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:11:21.077437 17361 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:21.044821 17704 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:21.078670 17704 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:21.067005 17809 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:21.036336 17683 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:21.039740 17796 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:21.037204 17779 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:21.012705 17670 consensus_queue.cc:237] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:21.089581 13679 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1606) took 1474 ms (client timeout 1618 ms). Trace:
I20260709 12:11:21.066314 17522 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:21.094655 13679 rpcz_store.cc:269] 0709 12:11:19.615549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.282804 (+667255us) service_pool.cc:224] Handling call
0709 12:11:21.089309 (+806505us) spinlock_profiling.cc:243] Waited 625 ms on lock 0x7b54002c3b54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:21.089484 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1438287616}
I20260709 12:11:21.101235 17597 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:21.101703 17796 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:21.104328 17796 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:21.107195 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:21.084406 17704 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:21.057574 17811 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:21.112792 13651 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:21.035310 17633 consensus_queue.cc:237] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:21.057988 17800 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:21.131022 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:21.139889 17811 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199)
I20260709 12:11:21.140235 17597 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.140586 17617 raft_consensus.cc:2749] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:21.134225 17796 consensus_queue.cc:1048] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 12:11:21.140875 17597 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:21.138211 13800 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:21.142057 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:21.142284 17583 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:21.142872 13762 raft_consensus.cc:2393] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 9: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:21.143108 17597 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:21.143882 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 50430.2us
I20260709 12:11:21.131765 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:21.144433 17583 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:21.144666 13800 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:21.144953 13836 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 10.
I20260709 12:11:21.145164 17583 raft_consensus.cc:2804] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:21.145704 17361 raft_consensus.cc:2804] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:21.146267 17361 raft_consensus.cc:697] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 11 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:21.147439 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:21.147251 17361 consensus_queue.cc:237] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:21.148017 13762 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:21.150362 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:21.152535 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:21.153357 13835 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:21.094080 17665 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:21.130076 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:21.129504 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:21.089761 17813 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:21.130520 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:21.107805 17522 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:21.130178 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:21.131126 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:21.178659 14407 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:21.180399 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:21.184065 14411 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 10.
I20260709 12:11:21.119212 17657 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:21.137969 17779 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:21.123910 17683 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:21.145684 17583 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:21.193866 13836 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:21.192231 13831 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 9.
I20260709 12:11:21.195331 13833 raft_consensus.cc:2393] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 10: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:21.199154 13762 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 8.
I20260709 12:11:21.101392 17817 consensus_queue.cc:1048] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.143s
I20260709 12:11:21.200354 13651 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:21.207285 13761 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 12.
W20260709 12:11:21.211320 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 47751.8us
I20260709 12:11:21.211615 13828 raft_consensus.cc:1240] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:21.212291 13726 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:21.213279 13828 raft_consensus.cc:1275] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:21.213843 13651 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:21.171751 17818 raft_consensus.cc:2749] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:21.197865 17583 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:21.213340 17683 raft_consensus.cc:2804] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:11:21.223568 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 159300us
I20260709 12:11:21.225173 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:21.226825 14414 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:21.203172 17706 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:21.237316 13832 raft_consensus.cc:1240] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:21.243841 17533 raft_consensus.cc:2749] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:21.244445 17577 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.245203 17577 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:21.247524 17577 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:21.248324 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 103785us
I20260709 12:11:21.249687 13761 raft_consensus.cc:1240] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:21.222036 17796 raft_consensus.cc:2804] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:21.257340 14407 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 10.
I20260709 12:11:21.215487 17698 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:21.258517 13836 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 11.
I20260709 12:11:21.260524 14379 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:21.267570 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:21.268946 13836 raft_consensus.cc:2393] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 8: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:21.270129 13830 raft_consensus.cc:1240] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:11:21.270460 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:21.271211 17796 raft_consensus.cc:697] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 12 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:21.272504 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:21.272591 17796 consensus_queue.cc:237] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:21.276146 17698 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:21.250013 17683 raft_consensus.cc:697] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 8 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:21.283509 17683 consensus_queue.cc:237] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:21.231462 17578 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:21.306689 17665 leader_election.cc:290] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:21.280480 17706 raft_consensus.cc:697] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:21.279807 17698 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:21.296932 17578 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:21.337741 17578 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:21.339134 17804 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:21.368152 17804 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:21.368382 17778 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:21.362133 17583 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:21.361994 17706 consensus_queue.cc:237] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:21.354961 17800 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:21.349807 17809 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:21.376976 17809 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:11:21.378167 13583 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53318 (request call id 142) took 21501 ms (client timeout 15000 ms). Trace:
I20260709 12:11:21.378803 17522 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:21.403177 17522 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:21.394084 17583 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:21.412137 17778 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:21.378865 13583 rpcz_store.cc:269] 0709 12:10:59.878513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.892034 (+ 13521us) service_pool.cc:224] Handling call
0709 12:11:21.377760 (+21485726us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:19.238206 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:19.239194 (+   988us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:19.239253 (+    59us) write_op.cc:435] Acquired schema lock
0709 12:11:19.239275 (+    22us) tablet.cc:662] Decoding operations
0709 12:11:19.240919 (+  1644us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:19.241006 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:19.241039 (+    33us) tablet.cc:685] Acquiring locks for 17 operations
0709 12:11:19.264055 (+ 23016us) tablet.cc:701] Row locks acquired
0709 12:11:19.264124 (+    69us) write_op.cc:260] PREPARE: finished
0709 12:11:19.264391 (+   267us) write_op.cc:270] Start()
0709 12:11:19.264646 (+   255us) write_op.cc:276] Timestamp: P: 1783599079264287 usec, L: 0
0709 12:11:19.264683 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 12:11:19.304857 (+ 40174us) log.cc:844] Serialized 6661 byte log entry
0709 12:11:20.372687 (+1067830us) op_driver.cc:464] REPLICATION: finished
0709 12:11:20.745652 (+372965us) write_op.cc:301] APPLY: starting
0709 12:11:20.769151 (+ 23499us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:20.778078 (+  8927us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:20.778251 (+   173us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:20.935528 (+157277us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:20.936052 (+   524us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=34
0709 12:11:20.936100 (+    48us) write_op.cc:312] APPLY: finished
0709 12:11:20.939132 (+  3032us) log.cc:844] Serialized 119 byte log entry
0709 12:11:20.940617 (+  1485us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:20.940865 (+   248us) write_op.cc:454] Released schema lock
0709 12:11:20.940949 (+    84us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:20.943552 (+  2603us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:20.943599 (+    47us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5309493,"reported_tablets":26,"child_traces":[["op",{"apply.queue_time_us":353795,"apply.run_cpu_time_us":11648,"apply.run_wall_time_us":206282,"num_ops":17,"prepare.queue_time_us":188059,"prepare.run_cpu_time_us":87204,"prepare.run_wall_time_us":659009,"raft.queue_time_us":541000,"raft.run_cpu_time_us":18758,"raft.run_wall_time_us":307356,"replication_time_us":1107575,"spinlock_wait_cycles":2944,"thread_start_us":1124355,"threads_started":4,"wal-append.queue_time_us":504690}]]}
I20260709 12:11:21.469995 14414 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 6.
I20260709 12:11:21.474571 13836 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 10.
I20260709 12:11:21.550436 13833 raft_consensus.cc:1240] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 11. Current term is 12. Ops: []
W20260709 12:11:21.558310 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.570894 17706 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.571614 17706 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:21.573585 17706 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:21.598546 13581 catalog_manager.cc:5697] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 4 to 6, leader changed from ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 6 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:11:21.600222 13581 catalog_manager.cc:5697] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 5 to 10. New cstate: current_term: 10 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:21.602861 13581 catalog_manager.cc:5697] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 5 to 8, leader changed from ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 8 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:11:21.604897 13581 catalog_manager.cc:5697] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 12 to 14, leader changed from ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 14 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:11:21.606120 13574 maintenance_manager.cc:643] P 17d79eae88f84be7a847d0cf544674cd: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 5.518s	user 0.163s	sys 0.046s Metrics: {"bytes_written":30228,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":1061,"dirs.run_cpu_time_us":419,"dirs.run_wall_time_us":1276,"drs_written":1,"lbm_read_time_us":306,"lbm_reads_lt_1ms":4,"lbm_write_time_us":5012,"lbm_writes_lt_1ms":33,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":617,"threads_started":1,"update_count":17}
I20260709 12:11:21.607272 13581 catalog_manager.cc:5697] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 4 to 9, leader changed from ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 9 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:11:21.608980 13581 catalog_manager.cc:5697] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 2 to 9, leader changed from ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 9 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:11:21.610724 13581 catalog_manager.cc:5697] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 4 to 8, leader changed from ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 8 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:11:21.612190 13581 catalog_manager.cc:5697] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 9 to 10, leader changed from ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 10 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:11:21.613583 13581 catalog_manager.cc:5697] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 2 to 9, leader changed from ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 9 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:11:21.616123 13581 catalog_manager.cc:5697] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 4 to 14, leader changed from ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 14 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:11:21.618822 13581 catalog_manager.cc:5697] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 3 to 9, leader changed from ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 9 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:11:21.620476 13581 catalog_manager.cc:5697] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 7 to 10, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 10 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:11:21.622155 13581 catalog_manager.cc:5697] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
W20260709 12:11:21.639397 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 395509us
I20260709 12:11:21.640883 13727 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:21.641692 17706 raft_consensus.cc:2804] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:21.641837 13727 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:21.642179 17706 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:21.642554 17706 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:21.642872 17602 raft_consensus.cc:2804] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:21.643293 17602 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:21.643678 17602 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:21.653306 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.661307 13727 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:21.662158 17606 raft_consensus.cc:2804] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:21.653892 17533 consensus_queue.cc:1048] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:21.662719 17606 raft_consensus.cc:697] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:21.657706 17706 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:21.663568 17602 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:21.663651 17606 consensus_queue.cc:237] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:21.665583 17706 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:21.666379 17602 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:21.681617 17796 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.681932 17683 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.682320 17796 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:21.682667 17683 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:21.684484 17796 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:21.685693 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:21.686180 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.686833 17796 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.688278 17683 leader_election.cc:290] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:21.690862 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:21.691521 13755 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 11.
I20260709 12:11:21.689368 17361 consensus_queue.cc:1059] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:21.697667 17361 raft_consensus.cc:3055] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:21.698072 17361 raft_consensus.cc:740] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:21.698923 17361 consensus_queue.cc:260] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:21.700240 17361 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:21.703477 13651 leader_election.cc:304] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:21.705260 17657 raft_consensus.cc:2804] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:21.705767 17657 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:21.706172 17657 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:21.687436 17796 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:21.689879 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:21.719605 17796 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:21.721827 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 461423us
I20260709 12:11:21.722666 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:21.722772 14379 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:21.723366 13756 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 5.
I20260709 12:11:21.724465 14379 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:21.726004 17804 raft_consensus.cc:2749] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:21.726884 17804 raft_consensus.cc:2749] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:21.728955 17809 raft_consensus.cc:2749] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:11:21.722721 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:21.731382 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.731381 14379 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:21.736676 17809 raft_consensus.cc:2804] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:21.737169 17809 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:21.737561 17809 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:21.740468 13836 raft_consensus.cc:1240] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:21.741950 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:21.742676 13830 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 15.
I20260709 12:11:21.743585 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:21.744851 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:21.745460 13837 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 9.
I20260709 12:11:21.733923 13831 raft_consensus.cc:1240] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:21.752211 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:21.755295 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:21.755965 13829 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:21.735304 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 523114us
I20260709 12:11:21.786173 13651 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:21.756466 14379 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:11:21.831730 13835 consensus_meta.cc:287] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.678s	user 0.015s	sys 0.000s
I20260709 12:11:21.832152 13835 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 10.
I20260709 12:11:21.832875 13828 raft_consensus.cc:1240] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 8. Current term is 10. Ops: []
I20260709 12:11:21.840698 13831 raft_consensus.cc:1240] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:21.843169 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:21.844048 13830 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:21.844779 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 88392.4us
I20260709 12:11:21.851387 14379 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:21.856041 13726 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:21.829268 17809 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:21.888969 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.890024 13727 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:21.891436 17602 raft_consensus.cc:2804] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:11:21.891633 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:21.892184 17602 raft_consensus.cc:697] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:21.892398 14411 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 14.
I20260709 12:11:21.895313 14407 raft_consensus.cc:1240] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:21.893599 17602 consensus_queue.cc:237] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:21.897881 13800 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:21.898866 13727 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:21.899552 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:21.900142 14414 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:21.900627 17698 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:21.901049 17698 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:21.901410 17698 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:21.903842 17827 consensus_queue.cc:1059] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:21.905664 14407 raft_consensus.cc:1240] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:21.905992 17533 raft_consensus.cc:3055] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:21.906559 17817 consensus_queue.cc:1048] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:21.906574 17533 raft_consensus.cc:740] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:21.908031 17533 consensus_queue.cc:260] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:21.909871 14414 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 11.
I20260709 12:11:21.854223 17778 raft_consensus.cc:2804] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:11:21.875983 17843 log.cc:927] Time spent T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.195s	user 0.002s	sys 0.000s
I20260709 12:11:21.917001 13727 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:21.881345 17606 raft_consensus.cc:2804] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:11:21.945044 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.908056 17817 consensus_queue.cc:1048] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 12:11:21.910629 17533 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:22.062851 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 276850us
I20260709 12:11:21.917009 17683 raft_consensus.cc:2804] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:21.915320 17778 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:21.916440 17804 raft_consensus.cc:2804] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:11:22.122620 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 269727us
I20260709 12:11:21.923228 17578 raft_consensus.cc:2804] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:22.058290 17606 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:22.150298 17606 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:11:22.150542 17847 log.cc:927] Time spent T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 12:11:22.162196 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 262997us
I20260709 12:11:21.916824 17706 consensus_queue.cc:1059] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.218s
I20260709 12:11:22.123920 17683 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:22.283037 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:22.290817 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:22.292953 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:22.293955 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:22.294301 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:22.295264 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:22.295481 13836 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 9.
I20260709 12:11:22.296459 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:22.296957 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:22.297500 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:11:22.289951 17361 consensus_meta.cc:287] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.589s	user 0.012s	sys 0.001s
I20260709 12:11:22.298770 17361 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:22.276065 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:22.138878 17804 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:22.307327 17848 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:22.307785 13824 tablet_service.cc:1558] Processing DeleteTablet for tablet a34b21ec197b4241a780a8ae562e4602 with delete_type TABLET_DATA_TOMBSTONED (TS 96701a74fdee481fb5f54aac841e17dd not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:54808
W20260709 12:11:22.278039 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:22.056856 17657 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:22.294086 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:22.298883 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:22.143916 17778 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:22.308717 13575 maintenance_manager.cc:419] P 17d79eae88f84be7a847d0cf544674cd: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 8324 bytes on disk
I20260709 12:11:22.279220 13726 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:22.326951 13800 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:22.314378 13836 raft_consensus.cc:2393] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 15: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:22.308169 17848 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:22.309353 17683 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:22.319262 13828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 661) took 1101 ms. Trace:
W20260709 12:11:22.270694 13829 consensus_meta.cc:287] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.514s	user 0.010s	sys 0.003s
I20260709 12:11:22.337847 13829 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 11.
I20260709 12:11:22.337693 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:22.339066 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:22.339514 13829 raft_consensus.cc:2376] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 10. Re-sending same reply.
I20260709 12:11:22.340137 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:11:22.322940 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 451566us
I20260709 12:11:22.324347 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:22.307313 17804 raft_consensus.cc:3060] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:22.312502 13834 raft_consensus.cc:2393] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 8: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:22.336529 13828 rpcz_store.cc:276] 0709 12:11:21.218073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.226835 (+  8762us) service_pool.cc:224] Handling call
0709 12:11:21.832621 (+605786us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:21.833364 (+   743us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:22.318969 (+485605us) spinlock_profiling.cc:243] Waited 594 ms on lock 0x7b540020dd50. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:22.319178 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1367003520}
W20260709 12:11:22.363541 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:22.368060 13574 maintenance_manager.cc:643] P 17d79eae88f84be7a847d0cf544674cd: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.021s	user 0.001s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":19528,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":3}
I20260709 12:11:22.380584 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:22.383041 17848 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:22.384299 17809 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 9 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:22.385016 17809 consensus_queue.cc:1059] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:11:22.394186 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 82279.8us
I20260709 12:11:22.395792 13800 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:22.396741 17817 raft_consensus.cc:2804] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:22.320143 17361 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:22.373514 17602 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:22.403364 17602 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:22.411005 17657 leader_election.cc:290] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:22.412153 17361 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:22.422577 17855 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:22.423277 17855 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:22.378552 17851 raft_consensus.cc:2749] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:22.396798 13800 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:11:22.434459 13830 consensus_meta.cc:287] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.584s	user 0.010s	sys 0.000s
I20260709 12:11:22.436228 13830 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 10.
W20260709 12:11:22.442415 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 45711.7us
I20260709 12:11:22.441931 17855 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:22.445182 17851 raft_consensus.cc:2804] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:22.405534 17602 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:22.503072 13800 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:22.497534 17602 raft_consensus.cc:2749] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:22.490011 17851 raft_consensus.cc:697] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 15 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
W20260709 12:11:22.535712 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 167565us
I20260709 12:11:22.529201 17855 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:22.566048 14380 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:22.543465 17855 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:22.584843 17862 raft_consensus.cc:3055] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:22.586882 17862 raft_consensus.cc:740] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:22.572355 17851 consensus_queue.cc:237] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:22.587872 17862 consensus_queue.cc:260] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:22.588974 17862 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:22.584175 17867 raft_consensus.cc:2804] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:22.590195 17867 raft_consensus.cc:697] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 9 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:22.591132 17867 consensus_queue.cc:237] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:22.596158 17855 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:22.582185 17870 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:22.600493 17870 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:22.605579 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:22.609571 14414 raft_consensus.cc:2468] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 6.
I20260709 12:11:22.621562 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:22.622107 17870 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:22.622440 14411 raft_consensus.cc:2393] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 12: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:11:22.622212 17871 raft_consensus.cc:2749] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:22.623405 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:22.624712 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:22.628458 14409 raft_consensus.cc:2393] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 10: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:11:22.628458 14414 raft_consensus.cc:2393] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 8: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
W20260709 12:11:22.621601 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 55706.2us
I20260709 12:11:22.633131 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:22.633356 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:22.634034 14414 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 9.
I20260709 12:11:22.635087 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:22.635900 14411 raft_consensus.cc:2368] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 7. Current term is 8.
I20260709 12:11:22.625905 14415 raft_consensus.cc:1275] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:22.642329 14409 raft_consensus.cc:1240] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:22.643693 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:22.646746 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:22.647650 14415 raft_consensus.cc:2393] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 8: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:11:22.653023 14409 raft_consensus.cc:1240] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:11:22.656054 17804 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:22.657342 14411 raft_consensus.cc:1240] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:22.660969 14409 raft_consensus.cc:1240] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:22.663054 17804 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 9 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:22.667626 17606 consensus_meta.cc:287] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.516s	user 0.012s	sys 0.002s
I20260709 12:11:22.668170 17606 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:22.670007 17606 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:22.706802 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:22.707806 13760 raft_consensus.cc:2410] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:11:22.709512 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:22.710507 13760 raft_consensus.cc:2410] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:11:22.713068 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:22.713132 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:22.716288 14379 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:22.716003 17778 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:22.717555 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:22.717837 14379 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:22.718830 17867 consensus_queue.cc:1059] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:22.719537 17804 raft_consensus.cc:2749] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:22.726244 17867 raft_consensus.cc:3055] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:22.726491 17804 raft_consensus.cc:2749] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:22.726711 17867 raft_consensus.cc:740] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:22.717851 13762 raft_consensus.cc:1240] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:11:22.727998 14414 raft_consensus.cc:1240] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:22.721840 17851 consensus_queue.cc:1059] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:22.727908 17867 consensus_queue.cc:260] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:22.729321 17867 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:22.730288 17778 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 9 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:22.730633 17879 raft_consensus.cc:3055] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:22.731947 17879 raft_consensus.cc:740] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:22.732319 17880 consensus_queue.cc:1059] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:22.733193 17879 consensus_queue.cc:260] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:22.735139 17879 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:22.747498 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:22.748045 17606 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:22.748951 17606 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:22.752166 17606 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:22.774271 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:22.776679 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:22.779538 13727 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:22.779443 17858 consensus_queue.cc:1059] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:11:22.780706 17606 raft_consensus.cc:2804] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:22.781082 17869 raft_consensus.cc:3055] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:22.781656 17869 raft_consensus.cc:740] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:22.783031 17869 consensus_queue.cc:260] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:22.784511 17869 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:22.781594 17606 raft_consensus.cc:697] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:22.789414 17606 consensus_queue.cc:237] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:22.792377 17533 consensus_meta.cc:287] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.669s	user 0.014s	sys 0.000s
I20260709 12:11:22.792626 17778 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.793159 17778 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:22.795630 17778 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:22.794950 17879 raft_consensus.cc:3055] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:22.796459 17879 raft_consensus.cc:740] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:22.796487 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:22.798571 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:22.799219 13828 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 10.
I20260709 12:11:22.800544 14380 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:22.801494 17778 raft_consensus.cc:2804] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:22.801936 17778 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:22.800853 17879 consensus_queue.cc:260] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:22.802268 17778 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:22.803678 17879 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:22.807745 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:22.809538 13837 raft_consensus.cc:1275] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:22.810560 17533 consensus_queue.cc:1059] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:22.810700 17778 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:22.810828 17866 consensus_queue.cc:1059] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:22.811693 17533 raft_consensus.cc:3055] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:22.811935 17866 raft_consensus.cc:3055] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:22.812073 17533 raft_consensus.cc:740] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:11:22.812510 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:22.812479 17866 raft_consensus.cc:740] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:22.813632 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:22.814957 13757 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 12.
I20260709 12:11:22.815804 17778 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:22.817026 17533 consensus_queue.cc:260] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:22.818406 17533 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:22.809478 13727 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:22.819105 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:22.819764 13837 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:22.821214 17858 raft_consensus.cc:2804] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:22.821698 17858 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:22.822135 17858 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:22.826478 17869 consensus_queue.cc:1059] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:11:22.826895 17861 consensus_queue.cc:1059] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:22.828043 17861 raft_consensus.cc:3055] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:22.828438 17861 raft_consensus.cc:740] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:22.829984 17533 raft_consensus.cc:3055] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:22.830591 17533 raft_consensus.cc:740] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:22.831082 13727 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:22.831712 17533 consensus_queue.cc:260] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:22.833135 17778 consensus_queue.cc:1048] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:22.813534 17866 consensus_queue.cc:260] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:22.839659 17533 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:22.840518 17866 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:22.843253 13726 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.012s	sys 0.012s
W20260709 12:11:22.843577 13726 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.013s	sys 0.013s
W20260709 12:11:22.844197 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 576212us
I20260709 12:11:22.845021 13726 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:22.843072 13832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 2476) took 1089 ms. Trace:
I20260709 12:11:22.849984 17856 raft_consensus.cc:2764] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:11:22.850874 17856 raft_consensus.cc:2804] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:22.851429 17856 raft_consensus.cc:697] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:22.853498 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:22.852464 17856 consensus_queue.cc:237] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:22.858171 14407 raft_consensus.cc:1275] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:22.858299 14415 raft_consensus.cc:1240] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:22.858290 14409 raft_consensus.cc:1275] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:22.861063 14408 raft_consensus.cc:1275] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:11:22.861359 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:22.862043 17602 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.862602 17602 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:22.865217 17602 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:22.865959 14410 raft_consensus.cc:1240] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:22.866182 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:22.867134 13833 raft_consensus.cc:2393] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 6: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:22.866977 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:22.870097 17859 consensus_queue.cc:1048] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:22.423157 17361 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:22.870939 17859 consensus_queue.cc:1243] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer b98d2519bb504dc6905ed2ede4571835 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:11:22.871182 17361 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:22.872182 13726 leader_election.cc:400] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 11. Current term is 12.
I20260709 12:11:22.872558 13726 leader_election.cc:403] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:22.873127 17859 raft_consensus.cc:2749] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 11. Current term is 12.
I20260709 12:11:22.848285 13832 rpcz_store.cc:276] 0709 12:11:21.753855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.757483 (+  3628us) service_pool.cc:224] Handling call
0709 12:11:21.836675 (+ 79192us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:21.843244 (+  6569us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:11:21.857210 (+ 13966us) log.cc:844] Serialized 14 byte log entry
0709 12:11:22.376738 (+519528us) spinlock_profiling.cc:243] Waited 2.14 ms on lock 0x7b1800488f20. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e82e07 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9fc02 00007fa927b2720b 00007fa927b2cd23 00007fa927b2d23a 00007fa927f97a2a
0709 12:11:22.842600 (+465862us) log.cc:844] Serialized 14 byte log entry
0709 12:11:22.842752 (+   152us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:22.842794 (+    42us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:22.842838 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:22.842903 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:22.843015 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1298,"prepare.queue_time_us":14128,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":79,"raft.queue_time_us":7814,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":146,"spinlock_wait_cycles":4918528,"thread_start_us":465387,"threads_started":1,"wal-append.queue_time_us":735116}
I20260709 12:11:22.829339 17861 consensus_queue.cc:260] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:22.873765 17361 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:22.876055 13651 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.012s	sys 0.022s
W20260709 12:11:22.881366 13651 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.013s	sys 0.023s
W20260709 12:11:22.881764 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:22.882133 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:22.883829 17864 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.884084 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:22.885087 13762 raft_consensus.cc:2393] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 9: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:22.884544 17864 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:22.887328 17864 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:22.887992 17864 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.888069 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:22.888494 17863 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.888635 17864 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:22.889127 17863 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:22.890399 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:22.891772 17863 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:22.891943 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:22.893321 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:22.894024 13760 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:22.853192 17858 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:22.893957 17864 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:22.906901 13762 raft_consensus.cc:2393] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 10: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:22.908903 17858 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:22.909345 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:22.912660 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:22.913201 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:22.930156 13832 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 9.
I20260709 12:11:22.902709 17860 tablet_replica.cc:333] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd: stopping tablet replica
I20260709 12:11:22.915882 13837 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 11.
I20260709 12:11:22.933039 17860 raft_consensus.cc:2243] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:22.880049 17861 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:22.878896 17522 raft_consensus.cc:2764] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 12:11:22.931315 13683 raft_consensus.cc:1240] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:23.021467 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:22.903928 13727 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:23.023415 17859 raft_consensus.cc:2749] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:11:23.023577 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 119789us
I20260709 12:11:23.025238 13727 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:23.025957 17859 raft_consensus.cc:2804] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:22.936069 13759 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 8.
I20260709 12:11:22.938426 13760 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 12.
I20260709 12:11:23.026327 17859 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:23.026774 17859 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:23.027484 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:22.944603 13686 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 6.
I20260709 12:11:23.028272 13760 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 8.
I20260709 12:11:23.028841 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:23.029206 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:23.029873 13686 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:23.029661 17861 consensus_queue.cc:1059] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:23.030527 17856 raft_consensus.cc:3055] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:23.030948 17856 raft_consensus.cc:740] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:23.031140 17853 consensus_queue.cc:1048] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:22.948501 13688 raft_consensus.cc:1275] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:23.031992 17856 consensus_queue.cc:260] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:23.033005 13688 raft_consensus.cc:1275] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:23.033411 17856 raft_consensus.cc:3060] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:22.961851 17670 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.009s	sys 0.015s
I20260709 12:11:22.980600 13726 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
W20260709 12:11:23.034046 17670 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.010s	sys 0.016s
I20260709 12:11:22.988631 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:23.034596 13684 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 8.
I20260709 12:11:23.035408 13688 pending_rounds.cc:85] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 5
I20260709 12:11:23.035714 13688 pending_rounds.cc:107] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 12:11:23.035995 13688 raft_consensus.cc:2889] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:22.993501 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:23.037858 17866 consensus_queue.cc:1048] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:23.038282 13682 raft_consensus.cc:2393] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 7: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:22.994735 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:23.042814 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:23.043527 13754 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 15.
W20260709 12:11:23.043592 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 63136.7us
I20260709 12:11:23.043094 17858 consensus_queue.cc:1059] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 12:11:23.045966 17858 raft_consensus.cc:2749] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:23.043608 13651 leader_election.cc:304] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:22.995255 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:23.047435 17858 raft_consensus.cc:3055] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:23.047864 17858 raft_consensus.cc:740] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:23.048633 17858 consensus_queue.cc:260] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:23.047483 13651 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:23.049808 17863 raft_consensus.cc:2804] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:23.049961 17864 raft_consensus.cc:2804] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:23.050451 17864 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:23.050799 17864 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:23.043154 17853 consensus_queue.cc:1048] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 12:11:23.050472 17863 raft_consensus.cc:697] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 12 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:23.052758 17863 consensus_queue.cc:237] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:23.056396 17861 consensus_queue.cc:1048] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:22.956673 17860 raft_consensus.cc:2272] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:23.062844 13726 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:23.064136 17861 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:23.066115 17858 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:23.047881 13681 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:23.067647 13727 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:23.067940 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:23.068682 13835 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:23.029248 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:23.072228 13760 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 12.
I20260709 12:11:23.072902 13682 raft_consensus.cc:1275] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:23.073726 17522 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.074354 17522 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:23.076403 17522 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:23.076787 17860 ts_tablet_manager.cc:1916] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:11:23.082806 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:23.083747 13685 raft_consensus.cc:2393] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 9: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:23.085652 13835 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 10.
I20260709 12:11:23.086563 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:23.087543 13651 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:23.077203 13681 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 10.
I20260709 12:11:23.078181 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:23.092403 13726 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:23.056468 13686 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 10.
I20260709 12:11:23.080576 17864 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:23.093725 13727 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:23.090610 13651 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:11:23.107614 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.107524 17670 raft_consensus.cc:2804] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:23.110955 17670 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:23.111472 17670 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:23.114094 17882 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:23.114755 17882 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:23.114816 17859 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:23.117409 17882 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:23.117929 17894 raft_consensus.cc:2749] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:23.119045 17894 consensus_queue.cc:1048] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:23.120499 17894 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:23.120836 17670 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:23.124681 17861 raft_consensus.cc:2749] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:23.130128 17864 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:23.096881 17855 raft_consensus.cc:2804] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:23.132179 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:23.134474 13835 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:23.117755 17859 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:23.125697 17861 raft_consensus.cc:2804] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:23.126871 17670 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:23.144098 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:23.133618 17855 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:23.145748 13684 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:11:23.155098 13835 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 10.
W20260709 12:11:23.156472 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 665031us
I20260709 12:11:23.156558 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:23.157018 13727 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:23.157428 13758 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:23.156641 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:23.157585 13800 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:23.158481 13754 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:23.159628 13800 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:23.160141 17583 raft_consensus.cc:2804] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:23.160450 17882 raft_consensus.cc:2804] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:11:23.162330 17882 raft_consensus.cc:697] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 6 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:23.162437 17858 raft_consensus.cc:2804] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:23.163017 17858 raft_consensus.cc:697] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:23.163074 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:23.163419 17882 consensus_queue.cc:237] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:23.164121 17858 consensus_queue.cc:237] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:23.160620 17583 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:23.167570 17583 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:23.168722 13754 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 9.
I20260709 12:11:23.149085 17855 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:11:23.174312 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.149397 17861 raft_consensus.cc:697] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:23.178838 17861 consensus_queue.cc:237] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.3, Last appended by leader: 3, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:23.186676 13684 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 10.
I20260709 12:11:23.197543 13756 raft_consensus.cc:1275] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:23.200066 14379 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:23.201305 14379 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:23.202536 17871 raft_consensus.cc:2749] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:23.203930 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 44380.6us
I20260709 12:11:23.206110 13800 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:23.206660 13763 raft_consensus.cc:1275] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:23.207338 17879 consensus_queue.cc:1059] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:23.208197 17879 raft_consensus.cc:2749] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:23.208847 17879 raft_consensus.cc:3055] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:23.209167 17879 raft_consensus.cc:740] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:23.209455 17871 raft_consensus.cc:2749] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:23.212522 17860 ts_tablet_manager.cc:1929] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.4
I20260709 12:11:23.213096 17860 log.cc:1199] T a34b21ec197b4241a780a8ae562e4602 P 96701a74fdee481fb5f54aac841e17dd: Deleting WAL directory at /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894707649-12515-0/minicluster-data/ts-2-root/wals/a34b21ec197b4241a780a8ae562e4602
I20260709 12:11:23.215219 17900 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:23.215781 17900 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:23.218050 17855 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:23.220252 17855 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:23.223711 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:23.206926 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.224619 13758 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 13.
I20260709 12:11:23.231510 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:23.238989 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:23.239794 13763 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:23.240772 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:23.241811 14411 raft_consensus.cc:2468] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 10.
I20260709 12:11:23.246050 13727 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:23.228967 17900 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:23.213106 17583 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:23.254092 17583 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:23.298633 17900 raft_consensus.cc:2804] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:23.299398 17900 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:23.299954 17900 raft_consensus.cc:3060] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:23.314746 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:11:23.324469 17683 consensus_meta.cc:287] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.950s	user 0.007s	sys 0.004s
I20260709 12:11:23.246780 17879 consensus_queue.cc:260] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:23.325433 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:23.327786 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:23.328220 13679 raft_consensus.cc:2376] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 10. Re-sending same reply.
I20260709 12:11:23.329273 17683 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:23.329380 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:23.331792 13683 raft_consensus.cc:2368] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 6. Current term is 7.
I20260709 12:11:23.333679 17683 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:23.342128 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:23.342787 13758 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:23.346271 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 101404us
I20260709 12:11:23.348596 14411 raft_consensus.cc:1275] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:23.350401 14380 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:23.353272 17804 raft_consensus.cc:2804] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:23.353746 17851 consensus_queue.cc:1059] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:23.355372 17882 consensus_queue.cc:1048] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:23.356318 13763 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 16.
I20260709 12:11:23.356663 17804 raft_consensus.cc:697] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 11 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
W20260709 12:11:23.357077 17706 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.078s	user 0.012s	sys 0.012s
W20260709 12:11:23.357475 17706 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.079s	user 0.012s	sys 0.012s
I20260709 12:11:23.357297 17522 consensus_queue.cc:1059] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:23.357600 17804 consensus_queue.cc:237] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:23.359359 17882 raft_consensus.cc:3055] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:23.359753 17882 raft_consensus.cc:740] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
W20260709 12:11:23.368707 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:23.370406 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.339249 17894 raft_consensus.cc:2749] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:23.387907 13758 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 7.
I20260709 12:11:23.391191 13830 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 9.
I20260709 12:11:23.393038 14380 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:23.406327 17871 raft_consensus.cc:2804] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:23.407022 17871 raft_consensus.cc:697] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 9 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:23.408054 17871 consensus_queue.cc:237] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:23.360785 17882 consensus_queue.cc:260] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:23.706920 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 313942us
W20260709 12:11:23.668746 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:23.668030 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:23.666102 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.433032 13800 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:11:23.425048 14437 debug-util.cc:398] Leaking SignalData structure 0x7b08002cc9c0 after lost signal to thread 12518
W20260709 12:11:23.761232 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.412555 17522 raft_consensus.cc:3055] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:11:23.762177 14437 debug-util.cc:398] Leaking SignalData structure 0x7b080010d5c0 after lost signal to thread 13620
W20260709 12:11:23.469445 14379 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.56.194:39545 timed out after 1.543s (SENT) [suppressed 51 similar messages]
W20260709 12:11:23.766113 14437 debug-util.cc:398] Leaking SignalData structure 0x7b080025a280 after lost signal to thread 13712
W20260709 12:11:23.763669 17665 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.839s	user 0.057s	sys 0.063s
W20260709 12:11:23.766287 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 365371us
W20260709 12:11:23.769589 14437 debug-util.cc:398] Leaking SignalData structure 0x7b08003d0480 after lost signal to thread 13787
W20260709 12:11:23.770171 17908 log.cc:927] Time spent T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.531s	user 0.002s	sys 0.000s
I20260709 12:11:23.764671 17522 raft_consensus.cc:740] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:23.772347 17522 consensus_queue.cc:260] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:23.773234 14437 debug-util.cc:398] Leaking SignalData structure 0x7b08003d0460 after lost signal to thread 13788
I20260709 12:11:23.773622 17522 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:23.774116 14414 raft_consensus.cc:1240] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260709 12:11:23.774619 14437 debug-util.cc:398] Leaking SignalData structure 0x7b080020f4c0 after lost signal to thread 13861
W20260709 12:11:23.775002 14437 debug-util.cc:398] Leaking SignalData structure 0x7b0800255760 after lost signal to thread 13862
I20260709 12:11:23.775451 17851 raft_consensus.cc:2804] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:23.776027 17851 raft_consensus.cc:697] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 8 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:23.777024 17851 consensus_queue.cc:237] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:23.778179 14437 debug-util.cc:398] Leaking SignalData structure 0x7b080031e620 after lost signal to thread 14440
W20260709 12:11:23.780500 14437 debug-util.cc:398] Leaking SignalData structure 0x7b0800326ac0 after lost signal to thread 14441
W20260709 12:11:23.791514 14437 debug-util.cc:398] Leaking SignalData structure 0x7b0800399860 after lost signal to thread 17738
W20260709 12:11:23.791921 14437 debug-util.cc:398] Leaking SignalData structure 0x7b0800373420 after lost signal to thread 17781
W20260709 12:11:23.792162 14437 debug-util.cc:398] Leaking SignalData structure 0x7b08003c3000 after lost signal to thread 17783
I20260709 12:11:23.806118 13800 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
W20260709 12:11:23.808878 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 339464us
W20260709 12:11:23.805043 17665 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.886s	user 0.058s	sys 0.064s
I20260709 12:11:23.809942 17583 raft_consensus.cc:2804] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:23.810456 17583 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:23.810899 17583 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:23.828265 17900 consensus_meta.cc:287] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.528s	user 0.012s	sys 0.000s
I20260709 12:11:23.840281 17583 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:23.857860 17851 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.858812 17851 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:23.862327 17851 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:23.863493 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:23.864225 14407 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 11.
I20260709 12:11:23.865919 13801 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:23.848395 17900 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:23.868624 17851 raft_consensus.cc:2804] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:23.880535 17851 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:23.880981 17851 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:23.883551 17900 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:23.886053 13834 raft_consensus.cc:1275] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:23.886701 13834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 2485) took 1026 ms. Trace:
I20260709 12:11:23.886971 13834 rpcz_store.cc:276] 0709 12:11:22.860424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.885302 (+1024878us) service_pool.cc:224] Handling call
0709 12:11:23.885679 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:23.886472 (+   793us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:23.886656 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:23.889309 13800 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:23.889422 17583 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:11:23.890359 17606 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.075s	user 0.010s	sys 0.026s
I20260709 12:11:23.890409 17583 raft_consensus.cc:2749] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:23.890931 17606 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.075s	user 0.011s	sys 0.026s
I20260709 12:11:23.891585 13800 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:23.895835 17920 raft_consensus.cc:2749] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:23.898415 17851 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:23.908617 13800 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:23.909044 17851 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:23.909699 17583 raft_consensus.cc:2764] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
W20260709 12:11:23.910465 17698 consensus_meta.cc:287] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 2.009s	user 0.018s	sys 0.001s
I20260709 12:11:23.911022 17698 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:23.914433 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:23.914433 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:23.912112 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:23.916324 14407 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:23.916429 13834 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 7.
I20260709 12:11:23.913089 13829 raft_consensus.cc:1240] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:23.913241 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:23.918177 13830 raft_consensus.cc:2393] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 12: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:23.913461 13835 raft_consensus.cc:1240] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:23.919605 17698 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:23.922734 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:11:23.923242 13858 debug-util.cc:398] Leaking SignalData structure 0x7b0800173e60 after lost signal to thread 12518
I20260709 12:11:23.923586 13835 raft_consensus.cc:2368] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 9. Current term is 10.
I20260709 12:11:23.924362 14407 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 12.
I20260709 12:11:23.925014 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:23.925871 13801 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:23.926739 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:23.927024 17583 raft_consensus.cc:2804] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:23.927482 13835 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 11.
I20260709 12:11:23.927805 17583 raft_consensus.cc:697] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 12 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:23.928917 17583 consensus_queue.cc:237] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:23.929579 13835 raft_consensus.cc:1275] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:23.932945 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:23.933876 13830 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:23.942682 13581 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53318 (request call id 143) took 5452 ms. Trace:
I20260709 12:11:23.943193 13581 rpcz_store.cc:276] 0709 12:11:18.490503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.490841 (+   338us) service_pool.cc:224] Handling call
0709 12:11:23.942552 (+5451711us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:21.631796 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:21.632249 (+   453us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:21.632283 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:11:21.632298 (+    15us) tablet.cc:662] Decoding operations
0709 12:11:21.633110 (+   812us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:21.633182 (+    72us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:21.633199 (+    17us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:11:21.634024 (+   825us) tablet.cc:701] Row locks acquired
0709 12:11:21.634057 (+    33us) write_op.cc:260] PREPARE: finished
0709 12:11:21.634211 (+   154us) write_op.cc:270] Start()
0709 12:11:21.634300 (+    89us) write_op.cc:276] Timestamp: P: 1783599081634148 usec, L: 0
0709 12:11:21.634313 (+    13us) op_driver.cc:348] REPLICATION: starting
0709 12:11:21.634860 (+   547us) log.cc:844] Serialized 5133 byte log entry
0709 12:11:21.637748 (+  2888us) op_driver.cc:464] REPLICATION: finished
0709 12:11:21.638992 (+  1244us) write_op.cc:301] APPLY: starting
0709 12:11:21.639105 (+   113us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:21.647815 (+  8710us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:21.647893 (+    78us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:21.654784 (+  6891us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:21.655050 (+   266us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=26,mrs_lookups=0
0709 12:11:21.655094 (+    44us) write_op.cc:312] APPLY: finished
0709 12:11:21.655426 (+   332us) log.cc:844] Serialized 121 byte log entry
0709 12:11:21.656253 (+   827us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:21.656406 (+   153us) write_op.cc:454] Released schema lock
0709 12:11:21.656460 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:21.656890 (+   430us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:21.656930 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":986,"apply.run_cpu_time_us":16658,"apply.run_wall_time_us":17858,"cfile_cache_hit":50,"cfile_cache_hit_bytes":52250,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6217,"cfile_init":2,"lbm_read_time_us":1201,"lbm_reads_lt_1ms":12,"num_ops":13,"prepare.queue_time_us":1047,"prepare.run_cpu_time_us":3392,"prepare.run_wall_time_us":3396,"replication_time_us":3280,"thread_start_us":1321,"threads_started":2}]]}
I20260709 12:11:23.947844 13829 raft_consensus.cc:1240] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:23.952828 13762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48114 (request call id 2476) took 1065 ms. Trace:
I20260709 12:11:23.954406 13762 rpcz_store.cc:276] 0709 12:11:22.886986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.887793 (+   807us) service_pool.cc:224] Handling call
0709 12:11:23.952557 (+1064764us) spinlock_profiling.cc:243] Waited 17.3 ms on lock 0x7b54003a07d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:23.952729 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39739648}
I20260709 12:11:23.960096 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:23.960196 13831 raft_consensus.cc:1240] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:23.962844 13831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 2482) took 1103 ms. Trace:
I20260709 12:11:23.963308 13831 rpcz_store.cc:276] 0709 12:11:22.859465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.959247 (+1099782us) service_pool.cc:224] Handling call
0709 12:11:23.959982 (+   735us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:23.962423 (+  2441us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:23.962725 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:23.959535 13830 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 12.
I20260709 12:11:23.975265 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:11:23.975832 17778 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.075s	user 0.010s	sys 0.006s
I20260709 12:11:23.975980 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:11:23.976380 17778 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.076s	user 0.010s	sys 0.006s
I20260709 12:11:23.976266 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:23.976629 13834 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:23.976687 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:23.977255 13837 raft_consensus.cc:2410] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:11:23.977360 13829 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:23.978672 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:23.979475 13837 raft_consensus.cc:2393] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 9: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:23.980765 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:23.981621 13837 raft_consensus.cc:2368] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 9. Current term is 10.
I20260709 12:11:23.982999 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:23.983808 13837 raft_consensus.cc:2368] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 7. Current term is 8.
I20260709 12:11:23.985118 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:23.985806 13837 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:23.986145 13829 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 12.
I20260709 12:11:23.987252 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:23.987936 13830 raft_consensus.cc:2393] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 11: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:23.988454 13834 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 11.
I20260709 12:11:23.994997 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:23.997061 13837 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 8.
I20260709 12:11:24.008126 13683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2361) took 1040 ms. Trace:
I20260709 12:11:24.008595 13683 rpcz_store.cc:276] 0709 12:11:22.967913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.021234 (+ 53321us) service_pool.cc:224] Handling call
0709 12:11:24.007915 (+986681us) spinlock_profiling.cc:243] Waited 309 ms on lock 0x7b5400245ed4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:24.008058 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":711760640}
I20260709 12:11:24.011512 17851 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:24.012056 17851 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:24.013860 17851 leader_election.cc:290] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:11:24.017004 13654 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.681s	user 0.024s	sys 0.048s
W20260709 12:11:24.017675 13654 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.683s	user 0.026s	sys 0.050s
I20260709 12:11:24.018059 17533 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:24.018721 17533 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:24.020946 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:24.022065 17866 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.021041 17533 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:24.022579 13683 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 11.
I20260709 12:11:24.022615 17866 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:24.025982 17882 raft_consensus.cc:3060] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:24.024338 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:24.028443 13685 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 9.
I20260709 12:11:24.033689 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:24.034451 13682 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:24.034570 13858 debug-util.cc:398] Leaking SignalData structure 0x7b08000e4b20 after lost signal to thread 13620
I20260709 12:11:24.044127 17866 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:24.045164 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:24.068874 13685 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:24.048086 17578 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.776s	user 0.018s	sys 0.012s
W20260709 12:11:24.074167 17578 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.806s	user 0.020s	sys 0.013s
W20260709 12:11:24.075501 17817 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.678s	user 0.008s	sys 0.017s
W20260709 12:11:24.076174 17817 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.678s	user 0.010s	sys 0.017s
I20260709 12:11:24.076525 17817 raft_consensus.cc:697] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 12 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:24.078210 17578 raft_consensus.cc:697] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:24.079290 17578 consensus_queue.cc:237] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:24.059919 13757 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38932 (request call id 570) took 1347 ms (client timeout 1543 ms). Trace:
W20260709 12:11:24.082140 13757 rpcz_store.cc:269] 0709 12:11:22.712499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.712634 (+   135us) service_pool.cc:224] Handling call
0709 12:11:24.059676 (+1347042us) spinlock_profiling.cc:243] Waited 79.2 ms on lock 0x7b54000a0ad4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:24.059839 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":182263040}
I20260709 12:11:24.067622 17827 raft_consensus.cc:3055] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:24.083326 17827 raft_consensus.cc:740] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:24.084403 17827 consensus_queue.cc:260] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:24.086086 17827 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:24.086336 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:24.087183 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:24.077626 17817 consensus_queue.cc:237] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:24.095283 13652 connection.cc:256] RPC call timeout handler was delayed by -2.8285517720000826s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20270000000000002s for a response
I20260709 12:11:24.067853 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:24.100044 13683 raft_consensus.cc:3060] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:11:24.105433 13755 raft_consensus.cc:2368] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for earlier term 15. Current term is 16.
I20260709 12:11:24.106520 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:24.107112 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:24.107725 13688 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:24.112329 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.118973 13688 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 9.
I20260709 12:11:24.120322 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:24.123852 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:11:24.125634 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.126225 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:24.137926 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:24.138517 13680 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:24.138639 13759 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 12.
I20260709 12:11:24.139135 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:24.139837 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:24.128465 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:24.143325 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:24.144232 13832 raft_consensus.cc:1275] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:24.129309 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:24.145336 13681 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 11.
I20260709 12:11:24.141947 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:24.146279 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:24.146833 13760 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 11.
I20260709 12:11:24.148591 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:24.149324 13832 raft_consensus.cc:2393] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 9: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:11:24.150126 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:24.151049 13759 raft_consensus.cc:2410] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:11:24.132257 13684 raft_consensus.cc:3060] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:24.151846 13800 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:24.152127 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:24.152819 13759 raft_consensus.cc:2376] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 12. Re-sending same reply.
I20260709 12:11:24.153043 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:24.153765 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:24.157141 13759 raft_consensus.cc:2368] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 7. Current term is 8.
I20260709 12:11:24.158023 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:24.158131 13800 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:24.133523 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:24.159713 13800 leader_election.cc:400] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 election: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 7. Current term is 8.
I20260709 12:11:24.160138 13800 leader_election.cc:403] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:11:24.160640 17917 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:24.161247 17917 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:24.163805 13759 raft_consensus.cc:2393] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 11: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:24.164970 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:24.136927 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:24.167829 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:24.137596 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:24.171805 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:24.137689 13762 raft_consensus.cc:1275] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:24.087227 14407 raft_consensus.cc:2393] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 9: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
W20260709 12:11:24.131739 13652 connection.cc:256] RPC call timeout handler was delayed by -2.2634215080001923s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3288s for a response
I20260709 12:11:24.144500 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:11:24.178746 13652 connection.cc:256] RPC call timeout handler was delayed by -1.9417963590001364s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1516s for a response
W20260709 12:11:24.179118 13652 connection.cc:256] RPC call timeout handler was delayed by -1.9312614000000394s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2076s for a response
W20260709 12:11:24.179450 13652 connection.cc:256] RPC call timeout handler was delayed by -1.8484614000001329s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21680000000000002s for a response
I20260709 12:11:24.179214 13686 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 9.
W20260709 12:11:24.179821 13652 connection.cc:256] RPC call timeout handler was delayed by -1.8115614000000733s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2209s for a response
W20260709 12:11:24.180188 13652 connection.cc:256] RPC call timeout handler was delayed by -1.7908614000000398s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22320000000000004s for a response
W20260709 12:11:24.180501 13652 connection.cc:256] RPC call timeout handler was delayed by -1.7845614000000296s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2239s for a response
W20260709 12:11:24.180778 13652 connection.cc:256] RPC call timeout handler was delayed by -1.7836517719999847s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31880000000000003s for a response
W20260709 12:11:24.181160 13652 connection.cc:256] RPC call timeout handler was delayed by -1.7550038130002577s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1516s for a response
W20260709 12:11:24.181528 13652 connection.cc:256] RPC call timeout handler was delayed by -1.7451038130002416s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1527s for a response
W20260709 12:11:24.181767 13652 connection.cc:256] RPC call timeout handler was delayed by -1.6969963589999679s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17880000000000001s for a response
I20260709 12:11:24.181876 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:24.182116 13652 connection.cc:256] RPC call timeout handler was delayed by -1.6484823900000265s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1875s for a response
W20260709 12:11:24.182396 13652 connection.cc:256] RPC call timeout handler was delayed by -1.6195395229999576s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21040000000000003s for a response
W20260709 12:11:24.182665 13652 connection.cc:256] RPC call timeout handler was delayed by -1.5098038920000363s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1708s for a response
W20260709 12:11:24.183024 13652 connection.cc:256] RPC call timeout handler was delayed by -1.4579651340002329s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1684s for a response
W20260709 12:11:24.183413 13652 connection.cc:256] RPC call timeout handler was delayed by -1.4579651340002329s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1684s for a response
W20260709 12:11:24.183784 13652 connection.cc:256] RPC call timeout handler was delayed by -1.3958495849999508s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1786s for a response
W20260709 12:11:24.184171 13652 connection.cc:256] RPC call timeout handler was delayed by -1.3684963590001189s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21530000000000002s for a response
W20260709 12:11:24.184540 13652 connection.cc:256] RPC call timeout handler was delayed by -1.1885846810002931s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19640000000000002s for a response
W20260709 12:11:24.184800 13652 connection.cc:256] RPC call timeout handler was delayed by -1.1839630050001233s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2098s for a response
W20260709 12:11:24.185035 13652 connection.cc:256] RPC call timeout handler was delayed by -1.1776139100002183s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21240000000000003s for a response
W20260709 12:11:24.185282 13652 connection.cc:256] RPC call timeout handler was delayed by -1.0139236790000723s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22050000000000003s for a response
I20260709 12:11:24.131485 17927 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.186383 17927 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:24.186728 13756 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 9.
I20260709 12:11:24.188544 17927 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:24.189443 13763 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 8.
I20260709 12:11:24.132553 13679 raft_consensus.cc:3060] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:24.150126 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:24.192608 13760 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 12.
I20260709 12:11:24.169422 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:24.173349 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:24.194897 13754 raft_consensus.cc:2368] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 11. Current term is 12.
I20260709 12:11:24.128052 13682 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 12.
I20260709 12:11:24.195858 13800 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:24.197077 13684 raft_consensus.cc:2468] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 9.
I20260709 12:11:24.197170 13680 raft_consensus.cc:2468] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 9.
W20260709 12:11:24.131800 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.125741 13685 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 10.
I20260709 12:11:24.202028 17921 raft_consensus.cc:2804] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:24.202215 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:24.202746 17921 raft_consensus.cc:697] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 11 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:24.203567 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:24.203771 17921 consensus_queue.cc:237] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:24.204881 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:24.161762 17917 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:24.189636 17927 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.210199 17927 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:24.214190 13679 raft_consensus.cc:2468] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 8.
I20260709 12:11:24.215189 17927 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:24.215391 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:24.216007 17927 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:24.216311 13683 raft_consensus.cc:2468] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 8.
I20260709 12:11:24.192559 13652 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:24.216737 17927 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:24.236057 17851 raft_consensus.cc:2749] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 7. Current term is 8.
I20260709 12:11:24.237805 17361 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.239643 17859 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:24.255995 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 60191.5us
I20260709 12:11:24.241488 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:11:24.242653 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 50410.7us
I20260709 12:11:24.244196 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:24.251843 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:24.254148 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:24.256863 13835 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 10.
I20260709 12:11:24.257313 13837 raft_consensus.cc:2410] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:11:24.258077 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:24.256863 13800 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:24.258649 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:24.259069 13837 raft_consensus.cc:1275] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:24.259102 13835 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:24.259428 13800 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:24.262615 17921 consensus_queue.cc:1048] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:11:24.258286 17361 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:24.268386 17361 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:24.269058 17361 raft_consensus.cc:2749] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:24.271899 13727 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.931s	user 0.075s	sys 0.121s
W20260709 12:11:24.272439 13727 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.932s	user 0.075s	sys 0.121s
W20260709 12:11:24.272778 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 932142us
I20260709 12:11:24.284000 13835 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 7.
I20260709 12:11:24.285483 17921 raft_consensus.cc:2804] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:24.286302 17921 raft_consensus.cc:697] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 8 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:24.287626 17921 consensus_queue.cc:237] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:24.276139 17851 raft_consensus.cc:2804] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:24.260380 17859 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:24.295118 13652 leader_election.cc:400] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 9. Current term is 10.
I20260709 12:11:24.299823 13652 leader_election.cc:403] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:24.302143 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:24.295774 17851 raft_consensus.cc:697] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 9 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:24.302855 13687 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:24.303556 17851 consensus_queue.cc:237] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:24.297335 17657 consensus_queue.cc:1059] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 12:11:24.305378 17361 consensus_queue.cc:1059] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:11:24.306370 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 47006.2us
I20260709 12:11:24.307504 17657 raft_consensus.cc:3055] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:24.295235 17922 raft_consensus.cc:2804] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:24.309355 13652 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:24.293174 17879 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:24.255913 17917 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:24.289701 17911 log.cc:927] Time spent T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.546s	user 0.004s	sys 0.000s
I20260709 12:11:24.346437 17922 raft_consensus.cc:697] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 12 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:24.310936 17657 raft_consensus.cc:740] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:24.347661 17922 consensus_queue.cc:237] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:24.350426 17859 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:24.347800 17657 consensus_queue.cc:260] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:24.351158 17859 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.351954 17657 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:24.351727 17859 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:24.357722 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:24.358736 13761 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38932 (request call id 564) took 1649 ms (client timeout 2183 ms). Trace:
W20260709 12:11:24.359249 13761 rpcz_store.cc:269] 0709 12:11:22.709410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.353016 (+1643606us) service_pool.cc:224] Handling call
0709 12:11:24.358648 (+  5632us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:24.359467 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 50222.3us
I20260709 12:11:24.357553 13687 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 9.
I20260709 12:11:24.360872 13687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2351) took 1450 ms. Trace:
I20260709 12:11:24.362983 13687 rpcz_store.cc:276] 0709 12:11:22.910588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.301819 (+1391231us) service_pool.cc:224] Handling call
0709 12:11:24.360791 (+ 58972us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:24.336563 17913 consensus_queue.cc:1048] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 12:11:24.365722 17913 consensus_queue.cc:1243] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer 96701a74fdee481fb5f54aac841e17dd log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:11:24.366897 17361 raft_consensus.cc:2749] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 9. Current term is 10.
I20260709 12:11:24.367058 13652 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:24.374411 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:24.375622 17927 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:24.385079 17927 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:24.385886 17927 consensus_queue.cc:1048] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:24.386571 17927 consensus_queue.cc:1243] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer 96701a74fdee481fb5f54aac841e17dd log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:11:24.387939 17927 raft_consensus.cc:2749] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:24.391949 17859 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:24.383378 17361 raft_consensus.cc:3055] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:24.427196 13652 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:24.430593 17927 raft_consensus.cc:2749] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:24.400374 17917 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:24.432396 13652 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:24.440013 13652 leader_election.cc:400] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 9. Current term is 10.
I20260709 12:11:24.440585 13652 leader_election.cc:403] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:24.427075 17361 raft_consensus.cc:740] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:24.443208 13652 leader_election.cc:400] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 7. Current term is 8.
I20260709 12:11:24.446628 17361 consensus_queue.cc:260] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:24.448553 17361 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:24.445827 13652 leader_election.cc:403] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:24.441339 17927 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:24.453151 13652 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:24.455539 13652 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:24.459964 17804 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:24.460538 17804 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:24.463496 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.463953 17804 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:24.465140 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:24.468211 14409 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:11:24.468449 17927 raft_consensus.cc:2749] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:24.469480 17927 raft_consensus.cc:2749] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 7. Current term is 8.
I20260709 12:11:24.451683 17935 raft_consensus.cc:2749] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 9. Current term is 10.
I20260709 12:11:24.470481 17927 raft_consensus.cc:2749] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:24.484254 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:24.485163 14407 raft_consensus.cc:3060] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:24.466776 17827 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.499302 14409 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 16.
I20260709 12:11:24.501459 13727 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:24.503954 14407 raft_consensus.cc:2468] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 11.
I20260709 12:11:24.504375 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:24.505198 13834 raft_consensus.cc:2376] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 7. Re-sending same reply.
I20260709 12:11:24.494472 17827 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:24.512023 17827 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:24.494624 17935 raft_consensus.cc:2749] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:24.518965 17869 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:24.519102 17859 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.519672 17869 raft_consensus.cc:697] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:24.520183 17859 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:24.520684 17869 consensus_queue.cc:237] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:24.523056 14411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41692 (request call id 669) took 1161 ms. Trace:
W20260709 12:11:24.523797 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:24.524326 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.527348 13727 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:24.523716 14411 rpcz_store.cc:276] 0709 12:11:23.362034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.362248 (+   214us) service_pool.cc:224] Handling call
0709 12:11:23.362680 (+   432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:23.393329 (+ 30649us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:23.393360 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:23.404955 (+ 11595us) log.cc:844] Serialized 26 byte log entry
0709 12:11:24.455366 (+1050411us) spinlock_profiling.cc:243] Waited 6.95 ms on lock 0x7b18003da860. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e82e07 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9fc02 00007fa927b2720b 00007fa927b2cd23 00007fa927b2d0d1 00007fa927f48a0f
0709 12:11:24.474374 (+ 19008us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:24.474419 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:24.474518 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:24.522526 (+ 48008us) raft_consensus.cc:1685] finished
0709 12:11:24.522559 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:24.522938 (+   379us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":26474,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":6971,"spinlock_wait_cycles":15982464,"thread_start_us":18793,"threads_started":1,"wal-append.queue_time_us":1115618}
I20260709 12:11:24.530215 17827 raft_consensus.cc:2804] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:24.530835 17827 raft_consensus.cc:697] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:24.531744 17827 consensus_queue.cc:237] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:24.534004 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.534227 17871 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:24.534859 17871 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:24.535948 17922 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:24.536576 17922 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:24.538844 17922 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:24.542371 17859 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:24.551764 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:24.560024 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:24.562889 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.565044 13571 catalog_manager.cc:5028] TS 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): tablet a34b21ec197b4241a780a8ae562e4602 (table test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]) successfully deleted
I20260709 12:11:24.570124 13835 raft_consensus.cc:1275] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:24.570013 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:24.570777 13828 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:24.537120 17871 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:24.578866 13830 raft_consensus.cc:1275] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:11:24.578979 13835 raft_consensus.cc:1275] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 8 index: 3. Preceding OpId from leader: term: 10 index: 4. (index mismatch)
I20260709 12:11:24.580549 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:24.582195 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:11:24.583016 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:24.587265 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 131788us
I20260709 12:11:24.591423 17900 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:24.593361 13828 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 16.
I20260709 12:11:24.595396 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:24.595809 13835 pending_rounds.cc:85] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 8
I20260709 12:11:24.596130 13835 pending_rounds.cc:107] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 12:11:24.596350 13835 raft_consensus.cc:2889] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:24.599244 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:24.599244 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:24.600194 13828 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 11.
I20260709 12:11:24.600118 13830 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 12.
I20260709 12:11:24.592123 17900 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:24.604604 13832 raft_consensus.cc:1275] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:11:24.606452 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:24.607008 17900 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:24.607162 13832 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 12.
I20260709 12:11:24.603333 13652 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:24.607880 17927 consensus_queue.cc:1048] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:11:24.610430 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:24.614555 14411 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 9.
I20260709 12:11:24.615454 17935 raft_consensus.cc:2804] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:24.629707 17902 consensus_queue.cc:1048] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:11:24.632511 13727 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:24.634593 17935 raft_consensus.cc:697] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 7 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:24.635639 17935 consensus_queue.cc:237] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:24.636257 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:24.622481 17898 consensus_queue.cc:1048] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:11:24.639309 13754 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "107415ab6e76484890fa8115e8832a21"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "b98d2519bb504dc6905ed2ede4571835"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:11:24.640050 13754 raft_consensus.cc:606] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Received request to transfer leadership to TS b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:24.640162 17869 raft_consensus.cc:2804] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:24.640524 13754 raft_consensus.cc:614] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:24.640761 17869 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.641294 17869 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:24.642930 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:24.643980 13831 raft_consensus.cc:2393] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 10: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
W20260709 12:11:24.652760 14379 leader_election.cc:336] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Timed out: RequestConsensusVote RPC to 127.12.56.194:39545 timed out after 2.183s (SENT)
I20260709 12:11:24.653267 14379 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:24.653800 17871 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:24.655912 17871 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:24.615937 17361 consensus_queue.cc:1048] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:11:24.654986 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:24.608170 17943 consensus_queue.cc:1048] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 12:11:24.633356 13727 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:24.662824 13651 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:24.675583 13651 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:24.664336 17804 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.666105 13754 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "b98d2519bb504dc6905ed2ede4571835"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:11:24.668454 17871 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:24.679127 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 45804us
W20260709 12:11:24.670611 13755 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38932 (request call id 567) took 1960 ms (client timeout 1698 ms). Trace:
I20260709 12:11:24.676824 13754 raft_consensus.cc:606] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Received request to transfer leadership to TS b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:24.682009 13754 raft_consensus.cc:614] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:11:24.681130 13755 rpcz_store.cc:269] 0709 12:11:22.710486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.327404 (+616918us) service_pool.cc:224] Handling call
0709 12:11:24.670392 (+1342988us) spinlock_profiling.cc:243] Waited 777 ms on lock 0x7b540009fe54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:24.670538 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1786064256}
I20260709 12:11:24.680533 13727 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:24.686506 13651 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:24.687879 13651 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:24.689728 13683 raft_consensus.cc:1240] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:24.690399 13726 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:24.691128 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:24.691491 17859 consensus_queue.cc:1048] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 12:11:24.691987 17657 raft_consensus.cc:2804] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:24.692196 17859 consensus_queue.cc:1243] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer 96701a74fdee481fb5f54aac841e17dd log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:11:24.692576 17657 raft_consensus.cc:697] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 16 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:24.692838 17950 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.693370 17950 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:24.693506 17657 consensus_queue.cc:237] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:24.696288 13685 raft_consensus.cc:1240] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:24.699805 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:24.685362 17683 raft_consensus.cc:2804] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:24.700675 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:24.685683 17898 raft_consensus.cc:2804] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:24.702482 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:24.683630 17361 raft_consensus.cc:2804] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:24.726192 13679 raft_consensus.cc:1240] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:11:24.702345 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:24.702729 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:24.732407 13687 raft_consensus.cc:2410] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:11:24.728822 13684 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 11.
I20260709 12:11:24.732710 13680 raft_consensus.cc:2393] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 8: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
W20260709 12:11:24.735205 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 44878.9us
I20260709 12:11:24.735517 13683 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 11.
I20260709 12:11:24.737507 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:24.738857 13727 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:11:24.743007 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 54631.3us
I20260709 12:11:24.696599 17871 raft_consensus.cc:2749] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:24.698381 17900 raft_consensus.cc:2804] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:11:24.747781 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 95113.6us
I20260709 12:11:24.749147 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:24.749687 13828 pending_rounds.cc:85] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 3
I20260709 12:11:24.749843 13680 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:24.750105 13828 pending_rounds.cc:107] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 12:11:24.683890 17927 consensus_queue.cc:1048] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 12:11:24.685184 17804 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:24.750543 13828 raft_consensus.cc:2889] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:24.754105 13754 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "b98d2519bb504dc6905ed2ede4571835"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:11:24.758912 13754 raft_consensus.cc:606] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 LEADER]: Received request to transfer leadership to TS b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:24.736653 17898 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.752343 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:24.753104 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:24.765437 13683 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:24.749752 17900 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:24.755208 13858 debug-util.cc:398] Leaking SignalData structure 0x7b080010b780 after lost signal to thread 13712
I20260709 12:11:24.766958 13680 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 8.
W20260709 12:11:24.767673 13858 debug-util.cc:398] Leaking SignalData structure 0x7b080023d6a0 after lost signal to thread 13787
W20260709 12:11:24.767988 13858 debug-util.cc:398] Leaking SignalData structure 0x7b08003136e0 after lost signal to thread 13788
W20260709 12:11:24.756785 13634 auto_rebalancer.cc:629] Failed to schedule move for tablet 407aabb01908409185c74e2349da4c3d: Illegal state: Replica 96701a74fdee481fb5f54aac841e17dd is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:11:24.744177 17859 raft_consensus.cc:2804] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:24.754091 13652 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:24.757642 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:11:24.777612 13858 debug-util.cc:398] Leaking SignalData structure 0x7b08003e8180 after lost signal to thread 13861
W20260709 12:11:24.782716 13858 debug-util.cc:398] Leaking SignalData structure 0x7b0800354a20 after lost signal to thread 13862
W20260709 12:11:24.784366 13858 debug-util.cc:398] Leaking SignalData structure 0x7b08002ca860 after lost signal to thread 14440
W20260709 12:11:24.784744 13858 debug-util.cc:398] Leaking SignalData structure 0x7b0800370f40 after lost signal to thread 14441
I20260709 12:11:24.785454 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:24.786196 13684 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:24.787045 17922 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.787619 17922 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:24.747102 17861 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:24.793639 13800 leader_election.cc:400] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 11. Current term is 12.
I20260709 12:11:24.810462 13800 leader_election.cc:403] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:24.747005 17602 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.746809 17827 raft_consensus.cc:2804] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:24.803265 13683 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 11.
I20260709 12:11:24.807765 13684 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 12.
I20260709 12:11:24.809381 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:24.813338 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:24.822638 13758 raft_consensus.cc:2393] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 11: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:24.777908 17898 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:24.830188 13680 raft_consensus.cc:2393] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 11: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:24.828799 13687 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 9.
I20260709 12:11:24.776373 17900 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:24.809751 17922 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:24.844481 13679 raft_consensus.cc:1240] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:24.812397 17856 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.815907 17665 raft_consensus.cc:2764] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:11:24.858511 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:24.852237 17796 raft_consensus.cc:2749] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:24.852903 17947 log.cc:927] Time spent T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 12:11:24.856659 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:24.832720 17683 raft_consensus.cc:697] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 13 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:24.882098 13831 raft_consensus.cc:1275] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:24.858470 13687 raft_consensus.cc:1240] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:24.815523 17859 raft_consensus.cc:697] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:24.815896 17827 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:24.826330 17912 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.826464 17882 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:11:24.861207 13686 raft_consensus.cc:1275] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:24.857471 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:24.979157 13683 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 10.
I20260709 12:11:24.864651 17950 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:24.872596 17869 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:24.873224 13754 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "b98d2519bb504dc6905ed2ede4571835"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:11:24.985121 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:24.862737 17578 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:24.877866 17817 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.879335 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:24.880545 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:24.861968 17856 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:24.995940 13835 raft_consensus.cc:2393] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 11: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:24.880914 14414 raft_consensus.cc:1275] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:24.883508 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:24.903777 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:24.997745 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 115831us
I20260709 12:11:24.998100 13763 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 11.
I20260709 12:11:24.906242 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:24.816447 17861 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:24.954836 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:25.002000 13756 raft_consensus.cc:2393] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 11: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:24.964130 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:24.963343 13761 raft_consensus.cc:1275] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 12:11:24.961052 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 207046us
I20260709 12:11:24.912892 13762 raft_consensus.cc:1240] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:24.827611 17602 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:24.962105 13836 raft_consensus.cc:1275] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 12:11:24.963039 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:24.956274 13634 auto_rebalancer.cc:629] Failed to schedule move for tablet 66aa0310b814479591b9f665634674f1: Illegal state: Replica 96701a74fdee481fb5f54aac841e17dd is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:11:24.980285 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:25.012959 13757 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 9.
I20260709 12:11:24.911034 17827 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:25.000519 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:25.016315 13687 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 10.
I20260709 12:11:25.000672 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:25.006978 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:25.022996 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:25.016733 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:25.025012 13687 raft_consensus.cc:1275] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:25.027125 13761 raft_consensus.cc:2410] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 12:11:25.031349 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 94531.4us
I20260709 12:11:24.960559 17912 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:25.046756 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.999502 17578 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:25.051996 13652 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:25.053903 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:25.055346 17861 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:25.025483 17361 raft_consensus.cc:697] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 9 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:25.054927 13585 catalog_manager.cc:5697] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:11:25.057699 17522 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.060379 13684 raft_consensus.cc:1275] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:11:25.060760 13757 raft_consensus.cc:1240] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:25.061429 13682 raft_consensus.cc:1275] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:11:25.061594 17856 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:25.063123 17583 consensus_queue.cc:1048] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:25.025844 17683 consensus_queue.cc:237] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:25.006165 17817 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:25.066085 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:25.067453 13688 raft_consensus.cc:1275] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:11:25.068146 13763 raft_consensus.cc:1240] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:25.069166 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:25.069895 17912 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:25.073496 17665 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:25.074167 17964 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.075049 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:25.075599 17866 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.039477 17804 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:25.077303 17853 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:25.088464 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 86310.9us
I20260709 12:11:25.092289 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:25.133132 13682 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 11.
I20260709 12:11:25.088395 13759 raft_consensus.cc:1275] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:11:25.094916 13585 catalog_manager.cc:5697] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 7 to 8, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 8 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:11:25.066915 13762 raft_consensus.cc:1240] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:25.137447 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:25.137151 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:25.140230 13684 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 11.
I20260709 12:11:25.142747 13758 raft_consensus.cc:1275] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:25.142769 13681 raft_consensus.cc:1275] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:11:25.152910 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:25.154526 13758 raft_consensus.cc:1275] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 12:11:25.155074 13758 pending_rounds.cc:85] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting all ops after (but not including) 8
I20260709 12:11:25.155342 13758 pending_rounds.cc:107] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 12:11:25.155637 13758 raft_consensus.cc:2889] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:25.156605 14414 raft_consensus.cc:1275] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 12:11:25.157015 14414 pending_rounds.cc:85] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f: Aborting all ops after (but not including) 8
I20260709 12:11:25.157209 13834 raft_consensus.cc:2468] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 11.
I20260709 12:11:25.156652 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:25.158291 13688 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 10.
I20260709 12:11:25.158406 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:25.157256 14414 pending_rounds.cc:107] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 12:11:25.161662 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:25.158237 13585 catalog_manager.cc:5697] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 2 to 3, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 3 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:25.169255 13757 raft_consensus.cc:3055] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:11:25.169601 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.169697 13757 raft_consensus.cc:740] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:25.169978 13681 raft_consensus.cc:1275] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 8 index: 3. Preceding OpId from leader: term: 10 index: 4. (index mismatch)
I20260709 12:11:25.171802 14379 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:25.173010 14379 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:25.161568 14414 raft_consensus.cc:2889] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:25.175575 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.175648 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:11:25.170394 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 137110us
I20260709 12:11:25.137363 17927 raft_consensus.cc:2764] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:11:25.142867 17935 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.180619 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:25.179637 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:25.186553 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:25.039050 17859 consensus_queue.cc:237] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:25.183346 13585 catalog_manager.cc:5697] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:25.192509 14379 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:25.195940 13801 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:25.195972 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:25.199476 13687 raft_consensus.cc:1275] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:25.157925 17856 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.097409 17522 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:25.211330 13680 raft_consensus.cc:1275] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:25.170900 17804 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.135099 17665 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:25.199105 13757 consensus_queue.cc:260] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:25.185318 17950 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:25.137210 17866 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:25.215256 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:25.185133 17778 raft_consensus.cc:2749] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:25.228340 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:25.228557 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:25.229434 13688 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 7.
I20260709 12:11:25.230033 13679 raft_consensus.cc:3055] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:25.230425 13679 raft_consensus.cc:740] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:25.217017 13585 catalog_manager.cc:5697] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 5 to 7, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 7 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:11:25.223084 13833 raft_consensus.cc:1240] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 12 LEADER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:25.142462 17853 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:25.234786 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 48038.9us
W20260709 12:11:25.226372 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.229079 14414 raft_consensus.cc:2468] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 8.
I20260709 12:11:25.236137 13683 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 8.
I20260709 12:11:25.184923 17871 consensus_queue.cc:1048] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
W20260709 12:11:25.221240 17951 log.cc:927] Time spent T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.235s	user 0.001s	sys 0.000s
W20260709 12:11:25.239326 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 196423us
I20260709 12:11:25.214651 17917 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.239554 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:25.240402 13836 raft_consensus.cc:1275] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:11:25.231230 13679 consensus_queue.cc:260] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:25.244843 13585 catalog_manager.cc:5697] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 4 to 5, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 5 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:11:25.135205 17964 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:25.267354 13652 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:25.202075 17935 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:25.276355 17778 consensus_queue.cc:1048] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:25.208565 17856 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:25.272543 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.223800 17804 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:25.287288 13784 debug-util.cc:398] Leaking SignalData structure 0x7b08002a1a20 after lost signal to thread 12518
I20260709 12:11:25.228021 17533 consensus_queue.cc:1048] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 12:11:25.275934 17921 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:25.277705 17946 log.cc:927] Time spent T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.326s	user 0.001s	sys 0.000s
W20260709 12:11:25.308099 13784 debug-util.cc:398] Leaking SignalData structure 0x7b08002a1200 after lost signal to thread 13620
W20260709 12:11:25.315655 13784 debug-util.cc:398] Leaking SignalData structure 0x7b080035d180 after lost signal to thread 13712
I20260709 12:11:25.285221 13679 raft_consensus.cc:3060] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:25.287282 17965 consensus_queue.cc:1059] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.020s
W20260709 12:11:25.320281 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 124413us
W20260709 12:11:25.317888 13784 debug-util.cc:398] Leaking SignalData structure 0x7b08002dec00 after lost signal to thread 13787
I20260709 12:11:25.317919 13585 catalog_manager.cc:5697] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
W20260709 12:11:25.321625 13784 debug-util.cc:398] Leaking SignalData structure 0x7b08003c6dc0 after lost signal to thread 13788
I20260709 12:11:25.275949 13835 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 11.
W20260709 12:11:25.321398 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 50525.7us
W20260709 12:11:25.319675 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 118639us
W20260709 12:11:25.323792 13784 debug-util.cc:398] Leaking SignalData structure 0x7b08002f8520 after lost signal to thread 13861
W20260709 12:11:25.324177 13784 debug-util.cc:398] Leaking SignalData structure 0x7b080033e1a0 after lost signal to thread 13862
I20260709 12:11:25.232736 17361 consensus_queue.cc:237] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:25.325630 13784 debug-util.cc:398] Leaking SignalData structure 0x7b08003e1040 after lost signal to thread 14440
I20260709 12:11:25.337407 13585 catalog_manager.cc:5697] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:25.309526 17698 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:25.286509 17917 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:25.356623 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 112683us
I20260709 12:11:25.318701 17522 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:25.317163 17602 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:25.317488 17921 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:25.352142 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:25.370216 13652 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:25.370867 14407 raft_consensus.cc:1275] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:11:25.386135 13585 catalog_manager.cc:5697] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 5 to 6, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 6 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
W20260709 12:11:25.386943 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 194511us
I20260709 12:11:25.356273 17965 raft_consensus.cc:2749] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:25.369236 13727 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:25.400386 13679 raft_consensus.cc:1275] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:11:25.427058 13585 catalog_manager.cc:5697] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 1 to 6. New cstate: current_term: 6 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:25.420256 14379 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:25.329327 17950 raft_consensus.cc:697] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 12 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
W20260709 12:11:25.432499 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 63545.2us
W20260709 12:11:25.442596 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.391695 17935 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:25.387034 17578 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:25.358105 17698 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:25.452746 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 129552us
I20260709 12:11:25.363420 17952 consensus_queue.cc:1048] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.245s
I20260709 12:11:25.456504 13585 catalog_manager.cc:5697] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:25.398900 17817 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:25.482263 17965 consensus_queue.cc:1059] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:25.482918 17981 raft_consensus.cc:2749] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:25.483279 17965 consensus_queue.cc:1048] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:25.484098 13759 raft_consensus.cc:1240] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:25.484442 17962 raft_consensus.cc:2749] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:25.484798 17965 raft_consensus.cc:3055] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:25.485247 17965 raft_consensus.cc:740] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:25.452900 17927 raft_consensus.cc:2749] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:25.498436 17950 consensus_queue.cc:237] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:25.504216 17917 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:25.506193 17853 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:25.507100 17522 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:25.507853 17522 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:25.508831 17866 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:25.515179 17698 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:25.468086 17976 consensus_queue.cc:1059] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.242s
I20260709 12:11:25.517385 17976 raft_consensus.cc:3055] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:25.517874 17976 raft_consensus.cc:740] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:25.518831 17976 consensus_queue.cc:260] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:25.471269 17871 raft_consensus.cc:2749] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:25.524130 13682 raft_consensus.cc:1240] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:25.532824 13651 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:11:25.545012 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 174850us
I20260709 12:11:25.546988 13652 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:11:25.551422 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 116219us
I20260709 12:11:25.535369 13585 catalog_manager.cc:5697] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 3 to 6, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 6 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:25.552312 14379 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:11:25.533229 17882 consensus_meta.cc:287] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.574s	user 0.008s	sys 0.000s
I20260709 12:11:25.451097 17879 consensus_queue.cc:1048] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.093s
I20260709 12:11:25.580425 13727 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:11:25.568058 17900 consensus_meta.cc:287] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.718s	user 0.012s	sys 0.000s
I20260709 12:11:25.560871 17935 raft_consensus.cc:2804] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:25.540318 17583 consensus_queue.cc:1059] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 12:11:25.566346 17871 raft_consensus.cc:2749] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:25.592142 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 305366us
I20260709 12:11:25.594412 17935 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:25.601730 17827 consensus_meta.cc:287] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.581s	user 0.012s	sys 0.001s
I20260709 12:11:25.579226 17882 raft_consensus.cc:2749] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 11. Current term is 12.
I20260709 12:11:25.587085 17578 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:25.632959 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 80711.8us
I20260709 12:11:25.635264 17964 leader_election.cc:290] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:25.636840 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:25.659559 13585 catalog_manager.cc:5697] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 2 to 7. New cstate: current_term: 7 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
W20260709 12:11:25.607249 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 117509us
I20260709 12:11:25.675094 14407 raft_consensus.cc:2468] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 11.
I20260709 12:11:25.675635 13800 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:11:25.658789 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 61673.9us
W20260709 12:11:25.663019 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 116361us
I20260709 12:11:25.664808 13726 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
W20260709 12:11:25.676878 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.677286 13652 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:25.606133 17856 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:25.665367 17657 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.044s	sys 0.065s
I20260709 12:11:25.673256 14379 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:25.634153 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:11:25.677639 17975 log.cc:927] Time spent T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
I20260709 12:11:25.664001 17683 consensus_queue.cc:1048] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:11:25.678293 13726 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:25.689005 13761 raft_consensus.cc:1240] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 8. Current term is 9. Ops: []
W20260709 12:11:25.672279 17958 log.cc:927] Time spent T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
I20260709 12:11:25.604224 17900 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:25.678032 17970 raft_consensus.cc:2804] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:25.686203 14414 raft_consensus.cc:2468] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 9.
I20260709 12:11:25.688076 14379 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:25.670084 17935 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:25.667151 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 116654us
I20260709 12:11:25.669391 17927 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:11:25.751588 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 63597.9us
I20260709 12:11:25.692116 17987 raft_consensus.cc:3055] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:25.692533 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:25.693926 17972 consensus_queue.cc:1048] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:11:25.697454 13830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 2516) took 1004 ms. Trace:
I20260709 12:11:25.699774 17869 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:25.680872 17522 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:25.701517 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:25.702525 14408 raft_consensus.cc:1275] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:11:25.674199 17827 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:25.745044 17879 raft_consensus.cc:2749] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:25.742095 17988 raft_consensus.cc:2749] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:25.741593 17957 consensus_queue.cc:1048] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.277s
I20260709 12:11:25.741917 17969 consensus_queue.cc:1059] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.314s
W20260709 12:11:25.744357 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 68815.9us
W20260709 12:11:25.747507 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 70285.8us
I20260709 12:11:25.741972 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:25.683030 17894 raft_consensus.cc:2749] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:25.678654 17578 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:25.752568 14379 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:11:25.685531 17657 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.045s	sys 0.065s
I20260709 12:11:25.742724 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:25.753885 13585 catalog_manager.cc:5697] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 6 to 7, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 7 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:25.594578 17965 consensus_queue.cc:260] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:25.751451 17851 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:25.774945 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 96723.4us
W20260709 12:11:25.742969 17982 log.cc:927] Time spent T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:11:25.907814 13685 raft_consensus.cc:1240] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 16 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:25.788403 13684 raft_consensus.cc:2393] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 11: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
W20260709 12:11:25.811877 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.705080 17921 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:25.803000 13652 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
W20260709 12:11:25.813906 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 136828us
I20260709 12:11:25.757691 14407 raft_consensus.cc:1275] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 12:11:25.808759 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 56294.3us
I20260709 12:11:25.916746 14379 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:25.792913 13755 raft_consensus.cc:1240] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:25.803359 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 56468.1us
I20260709 12:11:25.796623 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:25.918964 14408 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:25.689744 17962 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:11:25.909075 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:25.925806 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:25.812206 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:25.926993 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.919291 13651 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:25.789265 13830 rpcz_store.cc:276] 0709 12:11:24.693178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.695596 (+  2418us) service_pool.cc:224] Handling call
0709 12:11:24.695899 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:24.698068 (+  2169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:24.698088 (+    20us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:24.698501 (+   413us) log.cc:844] Serialized 26 byte log entry
0709 12:11:25.150202 (+451701us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:11:25.150243 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:25.150312 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:25.697231 (+546919us) raft_consensus.cc:1685] finished
0709 12:11:25.697251 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:25.697394 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1794,"raft.queue_time_us":1914,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":26055,"thread_start_us":411964,"threads_started":1,"wal-append.queue_time_us":490808}
I20260709 12:11:25.909487 13727 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:25.747488 17970 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:25.917248 14380 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:25.924257 13726 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:25.924376 14379 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:25.951357 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:25.804457 17898 consensus_meta.cc:287] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.958s	user 0.010s	sys 0.004s
W20260709 12:11:25.771533 17955 log.cc:927] Time spent T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.749s	user 0.008s	sys 0.000s
I20260709 12:11:25.931596 17894 consensus_queue.cc:1048] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:11:25.792022 17978 consensus_queue.cc:1048] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.140s
I20260709 12:11:25.792721 17827 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:25.797014 17969 consensus_queue.cc:1243] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Peer 96701a74fdee481fb5f54aac841e17dd log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 12:11:25.932415 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.932662 17952 raft_consensus.cc:2749] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:25.935964 17956 raft_consensus.cc:2804] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:25.938334 13585 catalog_manager.cc:5697] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 7 to 8, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 8 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
W20260709 12:11:25.940359 17983 log.cc:927] Time spent T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.254s	user 0.000s	sys 0.001s
W20260709 12:11:25.943399 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 140484us
I20260709 12:11:25.997900 13800 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:25.998490 13652 leader_election.cc:400] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 7. Current term is 8.
I20260709 12:11:25.944027 17657 raft_consensus.cc:2764] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:11:25.918387 17972 consensus_queue.cc:1048] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 12:11:25.783670 17976 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:25.952780 14408 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 10.
I20260709 12:11:25.953320 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:25.781646 17977 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.790119 17804 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:25.958163 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:25.774741 17912 raft_consensus.cc:2804] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:25.959239 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:26.062657 13829 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 13.
I20260709 12:11:25.961246 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:26.064714 13835 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 8.
I20260709 12:11:25.962904 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:25.759896 17986 raft_consensus.cc:2749] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:25.909240 17957 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:11:26.062826 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 56458.1us
I20260709 12:11:26.068552 13686 raft_consensus.cc:1240] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 9 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:26.068836 13652 leader_election.cc:304] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:25.803077 17871 raft_consensus.cc:2804] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:25.970042 13759 raft_consensus.cc:1275] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:25.800688 17665 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:25.787870 17987 raft_consensus.cc:740] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:25.786623 17900 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:25.971766 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:26.076790 13683 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 9.
I20260709 12:11:25.973961 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:25.976177 13801 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:11:25.972070 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 47832us
I20260709 12:11:25.978243 13684 raft_consensus.cc:1275] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 12:11:26.077836 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 101742us
I20260709 12:11:25.978988 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:26.008600 17972 consensus_queue.cc:1243] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer 96701a74fdee481fb5f54aac841e17dd log is divergent from this leader: its last log entry 13.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:11:25.973892 17997 consensus_queue.cc:1059] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.104s
I20260709 12:11:25.954846 17970 raft_consensus.cc:3060] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:25.995002 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:26.089051 13833 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:25.772570 17882 consensus_queue.cc:1048] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.219s
I20260709 12:11:25.956890 17927 raft_consensus.cc:2804] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:26.110118 17927 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:26.110677 17927 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:26.111552 17935 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:25.957553 17869 raft_consensus.cc:2804] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:26.085399 17665 raft_consensus.cc:2749] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:26.114053 17869 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:26.114910 17869 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:26.051265 13585 catalog_manager.cc:5697] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 4 to 5, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 5 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:26.055696 13834 raft_consensus.cc:2410] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:11:26.057619 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:26.120831 13682 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:26.120875 13585 catalog_manager.cc:5697] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 4 to 5, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 5 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:26.129673 13685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1631) took 1272 ms. Trace:
I20260709 12:11:26.130242 13685 rpcz_store.cc:276] 0709 12:11:24.856880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.857012 (+   132us) service_pool.cc:224] Handling call
0709 12:11:24.857315 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:25.908337 (+1051022us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:26.129378 (+221041us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54003f11d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:26.129591 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2415456512}
I20260709 12:11:26.134037 17935 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:26.136327 13682 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 12.
I20260709 12:11:25.977224 17898 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:26.060705 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:26.066090 13832 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 12.
I20260709 12:11:26.141530 13755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2494) took 1247 ms. Trace:
I20260709 12:11:25.947620 17851 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:26.142117 13755 rpcz_store.cc:276] 0709 12:11:24.894024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.895581 (+  1557us) service_pool.cc:224] Handling call
0709 12:11:24.949173 (+ 53592us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:25.917848 (+968675us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:26.141210 (+223362us) spinlock_profiling.cc:243] Waited 843 ms on lock 0x7b54000924d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:26.141446 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1939954432}
I20260709 12:11:26.000123 17992 raft_consensus.cc:2804] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:26.144577 17992 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:26.144753 17851 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:25.968364 13761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 1790) took 1058 ms. Trace:
I20260709 12:11:26.145201 17992 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:25.967099 17602 consensus_queue.cc:1048] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 12:11:26.145819 13760 raft_consensus.cc:1240] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:26.146400 13754 raft_consensus.cc:606] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Received request to transfer leadership to TS b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:26.146858 13754 raft_consensus.cc:614] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:26.087637 17984 raft_consensus.cc:2804] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:26.147423 13760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2498) took 1244 ms. Trace:
I20260709 12:11:26.147895 13760 rpcz_store.cc:276] 0709 12:11:24.902833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.903338 (+   505us) service_pool.cc:224] Handling call
0709 12:11:24.965537 (+ 62199us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:26.146267 (+1180730us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:26.147183 (+   916us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b5400087fd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:26.147363 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2713924352}
I20260709 12:11:26.149286 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:26.145466 13761 rpcz_store.cc:276] 0709 12:11:24.909596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:25.059076 (+149480us) service_pool.cc:224] Handling call
0709 12:11:25.059447 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:25.689569 (+630122us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:25.968134 (+278565us) spinlock_profiling.cc:243] Waited 629 ms on lock 0x7b5400417654. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:25.968306 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1447333248}
I20260709 12:11:26.147467 17984 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:26.153445 17984 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:26.153640 13754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:39554 (request call id 42) took 1280 ms. Trace:
I20260709 12:11:26.153891 17665 consensus_queue.cc:1059] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:26.154186 13754 rpcz_store.cc:276] 0709 12:11:24.872843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.873017 (+   174us) service_pool.cc:224] Handling call
0709 12:11:26.153395 (+1280378us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b5400087fd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f87853 00007fa92cf5560a 00007fa9264db7d4 00007fa9264db762 00007fa9264db691 00007fa9264db60c 00007fa9264da8c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:26.153533 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2665309056}
I20260709 12:11:26.154884 17665 raft_consensus.cc:3055] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:26.155288 17665 raft_consensus.cc:740] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:26.156141 13686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1638) took 1100 ms. Trace:
I20260709 12:11:26.156108 17665 consensus_queue.cc:260] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:26.156675 13686 rpcz_store.cc:276] 0709 12:11:25.055906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:25.065113 (+  9207us) service_pool.cc:224] Handling call
0709 12:11:25.065481 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:26.069224 (+1003743us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:26.155891 (+ 86667us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54002c3b54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:26.156078 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2306255232}
I20260709 12:11:26.002015 17956 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:26.157987 17956 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:26.153712 17999 consensus_queue.cc:1059] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 12:11:26.158957 17999 raft_consensus.cc:3055] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:26.159307 17999 raft_consensus.cc:740] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:26.160142 17999 consensus_queue.cc:260] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:26.160526 17992 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:26.161404 17999 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:26.157505 17665 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:25.979336 13758 raft_consensus.cc:1275] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:11:26.164853 13757 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:25.985668 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:26.078786 13801 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:11:26.165874 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 87207.7us
I20260709 12:11:26.080001 14379 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:25.982468 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:26.085299 17994 raft_consensus.cc:2804] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:26.082584 17361 consensus_queue.cc:1048] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 12:11:26.076220 17871 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:26.091365 17987 consensus_queue.cc:260] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:26.094154 13756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 1785) took 1186 ms. Trace:
I20260709 12:11:26.099681 17578 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:26.100934 13828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 2518) took 1355 ms. Trace:
I20260709 12:11:26.179592 13756 rpcz_store.cc:276] 0709 12:11:24.907611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:25.015693 (+108082us) service_pool.cc:224] Handling call
0709 12:11:25.016108 (+   415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:25.187183 (+171075us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:25.187220 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:25.187635 (+   415us) log.cc:844] Serialized 26 byte log entry
0709 12:11:25.447123 (+259488us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:11:25.447172 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:25.447263 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:26.093858 (+646595us) raft_consensus.cc:1685] finished
0709 12:11:26.093887 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:26.094055 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":62177,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":107,"thread_start_us":390698,"threads_started":2,"wal-append.queue_time_us":468154}
I20260709 12:11:26.180846 13828 rpcz_store.cc:276] 0709 12:11:24.745443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.745735 (+   292us) service_pool.cc:224] Handling call
0709 12:11:24.746131 (+   396us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:24.785301 (+ 39170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:24.785335 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:24.785985 (+   650us) log.cc:844] Serialized 52 byte log entry
0709 12:11:24.900124 (+114139us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:11:24.900170 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:24.900270 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:25.770628 (+870358us) spinlock_profiling.cc:243] Waited 2.13 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:11:26.100576 (+329948us) raft_consensus.cc:1685] finished
0709 12:11:26.100603 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:26.100861 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12740,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":92,"spinlock_wait_cycles":4900608,"thread_start_us":113693,"threads_started":1,"wal-append.queue_time_us":197936}
I20260709 12:11:26.074777 18003 raft_consensus.cc:2804] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:26.088876 17913 consensus_queue.cc:1048] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:11:26.071075 17912 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:26.066802 17977 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:26.135759 17935 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.124306 13585 catalog_manager.cc:5697] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:26.138851 17921 raft_consensus.cc:3055] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:26.076668 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:26.077535 13831 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:26.057961 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 60174.5us
I20260709 12:11:26.206635 13800 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:26.205420 13680 raft_consensus.cc:2468] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 8.
I20260709 12:11:26.169217 13830 raft_consensus.cc:2393] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 10: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
W20260709 12:11:26.175874 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 95956.3us
I20260709 12:11:26.209038 14379 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:26.189566 13758 raft_consensus.cc:1275] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:11:26.213999 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:26.214974 13686 raft_consensus.cc:2376] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 9. Re-sending same reply.
I20260709 12:11:26.175437 17879 raft_consensus.cc:2804] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:26.216797 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:26.180735 17871 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:26.178401 17882 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:26.175392 17994 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:26.180613 17957 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:26.220558 13685 raft_consensus.cc:2468] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 6.
I20260709 12:11:26.201807 13757 raft_consensus.cc:1275] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 12:11:26.239223 13757 pending_rounds.cc:85] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting all ops after (but not including) 9
I20260709 12:11:26.222084 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:26.240727 13682 raft_consensus.cc:2376] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 9. Re-sending same reply.
I20260709 12:11:26.218139 14379 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:26.229597 13800 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:26.243422 13800 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:26.191715 17912 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:26.184633 18003 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:26.245764 18003 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:26.224920 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:26.246675 14415 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 10.
I20260709 12:11:26.236429 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:26.248484 13684 raft_consensus.cc:2376] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 9. Re-sending same reply.
I20260709 12:11:26.219220 17981 consensus_queue.cc:1048] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 12:11:26.249699 17997 raft_consensus.cc:2804] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:26.250385 17997 raft_consensus.cc:697] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 11 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:26.204180 17987 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:26.258208 13831 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 13.
I20260709 12:11:26.258618 13727 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
W20260709 12:11:26.259613 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 190828us
I20260709 12:11:26.259775 13800 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:26.180589 17927 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:26.222380 17898 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:26.239647 17869 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:26.222548 17976 raft_consensus.cc:2749] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:26.219731 17879 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:26.219502 17778 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:26.253710 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:26.280360 13837 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:26.260767 13652 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:26.260861 13727 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:26.216518 17921 raft_consensus.cc:740] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:26.266420 13757 pending_rounds.cc:107] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 12:11:26.282373 13757 raft_consensus.cc:2889] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:26.283569 13757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 1796) took 1193 ms. Trace:
I20260709 12:11:26.264300 17827 raft_consensus.cc:2804] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:26.221280 17935 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:26.291280 13652 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:26.275025 13800 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:26.252842 17994 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:26.256894 17894 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:26.270498 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 313946us
I20260709 12:11:26.262599 17917 raft_consensus.cc:2749] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:26.300876 18000 consensus_queue.cc:1048] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.120s
I20260709 12:11:26.284134 13757 rpcz_store.cc:276] 0709 12:11:25.089830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:25.137083 (+ 47253us) service_pool.cc:224] Handling call
0709 12:11:25.169132 (+ 32049us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:25.774567 (+605435us) spinlock_profiling.cc:243] Waited 555 ms on lock 0x7b58007befd0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927ee90aa 00007fa927f6b447 00007fa927f83fe7 00007fa927f857de 00007fa927f8fb49 00007fa927f90416 00007fa927f8cd8f 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4
0709 12:11:26.164273 (+389706us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b54003785a0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f02a1d 00007fa927ee91a4 00007fa927f6b447 00007fa927f83fe7 00007fa927f857de 00007fa927f8fb49 00007fa927f90416 00007fa927f8cd8f 00007fa927f8c83e 00007fa92cf51419
0709 12:11:26.283185 (+118912us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:26.283472 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1755840512}
I20260709 12:11:26.301235 17894 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:26.303454 17898 raft_consensus.cc:2804] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:26.303364 13727 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:26.304073 17898 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:26.304489 17898 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:26.304682 17995 raft_consensus.cc:2749] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:26.304997 13727 leader_election.cc:304] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:26.309015 13727 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:26.312218 17972 raft_consensus.cc:2804] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:26.313144 17972 raft_consensus.cc:697] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:26.313839 13726 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
W20260709 12:11:26.272104 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 54063.5us
I20260709 12:11:26.296366 13837 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 13.
I20260709 12:11:26.315937 14379 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:26.279439 17981 raft_consensus.cc:2804] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:26.314483 13727 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:26.323211 14379 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:26.281821 17879 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:26.330449 13800 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:26.325464 17995 raft_consensus.cc:2749] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:11:26.336098 18011 raft_consensus.cc:2749] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:26.336655 17978 consensus_queue.cc:1048] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:26.336522 17921 consensus_queue.cc:260] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:26.337764 13726 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:26.261720 17882 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:26.346508 13800 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:26.290421 17827 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:26.326561 17917 raft_consensus.cc:2749] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:26.345402 17986 raft_consensus.cc:2804] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:26.366484 13687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2401) took 1181 ms. Trace:
I20260709 12:11:26.366586 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:26.367367 14415 raft_consensus.cc:2368] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 11. Current term is 12.
I20260709 12:11:26.347059 17952 raft_consensus.cc:2804] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:26.366987 13687 rpcz_store.cc:276] 0709 12:11:25.185378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:25.210661 (+ 25283us) service_pool.cc:224] Handling call
0709 12:11:25.810232 (+599571us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:25.810424 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:25.810467 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:25.810530 (+    63us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:25.810578 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:25.810648 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:26.366305 (+555657us) spinlock_profiling.cc:243] Waited 599 ms on lock 0x7b54002459d0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:26.366426 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1378156800}
I20260709 12:11:26.352047 17976 raft_consensus.cc:2804] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:26.353070 17981 raft_consensus.cc:697] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 9 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:26.378530 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:26.380574 14407 raft_consensus.cc:1240] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:26.377477 13800 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:26.358537 17533 raft_consensus.cc:2804] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:26.365983 17986 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:26.365386 17827 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:26.385641 17986 raft_consensus.cc:3060] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:26.393657 17927 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:26.381101 17851 raft_consensus.cc:2804] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:26.398603 17869 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:26.398495 17966 consensus_queue.cc:1048] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 12:11:26.380165 17602 raft_consensus.cc:2804] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:26.399418 17602 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:26.399827 17602 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:26.400166 17966 consensus_queue.cc:1048] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:26.403540 17965 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:26.404191 17898 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:26.381062 17976 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:26.406157 17976 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:26.406489 17981 consensus_queue.cc:237] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:26.410631 17977 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:26.387910 17917 raft_consensus.cc:2749] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:26.382969 17921 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:26.418460 17992 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:26.384758 17952 raft_consensus.cc:697] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 9 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:26.450572 13833 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 12.
W20260709 12:11:26.498205 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:26.503051 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:11:26.504345 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 46463.1us
I20260709 12:11:26.515914 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:26.439409 17935 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:26.524866 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:26.526322 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:26.526517 13652 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:26.410662 17898 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:26.526957 13687 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:11:26.450232 17856 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:26.527609 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 142365us
I20260709 12:11:26.319380 17997 consensus_queue.cc:237] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:26.532822 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 195150us
W20260709 12:11:26.533305 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 175017us
I20260709 12:11:26.452941 17817 raft_consensus.cc:2749] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:11:26.561681 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 56417.4us
I20260709 12:11:26.563167 13652 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:26.611088 13800 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:26.632973 17879 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:26.634120 13755 raft_consensus.cc:1275] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:26.627249 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:26.644805 13759 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:26.529050 17533 raft_consensus.cc:697] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:11:26.617722 17974 log.cc:927] Time spent T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 12:11:26.534715 17851 raft_consensus.cc:697] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 10 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:26.590339 17962 raft_consensus.cc:2749] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:26.434512 17972 consensus_queue.cc:237] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:26.447558 17956 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:26.524379 17361 consensus_queue.cc:1048] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.123s
W20260709 12:11:26.673028 17984 consensus_meta.cc:287] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.519s	user 0.011s	sys 0.004s
I20260709 12:11:26.697007 17984 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:26.675688 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 62636.6us
W20260709 12:11:26.676137 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 113097us
I20260709 12:11:26.707134 13652 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:26.468329 17990 consensus_queue.cc:1048] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.236s
I20260709 12:11:26.679106 13687 raft_consensus.cc:2468] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 12.
I20260709 12:11:26.637966 18026 raft_consensus.cc:2749] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:26.701190 14416 raft_consensus.cc:1240] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:26.640200 18000 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.653852 17657 raft_consensus.cc:2749] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:26.726583 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 106384us
I20260709 12:11:26.727897 13726 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:26.711211 14379 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:26.610263 17912 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:26.647644 17683 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:26.616788 17856 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:26.726527 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 106371us
I20260709 12:11:26.731940 13761 raft_consensus.cc:1240] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:11:26.739411 13727 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:26.744258 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:26.737658 18032 raft_consensus.cc:2804] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:26.745324 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:26.685810 18009 raft_consensus.cc:2804] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:26.766142 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:26.780169 13682 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 12.
I20260709 12:11:26.767153 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:26.769536 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:26.782011 13687 raft_consensus.cc:2393] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 10: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:26.720412 17935 raft_consensus.cc:2749] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:26.775421 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:26.792007 13685 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 10.
I20260709 12:11:26.792958 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:26.793547 13685 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 8.
I20260709 12:11:26.793654 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:26.776538 13686 raft_consensus.cc:1275] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 12:11:26.733012 17665 consensus_meta.cc:287] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.557s	user 0.004s	sys 0.016s
I20260709 12:11:26.778481 13760 raft_consensus.cc:2393] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 12: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:26.789331 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:26.790289 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:26.733649 17778 raft_consensus.cc:2749] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:26.591148 17952 consensus_queue.cc:237] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:26.806360 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:26.827180 13682 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:26.818840 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:26.829982 13685 raft_consensus.cc:2410] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:11:26.830451 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:11:26.824319 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 213341us
I20260709 12:11:26.679606 18003 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:26.833719 13800 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:26.733318 17987 consensus_queue.cc:1048] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.086s
I20260709 12:11:26.804744 17698 raft_consensus.cc:2804] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:26.837921 13652 leader_election.cc:400] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 11. Current term is 12.
I20260709 12:11:26.849638 13652 leader_election.cc:403] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:26.805048 17882 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:26.733248 18000 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:26.741196 17978 consensus_queue.cc:1048] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.091s
I20260709 12:11:26.851670 13652 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:26.850562 13682 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 11.
I20260709 12:11:26.831723 17665 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.747169 17683 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:26.869575 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:26.835533 18032 raft_consensus.cc:697] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:11:26.876513 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 165381us
I20260709 12:11:26.846201 17898 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:26.850970 18022 log.cc:927] Time spent T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.404s	user 0.002s	sys 0.000s
I20260709 12:11:26.888176 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:26.884826 13682 raft_consensus.cc:1275] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:26.889460 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:26.889974 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:26.897562 13831 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 9.
I20260709 12:11:26.890388 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:26.859954 18028 raft_consensus.cc:2804] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:26.850657 17606 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.934609 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:26.935442 13837 raft_consensus.cc:2376] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 8. Re-sending same reply.
I20260709 12:11:26.852285 17698 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:26.894294 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:26.900197 13726 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:26.900224 13828 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 11.
I20260709 12:11:26.906685 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:26.941339 13836 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:26.942229 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:26.944269 13830 raft_consensus.cc:1275] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 12:11:26.908950 18019 log.cc:927] Time spent T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:11:26.909018 13831 raft_consensus.cc:1217] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Deduplicated request from leader. Original: 6.4->[8.5-13.8]   Dedup: 10.6->[11.7-13.8]
W20260709 12:11:26.910090 17976 consensus_meta.cc:287] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.503s	user 0.010s	sys 0.002s
I20260709 12:11:26.882125 17990 consensus_queue.cc:1048] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:11:26.911540 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:26.912269 18039 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:11:26.925607 17965 consensus_meta.cc:287] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.522s	user 0.000s	sys 0.016s
I20260709 12:11:26.913897 17981 consensus_queue.cc:1048] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 12:11:26.914129 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:26.914711 18030 raft_consensus.cc:2804] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:26.918659 18038 raft_consensus.cc:2804] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:26.825614 17851 consensus_queue.cc:237] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:26.927630 18036 log.cc:927] Time spent T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:11:26.930430 17856 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:26.835345 17602 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:26.948354 13831 pending_rounds.cc:85] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 6
I20260709 12:11:27.010205 13831 pending_rounds.cc:107] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 12:11:27.010541 13831 raft_consensus.cc:2889] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:26.952040 13829 raft_consensus.cc:1240] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 12. Current term is 13. Ops: [8.7-12.9]
I20260709 12:11:26.954092 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:27.013074 13828 raft_consensus.cc:2468] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 8.
I20260709 12:11:26.825439 17533 consensus_queue.cc:237] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:26.888901 17935 raft_consensus.cc:2749] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 11. Current term is 12.
W20260709 12:11:26.956807 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 56705.8us
I20260709 12:11:27.017194 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:27.018134 13726 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:26.960234 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:26.997994 17879 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:26.925586 17970 consensus_meta.cc:287] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.786s	user 0.014s	sys 0.000s
W20260709 12:11:26.912886 18024 log.cc:927] Time spent T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:11:26.979081 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:27.024756 13837 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:26.929682 17986 consensus_meta.cc:287] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.539s	user 0.003s	sys 0.005s
I20260709 12:11:26.904271 18028 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:26.985672 13759 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 10.
I20260709 12:11:26.903977 17657 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:26.997170 13830 raft_consensus.cc:1240] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:26.946151 17698 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:26.987205 14412 raft_consensus.cc:2468] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 8.
W20260709 12:11:27.036499 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 50732.4us
I20260709 12:11:26.878473 17665 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:26.981070 17869 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:27.017172 17956 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:27.023726 17859 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:26.905401 17898 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:27.015316 13836 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 12.
I20260709 12:11:27.019125 13682 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:26.977190 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:26.946549 17882 consensus_queue.cc:1059] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 12:11:27.020787 13726 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:27.021298 13680 raft_consensus.cc:1275] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:11:26.999181 18030 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:26.947945 17606 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:27.024051 13828 raft_consensus.cc:1275] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:11:26.977993 17976 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:27.035159 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:27.003388 17992 consensus_queue.cc:1048] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.022s
W20260709 12:11:26.997331 18018 log.cc:927] Time spent T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.373s	user 0.001s	sys 0.000s
I20260709 12:11:27.044674 17984 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:27.031203 18037 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.057250 13763 raft_consensus.cc:2393] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 10: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
W20260709 12:11:27.083513 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 62823.5us
I20260709 12:11:27.083774 13800 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:27.102517 18042 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:27.043571 17827 consensus_meta.cc:287] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.649s	user 0.011s	sys 0.000s
I20260709 12:11:27.094609 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:26.985492 18039 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:27.042920 17869 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:27.130062 18042 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:27.131086 17869 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:27.036876 18028 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:27.039413 17912 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:27.101341 13759 raft_consensus.cc:1240] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 15. Current term is 16. Ops: [13.9-15.10]
I20260709 12:11:27.038437 17986 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:27.050570 13837 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 10.
W20260709 12:11:27.087563 18024 log.cc:927] Time spent T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.050s	user 0.002s	sys 0.000s
I20260709 12:11:27.052897 18011 raft_consensus.cc:2749] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:11:27.123935 18035 log.cc:927] Time spent T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 12:11:27.123713 18043 consensus_queue.cc:1048] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:11:27.126015 17989 consensus_queue.cc:1048] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:11:27.120254 18037 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:27.127487 17879 raft_consensus.cc:3055] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:27.130232 17827 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:27.038703 17935 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:27.096555 18030 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:27.032099 17970 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:27.039878 17657 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:27.133718 13682 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 10.
W20260709 12:11:27.134526 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 50847.6us
I20260709 12:11:27.084971 13835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 699) took 1109 ms. Trace:
I20260709 12:11:27.137105 13828 raft_consensus.cc:1275] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:11:27.094214 18038 raft_consensus.cc:697] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 12 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:27.100004 17956 raft_consensus.cc:2804] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:11:27.116971 18021 log.cc:927] Time spent T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.373s	user 0.001s	sys 0.000s
I20260709 12:11:27.015534 18032 consensus_queue.cc:237] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:27.132529 17583 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.177978 14415 raft_consensus.cc:1240] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:11:27.143042 17882 raft_consensus.cc:2749] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:27.173377 17921 consensus_meta.cc:287] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.756s	user 0.015s	sys 0.006s
I20260709 12:11:27.143210 18003 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:27.197566 13652 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:27.200018 13800 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:27.190912 14379 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:27.193979 13835 rpcz_store.cc:276] 0709 12:11:25.975333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:26.072920 (+ 97587us) service_pool.cc:224] Handling call
0709 12:11:26.073326 (+   406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:26.073726 (+   400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:26.073759 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:26.074317 (+   558us) log.cc:844] Serialized 26 byte log entry
0709 12:11:26.422337 (+348020us) spinlock_profiling.cc:243] Waited 57.1 ms on lock 0x7b18003a60c0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e82e07 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9fc02 00007fa927b2720b 00007fa927b2cd23 00007fa927b2d0d1 00007fa927f48a0f
0709 12:11:26.613875 (+191538us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:26.615045 (+  1170us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:26.615663 (+   618us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:27.084513 (+468850us) raft_consensus.cc:1685] finished
0709 12:11:27.084546 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:27.084882 (+   336us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":619,"raft.queue_time_us":831,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":7454,"spinlock_wait_cycles":131235712,"thread_start_us":190727,"threads_started":1,"wal-append.queue_time_us":643846}
W20260709 12:11:27.180492 17994 consensus_meta.cc:287] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.884s	user 0.010s	sys 0.008s
I20260709 12:11:27.205703 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:27.207751 13756 raft_consensus.cc:1240] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:27.180047 18057 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:27.178727 17683 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:27.180712 17879 raft_consensus.cc:740] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:27.206038 17956 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:27.216910 18048 log.cc:927] Time spent T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 12:11:27.217247 18012 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:27.218544 17970 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:27.195804 17935 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:27.208197 17602 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:27.238960 13652 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:27.225960 18057 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:27.241564 18037 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:27.242583 18057 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:27.244067 17827 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:27.245852 18038 consensus_queue.cc:237] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:27.254642 13652 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:27.226119 17956 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:27.228757 17683 raft_consensus.cc:2749] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:27.264851 18061 raft_consensus.cc:2749] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:27.229712 17989 raft_consensus.cc:2749] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:27.229274 17984 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:27.215421 17583 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:27.224524 17994 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:27.271646 17665 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:27.401363 13762 raft_consensus.cc:1240] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:27.401306 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:27.390038 17606 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:27.413085 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:27.397746 17898 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:27.391871 17984 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:27.414479 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:27.416425 17984 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:27.417021 13761 raft_consensus.cc:1275] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:27.418781 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:27.430002 13834 raft_consensus.cc:2393] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 12: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:27.233383 18012 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:27.423295 13837 raft_consensus.cc:1275] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:11:27.445034 13761 raft_consensus.cc:1240] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:27.456260 13837 pending_rounds.cc:85] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 4
I20260709 12:11:27.456645 13837 pending_rounds.cc:107] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 8.5
W20260709 12:11:27.455665 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 201141us
I20260709 12:11:27.349495 17879 consensus_queue.cc:260] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:27.457063 13837 raft_consensus.cc:2889] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:27.419385 18061 raft_consensus.cc:2749] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:27.463137 13652 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:27.396827 17683 consensus_queue.cc:1048] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 12:11:27.425961 18039 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:11:27.459233 17871 consensus_meta.cc:287] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 1.199s	user 0.015s	sys 0.003s
I20260709 12:11:27.454265 17902 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.469417 13652 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:27.471519 17657 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:27.472087 17698 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:27.475543 17935 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:27.493052 17935 raft_consensus.cc:2804] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:27.493561 17935 raft_consensus.cc:697] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 12 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:27.494546 17935 consensus_queue.cc:237] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:27.486351 17879 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:27.478318 18052 log.cc:927] Time spent T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.233s	user 0.003s	sys 0.000s
I20260709 12:11:27.497923 18059 raft_consensus.cc:2804] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:11:27.478849 18055 log.cc:927] Time spent T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.302s	user 0.001s	sys 0.000s
I20260709 12:11:27.498100 18011 consensus_queue.cc:1048] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:11:27.464432 18027 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.501253 18027 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:27.503502 17999 consensus_meta.cc:287] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 1.341s	user 0.018s	sys 0.000s
I20260709 12:11:27.503715 18027 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:27.467221 17665 raft_consensus.cc:2804] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:27.484498 18069 consensus_queue.cc:1059] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
W20260709 12:11:27.465565 18053 log.cc:927] Time spent T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:11:27.505482 18069 raft_consensus.cc:3055] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:27.506274 18069 raft_consensus.cc:740] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:27.506283 17665 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:27.490242 18060 log.cc:927] Time spent T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.180s	user 0.000s	sys 0.000s
I20260709 12:11:27.491519 17869 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:27.498611 18059 raft_consensus.cc:697] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 10 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:27.468030 18042 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:27.491348 13652 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:27.492206 17994 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:27.507072 17665 raft_consensus.cc:3060] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:27.509526 18074 log.cc:927] Time spent T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 12:11:27.532634 13679 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 10.
I20260709 12:11:27.516841 17698 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:27.541267 13760 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48114 (request call id 2510) took 1401 ms (client timeout 1838 ms). Trace:
W20260709 12:11:27.542241 13760 rpcz_store.cc:269] 0709 12:11:26.140221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:26.148977 (+  8756us) service_pool.cc:224] Handling call
0709 12:11:27.541097 (+1392120us) spinlock_profiling.cc:243] Waited 616 ms on lock 0x7b54003340d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:27.541212 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1416094592}
I20260709 12:11:27.486748 17871 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:27.536615 17657 raft_consensus.cc:2804] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:27.540287 18072 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:27.536777 18042 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:27.513903 18028 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:27.486542 18061 consensus_queue.cc:1059] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 12:11:27.510831 17902 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:27.517007 18069 consensus_queue.cc:260] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:27.561566 17976 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:27.563418 14413 raft_consensus.cc:1240] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:27.510792 18059 consensus_queue.cc:237] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:27.523567 17956 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:27.549185 18012 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:27.587284 17902 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:27.590608 13726 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:27.593338 17898 consensus_queue.cc:1048] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:27.596330 17898 raft_consensus.cc:2804] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:27.597767 17898 raft_consensus.cc:697] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:27.598783 17898 consensus_queue.cc:237] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:27.599298 17869 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:27.603708 18028 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:27.610253 18009 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:27.611171 18009 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:27.612691 18043 consensus_queue.cc:1048] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:27.614161 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:27.627761 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:27.636230 13828 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db"
dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
mode: GRACEFUL
new_leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
 from {username='slave'} at 127.0.0.1:43656
I20260709 12:11:27.636771 13763 raft_consensus.cc:1240] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:27.636950 13828 raft_consensus.cc:606] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 14 LEADER]: Received request to transfer leadership to TS 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:27.639839 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:27.640592 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:27.637212 17583 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:27.641279 13688 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:27.580070 17657 raft_consensus.cc:697] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 10 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:27.642609 17657 consensus_queue.cc:237] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:27.640017 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:27.646363 13683 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 12.
I20260709 12:11:27.655755 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:27.656670 13686 raft_consensus.cc:3060] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:27.660629 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:27.660709 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:27.661602 13681 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:27.663455 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:27.569476 18042 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:27.669369 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:27.670114 13684 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:27.568214 18072 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:27.634838 18069 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:27.675423 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:27.676069 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:27.676254 13683 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 11.
I20260709 12:11:27.677721 13683 raft_consensus.cc:1240] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 13 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:27.680186 13685 raft_consensus.cc:1275] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:27.684798 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:27.685909 13680 raft_consensus.cc:2468] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 9.
I20260709 12:11:27.687212 17665 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:27.690323 17665 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:27.693459 13681 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 11.
I20260709 12:11:27.698026 13684 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 13.
I20260709 12:11:27.703866 13686 raft_consensus.cc:2468] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 9.
I20260709 12:11:27.707263 13684 raft_consensus.cc:1275] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:11:27.707365 13688 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 8.
I20260709 12:11:27.707830 13681 raft_consensus.cc:1240] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:11:27.708099 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:27.708842 13686 raft_consensus.cc:2468] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 9.
I20260709 12:11:27.716782 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:27.719758 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:27.720762 13681 raft_consensus.cc:1240] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 10. Current term is 11. Ops: [6.4-10.6]
I20260709 12:11:27.721254 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:27.721808 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:27.722376 13684 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:27.725293 18042 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:27.736104 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:27.736564 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:27.737375 13681 raft_consensus.cc:2393] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 12: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:11:27.746899 13684 raft_consensus.cc:2468] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 10.
W20260709 12:11:27.736302 17859 consensus_meta.cc:287] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.656s	user 0.010s	sys 0.003s
I20260709 12:11:27.730799 18038 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:27.734385 17871 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:27.758417 14415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41692 (request call id 691) took 1309 ms. Trace:
I20260709 12:11:27.759047 14415 rpcz_store.cc:276] 0709 12:11:26.448499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:26.453652 (+  5153us) service_pool.cc:224] Handling call
0709 12:11:26.511175 (+ 57523us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:27.212428 (+701253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:27.758046 (+545618us) spinlock_profiling.cc:243] Waited 666 ms on lock 0x7b54005fee54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:27.758325 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1532719360}
I20260709 12:11:27.760517 13800 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:27.763983 17683 raft_consensus.cc:3055] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:27.764509 17683 raft_consensus.cc:740] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:27.766994 13679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2413) took 1022 ms. Trace:
I20260709 12:11:27.767406 13679 rpcz_store.cc:276] 0709 12:11:26.744787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:26.766825 (+ 22038us) service_pool.cc:224] Handling call
0709 12:11:27.766811 (+999986us) spinlock_profiling.cc:243] Waited 723 ms on lock 0x7b5400272754. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:27.766929 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1662530816}
I20260709 12:11:27.768625 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:27.769196 13679 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:27.756547 17956 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:27.753553 17859 raft_consensus.cc:2749] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:27.772441 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:11:27.777174 18078 log.cc:927] Time spent T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:11:27.777534 18072 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:27.779788 18030 consensus_meta.cc:287] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.578s	user 0.012s	sys 0.000s
I20260709 12:11:27.780967 17894 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:27.756865 18038 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:27.798859 18009 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:27.805976 14413 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41692 (request call id 690) took 1358 ms. Trace:
I20260709 12:11:27.809252 14413 rpcz_store.cc:276] 0709 12:11:26.447864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:26.448159 (+   295us) service_pool.cc:224] Handling call
0709 12:11:26.501117 (+ 52958us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:27.572660 (+1071543us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:27.805672 (+233012us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54003ebf54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:27.805904 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2442583296}
I20260709 12:11:27.807384 13686 raft_consensus.cc:1275] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:27.791015 13679 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 9.
I20260709 12:11:27.808060 13834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35422 (request call id 701) took 1305 ms. Trace:
I20260709 12:11:27.813292 13834 rpcz_store.cc:276] 0709 12:11:26.502538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:26.502703 (+   165us) service_pool.cc:224] Handling call
0709 12:11:27.807819 (+1305116us) spinlock_profiling.cc:243] Waited 926 ms on lock 0x7b54000b22d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:27.807966 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2129047936}
I20260709 12:11:27.765515 17683 consensus_queue.cc:260] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:27.808549 18030 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:27.810979 18038 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:27.830363 18054 log.cc:927] Time spent T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.586s	user 0.004s	sys 0.000s
I20260709 12:11:27.834704 17683 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:27.841645 17859 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:27.842355 17859 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:27.845225 17859 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:27.831403 17917 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.155s	user 0.007s	sys 0.017s
I20260709 12:11:27.838100 18030 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:27.848249 17917 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.178s	user 0.008s	sys 0.017s
I20260709 12:11:27.850175 13760 raft_consensus.cc:1240] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:11:27.849298 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:27.847364 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:27.846167 18038 consensus_queue.cc:1059] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 12:11:27.852713 13758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2512) took 1228 ms. Trace:
I20260709 12:11:27.853150 13758 rpcz_store.cc:276] 0709 12:11:26.624505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:26.625973 (+  1468us) service_pool.cc:224] Handling call
0709 12:11:26.626417 (+   444us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:26.726753 (+100336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:26.726786 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:26.727391 (+   605us) log.cc:844] Serialized 26 byte log entry
0709 12:11:26.985488 (+258097us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:26.985534 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:26.985689 (+   155us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:27.829808 (+844119us) spinlock_profiling.cc:243] Waited 6.4 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:11:27.850833 (+ 21025us) raft_consensus.cc:1685] finished
0709 12:11:27.850855 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:27.852634 (+  1779us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":99837,"raft.queue_time_us":108505,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":115,"spinlock_wait_cycles":14722304,"thread_start_us":207639,"threads_started":1,"wal-append.queue_time_us":445274}
I20260709 12:11:27.852588 17871 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.856375 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:27.856276 17871 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:27.856863 14416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41692 (request call id 689) took 1888 ms. Trace:
I20260709 12:11:27.857532 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:27.858278 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:27.858508 17871 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:27.859076 13759 raft_consensus.cc:1275] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:11:27.857344 14416 rpcz_store.cc:276] 0709 12:11:25.968185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:25.968391 (+   206us) service_pool.cc:224] Handling call
0709 12:11:25.968673 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:26.724499 (+755826us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:27.856580 (+1132081us) spinlock_profiling.cc:243] Waited 732 ms on lock 0x7b54005e01d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:27.856793 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1683995008}
I20260709 12:11:27.864251 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:27.866781 13758 raft_consensus.cc:1240] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 8. Current term is 9. Ops: []
W20260709 12:11:27.872011 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:27.875550 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:27.877946 13683 raft_consensus.cc:1240] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:11:27.874153 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:27.883625 13758 raft_consensus.cc:1240] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:27.883956 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:27.863601 18000 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:27.889320 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:27.890898 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:27.891713 13759 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 9.
I20260709 12:11:27.892789 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:27.882735 14416 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 11.
I20260709 12:11:27.894827 13651 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:27.899714 14379 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:27.901180 13652 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:27.902923 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:27.904044 14413 raft_consensus.cc:2410] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:11:27.910897 18009 leader_election.cc:290] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:27.912902 18059 raft_consensus.cc:2749] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:27.912781 18038 consensus_queue.cc:1059] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:27.914039 18059 raft_consensus.cc:3055] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:27.914462 18059 raft_consensus.cc:740] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:27.915824 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:27.916285 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:27.916846 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:27.917482 14415 raft_consensus.cc:3060] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:27.919179 13652 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:27.919378 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:27.917502 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:27.917059 14416 raft_consensus.cc:2393] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 12: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:11:27.923537 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:27.925170 17657 raft_consensus.cc:2804] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:27.925635 17657 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:27.926061 17657 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:27.930513 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:27.931423 13759 raft_consensus.cc:2393] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 11: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:27.933878 13651 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:27.928861 18069 consensus_queue.cc:1048] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:11:27.941243 17935 consensus_queue.cc:1059] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:27.942093 17935 raft_consensus.cc:3055] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:27.942462 17935 raft_consensus.cc:740] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:27.943383 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:27.943348 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:27.915589 18025 raft_consensus.cc:2749] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:27.945425 13685 raft_consensus.cc:2393] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 11: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:27.936174 17962 raft_consensus.cc:2749] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:27.915598 18059 consensus_queue.cc:260] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:27.959997 18059 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:27.939960 18042 raft_consensus.cc:2749] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:27.940034 18049 consensus_queue.cc:1059] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:11:27.982437 13756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2515) took 1356 ms. Trace:
I20260709 12:11:27.982671 13762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2516) took 1354 ms. Trace:
I20260709 12:11:27.983024 13762 rpcz_store.cc:276] 0709 12:11:26.628119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:26.628255 (+   136us) service_pool.cc:224] Handling call
0709 12:11:26.628531 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:27.408725 (+780194us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:27.982458 (+573733us) spinlock_profiling.cc:243] Waited 773 ms on lock 0x7b54003a02d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:27.982612 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1776753408}
I20260709 12:11:27.984253 18038 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:27.984921 18038 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:27.985723 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:27.987221 17986 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:27.982935 13756 rpcz_store.cc:276] 0709 12:11:26.625672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:26.627720 (+  2048us) service_pool.cc:224] Handling call
0709 12:11:26.653676 (+ 25956us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:27.216252 (+562576us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:27.982152 (+765900us) spinlock_profiling.cc:243] Waited 554 ms on lock 0x7b54003336d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:27.982367 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1273774464}
I20260709 12:11:27.987350 18038 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:27.969866 18072 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.990974 18072 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:27.993181 13831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 2411) took 1098 ms. Trace:
I20260709 12:11:27.995004 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:28.007949 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:11:28.008276 18065 log.cc:927] Time spent T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.559s	user 0.002s	sys 0.000s
I20260709 12:11:27.993414 18072 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:28.017970 13682 raft_consensus.cc:1275] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 12:11:28.018507 13682 pending_rounds.cc:85] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 8
I20260709 12:11:28.018404 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:28.019241 13682 pending_rounds.cc:107] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 12:11:28.019626 13682 raft_consensus.cc:2889] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:28.020376 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:27.976922 17935 consensus_queue.cc:260] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:28.035012 13687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2418) took 1260 ms. Trace:
I20260709 12:11:28.038045 14415 raft_consensus.cc:2468] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 9.
I20260709 12:11:28.038394 13726 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:28.039978 13652 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:28.040762 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:28.035567 13687 rpcz_store.cc:276] 0709 12:11:26.774875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:26.821905 (+ 47030us) service_pool.cc:224] Handling call
0709 12:11:26.822345 (+   440us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:26.891932 (+ 69587us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:26.891961 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:26.908215 (+ 16254us) log.cc:844] Serialized 52 byte log entry
0709 12:11:27.181169 (+272954us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:11:27.181741 (+   572us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:27.424029 (+242288us) spinlock_profiling.cc:243] Waited 69.1 ms on lock 0x7b54003124d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:27.424110 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:28.007416 (+583306us) spinlock_profiling.cc:243] Waited 6.92 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:11:28.034702 (+ 27286us) raft_consensus.cc:1685] finished
0709 12:11:28.034735 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:28.034938 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":48662,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":28764,"spinlock_wait_cycles":174907136,"thread_start_us":194471,"threads_started":1,"wal-append.queue_time_us":321145}
I20260709 12:11:28.089893 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:28.090975 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:28.091851 13756 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 10.
I20260709 12:11:28.091022 13686 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 9.
I20260709 12:11:28.034256 17984 raft_consensus.cc:3055] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:28.109709 13756 raft_consensus.cc:1240] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:11:28.044209 18042 raft_consensus.cc:2804] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:28.118309 18042 raft_consensus.cc:697] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 9 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:28.119448 18042 consensus_queue.cc:237] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:28.121115 13727 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:28.125872 17698 raft_consensus.cc:2804] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:28.127493 17698 raft_consensus.cc:697] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:11:28.128245 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:28.107404 17986 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.129062 17698 consensus_queue.cc:237] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:28.129509 17986 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:28.107257 17871 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:28.142097 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:28.142701 17871 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:28.145306 17871 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:28.146898 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:28.148298 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:28.108429 17935 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:28.153321 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:28.108187 17984 raft_consensus.cc:740] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:28.154448 14415 raft_consensus.cc:3060] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:28.155179 17984 consensus_queue.cc:260] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:28.156798 17984 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:28.167215 18026 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:28.168187 18026 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:28.172046 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:28.173419 14413 raft_consensus.cc:2410] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:11:28.176591 17986 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199)
I20260709 12:11:28.178400 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:28.179359 13756 raft_consensus.cc:2393] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 9: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:28.180282 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:28.181193 13684 raft_consensus.cc:2393] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 9: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:27.993695 13831 rpcz_store.cc:276] 0709 12:11:26.895209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:26.898491 (+  3282us) service_pool.cc:224] Handling call
0709 12:11:26.898858 (+   367us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 12:11:27.011233 (+112375us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:27.032037 (+ 20804us) log.cc:844] Serialized 14 byte log entry
0709 12:11:27.512666 (+480629us) spinlock_profiling.cc:243] Waited 3.23 ms on lock 0x7b1800013ae0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e82e07 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9fc02 00007fa927b2720b 00007fa927b2cd23 00007fa927b2d23a 00007fa927f97a2a
0709 12:11:27.541135 (+ 28469us) log.cc:844] Serialized 14 byte log entry
0709 12:11:27.547335 (+  6200us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:27.548347 (+  1012us) log.cc:844] Serialized 52 byte log entry
0709 12:11:27.548526 (+   179us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:27.552169 (+  3643us) log.cc:844] Serialized 14 byte log entry
0709 12:11:27.992186 (+440017us) spinlock_profiling.cc:243] Waited 2.34 ms on lock 0x7b1800013ae0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e1ac0a 00007fa92e55a219 00007fa924ea2a40 00007fa924e9d4e4 00007fa924e9d455 00007fa927f85060 00007fa927f97716 00007fa927fa8287 00007fa927fa8208
0709 12:11:27.992641 (+   455us) log.cc:844] Serialized 14 byte log entry
0709 12:11:27.992837 (+   196us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:27.992920 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:27.992968 (+    48us) raft_consensus.cc:1685] finished
0709 12:11:27.992980 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:27.993118 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":453154,"prepare.queue_time_us":40122,"prepare.run_cpu_time_us":231,"prepare.run_wall_time_us":32310,"raft.queue_time_us":467633,"raft.run_cpu_time_us":409,"raft.run_wall_time_us":10279,"spinlock_wait_cycles":21867904,"thread_start_us":28036,"threads_started":1,"wal-append.queue_time_us":607177}
I20260709 12:11:28.208060 13763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 1802) took 1327 ms. Trace:
I20260709 12:11:28.211761 13684 raft_consensus.cc:1275] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:28.212954 13680 raft_consensus.cc:1240] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:28.215613 17657 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:28.217165 18011 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.217761 18011 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:28.218343 18038 consensus_queue.cc:1048] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:28.220193 18011 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:28.221122 18038 consensus_queue.cc:1059] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:28.223331 14415 raft_consensus.cc:2468] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 9.
I20260709 12:11:28.222699 14379 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:28.096793 18061 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.238917 17966 raft_consensus.cc:2749] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:28.238668 18061 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:28.238689 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 478274us
I20260709 12:11:28.244674 17997 consensus_queue.cc:1048] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:28.245170 18057 consensus_queue.cc:1048] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:11:28.246742 18057 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.247471 13837 pending_rounds.cc:85] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 9
I20260709 12:11:28.247313 17987 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:28.247869 18094 consensus_queue.cc:1059] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:28.248131 17987 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:28.249873 17976 raft_consensus.cc:3055] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:11:28.230736 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:28.251349 13800 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:28.232903 13651 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:28.254598 17987 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:28.234516 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:28.256016 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:28.234874 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:11:28.235473 17990 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:28.256994 13756 raft_consensus.cc:1275] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:28.235983 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:28.236259 17851 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:28.258283 17851 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:28.259136 18072 consensus_queue.cc:1048] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:28.259720 17987 raft_consensus.cc:2804] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:28.260159 17987 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:28.260538 17987 raft_consensus.cc:3060] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:28.261229 17851 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:28.235478 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:28.247922 13837 pending_rounds.cc:107] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 12:11:28.263862 13837 raft_consensus.cc:2889] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:28.236928 18003 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:28.229344 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:28.247251 18057 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:28.250448 17976 raft_consensus.cc:740] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:28.234072 14379 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:28.254691 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:11:28.277643 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 44858.1us
I20260709 12:11:28.278095 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:28.208667 13763 rpcz_store.cc:276] 0709 12:11:26.880802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:27.132599 (+251797us) service_pool.cc:224] Handling call
0709 12:11:27.166135 (+ 33536us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:27.637494 (+471359us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:28.207684 (+570190us) spinlock_profiling.cc:243] Waited 463 ms on lock 0x7b54002b0cd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:28.207975 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1064987520}
W20260709 12:11:28.101854 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 63805.3us
I20260709 12:11:28.257440 17990 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:28.266170 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:28.266404 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:28.237371 18059 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:28.270035 13835 raft_consensus.cc:1240] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:28.286330 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:28.275449 13830 raft_consensus.cc:1240] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:28.255398 17927 raft_consensus.cc:2804] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:28.283922 14379 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:28.287467 14413 raft_consensus.cc:2410] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:11:28.258678 17994 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:28.280587 13726 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:28.294360 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:28.289219 13800 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:28.296875 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:28.308287 14380 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:28.308902 13800 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:28.299795 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:28.323207 13828 raft_consensus.cc:1240] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:28.333236 17913 raft_consensus.cc:2804] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:28.333761 17913 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:28.334167 17913 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:28.277117 17879 consensus_queue.cc:1059] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 12:11:28.277488 17989 consensus_queue.cc:1059] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 12:11:28.296128 17927 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:28.335840 17927 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:28.274341 17683 consensus_queue.cc:1059] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 12:11:28.307840 17917 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.338282 17683 raft_consensus.cc:3055] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:28.338747 17683 raft_consensus.cc:740] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:28.339407 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:28.339699 17683 consensus_queue.cc:260] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:28.340284 18057 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:28.292200 18038 raft_consensus.cc:2749] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:28.340898 17683 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:28.346977 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:28.338379 17917 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:28.342540 17657 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:28.313673 17994 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:28.350629 13759 raft_consensus.cc:1275] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:28.342025 18028 raft_consensus.cc:2804] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:28.344570 18061 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:28.351738 17990 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:28.276644 17997 consensus_queue.cc:1059] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 12:11:28.359218 17657 consensus_queue.cc:1048] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:11:28.380306 17871 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:28.380923 17989 raft_consensus.cc:3055] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:11:28.355947 13727 connection.cc:256] RPC call timeout handler was delayed by -1.0503950069999064s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1531s for a response
W20260709 12:11:28.358906 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 78412.9us
I20260709 12:11:28.277360 18003 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:28.382496 13755 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.028s	sys 0.042s
I20260709 12:11:28.384423 13726 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:28.295756 17966 consensus_queue.cc:1059] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 12:11:28.318276 18030 raft_consensus.cc:2749] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:28.352013 17994 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:28.396191 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:28.399499 13727 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:28.357273 18028 raft_consensus.cc:697] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 10 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:28.357950 17986 raft_consensus.cc:2749] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:28.402995 17999 raft_consensus.cc:3055] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:28.380196 17879 raft_consensus.cc:3055] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:28.409282 17999 raft_consensus.cc:740] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
W20260709 12:11:28.409053 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 77458us
I20260709 12:11:28.409484 17879 raft_consensus.cc:740] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:28.410212 13800 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:28.381031 17871 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:28.410272 17999 consensus_queue.cc:260] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:28.413012 17871 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:11:28.419800 13761 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.020s	sys 0.052s
W20260709 12:11:28.420351 13761 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.020s	sys 0.052s
I20260709 12:11:28.381675 17989 raft_consensus.cc:740] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:28.395524 18061 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:28.440459 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 56192.1us
W20260709 12:11:28.407624 13755 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.030s	sys 0.043s
W20260709 12:11:28.452680 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 53273us
I20260709 12:11:28.452739 13726 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:28.458469 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:28.459517 13836 raft_consensus.cc:2393] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 12: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:28.470146 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:28.471963 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:28.475148 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:28.479290 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:28.463284 13726 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:28.486860 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:28.487812 13681 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 13.
I20260709 12:11:28.490473 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:28.455919 18009 raft_consensus.cc:2804] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:28.496702 13836 raft_consensus.cc:1275] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:11:28.460714 17578 raft_consensus.cc:2804] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:28.500347 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:28.460887 18030 raft_consensus.cc:2804] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:28.458730 18044 raft_consensus.cc:2804] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:28.457381 17994 raft_consensus.cc:3055] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:28.423736 18094 consensus_queue.cc:1048] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
W20260709 12:11:28.532743 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 69543.3us
I20260709 12:11:28.482285 17851 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:28.501114 17969 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:28.498863 18026 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:28.460295 18061 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:28.565861 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:28.529471 18000 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.035s	sys 0.024s
I20260709 12:11:28.567647 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:28.539597 18009 raft_consensus.cc:697] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:11:28.561964 18095 log.cc:927] Time spent T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
I20260709 12:11:28.559302 17898 raft_consensus.cc:2804] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:28.575068 13836 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:28.483479 18049 consensus_queue.cc:1048] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.075s
I20260709 12:11:28.558780 17994 raft_consensus.cc:740] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:28.538853 18057 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:11:28.574841 18000 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.036s	sys 0.025s
I20260709 12:11:28.591655 17976 consensus_queue.cc:260] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:28.593534 18003 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:28.595439 18061 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:28.595495 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:28.596472 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:28.569945 17851 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:28.604489 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:28.629241 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:28.630180 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:28.630980 13828 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:28.572706 17969 raft_consensus.cc:697] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:28.539093 18028 consensus_queue.cc:237] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:28.578011 17917 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:11:28.601853 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:28.627287 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:28.529153 17989 consensus_queue.cc:260] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:28.623277 18057 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:28.619793 13757 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.015s	sys 0.013s
W20260709 12:11:28.640014 13757 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.015s	sys 0.013s
W20260709 12:11:28.628167 17952 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.001s	sys 0.022s
I20260709 12:11:28.658193 17989 raft_consensus.cc:3060] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:28.656956 17987 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:28.666672 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:28.670233 13836 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 8.
W20260709 12:11:28.671240 13688 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.021s	sys 0.008s
I20260709 12:11:28.642120 17976 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:28.671744 13688 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.021s	sys 0.009s
W20260709 12:11:28.666597 13683 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.006s	sys 0.041s
W20260709 12:11:28.672426 13683 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.006s	sys 0.041s
I20260709 12:11:28.679731 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:28.682611 13834 raft_consensus.cc:1275] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:28.679773 13829 raft_consensus.cc:1240] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 9. Current term is 10. Ops: [9.10-9.10]
W20260709 12:11:28.643962 17997 consensus_queue.cc:1175] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b98d2519bb504dc6905ed2ede4571835" responder_term: 6 status { last_received { term: 6 index: 8 } last_committed_idx: 7 last_received_current_leader { term: 6 index: 8 } }
I20260709 12:11:28.649322 17994 consensus_queue.cc:260] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:28.707325 17994 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:28.688191 18059 raft_consensus.cc:2749] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:28.668946 13828 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 14.
W20260709 12:11:28.644121 17952 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.001s	sys 0.022s
I20260709 12:11:28.720402 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:28.722368 13828 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 9.
I20260709 12:11:28.738554 17990 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:28.646553 18009 consensus_queue.cc:237] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:28.741547 17992 raft_consensus.cc:3055] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:11:28.752290 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 468442us
I20260709 12:11:28.752699 14416 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 11.
W20260709 12:11:28.743984 17977 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.850s	user 0.016s	sys 0.033s
I20260709 12:11:28.680228 17969 consensus_queue.cc:237] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:28.761795 14379 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:11:28.766121 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:28.748067 13680 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.017s	sys 0.022s
W20260709 12:11:28.774950 13680 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.017s	sys 0.022s
W20260709 12:11:28.753371 17698 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.010s	sys 0.028s
W20260709 12:11:28.790932 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:28.791671 13681 raft_consensus.cc:1275] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 12:11:28.792922 18096 log.cc:927] Time spent T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.086s	user 0.001s	sys 0.002s
I20260709 12:11:28.793056 17986 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:28.796397 17986 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:28.794318 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:28.801077 14415 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:28.806111 17986 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:28.812052 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 358503us
I20260709 12:11:28.815284 13762 raft_consensus.cc:1240] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:11:28.813336 13755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 1799) took 1946 ms. Trace:
I20260709 12:11:28.816205 17999 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:28.815968 13755 rpcz_store.cc:276] 0709 12:11:26.866848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:26.867048 (+   200us) service_pool.cc:224] Handling call
0709 12:11:26.889576 (+ 22528us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:26.889998 (+   422us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:26.890030 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:27.837003 (+946973us) spinlock_profiling.cc:243] Waited 5.19 ms on lock 0x7b2c00010828. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa926886a11 00007fa926896372 00007fa927fc8a01 00007fa927f8d43a 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2
0709 12:11:27.837453 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 12:11:28.453136 (+615683us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:28.453206 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:28.453292 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:28.792225 (+338933us) spinlock_profiling.cc:243] Waited 19.3 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:11:28.813070 (+ 20845us) raft_consensus.cc:1685] finished
0709 12:11:28.813103 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:28.813269 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7124,"raft.queue_time_us":510,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":36000,"spinlock_wait_cycles":56252160,"thread_start_us":615274,"threads_started":1,"wal-append.queue_time_us":836433}
I20260709 12:11:28.813172 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:28.784441 17977 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.891s	user 0.017s	sys 0.034s
I20260709 12:11:28.836545 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:28.760635 17992 raft_consensus.cc:740] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:28.835093 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:28.753930 17913 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:28.785000 17952 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:28.856910 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:28.857879 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:11:28.785143 17698 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.010s	sys 0.028s
W20260709 12:11:28.850251 13833 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.015s	sys 0.013s
W20260709 12:11:28.859925 13833 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.015s	sys 0.013s
I20260709 12:11:28.758773 17990 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:28.855295 17927 consensus_meta.cc:287] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.519s	user 0.013s	sys 0.000s
I20260709 12:11:28.834247 18044 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:28.886582 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:28.890046 14415 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 12.
I20260709 12:11:28.897213 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:11:28.898109 13831 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.018s	sys 0.016s
I20260709 12:11:28.898382 13829 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 11.
W20260709 12:11:28.898602 13831 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.018s	sys 0.016s
W20260709 12:11:28.899248 13756 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.016s	sys 0.027s
W20260709 12:11:28.908713 13756 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.016s	sys 0.027s
W20260709 12:11:28.916252 13837 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.011s	sys 0.010s
W20260709 12:11:28.916795 13837 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.011s	sys 0.011s
I20260709 12:11:28.892767 18044 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:28.927040 13652 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:28.895717 18057 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:28.950723 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:28.952710 13831 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:28.953332 13681 raft_consensus.cc:1240] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:11:28.954376 13652 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:28.982802 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:28.930191 18098 log.cc:927] Time spent T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
I20260709 12:11:28.892949 17927 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:28.950870 17935 consensus_meta.cc:287] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.801s	user 0.011s	sys 0.004s
I20260709 12:11:28.995977 14379 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:28.920045 17977 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:28.952039 18011 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:11:29.020109 18099 log.cc:927] Time spent T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:11:29.038041 13687 raft_consensus.cc:1240] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:28.994990 17999 raft_consensus.cc:2804] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:28.984405 18059 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:29.014686 17997 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.916774 17992 consensus_queue.cc:260] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:29.051510 13685 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 13.
W20260709 12:11:29.033811 18042 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.850s	user 0.035s	sys 0.038s
I20260709 12:11:29.027136 17977 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:28.995376 17986 consensus_queue.cc:1048] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
W20260709 12:11:29.062929 17683 consensus_meta.cc:287] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.716s	user 0.011s	sys 0.003s
I20260709 12:11:29.041263 13831 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 13.
I20260709 12:11:29.022809 17871 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:29.071337 13679 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.008s	sys 0.023s
I20260709 12:11:29.071403 13761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2525) took 1219 ms. Trace:
W20260709 12:11:29.079545 13679 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.008s	sys 0.024s
I20260709 12:11:29.079586 13761 rpcz_store.cc:276] 0709 12:11:27.851697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:27.860183 (+  8486us) service_pool.cc:224] Handling call
0709 12:11:27.860527 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:27.860951 (+   424us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:27.860980 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:27.861543 (+   563us) log.cc:844] Serialized 26 byte log entry
0709 12:11:28.420823 (+559280us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:28.420897 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:28.420991 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:29.071164 (+650173us) raft_consensus.cc:1685] finished
0709 12:11:29.071189 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:29.071341 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1036,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":93,"thread_start_us":555075,"threads_started":1,"wal-append.queue_time_us":823624}
W20260709 12:11:29.052480 14380 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.743s	user 0.039s	sys 0.034s
I20260709 12:11:29.053385 17999 raft_consensus.cc:697] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 12 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:29.088565 13688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2440) took 1083 ms. Trace:
W20260709 12:11:29.083139 14380 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.774s	user 0.039s	sys 0.034s
W20260709 12:11:29.088276 18100 log.cc:927] Time spent T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 12:11:29.020987 17952 raft_consensus.cc:2749] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:29.089572 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 781338us
I20260709 12:11:29.089114 13688 rpcz_store.cc:276] 0709 12:11:28.004769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.013542 (+  8773us) service_pool.cc:224] Handling call
0709 12:11:28.013953 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:28.014364 (+   411us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:28.014397 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:28.014914 (+   517us) log.cc:844] Serialized 26 byte log entry
0709 12:11:28.672488 (+657574us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:28.672640 (+   152us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:28.672723 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:29.088323 (+415600us) raft_consensus.cc:1685] finished
0709 12:11:29.088348 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:29.088502 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1032,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":117,"thread_start_us":656975,"threads_started":1,"wal-append.queue_time_us":981633}
W20260709 12:11:29.072809 18042 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.889s	user 0.036s	sys 0.038s
I20260709 12:11:29.053606 18059 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:29.111752 14380 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:29.113266 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:29.073359 17992 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:29.059092 17997 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:29.094763 17913 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:29.252640 14415 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 11.
I20260709 12:11:29.243899 17935 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:29.256474 13683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 688) took 1323 ms. Trace:
I20260709 12:11:29.212036 17990 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:29.257022 13683 rpcz_store.cc:276] 0709 12:11:27.932930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:27.933083 (+   153us) service_pool.cc:224] Handling call
0709 12:11:27.933433 (+   350us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:27.933915 (+   482us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:27.945923 (+ 12008us) log.cc:844] Serialized 14 byte log entry
0709 12:11:28.217768 (+271845us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b18002f3320. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924ea0557 00007fa924ea27c1 00007fa924ea2779 00007fa924ea2709 00007fa924ea26d1 00007fa924ea19cd 0000000000388634 0000000000388479 00007fa924e8383a
0709 12:11:28.678147 (+460379us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:28.723290 (+ 45143us) log.cc:844] Serialized 52 byte log entry
0709 12:11:28.723543 (+   253us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:28.723595 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:28.723707 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:29.254069 (+530362us) raft_consensus.cc:1685] finished
0709 12:11:29.256134 (+  2065us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:29.256387 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2108,"prepare.queue_time_us":11791,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":59,"raft.queue_time_us":4620,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":8066,"spinlock_wait_cycles":30166272,"thread_start_us":703537,"threads_started":1,"wal-append.queue_time_us":1057079}
W20260709 12:11:29.244640 17966 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.018s	sys 0.015s
I20260709 12:11:29.246115 18042 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.089058 17871 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:29.254333 17683 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.259806 17935 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:29.267036 18042 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:29.268617 17935 leader_election.cc:290] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:29.269045 18042 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:29.270443 18111 log.cc:927] Time spent T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 12:11:29.250939 17657 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
W20260709 12:11:29.263163 17976 consensus_meta.cc:287] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.589s	user 0.006s	sys 0.006s
I20260709 12:11:29.103346 17879 consensus_queue.cc:260] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:29.280077 13757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2513) took 2647 ms. Trace:
W20260709 12:11:29.280220 13800 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.794s	user 0.023s	sys 0.043s
I20260709 12:11:29.285390 13757 rpcz_store.cc:276] 0709 12:11:26.624925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:26.647327 (+ 22402us) service_pool.cc:224] Handling call
0709 12:11:26.647704 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:26.663402 (+ 15698us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:26.663438 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:27.988816 (+1325378us) spinlock_profiling.cc:243] Waited 5.97 ms on lock 0x7b2c00010828. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa926886a11 00007fa926896372 00007fa927fc8a01 00007fa927f8d43a 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2
0709 12:11:27.989349 (+   533us) log.cc:844] Serialized 26 byte log entry
0709 12:11:28.640475 (+651126us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:28.640517 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:28.640601 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:29.087560 (+446959us) spinlock_profiling.cc:243] Waited 5.18 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:11:29.272271 (+184711us) raft_consensus.cc:1685] finished
0709 12:11:29.272293 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:29.272441 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":76792,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":10005,"spinlock_wait_cycles":25636352,"thread_start_us":650722,"threads_started":1,"wal-append.queue_time_us":904578}
W20260709 12:11:29.287488 13800 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.801s	user 0.024s	sys 0.043s
W20260709 12:11:29.264314 17966 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.019s	sys 0.015s
W20260709 12:11:29.282925 13684 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.781s	user 0.007s	sys 0.026s
W20260709 12:11:29.297447 13684 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.795s	user 0.007s	sys 0.026s
I20260709 12:11:29.250411 17999 consensus_queue.cc:237] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:29.309449 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:11:29.280124 18030 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.009s	sys 0.026s
W20260709 12:11:29.310109 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:29.280076 17986 raft_consensus.cc:2749] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:29.313289 13836 raft_consensus.cc:1240] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:11:29.314787 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:29.315011 13828 raft_consensus.cc:1275] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 12:11:29.342581 13828 pending_rounds.cc:85] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 7
I20260709 12:11:29.343000 13828 pending_rounds.cc:107] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 12:11:29.343391 13828 raft_consensus.cc:2889] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:29.344805 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:29.316184 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:29.316476 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:29.283047 17927 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:29.320762 18059 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:29.311538 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:11:29.283578 18013 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.009s	sys 0.023s
I20260709 12:11:29.346235 13832 raft_consensus.cc:3060] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:29.347213 14414 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.044s	sys 0.130s
W20260709 12:11:29.378883 14414 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.045s	sys 0.130s
I20260709 12:11:29.350879 13831 raft_consensus.cc:1275] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
W20260709 12:11:29.298282 18094 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.703s	user 0.013s	sys 0.017s
I20260709 12:11:29.284428 17657 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:29.354351 13834 raft_consensus.cc:2393] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 10: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:29.349081 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:11:29.321542 18030 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.752s	user 0.010s	sys 0.026s
I20260709 12:11:29.346909 17917 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.392103 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:29.392944 13834 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 13.
I20260709 12:11:29.371901 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:11:29.393884 14413 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.022s	sys 0.026s
W20260709 12:11:29.394256 14413 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.022s	sys 0.026s
I20260709 12:11:29.274693 17683 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:29.321543 18057 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.384835 14414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41692 (request call id 701) took 1104 ms. Trace:
W20260709 12:11:29.385599 13759 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.015s	sys 0.023s
W20260709 12:11:29.344550 17898 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.711s	user 0.013s	sys 0.033s
W20260709 12:11:29.342620 17578 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.772s	user 0.017s	sys 0.027s
I20260709 12:11:29.389205 13831 pending_rounds.cc:85] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 8
I20260709 12:11:29.307423 17976 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:29.389011 18094 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.794s	user 0.013s	sys 0.017s
I20260709 12:11:29.354369 17879 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:29.414150 17657 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:29.415516 17871 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:29.416517 17851 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:11:29.378178 18013 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.781s	user 0.009s	sys 0.023s
I20260709 12:11:29.418033 17987 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:29.419286 13685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2448) took 1402 ms. Trace:
I20260709 12:11:29.419672 13685 rpcz_store.cc:276] 0709 12:11:28.017154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.020065 (+  2911us) service_pool.cc:224] Handling call
0709 12:11:29.419070 (+1399005us) spinlock_profiling.cc:243] Waited 991 ms on lock 0x7b54002c2754. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:29.419196 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2278717312}
I20260709 12:11:29.421026 17997 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:11:29.406324 17898 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.780s	user 0.013s	sys 0.033s
I20260709 12:11:29.421820 17898 raft_consensus.cc:697] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:11:29.422032 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:29.402184 17917 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:29.422868 17898 consensus_queue.cc:237] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:29.405184 18057 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:29.395447 18030 raft_consensus.cc:697] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 9 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:29.426175 13836 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 12.
I20260709 12:11:29.426509 18057 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:29.426849 18030 consensus_queue.cc:237] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:29.406046 14413 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41700 (request call id 602) took 1094 ms. Trace:
I20260709 12:11:29.427762 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:29.428946 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:29.428189 14413 rpcz_store.cc:276] 0709 12:11:28.311364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.311563 (+   199us) service_pool.cc:224] Handling call
0709 12:11:28.311933 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:28.312241 (+   308us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:11:28.744410 (+432169us) log.cc:844] Serialized 14 byte log entry
0709 12:11:29.405606 (+661196us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:29.405666 (+    60us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:29.405734 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.405830 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:29.405985 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":266486,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":3036,"raft.queue_time_us":10454,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":320,"thread_start_us":1078700,"threads_started":2}
I20260709 12:11:29.430300 18038 raft_consensus.cc:2749] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:29.433964 18114 log.cc:927] Time spent T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 12:11:29.435599 13758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2531) took 1395 ms. Trace:
I20260709 12:11:29.436105 13581 catalog_manager.cc:5697] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 8 to 9, leader changed from ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 9 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:11:29.436069 13758 rpcz_store.cc:276] 0709 12:11:28.040643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.040796 (+   153us) service_pool.cc:224] Handling call
0709 12:11:28.041263 (+   467us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:28.085076 (+ 43813us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:28.085125 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:28.288094 (+202969us) spinlock_profiling.cc:243] Waited 4.05 ms on lock 0x7b2c00010828. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa926886a11 00007fa926896372 00007fa927fc8a01 00007fa927f8d43a 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2
0709 12:11:28.288647 (+   553us) log.cc:844] Serialized 26 byte log entry
0709 12:11:28.851479 (+562832us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:28.851545 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:28.851651 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:29.435230 (+583579us) raft_consensus.cc:1685] finished
0709 12:11:29.435258 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:29.435501 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10614,"raft.queue_time_us":43333,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":7482,"spinlock_wait_cycles":9320192,"thread_start_us":494950,"threads_started":1,"wal-append.queue_time_us":944038}
I20260709 12:11:29.438246 13837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 2547) took 1192 ms. Trace:
I20260709 12:11:29.438122 13581 catalog_manager.cc:5697] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 7 to 10, leader changed from ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 10 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:11:29.439141 17859 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:29.438658 13837 rpcz_store.cc:276] 0709 12:11:28.246094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.246753 (+   659us) service_pool.cc:224] Handling call
0709 12:11:28.247205 (+   452us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:28.264577 (+ 17372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:28.264625 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:28.265356 (+   731us) log.cc:844] Serialized 52 byte log entry
0709 12:11:28.921195 (+655839us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:28.921257 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:28.921356 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:29.438004 (+516648us) raft_consensus.cc:1685] finished
0709 12:11:29.438026 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:29.438173 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3802,"raft.queue_time_us":12518,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":15550,"thread_start_us":644288,"threads_started":1,"wal-append.queue_time_us":1105024}
I20260709 12:11:29.439962 13581 catalog_manager.cc:5697] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 9 to 11, leader changed from ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 11 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:11:29.441035 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:29.441803 13581 catalog_manager.cc:5697] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 8 to 9, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 9 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:29.445370 13581 catalog_manager.cc:5697] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 1 to 6, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 6 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
W20260709 12:11:29.450461 17989 consensus_meta.cc:287] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.792s	user 0.006s	sys 0.006s
I20260709 12:11:29.450918 13581 catalog_manager.cc:5697] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:29.356997 18110 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
W20260709 12:11:29.397194 13726 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.834s	user 0.006s	sys 0.014s
W20260709 12:11:29.403491 13759 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.016s	sys 0.023s
I20260709 12:11:29.395431 14414 rpcz_store.cc:276] 0709 12:11:28.280088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.280514 (+   426us) service_pool.cc:224] Handling call
0709 12:11:28.280917 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:28.281195 (+   278us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:11:28.673388 (+392193us) log.cc:844] Serialized 14 byte log entry
0709 12:11:29.384339 (+710951us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:29.384421 (+    82us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:29.384490 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.384586 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:29.384755 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":277878,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":4851,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":113,"thread_start_us":1069529,"threads_started":2}
I20260709 12:11:29.406065 13831 pending_rounds.cc:107] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 12:11:29.408694 13828 raft_consensus.cc:1275] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:29.479221 13831 raft_consensus.cc:2889] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:29.479671 13831 pending_rounds.cc:107] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 12:11:29.410843 17976 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:29.482373 13680 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.015s	sys 0.015s
W20260709 12:11:29.482782 13680 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.015s	sys 0.015s
I20260709 12:11:29.395958 13834 raft_consensus.cc:1275] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:29.455394 13836 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 12.
I20260709 12:11:29.462728 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:29.465597 13800 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:29.595098 13758 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:29.595685 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 185879us
I20260709 12:11:29.596769 13800 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:11:29.478305 13726 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.915s	user 0.006s	sys 0.016s
W20260709 12:11:29.598037 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 1.03474e+06us
W20260709 12:11:29.599442 18103 log.cc:927] Time spent T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.496s	user 0.003s	sys 0.000s
I20260709 12:11:29.479916 13831 raft_consensus.cc:2889] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:29.602375 13831 raft_consensus.cc:1275] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:29.605535 13800 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:11:29.587143 18112 log.cc:927] Time spent T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.197s	user 0.000s	sys 0.000s
I20260709 12:11:29.508011 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:29.578321 17602 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.914s	user 0.010s	sys 0.068s
W20260709 12:11:29.550777 13727 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.731s	user 0.005s	sys 0.034s
I20260709 12:11:29.511687 18110 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:29.477449 17859 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:29.517117 18117 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:29.478264 17927 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:11:29.405440 17578 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.845s	user 0.018s	sys 0.028s
I20260709 12:11:29.508287 13754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:56790 (request call id 0) took 2623 ms. Trace:
I20260709 12:11:29.453078 17977 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:29.481205 18000 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:29.508854 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:29.510147 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:29.481519 18042 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:29.477545 17935 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:29.592747 13833 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.024s	sys 0.020s
I20260709 12:11:29.584828 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:11:29.551710 18044 consensus_meta.cc:287] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.597s	user 0.011s	sys 0.001s
I20260709 12:11:29.610774 18122 raft_consensus.cc:2749] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:11:29.653481 17602 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.997s	user 0.011s	sys 0.068s
I20260709 12:11:29.678195 18109 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.655813 17859 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:29.656484 17578 raft_consensus.cc:697] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:29.659420 18042 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:29.694176 17578 consensus_queue.cc:237] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:29.695302 18042 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:29.659792 17935 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:29.653875 13756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2535) took 1391 ms. Trace:
W20260709 12:11:29.659956 13833 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.799s	user 0.025s	sys 0.020s
I20260709 12:11:29.660933 18044 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:29.698688 18128 log.cc:927] Time spent T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260709 12:11:29.669953 17683 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:29.677325 18118 raft_consensus.cc:2749] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:29.679271 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 73845.1us
I20260709 12:11:29.706466 13759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2539) took 1323 ms. Trace:
W20260709 12:11:29.618914 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:29.654091 13727 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.834s	user 0.006s	sys 0.039s
I20260709 12:11:29.709079 13758 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 11.
I20260709 12:11:29.692552 18109 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:29.711252 18119 log.cc:927] Time spent T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 12:11:29.712435 13684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1667) took 1245 ms. Trace:
I20260709 12:11:29.712775 18109 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:29.712785 13684 rpcz_store.cc:276] 0709 12:11:28.466841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.468884 (+  2043us) service_pool.cc:224] Handling call
0709 12:11:28.500549 (+ 31665us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:28.501046 (+   497us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:11:28.501093 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:28.501806 (+   713us) log.cc:844] Serialized 26 byte log entry
0709 12:11:29.298029 (+796223us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:11:29.298070 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.298139 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:29.712192 (+414053us) raft_consensus.cc:1685] finished
0709 12:11:29.712215 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:29.712376 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":38377,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":6911,"spinlock_wait_cycles":8576,"thread_start_us":795864,"threads_started":1,"wal-append.queue_time_us":1051872}
I20260709 12:11:29.698061 13756 rpcz_store.cc:276] 0709 12:11:28.262128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.262296 (+   168us) service_pool.cc:224] Handling call
0709 12:11:28.262824 (+   528us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:28.263441 (+   617us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:28.263475 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:28.264042 (+   567us) log.cc:844] Serialized 26 byte log entry
0709 12:11:28.909563 (+645521us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:28.909627 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:28.909973 (+   346us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:29.653548 (+743575us) raft_consensus.cc:1685] finished
0709 12:11:29.653575 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:29.653800 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11835,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":14907,"thread_start_us":644795,"threads_started":1,"wal-append.queue_time_us":1033612}
I20260709 12:11:29.702749 13832 raft_consensus.cc:2468] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 9.
I20260709 12:11:29.704555 13763 raft_consensus.cc:2393] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 13: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:29.706846 13759 rpcz_store.cc:276] 0709 12:11:28.383153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.383549 (+   396us) service_pool.cc:224] Handling call
0709 12:11:28.383974 (+   425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:28.394824 (+ 10850us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:28.394874 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:28.395549 (+   675us) log.cc:844] Serialized 26 byte log entry
0709 12:11:28.834110 (+438561us) spinlock_profiling.cc:243] Waited 1.88 ms on lock 0x7b180043c840. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e82e07 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9fc02 00007fa927b2720b 00007fa927b2cd23 00007fa927b2d0d1 00007fa927f48a0f
0709 12:11:29.478476 (+644366us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:29.478535 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.478632 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:29.700415 (+221783us) raft_consensus.cc:1685] finished
0709 12:11:29.700435 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:29.706404 (+  5969us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34882,"raft.queue_time_us":13536,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":6389,"spinlock_wait_cycles":4327680,"thread_start_us":644125,"threads_started":1,"wal-append.queue_time_us":1282072}
I20260709 12:11:29.656615 13754 rpcz_store.cc:276] 0709 12:11:26.898449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:27.480124 (+581675us) service_pool.cc:224] Handling call
0709 12:11:29.482093 (+2001969us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b540038d1d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f93735 00007fa92cf53d29 00007fa9264d21d4 00007fa9264d2162 00007fa9264d2091 00007fa9264d200c 00007fa9264d12c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:29.505172 (+ 23079us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2668164480}
I20260709 12:11:29.710531 13687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1668) took 1243 ms. Trace:
I20260709 12:11:29.723539 13687 rpcz_store.cc:276] 0709 12:11:28.467138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.469008 (+  1870us) service_pool.cc:224] Handling call
0709 12:11:28.469392 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:29.040386 (+570994us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.710288 (+669902us) spinlock_profiling.cc:243] Waited 557 ms on lock 0x7b5400271854. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:29.710466 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1281490688}
W20260709 12:11:29.708510 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 893006us
I20260709 12:11:29.730760 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:29.733837 13833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 2548) took 1487 ms. Trace:
W20260709 12:11:29.676043 17994 consensus_meta.cc:287] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.968s	user 0.011s	sys 0.003s
I20260709 12:11:29.736101 14415 raft_consensus.cc:1275] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:29.736776 13832 raft_consensus.cc:1275] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:29.734342 13833 rpcz_store.cc:276] 0709 12:11:28.246496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.253421 (+  6925us) service_pool.cc:224] Handling call
0709 12:11:28.253804 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:28.319358 (+ 65554us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:11:28.860507 (+541149us) log.cc:844] Serialized 14 byte log entry
0709 12:11:29.698626 (+838119us) log.cc:844] Serialized 14 byte log entry
0709 12:11:29.698803 (+   177us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:29.698851 (+    48us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:29.698898 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.733566 (+ 34668us) spinlock_profiling.cc:243] Waited 65.2 ms on lock 0x7b540020d854. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:29.733614 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:29.733750 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":28122,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":3518,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":10400,"spinlock_wait_cycles":149996928,"thread_start_us":1356291,"threads_started":2}
I20260709 12:11:29.655804 18110 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:29.671542 17917 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:29.743206 13837 raft_consensus.cc:2410] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:11:29.688194 18122 raft_consensus.cc:2749] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:29.748374 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:29.749455 13831 raft_consensus.cc:2393] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 13: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:29.733858 13800 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:29.750869 17976 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:29.752070 13800 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
W20260709 12:11:29.746049 13727 connection.cc:256] RPC call timeout handler was delayed by -1.5337979700000233s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1569s for a response
W20260709 12:11:29.754001 13727 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 1.531s (SENT) [suppressed 13 similar messages]
I20260709 12:11:29.754649 13800 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:29.752729 17976 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:29.746842 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:29.656452 17927 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:29.672084 18126 consensus_queue.cc:1048] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.084s
I20260709 12:11:29.657548 18000 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:29.761812 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:29.713042 18057 consensus_queue.cc:1048] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 12:11:29.656219 18117 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:29.756091 18121 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:29.758674 17917 raft_consensus.cc:2749] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:29.766790 18044 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:29.734952 18028 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.733s	user 0.003s	sys 0.023s
W20260709 12:11:29.775818 13679 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.024s	sys 0.037s
W20260709 12:11:29.776386 13679 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.024s	sys 0.037s
I20260709 12:11:29.789813 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:29.790555 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:29.804438 17927 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:29.768234 18118 consensus_queue.cc:1059] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:11:29.812271 18118 raft_consensus.cc:3055] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:29.812796 18118 raft_consensus.cc:740] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
W20260709 12:11:29.773990 18028 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.792s	user 0.004s	sys 0.023s
W20260709 12:11:29.818281 18129 log.cc:927] Time spent T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:11:29.772336 18122 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:29.821406 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:29.826871 14380 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.020s	sys 0.043s
W20260709 12:11:29.827514 14380 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.020s	sys 0.043s
W20260709 12:11:29.773315 17969 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.006s	sys 0.017s
I20260709 12:11:29.805492 17927 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:29.820815 18057 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:29.823698 17917 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:11:29.828384 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 716723us
I20260709 12:11:29.812687 17935 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:29.770566 18121 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:29.848920 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:29.852989 17969 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.778s	user 0.007s	sys 0.017s
I20260709 12:11:29.834282 18122 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:29.868930 18057 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:29.869177 18109 consensus_queue.cc:1059] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:29.870384 18109 raft_consensus.cc:3055] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:29.870756 13758 raft_consensus.cc:1240] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:29.878918 14380 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:29.889346 13754 raft_consensus.cc:2393] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 9: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:29.891453 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:29.891645 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:29.892458 13754 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 12.
W20260709 12:11:29.907336 13835 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.015s	sys 0.029s
W20260709 12:11:29.907991 13835 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.016s	sys 0.029s
I20260709 12:11:29.848345 18110 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:11:29.933846 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 52667.6us
W20260709 12:11:29.903795 18009 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.006s	sys 0.017s
W20260709 12:11:29.962694 13829 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.003s	sys 0.029s
W20260709 12:11:29.963212 13829 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.003s	sys 0.029s
I20260709 12:11:29.948733 13800 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:29.890412 17871 raft_consensus.cc:2749] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:29.870816 18109 raft_consensus.cc:740] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:29.967105 13800 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:29.988535 13800 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:29.975757 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:29.970782 14379 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.856s	user 0.006s	sys 0.022s
I20260709 12:11:29.984652 14413 raft_consensus.cc:1240] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:29.984813 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:29.989562 14415 raft_consensus.cc:1240] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:29.976346 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
W20260709 12:11:29.962558 18009 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.006s	sys 0.017s
W20260709 12:11:29.992031 14379 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.877s	user 0.006s	sys 0.022s
W20260709 12:11:29.967598 17999 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.002s	sys 0.023s
I20260709 12:11:30.001947 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:29.867540 17927 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:29.871722 17917 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:29.894399 18059 consensus_queue.cc:1059] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.082s
I20260709 12:11:30.039243 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:29.976567 17997 raft_consensus.cc:2749] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:30.044902 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:30.045832 13754 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 10.
I20260709 12:11:29.830029 18118 consensus_queue.cc:260] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:29.995309 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:30.006541 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:30.000789 17999 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.002s	sys 0.023s
W20260709 12:11:30.054425 13828 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.001s	sys 0.032s
W20260709 12:11:30.054968 13828 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.001s	sys 0.032s
W20260709 12:11:30.057314 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:29.964120 18110 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:29.975807 18122 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:30.060246 13830 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.010s	sys 0.031s
I20260709 12:11:30.005067 17966 raft_consensus.cc:2749] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:30.064375 13830 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.010s	sys 0.031s
I20260709 12:11:29.988571 18117 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:30.040252 17898 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.007s	sys 0.008s
W20260709 12:11:30.047621 18072 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.005s	sys 0.007s
I20260709 12:11:30.036002 18038 consensus_queue.cc:1048] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 12:11:30.068635 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:30.078142 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 477783us
I20260709 12:11:30.106055 13754 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 12.
I20260709 12:11:30.057556 17989 raft_consensus.cc:2749] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:30.103325 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:30.066179 13680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 697) took 1842 ms. Trace:
I20260709 12:11:30.106796 13726 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:30.060443 17994 raft_consensus.cc:2804] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:30.110262 13685 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 10.
W20260709 12:11:30.087914 13652 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.000s	sys 0.013s
I20260709 12:11:30.112227 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:11:30.112615 13652 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.000s	sys 0.014s
I20260709 12:11:30.112790 13829 raft_consensus.cc:1275] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:11:30.118257 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:11:30.123909 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:30.124788 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:30.125663 13836 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 11.
I20260709 12:11:30.061970 18138 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:11:30.128054 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 374043us
I20260709 12:11:30.112735 13726 leader_election.cc:304] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:30.132472 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:30.150025 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:30.110713 13680 rpcz_store.cc:276] 0709 12:11:28.223468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.224372 (+   904us) service_pool.cc:224] Handling call
0709 12:11:28.224786 (+   414us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:28.225163 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:28.225194 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:28.225901 (+   707us) log.cc:844] Serialized 52 byte log entry
0709 12:11:28.775559 (+549658us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:29.483216 (+707657us) log.cc:844] Serialized 14 byte log entry
0709 12:11:30.065623 (+582407us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:30.065747 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:30.065834 (+    87us) raft_consensus.cc:1685] finished
0709 12:11:30.065854 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:30.066084 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":84432,"prepare.queue_time_us":1026170,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":55,"raft.queue_time_us":1272,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":30311,"thread_start_us":1669176,"threads_started":3,"wal-append.queue_time_us":843172}
I20260709 12:11:30.078580 17999 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.083869 18118 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:30.149412 14413 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 12.
I20260709 12:11:30.080938 18059 raft_consensus.cc:3055] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:11:30.080260 17898 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.007s	sys 0.008s
I20260709 12:11:30.152429 13801 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:30.086014 17997 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.162083 13801 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:30.108004 18122 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.127240 17966 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:30.169894 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 57266.8us
W20260709 12:11:30.170243 13651 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.026s	sys 0.036s
W20260709 12:11:30.171468 13727 connection.cc:256] RPC call timeout handler was delayed by -1.0990979700000025s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20520000000000002s for a response
W20260709 12:11:30.181494 13651 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.027s	sys 0.036s
I20260709 12:11:30.110365 18117 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
W20260709 12:11:30.153679 18013 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.735s	user 0.023s	sys 0.050s
I20260709 12:11:30.153352 17952 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:30.169667 18011 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.189661 14380 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:30.167905 17583 raft_consensus.cc:2804] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:30.159641 18059 raft_consensus.cc:740] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:30.198168 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:30.205530 14408 raft_consensus.cc:1275] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:11:30.205946 14408 pending_rounds.cc:85] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f: Aborting all ops after (but not including) 7
W20260709 12:11:30.184449 13653 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.006s	sys 0.055s
I20260709 12:11:30.206161 14408 pending_rounds.cc:107] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f: Aborting uncommitted NO_OP operation due to leader change: 9.8
W20260709 12:11:30.206328 13653 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.006s	sys 0.055s
I20260709 12:11:30.206430 14408 raft_consensus.cc:2889] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:30.189801 18030 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.020s	sys 0.027s
I20260709 12:11:30.208709 13837 raft_consensus.cc:1240] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:30.177369 18044 raft_consensus.cc:2804] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:11:30.196539 18013 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.776s	user 0.024s	sys 0.050s
W20260709 12:11:30.246349 13634 auto_rebalancer.cc:629] Failed to schedule move for tablet 107415ab6e76484890fa8115e8832a21: Illegal state: Replica 3f37c9cc9dda46b4be21dd675ba78fb7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:11:30.247771 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:30.244045 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:30.249341 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:30.250285 13763 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 12.
I20260709 12:11:30.166880 17999 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:30.168099 17989 consensus_queue.cc:1059] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
W20260709 12:11:30.216106 18127 log.cc:927] Time spent T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.309s	user 0.001s	sys 0.001s
W20260709 12:11:30.215499 18030 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.020s	sys 0.027s
I20260709 12:11:30.204712 18003 raft_consensus.cc:2804] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:30.173274 17997 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:30.211809 17583 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:30.155989 18138 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:30.269930 17657 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.278309 18038 raft_consensus.cc:2804] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:30.279846 18121 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:30.280645 17917 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:30.196743 18117 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:30.182474 18122 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:30.291003 18059 consensus_queue.cc:260] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:30.293908 17657 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:30.296357 13634 auto_rebalancer.cc:629] Failed to schedule move for tablet f1494f6353074242857c7901c21da06d: Illegal state: Replica 96701a74fdee481fb5f54aac841e17dd is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 16 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
W20260709 12:11:30.316851 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 115703us
I20260709 12:11:30.293246 18150 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:30.203536 17871 consensus_queue.cc:1048] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.081s
I20260709 12:11:30.318790 13727 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:30.319043 18150 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:30.322190 18150 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:30.323010 18150 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:30.323643 18150 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:30.327347 18150 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:30.330354 18150 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:30.332243 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 343771us
I20260709 12:11:30.333310 13800 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:30.328668 17935 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:30.334450 17935 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:30.329167 17683 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.336723 17683 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:30.339330 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:30.343588 17935 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:30.345681 17935 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:30.347678 17935 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:30.331058 18150 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:30.362941 18150 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:30.360653 17935 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:30.365841 18150 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:30.285163 18044 raft_consensus.cc:697] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:30.220331 18011 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:30.375252 13800 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:30.305603 18030 raft_consensus.cc:3055] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:30.389132 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:30.246464 17976 consensus_queue.cc:1048] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 12:11:30.375097 14415 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 10.
I20260709 12:11:30.283834 18003 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:11:30.377746 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 59042.4us
I20260709 12:11:30.289140 17583 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:30.187391 17966 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:30.298460 18154 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.211061 17952 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:30.304862 18038 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:30.383874 17927 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:30.383517 18150 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:30.389317 17602 raft_consensus.cc:2749] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:30.414731 18000 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:30.390172 13683 raft_consensus.cc:1275] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:30.417227 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:30.386911 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:30.419008 13832 raft_consensus.cc:2393] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 11: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:30.387092 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:30.419603 13831 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 13.
I20260709 12:11:30.387192 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:30.387452 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:30.387759 13685 raft_consensus.cc:1275] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:30.423448 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:30.424312 13685 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 13.
I20260709 12:11:30.388257 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:30.386087 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:30.395546 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:11:30.400660 13800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:30.382638 17913 raft_consensus.cc:2804] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:30.382833 17989 raft_consensus.cc:2804] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:30.401638 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:11:30.402312 18142 log.cc:927] Time spent T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 12:11:30.407666 13684 raft_consensus.cc:1240] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:30.370435 17935 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:11:30.391639 18124 log.cc:927] Time spent T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:11:30.389493 17987 raft_consensus.cc:2749] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:30.428203 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:30.427788 13834 raft_consensus.cc:2468] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 7.
I20260709 12:11:30.421644 13829 raft_consensus.cc:2468] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 12.
I20260709 12:11:30.420964 13835 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 9.
I20260709 12:11:30.455236 13685 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 10.
I20260709 12:11:30.389086 18030 raft_consensus.cc:740] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:30.394495 18059 raft_consensus.cc:3060] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:30.403496 18003 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:30.394472 18153 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:30.451589 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:30.442780 17989 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:30.418116 13683 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 9.
I20260709 12:11:30.429513 18110 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:30.471504 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:30.471606 18137 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:30.474994 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:30.476555 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:30.476915 14379 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:11:30.548789 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 71990.1us
I20260709 12:11:30.550068 14379 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:30.552153 14379 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:30.457612 17871 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:30.554486 17871 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:30.477450 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:30.546265 14413 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 10.
I20260709 12:11:30.566701 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:30.567800 13683 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 13.
I20260709 12:11:30.440842 17879 consensus_queue.cc:1059] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 12:11:30.497766 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:30.583495 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:30.497897 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:11:30.502326 18134 log.cc:927] Time spent T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.463s	user 0.000s	sys 0.002s
I20260709 12:11:30.508109 13833 raft_consensus.cc:2393] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 10: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:30.512907 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:30.588703 13688 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 9.
I20260709 12:11:30.415802 18038 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:30.538473 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 98859.4us
I20260709 12:11:30.575935 18150 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:30.544782 17989 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:30.539323 18000 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.580003 18030 consensus_queue.cc:260] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:30.456002 17935 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:30.410810 18154 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:30.570580 18110 raft_consensus.cc:2749] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:30.499295 17578 consensus_queue.cc:1059] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.114s
I20260709 12:11:30.574735 17871 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:30.582463 17992 raft_consensus.cc:2749] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:30.612443 17898 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
W20260709 12:11:30.659595 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 107541us
I20260709 12:11:30.632228 17683 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:30.510736 18044 consensus_queue.cc:237] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:30.654731 18011 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:30.543784 18153 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:30.699913 17935 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:30.700218 18153 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:30.700590 18138 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:30.700789 17987 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:30.584923 18137 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:30.654361 18030 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:30.642347 18000 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:30.655364 18166 raft_consensus.cc:2804] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:30.679872 17917 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.668699 17997 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:30.696813 17952 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:30.701872 18117 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:30.670778 17999 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:30.720582 17987 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:30.728127 18166 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
W20260709 12:11:30.742123 18156 log.cc:927] Time spent T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.258s	user 0.000s	sys 0.001s
W20260709 12:11:30.745743 18146 log.cc:927] Time spent T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.290s	user 0.000s	sys 0.001s
W20260709 12:11:30.745568 18182 log.cc:927] Time spent T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 12:11:30.745813 18170 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:11:30.746979 18144 log.cc:927] Time spent T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260709 12:11:30.746681 18166 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:30.754493 18170 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:30.763144 18170 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:30.763649 18137 leader_election.cc:290] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:30.767597 18166 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:30.769892 18166 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:30.584352 13684 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:30.803256 13679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1669) took 2335 ms. Trace:
I20260709 12:11:30.490094 13651 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:11:30.806008 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 315844us
I20260709 12:11:30.803988 13679 rpcz_store.cc:276] 0709 12:11:28.467455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.469614 (+  2159us) service_pool.cc:224] Handling call
0709 12:11:28.492992 (+ 23378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:29.080055 (+587063us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:29.778147 (+698092us) log.cc:844] Serialized 14 byte log entry
0709 12:11:30.385381 (+607234us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:30.386264 (+   883us) log.cc:844] Serialized 26 byte log entry
0709 12:11:30.386391 (+   127us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:30.386423 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:30.386485 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:30.802200 (+415715us) raft_consensus.cc:1685] finished
0709 12:11:30.802281 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:30.802860 (+   579us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":722090,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":132425,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":12579,"spinlock_wait_cycles":106356992,"thread_start_us":1799887,"threads_started":4,"wal-append.queue_time_us":763635}
I20260709 12:11:30.809023 13679 raft_consensus.cc:1275] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 12:11:30.810206 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 501996us
W20260709 12:11:30.810914 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:30.813930 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:30.814495 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:30.815855 13686 raft_consensus.cc:2410] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 14 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:11:30.816227 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:30.817241 13680 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 9.
I20260709 12:11:30.817894 13686 raft_consensus.cc:1240] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 10. Current term is 11. Ops: [6.4-10.6]
I20260709 12:11:30.818490 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:30.506474 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:30.821498 13682 raft_consensus.cc:3060] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:30.824432 13687 raft_consensus.cc:1275] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:30.829952 13830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 2428) took 1515 ms. Trace:
I20260709 12:11:30.830564 13828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 2442) took 1421 ms. Trace:
I20260709 12:11:30.830595 13830 rpcz_store.cc:276] 0709 12:11:29.314361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.315425 (+  1064us) service_pool.cc:224] Handling call
0709 12:11:29.354943 (+ 39518us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:29.355432 (+   489us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:29.355479 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:29.365296 (+  9817us) log.cc:844] Serialized 52 byte log entry
0709 12:11:30.065067 (+699771us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:30.455868 (+390801us) log.cc:844] Serialized 14 byte log entry
0709 12:11:30.828474 (+372606us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:30.828816 (+   342us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:30.828901 (+    85us) raft_consensus.cc:1685] finished
0709 12:11:30.828924 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:30.829484 (+   560us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":214146,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":245117,"raft.run_cpu_time_us":380,"raft.run_wall_time_us":18694,"thread_start_us":1339003,"threads_started":3,"wal-append.queue_time_us":1182516}
W20260709 12:11:30.834748 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 219742us
I20260709 12:11:30.836360 13727 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:30.831212 13828 rpcz_store.cc:276] 0709 12:11:29.408819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.506675 (+ 97856us) service_pool.cc:224] Handling call
0709 12:11:29.507144 (+   469us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:29.508070 (+   926us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:29.508102 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:29.508610 (+   508us) log.cc:844] Serialized 26 byte log entry
0709 12:11:30.055476 (+546866us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:30.055529 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:30.055619 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:30.830027 (+774408us) raft_consensus.cc:1685] finished
0709 12:11:30.830072 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:30.830381 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":489,"raft.queue_time_us":1574,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":132,"thread_start_us":546528,"threads_started":1,"wal-append.queue_time_us":798988}
I20260709 12:11:30.819708 13679 raft_consensus.cc:1240] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 12 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:11:30.738286 17966 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:30.881217 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:30.668938 17898 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:30.890355 18137 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.892047 18137 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:30.895114 14379 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:30.901867 18170 raft_consensus.cc:2804] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:30.902565 18170 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:30.902982 18170 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:30.437996 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:30.904404 17987 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:30.906230 18172 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:30.907311 18172 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:30.670130 17871 consensus_queue.cc:1059] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 12:11:30.917848 18121 raft_consensus.cc:2749] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:30.923303 17898 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:30.925745 14408 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 9.
I20260709 12:11:30.927088 18137 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:30.928985 18172 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:30.931025 13682 raft_consensus.cc:2410] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:11:30.935050 18000 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:30.910207 18013 consensus_queue.cc:1059] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:11:30.936823 18013 raft_consensus.cc:3055] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:30.734477 17917 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:30.938617 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:30.941274 17917 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:30.949513 17657 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:30.950695 17999 raft_consensus.cc:2804] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:30.908355 13581 catalog_manager.cc:5697] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 6 to 11. New cstate: current_term: 11 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:11:30.967231 17999 raft_consensus.cc:697] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 11 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:30.968454 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:30.968837 17999 consensus_queue.cc:237] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:30.974043 18137 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.955305 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:30.975384 13830 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 10.
I20260709 12:11:30.976172 13834 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 11.
I20260709 12:11:30.977937 18137 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:30.974225 18057 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:30.969483 17994 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:30.981253 18137 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:30.981318 17994 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:30.983304 18109 consensus_queue.cc:260] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:30.937527 18013 raft_consensus.cc:740] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:30.988374 18120 raft_consensus.cc:3055] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:30.988966 18120 raft_consensus.cc:740] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:30.989146 13800 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:30.990970 14379 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:30.991389 18122 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:30.992235 18122 consensus_queue.cc:1059] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:30.987398 18013 consensus_queue.cc:260] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:30.985472 18109 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:31.018000 13684 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 13.
I20260709 12:11:31.018628 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:31.019876 13681 raft_consensus.cc:1240] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:31.027159 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:31.011363 18195 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:31.022598 18172 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:31.033481 18195 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:31.057680 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 212652us
I20260709 12:11:31.058226 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:31.062621 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:31.063030 14380 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:31.063970 14414 raft_consensus.cc:2468] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 7.
I20260709 12:11:31.069908 17871 raft_consensus.cc:2804] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:11:31.065428 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.070068 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:31.084241 13801 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:31.085597 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:31.086241 14416 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 11.
I20260709 12:11:31.086661 13680 raft_consensus.cc:2468] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 10.
I20260709 12:11:31.088086 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:31.090199 13727 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:31.094131 17900 raft_consensus.cc:2749] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:31.094993 18201 consensus_queue.cc:1048] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:31.099088 17994 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:31.055716 18195 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:31.102092 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:31.107424 14379 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:31.109591 18137 raft_consensus.cc:2804] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:31.110025 18013 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:31.110199 18137 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:31.110706 18137 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:31.114666 13727 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:31.116114 18009 raft_consensus.cc:2749] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:11:31.116307 18059 consensus_meta.cc:287] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.605s	user 0.016s	sys 0.001s
I20260709 12:11:31.117249 18059 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.118041 18038 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:31.122079 18038 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:31.122193 18138 raft_consensus.cc:2804] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:31.122876 18138 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:31.122936 18038 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:31.123440 18138 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:31.123780 18038 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:31.124560 17994 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:31.133100 17859 consensus_queue.cc:1048] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:31.135104 13727 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:31.136719 18059 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:31.137904 18172 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:31.139524 18059 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199)
I20260709 12:11:31.140421 18172 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:31.140779 17859 raft_consensus.cc:2749] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:31.097658 18120 consensus_queue.cc:260] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:31.143380 13727 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
W20260709 12:11:31.146231 18199 log.cc:927] Time spent T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 12:11:31.151029 13687 raft_consensus.cc:1275] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:31.152534 14409 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 10.
I20260709 12:11:31.086323 18200 raft_consensus.cc:2804] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:31.155524 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:31.156675 18155 consensus_queue.cc:1048] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:31.075119 17871 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:31.154318 18038 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:31.157974 17871 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:31.159217 18155 consensus_queue.cc:1048] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:11:31.161387 18155 raft_consensus.cc:2804] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:31.162776 18155 raft_consensus.cc:697] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:31.164335 18155 consensus_queue.cc:237] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:31.162776 13727 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:31.154541 18200 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:31.186995 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:31.189441 13679 raft_consensus.cc:1275] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:31.181012 18170 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:31.182906 18200 raft_consensus.cc:3060] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:31.193352 18135 log.cc:927] Time spent T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 1.136s	user 0.006s	sys 0.004s
I20260709 12:11:31.218693 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:31.161381 18137 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:31.193702 18170 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:31.195241 17994 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:31.227414 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 64932.3us
I20260709 12:11:31.231451 13679 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:31.237586 18165 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:31.238046 17992 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:31.238584 18165 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:31.240583 17578 raft_consensus.cc:2804] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:31.241118 17578 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:31.241541 17578 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:31.233390 18154 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:31.238765 17992 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:31.234347 17994 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:31.255030 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:31.257745 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:31.258826 13687 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 11.
I20260709 12:11:31.260823 13688 raft_consensus.cc:2468] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 6.
I20260709 12:11:31.261438 18038 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:31.262108 18038 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:31.263037 18140 log.cc:927] Time spent T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 1.060s	user 0.005s	sys 0.002s
I20260709 12:11:31.267037 18038 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:31.266923 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:11:31.267395 18141 log.cc:927] Time spent T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 1.102s	user 0.000s	sys 0.001s
I20260709 12:11:31.268465 17990 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.268755 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:11:31.269177 18148 log.cc:927] Time spent T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.990s	user 0.002s	sys 0.000s
I20260709 12:11:31.269281 17990 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:31.272661 17990 leader_election.cc:290] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:31.276511 13727 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:31.282811 14415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41692 (request call id 707) took 1166 ms. Trace:
W20260709 12:11:31.283262 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.284942 13651 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:31.263605 13801 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:31.253509 13726 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:31.291226 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:31.285830 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:31.283378 14415 rpcz_store.cc:276] 0709 12:11:30.116527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:30.149709 (+ 33182us) service_pool.cc:224] Handling call
0709 12:11:31.282414 (+1132705us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b54004b41d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:31.282577 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":515585792}
I20260709 12:11:31.301100 13685 raft_consensus.cc:2468] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 9.
I20260709 12:11:31.306392 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:31.250389 18165 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:31.316089 13686 raft_consensus.cc:2410] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
W20260709 12:11:31.320822 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 175250us
I20260709 12:11:31.325248 14408 raft_consensus.cc:1240] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:31.328440 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:31.332906 18168 raft_consensus.cc:3055] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:31.336160 13688 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 13.
I20260709 12:11:31.329042 18072 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:31.333546 18168 raft_consensus.cc:740] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:31.337091 18188 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:11:31.343006 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 66744.8us
I20260709 12:11:31.354194 18195 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:31.340469 18072 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:31.368561 18207 raft_consensus.cc:2749] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:31.369020 18072 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:31.370124 18137 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:31.371485 17992 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:31.372128 17578 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:31.344980 18188 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:31.373128 18188 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:31.373453 13763 raft_consensus.cc:1240] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:31.375574 17578 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:31.384423 13801 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:31.404153 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:31.413062 13679 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 11.
W20260709 12:11:31.411911 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 67245us
I20260709 12:11:31.365521 17602 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:31.423086 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:31.379702 17900 consensus_queue.cc:1059] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:11:31.430027 14380 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:31.431885 18028 raft_consensus.cc:2804] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:31.432617 18028 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:31.433090 18028 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:31.438318 18197 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.439297 13652 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:31.439710 17994 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:31.440446 18011 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:31.440685 18181 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.441210 18011 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:31.443281 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:31.443897 18011 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:31.441386 18181 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:31.445302 17602 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:31.452099 18136 log.cc:927] Time spent T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 1.291s	user 0.001s	sys 0.003s
I20260709 12:11:31.459151 18166 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:31.459259 18122 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.452052 18057 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.460120 18122 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:31.460510 18057 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:31.462983 18122 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:31.463222 18057 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:11:31.464512 18206 log.cc:927] Time spent T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
W20260709 12:11:31.465624 18118 consensus_meta.cc:287] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 1.300s	user 0.010s	sys 0.010s
I20260709 12:11:31.459844 18166 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:31.431102 18044 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:11:31.467486 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 64239.3us
I20260709 12:11:31.468286 13800 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
W20260709 12:11:31.445199 17989 consensus_meta.cc:287] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.685s	user 0.014s	sys 0.004s
I20260709 12:11:31.474220 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:31.474720 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:31.470080 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 44138us
W20260709 12:11:31.457201 18003 consensus_meta.cc:287] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.815s	user 0.011s	sys 0.008s
I20260709 12:11:31.475092 18166 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:31.503877 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 47502us
I20260709 12:11:31.505252 13800 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:31.509093 17602 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:31.441594 18168 consensus_queue.cc:260] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:31.510356 17989 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:31.512454 18215 log.cc:927] Time spent T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 12:11:31.474015 18011 raft_consensus.cc:2749] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:31.522236 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:31.523594 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.523759 18122 raft_consensus.cc:2749] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:31.524849 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:31.525354 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:31.526679 18211 log.cc:927] Time spent T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
I20260709 12:11:31.527467 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:31.523655 14379 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:31.528568 14379 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:31.529379 14379 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:31.530032 17992 raft_consensus.cc:2804] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:31.530551 17992 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:31.530686 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:31.531145 17992 raft_consensus.cc:3060] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:31.531819 13761 raft_consensus.cc:2393] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 9: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:31.533934 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:31.534108 17952 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:11:31.534343 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 95243.5us
I20260709 12:11:31.534602 17952 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:31.534816 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:31.535079 17952 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:31.536223 13652 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:31.536404 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:31.536921 18154 consensus_queue.cc:1048] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:31.537668 17989 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:31.538116 17913 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:31.538702 17913 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:31.538921 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:31.539228 18154 raft_consensus.cc:2749] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:11:31.540285 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.477623 18044 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
W20260709 12:11:31.545873 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 59063.9us
I20260709 12:11:31.544982 13754 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 9.
W20260709 12:11:31.547305 18214 log.cc:927] Time spent T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
I20260709 12:11:31.548007 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:31.549012 18174 log.cc:927] Time spent T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.975s	user 0.002s	sys 0.001s
W20260709 12:11:31.549324 18212 log.cc:927] Time spent T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
W20260709 12:11:31.551168 18030 consensus_meta.cc:287] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.822s	user 0.013s	sys 0.006s
I20260709 12:11:31.551818 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:31.550806 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:31.482082 18200 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:31.553707 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:31.553587 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:31.519722 18003 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:31.557582 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:31.439330 18197 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:31.560436 13684 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:31.558197 13652 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:31.561760 13800 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:31.545302 18044 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:31.580940 13833 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:31.563511 18118 raft_consensus.cc:2804] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:31.590456 18149 raft_consensus.cc:2749] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:31.591699 18193 raft_consensus.cc:2804] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:31.592514 18193 raft_consensus.cc:697] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 11 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:31.593703 18193 consensus_queue.cc:237] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:31.593750 18028 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:31.596261 18028 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:31.593919 13727 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:31.546891 17871 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:31.604933 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.579094 18195 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:31.586639 18118 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:31.567338 18072 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:31.597512 18165 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:31.614324 18028 raft_consensus.cc:2804] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:31.619262 13726 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:11:31.624214 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 86421.1us
I20260709 12:11:31.629900 17602 raft_consensus.cc:2804] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:11:31.630131 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 73434.9us
I20260709 12:11:31.639995 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:31.619807 18118 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:31.624294 18003 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:31.633883 18137 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.637953 18120 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:31.653868 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 43794us
I20260709 12:11:31.637744 18028 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:31.639065 17602 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:31.661625 13754 raft_consensus.cc:1275] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:31.649762 18030 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:31.665887 13652 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
W20260709 12:11:31.668514 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 103421us
I20260709 12:11:31.663453 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:31.638191 18009 consensus_queue.cc:1048] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:11:31.640141 18195 consensus_queue.cc:1059] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:11:31.663516 18030 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:31.674049 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:31.674307 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:31.674995 13756 raft_consensus.cc:2393] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 12: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:31.675077 14414 raft_consensus.cc:2368] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 12. Current term is 13.
I20260709 12:11:31.675951 18030 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:31.676425 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:31.680667 18072 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:31.661170 18181 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:31.665036 17602 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:31.686210 14416 raft_consensus.cc:1240] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:31.664376 18028 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:31.691326 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:31.692633 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 44556.8us
I20260709 12:11:31.700735 13684 raft_consensus.cc:2468] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 11.
I20260709 12:11:31.686355 18154 raft_consensus.cc:2804] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:31.686923 18207 raft_consensus.cc:2804] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:31.661269 18165 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:31.705963 13801 leader_election.cc:400] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 election: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 12. Current term is 13.
I20260709 12:11:31.706331 13801 leader_election.cc:403] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:11:31.682617 18197 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:31.709218 14379 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:31.712935 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:31.671169 18137 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:31.703868 18166 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:31.716713 13800 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:31.719527 17989 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.707289 18200 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:31.723306 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 61618.6us
I20260709 12:11:31.722574 17987 consensus_queue.cc:1059] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 12:11:31.726066 17989 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:31.694767 18003 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.673555 17913 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:31.704162 18154 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:31.732327 18166 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:31.732766 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:31.733357 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:31.734319 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:31.734508 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:31.735159 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:31.737037 17987 raft_consensus.cc:3055] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:31.738226 18170 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.739882 17992 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:31.739882 18188 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:31.742178 17583 consensus_meta.cc:287] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 1.290s	user 0.018s	sys 0.003s
I20260709 12:11:31.744127 13727 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:31.745242 17900 consensus_queue.cc:1048] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:11:31.745312 18155 consensus_queue.cc:1048] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:31.775055 13762 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:31.710018 18044 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:31.747090 18137 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:31.767737 18154 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:31.748041 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:31.707209 18207 raft_consensus.cc:697] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:31.786212 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:31.750183 17871 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:31.750248 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:31.753556 18181 consensus_queue.cc:1048] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:31.755366 18011 consensus_queue.cc:1048] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:31.756343 18168 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:31.792789 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:31.793534 13828 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 12.
I20260709 12:11:31.795986 18207 consensus_queue.cc:237] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:31.798584 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:31.799445 18166 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:31.799607 14409 raft_consensus.cc:3060] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:31.800122 18166 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:31.802649 17913 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:31.803544 13681 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 11.
I20260709 12:11:31.804370 18030 raft_consensus.cc:3055] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:31.805006 18030 raft_consensus.cc:740] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:31.789628 13581 catalog_manager.cc:5697] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:31.806209 18122 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:31.806845 18122 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:31.809242 18122 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:31.809353 17989 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:31.758525 18165 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:11:31.760200 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.760248 14408 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 12.
I20260709 12:11:31.778070 18201 raft_consensus.cc:2749] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:31.765141 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:11:31.730032 18138 consensus_meta.cc:287] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.606s	user 0.012s	sys 0.004s
I20260709 12:11:31.771112 13757 raft_consensus.cc:2393] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 10: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:31.771647 13652 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:31.746714 13800 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:31.766875 18110 raft_consensus.cc:2804] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:31.747380 18200 raft_consensus.cc:2749] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:31.780925 13763 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 12.
I20260709 12:11:31.768810 17987 raft_consensus.cc:740] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:31.789039 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:31.815521 13762 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 11.
W20260709 12:11:31.828329 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 84303.9us
I20260709 12:11:31.800020 14380 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:31.765902 18003 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:31.834443 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:31.762439 13833 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 13.
I20260709 12:11:31.827150 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:31.770231 18170 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:31.836509 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:31.838068 18072 raft_consensus.cc:2804] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:31.838848 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:31.839061 13801 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:31.784111 17583 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:31.844831 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 100744us
I20260709 12:11:31.846698 14380 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:31.851507 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:31.852210 13755 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:31.838590 18072 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:31.840072 18110 raft_consensus.cc:697] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 11 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:31.837072 18195 raft_consensus.cc:2749] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 12. Current term is 13.
I20260709 12:11:31.856804 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:31.814440 17952 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:31.863060 18137 raft_consensus.cc:2804] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:31.863727 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:31.859890 13581 catalog_manager.cc:5697] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 6 to 10, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 10 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
W20260709 12:11:31.864424 13585 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45618 (request call id 233) took 38834 ms (client timeout 15000 ms). Trace:
I20260709 12:11:31.828502 18138 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:31.863062 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:31.869884 13688 raft_consensus.cc:1240] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:11:31.871912 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:31.872367 13686 raft_consensus.cc:1275] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:31.872453 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:31.875779 17992 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199)
I20260709 12:11:31.877053 18044 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:31.882097 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 118018us
I20260709 12:11:31.861440 18030 consensus_queue.cc:260] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:31.924572 18030 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:31.882918 14416 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 16.
I20260709 12:11:31.926642 17927 consensus_queue.cc:1048] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:31.928642 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:31.929528 13688 raft_consensus.cc:2368] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 13. Current term is 14.
I20260709 12:11:31.931262 13652 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:31.932467 17987 consensus_queue.cc:260] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:31.934222 13652 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:31.884821 13754 raft_consensus.cc:1240] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:11:31.886651 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:11:31.892920 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:31.892773 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 80475.5us
I20260709 12:11:31.838608 18166 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:31.844004 18165 raft_consensus.cc:2804] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:31.843255 18193 raft_consensus.cc:2804] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:31.906723 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:31.846849 17989 raft_consensus.cc:2804] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:31.865087 17977 consensus_queue.cc:1048] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:31.914404 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:31.894438 18072 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:31.917243 13835 raft_consensus.cc:2393] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 12: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
W20260709 12:11:31.917762 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 171168us
I20260709 12:11:31.919495 13755 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 13.
I20260709 12:11:31.935551 13801 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:31.943943 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:31.948349 14413 raft_consensus.cc:2393] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 11: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:11:31.951020 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:31.934149 17987 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:31.961115 13756 raft_consensus.cc:1240] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:31.962025 18044 consensus_queue.cc:1059] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:31.963186 18044 raft_consensus.cc:3055] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:31.963651 18044 raft_consensus.cc:740] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:31.964836 18044 consensus_queue.cc:260] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:31.934782 18137 raft_consensus.cc:697] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 13 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:31.941658 17989 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:31.969504 13757 raft_consensus.cc:1240] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:31.943107 18165 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:31.945289 18193 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:31.946184 18118 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:31.974946 18170 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:31.978192 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:31.979104 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:31.983343 13800 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:31.984193 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:31.959771 18181 raft_consensus.cc:2749] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:31.988091 18057 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.952534 18003 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:31.978291 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:31.990003 17583 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:31.970553 13759 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 9.
I20260709 12:11:31.958637 18200 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:31.991539 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:31.999292 14409 raft_consensus.cc:2468] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 8.
I20260709 12:11:32.004045 13679 raft_consensus.cc:3060] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:32.005211 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 71077.6us
I20260709 12:11:32.010051 13726 leader_election.cc:400] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 election: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 13. Current term is 14.
I20260709 12:11:32.018795 13726 leader_election.cc:403] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:11:32.019182 13801 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:31.996536 17989 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:31.952745 18028 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:31.999606 18165 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:31.998446 18193 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:32.028766 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:32.025897 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:32.029562 13686 raft_consensus.cc:2468] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 10.
I20260709 12:11:32.036687 14413 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:32.039558 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:32.040184 14409 raft_consensus.cc:2393] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 12: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:11:32.001374 18207 consensus_queue.cc:1048] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:11:32.018096 18200 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:32.046881 18200 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:11:32.048426 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.050123 13727 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:32.052182 17578 raft_consensus.cc:2749] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:32.018826 18110 consensus_queue.cc:237] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:32.055124 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:32.057713 14379 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:32.058710 17992 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:32.059710 14379 leader_election.cc:304] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:32.060611 17992 raft_consensus.cc:2749] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:32.061893 17602 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:32.064693 17602 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:32.064970 14410 raft_consensus.cc:1240] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:32.032343 18197 raft_consensus.cc:2804] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:32.067364 18200 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:32.070966 18200 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:32.071990 18137 consensus_queue.cc:237] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:32.042011 13833 raft_consensus.cc:2468] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 10.
I20260709 12:11:32.043412 13652 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:32.023319 18188 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:32.026103 18044 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:32.073935 14380 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:11:31.912837 13585 rpcz_store.cc:269] 0709 12:10:53.020081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.087878 (+ 67797us) service_pool.cc:224] Handling call
0709 12:11:31.847440 (+38759562us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:26.701654 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:26.929971 (+228317us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:26.930023 (+    52us) write_op.cc:435] Acquired schema lock
0709 12:11:26.930054 (+    31us) tablet.cc:662] Decoding operations
0709 12:11:27.127511 (+197457us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:27.127578 (+    67us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:27.127607 (+    29us) tablet.cc:685] Acquiring locks for 18 operations
0709 12:11:27.129292 (+  1685us) tablet.cc:701] Row locks acquired
0709 12:11:27.129313 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:11:27.129497 (+   184us) write_op.cc:270] Start()
0709 12:11:27.129638 (+   141us) write_op.cc:276] Timestamp: P: 1783599087129437 usec, L: 0
0709 12:11:27.129662 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:11:27.231865 (+102203us) log.cc:844] Serialized 7124 byte log entry
0709 12:11:27.685302 (+453437us) op_driver.cc:464] REPLICATION: finished
0709 12:11:27.776857 (+ 91555us) write_op.cc:301] APPLY: starting
0709 12:11:27.776974 (+   117us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:27.827169 (+ 50195us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:27.827288 (+   119us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:27.909972 (+ 82684us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:27.910841 (+   869us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=36,key_file_lookups=36,delta_file_lookups=36,mrs_lookups=0
0709 12:11:27.910907 (+    66us) write_op.cc:312] APPLY: finished
0709 12:11:27.911535 (+   628us) log.cc:844] Serialized 164 byte log entry
0709 12:11:27.912480 (+   945us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:27.973677 (+ 61197us) write_op.cc:454] Released schema lock
0709 12:11:27.976265 (+  2588us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:28.097720 (+121455us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:28.102802 (+  5082us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":369426,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":91162,"apply.run_cpu_time_us":28705,"apply.run_wall_time_us":263288,"cfile_cache_hit":74,"cfile_cache_hit_bytes":79367,"num_ops":18,"prepare.queue_time_us":308403,"prepare.run_cpu_time_us":54359,"prepare.run_wall_time_us":869631,"raft.queue_time_us":91863,"raft.run_cpu_time_us":8262,"raft.run_wall_time_us":50058,"replication_time_us":555357,"thread_start_us":468242,"threads_started":4,"wal-append.queue_time_us":290073,"wal-append.run_cpu_time_us":9848,"wal-append.run_wall_time_us":1374461}]]}
I20260709 12:11:32.075079 17992 raft_consensus.cc:2804] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:32.075562 17992 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:32.076007 17992 raft_consensus.cc:3060] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:32.072376 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:32.078313 14410 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:32.079476 18118 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:32.042666 18057 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:32.082065 18057 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:32.082484 18181 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:32.084437 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 101235us
I20260709 12:11:32.085311 13800 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:32.086119 13763 raft_consensus.cc:1275] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:32.041898 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:32.067785 13679 raft_consensus.cc:2468] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 10.
I20260709 12:11:32.089851 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:32.098173 14379 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:32.092226 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:11:32.104197 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.032613 18003 raft_consensus.cc:2749] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:32.089740 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 52792.6us
I20260709 12:11:32.039167 18120 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:32.130476 13834 raft_consensus.cc:1275] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:32.126670 17952 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:11:32.128019 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.067328 18028 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:32.134438 14379 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:32.140410 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:32.142194 14416 raft_consensus.cc:1240] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:32.144374 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:32.127859 18166 raft_consensus.cc:2749] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:32.148419 13679 raft_consensus.cc:1240] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 9. Current term is 10. Ops: [7.8-9.9]
I20260709 12:11:32.149991 13652 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:32.154014 18195 raft_consensus.cc:2749] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:32.154500 14408 raft_consensus.cc:1240] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 11 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:32.154976 17935 raft_consensus.cc:2749] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:32.161247 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:32.156512 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 71292.6us
I20260709 12:11:32.171523 13800 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:32.174149 13830 raft_consensus.cc:2393] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 11: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:32.111176 18197 raft_consensus.cc:697] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 8 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:32.180310 18197 consensus_queue.cc:237] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:32.198980 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:32.205945 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:11:32.206478 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 56584.9us
I20260709 12:11:32.207214 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:32.208328 18149 raft_consensus.cc:2804] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:32.208796 18149 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:32.209239 18149 raft_consensus.cc:3060] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:32.210454 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 95941.2us
I20260709 12:11:32.211388 14379 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:32.212558 17992 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:32.215371 17992 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:32.219440 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:32.220680 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 83473.6us
I20260709 12:11:32.223559 14413 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 12.
I20260709 12:11:32.224076 14410 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 17.
I20260709 12:11:32.207404 13652 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:32.193091 18154 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:32.189208 17989 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:32.232522 13684 raft_consensus.cc:1240] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:11:32.231302 13801 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:32.234568 14379 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:32.138690 18138 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:32.235751 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:32.238922 13834 raft_consensus.cc:3060] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:32.239176 18166 raft_consensus.cc:2749] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:32.259531 18170 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:32.259176 18072 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:32.260295 18170 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:32.261003 13682 raft_consensus.cc:1240] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 12. Current term is 13. Ops: [10.6-12.7]
I20260709 12:11:32.229660 17935 raft_consensus.cc:2804] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:32.264585 17935 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:32.265019 17935 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:32.266857 13801 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:32.268041 18168 raft_consensus.cc:2804] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:32.268177 18122 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.268751 18168 raft_consensus.cc:697] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 12 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:32.268115 18003 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:32.270373 18003 raft_consensus.cc:697] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 17 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:32.269937 18168 consensus_queue.cc:237] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:32.271370 18003 consensus_queue.cc:237] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:32.272962 14413 raft_consensus.cc:1240] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:32.268983 18122 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:32.274595 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:32.275067 14413 raft_consensus.cc:1240] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:32.275326 13828 raft_consensus.cc:2376] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 12. Re-sending same reply.
I20260709 12:11:32.276317 18122 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:32.276523 13829 raft_consensus.cc:1275] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:11:32.276849 13830 raft_consensus.cc:1240] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:32.277596 13836 raft_consensus.cc:1240] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:32.278126 13832 raft_consensus.cc:1240] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:32.278481 13835 raft_consensus.cc:1275] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:32.228668 18110 raft_consensus.cc:2804] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:32.279400 18110 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:32.279695 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:32.280416 13833 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 7.
I20260709 12:11:32.282024 18154 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:32.282757 13652 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:32.279873 18110 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:32.285033 17989 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:32.257210 18165 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:32.288887 18072 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:32.289952 18122 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:32.293744 18030 raft_consensus.cc:2749] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:32.294309 18122 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:32.292269 18165 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:32.293855 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:32.290695 18170 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:32.295750 18181 raft_consensus.cc:2749] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:32.296317 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 53447.4us
I20260709 12:11:32.296962 18011 consensus_queue.cc:1059] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:11:32.298036 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 61968.3us
I20260709 12:11:32.298673 17927 raft_consensus.cc:2804] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:32.292673 13834 raft_consensus.cc:2468] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 11.
W20260709 12:11:32.294159 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 122826us
I20260709 12:11:32.303068 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:32.319057 14410 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 10.
I20260709 12:11:32.322363 14380 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:32.324469 13801 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:32.325968 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:32.327041 13833 raft_consensus.cc:2468] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 9.
I20260709 12:11:32.326249 13651 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:11:32.330193 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 95664.9us
I20260709 12:11:32.312474 17992 raft_consensus.cc:2804] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:32.341372 17992 raft_consensus.cc:697] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 11 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:32.342931 14379 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:32.343143 17992 consensus_queue.cc:237] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:32.301888 13756 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "b98d2519bb504dc6905ed2ede4571835"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:11:32.321272 17927 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:32.353235 18072 raft_consensus.cc:2804] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:32.353338 18207 consensus_queue.cc:1048] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:32.354507 18011 consensus_queue.cc:1048] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:32.356024 18138 raft_consensus.cc:2749] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:32.325343 17989 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.356377 14410 raft_consensus.cc:1240] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:11:32.356606 14379 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:32.357199 14408 raft_consensus.cc:1240] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 16. Current term is 17. Ops: []
I20260709 12:11:32.357565 13727 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:32.390439 14379 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:32.329149 18170 raft_consensus.cc:2804] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:32.346873 18154 raft_consensus.cc:3055] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:32.361577 18149 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:32.336048 18030 raft_consensus.cc:2804] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:32.366076 13837 raft_consensus.cc:1240] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:32.370281 13756 raft_consensus.cc:606] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Received request to transfer leadership to TS b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:32.348702 14380 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:32.393065 14379 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:11:32.398959 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 50344.1us
I20260709 12:11:32.257388 18193 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:32.386466 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:32.400735 13834 raft_consensus.cc:2393] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 10: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
W20260709 12:11:32.400022 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 48308us
I20260709 12:11:32.298730 18110 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:32.382473 17927 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:32.395146 18166 raft_consensus.cc:2749] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:32.385035 18072 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:32.405040 14379 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:11:32.408353 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 50898.7us
I20260709 12:11:32.412074 13834 raft_consensus.cc:1275] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:32.405939 13651 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:32.394733 18137 raft_consensus.cc:2749] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:32.403570 17871 raft_consensus.cc:2749] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:32.394017 18154 raft_consensus.cc:740] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:32.396452 18030 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:32.416661 14413 raft_consensus.cc:2393] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 13: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:11:32.418221 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:32.422050 18030 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:32.414286 18213 raft_consensus.cc:2749] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:32.413959 18072 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:32.423035 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:11:32.423560 18239 log.cc:927] Time spent T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:11:32.423893 13682 raft_consensus.cc:3060] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:32.400445 17989 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:32.427059 18122 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:32.428489 17989 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:32.429695 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:32.430573 14408 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 12.
I20260709 12:11:32.432207 13801 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:32.436055 17871 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.436710 17871 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:32.441617 17989 raft_consensus.cc:2804] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:32.442696 17989 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:32.443387 17989 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:32.441522 17871 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:32.402783 18009 raft_consensus.cc:2749] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:32.451849 13682 raft_consensus.cc:2468] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 11.
I20260709 12:11:32.403232 18170 raft_consensus.cc:697] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 11 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:32.404203 17952 raft_consensus.cc:2804] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:32.457147 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:32.458209 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:32.458860 13837 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 10.
I20260709 12:11:32.459738 13829 raft_consensus.cc:1240] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 12 LEADER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:32.461273 18013 consensus_queue.cc:1059] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:32.462011 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:32.462797 13830 raft_consensus.cc:2368] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 13. Current term is 14.
I20260709 12:11:32.462707 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:32.463464 13829 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:32.462028 13831 raft_consensus.cc:1240] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:32.464615 18013 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.465168 18013 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:32.466197 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:32.467345 18155 raft_consensus.cc:3055] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:32.467720 18155 raft_consensus.cc:740] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:32.468211 18120 raft_consensus.cc:2749] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 13. Current term is 14.
I20260709 12:11:32.468611 18155 consensus_queue.cc:260] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:32.473315 18131 consensus_queue.cc:1059] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:32.474591 18131 consensus_queue.cc:1059] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:32.475380 18227 raft_consensus.cc:3055] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:32.475795 18227 raft_consensus.cc:740] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:32.476408 17977 raft_consensus.cc:3055] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:32.476825 17977 raft_consensus.cc:740] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:32.476702 18227 consensus_queue.cc:260] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:32.477537 18072 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:32.477820 17977 consensus_queue.cc:260] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:32.478497 17859 consensus_queue.cc:1059] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:32.479193 17977 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:32.479511 18149 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:32.474664 17578 consensus_queue.cc:1059] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:32.481974 18120 consensus_queue.cc:1059] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:32.482659 17578 raft_consensus.cc:3055] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:32.482899 18193 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:32.483098 18120 raft_consensus.cc:3055] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:11:32.483789 18120 raft_consensus.cc:740] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:32.466392 13831 raft_consensus.cc:1275] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:32.484697 13800 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:32.483090 17578 raft_consensus.cc:740] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:32.486212 13800 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:32.485296 18120 consensus_queue.cc:260] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:32.487056 18122 raft_consensus.cc:2804] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:32.486789 17578 consensus_queue.cc:260] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:32.487604 18122 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:32.488121 18122 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:32.485348 18155 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:32.488623 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:32.489817 17952 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:32.490283 17952 raft_consensus.cc:3060] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:32.490223 18030 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:32.494172 18227 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:32.494582 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 60162.4us
I20260709 12:11:32.487731 13800 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:32.499001 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:32.486711 14379 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:32.479655 18072 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:32.503297 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:32.513352 13829 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 12.
W20260709 12:11:32.514245 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 162063us
I20260709 12:11:32.515643 13763 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:32.520812 13761 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 14.
I20260709 12:11:32.526074 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:32.486725 18168 raft_consensus.cc:2749] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:32.527525 14379 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:32.528432 13830 raft_consensus.cc:3055] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:32.533875 13830 raft_consensus.cc:740] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:32.529481 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:11:32.534727 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.529202 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:32.535349 13651 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:32.536902 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:11:32.544063 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 56425.2us
I20260709 12:11:32.545468 13681 raft_consensus.cc:1275] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:32.488150 17578 raft_consensus.cc:3060] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:32.552675 13756 raft_consensus.cc:1275] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 12:11:32.553224 13756 pending_rounds.cc:85] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting all ops after (but not including) 9
I20260709 12:11:32.553798 13831 raft_consensus.cc:2393] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 13: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
W20260709 12:11:32.553927 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.555476 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:32.556360 13687 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:11:32.479223 17859 consensus_queue.cc:1243] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer ca9fbbc2c0a94897897d502d42f3951f log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:11:32.559028 13679 raft_consensus.cc:1275] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:32.455714 18243 raft_consensus.cc:2804] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:32.524472 18200 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:32.537628 18166 raft_consensus.cc:2804] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:32.532666 18028 raft_consensus.cc:2749] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:32.553524 13756 pending_rounds.cc:107] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 12:11:32.579020 13756 raft_consensus.cc:2889] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:32.537016 18137 raft_consensus.cc:2749] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:32.579303 13684 raft_consensus.cc:1275] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:32.569628 13830 consensus_queue.cc:260] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:32.589977 18200 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:32.563318 18243 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:32.594156 18243 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:32.599902 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.604115 18170 consensus_queue.cc:237] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:32.606621 18110 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:32.607379 18003 consensus_queue.cc:1059] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:32.611591 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:32.611773 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:32.612618 13757 raft_consensus.cc:2393] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 10: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
W20260709 12:11:32.613196 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.613267 14408 raft_consensus.cc:1240] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:32.614226 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:32.617372 13835 raft_consensus.cc:1240] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 17 LEADER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 16. Current term is 17. Ops: []
I20260709 12:11:32.618636 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:32.621984 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:32.623646 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:32.571343 18120 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:32.633296 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:32.633594 18154 consensus_queue.cc:260] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:32.634754 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:32.635677 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:32.635733 18013 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:32.625239 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:32.638718 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:32.639501 14409 raft_consensus.cc:2368] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 7. Current term is 8.
I20260709 12:11:32.639284 17935 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:32.642076 13685 raft_consensus.cc:1240] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:32.642220 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:32.642839 13684 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:32.643983 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:32.645982 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:32.631479 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:32.646628 13682 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 14.
I20260709 12:11:32.626470 14416 raft_consensus.cc:2393] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 10: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:11:32.631762 13760 raft_consensus.cc:1240] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:11:32.634024 18044 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.631632 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:32.661924 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:32.664290 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:32.665042 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:32.665745 13755 raft_consensus.cc:2368] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 12. Current term is 13.
I20260709 12:11:32.668587 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:32.669701 13754 raft_consensus.cc:2393] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 14: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:32.668509 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:32.672654 13763 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 10.
I20260709 12:11:32.672421 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:32.641577 17935 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:32.674955 14416 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 10.
W20260709 12:11:32.678660 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 149995us
I20260709 12:11:32.679387 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:32.680972 13830 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:32.624807 18011 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:32.684921 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:32.620108 18166 raft_consensus.cc:697] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 10 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:32.685179 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:32.690748 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:32.687608 13831 raft_consensus.cc:1275] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:11:32.689654 14416 raft_consensus.cc:2393] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 14: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:11:32.693104 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:32.693941 13684 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 14.
I20260709 12:11:32.694106 18154 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:32.695390 17900 raft_consensus.cc:993] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7: : Instructing follower b98d2519bb504dc6905ed2ede4571835 to start an election
I20260709 12:11:32.701761 13758 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "b98d2519bb504dc6905ed2ede4571835"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:11:32.706194 13758 raft_consensus.cc:606] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 LEADER]: Received request to transfer leadership to TS b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:32.707585 13651 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:32.672073 18122 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:32.734306 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:32.735030 13681 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 8.
I20260709 12:11:32.736035 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:32.736236 18122 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:32.736713 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:32.737110 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:32.737569 18207 raft_consensus.cc:3055] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:32.737953 13682 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 8.
I20260709 12:11:32.738065 18207 raft_consensus.cc:740] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:32.738317 18072 raft_consensus.cc:2804] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:32.738511 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:32.717522 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:32.738893 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:32.739146 18207 consensus_queue.cc:260] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:32.740161 13762 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "b98d2519bb504dc6905ed2ede4571835"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:11:32.740393 13682 raft_consensus.cc:1240] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 11 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:11:32.740761 13762 raft_consensus.cc:606] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 LEADER]: Received request to transfer leadership to TS b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:32.740831 18207 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:32.730240 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:32.710680 17900 raft_consensus.cc:1081] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Signalling peer b98d2519bb504dc6905ed2ede4571835 to start an election
I20260709 12:11:32.731096 17578 consensus_queue.cc:1059] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:32.745357 13758 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 9.
I20260709 12:11:32.707859 17977 consensus_queue.cc:1059] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:11:32.746129 17977 consensus_queue.cc:1243] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer b98d2519bb504dc6905ed2ede4571835 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:11:32.746667 17977 raft_consensus.cc:3055] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:32.746783 13837 raft_consensus.cc:1240] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:11:32.747051 17977 raft_consensus.cc:740] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:32.748135 17977 consensus_queue.cc:260] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:32.750164 18030 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:32.750571 13760 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8195765ed074b74be387475c214120b"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "b98d2519bb504dc6905ed2ede4571835"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:11:32.751235 13760 raft_consensus.cc:606] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 LEADER]: Received request to transfer leadership to TS b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:32.751819 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:32.752491 14409 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:32.745092 18155 raft_consensus.cc:3055] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:32.753468 18155 raft_consensus.cc:740] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:32.754956 18155 consensus_queue.cc:260] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:32.756387 18155 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:32.756554 14410 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 6.
I20260709 12:11:32.759822 13828 raft_consensus.cc:1275] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:32.738904 18072 raft_consensus.cc:697] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 10 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:32.762378 18072 consensus_queue.cc:237] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:32.763204 13760 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dabf40829555486da9d6b588472147ec"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "b98d2519bb504dc6905ed2ede4571835"
 from {username='slave'} at 127.0.0.1:39554
W20260709 12:11:32.765046 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.732901 17952 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:32.768138 17952 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:32.779641 13830 raft_consensus.cc:1275] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:32.732070 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:32.783856 13688 raft_consensus.cc:3060] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:32.705382 18137 consensus_queue.cc:1048] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 12:11:32.737210 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:32.784834 13681 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 11.
I20260709 12:11:32.733143 18166 consensus_queue.cc:237] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:32.641637 17927 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:32.788411 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:32.749549 17977 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:32.810099 14409 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 11.
I20260709 12:11:32.811561 13801 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:32.667065 18044 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:32.804358 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:32.812915 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:32.812956 13828 raft_consensus.cc:3060] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:32.785847 13652 connection.cc:256] RPC call timeout handler was delayed by -1.6145316259999163s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1726s for a response
W20260709 12:11:32.816756 13652 connection.cc:256] RPC call timeout handler was delayed by -1.5497316260000389s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17980000000000002s for a response
I20260709 12:11:32.816952 13755 raft_consensus.cc:1240] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 11. Current term is 12. Ops: []
W20260709 12:11:32.817117 13652 connection.cc:256] RPC call timeout handler was delayed by -1.0029134290000457s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16510000000000002s for a response
I20260709 12:11:32.823499 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:32.824755 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:32.816126 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:32.711125 18011 raft_consensus.cc:697] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 14 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:32.829361 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:32.838172 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:32.832108 14379 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:32.745518 18200 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:11:32.809499 18247 log.cc:927] Time spent T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.062s	user 0.000s	sys 0.005s
I20260709 12:11:32.834862 13680 raft_consensus.cc:1275] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:11:32.823313 18246 log.cc:927] Time spent T 00000000000000000000000000000000 P 17d79eae88f84be7a847d0cf544674cd: Append to log took a long time: real 0.126s	user 0.004s	sys 0.001s
W20260709 12:11:32.816184 18242 log.cc:927] Time spent T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.259s	user 0.003s	sys 0.003s
I20260709 12:11:32.859185 18044 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:32.859436 13759 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 17.
I20260709 12:11:32.860970 17927 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:32.864339 18248 log.cc:927] Time spent T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.117s	user 0.000s	sys 0.003s
I20260709 12:11:32.709540 17989 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:32.867739 17989 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:32.869064 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:32.842551 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:32.844405 13682 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 9.
I20260709 12:11:32.844606 13763 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 11.
W20260709 12:11:32.829288 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 139800us
W20260709 12:11:32.873450 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 44168.6us
I20260709 12:11:32.846359 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:11:32.823170 18249 log.cc:927] Time spent T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.074s	user 0.003s	sys 0.001s
I20260709 12:11:32.847826 14408 raft_consensus.cc:1275] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:32.849958 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:32.877328 13834 raft_consensus.cc:2393] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 13: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:32.853945 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:32.855775 18011 consensus_queue.cc:237] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:32.800011 17952 consensus_queue.cc:1048] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 12:11:32.826198 18122 raft_consensus.cc:2804] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:32.858081 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:32.858913 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:32.908020 13727 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:32.889356 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:32.908962 14416 raft_consensus.cc:2368] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 7. Current term is 8.
I20260709 12:11:32.908936 14380 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:32.897262 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:32.911645 13757 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 11.
I20260709 12:11:32.923316 13686 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 10.
I20260709 12:11:32.815923 17871 consensus_queue.cc:1048] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 12:11:32.924420 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:32.924453 14414 raft_consensus.cc:1275] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:11:32.926133 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:32.929142 13652 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:32.938244 13688 raft_consensus.cc:2468] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 8.
I20260709 12:11:32.847064 18170 raft_consensus.cc:2749] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:32.842181 18193 consensus_queue.cc:1059] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.082s
I20260709 12:11:32.946456 18122 raft_consensus.cc:697] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 11 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:32.965423 13727 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:32.976732 13727 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:32.966159 18240 raft_consensus.cc:2764] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:11:32.995239 13727 leader_election.cc:400] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 election: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 13. Current term is 14.
W20260709 12:11:32.983435 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 89644.5us
I20260709 12:11:32.941732 18110 consensus_queue.cc:1048] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 12:11:32.941303 18227 consensus_queue.cc:1059] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
W20260709 12:11:33.002362 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 73331.5us
I20260709 12:11:33.003618 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:33.003831 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:32.999903 17602 raft_consensus.cc:2749] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:33.000125 17913 consensus_queue.cc:1048] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:11:33.000252 17578 raft_consensus.cc:2804] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:33.005376 18154 consensus_queue.cc:1059] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:32.939139 17989 consensus_queue.cc:1059] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 12:11:32.947295 18044 consensus_queue.cc:1048] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:11:33.014824 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:33.014961 13756 raft_consensus.cc:2368] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 9. Current term is 10.
I20260709 12:11:32.970649 17992 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:33.020231 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:33.031356 13828 raft_consensus.cc:2468] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 10.
I20260709 12:11:32.964618 18251 raft_consensus.cc:2804] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:33.040096 18251 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:33.040678 18251 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:33.043913 17602 consensus_queue.cc:1059] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:33.014518 18013 consensus_queue.cc:1059] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 12:11:33.045569 18013 consensus_queue.cc:1243] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer 96701a74fdee481fb5f54aac841e17dd log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:11:32.977399 18137 consensus_queue.cc:1048] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 12:11:32.969821 17859 consensus_queue.cc:1059] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 12:11:33.050269 13652 leader_election.cc:304] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:33.051959 13687 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 13.
I20260709 12:11:33.019822 17578 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
W20260709 12:11:33.053707 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 321154us
I20260709 12:11:33.049521 13754 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 12.
I20260709 12:11:33.063241 13800 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:11:33.071530 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.018074 18243 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:33.075448 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.055358 17578 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:33.077443 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 152400us
W20260709 12:11:33.089483 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.092804 13681 raft_consensus.cc:1240] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:11:33.095806 13828 raft_consensus.cc:1275] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:33.096758 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:33.097365 13756 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:33.091881 18250 raft_consensus.cc:3055] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:33.102293 18250 raft_consensus.cc:740] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:33.103245 18250 consensus_queue.cc:260] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:33.104491 18250 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:33.078132 18201 raft_consensus.cc:3055] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:33.089488 17989 raft_consensus.cc:2749] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:33.106047 18201 raft_consensus.cc:740] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:33.105715 18122 consensus_queue.cc:237] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:33.106952 18201 consensus_queue.cc:260] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:33.094120 17859 raft_consensus.cc:3055] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:33.108978 17859 raft_consensus.cc:740] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:33.110059 17859 consensus_queue.cc:260] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:33.111495 17859 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:33.112047 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 61909.5us
I20260709 12:11:33.112845 13652 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:33.114207 13652 leader_election.cc:400] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 7. Current term is 8.
I20260709 12:11:33.115028 13652 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:33.094910 18168 consensus_queue.cc:1048] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 12:11:33.101512 13755 raft_consensus.cc:1275] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:11:33.120147 13800 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:33.120457 18193 raft_consensus.cc:3055] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:33.120054 18028 consensus_queue.cc:1048] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:33.120899 18193 raft_consensus.cc:740] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:33.121824 13760 raft_consensus.cc:606] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Received request to transfer leadership to TS b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:33.121951 18200 raft_consensus.cc:2749] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:33.122298 13760 raft_consensus.cc:614] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:33.126267 14380 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:33.126748 18252 raft_consensus.cc:2804] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:33.127074 18254 raft_consensus.cc:2804] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:33.127643 18254 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:33.127703 17952 raft_consensus.cc:2804] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:33.128101 18254 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:33.128265 17952 raft_consensus.cc:697] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 10 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:33.129127 18137 consensus_queue.cc:1048] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:33.129289 17952 consensus_queue.cc:237] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:33.129951 17927 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:33.131153 18240 raft_consensus.cc:3055] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:33.131577 18240 raft_consensus.cc:740] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:33.127192 18197 raft_consensus.cc:3055] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:33.137871 13756 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 10.
I20260709 12:11:33.139374 13800 leader_election.cc:400] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 election: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 12. Current term is 13.
I20260709 12:11:33.141453 13800 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:33.141853 13651 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:33.143519 13800 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:33.147352 13652 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:33.172637 13800 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:11:33.187251 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 177459us
I20260709 12:11:33.189379 13727 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:33.195933 13800 leader_election.cc:400] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 election: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 9. Current term is 10.
I20260709 12:11:33.196449 13800 leader_election.cc:403] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:11:33.144870 18149 raft_consensus.cc:2804] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:33.137322 18197 raft_consensus.cc:740] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
W20260709 12:11:33.215457 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 68216.2us
I20260709 12:11:33.148190 18028 raft_consensus.cc:2804] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:33.147159 18245 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:33.177284 17989 raft_consensus.cc:2804] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:33.136847 18252 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:33.218751 13652 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:33.219859 13727 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:33.191658 18154 raft_consensus.cc:2804] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:33.165185 18243 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:33.132586 18240 consensus_queue.cc:260] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:33.214818 18200 raft_consensus.cc:2804] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:33.223429 18028 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.223289 18155 raft_consensus.cc:2749] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:33.136718 18193 consensus_queue.cc:260] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:33.241602 14413 raft_consensus.cc:1275] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:11:33.243309 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 152483us
I20260709 12:11:33.231624 17989 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:33.247465 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 191583us
I20260709 12:11:33.235901 18131 raft_consensus.cc:2804] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:33.233407 18154 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:33.232548 18252 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:33.229141 18009 consensus_queue.cc:1048] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:11:33.267732 17900 consensus_queue.cc:1059] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:11:33.254065 18200 raft_consensus.cc:697] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 11 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:33.253888 18028 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:33.258505 18207 consensus_meta.cc:287] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.517s	user 0.015s	sys 0.000s
I20260709 12:11:33.357333 18149 raft_consensus.cc:697] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 10 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:33.283174 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:11:33.263880 17989 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:33.269797 18154 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:33.371975 18197 consensus_queue.cc:260] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:33.455948 18197 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:33.235333 18245 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:33.459738 18122 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.460635 18122 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:33.264770 18258 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:33.441169 18270 log.cc:927] Time spent T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.172s	user 0.006s	sys 0.000s
I20260709 12:11:33.327039 18155 consensus_queue.cc:1048] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 12:11:33.498238 18258 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:33.374374 18165 consensus_queue.cc:1048] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:33.445989 18131 raft_consensus.cc:697] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:11:33.442703 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 132003us
I20260709 12:11:33.447271 18207 raft_consensus.cc:3055] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:33.500629 18207 raft_consensus.cc:740] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:33.500442 18131 consensus_queue.cc:237] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:33.501657 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.259830 18181 raft_consensus.cc:2749] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:33.286959 18200 consensus_queue.cc:237] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:33.450438 18168 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:33.498654 18271 consensus_queue.cc:1048] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:33.501495 18207 consensus_queue.cc:260] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:33.506114 18240 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:33.505978 18207 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:33.510166 17927 raft_consensus.cc:2749] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:33.446220 17602 consensus_queue.cc:1048] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:33.514786 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:11:33.518072 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 257337us
W20260709 12:11:33.519888 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.525111 13756 raft_consensus.cc:1275] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:11:33.518203 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 253590us
I20260709 12:11:33.479246 18201 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:33.518587 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 258775us
W20260709 12:11:33.533919 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 272364us
I20260709 12:11:33.535235 14379 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:33.537314 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:33.538265 13828 raft_consensus.cc:2410] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:11:33.538072 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:33.548969 13681 raft_consensus.cc:1275] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 12:11:33.550603 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 354869us
I20260709 12:11:33.551760 13800 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:33.553313 13684 raft_consensus.cc:1240] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 13. Current term is 14. Ops: []
W20260709 12:11:33.563699 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 345014us
I20260709 12:11:33.590026 13683 raft_consensus.cc:1240] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:33.519935 18227 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.598879 13652 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:33.606353 13832 raft_consensus.cc:1275] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:11:33.604658 13756 raft_consensus.cc:1275] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 12:11:33.607352 13756 pending_rounds.cc:85] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting all ops after (but not including) 7
I20260709 12:11:33.607589 13756 pending_rounds.cc:107] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:11:33.597591 13680 raft_consensus.cc:1275] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:11:33.597901 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:33.489288 18149 consensus_queue.cc:237] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:33.618088 13756 raft_consensus.cc:2889] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:33.618594 13756 pending_rounds.cc:107] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:11:33.618875 13756 raft_consensus.cc:2889] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:33.630368 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.615064 18283 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.612917 18268 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:33.595312 18279 raft_consensus.cc:2804] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:33.607838 18291 consensus_queue.cc:1048] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 12:11:33.615780 18227 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:33.683220 14380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.623667 18166 consensus_queue.cc:1048] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 12:11:33.689268 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:33.690186 13684 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 11.
I20260709 12:11:33.693866 13685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 1701) took 1070 ms. Trace:
I20260709 12:11:33.700057 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:11:33.707381 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:33.708756 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 109950us
I20260709 12:11:33.709847 13652 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:33.711519 13652 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:33.714169 17935 raft_consensus.cc:2749] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:33.713611 18284 raft_consensus.cc:2804] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:33.734910 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:33.736152 17927 consensus_queue.cc:1048] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:33.737648 18193 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:33.740226 13652 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:33.733601 18284 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:33.741334 18284 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:33.746270 17927 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:33.694466 13685 rpcz_store.cc:276] 0709 12:11:32.623177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:32.643718 (+ 20541us) service_pool.cc:224] Handling call
0709 12:11:33.693496 (+1049778us) spinlock_profiling.cc:243] Waited 903 ms on lock 0x7b5400270e54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:33.693702 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2076916608}
I20260709 12:11:33.755870 13652 leader_election.cc:400] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 election: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 7. Current term is 8.
I20260709 12:11:33.756469 13652 leader_election.cc:403] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:11:33.757277 17927 raft_consensus.cc:2749] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 7. Current term is 8.
I20260709 12:11:33.639420 18279 raft_consensus.cc:697] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 13 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
W20260709 12:11:33.770859 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 140917us
I20260709 12:11:33.644381 13687 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac"
dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
 from {username='slave'} at 127.0.0.1:41688
I20260709 12:11:33.773324 13687 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:33.773756 13687 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:33.775785 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:33.635381 18170 consensus_queue.cc:1048] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 12:11:33.684867 18285 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:33.648213 18258 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:33.653600 17989 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:33.792652 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.827309 13685 raft_consensus.cc:3055] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:33.779093 18122 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:33.828147 13685 raft_consensus.cc:740] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:33.644667 18283 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:33.841037 13834 raft_consensus.cc:2393] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 12: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:33.841830 18279 consensus_queue.cc:237] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:33.842754 17578 consensus_meta.cc:287] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.749s	user 0.018s	sys 0.005s
I20260709 12:11:33.843194 13832 raft_consensus.cc:1240] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:33.843701 13685 consensus_queue.cc:260] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:33.844789 13685 raft_consensus.cc:3060] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:33.843196 17578 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:33.847625 18110 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:33.848253 18110 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:33.848707 17578 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:33.849460 13759 raft_consensus.cc:1240] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:33.850625 18110 leader_election.cc:290] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:33.851766 18110 consensus_queue.cc:1048] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:33.790256 18138 consensus_queue.cc:1048] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 12:11:33.855659 18284 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:33.857041 18168 raft_consensus.cc:2749] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 9. Current term is 10.
I20260709 12:11:33.839504 13687 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:33.647990 18268 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:33.859496 17989 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:11:33.860188 18254 consensus_meta.cc:287] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.732s	user 0.009s	sys 0.010s
I20260709 12:11:33.860404 18268 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:33.860667 18254 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:33.861995 18298 log.cc:927] Time spent T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:11:33.864686 18227 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:33.867635 14413 raft_consensus.cc:1275] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:33.868072 13679 raft_consensus.cc:1240] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:33.868758 18245 leader_election.cc:290] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:33.869110 13685 raft_consensus.cc:1275] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 12:11:33.869644 18250 consensus_meta.cc:287] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.765s	user 0.015s	sys 0.010s
I20260709 12:11:33.871920 18283 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:11:33.917999 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 71794.4us
W20260709 12:11:33.837970 17992 consensus_meta.cc:287] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.782s	user 0.017s	sys 0.004s
W20260709 12:11:33.839638 17859 consensus_meta.cc:287] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.728s	user 0.011s	sys 0.007s
W20260709 12:11:33.840209 18251 consensus_meta.cc:287] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.799s	user 0.004s	sys 0.020s
I20260709 12:11:33.800704 18285 raft_consensus.cc:697] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 12 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:33.833006 14409 raft_consensus.cc:2468] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 13.
W20260709 12:11:33.879969 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.912420 14416 raft_consensus.cc:1240] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 10 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:33.914361 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.892092 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:33.924384 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:33.924707 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:33.925179 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:33.927508 18264 consensus_queue.cc:1048] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:33.932832 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:33.935196 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:33.935621 13836 raft_consensus.cc:2410] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 12:11:33.936115 13832 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:33.938040 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.938465 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:33.939253 14413 raft_consensus.cc:2393] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 13: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
W20260709 12:11:33.939587 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.941085 13652 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:33.917665 18288 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.960150 13756 raft_consensus.cc:1275] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:33.961203 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:33.933231 18011 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:33.964126 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:33.971575 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:33.929647 18284 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:33.980880 14379 leader_election.cc:304] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:33.930445 18271 consensus_queue.cc:1059] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:11:34.010268 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:33.970657 13727 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:33.937211 18251 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:33.944108 17927 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:33.993719 18252 consensus_meta.cc:287] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.613s	user 0.007s	sys 0.009s
I20260709 12:11:34.006292 18285 consensus_queue.cc:237] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:33.966512 18311 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.008071 18254 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:33.965837 18240 raft_consensus.cc:2804] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:33.978550 18288 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:33.999429 17859 consensus_queue.cc:1059] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:11:34.039387 18268 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:34.009917 18193 consensus_queue.cc:1048] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 12:11:34.041405 18288 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:33.995380 17989 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:34.042176 17989 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:33.999188 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:34.012668 13726 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:34.044144 13726 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:33.937507 17992 raft_consensus.cc:2749] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:34.020965 13754 raft_consensus.cc:1275] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:11:34.048251 13755 raft_consensus.cc:1240] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:34.024935 13685 raft_consensus.cc:1275] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:11:34.026822 13681 raft_consensus.cc:1240] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:34.027127 13652 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:11:34.035722 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 65150.2us
I20260709 12:11:34.036396 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:34.050166 14409 raft_consensus.cc:2368] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 10. Current term is 11.
W20260709 12:11:34.002991 18028 consensus_meta.cc:287] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.630s	user 0.008s	sys 0.010s
I20260709 12:11:34.038040 18149 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:34.052649 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:34.053476 17602 raft_consensus.cc:2804] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:34.027961 18302 raft_consensus.cc:2749] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:34.052313 18044 raft_consensus.cc:3055] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:34.059724 13652 leader_election.cc:400] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 election: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 10. Current term is 11.
I20260709 12:11:34.107805 13652 leader_election.cc:403] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
W20260709 12:11:34.108600 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.108886 14408 raft_consensus.cc:1240] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
W20260709 12:11:34.112663 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 53151.2us
I20260709 12:11:33.995144 18258 consensus_queue.cc:1048] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
W20260709 12:11:34.119438 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 63668.3us
I20260709 12:11:34.033918 17927 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:34.055203 18240 raft_consensus.cc:697] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 13 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:34.124776 13726 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:34.061491 18243 raft_consensus.cc:2749] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:34.061787 17602 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:34.028637 18252 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:34.115146 18044 raft_consensus.cc:740] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:34.117228 18254 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:34.131850 17602 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:34.126745 18201 consensus_meta.cc:287] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.580s	user 0.010s	sys 0.002s
W20260709 12:11:34.168318 13652 leader_election.cc:336] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 1.563s (SENT)
I20260709 12:11:34.137291 18011 raft_consensus.cc:2749] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:34.139366 18197 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.140002 17977 raft_consensus.cc:2749] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:34.127048 18271 consensus_queue.cc:1059] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 12:11:34.174055 18044 consensus_queue.cc:260] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:34.175320 18271 raft_consensus.cc:3055] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:34.175541 18044 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:34.175890 18271 raft_consensus.cc:740] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:34.141000 13726 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:34.115454 18149 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:34.177393 18271 consensus_queue.cc:260] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:34.178877 18271 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:34.179759 18149 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:34.146963 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:34.180485 13833 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:34.181304 18227 raft_consensus.cc:2749] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:34.182271 18227 consensus_queue.cc:1059] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:34.184288 17859 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.184757 18227 raft_consensus.cc:3055] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:34.061461 18028 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:34.140818 18251 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:34.038264 18311 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:34.189146 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:34.195113 13684 raft_consensus.cc:2468] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 10.
I20260709 12:11:34.200780 13683 raft_consensus.cc:1240] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:34.204144 13726 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:11:34.174443 18154 consensus_meta.cc:287] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.720s	user 0.008s	sys 0.011s
I20260709 12:11:34.206413 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:34.209805 18154 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:34.212218 13688 raft_consensus.cc:1240] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:34.198911 18302 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:34.227285 13833 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 8.
I20260709 12:11:34.185196 18227 raft_consensus.cc:740] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:34.240773 13680 raft_consensus.cc:1275] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:34.174103 18197 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:34.184784 17859 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:34.230383 18251 raft_consensus.cc:2804] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:34.273126 18251 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:34.273669 18251 raft_consensus.cc:3060] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:34.277014 18197 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:34.260813 17900 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:34.260917 18028 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:34.262473 17927 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:34.264395 18311 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:34.267172 18193 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:34.267966 18268 raft_consensus.cc:2749] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:11:34.296986 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.271622 17859 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:34.281180 13652 leader_election.cc:336] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 1.656s (SENT)
I20260709 12:11:34.289316 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:34.287509 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:34.324200 13652 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:34.323647 13680 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 10.
I20260709 12:11:34.238377 18302 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:34.345324 18302 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:34.294442 18306 raft_consensus.cc:2749] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:34.336596 18013 raft_consensus.cc:3055] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:34.243714 18240 consensus_queue.cc:237] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:34.323371 14413 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 10.
I20260709 12:11:34.269498 17602 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:34.373988 13832 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 11.
I20260709 12:11:34.295650 17989 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:34.352001 18013 raft_consensus.cc:740] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:34.338866 18266 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.358341 18252 leader_election.cc:290] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:34.339721 18227 consensus_queue.cc:260] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:34.365602 18328 log.cc:927] Time spent T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
W20260709 12:11:34.366024 13800 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.757s	user 0.007s	sys 0.046s
W20260709 12:11:34.391741 13800 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.783s	user 0.007s	sys 0.046s
I20260709 12:11:34.387737 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:11:34.392571 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 840797us
I20260709 12:11:34.392797 13680 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:34.375820 17602 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:34.376402 13755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2594) took 1074 ms. Trace:
I20260709 12:11:34.325098 18193 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:34.377640 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.413086 18193 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:34.415855 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:34.422415 18251 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:34.423604 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.424772 18251 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:34.394673 13755 rpcz_store.cc:276] 0709 12:11:33.302053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.443295 (+141242us) service_pool.cc:224] Handling call
0709 12:11:33.443628 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:34.048713 (+605085us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:34.376179 (+327466us) spinlock_profiling.cc:243] Waited 604 ms on lock 0x7b54003935d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:34.376342 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1390067968}
I20260709 12:11:34.432291 18154 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:34.296602 17900 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:34.346505 18326 log.cc:927] Time spent T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 12:11:34.384431 13727 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:34.389844 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:34.397008 18327 consensus_queue.cc:1048] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 12:11:34.401815 18264 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.406810 18013 consensus_queue.cc:260] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:34.408444 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 127315us
I20260709 12:11:34.391153 18266 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:34.443897 18266 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:34.444928 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:34.445593 13686 raft_consensus.cc:3060] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:34.439422 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:34.440119 13829 raft_consensus.cc:2393] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 12: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:34.451799 13682 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 10.
I20260709 12:11:34.387270 17935 raft_consensus.cc:2749] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:34.440891 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:34.459354 13685 raft_consensus.cc:2393] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 7: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:34.454998 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:34.460850 13680 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 12.
I20260709 12:11:34.456177 14379 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:34.465862 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:34.468128 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:34.471956 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:34.472589 14413 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:34.474130 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:34.474675 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:34.476720 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:34.478899 13682 raft_consensus.cc:1275] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:34.494872 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:11:34.495702 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.498338 13681 raft_consensus.cc:2393] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 14: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:34.499119 13800 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:34.501749 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:34.502009 14413 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 10.
I20260709 12:11:34.505242 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:34.505911 13686 raft_consensus.cc:2468] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 11.
W20260709 12:11:34.506953 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 122656us
I20260709 12:11:34.507121 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:34.507849 13685 raft_consensus.cc:2393] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 12: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:34.510231 18170 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.510614 13834 raft_consensus.cc:1275] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:34.510893 18170 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:34.474095 17992 raft_consensus.cc:2804] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:34.506323 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:34.513599 13800 leader_election.cc:304] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:34.513940 13680 raft_consensus.cc:2393] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 10: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:34.517923 13800 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:34.518893 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:34.519119 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:34.519568 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:34.520169 13761 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 10.
I20260709 12:11:34.522440 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:34.524434 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:34.525364 13680 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:11:34.529716 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:34.469632 18154 consensus_queue.cc:1048] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 12:11:34.540093 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:34.531666 13800 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:34.559376 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:34.515447 18268 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.561079 14409 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 14.
I20260709 12:11:34.461898 18264 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:34.564414 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 113449us
I20260709 12:11:34.516784 17992 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:34.518823 18251 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.567039 13680 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 10.
I20260709 12:11:34.588825 13754 raft_consensus.cc:1240] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:11:34.589505 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:34.569665 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:34.590610 13757 raft_consensus.cc:1240] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:34.568002 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.534683 18009 raft_consensus.cc:2804] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:34.506256 18266 consensus_queue.cc:1048] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
W20260709 12:11:34.558283 18332 log.cc:927] Time spent T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:11:34.592545 18009 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:34.588071 17992 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:34.617854 13754 raft_consensus.cc:1240] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 12. Current term is 13. Ops: []
W20260709 12:11:34.571089 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.530465 18197 raft_consensus.cc:2749] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:34.644119 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:34.624889 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:34.626403 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:34.644255 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:34.645401 13756 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:34.646168 13761 raft_consensus.cc:2410] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:11:34.530400 18122 raft_consensus.cc:2749] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:34.647082 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:34.647868 13758 raft_consensus.cc:2410] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:11:34.648108 13761 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 10.
I20260709 12:11:34.648360 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:34.649291 13757 raft_consensus.cc:2393] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 12: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:34.561589 18030 raft_consensus.cc:2804] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:34.652002 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:34.659462 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.647673 18009 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:34.650593 18285 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.591449 18243 consensus_queue.cc:1059] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 12:11:34.655757 18028 raft_consensus.cc:2749] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:34.657599 18254 raft_consensus.cc:2749] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 10. Current term is 11.
W20260709 12:11:34.700240 13652 leader_election.cc:336] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 1.723s (SENT)
I20260709 12:11:34.708901 13652 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:34.699355 13756 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 10.
I20260709 12:11:34.588935 18268 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:34.651631 18030 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:34.617228 18251 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:34.712795 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 230527us
I20260709 12:11:34.692448 18197 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:34.730579 14379 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:34.798067 13726 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:34.704448 18137 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.802170 18354 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:34.809351 18354 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:34.810644 17578 consensus_queue.cc:1059] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:34.811784 18354 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:34.812435 17602 raft_consensus.cc:2804] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:11:34.813009 18344 log.cc:927] Time spent T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 12:11:34.813046 17602 raft_consensus.cc:697] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:34.812959 18354 raft_consensus.cc:2749] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:34.813905 18345 log.cc:927] Time spent T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.165s	user 0.000s	sys 0.000s
I20260709 12:11:34.814677 18137 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:34.816543 13726 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:11:34.808593 18342 log.cc:927] Time spent T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.296s	user 0.001s	sys 0.000s
I20260709 12:11:34.819614 18137 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:34.814404 17602 consensus_queue.cc:237] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:34.828310 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.762153 18197 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:34.725543 18030 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:34.816596 18341 log.cc:927] Time spent T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
W20260709 12:11:34.890389 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.892302 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:34.762836 18028 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.827777 18201 raft_consensus.cc:2804] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:34.836414 18264 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:34.836962 18266 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.811784 17578 raft_consensus.cc:3055] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:11:34.837903 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 137678us
I20260709 12:11:34.841988 18268 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:34.851445 17977 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.855001 13684 raft_consensus.cc:1275] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:34.858956 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:34.865619 13759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2591) took 1769 ms. Trace:
W20260709 12:11:34.900825 13652 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 1.765s (SENT) [suppressed 7 similar messages]
I20260709 12:11:34.903666 13759 rpcz_store.cc:276] 0709 12:11:33.096052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.096193 (+   141us) service_pool.cc:224] Handling call
0709 12:11:33.101496 (+  5303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:33.850068 (+748572us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:34.865303 (+1015235us) spinlock_profiling.cc:243] Waited 748 ms on lock 0x7b540035edd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:34.865519 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1719701760}
I20260709 12:11:34.868481 18013 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:34.871356 17992 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:34.875583 18251 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:34.707346 17913 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.702080 18288 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.717226 18240 raft_consensus.cc:3055] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:34.881690 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:34.762953 18243 raft_consensus.cc:2749] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:34.807615 18009 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:34.760303 18170 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:34.763087 17900 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:34.898852 13686 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 9.
I20260709 12:11:34.703197 18285 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:34.908089 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.885052 18289 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.929380 18288 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:34.948019 13680 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 13.
I20260709 12:11:34.904695 18350 consensus_queue.cc:1059] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 12:11:34.902413 17578 raft_consensus.cc:740] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:11:34.965142 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 433530us
I20260709 12:11:34.927754 18201 raft_consensus.cc:697] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:34.981710 13800 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:34.985004 13726 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:34.903357 18028 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:34.948582 18240 raft_consensus.cc:740] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:34.986515 13837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 2613) took 1448 ms. Trace:
I20260709 12:11:34.908043 17977 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:34.905043 18266 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:34.988760 13800 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:34.996954 13800 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:34.990341 13837 rpcz_store.cc:276] 0709 12:11:33.538414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.538535 (+   121us) service_pool.cc:224] Handling call
0709 12:11:33.561152 (+ 22617us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:33.965859 (+404707us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:33.965905 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:34.146898 (+180993us) spinlock_profiling.cc:243] Waited 7.45 ms on lock 0x7b2c0000bb28. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa926886a11 00007fa926896372 00007fa927fc8a01 00007fa927f8d43a 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2
0709 12:11:34.147448 (+   550us) log.cc:844] Serialized 26 byte log entry
0709 12:11:34.435061 (+287613us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:34.435097 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:34.435160 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:34.981715 (+546555us) raft_consensus.cc:1685] finished
0709 12:11:34.981741 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:34.986424 (+  4683us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16696,"raft.queue_time_us":55703,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":20721,"spinlock_wait_cycles":17133952,"thread_start_us":641605,"threads_started":2,"wal-append.queue_time_us":498521}
I20260709 12:11:34.998308 13726 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:34.942584 17913 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:35.007895 17913 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:35.011788 13837 raft_consensus.cc:1275] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:35.013170 14408 raft_consensus.cc:1275] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:11:35.014705 14409 raft_consensus.cc:1275] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:35.015877 14413 raft_consensus.cc:1240] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:35.022894 13800 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
W20260709 12:11:35.026177 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:35.026743 13727 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:34.980108 18289 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:35.027565 13800 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:35.022599 13652 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:35.018497 18009 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:34.992976 18165 raft_consensus.cc:2749] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:34.994091 18243 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.034528 13800 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:35.035002 13652 leader_election.cc:304] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:35.044075 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:35.045097 13686 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:34.997650 18207 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.054033 18289 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:35.054955 18201 consensus_queue.cc:237] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:35.027516 18306 raft_consensus.cc:3055] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:35.058164 18306 raft_consensus.cc:740] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:35.059569 18306 consensus_queue.cc:260] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:35.061250 18306 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:35.062521 18256 raft_consensus.cc:2749] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:35.039363 18284 consensus_queue.cc:1059] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:11:35.063795 17927 raft_consensus.cc:2804] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:35.064214 18284 raft_consensus.cc:3055] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:35.064888 18284 raft_consensus.cc:740] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:35.024307 17578 consensus_queue.cc:260] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:35.066242 18165 raft_consensus.cc:2749] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:35.067543 18165 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:35.067739 18207 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:35.068264 18165 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:35.049467 18200 raft_consensus.cc:2804] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:35.070648 18200 raft_consensus.cc:697] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 14 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:35.071978 18200 consensus_queue.cc:237] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:35.076014 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:11:35.080261 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 53618.1us
I20260709 12:11:35.083360 18357 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:35.084088 18357 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:35.084589 18357 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:35.086716 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:35.087152 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:35.088162 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:35.089381 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:35.090672 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:35.091305 13834 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 12.
I20260709 12:11:35.091770 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:35.093039 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:35.093628 13829 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 10.
I20260709 12:11:35.095323 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:35.095928 18207 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:35.019934 18280 raft_consensus.cc:2804] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:35.100982 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:35.104961 13800 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:35.105844 13688 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 14.
I20260709 12:11:35.024587 18350 raft_consensus.cc:2804] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:35.021368 18283 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:35.105114 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:35.109459 13726 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:35.111105 14413 raft_consensus.cc:1240] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:35.030486 18258 raft_consensus.cc:2804] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:35.043016 18301 raft_consensus.cc:2749] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:35.104046 18280 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:35.122153 18280 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:35.126124 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:35.104195 18243 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:35.127805 18284 consensus_queue.cc:260] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:35.129107 18284 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:35.130517 18353 consensus_queue.cc:1048] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:35.148001 18227 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:35.064605 17927 raft_consensus.cc:697] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 10 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:35.152773 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:35.153795 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:35.125134 18030 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:35.117534 18009 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.170269 14413 raft_consensus.cc:2393] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 11: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:11:35.177349 13686 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 11.
W20260709 12:11:35.187332 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 98980.1us
I20260709 12:11:35.185607 13726 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:35.112031 18350 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:35.115006 18254 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:11:35.178368 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:35.195842 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 90993us
I20260709 12:11:35.204834 13760 raft_consensus.cc:1275] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:11:35.182411 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 451900us
I20260709 12:11:35.118332 18258 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:35.154526 18207 raft_consensus.cc:2804] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:35.116470 18356 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.163358 18170 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:35.208072 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:35.183074 18268 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.235204 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:35.246978 13688 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 14.
I20260709 12:11:35.236353 13800 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:35.211076 13757 raft_consensus.cc:1240] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:35.251327 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:35.252250 13763 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 10.
I20260709 12:11:35.201032 18350 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:35.233060 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:35.261098 13688 raft_consensus.cc:1275] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:35.215884 18258 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:35.263653 13686 raft_consensus.cc:1240] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:11:35.265532 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:35.194063 18243 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:35.214955 18251 raft_consensus.cc:2804] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:35.217106 18207 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:35.244836 18197 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:35.310246 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:35.308025 17992 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:11:35.313030 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 48616.9us
I20260709 12:11:35.230444 18371 raft_consensus.cc:2749] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:35.194866 18009 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:35.339222 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:35.345878 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:35.349953 18332 log.cc:927] Time spent T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:11:35.348361 13651 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:35.218516 18254 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:35.260341 18268 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:35.266239 18355 consensus_queue.cc:1059] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.108s
W20260709 12:11:35.354023 18359 log.cc:927] Time spent T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 12:11:35.262877 18011 consensus_queue.cc:1059] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.077s
I20260709 12:11:35.299516 18207 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:35.244510 18283 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:35.182781 18301 consensus_queue.cc:1048] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.093s
I20260709 12:11:35.432009 18197 raft_consensus.cc:2749] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:35.367391 13760 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 17.
W20260709 12:11:35.374323 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 138087us
I20260709 12:11:35.465548 13800 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:35.253460 18256 consensus_queue.cc:1048] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.090s
I20260709 12:11:35.254050 18170 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:35.471045 18170 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:35.395077 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:11:35.443521 18326 log.cc:927] Time spent T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:11:35.473161 13686 raft_consensus.cc:2393] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 11: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:35.433211 18288 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:35.346665 18165 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:35.363425 18306 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.349437 17977 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:35.438583 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 65241.2us
I20260709 12:11:35.491111 13727 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:35.446470 18149 raft_consensus.cc:2804] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:35.363579 18291 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:35.438876 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 90719us
W20260709 12:11:35.402619 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:35.478250 13758 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 12.
I20260709 12:11:35.338949 17927 consensus_queue.cc:237] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:35.273738 18356 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:35.489915 18266 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:35.506220 13761 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 14.
I20260709 12:11:35.493251 17935 raft_consensus.cc:3055] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:35.511752 13727 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:35.496181 18149 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:35.500538 18291 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:35.511945 18293 log.cc:927] Time spent T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
W20260709 12:11:35.516929 18365 log.cc:927] Time spent T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 12:11:35.517668 18356 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:35.518532 18369 log.cc:927] Time spent T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 12:11:35.518611 13762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 633) took 1014 ms. Trace:
W20260709 12:11:35.519845 18366 log.cc:927] Time spent T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
I20260709 12:11:35.527508 18009 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:35.505311 18285 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:35.502365 18197 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.528950 18197 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:35.530930 13726 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:35.531243 18197 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:35.517007 18368 consensus_queue.cc:1048] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.140s
I20260709 12:11:35.534021 18289 raft_consensus.cc:2804] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:11:35.534848 18013 consensus_meta.cc:287] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.620s	user 0.010s	sys 0.002s
I20260709 12:11:35.535521 18378 raft_consensus.cc:2749] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:35.519261 13762 rpcz_store.cc:276] 0709 12:11:34.504558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:34.504739 (+   181us) service_pool.cc:224] Handling call
0709 12:11:34.530583 (+ 25844us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:34.588605 (+ 58022us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:34.588637 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:34.612605 (+ 23968us) log.cc:844] Serialized 26 byte log entry
0709 12:11:34.814728 (+202123us) spinlock_profiling.cc:243] Waited 6.19 ms on lock 0x7b48001a01d8. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92ceb6aa1 00007fa92ceadb37 00007fa92cead9ca 00007fa92cfa526f 00007fa92cfa4f37 00007fa92cfb955c 00007fa92cfb9508 00007fa92cfb9488 00007fa92cfb9443 00007fa92cfb86ec 00007fa92bee2a96
0709 12:11:34.907556 (+ 92828us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:34.907604 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:34.907671 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:35.518293 (+610622us) raft_consensus.cc:1685] finished
0709 12:11:35.518319 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:35.518545 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57615,"raft.queue_time_us":117569,"raft.run_cpu_time_us":1288,"raft.run_wall_time_us":163560,"spinlock_wait_cycles":14236544,"thread_start_us":213379,"threads_started":1,"wal-append.queue_time_us":459017}
I20260709 12:11:35.536586 18378 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.505836 18355 raft_consensus.cc:3055] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:11:35.540119 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 325874us
I20260709 12:11:35.537145 18378 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:35.481072 18283 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:35.563953 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 315030us
I20260709 12:11:35.567219 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:35.495733 18306 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:35.497246 18243 consensus_queue.cc:1059] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:11:35.514034 18030 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:35.513629 17935 raft_consensus.cc:740] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:35.541579 18268 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:35.596149 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:35.560279 18355 raft_consensus.cc:740] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:35.538964 18149 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:35.542042 18377 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:11:35.629710 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 164287us
I20260709 12:11:35.629973 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:35.596797 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:11:35.632330 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 120650us
W20260709 12:11:35.590463 18362 log.cc:927] Time spent T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.259s	user 0.000s	sys 0.001s
I20260709 12:11:35.589949 18289 raft_consensus.cc:697] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:35.666553 13800 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:35.670123 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:35.673842 18378 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:35.676913 13833 raft_consensus.cc:1275] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:35.668988 13685 raft_consensus.cc:1275] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
W20260709 12:11:35.692027 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:35.658839 18009 raft_consensus.cc:2804] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:35.661662 18356 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.661926 17913 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:35.702296 18200 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:35.706995 14409 raft_consensus.cc:1275] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:11:35.708315 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:35.705070 18378 raft_consensus.cc:2804] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:35.724340 13800 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:35.701750 18251 raft_consensus.cc:697] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:35.669225 18377 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:35.734228 13800 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:35.781014 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:35.784133 13679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2528) took 1847 ms. Trace:
I20260709 12:11:35.711081 18355 consensus_queue.cc:260] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:35.713070 18356 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:35.714098 18327 consensus_queue.cc:1048] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 12:11:35.746577 18360 consensus_queue.cc:1048] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.177s
I20260709 12:11:35.837163 13684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1726) took 1361 ms. Trace:
I20260709 12:11:35.778646 13687 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:35.782904 18028 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:35.837610 13684 rpcz_store.cc:276] 0709 12:11:34.475993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:34.476156 (+   163us) service_pool.cc:224] Handling call
0709 12:11:34.476441 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:34.902723 (+426282us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:35.836906 (+934183us) spinlock_profiling.cc:243] Waited 378 ms on lock 0x7b540006f754. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:35.837092 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":869821824}
W20260709 12:11:35.817099 18284 consensus_meta.cc:287] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.686s	user 0.011s	sys 0.005s
W20260709 12:11:35.748535 18370 log.cc:927] Time spent T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
W20260709 12:11:35.840561 18227 consensus_meta.cc:287] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.688s	user 0.016s	sys 0.006s
I20260709 12:11:35.741971 18386 consensus_queue.cc:1048] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:11:35.736979 18380 raft_consensus.cc:2804] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:35.715814 17913 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:35.737237 18251 consensus_queue.cc:237] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:35.726125 18009 raft_consensus.cc:697] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:35.742409 18289 consensus_queue.cc:237] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:35.720353 18200 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:35.790684 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 63899.8us
I20260709 12:11:35.847446 13755 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 7.
I20260709 12:11:35.866851 14379 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:35.864159 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:35.868494 13760 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 12.
W20260709 12:11:35.864441 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:35.874331 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:35.877547 13651 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:35.878031 13684 raft_consensus.cc:1275] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:35.778668 18201 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:35.745869 13634 auto_rebalancer.cc:629] Failed to schedule move for tablet 56d28ac895464968890083dea150a58d: Illegal state: Replica b98d2519bb504dc6905ed2ede4571835 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:11:35.879019 13651 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:35.814317 13757 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 12.
I20260709 12:11:35.814201 13679 rpcz_store.cc:276] 0709 12:11:33.936270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.940379 (+  4109us) service_pool.cc:224] Handling call
0709 12:11:33.971654 (+ 31275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:34.160356 (+188702us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:11:34.160405 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:34.162612 (+  2207us) log.cc:844] Serialized 26 byte log entry
0709 12:11:34.227027 (+ 64415us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:34.227174 (+   147us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:35.744144 (+1516970us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b54002bf7d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:35.772284 (+ 28140us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:35.772364 (+    80us) raft_consensus.cc:1685] finished
0709 12:11:35.772384 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:35.784025 (+ 11641us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":846,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":88,"spinlock_wait_cycles":432721280,"thread_start_us":64025,"threads_started":1,"wal-append.queue_time_us":183193,"wal-append.run_cpu_time_us":1808,"wal-append.run_wall_time_us":1026459}
W20260709 12:11:35.820935 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 86792.7us
W20260709 12:11:35.822963 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:35.824347 18353 raft_consensus.cc:2749] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:35.826777 18306 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:35.831270 18379 log.cc:927] Time spent T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 12:11:35.832755 18240 consensus_queue.cc:260] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:35.835090 18283 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:35.835271 18357 consensus_meta.cc:287] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.750s	user 0.008s	sys 0.007s
W20260709 12:11:35.836544 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 145664us
I20260709 12:11:35.847872 18355 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:35.747237 18378 raft_consensus.cc:697] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 10 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:35.842235 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:35.842346 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:35.925472 13761 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 13.
I20260709 12:11:35.863050 13727 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:35.854465 14414 raft_consensus.cc:1275] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:11:35.891119 18154 raft_consensus.cc:2804] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:35.732682 18030 raft_consensus.cc:2749] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:35.893580 13800 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:35.725317 18168 consensus_queue.cc:1059] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 12:11:35.850289 18380 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:35.845575 18271 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.927204 13754 raft_consensus.cc:1240] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 LEADER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:35.844980 13687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:41688 (request call id 2515) took 2232 ms. Trace:
I20260709 12:11:35.947249 13687 rpcz_store.cc:276] 0709 12:11:33.622673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.626090 (+  3417us) service_pool.cc:224] Handling call
0709 12:11:35.112551 (+1486461us) spinlock_profiling.cc:243] Waited 1.95 ms on lock 0x7b240013f028. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924d23cb9 00007fa924d21dcb 00007fa924e202b1 00007fa924e1b848 00007fa924e1b7ad 00007fa92625c9a7 00007fa927ee985c 00007fa927ee9699 00007fa927f3a012 00007fa927f84a55
0709 12:11:35.778503 (+665952us) spinlock_profiling.cc:243] Waited 5.06 ms on lock 0x7b4c000a6940. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa926259a20 00007fa92626aa29 00007fa92626b13f 00007fa92622f2ab 00007fa92625cf3c 00007fa92625d3fe 00007fa9264ea88b 00007fa927ee9495 00007fa927f3a30f 00007fa927f84a55 00007fa92cf54cd0
0709 12:11:35.839519 (+ 61016us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16116352}
W20260709 12:11:35.927011 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 64104.1us
I20260709 12:11:35.852845 17913 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:35.894915 17992 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:11:35.938547 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 45049.2us
I20260709 12:11:35.931250 18393 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.915823 18284 raft_consensus.cc:2804] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:35.861563 18120 consensus_queue.cc:1048] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 12:11:35.967775 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:35.968480 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:35.996519 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:35.971604 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:35.972577 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:35.999672 18149 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:36.004109 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:35.859840 18009 consensus_queue.cc:237] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:35.975028 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:35.975836 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:35.977839 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:36.011705 14410 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 12.
I20260709 12:11:35.992514 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:35.946844 18380 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:35.993819 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:36.004978 13829 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 13.
I20260709 12:11:35.948743 18240 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:36.008352 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:35.952234 18283 raft_consensus.cc:3055] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:35.902473 18201 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:36.000154 13761 consensus_queue.cc:237] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:11:35.927016 18357 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:35.912659 18371 consensus_queue.cc:1048] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.106s
I20260709 12:11:35.992340 18375 consensus_queue.cc:1048] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 12:11:35.944986 18327 consensus_queue.cc:1059] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 12:11:35.982576 17992 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:35.941330 18288 consensus_queue.cc:1048] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.053s
W20260709 12:11:36.031502 18392 log.cc:927] Time spent T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 12:11:36.016952 13688 raft_consensus.cc:2393] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 11: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:35.980109 18243 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.026573 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:36.072552 13834 raft_consensus.cc:2393] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 11: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:36.028409 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:36.073277 13832 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 10.
I20260709 12:11:36.074376 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:35.944643 18353 raft_consensus.cc:2804] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:36.076337 13829 raft_consensus.cc:1275] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:11:36.038388 13836 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 14.
I20260709 12:11:36.079273 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:36.080672 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:36.026037 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:36.030122 18390 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.082376 18309 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.040585 18283 raft_consensus.cc:740] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
W20260709 12:11:36.050104 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:36.083271 18309 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:35.952870 18271 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:35.995044 18284 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:36.096690 18284 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:36.067368 18378 consensus_queue.cc:237] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:36.099498 18149 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:36.058529 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 164058us
I20260709 12:11:36.101568 14379 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:35.945016 18302 consensus_queue.cc:1048] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.093s
I20260709 12:11:35.979995 17989 consensus_queue.cc:1048] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 12:11:36.061094 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:36.064455 13727 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:11:36.108364 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 44045.9us
I20260709 12:11:36.108894 13832 raft_consensus.cc:1240] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:36.039237 13837 raft_consensus.cc:2410] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 12:11:36.082222 18390 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:36.031950 17935 consensus_queue.cc:260] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:36.047972 18200 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:36.086691 13828 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 10.
I20260709 12:11:36.092767 18309 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:11:36.093845 18391 log.cc:927] Time spent T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 12:11:36.061542 17992 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:36.110620 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:36.112617 18227 raft_consensus.cc:2749] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:11:36.113533 18350 consensus_meta.cc:287] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.801s	user 0.009s	sys 0.005s
W20260709 12:11:36.082456 18280 consensus_meta.cc:287] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.960s	user 0.013s	sys 0.002s
I20260709 12:11:36.114890 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:36.114164 13727 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:36.120983 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:11:36.087136 18258 consensus_meta.cc:287] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.779s	user 0.011s	sys 0.003s
I20260709 12:11:35.994110 18393 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:36.089604 18243 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:36.143373 18350 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:36.137473 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:36.151028 13727 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:36.130388 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:36.157349 13828 raft_consensus.cc:2368] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 12. Current term is 13.
W20260709 12:11:36.161438 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:36.166127 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:36.150344 18306 raft_consensus.cc:2749] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:36.166931 13834 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 11.
I20260709 12:11:36.167769 18254 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:36.168654 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:36.150256 18258 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:36.175750 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:36.176796 13829 raft_consensus.cc:2368] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 12. Current term is 13.
I20260709 12:11:36.177925 18266 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:36.178143 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:36.178546 18266 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:36.179028 13832 raft_consensus.cc:2393] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 10: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:36.179103 18266 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:36.179975 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:36.179819 18284 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:36.180845 13832 raft_consensus.cc:2393] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 14: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:36.182204 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:36.184231 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:36.184975 13829 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 10.
W20260709 12:11:36.185905 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:36.186177 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:11:36.187767 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:36.190435 13727 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:36.198385 18382 raft_consensus.cc:2749] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:36.201702 18350 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:36.202350 13829 raft_consensus.cc:2393] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 15: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:36.128285 18400 raft_consensus.cc:2749] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:36.204761 14409 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 11.
I20260709 12:11:36.149012 18280 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:36.148869 17935 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:35.185897 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:36.134603 18353 raft_consensus.cc:697] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 10 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:36.236018 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:36.220651 13727 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:36.266256 13828 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 12.
W20260709 12:11:36.251438 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 126286us
I20260709 12:11:36.263203 13757 raft_consensus.cc:1240] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 7. Current term is 8. Ops: []
W20260709 12:11:36.269371 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 48837.5us
I20260709 12:11:36.270521 13727 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:36.275275 13829 raft_consensus.cc:1240] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:11:36.132313 17927 consensus_queue.cc:1048] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.107s
I20260709 12:11:36.287282 18243 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:36.287637 18280 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:36.290855 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:36.291630 13837 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 13.
I20260709 12:11:36.292490 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:36.296145 13727 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
W20260709 12:11:36.310307 18402 log.cc:927] Time spent T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:11:36.299631 17602 consensus_queue.cc:1048] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:11:36.295401 17913 raft_consensus.cc:2749] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:36.292003 18227 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:36.303287 17900 raft_consensus.cc:2749] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:36.314109 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:36.348624 13837 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:36.308194 18284 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:36.323287 18227 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:36.376106 18227 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:36.395538 18284 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.366323 18353 consensus_queue.cc:237] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:36.409986 18207 consensus_meta.cc:287] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.923s	user 0.010s	sys 0.006s
W20260709 12:11:36.420907 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 126948us
I20260709 12:11:36.423173 18393 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:36.427861 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:36.428619 13756 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 11.
I20260709 12:11:36.428673 13837 raft_consensus.cc:2468] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 13.
I20260709 12:11:36.429837 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:36.436439 13837 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 10.
I20260709 12:11:36.429729 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:36.437664 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:36.438253 14407 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 6.
I20260709 12:11:36.438364 13837 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 12.
I20260709 12:11:36.445588 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:36.454128 13687 raft_consensus.cc:1240] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:11:36.440611 18207 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:36.474956 18407 log.cc:927] Time spent T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 12:11:36.410204 18284 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:36.444255 18417 log.cc:927] Time spent T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.113s	user 0.002s	sys 0.003s
W20260709 12:11:36.441879 18413 log.cc:927] Time spent T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.107s	user 0.000s	sys 0.008s
I20260709 12:11:36.462106 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:36.499686 13837 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 10.
W20260709 12:11:36.506057 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 48402.3us
W20260709 12:11:36.518785 13788 heartbeater.cc:646] Failed to heartbeat to 127.12.56.254:40645 (2 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.12.56.254:40645 timed out after 15.000s (SENT)
I20260709 12:11:36.507601 13652 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:36.530519 18418 consensus_queue.cc:1059] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 12:11:36.527678 17927 raft_consensus.cc:2804] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:36.536779 17927 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:36.537328 17927 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:36.530761 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:36.517382 17871 raft_consensus.cc:3055] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:36.557205 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:36.561347 13837 raft_consensus.cc:2393] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 14: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:36.526742 18266 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:36.564746 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:36.553834 17871 raft_consensus.cc:740] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:36.588624 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:36.566172 18423 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.594352 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:36.595003 13837 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:36.563408 17992 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:36.595293 18393 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:36.595947 18207 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:36.597700 18284 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:36.597030 18300 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:11:36.632403 13652 leader_election.cc:336] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 1.689s (SENT)
I20260709 12:11:36.632993 13652 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:36.622212 18393 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:36.636277 18266 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:36.637516 18355 consensus_meta.cc:287] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.702s	user 0.014s	sys 0.000s
I20260709 12:11:36.637868 14412 raft_consensus.cc:1240] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 17. Current term is 18. Ops: []
I20260709 12:11:36.644408 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:36.646844 13830 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 13.
W20260709 12:11:36.644968 18380 consensus_meta.cc:287] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.614s	user 0.007s	sys 0.008s
I20260709 12:11:36.626789 17871 consensus_queue.cc:260] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:36.651057 17871 raft_consensus.cc:3060] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:36.650736 18380 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:36.655380 13758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38932 (request call id 637) took 1340 ms. Trace:
I20260709 12:11:36.640849 18284 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:36.655866 13758 rpcz_store.cc:276] 0709 12:11:35.308184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:35.308370 (+   186us) service_pool.cc:224] Handling call
0709 12:11:36.648058 (+1339688us) spinlock_profiling.cc:243] Waited 46.8 ms on lock 0x7b540032ee54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:36.648194 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":107550080}
W20260709 12:11:36.662989 13652 leader_election.cc:336] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 1.713s (SENT)
I20260709 12:11:36.663708 13652 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:36.638134 18227 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:36.668164 13652 leader_election.cc:336] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 1.714s (SENT)
I20260709 12:11:36.668838 13652 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:36.593636 18423 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:36.674053 13652 leader_election.cc:336] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 1.717s (SENT)
I20260709 12:11:36.633338 18300 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:36.675823 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:36.666368 18213 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:36.677882 13837 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 11.
I20260709 12:11:36.673373 17935 raft_consensus.cc:2749] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:36.675899 18154 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.013s	sys 0.020s
I20260709 12:11:36.676371 18254 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:36.687580 18426 log.cc:927] Time spent T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:11:36.691085 18423 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:36.693819 14379 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:36.695149 14379 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:36.695695 18201 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:36.696226 18357 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:36.696414 18393 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:36.697054 18393 raft_consensus.cc:2749] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:36.700461 17992 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:36.704363 18380 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:36.709146 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:36.678431 18381 raft_consensus.cc:2749] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:36.714166 13760 raft_consensus.cc:1275] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:11:36.714246 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:36.696273 14379 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:36.718202 13762 raft_consensus.cc:2393] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 14: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
W20260709 12:11:36.684970 18154 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.013s	sys 0.020s
I20260709 12:11:36.718430 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:36.718806 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:36.718814 13652 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:36.719488 13837 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:36.720078 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:36.721355 18307 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:36.721516 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:36.722266 14379 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:36.723817 14379 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:36.683210 18213 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:36.722275 13800 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:36.732755 18193 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:36.725369 14379 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
W20260709 12:11:36.733661 18364 log.cc:927] Time spent T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 1.547s	user 0.003s	sys 0.003s
I20260709 12:11:36.734218 18414 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:36.734542 18213 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:36.734754 18414 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:36.735216 18414 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:36.735467 13681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2549) took 1881 ms. Trace:
I20260709 12:11:36.735927 13681 rpcz_store.cc:276] 0709 12:11:34.854371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:34.854487 (+   116us) service_pool.cc:224] Handling call
0709 12:11:34.854908 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:34.855255 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:34.855284 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:34.855818 (+   534us) log.cc:844] Serialized 26 byte log entry
0709 12:11:35.150131 (+294313us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:35.150170 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:35.150247 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:36.733059 (+1582812us) spinlock_profiling.cc:243] Waited 2.53 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:11:36.735139 (+  2080us) raft_consensus.cc:1685] finished
0709 12:11:36.735160 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:36.735401 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":693,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":136,"spinlock_wait_cycles":5836288,"thread_start_us":293842,"threads_started":1,"wal-append.queue_time_us":330290}
W20260709 12:11:36.738174 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:36.732897 18380 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:36.722710 18166 raft_consensus.cc:2804] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:36.755373 18166 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:36.748607 13837 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 10.
I20260709 12:11:36.724771 18368 consensus_queue.cc:1059] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:11:36.759446 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:36.758421 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:36.760298 13760 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 12.
I20260709 12:11:36.760495 13837 raft_consensus.cc:2410] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 12:11:36.724565 18408 raft_consensus.cc:2804] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:36.723241 18154 raft_consensus.cc:697] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 14 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:36.755590 18353 raft_consensus.cc:2749] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:36.762367 18358 raft_consensus.cc:2804] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:36.769618 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:36.770507 13760 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:11:36.772254 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:36.793408 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:36.761852 18166 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:36.758777 18240 raft_consensus.cc:2749] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:36.721706 18355 consensus_queue.cc:1059] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
W20260709 12:11:37.004911 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 257634us
W20260709 12:11:37.005514 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.009245 14413 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41692 (request call id 751) took 1413 ms. Trace:
I20260709 12:11:36.767656 18408 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:37.009721 14413 rpcz_store.cc:276] 0709 12:11:35.591517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:35.591731 (+   214us) service_pool.cc:224] Handling call
0709 12:11:35.592197 (+   466us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:36.689043 (+1096846us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b180047bc60. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa927b354bc 00007fa924e8348b 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9d455 00007fa927f85060 00007fa927f85bfb 00007fa927f9064b
0709 12:11:36.689196 (+   153us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:36.689226 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:36.689796 (+   570us) log.cc:844] Serialized 26 byte log entry
0709 12:11:36.756867 (+ 67071us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:36.756922 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:36.756999 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:37.004505 (+247506us) raft_consensus.cc:1685] finished
0709 12:11:37.004532 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:37.004779 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39433,"raft.queue_time_us":101449,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":2837,"spinlock_wait_cycles":23375744,"thread_start_us":140981,"threads_started":2,"wal-append.queue_time_us":73524}
I20260709 12:11:37.009745 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:36.756690 18380 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:37.035477 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:36.724396 18307 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:37.049746 13800 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:37.010450 18431 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.031615 18408 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:37.033516 18353 raft_consensus.cc:3055] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:37.059283 13800 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:37.062636 13800 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:37.063128 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:37.064280 13837 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 13.
I20260709 12:11:37.069489 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:37.070464 13837 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:37.081948 18154 consensus_queue.cc:237] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:37.066133 18368 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:37.087030 18307 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:37.081430 18193 raft_consensus.cc:2749] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:37.061738 18353 raft_consensus.cc:740] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:37.065837 18227 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:37.095777 17927 consensus_meta.cc:287] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.558s	user 0.011s	sys 0.001s
I20260709 12:11:37.103255 17927 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:37.107481 18291 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:37.093474 18355 raft_consensus.cc:2764] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:11:37.091804 18437 raft_consensus.cc:2749] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:37.119438 18433 log.cc:927] Time spent T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.358s	user 0.001s	sys 0.000s
I20260709 12:11:37.060659 18431 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:37.105554 17927 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:37.139750 13837 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 14.
I20260709 12:11:37.153096 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:37.154052 13837 raft_consensus.cc:2376] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 13. Re-sending same reply.
I20260709 12:11:37.115522 18300 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:11:37.158855 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.170866 13757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2626) took 1296 ms. Trace:
I20260709 12:11:37.171366 13757 rpcz_store.cc:276] 0709 12:11:35.875704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:35.896650 (+ 20946us) service_pool.cc:224] Handling call
0709 12:11:35.897054 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:36.267947 (+370893us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:37.170605 (+902658us) spinlock_profiling.cc:243] Waited 366 ms on lock 0x7b54003935d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:37.170797 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":841428864}
I20260709 12:11:37.172510 14411 raft_consensus.cc:1240] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:11:37.172780 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:37.173202 14411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 929) took 1044 ms. Trace:
I20260709 12:11:37.173408 13757 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 11.
I20260709 12:11:37.152899 18355 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.173539 14411 rpcz_store.cc:276] 0709 12:11:36.128462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:36.163101 (+ 34639us) service_pool.cc:224] Handling call
0709 12:11:37.171929 (+1008828us) spinlock_profiling.cc:243] Waited 59.1 ms on lock 0x7b5800003c98. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924e68b71 00007fa924e68a22 00007fa92dd818d9 00007fa92cedbee0 00007fa92cfa50ab 00007fa92cfa5131 00007fa92cf66fc0 00007fa92cf51929 00007fa92cf513d2 00007fa9264c8bd4
0709 12:11:37.172146 (+   217us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:37.172954 (+   808us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:37.173151 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":135905536}
I20260709 12:11:37.196537 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:37.197715 13837 raft_consensus.cc:2393] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 12: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:37.132226 18166 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:37.200520 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 137931us
I20260709 12:11:37.201395 13800 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:37.162303 18286 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.206977 13800 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:37.208356 13760 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 18.
I20260709 12:11:37.208577 13763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2620) took 1481 ms. Trace:
I20260709 12:11:37.208693 13800 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:37.160174 18353 consensus_queue.cc:260] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:37.206459 18286 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:37.214076 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:37.214974 13757 raft_consensus.cc:2410] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:11:37.215562 18286 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:37.215875 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:37.196888 18355 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:37.217089 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:37.202642 18368 raft_consensus.cc:2749] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:37.213637 18353 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:37.229002 13754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 644) took 1352 ms. Trace:
I20260709 12:11:37.229195 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:37.204939 18154 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:37.230952 13800 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:37.210057 13763 rpcz_store.cc:276] 0709 12:11:35.727242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:35.727713 (+   471us) service_pool.cc:224] Handling call
0709 12:11:35.728191 (+   478us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:35.781051 (+ 52860us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:35.781090 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:36.649434 (+868344us) spinlock_profiling.cc:243] Waited 23.4 ms on lock 0x7b2c00010828. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa926886a11 00007fa926896372 00007fa927fc8a01 00007fa927f8d43a 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2
0709 12:11:36.649862 (+   428us) log.cc:844] Serialized 26 byte log entry
0709 12:11:36.677866 (+ 28004us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:36.677904 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:36.677983 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:37.205829 (+527846us) raft_consensus.cc:1685] finished
0709 12:11:37.205853 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:37.208513 (+  2660us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47018,"raft.queue_time_us":48048,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":145,"spinlock_wait_cycles":53790592,"thread_start_us":27583,"threads_started":1,"wal-append.queue_time_us":64382}
I20260709 12:11:37.232363 18271 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:37.206370 17927 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:37.232743 13754 rpcz_store.cc:276] 0709 12:11:35.876669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:35.920682 (+ 44013us) service_pool.cc:224] Handling call
0709 12:11:35.921421 (+   739us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:35.948192 (+ 26771us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:37.228651 (+1280459us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b54001f2820. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f04dc0 00007fa927f90a02 00007fa927f8cdd6 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2
0709 12:11:37.228923 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":272274176}
W20260709 12:11:37.236610 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 108543us
I20260709 12:11:37.233474 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:37.239099 13652 leader_election.cc:336] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 1.812s (SENT)
I20260709 12:11:37.197255 18414 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:37.236754 17871 consensus_meta.cc:287] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.585s	user 0.012s	sys 0.000s
I20260709 12:11:37.239681 13652 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:37.247076 18439 raft_consensus.cc:2749] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:11:37.247269 13755 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38932 (request call id 636) took 2717 ms (client timeout 1635 ms). Trace:
I20260709 12:11:37.247699 18431 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:37.247833 13755 rpcz_store.cc:269] 0709 12:11:34.522316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:34.523294 (+   978us) service_pool.cc:224] Handling call
0709 12:11:37.239963 (+2716669us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b54000a0fd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:37.240093 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2960497536}
I20260709 12:11:37.248055 18439 consensus_queue.cc:1048] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:37.212093 18437 raft_consensus.cc:2749] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:37.249382 18166 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:37.249890 18437 raft_consensus.cc:2749] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:11:37.242115 18284 consensus_meta.cc:287] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.576s	user 0.011s	sys 0.001s
I20260709 12:11:37.250874 18284 raft_consensus.cc:2749] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:37.251734 18355 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:37.233196 18380 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:37.253991 17927 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:37.257087 17927 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:37.259128 18414 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:37.268523 13836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54830 (request call id 2459) took 1224 ms. Trace:
I20260709 12:11:37.262176 13763 raft_consensus.cc:1275] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:37.269164 13836 rpcz_store.cc:276] 0709 12:11:36.044198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:36.080396 (+ 36198us) service_pool.cc:224] Handling call
0709 12:11:37.268197 (+1187801us) spinlock_profiling.cc:243] Waited 674 ms on lock 0x7b54000b3bd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:37.268412 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1549799808}
I20260709 12:11:37.270684 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:37.271376 13836 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 10.
I20260709 12:11:37.272312 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:37.273427 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:37.274333 13837 raft_consensus.cc:2393] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 11: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
W20260709 12:11:37.277608 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.282756 13757 raft_consensus.cc:1240] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:37.281227 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:37.284852 13681 raft_consensus.cc:2393] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 11: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
W20260709 12:11:37.261475 18254 consensus_meta.cc:287] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.555s	user 0.007s	sys 0.003s
I20260709 12:11:37.271943 17927 raft_consensus.cc:2749] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 14 LEADER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:37.290022 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:37.291457 18254 raft_consensus.cc:2749] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:37.294914 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:37.293931 13836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54830 (request call id 2487) took 1008 ms. Trace:
I20260709 12:11:37.302523 13836 rpcz_store.cc:276] 0709 12:11:36.285582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.280488 (+994906us) service_pool.cc:224] Handling call
0709 12:11:37.293825 (+ 13337us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:37.304088 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:37.306588 14409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41700 (request call id 648) took 1335 ms. Trace:
I20260709 12:11:37.307682 14409 rpcz_store.cc:276] 0709 12:11:35.971036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:35.971254 (+   218us) service_pool.cc:224] Handling call
0709 12:11:37.306318 (+1335064us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b54004b41d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:37.306501 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":476063104}
I20260709 12:11:37.305964 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:37.278695 18284 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.311434 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:37.311340 18284 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:37.286901 18408 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:37.314407 13688 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2564) took 1739 ms (client timeout 2002 ms). Trace:
W20260709 12:11:37.314844 13688 rpcz_store.cc:269] 0709 12:11:35.574765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:35.593226 (+ 18461us) service_pool.cc:224] Handling call
0709 12:11:37.314206 (+1720980us) spinlock_profiling.cc:243] Waited 337 ms on lock 0x7b54002c3b54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:37.314342 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":774368512}
I20260709 12:11:37.316130 18408 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:37.317366 18377 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:37.317646 14408 raft_consensus.cc:1240] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:11:37.320504 14408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41692 (request call id 754) took 1213 ms. Trace:
I20260709 12:11:37.320906 14408 rpcz_store.cc:276] 0709 12:11:36.107000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:36.111418 (+  4418us) service_pool.cc:224] Handling call
0709 12:11:37.306699 (+1195281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:37.318074 (+ 11375us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:37.319469 (+  1395us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b54004b41d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:37.320275 (+   806us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54004b41d0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:37.320434 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2772356608}
W20260709 12:11:37.323124 18435 log.cc:927] Time spent T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.303s	user 0.001s	sys 0.000s
I20260709 12:11:37.325830 18390 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:37.334538 14412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41692 (request call id 758) took 1221 ms. Trace:
I20260709 12:11:37.335016 14412 rpcz_store.cc:276] 0709 12:11:36.113476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:36.144995 (+ 31519us) service_pool.cc:224] Handling call
0709 12:11:36.264894 (+119899us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:36.642451 (+377557us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:37.334213 (+691762us) spinlock_profiling.cc:243] Waited 366 ms on lock 0x7b5400530054. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:37.334468 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":842246272}
I20260709 12:11:37.336781 13830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35422 (request call id 771) took 1692 ms. Trace:
I20260709 12:11:37.337180 13830 rpcz_store.cc:276] 0709 12:11:35.643982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:35.644797 (+   815us) service_pool.cc:224] Handling call
0709 12:11:37.336586 (+1691789us) spinlock_profiling.cc:243] Waited 976 ms on lock 0x7b54000af0d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:37.336702 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2244133120}
I20260709 12:11:37.337867 13836 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 14.
I20260709 12:11:37.338420 13836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54830 (request call id 2477) took 1055 ms. Trace:
I20260709 12:11:37.338332 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:37.338807 13836 rpcz_store.cc:276] 0709 12:11:36.282715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.311128 (+1028413us) service_pool.cc:224] Handling call
0709 12:11:37.338338 (+ 27210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:37.339041 13830 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 10.
I20260709 12:11:37.339630 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:37.339728 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:37.340997 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:37.341213 14411 raft_consensus.cc:1240] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:11:37.341574 13836 raft_consensus.cc:2376] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 10. Re-sending same reply.
I20260709 12:11:37.346853 13832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 2469) took 1171 ms. Trace:
I20260709 12:11:37.347311 13832 rpcz_store.cc:276] 0709 12:11:36.176127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:36.202513 (+ 26386us) service_pool.cc:224] Handling call
0709 12:11:36.210019 (+  7506us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:36.210545 (+   526us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:36.210589 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:36.235346 (+ 24757us) log.cc:844] Serialized 26 byte log entry
0709 12:11:36.372673 (+137327us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:37.346286 (+973613us) log.cc:844] Serialized 14 byte log entry
0709 12:11:37.346503 (+   217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:37.346588 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:37.346634 (+    46us) raft_consensus.cc:1685] finished
0709 12:11:37.346649 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:37.346791 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":981796,"raft.queue_time_us":567,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":10343,"thread_start_us":80755,"threads_started":1,"wal-append.queue_time_us":131119}
I20260709 12:11:37.339869 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:37.349448 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:37.350275 13832 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 10.
I20260709 12:11:37.350214 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:37.351748 13830 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 11.
I20260709 12:11:37.353582 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:37.347976 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:37.355881 13836 raft_consensus.cc:2393] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 15: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
W20260709 12:11:37.308354 18429 log.cc:927] Time spent T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.642s	user 0.000s	sys 0.005s
W20260709 12:11:37.367254 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.375058 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:37.375648 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:37.376998 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:37.377216 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:37.377604 13836 raft_consensus.cc:2376] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 14. Re-sending same reply.
I20260709 12:11:37.378968 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:37.380244 13836 raft_consensus.cc:2393] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 9: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:37.382344 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:37.387604 17992 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.388334 17992 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:37.238446 18154 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:37.392787 13833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 775) took 1448 ms. Trace:
I20260709 12:11:37.392889 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:37.395094 13756 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "b98d2519bb504dc6905ed2ede4571835"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:11:37.395406 13832 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:37.395696 13756 raft_consensus.cc:606] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Received request to transfer leadership to TS b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:37.392689 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:37.396064 13756 raft_consensus.cc:614] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:37.396072 13830 raft_consensus.cc:2393] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 12: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:37.396492 13836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54830 (request call id 2491) took 1074 ms. Trace:
I20260709 12:11:37.398490 13836 rpcz_store.cc:276] 0709 12:11:36.322409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.392437 (+1070028us) service_pool.cc:224] Handling call
0709 12:11:37.396435 (+  3998us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:37.399425 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:37.399956 13836 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:37.374261 18436 raft_consensus.cc:2749] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:11:37.401733 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 170842us
I20260709 12:11:37.393293 13833 rpcz_store.cc:276] 0709 12:11:35.944245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:35.952761 (+  8516us) service_pool.cc:224] Handling call
0709 12:11:35.953159 (+   398us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:35.953567 (+   408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:35.953594 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:35.954165 (+   571us) log.cc:844] Serialized 52 byte log entry
0709 12:11:36.124585 (+170420us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:36.146184 (+ 21599us) log.cc:844] Serialized 14 byte log entry
0709 12:11:37.260072 (+1113888us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b180034e640. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924ea03f3 00007fa924ea27c1 00007fa924ea2779 00007fa924ea2709 00007fa924ea26d1 00007fa924ea19cd 0000000000388634 0000000000388479 00007fa924e8383a
0709 12:11:37.341509 (+ 81437us) spinlock_profiling.cc:243] Waited 2.93 ms on lock 0x7b180034e640. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e1ac0a 00007fa92e55a219 00007fa924ea2a40 00007fa924e9d4e4 00007fa924e9d455 00007fa92b9853c7 00007fa927f979a7 00007fa927fa70bf 00007fa927fa7038
0709 12:11:37.341716 (+   207us) log.cc:844] Serialized 14 byte log entry
0709 12:11:37.392477 (+ 50761us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:37.392549 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:37.392590 (+    41us) raft_consensus.cc:1685] finished
0709 12:11:37.392601 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:37.392723 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":101061,"prepare.queue_time_us":27396,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":32328,"raft.run_cpu_time_us":296,"raft.run_wall_time_us":16722,"spinlock_wait_cycles":31736448,"thread_start_us":126110,"threads_started":2,"wal-append.queue_time_us":167242,"wal-append.run_cpu_time_us":2322,"wal-append.run_wall_time_us":1004969}
I20260709 12:11:37.402681 13829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 2474) took 1225 ms. Trace:
I20260709 12:11:37.403654 13800 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:37.403539 13829 rpcz_store.cc:276] 0709 12:11:36.177564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:36.279548 (+101984us) service_pool.cc:224] Handling call
0709 12:11:36.285827 (+  6279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:36.291284 (+  5457us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:36.291329 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:36.297090 (+  5761us) log.cc:844] Serialized 26 byte log entry
0709 12:11:36.385492 (+ 88402us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:37.401005 (+1015513us) log.cc:844] Serialized 14 byte log entry
0709 12:11:37.402301 (+  1296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:37.402394 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:37.402441 (+    47us) raft_consensus.cc:1685] finished
0709 12:11:37.402455 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:37.402625 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":968512,"prepare.queue_time_us":994453,"raft.queue_time_us":7588,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":4916,"thread_start_us":128315,"threads_started":2,"wal-append.queue_time_us":132534}
I20260709 12:11:37.375167 18383 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:37.403870 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:37.381886 18284 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:37.408406 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:37.402661 13837 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 10.
I20260709 12:11:37.409696 13686 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 11.
I20260709 12:11:37.410955 13837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54830 (request call id 2480) took 1127 ms. Trace:
I20260709 12:11:37.411405 13837 rpcz_store.cc:276] 0709 12:11:36.283711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.280421 (+996710us) service_pool.cc:224] Handling call
0709 12:11:37.410894 (+130473us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:37.412225 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.412205 13833 raft_consensus.cc:1240] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:37.413254 13833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 2482) took 1129 ms. Trace:
I20260709 12:11:37.413547 13833 rpcz_store.cc:276] 0709 12:11:36.284252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.411754 (+1127502us) service_pool.cc:224] Handling call
0709 12:11:37.412044 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:37.413045 (+  1001us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:37.413206 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:37.397591 17900 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:37.404918 18371 raft_consensus.cc:2804] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:37.420627 13652 leader_election.cc:304] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:37.397394 18201 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:37.417021 13762 raft_consensus.cc:1275] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:11:37.417408 13833 raft_consensus.cc:1275] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 12:11:37.423897 13833 pending_rounds.cc:85] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 6
I20260709 12:11:37.424151 13833 pending_rounds.cc:107] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:11:37.424249 13830 raft_consensus.cc:1240] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 11. Current term is 12. Ops: []
W20260709 12:11:37.421296 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.421463 13726 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:37.415253 13837 raft_consensus.cc:1275] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:37.425427 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:37.423277 13829 raft_consensus.cc:1217] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Deduplicated request from leader. Original: 6.8->[9.9-9.9]   Dedup: 9.9->[]
I20260709 12:11:37.426086 13754 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 7.
I20260709 12:11:37.424497 13833 raft_consensus.cc:2889] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:37.424886 13830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 2476) took 1157 ms. Trace:
I20260709 12:11:37.426667 13652 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:37.426892 13830 rpcz_store.cc:276] 0709 12:11:36.267431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.411045 (+1143614us) service_pool.cc:224] Handling call
0709 12:11:37.424082 (+ 13037us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:37.424649 (+   567us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:37.424832 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:37.427142 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:37.428704 13829 raft_consensus.cc:1240] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:11:37.428853 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:37.426662 13837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 2485) took 1141 ms. Trace:
W20260709 12:11:37.429431 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.430776 13829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 2475) took 1252 ms. Trace:
I20260709 12:11:37.430747 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:37.431418 13829 rpcz_store.cc:276] 0709 12:11:36.211249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.408986 (+1197737us) service_pool.cc:224] Handling call
0709 12:11:37.423130 (+ 14144us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:37.430539 (+  7409us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:37.430724 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:37.429745 13837 rpcz_store.cc:276] 0709 12:11:36.285041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.412022 (+1126981us) service_pool.cc:224] Handling call
0709 12:11:37.412383 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:37.426435 (+ 14052us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:37.426609 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:37.434305 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:37.435063 13754 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:37.437536 13832 raft_consensus.cc:2410] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:11:37.438336 13836 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 14.
I20260709 12:11:37.439544 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:37.440855 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:37.441644 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:37.442421 13762 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 11.
I20260709 12:11:37.443665 17578 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:37.415530 18390 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:37.446213 18390 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:37.446861 18283 consensus_queue.cc:260] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:37.448319 18283 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:37.448879 18390 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:37.448992 18355 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:37.429165 18201 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:37.449555 18355 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:37.450932 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:37.457988 13830 raft_consensus.cc:1240] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:37.458141 13837 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 11.
I20260709 12:11:37.458878 13830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 2651) took 1166 ms. Trace:
I20260709 12:11:37.459364 13830 rpcz_store.cc:276] 0709 12:11:36.292826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.427922 (+1135096us) service_pool.cc:224] Handling call
0709 12:11:37.457749 (+ 29827us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:37.458548 (+   799us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:37.458809 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:37.461045 13830 raft_consensus.cc:1275] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:11:37.405676 18168 consensus_queue.cc:1059] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 12:11:37.428994 18254 raft_consensus.cc:2804] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:37.462193 18254 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:37.462348 18374 raft_consensus.cc:3055] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:37.462651 18254 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:37.462883 18374 raft_consensus.cc:740] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:37.463506 17992 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:37.463845 18374 consensus_queue.cc:260] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:37.465209 18374 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:37.432471 18431 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:37.466142 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:37.466058 18431 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:37.453279 18291 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:37.423354 18284 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.468052 18291 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:37.468305 18284 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:37.467119 18368 consensus_queue.cc:1175] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" responder_term: 13 status { last_received { term: 11 index: 10 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 12. Current term is 13. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:11:37.462533 13762 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "b98d2519bb504dc6905ed2ede4571835"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:11:37.470482 18284 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:37.470873 13762 raft_consensus.cc:606] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Received request to transfer leadership to TS b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:37.470949 18431 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:37.471344 13762 raft_consensus.cc:614] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:37.422973 18256 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.472483 18256 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:37.472857 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:37.473868 13762 raft_consensus.cc:2368] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 13. Current term is 14.
I20260709 12:11:37.453392 18355 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:37.423067 18371 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:37.474615 18256 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:37.474712 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:37.430243 18381 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:37.475062 18371 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:37.475409 13762 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 11.
I20260709 12:11:37.410465 18383 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:37.476109 13836 raft_consensus.cc:1275] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:11:37.476300 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:37.477454 18383 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:37.410288 18377 consensus_queue.cc:1048] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 12:11:37.478467 13829 raft_consensus.cc:1240] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:37.478760 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:37.479219 13829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 2653) took 1185 ms. Trace:
I20260709 12:11:37.479758 18256 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.480443 18377 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:37.455145 18154 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:37.432937 17900 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:37.451967 18201 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:37.480525 13834 raft_consensus.cc:2410] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:11:37.449519 18390 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:37.466943 13761 raft_consensus.cc:2393] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 15: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:37.479552 13829 rpcz_store.cc:276] 0709 12:11:36.293430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.432201 (+1138771us) service_pool.cc:224] Handling call
0709 12:11:37.478297 (+ 46096us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:37.478992 (+   695us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:37.479169 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:37.439551 14380 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:37.461673 13830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 2497) took 1073 ms. Trace:
I20260709 12:11:37.482667 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:37.483224 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:11:37.496803 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 57335.2us
I20260709 12:11:37.497454 13681 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 13.
I20260709 12:11:37.484678 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:37.485589 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:11:37.498869 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 72306.3us
I20260709 12:11:37.489866 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:37.483248 13833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 2488) took 1197 ms. Trace:
I20260709 12:11:37.494859 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:37.499917 13652 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:37.501682 13680 raft_consensus.cc:1275] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:11:37.500072 13833 rpcz_store.cc:276] 0709 12:11:36.294162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.416815 (+1122653us) service_pool.cc:224] Handling call
0709 12:11:37.417100 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:37.482141 (+ 65041us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:37.483194 (+  1053us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:37.498879 13684 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 12.
I20260709 12:11:37.500550 13800 leader_election.cc:400] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 13. Current term is 14.
I20260709 12:11:37.504925 13800 leader_election.cc:403] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:37.505162 13759 raft_consensus.cc:2393] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 15: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:37.507840 13759 raft_consensus.cc:1240] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:37.497074 13687 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:37.476739 13836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 2489) took 1174 ms. Trace:
I20260709 12:11:37.498261 13763 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 12.
I20260709 12:11:37.509814 13836 rpcz_store.cc:276] 0709 12:11:36.302856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.475519 (+1172663us) service_pool.cc:224] Handling call
0709 12:11:37.475820 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:37.476506 (+   686us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:37.476688 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:37.496639 13830 rpcz_store.cc:276] 0709 12:11:36.388114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.460382 (+1072268us) service_pool.cc:224] Handling call
0709 12:11:37.460676 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:37.461432 (+   756us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:37.461611 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:37.515996 13762 raft_consensus.cc:1240] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 12:11:37.480343 18256 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:37.474759 18291 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:37.522235 13832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54830 (request call id 2478) took 1239 ms. Trace:
I20260709 12:11:37.550240 13684 raft_consensus.cc:1240] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:37.522569 13800 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:37.523564 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:37.523974 13761 raft_consensus.cc:1275] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:37.524871 18240 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:37.523597 18283 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:37.527356 17900 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:37.527467 18258 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:37.480986 18377 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:37.518563 17952 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:37.535504 18358 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:37.494158 18154 raft_consensus.cc:2804] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:37.540190 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:11:37.545540 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.546604 13652 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:37.514966 17992 raft_consensus.cc:2804] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:37.555359 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:37.489418 18355 consensus_queue.cc:1048] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 12:11:37.557583 13759 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "232d133451004a83941860574adec712"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "b98d2519bb504dc6905ed2ede4571835"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:11:37.560251 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:37.596748 13680 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 8.
I20260709 12:11:37.597715 13831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 2646) took 1614 ms. Trace:
I20260709 12:11:37.547820 18227 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.570173 18154 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:37.591692 18431 raft_consensus.cc:2804] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:11:37.592437 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 45946.9us
I20260709 12:11:37.553099 18120 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.598035 13759 raft_consensus.cc:606] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Received request to transfer leadership to TS b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:37.615051 13652 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:37.548988 13832 rpcz_store.cc:276] 0709 12:11:36.283079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.392640 (+1109561us) service_pool.cc:224] Handling call
0709 12:11:37.522149 (+129509us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:37.598421 13687 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 15.
I20260709 12:11:37.546630 13754 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 8.
I20260709 12:11:37.517078 18390 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:37.563135 18291 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.629391 13680 raft_consensus.cc:1240] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 10 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:11:37.614920 18154 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:37.614396 17992 raft_consensus.cc:697] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 14 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:37.593498 18168 consensus_queue.cc:1059] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:11:37.599159 13831 rpcz_store.cc:276] 0709 12:11:35.983494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:36.029347 (+ 45853us) service_pool.cc:224] Handling call
0709 12:11:36.029685 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:36.029965 (+   280us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:11:37.350795 (+1320830us) spinlock_profiling.cc:243] Waited 2.84 ms on lock 0x7b180039ef80. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa927b354bc 00007fa924e8348b 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9d455 00007fa92b9853c7 00007fa927f979a7 00007fa927fa70bf
0709 12:11:37.350949 (+   154us) log.cc:844] Serialized 14 byte log entry
0709 12:11:37.597228 (+246279us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:37.597315 (+    87us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:37.597388 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:37.597483 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:37.597639 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2172,"prepare.queue_time_us":93708,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":3428,"raft.queue_time_us":2271,"spinlock_wait_cycles":6521728,"thread_start_us":338685,"threads_started":2}
I20260709 12:11:37.595484 18439 consensus_queue.cc:1059] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 12:11:37.595252 18437 consensus_queue.cc:1048] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:11:37.570526 17952 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:37.562968 18443 raft_consensus.cc:2804] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:37.571283 18358 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:37.614701 18227 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:37.619573 18120 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:37.638165 13688 raft_consensus.cc:2410] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:11:37.663813 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:37.697105 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:11:37.672312 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.698099 13686 raft_consensus.cc:2393] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 13: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:37.697173 13680 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:37.678027 13835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 772) took 2032 ms. Trace:
W20260709 12:11:37.693703 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.733596 13755 raft_consensus.cc:1275] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:37.689482 13687 raft_consensus.cc:1240] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:37.634449 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:37.756146 13758 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "b98d2519bb504dc6905ed2ede4571835"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:11:37.674232 17992 consensus_queue.cc:237] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:37.754536 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:37.756815 13758 raft_consensus.cc:606] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 LEADER]: Received request to transfer leadership to TS b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:37.750272 13835 rpcz_store.cc:276] 0709 12:11:35.645393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:35.645525 (+   132us) service_pool.cc:224] Handling call
0709 12:11:35.679090 (+ 33565us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:35.819889 (+140799us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:35.819941 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:35.820007 (+    66us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:35.820057 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:37.677634 (+1857577us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b54000da554. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:37.677695 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:37.677943 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":323088256}
I20260709 12:11:37.755065 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:11:37.755344 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 140377us
I20260709 12:11:37.635113 18258 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:37.776445 13680 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 9.
I20260709 12:11:37.769287 13652 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:37.808902 13836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 778) took 1050 ms. Trace:
I20260709 12:11:37.810052 13836 rpcz_store.cc:276] 0709 12:11:36.758331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.512960 (+754629us) service_pool.cc:224] Handling call
0709 12:11:37.513313 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:37.513558 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:11:37.543100 (+ 29542us) log.cc:844] Serialized 14 byte log entry
0709 12:11:37.641045 (+ 97945us) log.cc:844] Serialized 14 byte log entry
0709 12:11:37.808419 (+167374us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:37.808498 (+    79us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:37.808563 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:37.808663 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:37.808835 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":33852,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":47,"raft.queue_time_us":40613,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":7220,"spinlock_wait_cycles":25578880,"thread_start_us":264047,"threads_started":2}
I20260709 12:11:37.639722 18284 raft_consensus.cc:2749] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:37.828953 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:11:37.763671 18446 log.cc:927] Time spent T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.246s	user 0.000s	sys 0.001s
I20260709 12:11:37.673502 18256 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:37.679201 18390 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:37.809286 18258 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:37.840834 18258 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:37.686496 18443 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:37.841593 18443 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:37.841899 18356 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:37.844378 18280 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:37.845052 18280 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:37.847378 18280 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:37.675822 17952 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:37.708598 18377 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:37.850788 18377 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.851356 18377 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:37.854934 13754 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 11.
I20260709 12:11:37.639561 18291 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:37.849467 18454 log.cc:927] Time spent T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.089s	user 0.002s	sys 0.000s
I20260709 12:11:37.830149 18381 raft_consensus.cc:2749] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:37.868003 13834 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54830 (request call id 2464) took 1694 ms (client timeout 1983 ms). Trace:
W20260709 12:11:37.869948 13834 rpcz_store.cc:269] 0709 12:11:36.174123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:36.181885 (+  7762us) service_pool.cc:224] Handling call
0709 12:11:37.865755 (+1683870us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b5400166cd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:37.867922 (+  2167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2982953728}
I20260709 12:11:37.869601 13682 raft_consensus.cc:1275] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:37.853754 18377 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:37.853989 18442 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:37.882647 13756 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "b98d2519bb504dc6905ed2ede4571835"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:11:37.883423 13756 raft_consensus.cc:606] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Received request to transfer leadership to TS b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:37.883865 13756 raft_consensus.cc:614] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:37.882155 18408 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.841127 18390 raft_consensus.cc:2804] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:37.867713 18280 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.936138 18283 raft_consensus.cc:2749] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 13. Current term is 14.
I20260709 12:11:37.939268 18291 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:37.942878 18443 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:37.944295 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.947661 18240 raft_consensus.cc:2749] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:37.947342 18254 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:37.949254 18452 log.cc:927] Time spent T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260709 12:11:37.955343 18254 leader_election.cc:290] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:37.956467 13686 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 11.
I20260709 12:11:37.960880 18371 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:37.949986 18443 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:37.967850 18437 raft_consensus.cc:3055] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:37.968405 18437 raft_consensus.cc:740] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:37.969810 18437 consensus_queue.cc:260] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:37.971451 18437 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:37.886139 18431 raft_consensus.cc:697] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 10 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:37.987987 18431 consensus_queue.cc:237] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:37.995184 18451 log.cc:927] Time spent T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.234s	user 0.000s	sys 0.002s
I20260709 12:11:37.996304 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 12:11:37.997035 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:38.011866 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:38.017323 13757 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 11.
I20260709 12:11:37.887430 18442 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:37.925252 18390 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:38.024669 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:38.024750 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:38.027084 13686 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 6.
I20260709 12:11:38.027557 13679 raft_consensus.cc:2410] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:11:37.982623 18358 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:38.035369 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:37.930912 18408 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:38.029909 18390 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:38.036837 13680 raft_consensus.cc:2468] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 11.
I20260709 12:11:37.980765 18280 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:38.043205 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:38.042290 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 273114us
I20260709 12:11:38.057457 13652 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
W20260709 12:11:38.069146 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 303015us
I20260709 12:11:38.071123 13801 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:38.067929 18464 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:38.074195 13652 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:38.079020 13837 raft_consensus.cc:1275] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
W20260709 12:11:38.079093 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 250422us
I20260709 12:11:38.079715 13837 pending_rounds.cc:85] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 5
I20260709 12:11:38.080091 13837 pending_rounds.cc:107] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:11:38.080384 13837 raft_consensus.cc:2889] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:38.083428 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:38.084175 14409 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 13.
I20260709 12:11:38.086442 13833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 776) took 1348 ms. Trace:
I20260709 12:11:38.086877 13833 rpcz_store.cc:276] 0709 12:11:36.737713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.503459 (+765746us) service_pool.cc:224] Handling call
0709 12:11:37.503881 (+   422us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:37.521114 (+ 17233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:37.521158 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:37.521738 (+   580us) log.cc:844] Serialized 26 byte log entry
0709 12:11:37.687682 (+165944us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:37.687721 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:37.687802 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:38.086193 (+398391us) raft_consensus.cc:1685] finished
0709 12:11:38.086213 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:38.086377 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16695,"raft.queue_time_us":16889,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":129,"thread_start_us":125030,"threads_started":1,"wal-append.queue_time_us":365281}
W20260709 12:11:38.088848 13727 consensus_peers.cc:597] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Couldn't send request to peer ca9fbbc2c0a94897897d502d42f3951f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d2f365337b324999a073edacbe6c6e09. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:38.089458 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 1.7763e+06us
I20260709 12:11:38.091311 18457 raft_consensus.cc:2749] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:38.099472 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:38.100524 13831 raft_consensus.cc:2410] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
W20260709 12:11:38.101295 13581 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53318 (request call id 144) took 13506 ms (client timeout 15000 ms). Trace:
I20260709 12:11:38.102119 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:38.102799 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:38.103531 13830 raft_consensus.cc:2393] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 12: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:38.107635 18280 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:38.110308 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:38.111373 14416 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 10.
I20260709 12:11:38.110860 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:38.112846 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:38.115358 18381 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:38.115988 18381 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:38.119064 13584 catalog_manager.cc:5697] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 5 to 8, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 8 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:38.123749 18358 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:38.124110 18120 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:38.124734 18358 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.119086 18442 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:38.127997 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:38.130887 13584 catalog_manager.cc:5697] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 3 to 6, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 6 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
W20260709 12:11:38.158599 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 84511.5us
I20260709 12:11:38.160650 13652 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
W20260709 12:11:38.179417 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:38.132778 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:38.187465 13829 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:38.144135 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 49280.3us
I20260709 12:11:38.195552 13651 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:38.198122 13651 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:38.205197 13652 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:38.075475 18240 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:38.206383 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:38.206250 13584 catalog_manager.cc:5697] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 7 to 8, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 8 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:38.216885 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:38.209064 13727 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:38.217761 13755 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:38.208807 13651 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:38.219776 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:38.211725 18288 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:38.077916 18254 raft_consensus.cc:2804] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:38.202379 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:38.233817 13830 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:38.215188 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:11:38.201844 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 74380.2us
I20260709 12:11:38.125403 18358 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:38.243464 14409 raft_consensus.cc:2393] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 13: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:11:38.235015 13831 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 10.
I20260709 12:11:38.225274 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:38.076366 18464 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:38.224337 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:38.246114 13584 catalog_manager.cc:5697] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 7 to 8, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 8 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:38.249749 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:38.250962 13831 raft_consensus.cc:2393] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 13: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:38.126294 18463 raft_consensus.cc:2749] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:38.144361 18436 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.212492 18258 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.256445 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:38.301013 14416 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:38.260740 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:11:38.261399 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 52711.9us
I20260709 12:11:38.262286 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:38.303525 13831 raft_consensus.cc:2410] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for term 14 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:11:38.303891 13756 raft_consensus.cc:2393] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 13: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:38.268036 13829 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 15.
I20260709 12:11:38.305035 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:38.305676 13829 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 11.
I20260709 12:11:38.269135 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:38.306368 13830 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 15.
I20260709 12:11:38.306704 13834 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 10.
I20260709 12:11:38.233072 18356 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:38.232692 17927 raft_consensus.cc:2804] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:38.253873 18288 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:38.272784 18443 consensus_queue.cc:1059] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.010s
I20260709 12:11:38.273963 18371 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:38.244385 18254 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:38.323160 18254 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:38.206662 18256 raft_consensus.cc:2804] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:38.263091 18468 raft_consensus.cc:2804] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:38.274587 18462 raft_consensus.cc:2804] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:38.201829 18227 leader_election.cc:290] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:38.213172 18284 raft_consensus.cc:2749] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:38.123790 18154 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:38.275813 18361 consensus_queue.cc:1059] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:38.276436 18381 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:38.276324 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:38.278033 13584 catalog_manager.cc:5697] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 5 to 6, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 6 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:11:38.280086 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:38.280798 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 75702.6us
I20260709 12:11:38.335445 13652 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:11:38.281363 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:38.281934 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:38.282805 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:38.287055 18408 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199)
I20260709 12:11:38.288112 13755 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 14.
I20260709 12:11:38.201728 18414 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:38.256731 18382 raft_consensus.cc:2804] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:38.352425 13682 raft_consensus.cc:1240] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:38.319410 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:38.321556 13830 raft_consensus.cc:1275] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:11:38.101735 13581 rpcz_store.cc:269] 0709 12:11:24.603870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.604066 (+   196us) service_pool.cc:224] Handling call
0709 12:11:38.101187 (+13497121us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:32.300671 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:32.301632 (+   961us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:32.301730 (+    98us) write_op.cc:435] Acquired schema lock
0709 12:11:32.301755 (+    25us) tablet.cc:662] Decoding operations
0709 12:11:32.357305 (+ 55550us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:32.357431 (+   126us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:32.357462 (+    31us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:11:32.358449 (+   987us) tablet.cc:701] Row locks acquired
0709 12:11:32.358503 (+    54us) write_op.cc:260] PREPARE: finished
0709 12:11:32.358719 (+   216us) write_op.cc:270] Start()
0709 12:11:32.358893 (+   174us) write_op.cc:276] Timestamp: P: 1783599092358642 usec, L: 0
0709 12:11:32.358928 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 12:11:32.359700 (+   772us) log.cc:844] Serialized 3601 byte log entry
0709 12:11:33.281534 (+921834us) op_driver.cc:464] REPLICATION: finished
0709 12:11:33.654491 (+372957us) write_op.cc:301] APPLY: starting
0709 12:11:33.654592 (+   101us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:33.868942 (+214350us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:33.869066 (+   124us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:34.004171 (+135105us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:34.004580 (+   409us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 12:11:34.004665 (+    85us) write_op.cc:312] APPLY: finished
0709 12:11:34.005135 (+   470us) log.cc:844] Serialized 89 byte log entry
0709 12:11:34.005334 (+   199us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:34.005469 (+   135us) write_op.cc:454] Released schema lock
0709 12:11:34.005537 (+    68us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:34.043399 (+ 37862us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:34.047594 (+  4195us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2160208,"reported_tablets":13,"child_traces":[["op",{"apply.queue_time_us":372637,"apply.run_cpu_time_us":16027,"apply.run_wall_time_us":360305,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41747,"num_ops":9,"prepare.queue_time_us":253120,"prepare.run_cpu_time_us":24062,"prepare.run_wall_time_us":244593,"raft.queue_time_us":234996,"raft.run_cpu_time_us":20739,"raft.run_wall_time_us":344120,"replication_time_us":922408,"thread_start_us":695931,"threads_started":4,"wal-append.queue_time_us":223610,"wal-append.run_cpu_time_us":52944,"wal-append.run_wall_time_us":2395940}]]}
I20260709 12:11:38.337440 13761 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:38.328728 18256 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:38.243786 18240 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:38.346406 13584 catalog_manager.cc:5697] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 9 to 10, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 10 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:38.295940 18280 consensus_queue.cc:1059] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 12:11:38.361074 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:38.363907 13834 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 12.
I20260709 12:11:38.365329 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:38.366149 13830 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 12.
I20260709 12:11:38.366622 13584 catalog_manager.cc:5697] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 6 to 8, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 8 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:38.366170 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:38.298409 18436 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:38.302850 18258 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:38.391322 13584 catalog_manager.cc:5697] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 4 to 6, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 6 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:38.357336 18256 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:38.324999 18356 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:38.373901 18013 raft_consensus.cc:3055] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:38.410066 13584 catalog_manager.cc:5697] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
W20260709 12:11:38.398630 18378 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.016s	sys 0.018s
I20260709 12:11:38.374346 18355 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
W20260709 12:11:38.414080 13687 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.044s	sys 0.041s
W20260709 12:11:38.449898 13687 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.045s	sys 0.043s
I20260709 12:11:38.445724 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:38.376101 18382 raft_consensus.cc:697] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:38.428452 13828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 2473) took 2224 ms. Trace:
I20260709 12:11:38.449402 13836 raft_consensus.cc:2410] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 12:11:38.448388 13761 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 12.
I20260709 12:11:38.362673 18414 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:38.371026 18284 consensus_queue.cc:1048] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 12:11:38.454694 13828 rpcz_store.cc:276] 0709 12:11:36.177277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:36.267106 (+ 89829us) service_pool.cc:224] Handling call
0709 12:11:36.273010 (+  5904us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:36.297437 (+ 24427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:36.297487 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:36.298055 (+   568us) log.cc:844] Serialized 26 byte log entry
0709 12:11:36.633742 (+335687us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:37.926068 (+1292326us) spinlock_profiling.cc:243] Waited 3.84 ms on lock 0x7b18003ea400. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa927b354bc 00007fa924e8348b 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9d455 00007fa92b9853c7 00007fa927f979a7 00007fa927fa70bf
0709 12:11:37.926225 (+   157us) log.cc:844] Serialized 14 byte log entry
0709 12:11:38.374215 (+447990us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:38.374490 (+   275us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:38.374543 (+    53us) raft_consensus.cc:1685] finished
0709 12:11:38.401097 (+ 26554us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:38.401292 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":729308,"prepare.queue_time_us":747328,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":42,"raft.queue_time_us":28124,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":27303,"spinlock_wait_cycles":8822528,"thread_start_us":788034,"threads_started":3,"wal-append.queue_time_us":363702,"wal-append.run_cpu_time_us":1812,"wal-append.run_wall_time_us":1026798}
I20260709 12:11:38.461716 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:38.465531 13680 raft_consensus.cc:2410] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 12:11:38.471962 13584 catalog_manager.cc:5697] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 8 to 9, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 9 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:38.474831 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:38.477262 13688 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:38.413842 18013 raft_consensus.cc:740] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:38.376680 18390 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:38.449221 18378 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.017s	sys 0.018s
W20260709 12:11:38.479341 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:38.480525 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:38.492902 14408 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:38.492978 14414 raft_consensus.cc:1275] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:38.496629 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:38.497555 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:38.507769 13584 catalog_manager.cc:5697] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 5 to 6, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 6 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:11:38.458330 18355 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:38.510040 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:38.510741 14409 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 10.
I20260709 12:11:38.520147 13688 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 15.
I20260709 12:11:38.448232 18469 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.510867 18240 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:38.523346 14379 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:11:38.524185 13758 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.014s	sys 0.036s
I20260709 12:11:38.486598 18431 raft_consensus.cc:2749] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:38.538386 14379 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:11:38.532704 13758 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.015s	sys 0.036s
I20260709 12:11:38.534277 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:11:38.545948 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:38.548661 13834 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 14.
I20260709 12:11:38.554056 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:11:38.553395 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 470137us
I20260709 12:11:38.558099 14379 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:38.559063 14379 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:38.558997 13801 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:38.561050 14379 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:38.537003 18473 raft_consensus.cc:2804] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:38.576898 18013 consensus_queue.cc:260] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:38.578164 18288 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:38.502683 18464 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:38.590485 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:38.550009 18468 raft_consensus.cc:697] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 12 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:38.591110 13683 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:11:38.596590 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:38.558116 18358 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:38.592536 13584 catalog_manager.cc:5697] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 6 to 8, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 8 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:38.596887 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:38.604432 13679 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:38.600266 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:11:38.606297 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 363052us
I20260709 12:11:38.570798 18460 raft_consensus.cc:2804] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:38.606400 13686 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 11.
I20260709 12:11:38.575806 18473 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:38.580139 18154 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:38.588574 18311 raft_consensus.cc:2804] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:38.536598 18469 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:38.615872 18470 log.cc:927] Time spent T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 12:11:38.618170 13681 raft_consensus.cc:1240] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:38.618851 13584 catalog_manager.cc:5697] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 4 to 5, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 5 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:38.608040 18460 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:38.623718 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:11:38.624480 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 289179us
I20260709 12:11:38.624691 13685 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:38.612042 18473 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:38.629202 13686 raft_consensus.cc:1275] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:38.616333 18311 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:38.627300 13652 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:38.628314 18479 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:11:38.617926 18358 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.620389 18408 raft_consensus.cc:2804] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:38.616845 18436 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:38.562345 18382 consensus_queue.cc:237] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:38.620853 18258 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:38.619346 18482 raft_consensus.cc:2804] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:38.625506 18460 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:38.650424 13683 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 11.
I20260709 12:11:38.670991 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:38.637730 13679 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 14.
I20260709 12:11:38.650746 13837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 2492) took 2288 ms. Trace:
I20260709 12:11:38.672420 13837 rpcz_store.cc:276] 0709 12:11:36.362226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.459178 (+1096952us) service_pool.cc:224] Handling call
0709 12:11:37.866002 (+406824us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:38.080941 (+214939us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:38.232117 (+151176us) spinlock_profiling.cc:243] Waited 211 ms on lock 0x7b5400166cd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:38.650496 (+418379us) spinlock_profiling.cc:243] Waited 406 ms on lock 0x7b5400166cd0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:38.650663 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1419262080}
W20260709 12:11:38.651261 13757 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48114 (request call id 2629) took 1234 ms (client timeout 1580 ms). Trace:
W20260709 12:11:38.674170 13757 rpcz_store.cc:269] 0709 12:11:37.416633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.417884 (+  1251us) service_pool.cc:224] Handling call
0709 12:11:38.651060 (+1233176us) spinlock_profiling.cc:243] Waited 451 ms on lock 0x7b54003c9954. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:38.651174 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1037531648}
I20260709 12:11:38.642999 13584 catalog_manager.cc:5697] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 9 to 11, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 11 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:38.651341 13652 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:38.676923 13652 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:38.666225 14416 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 15.
I20260709 12:11:38.683779 13681 raft_consensus.cc:1275] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:11:38.629850 18356 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:38.686456 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:11:38.695050 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:38.694908 13584 catalog_manager.cc:5697] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 3 to 4, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 4 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:11:38.654603 18462 raft_consensus.cc:697] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 8 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:38.643208 18311 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:38.649102 18374 raft_consensus.cc:3055] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:11:38.705766 13727 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:38.706401 13685 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 15.
I20260709 12:11:38.669920 18482 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:38.673216 18154 raft_consensus.cc:2749] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:38.686134 18414 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:38.646342 18479 raft_consensus.cc:697] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 18 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:38.653635 18408 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:38.694007 18227 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
W20260709 12:11:38.666267 18458 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.012s	sys 0.009s
I20260709 12:11:38.687702 18431 raft_consensus.cc:2804] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:38.715607 13727 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
W20260709 12:11:38.716243 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 155284us
I20260709 12:11:38.639854 18469 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:38.722458 13685 raft_consensus.cc:1240] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 10 LEADER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:38.697824 18390 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:38.731412 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:38.731983 14408 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 8.
I20260709 12:11:38.650647 18490 consensus_queue.cc:1048] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 12:11:38.651117 17927 raft_consensus.cc:697] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 14 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:38.651042 18473 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:38.655566 18288 consensus_queue.cc:1059] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 12:11:38.646606 18358 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:38.736117 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:38.690294 18240 consensus_queue.cc:1048] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
W20260709 12:11:38.792001 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 76455us
I20260709 12:11:38.843389 13727 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
W20260709 12:11:38.790894 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 79713.8us
I20260709 12:11:38.714591 18475 consensus_queue.cc:1048] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.099s
I20260709 12:11:38.715489 18374 raft_consensus.cc:740] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:38.714742 18457 raft_consensus.cc:2749] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:11:38.800326 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 65414.4us
I20260709 12:11:38.852939 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:38.853260 14380 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:38.722239 18044 raft_consensus.cc:2804] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:38.734421 18408 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:38.844895 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:38.848505 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:38.836005 18381 raft_consensus.cc:2804] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:38.664683 18468 consensus_queue.cc:237] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:38.858413 13727 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
W20260709 12:11:38.845160 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 56307.4us
I20260709 12:11:38.791301 18431 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:38.865156 14379 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:38.850684 18258 raft_consensus.cc:3055] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:38.736351 18492 consensus_queue.cc:1048] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.133s
I20260709 12:11:38.875212 13727 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:38.875623 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:38.876281 13837 raft_consensus.cc:2468] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 13.
I20260709 12:11:38.724335 18482 raft_consensus.cc:3060] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:38.876664 13727 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:38.877972 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:38.799579 18227 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:38.855990 18467 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:38.884488 18467 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:38.885244 18466 log.cc:927] Time spent T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.611s	user 0.002s	sys 0.000s
I20260709 12:11:38.885409 18358 leader_election.cc:290] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:38.873936 18258 raft_consensus.cc:740] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:38.886780 18358 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.887421 18358 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:38.887688 18258 consensus_queue.cc:260] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:38.889190 18258 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:38.891803 18472 log.cc:927] Time spent T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.262s	user 0.000s	sys 0.001s
W20260709 12:11:38.899473 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:38.863935 18288 raft_consensus.cc:2804] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:38.889685 17977 consensus_queue.cc:1048] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:38.874797 18356 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.904264 13727 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:11:38.906909 18474 log.cc:927] Time spent T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.268s	user 0.001s	sys 0.000s
I20260709 12:11:38.908203 18414 raft_consensus.cc:2749] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:38.858682 18044 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:38.915503 13685 raft_consensus.cc:1240] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 10. Current term is 11. Ops: []
W20260709 12:11:38.929363 18485 log.cc:927] Time spent T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 12:11:38.890592 18266 raft_consensus.cc:2804] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:38.902213 18358 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:38.867357 18431 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:38.874145 17952 raft_consensus.cc:2749] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:11:38.928423 18484 log.cc:927] Time spent T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
I20260709 12:11:38.942540 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:38.920251 18371 raft_consensus.cc:3055] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:38.941325 13727 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:38.920614 18361 raft_consensus.cc:2804] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:38.890206 18201 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:38.927268 18288 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:39.035099 18288 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:38.944764 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:39.038172 18201 raft_consensus.cc:697] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:39.039112 13685 raft_consensus.cc:1240] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:39.039585 18201 consensus_queue.cc:237] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:38.947188 18467 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:38.942468 18356 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:38.939234 17927 consensus_queue.cc:237] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:38.929688 18476 log.cc:927] Time spent T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.306s	user 0.000s	sys 0.002s
I20260709 12:11:38.930841 18374 consensus_queue.cc:260] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:38.962165 18266 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
W20260709 12:11:39.011654 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 146570us
W20260709 12:11:39.032205 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 91008.2us
I20260709 12:11:38.953759 18044 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:38.963502 18465 log.cc:927] Time spent T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.685s	user 0.003s	sys 0.000s
I20260709 12:11:39.073289 14379 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:38.959825 18120 raft_consensus.cc:2804] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:39.041565 13758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 1904) took 1355 ms. Trace:
I20260709 12:11:38.985591 18371 raft_consensus.cc:740] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:39.055835 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:39.032490 18361 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:39.088861 14408 raft_consensus.cc:1275] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:38.861001 18462 consensus_queue.cc:237] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:39.098284 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:11:39.098980 18499 log.cc:927] Time spent T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 12:11:39.099839 18361 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:39.110455 18504 log.cc:927] Time spent T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 12:11:39.112744 13687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1751) took 1334 ms. Trace:
I20260709 12:11:39.113219 18371 consensus_queue.cc:260] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:39.114414 18371 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:39.041065 18486 raft_consensus.cc:2749] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:39.117866 17900 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:39.118795 17900 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:39.120676 18408 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:39.065714 18266 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:39.122316 18283 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:39.123221 18283 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:39.126277 18501 log.cc:927] Time spent T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
I20260709 12:11:39.127509 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:39.089830 18358 raft_consensus.cc:2749] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:39.133239 18283 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:39.078399 18120 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:39.113142 13687 rpcz_store.cc:276] 0709 12:11:37.778908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.779081 (+   173us) service_pool.cc:224] Handling call
0709 12:11:37.779530 (+   449us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:38.450270 (+670740us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:38.689691 (+239421us) log.cc:844] Serialized 14 byte log entry
0709 12:11:38.860190 (+170499us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:38.860663 (+   473us) log.cc:844] Serialized 26 byte log entry
0709 12:11:38.860814 (+   151us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:38.861006 (+   192us) log.cc:844] Serialized 14 byte log entry
0709 12:11:38.861169 (+   163us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:38.861243 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:39.112509 (+251266us) raft_consensus.cc:1685] finished
0709 12:11:39.112530 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:39.112680 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":638309,"prepare.run_cpu_time_us":132,"prepare.run_wall_time_us":9704,"raft.queue_time_us":136674,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":259,"thread_start_us":1002378,"threads_started":3,"wal-append.queue_time_us":240047}
I20260709 12:11:39.134160 18356 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:39.076122 13727 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:39.078941 13758 rpcz_store.cc:276] 0709 12:11:37.686645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.757715 (+ 71070us) service_pool.cc:224] Handling call
0709 12:11:37.762032 (+  4317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:37.763602 (+  1570us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:37.763651 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:37.764300 (+   649us) log.cc:844] Serialized 26 byte log entry
0709 12:11:38.541109 (+776809us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:38.541169 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:38.541267 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:38.716508 (+175241us) spinlock_profiling.cc:243] Waited 21.4 ms on lock 0x7b48001a01d8. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92ceb6aa1 00007fa92ceadb37 00007fa92cead9ca 00007fa92cfa526f 00007fa92cfa4f37 00007fa92cfb955c 00007fa92cfb9508 00007fa92cfb9488 00007fa92cfb9443 00007fa92cfb86ec 00007fa92bee2a96
0709 12:11:39.024007 (+307499us) raft_consensus.cc:1685] finished
0709 12:11:39.024044 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:39.041477 (+ 17433us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17959,"raft.run_cpu_time_us":13240,"raft.run_wall_time_us":932027,"spinlock_wait_cycles":49174784,"thread_start_us":686575,"threads_started":1,"wal-append.queue_time_us":792476}
W20260709 12:11:39.140098 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 64111.8us
I20260709 12:11:39.141197 18120 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:39.141765 18251 raft_consensus.cc:2804] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:39.142401 18251 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:39.142894 18251 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:39.148614 13759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 1903) took 1474 ms. Trace:
I20260709 12:11:38.915784 18479 consensus_queue.cc:237] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:39.152266 18013 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:39.155407 18497 log.cc:927] Time spent T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 12:11:39.156514 17900 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:39.157158 18355 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:39.149091 13759 rpcz_store.cc:276] 0709 12:11:37.673906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.676859 (+  2953us) service_pool.cc:224] Handling call
0709 12:11:37.677583 (+   724us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:37.752503 (+ 74920us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:37.752538 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:37.757582 (+  5044us) log.cc:844] Serialized 52 byte log entry
0709 12:11:37.915266 (+157684us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:38.403861 (+488595us) log.cc:844] Serialized 14 byte log entry
0709 12:11:38.404295 (+   434us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:38.884504 (+480209us) spinlock_profiling.cc:243] Waited 29.1 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:11:39.147349 (+262845us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b18000c17e0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e6e2a6 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419
0709 12:11:39.148262 (+   913us) spinlock_profiling.cc:243] Waited 62.6 ms on lock 0x7b54002b0cd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:39.148319 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:39.148365 (+    46us) raft_consensus.cc:1685] finished
0709 12:11:39.148376 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:39.148545 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11725,"prepare.queue_time_us":560718,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":4997,"raft.queue_time_us":21166,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":61655,"spinlock_wait_cycles":234316672,"thread_start_us":575894,"threads_started":2,"wal-append.queue_time_us":490656}
I20260709 12:11:39.162073 18473 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:11:39.167378 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:39.175631 13727 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:39.176313 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:11:39.168474 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:39.164222 18374 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:39.171896 13684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1745) took 1553 ms. Trace:
I20260709 12:11:39.178617 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:39.181473 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:39.192483 14412 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 10.
I20260709 12:11:39.191861 13684 rpcz_store.cc:276] 0709 12:11:37.618357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.618494 (+   137us) service_pool.cc:224] Handling call
0709 12:11:37.618862 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:37.751699 (+132837us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:37.751729 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:37.756240 (+  4511us) log.cc:844] Serialized 26 byte log entry
0709 12:11:38.011783 (+255543us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:38.011845 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:38.011951 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:38.907624 (+895673us) spinlock_profiling.cc:243] Waited 27.8 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:11:39.171611 (+263987us) raft_consensus.cc:1685] finished
0709 12:11:39.171632 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:39.171838 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3729,"raft.queue_time_us":220162,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":90,"spinlock_wait_cycles":64021504,"thread_start_us":383656,"threads_started":2,"wal-append.queue_time_us":477965}
I20260709 12:11:39.182595 13829 raft_consensus.cc:1275] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:11:39.197229 14409 raft_consensus.cc:1275] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:11:39.158442 18256 consensus_meta.cc:287] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.744s	user 0.012s	sys 0.002s
I20260709 12:11:39.202497 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:39.203697 13684 raft_consensus.cc:1240] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:39.206100 13686 raft_consensus.cc:2410] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 11 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:11:39.209255 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:39.215574 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:39.215847 14380 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:39.216284 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:39.216976 13828 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 14.
I20260709 12:11:39.216336 13837 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 13.
I20260709 12:11:39.207924 13727 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:39.221088 13727 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:39.154300 18288 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:39.218158 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:39.222890 18356 raft_consensus.cc:2749] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:39.230343 18408 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:39.231523 18288 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:39.216991 18254 consensus_meta.cc:287] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.893s	user 0.015s	sys 0.000s
I20260709 12:11:39.234808 18254 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:39.235131 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:39.237020 18254 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:39.237921 13685 raft_consensus.cc:1240] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:39.238261 14410 raft_consensus.cc:1240] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:11:39.240275 18431 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:39.240597 18044 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:39.242084 13688 raft_consensus.cc:1240] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:39.242460 17977 raft_consensus.cc:2804] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:39.243103 17977 raft_consensus.cc:697] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:39.244037 17977 consensus_queue.cc:237] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:39.249907 18358 raft_consensus.cc:2804] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:39.250391 18358 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:39.250789 18358 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:39.261679 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:39.262384 13686 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 11.
I20260709 12:11:39.262331 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:39.263115 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:39.261590 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:39.264091 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:39.266856 13762 raft_consensus.cc:1275] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:11:39.267197 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:39.266865 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:39.268790 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:39.272399 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:39.277274 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:39.277746 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:39.278959 13686 raft_consensus.cc:2410] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:11:39.280136 13754 raft_consensus.cc:1240] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:39.280364 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:39.281001 13682 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:39.281360 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:39.282145 13651 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:39.284368 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:39.285075 14408 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 13.
I20260709 12:11:39.208627 18381 raft_consensus.cc:697] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:39.288252 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:39.295796 13684 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:39.297734 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:39.299526 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:39.300354 13830 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:39.302855 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:39.303006 13835 raft_consensus.cc:1275] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:39.301862 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:39.303884 13801 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:39.228577 17900 raft_consensus.cc:2804] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:39.319062 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:39.259744 18288 consensus_queue.cc:1048] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:11:39.332945 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:39.334336 18381 consensus_queue.cc:237] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:39.208678 18256 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:39.339843 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 57774.3us
I20260709 12:11:39.340708 13682 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 12.
I20260709 12:11:39.341096 18458 raft_consensus.cc:2804] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:11:39.342691 18460 consensus_meta.cc:287] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.652s	user 0.009s	sys 0.003s
I20260709 12:11:39.330530 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:39.352242 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:39.354070 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:39.355031 18460 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:39.343057 18120 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:39.359385 18358 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:39.358166 18460 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:39.361629 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:39.363196 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:39.364528 13682 raft_consensus.cc:2376] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 15. Re-sending same reply.
I20260709 12:11:39.366153 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:39.368085 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:39.368276 18251 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:39.368746 13682 raft_consensus.cc:2376] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 15. Re-sending same reply.
I20260709 12:11:39.337541 18482 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:39.370751 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:39.373108 18482 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:39.374541 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:39.373672 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:39.375622 13682 raft_consensus.cc:2376] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 11. Re-sending same reply.
I20260709 12:11:39.375468 18356 consensus_queue.cc:1048] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:39.376035 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:39.377573 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:39.377728 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:39.378834 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:39.353602 18475 raft_consensus.cc:476] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 14 LEADER]: Not starting pre-election -- already a leader
I20260709 12:11:39.381517 13759 raft_consensus.cc:1240] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:39.344129 17900 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:39.383248 17900 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:39.389043 13830 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 12.
I20260709 12:11:39.361476 18358 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:39.399818 18256 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:39.401010 13679 raft_consensus.cc:2393] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 12: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:39.343941 17989 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:39.402089 17989 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:39.402566 17989 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:39.406066 18458 raft_consensus.cc:697] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 11 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:39.407404 18458 consensus_queue.cc:237] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:39.410367 18431 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:39.422531 13836 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54820 (request call id 2656) took 1326 ms (client timeout 1670 ms). Trace:
W20260709 12:11:39.423151 13836 rpcz_store.cc:269] 0709 12:11:38.096204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.101864 (+  5660us) service_pool.cc:224] Handling call
0709 12:11:39.422225 (+1320361us) spinlock_profiling.cc:243] Waited 346 ms on lock 0x7b54000d9b54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:39.422434 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":796487040}
I20260709 12:11:39.434154 14416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41700 (request call id 655) took 1307 ms. Trace:
I20260709 12:11:39.434626 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:39.434751 14416 rpcz_store.cc:276] 0709 12:11:38.127013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.127609 (+   596us) service_pool.cc:224] Handling call
0709 12:11:39.433917 (+1306308us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b54005e0e54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:39.434068 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":332822912}
I20260709 12:11:39.436941 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:39.439036 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:39.440095 13686 raft_consensus.cc:2393] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 15: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:39.442673 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:39.448163 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:39.449018 13685 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 11.
I20260709 12:11:39.455627 18227 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:39.464987 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:39.465703 13837 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:39.486517 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:39.514310 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:39.515216 14412 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:39.524446 13684 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 13.
W20260709 12:11:39.534261 18487 log.cc:927] Time spent T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.553s	user 0.000s	sys 0.006s
I20260709 12:11:39.535646 13833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 2654) took 1440 ms. Trace:
I20260709 12:11:39.536090 13833 rpcz_store.cc:276] 0709 12:11:38.095521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.111502 (+ 15981us) service_pool.cc:224] Handling call
0709 12:11:38.111846 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:38.189089 (+ 77243us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:38.189125 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:38.207731 (+ 18606us) log.cc:844] Serialized 26 byte log entry
0709 12:11:38.612123 (+404392us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:38.612164 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:38.612243 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:39.533622 (+921379us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:11:39.535325 (+  1703us) raft_consensus.cc:1685] finished
0709 12:11:39.535347 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:39.535582 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":82801,"raft.queue_time_us":77413,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":12141,"spinlock_wait_cycles":31030016,"thread_start_us":343376,"threads_started":1,"wal-append.queue_time_us":628396}
I20260709 12:11:39.537709 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:39.541078 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:39.543329 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:11:39.544351 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 55094us
I20260709 12:11:39.546731 14411 raft_consensus.cc:2393] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 13: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:11:39.547106 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:39.548429 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:39.564543 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:39.564220 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:39.567999 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:39.569634 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:11:39.573961 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 483564us
I20260709 12:11:39.361387 18361 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:39.581624 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:39.584446 13837 raft_consensus.cc:2468] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 14.
I20260709 12:11:39.538745 18256 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:39.586145 14380 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:39.598706 13758 raft_consensus.cc:1240] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 10. Current term is 11. Ops: []
W20260709 12:11:39.567814 18461 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.300s	user 0.020s	sys 0.027s
I20260709 12:11:39.600392 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:39.547084 18460 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:39.616570 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:39.624404 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:11:39.604933 18461 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.510s	user 0.020s	sys 0.028s
I20260709 12:11:39.629724 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:39.629946 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:39.637316 14416 raft_consensus.cc:2410] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:11:39.632786 13681 raft_consensus.cc:2368] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for earlier term 11. Current term is 12.
I20260709 12:11:39.587489 18291 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:39.603614 18473 raft_consensus.cc:2804] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:39.643576 13829 raft_consensus.cc:2410] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 19 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 12:11:39.599001 18491 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:39.600131 18044 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:39.653481 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:11:39.646044 18311 consensus_meta.cc:287] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.916s	user 0.013s	sys 0.000s
I20260709 12:11:39.606830 18266 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:39.663412 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:39.666618 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:39.621950 18460 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:39.648427 18291 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:39.671160 18284 consensus_queue.cc:1048] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:39.672734 18266 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:39.673869 13758 raft_consensus.cc:1240] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:39.672734 18291 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:39.674340 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:39.616958 18256 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:39.658515 18473 raft_consensus.cc:697] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 14 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:39.679404 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:39.691089 13754 raft_consensus.cc:2393] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 12: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:39.684522 18361 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:39.689965 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 411227us
I20260709 12:11:39.677742 14416 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 11.
W20260709 12:11:39.696165 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 421308us
I20260709 12:11:39.652168 18491 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:39.698817 13726 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
W20260709 12:11:39.669313 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 74967.8us
I20260709 12:11:39.703433 13652 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:11:39.715795 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:39.716679 13837 raft_consensus.cc:1275] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 12:11:39.718077 13800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:39.718637 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:39.717883 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:39.666608 18311 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:39.722241 14411 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:39.716044 18512 ts_tablet_manager.cc:933] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f: Initiating tablet copy from peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:39.728489 18284 consensus_queue.cc:1059] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 12:11:39.731999 18120 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:39.742712 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:39.744396 13754 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:39.745261 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:39.737413 13652 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:39.746121 13757 raft_consensus.cc:2393] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 15: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:39.748113 14413 raft_consensus.cc:1240] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:39.749150 13757 raft_consensus.cc:1275] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:39.723932 18283 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:39.750231 13726 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:39.725286 18361 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:39.753517 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:39.753945 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:39.723810 18374 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:39.756026 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:39.756753 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:39.760097 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:39.729755 14379 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:39.721383 18291 consensus_queue.cc:1048] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:11:39.742621 18492 raft_consensus.cc:2749] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:39.765755 13754 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 13.
I20260709 12:11:39.771229 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:39.767277 14379 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:39.726539 18475 consensus_queue.cc:1059] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:11:39.776436 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:39.778264 13763 raft_consensus.cc:2368] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for earlier term 11. Current term is 12.
W20260709 12:11:39.768707 18479 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.022s	sys 0.028s
I20260709 12:11:39.728201 18431 consensus_queue.cc:1059] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:11:39.786895 18013 consensus_queue.cc:1048] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:11:39.783545 18355 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:39.765535 18463 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:39.789193 18311 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:39.789708 13726 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:39.791419 17989 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:39.794813 18251 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:39.761786 18283 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:39.803802 18491 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:39.805047 18256 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:39.769873 18120 raft_consensus.cc:2764] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:11:39.753198 18493 raft_consensus.cc:2749] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:39.761245 18473 consensus_queue.cc:237] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:39.781354 18486 consensus_queue.cc:1059] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 10.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:11:39.772157 18374 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:39.809487 18460 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:39.810664 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:39.816998 14416 raft_consensus.cc:1240] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:39.779125 18507 raft_consensus.cc:2804] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:11:39.826013 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 58843.6us
I20260709 12:11:39.829605 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:11:39.818348 18479 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.023s	sys 0.028s
I20260709 12:11:39.865268 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:39.865612 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 77406.5us
I20260709 12:11:39.882670 13760 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 13.
I20260709 12:11:39.862345 18355 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:39.827951 18468 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.018s	sys 0.007s
I20260709 12:11:39.873906 13763 raft_consensus.cc:1240] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:39.874882 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:39.823889 18498 raft_consensus.cc:2749] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:39.878069 18266 raft_consensus.cc:2749] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:39.892756 18374 leader_election.cc:290] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:39.902356 14412 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 14.
I20260709 12:11:39.872707 18284 raft_consensus.cc:3055] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:39.914270 14407 raft_consensus.cc:1240] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 18 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 17. Current term is 18. Ops: []
I20260709 12:11:39.916828 14379 leader_election.cc:400] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 election: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for earlier term 11. Current term is 12.
I20260709 12:11:39.917251 14379 leader_election.cc:403] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
W20260709 12:11:39.918426 13727 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.000s	sys 0.012s
W20260709 12:11:39.918919 13727 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.000s	sys 0.012s
W20260709 12:11:39.919270 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 622762us
I20260709 12:11:39.919994 13727 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:11:39.901672 18468 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.018s	sys 0.007s
I20260709 12:11:39.893656 18507 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:39.931257 13754 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 16.
I20260709 12:11:39.865041 18463 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:39.937412 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:39.963371 13685 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:39.916700 18284 raft_consensus.cc:740] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:39.939785 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:39.939267 14379 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:39.899909 18256 consensus_queue.cc:1059] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:11:39.950462 17989 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:39.933139 18507 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:39.953596 18371 consensus_meta.cc:287] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.839s	user 0.013s	sys 0.000s
W20260709 12:11:39.951756 17900 consensus_meta.cc:287] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.568s	user 0.013s	sys 0.000s
I20260709 12:11:39.950925 18355 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:39.952992 18283 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:11:39.996838 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 57700.8us
W20260709 12:11:39.999243 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 240236us
I20260709 12:11:39.991923 13685 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 7.
I20260709 12:11:40.000041 13652 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:40.005201 13652 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:40.005365 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:40.005950 14412 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:40.006681 13652 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:40.006901 13801 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:40.008239 14411 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 12.
I20260709 12:11:40.012565 13652 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:40.013666 14412 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 14.
I20260709 12:11:40.003213 13800 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:40.014077 14379 leader_election.cc:304] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:11:40.025574 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 105659us
W20260709 12:11:40.026234 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 125334us
I20260709 12:11:40.026166 13755 raft_consensus.cc:1240] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:40.050354 13652 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:39.999429 18482 raft_consensus.cc:2749] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:40.029278 13800 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:40.045620 13727 leader_election.cc:304] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:40.049091 18371 raft_consensus.cc:2804] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:40.025851 18283 raft_consensus.cc:2804] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:40.015154 18493 raft_consensus.cc:2749] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:40.014988 17927 raft_consensus.cc:2749] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:40.015611 18498 raft_consensus.cc:2749] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for earlier term 11. Current term is 12.
I20260709 12:11:40.059646 13800 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:39.994328 17900 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:40.025725 18491 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:11:40.072644 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.004179 17952 consensus_queue.cc:1048] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
W20260709 12:11:40.088165 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 89669us
I20260709 12:11:40.048595 18468 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:40.053916 18201 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:40.095788 18201 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:40.098210 18201 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:40.014585 18374 consensus_queue.cc:1059] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 12:11:40.090246 14379 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:40.043471 18527 raft_consensus.cc:2749] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:40.045428 18529 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:40.099946 18529 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:40.025825 18284 consensus_queue.cc:260] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:40.102228 18529 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:40.102681 18284 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:40.063246 17989 raft_consensus.cc:2749] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:40.104178 18510 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:40.106913 18530 log.cc:927] Time spent T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:11:40.106720 14379 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:40.108103 18510 raft_consensus.cc:2749] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:11:40.108160 18519 log.cc:927] Time spent T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
I20260709 12:11:40.111609 18361 raft_consensus.cc:2749] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:40.112087 14379 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:40.113248 13727 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:40.113960 18258 consensus_queue.cc:1048] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:40.115157 17900 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:40.115015 18527 consensus_queue.cc:1048] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:40.115801 17900 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:40.116289 17900 raft_consensus.cc:697] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:40.116703 18527 consensus_queue.cc:1059] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:40.118073 17977 raft_consensus.cc:3055] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:40.118481 17977 raft_consensus.cc:740] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:40.118521 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:40.119300 13829 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 10.
I20260709 12:11:40.119442 17977 consensus_queue.cc:260] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:40.113349 18510 raft_consensus.cc:2804] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:40.120894 17977 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:40.121085 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:40.122413 18524 consensus_queue.cc:1059] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:11:40.123294 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:40.123835 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:40.124058 13833 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:40.124580 14411 raft_consensus.cc:2393] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 12: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:40.125825 14410 raft_consensus.cc:1240] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:40.126194 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:40.123535 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:40.127688 14412 raft_consensus.cc:2393] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 12: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:11:40.129374 14413 raft_consensus.cc:1240] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:40.128950 14379 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:40.123519 18524 raft_consensus.cc:3055] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:40.168843 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:40.169591 13832 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:40.170594 14379 leader_election.cc:400] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 election: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for earlier term 11. Current term is 12.
I20260709 12:11:40.133939 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:40.120905 18510 raft_consensus.cc:697] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 13 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:40.058104 18371 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:40.173239 13727 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:40.051846 18486 consensus_queue.cc:1059] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:11:40.175379 13829 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 9.
W20260709 12:11:40.129472 18526 log.cc:927] Time spent T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 12:11:40.063589 18462 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:40.081203 18482 raft_consensus.cc:2749] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:40.130108 18493 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:40.067544 18431 raft_consensus.cc:2804] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:40.179600 13727 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
W20260709 12:11:40.212105 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 152539us
I20260709 12:11:40.131552 18534 raft_consensus.cc:2804] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:40.186517 13836 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 12.
I20260709 12:11:40.136163 13726 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:40.117185 17900 consensus_queue.cc:237] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:40.178925 18508 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:40.129886 18463 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:40.067111 18291 consensus_queue.cc:1048] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.116s
W20260709 12:11:40.183918 18521 log.cc:927] Time spent T 00000000000000000000000000000000 P 17d79eae88f84be7a847d0cf544674cd: Append to log took a long time: real 0.291s	user 0.003s	sys 0.000s
I20260709 12:11:40.205907 17989 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:40.176442 18311 raft_consensus.cc:2749] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:40.179446 18371 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:40.213284 13800 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:40.214916 13833 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 11.
I20260709 12:11:40.178400 18529 raft_consensus.cc:2749] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:40.243805 13800 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:40.211815 18431 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:40.258303 18431 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:40.088285 18512 tablet_copy_client.cc:323] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Beginning tablet copy session from remote peer at address 127.12.56.194:39545
I20260709 12:11:40.261461 18361 raft_consensus.cc:3055] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:40.262079 18361 raft_consensus.cc:740] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:40.179251 18535 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:40.263077 18535 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:40.263728 18120 raft_consensus.cc:3055] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:40.263157 18361 consensus_queue.cc:260] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:40.264204 18120 raft_consensus.cc:740] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:40.265101 18361 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:40.131640 13831 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:40.223114 18534 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:40.266434 18534 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:40.227804 18356 raft_consensus.cc:2804] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:40.270467 18356 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:40.270977 18356 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:40.229334 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.272746 18492 raft_consensus.cc:3055] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:40.273268 18492 raft_consensus.cc:740] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:40.257241 18510 consensus_queue.cc:237] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:40.274279 18492 consensus_queue.cc:260] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:40.275529 18492 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:40.233673 13762 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 13.
I20260709 12:11:40.168805 18524 raft_consensus.cc:740] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:40.210740 18251 raft_consensus.cc:2804] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:40.246076 13800 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:40.185595 13828 raft_consensus.cc:1275] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 12:11:40.250321 18533 log.cc:927] Time spent T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.185s	user 0.000s	sys 0.000s
W20260709 12:11:40.250898 18528 log.cc:927] Time spent T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260709 12:11:40.251489 18266 raft_consensus.cc:2749] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:40.269893 18535 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:40.338908 13680 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2578) took 1835 ms (client timeout 2040 ms). Trace:
I20260709 12:11:40.278190 13755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2649) took 1008 ms. Trace:
I20260709 12:11:40.340658 13755 rpcz_store.cc:276] 0709 12:11:39.270097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:39.272396 (+  2299us) service_pool.cc:224] Handling call
0709 12:11:39.272691 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:40.045516 (+772825us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:40.277905 (+232389us) spinlock_profiling.cc:243] Waited 753 ms on lock 0x7b54003c8a54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:40.278120 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1732346240}
I20260709 12:11:40.234241 13832 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 13.
I20260709 12:11:40.281854 13831 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 11.
W20260709 12:11:40.207039 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 197586us
W20260709 12:11:40.296139 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 50124.4us
W20260709 12:11:40.299782 13683 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2589) took 1637 ms (client timeout 1575 ms). Trace:
I20260709 12:11:40.343227 13800 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:11:40.312496 13652 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 1.524s (SENT) [suppressed 36 similar messages]
W20260709 12:11:40.315996 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.320020 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:40.345440 13763 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 10.
I20260709 12:11:40.345647 13800 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:40.322520 13757 raft_consensus.cc:1240] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:40.242529 18486 consensus_queue.cc:1048] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.084s
I20260709 12:11:40.348959 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:40.208966 18462 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:40.243157 18508 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:40.228562 18355 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:40.213011 18493 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:40.343115 13683 rpcz_store.cc:269] 0709 12:11:38.662364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.670638 (+  8274us) service_pool.cc:224] Handling call
0709 12:11:40.299409 (+1628771us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54002be8d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:40.299672 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2935051136}
I20260709 12:11:40.350813 13755 raft_consensus.cc:1240] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:40.349462 13801 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:40.359778 13756 raft_consensus.cc:1240] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 12. Current term is 13. Ops: []
W20260709 12:11:40.339689 13680 rpcz_store.cc:269] 0709 12:11:38.503541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.505140 (+  1599us) service_pool.cc:224] Handling call
0709 12:11:40.338625 (+1833485us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b540021fa54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:40.338816 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3237325056}
I20260709 12:11:40.363270 13651 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:40.314987 18251 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:40.265234 18120 consensus_queue.cc:260] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.4, Last appended by leader: 4, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:40.246821 17989 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:40.337385 18283 raft_consensus.cc:697] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 14 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:40.377362 13759 raft_consensus.cc:1240] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 11. Current term is 12. Ops: []
W20260709 12:11:40.401523 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.361712 18535 raft_consensus.cc:2804] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:40.438903 14407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41692 (request call id 771) took 1205 ms. Trace:
W20260709 12:11:40.439525 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.439383 14407 rpcz_store.cc:276] 0709 12:11:39.233247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:39.233917 (+   670us) service_pool.cc:224] Handling call
0709 12:11:39.234254 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:39.916830 (+682576us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:40.305320 (+388490us) spinlock_profiling.cc:243] Waited 2.91 ms on lock 0x7b540058e420. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f04dc0 00007fa927f90a02 00007fa927f8cdd6 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2
0709 12:11:40.438655 (+133335us) spinlock_profiling.cc:243] Waited 680 ms on lock 0x7b5400530054. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:40.438840 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1570075264}
I20260709 12:11:40.384338 18251 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:40.447867 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 243985us
I20260709 12:11:40.450997 13762 raft_consensus.cc:1275] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 12:11:40.452631 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.395279 18254 raft_consensus.cc:3055] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:40.363792 18374 consensus_queue.cc:1059] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
W20260709 12:11:40.454715 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 318657us
I20260709 12:11:40.364255 18498 consensus_queue.cc:1048] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.072s
I20260709 12:11:40.369580 18491 consensus_queue.cc:1059] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.078s
I20260709 12:11:40.374560 18355 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:40.431123 18468 raft_consensus.cc:2804] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:11:40.490170 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 177719us
I20260709 12:11:40.501381 13726 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:11:40.534646 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:40.525955 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 301672us
I20260709 12:11:40.536599 13727 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:40.446702 18544 raft_consensus.cc:2804] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:11:40.534226 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 164099us
I20260709 12:11:40.456265 18254 raft_consensus.cc:740] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:40.458715 18549 raft_consensus.cc:2749] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:40.441300 18291 consensus_queue.cc:1059] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.095s
W20260709 12:11:40.547370 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 148728us
I20260709 12:11:40.545661 13726 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:40.548653 13727 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:40.549919 13652 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:40.526448 18468 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:40.528548 17900 raft_consensus.cc:2804] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:40.491578 18548 raft_consensus.cc:2749] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:40.524900 18463 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:40.535554 18013 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:40.536984 18491 consensus_queue.cc:1243] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer 3f37c9cc9dda46b4be21dd675ba78fb7 log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:11:40.429462 18524 consensus_queue.cc:260] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:40.565105 13727 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:40.552191 18201 raft_consensus.cc:2749] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:40.561115 18468 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:40.560566 17900 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:40.589061 18527 raft_consensus.cc:2804] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:11:40.609385 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 59626.1us
I20260709 12:11:40.561964 13773 tablet_copy_service.cc:140] P 3f37c9cc9dda46b4be21dd675ba78fb7: Received BeginTabletCopySession request for tablet d2f365337b324999a073edacbe6c6e09 from peer ca9fbbc2c0a94897897d502d42f3951f ({username='slave'} at 127.0.0.1:38932)
I20260709 12:11:40.577049 18227 raft_consensus.cc:2804] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:40.578804 18291 consensus_queue.cc:1243] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer 3f37c9cc9dda46b4be21dd675ba78fb7 log is divergent from this leader: its last log entry 15.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:11:40.580628 18463 raft_consensus.cc:697] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 14 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:40.589793 18548 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:40.608242 18535 raft_consensus.cc:697] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 15 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:40.544207 18283 consensus_queue.cc:237] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:40.617390 18537 raft_consensus.cc:2804] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:40.628885 18506 consensus_queue.cc:1059] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:40.606175 18550 raft_consensus.cc:3055] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:40.612066 17900 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:40.580111 18013 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:40.672646 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:40.669996 18537 raft_consensus.cc:697] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 12 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:40.614168 18371 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:40.697359 13652 leader_election.cc:336] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 1.913s (SENT)
I20260709 12:11:40.639328 18548 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:40.670547 18355 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:40.641047 18560 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:40.636178 18527 raft_consensus.cc:697] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:40.638907 18551 raft_consensus.cc:2749] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:11:40.739593 18507 consensus_meta.cc:287] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.745s	user 0.010s	sys 0.002s
I20260709 12:11:40.740253 18507 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:40.742936 18507 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:11:40.711685 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 146677us
I20260709 12:11:40.637410 18508 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:40.673242 18545 log.cc:927] Time spent T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
W20260709 12:11:40.670503 18553 log.cc:927] Time spent T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:11:40.635310 13773 tablet_copy_service.cc:161] P 3f37c9cc9dda46b4be21dd675ba78fb7: Beginning new tablet copy session on tablet d2f365337b324999a073edacbe6c6e09 from peer ca9fbbc2c0a94897897d502d42f3951f at {username='slave'} at 127.0.0.1:38932: session id = ca9fbbc2c0a94897897d502d42f3951f-d2f365337b324999a073edacbe6c6e09
I20260709 12:11:40.738492 18534 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:40.720494 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 374905us
I20260709 12:11:40.635361 18201 consensus_queue.cc:1059] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
W20260709 12:11:40.708964 18546 log.cc:927] Time spent T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.251s	user 0.001s	sys 0.000s
I20260709 12:11:40.754770 13831 raft_consensus.cc:1275] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:11:40.755347 13800 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:40.755529 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:40.643816 18227 raft_consensus.cc:697] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:40.622383 18254 consensus_queue.cc:260] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:40.764564 18201 raft_consensus.cc:3055] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:40.765054 18201 raft_consensus.cc:740] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:40.766597 13800 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:40.639931 18431 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:40.720291 18458 raft_consensus.cc:3055] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:11:40.726502 18557 log.cc:927] Time spent T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 12:11:40.637328 18556 consensus_queue.cc:1059] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.095s
W20260709 12:11:40.729393 18554 log.cc:927] Time spent T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:11:40.744632 18527 consensus_queue.cc:237] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:40.723642 18538 raft_consensus.cc:3055] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:40.769966 13800 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:40.675084 18493 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:40.674775 18550 raft_consensus.cc:740] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:40.640816 18529 raft_consensus.cc:2804] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:40.703873 17989 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:40.755620 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:40.788256 13800 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:40.756166 14412 raft_consensus.cc:2376] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 8. Re-sending same reply.
I20260709 12:11:40.790210 14414 raft_consensus.cc:1275] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:40.757570 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:40.792652 14410 raft_consensus.cc:2393] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 12: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:11:40.757741 14379 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
W20260709 12:11:40.723832 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 147044us
I20260709 12:11:40.753593 13727 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:40.717868 18462 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:40.768682 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:40.640386 18544 raft_consensus.cc:697] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 9 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:40.798815 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:40.799551 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:40.807080 13800 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:40.801944 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:40.812593 13837 raft_consensus.cc:2376] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 14. Re-sending same reply.
I20260709 12:11:40.814242 18570 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:40.786540 18458 raft_consensus.cc:740] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:40.818279 18570 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:40.818949 18458 consensus_queue.cc:260] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:40.820116 18458 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:40.820875 18570 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:40.770259 18549 raft_consensus.cc:2749] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:40.797425 17989 raft_consensus.cc:2749] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:40.753715 18463 consensus_queue.cc:237] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:40.797618 18356 consensus_meta.cc:287] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.526s	user 0.011s	sys 0.002s
I20260709 12:11:40.823819 18356 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:40.825193 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.825436 13763 raft_consensus.cc:1240] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:40.761435 18374 consensus_queue.cc:1048] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
W20260709 12:11:40.828277 18361 consensus_meta.cc:287] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.563s	user 0.011s	sys 0.000s
I20260709 12:11:40.829941 18556 raft_consensus.cc:2804] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:11:40.830837 17977 consensus_meta.cc:287] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.709s	user 0.012s	sys 0.002s
I20260709 12:11:40.778165 18227 consensus_queue.cc:237] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:40.832234 18475 raft_consensus.cc:3055] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:40.832674 18475 raft_consensus.cc:740] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:40.833930 18555 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:40.834615 18555 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:40.836258 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:40.779034 18534 leader_election.cc:290] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:40.816653 13652 leader_election.cc:336] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 2.023s (SENT)
W20260709 12:11:40.816356 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 62836.7us
I20260709 12:11:40.811699 18479 raft_consensus.cc:2804] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:40.784994 18491 consensus_queue.cc:1059] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
W20260709 12:11:40.860668 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 53683.6us
I20260709 12:11:40.836897 13832 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:40.838480 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.779374 18562 raft_consensus.cc:2804] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:40.836853 18555 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:40.814601 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:40.830471 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:40.840787 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:11:40.861688 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 46745.2us
I20260709 12:11:40.788869 18538 raft_consensus.cc:740] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:40.901099 13800 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:40.746731 18560 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:40.797494 18551 raft_consensus.cc:3055] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:11:40.865803 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:40.873730 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.792224 18564 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:40.800135 18493 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:40.954020 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:40.955245 13829 raft_consensus.cc:2368] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 10. Current term is 11.
I20260709 12:11:40.956367 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:11:40.940102 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 326420us
I20260709 12:11:40.943638 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:40.830425 18556 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:40.945864 13832 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 12.
I20260709 12:11:40.837792 18462 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:40.958329 13829 raft_consensus.cc:2368] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 10. Current term is 11.
I20260709 12:11:40.959558 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:40.963689 13832 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:40.964044 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:40.947645 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:40.828069 18356 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:40.839746 18013 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:40.962520 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:40.797926 18507 consensus_queue.cc:1048] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.143s
I20260709 12:11:40.965932 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:40.960213 13652 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:40.900652 18549 raft_consensus.cc:2804] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:11:40.968487 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 67471.5us
I20260709 12:11:40.868075 18569 raft_consensus.cc:2804] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:40.970062 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:40.970851 13688 raft_consensus.cc:3055] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:40.987083 13688 raft_consensus.cc:740] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
W20260709 12:11:40.967499 18492 consensus_meta.cc:287] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.692s	user 0.014s	sys 0.000s
I20260709 12:11:40.965823 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:40.979722 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:40.980055 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:40.982594 13832 raft_consensus.cc:2410] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:11:40.983425 13800 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:11:40.965047 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 117770us
I20260709 12:11:40.937623 18479 raft_consensus.cc:697] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 7 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:40.849877 18567 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:40.945560 18551 raft_consensus.cc:740] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:40.792948 18535 consensus_queue.cc:237] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:41.014154 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:41.002720 13679 raft_consensus.cc:2393] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 12: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:41.014894 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:41.004824 13800 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:40.963074 18556 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:41.016247 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 225611us
I20260709 12:11:40.766713 18537 consensus_queue.cc:237] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:41.012671 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:40.838524 18201 consensus_queue.cc:260] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:41.018340 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:41.028674 13833 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 10.
I20260709 12:11:41.019186 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:41.030593 13836 raft_consensus.cc:1240] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:11:41.030922 13830 raft_consensus.cc:1275] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:11:40.984799 17989 raft_consensus.cc:2749] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:41.014256 13727 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:40.833556 18475 consensus_queue.cc:260] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:41.042192 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 82083.5us
I20260709 12:11:41.004417 18569 raft_consensus.cc:697] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 13 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:40.980329 18550 consensus_queue.cc:260] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:40.981897 18562 raft_consensus.cc:697] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 12 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:40.978515 18462 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:40.988143 13688 consensus_queue.cc:260] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:41.033900 13727 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:41.034495 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:11:41.077376 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 43629.9us
I20260709 12:11:41.077652 13688 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:41.077963 13837 raft_consensus.cc:2410] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 12:11:40.990868 18570 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.017423 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:41.025960 18551 consensus_queue.cc:260] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:11:41.062017 18578 raft_consensus.cc:2804] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:41.084281 18578 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:41.084753 18578 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:41.084475 18562 consensus_queue.cc:237] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:41.088702 18548 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:41.089570 18254 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:41.089469 18570 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:40.991742 18291 raft_consensus.cc:3060] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:41.092043 18570 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:41.093494 18560 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:41.094753 13834 raft_consensus.cc:1240] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
W20260709 12:11:41.095302 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.063549 13836 raft_consensus.cc:1240] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 12:11:41.064164 13830 raft_consensus.cc:1240] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 12:11:41.013702 18573 raft_consensus.cc:2749] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:41.101460 13758 raft_consensus.cc:1275] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:41.066938 18463 raft_consensus.cc:2749] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:41.102658 13833 raft_consensus.cc:1240] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:41.104555 18551 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:41.106354 18120 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:41.106851 18291 raft_consensus.cc:2749] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:41.107829 18578 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:41.110879 18575 log.cc:927] Time spent T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:11:41.014276 18567 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:41.112231 18578 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:41.115916 18529 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:41.116442 18529 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:41.121277 18468 consensus_meta.cc:287] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.505s	user 0.002s	sys 0.006s
I20260709 12:11:41.067850 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
W20260709 12:11:41.068809 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 64064us
I20260709 12:11:40.985954 18549 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:40.990140 18555 consensus_queue.cc:1048] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 12:11:40.981607 18493 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:41.025846 18479 consensus_queue.cc:237] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:41.062994 18431 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:40.967278 18564 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:41.098745 13760 raft_consensus.cc:1275] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:41.099804 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:41.229802 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.258225 13762 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 8.
W20260709 12:11:41.230993 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.078181 13727 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
W20260709 12:11:41.261831 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 183581us
I20260709 12:11:41.263803 13727 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:41.098819 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:41.249940 13756 raft_consensus.cc:1240] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:41.252357 13757 raft_consensus.cc:1240] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:41.260305 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:41.265447 13727 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:41.274945 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:41.128073 13800 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:41.276561 13679 raft_consensus.cc:2410] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
W20260709 12:11:41.278774 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 150591us
W20260709 12:11:41.281520 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.039177 13829 raft_consensus.cc:1240] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:41.284874 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:41.135854 13830 raft_consensus.cc:1275] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:41.145326 13835 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:41.126207 14414 raft_consensus.cc:2393] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 12: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:11:41.144776 17900 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:41.330718 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:41.331065 13687 raft_consensus.cc:1240] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:41.331851 13681 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 9.
I20260709 12:11:41.103538 18201 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:41.131253 18251 consensus_meta.cc:287] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.656s	user 0.012s	sys 0.000s
I20260709 12:11:41.154578 18284 raft_consensus.cc:3055] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:41.402279 18284 raft_consensus.cc:740] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:41.404253 18284 consensus_queue.cc:260] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:41.083431 18356 raft_consensus.cc:2804] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:41.406729 18356 raft_consensus.cc:697] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:41.187505 18371 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:41.076228 18461 consensus_queue.cc:1048] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 12:11:41.411083 18582 consensus_queue.cc:1048] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:41.164469 18462 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:41.130940 18468 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:41.163097 18493 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:41.164397 18524 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:41.420845 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:41.421644 17900 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:41.424772 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:41.027091 18544 consensus_queue.cc:237] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:41.439406 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:41.130576 18549 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:41.441637 13773 tablet_copy_source_session.cc:215] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:11:41.102749 18550 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:41.154429 18564 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:41.145418 18567 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:41.112329 18569 consensus_queue.cc:237] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:41.447847 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:41.451118 14412 raft_consensus.cc:1240] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:11:41.327421 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:41.328800 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:41.344142 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:41.342370 13828 raft_consensus.cc:1240] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 11. Current term is 12. Ops: [10.6-11.7]
I20260709 12:11:41.335465 18044 raft_consensus.cc:2804] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:41.344987 18490 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:41.339648 18382 raft_consensus.cc:2804] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:41.340269 18288 raft_consensus.cc:2804] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:41.338506 13759 raft_consensus.cc:1240] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:41.346990 13684 raft_consensus.cc:1240] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:41.336508 18266 consensus_queue.cc:1048] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:11:41.337087 18593 log.cc:927] Time spent T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 12:11:41.368768 18256 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.465145 18382 raft_consensus.cc:697] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:41.370697 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:41.465464 18256 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:41.466950 18382 consensus_queue.cc:237] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:41.467458 18490 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:41.371790 13834 raft_consensus.cc:1275] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:11:41.371575 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:41.372162 18475 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:41.373706 18355 raft_consensus.cc:2804] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:41.395485 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:41.144027 18460 raft_consensus.cc:3055] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:41.425285 13831 raft_consensus.cc:1275] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:40.986447 18538 consensus_queue.cc:260] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:41.492501 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:41.492571 18460 raft_consensus.cc:740] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:41.494861 18538 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:41.495942 13828 raft_consensus.cc:1240] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:41.496161 18460 consensus_queue.cc:260] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:41.496099 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:41.502624 18551 consensus_queue.cc:1059] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:41.503463 13762 raft_consensus.cc:1240] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:41.504895 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:41.505837 13754 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 15.
I20260709 12:11:41.415966 18284 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:41.494870 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 62154.1us
I20260709 12:11:41.427796 18251 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:41.480871 18355 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:41.468485 18256 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:41.505679 13762 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:41.408581 18356 consensus_queue.cc:237] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:41.475136 18044 raft_consensus.cc:697] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:41.528791 18468 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:41.485829 18288 raft_consensus.cc:697] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:11:41.533028 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 57599.6us
I20260709 12:11:41.522605 18355 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:41.532960 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:41.531190 18582 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.590281 18582 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:41.589389 18564 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.592918 18564 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:41.593611 18288 consensus_queue.cc:237] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:41.594898 18570 consensus_queue.cc:1059] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:11:41.596370 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:41.597004 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 62633us
I20260709 12:11:41.599740 13652 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:41.592485 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:41.602579 13679 raft_consensus.cc:2393] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 11: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
W20260709 12:11:41.603029 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 57275.9us
I20260709 12:11:41.603873 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:41.549515 14379 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:41.550390 18460 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:41.554692 13773 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:38932 (request call id 679) took 1080 ms. Trace:
I20260709 12:11:41.559751 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:41.566244 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:41.576440 14416 raft_consensus.cc:1275] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:11:41.577936 18490 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:41.578526 13757 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 14.
W20260709 12:11:41.578985 18556 consensus_meta.cc:287] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.554s	user 0.013s	sys 0.001s
I20260709 12:11:41.550398 13761 raft_consensus.cc:1240] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 12:11:41.583575 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:41.586139 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:41.604861 13679 raft_consensus.cc:2376] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 13. Re-sending same reply.
I20260709 12:11:41.615387 13684 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:41.621688 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 72460.6us
I20260709 12:11:41.596403 18570 raft_consensus.cc:3055] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:41.546408 18044 consensus_queue.cc:237] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:41.611492 13773 rpcz_store.cc:276] 0709 12:11:40.476663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:40.552098 (+ 75435us) service_pool.cc:224] Handling call
0709 12:11:41.525808 (+973710us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:41.645951 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.628248 18251 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:41.663261 13688 raft_consensus.cc:2393] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 14: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:41.663822 13761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2667) took 1338 ms. Trace:
I20260709 12:11:41.664256 13761 rpcz_store.cc:276] 0709 12:11:40.325637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:40.336907 (+ 11270us) service_pool.cc:224] Handling call
0709 12:11:40.364473 (+ 27566us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:41.626680 (+1262207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:41.663461 (+ 36781us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54003a02d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:41.663730 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2707291520}
I20260709 12:11:41.666579 18564 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:41.667613 18543 raft_consensus.cc:2804] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:41.668164 18543 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:41.668547 18543 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:41.669878 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.670110 18572 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:41.670924 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.670836 18572 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:41.671530 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:41.672055 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.624358 18556 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:41.674916 13756 raft_consensus.cc:1240] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:41.624990 18570 raft_consensus.cc:740] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:41.688309 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:41.683940 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:41.696842 13762 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 14.
I20260709 12:11:41.697808 18498 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.698601 18498 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:41.696970 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:41.708523 18479 consensus_queue.cc:1048] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:41.718425 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:41.719450 13679 raft_consensus.cc:2393] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 11: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
W20260709 12:11:41.719812 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.720316 18551 raft_consensus.cc:3055] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:41.720453 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:11:41.720659 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 178094us
I20260709 12:11:41.721069 18551 raft_consensus.cc:740] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:41.721343 13679 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 14.
I20260709 12:11:41.723240 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:41.723639 13726 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:41.723825 18556 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:41.724383 18120 consensus_queue.cc:1059] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:11:41.728539 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 130754us
I20260709 12:11:41.730293 18534 consensus_queue.cc:1059] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:41.731462 18461 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.720613 18549 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:41.720350 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.746304 18254 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.758626 18254 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:41.762138 13652 leader_election.cc:400] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 10. Current term is 11.
I20260709 12:11:41.762543 13652 leader_election.cc:403] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:41.765733 13683 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 11.
I20260709 12:11:41.763309 13686 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 15.
I20260709 12:11:41.769843 13682 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 13.
I20260709 12:11:41.779325 13684 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 10.
I20260709 12:11:41.729426 18507 consensus_queue.cc:1048] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 12:11:41.761461 18254 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:41.742352 18582 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:41.781697 18490 raft_consensus.cc:2749] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 10. Current term is 11.
W20260709 12:11:41.790573 18596 log.cc:927] Time spent T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
W20260709 12:11:41.791357 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 56894.5us
I20260709 12:11:41.794009 13680 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 15.
I20260709 12:11:41.829509 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:11:41.830199 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:41.830637 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.795680 18498 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:41.797921 18120 raft_consensus.cc:2749] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:41.789463 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:11:41.789374 18603 log.cc:927] Time spent T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:11:41.832772 13681 raft_consensus.cc:2410] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:11:41.786820 18355 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:41.835391 18355 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:41.814462 18284 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.836237 18570 consensus_queue.cc:260] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:41.837471 18284 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:41.832783 13686 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:41.839619 13837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 2550) took 1035 ms. Trace:
I20260709 12:11:41.840093 13837 rpcz_store.cc:276] 0709 12:11:40.804185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:41.096166 (+291981us) service_pool.cc:224] Handling call
0709 12:11:41.096538 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:41.142820 (+ 46282us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:41.142861 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:41.144473 (+  1612us) log.cc:844] Serialized 26 byte log entry
0709 12:11:41.507297 (+362824us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:41.533921 (+ 26624us) log.cc:844] Serialized 14 byte log entry
0709 12:11:41.539734 (+  5813us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:41.839006 (+299272us) spinlock_profiling.cc:243] Waited 45.8 ms on lock 0x7b5400166cd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:41.839053 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:41.839101 (+    48us) raft_consensus.cc:1685] finished
0709 12:11:41.839225 (+   124us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:41.839428 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":601,"prepare.queue_time_us":26169,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":6554,"raft.queue_time_us":4289,"raft.run_cpu_time_us":391,"raft.run_wall_time_us":7426,"spinlock_wait_cycles":105450240,"thread_start_us":123037,"threads_started":1,"wal-append.queue_time_us":326297}
I20260709 12:11:41.842605 13763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2668) took 1505 ms. Trace:
I20260709 12:11:41.846064 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:41.850656 13763 rpcz_store.cc:276] 0709 12:11:40.347788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:40.349790 (+  2002us) service_pool.cc:224] Handling call
0709 12:11:40.350141 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:40.825988 (+475847us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:41.842095 (+1016107us) spinlock_profiling.cc:243] Waited 475 ms on lock 0x7b540038d1d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:41.842429 (+   334us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1092611456}
W20260709 12:11:41.855098 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 131536us
W20260709 12:11:41.858170 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.863284 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:41.863842 13835 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 11.
I20260709 12:11:41.865007 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:41.783399 18461 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:41.890926 13726 leader_election.cc:304] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:41.871302 18570 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:41.897037 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:41.897934 13726 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:41.898793 13686 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 14.
W20260709 12:11:41.899816 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.881997 18567 raft_consensus.cc:2749] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:41.863719 18534 consensus_queue.cc:1059] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 12:11:41.907606 13684 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:41.878167 18556 consensus_queue.cc:1048] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 12:11:41.917361 13686 raft_consensus.cc:1275] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:11:41.914804 13727 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:41.926637 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:41.928335 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:41.900712 18572 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:41.939329 13830 raft_consensus.cc:1275] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:11:41.939762 13683 raft_consensus.cc:1240] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:11:41.933997 13652 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:41.943591 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:41.944986 18284 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:41.945335 13754 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 10.
I20260709 12:11:41.934974 18288 raft_consensus.cc:2804] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:41.936125 18556 consensus_queue.cc:1243] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer ca9fbbc2c0a94897897d502d42f3951f log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:11:41.957371 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:41.957607 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:41.958137 13754 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 11.
I20260709 12:11:41.958362 18013 raft_consensus.cc:2749] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:41.952507 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:41.959218 13683 raft_consensus.cc:1240] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:41.959246 18266 raft_consensus.cc:2749] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:41.958148 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:41.944222 18572 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.968060 13833 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:41.947978 18549 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:41.953164 18288 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:41.970675 13726 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:41.978720 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:41.979360 17900 raft_consensus.cc:3055] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:41.979816 17900 raft_consensus.cc:740] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:41.991676 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:41.994065 13756 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 18.
I20260709 12:11:41.994736 13687 raft_consensus.cc:1275] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:11:41.976795 18288 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:41.998919 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:41.999982 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 85249.3us
I20260709 12:11:42.002856 13688 raft_consensus.cc:1275] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:11:42.013616 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:42.014529 13836 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:42.015550 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 91582.7us
W20260709 12:11:42.012187 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 50486.1us
I20260709 12:11:42.020133 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:42.022845 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:42.027657 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:11:42.040426 18475 consensus_meta.cc:287] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.550s	user 0.011s	sys 0.004s
W20260709 12:11:42.040652 18529 consensus_meta.cc:287] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.924s	user 0.012s	sys 0.006s
I20260709 12:11:42.041316 18529 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:42.042716 13837 raft_consensus.cc:1240] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:42.043984 13686 raft_consensus.cc:1275] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:11:42.045418 13763 raft_consensus.cc:2410] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:11:42.022200 18461 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:42.048564 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:42.014523 18551 consensus_queue.cc:260] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:42.054206 18529 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:42.054965 13829 raft_consensus.cc:1275] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:42.055621 18551 raft_consensus.cc:3060] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:41.997510 18572 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:42.059824 18572 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:42.060863 13652 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:42.055717 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:42.062589 13834 raft_consensus.cc:1240] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:42.062772 13652 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:42.064671 13652 leader_election.cc:304] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:42.064783 13836 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 13.
I20260709 12:11:42.070096 13687 raft_consensus.cc:1240] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 11 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 10. Current term is 11. Ops: [10.6-10.6]
W20260709 12:11:42.075934 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 56903.5us
I20260709 12:11:42.078135 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:42.084569 13684 raft_consensus.cc:2410] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:11:42.085901 18461 raft_consensus.cc:2749] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:42.086413 13684 raft_consensus.cc:1275] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 12:11:42.073405 18490 raft_consensus.cc:2749] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:42.086894 13684 pending_rounds.cc:85] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 7
I20260709 12:11:42.087248 13684 pending_rounds.cc:107] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 12:11:42.087558 13684 raft_consensus.cc:2889] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:42.089990 18284 raft_consensus.cc:2749] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:42.092772 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:42.093263 13754 raft_consensus.cc:1217] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 LEADER]: Deduplicated request from leader. Original: 12.7->[14.8-14.8]   Dedup: 14.8->[]
I20260709 12:11:42.093932 13754 raft_consensus.cc:1240] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 12:11:42.093798 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:42.093604 13756 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 12.
I20260709 12:11:42.095853 13652 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:42.096877 18284 raft_consensus.cc:2749] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:42.097872 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:42.099033 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:42.100003 18475 raft_consensus.cc:2749] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:11:42.105360 13835 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54830 (request call id 2554) took 1300 ms (client timeout 1524 ms). Trace:
W20260709 12:11:42.114539 13835 rpcz_store.cc:269] 0709 12:11:40.805332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:40.830046 (+ 24714us) service_pool.cc:224] Handling call
0709 12:11:42.105102 (+1275056us) spinlock_profiling.cc:243] Waited 211 ms on lock 0x7b540020d854. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:42.105265 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":485838080}
I20260709 12:11:42.115077 18120 consensus_queue.cc:1048] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:42.106732 18556 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.113446 18311 consensus_queue.cc:1059] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 12:11:42.108229 18201 consensus_queue.cc:1048] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:42.116670 18311 raft_consensus.cc:3055] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:42.116293 18556 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:42.109527 18534 consensus_queue.cc:1059] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:42.117187 18311 raft_consensus.cc:740] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:42.110294 13763 raft_consensus.cc:1240] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 14. Current term is 15. Ops: [12.7-14.8]
W20260709 12:11:42.118067 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 44233.7us
I20260709 12:11:42.118896 14379 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:42.110966 18283 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:42.119370 18556 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:42.119438 18534 consensus_queue.cc:1048] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:42.119915 18283 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:42.122637 18479 raft_consensus.cc:2749] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:42.122977 13727 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:42.124637 18266 raft_consensus.cc:2749] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:42.110884 18382 consensus_queue.cc:1059] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:42.126451 18356 consensus_queue.cc:1048] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:42.127339 18382 raft_consensus.cc:3055] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:42.127535 18201 consensus_queue.cc:1059] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:42.127867 18382 raft_consensus.cc:740] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:42.130751 18283 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:42.133991 13833 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 15.
I20260709 12:11:42.113767 13652 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:42.017604 18044 raft_consensus.cc:2804] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:42.135196 18044 raft_consensus.cc:697] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:42.135844 18582 raft_consensus.cc:2749] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:42.136400 18044 consensus_queue.cc:237] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:42.137691 18381 raft_consensus.cc:3055] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:11:42.137943 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:42.138195 18381 raft_consensus.cc:740] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:42.139474 18534 consensus_queue.cc:1048] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:42.139310 18381 consensus_queue.cc:260] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:42.132478 18311 consensus_queue.cc:260] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:42.141134 18381 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:42.141445 18311 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:42.129014 18543 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:42.143712 18543 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 9 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:42.144708 18475 consensus_queue.cc:1048] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:42.145994 17900 consensus_queue.cc:260] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:42.146503 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:42.147330 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:42.147914 13756 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:42.111047 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:42.156641 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:42.158541 13727 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:42.166527 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:42.168268 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:11:42.168871 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:42.108798 18498 consensus_queue.cc:1048] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 12:11:42.172142 13726 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:42.174453 13727 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:42.179327 14414 pending_rounds.cc:85] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f: Aborting all ops after (but not including) 10
I20260709 12:11:42.179741 14414 pending_rounds.cc:107] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 12:11:42.180011 14414 raft_consensus.cc:2889] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:42.182044 13682 raft_consensus.cc:2393] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 11: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:42.182482 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:42.175388 18013 raft_consensus.cc:2804] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:42.184641 14416 raft_consensus.cc:1275] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
W20260709 12:11:42.186111 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:42.170954 18355 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.190384 18355 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:42.192806 18355 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:42.147675 18556 consensus_queue.cc:1048] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:11:42.164060 17900 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:42.214298 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:42.217679 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:42.218493 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:42.218573 13686 raft_consensus.cc:1275] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:42.220355 13679 raft_consensus.cc:1275] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:42.218677 13680 raft_consensus.cc:2410] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:11:42.220829 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:42.222396 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:42.221480 13681 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 7.
I20260709 12:11:42.226507 13685 raft_consensus.cc:1275] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:11:42.242712 13682 raft_consensus.cc:1240] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:42.246281 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 136170us
I20260709 12:11:42.247850 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:42.233646 18567 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.266726 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:42.233439 18551 consensus_queue.cc:1048] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.033s
W20260709 12:11:42.275137 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 154247us
I20260709 12:11:42.249657 18534 raft_consensus.cc:2749] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:42.276691 13763 raft_consensus.cc:1275] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:42.270123 14416 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 12.
W20260709 12:11:42.278450 13800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:42.234424 18288 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:42.290074 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:42.290994 13652 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:42.285722 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:42.297986 13833 raft_consensus.cc:2376] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 12. Re-sending same reply.
I20260709 12:11:42.297153 13686 raft_consensus.cc:2410] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for term 16 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 12:11:42.292373 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:42.302363 14413 raft_consensus.cc:1240] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:11:42.303360 13681 raft_consensus.cc:1275] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:11:42.303522 18524 raft_consensus.cc:2749] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:42.304873 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:42.306095 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:42.306838 13762 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 13.
I20260709 12:11:42.302207 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:42.308068 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:42.310207 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:42.314730 13832 raft_consensus.cc:2410] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:11:42.284174 18551 consensus_queue.cc:1243] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer b98d2519bb504dc6905ed2ede4571835 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 12:11:42.314522 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 140198us
W20260709 12:11:42.318269 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 103417us
W20260709 12:11:42.320554 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:42.321710 13828 raft_consensus.cc:1240] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:42.318185 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:42.323499 13836 raft_consensus.cc:1275] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 12:11:42.325178 13727 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:42.311434 18013 raft_consensus.cc:697] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:11:42.535620 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 209974us
W20260709 12:11:42.370497 18614 log.cc:927] Time spent T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 12:11:42.569696 18013 consensus_queue.cc:237] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:42.536245 18569 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:42.536484 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 267857us
I20260709 12:11:42.571126 18569 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:42.362818 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:42.324016 13836 pending_rounds.cc:85] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 5
I20260709 12:11:42.537890 13756 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 11.
I20260709 12:11:42.572389 13836 pending_rounds.cc:107] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 12:11:42.572770 13836 raft_consensus.cc:2889] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:42.573549 18569 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:42.574028 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:42.575224 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:42.539269 13800 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:42.576685 13834 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:42.576997 18569 raft_consensus.cc:2749] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:42.545249 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:42.354210 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:42.579763 13833 raft_consensus.cc:2410] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 15 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:11:42.546274 14413 raft_consensus.cc:1275] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:42.546737 18507 consensus_queue.cc:1059] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:42.582602 18507 raft_consensus.cc:3055] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:42.582962 18507 raft_consensus.cc:740] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:42.583766 13833 raft_consensus.cc:1240] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:42.584005 18507 consensus_queue.cc:260] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:42.585602 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 46472.1us
I20260709 12:11:42.548768 18543 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.586601 18543 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:42.318359 18284 raft_consensus.cc:2804] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:42.550161 18512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2f365337b324999a073edacbe6c6e09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:42.550333 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:42.383241 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:42.551208 18475 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.366007 13801 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:42.271725 18567 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:42.553025 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:42.554541 18288 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:42.331099 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:42.558511 18311 consensus_queue.cc:1048] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:42.560217 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:42.535665 14410 raft_consensus.cc:1275] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:42.612215 13837 raft_consensus.cc:2393] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 14: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
W20260709 12:11:42.564402 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 239336us
I20260709 12:11:42.565145 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:42.609639 13828 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 11.
I20260709 12:11:42.565243 18382 consensus_queue.cc:260] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:42.566591 18623 raft_consensus.cc:2804] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:11:42.403021 18617 log.cc:927] Time spent T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 12:11:42.388656 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:42.625192 13651 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:42.576081 18460 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.329917 18534 consensus_queue.cc:1059] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 12:11:42.547505 18619 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
W20260709 12:11:42.606364 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:42.616981 18569 raft_consensus.cc:2804] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:42.606788 13800 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:11:42.609189 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 300041us
I20260709 12:11:42.601526 13726 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:42.621410 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:42.616449 18582 consensus_queue.cc:1059] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 12:11:42.592777 18507 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:42.640403 13757 raft_consensus.cc:1275] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:11:42.604489 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:42.592988 18543 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:42.636963 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:42.637667 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:42.646612 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:42.634436 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:42.626662 18284 raft_consensus.cc:697] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 11 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:42.636884 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:42.648177 13758 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 12.
I20260709 12:11:42.617882 18120 consensus_queue.cc:1048] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:11:42.647418 13757 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 14.
I20260709 12:11:42.651799 14410 raft_consensus.cc:1275] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:42.650102 13759 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 12.
I20260709 12:11:42.635299 18569 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:42.657678 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:42.617624 18475 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:42.632400 18460 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:42.660056 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:11:42.660063 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 58656.9us
I20260709 12:11:42.663302 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:42.667164 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:42.649693 18201 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.672464 13763 raft_consensus.cc:1240] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:42.653988 18570 raft_consensus.cc:2804] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:42.670645 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:42.670902 18544 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:42.670295 18013 raft_consensus.cc:2804] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:42.658324 18564 raft_consensus.cc:2749] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:42.670531 13757 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 11.
I20260709 12:11:42.657505 18569 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:42.675422 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:42.673344 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:42.665063 18382 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:42.665504 18458 consensus_queue.cc:1048] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 12:11:42.686816 18623 raft_consensus.cc:697] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:42.687983 18623 consensus_queue.cc:237] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:42.666666 18556 raft_consensus.cc:3055] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:42.690514 18556 raft_consensus.cc:740] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:11:42.683573 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 87941.4us
I20260709 12:11:42.684482 18266 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.666504 18549 consensus_queue.cc:1048] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 12:11:42.691565 18556 consensus_queue.cc:260] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:42.677115 18570 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:42.703292 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:42.640473 18619 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:42.680351 18013 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:42.707892 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:42.710657 13758 raft_consensus.cc:1240] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:42.710834 13800 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:11:42.704916 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 61478.9us
W20260709 12:11:42.715727 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 51299.8us
W20260709 12:11:42.718408 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:42.721021 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:42.735767 13759 raft_consensus.cc:1275] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:42.706414 18570 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:11:42.747246 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:42.748178 13757 raft_consensus.cc:1275] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:42.676920 18201 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:42.710487 18013 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:42.755735 13800 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:42.712180 18556 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:42.759102 13834 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 11.
I20260709 12:11:42.712493 18544 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:42.762342 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:42.763552 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 43486.6us
I20260709 12:11:42.770289 13800 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:42.776041 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:42.702718 18266 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:11:42.784974 13836 raft_consensus.cc:1240] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:42.770582 18355 raft_consensus.cc:2804] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:42.787092 13832 raft_consensus.cc:1275] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:42.787581 14379 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:42.719833 18284 consensus_queue.cc:237] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:42.800474 13837 raft_consensus.cc:1275] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 12:11:42.797295 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 51423.7us
W20260709 12:11:42.801813 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:42.802228 18550 raft_consensus.cc:2804] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:42.802964 18550 raft_consensus.cc:697] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 14 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:42.804003 18550 consensus_queue.cc:237] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:42.762977 18120 consensus_queue.cc:1048] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 12:11:42.824194 14379 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:42.798749 18355 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:42.825920 18355 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:42.825495 18638 consensus_queue.cc:1059] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 12:11:42.797389 18633 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.847059 18266 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:42.848522 18201 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:42.856418 18567 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:42.793709 18498 consensus_queue.cc:1048] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:11:42.857980 14379 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:42.854342 18618 raft_consensus.cc:2749] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:42.836051 18549 consensus_queue.cc:1048] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 12:11:42.865396 18475 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:42.898901 18311 raft_consensus.cc:2804] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:11:42.910854 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 89330.5us
I20260709 12:11:42.837852 13757 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "232d133451004a83941860574adec712"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "b98d2519bb504dc6905ed2ede4571835"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:11:42.914057 13757 raft_consensus.cc:606] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Received request to transfer leadership to TS b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:42.914465 13757 raft_consensus.cc:614] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:42.915107 13581 catalog_manager.cc:5697] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 9 to 11, leader changed from ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 11 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:11:42.891064 18564 raft_consensus.cc:2804] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:11:42.954941 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 98503us
I20260709 12:11:42.908629 18311 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:42.983095 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 125402us
I20260709 12:11:42.909662 18634 raft_consensus.cc:2749] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:42.986800 14379 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:42.863967 18633 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:43.001839 18650 consensus_queue.cc:1048] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:43.004298 18650 consensus_queue.cc:1048] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:11:43.036759 18637 log.cc:927] Time spent T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
W20260709 12:11:43.041024 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 54363.9us
I20260709 12:11:43.042141 14379 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:42.997493 18311 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:43.060323 18543 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:43.063745 18381 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:43.064602 18619 leader_election.cc:290] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:43.062611 18639 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:43.114499 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:43.064956 18544 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:43.081951 18543 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:43.108677 18460 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:43.096666 13757 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:39554
W20260709 12:11:43.118336 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:43.062125 18284 consensus_queue.cc:1059] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 12:11:43.123759 13757 raft_consensus.cc:606] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 LEADER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
W20260709 12:11:43.133139 18642 log.cc:927] Time spent T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
W20260709 12:11:43.139252 18643 log.cc:927] Time spent T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 12:11:43.141270 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 215338us
I20260709 12:11:43.101809 18013 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:43.152084 18013 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:43.123725 18543 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:43.154688 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 169270us
W20260709 12:11:43.160988 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 331185us
I20260709 12:11:43.163614 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:43.167313 13762 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca94d8f3109143599733e3a684149726"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "b98d2519bb504dc6905ed2ede4571835"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:11:43.168118 13762 raft_consensus.cc:606] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 LEADER]: Received request to transfer leadership to TS b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:43.143332 18633 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:43.118757 18639 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:43.174218 18639 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:43.174033 18635 consensus_queue.cc:1059] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:43.175890 18652 raft_consensus.cc:3055] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:43.176343 18652 raft_consensus.cc:740] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:43.115092 18381 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:43.177285 18652 consensus_queue.cc:260] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:43.178771 18381 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:43.178838 18652 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:43.180423 18311 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:43.180851 18570 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:43.182096 13762 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "b98d2519bb504dc6905ed2ede4571835"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:11:43.182734 13762 raft_consensus.cc:606] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Received request to transfer leadership to TS b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:43.183104 13762 raft_consensus.cc:614] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:43.183446 18570 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:43.194630 18355 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:43.196332 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:43.197140 13828 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 12.
I20260709 12:11:43.197279 18355 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:43.198031 13651 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:43.198243 13834 raft_consensus.cc:1240] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:43.198328 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:43.199602 13831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 827) took 1146 ms. Trace:
W20260709 12:11:43.171748 18507 consensus_meta.cc:287] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.525s	user 0.007s	sys 0.004s
W20260709 12:11:43.203068 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:43.205475 18646 log.cc:927] Time spent T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.120s	user 0.003s	sys 0.000s
I20260709 12:11:43.223491 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:43.224376 13757 raft_consensus.cc:2393] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 11: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:43.228372 18529 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.228837 13762 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e5274c30729744338992e7c7710e5266"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "b98d2519bb504dc6905ed2ede4571835"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:11:43.229540 17900 consensus_queue.cc:1048] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:43.230285 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:43.230948 18311 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:43.231129 18635 raft_consensus.cc:2749] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:43.230950 13757 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 11.
I20260709 12:11:43.231884 18551 consensus_queue.cc:1048] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:43.234131 18549 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:43.234826 18549 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:43.229580 18529 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:43.236654 18475 raft_consensus.cc:3055] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:43.237080 18475 raft_consensus.cc:740] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:43.237309 18549 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:43.238296 18544 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:43.238060 18475 consensus_queue.cc:260] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:43.238857 18544 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:43.200712 13837 raft_consensus.cc:1275] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:43.240115 13836 raft_consensus.cc:3055] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:43.240522 13836 raft_consensus.cc:740] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:43.241073 18544 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:43.241381 13836 consensus_queue.cc:260] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:43.242507 13836 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:43.242729 13800 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:43.243598 18544 raft_consensus.cc:2749] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:11:43.208547 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:43.210990 13835 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 12.
I20260709 12:11:43.206292 18458 raft_consensus.cc:3055] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:43.246637 13800 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:43.246735 18458 raft_consensus.cc:740] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:43.211320 18288 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.205003 18569 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:43.220722 13651 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:43.239229 18475 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:43.159940 13755 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 14.
I20260709 12:11:43.248239 13754 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 9.
I20260709 12:11:43.210417 13831 rpcz_store.cc:276] 0709 12:11:42.053176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.071207 (+ 18031us) service_pool.cc:224] Handling call
0709 12:11:42.077913 (+  6706us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:42.166854 (+ 88941us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:42.166905 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:42.241965 (+ 75060us) log.cc:844] Serialized 52 byte log entry
0709 12:11:42.624006 (+382041us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:42.636903 (+ 12897us) log.cc:844] Serialized 14 byte log entry
0709 12:11:42.637152 (+   249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:42.637221 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:43.188665 (+551444us) spinlock_profiling.cc:243] Waited 6.66 ms on lock 0x7b2400261ff8. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924d269c4 00007fa924d24acb 00007fa924edfdc9 00007fa924edfa55 00007fa924edefb0 00007fa927b55488 00007fa927b55be8 00007fa927b2d398 00007fa927b2876a 00007fa927b27bb6
0709 12:11:43.199203 (+ 10538us) raft_consensus.cc:1685] finished
0709 12:11:43.199312 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:43.199512 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":89769,"prepare.queue_time_us":8235,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":1471,"raft.queue_time_us":88958,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":12972,"spinlock_wait_cycles":15322496,"thread_start_us":330088,"threads_started":1,"wal-append.queue_time_us":437719}
W20260709 12:11:43.159435 13652 leader_election.cc:336] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 1.544s (SENT)
I20260709 12:11:43.229532 13762 raft_consensus.cc:606] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Received request to transfer leadership to TS b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:43.250306 13762 raft_consensus.cc:614] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:43.250134 13652 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:43.237525 18529 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:43.274602 13835 raft_consensus.cc:1275] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:43.273128 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:43.277112 13727 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:43.278760 13830 raft_consensus.cc:1240] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:43.279191 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:43.282408 13831 raft_consensus.cc:1275] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:11:43.278545 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:11:43.284710 13800 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:43.283628 13828 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 11.
I20260709 12:11:43.285607 13651 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:43.294137 13836 raft_consensus.cc:1275] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:11:43.294971 13727 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:43.295440 13836 pending_rounds.cc:85] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 5
I20260709 12:11:43.295768 13836 pending_rounds.cc:107] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:11:43.296058 13836 raft_consensus.cc:2889] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:43.269897 18549 raft_consensus.cc:2764] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:11:43.247673 18288 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:43.270951 18284 raft_consensus.cc:2804] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:43.301617 13651 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:11:43.306859 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 164556us
I20260709 12:11:43.306367 13651 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:11:43.308805 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:43.300873 18623 raft_consensus.cc:2804] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:43.342231 13800 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:43.343673 18625 raft_consensus.cc:2804] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:43.344200 18626 consensus_queue.cc:1048] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:11:43.344635 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:43.345674 13688 raft_consensus.cc:2410] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:11:43.311678 13829 raft_consensus.cc:1275] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:11:43.347842 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:43.304872 18570 raft_consensus.cc:2749] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:43.305989 18284 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:43.350301 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:43.306483 18498 raft_consensus.cc:2804] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:43.340588 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:43.347185 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:43.368687 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:43.317808 18529 raft_consensus.cc:2804] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:43.302656 18382 consensus_queue.cc:1048] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:11:43.351053 13681 raft_consensus.cc:1240] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:43.347072 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:43.305059 18635 consensus_queue.cc:1048] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:11:43.376607 13581 catalog_manager.cc:5697] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 9 to 14, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 14 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:43.382643 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:43.307607 18582 raft_consensus.cc:2804] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:43.352736 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:43.356047 18656 raft_consensus.cc:2804] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:43.356551 18666 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.358273 18355 raft_consensus.cc:2749] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:43.362100 18288 leader_election.cc:290] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:43.341888 18623 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:43.335129 18567 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:43.373176 18529 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:43.423691 18529 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:43.378281 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:43.388125 13762 raft_consensus.cc:2393] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 16: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:43.394385 18677 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.430111 18677 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:43.394610 13652 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:43.352553 18665 raft_consensus.cc:2749] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:43.366618 18284 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:43.405440 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 316589us
I20260709 12:11:43.386620 18582 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:43.344218 18625 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:43.409664 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 91165us
I20260709 12:11:43.417200 18569 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:43.418491 18567 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:43.419137 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:43.423100 18656 raft_consensus.cc:697] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 11 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:43.432574 18512 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:41700 (request call id 660) took 4357 ms. Trace:
I20260709 12:11:43.310350 18458 consensus_queue.cc:260] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:43.390372 18570 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:43.450449 18665 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:43.374553 18544 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.456499 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:43.465745 18625 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:43.454123 18382 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.464774 14410 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:43.409153 18623 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:43.455250 18669 log.cc:927] Time spent T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:11:43.468439 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:43.473289 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:43.474870 13762 raft_consensus.cc:1240] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:11:43.490051 13758 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:43.475150 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:43.457957 18582 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:43.474118 18564 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:43.404917 18666 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:43.480177 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:43.480788 18458 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:43.482144 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:43.493882 13682 raft_consensus.cc:2393] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 16: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:43.462549 13800 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:43.486299 13760 raft_consensus.cc:2393] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 11: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:43.483388 18570 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:43.487347 13687 pending_rounds.cc:85] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 6
I20260709 12:11:43.495146 13687 pending_rounds.cc:107] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 12:11:43.493592 13686 raft_consensus.cc:2468] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 12.
I20260709 12:11:43.487347 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:43.495428 13687 raft_consensus.cc:2889] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:43.501266 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:43.510193 13835 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 13.
I20260709 12:11:43.511392 13686 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 12.
W20260709 12:11:43.514271 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 51842.8us
I20260709 12:11:43.515203 13800 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:43.516212 18676 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:11:43.516733 18676 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:43.517213 18676 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:11:43.492900 18382 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:43.520519 18382 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:43.493497 18564 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:43.522862 18656 consensus_queue.cc:237] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:43.496455 18569 raft_consensus.cc:2749] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:43.489527 18543 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:43.510736 13684 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 11.
I20260709 12:11:43.527022 13759 raft_consensus.cc:2468] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 12.
I20260709 12:11:43.532572 13683 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 11.
I20260709 12:11:43.517179 13800 leader_election.cc:304] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:43.538789 14416 raft_consensus.cc:1240] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 14. Current term is 15. Ops: [12.11-14.12]
W20260709 12:11:43.539322 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 143620us
I20260709 12:11:43.528271 13726 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:43.540591 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:43.543105 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:43.546279 13682 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:11:43.546625 13686 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 12.
I20260709 12:11:43.488682 18544 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:43.551476 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:43.552600 13652 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:43.545338 18524 raft_consensus.cc:2749] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:43.558856 13800 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:43.556561 18569 raft_consensus.cc:2804] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:43.557878 18665 raft_consensus.cc:2749] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:43.550048 18677 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:43.575104 18678 log.cc:927] Time spent T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:11:43.570031 17900 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.575873 17900 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:43.578234 17900 leader_election.cc:290] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:43.571185 18550 raft_consensus.cc:2749] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:11:43.572613 13652 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:43.567631 18569 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:43.579385 18569 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:43.579793 13652 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:43.580782 18680 raft_consensus.cc:2749] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:43.581473 18680 raft_consensus.cc:2749] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:43.581482 13652 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:43.582430 18567 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:43.582882 13652 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:43.574155 18665 consensus_queue.cc:1048] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:43.584187 13652 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:43.584406 18665 raft_consensus.cc:2804] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:43.573839 18623 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:43.584853 18665 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:43.585247 18665 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:43.468912 18512 rpcz_store.cc:276] 0709 12:11:39.085909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:39.092645 (+  6736us) service_pool.cc:224] Handling call
0709 12:11:39.747204 (+654559us) ts_tablet_manager.cc:934] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f: Initiating tablet copy from peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
0709 12:11:42.548054 (+2800850us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:11:43.153252 (+605198us) tablet_metadata.cc:665] Metadata flushed
0709 12:11:43.153400 (+   148us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:11:43.431572 (+278172us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:11:43.431915 (+   343us) tablet_replica.cc:206] Creating consensus instance
0709 12:11:43.432294 (+   379us) ts_tablet_manager.cc:989] Replica registered.
0709 12:11:43.432440 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":56871,"tablet-copy.queue_time_us":556972,"thread_start_us":706312,"threads_started":2}
I20260709 12:11:43.575002 18544 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:43.586135 18512 tablet_copy_client.cc:806] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 0 data blocks...
I20260709 12:11:43.586860 18512 tablet_copy_client.cc:670] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:11:43.589036 18623 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:43.583014 18567 raft_consensus.cc:2749] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:43.553057 18676 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:43.590550 18679 raft_consensus.cc:2749] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:43.591961 18676 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:43.592128 13652 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:43.564805 18564 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:43.593015 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:43.568192 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:43.594672 13800 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:43.597558 13758 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 13.
I20260709 12:11:43.600870 13652 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:43.601543 14410 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 13.
I20260709 12:11:43.606632 13801 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:43.567575 18666 leader_election.cc:290] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:43.617970 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:43.622197 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:43.593755 18679 raft_consensus.cc:2749] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:43.624629 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:43.621052 18475 raft_consensus.cc:2749] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:43.620687 18544 raft_consensus.cc:2804] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:43.639287 18544 raft_consensus.cc:697] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 13 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:43.639635 18529 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:43.640355 18544 consensus_queue.cc:237] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:43.627617 13682 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 13.
I20260709 12:11:43.646934 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:43.647987 14414 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 10.
I20260709 12:11:43.648226 13686 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:43.645656 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 51046.9us
I20260709 12:11:43.652992 13800 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:11:43.657562 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:43.615262 18676 raft_consensus.cc:2764] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:11:43.657060 14410 raft_consensus.cc:1240] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:11:43.626600 18680 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.637295 18543 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:43.667510 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:43.625595 18524 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:43.669518 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:43.644354 18475 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:43.672784 13681 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 14.
I20260709 12:11:43.674340 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:43.675638 13800 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:43.677318 14410 raft_consensus.cc:1240] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 12. Current term is 13. Ops: [11.11-12.12]
I20260709 12:11:43.677397 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:43.678083 13834 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:43.678237 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:43.661033 18550 consensus_queue.cc:1059] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 12:11:43.682235 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:43.683182 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:43.683434 13683 raft_consensus.cc:1275] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:43.689195 13682 raft_consensus.cc:2468] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 12.
I20260709 12:11:43.684083 18641 raft_consensus.cc:3055] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:43.684589 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:43.688287 14407 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 10.
I20260709 12:11:43.685355 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:43.685210 18625 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:11:43.685913 18475 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:43.672607 18680 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:43.688228 14412 raft_consensus.cc:2468] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 12.
I20260709 12:11:43.709818 13652 leader_election.cc:304] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:43.721659 13683 raft_consensus.cc:1275] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:43.717258 13727 leader_election.cc:304] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:43.696588 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:43.708653 13800 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:43.711273 13679 raft_consensus.cc:1275] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:11:43.728906 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:43.731319 13679 raft_consensus.cc:1275] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 12:11:43.749804 13679 pending_rounds.cc:85] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 7
I20260709 12:11:43.714607 13687 raft_consensus.cc:1275] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:43.751010 13679 pending_rounds.cc:107] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 12:11:43.751418 13679 raft_consensus.cc:2889] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:43.771601 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 63024us
I20260709 12:11:43.772469 13800 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:11:43.715498 18645 log.cc:927] Time spent T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.782s	user 0.016s	sys 0.000s
W20260709 12:11:43.774199 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:43.691332 18529 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:43.741541 13727 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:43.745107 13754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48120 (request call id 1936) took 1047 ms. Trace:
I20260709 12:11:43.664721 18582 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:43.733724 13686 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 13.
W20260709 12:11:43.750231 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:43.691519 18549 raft_consensus.cc:2749] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:43.691272 18641 raft_consensus.cc:740] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:43.675674 18524 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:43.788945 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 67693.8us
W20260709 12:11:43.789054 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 61892.7us
I20260709 12:11:43.707818 18677 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:43.823752 13828 raft_consensus.cc:1240] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 18. Current term is 19. Ops: []
I20260709 12:11:43.745256 18567 raft_consensus.cc:2804] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:11:43.792150 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 50720.8us
I20260709 12:11:43.749902 18266 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.825310 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:43.786338 13834 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 13.
I20260709 12:11:43.746152 17900 raft_consensus.cc:2804] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:43.716267 18013 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:43.707317 18564 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:43.857446 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:43.881991 13763 raft_consensus.cc:2393] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 12: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:43.714644 18498 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:43.717381 18680 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:43.716617 18570 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:43.911052 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:43.911827 13759 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:43.786911 13754 rpcz_store.cc:276] 0709 12:11:42.697541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.697690 (+   149us) service_pool.cc:224] Handling call
0709 12:11:43.114268 (+416578us) spinlock_profiling.cc:243] Waited 1.83 ms on lock 0x7b58001e3f98. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924e68b71 00007fa924e68a22 00007fa92dd818d9 00007fa92cedbee0 00007fa92cfa50ab 00007fa92cfa5131 00007fa92cf530a0 00007fa92cf52984 00007fa9264cd6d4 00007fa9264cd662
0709 12:11:43.744866 (+630598us) spinlock_profiling.cc:243] Waited 74.3 ms on lock 0x7b54003935d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:43.745020 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":175143040}
I20260709 12:11:43.848176 18524 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:43.829639 13755 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48120 (request call id 1925) took 1149 ms (client timeout 1527 ms). Trace:
I20260709 12:11:43.829470 13760 raft_consensus.cc:1240] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 12:11:43.802585 13726 leader_election.cc:304] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:43.849925 18567 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:43.923295 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:43.924983 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:43.925719 13763 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:43.914436 13755 rpcz_store.cc:269] 0709 12:11:42.648317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.655174 (+  6857us) service_pool.cc:224] Handling call
0709 12:11:43.797629 (+1142455us) spinlock_profiling.cc:243] Waited 439 ms on lock 0x7b54001d2c54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:43.797750 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1008608640}
W20260709 12:11:43.929512 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 79761.9us
I20260709 12:11:43.931231 14379 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:43.850337 18266 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:43.777825 18626 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.831147 18356 raft_consensus.cc:2804] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:43.852277 18120 consensus_queue.cc:1048] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:43.856295 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:43.710804 18569 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:43.870573 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:43.871520 18677 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:43.751390 18639 consensus_queue.cc:1048] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.122s
I20260709 12:11:43.714871 18284 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:43.872879 18641 consensus_queue.cc:260] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:43.876538 18625 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:43.746636 18623 consensus_queue.cc:1048] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.082s
I20260709 12:11:43.775110 18355 raft_consensus.cc:2749] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:43.864954 18664 raft_consensus.cc:2749] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:43.694573 18382 consensus_queue.cc:1059] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.083s
I20260709 12:11:43.916664 13762 raft_consensus.cc:1275] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:11:43.921692 18582 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:43.939276 13759 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 15.
I20260709 12:11:43.855854 17900 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:43.943953 14379 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:43.912288 18498 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:43.933085 18567 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:43.943676 18680 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.944650 18356 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
W20260709 12:11:43.990552 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:43.981451 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 209046us
I20260709 12:11:43.947737 18626 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:43.912070 18013 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:43.980197 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 128313us
I20260709 12:11:43.993129 13685 raft_consensus.cc:1240] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:11:43.915427 18665 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:44.004285 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:44.010035 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 66286.8us
I20260709 12:11:43.987802 18251 raft_consensus.cc:2804] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:44.000722 18641 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:44.013087 17900 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:44.033241 14379 leader_election.cc:304] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:44.030975 18266 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:44.027107 18697 raft_consensus.cc:2749] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:44.026918 18649 raft_consensus.cc:2804] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:44.015618 18479 raft_consensus.cc:2804] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:44.019539 18356 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:44.047498 13682 raft_consensus.cc:1240] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:44.028347 18013 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:44.030434 18690 log.cc:927] Time spent T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:11:44.045466 13800 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:44.024121 18251 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:44.054167 18626 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:44.054769 18512 tablet_copy_client.cc:538] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:11:44.023907 18582 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.058455 18582 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:44.061347 18479 raft_consensus.cc:697] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 13 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:44.061867 18382 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.062446 18479 consensus_queue.cc:237] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:44.048687 18288 raft_consensus.cc:993] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7: : Instructing follower b98d2519bb504dc6905ed2ede4571835 to start an election
I20260709 12:11:44.021083 18680 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:44.075165 13800 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:44.033814 18564 consensus_queue.cc:1048] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:11:44.089558 18612 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.072456 13727 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:44.051940 18543 raft_consensus.cc:2804] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:44.090138 18681 consensus_queue.cc:1059] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:11:44.092875 18543 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:44.093473 18543 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:44.094095 18707 raft_consensus.cc:2804] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:44.094339 18569 leader_election.cc:290] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:44.094727 18707 raft_consensus.cc:697] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:44.095719 18707 consensus_queue.cc:237] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:44.096884 18458 consensus_meta.cc:287] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.600s	user 0.006s	sys 0.006s
I20260709 12:11:44.048271 18649 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:44.097999 18649 raft_consensus.cc:3060] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:44.090258 18612 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:44.062448 18382 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:44.078948 18694 raft_consensus.cc:2804] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:44.079280 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:44.079460 18284 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:44.079628 18623 raft_consensus.cc:1081] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 LEADER]: Signalling peer b98d2519bb504dc6905ed2ede4571835 to start an election
I20260709 12:11:44.114629 14416 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 12.
I20260709 12:11:44.100111 18612 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:44.121882 18694 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:44.066138 18251 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:44.082387 18567 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:44.051223 18556 consensus_queue.cc:1059] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 12:11:44.071455 18475 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:44.122573 13763 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 14.
I20260709 12:11:44.125160 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:44.133360 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:44.133890 13832 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:44.125948 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 57124.9us
I20260709 12:11:44.126791 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:44.075866 18677 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:44.035883 18664 consensus_queue.cc:1048] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 12:11:44.139381 13652 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:44.136576 13835 raft_consensus.cc:2393] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 17: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:44.134065 14407 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 12.
I20260709 12:11:44.137825 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:44.141032 14416 raft_consensus.cc:2393] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 9: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:11:44.138374 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:11:44.135464 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 332941us
I20260709 12:11:44.129086 18569 raft_consensus.cc:2804] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:44.078461 18524 consensus_queue.cc:1059] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 12:11:44.130820 18694 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:44.154812 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:44.157151 13828 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 13.
I20260709 12:11:44.159049 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:44.141757 18556 consensus_queue.cc:1243] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer 96701a74fdee481fb5f54aac841e17dd log is divergent from this leader: its last log entry 14.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:11:44.146543 18013 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.164357 18709 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:44.164247 18013 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:44.165025 18709 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:44.166774 18013 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:44.167626 18709 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:44.167886 18713 consensus_queue.cc:1048] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:44.183146 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:44.170245 13726 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:44.186159 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:44.149474 18677 raft_consensus.cc:2804] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:44.187620 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:44.184826 18524 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:44.176976 17900 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:44.192895 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:44.196862 13832 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 13.
I20260709 12:11:44.179634 13727 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:44.199709 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:44.149200 18529 consensus_queue.cc:1059] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 12:11:44.163506 18569 raft_consensus.cc:697] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 9 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:44.179021 18382 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:44.194891 18677 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:44.210865 18677 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:44.210929 18680 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:44.212553 18251 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:44.213341 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:44.207213 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:44.214232 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:44.214885 18251 leader_election.cc:290] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:44.215286 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:44.207229 18567 leader_election.cc:290] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:44.216347 13836 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 10.
I20260709 12:11:44.205432 18524 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:44.219599 13727 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:44.220834 13727 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:44.221405 18524 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:44.222728 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:44.223140 18623 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:44.223392 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:44.224370 13727 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:11:44.227803 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:44.231285 13757 raft_consensus.cc:2393] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 12: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:44.223594 18701 raft_consensus.cc:2749] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:44.239682 18251 consensus_queue.cc:1048] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:11:44.245940 17977 raft_consensus.cc:2804] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:44.246601 17977 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:44.239902 18677 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:44.247011 17977 raft_consensus.cc:3060] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:44.248942 18677 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:44.251103 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
W20260709 12:11:44.254092 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:44.255347 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:44.257014 18498 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:44.260710 18569 consensus_queue.cc:237] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:44.226524 18556 raft_consensus.cc:2804] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:44.233407 18283 raft_consensus.cc:3055] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:44.268904 18556 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:44.269632 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 45375.1us
I20260709 12:11:44.270121 18701 raft_consensus.cc:2804] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:44.270761 17900 leader_election.cc:290] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:44.275797 18677 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.304388 18677 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:44.301574 18701 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:44.306275 18701 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:44.307701 18677 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:44.285895 14410 raft_consensus.cc:1240] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:44.287127 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:44.291298 18498 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:44.296919 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:44.300194 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:44.299376 13727 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:44.316319 13727 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:44.317214 13727 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:44.310868 13829 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 12.
I20260709 12:11:44.313511 14413 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 12.
I20260709 12:11:44.321487 13652 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:44.322403 18677 raft_consensus.cc:2804] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:44.298203 18283 raft_consensus.cc:740] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:44.300143 18556 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:44.323626 18283 consensus_queue.cc:260] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:44.326130 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:44.326790 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:44.328321 13837 raft_consensus.cc:1240] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 16. Current term is 17. Ops: []
I20260709 12:11:44.328981 18543 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:44.330286 14414 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:44.331007 17900 raft_consensus.cc:2749] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:11:44.331449 18649 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:44.334019 18649 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:44.334061 13651 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:44.335093 13685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1791) took 1002 ms. Trace:
I20260709 12:11:44.335454 13685 rpcz_store.cc:276] 0709 12:11:43.333047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:43.333310 (+   263us) service_pool.cc:224] Handling call
0709 12:11:43.335899 (+  2589us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:44.021316 (+685417us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:44.334851 (+313535us) spinlock_profiling.cc:243] Waited 657 ms on lock 0x7b5400199e54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:44.335036 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1510877568}
I20260709 12:11:44.335831 13651 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:44.336678 18284 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:44.337698 18475 raft_consensus.cc:2804] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:44.338232 18475 raft_consensus.cc:697] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 14 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:44.322949 18677 raft_consensus.cc:697] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 12 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:44.339351 14414 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 12.
I20260709 12:11:44.339236 18475 consensus_queue.cc:237] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:44.341629 14379 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:44.337330 18284 consensus_queue.cc:1048] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:44.351294 18633 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:44.351874 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:44.342764 18694 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:44.358121 13829 raft_consensus.cc:1240] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 12:11:44.359561 18694 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:44.363648 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:44.364521 13680 raft_consensus.cc:3060] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:44.366215 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:44.372865 13652 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:44.368728 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:44.369172 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 52002.9us
W20260709 12:11:44.377441 13800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:44.383637 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:44.347594 18381 raft_consensus.cc:2804] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:44.389698 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:44.347138 18649 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:44.391062 13686 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 14.
I20260709 12:11:44.393836 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:44.391069 13800 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:44.398615 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:44.402065 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:44.402349 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:44.403226 13683 raft_consensus.cc:2393] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 14: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:44.403677 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:44.404094 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:44.402057 13687 raft_consensus.cc:2410] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:11:44.406363 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:44.407096 13687 raft_consensus.cc:2368] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for earlier term 11. Current term is 12.
I20260709 12:11:44.407943 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:44.408674 18612 consensus_queue.cc:1059] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:11:44.409000 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:44.390219 18638 raft_consensus.cc:2749] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:44.409942 18673 raft_consensus.cc:3055] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:11:44.410176 18543 leader_election.cc:290] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:44.410430 18673 raft_consensus.cc:740] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:44.411721 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:44.411479 18673 consensus_queue.cc:260] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:44.412889 18673 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:11:44.383699 17900 raft_consensus.cc:2804] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:44.414667 17900 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:44.415074 17900 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:44.415984 13652 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:44.416688 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:44.419652 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:44.419973 18283 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:44.420845 18641 raft_consensus.cc:2749] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:44.423012 13681 raft_consensus.cc:1275] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 12:11:44.423385 13681 pending_rounds.cc:85] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 9
I20260709 12:11:44.423597 13681 pending_rounds.cc:107] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 12:11:44.423830 13681 raft_consensus.cc:2889] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:44.424800 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:44.425617 13760 raft_consensus.cc:2393] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 12: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:44.409590 13687 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 13.
I20260709 12:11:44.355782 18709 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:44.360965 18713 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.348039 18356 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:44.428809 18699 raft_consensus.cc:2749] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:44.435357 13755 raft_consensus.cc:1240] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:44.352447 18633 raft_consensus.cc:697] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 15 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:44.399410 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:44.405412 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:44.443559 13683 raft_consensus.cc:2393] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 11: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:44.437734 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:44.412914 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:44.429843 13800 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:44.444671 13761 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:44.427845 13652 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:44.428910 14379 leader_election.cc:400] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 election: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for earlier term 11. Current term is 12.
I20260709 12:11:44.445199 14379 leader_election.cc:403] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:11:44.445956 13652 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:44.437734 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:44.447395 13754 raft_consensus.cc:2393] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 12: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:44.437857 18564 consensus_queue.cc:1059] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:44.430836 18713 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:44.439713 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:44.339354 18677 consensus_queue.cc:237] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:44.441416 18512 tablet_bootstrap.cc:492] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap starting.
I20260709 12:11:44.447667 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:44.453277 13800 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:44.459589 13652 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:11:44.464576 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 57551.3us
I20260709 12:11:44.465413 14380 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:44.469686 13758 raft_consensus.cc:1275] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:11:44.471004 13757 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 11.
I20260709 12:11:44.432539 18356 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:44.473579 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:44.474429 13652 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:44.449165 18638 raft_consensus.cc:2749] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:44.477458 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:44.449267 18381 raft_consensus.cc:697] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:44.435616 18664 consensus_queue.cc:1048] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 12:11:44.456969 18641 raft_consensus.cc:2749] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:44.473269 18564 raft_consensus.cc:2804] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:44.457548 18699 raft_consensus.cc:2749] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:44.482630 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:44.455698 18382 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:44.473117 18650 consensus_queue.cc:1059] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:11:44.501757 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:44.436592 18649 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:44.455667 18681 raft_consensus.cc:2749] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for earlier term 11. Current term is 12.
I20260709 12:11:44.466125 18567 raft_consensus.cc:2749] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:44.509462 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:44.522585 13652 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:44.526408 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:44.497460 18725 raft_consensus.cc:2804] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:44.524065 18458 consensus_queue.cc:1059] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 12:11:44.500917 18524 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.572779 18524 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:44.442104 18709 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:44.541446 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:44.542546 18649 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199)
W20260709 12:11:44.578707 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 56236.5us
I20260709 12:11:44.579648 13652 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:44.519011 18564 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:44.581370 18564 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:44.551128 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:44.583040 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:44.583263 13759 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 11.
I20260709 12:11:44.583814 13763 raft_consensus.cc:2368] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 14. Current term is 15.
I20260709 12:11:44.556430 18650 raft_consensus.cc:3055] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:44.504240 18680 raft_consensus.cc:2749] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:44.510303 18664 consensus_queue.cc:1243] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer b98d2519bb504dc6905ed2ede4571835 log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:11:44.566704 18381 consensus_queue.cc:237] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:11:44.544255 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:44.585625 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:44.588016 13681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2671) took 1078 ms. Trace:
I20260709 12:11:44.592423 14414 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 12.
I20260709 12:11:44.594904 13727 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:44.570580 18725 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:44.592332 13681 rpcz_store.cc:276] 0709 12:11:43.510070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:43.748998 (+238928us) service_pool.cc:224] Handling call
0709 12:11:43.789226 (+ 40228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:44.424280 (+635054us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:44.587768 (+163488us) spinlock_profiling.cc:243] Waited 633 ms on lock 0x7b54002c2c54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:44.587957 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1456685440}
I20260709 12:11:44.596972 13652 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:44.601567 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:44.581641 18651 raft_consensus.cc:3055] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:44.605924 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:11:44.603399 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 379586us
I20260709 12:11:44.606838 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:44.602191 13652 leader_election.cc:304] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:44.608819 13684 raft_consensus.cc:1240] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 14 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 12:11:44.581370 18524 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:44.588052 18650 raft_consensus.cc:740] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:44.614073 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:44.614162 13652 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:44.615375 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:44.615051 18650 consensus_queue.cc:260] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:44.615964 13652 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:44.616472 18650 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:44.617089 18638 raft_consensus.cc:2749] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:44.617420 18623 consensus_queue.cc:1048] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:44.617851 18638 raft_consensus.cc:2749] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:44.619022 13652 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:44.620108 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:44.606030 18651 raft_consensus.cc:740] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:44.612897 14411 raft_consensus.cc:1240] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 12. Current term is 13. Ops: [11.11-12.12]
I20260709 12:11:44.597344 18641 raft_consensus.cc:2749] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:44.622741 18641 raft_consensus.cc:2749] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:44.604089 18639 raft_consensus.cc:2804] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:44.613350 18709 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:44.613896 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:44.616514 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:44.634182 13837 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 11.
I20260709 12:11:44.576269 18382 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:44.636405 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:44.600842 18570 raft_consensus.cc:2749] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:44.606045 18680 raft_consensus.cc:2749] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:44.624184 18284 raft_consensus.cc:2804] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:44.656348 13686 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:44.627954 18639 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:44.603509 18725 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:44.659349 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:44.642725 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:44.666343 13652 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:44.676492 13837 raft_consensus.cc:1275] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:11:44.676680 13652 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:44.656494 13763 raft_consensus.cc:1240] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:44.579154 18633 consensus_queue.cc:237] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:44.667893 18721 log.cc:927] Time spent T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.075s	user 0.003s	sys 0.003s
I20260709 12:11:44.637494 18288 consensus_queue.cc:1048] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:11:44.684338 13686 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 13.
I20260709 12:11:44.637003 18623 consensus_queue.cc:1048] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:11:44.672417 18639 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:44.686002 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:44.621801 18651 consensus_queue.cc:260] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:44.638695 18356 consensus_queue.cc:1059] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 12:11:44.687759 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:11:44.688650 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:44.689033 13681 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 9.
I20260709 12:11:44.689725 13686 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 12.
I20260709 12:11:44.671236 18284 raft_consensus.cc:697] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 12 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:44.690629 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:44.692006 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:44.702984 13762 raft_consensus.cc:2368] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for earlier term 11. Current term is 12.
I20260709 12:11:44.702916 14379 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:44.705935 13800 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:44.706175 18570 consensus_queue.cc:1048] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:44.707365 13800 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:44.708774 13800 leader_election.cc:400] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 election: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 14. Current term is 15.
I20260709 12:11:44.709031 13800 leader_election.cc:403] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:11:44.710425 18655 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.710947 18649 raft_consensus.cc:2749] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:44.711458 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:44.712131 18529 raft_consensus.cc:2749] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:44.712916 18529 raft_consensus.cc:2749] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:11:44.713580 18529 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:44.710983 18655 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:44.719308 18655 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:44.719473 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:44.720264 13686 raft_consensus.cc:2393] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 13: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:44.721061 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:44.698737 18460 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:44.722396 18460 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:44.722905 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:44.712163 13681 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 14.
I20260709 12:11:44.724589 18460 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:44.725363 18641 consensus_queue.cc:1048] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:44.726361 18355 consensus_queue.cc:1059] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:44.727279 18697 raft_consensus.cc:3055] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:44.682433 18458 raft_consensus.cc:2749] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:44.727701 18697 raft_consensus.cc:740] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:44.722076 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:44.709362 17900 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:44.728766 13686 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:44.728459 18655 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:44.729265 18697 consensus_queue.cc:260] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:44.730634 18655 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:44.731746 18697 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:44.733074 18655 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:44.733336 13837 raft_consensus.cc:1275] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:11:44.729547 13763 raft_consensus.cc:1275] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:11:44.737493 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:44.740743 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:44.747964 18626 raft_consensus.cc:3055] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:44.748445 18626 raft_consensus.cc:740] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:44.750608 13761 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 13.
I20260709 12:11:44.751600 13763 raft_consensus.cc:1240] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:11:44.671689 17977 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:44.754750 13800 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:11:44.760104 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:44.755604 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:44.761071 13681 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 11.
I20260709 12:11:44.758272 13680 raft_consensus.cc:2468] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 13.
I20260709 12:11:44.762864 13686 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 15.
I20260709 12:11:44.760489 13800 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:44.685968 18475 raft_consensus.cc:2804] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:44.704319 18582 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:44.777931 18729 log.cc:927] Time spent T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 12:11:44.778239 18284 consensus_queue.cc:237] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:44.753696 18460 consensus_queue.cc:1048] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 12:11:44.769629 18355 raft_consensus.cc:2749] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:44.769969 18458 consensus_queue.cc:1048] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 12:11:44.775449 18626 consensus_queue.cc:260] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:44.776755 18713 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:44.782233 13760 raft_consensus.cc:2393] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 13: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:44.783843 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:44.741235 18564 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:44.738011 17900 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:44.785115 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 82290.8us
I20260709 12:11:44.770262 13680 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ca94d8f3109143599733e3a684149726"
dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
 from {username='slave'} at 127.0.0.1:41688
I20260709 12:11:44.792667 13680 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:44.793097 13680 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:44.772344 18698 raft_consensus.cc:2804] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:44.771708 18475 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:44.890728 13762 raft_consensus.cc:1240] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 15. Current term is 16. Ops: [15.10-15.10]
W20260709 12:11:44.891614 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 94028.1us
I20260709 12:11:44.895344 14379 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:44.895948 13756 raft_consensus.cc:3055] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:44.896385 13756 raft_consensus.cc:740] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:11:44.842415 18556 consensus_meta.cc:287] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.519s	user 0.009s	sys 0.003s
I20260709 12:11:44.898887 18556 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:44.901525 18556 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:44.902176 13758 raft_consensus.cc:2368] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 14. Current term is 15.
I20260709 12:11:44.903326 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:44.801565 18698 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:44.838061 18626 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:44.783432 18701 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:44.802116 18475 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:44.920357 13762 raft_consensus.cc:1240] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 14. Current term is 15. Ops: [12.11-14.12]
I20260709 12:11:44.921106 13688 raft_consensus.cc:1275] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:11:44.923346 18647 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:44.926911 14379 leader_election.cc:400] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 election: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for earlier term 11. Current term is 12.
W20260709 12:11:44.933905 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:44.907135 13756 consensus_queue.cc:260] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:44.949108 13762 raft_consensus.cc:1275] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:44.951845 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:44.952834 13688 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 14.
I20260709 12:11:44.954377 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:44.936182 18698 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:44.955421 13757 raft_consensus.cc:2410] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:11:44.937601 18567 raft_consensus.cc:3055] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:11:44.979624 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:44.984952 13683 raft_consensus.cc:2410] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
W20260709 12:11:44.967411 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 199659us
I20260709 12:11:44.941310 13680 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:44.990006 13800 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:44.991556 13800 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:44.998335 13680 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:45.004155 13800 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:44.969523 18567 raft_consensus.cc:740] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:45.009110 13800 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:45.010897 13800 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:45.010994 13680 raft_consensus.cc:1240] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 10. Current term is 11. Ops: []
W20260709 12:11:45.012626 18732 log.cc:927] Time spent T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 12:11:45.014815 18665 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:45.018236 13831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 2747) took 1319 ms. Trace:
I20260709 12:11:45.018702 13831 rpcz_store.cc:276] 0709 12:11:43.699241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:43.755168 (+ 55927us) service_pool.cc:224] Handling call
0709 12:11:43.755644 (+   476us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:44.573871 (+818227us) spinlock_profiling.cc:243] Waited 7.98 ms on lock 0x7b180049d3e0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa927b354bc 00007fa924e8348b 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9d455 00007fa927f85060 00007fa927f85bfb 00007fa927f9064b
0709 12:11:44.573999 (+   128us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:44.574024 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:44.574481 (+   457us) log.cc:844] Serialized 26 byte log entry
0709 12:11:44.697922 (+123441us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:44.697977 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:44.698073 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:45.017901 (+319828us) raft_consensus.cc:1685] finished
0709 12:11:45.017927 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:45.018169 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":79085,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":31230,"spinlock_wait_cycles":18353536,"thread_start_us":220914,"threads_started":2,"wal-append.queue_time_us":207494}
I20260709 12:11:45.018538 17977 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:44.992178 18647 consensus_queue.cc:1048] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 12:11:45.007547 18355 raft_consensus.cc:2749] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:45.028023 18355 raft_consensus.cc:2804] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:45.027207 13755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2708) took 1175 ms. Trace:
I20260709 12:11:45.028595 13755 rpcz_store.cc:276] 0709 12:11:43.852111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:43.943118 (+ 91007us) service_pool.cc:224] Handling call
0709 12:11:43.952535 (+  9417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:44.436016 (+483481us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:45.026985 (+590969us) spinlock_profiling.cc:243] Waited 483 ms on lock 0x7b54003c9954. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:45.027150 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1109900672}
W20260709 12:11:45.071993 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 61159.8us
I20260709 12:11:45.006309 18741 raft_consensus.cc:2749] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:45.075603 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:45.011309 18283 raft_consensus.cc:2749] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:45.053740 18355 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:45.084834 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:11:45.093130 18735 log.cc:927] Time spent T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:11:45.084959 18355 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:45.104772 18739 log.cc:927] Time spent T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:11:45.108363 13682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2663) took 1618 ms. Trace:
I20260709 12:11:45.108837 13682 rpcz_store.cc:276] 0709 12:11:43.490231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:43.706676 (+216445us) service_pool.cc:224] Handling call
0709 12:11:43.707015 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:44.049953 (+342938us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:45.108054 (+1058101us) spinlock_profiling.cc:243] Waited 340 ms on lock 0x7b5400285ad4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:45.108269 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":782562688}
I20260709 12:11:45.090309 18741 raft_consensus.cc:2749] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:45.130772 18701 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:45.105038 18529 raft_consensus.cc:2749] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 14. Current term is 15.
W20260709 12:11:45.140122 18724 log.cc:927] Time spent T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.674s	user 0.000s	sys 0.008s
W20260709 12:11:45.131319 18737 log.cc:927] Time spent T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 12:11:45.168737 18475 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:43.427889 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:45.172809 18639 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:45.157347 13581 catalog_manager.cc:5697] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 10 to 11, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 11 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:45.097157 18567 consensus_queue.cc:260] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:45.185341 13584 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45610 (request call id 255) took 41585 ms (client timeout 15000 ms). Trace:
W20260709 12:11:45.187690 18720 log.cc:927] Time spent T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.726s	user 0.005s	sys 0.000s
I20260709 12:11:45.192546 18701 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:45.194192 18623 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.204025 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:45.270043 13762 raft_consensus.cc:2368] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 11. Current term is 12.
I20260709 12:11:45.204161 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:45.270695 13763 raft_consensus.cc:3055] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:45.271112 13763 raft_consensus.cc:740] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:45.205164 13754 raft_consensus.cc:1275] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:11:45.207793 18564 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:11:45.211508 18727 log.cc:927] Time spent T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.583s	user 0.006s	sys 0.000s
I20260709 12:11:45.164835 13832 raft_consensus.cc:1240] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 16. Current term is 17. Ops: []
I20260709 12:11:45.274814 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:45.275805 13832 raft_consensus.cc:2393] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 12: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
W20260709 12:11:45.213518 18731 log.cc:927] Time spent T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.530s	user 0.000s	sys 0.001s
W20260709 12:11:45.216563 18650 consensus_meta.cc:287] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.599s	user 0.011s	sys 0.002s
I20260709 12:11:45.217559 18638 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:11:45.222743 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:45.224085 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:45.226459 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:45.282730 13680 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:45.228453 13833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 2740) took 1922 ms. Trace:
I20260709 12:11:45.228614 14410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 964) took 1165 ms. Trace:
I20260709 12:11:45.230755 13651 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:45.245208 13683 raft_consensus.cc:1275] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:45.244800 13831 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 15.
W20260709 12:11:45.248943 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:45.250810 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:45.254645 13581 catalog_manager.cc:5697] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 9 to 10, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 10 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:45.251163 18738 consensus_queue.cc:1059] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 12:11:45.267336 18639 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:45.268383 18460 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:45.271304 13800 leader_election.cc:400] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 14. Current term is 15.
I20260709 12:11:45.278492 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:11:45.288465 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 57774.5us
I20260709 12:11:45.322577 13832 raft_consensus.cc:2393] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 12: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:45.285945 14410 rpcz_store.cc:276] 0709 12:11:44.062695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:44.065006 (+  2311us) service_pool.cc:224] Handling call
0709 12:11:44.065347 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:44.310214 (+244867us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:45.228271 (+918057us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b54007f0154. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:45.228529 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":506547584}
I20260709 12:11:45.323665 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:45.283735 13833 rpcz_store.cc:276] 0709 12:11:43.305804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:43.306081 (+   277us) service_pool.cc:224] Handling call
0709 12:11:43.320532 (+ 14451us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:43.350418 (+ 29886us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:43.350495 (+    77us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:43.773186 (+422691us) spinlock_profiling.cc:243] Waited 18.1 ms on lock 0x7b18002e6ba0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e6e2a6 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa926886a11 00007fa926896372 00007fa927fc8a01 00007fa927f8d43a
0709 12:11:44.284255 (+511069us) spinlock_profiling.cc:243] Waited 4.33 ms on lock 0x7b2c0000bb28. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa926886a11 00007fa926896372 00007fa927fc8a01 00007fa927f8d43a 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2
0709 12:11:44.338905 (+ 54650us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b2c0000bb28. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa926886a11 00007fa926896372 00007fa927fc8a01 00007fa927f8d43a 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2
0709 12:11:44.339400 (+   495us) log.cc:844] Serialized 52 byte log entry
0709 12:11:44.454958 (+115558us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:44.463271 (+  8313us) log.cc:844] Serialized 14 byte log entry
0709 12:11:44.467025 (+  3754us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:44.467104 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:45.223757 (+756653us) spinlock_profiling.cc:243] Waited 7.96 ms on lock 0x7b18002e6ba0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924ea03f3 00007fa924ea27c1 00007fa924ea2779 00007fa924ea2709 00007fa924ea26d1 00007fa924ea19cd 0000000000388634 0000000000388479 00007fa924e8383a
0709 12:11:45.228203 (+  4446us) raft_consensus.cc:1685] finished
0709 12:11:45.228228 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:45.228386 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47032,"prepare.queue_time_us":8125,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":13303,"raft.run_cpu_time_us":308,"raft.run_wall_time_us":12053,"spinlock_wait_cycles":102587264,"thread_start_us":115144,"threads_started":1,"wal-append.queue_time_us":139107}
I20260709 12:11:45.300958 13686 raft_consensus.cc:2393] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 12: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:45.307469 13581 catalog_manager.cc:5697] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 5 to 8, leader changed from ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 8 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
W20260709 12:11:45.279337 18725 consensus_meta.cc:287] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.595s	user 0.010s	sys 0.002s
I20260709 12:11:45.181365 18355 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:45.328013 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 56880.5us
I20260709 12:11:45.328693 13581 catalog_manager.cc:5697] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:45.280633 18567 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:45.283874 13726 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:45.273738 18701 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:45.319671 13763 consensus_queue.cc:260] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:45.309615 18641 raft_consensus.cc:2804] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:45.343963 13763 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:45.351953 13581 catalog_manager.cc:5697] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 14 to 18, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 18 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:45.354993 13581 catalog_manager.cc:5697] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 11 to 13, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 13 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:45.273975 18623 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:45.354784 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 71050.6us
I20260709 12:11:45.360239 13686 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:45.361408 13726 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:45.365451 13680 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 12.
I20260709 12:11:45.355177 18740 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:45.378336 18740 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:45.381888 18740 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:45.383913 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:45.375309 13681 pending_rounds.cc:85] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 9
I20260709 12:11:45.392680 13681 pending_rounds.cc:107] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 12:11:45.393062 13681 raft_consensus.cc:2889] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:45.372123 13581 catalog_manager.cc:5697] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 6 to 11. New cstate: current_term: 11 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:45.376688 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:45.376863 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:45.368768 13726 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:45.395699 13682 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:45.372596 18639 raft_consensus.cc:2804] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:11:45.385537 18746 log.cc:927] Time spent T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:11:45.386130 18355 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:45.317750 18356 consensus_queue.cc:1048] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 12:11:45.391666 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:45.403549 13683 raft_consensus.cc:2368] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 11. Current term is 12.
I20260709 12:11:45.359683 18556 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:45.359166 18679 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:45.397629 13688 raft_consensus.cc:2393] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 13: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:11:45.398146 13726 leader_election.cc:304] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:45.414000 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:45.400002 13581 catalog_manager.cc:5697] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 7 to 14. New cstate: current_term: 14 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:45.353943 18564 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.346760 18650 consensus_queue.cc:1048] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 12:11:45.366442 18641 raft_consensus.cc:697] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 13 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:45.309216 18638 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:45.412540 13800 leader_election.cc:400] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 election: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 11. Current term is 12.
I20260709 12:11:45.426770 13800 leader_election.cc:403] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:11:45.396415 13680 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:45.419064 13581 catalog_manager.cc:5697] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 4 to 10. New cstate: current_term: 10 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:45.416572 13726 leader_election.cc:304] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:45.430297 13581 catalog_manager.cc:5697] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 9 to 11, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 11 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:45.356770 18677 consensus_queue.cc:1059] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 12:11:45.432802 18564 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:45.397946 18013 raft_consensus.cc:2749] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:45.342980 18460 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:45.397148 18639 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:45.425203 17977 raft_consensus.cc:2749] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:45.350580 18725 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:45.444809 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:45.441561 18564 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:45.442037 18676 raft_consensus.cc:3055] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:45.442310 18626 raft_consensus.cc:2804] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:11:45.251816 13584 rpcz_store.cc:269] 0709 12:11:03.617591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.660335 (+ 42744us) service_pool.cc:224] Handling call
0709 12:11:04.918758 (+1258423us) spinlock_profiling.cc:243] Waited 24.4 ms on lock 0x7b5400373cd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef7090 00007fa927f95f3a 00007fa92dd4be9c 00007fa92de4a04e 00007fa92c30b2a4 00007fa92c30b232 00007fa92c30b161 00007fa92c30b0dc 00007fa92c30a392 00007fa9262c848c 00007fa9262c78c6
0709 12:11:45.183670 (+40264912us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:39.127455 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:39.128085 (+   630us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:39.128123 (+    38us) write_op.cc:435] Acquired schema lock
0709 12:11:39.128142 (+    19us) tablet.cc:662] Decoding operations
0709 12:11:39.254833 (+126691us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:39.254900 (+    67us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:39.254930 (+    30us) tablet.cc:685] Acquiring locks for 15 operations
0709 12:11:39.256064 (+  1134us) tablet.cc:701] Row locks acquired
0709 12:11:39.256084 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:11:39.256210 (+   126us) write_op.cc:270] Start()
0709 12:11:39.256316 (+   106us) write_op.cc:276] Timestamp: P: 1783599099256168 usec, L: 0
0709 12:11:39.256337 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:11:39.257038 (+   701us) log.cc:844] Serialized 5970 byte log entry
0709 12:11:40.673435 (+1416397us) op_driver.cc:464] REPLICATION: finished
0709 12:11:40.837835 (+164400us) write_op.cc:301] APPLY: starting
0709 12:11:40.837922 (+    87us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:41.136128 (+298206us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:41.141817 (+  5689us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:41.580074 (+438257us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:41.580734 (+   660us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=30,mrs_lookups=0
0709 12:11:41.580837 (+   103us) write_op.cc:312] APPLY: finished
0709 12:11:41.581732 (+   895us) log.cc:844] Serialized 139 byte log entry
0709 12:11:41.896204 (+314472us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:41.913382 (+ 17178us) write_op.cc:454] Released schema lock
0709 12:11:41.913460 (+    78us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:41.918464 (+  5004us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:41.918499 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":745111,"reported_tablets":48,"spinlock_wait_cycles":56110464,"child_traces":[["op",{"apply.queue_time_us":124163,"apply.run_cpu_time_us":59343,"apply.run_wall_time_us":1080492,"cfile_cache_hit":62,"cfile_cache_hit_bytes":66827,"num_ops":15,"prepare.queue_time_us":202107,"prepare.run_cpu_time_us":11433,"prepare.run_wall_time_us":547747,"raft.queue_time_us":288272,"raft.run_cpu_time_us":6331,"raft.run_wall_time_us":46342,"replication_time_us":1416907,"thread_start_us":930321,"threads_started":5,"wal-append.queue_time_us":970174,"wal-append.run_cpu_time_us":25506,"wal-append.run_wall_time_us":2716482}]]}
I20260709 12:11:45.454340 13682 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 15.
I20260709 12:11:45.455878 13763 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 11.
I20260709 12:11:45.436049 13581 catalog_manager.cc:5697] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:45.412832 18529 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:45.434943 18355 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:45.472028 13581 catalog_manager.cc:5697] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 8 to 11, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 11 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:45.451188 18639 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:45.424757 18679 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:45.490965 14414 raft_consensus.cc:2368] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 12. Current term is 13.
I20260709 12:11:45.449954 18664 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:45.498129 13680 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 13.
I20260709 12:11:45.464216 18676 raft_consensus.cc:740] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
W20260709 12:11:45.529513 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 113022us
I20260709 12:11:45.490449 18626 raft_consensus.cc:697] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:45.509516 18475 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:45.480865 18529 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:45.538228 18650 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:45.546940 18698 consensus_meta.cc:287] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.564s	user 0.006s	sys 0.005s
I20260709 12:11:45.510260 18664 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:45.540257 18641 consensus_queue.cc:237] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:45.597369 18752 log.cc:927] Time spent T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 12:11:45.579698 18650 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:45.582015 18698 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:45.599182 18623 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:45.614712 13837 raft_consensus.cc:1240] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
W20260709 12:11:45.616479 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 68330.6us
I20260709 12:11:45.617141 18460 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:45.617704 18679 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:45.618726 18755 log.cc:927] Time spent T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:11:45.620249 18638 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:45.620711 18626 consensus_queue.cc:237] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:45.600342 18676 consensus_queue.cc:260] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:45.645359 13800 leader_election.cc:400] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 election: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 11. Current term is 12.
W20260709 12:11:45.638927 18758 log.cc:927] Time spent T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:11:45.640336 18650 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:11:45.624702 18719 log.cc:927] Time spent T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 1.159s	user 0.003s	sys 0.005s
I20260709 12:11:45.610639 18701 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:45.661407 18382 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:45.664399 18529 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:45.666925 18756 log.cc:927] Time spent T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 12:11:45.669737 18639 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:45.671991 13834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 2754) took 1543 ms. Trace:
I20260709 12:11:45.672555 13834 rpcz_store.cc:276] 0709 12:11:44.128345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:44.176011 (+ 47666us) service_pool.cc:224] Handling call
0709 12:11:44.176427 (+   416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:44.176880 (+   453us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:44.176913 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:44.177466 (+   553us) log.cc:844] Serialized 26 byte log entry
0709 12:11:44.452475 (+275009us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:44.452519 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:44.452625 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:45.529047 (+1076422us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:11:45.671628 (+142581us) raft_consensus.cc:1685] finished
0709 12:11:45.671651 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:45.671907 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":532,"raft.run_cpu_time_us":56,"raft.run_wall_time_us":55,"spinlock_wait_cycles":262622592,"thread_start_us":274606,"threads_started":1,"wal-append.queue_time_us":285780}
I20260709 12:11:45.675652 13651 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:45.676210 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:45.676506 13836 raft_consensus.cc:1240] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 12:11:45.677028 14416 raft_consensus.cc:2393] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 13: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:11:45.678138 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:45.677670 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:45.685159 14410 raft_consensus.cc:2393] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 13: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:11:45.685729 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:45.686506 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:45.687256 13832 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 11.
I20260709 12:11:45.683844 14411 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:45.688819 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:45.691253 13688 raft_consensus.cc:1240] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 12:11:45.683763 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:45.679327 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:45.693951 14407 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:45.695245 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:45.698257 13832 raft_consensus.cc:1275] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:45.704645 13831 raft_consensus.cc:1240] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:45.634784 18356 consensus_queue.cc:1059] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:11:45.651445 18725 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:45.708580 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:45.709343 13834 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 10.
W20260709 12:11:45.709748 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 67470.8us
I20260709 12:11:45.679951 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:45.656390 18556 raft_consensus.cc:2749] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:45.678819 18623 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.712241 13833 raft_consensus.cc:1275] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:45.678292 18679 raft_consensus.cc:2804] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:45.677932 18638 consensus_queue.cc:1048] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:11:45.673180 18639 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:45.718645 18355 raft_consensus.cc:2749] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 11. Current term is 12.
I20260709 12:11:45.711428 13726 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:45.717448 18664 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:45.723917 13759 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38932 (request call id 708) took 1355 ms (client timeout 1576 ms). Trace:
I20260709 12:11:45.709476 18564 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:45.724505 13759 rpcz_store.cc:269] 0709 12:11:44.368329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:44.368481 (+   152us) service_pool.cc:224] Handling call
0709 12:11:45.723690 (+1355209us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b540035f2d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:45.723838 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":479647488}
W20260709 12:11:45.728713 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:45.720415 18698 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:11:45.760783 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:45.734707 18679 raft_consensus.cc:697] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 11 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:45.716149 18623 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:45.784183 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 81209.6us
W20260709 12:11:45.802973 18715 log.cc:927] Time spent T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 1.279s	user 0.000s	sys 0.005s
W20260709 12:11:45.804543 18764 log.cc:927] Time spent T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:11:45.805127 13835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 2753) took 1677 ms. Trace:
I20260709 12:11:45.805522 13835 rpcz_store.cc:276] 0709 12:11:44.128035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:44.173318 (+ 45283us) service_pool.cc:224] Handling call
0709 12:11:44.173687 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:44.174086 (+   399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:44.174120 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:44.174657 (+   537us) log.cc:844] Serialized 26 byte log entry
0709 12:11:44.353798 (+179141us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:44.353861 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:44.353958 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:45.779466 (+1425508us) spinlock_profiling.cc:243] Waited 51.1 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:11:45.804796 (+ 25330us) raft_consensus.cc:1685] finished
0709 12:11:45.804817 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:45.805062 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3077,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"spinlock_wait_cycles":117618560,"thread_start_us":178682,"threads_started":1,"wal-append.queue_time_us":291874}
I20260709 12:11:45.736218 18564 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:45.766440 18773 raft_consensus.cc:2804] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:45.818693 14412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41700 (request call id 693) took 1400 ms. Trace:
I20260709 12:11:45.791105 18356 consensus_queue.cc:1243] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer b98d2519bb504dc6905ed2ede4571835 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:11:45.820703 14411 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 13.
I20260709 12:11:45.820564 13680 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 17.
W20260709 12:11:45.810781 18771 log.cc:927] Time spent T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 12:11:45.826473 13727 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:45.819594 14412 rpcz_store.cc:276] 0709 12:11:44.418746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:44.418919 (+   173us) service_pool.cc:224] Handling call
0709 12:11:44.419243 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:44.542203 (+122960us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:44.542235 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:44.542281 (+    46us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:44.542335 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:45.818342 (+1276007us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b54006d0e54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:45.818398 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:45.818598 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":282279680}
I20260709 12:11:45.832789 18564 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:45.840307 18762 log.cc:927] Time spent T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.250s	user 0.004s	sys 0.000s
I20260709 12:11:45.846165 14407 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 13.
W20260709 12:11:45.846151 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 125913us
I20260709 12:11:45.861840 13727 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
W20260709 12:11:45.864944 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:45.866436 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:45.868225 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:45.870105 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:45.867529 13726 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:45.873090 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:45.875336 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:45.875998 13761 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:45.875816 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:45.845383 18698 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:45.846550 18773 raft_consensus.cc:697] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:45.878347 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:45.860519 18283 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:45.868085 18556 raft_consensus.cc:2749] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:45.924247 13761 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 12.
I20260709 12:11:45.911428 18698 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:45.929247 18780 raft_consensus.cc:2749] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:45.936254 18698 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:11:45.943620 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 76155.9us
I20260709 12:11:45.944849 13726 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:45.946233 18639 raft_consensus.cc:2804] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:11:45.948058 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 80142.6us
I20260709 12:11:45.941758 18649 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.957937 13757 raft_consensus.cc:1275] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:11:45.868556 18679 consensus_queue.cc:237] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:45.941372 18767 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:45.928179 18283 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:46.000731 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 45355.3us
W20260709 12:11:46.007350 18765 log.cc:927] Time spent T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 12:11:45.991767 18623 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:46.046087 13727 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:46.073443 18676 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:46.077919 13727 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:46.078938 18785 raft_consensus.cc:2764] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
W20260709 12:11:46.080502 18775 log.cc:927] Time spent T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 12:11:46.081537 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:46.082125 18788 consensus_queue.cc:1048] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:46.082392 18778 raft_consensus.cc:2804] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:46.082829 18356 consensus_queue.cc:1048] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:46.083418 18013 raft_consensus.cc:3055] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:46.083791 18013 raft_consensus.cc:740] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:46.082993 18778 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:46.080525 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:45.987015 18774 raft_consensus.cc:2804] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:45.966883 18649 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:46.082450 14407 raft_consensus.cc:2393] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 9: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:11:45.993153 18767 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:46.092095 18778 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:46.110742 18774 raft_consensus.cc:697] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:11:46.128405 13727 consensus_peers.cc:597] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Couldn't send request to peer ca9fbbc2c0a94897897d502d42f3951f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:46.136336 13727 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:46.142117 18774 consensus_queue.cc:237] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:46.023859 18773 consensus_queue.cc:237] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:46.144232 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 199505us
I20260709 12:11:46.159482 13727 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:46.173952 18626 raft_consensus.cc:2804] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:46.181938 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:46.182188 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:46.184386 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:46.185441 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:46.185719 13683 raft_consensus.cc:1275] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:46.156075 18801 raft_consensus.cc:2749] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:46.201993 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:11:46.329916 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:46.335814 18639 raft_consensus.cc:697] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:11:46.340587 14414 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41700 (request call id 696) took 1720 ms (client timeout 2148 ms). Trace:
I20260709 12:11:46.341060 18639 consensus_queue.cc:237] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:46.341248 14414 rpcz_store.cc:269] 0709 12:11:44.619694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:44.619861 (+   167us) service_pool.cc:224] Handling call
0709 12:11:46.340281 (+1720420us) spinlock_profiling.cc:243] Waited 870 ms on lock 0x7b5400702954. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:46.340473 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2000685824}
I20260709 12:11:46.346793 13837 raft_consensus.cc:1275] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 12:11:46.347352 13837 pending_rounds.cc:85] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 10
I20260709 12:11:46.347575 13837 pending_rounds.cc:107] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 12:11:46.347787 13837 raft_consensus.cc:2889] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:46.348097 13837 pending_rounds.cc:107] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 12:11:46.348309 13837 raft_consensus.cc:2889] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:46.362879 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:46.363864 13832 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:46.372509 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:46.382458 13687 raft_consensus.cc:1275] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:46.124949 18013 consensus_queue.cc:260] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:46.339779 18665 raft_consensus.cc:3055] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:46.434156 18665 raft_consensus.cc:740] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:46.434470 13727 leader_election.cc:400] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 12. Current term is 13.
I20260709 12:11:46.434875 13727 leader_election.cc:403] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:46.435236 18665 consensus_queue.cc:260] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:46.436836 18665 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:46.437455 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:46.386409 18512 log.cc:927] Time spent T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.186s	user 0.000s	sys 0.000s
I20260709 12:11:46.359488 18626 raft_consensus.cc:697] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:46.388170 18355 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:46.443848 13679 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 9.
I20260709 12:11:46.406229 18283 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:46.406466 18698 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.420709 18564 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.419864 18507 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:46.520207 13836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 2579) took 2346 ms. Trace:
I20260709 12:11:46.520696 13836 rpcz_store.cc:276] 0709 12:11:44.155157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:44.217166 (+ 62009us) service_pool.cc:224] Handling call
0709 12:11:45.676232 (+1459066us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:45.676947 (+   715us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:46.500998 (+824051us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b540002d350. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:46.501270 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3354789120}
I20260709 12:11:46.538692 13836 raft_consensus.cc:1240] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:46.498358 18013 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:46.547577 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:46.554322 13679 raft_consensus.cc:2368] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 14. Current term is 15.
I20260709 12:11:46.498355 18789 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:46.502770 18623 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:46.560107 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 136989us
I20260709 12:11:46.576949 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:46.562115 18733 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.563424 18673 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:46.563578 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:46.529760 18355 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:46.525619 18801 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:46.567612 13832 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 13.
I20260709 12:11:46.568771 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:46.568612 18283 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:46.570353 18676 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:46.571026 18785 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:11:46.571619 17900 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.609019 17900 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:46.525055 18567 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.519567 18569 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:46.606676 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:46.526861 18698 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:46.530318 18564 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:46.537304 18507 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:46.606552 18801 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:46.682978 18567 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:46.685936 18767 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:46.597741 18673 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:46.686682 18767 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.687552 18698 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:46.687305 18767 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:46.688148 18698 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:46.688545 18673 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:46.606076 18649 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:46.689707 18767 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:46.588969 18733 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:46.690498 18767 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:46.691149 18767 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:46.692425 18733 leader_election.cc:290] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:46.689707 18569 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:46.696456 18569 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:46.693632 18767 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:46.697481 18767 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.698017 18767 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:46.700730 18767 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:46.583217 18798 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.709079 18798 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:46.712411 18798 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:46.713269 18567 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:46.688758 18698 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:46.716665 18698 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:46.723953 18355 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:46.735240 17900 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:46.743047 13835 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.014s	sys 0.032s
W20260709 12:11:46.743579 13835 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.014s	sys 0.032s
I20260709 12:11:46.685460 18801 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:46.583379 18763 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:11:46.734247 18773 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.010s	sys 0.013s
W20260709 12:11:46.736469 18512 log.cc:927] Time spent T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.059s	user 0.004s	sys 0.000s
W20260709 12:11:46.798691 13685 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.017s	sys 0.017s
I20260709 12:11:46.799574 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:46.667757 18793 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:46.810423 18564 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:46.810216 18793 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:46.804399 14379 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
W20260709 12:11:46.804991 13685 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.017s	sys 0.018s
I20260709 12:11:46.584576 18789 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:46.808648 18507 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:46.790547 18738 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
W20260709 12:11:46.801309 18773 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.010s	sys 0.014s
I20260709 12:11:46.614322 18676 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:46.734764 18283 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:46.893383 18789 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:46.876562 18679 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.787s	user 0.037s	sys 0.079s
I20260709 12:11:46.793594 18567 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:46.794377 18618 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:46.802572 18684 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
W20260709 12:11:46.909675 18679 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.820s	user 0.037s	sys 0.079s
I20260709 12:11:46.674480 18626 consensus_queue.cc:237] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:46.876087 18564 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:11:46.905474 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 493263us
I20260709 12:11:46.587407 18623 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:46.879460 18636 raft_consensus.cc:2804] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:46.823845 18767 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:46.933686 18698 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:11:46.928002 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:46.904682 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 74552.7us
I20260709 12:11:46.934314 18569 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.936602 18636 raft_consensus.cc:697] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 13 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:46.941102 14379 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:46.945986 14379 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:46.915668 18567 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:46.958935 13682 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.771s	user 0.032s	sys 0.061s
W20260709 12:11:46.961721 13682 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.774s	user 0.032s	sys 0.061s
W20260709 12:11:46.941154 18791 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.005s	sys 0.033s
I20260709 12:11:46.922993 18564 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:46.954594 18507 raft_consensus.cc:2749] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:46.970657 18791 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.005s	sys 0.034s
I20260709 12:11:46.956154 18793 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:46.956480 18743 raft_consensus.cc:2804] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:11:46.971172 13654 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.022s	sys 0.021s
W20260709 12:11:46.977634 13654 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.022s	sys 0.021s
I20260709 12:11:46.941761 18767 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:46.947115 18569 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:46.945618 18698 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:46.983846 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:46.989233 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:47.005578 13832 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:46.989904 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:47.010931 13754 raft_consensus.cc:1240] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:46.990813 18623 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:46.972466 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:46.965884 18733 consensus_queue.cc:1048] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 12:11:46.992703 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:47.017980 13836 raft_consensus.cc:2468] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 11.
I20260709 12:11:46.993732 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:47.019170 13831 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:46.995157 13834 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.004s	sys 0.021s
I20260709 12:11:46.996865 13833 raft_consensus.cc:1275] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 12:11:47.022133 13833 pending_rounds.cc:85] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 9
I20260709 12:11:47.022469 13833 pending_rounds.cc:107] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 12:11:47.022735 13833 raft_consensus.cc:2889] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:47.022887 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:46.999742 18818 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.001528 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:47.022497 13832 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 12.
I20260709 12:11:46.979233 18743 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
W20260709 12:11:47.024601 13834 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.004s	sys 0.022s
I20260709 12:11:47.042419 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:47.037590 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:47.068279 13761 raft_consensus.cc:2410] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:11:47.076224 13831 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 11.
I20260709 12:11:47.029111 18743 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:47.079262 18767 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:47.080478 18569 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:47.084404 13837 raft_consensus.cc:2393] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 15: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:47.086649 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:47.091755 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:11:47.095863 13830 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.025s	sys 0.061s
W20260709 12:11:47.096489 13830 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.025s	sys 0.061s
I20260709 12:11:47.042589 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:47.098557 13758 raft_consensus.cc:2468] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 13.
W20260709 12:11:47.095064 18512 log.cc:927] Time spent T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:11:47.080651 18767 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:47.109457 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:47.110400 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:47.108489 13684 raft_consensus.cc:1275] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:11:47.089984 18676 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:46.888574 18738 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:46.806515 18763 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:46.920143 18684 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:47.020884 18793 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.118566 13688 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 13.
I20260709 12:11:47.119603 13683 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 15.
I20260709 12:11:46.915521 18618 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:47.113353 18778 consensus_meta.cc:287] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.987s	user 0.014s	sys 0.001s
I20260709 12:11:47.128221 18812 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:47.122743 13763 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.027s	sys 0.033s
W20260709 12:11:47.149821 13763 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.027s	sys 0.034s
I20260709 12:11:47.124867 18623 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:47.028148 18791 consensus_queue.cc:1059] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.103s
I20260709 12:11:47.129674 18676 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.161964 18676 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:47.162384 18651 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:47.164326 18676 leader_election.cc:290] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:11:47.135239 13652 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.005s	sys 0.017s
I20260709 12:11:47.125612 18767 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:47.065696 18818 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:47.166781 18767 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:47.167323 18818 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:47.167677 18767 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:47.167904 18818 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:47.168393 18767 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:47.170158 18806 log.cc:927] Time spent T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
W20260709 12:11:47.166986 18808 log.cc:927] Time spent T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.148s	user 0.000s	sys 0.002s
W20260709 12:11:47.172302 18809 log.cc:927] Time spent T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 12:11:47.173929 13763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2729) took 1300 ms. Trace:
W20260709 12:11:47.175639 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 139056us
I20260709 12:11:47.174410 13763 rpcz_store.cc:276] 0709 12:11:45.873263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:45.928124 (+ 54861us) service_pool.cc:224] Handling call
0709 12:11:45.928693 (+   569us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:46.097766 (+169073us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:46.097818 (+    52us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:46.105047 (+  7229us) log.cc:844] Serialized 52 byte log entry
0709 12:11:46.586265 (+481218us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:46.619634 (+ 33369us) log.cc:844] Serialized 14 byte log entry
0709 12:11:47.150338 (+530704us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:47.150579 (+   241us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:47.173676 (+ 23097us) raft_consensus.cc:1685] finished
0709 12:11:47.173700 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:47.173866 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23136,"prepare.queue_time_us":110358,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":63,"raft.queue_time_us":91212,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":26404,"thread_start_us":1126056,"threads_started":3,"wal-append.queue_time_us":794093}
W20260709 12:11:47.178289 13652 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.005s	sys 0.017s
I20260709 12:11:47.177963 18789 consensus_queue.cc:1059] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:47.178965 18816 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:47.179562 18816 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:47.180902 18789 raft_consensus.cc:3055] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:47.181334 18789 raft_consensus.cc:740] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:47.182554 18679 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.182099 18773 raft_consensus.cc:2955] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:11:47.183172 18679 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:47.185534 18679 leader_election.cc:290] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:47.168541 18818 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:47.187772 13835 raft_consensus.cc:1275] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:11:47.157517 18812 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:47.187822 18567 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:47.190478 18283 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:47.191018 18763 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:47.191282 18283 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:47.191855 18283 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:47.183166 18618 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:47.192903 18567 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
W20260709 12:11:47.207263 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 161318us
I20260709 12:11:47.208530 13800 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:47.019065 18636 consensus_queue.cc:237] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:47.127389 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:47.204691 18512 tablet_bootstrap.cc:492] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=1 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:11:47.215523 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:47.218472 13832 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 16.
I20260709 12:11:47.208057 18567 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:47.213685 13758 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 18.
I20260709 12:11:47.221354 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:47.227828 13832 raft_consensus.cc:2393] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 19: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:47.156292 18778 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:47.146171 18793 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:47.232421 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:47.211428 18818 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:47.235450 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:47.237561 13835 raft_consensus.cc:2955] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
W20260709 12:11:47.239289 18785 consensus_meta.cc:287] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.521s	user 0.007s	sys 0.005s
W20260709 12:11:47.216773 18013 consensus_meta.cc:287] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.644s	user 0.012s	sys 0.000s
I20260709 12:11:47.239909 18785 raft_consensus.cc:2749] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 12. Current term is 13.
I20260709 12:11:47.237272 18812 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:47.241001 18812 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.216262 18564 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:47.239349 13833 raft_consensus.cc:2410] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:11:47.236639 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:47.211028 18816 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:47.236544 18567 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:47.232398 13726 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:47.193605 18623 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:47.247222 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:47.214184 13800 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:47.252173 13832 raft_consensus.cc:1275] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:47.233739 13831 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 13.
I20260709 12:11:47.213145 18767 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:47.225538 18718 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.259533 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:47.260304 13755 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 12.
W20260709 12:11:47.135553 14381 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.004s	sys 0.018s
W20260709 12:11:47.261596 14381 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.731s	user 0.005s	sys 0.018s
I20260709 12:11:47.262730 13727 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:47.256835 13800 leader_election.cc:400] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 election: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 14. Current term is 15.
I20260709 12:11:47.264837 13800 leader_election.cc:403] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:11:47.269088 13762 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 13.
I20260709 12:11:47.277521 13754 raft_consensus.cc:2393] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 8: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:47.305203 18801 consensus_queue.cc:1048] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:47.317183 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:47.320245 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:47.321257 13688 raft_consensus.cc:2468] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 10.
I20260709 12:11:47.324131 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:47.327050 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:47.330983 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:47.331990 13686 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 13.
W20260709 12:11:47.382699 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 423334us
I20260709 12:11:47.382745 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:47.255628 18818 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.399037 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:47.401664 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:47.406402 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:47.407975 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:47.410837 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:47.411777 13680 raft_consensus.cc:2468] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 11.
I20260709 12:11:47.413314 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:47.258663 18564 raft_consensus.cc:2749] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:11:47.268589 18772 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.010s	sys 0.017s
I20260709 12:11:47.421074 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:47.427676 14412 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 19.
I20260709 12:11:47.314083 18507 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.435163 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:11:47.438791 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:47.255887 18763 consensus_queue.cc:1048] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.160s
I20260709 12:11:47.389477 18827 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:47.468293 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 145037us
W20260709 12:11:47.427184 18772 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.011s	sys 0.017s
I20260709 12:11:47.511188 13726 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
W20260709 12:11:47.511387 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:47.513042 14379 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.038s	sys 0.013s
I20260709 12:11:47.529313 13830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 2782) took 1443 ms. Trace:
W20260709 12:11:47.572671 14379 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.038s	sys 0.014s
I20260709 12:11:47.256062 18812 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:47.227583 18789 consensus_queue.cc:260] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:47.566643 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:47.261368 18816 consensus_queue.cc:1059] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.216s
I20260709 12:11:47.391788 18819 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:47.392148 18679 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:11:47.572911 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 61826.3us
W20260709 12:11:47.573137 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 613816us
W20260709 12:11:47.569986 18808 log.cc:927] Time spent T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 12:11:47.565183 18512 tablet_bootstrap.cc:492] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap complete.
I20260709 12:11:47.430560 18507 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:47.572721 13830 rpcz_store.cc:276] 0709 12:11:46.085529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:46.085731 (+   202us) service_pool.cc:224] Handling call
0709 12:11:46.088659 (+  2928us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:46.088873 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:46.581590 (+492717us) log.cc:844] Serialized 14 byte log entry
0709 12:11:47.528876 (+947286us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:47.528942 (+    66us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:47.529043 (+   101us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:47.529112 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:47.529241 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":712737,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":5135,"raft.queue_time_us":94132,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"thread_start_us":1439061,"threads_started":3,"wal-append.queue_time_us":592509}
I20260709 12:11:47.314239 18718 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:47.582522 18820 log.cc:927] Time spent T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.335s	user 0.001s	sys 0.005s
I20260709 12:11:47.594825 14411 raft_consensus.cc:1275] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:47.423542 18818 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:47.606793 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:47.593173 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:47.598315 14412 raft_consensus.cc:1240] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:47.608393 13755 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 15.
I20260709 12:11:47.601826 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:47.575217 18785 raft_consensus.cc:2804] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:47.575145 18798 raft_consensus.cc:2749] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:47.598387 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:11:47.593833 18665 consensus_meta.cc:287] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 1.153s	user 0.007s	sys 0.011s
I20260709 12:11:47.606606 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:47.592576 18679 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:47.615471 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:47.615659 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:47.580339 18673 consensus_queue.cc:1048] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 12:11:47.593025 18738 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:47.592500 18819 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:47.618261 18738 raft_consensus.cc:2804] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:11:47.618690 18738 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:47.619055 18738 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:47.620201 18819 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199)
I20260709 12:11:47.622249 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:47.622402 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:47.625427 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:47.625286 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:47.627328 18818 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:47.627213 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:47.628509 13763 raft_consensus.cc:2410] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 12:11:47.628862 18818 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:47.632711 18679 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:47.610607 18785 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:47.638398 13687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1823) took 1030 ms. Trace:
I20260709 12:11:47.639060 13687 rpcz_store.cc:276] 0709 12:11:46.608351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:46.610561 (+  2210us) service_pool.cc:224] Handling call
0709 12:11:46.743270 (+132709us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:46.743591 (+   321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:46.743647 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:46.787568 (+ 43921us) log.cc:844] Serialized 26 byte log entry
0709 12:11:47.260290 (+472722us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:47.260362 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:47.260560 (+   198us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:47.638031 (+377471us) raft_consensus.cc:1685] finished
0709 12:11:47.638059 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:47.638308 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":468155,"threads_started":1,"wal-append.queue_time_us":634401}
I20260709 12:11:47.641525 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:47.646271 13759 raft_consensus.cc:1275] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:11:47.647450 18793 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:47.593205 18684 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:47.650364 18564 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.651096 18564 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:47.652299 18827 raft_consensus.cc:2749] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:47.598707 18567 raft_consensus.cc:3055] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:47.662158 18567 raft_consensus.cc:740] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:47.663146 18567 consensus_queue.cc:260] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:47.664559 18567 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:47.603291 18816 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.667244 18816 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:47.668361 18833 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:47.668944 18833 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:47.671226 18828 log.cc:927] Time spent T 00000000000000000000000000000000 P 17d79eae88f84be7a847d0cf544674cd: Append to log took a long time: real 0.241s	user 0.001s	sys 0.000s
I20260709 12:11:47.671550 18833 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:47.673280 18778 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:47.584169 18283 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:47.674633 18623 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:47.609437 13685 raft_consensus.cc:2468] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 8.
I20260709 12:11:47.675434 18283 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:47.669433 18816 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:47.676154 18283 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:47.677439 18512 ts_tablet_manager.cc:1403] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f: Time spent bootstrapping tablet: real 3.236s	user 0.061s	sys 0.025s
I20260709 12:11:47.585255 18815 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:47.678145 18815 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:47.677479 13834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 2787) took 1497 ms. Trace:
I20260709 12:11:47.680280 13834 rpcz_store.cc:276] 0709 12:11:46.179873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:46.183544 (+  3671us) service_pool.cc:224] Handling call
0709 12:11:46.189874 (+  6330us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:11:46.336194 (+146320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:46.336230 (+    36us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:11:46.351543 (+ 15313us) log.cc:844] Serialized 78 byte log entry
0709 12:11:47.025271 (+673728us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:47.129672 (+104401us) log.cc:844] Serialized 14 byte log entry
0709 12:11:47.130063 (+   391us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:47.130139 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:47.677237 (+547098us) raft_consensus.cc:1685] finished
0709 12:11:47.677258 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:47.677417 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52,"prepare.queue_time_us":99232,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":1780,"raft.queue_time_us":261630,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":19145,"thread_start_us":582926,"threads_started":1,"wal-append.queue_time_us":773156}
W20260709 12:11:47.683753 13802 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.037s	sys 0.070s
I20260709 12:11:47.673353 18812 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:47.683473 14409 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 8.
W20260709 12:11:47.686141 13802 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.038s	sys 0.070s
W20260709 12:11:47.694934 13829 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.031s	sys 0.075s
W20260709 12:11:47.696601 13829 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.031s	sys 0.075s
I20260709 12:11:47.698733 13829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 2784) took 1608 ms. Trace:
I20260709 12:11:47.638782 18785 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:47.702979 13829 rpcz_store.cc:276] 0709 12:11:46.090575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:46.091260 (+   685us) service_pool.cc:224] Handling call
0709 12:11:46.091631 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:46.091851 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:46.559797 (+467946us) log.cc:844] Serialized 14 byte log entry
0709 12:11:47.698348 (+1138551us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:47.698422 (+    74us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:47.698469 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:47.698538 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:47.698672 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":715144,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":46,"raft.queue_time_us":100194,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":110,"spinlock_wait_cycles":74112,"thread_start_us":1605678,"threads_started":3,"wal-append.queue_time_us":438299}
I20260709 12:11:47.693166 18816 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.693701 18564 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:47.707469 18833 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:11:47.728205 13652 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.009s	sys 0.020s
W20260709 12:11:47.749128 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 486455us
I20260709 12:11:47.729133 18564 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.764153 18564 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:47.766952 18564 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:11:47.729662 13652 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.009s	sys 0.020s
W20260709 12:11:47.756273 18743 consensus_meta.cc:287] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.678s	user 0.010s	sys 0.003s
I20260709 12:11:47.725838 18816 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:47.791917 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:47.794081 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:11:47.730225 18676 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.000s	sys 0.026s
I20260709 12:11:47.728987 18833 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:47.799124 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:11:47.785163 18773 consensus_meta.cc:287] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.599s	user 0.008s	sys 0.004s
I20260709 12:11:47.782079 18815 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:47.800071 13832 raft_consensus.cc:1240] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:47.807749 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:47.816075 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:47.802928 14413 raft_consensus.cc:2468] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 8.
I20260709 12:11:47.816921 13834 raft_consensus.cc:2393] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 16: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:47.817227 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:47.815056 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:11:47.802284 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 405244us
I20260709 12:11:47.810151 13727 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
W20260709 12:11:47.799738 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:47.817901 13833 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 10.
I20260709 12:11:47.824934 13830 raft_consensus.cc:1275] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:47.820268 13837 raft_consensus.cc:2468] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 10.
W20260709 12:11:47.812676 13801 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.56.196:46341 timed out after 1.665s (SENT) [suppressed 12 similar messages]
I20260709 12:11:47.802924 18743 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:47.838251 18743 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:47.806406 18623 consensus_queue.cc:1048] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:11:47.839540 18512 raft_consensus.cc:359] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 12 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:47.833000 18778 raft_consensus.cc:2804] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:47.840575 18778 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:47.840991 18778 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:47.841128 18512 raft_consensus.cc:740] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Initialized, Role: LEARNER
I20260709 12:11:47.841960 18841 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:47.842506 18841 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:47.835042 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:47.836169 13833 raft_consensus.cc:1275] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 12:11:47.846273 13833 pending_rounds.cc:85] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 6
I20260709 12:11:47.846633 13833 pending_rounds.cc:107] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 12:11:47.846936 13833 raft_consensus.cc:2889] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:47.847056 18816 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:47.848460 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:47.850620 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:47.851238 13830 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 15.
I20260709 12:11:47.852749 18738 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:47.845566 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:47.854326 13837 raft_consensus.cc:2468] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 11.
I20260709 12:11:47.854370 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:47.844871 18841 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:47.856185 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:47.856838 13829 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 12.
W20260709 12:11:47.857149 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 47119.6us
I20260709 12:11:47.822459 14380 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:47.857708 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:47.858577 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:47.859194 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:47.860033 13837 raft_consensus.cc:2410] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:11:47.859218 13834 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 13.
I20260709 12:11:47.861989 13833 raft_consensus.cc:2410] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:11:47.858580 13829 raft_consensus.cc:2393] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 14: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:47.806416 18283 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:47.868378 14413 raft_consensus.cc:1275] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 12:11:47.871762 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 287713us
I20260709 12:11:47.873047 13726 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:47.874357 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:47.880304 13652 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:47.900068 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:47.886662 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:47.922912 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:47.923920 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:47.889799 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:47.901517 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:47.935834 13828 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 15.
I20260709 12:11:47.887113 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:47.911222 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:47.938472 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 65558.3us
I20260709 12:11:47.899245 14414 raft_consensus.cc:1240] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:47.944842 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:47.945818 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:47.946038 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:47.946877 14412 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 19.
I20260709 12:11:47.945991 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:47.947777 13828 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:47.947098 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:47.953750 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:47.954391 13757 raft_consensus.cc:2410] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:11:47.949398 13652 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:47.901242 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:47.945313 14379 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:47.956854 14379 leader_election.cc:304] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
W20260709 12:11:47.957162 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 75834.7us
I20260709 12:11:47.957849 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:47.958238 13800 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:47.863618 18816 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:47.866513 18743 raft_consensus.cc:2804] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:47.960381 13726 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:47.968544 13800 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:47.898031 18837 raft_consensus.cc:2804] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:47.962256 13652 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:47.961761 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:47.969425 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:47.922119 18698 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:47.974439 13800 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:47.906023 18738 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:47.944777 17977 raft_consensus.cc:2749] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:47.972374 13757 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 11.
I20260709 12:11:48.006356 18832 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:48.006379 18564 raft_consensus.cc:2749] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:48.006976 18832 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:48.007519 18832 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:48.006423 18801 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.008432 13800 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:48.008864 18801 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:48.003611 18847 consensus_queue.cc:1048] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:11:48.014953 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:47.901638 18841 consensus_queue.cc:1048] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.071s
I20260709 12:11:48.018971 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:47.975378 18817 raft_consensus.cc:2804] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:48.063575 18773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:56790 (request call id 1) took 12083 ms. Trace:
I20260709 12:11:48.063822 18817 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:48.064482 18817 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:48.004688 18827 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:48.070627 18827 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:48.071051 18785 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:47.968056 18835 raft_consensus.cc:2804] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:47.952853 18636 consensus_queue.cc:1048] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.122s
I20260709 12:11:48.074348 18835 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:48.075014 18835 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:48.075596 18849 raft_consensus.cc:2749] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:48.074204 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:47.970566 18814 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:11:48.064216 18773 rpcz_store.cc:276] 0709 12:11:35.987997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:35.988189 (+   192us) service_pool.cc:224] Handling call
0709 12:11:36.105148 (+116959us) log.cc:844] Serialized 506 byte log entry
0709 12:11:37.303109 (+1197961us) spinlock_profiling.cc:243] Waited 43.2 ms on lock 0x7b5400423c20. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f0db26 00007fa927f0749a 00007fa927f06714 00007fa927ee6eaa 00007fa927eedd53 00007fa927eedcd9 00007fa927eedc69 00007fa927eedc31 00007fa927eecdfd 0000000000388634
0709 12:11:37.347091 (+ 43982us) spinlock_profiling.cc:243] Waited 52.8 ms on lock 0x7b5400423c20. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f06142 00007fa927ee6eaa 00007fa927eedd53 00007fa927eedcd9 00007fa927eedc69 00007fa927eedc31 00007fa927eecdfd 0000000000388634 0000000000388479 00007fa924ea0475
0709 12:11:48.063435 (+10716344us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46304,"raft.queue_time_us":53153,"raft.run_cpu_time_us":23365,"raft.run_wall_time_us":2036231,"spinlock_wait_cycles":220708096,"thread_start_us":107404,"threads_started":1,"wal-append.queue_time_us":164668,"wal-append.run_cpu_time_us":2647,"wal-append.run_wall_time_us":1084641}
I20260709 12:11:48.078145 18814 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:48.078634 18814 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:11:48.012065 18801 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:47.890606 18815 consensus_queue.cc:1059] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.091s
I20260709 12:11:48.073462 18827 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:48.081457 18785 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:48.142498 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 182239us
I20260709 12:11:48.142670 18785 raft_consensus.cc:2804] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:48.143572 18785 raft_consensus.cc:697] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:47.982308 18837 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:48.019018 18743 raft_consensus.cc:697] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 13 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:47.967792 18812 consensus_queue.cc:1048] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.170s
I20260709 12:11:48.005059 18844 raft_consensus.cc:2804] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:11:48.214965 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 71101.9us
I20260709 12:11:47.907671 18512 consensus_queue.cc:260] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
W20260709 12:11:48.210882 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 248668us
I20260709 12:11:47.970872 18816 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:48.247258 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:48.248858 13652 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:48.250463 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:48.193310 18837 raft_consensus.cc:3060] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:48.235054 18815 raft_consensus.cc:2804] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:48.234256 18844 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:48.258924 18763 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:48.287618 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:48.288847 13757 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 13.
W20260709 12:11:48.284569 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 471866us
I20260709 12:11:48.304780 13756 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:48.280673 18844 raft_consensus.cc:3060] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:48.328022 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:48.312579 18569 consensus_queue.cc:1048] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 12:11:48.329396 13757 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 18.
I20260709 12:11:48.362653 13756 raft_consensus.cc:1275] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 12. (term mismatch)
I20260709 12:11:48.383075 13756 pending_rounds.cc:85] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting all ops after (but not including) 11
I20260709 12:11:48.383538 13756 pending_rounds.cc:107] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting uncommitted NO_OP operation due to leader change: 12.12
I20260709 12:11:48.385696 13756 raft_consensus.cc:2889] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:48.293256 18763 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:48.391863 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:48.355713 13801 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:48.313900 18812 raft_consensus.cc:2749] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:11:48.351511 18567 consensus_meta.cc:287] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.687s	user 0.014s	sys 0.000s
I20260709 12:11:48.381731 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:48.404801 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 133739us
I20260709 12:11:48.405714 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:48.400777 13756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 1959) took 3815 ms. Trace:
I20260709 12:11:48.407747 13755 raft_consensus.cc:2368] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 16. Current term is 17.
I20260709 12:11:48.409006 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:48.410094 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:11:48.410750 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 161997us
I20260709 12:11:48.412067 13652 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:48.410198 13755 raft_consensus.cc:2410] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:11:48.407480 13756 rpcz_store.cc:276] 0709 12:11:44.571758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:44.799196 (+227438us) service_pool.cc:224] Handling call
0709 12:11:44.895812 (+ 96616us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:47.227716 (+2331904us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b58004466d0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927ee90aa 00007fa927f6b447 00007fa927f83fe7 00007fa927f857de 00007fa927f8fb49 00007fa927f90416 00007fa927f8cd8f 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4
0709 12:11:48.304045 (+1076329us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b54002583a0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f02a1d 00007fa927ee91a4 00007fa927f6b447 00007fa927f83fe7 00007fa927f857de 00007fa927f8fb49 00007fa927f90416 00007fa927f8cd8f 00007fa927f8c83e 00007fa92cf51419
0709 12:11:48.386464 (+ 82419us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:48.386800 (+   336us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3549730304}
I20260709 12:11:48.412387 13726 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:48.414287 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:48.416451 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:48.416020 13756 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 16.
I20260709 12:11:48.414788 13652 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:48.295262 18785 consensus_queue.cc:237] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:48.400704 18625 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 12:11:48.295794 18743 consensus_queue.cc:237] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:48.403640 18569 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:11:48.367781 18849 consensus_queue.cc:1059] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 12:11:48.423107 13652 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:48.421378 13727 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:48.430231 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:48.431941 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:48.438531 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:48.421522 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:48.435384 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:48.439373 13757 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 12.
I20260709 12:11:48.444092 13727 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:48.447542 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:48.448261 13755 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:48.448402 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:48.413790 18567 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:48.425140 18788 raft_consensus.cc:2804] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:11:48.453982 13828 consensus_meta.cc:287] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.506s	user 0.008s	sys 0.004s
I20260709 12:11:48.464855 13828 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 11.
I20260709 12:11:48.452052 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:48.425388 18556 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.425985 18812 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:48.457631 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:48.459233 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:48.458738 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:48.467355 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:48.468179 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:48.468519 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:48.434527 18569 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:48.462482 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:48.417625 18827 consensus_queue.cc:1048] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 12:11:48.475073 14380 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:11:48.478358 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 55398us
W20260709 12:11:48.463425 18818 consensus_meta.cc:287] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.779s	user 0.014s	sys 0.000s
I20260709 12:11:48.451622 18815 raft_consensus.cc:697] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 12 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:48.480697 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:48.456990 18788 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:48.470515 18867 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.492888 13756 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "107415ab6e76484890fa8115e8832a21"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:11:48.472162 18569 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:11:48.479612 18512 ts_tablet_manager.cc:1434] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f: Time spent starting tablet: real 0.799s	user 0.014s	sys 0.001s
W20260709 12:11:48.480398 18853 log.cc:927] Time spent T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.210s	user 0.000s	sys 0.001s
I20260709 12:11:48.438730 18832 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:48.470808 18847 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:11:48.479194 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:48.463881 18567 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:48.489224 18816 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:48.508882 13755 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 18.
I20260709 12:11:48.491406 18818 raft_consensus.cc:2749] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 14. Current term is 15.
I20260709 12:11:48.471958 18817 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:48.482532 18868 raft_consensus.cc:2749] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:48.494153 18788 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:48.513011 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 69051.7us
I20260709 12:11:48.477037 18556 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:48.514108 13828 raft_consensus.cc:1240] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 12:11:48.499359 18864 raft_consensus.cc:2804] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:48.512122 18773 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:48.500854 18512 ts_tablet_manager.cc:1467] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f: Tablet startup took 822ms
I20260709 12:11:48.504019 18847 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:48.531584 14416 raft_consensus.cc:1275] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:48.536754 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:48.538712 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:48.539665 13836 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:48.545964 13762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38932 (request call id 724) took 1454 ms. Trace:
I20260709 12:11:48.546530 13762 rpcz_store.cc:276] 0709 12:11:47.091287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:47.091448 (+   161us) service_pool.cc:224] Handling call
0709 12:11:48.545721 (+1454273us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b540035f2d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:48.545875 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":340475264}
I20260709 12:11:48.512118 18825 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:48.551079 13727 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:11:48.556718 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:48.517963 18871 raft_consensus.cc:2804] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:48.503580 18867 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:48.517640 18816 consensus_queue.cc:1048] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 12:11:48.526913 18864 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:48.512403 18869 consensus_queue.cc:1048] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
W20260709 12:11:48.578560 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 99438.6us
I20260709 12:11:48.586746 18817 leader_election.cc:290] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:48.587441 13727 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:48.614157 13652 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:48.615592 13727 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:48.616003 13652 leader_election.cc:304] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:48.588029 18868 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:11:48.531522 18512 ts_tablet_manager.cc:1469] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f: Trace:
0709 12:11:39.085909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:39.092645 (+  6736us) service_pool.cc:224] Handling call
0709 12:11:39.747204 (+654559us) ts_tablet_manager.cc:934] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f: Initiating tablet copy from peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
0709 12:11:42.548054 (+2800850us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:11:43.153252 (+605198us) tablet_metadata.cc:665] Metadata flushed
0709 12:11:43.153400 (+   148us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:11:43.431572 (+278172us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:11:43.431915 (+   343us) tablet_replica.cc:206] Creating consensus instance
0709 12:11:43.432294 (+   379us) ts_tablet_manager.cc:989] Replica registered.
0709 12:11:43.432440 (+   146us) inbound_call.cc:177] Queueing success response
0709 12:11:44.440973 (+1008533us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:11:47.677931 (+3236958us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:11:47.678575 (+   644us) tablet_replica.cc:261] Starting instrumentation
0709 12:11:47.679304 (+   729us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":56871,"mutex_wait_us":34198,"raft.queue_time_us":6650,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":9257,"tablet-copy.queue_time_us":556972,"tablet-download-pool.queue_time_us":182,"tablet-download-pool.run_cpu_time_us":1149,"tablet-download-pool.run_wall_time_us":467132,"thread_start_us":706312,"threads_started":2}
W20260709 12:11:48.588922 18865 log.cc:927] Time spent T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:11:48.627429 13756 raft_consensus.cc:606] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 LEADER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:48.580140 18871 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:11:48.592054 18778 consensus_meta.cc:287] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.751s	user 0.012s	sys 0.000s
I20260709 12:11:48.592290 18867 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:48.585511 13836 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 17.
I20260709 12:11:48.532984 18847 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:11:48.634177 18778 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:48.634680 18567 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:48.635258 18567 raft_consensus.cc:2749] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:48.635905 18567 raft_consensus.cc:2804] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:48.552939 18832 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:48.548295 18863 log.cc:927] Time spent T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:11:48.639721 18833 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:48.599602 18812 raft_consensus.cc:2749] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:11:48.605067 18814 consensus_meta.cc:287] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.526s	user 0.011s	sys 0.000s
I20260709 12:11:48.532652 18773 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:48.624086 18870 raft_consensus.cc:2804] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:48.626345 18774 consensus_queue.cc:1048] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:48.636296 18567 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:48.636559 18778 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:48.642006 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:48.656925 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:48.657516 13828 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:48.615489 18763 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:48.619463 18770 raft_consensus.cc:2749] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:48.642903 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:48.614851 18864 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:48.621814 18868 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:48.572852 18825 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:48.647830 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:48.648298 13727 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:48.574208 18815 consensus_queue.cc:237] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.4, Last appended by leader: 4, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:48.631388 18871 raft_consensus.cc:3060] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:48.660370 18870 raft_consensus.cc:697] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:11:48.655190 18835 consensus_meta.cc:287] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.580s	user 0.013s	sys 0.000s
I20260709 12:11:48.670125 13828 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 14.
I20260709 12:11:48.648731 18814 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:48.672333 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:48.672827 13832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 2803) took 1419 ms. Trace:
I20260709 12:11:48.673573 14379 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:48.644171 18649 consensus_queue.cc:1059] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 12:11:48.674135 18812 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:48.676436 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:48.654541 18567 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:48.678835 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:48.699420 13688 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:48.679595 13727 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:48.673959 14409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 972) took 1072 ms. Trace:
I20260709 12:11:48.682083 13837 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 13.
I20260709 12:11:48.686332 18858 raft_consensus.cc:2749] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:48.686570 18870 consensus_queue.cc:237] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:48.687371 14379 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:48.687916 18873 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:48.682099 13832 rpcz_store.cc:276] 0709 12:11:47.253799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:47.258232 (+  4433us) service_pool.cc:224] Handling call
0709 12:11:47.799859 (+541627us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:47.814623 (+ 14764us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:48.672630 (+858007us) spinlock_profiling.cc:243] Waited 416 ms on lock 0x7b54000d9150. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:48.672763 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":957304192}
I20260709 12:11:48.698693 13833 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 12.
I20260709 12:11:48.708185 13686 raft_consensus.cc:1275] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:11:48.710352 18812 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:48.665658 18868 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:48.700986 14409 rpcz_store.cc:276] 0709 12:11:47.601966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:47.602149 (+   183us) service_pool.cc:224] Handling call
0709 12:11:48.673702 (+1071553us) spinlock_profiling.cc:243] Waited 67.1 ms on lock 0x7b54005a6c54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:48.673884 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":154331008}
I20260709 12:11:48.726877 13727 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:48.718148 18569 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:48.719499 18825 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:48.720036 18774 raft_consensus.cc:2804] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:48.680291 18770 raft_consensus.cc:2804] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:48.680138 18816 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:48.742429 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:48.739022 18858 raft_consensus.cc:2804] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:48.750396 18798 raft_consensus.cc:2804] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:48.760474 18569 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:48.757421 13835 raft_consensus.cc:2393] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 20: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:48.762944 13688 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 15.
W20260709 12:11:48.764582 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 148692us
I20260709 12:11:48.765934 13652 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:48.769218 18814 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:48.770939 18507 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:48.771293 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:48.771598 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:48.772152 14409 raft_consensus.cc:2393] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 20: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:11:48.764858 18798 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:48.774509 18798 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:48.782830 18567 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:48.684067 18835 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:48.767591 13652 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:11:48.800469 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 49990.6us
I20260709 12:11:48.755023 18774 raft_consensus.cc:697] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:48.763546 18858 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
W20260709 12:11:48.798175 18837 consensus_meta.cc:287] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.529s	user 0.012s	sys 0.000s
I20260709 12:11:48.810987 18883 raft_consensus.cc:2804] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:48.823227 13685 raft_consensus.cc:1240] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:48.865618 18883 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:48.866220 18883 raft_consensus.cc:3060] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:48.867352 18382 raft_consensus.cc:3055] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:48.867771 18382 raft_consensus.cc:740] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:48.755702 18816 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:48.823374 18835 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:48.794471 18801 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:48.770987 18812 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:48.802608 18649 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:48.826541 18788 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:48.755807 18859 consensus_queue.cc:1048] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 12:11:48.801674 14379 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:48.737850 18873 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:48.838579 18858 raft_consensus.cc:3060] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:48.905081 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 163871us
I20260709 12:11:48.784669 18825 consensus_queue.cc:1059] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 12:11:48.905943 13727 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:48.767436 18844 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:48.862676 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:48.910989 13679 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 16.
I20260709 12:11:48.863626 18567 leader_election.cc:290] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:48.864277 18570 raft_consensus.cc:2804] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:48.861832 18841 raft_consensus.cc:3055] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:48.832281 18864 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:48.904592 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 103018us
W20260709 12:11:48.927503 13679 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2733) took 1804 ms (client timeout 1841 ms). Trace:
I20260709 12:11:48.932018 18873 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:48.929827 13679 rpcz_store.cc:269] 0709 12:11:47.106812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:47.109019 (+  2207us) service_pool.cc:224] Handling call
0709 12:11:48.862506 (+1753487us) spinlock_profiling.cc:243] Waited 4.26 ms on lock 0x7b5800002798. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924e68b71 00007fa924e68a22 00007fa92dd818d9 00007fa92cedbee0 00007fa92cfa50ab 00007fa92cfa5131 00007fa92cf530a0 00007fa92cf52984 00007fa9264cd6d4 00007fa9264cd662
0709 12:11:48.911499 (+ 48993us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9788800}
I20260709 12:11:48.908341 18684 raft_consensus.cc:2804] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:11:48.936365 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 89206.5us
I20260709 12:11:48.937367 14411 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 12 LEARNER]: Advancing to term 13
I20260709 12:11:48.937450 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:48.938344 13686 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 13.
I20260709 12:11:48.938786 13761 raft_consensus.cc:1240] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 7. Current term is 8. Ops: [7.7-7.7]
W20260709 12:11:48.938663 13754 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48114 (request call id 2731) took 1925 ms (client timeout 2061 ms). Trace:
W20260709 12:11:48.939276 13754 rpcz_store.cc:269] 0709 12:11:47.013168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:47.037227 (+ 24059us) service_pool.cc:224] Handling call
0709 12:11:48.938430 (+1901203us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b54002ef754. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:48.938596 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":482794752}
I20260709 12:11:48.906641 18770 raft_consensus.cc:697] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:48.862739 18847 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:48.942909 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:48.881757 18801 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:48.902375 18649 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:48.943739 13688 raft_consensus.cc:1240] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:48.876420 18837 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:48.941474 18774 consensus_queue.cc:237] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:48.954424 18718 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:48.959336 18788 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:48.962147 18773 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:48.968912 18816 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:48.969798 18743 raft_consensus.cc:3055] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:48.970285 18743 raft_consensus.cc:740] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:48.971048 18801 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:48.971186 18743 consensus_queue.cc:260] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:48.973687 18743 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:48.974087 18868 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:48.974740 18816 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:48.975345 18816 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:48.976532 18868 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:48.977555 18816 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:48.978387 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:48.978567 18649 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:48.979122 18767 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:48.944799 18684 raft_consensus.cc:697] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 15 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:48.979948 18816 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:48.980350 18864 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:48.980548 18816 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:48.980973 18864 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.979691 18767 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:48.943202 18013 raft_consensus.cc:2804] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:48.982115 18013 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:48.982475 18013 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:48.982796 18816 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:48.983156 18767 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:48.983668 18815 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.983733 18767 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.984393 18815 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:48.984539 18767 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:48.986670 18815 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:48.929112 18841 raft_consensus.cc:740] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:48.928463 18570 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:48.979324 18567 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:48.989259 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:48.997434 13686 raft_consensus.cc:2410] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:11:48.990545 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:48.989005 14379 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:48.998231 13754 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "243ef5a036904f43835a7e29d96599de"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:11:48.998960 13754 raft_consensus.cc:606] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 LEADER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:49.000332 18567 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:49.002729 18567 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:49.003106 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:49.005023 13679 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:11:49.005348 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:49.008400 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:49.000365 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:48.970983 18844 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:49.011492 13681 raft_consensus.cc:1240] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:49.003978 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:49.021842 13682 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 15.
I20260709 12:11:48.987262 18767 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:48.981459 18864 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:49.025316 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:48.987450 18815 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:48.996362 18570 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:49.013253 14411 raft_consensus.cc:2955] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 13 LEARNER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:11:49.036475 14379 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:49.045766 13679 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 17.
I20260709 12:11:49.046911 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:49.050485 13682 raft_consensus.cc:1240] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 12:11:48.995321 18816 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:49.057977 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
W20260709 12:11:49.058737 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:49.062213 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:49.066517 13679 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 12.
I20260709 12:11:49.068773 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:49.069103 13651 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:48.938906 18871 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:49.074008 13651 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:49.076256 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:49.077073 13684 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 10.
I20260709 12:11:49.053699 18734 raft_consensus.cc:2804] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:49.078771 13651 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:49.081944 13754 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:11:49.082662 13754 raft_consensus.cc:606] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 LEADER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:49.060628 18673 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:49.086043 18673 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:49.086521 18673 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:49.069336 18618 raft_consensus.cc:2749] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:49.079550 18734 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:49.094318 18734 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:49.056406 18883 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:49.054622 18815 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:49.103160 18815 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:49.056305 18841 consensus_queue.cc:260] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:49.104792 18841 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:49.067775 18816 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:49.127315 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:49.117614 13687 raft_consensus.cc:2955] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:11:49.106745 18774 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:49.137382 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 369826us
I20260709 12:11:49.138700 13652 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:49.122732 18767 raft_consensus.cc:2749] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:49.149864 18835 raft_consensus.cc:2804] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:11:49.152791 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:49.152688 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:49.076901 18684 consensus_queue.cc:237] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:49.188954 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:49.056664 18770 consensus_queue.cc:237] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:49.198483 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:49.165870 18567 raft_consensus.cc:2804] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:49.199231 13684 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 15.
I20260709 12:11:49.144544 18774 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:49.219305 14412 raft_consensus.cc:2410] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:11:49.222808 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:49.224598 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:11:49.226843 18893 log.cc:927] Time spent T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:11:49.233754 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:49.249238 13684 raft_consensus.cc:2393] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 12: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:49.205425 18567 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:49.221968 18837 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:49.221851 18847 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:49.263229 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:49.280980 13687 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 16.
I20260709 12:11:49.272164 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:49.221344 18798 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:49.218576 18858 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:49.268689 18382 consensus_queue.cc:260] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:49.284457 18382 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:49.267139 18892 log.cc:927] Time spent T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:11:49.255266 18883 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:49.258258 18567 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:49.302333 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:49.303740 13687 raft_consensus.cc:2393] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 16: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
W20260709 12:11:49.306476 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:49.309455 18798 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:49.285611 18013 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:49.312492 18013 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:49.294678 18864 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:49.330161 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:49.331753 18871 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:49.380642 18734 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:49.414925 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:11:49.366966 18897 log.cc:927] Time spent T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 12:11:49.420509 13682 raft_consensus.cc:1240] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:49.424584 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:49.425117 13681 raft_consensus.cc:1240] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:49.425458 13680 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:49.429597 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:49.430472 13681 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 12.
I20260709 12:11:49.388774 18835 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:49.333568 18816 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:49.433480 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:49.435921 18570 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:49.444010 13687 raft_consensus.cc:2393] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 13: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:49.445165 18698 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.406980 18774 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:49.463707 18570 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:49.452119 18698 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:49.441064 18801 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.466627 18529 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:49.466903 18801 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:49.467232 18529 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:49.468391 18698 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:49.435120 13726 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:49.394222 18567 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:49.340086 18556 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:49.458591 13680 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 18.
I20260709 12:11:49.466095 18569 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:49.413949 18789 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:49.478358 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:49.418512 18858 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 9 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:49.489126 13834 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 18.
I20260709 12:11:49.469323 18801 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:49.490058 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 55064.6us
I20260709 12:11:49.490873 13726 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:49.491137 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:49.491670 13759 raft_consensus.cc:1240] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:49.491918 13834 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 13.
I20260709 12:11:49.492833 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:49.494228 13759 raft_consensus.cc:1275] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:49.494074 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:49.495210 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:49.495904 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:49.494149 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:49.497149 13757 raft_consensus.cc:1275] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:49.497709 13758 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 16.
I20260709 12:11:49.499121 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:49.500416 13755 raft_consensus.cc:2393] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 18: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:49.502954 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:49.503300 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:49.505604 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:49.509548 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:49.511148 13755 raft_consensus.cc:1240] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:49.509936 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:49.514823 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:49.517445 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:49.519982 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:49.523284 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:49.524158 13834 raft_consensus.cc:2393] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 16: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:49.526891 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:49.527419 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 62028.9us
I20260709 12:11:49.450549 18835 raft_consensus.cc:3060] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:49.533063 13726 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:49.534408 14413 raft_consensus.cc:1240] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 8. Current term is 9. Ops: []
W20260709 12:11:49.533658 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 59325.2us
I20260709 12:11:49.416373 18673 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:49.533643 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:49.542028 13830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 2811) took 1017 ms. Trace:
I20260709 12:11:49.532015 18801 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:49.535880 13800 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
W20260709 12:11:49.489884 18897 log.cc:927] Time spent T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:11:49.488915 18849 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:49.466559 18699 raft_consensus.cc:3055] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:49.539340 13727 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:49.469373 18529 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:49.540702 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:49.535126 14407 raft_consensus.cc:1240] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 15 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:49.550537 13727 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:49.542492 13830 rpcz_store.cc:276] 0709 12:11:48.524404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:48.526227 (+  1823us) service_pool.cc:224] Handling call
0709 12:11:48.526538 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:48.526758 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:48.527040 (+   282us) log.cc:844] Serialized 14 byte log entry
0709 12:11:49.439692 (+912652us) spinlock_profiling.cc:243] Waited 2.66 ms on lock 0x7b180049dda0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e1ac0a 00007fa92e55a219 00007fa924ea2a40 00007fa924e9d4e4 00007fa924e9d455 00007fa927f85060 00007fa927f97716 00007fa927fa8287 00007fa927fa8208
0709 12:11:49.538441 (+ 98749us) log.cc:844] Serialized 14 byte log entry
0709 12:11:49.541471 (+  3030us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:49.541538 (+    67us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:49.541591 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:49.541658 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:49.541967 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3317,"prepare.queue_time_us":324,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":51,"raft.queue_time_us":921252,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":105,"spinlock_wait_cycles":6120192,"thread_start_us":98008,"threads_started":1}
I20260709 12:11:49.530704 18556 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
W20260709 12:11:49.545812 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 72329.8us
I20260709 12:11:49.522374 18774 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.537515 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:49.561538 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:49.540661 18832 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.554016 13800 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:49.554026 13726 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:49.541663 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:49.538759 18738 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.538935 18868 raft_consensus.cc:2749] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:49.560964 13679 raft_consensus.cc:1240] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:49.561929 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:49.548163 13686 raft_consensus.cc:1275] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 12:11:49.570895 13686 pending_rounds.cc:85] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 10
I20260709 12:11:49.570971 13681 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 18.
I20260709 12:11:49.571273 13686 pending_rounds.cc:107] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 12:11:49.571448 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:49.571660 13686 raft_consensus.cc:2889] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:49.572027 13679 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:49.571965 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:49.565122 13651 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:49.565392 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:49.566396 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:49.555681 18798 raft_consensus.cc:2749] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:49.529433 18569 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:11:49.574677 18832 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:49.566272 18847 consensus_queue.cc:1059] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 12:11:49.586802 18567 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:49.587744 18569 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:49.587932 18832 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:49.555528 18872 raft_consensus.cc:2804] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:11:49.589267 18872 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:49.576471 18850 raft_consensus.cc:2804] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:49.589732 18872 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:11:49.589898 18850 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:49.590469 18850 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:49.576933 13683 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 16.
I20260709 12:11:49.576872 13688 raft_consensus.cc:2393] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 9: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:49.595664 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:49.596593 13688 raft_consensus.cc:2393] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 11: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:49.596644 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:49.569536 13762 raft_consensus.cc:2393] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 13: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:49.553037 18699 raft_consensus.cc:740] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:49.556993 18382 raft_consensus.cc:2804] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:11:49.602216 18905 log.cc:927] Time spent T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 12:11:49.576712 18738 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:49.611817 18734 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:49.612517 18738 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:49.581947 13682 raft_consensus.cc:1275] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:49.553133 18833 raft_consensus.cc:2804] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:49.588829 18673 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:49.599063 13679 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 13.
I20260709 12:11:49.563766 18873 raft_consensus.cc:2749] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:49.602123 18382 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:49.580695 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:49.614814 13835 raft_consensus.cc:1240] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 13. Current term is 14. Ops: []
W20260709 12:11:49.623068 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:49.554842 18355 consensus_queue.cc:1048] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:11:49.633860 13828 raft_consensus.cc:1240] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:49.634493 18699 consensus_queue.cc:260] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:49.635958 18699 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:49.636317 13828 raft_consensus.cc:1240] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:49.593056 18871 raft_consensus.cc:2749] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:49.638597 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:11:49.639897 18882 log.cc:927] Time spent T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.707s	user 0.005s	sys 0.000s
I20260709 12:11:49.627538 13684 raft_consensus.cc:1240] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:11:49.643182 13828 raft_consensus.cc:1275] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:49.643808 13652 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:49.629943 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:49.638852 13801 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:49.645466 13835 raft_consensus.cc:2393] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 20: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:49.647011 13726 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:49.555332 18849 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:49.648058 18798 raft_consensus.cc:2749] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:49.650307 18849 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:49.651630 13761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 726) took 2550 ms. Trace:
I20260709 12:11:49.652063 13761 rpcz_store.cc:276] 0709 12:11:47.100964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:47.102827 (+  1863us) service_pool.cc:224] Handling call
0709 12:11:48.938554 (+1835727us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:48.939243 (+   689us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:49.651458 (+712215us) spinlock_profiling.cc:243] Waited 1.84 s on lock 0x7b54002ef750. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:49.651574 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4220755200}
I20260709 12:11:49.660490 13830 raft_consensus.cc:1240] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:49.567145 18556 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:49.663388 13682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "407aabb01908409185c74e2349da4c3d"
dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:58662
I20260709 12:11:49.664145 13682 raft_consensus.cc:606] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:49.664191 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:49.664615 13682 raft_consensus.cc:614] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:11:49.665277 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 100506us
I20260709 12:11:49.569006 18774 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:49.666891 13828 raft_consensus.cc:2368] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 19. Current term is 20.
I20260709 12:11:49.625030 18833 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:49.669849 13726 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:49.670264 14412 raft_consensus.cc:1275] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:11:49.670497 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:49.671489 13828 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:49.642256 18382 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:49.674039 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:49.676229 13830 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:49.678176 13727 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:49.679484 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:49.680212 13835 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 13.
I20260709 12:11:49.672362 18833 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:49.679898 18013 raft_consensus.cc:2804] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:49.682144 18013 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:49.682543 18013 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:11:49.666918 18909 log.cc:927] Time spent T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 12:11:49.689018 18634 consensus_queue.cc:1059] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:49.689543 17977 raft_consensus.cc:2749] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:49.679927 18841 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:49.690810 18841 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:49.659446 18570 raft_consensus.cc:2804] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:49.693843 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:49.694932 14411 raft_consensus.cc:2368] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 19. Current term is 20.
I20260709 12:11:49.690222 18634 raft_consensus.cc:3055] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:11:49.699517 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:49.743530 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:49.713064 13760 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 14.
I20260709 12:11:49.742347 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:11:49.742734 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 61637.5us
W20260709 12:11:49.743782 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 62605.4us
I20260709 12:11:49.746371 13828 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 14.
I20260709 12:11:49.755340 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:49.756299 14379 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:49.759641 13828 raft_consensus.cc:1275] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 12:11:49.693663 18914 log.cc:927] Time spent T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:11:49.768505 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:49.769747 13686 raft_consensus.cc:1240] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:49.772094 14412 raft_consensus.cc:1240] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:11:49.773083 14414 raft_consensus.cc:3055] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:49.773469 14414 raft_consensus.cc:740] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:49.772122 13679 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:49.777078 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:49.778075 13761 raft_consensus.cc:2410] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:11:49.779574 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:49.780124 14412 raft_consensus.cc:1217] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Deduplicated request from leader. Original: 11.10->[12.11-12.11]   Dedup: 12.11->[]
I20260709 12:11:49.743373 18618 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.786619 13679 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 14.
I20260709 12:11:49.754284 18825 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.782024 14412 raft_consensus.cc:1240] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:11:49.783291 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:49.743196 18570 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:49.743440 18634 raft_consensus.cc:740] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:49.786911 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:49.783164 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:49.788404 13761 raft_consensus.cc:2393] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 16: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:49.789175 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:11:49.792137 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:49.795106 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:49.795657 13754 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:11:49.796703 14413 raft_consensus.cc:2393] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 16: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:11:49.794129 13726 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:49.797474 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:49.792815 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:49.800854 13758 raft_consensus.cc:1240] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 LEADER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:49.800556 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:49.801702 13828 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 11.
I20260709 12:11:49.803812 13685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 844) took 1128 ms. Trace:
I20260709 12:11:49.772886 18684 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:49.804168 13685 rpcz_store.cc:276] 0709 12:11:48.675230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:48.679334 (+  4104us) service_pool.cc:224] Handling call
0709 12:11:48.698754 (+ 19420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:48.865698 (+166944us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:49.803650 (+937952us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b54003115d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:49.803768 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":285753088}
I20260709 12:11:49.790297 14414 consensus_queue.cc:260] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:49.777145 18816 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.759233 18673 consensus_queue.cc:1059] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 12:11:49.810232 13758 raft_consensus.cc:1240] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 12:11:49.806543 14414 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:49.790203 18570 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:49.814103 13758 raft_consensus.cc:1275] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:11:49.815793 13754 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 20.
I20260709 12:11:49.816972 13758 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "b98d2519bb504dc6905ed2ede4571835"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:11:49.817629 13758 raft_consensus.cc:606] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Received request to transfer leadership to TS b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:49.818730 18556 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:49.818987 18774 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:49.819365 18626 consensus_queue.cc:1048] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:49.820067 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:49.820685 13763 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:49.822084 18673 raft_consensus.cc:3055] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:49.793401 18618 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:49.822548 18673 raft_consensus.cc:740] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:49.823581 18673 consensus_queue.cc:260] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:49.824352 18618 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:49.824975 18673 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:49.822086 13773 tablet_copy_service.cc:342] P 3f37c9cc9dda46b4be21dd675ba78fb7: Request end of tablet copy session ca9fbbc2c0a94897897d502d42f3951f-d2f365337b324999a073edacbe6c6e09 received from {username='slave'} at 127.0.0.1:38932
I20260709 12:11:49.826122 13755 raft_consensus.cc:1240] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:49.826454 13773 tablet_copy_service.cc:434] P 3f37c9cc9dda46b4be21dd675ba78fb7: ending tablet copy session ca9fbbc2c0a94897897d502d42f3951f-d2f365337b324999a073edacbe6c6e09 on tablet d2f365337b324999a073edacbe6c6e09 with peer ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:49.826718 18887 raft_consensus.cc:2804] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:49.827257 18887 raft_consensus.cc:697] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:49.827414 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:49.780977 17977 consensus_queue.cc:1048] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 12:11:49.828326 13756 raft_consensus.cc:2393] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 20: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:49.828285 18887 consensus_queue.cc:237] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:49.798004 18825 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:49.805491 18770 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.831251 18770 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:49.832198 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:49.832870 14407 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 9.
I20260709 12:11:49.833585 18770 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:49.822136 13762 raft_consensus.cc:1240] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 LEADER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:49.834056 18850 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:49.836449 18850 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:49.838508 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:49.840704 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:49.841495 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:49.841876 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:49.842546 13727 leader_election.cc:400] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 election: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 19. Current term is 20.
I20260709 12:11:49.846467 13727 leader_election.cc:403] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 12:11:49.847990 13683 raft_consensus.cc:2393] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 14: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:11:49.818078 13758 raft_consensus.cc:614] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:49.831910 18835 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:49.844727 13761 raft_consensus.cc:1240] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:49.843637 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:49.844161 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:49.852905 13759 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 13.
I20260709 12:11:49.849551 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:49.850417 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:49.847347 18556 consensus_queue.cc:1048] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 12:11:49.847260 18763 consensus_queue.cc:1059] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:11:49.856746 14407 raft_consensus.cc:2393] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 9: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:11:49.864687 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:49.871598 13759 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 8.
I20260709 12:11:49.872144 13754 raft_consensus.cc:1275] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:49.868614 13763 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 13.
I20260709 12:11:49.815177 18816 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:49.875494 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:49.883174 13760 raft_consensus.cc:2376] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 13. Re-sending same reply.
I20260709 12:11:49.890661 13680 raft_consensus.cc:1240] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:49.891741 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:49.895264 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:49.895998 13836 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 14.
I20260709 12:11:49.896772 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:49.896917 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:49.897639 14407 raft_consensus.cc:2393] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 14: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:11:49.900170 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:49.900861 13831 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 12.
I20260709 12:11:49.902622 14414 raft_consensus.cc:1275] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:49.903162 14407 raft_consensus.cc:1240] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:49.877411 18847 raft_consensus.cc:2749] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 19. Current term is 20.
W20260709 12:11:49.916013 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:49.883226 18841 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:49.920534 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:49.922178 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:49.921610 13763 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:49.926755 18777 raft_consensus.cc:3055] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:49.927251 18777 raft_consensus.cc:740] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:49.927673 18382 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:49.928961 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:49.935504 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:49.924674 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:49.936584 13681 raft_consensus.cc:2410] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:11:49.944440 13727 leader_election.cc:400] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 election: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 19. Current term is 20.
I20260709 12:11:49.944576 13760 raft_consensus.cc:1240] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:49.945623 13727 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:49.947909 13651 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:49.949915 18841 consensus_queue.cc:1059] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:11:49.951053 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:49.952066 18567 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:49.952737 18567 consensus_queue.cc:1048] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:49.953474 13651 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:49.967590 13763 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 14.
I20260709 12:11:49.968422 13651 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:49.955226 13652 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:49.976392 13727 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:49.854256 18634 consensus_queue.cc:260] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:49.980921 13727 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
W20260709 12:11:49.983429 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:49.945642 18382 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:49.985690 13681 raft_consensus.cc:1240] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:49.928082 18777 consensus_queue.cc:260] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:49.984920 18870 raft_consensus.cc:2749] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:49.986265 18850 raft_consensus.cc:2804] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:49.974169 18872 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:50.003644 18634 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:49.985147 18770 raft_consensus.cc:2804] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:50.003671 18684 consensus_queue.cc:1059] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 12:11:50.005937 13830 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 13.
I20260709 12:11:49.988925 18774 consensus_queue.cc:1048] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 12:11:50.032836 14379 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:50.004769 18777 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:50.044770 13727 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:50.045338 14379 leader_election.cc:304] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:50.014297 18770 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:50.014164 18570 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:50.031293 18567 raft_consensus.cc:2804] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:50.019295 18850 raft_consensus.cc:697] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:50.064337 18850 consensus_queue.cc:237] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:50.054069 13727 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:50.048707 18684 consensus_queue.cc:1243] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer 3f37c9cc9dda46b4be21dd675ba78fb7 log is divergent from this leader: its last log entry 11.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:11:50.052737 18770 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:50.068671 18871 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:50.062629 13681 raft_consensus.cc:1275] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:11:50.056095 18626 raft_consensus.cc:2804] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:50.070204 18626 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:50.070577 18626 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:50.074136 18567 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:50.074774 18567 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:50.076263 18825 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:50.095312 18570 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:50.097333 13727 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:50.080787 18770 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:50.082984 18872 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:50.101351 18770 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:50.015012 18734 consensus_queue.cc:1059] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 12:11:50.102420 18734 raft_consensus.cc:3055] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:50.102823 18734 raft_consensus.cc:740] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:50.102866 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:50.103605 13831 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 14.
I20260709 12:11:50.103770 18734 consensus_queue.cc:260] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:50.104619 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:50.105227 13834 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:11:50.105312 18734 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:50.118698 14379 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:11:50.121167 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:50.051468 18858 consensus_queue.cc:1048] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 12:11:50.083060 18815 raft_consensus.cc:2804] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:50.048547 18618 raft_consensus.cc:2804] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:50.091382 18013 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:50.049433 18835 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:50.130275 14407 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 14.
I20260709 12:11:50.094760 18847 raft_consensus.cc:993] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7: : Instructing follower 96701a74fdee481fb5f54aac841e17dd to start an election
I20260709 12:11:50.053514 18636 raft_consensus.cc:2804] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:50.108302 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:50.109975 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:50.012864 18845 consensus_queue.cc:1048] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 12:11:50.110188 18833 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:50.112493 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 560159us
I20260709 12:11:50.120838 18382 raft_consensus.cc:2804] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:50.114950 18355 raft_consensus.cc:2749] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:11:50.115154 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 476325us
I20260709 12:11:50.127664 18618 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:50.148715 13801 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:50.117977 13834 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 19.
I20260709 12:11:50.121039 18718 consensus_queue.cc:1059] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 12:11:50.125936 18684 consensus_queue.cc:1059] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:50.126495 18815 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:50.128520 18673 raft_consensus.cc:2804] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:50.126600 18785 consensus_queue.cc:1048] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:11:50.141577 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 173218us
W20260709 12:11:50.142385 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 187241us
I20260709 12:11:50.114298 18913 raft_consensus.cc:2764] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:11:50.124017 18870 raft_consensus.cc:2804] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:50.165855 18846 raft_consensus.cc:1081] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 LEADER]: Signalling peer 96701a74fdee481fb5f54aac841e17dd to start an election
I20260709 12:11:50.150172 13801 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:50.167999 13801 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:50.168205 18355 raft_consensus.cc:2749] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:50.152629 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:50.152663 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:50.153679 18699 raft_consensus.cc:2749] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:50.163472 13651 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:50.165967 18870 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:50.144773 13800 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:50.170509 13830 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:50.145334 18382 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:50.153858 18798 consensus_queue.cc:1059] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.011s
I20260709 12:11:50.199180 18798 raft_consensus.cc:3055] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:50.199743 18798 raft_consensus.cc:740] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:11:50.200460 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 55786us
I20260709 12:11:50.213717 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:50.156778 18815 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:50.150207 18618 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:50.198331 18382 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:50.202070 13800 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
W20260709 12:11:50.245630 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 43641.6us
I20260709 12:11:50.147464 18529 consensus_queue.cc:1048] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 12:11:50.247380 13800 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:50.190274 13652 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:50.201354 18870 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:50.252067 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:50.255386 18699 raft_consensus.cc:2764] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader election decision vote started in defunct term 18: won
I20260709 12:11:50.256093 18887 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:50.256328 13834 raft_consensus.cc:1275] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:11:50.239742 18569 raft_consensus.cc:2804] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:11:50.251291 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 108458us
I20260709 12:11:50.258388 13682 raft_consensus.cc:1240] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 12:11:50.301234 13726 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:50.308082 13726 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:50.259380 18833 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:50.259732 13757 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "b98d2519bb504dc6905ed2ede4571835"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:11:50.236038 13830 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 14.
I20260709 12:11:50.260754 18927 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:50.301931 18569 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:50.267263 18013 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:50.174446 18835 consensus_queue.cc:1059] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.095s
I20260709 12:11:50.326318 18846 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.272258 18871 raft_consensus.cc:2749] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:50.326995 18846 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:50.275104 18798 consensus_queue.cc:260] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:50.329089 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:50.329967 13756 raft_consensus.cc:2393] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 8: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:50.330161 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:50.330926 13758 raft_consensus.cc:2393] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 8: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:50.330828 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:50.203529 18570 raft_consensus.cc:2804] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:50.331667 18570 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:50.332036 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:50.230377 18832 consensus_queue.cc:1059] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 12:11:50.333729 18832 raft_consensus.cc:3055] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:50.253670 18913 raft_consensus.cc:2804] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:50.203198 18869 consensus_queue.cc:1048] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.080s
W20260709 12:11:50.266975 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 139042us
I20260709 12:11:50.311288 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:50.309484 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:50.315727 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:50.336422 13754 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 9.
I20260709 12:11:50.336720 13759 raft_consensus.cc:3060] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:50.304953 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:50.294263 13685 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:11:50.265745 18567 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:50.300273 18887 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:50.300624 18626 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:50.345691 18567 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:50.347941 18626 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:50.261420 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 71192.6us
W20260709 12:11:50.350514 13634 auto_rebalancer.cc:629] Failed to schedule move for tablet 1d3056e0d375412a9db3769da3ef2eb9: Illegal state: Replica b98d2519bb504dc6905ed2ede4571835 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:11:50.353832 13762 raft_consensus.cc:1240] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:11:50.332222 18570 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:50.354794 18382 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:50.357271 18382 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:50.358168 18872 raft_consensus.cc:1064] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7: attempting to promote NON_VOTER ca9fbbc2c0a94897897d502d42f3951f to VOTER
I20260709 12:11:50.258970 13800 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:50.250293 18636 raft_consensus.cc:697] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 13 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
W20260709 12:11:50.363476 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:50.314554 18934 raft_consensus.cc:2749] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:50.334247 18832 raft_consensus.cc:740] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
W20260709 12:11:50.378165 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:50.326321 18569 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:50.335548 18913 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:50.413092 13757 raft_consensus.cc:606] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Received request to transfer leadership to TS b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:50.420337 13757 raft_consensus.cc:614] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:50.401750 13754 raft_consensus.cc:1240] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:11:50.404100 13652 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:50.404171 13763 raft_consensus.cc:1240] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 LEADER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 10. Current term is 11. Ops: []
W20260709 12:11:50.405870 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:50.370659 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 111760us
I20260709 12:11:50.381152 13759 raft_consensus.cc:2468] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 14.
I20260709 12:11:50.413827 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:50.427177 13800 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:50.327154 18868 raft_consensus.cc:2749] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:50.390136 18699 raft_consensus.cc:2749] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:50.365607 18887 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:50.428570 13761 raft_consensus.cc:1240] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 12:11:50.396426 18355 raft_consensus.cc:2749] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:50.431651 18873 raft_consensus.cc:3055] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:50.364636 18634 consensus_queue.cc:1059] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.061s
I20260709 12:11:50.450417 13581 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53318 (request call id 145) took 9217 ms. Trace:
I20260709 12:11:50.445555 13800 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:50.409948 18913 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:50.382684 18567 raft_consensus.cc:3055] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:50.442974 18833 raft_consensus.cc:2749] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:50.456074 13800 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:50.369915 18618 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:50.443819 18927 raft_consensus.cc:2804] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:50.473594 13800 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:50.475474 13800 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:50.449998 18873 raft_consensus.cc:740] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:50.396342 18858 consensus_queue.cc:1048] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.057s
I20260709 12:11:50.454646 18673 raft_consensus.cc:697] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 14 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:50.456876 18699 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:11:50.457340 18567 raft_consensus.cc:740] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
W20260709 12:11:50.514443 13634 auto_rebalancer.cc:629] Failed to schedule move for tablet 14d7a26ca33940fbba5fa30c5212e5ac: Illegal state: Replica b98d2519bb504dc6905ed2ede4571835 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
W20260709 12:11:50.527494 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 98728.1us
I20260709 12:11:50.528709 18846 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:50.530004 18870 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:50.482482 18738 raft_consensus.cc:2804] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:50.531438 18738 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:50.531880 18738 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:50.532516 18870 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:50.521451 18940 consensus_queue.cc:1059] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 12:11:50.533430 13760 raft_consensus.cc:1240] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:50.457787 18838 consensus_queue.cc:1059] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 12:11:50.525038 18570 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:50.486824 18844 raft_consensus.cc:2804] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:50.509276 18927 raft_consensus.cc:697] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 14 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:50.519356 18673 consensus_queue.cc:237] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:50.528756 18932 log.cc:927] Time spent T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:11:50.452668 13581 rpcz_store.cc:276] 0709 12:11:41.228750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:41.229879 (+  1129us) service_pool.cc:224] Handling call
0709 12:11:50.444895 (+9215016us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:45.764076 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:45.839301 (+ 75225us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:45.839508 (+   207us) write_op.cc:435] Acquired schema lock
0709 12:11:45.839524 (+    16us) tablet.cc:662] Decoding operations
0709 12:11:45.953482 (+113958us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:45.962383 (+  8901us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:45.967379 (+  4996us) tablet.cc:685] Acquiring locks for 14 operations
0709 12:11:46.519905 (+552526us) tablet.cc:701] Row locks acquired
0709 12:11:46.536722 (+ 16817us) write_op.cc:260] PREPARE: finished
0709 12:11:46.597746 (+ 61024us) write_op.cc:270] Start()
0709 12:11:46.680950 (+ 83204us) write_op.cc:276] Timestamp: P: 1783599106579197 usec, L: 0
0709 12:11:46.680989 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 12:11:46.681886 (+   897us) log.cc:844] Serialized 5516 byte log entry
0709 12:11:47.919012 (+1237126us) op_driver.cc:464] REPLICATION: finished
0709 12:11:48.389422 (+470410us) write_op.cc:301] APPLY: starting
0709 12:11:48.401833 (+ 12411us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:48.820524 (+418691us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:48.820669 (+   145us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:49.563615 (+742946us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:49.587781 (+ 24166us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=28,mrs_lookups=0
0709 12:11:49.587831 (+    50us) write_op.cc:312] APPLY: finished
0709 12:11:49.588194 (+   363us) log.cc:844] Serialized 129 byte log entry
0709 12:11:49.777411 (+189217us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:49.794095 (+ 16684us) write_op.cc:454] Released schema lock
0709 12:11:49.803356 (+  9261us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:49.829446 (+ 26090us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:49.829479 (+    33us) write_op.cc:454] Released schema lock
0709 12:11:50.097098 (+267619us) spinlock_profiling.cc:243] Waited 27.1 ms on lock 0x7b18004891c0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924ea03f3 00007fa924ea27c1 00007fa924ea2779 00007fa924ea2709 00007fa924ea26d1 00007fa924ea19cd 0000000000388634 0000000000388479 00007fa924e8383a
Metrics: {"mutex_wait_us":2250146,"reported_tablets":20,"child_traces":[["op",{"apply.queue_time_us":430323,"apply.run_cpu_time_us":62638,"apply.run_wall_time_us":1445448,"cfile_cache_hit":58,"cfile_cache_hit_bytes":62647,"num_ops":14,"prepare.queue_time_us":92403,"prepare.run_cpu_time_us":44558,"prepare.run_wall_time_us":1864612,"raft.queue_time_us":246154,"raft.run_cpu_time_us":46358,"raft.run_wall_time_us":365268,"replication_time_us":1237806,"spinlock_wait_cycles":62434048,"thread_start_us":1690296,"threads_started":5,"wal-append.queue_time_us":977017,"wal-append.run_cpu_time_us":46240,"wal-append.run_wall_time_us":1515731}]]}
I20260709 12:11:50.471016 18636 consensus_queue.cc:237] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:50.518148 18833 raft_consensus.cc:2749] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:50.526118 18815 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:50.569048 18815 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:50.566529 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 140143us
I20260709 12:11:50.572009 14379 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:50.574424 13680 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 14.
I20260709 12:11:50.541266 18844 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:50.458782 18832 consensus_queue.cc:260] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:50.590200 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 44610.3us
W20260709 12:11:50.595407 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 120019us
I20260709 12:11:50.597043 13800 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:50.598791 13800 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:50.600317 14380 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:50.601632 14380 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:50.602424 13685 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 19.
I20260709 12:11:50.574388 18858 raft_consensus.cc:3055] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:50.575677 18940 raft_consensus.cc:3055] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:50.588819 18844 raft_consensus.cc:3060] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:50.578567 18928 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:50.564390 18567 consensus_queue.cc:260] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:50.618341 18941 raft_consensus.cc:2749] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:11:50.618824 18939 raft_consensus.cc:2749] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:11:50.620311 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 468014us
I20260709 12:11:50.544188 18873 consensus_queue.cc:260] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:50.621052 13727 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:50.621408 18873 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:50.629920 18927 consensus_queue.cc:237] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:50.631265 18816 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:50.632241 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:11:50.634660 13727 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:50.602982 18699 raft_consensus.cc:697] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 20 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:50.635936 13727 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:50.636348 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:50.639420 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:50.607477 18858 raft_consensus.cc:740] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:50.610845 18845 raft_consensus.cc:2749] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:50.633674 18817 raft_consensus.cc:3055] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:50.597888 18684 consensus_queue.cc:1059] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 12:11:50.644908 13727 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:50.613174 18940 raft_consensus.cc:740] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:50.676874 14412 raft_consensus.cc:1275] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:50.642344 18763 raft_consensus.cc:2749] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:50.658849 18816 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.683233 18816 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:50.670324 18817 raft_consensus.cc:740] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:50.676378 18950 raft_consensus.cc:2749] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:50.634274 18928 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:50.686909 18940 consensus_queue.cc:260] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:50.688216 18940 raft_consensus.cc:3060] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:50.688445 18928 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:50.671525 18618 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 9 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:11:50.691370 18734 consensus_meta.cc:287] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.566s	user 0.011s	sys 0.000s
I20260709 12:11:50.692768 18570 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:50.613618 18718 consensus_queue.cc:1059] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 12:11:50.689651 18937 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.614017 18634 consensus_queue.cc:1059] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 12:11:50.679958 18838 raft_consensus.cc:2749] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:50.698556 18937 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:50.689505 18858 consensus_queue.cc:260] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:50.724661 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:50.646454 18885 raft_consensus.cc:2804] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:11:50.671231 18567 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:50.685585 18816 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:50.676146 18825 raft_consensus.cc:2804] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:50.736460 18825 raft_consensus.cc:697] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:50.737510 18825 consensus_queue.cc:237] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:50.700533 18933 raft_consensus.cc:3055] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:50.727988 18950 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.741982 18382 consensus_queue.cc:1048] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:50.742354 18950 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:50.744709 18950 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:50.741932 18933 raft_consensus.cc:740] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:50.747983 18933 consensus_queue.cc:260] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:50.689589 18569 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:50.748612 18738 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:50.750195 18933 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:50.750770 18569 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:50.735538 18885 raft_consensus.cc:697] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:50.643263 18770 raft_consensus.cc:2804] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:50.746626 18844 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:50.754716 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 182824us
I20260709 12:11:50.756283 14379 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:50.762804 14379 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:50.678879 18699 consensus_queue.cc:237] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:50.771699 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 170092us
W20260709 12:11:50.776819 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:50.781545 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:50.793890 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:50.794627 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:50.803835 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:50.804821 13761 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:50.764684 18947 raft_consensus.cc:2749] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:50.645272 18946 consensus_queue.cc:1048] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.149s
I20260709 12:11:50.763916 18770 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:50.819955 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:50.765028 18673 raft_consensus.cc:2749] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:50.820762 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:50.821213 14414 raft_consensus.cc:2468] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 14.
I20260709 12:11:50.870198 13761 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 9.
W20260709 12:11:50.870790 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 272085us
I20260709 12:11:50.871191 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:50.827052 14415 raft_consensus.cc:2368] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 8. Current term is 9.
I20260709 12:11:50.823167 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:50.872212 13682 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:50.875372 14379 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:50.753610 18913 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:50.881269 13800 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:50.823788 18718 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.818966 18858 raft_consensus.cc:3060] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:50.887375 13800 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:50.821404 18770 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:50.814821 18734 consensus_queue.cc:1059] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.069s
I20260709 12:11:50.821622 18816 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:11:50.920250 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:50.943567 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 151197us
W20260709 12:11:50.946202 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 58970.6us
I20260709 12:11:50.946998 13800 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:50.878868 18954 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:50.890882 18947 raft_consensus.cc:2804] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:50.944486 13682 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 9.
I20260709 12:11:50.890208 18950 raft_consensus.cc:2749] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:50.883023 18845 consensus_queue.cc:1059] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 12:11:50.815577 18953 consensus_queue.cc:1048] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.152s
I20260709 12:11:50.950802 13800 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:50.949472 18838 raft_consensus.cc:2749] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:50.967724 13652 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:50.970129 13652 leader_election.cc:400] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 election: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 8. Current term is 9.
I20260709 12:11:50.970602 13652 leader_election.cc:403] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:11:50.970968 13800 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:50.951817 18734 consensus_queue.cc:1243] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer 3f37c9cc9dda46b4be21dd675ba78fb7 log is divergent from this leader: its last log entry 11.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:11:50.954617 18952 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:50.997946 18952 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:51.003085 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:50.980813 13800 leader_election.cc:304] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:50.966691 18927 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:50.982007 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:50.949208 18885 consensus_queue.cc:237] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:50.954427 18954 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:50.896996 18718 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:50.989979 18570 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 8. Current term is 9.
I20260709 12:11:50.974530 18951 raft_consensus.cc:2749] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:51.022358 18951 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:50.952644 18816 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:51.023712 18954 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:50.991464 18913 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:50.965939 18738 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:50.992028 18844 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:50.993981 18770 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:51.015211 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.028610 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:51.029352 13682 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 11.
I20260709 12:11:50.979722 18873 raft_consensus.cc:2804] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:51.030195 18873 raft_consensus.cc:697] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 14 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:51.030350 18844 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:51.031013 18844 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:51.031076 18817 consensus_queue.cc:260] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:51.018103 14409 raft_consensus.cc:2393] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 14: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:51.019901 13800 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:50.965312 18947 raft_consensus.cc:697] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 9 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
W20260709 12:11:51.022480 18957 log.cc:927] Time spent T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:11:51.033496 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:50.998833 18952 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:51.032305 18816 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:51.034675 14379 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:51.000108 18950 raft_consensus.cc:2749] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:51.043067 13800 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:51.051617 13800 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:51.028694 18770 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:51.059140 18832 raft_consensus.cc:3060] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:51.060007 18817 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:51.094846 18937 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:51.058751 18569 raft_consensus.cc:2804] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:51.086714 18947 consensus_queue.cc:237] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:51.052861 18825 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:51.097278 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 45704.5us
I20260709 12:11:51.050226 18954 raft_consensus.cc:2804] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:51.100039 14412 raft_consensus.cc:2468] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 12.
I20260709 12:11:51.103507 18816 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:51.020656 18927 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:51.123068 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.127806 13800 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:51.031194 18873 consensus_queue.cc:237] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:51.123208 18958 log.cc:927] Time spent T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 12:11:51.060828 18966 raft_consensus.cc:2749] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:51.102520 18913 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:51.125114 18569 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:51.152957 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:51.160681 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:51.167655 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:51.169826 13830 raft_consensus.cc:2368] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 18. Current term is 19.
I20260709 12:11:51.169698 13828 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 11.
I20260709 12:11:51.171959 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:51.130393 18954 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:51.165838 18623 raft_consensus.cc:993] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7: : Instructing follower 96701a74fdee481fb5f54aac841e17dd to start an election
I20260709 12:11:51.175314 13835 raft_consensus.cc:1240] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:11:51.146572 18838 raft_consensus.cc:2749] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:51.142354 17977 raft_consensus.cc:3055] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:11:51.179196 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.168397 18569 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:51.186350 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:51.133415 18825 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:51.187398 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:51.188727 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:51.190254 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:51.190843 13828 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 11.
I20260709 12:11:51.190898 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:51.191668 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:51.192341 13833 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:51.188906 13830 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:51.187281 13835 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 10.
I20260709 12:11:51.194854 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:51.181275 18954 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:51.181847 17977 raft_consensus.cc:740] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:51.143992 18816 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:51.207882 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:51.208010 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:51.208084 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:51.213336 13833 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 11.
I20260709 12:11:51.206045 18718 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:51.215644 13830 raft_consensus.cc:2468] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 12.
I20260709 12:11:51.216670 14411 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 11.
I20260709 12:11:51.208925 13829 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 13.
I20260709 12:11:51.218528 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:51.220167 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:51.221612 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:51.202364 18844 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:51.222481 13830 raft_consensus.cc:2393] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 12: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:51.207033 18937 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.224403 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:51.225666 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:51.226622 13830 raft_consensus.cc:2393] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 13: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:51.226707 13829 raft_consensus.cc:2393] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 11: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:51.219987 18951 raft_consensus.cc:2749] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:51.229831 18968 raft_consensus.cc:1081] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 LEADER]: Signalling peer 96701a74fdee481fb5f54aac841e17dd to start an election
I20260709 12:11:51.240003 18927 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:51.232527 18955 log.cc:927] Time spent T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.553s	user 0.002s	sys 0.000s
I20260709 12:11:51.233019 17977 consensus_queue.cc:260] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:51.246495 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:51.252923 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:51.254016 13836 raft_consensus.cc:2393] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 14: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
W20260709 12:11:51.254607 18969 log.cc:927] Time spent T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:11:51.252022 18952 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:51.257014 18816 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:51.257162 18833 raft_consensus.cc:3055] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:51.257403 18952 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:51.257604 18833 raft_consensus.cc:740] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:51.258077 18934 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:51.258670 18934 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:51.259336 13836 raft_consensus.cc:1275] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 10 index: 4. Preceding OpId from leader: term: 12 index: 5. (index mismatch)
I20260709 12:11:51.258792 18833 consensus_queue.cc:260] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:51.260650 18833 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:51.260824 18934 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:51.240775 18937 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:51.262127 18798 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:51.263935 13836 raft_consensus.cc:1240] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 11. Current term is 12. Ops: []
W20260709 12:11:51.264815 18959 log.cc:927] Time spent T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.490s	user 0.002s	sys 0.000s
I20260709 12:11:51.264919 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:51.266661 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:51.275571 13830 raft_consensus.cc:2393] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 17: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:51.267371 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:51.276503 13828 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 15.
I20260709 12:11:51.267428 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:51.277988 13835 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 15.
I20260709 12:11:51.273169 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:51.279373 13832 raft_consensus.cc:2393] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 14: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:51.280536 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:51.281440 13834 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 12.
I20260709 12:11:51.267459 17977 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:51.283541 18774 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.284204 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:11:51.300073 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.309624 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:51.312099 13830 raft_consensus.cc:2393] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 13: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:51.297734 18954 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:51.339529 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:51.302641 18774 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:51.343755 13651 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:51.330291 18529 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:51.346496 13651 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:51.339886 18825 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:51.356130 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:51.351553 18529 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:51.351744 18871 raft_consensus.cc:2804] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:51.359138 18871 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:51.359609 18871 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:51.360270 18529 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:51.361979 18825 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:51.350682 18816 raft_consensus.cc:2749] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:51.363574 18937 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:51.364451 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 326545us
W20260709 12:11:51.365139 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.366052 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:51.369240 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:51.369607 13833 raft_consensus.cc:2468] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 9.
I20260709 12:11:51.370872 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:51.371196 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:51.371647 13759 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 15.
I20260709 12:11:51.371948 13685 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 12.
I20260709 12:11:51.372579 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:51.372824 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:51.373061 13801 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:51.374145 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:51.374312 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:51.374923 13754 raft_consensus.cc:2368] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 14. Current term is 15.
I20260709 12:11:51.375249 13685 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 11.
I20260709 12:11:51.374145 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:51.376185 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:51.376506 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:51.377377 13685 raft_consensus.cc:2393] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 12: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:51.370888 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:51.380184 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:51.380944 13680 raft_consensus.cc:2393] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 17: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:51.382566 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:51.382755 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:51.383700 13683 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 14.
I20260709 12:11:51.383915 13759 raft_consensus.cc:2393] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 14: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:51.376220 13830 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 16.
I20260709 12:11:51.376868 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:51.373296 13686 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 14.
I20260709 12:11:51.387257 13687 raft_consensus.cc:2393] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 12: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:51.388581 13687 raft_consensus.cc:1275] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:11:51.388962 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:51.366154 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:51.391021 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:51.391652 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:51.392373 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:51.392580 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:51.392846 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:51.356896 13829 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 11.
I20260709 12:11:51.391429 13762 raft_consensus.cc:2393] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 17: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:51.396384 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:51.396821 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:51.397560 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:51.398710 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:51.397497 14414 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 14.
I20260709 12:11:51.401077 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:51.402186 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:51.402979 13686 raft_consensus.cc:1240] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:51.404372 13686 raft_consensus.cc:1275] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:11:51.409760 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:51.410727 13759 raft_consensus.cc:2393] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 15: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:51.418936 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:51.419857 13683 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 15.
I20260709 12:11:51.422034 13685 raft_consensus.cc:1275] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
I20260709 12:11:51.390599 18529 raft_consensus.cc:2804] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:51.422819 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:51.423116 18529 raft_consensus.cc:697] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 12 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:51.424433 13685 pending_rounds.cc:85] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 6
I20260709 12:11:51.424592 13684 raft_consensus.cc:1240] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:51.424839 13685 pending_rounds.cc:107] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 12:11:51.425369 13685 raft_consensus.cc:2889] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:51.425652 13687 raft_consensus.cc:1240] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:11:51.428511 13727 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:51.420936 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:51.429196 14407 raft_consensus.cc:3055] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:51.430500 14407 raft_consensus.cc:740] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:51.429742 13763 raft_consensus.cc:2393] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 11: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:51.432726 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:51.434118 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:51.432329 13683 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:51.435240 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:51.436139 13679 raft_consensus.cc:2393] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 12: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:51.437381 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:51.438393 13832 raft_consensus.cc:2393] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 17: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:51.433657 13756 raft_consensus.cc:2393] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 12: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:51.442147 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:51.443799 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:51.431289 14407 consensus_queue.cc:260] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:51.448451 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:51.452013 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:51.453032 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:51.453807 13682 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 13.
I20260709 12:11:51.447135 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:51.455114 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:51.460851 13836 raft_consensus.cc:1240] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:51.461192 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:51.462152 13832 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 15.
I20260709 12:11:51.463342 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:51.463963 13830 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:51.466548 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:51.466866 13833 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612"
dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:54820
I20260709 12:11:51.467391 13833 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:51.467769 13833 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:51.468940 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:51.467391 13759 raft_consensus.cc:2393] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 17: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:51.472075 13681 raft_consensus.cc:2393] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 17: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:51.470121 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:51.472780 13679 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 12.
I20260709 12:11:51.362620 18825 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:51.478260 13758 raft_consensus.cc:1240] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:51.478461 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:51.479133 13679 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 13.
I20260709 12:11:51.483994 13830 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 13.
I20260709 12:11:51.470423 18777 raft_consensus.cc:2804] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:51.485126 13726 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:51.490274 13683 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 15.
I20260709 12:11:51.485888 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:51.388933 18873 consensus_queue.cc:1059] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.091s
I20260709 12:11:51.497393 13683 raft_consensus.cc:1240] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:51.488778 13833 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:51.492362 13651 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:11:51.515741 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.435963 18569 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:51.522634 13681 raft_consensus.cc:1275] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:51.532423 13756 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 12.
W20260709 12:11:51.536428 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 44143.2us
I20260709 12:11:51.538002 13651 leader_election.cc:400] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 election: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 14. Current term is 15.
I20260709 12:11:51.538461 13651 leader_election.cc:403] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:11:51.540047 18954 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:51.545056 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:51.545964 18873 raft_consensus.cc:2804] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:51.546449 13834 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 12.
I20260709 12:11:51.546622 18873 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:51.550935 13651 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:51.550989 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:51.499338 18777 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:51.517460 18789 raft_consensus.cc:2804] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:51.562445 13833 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:51.562801 13834 raft_consensus.cc:2393] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 13: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:51.560684 13726 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:51.568384 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:51.569047 13836 raft_consensus.cc:2376] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 11. Re-sending same reply.
I20260709 12:11:51.513489 18869 consensus_queue.cc:1059] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:11:51.477509 18529 consensus_queue.cc:237] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:51.558534 18777 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:51.555493 18570 raft_consensus.cc:2749] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 14. Current term is 15.
I20260709 12:11:51.554960 18873 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:51.521442 18885 consensus_queue.cc:1048] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:11:51.576727 13836 raft_consensus.cc:1240] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:51.560441 18789 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:51.555101 18846 consensus_queue.cc:1048] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:11:51.587383 18816 raft_consensus.cc:3055] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:51.602931 18816 raft_consensus.cc:740] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:51.590871 18569 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:51.577678 18935 raft_consensus.cc:3055] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:51.594667 13832 raft_consensus.cc:1275] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:11:51.595399 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:51.567852 18927 raft_consensus.cc:2749] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:51.598930 13837 raft_consensus.cc:1275] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:11:51.597896 13828 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "243ef5a036904f43835a7e29d96599de"
dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:54820
I20260709 12:11:51.607367 13828 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:51.607856 13828 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:51.601913 18825 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:51.604202 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:51.591547 18626 raft_consensus.cc:2804] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:51.605671 13835 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 15.
I20260709 12:11:51.567601 18774 leader_election.cc:290] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:51.614360 18626 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:51.617087 18626 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:11:51.617240 18989 log.cc:927] Time spent T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:11:51.606146 18789 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:51.605226 18935 raft_consensus.cc:740] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:51.600677 18913 raft_consensus.cc:2749] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:51.610241 18869 raft_consensus.cc:3055] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:51.604269 18816 consensus_queue.cc:260] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:51.621646 18935 consensus_queue.cc:260] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:51.626264 18935 raft_consensus.cc:3060] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:51.627445 18816 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:51.622486 18869 raft_consensus.cc:740] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:51.634634 18626 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:51.635077 18789 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:51.636580 18626 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:51.637522 18789 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:51.629320 18869 consensus_queue.cc:260] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.5, Last appended by leader: 5, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:51.638569 18869 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:51.642498 18871 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:51.644078 18777 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:51.644946 18871 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:51.644894 18873 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:51.683285 13688 raft_consensus.cc:1240] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:51.686568 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 109988us
I20260709 12:11:51.611471 13829 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:51.613891 13833 raft_consensus.cc:1275] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:51.612625 13836 raft_consensus.cc:1275] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:11:51.615198 13837 raft_consensus.cc:1275] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:11:51.699353 18639 consensus_queue.cc:1048] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 12:11:51.695796 13831 raft_consensus.cc:1240] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 12. Current term is 13. Ops: []
W20260709 12:11:51.697979 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.715046 13726 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:51.743453 18777 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:51.746876 18873 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:51.750955 18626 raft_consensus.cc:2804] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:51.751732 18626 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:51.752291 18626 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:51.753067 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:51.699335 18789 consensus_queue.cc:1059] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 12:11:51.776623 13830 raft_consensus.cc:1240] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:51.773602 18777 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.782796 18777 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:51.783650 18945 raft_consensus.cc:3055] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:51.784183 18945 raft_consensus.cc:740] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:51.791412 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:51.792662 13758 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 16.
I20260709 12:11:51.767310 18873 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:51.794596 18873 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:51.796588 18988 log.cc:927] Time spent T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.178s	user 0.002s	sys 0.000s
W20260709 12:11:51.798241 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.799538 18873 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:51.809002 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.809100 18789 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:51.810400 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 259424us
I20260709 12:11:51.810264 18789 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:51.812918 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.814865 18789 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:51.818922 14409 raft_consensus.cc:1275] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:11:51.819896 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:51.820967 14413 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 14.
I20260709 12:11:51.824304 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:51.824534 18936 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:51.825762 18936 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:51.828918 18936 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:51.830403 18636 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:51.831586 18636 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:51.833709 18673 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.834661 18673 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:51.836247 13651 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:51.808859 14411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41692 (request call id 841) took 1027 ms. Trace:
W20260709 12:11:51.854388 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.855798 18636 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:51.841460 14411 rpcz_store.cc:276] 0709 12:11:50.781121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:50.781268 (+   147us) service_pool.cc:224] Handling call
0709 12:11:51.808231 (+1026963us) spinlock_profiling.cc:243] Waited 434 ms on lock 0x7b54006b0154. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:51.808481 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":998645632}
I20260709 12:11:51.867810 18816 raft_consensus.cc:2749] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:51.806020 18945 consensus_queue.cc:260] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:51.875341 18777 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:51.885340 13829 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 15.
I20260709 12:11:51.885609 18673 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:51.904922 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:51.905915 13835 raft_consensus.cc:2376] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 12. Re-sending same reply.
I20260709 12:11:51.907239 18872 consensus_queue.cc:237] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:51.910650 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:51.912667 13828 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:51.917750 13828 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:51.917003 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:11:51.921166 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 85215.5us
I20260709 12:11:51.922906 18636 consensus_queue.cc:1048] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:51.924351 18529 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:11:51.925911 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.924093 18938 raft_consensus.cc:3055] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:51.929569 18938 raft_consensus.cc:740] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:51.930420 13652 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:51.931109 18938 consensus_queue.cc:260] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:51.932083 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:51.932967 18873 raft_consensus.cc:2804] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:51.933135 13679 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:51.933530 18873 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:51.934237 18873 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:51.935231 13680 raft_consensus.cc:1275] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 12:11:51.935670 13680 pending_rounds.cc:85] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 10
I20260709 12:11:51.935963 13680 pending_rounds.cc:107] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 12:11:51.936302 13680 raft_consensus.cc:2889] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:51.944638 14409 raft_consensus.cc:1240] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:51.925408 13832 raft_consensus.cc:2393] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 14: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:51.945847 18970 consensus_queue.cc:1048] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:51.909451 14407 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:51.947407 18996 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.948303 18996 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:51.925382 18529 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:51.951506 18996 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:51.951807 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:51.956758 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:51.953683 14380 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:51.958722 13835 raft_consensus.cc:2393] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 12: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:51.959836 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:51.952728 18529 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:51.952837 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:51.953359 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:51.961702 13834 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:51.962095 18996 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:51.962634 18996 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:51.963025 18996 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:51.966293 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:51.967979 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:51.968824 13833 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 11.
I20260709 12:11:51.971042 13836 raft_consensus.cc:1240] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:11:51.972921 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:51.973309 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:51.974103 14409 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:51.982574 18945 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:51.982729 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:51.984098 13828 raft_consensus.cc:2376] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 9. Re-sending same reply.
I20260709 12:11:51.984683 14409 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 15.
W20260709 12:11:51.953828 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.952852 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:52.009810 13831 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 16.
I20260709 12:11:51.997851 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:52.010892 13833 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 14.
I20260709 12:11:52.010998 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:52.011821 13727 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:52.012035 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:52.012414 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:52.013382 13831 raft_consensus.cc:2393] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 16: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:51.955077 13837 raft_consensus.cc:1275] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:11:52.014813 18789 raft_consensus.cc:2749] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:11:52.014875 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:52.016427 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:51.960800 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:51.953474 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:51.986001 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:51.987460 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:51.989979 18816 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.992051 13761 raft_consensus.cc:1275] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:51.933144 18938 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:51.994171 13759 raft_consensus.cc:1275] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 12:11:51.997264 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.997869 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:51.998400 13801 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:51.999478 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:52.005311 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:52.013518 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:52.055049 13837 raft_consensus.cc:1275] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:52.055179 13834 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 16.
I20260709 12:11:51.985409 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:52.067327 13679 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 12.
I20260709 12:11:52.064455 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:52.068172 14415 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 20.
I20260709 12:11:52.070487 13832 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 12.
I20260709 12:11:52.070721 18868 raft_consensus.cc:1027] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: attempt to promote peer ca9fbbc2c0a94897897d502d42f3951f: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 12:11:52.071614 14407 raft_consensus.cc:1275] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 12:11:52.072031 14411 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 16.
I20260709 12:11:52.072172 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:52.073854 13727 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:52.076447 13727 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:52.078120 13688 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 11.
I20260709 12:11:52.072045 14407 pending_rounds.cc:85] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f: Aborting all ops after (but not including) 10
I20260709 12:11:52.080166 14407 pending_rounds.cc:107] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 12:11:52.079252 13652 leader_election.cc:304] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:52.082618 13836 raft_consensus.cc:2393] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 11: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:52.084010 14407 raft_consensus.cc:2889] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:52.085074 18934 raft_consensus.cc:2749] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:11:52.089445 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 91359.6us
I20260709 12:11:52.094121 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:52.094926 13832 raft_consensus.cc:2393] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 16: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:52.091843 13833 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 11.
I20260709 12:11:52.100018 14379 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:52.099866 18684 consensus_queue.cc:1048] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 12:11:52.103385 18636 raft_consensus.cc:2804] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:52.103888 18636 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:52.104274 18636 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:52.105544 13757 raft_consensus.cc:1275] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 12:11:52.105967 18940 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260709 12:11:52.106087 18734 consensus_queue.cc:1048] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:52.108047 18995 consensus_queue.cc:1048] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:52.108279 18355 consensus_queue.cc:1059] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:52.109093 13727 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:52.110633 18355 raft_consensus.cc:3055] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:52.111220 18355 raft_consensus.cc:740] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:52.112394 18355 consensus_queue.cc:260] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:52.116117 18940 consensus_queue.cc:1048] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:52.115432 14379 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:52.119513 13583 catalog_manager.cc:5697] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 8 to 13, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 13 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:52.120664 18673 raft_consensus.cc:2804] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:52.121352 18673 raft_consensus.cc:697] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 12 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:52.123090 13583 catalog_manager.cc:5697] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
W20260709 12:11:52.159511 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 50580.3us
I20260709 12:11:52.125489 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:52.170987 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:52.092694 18777 raft_consensus.cc:2749] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:52.181923 13583 catalog_manager.cc:5697] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:52.167133 18355 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:52.185617 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:52.187549 13727 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:52.189183 18868 consensus_queue.cc:1059] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:52.190740 18868 raft_consensus.cc:2804] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:52.183861 14380 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:52.192297 14380 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:52.193177 18684 raft_consensus.cc:2749] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:52.191691 13583 catalog_manager.cc:5697] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:52.193987 18684 raft_consensus.cc:2804] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:52.194432 18684 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:52.194821 18684 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:52.198309 18872 raft_consensus.cc:3055] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:52.198832 18872 raft_consensus.cc:740] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:52.200947 18868 raft_consensus.cc:697] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:52.196643 13583 catalog_manager.cc:5697] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:52.202347 18868 consensus_queue.cc:237] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.4, Last appended by leader: 4, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:52.151531 18991 raft_consensus.cc:2749] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:52.167686 18934 raft_consensus.cc:2749] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:52.158259 18913 raft_consensus.cc:2804] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:52.124723 18673 consensus_queue.cc:237] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:52.142935 18626 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:52.209995 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:52.224884 13583 catalog_manager.cc:5697] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:52.215876 18913 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:52.238503 13680 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 16.
I20260709 12:11:52.244724 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:52.245755 13687 raft_consensus.cc:2393] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 16: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:52.249217 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:52.246407 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:52.250911 13685 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:52.248030 18626 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:52.237908 18913 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:52.265900 13683 raft_consensus.cc:1275] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:52.254454 18991 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.091467 18816 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:52.273132 18873 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:52.315227 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:52.318029 18777 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.319129 18777 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:52.331220 14409 raft_consensus.cc:1275] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
W20260709 12:11:52.341279 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 48445.3us
I20260709 12:11:52.275048 18995 consensus_queue.cc:1048] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:11:52.275189 18970 consensus_queue.cc:1059] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 12:11:52.347939 13687 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:52.354290 13685 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 15.
I20260709 12:11:52.347281 13583 catalog_manager.cc:5697] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 8 to 10, leader changed from ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 10 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:52.359712 18970 raft_consensus.cc:3055] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:52.360374 18970 raft_consensus.cc:740] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:52.362627 18934 consensus_queue.cc:1048] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:52.364630 18934 consensus_queue.cc:1048] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:52.365195 13727 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:52.366231 18785 consensus_queue.cc:1048] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:52.368126 18785 consensus_queue.cc:1048] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:52.368716 18785 consensus_queue.cc:1243] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer 96701a74fdee481fb5f54aac841e17dd log is divergent from this leader: its last log entry 14.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:11:52.369978 18936 consensus_queue.cc:1048] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:52.374904 18946 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.375869 18946 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:52.376997 18785 raft_consensus.cc:2749] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:52.378211 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:52.376384 13727 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:52.379189 13682 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 16.
I20260709 12:11:52.380388 18789 raft_consensus.cc:2804] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:52.380721 18763 consensus_queue.cc:1059] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:52.381083 18789 raft_consensus.cc:697] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:52.381997 18626 raft_consensus.cc:3055] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:52.382439 18626 raft_consensus.cc:740] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:52.382623 18789 consensus_queue.cc:237] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:52.383517 18626 consensus_queue.cc:260] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:52.385001 18626 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:52.382927 18684 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:52.389843 14409 raft_consensus.cc:1275] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 13 LEARNER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:11:52.391976 18684 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:52.398137 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:52.404995 13687 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 15.
I20260709 12:11:52.299034 18991 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:52.406950 13583 catalog_manager.cc:5697] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
W20260709 12:11:52.414747 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 58972.6us
W20260709 12:11:52.416678 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:52.415064 13727 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:52.422878 13727 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:52.430099 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:52.430780 13828 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:52.448632 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:52.422617 18936 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:11:52.411791 18996 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:52.439050 18777 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:52.401743 18970 consensus_queue.cc:260] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:52.428404 18355 consensus_queue.cc:1048] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.035s
I20260709 12:11:52.458689 18936 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:52.510208 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:52.466878 13583 catalog_manager.cc:5697] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 9 to 10, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 10 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:11:52.530103 19003 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:11:52.530936 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:52.530838 19003 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:52.533389 19003 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:52.534200 19002 log.cc:927] Time spent T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 12:11:52.535610 14412 raft_consensus.cc:1275] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:11:52.504391 18936 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:11:52.544282 13583 catalog_manager.cc:5697] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 7 to 11, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 11 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:11:52.553601 13688 raft_consensus.cc:2468] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 12.
I20260709 12:11:52.521431 18626 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:52.571638 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 152243us
I20260709 12:11:52.564570 13583 catalog_manager.cc:5697] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 6 to 7, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 7 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:11:52.572563 13727 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:52.587656 14379 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:52.591041 13688 raft_consensus.cc:1275] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:11:52.595651 13688 raft_consensus.cc:1240] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 12:11:52.591801 18684 raft_consensus.cc:2804] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:52.596427 18684 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:52.596952 18684 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:52.610122 18734 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.611117 18734 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:52.548437 18946 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:52.616328 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:52.616734 18734 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:52.617084 13832 raft_consensus.cc:2468] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 9.
I20260709 12:11:52.552434 18777 raft_consensus.cc:2804] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:52.617923 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:52.618888 14380 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:52.619102 13688 raft_consensus.cc:2468] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 9.
I20260709 12:11:52.619918 18734 raft_consensus.cc:2804] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:52.620316 18734 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:52.620668 18734 raft_consensus.cc:3060] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:52.622499 18991 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:52.559676 18873 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:52.624248 18636 consensus_meta.cc:287] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.519s	user 0.009s	sys 0.005s
I20260709 12:11:52.624701 18636 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:52.626758 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:52.627521 13833 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:52.629938 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:52.630710 14414 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 14.
W20260709 12:11:52.636050 18938 consensus_meta.cc:287] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.569s	user 0.009s	sys 0.001s
I20260709 12:11:52.636905 18938 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:52.637408 18938 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:52.626183 18684 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:52.638147 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:52.663089 13828 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 15.
I20260709 12:11:52.661908 13830 raft_consensus.cc:2468] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 12.
I20260709 12:11:52.551275 18673 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.642424 18785 consensus_queue.cc:1048] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 12:11:52.558436 19003 consensus_queue.cc:1048] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.111s
I20260709 12:11:52.626327 18626 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:52.642269 18763 consensus_queue.cc:1048] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
W20260709 12:11:52.720621 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 232464us
I20260709 12:11:52.644960 13688 raft_consensus.cc:1275] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:11:52.788031 13801 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:52.790846 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:52.793066 14380 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:52.637756 18938 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:52.671362 18355 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
W20260709 12:11:52.803757 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:52.808110 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:52.809000 13834 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 13.
I20260709 12:11:52.815236 13583 catalog_manager.cc:5697] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 6 to 9, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 9 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:52.798703 18940 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:52.821733 13685 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:52.827103 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 211817us
I20260709 12:11:52.829229 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:52.830147 13830 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:52.838143 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:52.838258 13831 raft_consensus.cc:1240] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:52.646752 18734 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:52.841969 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:52.832834 13583 catalog_manager.cc:5697] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:11:52.851590 13828 raft_consensus.cc:1275] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:11:52.837036 18995 raft_consensus.cc:2804] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:52.835223 18777 raft_consensus.cc:697] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:52.814785 18673 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:52.864799 13831 pending_rounds.cc:85] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 7
I20260709 12:11:52.865182 13831 pending_rounds.cc:107] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 12:11:52.865492 13831 raft_consensus.cc:2889] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:52.867290 13652 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:52.848126 18940 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:52.832549 18355 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:52.912243 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:52.913157 13680 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:52.912560 13583 catalog_manager.cc:5697] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 8 to 11, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 11 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:11:52.863286 19003 raft_consensus.cc:2804] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:52.873839 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:11:52.921020 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:52.922312 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:52.936652 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 143703us
I20260709 12:11:52.861256 18789 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.868171 18636 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:52.964118 13685 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 13.
I20260709 12:11:52.967093 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:52.960908 13583 catalog_manager.cc:5697] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 2 to 10. New cstate: current_term: 10 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:11:52.968506 13688 raft_consensus.cc:1275] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:11:52.947678 19009 log.cc:927] Time spent T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:11:52.920697 19003 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:52.969198 19004 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:52.920078 18529 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:52.973831 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 185881us
I20260709 12:11:52.973272 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:52.973193 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:11:52.987200 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:52.995970 13757 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:52.947333 18991 raft_consensus.cc:2749] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:11:52.990005 19003 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:52.960384 18873 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:52.992256 19013 log.cc:927] Time spent T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.323s	user 0.000s	sys 0.001s
I20260709 12:11:52.999507 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:11:53.008513 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 163545us
I20260709 12:11:53.011261 13832 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:53.014336 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 156456us
I20260709 12:11:53.016323 13828 raft_consensus.cc:1275] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:11:53.001200 19014 log.cc:927] Time spent T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260709 12:11:53.007920 18995 raft_consensus.cc:697] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 15 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:53.027973 18995 consensus_queue.cc:237] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:53.023628 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:53.030156 13727 leader_election.cc:304] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:53.030550 13688 raft_consensus.cc:2393] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 10: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:53.031473 18777 consensus_queue.cc:237] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:53.068848 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:53.072682 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:53.073385 14407 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 14.
I20260709 12:11:53.013458 18626 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:53.043531 13583 catalog_manager.cc:5697] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 5 to 8, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 8 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:11:53.086442 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:53.091279 13833 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 17.
I20260709 12:11:52.991009 18789 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:53.004730 18529 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:53.096855 13761 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:53.096855 13652 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:53.098614 13727 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:53.106290 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:53.106789 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:53.045092 18873 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:53.110535 13758 raft_consensus.cc:2393] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 16: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
W20260709 12:11:53.110690 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 107827us
I20260709 12:11:53.115640 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:53.107443 18355 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:53.100472 18816 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:53.035302 19004 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:53.130245 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:53.107985 18940 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:53.143406 19032 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:53.144150 19032 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:53.146772 18872 consensus_queue.cc:260] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:53.147585 19004 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:53.147889 18872 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:53.149724 18873 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:53.117291 18636 consensus_queue.cc:1048] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 12:11:53.149966 18825 consensus_queue.cc:1048] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.079s
I20260709 12:11:53.152424 13583 catalog_manager.cc:5697] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:11:53.155282 13727 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:53.155480 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:53.156136 13687 raft_consensus.cc:3060] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:53.156239 13832 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 12.
W20260709 12:11:53.158128 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 95317.6us
I20260709 12:11:53.158321 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:53.158628 18626 raft_consensus.cc:2804] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:53.159129 18626 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:53.159543 18626 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:53.160029 13652 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:53.161151 18816 raft_consensus.cc:2804] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:53.161653 18816 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:53.162081 18816 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:53.166020 13761 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 10.
W20260709 12:11:53.174785 19025 log.cc:927] Time spent T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 12:11:53.175282 19016 raft_consensus.cc:2804] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:53.176002 19016 raft_consensus.cc:697] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:53.173012 13583 catalog_manager.cc:5697] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:11:53.133860 18734 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:53.186894 13760 raft_consensus.cc:1240] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:53.187116 19033 consensus_queue.cc:1048] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:53.187400 19026 raft_consensus.cc:2804] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:53.187863 18789 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:53.188004 19026 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:53.187996 18873 consensus_queue.cc:1059] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:53.188640 19026 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:53.189446 18873 raft_consensus.cc:3055] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:53.189888 19029 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:53.190629 19029 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:53.193183 19029 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:53.172472 18825 consensus_queue.cc:1048] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 12:11:53.194195 19017 raft_consensus.cc:2804] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:53.177263 19016 consensus_queue.cc:237] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:53.194818 19017 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:53.195317 19017 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:11:53.199293 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 82396.2us
I20260709 12:11:53.202188 14380 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:53.216332 14380 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:53.222483 18734 raft_consensus.cc:2804] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:53.223193 18734 raft_consensus.cc:697] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 12 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:53.224205 13681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 879) took 1220 ms. Trace:
I20260709 12:11:53.224319 18734 consensus_queue.cc:237] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:53.189926 18873 raft_consensus.cc:740] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:53.224804 13681 rpcz_store.cc:276] 0709 12:11:52.003752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:52.004017 (+   265us) service_pool.cc:224] Handling call
0709 12:11:52.004666 (+   649us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:52.320034 (+315368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:52.320069 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:52.320574 (+   505us) log.cc:844] Serialized 26 byte log entry
0709 12:11:52.563125 (+242551us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:52.563168 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:53.223558 (+660390us) spinlock_profiling.cc:243] Waited 308 ms on lock 0x7b54002c3154. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:53.223613 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:53.223665 (+    52us) raft_consensus.cc:1685] finished
0709 12:11:53.223680 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:53.223982 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":212357,"raft.run_cpu_time_us":55,"raft.run_wall_time_us":55,"spinlock_wait_cycles":709053696,"thread_start_us":242016,"threads_started":1,"wal-append.queue_time_us":348203}
I20260709 12:11:53.252374 19039 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:53.266021 13687 raft_consensus.cc:2468] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 10.
I20260709 12:11:53.268986 14379 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:53.219661 19003 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:53.282660 13652 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:53.301126 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:53.302012 13829 raft_consensus.cc:3060] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:53.318339 19021 log.cc:927] Time spent T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.305s	user 0.001s	sys 0.000s
I20260709 12:11:53.319804 13679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2816) took 1134 ms. Trace:
W20260709 12:11:53.320459 19038 log.cc:927] Time spent T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 12:11:53.320266 13679 rpcz_store.cc:276] 0709 12:11:52.185249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:52.185445 (+   196us) service_pool.cc:224] Handling call
0709 12:11:52.224477 (+ 39032us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:52.412400 (+187923us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:52.412437 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:52.456833 (+ 44396us) log.cc:844] Serialized 26 byte log entry
0709 12:11:52.735218 (+278385us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:52.735277 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:52.735377 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:53.319520 (+584143us) raft_consensus.cc:1685] finished
0709 12:11:53.319550 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:53.319731 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":302806,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":8153,"thread_start_us":409292,"threads_started":2,"wal-append.queue_time_us":352716}
I20260709 12:11:53.321969 18873 consensus_queue.cc:260] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:53.318339 19040 log.cc:927] Time spent T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260709 12:11:53.323590 18873 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:53.326025 18529 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:53.328143 19045 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:53.286425 19039 raft_consensus.cc:697] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 17 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:53.330832 19039 consensus_queue.cc:237] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:53.334219 19036 log.cc:927] Time spent T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:11:53.338176 18991 raft_consensus.cc:2749] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:53.340885 18684 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:53.299058 18636 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:53.328878 19045 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:53.357475 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 199890us
W20260709 12:11:53.350922 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 233871us
W20260709 12:11:53.338464 18936 consensus_meta.cc:287] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.768s	user 0.012s	sys 0.000s
W20260709 12:11:53.347651 18938 consensus_meta.cc:287] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.536s	user 0.008s	sys 0.005s
I20260709 12:11:53.375214 13680 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 12.
I20260709 12:11:53.341764 18684 raft_consensus.cc:2804] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:53.384519 13757 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 17.
I20260709 12:11:53.383093 13726 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:53.345532 19030 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:53.350217 19045 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:53.348073 18626 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:53.407766 13683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2822) took 1163 ms. Trace:
I20260709 12:11:53.408286 19003 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:53.408082 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 125532us
W20260709 12:11:53.430233 19048 log.cc:927] Time spent T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:11:53.431032 18626 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:53.432065 13800 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:53.433190 13800 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:53.434252 13800 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:53.435905 13800 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:53.436123 19004 raft_consensus.cc:2804] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:53.436645 19004 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:53.437076 19004 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:53.438994 18996 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 17 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:53.438824 19030 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:53.441249 19030 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:53.443840 13651 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:53.402127 18938 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:53.445600 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:53.446134 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:53.442068 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:53.446873 13688 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 15.
I20260709 12:11:53.447093 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: true dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:53.448390 13679 raft_consensus.cc:1240] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:53.401815 18936 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:53.450193 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:53.450793 13687 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:53.451395 18936 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:53.452435 18873 raft_consensus.cc:2749] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:53.456938 19032 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:53.459539 18970 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:53.460901 18913 consensus_meta.cc:287] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 1.173s	user 0.011s	sys 0.000s
I20260709 12:11:53.348217 18636 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:53.464123 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:11:53.430333 19020 log.cc:927] Time spent T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.398s	user 0.001s	sys 0.003s
W20260709 12:11:53.464527 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:53.466233 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:53.469905 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:53.479518 13687 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 12.
I20260709 12:11:53.487185 13834 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 11.
W20260709 12:11:53.488963 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:53.490427 13830 consensus_meta.cc:287] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.653s	user 0.012s	sys 0.000s
I20260709 12:11:53.491216 13830 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 13.
I20260709 12:11:53.499082 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:53.499418 13829 raft_consensus.cc:2468] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 10.
I20260709 12:11:53.422578 13683 rpcz_store.cc:276] 0709 12:11:52.244218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:52.266934 (+ 22716us) service_pool.cc:224] Handling call
0709 12:11:52.267335 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:52.800467 (+533132us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:52.800506 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:52.823351 (+ 22845us) log.cc:844] Serialized 26 byte log entry
0709 12:11:52.946380 (+123029us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:52.946415 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:53.407127 (+460712us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b5400199e54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:53.407188 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:53.407246 (+    58us) raft_consensus.cc:1685] finished
0709 12:11:53.407445 (+   199us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:53.407693 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":92928,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":73,"spinlock_wait_cycles":363063168,"thread_start_us":438431,"threads_started":2,"wal-append.queue_time_us":163224}
I20260709 12:11:53.511669 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:53.511816 13651 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:53.512764 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:53.513616 13756 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 10.
I20260709 12:11:53.446154 18938 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:53.461396 18913 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:53.463150 18684 raft_consensus.cc:697] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 10 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:53.487079 18529 raft_consensus.cc:2749] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:53.498524 19045 raft_consensus.cc:2764] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:11:53.523217 13652 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:11:53.532491 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 219802us
I20260709 12:11:53.533691 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:53.534061 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 52080.4us
I20260709 12:11:53.547791 13757 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 13.
W20260709 12:11:53.550014 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 178458us
I20260709 12:11:53.536455 13755 raft_consensus.cc:2468] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 14.
I20260709 12:11:53.551784 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:53.571264 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:53.572345 14407 raft_consensus.cc:2410] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 12:11:53.577092 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:53.577996 13834 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:53.587844 13836 raft_consensus.cc:1240] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:11:53.593693 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:53.597848 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:53.598224 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:53.598582 14411 raft_consensus.cc:2468] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 11.
I20260709 12:11:53.598798 13683 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:53.603132 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
W20260709 12:11:53.616495 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 65686.3us
I20260709 12:11:53.616308 13686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 883) took 1458 ms. Trace:
I20260709 12:11:53.575732 18991 raft_consensus.cc:2804] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:53.627972 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:11:53.599558 19009 log.cc:927] Time spent T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 12:11:53.622987 14379 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:53.601768 19029 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:53.609207 18995 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:53.643812 13687 raft_consensus.cc:2468] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 11.
I20260709 12:11:53.645756 13679 raft_consensus.cc:2468] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 12.
I20260709 12:11:53.587210 18873 consensus_queue.cc:1059] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
W20260709 12:11:53.647279 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 126416us
I20260709 12:11:53.638733 13688 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 10.
I20260709 12:11:53.620496 13686 rpcz_store.cc:276] 0709 12:11:52.144165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:52.144346 (+   181us) service_pool.cc:224] Handling call
0709 12:11:52.202585 (+ 58239us) spinlock_profiling.cc:243] Waited 19.1 ms on lock 0x7b5800002798. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924e68b71 00007fa924e68a22 00007fa92dd818d9 00007fa92cedbee0 00007fa92cfa50ab 00007fa92cfa5131 00007fa92cf66fc0 00007fa92cf51929 00007fa92cf513d2 00007fa9264c8bd4
0709 12:11:52.202790 (+   205us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:52.454315 (+251525us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:52.454349 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:52.456032 (+  1683us) log.cc:844] Serialized 26 byte log entry
0709 12:11:52.799326 (+343294us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:52.799388 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:52.799499 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:53.429631 (+630132us) spinlock_profiling.cc:243] Waited 20.5 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:11:53.601928 (+172297us) raft_consensus.cc:1685] finished
0709 12:11:53.601951 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:53.602087 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1950,"raft.queue_time_us":264232,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":48529,"spinlock_wait_cycles":91289088,"thread_start_us":522689,"threads_started":2,"wal-append.queue_time_us":479516}
W20260709 12:11:53.671629 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 184384us
I20260709 12:11:53.673043 13652 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:53.671722 19054 raft_consensus.cc:3055] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:11:53.673878 19044 log.cc:927] Time spent T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
W20260709 12:11:53.678565 19058 log.cc:927] Time spent T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 12:11:53.680001 19034 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:53.680884 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: true dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:53.680672 19034 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:53.682200 18825 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:53.682772 18825 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:53.683470 13760 raft_consensus.cc:3055] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:53.683543 19056 raft_consensus.cc:2749] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:53.683889 13760 raft_consensus.cc:740] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:53.684370 19015 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:53.684886 18825 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:53.684805 13760 consensus_queue.cc:260] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:53.685086 19015 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:53.685674 13755 raft_consensus.cc:1275] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:11:53.686017 13726 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:53.686825 13760 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:53.687935 13726 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:53.688181 18868 raft_consensus.cc:2804] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:53.689040 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:53.689949 13831 raft_consensus.cc:1240] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:53.690747 19033 raft_consensus.cc:2804] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:53.691013 19035 raft_consensus.cc:2804] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:53.691229 19033 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:53.691642 19035 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:53.691768 19033 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:53.692138 19035 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:53.673748 19054 raft_consensus.cc:740] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:53.699635 18913 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:53.687115 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:53.689851 19027 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:53.710510 18639 raft_consensus.cc:2749] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:53.654165 18636 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:53.714248 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:53.714042 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 178375us
I20260709 12:11:53.709607 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:53.723738 13760 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 13.
I20260709 12:11:53.659247 18991 raft_consensus.cc:697] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 10 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
W20260709 12:11:53.746167 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 123301us
I20260709 12:11:53.707010 18868 raft_consensus.cc:697] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:53.748617 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:53.749076 18868 consensus_queue.cc:237] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:53.751219 13834 raft_consensus.cc:2468] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 13.
I20260709 12:11:53.752148 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:53.752769 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:53.646994 19029 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:53.689802 19007 raft_consensus.cc:2749] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:53.753563 13836 raft_consensus.cc:2468] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 11.
I20260709 12:11:53.656963 18995 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:53.701222 19004 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:53.764074 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 82057.6us
W20260709 12:11:53.766367 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 57195.6us
I20260709 12:11:53.706845 18873 consensus_queue.cc:1048] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 12:11:53.771952 14379 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:53.783003 14379 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:53.783965 13834 raft_consensus.cc:1275] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 10 index: 4. Preceding OpId from leader: term: 13 index: 5. (index mismatch)
I20260709 12:11:53.785831 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:53.786662 13829 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:53.801357 13837 raft_consensus.cc:1240] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 12. Current term is 13. Ops: []
W20260709 12:11:53.775262 18816 consensus_meta.cc:287] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.613s	user 0.013s	sys 0.000s
I20260709 12:11:53.802917 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:53.687654 19015 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:53.774081 18718 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.011s	sys 0.031s
I20260709 12:11:53.806062 14413 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:53.816912 14380 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:53.808468 13727 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:53.702281 18684 consensus_queue.cc:237] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:53.818159 13727 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:53.811157 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:53.814421 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:53.821174 13683 raft_consensus.cc:2468] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 13.
I20260709 12:11:53.833123 13800 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:53.803848 18636 raft_consensus.cc:2804] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:53.839222 13688 raft_consensus.cc:3055] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:53.800376 19007 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:53.864753 13829 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 15.
I20260709 12:11:53.867233 19031 raft_consensus.cc:2804] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:11:53.868212 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 51356.1us
I20260709 12:11:53.870448 19053 raft_consensus.cc:2804] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:53.870790 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:53.871133 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:53.873164 18873 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:11:53.873487 19075 log.cc:927] Time spent T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 12:11:53.873914 18846 raft_consensus.cc:2804] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:53.873723 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:11:53.878693 19017 consensus_meta.cc:287] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.683s	user 0.009s	sys 0.004s
I20260709 12:11:53.822463 18816 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:53.861223 18636 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:53.865350 13688 raft_consensus.cc:740] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:53.780843 18938 consensus_queue.cc:1048] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 12:11:53.894694 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:53.895324 13831 raft_consensus.cc:1275] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:11:53.894982 14380 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:53.864802 19039 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:53.901192 19019 consensus_queue.cc:1059] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 12:11:53.901377 18825 consensus_queue.cc:1048] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:53.916831 13835 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 13.
W20260709 12:11:53.904075 19025 log.cc:927] Time spent T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:11:53.896453 19053 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:53.903160 18873 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
W20260709 12:11:53.939004 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 266023us
I20260709 12:11:53.923039 18636 raft_consensus.cc:3060] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:53.908893 19031 raft_consensus.cc:697] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 13 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:53.914837 19043 raft_consensus.cc:2804] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:53.938166 13688 consensus_queue.cc:260] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:53.954433 14413 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 17.
I20260709 12:11:53.954373 13682 raft_consensus.cc:2393] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 13: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:53.937749 19053 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:53.919097 19015 consensus_queue.cc:1048] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
W20260709 12:11:53.955109 19026 consensus_meta.cc:287] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.766s	user 0.014s	sys 0.000s
I20260709 12:11:53.960713 13727 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:53.921578 19017 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:53.941233 18846 raft_consensus.cc:697] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:53.915997 13757 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:11:53.958024 19043 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:53.974088 19086 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:53.975176 18816 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:53.975442 19073 log.cc:927] Time spent T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 12:11:53.975842 19069 log.cc:927] Time spent T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.196s	user 0.000s	sys 0.001s
I20260709 12:11:53.980316 13688 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:53.982312 13652 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:53.897360 18991 consensus_queue.cc:237] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:53.973198 19065 log.cc:927] Time spent T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:11:53.985108 13757 raft_consensus.cc:606] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:54.015122 13757 raft_consensus.cc:614] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:11:53.986842 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:53.987360 13801 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:53.988165 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:53.934648 19039 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:53.996613 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:53.996788 18995 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:53.997354 19029 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:53.957820 19088 raft_consensus.cc:2749] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:53.989496 13727 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:54.011628 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:53.938742 19007 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:54.013906 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:54.017334 13687 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:54.107268 13761 raft_consensus.cc:2393] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 13: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:53.984694 19034 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:53.994043 19043 raft_consensus.cc:3060] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:54.079454 19064 log.cc:927] Time spent T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
W20260709 12:11:54.079679 19060 log.cc:927] Time spent T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.237s	user 0.000s	sys 0.001s
W20260709 12:11:54.080582 19067 log.cc:927] Time spent T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.254s	user 0.001s	sys 0.000s
W20260709 12:11:54.081669 19071 log.cc:927] Time spent T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:11:54.014542 19086 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:54.016861 18970 consensus_meta.cc:287] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.557s	user 0.010s	sys 0.005s
I20260709 12:11:54.086351 18673 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:54.087436 18873 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:54.015322 19004 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:53.988090 19015 raft_consensus.cc:2804] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:54.092275 13685 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 13.
I20260709 12:11:54.106474 13682 raft_consensus.cc:1275] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 12 index: 5. Preceding OpId from leader: term: 13 index: 5. (term mismatch)
W20260709 12:11:54.173255 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 185986us
I20260709 12:11:54.110080 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:54.111354 19033 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:54.112450 13681 raft_consensus.cc:1240] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:54.115751 18816 raft_consensus.cc:2764] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:11:54.117081 19029 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.118108 19031 consensus_queue.cc:237] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:54.122006 19076 raft_consensus.cc:2749] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:54.122613 18355 raft_consensus.cc:2804] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:53.988838 19026 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:54.125052 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:54.138259 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 153803us
W20260709 12:11:54.145161 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:54.162104 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 351830us
I20260709 12:11:54.168524 19090 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:54.169426 13687 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 17.
I20260709 12:11:54.170879 18636 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:54.172111 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 210462us
I20260709 12:11:54.172232 19086 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:54.109593 18846 consensus_queue.cc:237] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:54.150660 18938 raft_consensus.cc:2804] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:54.182227 19033 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:54.173570 13682 pending_rounds.cc:85] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 4
I20260709 12:11:54.188050 13757 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:11:54.202206 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:54.206561 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:54.211079 13684 raft_consensus.cc:1275] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:11:54.193143 18355 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:54.214157 19063 log.cc:927] Time spent T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.373s	user 0.001s	sys 0.004s
I20260709 12:11:54.191887 19029 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:54.191663 19015 raft_consensus.cc:697] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:11:54.200435 19035 consensus_meta.cc:287] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.508s	user 0.009s	sys 0.003s
I20260709 12:11:54.196440 19027 raft_consensus.cc:2749] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:54.216599 19026 leader_election.cc:290] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:54.214458 13800 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:54.241979 13757 raft_consensus.cc:606] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:54.273765 13757 raft_consensus.cc:614] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:54.252807 13652 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:54.259409 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:54.286285 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:54.286957 13830 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:54.265386 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:54.254506 14414 consensus_meta.cc:287] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.635s	user 0.012s	sys 0.000s
I20260709 12:11:54.217166 18938 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:54.243155 13682 pending_rounds.cc:107] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 12.5
W20260709 12:11:54.285638 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:54.288708 13682 raft_consensus.cc:2889] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:54.289433 14414 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 14.
I20260709 12:11:54.244014 18355 raft_consensus.cc:3060] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:54.217494 18673 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:11:54.294484 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 88849.9us
I20260709 12:11:54.292024 13761 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 12.
I20260709 12:11:54.321657 19076 raft_consensus.cc:2804] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:54.210721 18777 consensus_queue.cc:1048] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.112s
I20260709 12:11:54.322306 19076 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:54.322882 19076 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:54.323361 13800 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:54.323716 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:54.208995 19090 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:54.324898 13800 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:54.289989 18938 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:54.327072 19090 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:54.327342 18913 raft_consensus.cc:2804] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:54.327870 18913 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:54.328425 18913 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:54.330461 19102 consensus_queue.cc:1059] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:54.332015 19102 raft_consensus.cc:2804] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:54.332613 19102 raft_consensus.cc:697] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 12 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:54.333680 19097 raft_consensus.cc:3055] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:54.334293 19097 raft_consensus.cc:740] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:54.335323 19097 consensus_queue.cc:260] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:54.336572 18355 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:54.327091 19096 consensus_queue.cc:1059] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.002s
W20260709 12:11:54.338124 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 96189us
I20260709 12:11:54.339073 18355 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:54.338528 19096 raft_consensus.cc:3055] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:54.339747 19096 raft_consensus.cc:740] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:54.340827 19096 consensus_queue.cc:260] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:54.342579 19096 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:54.342159 19015 consensus_queue.cc:237] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:54.344426 19029 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:54.345611 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:54.347219 19054 consensus_queue.cc:260] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:54.348489 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:54.348659 19054 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:54.349306 13687 raft_consensus.cc:2393] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 10: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:54.354899 18734 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:54.355571 19028 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.356201 19028 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:54.355592 18734 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:54.358304 19095 log.cc:927] Time spent T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 12:11:54.360277 13800 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:54.361405 18529 raft_consensus.cc:2749] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:54.362440 19090 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:54.364198 14379 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:54.354285 19102 consensus_queue.cc:237] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:54.336942 19097 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:54.258996 19077 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.339165 13652 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:54.252234 19007 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:54.344667 13754 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 12.
I20260709 12:11:54.387593 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:54.394038 13830 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 17.
I20260709 12:11:54.383875 13757 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 10.
I20260709 12:11:54.395475 13756 raft_consensus.cc:2393] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 21: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:54.396813 14379 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:54.398263 18763 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.373667 18970 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.404819 18763 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:54.425457 13688 raft_consensus.cc:1275] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 12:11:54.428853 13688 pending_rounds.cc:85] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 11
I20260709 12:11:54.255134 19035 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:54.430364 14380 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.002s	sys 0.020s
W20260709 12:11:54.405027 19092 log.cc:927] Time spent T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
I20260709 12:11:54.390377 18940 raft_consensus.cc:2804] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:54.432355 14379 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:11:54.433202 14380 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.002s	sys 0.020s
I20260709 12:11:54.367350 19086 raft_consensus.cc:2804] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:11:54.435269 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 513838us
I20260709 12:11:54.433413 13688 pending_rounds.cc:107] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 12:11:54.436313 13688 raft_consensus.cc:2889] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:54.419400 19069 log.cc:927] Time spent T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.399s	user 0.002s	sys 0.000s
I20260709 12:11:54.408408 19028 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:54.408993 19032 raft_consensus.cc:2804] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:54.445421 13761 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:11:54.446169 13761 raft_consensus.cc:606] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:54.427093 19007 raft_consensus.cc:2749] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:54.444005 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:54.447177 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:54.460593 13681 raft_consensus.cc:3060] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:54.375031 18673 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:54.441530 13828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 2916) took 1021 ms. Trace:
I20260709 12:11:54.414131 18734 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:54.467329 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:54.464120 13828 rpcz_store.cc:276] 0709 12:11:53.420231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:53.420421 (+   190us) service_pool.cc:224] Handling call
0709 12:11:53.693665 (+273244us) spinlock_profiling.cc:243] Waited 31.6 ms on lock 0x7b5800034898. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924e68b71 00007fa924e68a22 00007fa92dd818d9 00007fa92cedbee0 00007fa92cfa50ab 00007fa92cfa5131 00007fa92cf66fc0 00007fa92cf51929 00007fa92cf513d2 00007fa9264c8bd4
0709 12:11:53.693900 (+   235us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:54.107083 (+413183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:54.107154 (+    71us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:54.154178 (+ 47024us) log.cc:844] Serialized 26 byte log entry
0709 12:11:54.380320 (+226142us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:54.380373 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:54.433659 (+ 53286us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:54.434636 (+   977us) raft_consensus.cc:1685] finished
0709 12:11:54.434659 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:54.441458 (+  6799us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":306013,"raft.queue_time_us":320147,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":62956,"spinlock_wait_cycles":72596736,"thread_start_us":305794,"threads_started":2,"wal-append.queue_time_us":226676}
W20260709 12:11:54.469671 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:54.470300 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:54.471287 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 111221us
I20260709 12:11:54.440780 19068 raft_consensus.cc:2749] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:54.438309 18940 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:54.440249 19086 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:54.401844 19077 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:54.478197 13726 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:11:54.482959 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 143935us
I20260709 12:11:54.410552 19090 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:54.412544 19053 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:54.431051 18970 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:54.488070 14414 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 14.
I20260709 12:11:54.493985 13652 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:54.499009 13800 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:54.470248 19032 raft_consensus.cc:697] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 10 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:54.504957 13726 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:54.506021 18934 raft_consensus.cc:2749] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:54.506613 18626 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:54.507251 18626 raft_consensus.cc:697] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:54.508229 18626 consensus_queue.cc:237] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:54.489032 18940 raft_consensus.cc:3060] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:54.510807 19035 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:54.514842 19053 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:54.462620 19051 consensus_queue.cc:1048] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 12:11:54.482884 19086 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:54.525906 19056 raft_consensus.cc:2804] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:54.526489 19056 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:54.526957 19056 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:54.529134 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 46300.5us
I20260709 12:11:54.532255 18936 raft_consensus.cc:3055] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:54.532747 18936 raft_consensus.cc:740] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:54.534487 19032 consensus_queue.cc:237] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:54.535897 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:54.536720 14413 raft_consensus.cc:2393] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 12: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
W20260709 12:11:54.537952 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 44086.1us
I20260709 12:11:54.538784 13652 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:54.539610 19007 raft_consensus.cc:2764] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 12:11:54.541759 13652 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:54.543385 13761 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8195765ed074b74be387475c214120b"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "b98d2519bb504dc6905ed2ede4571835"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:11:54.543946 18970 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:54.544309 13761 raft_consensus.cc:606] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Received request to transfer leadership to TS b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:54.544718 13761 raft_consensus.cc:614] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:54.546016 19007 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:54.550774 13652 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:54.556403 19089 raft_consensus.cc:2764] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 12:11:54.551529 19090 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:54.533730 18936 consensus_queue.cc:260] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:54.557276 13652 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:54.533735 13800 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:11:54.588680 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:54.596277 13681 raft_consensus.cc:2468] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 12.
I20260709 12:11:54.597029 18936 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:54.598058 19035 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:54.603314 13830 raft_consensus.cc:1275] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:54.603964 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:54.603132 13801 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:54.525321 18938 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:54.614923 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 81285.1us
I20260709 12:11:54.549654 19096 raft_consensus.cc:2749] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:54.612142 19089 raft_consensus.cc:2749] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:54.626075 13800 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:54.627480 13801 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:54.614682 18529 raft_consensus.cc:2764] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
W20260709 12:11:54.702804 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 145790us
I20260709 12:11:54.594628 19043 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:54.694886 19020 log.cc:927] Time spent T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 12:11:54.713706 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 87742.7us
I20260709 12:11:54.632805 18913 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:54.770901 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:54.706135 19104 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:54.701819 19100 raft_consensus.cc:2804] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:11:54.806443 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:54.621090 18873 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.816262 13761 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "b98d2519bb504dc6905ed2ede4571835"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:11:54.829447 13761 raft_consensus.cc:606] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Received request to transfer leadership to TS b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:54.829861 13761 raft_consensus.cc:614] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:54.814218 18816 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:54.812167 19090 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.817122 18938 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:54.823302 19101 consensus_queue.cc:1048] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:54.826328 13837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 2915) took 1407 ms. Trace:
W20260709 12:11:54.818729 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 184060us
I20260709 12:11:54.835274 14380 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:54.832913 18873 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:54.837846 19077 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:54.837925 18913 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:54.838318 18873 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:54.834375 18816 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:54.840317 19090 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:54.841044 18816 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:54.841760 19083 log.cc:927] Time spent T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.940s	user 0.004s	sys 0.000s
I20260709 12:11:54.842399 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:11:54.842648 19090 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:54.834847 13837 rpcz_store.cc:276] 0709 12:11:53.419024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:53.419188 (+   164us) service_pool.cc:224] Handling call
0709 12:11:53.672877 (+253689us) spinlock_profiling.cc:243] Waited 33 ms on lock 0x7b5800034898. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924e68b71 00007fa924e68a22 00007fa92dd818d9 00007fa92cedbee0 00007fa92cfa50ab 00007fa92cfa5131 00007fa92cf66fc0 00007fa92cf51929 00007fa92cf513d2 00007fa9264c8bd4
0709 12:11:53.673116 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:53.803795 (+130679us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:54.826025 (+1022230us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b54002a6f54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:54.826234 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":370132480}
I20260709 12:11:54.843922 13800 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:54.845796 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:54.820592 19032 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:54.844692 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:11:54.844165 13754 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48120 (request call id 2019) took 1377 ms (client timeout 1775 ms). Trace:
I20260709 12:11:54.876878 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:54.829380 19104 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:54.827389 19100 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:11:54.846272 19111 log.cc:927] Time spent T 00000000000000000000000000000000 P 17d79eae88f84be7a847d0cf544674cd: Append to log took a long time: real 0.223s	user 0.004s	sys 0.004s
I20260709 12:11:54.834514 18940 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:54.899242 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 69388.8us
I20260709 12:11:54.900203 13652 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:54.900362 18940 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:54.901749 13652 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:54.907845 18673 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:54.908038 19035 raft_consensus.cc:2749] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:54.909070 18873 raft_consensus.cc:2749] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:54.909457 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:54.906109 14412 raft_consensus.cc:1240] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:54.910935 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:54.906816 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:54.906474 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:54.913540 13757 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 12.
I20260709 12:11:54.915904 19007 raft_consensus.cc:2749] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:54.916352 13652 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:54.828688 19056 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:54.917677 13652 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:11:54.918350 19054 consensus_meta.cc:287] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.569s	user 0.015s	sys 0.007s
I20260709 12:11:54.918782 19056 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:54.918938 19054 raft_consensus.cc:2749] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:54.919504 19056 raft_consensus.cc:2749] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:54.829677 19029 raft_consensus.cc:2749] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:11:54.909076 19032 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:54.914649 19017 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:54.923313 19032 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:54.830083 19076 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:54.927179 19076 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:54.918936 13652 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:54.927618 19043 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:54.928810 13652 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:11:54.929116 19116 log.cc:927] Time spent T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:11:54.929971 19017 raft_consensus.cc:2749] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:54.930169 13652 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:54.930491 19090 raft_consensus.cc:2749] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:54.931416 19090 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:11:54.910275 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 60157.2us
I20260709 12:11:54.938289 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:54.938890 13679 raft_consensus.cc:3060] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:54.939088 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:54.939867 13688 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 15.
I20260709 12:11:54.943384 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:54.944125 13683 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 13.
I20260709 12:11:54.945052 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:54.951627 19100 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:54.886250 18913 raft_consensus.cc:2764] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 12:11:54.968063 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:54.969882 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:54.968806 13756 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 12.
I20260709 12:11:54.973191 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:54.853799 13754 rpcz_store.cc:269] 0709 12:11:53.467258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:53.467776 (+   518us) service_pool.cc:224] Handling call
0709 12:11:54.843976 (+1376200us) spinlock_profiling.cc:243] Waited 477 ms on lock 0x7b54000efe54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:54.844082 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1097480960}
I20260709 12:11:54.890282 18763 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:54.890489 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:54.975281 13679 raft_consensus.cc:2468] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 13.
W20260709 12:11:54.891857 19105 log.cc:927] Time spent T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 12:11:54.977648 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 133802us
W20260709 12:11:54.979885 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 57441us
I20260709 12:11:54.884986 13727 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:54.973322 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:54.981549 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:54.982275 13685 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:54.973281 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:54.881839 19077 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:11:54.986577 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:54.902256 18816 raft_consensus.cc:2764] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 12:11:54.913625 18636 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:54.991473 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:54.994961 14409 raft_consensus.cc:1240] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:54.982651 13651 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:54.996377 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:54.997426 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:54.998485 14414 raft_consensus.cc:2368] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 14. Current term is 15.
I20260709 12:11:54.999852 13680 raft_consensus.cc:1240] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 12. Current term is 13. Ops: []
W20260709 12:11:55.002080 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:55.005139 13757 raft_consensus.cc:1275] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 12:11:55.006837 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:55.008754 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:55.009586 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:55.009645 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:55.011096 13679 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:55.011155 14379 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:54.981725 19017 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.015751 13651 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:55.019126 14408 raft_consensus.cc:1240] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 15 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:55.019721 13835 raft_consensus.cc:2393] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 12: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:55.020349 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:11:54.995652 13652 connection.cc:256] RPC call timeout handler was delayed by -1.7026384569999209s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.221s for a response
W20260709 12:11:55.021190 13652 connection.cc:256] RPC call timeout handler was delayed by -1.6308168159998786s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1743s for a response
W20260709 12:11:55.021528 13652 connection.cc:256] RPC call timeout handler was delayed by -1.5894604739999068s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2056s for a response
W20260709 12:11:55.021821 13652 connection.cc:256] RPC call timeout handler was delayed by -1.4608290880000823s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19890000000000002s for a response
I20260709 12:11:55.025089 13685 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 17.
I20260709 12:11:55.028842 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:55.029579 14413 raft_consensus.cc:2468] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 11.
I20260709 12:11:55.031677 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:55.023073 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:11:55.034308 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 149430us
I20260709 12:11:55.032382 13686 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 12.
I20260709 12:11:55.035187 13727 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:55.035756 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:55.029599 14379 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:55.037060 13685 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 17.
I20260709 12:11:55.034862 13680 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:11:55.042253 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:55.042675 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:55.043136 13830 raft_consensus.cc:2393] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 14: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:55.004113 19056 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.014570 19007 raft_consensus.cc:2804] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:55.048254 14379 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:55.067329 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:55.052438 13835 raft_consensus.cc:1275] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:11:55.032757 18816 raft_consensus.cc:2804] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:55.035941 18636 raft_consensus.cc:2804] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:55.085209 13835 raft_consensus.cc:1275] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:55.086951 13726 leader_election.cc:304] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:11:55.091518 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 45210.7us
I20260709 12:11:55.023119 18846 consensus_queue.cc:1048] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 12:11:55.096154 13652 leader_election.cc:400] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 election: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 14. Current term is 15.
I20260709 12:11:55.112746 13652 leader_election.cc:403] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:11:55.074585 19039 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:55.049245 18946 raft_consensus.cc:2804] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:55.102150 18991 consensus_queue.cc:1059] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 12:11:55.109171 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:55.104724 14379 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:55.047079 18934 raft_consensus.cc:2749] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:11:55.095201 19007 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:55.075873 18970 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:55.083508 19016 raft_consensus.cc:2749] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:55.121064 13800 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:55.103093 13726 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:55.029963 19017 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:55.125928 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:55.093312 18673 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:55.170172 18673 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:55.124891 18946 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:55.086086 18816 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:55.134393 19088 raft_consensus.cc:2804] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:11:55.049561 19097 consensus_meta.cc:287] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.649s	user 0.011s	sys 0.000s
I20260709 12:11:55.111183 19101 raft_consensus.cc:2804] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:55.133028 14379 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:55.122481 18938 raft_consensus.cc:2804] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:55.081632 19056 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:55.122833 18636 raft_consensus.cc:697] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 12 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:55.124692 19089 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:55.169157 13679 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 14.
I20260709 12:11:55.174085 13835 raft_consensus.cc:2393] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 12: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
W20260709 12:11:55.198240 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 93826.4us
I20260709 12:11:55.158562 18995 consensus_queue.cc:1048] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 12:11:55.180584 19088 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:55.139293 19007 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:55.133020 18991 raft_consensus.cc:2749] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 14. Current term is 15.
I20260709 12:11:55.177075 18946 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:55.108896 18529 consensus_queue.cc:1059] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 12:11:55.096562 19019 consensus_queue.cc:1059] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 12:11:55.177181 18816 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:54.991961 19015 consensus_queue.cc:1048] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.042s
W20260709 12:11:55.193131 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 90132us
W20260709 12:11:55.193625 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 89651.8us
I20260709 12:11:55.196141 19101 raft_consensus.cc:697] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 13 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
W20260709 12:11:55.185375 19086 consensus_meta.cc:287] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.631s	user 0.005s	sys 0.007s
I20260709 12:11:55.161105 18970 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:55.180470 19098 raft_consensus.cc:2749] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:55.299464 14413 raft_consensus.cc:1275] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:11:55.153360 13680 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 12.
I20260709 12:11:55.196907 18763 raft_consensus.cc:2804] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:11:55.200675 18938 raft_consensus.cc:697] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:55.262751 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:55.195487 19041 raft_consensus.cc:2749] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:55.266634 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:55.269250 13800 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:11:55.191421 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 58451.9us
I20260709 12:11:55.316792 13829 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:55.317060 13835 raft_consensus.cc:2410] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 18 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:11:55.268396 13726 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:55.274396 13831 raft_consensus.cc:1240] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:11:55.277416 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:55.279896 14414 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:55.211884 19088 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:55.303752 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 209638us
I20260709 12:11:55.304714 13681 raft_consensus.cc:1275] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:11:55.327564 13681 raft_consensus.cc:1275] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:11:55.322244 13679 raft_consensus.cc:2468] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 11.
I20260709 12:11:55.257692 19089 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:55.330479 13679 raft_consensus.cc:1240] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 15. Current term is 16. Ops: []
W20260709 12:11:55.326709 13652 leader_election.cc:336] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 1.743s (SENT)
I20260709 12:11:55.332497 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:55.333323 13830 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 16.
I20260709 12:11:55.333699 14379 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:55.332370 13681 raft_consensus.cc:1275] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:11:55.309120 18529 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.312968 18763 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:55.305299 18868 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.327406 18825 consensus_queue.cc:1059] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:11:55.285029 19086 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:55.286247 19100 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:55.262974 19016 raft_consensus.cc:2955] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index 8 to 10, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:11:55.341946 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:55.410063 13831 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:55.355633 14414 raft_consensus.cc:1275] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:11:55.342412 13684 raft_consensus.cc:1275] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:11:55.394788 13686 raft_consensus.cc:1275] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:55.408138 13836 raft_consensus.cc:1240] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:55.337013 13829 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 12.
I20260709 12:11:55.423492 13829 raft_consensus.cc:1240] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:55.424965 13829 raft_consensus.cc:1240] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:55.545224 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:55.391732 19131 raft_consensus.cc:993] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7: : Instructing follower 96701a74fdee481fb5f54aac841e17dd to start an election
W20260709 12:11:55.346107 13652 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 1.989s (SENT) [suppressed 34 similar messages]
I20260709 12:11:55.472831 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:55.468009 13832 raft_consensus.cc:1275] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:11:55.407809 19100 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:55.547721 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 245804us
I20260709 12:11:55.341472 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:55.555516 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:55.581707 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:11:55.376632 19127 log.cc:927] Time spent T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:11:55.606747 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:55.362084 18763 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:11:55.382109 19123 log.cc:927] Time spent T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260709 12:11:55.360246 19017 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:55.627878 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 359566us
I20260709 12:11:55.371950 19089 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:55.379400 18872 raft_consensus.cc:2804] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:55.362579 18970 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:55.341897 19041 raft_consensus.cc:2804] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:55.374583 18996 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:55.365051 19086 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:55.403106 19056 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:55.549170 19027 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.346263 18529 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:55.698561 13830 raft_consensus.cc:1275] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:11:55.692287 13726 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:55.362211 18868 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:55.644784 19124 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.013s	sys 0.036s
I20260709 12:11:55.711037 13680 raft_consensus.cc:1275] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:55.726612 13761 raft_consensus.cc:2410] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
W20260709 12:11:55.546360 19090 consensus_meta.cc:287] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.546s	user 0.013s	sys 0.000s
W20260709 12:11:55.733839 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 387746us
W20260709 12:11:55.778020 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:55.695007 19131 raft_consensus.cc:1081] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Signalling peer 96701a74fdee481fb5f54aac841e17dd to start an election
I20260709 12:11:55.691618 19132 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.403322 18816 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:55.702018 19050 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.705229 18872 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:55.359215 18938 consensus_queue.cc:237] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:55.803305 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:55.727298 18970 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.354010 19101 consensus_queue.cc:237] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:55.810374 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 82404.9us
I20260709 12:11:55.712128 19041 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:55.398234 18636 consensus_queue.cc:237] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:55.813594 13652 leader_election.cc:336] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 2.056s (SENT)
I20260709 12:11:55.819334 13652 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:55.817809 19041 raft_consensus.cc:3060] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:55.784214 19090 raft_consensus.cc:2749] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:55.746661 19056 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:55.813905 13727 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
W20260709 12:11:55.789862 19124 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.016s	sys 0.050s
I20260709 12:11:55.802188 18872 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:55.770146 18996 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:55.874863 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 179408us
W20260709 12:11:55.876057 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 68635.9us
I20260709 12:11:55.876778 13682 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 16.
I20260709 12:11:55.826932 18970 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:55.884047 18816 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:55.884786 18970 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:55.842238 19056 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:55.746966 19027 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:55.837921 18991 raft_consensus.cc:2749] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:55.807736 19050 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:55.902160 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:55.902779 14413 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 14.
I20260709 12:11:55.903527 13761 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:55.906368 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:55.907441 13652 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:55.807734 19132 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:55.916117 13652 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
W20260709 12:11:55.901644 19077 consensus_meta.cc:287] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.906s	user 0.008s	sys 0.007s
I20260709 12:11:55.914284 18816 raft_consensus.cc:2749] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:55.925622 13652 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:55.926913 13756 raft_consensus.cc:1275] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 12:11:55.927096 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 113307us
I20260709 12:11:55.914893 18970 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:55.930079 13726 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:55.914889 19148 raft_consensus.cc:2804] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:55.950512 18868 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:55.953884 18868 consensus_queue.cc:1048] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:55.951684 18816 raft_consensus.cc:2749] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:55.955663 19050 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:55.957167 19148 raft_consensus.cc:697] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:55.958240 19148 consensus_queue.cc:237] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:55.959363 19027 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:55.950839 18934 consensus_queue.cc:1048] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:11:55.963183 13831 consensus_meta.cc:287] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.533s	user 0.010s	sys 0.000s
I20260709 12:11:55.927170 19077 raft_consensus.cc:2749] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:11:55.927776 19144 raft_consensus.cc:2804] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:55.963714 13831 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 14.
W20260709 12:11:55.954222 19088 consensus_meta.cc:287] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.562s	user 0.010s	sys 0.001s
I20260709 12:11:55.934319 18970 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:55.962321 19007 consensus_meta.cc:287] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.681s	user 0.006s	sys 0.002s
I20260709 12:11:55.967671 19015 consensus_queue.cc:1048] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:55.968642 19139 consensus_queue.cc:1048] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:55.969686 19140 consensus_queue.cc:1059] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:55.975353 18626 consensus_queue.cc:1048] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:11:55.977968 18626 consensus_queue.cc:1243] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer b98d2519bb504dc6905ed2ede4571835 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:11:55.974874 19144 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:55.975592 18970 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:55.979527 19144 raft_consensus.cc:3060] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:55.980594 19016 consensus_meta.cc:287] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.583s	user 0.009s	sys 0.000s
I20260709 12:11:55.975569 18529 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:55.988183 18789 raft_consensus.cc:3055] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:55.988791 18789 raft_consensus.cc:740] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:55.989817 18789 consensus_queue.cc:260] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:55.991020 18789 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:55.994215 19088 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:55.996745 19088 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:55.997747 19077 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:55.997936 19027 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.998306 19077 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:55.998618 19027 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:55.999495 19137 log.cc:927] Time spent T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:11:56.000800 19077 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:56.002512 19132 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:55.971534 19131 raft_consensus.cc:2804] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:56.004343 18673 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:56.004519 19131 raft_consensus.cc:697] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:56.005599 19131 consensus_queue.cc:237] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:56.006167 19098 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:56.006814 19098 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:56.009351 19098 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:56.009904 19056 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:56.010212 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 740992us
I20260709 12:11:56.011176 18996 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:55.967787 18946 consensus_meta.cc:287] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.693s	user 0.011s	sys 0.000s
I20260709 12:11:56.011637 13800 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:11:56.014780 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:56.017128 14380 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:56.023211 13761 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 13.
I20260709 12:11:56.025030 13800 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:56.027753 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:56.028472 13829 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 13.
I20260709 12:11:56.028434 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:56.029814 13756 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 15.
I20260709 12:11:56.030269 14380 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:56.042078 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:56.042234 13830 raft_consensus.cc:1275] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:56.043434 13831 raft_consensus.cc:2393] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 12: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:56.045194 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:11:56.049913 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 73701.8us
I20260709 12:11:56.049374 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:56.034927 18529 raft_consensus.cc:2749] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:56.038499 19077 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:56.034934 18913 raft_consensus.cc:2749] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:56.072973 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:56.049206 19029 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:56.046367 13835 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c"
dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:54820
I20260709 12:11:56.084790 13685 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 13.
I20260709 12:11:56.085234 13835 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:56.085645 13835 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:56.037523 19101 raft_consensus.cc:2749] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:56.064977 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:56.038730 19068 consensus_queue.cc:1048] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 12:11:56.091854 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:56.023896 18946 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:56.083343 19015 consensus_queue.cc:1048] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 12:11:56.094128 18946 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:56.040232 18673 consensus_queue.cc:1048] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 12:11:56.040952 19041 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:56.091881 19141 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:56.096854 19141 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:56.098095 19041 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199)
I20260709 12:11:56.038429 18763 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:56.099279 19141 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:56.100835 18763 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:56.102058 18970 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:56.102634 19141 consensus_queue.cc:1048] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:56.104334 18970 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:56.079640 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:56.083426 13679 raft_consensus.cc:1275] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:11:56.038568 19098 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:56.105304 19139 consensus_queue.cc:1059] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:56.077466 13800 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:56.105813 19098 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:56.108192 19098 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:56.108799 19098 raft_consensus.cc:2804] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:56.109361 19098 raft_consensus.cc:697] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 13 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:56.013111 19007 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:56.110683 13684 raft_consensus.cc:1240] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:56.095881 19100 raft_consensus.cc:2804] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:56.089874 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:56.088699 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:56.130884 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:56.131801 13683 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 15.
I20260709 12:11:56.133401 13683 pending_rounds.cc:85] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 5
I20260709 12:11:56.094131 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:56.115697 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:56.129575 13686 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 13.
I20260709 12:11:56.137040 13679 raft_consensus.cc:1240] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:56.136201 13683 pending_rounds.cc:107] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 12:11:56.142541 13683 raft_consensus.cc:2889] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:56.157914 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:56.101552 18763 consensus_queue.cc:1059] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:11:56.174973 13761 raft_consensus.cc:1240] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 20. Current term is 21. Ops: []
I20260709 12:11:56.092283 19029 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:56.161561 19027 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:56.159791 19100 raft_consensus.cc:697] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 13 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:56.170373 18626 raft_consensus.cc:3055] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:56.192862 19029 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:56.195467 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:56.197227 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 96523.8us
I20260709 12:11:56.198498 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:56.215202 13727 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:56.215709 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:56.218138 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:56.198444 19026 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.010s	user 0.006s	sys 0.011s
I20260709 12:11:56.216070 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:56.226948 13754 raft_consensus.cc:2393] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 15: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
W20260709 12:11:56.239547 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 61791.7us
I20260709 12:11:56.257663 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:56.189642 18626 raft_consensus.cc:740] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:56.259521 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:56.260376 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:56.187435 19056 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:56.280542 13829 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 12.
I20260709 12:11:56.282017 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:56.283299 13829 raft_consensus.cc:2410] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 14 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:11:56.285760 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:56.286751 13829 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 12.
I20260709 12:11:56.216746 19102 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:56.289654 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:56.290627 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:56.293277 13832 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:56.279470 13684 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 15.
I20260709 12:11:56.184587 19144 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:56.293999 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:56.255820 18970 consensus_queue.cc:1048] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:11:56.263268 19026 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.083s	user 0.009s	sys 0.014s
I20260709 12:11:56.299558 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:56.298905 13829 raft_consensus.cc:2393] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 13: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:56.311618 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:56.312768 13829 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:56.314744 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:56.291980 19139 raft_consensus.cc:2804] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:56.321657 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:56.322103 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:56.322897 19077 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:56.323222 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:56.323421 19131 raft_consensus.cc:3055] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:56.323971 19131 raft_consensus.cc:740] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:11:56.324162 19158 log.cc:927] Time spent T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:11:56.324486 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:56.325222 13828 raft_consensus.cc:2393] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 14: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:56.324918 19131 consensus_queue.cc:260] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:56.326771 19056 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:56.327278 13800 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:56.328743 19097 raft_consensus.cc:3055] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:56.329159 19097 raft_consensus.cc:740] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
W20260709 12:11:56.329911 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:56.330080 19097 consensus_queue.cc:260] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:56.330687 13652 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:56.331113 19097 raft_consensus.cc:3060] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:56.332463 13652 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:56.333456 19029 raft_consensus.cc:2804] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:56.333881 19029 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:56.334270 19029 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:56.334753 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:56.336606 19157 log.cc:927] Time spent T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:11:56.318521 19165 consensus_queue.cc:1048] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 12:11:56.338115 19054 raft_consensus.cc:2749] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:56.338851 19054 raft_consensus.cc:2749] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:56.339249 19007 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:56.339985 13836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 2936) took 1128 ms. Trace:
I20260709 12:11:56.340369 13836 rpcz_store.cc:276] 0709 12:11:55.211566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:55.211761 (+   195us) service_pool.cc:224] Handling call
0709 12:11:55.273491 (+ 61730us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:55.544083 (+270592us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:56.339768 (+795685us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b540020dd54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:56.339930 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":308893440}
I20260709 12:11:56.317703 19100 consensus_queue.cc:237] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:56.345824 19156 log.cc:927] Time spent T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:11:56.347250 19104 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199)
I20260709 12:11:56.216777 19098 consensus_queue.cc:237] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:56.350593 18825 raft_consensus.cc:3055] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:56.350838 13652 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:56.351163 18825 raft_consensus.cc:740] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:56.352209 18825 consensus_queue.cc:260] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:56.353333 18825 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:56.355998 19007 raft_consensus.cc:2749] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:56.357345 13652 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:56.358260 19122 raft_consensus.cc:2749] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:56.359431 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:56.361301 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:56.361132 19029 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:56.362604 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:56.362665 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:56.366880 19029 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:11:56.376185 19133 log.cc:927] Time spent T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.497s	user 0.000s	sys 0.001s
I20260709 12:11:56.383881 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:56.384722 13831 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:56.386906 14409 raft_consensus.cc:1240] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
W20260709 12:11:56.400630 19129 log.cc:927] Time spent T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.522s	user 0.001s	sys 0.000s
I20260709 12:11:56.404820 19029 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:56.405443 19029 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:56.407680 19029 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:56.408476 13831 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 13.
I20260709 12:11:56.359571 13652 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:11:56.413571 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 54097.9us
I20260709 12:11:56.415308 13652 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:56.414098 13832 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 16.
I20260709 12:11:56.409607 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:56.424010 13836 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 10.
I20260709 12:11:56.425122 13652 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:56.426324 13652 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:56.433054 14407 raft_consensus.cc:1240] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 20. Current term is 21. Ops: []
I20260709 12:11:56.434195 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:11:56.438266 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 173109us
I20260709 12:11:56.441212 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:56.441879 13837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 926) took 1480 ms. Trace:
I20260709 12:11:56.442294 13652 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:56.444680 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:56.445930 13757 raft_consensus.cc:2410] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:11:56.438365 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:56.438949 13834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 932) took 1434 ms. Trace:
I20260709 12:11:56.294822 18872 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:56.441341 13726 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:56.450055 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:56.447962 13834 rpcz_store.cc:276] 0709 12:11:55.004370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:55.004520 (+   150us) service_pool.cc:224] Handling call
0709 12:11:55.023946 (+ 19426us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:55.024164 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:55.024186 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:55.024639 (+   453us) log.cc:844] Serialized 26 byte log entry
0709 12:11:55.457850 (+433211us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:55.457913 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:55.458244 (+   331us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:56.375465 (+917221us) spinlock_profiling.cc:243] Waited 32 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:11:56.412868 (+ 37403us) raft_consensus.cc:1685] finished
0709 12:11:56.412905 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:56.438883 (+ 25978us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":73572736,"thread_start_us":368651,"threads_started":1,"wal-append.queue_time_us":733836}
I20260709 12:11:56.450783 13836 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 15.
I20260709 12:11:56.450103 14408 raft_consensus.cc:1240] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 13 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:56.457069 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:56.458077 13684 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 13.
W20260709 12:11:56.459970 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:56.320878 19139 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:56.462426 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:56.451227 13726 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:56.462826 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:56.298131 19102 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:56.465560 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:56.466876 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:56.437911 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:56.455756 13835 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:56.468082 13828 raft_consensus.cc:2368] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 11. Current term is 12.
I20260709 12:11:56.468259 13830 raft_consensus.cc:1240] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:56.469235 13687 raft_consensus.cc:2393] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 13: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:56.442432 13837 rpcz_store.cc:276] 0709 12:11:54.961860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:54.962686 (+   826us) service_pool.cc:224] Handling call
0709 12:11:54.977285 (+ 14599us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:55.008171 (+ 30886us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:55.008205 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:55.042231 (+ 34026us) log.cc:844] Serialized 26 byte log entry
0709 12:11:55.417485 (+375254us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:55.417545 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:55.417642 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:56.399747 (+982105us) spinlock_profiling.cc:243] Waited 32 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:11:56.421966 (+ 22219us) raft_consensus.cc:1685] finished
0709 12:11:56.422001 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:56.441814 (+ 19813us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":25017,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":6755,"spinlock_wait_cycles":73612544,"thread_start_us":350974,"threads_started":1,"wal-append.queue_time_us":744010}
W20260709 12:11:56.444100 19137 log.cc:927] Time spent T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:11:56.474677 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:56.429828 19054 raft_consensus.cc:2749] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:56.438685 19132 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:56.487711 13832 raft_consensus.cc:2393] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 16: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:56.477154 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:56.465420 18846 raft_consensus.cc:2804] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:56.471140 19019 consensus_queue.cc:1059] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 12:11:56.480760 19054 raft_consensus.cc:2749] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:56.440217 18816 raft_consensus.cc:2804] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:56.494856 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:56.481482 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:56.482174 19102 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:56.498569 13834 raft_consensus.cc:1240] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:56.437366 19146 raft_consensus.cc:2804] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:56.471431 19150 raft_consensus.cc:2804] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:56.503222 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:56.505136 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:56.478747 13835 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:56.466015 19139 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:56.492453 13836 raft_consensus.cc:1275] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:11:56.471750 19104 consensus_queue.cc:1048] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 12:11:56.520247 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:56.521166 13687 raft_consensus.cc:2468] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 10.
I20260709 12:11:56.506676 14415 raft_consensus.cc:1240] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:56.464697 19043 consensus_queue.cc:1048] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 12:11:56.490211 18846 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:56.510417 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:56.471294 18718 consensus_queue.cc:1048] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 12:11:56.490079 19029 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:56.511763 18763 raft_consensus.cc:3055] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:56.512158 19169 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:56.514307 13833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 2937) took 1301 ms. Trace:
I20260709 12:11:56.510788 14416 raft_consensus.cc:1240] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:56.525499 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:56.530728 18846 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:56.409633 18626 consensus_queue.cc:260] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:56.504451 18816 raft_consensus.cc:697] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 16 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:56.489760 18970 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:56.539664 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:56.538043 18763 raft_consensus.cc:740] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:56.542361 13687 raft_consensus.cc:2410] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 20 because replica has last-logged OpId of term: 19 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 12:11:56.540109 13684 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 14.
I20260709 12:11:56.543401 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:56.543212 18763 consensus_queue.cc:260] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:56.544401 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:56.544657 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:56.545442 13687 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 13.
I20260709 12:11:56.544836 18763 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:56.545624 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:56.550913 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:56.551205 18816 consensus_queue.cc:237] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:56.552284 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:56.538718 13833 rpcz_store.cc:276] 0709 12:11:55.212444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:55.212617 (+   173us) service_pool.cc:224] Handling call
0709 12:11:55.273174 (+ 60557us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:55.273617 (+   443us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:55.278524 (+  4907us) log.cc:844] Serialized 14 byte log entry
0709 12:11:56.002433 (+723909us) spinlock_profiling.cc:243] Waited 3.54 ms on lock 0x7b18000bc560. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e1ac0a 00007fa92e55a219 00007fa92be6158f 00007fa924ea0571 00007fa924ea27c1 00007fa924ea2779 00007fa924ea2709 00007fa924ea26d1 00007fa924ea19cd
0709 12:11:56.006613 (+  4180us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b18000bc560. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924ea0522 00007fa924ea27c1 00007fa924ea2779 00007fa924ea2709 00007fa924ea26d1 00007fa924ea19cd 0000000000388634 0000000000388479 00007fa924e8383a
0709 12:11:56.167217 (+160604us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:56.359910 (+192693us) spinlock_profiling.cc:243] Waited 1.12 ms on lock 0x7b2c0000bb28. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa926886a11 00007fa926896372 00007fa927fc8a01 00007fa927f8d43a 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2
0709 12:11:56.360389 (+   479us) log.cc:844] Serialized 26 byte log entry
0709 12:11:56.360582 (+   193us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:56.360626 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:56.360705 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:56.514101 (+153396us) raft_consensus.cc:1685] finished
0709 12:11:56.514122 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:56.514247 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":476502,"prepare.queue_time_us":4880,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":59,"raft.queue_time_us":470814,"raft.run_cpu_time_us":320,"raft.run_wall_time_us":22506,"spinlock_wait_cycles":37400448,"thread_start_us":410886,"threads_started":2,"wal-append.queue_time_us":597460}
I20260709 12:11:56.552764 13829 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 13.
I20260709 12:11:56.553958 18970 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:56.556572 18970 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:56.558913 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:56.553488 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:56.560678 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:56.561954 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:56.562856 13687 raft_consensus.cc:2393] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 12: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:11:56.563841 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:56.563974 13684 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 15.
I20260709 12:11:56.564754 13687 raft_consensus.cc:2393] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 12: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:11:56.564957 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:56.508658 19150 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:56.565564 13684 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:56.589597 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:56.599843 13761 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 13.
I20260709 12:11:56.615361 13758 raft_consensus.cc:1240] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:56.588467 19150 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:56.628069 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:56.576157 19029 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:56.642617 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:56.643446 13760 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 17.
I20260709 12:11:56.588148 19169 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:56.659407 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:56.665279 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:56.674121 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:56.674943 13760 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 10.
I20260709 12:11:56.652642 13684 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 18.
W20260709 12:11:56.657179 13682 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2860) took 1661 ms (client timeout 1875 ms). Trace:
W20260709 12:11:56.684949 13682 rpcz_store.cc:269] 0709 12:11:54.980105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:55.006179 (+ 26074us) service_pool.cc:224] Handling call
0709 12:11:56.641494 (+1635315us) spinlock_profiling.cc:243] Waited 867 ms on lock 0x7b5400270e54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:56.641614 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1994603264}
I20260709 12:11:56.698129 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:56.699704 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:56.706507 13684 raft_consensus.cc:1240] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 12. Current term is 13. Ops: []
W20260709 12:11:56.706590 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:56.712842 18913 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:56.713812 18913 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:56.716982 18913 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:56.719343 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:56.719915 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:56.720784 13829 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:56.722477 13682 raft_consensus.cc:1275] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:56.750975 13833 raft_consensus.cc:1240] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:56.762578 13800 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:56.764010 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:56.685730 18872 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:56.765786 13800 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
W20260709 12:11:56.768442 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 326230us
I20260709 12:11:56.790616 13829 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 17.
I20260709 12:11:56.792266 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:56.699769 19102 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:56.762578 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:56.837635 13830 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 15.
I20260709 12:11:56.766220 19160 raft_consensus.cc:2749] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:56.840107 19098 consensus_queue.cc:1059] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:56.838609 19146 raft_consensus.cc:697] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 13 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:56.847033 19146 consensus_queue.cc:237] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:56.840463 13763 raft_consensus.cc:1275] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:11:56.836619 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:56.840426 19160 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:56.862648 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:56.863549 13833 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 10.
I20260709 12:11:56.865039 13833 raft_consensus.cc:1240] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:56.845808 19035 raft_consensus.cc:2804] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:56.744997 19076 consensus_queue.cc:1059] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.133s
I20260709 12:11:56.866560 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:56.878556 13679 raft_consensus.cc:1275] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:11:56.878777 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:11:56.881387 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 264180us
I20260709 12:11:56.887480 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:56.888160 13763 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:56.881815 19172 log.cc:927] Time spent T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.261s	user 0.001s	sys 0.000s
I20260709 12:11:56.856209 19102 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:56.859483 19160 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:56.899473 19077 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:56.901104 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:56.902344 14413 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41700 (request call id 783) took 1198 ms. Trace:
I20260709 12:11:56.903924 19150 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:56.904657 19056 leader_election.cc:290] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:56.905485 13763 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 13.
I20260709 12:11:56.889796 19176 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:56.910581 13832 raft_consensus.cc:1275] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:56.911019 19007 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:56.916092 14413 rpcz_store.cc:276] 0709 12:11:55.703897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:55.742213 (+ 38316us) service_pool.cc:224] Handling call
0709 12:11:56.902113 (+1159900us) spinlock_profiling.cc:243] Waited 98.5 ms on lock 0x7b540068ced4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:56.902259 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":226586496}
I20260709 12:11:56.906242 14379 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:56.946251 13829 raft_consensus.cc:1275] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:11:56.955458 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:11:56.975210 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 69061.4us
I20260709 12:11:56.987339 13832 raft_consensus.cc:1275] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:56.937705 19029 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:56.998287 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 230792us
I20260709 12:11:56.979040 19031 raft_consensus.cc:2749] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:56.945652 19077 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:57.001148 13800 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:56.999660 19029 raft_consensus.cc:3055] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:56.977032 19007 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:57.020684 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:57.021067 13800 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:56.994529 19169 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:57.029065 19035 raft_consensus.cc:697] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 13 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:57.037714 19035 consensus_queue.cc:237] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:57.000625 19100 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.012s	sys 0.012s
I20260709 12:11:56.996060 18913 consensus_queue.cc:1059] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.024s
I20260709 12:11:56.976482 19176 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:57.049090 13652 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:57.050786 13800 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:11:57.054728 13652 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:11:57.050324 19100 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.012s	sys 0.012s
W20260709 12:11:57.048931 19139 consensus_meta.cc:287] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.537s	user 0.003s	sys 0.010s
I20260709 12:11:57.030613 19056 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.029397 19029 raft_consensus.cc:740] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
W20260709 12:11:57.070437 19178 log.cc:927] Time spent T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 12:11:57.073503 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:11:57.074536 19180 log.cc:927] Time spent T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 12:11:57.080374 19183 raft_consensus.cc:2749] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:57.081544 19076 raft_consensus.cc:3055] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:11:57.162853 19076 raft_consensus.cc:740] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
W20260709 12:11:57.164003 19181 log.cc:927] Time spent T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 12:11:57.164381 19076 consensus_queue.cc:260] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:57.166067 19076 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:11:57.166406 19195 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.167039 19195 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:57.158728 19056 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:57.170650 19198 raft_consensus.cc:2804] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:57.171247 19198 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:57.171725 19198 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:57.110832 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:11:57.085101 19132 consensus_meta.cc:287] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.582s	user 0.012s	sys 0.000s
I20260709 12:11:57.156998 19189 raft_consensus.cc:2804] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:11:57.090251 19174 log.cc:927] Time spent T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
I20260709 12:11:57.177944 13687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2887) took 1040 ms. Trace:
I20260709 12:11:57.178074 19132 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:57.154925 19139 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:57.178442 13687 rpcz_store.cc:276] 0709 12:11:56.137608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:56.565393 (+427785us) service_pool.cc:224] Handling call
0709 12:11:56.565749 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:56.894628 (+328879us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:56.894676 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:56.938393 (+ 43717us) log.cc:844] Serialized 26 byte log entry
0709 12:11:57.064156 (+125763us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:57.064251 (+    95us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:57.064378 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:57.177677 (+113299us) raft_consensus.cc:1685] finished
0709 12:11:57.177706 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:57.177881 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":330901,"raft.run_cpu_time_us":44,"raft.run_wall_time_us":44,"thread_start_us":381527,"threads_started":2,"wal-append.queue_time_us":197907}
I20260709 12:11:57.179658 19191 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:11:57.180156 19191 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:11:57.174796 19179 log.cc:927] Time spent T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 12:11:57.180593 19191 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:57.181257 13757 raft_consensus.cc:2393] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 14: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:57.182045 13686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2884) took 1091 ms. Trace:
I20260709 12:11:57.182574 19150 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:57.091040 19160 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:57.182456 13686 rpcz_store.cc:276] 0709 12:11:56.090354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:56.143719 (+ 53365us) service_pool.cc:224] Handling call
0709 12:11:56.162807 (+ 19088us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:56.180221 (+ 17414us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:56.180276 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:56.180922 (+   646us) log.cc:844] Serialized 26 byte log entry
0709 12:11:56.437567 (+256645us) spinlock_profiling.cc:243] Waited 5.4 ms on lock 0x7b180035a280. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e82e07 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9fc02 00007fa927b2720b 00007fa927b2cd23 00007fa927b2d0d1 00007fa927f48a0f
0709 12:11:56.823701 (+386134us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:56.823769 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:56.823877 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:57.181704 (+357827us) raft_consensus.cc:1685] finished
0709 12:11:57.181726 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:57.181981 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7029,"raft.queue_time_us":13872,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":5635,"spinlock_wait_cycles":12422016,"thread_start_us":385830,"threads_started":1,"wal-append.queue_time_us":766013}
I20260709 12:11:57.062860 19177 consensus_queue.cc:1059] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.120s
I20260709 12:11:57.065197 19182 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:57.162674 19029 consensus_queue.cc:260] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:57.185977 19182 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:57.186777 19029 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:57.191293 19007 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:57.154388 18873 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:57.192688 18873 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:57.194638 19102 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:57.195902 18873 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:57.197731 19077 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:57.169557 19195 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:57.198336 19176 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:57.154590 19194 raft_consensus.cc:2749] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:57.180691 19139 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:57.180751 18626 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:57.216262 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 127015us
I20260709 12:11:57.173138 19056 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:57.215364 19189 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:57.219871 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:57.226959 13762 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 12.
I20260709 12:11:57.220849 14407 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 14.
I20260709 12:11:57.236860 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:57.237833 19132 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:57.241684 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:57.220486 19077 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.240427 19176 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:57.228968 19189 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:11:57.250618 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 164288us
I20260709 12:11:57.216284 19198 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:57.261193 13651 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:57.238494 19132 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:57.278880 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:57.238992 19031 consensus_queue.cc:1048] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 12:11:57.281181 13828 raft_consensus.cc:1275] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:11:57.266593 19007 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.288025 13800 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:57.292908 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:57.285130 19203 raft_consensus.cc:2749] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:11:57.293663 18846 consensus_meta.cc:287] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.744s	user 0.008s	sys 0.001s
I20260709 12:11:57.294234 18846 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:57.297153 18846 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:57.300112 19198 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:57.302240 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:57.285389 19195 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:57.303308 19195 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:57.303380 19189 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:57.303843 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:57.304548 13759 raft_consensus.cc:2368] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 15. Current term is 16.
I20260709 12:11:57.305202 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:57.305425 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:57.306087 13833 raft_consensus.cc:2393] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 12: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:57.306356 14414 raft_consensus.cc:2393] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 12: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:11:57.284579 13651 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:57.309943 13651 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:57.309886 13801 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:57.293708 13828 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 14.
I20260709 12:11:57.318589 13651 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:57.252079 19077 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:57.331566 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:57.303892 19144 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:57.280793 19100 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:11:57.336941 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 49009.2us
I20260709 12:11:57.278312 18913 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:57.338601 13800 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:57.285964 19035 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.270532 19176 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:57.330066 19203 raft_consensus.cc:2749] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:57.320171 19195 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:57.345592 13651 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:57.330688 19122 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:57.367462 19132 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:57.370059 19189 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:57.345165 19100 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:57.371240 19176 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:57.371671 19202 log.cc:927] Time spent T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:11:57.372691 19100 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:57.341596 19205 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:57.373659 19205 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:57.376058 19205 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:57.350687 19199 raft_consensus.cc:2749] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:57.354116 19035 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:57.379571 19077 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:57.351313 14407 raft_consensus.cc:1240] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 12:11:57.381172 13651 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:57.342242 19056 raft_consensus.cc:2749] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:57.342435 19194 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:57.381985 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 96603.4us
W20260709 12:11:57.383401 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 44952.5us
I20260709 12:11:57.394013 13800 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:57.396018 13800 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:11:57.346654 19043 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.005s	sys 0.026s
I20260709 12:11:57.404682 19176 raft_consensus.cc:2749] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:57.405390 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:57.406818 13685 raft_consensus.cc:1240] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:57.314004 19007 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:57.410326 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:57.410347 13685 raft_consensus.cc:1275] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:57.382791 19193 raft_consensus.cc:2804] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:57.414088 19193 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:57.414613 19193 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:57.382798 19203 raft_consensus.cc:2804] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:57.415390 19203 raft_consensus.cc:697] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 13 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:57.416554 19203 consensus_queue.cc:237] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:57.401639 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:57.402653 13800 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:57.418383 19195 raft_consensus.cc:2804] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:57.418860 19195 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:57.419224 19195 raft_consensus.cc:3060] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:57.419524 13800 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:57.420742 13800 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:57.421662 13800 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:57.349103 19146 consensus_queue.cc:1048] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:11:57.425534 19100 raft_consensus.cc:2804] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:57.426568 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:57.427249 13800 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:57.345679 18913 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:57.422513 19043 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.010s	sys 0.036s
I20260709 12:11:57.430682 13800 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:57.441926 13800 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:57.442689 13761 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 14.
I20260709 12:11:57.424228 19029 raft_consensus.cc:2749] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:11:57.423609 19194 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:57.426066 19100 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:57.444404 19100 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:57.444043 19191 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:57.444892 19201 log.cc:927] Time spent T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:11:57.428821 19208 raft_consensus.cc:2749] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:57.445802 19194 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:57.426061 18529 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:57.447616 19199 raft_consensus.cc:2804] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:57.424068 19205 raft_consensus.cc:2749] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:11:57.458041 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:57.424580 19176 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.436003 19198 raft_consensus.cc:2749] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:57.466711 13800 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:57.472851 13652 leader_election.cc:400] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 11. Current term is 12.
I20260709 12:11:57.473354 13652 leader_election.cc:403] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:57.476090 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:57.476747 13683 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:57.476502 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:57.484233 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:57.485083 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:57.485173 13684 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 12.
I20260709 12:11:57.484746 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:57.488461 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:57.489234 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:57.491135 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:57.493732 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:57.494447 13686 raft_consensus.cc:2468] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 14.
I20260709 12:11:57.494716 13684 raft_consensus.cc:2393] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 18: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:57.499549 19035 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:57.501560 18913 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:57.497262 19199 raft_consensus.cc:697] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 15 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:57.503360 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:57.462925 19176 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:57.504520 19199 consensus_queue.cc:237] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:57.503381 13683 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 14.
I20260709 12:11:57.508008 18873 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.508554 18873 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:57.461431 19206 consensus_queue.cc:1048] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 12:11:57.510890 19191 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:57.513912 13800 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:57.457832 19100 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:57.487457 19205 raft_consensus.cc:2749] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:57.534201 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:57.531647 13800 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:57.534956 13837 raft_consensus.cc:2468] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 14.
I20260709 12:11:57.535925 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:11:57.537663 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 65027.1us
W20260709 12:11:57.538537 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 116412us
I20260709 12:11:57.511844 19198 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.539189 14380 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:57.542092 13652 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:57.543087 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:57.532020 19056 raft_consensus.cc:2749] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 11. Current term is 12.
I20260709 12:11:57.547642 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:57.538164 18913 raft_consensus.cc:2749] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:57.542207 19029 raft_consensus.cc:2804] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:57.552832 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:57.553093 13652 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:57.553503 14410 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 14.
I20260709 12:11:57.556015 13652 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:57.557026 13652 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:11:57.559986 19211 log.cc:927] Time spent T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:11:57.544170 19189 consensus_queue.cc:1048] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:11:57.553298 19029 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:57.563333 19029 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:57.543697 19191 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:11:57.561769 19143 log.cc:927] Time spent T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 1.660s	user 0.004s	sys 0.001s
I20260709 12:11:57.549695 19043 raft_consensus.cc:2804] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:57.545388 19132 raft_consensus.cc:2749] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:57.566911 13828 raft_consensus.cc:1240] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 17. Current term is 18. Ops: []
I20260709 12:11:57.564165 19177 raft_consensus.cc:2749] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:57.554193 19144 raft_consensus.cc:2749] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:57.545918 19198 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:57.549508 18529 raft_consensus.cc:2749] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:57.574306 19056 raft_consensus.cc:2804] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:57.572896 19043 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:57.575975 19176 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:57.575232 19191 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:57.591336 19122 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:57.595906 19043 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:57.594563 19056 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:57.580720 19193 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:57.602872 13837 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 10.
I20260709 12:11:57.603794 19191 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:57.604983 19131 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:57.586633 19210 consensus_queue.cc:1059] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 12:11:57.610704 19198 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:57.611459 19100 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:57.611878 19056 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:57.616233 19122 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:57.622817 19176 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.642758 19176 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:57.624089 19193 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:57.629058 19228 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.629653 19195 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:57.634152 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
W20260709 12:11:57.635957 19168 log.cc:927] Time spent T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 1.141s	user 0.002s	sys 0.002s
I20260709 12:11:57.636953 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:57.662228 13836 raft_consensus.cc:1240] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:57.663235 19195 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:57.658946 19228 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:57.664723 18970 consensus_queue.cc:1059] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 12:11:57.665616 19228 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:57.671808 19027 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.672621 19027 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:57.674945 19029 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:57.682452 19228 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:57.683275 19228 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:57.689196 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:57.690052 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:57.686301 13688 raft_consensus.cc:1275] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:11:57.686667 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:57.691394 13800 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:57.692200 13684 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 17.
I20260709 12:11:57.693467 13800 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:11:57.704171 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 71674.7us
I20260709 12:11:57.704082 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:57.706794 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:57.707019 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:57.707544 13680 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 10.
I20260709 12:11:57.707675 13684 raft_consensus.cc:3060] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:57.703342 13800 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:57.711701 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:57.677582 19029 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:57.619235 19190 consensus_queue.cc:1059] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.084s
I20260709 12:11:57.685730 19228 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:57.721495 13800 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:57.706074 19195 raft_consensus.cc:2749] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:57.727053 13756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2814) took 1671 ms. Trace:
I20260709 12:11:57.724618 13800 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:57.710029 19191 raft_consensus.cc:2804] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:57.706048 19176 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:57.730690 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:57.731491 18913 raft_consensus.cc:2804] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:11:57.733688 18970 raft_consensus.cc:3055] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:57.736963 13680 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 14.
I20260709 12:11:57.739470 13727 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:57.727465 13756 rpcz_store.cc:276] 0709 12:11:56.049221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:56.050087 (+   866us) service_pool.cc:224] Handling call
0709 12:11:56.050483 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:56.050750 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:11:56.163920 (+113170us) log.cc:844] Serialized 14 byte log entry
0709 12:11:56.591366 (+427446us) log.cc:844] Serialized 14 byte log entry
0709 12:11:57.079070 (+487704us) spinlock_profiling.cc:243] Waited 4.44 ms on lock 0x7b180029e240. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924ea0522 00007fa924ea27c1 00007fa924ea2779 00007fa924ea2709 00007fa924ea26d1 00007fa924ea19cd 0000000000388634 0000000000388479 00007fa924e8383a
0709 12:11:57.650868 (+571798us) spinlock_profiling.cc:243] Waited 3.22 ms on lock 0x7b180029e240. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e1ac0a 00007fa92e55a219 00007fa924ea2a40 00007fa924e9d4e4 00007fa924e9d455 00007fa927f85060 00007fa927f97716 00007fa927fa8287 00007fa927fa8208
0709 12:11:57.719693 (+ 68825us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:57.719771 (+    78us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:11:57.719844 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:57.719942 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:57.720092 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":641201,"prepare.queue_time_us":209710,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":2694,"raft.queue_time_us":1091062,"raft.run_cpu_time_us":332,"raft.run_wall_time_us":5282,"spinlock_wait_cycles":25047936,"thread_start_us":580044,"threads_started":3,"wal-append.queue_time_us":602445}
I20260709 12:11:57.745707 14379 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:57.748409 14379 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:57.749532 13684 raft_consensus.cc:2468] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 11.
I20260709 12:11:57.716151 18718 consensus_queue.cc:1048] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 12:11:57.729074 19193 raft_consensus.cc:2804] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:57.741499 18970 raft_consensus.cc:740] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:57.753126 19212 raft_consensus.cc:2749] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:57.754067 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:57.778254 13680 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:57.735073 19191 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:57.756443 14379 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:57.799285 14379 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:57.737881 18913 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:57.750631 19210 raft_consensus.cc:2749] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:57.760684 18872 consensus_queue.cc:1059] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:11:57.762090 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:57.762836 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:57.765139 19019 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.765843 19026 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
W20260709 12:11:57.766887 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:57.767194 19182 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:57.767370 19150 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.738420 19029 raft_consensus.cc:2804] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:57.755280 13800 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:57.810983 19027 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:57.810806 19026 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:57.811231 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 56070us
I20260709 12:11:57.809983 19019 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:57.812204 13800 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:57.779889 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:57.780756 18825 raft_consensus.cc:2804] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:57.782475 18970 consensus_queue.cc:260] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:57.793992 19193 raft_consensus.cc:697] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 14 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:57.823118 19140 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:57.795531 18868 consensus_queue.cc:1059] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:57.823721 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:57.824010 18970 raft_consensus.cc:3060] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:57.824368 18868 raft_consensus.cc:3055] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:57.824786 18868 raft_consensus.cc:740] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:57.816651 18825 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:57.794991 19016 consensus_queue.cc:1059] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:57.814740 19195 raft_consensus.cc:2804] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:57.825596 18868 consensus_queue.cc:260] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:57.826445 19195 raft_consensus.cc:697] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 11 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:57.759809 13829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 2966) took 1057 ms. Trace:
I20260709 12:11:57.826032 19150 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:57.750190 19152 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:11:57.830768 19195 consensus_queue.cc:237] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:57.807821 18940 raft_consensus.cc:2804] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:57.831087 19152 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:57.805157 13680 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 13.
I20260709 12:11:57.831979 18940 raft_consensus.cc:697] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 12 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:57.830327 13829 rpcz_store.cc:276] 0709 12:11:56.702121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:56.851218 (+149097us) service_pool.cc:224] Handling call
0709 12:11:56.851798 (+   580us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:56.955336 (+103538us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:57.759435 (+804099us) spinlock_profiling.cc:243] Waited 92.1 ms on lock 0x7b540020e254. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:57.759717 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":211748224}
I20260709 12:11:57.823738 19140 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:57.834944 18940 consensus_queue.cc:237] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:57.835494 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:57.836541 13829 raft_consensus.cc:2410] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:11:57.834082 19035 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.838126 19223 consensus_queue.cc:1048] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 12:11:57.838840 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:57.801342 19191 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:57.814146 13684 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:57.812534 19097 raft_consensus.cc:2804] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:57.806243 19206 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.801966 19033 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:57.805168 18913 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:57.817663 13760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 2045) took 1132 ms. Trace:
I20260709 12:11:57.827315 19182 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.818506 18872 raft_consensus.cc:3055] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:57.873371 18872 raft_consensus.cc:740] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:57.874462 18872 consensus_queue.cc:260] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:57.875725 18872 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:57.820343 19019 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:57.821060 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:57.822721 19193 consensus_queue.cc:237] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:57.801019 14379 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:11:57.877710 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 76779.5us
I20260709 12:11:57.877914 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:57.879293 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:57.796507 13727 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:11:57.880654 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 84244.8us
I20260709 12:11:57.828265 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:57.828508 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:57.826577 19016 raft_consensus.cc:3055] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:57.835646 19152 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:57.838587 19035 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:57.837697 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:57.813680 13652 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:57.891898 13681 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:57.892218 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 78618.3us
I20260709 12:11:57.825544 18825 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:57.893210 19026 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:57.895118 19035 leader_election.cc:290] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:57.855858 19097 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:57.840613 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:57.898047 19097 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:57.899303 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:57.899811 14412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41692 (request call id 866) took 1902 ms. Trace:
I20260709 12:11:57.900290 14412 rpcz_store.cc:276] 0709 12:11:55.997370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:56.001862 (+  4492us) service_pool.cc:224] Handling call
0709 12:11:56.905854 (+903992us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:56.906052 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:56.906074 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:56.906123 (+    49us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:56.906161 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:56.906226 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:57.899564 (+993338us) spinlock_profiling.cc:243] Waited 904 ms on lock 0x7b540068ced0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:57.899709 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2078096256}
I20260709 12:11:57.901336 13829 raft_consensus.cc:1275] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 12:11:57.805866 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 108936us
I20260709 12:11:57.890075 19033 raft_consensus.cc:2749] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:11:57.902278 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:57.902810 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:57.905280 13726 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:57.841904 13800 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:11:57.906656 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 64881.4us
I20260709 12:11:57.808120 19122 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:57.844173 19043 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:57.934517 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:57.844913 19056 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:57.846436 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:57.935288 13726 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:57.847675 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:57.837560 19183 raft_consensus.cc:3055] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:57.615029 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:57.810830 19029 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:57.867120 13828 raft_consensus.cc:1275] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:11:57.870150 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:57.878085 13758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 790) took 1122 ms. Trace:
I20260709 12:11:57.949244 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:57.882776 13684 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 13.
I20260709 12:11:57.950698 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:57.953198 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:57.952664 13755 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:57.888550 13727 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:57.890838 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:57.836563 19140 leader_election.cc:290] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:57.959594 13679 raft_consensus.cc:2393] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 16: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:57.886984 19016 raft_consensus.cc:740] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:57.963258 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:57.827320 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:57.892019 19019 raft_consensus.cc:2749] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:57.898034 19176 raft_consensus.cc:2804] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:57.966545 14416 raft_consensus.cc:2393] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 15: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:11:57.935891 13763 raft_consensus.cc:2393] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 18: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:57.950664 13758 rpcz_store.cc:276] 0709 12:11:56.756198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:56.756398 (+   200us) service_pool.cc:224] Handling call
0709 12:11:56.756879 (+   481us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:57.686359 (+929480us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:57.686393 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:57.686979 (+   586us) log.cc:844] Serialized 52 byte log entry
0709 12:11:57.802497 (+115518us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:57.802555 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:57.802650 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:57.877843 (+ 75193us) raft_consensus.cc:1685] finished
0709 12:11:57.877864 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:57.878018 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":928974,"raft.queue_time_us":929255,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":93,"thread_start_us":115075,"threads_started":1,"wal-append.queue_time_us":186270}
I20260709 12:11:57.941731 19152 raft_consensus.cc:2804] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:57.968209 13758 raft_consensus.cc:1240] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:57.936614 19195 raft_consensus.cc:2804] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:57.969373 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:57.957940 19029 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:57.941708 19183 raft_consensus.cc:740] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:57.886268 19182 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:58.146028 18846 consensus_queue.cc:1048] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:58.146994 19182 leader_election.cc:290] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:57.868709 19206 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:58.147612 19190 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:57.966395 19176 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:58.148178 19190 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:58.150054 19195 raft_consensus.cc:697] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 13 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:11:58.153302 19176 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:58.034466 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:11:58.137004 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 248587us
W20260709 12:11:58.137159 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 141877us
I20260709 12:11:57.935539 18970 consensus_queue.cc:1059] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 12:11:58.142323 13762 raft_consensus.cc:1240] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:58.238021 13680 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 14.
W20260709 12:11:58.142642 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 181146us
I20260709 12:11:58.143882 13828 raft_consensus.cc:1240] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:58.149058 13684 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 17.
I20260709 12:11:58.150653 13681 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 14.
I20260709 12:11:58.151300 13755 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 11.
W20260709 12:11:58.198678 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:58.154121 19203 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:58.232652 13727 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:58.247797 13726 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:58.141760 19026 raft_consensus.cc:2804] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:11:58.163825 19131 consensus_meta.cc:287] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.504s	user 0.013s	sys 0.002s
I20260709 12:11:58.143610 19152 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:58.141350 19140 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:58.288733 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:58.286471 19150 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:58.292220 13680 raft_consensus.cc:1240] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 10. Current term is 11. Ops: [10.10-10.10]
W20260709 12:11:58.292748 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 60218.4us
I20260709 12:11:58.293619 13727 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:58.294247 19031 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:58.293985 19016 consensus_queue.cc:260] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:58.295552 19016 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:58.294898 19031 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:58.297565 13680 raft_consensus.cc:1275] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:58.281908 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:58.231196 19104 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:11:58.330545 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 82848.3us
I20260709 12:11:58.322526 19206 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:58.375128 13754 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 12.
W20260709 12:11:58.323001 18816 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.629s	user 0.021s	sys 0.032s
W20260709 12:11:58.377161 18816 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.689s	user 0.024s	sys 0.054s
I20260709 12:11:58.378620 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:58.378997 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:58.379904 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:58.380048 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:58.380548 13755 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 13.
I20260709 12:11:58.381526 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:58.382195 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:58.383277 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:58.383494 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:58.384507 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:58.371585 18825 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:58.386165 13680 raft_consensus.cc:1240] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:58.386195 13755 raft_consensus.cc:1275] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:58.387682 13680 raft_consensus.cc:1240] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:58.387880 13757 raft_consensus.cc:1240] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:58.387714 18825 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:11:58.390645 19238 log.cc:927] Time spent T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
I20260709 12:11:58.390409 13758 raft_consensus.cc:2468] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 12.
I20260709 12:11:58.324244 19104 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:58.296339 19152 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:58.323201 18718 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:58.399629 18718 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:58.401865 19139 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:58.403895 19139 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:58.406635 19104 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:58.407531 18718 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:58.393409 19031 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:58.413894 19152 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:58.417043 19152 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:58.315258 19122 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:58.419147 19122 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:58.341042 19233 consensus_queue.cc:1048] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.081s
I20260709 12:11:58.422415 19195 consensus_queue.cc:237] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:58.424482 19122 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:58.425814 19056 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:58.426900 19131 raft_consensus.cc:2804] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:58.427552 19131 raft_consensus.cc:697] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:58.428581 19131 consensus_queue.cc:237] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:58.432214 19043 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:58.432555 19026 raft_consensus.cc:697] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:58.434172 19026 consensus_queue.cc:237] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:58.435652 19183 consensus_queue.cc:260] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:58.437193 19183 raft_consensus.cc:3060] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:58.382236 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:58.450348 13685 raft_consensus.cc:1240] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:58.315595 18936 raft_consensus.cc:2764] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:11:58.307276 19027 raft_consensus.cc:2749] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:58.454506 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:58.280826 19203 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:58.372778 19191 consensus_meta.cc:287] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.504s	user 0.005s	sys 0.012s
I20260709 12:11:58.467298 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:58.420465 19176 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:58.495296 13759 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48120 (request call id 2046) took 1749 ms (client timeout 1971 ms). Trace:
W20260709 12:11:58.495914 13759 rpcz_store.cc:269] 0709 12:11:56.746191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:56.746370 (+   179us) service_pool.cc:224] Handling call
0709 12:11:58.491839 (+1745469us) spinlock_profiling.cc:243] Waited 454 ms on lock 0x7b5400088ed4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:58.495201 (+  3362us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1044106624}
I20260709 12:11:58.565909 13680 raft_consensus.cc:1275] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:11:58.572005 13763 raft_consensus.cc:1240] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:11:58.578743 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:58.580088 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:58.581254 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:58.582021 13758 raft_consensus.cc:2393] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 12: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:58.582572 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:58.582801 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:58.583256 13755 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 16.
I20260709 12:11:58.583864 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:58.584039 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:58.584559 13755 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 21.
I20260709 12:11:58.584707 13758 raft_consensus.cc:2410] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for term 16 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 12:11:58.585107 18873 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:58.585799 13758 raft_consensus.cc:1275] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:11:58.596829 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:11:58.600562 18913 consensus_meta.cc:287] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.714s	user 0.009s	sys 0.002s
I20260709 12:11:58.601173 18913 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:58.611292 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:58.612432 18913 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:58.621650 19203 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:58.627288 13679 raft_consensus.cc:1275] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:58.612291 13830 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:58.569756 19100 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:58.493105 19191 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:58.565708 19029 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:58.649046 19190 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:58.643612 19097 consensus_meta.cc:287] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.745s	user 0.011s	sys 0.005s
I20260709 12:11:58.656991 13829 raft_consensus.cc:1240] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:58.642617 19100 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:11:58.707876 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:58.712706 13834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 951) took 1433 ms. Trace:
I20260709 12:11:58.713397 13834 rpcz_store.cc:276] 0709 12:11:57.279773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:57.279925 (+   152us) service_pool.cc:224] Handling call
0709 12:11:57.294299 (+ 14374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:57.309626 (+ 15327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:57.309664 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:57.309714 (+    50us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:57.309754 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:58.712329 (+1402575us) spinlock_profiling.cc:243] Waited 15.1 ms on lock 0x7b54002a6554. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:58.712409 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:58.712609 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34718592}
I20260709 12:11:58.724653 13830 raft_consensus.cc:2410] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 18 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
W20260709 12:11:58.728554 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 493930us
I20260709 12:11:58.729724 13726 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:58.720834 19190 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:58.762215 19190 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:58.756937 19249 log.cc:927] Time spent T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 12:11:58.766008 19007 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:58.766721 19232 raft_consensus.cc:2804] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:58.767552 19232 raft_consensus.cc:697] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:58.770666 13832 raft_consensus.cc:1240] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:58.755754 19248 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:58.773540 19248 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:58.781522 19248 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:58.768858 19232 consensus_queue.cc:237] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:58.656744 19097 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:58.755738 18934 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:11:58.783082 18934 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:58.783774 19100 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:58.784904 19097 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:58.784973 19191 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:58.782152 19029 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:58.786062 13681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 935) took 1155 ms. Trace:
I20260709 12:11:58.792073 13681 rpcz_store.cc:276] 0709 12:11:57.631038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:58.273668 (+642630us) service_pool.cc:224] Handling call
0709 12:11:58.274166 (+   498us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:58.281845 (+  7679us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:58.281897 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:58.294990 (+ 13093us) log.cc:844] Serialized 26 byte log entry
0709 12:11:58.492359 (+197369us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:58.492427 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:58.492535 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:58.785722 (+293187us) raft_consensus.cc:1685] finished
0709 12:11:58.785755 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:58.785969 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":471,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":22492,"thread_start_us":196805,"threads_started":1,"wal-append.queue_time_us":460557}
I20260709 12:11:58.749327 13651 leader_election.cc:304] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:11:58.789867 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 493820us
W20260709 12:11:58.807632 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 58438.4us
I20260709 12:11:58.808543 13651 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:58.750978 18936 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:58.811928 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:58.812621 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:58.834162 14408 raft_consensus.cc:2410] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 12:11:58.813460 13651 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:11:58.835758 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:58.836481 13727 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:58.836885 13651 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:58.837170 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:58.837425 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:58.785355 18934 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:58.847678 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:58.849169 14412 raft_consensus.cc:2393] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 16: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:11:58.850335 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:58.751909 18873 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:58.839347 13830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54820 (request call id 2964) took 2126 ms. Trace:
I20260709 12:11:58.840801 13833 raft_consensus.cc:1240] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 17. Current term is 18. Ops: []
I20260709 12:11:58.840907 13727 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:58.853832 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:58.765615 18529 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:58.842052 13651 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:11:58.820214 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:58.861296 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:58.869854 13832 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 21.
I20260709 12:11:58.858378 14410 raft_consensus.cc:1240] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:58.870671 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:58.871039 14407 raft_consensus.cc:1240] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 12:11:58.790198 19007 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:58.765564 19190 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:58.861974 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:58.885385 13758 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 15.
I20260709 12:11:58.839986 19203 raft_consensus.cc:2749] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:58.852948 13830 rpcz_store.cc:276] 0709 12:11:56.701472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:56.852294 (+150822us) service_pool.cc:224] Handling call
0709 12:11:58.611061 (+1758767us) spinlock_profiling.cc:243] Waited 3.77 ms on lock 0x7b5800034898. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924e68b71 00007fa924e68a22 00007fa92dd818d9 00007fa92cedbee0 00007fa92cfa50ab 00007fa92cfa5131 00007fa92cf530a0 00007fa92cf52984 00007fa9264cd6d4 00007fa9264cd662
0709 12:11:58.826286 (+215225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8669952}
I20260709 12:11:58.854653 14379 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:58.834612 19189 raft_consensus.cc:2749] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:11:58.892014 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:58.865477 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:58.892638 14409 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:58.893646 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:58.893896 14379 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:58.866267 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:58.766031 19176 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:58.871248 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:58.756575 19140 raft_consensus.cc:697] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:58.851946 18789 raft_consensus.cc:2749] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:58.876883 18873 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:58.877501 13828 raft_consensus.cc:1275] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:11:58.839841 18626 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:58.877887 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:58.853344 18936 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:58.878762 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:58.880362 19029 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:58.880498 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:58.915741 13727 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:58.839674 18970 consensus_queue.cc:1048] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 12:11:58.863065 19148 consensus_queue.cc:1048] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:11:58.839560 19234 consensus_queue.cc:1048] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 12:11:58.887090 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:58.885515 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
W20260709 12:11:58.888669 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 49947.5us
I20260709 12:11:58.891543 19097 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:58.864312 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:58.890395 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:58.898142 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:58.898408 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:58.883456 19152 consensus_queue.cc:1048] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 12:11:58.952494 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:58.901938 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:58.901867 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:58.954584 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:58.955783 13755 raft_consensus.cc:2410] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:11:58.810400 18940 consensus_queue.cc:1059] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.088s
I20260709 12:11:58.903309 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:58.902977 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:58.904275 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:58.863675 19165 raft_consensus.cc:2749] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:58.912015 13837 raft_consensus.cc:2393] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 15: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:58.910367 13834 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 15.
I20260709 12:11:58.856141 19122 raft_consensus.cc:2804] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:58.851691 19228 consensus_queue.cc:1048] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 12:11:58.852066 19043 consensus_queue.cc:1059] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 12:11:58.922549 18789 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:58.886550 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:58.887650 19198 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:58.898557 19190 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:58.912883 19029 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:58.939813 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:58.900379 19212 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:11:58.833983 19183 raft_consensus.cc:2804] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:58.943411 13651 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:58.898600 18913 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:58.950893 13830 raft_consensus.cc:2410] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:11:58.898849 13831 raft_consensus.cc:2393] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 15: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:58.885269 18529 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:58.957507 13800 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:11:58.959882 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:59.002458 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 45065.7us
I20260709 12:11:58.957564 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:58.941299 19248 raft_consensus.cc:2749] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:58.968106 13755 raft_consensus.cc:1275] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:11:58.962435 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:58.895051 19007 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:58.975016 13762 raft_consensus.cc:1240] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:58.953053 19097 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:58.926748 19031 consensus_queue.cc:1059] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 12:11:58.981693 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:58.988180 14409 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 15.
I20260709 12:11:58.989290 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:59.031193 13755 raft_consensus.cc:1275] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:59.031919 13834 raft_consensus.cc:2410] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 18 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:11:58.990012 14416 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:58.927651 18626 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:58.995636 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 52315.7us
I20260709 12:11:59.032816 13759 raft_consensus.cc:1240] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:59.003957 13800 leader_election.cc:304] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:11:58.978268 19026 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.007s	sys 0.011s
I20260709 12:11:59.018020 13828 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 13.
I20260709 12:11:59.057157 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:59.057395 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:59.022639 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:59.057883 13830 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 13.
I20260709 12:11:58.951576 19206 consensus_queue.cc:1048] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 12:11:59.030257 14407 raft_consensus.cc:2393] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 15: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:11:59.035763 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:59.038981 19007 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:59.042007 18868 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:59.042685 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:59.022776 19191 raft_consensus.cc:2804] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:58.995034 19212 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:59.065178 13834 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 13.
I20260709 12:11:59.047884 19097 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:59.048411 13833 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 15.
I20260709 12:11:59.068017 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:59.016535 19189 raft_consensus.cc:2804] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:59.016502 19195 consensus_queue.cc:1059] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:11:59.019755 18913 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:59.050537 13687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2894) took 1642 ms. Trace:
I20260709 12:11:59.051321 18529 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:58.994781 19198 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:58.978309 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:59.058476 13831 raft_consensus.cc:2393] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 16: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:58.995217 19122 raft_consensus.cc:697] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 12 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:58.994151 19183 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:59.083165 13834 raft_consensus.cc:1240] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:11:57.864270 13760 rpcz_store.cc:276] 0709 12:11:56.685177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:56.685350 (+   173us) service_pool.cc:224] Handling call
0709 12:11:56.704711 (+ 19361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:56.744683 (+ 39972us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:11:57.035206 (+290523us) log.cc:844] Serialized 14 byte log entry
0709 12:11:57.805803 (+770597us) log.cc:844] Serialized 14 byte log entry
0709 12:11:57.817280 (+ 11477us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:57.817336 (+    56us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:11:57.817379 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:57.817445 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:57.817587 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":555554,"prepare.queue_time_us":565760,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":507993,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":8555,"thread_start_us":538194,"threads_started":3,"wal-append.queue_time_us":271630}
I20260709 12:11:59.047077 14416 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 15.
W20260709 12:11:59.060699 19250 log.cc:927] Time spent T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 12:11:59.088378 13832 raft_consensus.cc:1275] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:11:59.055387 18718 consensus_queue.cc:1059] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 12:11:58.998759 19093 consensus_queue.cc:1059] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.066s
I20260709 12:11:59.077823 13687 rpcz_store.cc:276] 0709 12:11:57.407920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:57.408075 (+   155us) service_pool.cc:224] Handling call
0709 12:11:57.408411 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:57.413385 (+  4974us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:57.413419 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:57.413913 (+   494us) log.cc:844] Serialized 26 byte log entry
0709 12:11:57.460386 (+ 46473us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:11:57.460428 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:59.050159 (+1589731us) spinlock_profiling.cc:243] Waited 4.54 ms on lock 0x7b5400246dd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:59.050209 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:59.050256 (+    47us) raft_consensus.cc:1685] finished
0709 12:11:59.050268 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:59.050473 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":146,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":94,"spinlock_wait_cycles":10433280,"thread_start_us":45981,"threads_started":1,"wal-append.queue_time_us":101735,"wal-append.run_cpu_time_us":2279,"wal-append.run_wall_time_us":1073556}
I20260709 12:11:59.085202 13727 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:11:59.128407 13688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1894) took 1645 ms. Trace:
W20260709 12:11:59.058861 19026 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.008s	sys 0.011s
I20260709 12:11:59.068297 19191 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:59.059854 19176 consensus_queue.cc:1048] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:11:59.068167 19212 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:11:59.066443 19254 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.068394 19203 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.115654 13828 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 14.
I20260709 12:11:59.068130 19007 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.070990 19189 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:59.117296 13831 raft_consensus.cc:1275] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:58.980779 19140 consensus_queue.cc:237] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:59.085456 19183 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:59.128989 13688 rpcz_store.cc:276] 0709 12:11:57.483418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:57.483552 (+   134us) service_pool.cc:224] Handling call
0709 12:11:57.483881 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:57.691406 (+207525us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:59.128078 (+1436672us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b5400312ed4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:59.128337 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":464491392}
I20260709 12:11:59.114745 18529 raft_consensus.cc:2804] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:11:59.134176 19165 raft_consensus.cc:2804] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:59.137593 19191 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:59.163707 18529 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:59.157970 19189 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:59.169714 19165 raft_consensus.cc:697] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:59.157972 19203 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:59.183833 19029 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:59.186694 19203 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:11:59.188238 19262 log.cc:927] Time spent T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:11:59.172297 18873 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:59.199472 18913 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:59.201345 19198 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:59.172679 18529 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:11:59.203070 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 291794us
I20260709 12:11:59.168377 18936 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:59.144711 19254 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:59.161514 19007 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:59.215464 14379 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:11:59.258363 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 226258us
I20260709 12:11:59.168964 19122 consensus_queue.cc:237] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:59.254601 19210 raft_consensus.cc:2804] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:59.252205 18626 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:59.251159 18873 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:59.265620 13800 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:59.270838 13685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 940) took 1388 ms. Trace:
W20260709 12:11:59.273418 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 213899us
I20260709 12:11:59.282697 13679 raft_consensus.cc:1240] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:59.276530 13685 rpcz_store.cc:276] 0709 12:11:57.882525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:58.473991 (+591466us) service_pool.cc:224] Handling call
0709 12:11:58.474400 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:58.474674 (+   274us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:11:58.899065 (+424391us) log.cc:844] Serialized 14 byte log entry
0709 12:11:59.269621 (+370556us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:59.269679 (+    58us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:59.270505 (+   826us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:59.270594 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:59.270753 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9889,"prepare.queue_time_us":500004,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":59,"raft.queue_time_us":127538,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"thread_start_us":769730,"threads_started":3,"wal-append.queue_time_us":305601}
I20260709 12:11:59.285140 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:59.296137 13800 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:11:59.276616 19261 log.cc:927] Time spent T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 12:11:59.303014 13682 raft_consensus.cc:1275] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:11:59.306615 13680 raft_consensus.cc:1275] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:11:59.308267 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:59.309018 13679 raft_consensus.cc:2468] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 15.
I20260709 12:11:59.309654 13800 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:11:59.310426 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 58228.9us
I20260709 12:11:59.311590 13800 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:59.314060 13652 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:59.315250 13800 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:59.268544 19210 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:59.325274 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:59.267977 19198 consensus_queue.cc:1048] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:11:59.327510 13687 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 16.
I20260709 12:11:59.335691 13757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 2061) took 1309 ms. Trace:
I20260709 12:11:59.336198 13757 rpcz_store.cc:276] 0709 12:11:58.026266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:58.137934 (+111668us) service_pool.cc:224] Handling call
0709 12:11:58.138294 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:58.388257 (+249963us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:59.335448 (+947191us) spinlock_profiling.cc:243] Waited 249 ms on lock 0x7b54000a00d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:59.335632 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":573599104}
I20260709 12:11:59.335583 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:59.337642 13800 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:59.343755 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:59.342295 13682 raft_consensus.cc:1240] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:11:59.341861 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:59.278911 18940 consensus_queue.cc:1059] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 12:11:59.269546 19266 consensus_queue.cc:1048] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 12:11:59.325861 19029 raft_consensus.cc:2749] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:59.282732 18873 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:59.326395 19210 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:59.324376 18913 raft_consensus.cc:2749] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:59.306315 19270 raft_consensus.cc:2749] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:59.318091 19195 raft_consensus.cc:2749] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:59.361970 19280 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:59.362350 19269 log.cc:927] Time spent T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:11:59.282497 19165 consensus_queue.cc:237] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:59.362703 19280 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:59.340137 19275 raft_consensus.cc:2749] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:11:59.364547 13684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 942) took 1478 ms. Trace:
I20260709 12:11:59.365031 19280 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:59.362331 19195 raft_consensus.cc:2749] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:59.364930 13684 rpcz_store.cc:276] 0709 12:11:57.886614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:58.602581 (+715967us) service_pool.cc:224] Handling call
0709 12:11:58.603086 (+   505us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:58.603767 (+   681us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:11:58.952230 (+348463us) log.cc:844] Serialized 14 byte log entry
0709 12:11:59.131312 (+179082us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:59.136281 (+  4969us) log.cc:844] Serialized 52 byte log entry
0709 12:11:59.136489 (+   208us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:59.136852 (+   363us) log.cc:844] Serialized 14 byte log entry
0709 12:11:59.137061 (+   209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:59.137163 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:59.364305 (+227142us) raft_consensus.cc:1685] finished
0709 12:11:59.364327 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:59.364464 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":458184,"prepare.run_cpu_time_us":130,"prepare.run_wall_time_us":15125,"raft.queue_time_us":69508,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":176,"thread_start_us":516859,"threads_started":2,"wal-append.queue_time_us":272176}
W20260709 12:11:59.357388 19263 log.cc:927] Time spent T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 12:11:59.327946 19274 raft_consensus.cc:2749] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:59.342867 19254 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:59.384277 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:59.386186 13684 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 13.
I20260709 12:11:59.387831 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:59.388514 13684 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:59.401623 13684 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 15.
I20260709 12:11:59.408223 19139 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:59.409101 13835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 945) took 2983 ms. Trace:
I20260709 12:11:59.374831 19198 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:59.415623 13835 rpcz_store.cc:276] 0709 12:11:56.425506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:56.527912 (+102406us) service_pool.cc:224] Handling call
0709 12:11:56.528191 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:57.278937 (+750746us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:57.278990 (+    53us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:57.279083 (+    93us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:57.279147 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:59.408823 (+2129676us) spinlock_profiling.cc:243] Waited 750 ms on lock 0x7b54000af0d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:59.408876 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:59.409007 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1725839744}
I20260709 12:11:59.421063 18868 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.412582 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:59.408795 19189 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:59.401464 19254 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.365060 19275 consensus_queue.cc:1059] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 12:11:59.437258 13684 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 17.
W20260709 12:11:59.430424 19265 log.cc:927] Time spent T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.172s	user 0.000s	sys 0.001s
I20260709 12:11:59.420339 13688 raft_consensus.cc:1240] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 14. Current term is 15. Ops: []
W20260709 12:11:59.476255 13761 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48120 (request call id 2038) took 2873 ms (client timeout 2086 ms). Trace:
W20260709 12:11:59.476735 13761 rpcz_store.cc:269] 0709 12:11:56.603137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:56.664925 (+ 61788us) service_pool.cc:224] Handling call
0709 12:11:59.476042 (+2811117us) spinlock_profiling.cc:243] Waited 756 ms on lock 0x7b540038bdd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:59.476164 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1739903232}
I20260709 12:11:59.436467 19198 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:59.483218 19191 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:59.484422 19198 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:59.467314 19254 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:59.486310 19273 log.cc:927] Time spent T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 12:11:59.486505 19286 consensus_queue.cc:1048] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:59.488271 19254 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:59.484611 13837 raft_consensus.cc:2393] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 15: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:11:59.491819 13756 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 14.
I20260709 12:11:59.500993 13684 raft_consensus.cc:1240] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:59.485587 19191 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:11:59.514904 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:59.527606 19242 log.cc:927] Time spent T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 1.571s	user 0.000s	sys 0.017s
I20260709 12:11:59.446316 18868 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:59.530026 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:59.535920 13683 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 13.
I20260709 12:11:59.537026 13684 raft_consensus.cc:1275] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:59.537230 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:59.532936 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:59.538517 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:11:59.541821 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:59.542266 19183 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:59.544166 19189 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:59.581313 13685 raft_consensus.cc:2393] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 14: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:59.584359 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:59.586890 13685 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:59.555506 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:59.587553 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:59.588045 13755 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 16.
W20260709 12:11:59.588610 13754 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48120 (request call id 2036) took 3053 ms (client timeout 1872 ms). Trace:
I20260709 12:11:59.566486 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:11:59.589040 13754 rpcz_store.cc:269] 0709 12:11:56.535203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:56.535383 (+   180us) service_pool.cc:224] Handling call
0709 12:11:59.588409 (+3053026us) spinlock_profiling.cc:243] Waited 1.73 s on lock 0x7b54000889d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:11:59.588533 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3970798336}
I20260709 12:11:59.546453 18873 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:59.591884 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:59.592509 13687 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 16.
I20260709 12:11:59.549726 19212 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:59.593463 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:59.594038 14415 raft_consensus.cc:2393] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 22: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:11:59.594645 13687 raft_consensus.cc:2393] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 11: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:59.596839 13763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2826) took 1119 ms. Trace:
I20260709 12:11:59.597265 13763 rpcz_store.cc:276] 0709 12:11:58.477539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:58.477767 (+   228us) service_pool.cc:224] Handling call
0709 12:11:58.478273 (+   506us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:58.572736 (+ 94463us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:59.596571 (+1023835us) spinlock_profiling.cc:243] Waited 93.4 ms on lock 0x7b54003935d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:59.596777 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":214758656}
I20260709 12:11:59.599125 19212 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:59.602264 19019 raft_consensus.cc:3055] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:59.585431 19210 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:59.602694 19019 raft_consensus.cc:740] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:59.603551 19019 consensus_queue.cc:260] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:59.604555 19019 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:59.604647 19210 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:59.609910 19270 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.610407 19270 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:59.611215 19198 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:59.611811 19198 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:59.612506 19270 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:59.613070 19270 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.551388 18529 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:59.562727 19191 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.556187 18868 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:59.609660 19195 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:59.554615 19190 consensus_meta.cc:287] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.559s	user 0.008s	sys 0.004s
I20260709 12:11:59.585297 13679 raft_consensus.cc:1240] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:59.613588 19270 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:59.569016 13684 raft_consensus.cc:1240] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:59.571686 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:59.612092 13836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 955) took 2214 ms. Trace:
I20260709 12:11:59.558055 13757 raft_consensus.cc:2393] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 15: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:59.590268 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:11:59.619776 13832 raft_consensus.cc:1240] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 17. Current term is 18. Ops: []
I20260709 12:11:59.620648 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:59.620954 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:59.621618 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:11:59.640755 13834 raft_consensus.cc:1240] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 17. Current term is 18. Ops: []
I20260709 12:11:59.618786 13829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 2977) took 1787 ms. Trace:
I20260709 12:11:59.618681 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:59.655511 13829 rpcz_store.cc:276] 0709 12:11:57.831514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:57.910749 (+ 79235us) service_pool.cc:224] Handling call
0709 12:11:57.911054 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:58.657521 (+746467us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:59.618546 (+961025us) spinlock_profiling.cc:243] Waited 746 ms on lock 0x7b54000db454. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:59.618729 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1715001600}
I20260709 12:11:59.656900 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:59.656949 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:59.613863 13685 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 15.
I20260709 12:11:59.658129 13651 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:11:59.638302 13683 raft_consensus.cc:2393] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 15: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:11:59.619001 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:59.661592 13830 raft_consensus.cc:2410] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 22 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260709 12:11:59.616504 13836 rpcz_store.cc:276] 0709 12:11:57.398174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:57.414361 (+ 16187us) service_pool.cc:224] Handling call
0709 12:11:57.414706 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:57.662724 (+248018us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:59.611868 (+1949144us) spinlock_profiling.cc:243] Waited 247 ms on lock 0x7b54000b31d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:11:59.612038 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":568772480}
I20260709 12:11:59.621295 13760 raft_consensus.cc:2393] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 14: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:11:59.658552 13835 raft_consensus.cc:1240] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:59.679829 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:11:59.614593 19190 raft_consensus.cc:2749] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:59.613921 19029 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.616289 19270 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:59.615810 19007 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:11:59.625856 19077 raft_consensus.cc:3055] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:11:59.618319 19198 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:59.651804 19225 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.587581 19183 leader_election.cc:290] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:59.689421 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:11:59.699925 13832 raft_consensus.cc:1240] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 13 LEADER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
W20260709 12:11:59.699141 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 220568us
I20260709 12:11:59.676584 19228 raft_consensus.cc:2804] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:59.615335 18529 leader_election.cc:290] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:59.709131 13757 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 16.
I20260709 12:11:59.614164 19191 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:59.614429 19195 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:59.725243 14379 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:59.681378 18873 consensus_queue.cc:1059] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:11:59.730114 19247 raft_consensus.cc:3055] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:59.757917 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:59.733511 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:59.737682 19152 raft_consensus.cc:3055] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:59.719421 19077 raft_consensus.cc:740] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:59.705111 19029 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:11:59.743428 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:59.752854 19228 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:59.751849 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:59.756011 19216 raft_consensus.cc:2804] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:59.756830 14379 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:11:59.759670 13837 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 12.
I20260709 12:11:59.760702 19056 raft_consensus.cc:3055] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:59.762874 19195 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:11:59.763880 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 420698us
I20260709 12:11:59.746291 14411 raft_consensus.cc:1240] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:59.778683 13832 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 15.
I20260709 12:11:59.757966 19247 raft_consensus.cc:740] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:11:59.791599 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:11:59.779452 13727 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:59.786783 13800 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:59.795167 13800 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:59.783852 19228 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:59.793089 13834 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 13.
I20260709 12:11:59.764104 19152 raft_consensus.cc:740] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:59.801344 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:59.754630 19225 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:59.814544 13800 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:11:59.816859 13727 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:59.781278 19056 raft_consensus.cc:740] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:11:59.842329 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:11:59.779527 19216 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:59.809046 19104 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:11:59.802474 19154 raft_consensus.cc:2749] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:59.802940 19195 raft_consensus.cc:2804] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:59.812409 19191 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:59.839964 19271 raft_consensus.cc:2749] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:11:59.907604 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 90862.8us
I20260709 12:11:59.780936 18763 consensus_queue.cc:1059] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 12:11:59.783970 19141 consensus_queue.cc:1059] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 12:11:59.784878 18868 consensus_queue.cc:1059] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 12:11:59.914219 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
W20260709 12:11:59.906453 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 91986.2us
I20260709 12:11:59.801878 18529 consensus_queue.cc:1059] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.108s
I20260709 12:11:59.906278 19216 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:59.924147 18936 raft_consensus.cc:3055] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:59.924505 19141 raft_consensus.cc:3055] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:11:59.809739 18995 consensus_queue.cc:1059] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.102s
I20260709 12:11:59.905705 19198 raft_consensus.cc:2749] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:59.903666 19093 raft_consensus.cc:2749] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:59.819073 19234 consensus_queue.cc:1059] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.099s
I20260709 12:11:59.928287 13688 raft_consensus.cc:1240] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:11:59.840106 19139 consensus_queue.cc:1059] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.080s
I20260709 12:11:59.909209 19104 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:11:59.932431 13652 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:59.934870 13800 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:59.935938 14410 raft_consensus.cc:2393] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 16: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:11:59.939823 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:11:59.913492 18913 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:11:59.925017 19169 consensus_queue.cc:1059] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
W20260709 12:11:59.954313 13680 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.010s	sys 0.017s
I20260709 12:11:59.919941 19195 raft_consensus.cc:697] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 11 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
W20260709 12:11:59.965679 13680 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.011s	sys 0.017s
I20260709 12:11:59.977912 14407 raft_consensus.cc:1275] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:11:59.929080 18936 raft_consensus.cc:740] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:59.986433 19271 consensus_queue.cc:1059] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:59.986800 19232 consensus_queue.cc:1048] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:59.990454 19029 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:59.934427 19056 consensus_queue.cc:260] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:59.992697 19056 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:59.928170 19247 consensus_queue.cc:260] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:59.933063 19141 raft_consensus.cc:740] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:59.950457 19154 consensus_queue.cc:1059] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:11:59.995462 19154 consensus_queue.cc:1243] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer 96701a74fdee481fb5f54aac841e17dd log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:11:59.996008 19154 raft_consensus.cc:3055] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:59.996470 19154 raft_consensus.cc:740] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:11:59.978157 18913 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:59.999037 19247 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:00.000330 18913 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:11:59.954684 19254 raft_consensus.cc:2749] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:59.956912 19104 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:00.006778 18936 consensus_queue.cc:260] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:00.009122 18936 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:59.843271 19077 consensus_queue.cc:260] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:11:59.995558 19141 consensus_queue.cc:260] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:00.034986 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:59.978225 18529 raft_consensus.cc:2749] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:00.038300 13652 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:00.043004 13652 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:00.053761 13652 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:11:59.988894 19225 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:11:59.997269 19154 consensus_queue.cc:260] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:11:59.982139 19198 consensus_queue.cc:1048] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.077s
I20260709 12:12:00.063234 13652 leader_election.cc:304] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:12:00.065255 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:00.065541 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:00.065243 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:11:59.982823 19165 consensus_queue.cc:1059] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.085s
I20260709 12:12:00.057785 19190 raft_consensus.cc:2749] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:00.058230 19007 raft_consensus.cc:2749] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:00.068342 19141 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:00.080178 13652 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
W20260709 12:12:00.090642 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:00.094996 13652 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:00.092056 13831 raft_consensus.cc:1240] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 12:12:00.094939 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:00.111590 13831 raft_consensus.cc:1275] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 12:12:00.116496 13800 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:00.115501 13831 pending_rounds.cc:85] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 9
I20260709 12:12:00.117691 13831 pending_rounds.cc:107] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 12:12:00.118093 13831 raft_consensus.cc:2889] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:00.083011 19189 raft_consensus.cc:2749] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:00.072633 18529 consensus_queue.cc:1059] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 12:12:00.125893 13682 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 13.
I20260709 12:12:00.092922 18873 raft_consensus.cc:2804] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:00.095422 19154 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:00.138134 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:00.150120 13800 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:00.080040 19195 consensus_queue.cc:237] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:00.136034 18873 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:00.128867 19029 consensus_queue.cc:1048] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:12:00.191133 18945 raft_consensus.cc:3055] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:12:00.191658 18945 raft_consensus.cc:740] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:00.192555 18945 consensus_queue.cc:260] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:00.198316 14415 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41700 (request call id 797) took 1333 ms (client timeout 1766 ms). Trace:
W20260709 12:12:00.199043 14415 rpcz_store.cc:269] 0709 12:11:58.864905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:58.865094 (+   189us) service_pool.cc:224] Handling call
0709 12:12:00.197996 (+1332902us) spinlock_profiling.cc:243] Waited 680 ms on lock 0x7b5400530054. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:00.198217 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1564790144}
W20260709 12:12:00.204694 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 54686.2us
I20260709 12:12:00.205473 13727 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:00.205953 13800 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:00.193553 18945 raft_consensus.cc:3060] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:00.177158 19301 raft_consensus.cc:2749] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:00.209376 14380 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:00.212272 14380 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:12:00.213438 13756 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48120 (request call id 2047) took 2394 ms (client timeout 1956 ms). Trace:
W20260709 12:12:00.214116 13756 rpcz_store.cc:269] 0709 12:11:57.819457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:57.823429 (+  3972us) service_pool.cc:224] Handling call
0709 12:12:00.213150 (+2389721us) spinlock_profiling.cc:243] Waited 1.56 s on lock 0x7b5400333bd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:00.213326 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3597053184}
I20260709 12:12:00.187736 18873 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:00.226387 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:00.205363 19100 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:00.206804 18529 raft_consensus.cc:2749] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:12:00.210702 19165 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:00.229897 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:00.226174 19210 raft_consensus.cc:2804] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:00.226505 19234 raft_consensus.cc:2749] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:00.245371 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:00.243981 19210 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:00.255450 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:00.257652 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:00.257326 19210 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:00.257699 19302 log.cc:927] Time spent T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
I20260709 12:12:00.269647 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:00.272135 13685 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:00.237619 19104 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:00.275055 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:00.275974 13834 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 15.
I20260709 12:12:00.236502 19100 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:00.262797 19306 log.cc:927] Time spent T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:12:00.279862 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:00.277354 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:12:00.336227 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:00.337008 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:00.321530 13687 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 16.
I20260709 12:12:00.348210 13834 raft_consensus.cc:2393] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 15: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:00.348528 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:00.353627 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:00.354635 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:00.355302 13834 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 15.
I20260709 12:12:00.356022 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:00.356468 13834 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:12:00.361850 19307 log.cc:927] Time spent T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 12:12:00.364018 19198 raft_consensus.cc:3055] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:00.364705 19198 raft_consensus.cc:740] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:00.368604 19077 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:00.370087 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:00.373580 19206 raft_consensus.cc:3055] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:00.378428 19206 raft_consensus.cc:740] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:00.379462 19206 consensus_queue.cc:260] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:00.399878 14415 raft_consensus.cc:1275] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:12:00.384745 19216 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:00.404373 19100 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:00.405319 19216 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:00.407405 18873 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:00.414861 19301 raft_consensus.cc:2804] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:00.343145 19234 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:00.415699 19301 raft_consensus.cc:697] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 15 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:00.416115 19234 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:00.416777 19301 consensus_queue.cc:237] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:00.418434 19234 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:00.418634 18873 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:00.426573 19310 log.cc:927] Time spent T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
I20260709 12:12:00.370776 13687 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 15.
I20260709 12:12:00.429749 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:00.433328 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:00.441221 13685 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 15.
I20260709 12:12:00.442279 18936 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:00.349066 19304 log.cc:927] Time spent T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.217s	user 0.001s	sys 0.001s
I20260709 12:12:00.446908 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:00.449379 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:00.460438 14416 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 15.
I20260709 12:12:00.453732 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:12:00.456844 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 362132us
I20260709 12:12:00.445793 19104 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:00.462172 13652 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:00.458297 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:00.463366 13685 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:00.465281 13830 raft_consensus.cc:2393] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 17: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:00.466946 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:12:00.485831 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:00.486184 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:00.453881 19270 consensus_queue.cc:1059] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 12:12:00.497502 13687 raft_consensus.cc:1275] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:12:00.500198 13828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54830 (request call id 2730) took 1599 ms. Trace:
I20260709 12:12:00.500672 13828 rpcz_store.cc:276] 0709 12:11:58.900712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:59.057154 (+156442us) service_pool.cc:224] Handling call
0709 12:12:00.500020 (+1442866us) spinlock_profiling.cc:243] Waited 57.7 ms on lock 0x7b54001671d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:00.500139 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":132624768}
I20260709 12:12:00.503933 13685 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 18.
I20260709 12:12:00.453125 19198 consensus_queue.cc:260] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:00.506613 19198 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:00.507862 18639 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:00.508162 19019 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:00.508443 18639 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:00.508728 19019 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:00.504788 13834 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 22.
I20260709 12:12:00.515584 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:00.515856 13685 raft_consensus.cc:1240] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:12:00.517678 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:00.464300 18936 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:00.516242 13828 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 16.
W20260709 12:12:00.514101 19228 consensus_meta.cc:287] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.683s	user 0.014s	sys 0.000s
I20260709 12:12:00.524228 13834 raft_consensus.cc:1240] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:00.526262 13685 raft_consensus.cc:1275] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:12:00.527872 13830 raft_consensus.cc:3055] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:00.528389 13830 raft_consensus.cc:740] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:00.532224 13828 raft_consensus.cc:1275] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 12:12:00.532738 13828 pending_rounds.cc:85] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 7
I20260709 12:12:00.533166 13828 pending_rounds.cc:107] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 12:12:00.533469 13828 raft_consensus.cc:2889] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:12:00.535866 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 329972us
I20260709 12:12:00.536966 13800 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:00.530709 13830 consensus_queue.cc:260] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:00.551007 13830 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:00.552742 13800 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.56.194:39545 timed out after 1.956s (SENT) [suppressed 7 similar messages]
W20260709 12:12:00.559520 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:00.560323 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:00.585767 14414 raft_consensus.cc:1240] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 14. Current term is 15. Ops: []
W20260709 12:12:00.587172 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:00.555168 19029 raft_consensus.cc:2749] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:00.525699 19228 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:00.593195 18936 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:00.593627 19212 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:00.593871 13681 raft_consensus.cc:1240] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 12 LEADER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 11. Current term is 12. Ops: []
W20260709 12:12:00.594698 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:00.593665 13833 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54830 (request call id 2716) took 1697 ms (client timeout 1954 ms). Trace:
W20260709 12:12:00.628520 13833 rpcz_store.cc:269] 0709 12:11:58.895914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:58.897884 (+  1970us) service_pool.cc:224] Handling call
0709 12:12:00.593482 (+1695598us) spinlock_profiling.cc:243] Waited 97.8 ms on lock 0x7b54000daf54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:00.593607 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":224967424}
I20260709 12:12:00.598524 18940 raft_consensus.cc:3055] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:00.629663 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:00.635465 13680 raft_consensus.cc:2368] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 16. Current term is 17.
I20260709 12:12:00.656468 13833 raft_consensus.cc:1275] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:12:00.659026 19019 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:00.660950 18639 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:00.667201 13836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 2993) took 1041 ms. Trace:
I20260709 12:12:00.667766 13836 rpcz_store.cc:276] 0709 12:11:59.625436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:59.664250 (+ 38814us) service_pool.cc:224] Handling call
0709 12:12:00.500135 (+835885us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:00.500325 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:00.500350 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:00.500399 (+    49us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:12:00.500431 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:00.500499 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:00.666922 (+166423us) spinlock_profiling.cc:243] Waited 835 ms on lock 0x7b54001671d0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:00.667103 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1921632128}
I20260709 12:12:00.672047 19206 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:00.632390 19212 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:00.674482 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:00.676137 19212 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199)
W20260709 12:12:00.677258 19154 consensus_meta.cc:287] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.539s	user 0.005s	sys 0.007s
I20260709 12:12:00.676690 19210 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:00.678256 19165 raft_consensus.cc:2749] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:00.678356 14380 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:00.680359 19104 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:00.680861 19104 raft_consensus.cc:697] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 22 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:00.681172 19228 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:00.681430 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:00.681731 19104 consensus_queue.cc:237] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:00.685633 19140 raft_consensus.cc:3055] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:00.686167 19140 raft_consensus.cc:740] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:00.687077 19140 consensus_queue.cc:260] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:00.688416 19140 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:00.690062 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:00.690759 13828 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 15.
I20260709 12:12:00.691725 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:00.695144 19152 consensus_queue.cc:260] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:00.709560 13830 raft_consensus.cc:1275] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 12:12:00.710034 13830 pending_rounds.cc:85] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 8
I20260709 12:12:00.710273 13830 pending_rounds.cc:107] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 13.9
W20260709 12:12:00.710564 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 248473us
I20260709 12:12:00.711795 13652 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:00.710525 13830 raft_consensus.cc:2889] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:00.655167 18940 raft_consensus.cc:740] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:00.657588 19029 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:00.713832 19315 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
W20260709 12:12:00.737185 19097 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
W20260709 12:12:00.755208 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 43533.4us
I20260709 12:12:00.754920 13830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 3005) took 1002 ms. Trace:
I20260709 12:12:00.736579 19152 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:00.756358 13652 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:00.759068 13652 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:00.760010 13830 rpcz_store.cc:276] 0709 12:11:59.752359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:00.523198 (+770839us) service_pool.cc:224] Handling call
0709 12:12:00.527721 (+  4523us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:00.717317 (+189596us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:00.754864 (+ 37547us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:00.757453 13726 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:00.767611 13684 raft_consensus.cc:1275] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:12:00.745575 19317 raft_consensus.cc:2804] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:00.718060 19165 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:00.774623 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:00.771695 19122 raft_consensus.cc:2749] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:12:00.774981 19165 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:00.753270 19315 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:00.753489 19189 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:00.775416 13684 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 12.
I20260709 12:12:00.771893 18639 raft_consensus.cc:2804] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:00.778702 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:00.802474 13726 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:00.774430 19019 consensus_queue.cc:1048] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:12:00.778798 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:00.757011 19190 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:00.770351 19007 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:00.774380 19317 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:00.758978 19228 raft_consensus.cc:2749] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:00.805503 19189 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:00.802772 13682 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 15.
I20260709 12:12:00.769025 19056 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:00.816147 19056 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:00.819382 19056 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:00.807154 13726 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:00.789489 19183 raft_consensus.cc:2749] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:00.752100 19029 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:00.823944 13686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2918) took 1507 ms. Trace:
I20260709 12:12:00.802474 18639 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:00.828986 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:12:00.836719 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 283997us
I20260709 12:12:00.833197 13726 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:00.840155 13800 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:00.810638 19141 raft_consensus.cc:2749] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:00.811393 19122 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:00.808772 19190 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:00.845113 13682 raft_consensus.cc:1275] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:12:00.812855 19317 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:00.832588 13686 rpcz_store.cc:276] 0709 12:11:59.317025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:59.344171 (+ 27146us) service_pool.cc:224] Handling call
0709 12:11:59.362103 (+ 17932us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:59.362328 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:11:59.412874 (+ 50546us) log.cc:844] Serialized 14 byte log entry
0709 12:12:00.339237 (+926363us) spinlock_profiling.cc:243] Waited 15.4 ms on lock 0x7b1800374920. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa927b354bc 00007fa924e8348b 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9fc02 00007fa927b2720b 00007fa927b2cd23 00007fa927b2d23a
0709 12:12:00.692556 (+353319us) log.cc:844] Serialized 14 byte log entry
0709 12:12:00.822858 (+130302us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:00.822931 (+    73us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:12:00.823002 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:00.823464 (+   462us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:00.823856 (+   392us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":378385,"prepare.queue_time_us":90131,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":92,"raft.queue_time_us":354486,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"spinlock_wait_cycles":35362688,"thread_start_us":182353,"threads_started":2,"wal-append.queue_time_us":235171,"wal-append.run_cpu_time_us":1173,"wal-append.run_wall_time_us":1001202}
I20260709 12:12:00.821269 19165 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:00.833992 19254 raft_consensus.cc:2804] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:12:00.858565 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 88590.4us
I20260709 12:12:00.826707 19315 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:00.808233 18940 consensus_queue.cc:260] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:00.840638 18639 raft_consensus.cc:3060] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:00.842617 19198 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:00.872505 13686 raft_consensus.cc:1240] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:00.865593 13800 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:00.844666 18936 raft_consensus.cc:2804] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:00.875020 13726 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:00.866716 13652 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:00.841113 19322 raft_consensus.cc:2749] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:12:00.881275 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:00.874398 13800 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:00.890522 13726 leader_election.cc:304] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:00.863785 19228 consensus_queue.cc:1048] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:12:00.893865 19228 raft_consensus.cc:2749] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:00.907312 19141 consensus_queue.cc:1048] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:12:00.866492 19318 raft_consensus.cc:2749] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:00.883962 13800 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:00.924631 13800 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:00.880551 18940 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:00.926314 13680 raft_consensus.cc:1275] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 12:12:00.931792 13680 pending_rounds.cc:85] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 7
I20260709 12:12:00.932126 13680 pending_rounds.cc:107] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 12:12:00.932390 13680 raft_consensus.cc:2889] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:00.929934 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:00.929826 13726 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:00.931535 13651 leader_election.cc:304] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:00.889729 19315 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:00.890625 19195 raft_consensus.cc:2804] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:12:00.936542 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:00.937949 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:00.850677 19122 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:00.871950 19330 consensus_queue.cc:1048] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.071s
W20260709 12:12:00.935990 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:00.931555 19100 raft_consensus.cc:2804] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:00.926910 19228 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:00.967984 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:00.924333 19335 raft_consensus.cc:2804] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:00.963282 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:00.975761 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:00.976920 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:00.964076 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:00.936941 19322 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:00.964857 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:00.938061 19189 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:00.965541 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:00.983635 13759 raft_consensus.cc:2376] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 14. Re-sending same reply.
W20260709 12:12:00.984520 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 117895us
I20260709 12:12:00.879700 19198 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:00.987771 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 45071.9us
W20260709 12:12:00.988904 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:00.934082 19210 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:00.970448 13763 raft_consensus.cc:1275] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 12:12:00.970631 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:00.989984 13763 pending_rounds.cc:85] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting all ops after (but not including) 7
I20260709 12:12:00.990383 13763 pending_rounds.cc:107] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 12:12:00.990640 13763 raft_consensus.cc:2889] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:00.990891 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:00.991425 13652 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:00.937966 19315 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:00.973940 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:00.943831 19195 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:00.944501 19093 raft_consensus.cc:3055] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:00.938827 19166 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:00.978634 13760 raft_consensus.cc:2376] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 12. Re-sending same reply.
I20260709 12:12:00.945312 19318 consensus_queue.cc:1048] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 12:12:00.980191 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:12:00.999423 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 68011us
I20260709 12:12:00.951946 19141 raft_consensus.cc:2804] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:00.984818 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:00.968264 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:00.973942 18936 raft_consensus.cc:697] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:01.002759 13754 raft_consensus.cc:2368] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 15. Current term is 16.
I20260709 12:12:00.986819 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:00.991984 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:01.023578 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:01.024004 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:01.024231 13754 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 13.
I20260709 12:12:00.992202 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:01.025029 13755 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 14.
I20260709 12:12:01.025162 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:00.994588 13727 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:00.995934 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:00.931198 19271 raft_consensus.cc:2749] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:00.974684 19335 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:00.996774 19315 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:00.981000 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 53180.6us
I20260709 12:12:00.986786 19344 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:01.025946 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:01.066658 14379 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:00.999496 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:12:01.006912 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:01.068077 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:01.068243 13685 raft_consensus.cc:1240] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:01.069590 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:01.070653 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:12:01.071130 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:01.071005 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:01.028812 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:00.997958 19195 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:01.001181 13756 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 15.
I20260709 12:12:01.081640 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:01.081883 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:00.993497 19189 raft_consensus.cc:2749] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:01.062773 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:01.062919 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:12:01.061964 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 60928.3us
I20260709 12:12:01.002269 13759 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 14.
W20260709 12:12:01.074589 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 80102.9us
I20260709 12:12:01.074875 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:01.086055 13756 raft_consensus.cc:1275] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:12:01.086596 13755 raft_consensus.cc:2410] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:12:01.087641 13756 raft_consensus.cc:1240] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 12:12:01.078949 14410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 1023) took 1165 ms. Trace:
I20260709 12:12:01.087740 13727 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:01.088272 13762 raft_consensus.cc:2410] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 12:12:01.088847 13652 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:01.067030 13800 leader_election.cc:304] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:01.080260 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:01.089716 13754 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 16.
I20260709 12:12:01.090020 14379 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:01.090610 13800 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:01.001997 19141 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:00.998229 19093 raft_consensus.cc:740] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:01.073653 13685 raft_consensus.cc:1240] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:00.979058 19228 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:01.004473 13651 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:01.086530 13680 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:01.076820 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:01.085856 13759 raft_consensus.cc:1240] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:12:01.080343 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:01.090939 13652 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:01.088186 14410 rpcz_store.cc:276] 0709 12:11:59.913599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:59.913813 (+   214us) service_pool.cc:224] Handling call
0709 12:12:01.078757 (+1164944us) spinlock_profiling.cc:243] Waited 8 ms on lock 0x7b540059e554. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:01.078887 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18392832}
I20260709 12:12:01.094991 13800 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:01.100210 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:01.063649 19225 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.116684 13760 raft_consensus.cc:2410] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:12:01.115994 13682 raft_consensus.cc:2410] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
W20260709 12:12:01.117965 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 113559us
I20260709 12:12:00.999500 19336 raft_consensus.cc:2749] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:01.078421 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:01.133440 14414 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 15.
I20260709 12:12:01.134215 14411 raft_consensus.cc:2393] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 15: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:01.114531 13757 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 22.
I20260709 12:12:01.065053 19335 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:01.136143 13800 leader_election.cc:400] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 16. Current term is 17.
I20260709 12:12:01.081611 19191 raft_consensus.cc:3055] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:01.082535 19029 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:01.078118 19248 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:01.148561 13800 leader_election.cc:403] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:01.026712 19166 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:01.091464 19216 raft_consensus.cc:2804] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:01.101912 19330 raft_consensus.cc:2804] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:12:01.155001 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 166438us
I20260709 12:12:01.157450 13688 raft_consensus.cc:1240] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 13. Current term is 14. Ops: []
W20260709 12:12:01.181483 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 45539.3us
I20260709 12:12:01.154512 19189 raft_consensus.cc:2804] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:01.102583 19270 raft_consensus.cc:2804] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:01.118909 19339 raft_consensus.cc:2804] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:01.117919 18873 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.116437 19190 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:01.107086 19342 raft_consensus.cc:2804] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:01.113426 19141 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:01.188266 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:01.213850 13760 raft_consensus.cc:2376] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 14. Re-sending same reply.
I20260709 12:12:01.120404 19271 consensus_queue.cc:1048] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
W20260709 12:12:01.159332 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 71652us
I20260709 12:12:01.152851 19191 raft_consensus.cc:740] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:01.160274 19019 raft_consensus.cc:2804] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:01.211225 13800 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:01.208447 13757 raft_consensus.cc:1275] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:12:01.085958 19344 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:01.208662 19043 raft_consensus.cc:2749] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:01.208575 19029 consensus_queue.cc:1048] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:12:01.230022 19301 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:01.210095 19339 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:01.235253 19166 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:01.236460 19191 consensus_queue.cc:260] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:01.232673 19331 log.cc:927] Time spent T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.235s	user 0.000s	sys 0.000s
I20260709 12:12:01.239863 18639 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:01.165421 19216 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:01.192726 19093 consensus_queue.cc:260] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:01.212713 19189 raft_consensus.cc:697] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 16 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:01.248728 19270 raft_consensus.cc:697] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 18 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:01.245988 18873 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:01.133575 19345 consensus_queue.cc:1048] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.090s
I20260709 12:12:01.152896 19225 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:01.201187 19332 log.cc:927] Time spent T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
I20260709 12:12:01.205395 13680 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 18.
W20260709 12:12:01.310988 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 150144us
W20260709 12:12:01.312047 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 222102us
W20260709 12:12:01.312124 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 221252us
I20260709 12:12:01.320720 19271 raft_consensus.cc:2749] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:01.180663 19330 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:12:01.238900 19334 log.cc:927] Time spent T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.211s	user 0.000s	sys 0.000s
W20260709 12:12:01.213886 19206 consensus_meta.cc:287] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.541s	user 0.014s	sys 0.001s
I20260709 12:12:01.318230 19190 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:01.213135 19275 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:01.166661 19248 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:01.247179 19342 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:01.247725 19019 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:01.200695 19343 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Advancing to term 17
W20260709 12:12:01.326027 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 50774.7us
I20260709 12:12:01.316107 19339 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:01.355697 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 183872us
I20260709 12:12:01.169847 18936 consensus_queue.cc:237] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:01.319378 19351 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.340713 19216 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:01.366222 13652 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
W20260709 12:12:01.314999 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 103874us
I20260709 12:12:01.368988 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:12:01.358527 19140 consensus_meta.cc:287] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.670s	user 0.012s	sys 0.005s
I20260709 12:12:01.342144 19191 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:01.354446 18913 raft_consensus.cc:3055] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:01.357448 19122 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:01.381085 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:01.424539 13800 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:12:01.397658 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:01.375214 19361 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:01.320545 19301 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:01.367091 19198 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:01.368760 19330 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:01.392109 19189 consensus_queue.cc:237] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:01.392627 19342 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:01.431522 13800 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:01.419840 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:01.376420 19093 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:01.454210 19270 consensus_queue.cc:237] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:01.459087 19228 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:01.459911 19228 raft_consensus.cc:2804] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:01.460384 19228 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:01.460830 19228 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:01.445012 19007 consensus_meta.cc:287] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.622s	user 0.006s	sys 0.007s
I20260709 12:12:01.462423 19007 raft_consensus.cc:2749] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:01.462567 13687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1921) took 1410 ms. Trace:
I20260709 12:12:01.463287 19007 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:01.463169 13687 rpcz_store.cc:276] 0709 12:12:00.051729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:00.499242 (+447513us) service_pool.cc:224] Handling call
0709 12:12:00.499578 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:00.737101 (+237523us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:00.737150 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:00.745435 (+  8285us) log.cc:844] Serialized 26 byte log entry
0709 12:12:00.861135 (+115700us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:00.861174 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:00.864117 (+  2943us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:01.462234 (+598117us) raft_consensus.cc:1685] finished
0709 12:12:01.462269 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:01.462488 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":235863,"raft.queue_time_us":236441,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":3125,"thread_start_us":70756,"threads_started":1,"wal-append.queue_time_us":176093}
W20260709 12:12:01.417116 19328 log.cc:927] Time spent T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.602s	user 0.000s	sys 0.010s
I20260709 12:12:01.439206 14379 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:01.442423 19361 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:01.412593 18873 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:01.467139 14379 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:01.467586 18873 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:01.468205 18873 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:01.468662 19361 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:01.469691 19104 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:01.401464 19027 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.471570 19154 consensus_queue.cc:1059] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:01.472431 19027 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:01.473845 19198 consensus_queue.cc:1048] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:01.474928 19027 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:01.419119 18639 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:01.425704 18913 raft_consensus.cc:740] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:01.464210 19007 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:01.437358 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:01.465508 13684 raft_consensus.cc:1240] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:01.398955 19019 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:01.510015 19361 raft_consensus.cc:2749] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:01.400149 19275 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:01.469982 19043 raft_consensus.cc:2749] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:01.473651 13835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 2995) took 1822 ms. Trace:
I20260709 12:12:01.552516 13835 rpcz_store.cc:276] 0709 12:11:59.651777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:59.665753 (+ 13976us) service_pool.cc:224] Handling call
0709 12:12:00.594220 (+928467us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:00.594420 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:12:00.813039 (+218619us) log.cc:844] Serialized 14 byte log entry
0709 12:12:01.061485 (+248446us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:01.061570 (+    85us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:01.061616 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:01.061693 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:01.473447 (+411754us) spinlock_profiling.cc:243] Waited 928 ms on lock 0x7b54000daf50. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:01.473567 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":259443,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":27,"raft.queue_time_us":51492,"raft.run_cpu_time_us":64,"raft.run_wall_time_us":64,"spinlock_wait_cycles":2134449408,"thread_start_us":466236,"threads_started":3,"wal-append.queue_time_us":160823}
I20260709 12:12:01.355966 19100 raft_consensus.cc:697] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 15 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:01.412544 19344 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:01.500854 19271 raft_consensus.cc:2749] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:01.555464 19007 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:01.555943 19100 consensus_queue.cc:237] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:01.557046 19248 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:01.559083 19275 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:01.501063 19354 consensus_queue.cc:1048] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:12:01.501349 19166 raft_consensus.cc:3055] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:12:01.502331 19349 log.cc:927] Time spent T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
W20260709 12:12:01.509258 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:01.568646 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 160310us
I20260709 12:12:01.476745 19301 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:12:01.475193 19317 consensus_meta.cc:287] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.612s	user 0.010s	sys 0.000s
I20260709 12:12:01.359123 19350 consensus_queue.cc:1059] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 12:12:01.427009 19351 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:01.561723 13829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 2996) took 1885 ms. Trace:
W20260709 12:12:01.561911 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 130470us
I20260709 12:12:01.578611 13800 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:01.566373 19166 raft_consensus.cc:740] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:01.577616 13829 rpcz_store.cc:276] 0709 12:11:59.676808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:59.677294 (+   486us) service_pool.cc:224] Handling call
0709 12:11:59.677764 (+   470us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:59.678292 (+   528us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:59.678344 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:59.686534 (+  8190us) log.cc:844] Serialized 26 byte log entry
0709 12:12:00.895679 (+1209145us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b1800317740. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e82e07 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9fc02 00007fa927b2720b 00007fa927b2cd23 00007fa927b2d0d1 00007fa927f48a0f
0709 12:12:00.946487 (+ 50808us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:00.978456 (+ 31969us) log.cc:844] Serialized 14 byte log entry
0709 12:12:01.065476 (+ 87020us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:01.065570 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:01.557831 (+492261us) spinlock_profiling.cc:243] Waited 3.22 ms on lock 0x7b1800317740. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924ea03f3 00007fa924ea27c1 00007fa924ea2779 00007fa924ea2709 00007fa924ea26d1 00007fa924ea19cd 0000000000388634 0000000000388479 00007fa924e8383a
0709 12:12:01.561475 (+  3644us) raft_consensus.cc:1685] finished
0709 12:12:01.561505 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:01.561656 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48,"prepare.queue_time_us":37129,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":27589,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":7063,"spinlock_wait_cycles":36726400,"thread_start_us":137269,"threads_started":2,"wal-append.queue_time_us":1295638}
I20260709 12:12:01.580088 19166 consensus_queue.cc:260] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:01.581076 19141 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:01.582460 13761 raft_consensus.cc:2393] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 17: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:01.568905 18913 consensus_queue.cc:260] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:01.587091 18913 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:01.587805 19225 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:01.597863 13800 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:12:01.575500 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 208258us
W20260709 12:12:01.599602 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:01.600214 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:01.600250 13652 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:01.571504 13727 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
W20260709 12:12:01.573213 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 202345us
I20260709 12:12:01.453271 19335 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:01.605103 13828 raft_consensus.cc:1275] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:12:01.498975 19363 consensus_queue.cc:1048] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.130s
I20260709 12:12:01.607266 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:01.609861 13800 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:01.611924 13829 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 18.
I20260709 12:12:01.613576 19373 raft_consensus.cc:2749] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:12:01.614292 19323 log.cc:927] Time spent T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.729s	user 0.000s	sys 0.005s
I20260709 12:12:01.615240 13800 leader_election.cc:400] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 election: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 15. Current term is 16.
W20260709 12:12:01.616869 19195 consensus_meta.cc:287] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.517s	user 0.008s	sys 0.000s
I20260709 12:12:01.617978 19373 raft_consensus.cc:2804] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:12:01.618706 19183 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:01.619228 13800 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:01.619300 19183 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:01.620779 19152 consensus_meta.cc:287] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.854s	user 0.010s	sys 0.000s
I20260709 12:12:01.621472 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:01.622335 14414 raft_consensus.cc:2393] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 16: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:12:01.622169 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:01.622951 13687 raft_consensus.cc:2468] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 13.
I20260709 12:12:01.623744 19271 raft_consensus.cc:2749] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:01.599049 19348 consensus_queue.cc:1048] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 12:12:01.599807 19301 consensus_queue.cc:1048] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:12:01.607090 19043 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.625140 13800 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:01.627146 19043 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:01.627780 19301 raft_consensus.cc:2804] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:01.628257 19301 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:01.577744 18873 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:01.628711 19301 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:01.613487 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:12:01.630784 19321 log.cc:927] Time spent T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.826s	user 0.001s	sys 0.008s
W20260709 12:12:01.631052 19320 log.cc:927] Time spent T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.809s	user 0.001s	sys 0.009s
I20260709 12:12:01.632545 13679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 954) took 1697 ms. Trace:
I20260709 12:12:01.602968 19248 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:01.632982 13679 rpcz_store.cc:276] 0709 12:11:59.935096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:59.935499 (+   403us) service_pool.cc:224] Handling call
0709 12:11:59.961576 (+ 26077us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:59.962054 (+   478us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:59.962215 (+   161us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:00.464704 (+502489us) spinlock_profiling.cc:243] Waited 7.05 ms on lock 0x7b2c000014c8. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa926886a11 00007fa926896372 00007fa927fc8a01 00007fa927f8d43a 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2
0709 12:12:00.479526 (+ 14822us) log.cc:844] Serialized 26 byte log entry
0709 12:12:00.754291 (+274765us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:00.776693 (+ 22402us) log.cc:844] Serialized 14 byte log entry
0709 12:12:00.781334 (+  4641us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:00.781435 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:01.630187 (+848752us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:12:01.632310 (+  2123us) raft_consensus.cc:1685] finished
0709 12:12:01.632336 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:01.632481 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4331,"prepare.queue_time_us":21921,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":28811,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":31202,"spinlock_wait_cycles":295595008,"thread_start_us":248870,"threads_started":1,"wal-append.queue_time_us":301649}
I20260709 12:12:01.634840 19248 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:01.636618 19254 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:01.576618 19317 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:01.637535 19327 log.cc:927] Time spent T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.783s	user 0.003s	sys 0.008s
I20260709 12:12:01.601534 19191 raft_consensus.cc:2749] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:01.642447 13800 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:01.699759 14380 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:01.641510 19301 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:01.702934 14411 raft_consensus.cc:1275] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:12:01.617288 19195 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:01.644989 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:01.645475 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:01.646188 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:01.649643 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:01.650620 19183 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:01.587891 19216 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:01.651235 19350 raft_consensus.cc:3055] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:01.618778 19373 raft_consensus.cc:697] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 12 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
W20260709 12:12:01.659968 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 88581.4us
I20260709 12:12:01.660092 18639 raft_consensus.cc:2804] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:01.668452 19356 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.669157 19354 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.670123 19375 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.625140 19351 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:01.673502 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:01.698836 19294 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.683409 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:01.772269 13837 raft_consensus.cc:2468] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 15.
I20260709 12:12:01.629477 19043 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:01.699858 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 57499.9us
I20260709 12:12:01.642599 13686 raft_consensus.cc:1275] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 12:12:01.636721 18940 consensus_meta.cc:287] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.697s	user 0.009s	sys 0.000s
I20260709 12:12:01.701370 13763 raft_consensus.cc:1240] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:12:01.735651 13754 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 18.
I20260709 12:12:01.744741 13829 raft_consensus.cc:1240] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:01.745644 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:01.776445 13832 raft_consensus.cc:2393] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 18: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:01.744786 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:01.747263 14416 raft_consensus.cc:1240] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:01.776707 13800 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:01.748198 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:01.778865 13831 raft_consensus.cc:2410] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 12:12:01.736465 13755 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 16.
I20260709 12:12:01.692535 18873 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:01.684118 18945 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.751678 14407 raft_consensus.cc:1240] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 13. Current term is 14. Ops: []
W20260709 12:12:01.677105 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 76945.8us
I20260709 12:12:01.786682 13652 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:01.750890 18639 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:01.763967 19351 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:01.798962 19351 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:01.799067 13681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2908) took 2517 ms. Trace:
I20260709 12:12:01.733917 19029 raft_consensus.cc:2804] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:01.800098 19029 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:01.799960 13681 rpcz_store.cc:276] 0709 12:11:59.281107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:59.281259 (+   152us) service_pool.cc:224] Handling call
0709 12:11:59.300108 (+ 18849us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:00.627745 (+1327637us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:01.798605 (+1170860us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b54002841d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:01.798877 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2974886784}
I20260709 12:12:01.800726 19029 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:01.764926 14415 raft_consensus.cc:1240] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:01.701077 19139 consensus_queue.cc:1048] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 12:12:01.765892 19371 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.758258 19148 consensus_queue.cc:1048] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 12:12:01.766366 19341 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:01.741390 19322 consensus_meta.cc:287] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.749s	user 0.010s	sys 0.002s
I20260709 12:12:01.766355 19216 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:01.793849 19191 raft_consensus.cc:2749] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:01.767127 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:01.692698 19254 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:01.775660 13651 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:12:01.851459 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 75869.5us
I20260709 12:12:01.767218 19225 consensus_queue.cc:1048] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.050s
I20260709 12:12:01.738453 19350 raft_consensus.cc:740] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:01.683900 19228 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:01.795907 13652 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
W20260709 12:12:01.865001 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 69226.4us
I20260709 12:12:01.858263 13651 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:01.695885 19190 raft_consensus.cc:2749] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:01.798467 19183 raft_consensus.cc:2804] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:01.798206 18913 consensus_queue.cc:1048] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:12:01.799504 19351 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:01.764356 19140 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.814558 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:01.767127 19373 consensus_queue.cc:237] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:01.802814 18945 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:01.817062 13754 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:01.879089 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:01.826967 13800 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:01.734584 19342 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:01.767431 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:01.845655 19195 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:01.896576 13727 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:01.738940 19097 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.903568 19097 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:01.856519 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:01.906853 13687 raft_consensus.cc:2393] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 14: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:01.857012 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:01.792483 19318 consensus_queue.cc:1048] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 12:12:01.908160 13688 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 15.
I20260709 12:12:01.782183 19019 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:01.870412 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 449034us
I20260709 12:12:01.872768 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:01.760681 19356 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:01.789647 19294 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:01.815846 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:01.876169 19183 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:01.877377 19364 raft_consensus.cc:2804] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:12:01.890941 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 64113.8us
I20260709 12:12:01.803054 18639 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:01.917958 19352 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.023s	sys 0.008s
I20260709 12:12:01.866824 19122 raft_consensus.cc:2804] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:01.864668 19340 raft_consensus.cc:2804] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:01.912887 13727 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:01.851049 19322 raft_consensus.cc:2749] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:12:01.920746 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 221043us
I20260709 12:12:01.927204 19369 raft_consensus.cc:2749] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:01.769908 19354 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:01.783041 19375 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:01.934166 13754 raft_consensus.cc:1275] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:12:01.850708 19341 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:01.918924 19315 consensus_meta.cc:287] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.833s	user 0.013s	sys 0.002s
I20260709 12:12:01.911434 19191 raft_consensus.cc:2804] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:01.954631 19364 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:01.957374 13800 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:01.960603 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:12:01.968281 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:01.985852 14410 raft_consensus.cc:2393] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 15: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:12:01.912709 19344 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:01.838753 19371 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:01.927767 18936 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.918483 19165 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:01.886035 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 416870us
I20260709 12:12:01.895134 19140 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:01.951531 19183 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:01.980230 19141 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:02.009150 19093 consensus_meta.cc:287] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.551s	user 0.012s	sys 0.000s
W20260709 12:12:02.078455 19368 log.cc:927] Time spent T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 12:12:02.080874 18639 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:02.081413 19356 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:02.081920 18945 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:02.083019 19354 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:02.083217 18639 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:02.084152 19228 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:01.981935 19350 consensus_queue.cc:260] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:02.033681 19301 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:02.034682 19271 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:02.044330 19165 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:01.984503 19122 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:12:02.012477 19343 consensus_meta.cc:287] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.584s	user 0.012s	sys 0.000s
I20260709 12:12:02.090124 19122 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:02.039754 19248 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:02.035861 19344 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:02.041679 18936 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:02.037560 19152 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:02.019743 19191 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:02.104079 19191 raft_consensus.cc:3060] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:02.010057 19339 consensus_meta.cc:287] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.582s	user 0.011s	sys 0.000s
I20260709 12:12:02.019999 19315 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:02.106972 19339 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:02.028915 19364 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:02.006772 19335 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:02.071870 19378 log.cc:927] Time spent T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 12:12:02.072125 19019 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:01.979126 19097 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:02.086216 19350 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:02.090243 19343 raft_consensus.cc:2749] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 16. Current term is 17.
I20260709 12:12:01.991102 19340 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:02.073365 19341 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:02.089497 19165 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:02.124358 19340 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:02.148130 18936 leader_election.cc:290] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:02.109759 19315 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:02.150903 19339 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:02.155679 19029 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:02.165881 19330 consensus_meta.cc:287] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.668s	user 0.006s	sys 0.009s
I20260709 12:12:02.214954 19330 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:02.135398 19344 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:02.135659 19140 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:02.138921 19371 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:02.139992 19375 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:02.142887 19294 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:02.208213 18873 raft_consensus.cc:2749] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:02.223026 19271 raft_consensus.cc:2749] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:02.231411 19364 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:02.239501 19351 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:02.282292 19364 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:02.282503 19351 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:02.255337 19340 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:02.283538 19254 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:02.287456 19254 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:02.290233 19340 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:01.915863 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:02.351145 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:01.987705 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:02.359591 13684 raft_consensus.cc:2393] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 15: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:02.361057 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:02.363780 13683 raft_consensus.cc:2393] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 17: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:02.364017 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:02.367353 13685 raft_consensus.cc:2393] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 17: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:02.367487 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:02.368633 13683 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:02.361373 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:02.371824 13684 raft_consensus.cc:1240] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 17. Current term is 18. Ops: []
W20260709 12:12:02.379436 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 466369us
W20260709 12:12:02.380749 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:02.007040 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:02.383440 13754 raft_consensus.cc:2393] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 16: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
W20260709 12:12:02.387440 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:02.369654 13685 raft_consensus.cc:1275] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:12:02.392254 13758 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 14.
W20260709 12:12:02.030762 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 73451.1us
I20260709 12:12:02.403520 13759 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:02.036734 14379 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:02.236212 19029 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:02.392933 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:02.424775 13684 raft_consensus.cc:1240] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 14. Current term is 15. Ops: [12.7-14.8]
I20260709 12:12:02.431758 13833 raft_consensus.cc:1240] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 12:12:02.431530 19152 consensus_queue.cc:1059] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:02.432977 13679 raft_consensus.cc:1275] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:12:02.437279 19195 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:02.469276 19195 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:02.438333 19352 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:02.438634 18936 consensus_queue.cc:1059] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:02.439805 19358 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:02.440202 19165 consensus_queue.cc:1059] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:02.443758 13834 raft_consensus.cc:1240] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:12:02.450327 19254 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:02.451637 14414 raft_consensus.cc:2368] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 18. Current term is 19.
I20260709 12:12:02.261453 19191 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:02.489252 13679 raft_consensus.cc:1240] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:02.452735 19271 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:02.456864 19335 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:02.458775 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:02.492471 13835 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:02.459971 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:02.462000 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:02.479470 19166 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:02.480096 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:02.487632 14415 raft_consensus.cc:1240] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:02.487946 19330 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:02.482213 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:02.487675 13762 raft_consensus.cc:1240] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:02.505498 13832 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 14.
I20260709 12:12:02.505761 19352 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:02.507050 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:02.508638 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:02.509356 19352 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:02.509974 19271 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:02.510457 19254 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:02.513075 19271 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:02.497380 19335 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:02.532882 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:02.541018 13835 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 14.
I20260709 12:12:02.554587 13759 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 17.
I20260709 12:12:02.527721 19191 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:02.520722 19335 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:02.513696 19254 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:02.521389 19225 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:02.573643 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:02.574815 13679 raft_consensus.cc:1240] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:02.528486 19294 raft_consensus.cc:2749] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:02.576664 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:02.582520 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:02.586226 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:02.581441 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:02.528563 19358 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:02.593881 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:12:02.596063 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 46731.5us
I20260709 12:12:02.584607 19330 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:02.604941 13754 raft_consensus.cc:1240] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:02.608222 13832 raft_consensus.cc:2393] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 16: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:02.608577 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:02.609464 14416 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 16.
I20260709 12:12:02.613708 19322 raft_consensus.cc:3055] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:02.614352 19322 raft_consensus.cc:740] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:12:02.615772 19329 log.cc:927] Time spent T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 1.811s	user 0.005s	sys 0.026s
I20260709 12:12:02.615877 19322 consensus_queue.cc:260] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:02.618544 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:02.619553 14409 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:02.620242 14380 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:12:02.621192 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 78154us
I20260709 12:12:02.608240 19122 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:02.624037 19216 raft_consensus.cc:2804] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:02.624533 19216 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:02.624624 19122 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:02.625011 19216 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:02.627208 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:02.629585 13763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 2093) took 1657 ms. Trace:
I20260709 12:12:02.629974 19225 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:02.630196 13763 rpcz_store.cc:276] 0709 12:12:00.972310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:01.085136 (+112826us) service_pool.cc:224] Handling call
0709 12:12:01.085603 (+   467us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:01.780452 (+694849us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:02.628999 (+848547us) spinlock_profiling.cc:243] Waited 615 ms on lock 0x7b54002b07d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:02.629364 (+   365us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1415426688}
I20260709 12:12:02.633230 19225 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:02.633711 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:02.634137 13684 raft_consensus.cc:1240] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 15. Current term is 16. Ops: []
W20260709 12:12:02.635624 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 598829us
I20260709 12:12:02.636475 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:02.637048 14379 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:02.644788 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:02.604401 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:12:02.682367 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 45568us
I20260709 12:12:02.685948 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:02.686211 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:02.682207 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:02.677054 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:02.703261 13682 raft_consensus.cc:2468] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 15.
I20260709 12:12:02.710320 13683 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 17.
I20260709 12:12:02.671393 19294 raft_consensus.cc:2749] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:12:02.730113 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 76696.7us
I20260709 12:12:02.703923 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:02.723930 13758 raft_consensus.cc:2468] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 15.
I20260709 12:12:02.686048 19322 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:02.738268 13830 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 15.
I20260709 12:12:02.758198 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:02.735764 13726 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:02.771230 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:02.773553 13837 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 17.
I20260709 12:12:02.729079 19166 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:02.768770 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:02.777058 13684 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 18.
W20260709 12:12:02.778033 19401 log.cc:927] Time spent T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:12:02.778115 19234 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:02.778776 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:02.779304 19271 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:02.780172 19183 consensus_meta.cc:287] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.681s	user 0.014s	sys 0.005s
I20260709 12:12:02.780794 19358 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:02.780817 19405 log.cc:927] Time spent T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:12:02.802048 14414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41700 (request call id 817) took 1059 ms. Trace:
I20260709 12:12:02.806524 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:02.814162 19100 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:02.814936 19029 consensus_queue.cc:1048] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:02.833945 19100 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:02.815873 19373 consensus_queue.cc:1059] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:02.826541 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:02.834995 19271 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:02.835853 19373 raft_consensus.cc:3055] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:02.836203 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:02.836357 19373 raft_consensus.cc:740] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:02.836589 19100 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:02.837126 13835 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 15.
I20260709 12:12:02.819862 14408 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 15.
I20260709 12:12:02.831264 14409 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 16.
I20260709 12:12:02.831307 14414 rpcz_store.cc:276] 0709 12:12:01.743114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:01.759451 (+ 16337us) service_pool.cc:224] Handling call
0709 12:12:02.801623 (+1042172us) spinlock_profiling.cc:243] Waited 562 ms on lock 0x7b54007c01d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:02.801916 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1292355840}
I20260709 12:12:02.834448 13756 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:02.744571 19330 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:02.838330 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:02.839476 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:02.830309 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:02.843194 14410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41700 (request call id 818) took 1098 ms. Trace:
I20260709 12:12:02.851534 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:02.841286 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:02.852720 13831 raft_consensus.cc:2393] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 18: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:02.851537 14410 rpcz_store.cc:276] 0709 12:12:01.744386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:01.744532 (+   146us) service_pool.cc:224] Handling call
0709 12:12:02.842637 (+1098105us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b54004d6054. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:02.842955 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":479482624}
I20260709 12:12:02.837734 19271 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:02.858618 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:02.859475 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:02.926738 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:02.942261 13836 raft_consensus.cc:2410] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 12:12:02.833997 19166 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:02.973345 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:02.975956 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:02.976603 13833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 3019) took 1228 ms. Trace:
I20260709 12:12:02.976704 13836 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:02.976840 13759 raft_consensus.cc:1275] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:12:02.977035 13833 rpcz_store.cc:276] 0709 12:12:01.747775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:01.756112 (+  8337us) service_pool.cc:224] Handling call
0709 12:12:01.756612 (+   500us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:02.473358 (+716746us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:02.976237 (+502879us) spinlock_profiling.cc:243] Waited 656 ms on lock 0x7b5400361d54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:02.976505 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1507880320}
I20260709 12:12:02.832872 19183 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:02.974615 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:12:02.982281 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 118885us
I20260709 12:12:02.846733 19373 consensus_queue.cc:260] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:03.003846 13831 raft_consensus.cc:2393] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 14: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:03.010946 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:02.842130 19234 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:02.926508 19335 raft_consensus.cc:2749] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:03.023006 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:12:03.023305 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 431027us
W20260709 12:12:03.023155 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:03.028550 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:03.029675 13830 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:03.043130 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:03.045581 19056 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:03.046452 19056 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:03.047991 19234 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:03.048977 19056 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:03.049835 19254 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.050632 19254 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:03.053159 19254 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:03.044597 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:03.059367 13828 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:03.060352 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:03.061137 13836 raft_consensus.cc:2410] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 12:12:03.068974 13837 raft_consensus.cc:2393] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 18: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:03.066147 13833 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 15.
I20260709 12:12:03.067071 14380 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:03.072026 19225 raft_consensus.cc:2804] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:03.072532 19225 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:12:03.079324 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 44538.8us
I20260709 12:12:03.049862 19166 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:03.083544 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:03.072947 19225 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:03.096602 13837 raft_consensus.cc:1275] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:12:03.106781 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:03.098623 19373 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:03.110631 14380 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:03.117503 13834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 3021) took 1366 ms. Trace:
I20260709 12:12:03.105151 19166 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:03.121245 13762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 817) took 2128 ms. Trace:
I20260709 12:12:03.121230 19166 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:03.121809 13762 rpcz_store.cc:276] 0709 12:12:00.994387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:01.088918 (+ 94531us) service_pool.cc:224] Handling call
0709 12:12:01.089195 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:02.528790 (+1439595us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:03.120921 (+592131us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b540032e454. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:03.121186 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3214560640}
I20260709 12:12:03.118022 13834 rpcz_store.cc:276] 0709 12:12:01.754349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:01.754550 (+   201us) service_pool.cc:224] Handling call
0709 12:12:01.755053 (+   503us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:02.499829 (+744776us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:03.117174 (+617345us) spinlock_profiling.cc:243] Waited 658 ms on lock 0x7b5400362c54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:03.117430 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1513423744}
I20260709 12:12:03.123708 19166 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:03.125104 19029 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:03.125828 19029 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:03.128170 19029 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:03.128767 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:03.131690 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:03.138803 13756 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 17.
I20260709 12:12:03.139008 19234 raft_consensus.cc:2804] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:03.139971 19234 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:03.140396 19234 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:03.143461 19140 raft_consensus.cc:3055] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:03.143970 19140 raft_consensus.cc:740] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:03.144981 19140 consensus_queue.cc:260] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:03.153095 13828 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 15.
W20260709 12:12:03.154265 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 50084.3us
I20260709 12:12:03.161984 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:03.162932 13681 raft_consensus.cc:2468] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 15.
I20260709 12:12:03.171926 13754 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 18.
I20260709 12:12:03.177765 13833 raft_consensus.cc:1240] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:03.180145 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:03.182152 19140 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:03.182260 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:03.182431 14407 raft_consensus.cc:1275] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:12:03.183871 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:12:03.193197 19216 consensus_meta.cc:287] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.567s	user 0.012s	sys 0.000s
I20260709 12:12:03.194723 19216 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:03.195708 19402 log.cc:927] Time spent T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 12:12:03.197278 19393 raft_consensus.cc:3055] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:03.197820 19393 raft_consensus.cc:740] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:03.198979 19393 consensus_queue.cc:260] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:03.200839 19393 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:03.197260 13830 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 19.
I20260709 12:12:03.203233 14380 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:12:03.205096 19403 log.cc:927] Time spent T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.468s	user 0.000s	sys 0.011s
I20260709 12:12:03.203393 13755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 2106) took 1390 ms. Trace:
I20260709 12:12:03.174934 19166 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:03.210207 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:03.210991 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:03.206516 13755 rpcz_store.cc:276] 0709 12:12:01.813378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:01.895889 (+ 82511us) service_pool.cc:224] Handling call
0709 12:12:01.910252 (+ 14363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:02.380300 (+470048us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:02.380364 (+    64us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:02.381223 (+   859us) log.cc:844] Serialized 26 byte log entry
0709 12:12:02.464366 (+ 83143us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:12:02.464412 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:03.202874 (+738462us) spinlock_profiling.cc:243] Waited 469 ms on lock 0x7b54002b0cd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:03.202923 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:03.202969 (+    46us) raft_consensus.cc:1685] finished
0709 12:12:03.202983 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:03.203229 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":29540,"raft.run_cpu_time_us":351,"raft.run_wall_time_us":11362,"spinlock_wait_cycles":1078418304,"thread_start_us":82556,"threads_started":1,"wal-append.queue_time_us":182364}
I20260709 12:12:03.213796 19166 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:03.212172 19294 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:03.214501 19234 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:03.215370 19294 raft_consensus.cc:697] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 19 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:03.216564 19294 consensus_queue.cc:237] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:03.217340 19234 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:03.208630 13836 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:03.221889 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:12:03.222893 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:03.233320 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:03.234678 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:03.235327 13833 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:03.235822 13837 raft_consensus.cc:1240] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:03.239990 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:03.243532 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:03.244179 13800 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:03.244552 13762 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:03.246968 13756 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 17.
I20260709 12:12:03.248780 13755 raft_consensus.cc:1275] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:12:03.251894 19183 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:03.257553 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 233326us
I20260709 12:12:03.259354 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:03.268203 19373 raft_consensus.cc:2749] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:03.285275 19373 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:03.290225 19216 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:03.294126 19183 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:03.295306 19183 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:03.298406 19183 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:03.299705 13761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 2108) took 1339 ms. Trace:
I20260709 12:12:03.300169 13761 rpcz_store.cc:276] 0709 12:12:01.959739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:01.960181 (+   442us) service_pool.cc:224] Handling call
0709 12:12:01.960560 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:02.403855 (+443295us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:02.403912 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:02.404832 (+   920us) log.cc:844] Serialized 26 byte log entry
0709 12:12:02.568867 (+164035us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:02.568926 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:03.204309 (+635383us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:12:03.299170 (+ 94861us) spinlock_profiling.cc:243] Waited 442 ms on lock 0x7b5400333bd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:03.299243 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:03.299316 (+    73us) raft_consensus.cc:1685] finished
0709 12:12:03.299332 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:03.299513 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":44541,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":175,"spinlock_wait_cycles":1045039104,"thread_start_us":163424,"threads_started":1,"wal-append.queue_time_us":196211}
W20260709 12:12:03.302356 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 70878.3us
W20260709 12:12:03.303654 19406 log.cc:927] Time spent T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.177s	user 0.002s	sys 0.000s
I20260709 12:12:03.305289 19384 consensus_queue.cc:1059] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 12:12:03.306192 19270 consensus_queue.cc:1048] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.086s
I20260709 12:12:03.260560 19195 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:03.284171 13726 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:03.309090 13727 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:12:03.279955 19322 consensus_meta.cc:287] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.517s	user 0.006s	sys 0.006s
I20260709 12:12:03.319299 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:03.325649 19393 raft_consensus.cc:2749] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:03.325982 19367 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:12:03.326428 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:03.326783 19367 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:03.329368 19367 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:03.334546 13830 raft_consensus.cc:2468] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 15.
I20260709 12:12:03.343964 13800 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:03.344055 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:03.344305 19367 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:03.344305 19100 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:03.345324 19367 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:03.346324 19029 raft_consensus.cc:2804] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:03.346761 19029 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:03.347180 19029 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:03.347925 19367 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:03.345431 19100 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:03.285986 19373 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:03.352705 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 89678.4us
I20260709 12:12:03.363662 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:12:03.369815 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 105820us
I20260709 12:12:03.312880 19317 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:03.368441 13688 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 15.
W20260709 12:12:03.381206 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:03.381462 13726 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:03.385841 13727 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:03.391075 13833 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 16.
I20260709 12:12:03.393572 13727 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:03.397401 19027 raft_consensus.cc:2804] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:03.397995 19027 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:03.398488 19027 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:03.399050 13727 leader_election.cc:400] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 18. Current term is 19.
I20260709 12:12:03.399421 13727 leader_election.cc:403] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:03.400321 19139 raft_consensus.cc:2804] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:03.401115 19393 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:12:03.371318 19322 raft_consensus.cc:2804] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:03.414518 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:03.419066 13836 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 16.
I20260709 12:12:03.401160 19139 raft_consensus.cc:697] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:03.423753 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:03.406167 19322 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:03.391937 19225 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:03.436215 13688 raft_consensus.cc:2410] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for term 16 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 12:12:03.429581 13685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2941) took 1505 ms. Trace:
I20260709 12:12:03.443087 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:03.463424 13835 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 14.
I20260709 12:12:03.437837 19322 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:03.472012 19225 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:03.472458 19154 raft_consensus.cc:2749] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:03.474308 19357 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.474985 19357 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:03.477320 19357 leader_election.cc:290] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:03.477205 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:03.479053 19139 consensus_queue.cc:237] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:03.481145 19019 consensus_queue.cc:1048] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 12:12:03.483618 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:03.486212 19330 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:03.438822 13685 rpcz_store.cc:276] 0709 12:12:01.924427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:02.390096 (+465669us) service_pool.cc:224] Handling call
0709 12:12:02.390867 (+   771us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:02.391868 (+  1001us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:02.391911 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:02.392673 (+   762us) log.cc:844] Serialized 26 byte log entry
0709 12:12:02.831900 (+439227us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:12:02.832593 (+   693us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:02.832669 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:03.302853 (+470184us) spinlock_profiling.cc:243] Waited 35.7 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:12:03.412870 (+110017us) raft_consensus.cc:1685] finished
0709 12:12:03.412901 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:03.429483 (+ 16582us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":47619,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":206,"spinlock_wait_cycles":82058112,"thread_start_us":428719,"threads_started":1,"wal-append.queue_time_us":712715}
I20260709 12:12:03.506961 13837 raft_consensus.cc:1240] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:03.489668 13830 raft_consensus.cc:1240] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:03.523245 13828 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:03.543749 13836 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 11.
I20260709 12:12:03.502010 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:03.546286 14380 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:12:03.492048 19400 log.cc:927] Time spent T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.756s	user 0.001s	sys 0.010s
I20260709 12:12:03.501075 19216 raft_consensus.cc:3055] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:03.559705 13679 raft_consensus.cc:2410] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:12:03.560564 19384 raft_consensus.cc:2804] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:03.582465 13829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 2744) took 1122 ms. Trace:
I20260709 12:12:03.561141 19373 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:12:03.601946 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 254556us
I20260709 12:12:03.561556 19357 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.566776 19100 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:12:03.568307 13583 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45610 (request call id 256) took 38911 ms (client timeout 15000 ms). Trace:
I20260709 12:12:03.493257 19029 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:03.499560 19342 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:03.468426 19166 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:03.578306 13835 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 12.
W20260709 12:12:03.627110 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:03.552980 19330 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.635464 13762 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 14.
I20260709 12:12:03.595129 19216 raft_consensus.cc:740] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:03.578783 19140 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.641249 14380 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:03.655294 13830 raft_consensus.cc:1240] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 13. Current term is 14. Ops: []
W20260709 12:12:03.653940 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 245918us
I20260709 12:12:03.599858 13829 rpcz_store.cc:276] 0709 12:12:02.459774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:02.460703 (+   929us) service_pool.cc:224] Handling call
0709 12:12:02.461352 (+   649us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:02.462253 (+   901us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:02.462296 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:02.478154 (+ 15858us) log.cc:844] Serialized 26 byte log entry
0709 12:12:02.556598 (+ 78444us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:12:02.556658 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:02.556743 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:03.491355 (+934612us) spinlock_profiling.cc:243] Waited 18.7 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:12:03.581912 (+ 90557us) raft_consensus.cc:1685] finished
0709 12:12:03.581945 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:03.582257 (+   312us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4087,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":235,"spinlock_wait_cycles":42938624,"thread_start_us":77918,"threads_started":1,"wal-append.queue_time_us":106680}
I20260709 12:12:03.665807 13828 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 16.
I20260709 12:12:03.636746 19384 raft_consensus.cc:697] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 16 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:03.632661 19317 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:03.573763 19027 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:03.691679 19027 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:03.696146 19029 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:03.656133 19357 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:03.699169 19357 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:03.699815 19225 raft_consensus.cc:2804] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:03.700476 19225 raft_consensus.cc:697] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 14 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:03.701509 19225 consensus_queue.cc:237] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:03.676267 19330 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:03.704380 19317 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:03.706657 19317 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:03.707196 19317 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.707749 19317 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:03.655267 19183 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.674295 13830 raft_consensus.cc:1240] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:03.678587 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:03.679522 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:03.685921 19140 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:03.686888 19216 consensus_queue.cc:260] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:03.671761 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 61826.1us
I20260709 12:12:03.732262 14415 raft_consensus.cc:2468] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 12.
I20260709 12:12:03.784767 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:03.785095 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:03.787667 13761 raft_consensus.cc:2410] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for term 16 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 12:12:03.789462 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:03.709740 19317 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:03.793746 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:03.794950 13755 raft_consensus.cc:2393] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 16: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
W20260709 12:12:03.795894 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 414620us
I20260709 12:12:03.781287 19393 raft_consensus.cc:2749] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 18. Current term is 19.
W20260709 12:12:03.819214 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 149580us
I20260709 12:12:03.714494 13582 catalog_manager.cc:5697] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 4 to 7, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 7 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:12:03.844177 13726 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:03.789031 19183 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:03.848484 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:03.851054 13758 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 18.
I20260709 12:12:03.826602 19216 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:03.854048 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:03.816820 19330 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:12:03.856813 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 246966us
I20260709 12:12:03.857988 13763 raft_consensus.cc:1275] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 12:12:03.871124 13763 pending_rounds.cc:85] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting all ops after (but not including) 7
I20260709 12:12:03.871476 13763 pending_rounds.cc:107] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 12:12:03.871816 13763 raft_consensus.cc:2889] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:03.857905 19393 raft_consensus.cc:2749] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:03.856870 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:03.864504 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:03.812465 19384 consensus_queue.cc:237] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:03.883854 13652 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
W20260709 12:12:03.885258 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 50061.5us
I20260709 12:12:03.888792 19417 consensus_queue.cc:1048] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:12:03.890431 19412 log.cc:927] Time spent T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:12:03.891086 19183 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:03.892767 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:03.903571 13762 raft_consensus.cc:1240] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:03.908039 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:03.911419 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:03.912261 13763 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 14.
I20260709 12:12:03.912107 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:03.913748 13760 raft_consensus.cc:1240] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:03.914964 13831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 3026) took 1360 ms. Trace:
W20260709 12:12:03.917258 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 63563.4us
I20260709 12:12:03.918918 13726 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
W20260709 12:12:03.922314 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 265016us
I20260709 12:12:03.826304 19357 consensus_queue.cc:1059] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.048s
I20260709 12:12:03.945276 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:03.946485 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:03.915537 13831 rpcz_store.cc:276] 0709 12:12:02.531225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:03.022419 (+491194us) service_pool.cc:224] Handling call
0709 12:12:03.036358 (+ 13939us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:03.089576 (+ 53218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:03.089609 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:03.108358 (+ 18749us) log.cc:844] Serialized 26 byte log entry
0709 12:12:03.520223 (+411865us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:03.520266 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:03.520339 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:03.891594 (+371255us) raft_consensus.cc:1685] finished
0709 12:12:03.891627 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:03.891816 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13114,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":11649,"thread_start_us":335283,"threads_started":1,"wal-append.queue_time_us":623645}
I20260709 12:12:03.952422 19425 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.953161 13726 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:03.953353 19425 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:03.954103 19342 consensus_queue.cc:1059] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:03.955310 19342 raft_consensus.cc:3055] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:03.955693 19342 raft_consensus.cc:740] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:03.956933 19425 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:03.958549 13726 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
W20260709 12:12:03.637843 13583 rpcz_store.cc:269] 0709 12:11:24.656287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.656469 (+   182us) service_pool.cc:224] Handling call
0709 12:12:03.567996 (+38911527us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:53.799822 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:53.965467 (+165645us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:53.965607 (+   140us) write_op.cc:435] Acquired schema lock
0709 12:11:53.965892 (+   285us) tablet.cc:662] Decoding operations
0709 12:11:54.120569 (+154677us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:54.120677 (+   108us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:54.120710 (+    33us) tablet.cc:685] Acquiring locks for 18 operations
0709 12:11:54.373633 (+252923us) tablet.cc:701] Row locks acquired
0709 12:11:54.398427 (+ 24794us) write_op.cc:260] PREPARE: finished
0709 12:11:54.422481 (+ 24054us) write_op.cc:270] Start()
0709 12:11:54.422672 (+   191us) write_op.cc:276] Timestamp: P: 1783599114422392 usec, L: 0
0709 12:11:54.422708 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 12:11:54.423487 (+   779us) log.cc:844] Serialized 7128 byte log entry
0709 12:11:55.133131 (+709644us) op_driver.cc:464] REPLICATION: finished
0709 12:11:55.986785 (+853654us) write_op.cc:301] APPLY: starting
0709 12:11:55.986915 (+   130us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:56.394861 (+407946us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b18003f6160. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa927ccc0ec 00007fa927d18c0a 00007fa927d184f7 00007fa927d18490 00007fa927ccff48 00007fa92b9e41bb 00007fa92b9e4532 00007fa92ba2bb93 00007fa92b8d8de3
0709 12:11:56.603983 (+209122us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:56.613356 (+  9373us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:57.420935 (+807579us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:57.421359 (+   424us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=36,key_file_lookups=36,delta_file_lookups=36,mrs_lookups=0
0709 12:11:57.421432 (+    73us) write_op.cc:312] APPLY: finished
0709 12:11:57.461558 (+ 40126us) log.cc:844] Serialized 164 byte log entry
0709 12:11:57.547120 (+ 85562us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:57.564197 (+ 17077us) write_op.cc:454] Released schema lock
0709 12:11:57.568888 (+  4691us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:57.594048 (+ 25160us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:57.595940 (+  1892us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":18980,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":853260,"apply.run_cpu_time_us":48980,"apply.run_wall_time_us":1595785,"cfile_cache_hit":74,"cfile_cache_hit_bytes":79367,"num_ops":18,"prepare.queue_time_us":312721,"prepare.run_cpu_time_us":17835,"prepare.run_wall_time_us":750673,"raft.queue_time_us":239740,"raft.run_cpu_time_us":69289,"raft.run_wall_time_us":749739,"replication_time_us":710231,"spinlock_wait_cycles":30709504,"thread_start_us":1169409,"threads_started":5,"wal-append.queue_time_us":296691,"wal-append.run_cpu_time_us":43254,"wal-append.run_wall_time_us":2476559}]]}
I20260709 12:12:03.960496 19335 raft_consensus.cc:2749] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:03.961872 19417 consensus_queue.cc:1048] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:03.959441 19027 raft_consensus.cc:2749] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:03.962318 13726 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:03.956717 19342 consensus_queue.cc:260] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:03.952214 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:03.958608 19140 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:03.972239 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:03.947834 19183 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.975620 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:03.975284 13757 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 14.
I20260709 12:12:03.982062 13758 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:04.003579 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:03.973588 19425 raft_consensus.cc:2804] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:04.007417 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:12:04.015180 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 232263us
I20260709 12:12:04.013970 13760 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 14.
I20260709 12:12:04.017818 14380 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:04.020401 13754 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 19.
W20260709 12:12:04.026085 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 63919.5us
I20260709 12:12:03.951292 19019 consensus_queue.cc:1059] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 13.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:12:04.001304 19335 raft_consensus.cc:2804] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:12:04.028904 13728 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.12.56.254:40645, user_credentials={real_user=slave}} blocked reactor thread for 44495.2us
I20260709 12:12:03.984352 19415 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:04.032294 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:04.017833 19425 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:03.988096 19428 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:04.013921 19029 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:03.981383 19139 consensus_queue.cc:1059] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 12:12:04.072654 13800 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:04.042886 14410 raft_consensus.cc:1275] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:12:04.041528 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 72306.1us
I20260709 12:12:04.071134 13582 catalog_manager.cc:5697] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 6 to 8, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 8 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:04.002521 19183 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:04.111554 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:12:04.070665 19418 log.cc:927] Time spent T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.216s	user 0.001s	sys 0.000s
I20260709 12:12:04.043098 19425 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:04.071915 19342 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:04.121028 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:04.038118 19100 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:04.035542 19140 consensus_queue.cc:1048] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.069s
I20260709 12:12:04.070266 19431 raft_consensus.cc:2804] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:04.034142 19367 consensus_queue.cc:1048] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.083s
W20260709 12:12:04.141988 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 258368us
I20260709 12:12:04.122499 19373 raft_consensus.cc:2749] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:04.147372 19183 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:04.148249 19419 log.cc:927] Time spent T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
W20260709 12:12:04.149194 19427 log.cc:927] Time spent T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 12:12:04.151736 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 71558.5us
I20260709 12:12:04.152420 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:12:04.162827 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 121003us
W20260709 12:12:04.163905 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 53825.8us
I20260709 12:12:04.164666 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:04.041975 19027 consensus_queue.cc:1059] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.095s
I20260709 12:12:04.098153 19029 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:04.172883 13830 raft_consensus.cc:1275] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:12:04.178452 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:04.041872 19415 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:04.110459 19428 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:04.166555 19198 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:04.192389 13726 leader_election.cc:304] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:04.193450 14415 raft_consensus.cc:1275] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:12:04.187041 13582 catalog_manager.cc:5697] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 7 to 10, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 10 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:12:04.171808 19335 raft_consensus.cc:697] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:04.170153 19357 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:04.203190 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:04.170785 19431 raft_consensus.cc:697] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 16 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:04.195832 14410 raft_consensus.cc:2468] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 15.
I20260709 12:12:04.176636 19393 raft_consensus.cc:2749] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:04.160035 19100 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:04.179010 19183 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:04.150110 19420 consensus_queue.cc:1059] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.258s
I20260709 12:12:04.215148 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:04.222174 13834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 3033) took 1687 ms. Trace:
I20260709 12:12:04.223538 13651 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:04.221913 19357 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:04.209401 19234 raft_consensus.cc:3055] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:04.234287 19234 raft_consensus.cc:740] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:04.234927 19019 raft_consensus.cc:3055] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:04.235505 19019 raft_consensus.cc:740] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:04.235325 19234 consensus_queue.cc:260] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:04.237182 19234 raft_consensus.cc:3060] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:04.236738 19019 consensus_queue.cc:260] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:04.238436 19166 raft_consensus.cc:3055] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:04.238965 19166 raft_consensus.cc:740] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:12:04.240255 19322 consensus_meta.cc:287] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.690s	user 0.011s	sys 0.000s
I20260709 12:12:04.240097 19166 consensus_queue.cc:260] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.5, Last appended by leader: 5, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:04.240857 19322 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:04.242137 19183 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:04.242353 19431 consensus_queue.cc:237] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:04.244982 19415 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:04.248415 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:04.249220 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:04.249811 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:04.250665 14410 raft_consensus.cc:2393] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 14: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:12:04.250818 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:12:04.251122 19430 log.cc:927] Time spent T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:12:04.251772 14414 raft_consensus.cc:2393] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 16: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:12:04.253288 19357 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:04.252851 19335 consensus_queue.cc:237] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:04.255342 19100 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:04.211473 13800 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:04.233285 19416 raft_consensus.cc:2804] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:04.209669 19198 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:04.260190 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:04.270162 13754 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 9.
W20260709 12:12:04.271725 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 84074.8us
I20260709 12:12:04.271416 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:04.270515 13652 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:04.275981 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:04.223879 13834 rpcz_store.cc:276] 0709 12:12:02.534749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:03.133568 (+598819us) service_pool.cc:224] Handling call
0709 12:12:03.135129 (+  1561us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:03.137425 (+  2296us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:12:03.404655 (+267230us) log.cc:844] Serialized 14 byte log entry
0709 12:12:03.733685 (+329030us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:03.781583 (+ 47898us) log.cc:844] Serialized 26 byte log entry
0709 12:12:03.781799 (+   216us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:03.781851 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:03.781945 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:04.221870 (+439925us) raft_consensus.cc:1685] finished
0709 12:12:04.221897 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:04.222090 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":436652,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":60,"raft.queue_time_us":2030,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":32195,"thread_start_us":572443,"threads_started":2,"wal-append.queue_time_us":388519}
W20260709 12:12:04.278252 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:04.281602 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 66106us
I20260709 12:12:04.214517 19439 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:04.298856 13800 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:04.281647 13832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 1005) took 1469 ms. Trace:
I20260709 12:12:04.286562 19140 raft_consensus.cc:3055] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:04.287335 13652 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:04.288058 19317 raft_consensus.cc:2804] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:04.288664 19435 raft_consensus.cc:2804] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:04.298760 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:04.299188 13758 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 15.
W20260709 12:12:04.283372 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 93801us
I20260709 12:12:04.298264 13582 catalog_manager.cc:5697] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 11 to 13, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 13 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:04.245023 19183 leader_election.cc:290] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:04.307104 14415 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 15.
I20260709 12:12:04.312232 19428 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:04.272962 19416 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:04.316941 19416 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:04.300127 13832 rpcz_store.cc:276] 0709 12:12:02.812580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:03.239091 (+426511us) service_pool.cc:224] Handling call
0709 12:12:03.246518 (+  7427us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:03.265478 (+ 18960us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:03.265524 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:03.366482 (+100958us) log.cc:844] Serialized 26 byte log entry
0709 12:12:03.730458 (+363976us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:03.730500 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:03.730577 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:04.281401 (+550824us) raft_consensus.cc:1685] finished
0709 12:12:04.281425 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:04.281584 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13879,"raft.queue_time_us":19919,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":25211,"thread_start_us":319651,"threads_started":1,"wal-append.queue_time_us":454368}
I20260709 12:12:04.302807 19140 raft_consensus.cc:740] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:04.306365 19317 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:04.309103 19440 consensus_queue.cc:1059] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:12:04.324062 19317 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:04.324488 19440 raft_consensus.cc:3055] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:04.324955 19440 raft_consensus.cc:740] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:04.326064 19440 consensus_queue.cc:260] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:04.326480 19140 consensus_queue.cc:260] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:04.327559 19440 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:04.328007 19140 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:04.311785 19448 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:04.330473 19448 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:04.333231 19448 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:04.314608 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:12:04.334231 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 47033.7us
I20260709 12:12:04.284999 19166 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:04.315874 19435 raft_consensus.cc:697] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 14 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:04.336406 19435 consensus_queue.cc:237] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:04.316036 19183 raft_consensus.cc:2749] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:04.270469 19198 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:12:04.323487 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:04.333699 19447 raft_consensus.cc:3055] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:04.323803 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:04.347357 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:04.347491 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:04.348239 13756 raft_consensus.cc:2393] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 16: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:04.348096 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:04.348284 13762 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 14.
I20260709 12:12:04.349077 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:04.349229 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:04.349768 13760 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 14.
W20260709 12:12:04.350509 19437 log.cc:927] Time spent T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 12:12:04.351514 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:04.354346 19442 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:04.355770 19441 log.cc:927] Time spent T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.076s	user 0.000s	sys 0.002s
I20260709 12:12:04.356958 13651 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:04.313017 19439 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:04.358812 13651 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:04.359750 13651 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:04.360520 19439 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:04.360621 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 79832.7us
I20260709 12:12:04.361304 19439 raft_consensus.cc:2804] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:04.361941 19183 consensus_queue.cc:1048] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:04.338289 19029 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:04.348742 13830 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 16.
W20260709 12:12:04.353585 19432 log.cc:927] Time spent T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 12:12:04.366158 19428 raft_consensus.cc:2804] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:04.366917 19428 raft_consensus.cc:697] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 17 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:04.302966 19367 raft_consensus.cc:2804] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:04.365990 19447 raft_consensus.cc:740] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:04.374431 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:04.387887 19100 consensus_queue.cc:1059] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:04.389103 19448 raft_consensus.cc:2804] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:04.389876 19448 raft_consensus.cc:697] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 18 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:04.390947 19448 consensus_queue.cc:237] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:04.394057 13754 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 15.
I20260709 12:12:04.394254 13652 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:04.394559 19447 consensus_queue.cc:260] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:04.395984 19447 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:04.396430 13652 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:04.398015 19183 raft_consensus.cc:2749] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:04.398881 19183 raft_consensus.cc:2749] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:04.410544 13800 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:04.412668 19415 raft_consensus.cc:2804] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:04.413118 19415 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:04.414077 19373 raft_consensus.cc:3055] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:04.414561 19373 raft_consensus.cc:740] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:04.414754 19100 consensus_queue.cc:1048] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:12:04.381078 13763 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 16.
I20260709 12:12:04.416599 13758 raft_consensus.cc:1240] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 14. Current term is 15. Ops: []
W20260709 12:12:04.417618 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 322172us
I20260709 12:12:04.418419 13727 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:04.420270 13757 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 16.
W20260709 12:12:04.422627 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:04.413492 19415 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:04.322865 19393 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:04.370744 19439 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:04.431020 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:12:04.434235 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:04.434154 13681 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:04.416026 19019 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:04.368163 19428 consensus_queue.cc:237] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:04.438738 13652 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:04.415642 19373 consensus_queue.cc:260] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:04.445453 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:04.446645 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:04.450565 13681 raft_consensus.cc:2468] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 16.
I20260709 12:12:04.450695 19373 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:04.446180 13688 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 13.
I20260709 12:12:04.454386 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:04.455086 13685 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 14.
I20260709 12:12:04.429713 19421 consensus_queue.cc:1048] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 12:12:04.447245 13679 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 15.
I20260709 12:12:04.448825 13800 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:04.426069 19342 raft_consensus.cc:2804] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:04.427685 19367 raft_consensus.cc:697] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 17 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:04.432925 19183 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:04.474071 13800 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:04.478519 13727 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:04.438737 19439 raft_consensus.cc:3060] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:04.479730 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 48745.2us
I20260709 12:12:04.482474 13800 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:04.482805 13652 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:04.490479 19367 consensus_queue.cc:237] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:04.472946 19342 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:04.494133 19342 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:04.457734 19425 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:04.494810 13652 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:04.495891 19330 raft_consensus.cc:2749] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:04.496356 19425 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:04.496587 19330 raft_consensus.cc:2764] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 12:12:04.497643 13652 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:04.479951 19322 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:04.498541 19450 raft_consensus.cc:2804] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:04.479794 19029 consensus_queue.cc:1059] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:12:04.499220 19450 raft_consensus.cc:697] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 16 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:04.499471 19029 raft_consensus.cc:3055] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:04.499955 19029 raft_consensus.cc:740] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:04.500329 19450 consensus_queue.cc:237] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:04.477932 19100 raft_consensus.cc:2804] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:04.502102 19100 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:04.502485 19100 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:04.505905 19183 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:04.445461 19317 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:04.462889 13758 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:12:04.512362 13758 raft_consensus.cc:606] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:04.512777 13758 raft_consensus.cc:614] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:12:04.515153 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 155506us
I20260709 12:12:04.515949 13651 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:04.516222 13759 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "56d28ac895464968890083dea150a58d"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:12:04.516942 13759 raft_consensus.cc:606] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:04.517333 13759 raft_consensus.cc:614] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:04.517517 19195 raft_consensus.cc:2764] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:12:04.432194 19416 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:04.518060 13652 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:04.518635 19452 consensus_queue.cc:1048] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:04.520418 19416 leader_election.cc:290] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:04.520537 19452 raft_consensus.cc:2749] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:04.517239 19330 raft_consensus.cc:2804] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:04.479807 19393 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:04.520718 14380 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:04.500931 19029 consensus_queue.cc:260] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:04.533095 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 54648us
I20260709 12:12:04.517359 13651 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:12:04.542486 14380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:04.538755 13651 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:04.551458 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:04.553261 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:04.554355 13757 raft_consensus.cc:2410] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:12:04.558569 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:04.559736 13754 raft_consensus.cc:2410] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 16 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:12:04.478417 19440 raft_consensus.cc:2804] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:04.565698 13834 raft_consensus.cc:1275] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:12:04.568931 19198 raft_consensus.cc:2804] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:04.581034 13679 raft_consensus.cc:1275] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:12:04.582506 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:04.579209 13652 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:04.587757 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:04.589514 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:04.590909 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:04.592298 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:04.593055 13759 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 15.
I20260709 12:12:04.540123 19322 raft_consensus.cc:2804] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:04.599753 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:04.523509 19330 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:04.601397 13681 raft_consensus.cc:1240] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:04.602020 13755 raft_consensus.cc:1240] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 12:12:04.590366 13756 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 14.
I20260709 12:12:04.591702 13761 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 14.
I20260709 12:12:04.570786 19442 raft_consensus.cc:2749] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:12:04.607627 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 125219us
I20260709 12:12:04.608711 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:04.619249 13758 raft_consensus.cc:2393] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 14: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:04.566464 19357 raft_consensus.cc:2804] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:04.610191 13762 raft_consensus.cc:2393] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 13: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:04.611696 13679 raft_consensus.cc:1240] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:04.626230 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:04.563875 19317 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:04.573856 19425 raft_consensus.cc:2804] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:12:04.537271 19415 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:04.638186 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:04.641700 13681 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:04.638950 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:04.639559 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:04.585635 19183 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:04.634253 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:04.656024 13831 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 14.
I20260709 12:12:04.657341 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:04.612893 19330 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:04.643184 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:04.644181 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:04.649915 13726 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:04.612149 19431 consensus_queue.cc:1048] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 12:12:04.654044 19454 raft_consensus.cc:2749] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:04.600714 19198 raft_consensus.cc:697] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 15 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:04.643108 13756 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 14.
I20260709 12:12:04.659327 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:12:04.659879 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 196304us
I20260709 12:12:04.659850 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:04.600181 19322 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:04.683467 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:04.594254 19416 consensus_queue.cc:1059] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 12:12:04.683531 13727 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:04.662781 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:04.663143 13681 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 13.
I20260709 12:12:04.664177 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:04.703576 13833 raft_consensus.cc:2410] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:12:04.665068 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:04.628376 19029 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:04.658953 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:04.709523 13829 raft_consensus.cc:2393] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 18: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:04.709729 13837 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 11.
I20260709 12:12:04.710182 13834 raft_consensus.cc:2368] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 18. Current term is 19.
I20260709 12:12:04.669871 14414 raft_consensus.cc:1240] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 16 LEADER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:04.666266 13679 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 15.
I20260709 12:12:04.669548 13762 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "b98d2519bb504dc6905ed2ede4571835"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:12:04.711273 13762 raft_consensus.cc:606] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Received request to transfer leadership to TS b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:04.711704 13762 raft_consensus.cc:614] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:04.632279 19357 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:04.667793 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:04.715975 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:04.670148 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:04.572268 19452 consensus_queue.cc:1048] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.065s
I20260709 12:12:04.680692 13836 raft_consensus.cc:2376] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 17. Re-sending same reply.
I20260709 12:12:04.639988 19425 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:04.706125 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:12:04.717398 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 53972.2us
I20260709 12:12:04.721410 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:04.740451 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:04.686087 19322 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:04.686218 19166 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:04.772876 14412 raft_consensus.cc:1275] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:12:04.666044 19183 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:04.727325 19357 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:04.728451 13831 raft_consensus.cc:2393] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 16: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:12:04.769853 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:04.795635 13833 raft_consensus.cc:2393] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 14: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:04.768841 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:12:04.769088 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 119319us
I20260709 12:12:04.796777 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:04.797425 14407 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:04.792260 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:04.767789 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:04.768311 13830 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:04.799469 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:04.802953 13831 raft_consensus.cc:1240] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:12:04.641121 19435 raft_consensus.cc:2749] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:04.788595 13834 raft_consensus.cc:1240] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 12:12:04.739665 19425 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:12:04.792816 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:04.767079 19446 raft_consensus.cc:2749] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:04.771384 19440 raft_consensus.cc:697] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 15 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:04.809186 13687 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:04.810141 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 231055us
I20260709 12:12:04.827505 13836 raft_consensus.cc:1275] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:12:04.829154 13686 raft_consensus.cc:1240] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:12:04.805546 13582 catalog_manager.cc:5697] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 5 to 8, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 8 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:04.827291 13652 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:04.835186 19462 raft_consensus.cc:2749] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:04.814574 13830 raft_consensus.cc:2410] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:12:04.837191 13652 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:04.847828 13652 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:04.786357 19166 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:04.863976 19435 raft_consensus.cc:2749] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:04.873890 13757 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 14.
I20260709 12:12:04.841426 19384 consensus_queue.cc:1048] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 12:12:04.863730 19393 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:04.850485 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 167028us
W20260709 12:12:04.876329 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 83369.6us
I20260709 12:12:04.845149 19449 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:04.808199 19183 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:04.882640 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:04.886232 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:04.845386 19447 raft_consensus.cc:2804] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:04.898473 13681 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:04.890173 19448 raft_consensus.cc:2804] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:04.910600 13681 raft_consensus.cc:2410] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:12:04.911123 13652 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:04.915632 13652 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:04.916349 13686 raft_consensus.cc:1275] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 12:12:04.918511 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:04.920169 13759 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "b98d2519bb504dc6905ed2ede4571835"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:12:04.920810 13759 raft_consensus.cc:606] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 LEADER]: Received request to transfer leadership to TS b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:04.927325 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:04.908695 19415 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:04.914649 19448 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:04.885450 19449 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:04.929402 13652 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:04.878264 19198 consensus_queue.cc:237] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:04.918237 19139 consensus_queue.cc:1059] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
W20260709 12:12:04.950243 19464 log.cc:927] Time spent T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:12:04.950783 19166 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:04.951099 19463 raft_consensus.cc:2749] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 12:12:04.952448 19458 log.cc:927] Time spent T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
W20260709 12:12:04.954689 19461 log.cc:927] Time spent T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 12:12:04.933517 19448 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:04.970297 14407 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 17.
I20260709 12:12:04.987701 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:12:04.973977 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:04.914111 19440 consensus_queue.cc:237] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:05.011979 13652 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:05.015769 13681 raft_consensus.cc:2393] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 17: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:04.991209 19463 raft_consensus.cc:2804] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:04.950338 19139 raft_consensus.cc:3055] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:05.022300 19183 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:12:05.022835 19466 log.cc:927] Time spent T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:12:05.019148 19463 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:05.030494 19463 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:05.007118 19452 raft_consensus.cc:2804] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:04.981614 19342 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:05.043394 13684 raft_consensus.cc:1240] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:05.032892 19139 raft_consensus.cc:740] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:05.051489 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:05.051122 19183 raft_consensus.cc:2804] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:05.053598 19183 raft_consensus.cc:697] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 17 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:05.054857 19183 consensus_queue.cc:237] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:05.056826 13837 raft_consensus.cc:2410] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:12:05.059664 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:05.060547 13686 raft_consensus.cc:3060] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:05.066321 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 139695us
I20260709 12:12:05.066223 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:05.068011 13757 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 17.
I20260709 12:12:05.068190 14379 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:05.069515 13687 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 19.
I20260709 12:12:05.070495 13679 raft_consensus.cc:1240] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:05.072590 13759 raft_consensus.cc:1240] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:05.074623 13763 raft_consensus.cc:2393] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 12: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:05.074693 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:05.075774 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:05.076315 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:05.079509 13756 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 14.
I20260709 12:12:05.079840 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:05.080474 13754 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:05.074885 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:05.077930 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:05.082922 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:05.083797 13687 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 14.
I20260709 12:12:05.086400 14379 leader_election.cc:304] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:05.087270 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:12:05.087486 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 122552us
I20260709 12:12:05.087652 13836 raft_consensus.cc:1240] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:05.079759 13760 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 16.
I20260709 12:12:05.089171 13652 leader_election.cc:400] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 18. Current term is 19.
W20260709 12:12:05.066856 19294 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.012s	sys 0.010s
I20260709 12:12:05.091495 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:05.090283 13800 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:05.092239 13835 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 14.
I20260709 12:12:05.065364 19029 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:05.099233 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:12:05.091953 19294 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.012s	sys 0.010s
I20260709 12:12:05.075176 19470 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:05.102778 13800 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:05.091621 19421 raft_consensus.cc:2804] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:05.107553 13800 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:05.109254 13652 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:05.100545 19270 raft_consensus.cc:2804] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:05.118125 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:05.119102 13684 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 12.
I20260709 12:12:05.125586 13754 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 19.
I20260709 12:12:05.127347 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:05.127270 13800 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:05.114406 19415 raft_consensus.cc:2804] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:05.123328 19270 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:05.123657 19439 consensus_meta.cc:287] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.605s	user 0.012s	sys 0.004s
I20260709 12:12:05.103832 19029 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:05.146047 13754 raft_consensus.cc:1275] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:12:05.149832 19477 raft_consensus.cc:2804] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:05.150406 19477 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:05.150780 19477 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:05.124876 19462 raft_consensus.cc:2749] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:05.114688 19449 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:05.118675 19442 raft_consensus.cc:2804] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:05.113164 19421 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:05.152536 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:12:05.155691 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 46540.3us
I20260709 12:12:05.162804 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:05.144760 19415 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:05.153163 19270 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:05.146656 19481 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:05.152911 19198 raft_consensus.cc:2804] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:05.162915 19442 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:05.165398 13652 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:05.167342 19342 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:05.174959 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 56986.5us
I20260709 12:12:05.167838 19421 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:05.115545 19470 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:05.171285 19415 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:05.155161 19439 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:05.149871 19471 consensus_queue.cc:1059] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
W20260709 12:12:05.192092 19330 consensus_meta.cc:287] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.512s	user 0.007s	sys 0.003s
I20260709 12:12:05.178542 19481 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:05.192600 19330 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:05.177027 19442 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:05.175366 19473 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:05.198644 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:05.179584 19462 raft_consensus.cc:2804] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:12:05.200668 19469 log.cc:927] Time spent T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 12:12:05.199470 14379 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:05.201643 19473 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:05.206619 19450 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:05.204690 19322 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:05.205809 19462 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:05.252815 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 53414.7us
I20260709 12:12:05.249688 19481 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:05.197435 19357 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:05.250177 19294 raft_consensus.cc:2749] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:05.205480 19425 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:05.248172 19450 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:05.266076 19462 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:05.309614 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:05.310196 13688 raft_consensus.cc:2393] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 10: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:05.310519 13682 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 15.
I20260709 12:12:05.313396 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:05.314193 13682 raft_consensus.cc:2468] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 13.
I20260709 12:12:05.318089 13686 raft_consensus.cc:2468] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 14.
I20260709 12:12:05.302865 19471 consensus_queue.cc:1243] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer 3f37c9cc9dda46b4be21dd675ba78fb7 log is divergent from this leader: its last log entry 17.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:12:05.311076 19029 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:05.331219 19330 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:12:05.334164 19490 log.cc:927] Time spent T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 12:12:05.334674 19357 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 17 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:05.327728 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:05.339349 13686 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:05.335291 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:12:05.330854 19100 consensus_meta.cc:287] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.828s	user 0.012s	sys 0.002s
I20260709 12:12:05.363548 14379 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:05.371042 19357 raft_consensus.cc:2749] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:05.314448 19492 consensus_queue.cc:1048] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 12:12:05.373799 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:05.383162 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:05.388298 13686 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 16.
I20260709 12:12:05.362696 19342 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:12:05.387606 19491 log.cc:927] Time spent T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 12:12:05.372332 19322 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:05.372372 19439 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:05.404572 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:05.372810 19100 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:05.396972 19470 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:05.395401 19198 raft_consensus.cc:697] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 19 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
W20260709 12:12:05.419222 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 221753us
W20260709 12:12:05.421619 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 93774.5us
I20260709 12:12:05.422789 14379 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:05.428750 14379 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:05.400979 19342 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:05.430262 13828 raft_consensus.cc:2368] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 14. Current term is 15.
I20260709 12:12:05.412520 19425 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:05.429585 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:05.432542 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:05.434554 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:12:05.438194 13800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:05.438431 13757 raft_consensus.cc:2393] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 14: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:05.439278 19470 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:05.440099 19470 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:05.442152 19489 raft_consensus.cc:2749] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:05.443197 19342 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:05.443543 19198 consensus_queue.cc:237] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:05.448140 19495 log.cc:927] Time spent T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 12:12:05.450634 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:05.451119 19477 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:05.452142 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:05.452821 13686 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 14.
I20260709 12:12:05.452925 13680 raft_consensus.cc:1275] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:12:05.453737 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:12:05.455557 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:05.458177 19493 log.cc:927] Time spent T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:12:05.438671 13759 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 11.
I20260709 12:12:05.457928 13726 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:05.474270 13754 raft_consensus.cc:1240] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:05.463116 14379 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:05.426983 19473 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:05.456632 19472 consensus_queue.cc:1048] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:05.483198 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:05.484300 13726 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:05.437673 19294 raft_consensus.cc:2804] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:05.479030 14379 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:05.488330 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:05.489511 13652 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:05.458695 19322 consensus_queue.cc:1059] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:12:05.482702 19488 raft_consensus.cc:2804] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:05.535027 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:12:05.539527 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 50108.7us
I20260709 12:12:05.535167 13651 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:05.546516 13651 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:05.497980 13757 raft_consensus.cc:1275] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:12:05.482393 19425 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:05.548098 19498 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:05.549230 19499 raft_consensus.cc:2804] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:05.552950 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:05.555673 19477 leader_election.cc:290] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:05.568492 19425 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:05.558893 19470 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:12:05.566944 19463 consensus_meta.cc:287] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.536s	user 0.007s	sys 0.006s
W20260709 12:12:05.558022 19503 log.cc:927] Time spent T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 12:12:05.477052 19449 consensus_queue.cc:1059] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 12:12:05.488332 19474 raft_consensus.cc:2804] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:05.487335 19450 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:05.485684 19294 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:05.573024 13754 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 14.
I20260709 12:12:05.593608 13754 raft_consensus.cc:1275] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:12:05.490469 19166 raft_consensus.cc:2804] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:05.535777 19473 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:05.577723 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 138794us
I20260709 12:12:05.549234 19330 raft_consensus.cc:2749] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:05.553751 19183 raft_consensus.cc:2749] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:05.602837 19420 raft_consensus.cc:3055] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:05.603402 19420 raft_consensus.cc:740] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:05.603935 19474 raft_consensus.cc:697] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:05.604377 19420 consensus_queue.cc:260] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:05.605027 19474 consensus_queue.cc:237] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:05.607334 19462 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:05.586217 13759 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 14.
I20260709 12:12:05.610081 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:05.610754 13757 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:05.597699 19166 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:05.590221 19425 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:05.617645 19166 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:05.612896 19420 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:05.618537 19100 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:05.572598 19499 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:05.622040 19499 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:05.602973 19473 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:05.623982 19448 consensus_meta.cc:287] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.613s	user 0.003s	sys 0.008s
I20260709 12:12:05.624481 19448 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:05.577178 19342 consensus_queue.cc:1059] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 12:12:05.625869 13687 raft_consensus.cc:2393] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 15: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:05.626382 19447 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:05.626955 19447 raft_consensus.cc:3060] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:05.593724 19488 raft_consensus.cc:697] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 16 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:05.628727 19488 consensus_queue.cc:237] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:05.625852 19473 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:05.593688 19294 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:05.629971 19462 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:05.632665 19442 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:05.636834 19448 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:05.638865 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:05.639575 13683 raft_consensus.cc:2376] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 18. Re-sending same reply.
W20260709 12:12:05.596792 13800 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.666s (SENT) [suppressed 10 similar messages]
W20260709 12:12:05.658533 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 61782.4us
I20260709 12:12:05.659247 13757 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 17.
I20260709 12:12:05.668042 13800 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
W20260709 12:12:05.671535 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 183768us
I20260709 12:12:05.672627 13726 leader_election.cc:304] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:05.601322 19270 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:05.673935 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:05.676517 13757 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 17.
I20260709 12:12:05.666878 19472 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:05.587306 19463 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:05.680819 13757 raft_consensus.cc:1240] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 12:12:05.681847 19504 raft_consensus.cc:2804] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:05.673475 19442 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:05.686480 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:05.688691 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:05.698305 13757 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:05.699558 13685 raft_consensus.cc:2393] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 12: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:05.698395 13755 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 14.
I20260709 12:12:05.701939 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:05.702553 13755 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:05.690491 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 144100us
I20260709 12:12:05.696076 19166 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:05.704962 13651 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:12:05.707913 19415 consensus_meta.cc:287] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.510s	user 0.014s	sys 0.000s
I20260709 12:12:05.712110 13757 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 15.
I20260709 12:12:05.713289 13755 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 15.
I20260709 12:12:05.716913 13651 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:05.726666 19512 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:05.727595 19027 raft_consensus.cc:3055] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:05.694355 19504 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:05.727301 19512 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:05.730599 13651 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:05.733322 13651 leader_election.cc:304] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:05.731909 19504 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:05.734834 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:05.735258 19100 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:05.735512 13835 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 14.
I20260709 12:12:05.735889 19100 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:05.738019 19450 raft_consensus.cc:2804] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:05.725472 19463 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:05.740898 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:05.741751 13830 raft_consensus.cc:2393] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 15: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:05.728220 19513 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:05.717366 19514 raft_consensus.cc:2804] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:05.728250 19027 raft_consensus.cc:740] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:05.742756 13835 raft_consensus.cc:1275] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:12:05.749327 13651 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:05.743742 19270 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:05.743983 19166 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:05.694588 19472 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:05.729538 19448 raft_consensus.cc:2749] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:05.753871 13800 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:05.766831 19198 raft_consensus.cc:2749] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:05.768637 19198 consensus_queue.cc:1048] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:12:05.770231 19384 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:05.770982 19384 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:05.771831 19139 consensus_queue.cc:260] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:05.773309 19139 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:05.775972 13800 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:05.776808 19198 raft_consensus.cc:2749] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:05.779470 13800 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:05.723582 19415 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:05.750547 19499 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:05.781567 19415 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:05.741628 19428 raft_consensus.cc:2804] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:05.782348 19428 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:05.782788 19428 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:05.783681 19499 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:05.753925 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:05.755183 13830 raft_consensus.cc:1275] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:12:05.784740 13835 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:05.738670 19450 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:05.785974 13836 raft_consensus.cc:1240] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:05.786064 19450 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:05.754804 19183 raft_consensus.cc:2804] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:05.790338 19335 raft_consensus.cc:3055] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:05.790799 19335 raft_consensus.cc:740] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:05.791694 19335 consensus_queue.cc:260] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:05.738657 19100 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:05.751183 19439 consensus_queue.cc:1059] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 12:12:05.794723 13763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48114 (request call id 2888) took 1243 ms. Trace:
I20260709 12:12:05.795331 19428 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:05.795169 13763 rpcz_store.cc:276] 0709 12:12:04.551744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:04.551895 (+   151us) service_pool.cc:224] Handling call
0709 12:12:05.794461 (+1242566us) spinlock_profiling.cc:243] Waited 486 ms on lock 0x7b54000a14d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:05.794629 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1117232000}
I20260709 12:12:05.759728 19512 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199)
I20260709 12:12:05.803128 19183 raft_consensus.cc:697] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 14 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:05.803589 19452 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:05.804157 19452 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:05.804064 19439 consensus_queue.cc:1059] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:05.805239 19439 raft_consensus.cc:3055] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:05.805584 19439 raft_consensus.cc:740] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:05.805902 19384 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:05.792948 19447 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:05.806815 19448 raft_consensus.cc:3055] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:05.806483 19439 consensus_queue.cc:260] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:05.807202 19448 raft_consensus.cc:740] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:05.807839 19439 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:05.763029 19514 raft_consensus.cc:697] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:05.807996 19447 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:05.809013 19514 consensus_queue.cc:237] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:05.811005 19027 consensus_queue.cc:260] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:05.812134 19027 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:05.815798 13833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 2780) took 1164 ms. Trace:
I20260709 12:12:05.812945 19513 raft_consensus.cc:2749] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:05.820655 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:05.813956 13835 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 12.
I20260709 12:12:05.822652 13651 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:05.825289 13651 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:05.769326 19504 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:05.827539 19425 raft_consensus.cc:2804] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:05.828014 19425 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:05.828261 13834 raft_consensus.cc:2393] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 12: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:05.828429 19425 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:05.829137 19504 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:05.830300 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:05.832130 19462 raft_consensus.cc:2804] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:05.832665 19462 raft_consensus.cc:697] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 14 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:05.833551 19462 consensus_queue.cc:237] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:05.837160 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:05.838687 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:05.839341 13679 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 17.
I20260709 12:12:05.840969 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:12:05.843079 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:05.843541 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:05.849121 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:05.849471 14415 raft_consensus.cc:1275] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:12:05.849921 13835 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:05.850390 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:12:05.821712 19421 consensus_meta.cc:287] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.620s	user 0.012s	sys 0.002s
I20260709 12:12:05.816529 19492 raft_consensus.cc:2804] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:05.854655 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:05.861690 13679 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 15.
I20260709 12:12:05.861747 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:05.855851 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:05.856484 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:05.856894 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:05.864006 13836 raft_consensus.cc:2393] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 12: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:05.864169 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:05.857240 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:05.864795 14412 raft_consensus.cc:3060] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:05.865159 14407 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 18.
I20260709 12:12:05.864816 13686 raft_consensus.cc:2393] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 15: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:05.857499 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:05.856608 19471 raft_consensus.cc:2955] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 15 LEADER]: Committing config change with OpId 13.10: config changed from index 8 to 10, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:12:05.867498 13758 raft_consensus.cc:2393] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 15: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:05.863272 13763 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 18.
I20260709 12:12:05.858491 19183 consensus_queue.cc:237] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:05.859107 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:05.859386 19166 consensus_queue.cc:1048] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:05.853585 13800 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:05.848520 19342 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:05.875813 19342 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:05.879397 13685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2963) took 1283 ms. Trace:
I20260709 12:12:05.879789 19474 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:05.880620 19415 raft_consensus.cc:2804] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:05.880373 19474 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:05.880947 13727 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:05.881214 19415 raft_consensus.cc:697] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 16 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:05.882205 19415 consensus_queue.cc:237] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:05.882575 13727 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:05.879842 13685 rpcz_store.cc:276] 0709 12:12:04.596266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:04.606419 (+ 10153us) service_pool.cc:224] Handling call
0709 12:12:04.987485 (+381066us) spinlock_profiling.cc:243] Waited 2.39 ms on lock 0x7b5800002798. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924e68b71 00007fa924e68a22 00007fa92dd818d9 00007fa92cedbee0 00007fa92cfa50ab 00007fa92cfa5131 00007fa92cf530a0 00007fa92cf52984 00007fa9264cd6d4 00007fa9264cd662
0709 12:12:05.879159 (+891674us) spinlock_profiling.cc:243] Waited 711 ms on lock 0x7b5400040bd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:05.879304 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1640271872}
I20260709 12:12:05.883968 19449 raft_consensus.cc:2749] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:05.884835 19449 consensus_queue.cc:1048] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:05.885473 19510 raft_consensus.cc:2804] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:05.886053 19510 raft_consensus.cc:697] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:05.886934 19510 consensus_queue.cc:237] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:05.890482 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:05.893472 19474 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:05.894953 13756 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca94d8f3109143599733e3a684149726"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:12:05.895958 13756 raft_consensus.cc:606] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:05.896497 13756 raft_consensus.cc:614] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:05.897464 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:05.898386 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:12:05.898506 13828 raft_consensus.cc:2410] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:12:05.899531 19481 raft_consensus.cc:3055] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:05.899632 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:05.900015 19481 raft_consensus.cc:740] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:05.900434 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:05.901085 13760 raft_consensus.cc:1275] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:12:05.900380 13832 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 17.
W20260709 12:12:05.902360 13688 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 2964) took 1305 ms (client timeout 1577 ms). Trace:
I20260709 12:12:05.902483 19492 raft_consensus.cc:697] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 14 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
W20260709 12:12:05.902794 13688 rpcz_store.cc:269] 0709 12:12:04.596585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:04.596731 (+   146us) service_pool.cc:224] Handling call
0709 12:12:05.902161 (+1305430us) spinlock_profiling.cc:243] Waited 670 ms on lock 0x7b540021eb54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:05.902300 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1540974336}
I20260709 12:12:05.901181 19481 consensus_queue.cc:260] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:05.903591 19492 consensus_queue.cc:237] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:05.904651 13684 raft_consensus.cc:2393] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 16: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:05.906527 13687 raft_consensus.cc:1240] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 9. Current term is 10. Ops: []
I20260709 12:12:05.920624 13800 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:05.923826 13651 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:05.926916 14412 raft_consensus.cc:2468] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 13.
I20260709 12:12:05.928830 13727 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:05.939317 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:12:05.898559 19518 log.cc:927] Time spent T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.164s	user 0.003s	sys 0.000s
I20260709 12:12:05.904688 19481 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:05.949097 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:05.949126 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:05.951622 13832 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 18.
I20260709 12:12:05.816529 19452 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:05.855391 19472 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:05.954036 13762 raft_consensus.cc:2393] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 12: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:05.953150 19322 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:05.808060 19448 consensus_queue.cc:260] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:05.962105 13835 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 13.
I20260709 12:12:05.950899 13800 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:05.837018 19454 consensus_queue.cc:1048] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.110s
I20260709 12:12:05.941275 19435 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:05.967941 13727 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:05.905815 19421 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:05.954034 19270 raft_consensus.cc:2749] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:05.983865 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:05.983544 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:05.987721 13800 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:05.941533 19330 consensus_queue.cc:1048] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:12:05.942054 19166 consensus_queue.cc:1048] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 12:12:05.989584 13761 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:05.989702 13835 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 14.
I20260709 12:12:05.968739 19322 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:05.993690 13800 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:05.975610 19435 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:05.983271 19198 raft_consensus.cc:2804] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:05.983484 19342 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:06.008608 19435 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:06.012494 19470 raft_consensus.cc:3055] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:06.015053 19452 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:06.016240 13835 raft_consensus.cc:1275] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:12:06.019042 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:06.069763 13762 raft_consensus.cc:2393] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 14: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:06.020054 19294 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:05.816852 13833 rpcz_store.cc:276] 0709 12:12:04.651464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:04.802474 (+151010us) service_pool.cc:224] Handling call
0709 12:12:04.837079 (+ 34605us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:04.837314 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:12:04.861199 (+ 23885us) log.cc:844] Serialized 14 byte log entry
0709 12:12:05.681934 (+820735us) spinlock_profiling.cc:243] Waited 8.27 ms on lock 0x7b1800416560. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e82e07 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9fc02 00007fa927b2720b 00007fa927b2cd23 00007fa927b2d23a 00007fa927f97a2a
0709 12:12:05.814041 (+132107us) log.cc:844] Serialized 14 byte log entry
0709 12:12:05.815049 (+  1008us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:05.815121 (+    72us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:05.815174 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:05.815544 (+   370us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:05.815704 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":23876,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":980,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":5974,"spinlock_wait_cycles":21535872,"thread_start_us":131587,"threads_started":2}
I20260709 12:12:05.998210 19473 raft_consensus.cc:2804] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:05.984122 19504 consensus_queue.cc:1048] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 12:12:06.033247 19270 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:05.984380 19472 raft_consensus.cc:2804] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:06.097944 19472 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:06.098413 19472 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:06.100900 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:06.040431 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:06.104894 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:06.050335 13686 raft_consensus.cc:1240] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 12:12:06.106192 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:06.042939 13727 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
W20260709 12:12:06.107404 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 64595.9us
I20260709 12:12:06.108341 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:06.109086 19474 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:06.109652 19474 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:06.110018 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:06.110200 19474 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:06.110595 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:06.110872 14416 raft_consensus.cc:2410] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:12:06.111213 13685 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 10.
I20260709 12:12:06.111665 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:06.112779 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:06.113405 14416 raft_consensus.cc:2368] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 14. Current term is 15.
I20260709 12:12:06.114280 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:06.115861 14413 raft_consensus.cc:1240] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
W20260709 12:12:06.116427 19527 log.cc:927] Time spent T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 12:12:06.077107 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:06.057396 19198 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:06.119917 19198 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:06.125123 14415 raft_consensus.cc:1240] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:06.080405 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:06.004700 19322 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:06.141417 14413 raft_consensus.cc:1240] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 16. Current term is 17. Ops: [15.12-16.13]
I20260709 12:12:06.086210 13683 raft_consensus.cc:1240] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:12:06.086967 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:06.142954 13680 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:06.077028 19473 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:06.092046 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:06.092803 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:06.093226 19421 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:06.094115 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:06.148002 13828 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:06.072564 19428 leader_election.cc:290] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:06.095314 13833 raft_consensus.cc:1275] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:12:06.074707 19342 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:06.141068 19499 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:06.157979 19342 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:06.158479 19499 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:06.159972 14414 raft_consensus.cc:1275] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:12:06.160466 19342 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:06.106663 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:06.108279 13727 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:12:06.161831 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 53675us
I20260709 12:12:06.162088 13686 raft_consensus.cc:1240] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:06.162837 13727 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:06.075233 19470 raft_consensus.cc:740] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:06.166165 19470 consensus_queue.cc:260] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:06.167392 19294 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:06.175508 19473 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:05.994660 19448 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:06.114315 13687 raft_consensus.cc:1240] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:06.148025 13761 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 15.
I20260709 12:12:06.087802 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:06.109606 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:06.144966 14415 raft_consensus.cc:1240] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:06.090517 19488 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:06.145953 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:06.149679 14411 raft_consensus.cc:2393] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 15: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:12:06.150774 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:06.154464 19512 consensus_queue.cc:1048] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:06.156038 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:06.184137 13754 raft_consensus.cc:1275] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:12:06.184859 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:06.188335 13684 raft_consensus.cc:2393] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 12: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:06.189709 13651 leader_election.cc:304] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:06.191522 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:06.194247 13688 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 14.
I20260709 12:12:06.199965 13834 raft_consensus.cc:2410] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 20 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 12:12:06.209860 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:06.210582 14408 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 18.
I20260709 12:12:06.212451 13829 raft_consensus.cc:1240] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:06.216967 13837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54830 (request call id 2778) took 1559 ms. Trace:
W20260709 12:12:06.218374 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:06.217417 13837 rpcz_store.cc:276] 0709 12:12:04.637262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:04.711923 (+ 74661us) service_pool.cc:224] Handling call
0709 12:12:06.196363 (+1484440us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b54002a6a54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:06.196526 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":591439232}
I20260709 12:12:06.224835 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:06.230247 19474 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:06.231148 19470 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:06.233182 19474 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:06.236016 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:06.239956 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:06.195998 19166 raft_consensus.cc:2804] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:06.197674 19417 raft_consensus.cc:2804] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:06.246677 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:06.237964 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:06.198572 19499 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:06.218582 19463 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:06.217422 19498 raft_consensus.cc:2804] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:12:06.249954 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 191662us
I20260709 12:12:06.192945 19431 consensus_queue.cc:1048] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 12:12:06.252621 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:06.251451 14416 raft_consensus.cc:2393] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 16: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:12:06.264595 13726 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:06.258702 13652 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:12:06.260089 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:06.269452 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:06.270329 14415 raft_consensus.cc:2393] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 15: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:12:06.265841 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:06.266424 14379 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:06.189690 19450 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:06.282186 13754 raft_consensus.cc:2393] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 15: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:06.331372 13829 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:06.214759 19488 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:06.342844 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 84207.7us
I20260709 12:12:06.235445 19454 consensus_queue.cc:1048] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 12:12:06.347584 13756 raft_consensus.cc:1275] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:12:06.250656 19417 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:06.349987 19499 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:12:06.349939 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 83604us
W20260709 12:12:06.351647 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 358014us
I20260709 12:12:06.349812 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:06.363581 13828 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 17.
W20260709 12:12:06.344421 13652 leader_election.cc:336] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Timed out: RequestConsensusVote RPC to 127.12.56.196:46341 timed out after 1.822s (SENT)
I20260709 12:12:06.364711 13652 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:06.256670 19234 consensus_queue.cc:1059] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.094s
I20260709 12:12:06.269659 19166 raft_consensus.cc:697] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:06.383579 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:06.277060 19498 raft_consensus.cc:697] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 15 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:06.250298 19481 consensus_queue.cc:1059] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.101s
I20260709 12:12:06.379397 14409 raft_consensus.cc:2468] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 14.
I20260709 12:12:06.264632 19463 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:06.381603 19499 raft_consensus.cc:697] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 18 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
W20260709 12:12:06.363101 19425 consensus_meta.cc:287] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.534s	user 0.012s	sys 0.000s
I20260709 12:12:06.407507 19499 consensus_queue.cc:237] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:06.408427 19425 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:06.342741 19459 raft_consensus.cc:2749] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:06.415241 19498 consensus_queue.cc:237] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:06.388139 19511 consensus_queue.cc:1059] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:12:06.419057 19511 raft_consensus.cc:3055] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:12:06.419503 19511 raft_consensus.cc:740] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:06.420536 19511 consensus_queue.cc:260] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:06.392382 19216 consensus_queue.cc:1048] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
W20260709 12:12:06.420550 19439 consensus_meta.cc:287] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.612s	user 0.012s	sys 0.000s
I20260709 12:12:06.343097 19373 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:06.430792 19367 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:06.430761 19373 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:06.381112 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:06.346920 19342 raft_consensus.cc:2804] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:06.366230 13760 raft_consensus.cc:2393] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 13: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:06.351300 19417 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:06.387185 13652 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:06.367823 19100 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:06.401513 13829 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 19.
I20260709 12:12:06.386545 19452 raft_consensus.cc:2749] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:06.402766 19166 consensus_queue.cc:237] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:06.405148 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:06.434752 19342 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:06.453344 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 66267.7us
I20260709 12:12:06.454056 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:06.474534 13760 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 15.
I20260709 12:12:06.462507 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:06.475471 13755 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:06.475911 13756 raft_consensus.cc:1275] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:12:06.466259 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:06.479012 13754 raft_consensus.cc:1240] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:06.480219 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:06.462428 19330 raft_consensus.cc:2749] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:06.481074 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:06.482230 19442 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:06.482803 19442 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:06.485049 19442 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:06.480255 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:06.485926 19488 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:06.486244 13757 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:06.452787 19367 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:06.488540 19367 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:06.489943 19511 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:12:06.481323 13800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:06.490551 19198 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:06.491129 13800 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:06.492712 19198 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:06.492996 13800 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:06.493345 19198 raft_consensus.cc:2804] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:06.493999 19425 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:06.494336 19450 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:06.485091 19463 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:06.494940 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:06.495299 13800 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:06.497067 13800 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:06.499862 19435 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:06.501116 13681 raft_consensus.cc:2393] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 19: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:06.503959 13652 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:06.511408 13652 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:12:06.493023 19027 consensus_meta.cc:287] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.680s	user 0.013s	sys 0.004s
I20260709 12:12:06.485644 19442 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:06.528292 13755 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 15.
I20260709 12:12:06.530457 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:06.534178 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:06.497483 19322 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:06.536777 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:06.547091 13759 raft_consensus.cc:1275] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:12:06.551100 13652 leader_election.cc:400] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 election: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 14. Current term is 15.
I20260709 12:12:06.551673 19183 raft_consensus.cc:2749] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:06.536599 13760 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 15.
I20260709 12:12:06.519976 19481 raft_consensus.cc:2804] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:06.542958 13757 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 18.
I20260709 12:12:06.628230 13680 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 16.
I20260709 12:12:06.616808 14380 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:06.513418 19198 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:06.640036 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:06.642614 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:06.596766 19451 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:06.599232 19335 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:06.580603 19270 raft_consensus.cc:2749] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:06.476986 19100 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:06.555559 19373 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:12:06.612541 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 61630.7us
I20260709 12:12:06.520081 19450 raft_consensus.cc:2749] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:06.556324 19425 consensus_queue.cc:1059] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
W20260709 12:12:06.609230 19139 consensus_meta.cc:287] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.835s	user 0.005s	sys 0.009s
I20260709 12:12:06.610169 19442 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:06.598387 19384 raft_consensus.cc:3055] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:06.503364 19342 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:06.518015 13754 raft_consensus.cc:1275] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:12:06.653842 13679 raft_consensus.cc:1275] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:12:06.607581 19538 raft_consensus.cc:2804] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:06.635816 19435 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:06.638705 19294 raft_consensus.cc:2804] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:06.639653 19198 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:06.633317 19322 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:06.660818 13652 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:12:06.659461 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 280628us
I20260709 12:12:06.672545 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:06.675357 13835 raft_consensus.cc:1240] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:06.585721 19472 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:06.685320 13684 raft_consensus.cc:2393] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 16: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:06.634886 19417 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:06.657438 19514 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:06.658716 19510 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:06.637550 19473 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:06.678642 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 409085us
I20260709 12:12:06.693456 13652 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:12:06.702025 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:06.676911 19384 raft_consensus.cc:740] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:06.723248 14412 raft_consensus.cc:1275] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:12:06.711503 14379 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:06.714758 13761 raft_consensus.cc:1240] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:06.650622 19451 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:06.704178 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 206032us
I20260709 12:12:06.684152 19538 raft_consensus.cc:697] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 15 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:06.720607 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:06.721964 13836 raft_consensus.cc:1240] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:06.685346 19294 raft_consensus.cc:697] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 17 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:06.722555 13727 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:06.726052 14379 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:12:06.731367 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:06.712581 19425 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:12:06.702814 19435 raft_consensus.cc:2749] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:06.742655 14379 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
W20260709 12:12:06.743597 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:06.761456 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:06.762684 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:06.763358 13755 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:06.767071 13754 raft_consensus.cc:1240] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:06.753682 13727 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:06.732856 19421 raft_consensus.cc:2749] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:06.775991 13682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1970) took 1463 ms. Trace:
I20260709 12:12:06.770829 14379 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:06.710218 19510 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:06.703058 19514 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:06.716866 19488 consensus_queue.cc:1048] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 12:12:06.779690 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:06.776762 13682 rpcz_store.cc:276] 0709 12:12:05.303310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:05.324784 (+ 21474us) service_pool.cc:224] Handling call
0709 12:12:05.330901 (+  6117us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:05.795954 (+465053us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:12:05.796262 (+   308us) log.cc:844] Serialized 14 byte log entry
0709 12:12:05.983719 (+187457us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:05.983776 (+    57us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:05.983827 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:06.766777 (+782950us) spinlock_profiling.cc:243] Waited 465 ms on lock 0x7b5400245ed4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:06.766827 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:06.766973 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4320,"prepare.queue_time_us":6126,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":3490,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":4226,"spinlock_wait_cycles":1068993792,"thread_start_us":187065,"threads_started":1,"wal-append.queue_time_us":347725}
I20260709 12:12:06.787460 13727 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:06.788187 13759 raft_consensus.cc:1240] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 12:12:06.753376 19234 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:06.793581 13754 raft_consensus.cc:2393] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 19: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:06.787405 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:06.796816 13756 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 14.
I20260709 12:12:06.795344 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:06.803139 13755 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 15.
I20260709 12:12:06.805048 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:06.806739 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:06.807564 13681 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 19.
I20260709 12:12:06.775424 19425 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:06.811794 13757 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:06.812152 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:06.812951 13686 raft_consensus.cc:2368] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 14. Current term is 15.
I20260709 12:12:06.813769 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:06.808957 13763 raft_consensus.cc:1240] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:06.772815 19447 raft_consensus.cc:2804] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:06.802030 13684 raft_consensus.cc:2468] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 14.
I20260709 12:12:06.810999 13688 raft_consensus.cc:2410] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 12:12:06.773272 19270 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:06.815759 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:06.816587 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:06.817914 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:06.819639 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:06.839454 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:06.793650 19470 raft_consensus.cc:2749] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:06.842549 13679 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 15.
I20260709 12:12:06.838955 13682 raft_consensus.cc:1240] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:06.838093 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:12:06.848738 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 114712us
I20260709 12:12:06.849138 13757 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 15.
I20260709 12:12:06.852082 14379 leader_election.cc:304] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:06.853615 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
W20260709 12:12:06.855943 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 68541.4us
I20260709 12:12:06.859630 13683 raft_consensus.cc:1240] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 15. Current term is 16. Ops: [12.7-15.8]
W20260709 12:12:06.865839 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 159020us
I20260709 12:12:06.795548 19548 raft_consensus.cc:2804] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:06.811808 19421 raft_consensus.cc:2804] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:06.794575 19512 consensus_queue.cc:1048] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.063s
I20260709 12:12:06.838442 13688 raft_consensus.cc:2955] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 8 to 10, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:12:06.785375 19546 consensus_queue.cc:1059] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.093s
I20260709 12:12:06.837507 19481 raft_consensus.cc:697] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 15 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
W20260709 12:12:06.870508 19542 log.cc:927] Time spent T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 12:12:06.821156 19435 consensus_queue.cc:1059] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 12:12:06.819000 19439 consensus_queue.cc:1059] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 12:12:06.905529 19439 raft_consensus.cc:3055] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:06.829210 19425 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:06.905992 19439 raft_consensus.cc:740] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:06.906966 19439 consensus_queue.cc:260] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:06.907780 19425 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:06.908306 19439 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:06.912545 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:12:06.891911 13726 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.006s	sys 0.011s
I20260709 12:12:06.896255 13761 raft_consensus.cc:1275] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 12:12:06.918195 13726 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.007s	sys 0.011s
I20260709 12:12:06.918704 13687 raft_consensus.cc:2393] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 17: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:06.897372 19421 raft_consensus.cc:697] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 15 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:06.920323 19510 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:06.921015 19442 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:06.871243 19294 consensus_queue.cc:237] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:06.821892 19449 consensus_queue.cc:1048] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 12:12:06.899956 19463 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:06.922012 19322 raft_consensus.cc:3055] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:06.922581 19322 raft_consensus.cc:740] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:06.922255 19463 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:06.924001 19322 consensus_queue.cc:260] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:06.925256 19463 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:06.927930 19472 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:06.873013 19548 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:06.929921 19548 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:06.930900 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:06.930732 13652 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:06.861013 19550 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:06.932329 19550 raft_consensus.cc:697] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:06.900372 19216 raft_consensus.cc:2749] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:06.901700 19417 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:06.880978 19538 consensus_queue.cc:237] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:06.949282 19450 raft_consensus.cc:2749] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:06.949600 19558 consensus_queue.cc:1059] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:12:06.858804 19270 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:06.903195 19481 consensus_queue.cc:237] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:06.904314 19100 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:12:06.890416 19544 log.cc:927] Time spent T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 12:12:06.920607 19421 consensus_queue.cc:237] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:06.866776 19447 raft_consensus.cc:697] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:06.811681 19384 consensus_queue.cc:260] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:06.900089 19451 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:06.929320 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 664722us
I20260709 12:12:06.913434 13760 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 17.
I20260709 12:12:06.938547 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:06.981091 13828 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:06.981148 13726 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:06.933254 19550 consensus_queue.cc:237] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:06.902289 19473 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:06.951368 13652 leader_election.cc:400] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 election: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 14. Current term is 15.
I20260709 12:12:06.960988 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:06.964479 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:06.965406 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:12:06.967051 19551 log.cc:927] Time spent T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.057s	user 0.000s	sys 0.004s
I20260709 12:12:06.925635 19322 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:06.977569 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:06.951258 19435 consensus_queue.cc:1048] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:12:06.955200 19450 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:06.960467 19415 raft_consensus.cc:3055] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:12:06.974222 19530 log.cc:927] Time spent T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.956s	user 0.013s	sys 0.000s
I20260709 12:12:06.988626 13726 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:06.991016 19471 raft_consensus.cc:3055] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:07.002065 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:06.961853 19558 consensus_queue.cc:1048] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 12:12:06.974068 19514 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:06.979972 19504 raft_consensus.cc:2804] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:07.019917 13828 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 15.
W20260709 12:12:07.009378 19549 log.cc:927] Time spent T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.339s	user 0.000s	sys 0.003s
I20260709 12:12:06.996025 19451 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:07.020167 19471 raft_consensus.cc:740] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:07.038126 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:07.039004 19100 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:07.014094 19415 raft_consensus.cc:740] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:06.999100 19425 consensus_queue.cc:1048] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 12:12:07.026180 19473 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.004264 19556 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:07.049393 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:07.050037 14407 raft_consensus.cc:1240] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:07.052196 13726 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:07.030802 19417 raft_consensus.cc:2749] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:07.058914 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:07.004352 19459 consensus_queue.cc:1059] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 12:12:07.071952 14414 raft_consensus.cc:1240] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 15 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:07.077883 13726 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:07.020759 19450 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:07.064692 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 212713us
W20260709 12:12:07.065651 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 76238.2us
W20260709 12:12:07.063529 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 213443us
I20260709 12:12:07.084017 13800 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:07.084689 13726 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:07.085197 13652 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:07.071508 19335 raft_consensus.cc:2804] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:12:07.087438 13832 raft_consensus.cc:1240] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 19 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:07.088409 13835 raft_consensus.cc:1275] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:12:07.090728 13726 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:07.092835 13760 raft_consensus.cc:1275] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:12:07.093556 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:07.093880 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:07.096167 13800 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:07.097246 13685 raft_consensus.cc:1240] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:07.098680 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:07.099603 13800 leader_election.cc:400] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 election: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 14. Current term is 15.
I20260709 12:12:07.099548 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:07.100178 13800 leader_election.cc:403] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:12:07.101209 19139 raft_consensus.cc:2749] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:12:07.102209 19567 raft_consensus.cc:2804] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:07.102694 19567 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:07.103070 19567 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:07.106132 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:07.106599 13683 raft_consensus.cc:1275] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 10. (term mismatch)
I20260709 12:12:07.106984 13683 pending_rounds.cc:85] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 9
I20260709 12:12:07.107220 13683 pending_rounds.cc:107] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 18.10
I20260709 12:12:07.107085 13727 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:07.107549 13683 raft_consensus.cc:2889] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:07.107810 19513 raft_consensus.cc:3055] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:07.108165 19513 raft_consensus.cc:740] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:07.108703 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:07.108794 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:07.109396 13685 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 13.
I20260709 12:12:07.109987 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:07.111114 13685 raft_consensus.cc:1275] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 12:12:07.111497 19562 log.cc:927] Time spent T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:12:07.113087 19435 raft_consensus.cc:2804] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:12:07.116006 19571 raft_consensus.cc:2804] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:07.082834 19449 raft_consensus.cc:2749] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:07.117902 19450 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:07.118453 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:07.119845 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:07.120443 13832 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:07.073252 19556 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:07.121093 13652 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:07.125748 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:07.108978 19513 consensus_queue.cc:260] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:07.060891 19561 consensus_queue.cc:1059] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 12:12:07.129128 14379 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:07.100571 13686 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 14.
I20260709 12:12:07.133641 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:07.135246 13760 raft_consensus.cc:2393] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 14: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:07.097496 19335 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:07.127198 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:07.064607 19100 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:07.130290 13679 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 14.
I20260709 12:12:07.138616 13652 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:07.105369 19198 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:07.078137 19473 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:07.128410 19449 raft_consensus.cc:2804] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:07.126502 19514 raft_consensus.cc:2804] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:07.124809 19435 raft_consensus.cc:697] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 12 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:07.088604 19417 consensus_queue.cc:1059] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.051s
I20260709 12:12:07.153965 13755 raft_consensus.cc:1240] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:07.149015 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:07.132495 19450 raft_consensus.cc:2749] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:07.155645 13679 raft_consensus.cc:1240] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:07.156620 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:07.161656 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:07.163091 13835 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 13.
I20260709 12:12:07.157850 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:07.159302 13760 raft_consensus.cc:2410] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 12:12:07.164007 13683 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:07.080458 19447 consensus_queue.cc:237] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:07.155061 14379 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:07.165436 13830 raft_consensus.cc:2393] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 18: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
W20260709 12:12:07.168099 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 62052.3us
I20260709 12:12:07.131512 19571 raft_consensus.cc:697] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 18 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:07.150319 19511 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:07.174161 13834 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 14.
I20260709 12:12:07.185206 13834 raft_consensus.cc:1240] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:07.124060 13800 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:07.145423 19335 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:07.153242 19425 raft_consensus.cc:2749] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:07.172617 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:07.187863 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:07.188310 13679 raft_consensus.cc:2393] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 10: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:07.188683 13682 raft_consensus.cc:2393] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 19: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:07.190570 13686 raft_consensus.cc:1275] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260709 12:12:07.192523 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 68540us
I20260709 12:12:07.160588 19513 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:07.190564 14379 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:07.187008 19514 raft_consensus.cc:697] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:07.195779 19554 consensus_queue.cc:1048] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.098s
I20260709 12:12:07.196678 19166 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.197811 19546 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.170770 19449 raft_consensus.cc:697] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:07.198720 19550 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:07.200554 19571 consensus_queue.cc:237] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:07.259166 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 65536.3us
I20260709 12:12:07.206938 19198 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:07.208788 19100 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:07.157650 19270 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:07.237871 13683 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 19.
I20260709 12:12:07.097558 19471 consensus_queue.cc:260] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:07.198288 19472 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.240718 13685 raft_consensus.cc:1275] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:12:07.161265 19421 consensus_queue.cc:1048] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.063s
I20260709 12:12:07.281309 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:07.257588 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:07.203552 14409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 1043) took 1101 ms. Trace:
I20260709 12:12:07.284778 14409 rpcz_store.cc:276] 0709 12:12:06.102707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.105881 (+  3174us) service_pool.cc:224] Handling call
0709 12:12:07.203384 (+1097503us) spinlock_profiling.cc:243] Waited 272 ms on lock 0x7b54006b0dd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:07.203486 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":626369280}
I20260709 12:12:07.256313 19564 raft_consensus.cc:2804] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:07.261374 13800 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:07.192956 19443 raft_consensus.cc:2749] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:07.218947 19538 raft_consensus.cc:2749] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:12:07.252328 19342 consensus_meta.cc:287] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.569s	user 0.010s	sys 0.002s
I20260709 12:12:07.279074 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:07.281134 14407 raft_consensus.cc:1240] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:12:07.127483 19415 consensus_queue.cc:260] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:07.295475 14415 raft_consensus.cc:1275] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:12:07.262820 19431 consensus_queue.cc:1048] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.045s
I20260709 12:12:07.256313 19561 consensus_queue.cc:1059] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 12:12:07.255440 13686 raft_consensus.cc:1275] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 12:12:07.303679 13800 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:07.353626 13686 pending_rounds.cc:85] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 12
I20260709 12:12:07.252022 19425 consensus_queue.cc:1059] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 12:12:07.256186 19166 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:07.276309 19550 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:07.320429 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:07.322232 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:07.296038 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:07.360649 13832 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 15.
I20260709 12:12:07.326138 13762 raft_consensus.cc:1240] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:07.300045 19449 consensus_queue.cc:237] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.5, Last appended by leader: 5, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:07.300251 19452 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
W20260709 12:12:07.295527 19442 consensus_queue.cc:1175] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ca9fbbc2c0a94897897d502d42f3951f" responder_term: 16 status { last_received { term: 15 index: 11 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 15. Current term is 16. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:12:07.330368 19027 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.301668 19564 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:07.330705 19514 consensus_queue.cc:237] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:07.375497 19166 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:07.334161 19342 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:07.335453 13652 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:07.261385 19546 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:07.336905 19553 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:07.337385 19568 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.287030 19435 consensus_queue.cc:237] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:07.339977 13831 raft_consensus.cc:1275] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:12:07.340669 13833 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:07.342615 19473 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:12:07.343508 19536 log.cc:927] Time spent T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.961s	user 0.001s	sys 0.003s
I20260709 12:12:07.344699 19556 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:07.270557 19558 consensus_queue.cc:1048] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 12:12:07.232012 19548 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:07.399528 19548 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:07.365751 19425 consensus_queue.cc:1243] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer ca9fbbc2c0a94897897d502d42f3951f log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:12:07.354492 13686 pending_rounds.cc:107] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 12:12:07.404246 13686 raft_consensus.cc:2889] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:07.354776 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:07.309376 19198 raft_consensus.cc:2749] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:07.319906 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:07.409981 13683 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:07.358309 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 54728.2us
I20260709 12:12:07.413942 13800 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:07.415212 13800 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:07.323819 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:07.417308 13680 raft_consensus.cc:2393] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 15: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:07.285879 19472 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:07.366123 13651 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:07.419446 13758 raft_consensus.cc:1240] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 17. Current term is 18. Ops: [17.10-17.10]
W20260709 12:12:07.418824 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 52837.2us
I20260709 12:12:07.420575 13651 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:07.372745 19027 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:07.374881 19583 raft_consensus.cc:2749] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:12:07.378212 13829 raft_consensus.cc:1240] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 15 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 14. Current term is 15. Ops: []
W20260709 12:12:07.380918 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 45537.5us
I20260709 12:12:07.396289 19568 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:07.362073 19195 raft_consensus.cc:2749] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 14. Current term is 15.
I20260709 12:12:07.421209 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:07.423187 13833 raft_consensus.cc:1275] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:12:07.426909 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:07.454159 13755 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 14.
I20260709 12:12:07.455245 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:07.455967 13755 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 14.
I20260709 12:12:07.430218 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:07.457046 13761 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 14.
I20260709 12:12:07.427441 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:07.458115 13754 raft_consensus.cc:2393] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 18: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:07.459273 13652 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:07.434645 13651 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:07.437021 13834 raft_consensus.cc:1240] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 18 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:07.379042 19564 raft_consensus.cc:3060] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:07.394635 19439 raft_consensus.cc:2749] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:12:07.492451 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 57927us
I20260709 12:12:07.462268 13800 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:07.493253 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:12:07.486148 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:07.463992 13683 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 15.
I20260709 12:12:07.378847 19452 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:07.494889 13800 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:07.460021 13831 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 14.
I20260709 12:12:07.439497 19425 raft_consensus.cc:2804] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:07.435151 19473 raft_consensus.cc:2749] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:07.388104 19561 consensus_queue.cc:1059] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.064s
I20260709 12:12:07.450130 19570 raft_consensus.cc:3055] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:07.438845 19459 raft_consensus.cc:2749] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 12:12:07.447052 19587 log.cc:927] Time spent T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
W20260709 12:12:07.476495 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:07.515897 13727 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:07.443590 19330 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.434767 19556 raft_consensus.cc:2804] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:07.499406 13800 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:07.444413 19481 consensus_queue.cc:1059] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 12:12:07.440024 19322 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:07.529541 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:07.503752 19463 raft_consensus.cc:2804] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:07.501389 19270 raft_consensus.cc:2749] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:07.494215 19431 consensus_queue.cc:1048] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 12:12:07.531426 13800 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:07.403735 19553 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:07.491559 19166 consensus_queue.cc:1048] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.068s
I20260709 12:12:07.564296 19373 raft_consensus.cc:2804] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:07.564903 19373 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:07.565158 19582 raft_consensus.cc:2749] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:07.518632 19425 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:07.522718 19570 raft_consensus.cc:740] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:07.496640 19498 consensus_queue.cc:1048] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:12:07.448635 19571 consensus_queue.cc:1048] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.085s
I20260709 12:12:07.556449 13800 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:07.565335 19373 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:07.534230 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:07.516350 19100 consensus_queue.cc:1059] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 12:12:07.533267 19556 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:07.545660 19473 raft_consensus.cc:2804] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:07.546376 19440 raft_consensus.cc:2804] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:07.645857 19556 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:07.532881 19488 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:07.646024 19582 raft_consensus.cc:2804] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:07.527518 19439 consensus_queue.cc:1059] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 12:12:07.646957 19582 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:12:07.579509 19578 log.cc:927] Time spent T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:12:07.647423 19582 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:07.580569 19563 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.648375 19563 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:07.651052 19563 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:07.674840 19570 consensus_queue.cc:260] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:07.676570 19570 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:07.535522 19330 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:07.566256 19514 raft_consensus.cc:2804] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:12:07.645243 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:07.605727 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:07.604663 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 145465us
W20260709 12:12:07.643870 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 87516.5us
I20260709 12:12:07.646073 19473 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:07.646734 19488 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:07.572723 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 77180us
I20260709 12:12:07.646262 19440 raft_consensus.cc:697] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 14 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
W20260709 12:12:07.588317 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 72499.9us
I20260709 12:12:07.653738 13837 raft_consensus.cc:1275] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 12:12:07.654764 19452 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:07.658473 19472 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:07.659065 19342 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:07.659219 19572 log.cc:927] Time spent T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:12:07.659718 13758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 2144) took 1194 ms. Trace:
I20260709 12:12:07.755782 13758 rpcz_store.cc:276] 0709 12:12:06.465705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.477359 (+ 11654us) service_pool.cc:224] Handling call
0709 12:12:06.501831 (+ 24472us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:07.419867 (+918036us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:07.659396 (+239529us) spinlock_profiling.cc:243] Waited 917 ms on lock 0x7b540038d1d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:07.659621 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2109739776}
W20260709 12:12:07.660910 19588 log.cc:927] Time spent T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:12:07.647444 19439 raft_consensus.cc:3055] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:07.658509 19027 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:07.664090 19373 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:07.666314 19502 raft_consensus.cc:3055] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:07.667484 13828 raft_consensus.cc:1240] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:07.574767 19425 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:07.555220 19322 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:07.683904 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:07.777851 13832 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 16.
I20260709 12:12:07.688850 13754 raft_consensus.cc:1275] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:12:07.698499 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:07.704722 13837 pending_rounds.cc:85] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 7
I20260709 12:12:07.779862 13837 pending_rounds.cc:107] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 12:12:07.779930 13829 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 16.
I20260709 12:12:07.780215 13837 raft_consensus.cc:2889] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:07.697562 13651 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:07.711935 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:07.782670 13761 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:07.783020 19556 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:07.753741 19463 raft_consensus.cc:697] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 15 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:07.719480 19330 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:12:07.726583 19592 log.cc:927] Time spent T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 12:12:07.727696 13763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 858) took 1346 ms. Trace:
I20260709 12:12:07.751528 13833 raft_consensus.cc:1275] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:12:07.795511 13763 rpcz_store.cc:276] 0709 12:12:06.381394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.381525 (+   131us) service_pool.cc:224] Handling call
0709 12:12:06.394778 (+ 13253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:06.825215 (+430437us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:07.727411 (+902196us) spinlock_profiling.cc:243] Waited 405 ms on lock 0x7b54003101d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:07.727620 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":931329408}
I20260709 12:12:07.692224 19513 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.797214 13761 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 16.
I20260709 12:12:07.689389 19514 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:07.696277 19473 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:07.775955 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:07.770097 19502 raft_consensus.cc:740] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:07.781442 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:07.695967 19435 consensus_queue.cc:1059] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 12:12:07.705492 19183 consensus_queue.cc:1059] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 12:12:07.762665 19439 raft_consensus.cc:740] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:07.755618 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:07.718154 13759 raft_consensus.cc:1275] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 12:12:07.812654 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:07.812765 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:07.813835 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:07.816479 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:07.799600 19514 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:07.826213 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:07.828526 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:07.827181 13837 raft_consensus.cc:2468] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 16.
I20260709 12:12:07.806730 19546 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:07.799790 19510 consensus_queue.cc:1048] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:12:07.837867 13837 raft_consensus.cc:1240] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
W20260709 12:12:07.838387 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 140947us
I20260709 12:12:07.812983 19568 leader_election.cc:290] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:07.787472 19602 consensus_queue.cc:1048] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 12:12:07.837001 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:07.846045 13651 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:07.819154 19548 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:07.828343 19448 raft_consensus.cc:3055] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:07.808861 19513 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:07.861037 13760 raft_consensus.cc:1275] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:12:07.856990 13759 raft_consensus.cc:1240] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 14. Current term is 15. Ops: []
W20260709 12:12:07.863235 19577 log.cc:927] Time spent T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.667s	user 0.003s	sys 0.000s
I20260709 12:12:07.866137 19556 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:07.866652 19373 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:12:07.867826 19601 log.cc:927] Time spent T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 12:12:07.868489 19597 log.cc:927] Time spent T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.265s	user 0.000s	sys 0.001s
W20260709 12:12:07.869204 19596 log.cc:927] Time spent T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
W20260709 12:12:07.870353 19451 consensus_meta.cc:287] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.812s	user 0.013s	sys 0.000s
I20260709 12:12:07.870154 19548 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:07.874128 19607 raft_consensus.cc:3055] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:12:07.811466 19598 consensus_queue.cc:1059] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 12:12:07.887362 13800 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:07.842911 19330 raft_consensus.cc:2804] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:07.898386 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:07.903620 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:07.851509 19435 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.815745 19440 consensus_queue.cc:237] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:07.931286 13800 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:07.909361 13759 raft_consensus.cc:1240] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 14. Current term is 15. Ops: []
W20260709 12:12:07.932672 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:07.912899 19504 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:07.860155 19448 raft_consensus.cc:740] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:07.932377 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:07.936645 13683 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 13.
I20260709 12:12:07.910917 13763 raft_consensus.cc:1240] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:07.933194 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:07.933203 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:07.934389 13800 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:07.941015 13800 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:07.943861 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:07.948205 19582 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:07.952394 19582 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:07.945657 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:07.955444 14410 raft_consensus.cc:2393] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 16: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:12:07.956298 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:12:08.130963 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:07.955118 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:07.853284 19439 consensus_queue.cc:260] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:07.926214 19451 raft_consensus.cc:2749] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:07.930473 19607 raft_consensus.cc:740] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:07.851716 19463 consensus_queue.cc:237] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:08.259518 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:08.197221 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:08.197307 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:12:08.198410 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:07.897192 19502 consensus_queue.cc:260] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:07.954593 19195 raft_consensus.cc:2749] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:07.939791 19598 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:08.185925 19443 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.936491 19504 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:07.926352 19330 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:08.194518 13727 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:07.935195 19435 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:07.937601 19583 consensus_queue.cc:1048] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.312s
I20260709 12:12:08.251485 19448 consensus_queue.cc:260] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:08.254612 14411 raft_consensus.cc:1275] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:12:07.957177 19373 raft_consensus.cc:2804] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:08.300704 13758 raft_consensus.cc:1240] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:08.191824 19488 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:12:08.247530 19567 consensus_meta.cc:287] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 1.144s	user 0.010s	sys 0.003s
I20260709 12:12:08.205194 19270 raft_consensus.cc:2749] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:12:08.309473 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 115076us
I20260709 12:12:08.187127 19571 consensus_queue.cc:1048] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.117s
I20260709 12:12:08.295555 19322 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:08.296023 19216 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:08.308329 19330 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:08.311367 19373 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:08.318362 13682 raft_consensus.cc:1240] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 15. Current term is 16. Ops: [15.14-15.14]
I20260709 12:12:08.314268 19510 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:08.317267 19502 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:08.308650 19568 consensus_queue.cc:1175] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b98d2519bb504dc6905ed2ede4571835" responder_term: 15 status { last_received { term: 14 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 14. Current term is 15. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:12:08.340161 19373 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:08.314677 19598 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:08.331039 19216 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:08.199306 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 258396us
I20260709 12:12:08.310282 19443 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:08.347177 19448 raft_consensus.cc:3060] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:12:08.318372 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:08.326242 19567 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:08.334739 19322 consensus_queue.cc:1048] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.023s
W20260709 12:12:08.417558 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:08.418747 13683 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 19.
I20260709 12:12:08.376235 13800 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:08.351946 19606 raft_consensus.cc:2804] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:12:08.435581 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 59447.5us
I20260709 12:12:08.431020 19451 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.441124 19451 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:08.444414 19451 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:08.378403 19513 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:08.445973 19435 leader_election.cc:290] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:08.450091 19620 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:08.452215 19415 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:08.453506 19564 consensus_meta.cc:287] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.951s	user 0.005s	sys 0.007s
I20260709 12:12:08.457005 19447 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:08.458748 19450 raft_consensus.cc:3055] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:08.462306 19567 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:08.464133 19216 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:08.454829 13800 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:08.469906 13837 raft_consensus.cc:1240] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 19. Current term is 20. Ops: []
W20260709 12:12:08.431505 19470 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.001s	sys 0.008s
W20260709 12:12:08.444775 19425 consensus_meta.cc:287] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.656s	user 0.009s	sys 0.000s
I20260709 12:12:08.466394 19571 raft_consensus.cc:2804] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:08.439301 19548 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:08.493036 19620 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:08.469126 19608 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:08.513564 19608 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:08.498477 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 43742.3us
I20260709 12:12:08.500126 13831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 1054) took 1320 ms. Trace:
I20260709 12:12:08.516114 13831 rpcz_store.cc:276] 0709 12:12:07.179617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:07.515342 (+335725us) service_pool.cc:224] Handling call
0709 12:12:07.515677 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:07.587639 (+ 71962us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:07.587679 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:07.587779 (+   100us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:12:07.587839 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:08.497433 (+909594us) spinlock_profiling.cc:243] Waited 71.7 ms on lock 0x7b54000da054. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:08.497510 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:08.500046 (+  2536us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":164974464}
I20260709 12:12:08.517189 13800 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:08.520067 19195 raft_consensus.cc:2749] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:08.502259 19582 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:08.512974 19620 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:08.479929 19513 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.490801 19450 raft_consensus.cc:740] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
W20260709 12:12:08.502413 19470 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.001s	sys 0.008s
I20260709 12:12:08.504917 19447 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:08.543269 19335 consensus_meta.cc:287] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 1.314s	user 0.010s	sys 0.003s
W20260709 12:12:08.545393 19570 consensus_meta.cc:287] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.868s	user 0.009s	sys 0.004s
I20260709 12:12:08.521674 19425 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:08.505856 13684 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.005s	sys 0.007s
W20260709 12:12:08.515825 19514 consensus_meta.cc:287] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.674s	user 0.008s	sys 0.000s
W20260709 12:12:08.576869 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:08.515882 19608 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:08.491873 19564 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:08.605122 19473 consensus_meta.cc:287] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.791s	user 0.012s	sys 0.001s
I20260709 12:12:08.623545 13686 raft_consensus.cc:2368] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 14. Current term is 15.
W20260709 12:12:08.605809 13684 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.760s	user 0.007s	sys 0.009s
W20260709 12:12:08.618260 13755 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.891s	user 0.060s	sys 0.192s
W20260709 12:12:08.624346 13755 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.898s	user 0.060s	sys 0.192s
I20260709 12:12:08.599510 19443 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:08.602144 19421 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.608006 19195 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.642271 14414 raft_consensus.cc:1240] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 14. Current term is 15. Ops: [14.14-14.14]
I20260709 12:12:08.573572 19513 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:08.627230 19183 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.784s	user 0.038s	sys 0.114s
W20260709 12:12:08.645654 14415 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.781s	user 0.045s	sys 0.107s
W20260709 12:12:08.646134 14415 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.781s	user 0.045s	sys 0.107s
I20260709 12:12:08.626451 19608 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.604318 19335 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:08.655361 13836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 1033) took 2636 ms. Trace:
I20260709 12:12:08.655900 13836 rpcz_store.cc:276] 0709 12:12:06.013280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.013816 (+   536us) service_pool.cc:224] Handling call
0709 12:12:06.014122 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:06.741371 (+727249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:08.649385 (+1908014us) spinlock_profiling.cc:243] Waited 707 ms on lock 0x7b540002dd54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:08.649586 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1625870080}
I20260709 12:12:08.618290 19514 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:08.650383 19183 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.809s	user 0.038s	sys 0.114s
I20260709 12:12:08.663659 19514 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:08.663718 19564 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:08.664410 13760 raft_consensus.cc:1240] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:08.658174 19608 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:08.668751 13762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 2162) took 1246 ms. Trace:
I20260709 12:12:08.669616 13835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54830 (request call id 2799) took 1579 ms. Trace:
I20260709 12:12:08.673672 19447 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:08.630280 19473 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:08.696861 19608 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:08.679734 13685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 2996) took 1519 ms. Trace:
I20260709 12:12:08.665442 19598 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:08.684734 13761 raft_consensus.cc:1240] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 10. Current term is 11. Ops: []
I20260709 12:12:08.681223 19330 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:08.699370 19473 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:08.692389 13835 rpcz_store.cc:276] 0709 12:12:07.089908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:07.126884 (+ 36976us) service_pool.cc:224] Handling call
0709 12:12:08.669427 (+1542543us) spinlock_profiling.cc:243] Waited 20.6 ms on lock 0x7b540002e254. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:08.669548 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47315712}
I20260709 12:12:08.640235 19421 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:08.716241 14407 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.782s	user 0.013s	sys 0.008s
I20260709 12:12:08.690641 13762 rpcz_store.cc:276] 0709 12:12:07.422127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:07.422312 (+   185us) service_pool.cc:224] Handling call
0709 12:12:07.451583 (+ 29271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:07.516600 (+ 65017us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:07.516655 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:07.517384 (+   729us) log.cc:844] Serialized 26 byte log entry
0709 12:12:07.582211 (+ 64827us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:07.582255 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:08.668305 (+1086050us) spinlock_profiling.cc:243] Waited 45.4 ms on lock 0x7b5400393ad4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:08.668361 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:08.668419 (+    58us) raft_consensus.cc:1685] finished
0709 12:12:08.668437 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:08.668681 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":144,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":15626,"spinlock_wait_cycles":104382336,"thread_start_us":34557,"threads_started":1,"wal-append.queue_time_us":222466}
W20260709 12:12:08.716744 14407 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.782s	user 0.013s	sys 0.008s
I20260709 12:12:08.705035 13685 rpcz_store.cc:276] 0709 12:12:07.160199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:07.160455 (+   256us) service_pool.cc:224] Handling call
0709 12:12:07.160768 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:07.275804 (+115036us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:08.679364 (+1403560us) spinlock_profiling.cc:243] Waited 79.4 ms on lock 0x7b540021f054. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:08.679658 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":182698240}
I20260709 12:12:08.687855 19606 raft_consensus.cc:697] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 15 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:08.679157 19513 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:08.633975 19450 consensus_queue.cc:260] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:08.642866 19195 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:08.691781 19183 consensus_queue.cc:1243] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer 96701a74fdee481fb5f54aac841e17dd log is divergent from this leader: its last log entry 15.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:12:08.718447 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:08.720255 13836 raft_consensus.cc:1275] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:12:08.721401 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:12:08.771786 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:08.748009 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:08.753799 13755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 870) took 1042 ms. Trace:
W20260709 12:12:08.889452 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:08.749919 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:08.890110 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:08.758627 13837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 3084) took 1052 ms. Trace:
I20260709 12:12:08.891317 13835 raft_consensus.cc:2410] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 20 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:12:08.891506 13837 rpcz_store.cc:276] 0709 12:12:07.706611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:07.849188 (+142577us) service_pool.cc:224] Handling call
0709 12:12:07.849648 (+   460us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:08.499224 (+649576us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:08.758313 (+259089us) spinlock_profiling.cc:243] Waited 617 ms on lock 0x7b54001680d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:08.758551 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1418486656}
I20260709 12:12:08.892253 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:08.887471 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:12:08.870564 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:08.767894 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:08.757418 14414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41692 (request call id 922) took 1541 ms. Trace:
W20260709 12:12:08.900822 14380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:08.889436 13833 raft_consensus.cc:2393] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 16: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:08.906800 13832 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 17.
I20260709 12:12:08.855926 19635 consensus_queue.cc:1048] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.091s
I20260709 12:12:08.715458 19554 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.889226 13755 rpcz_store.cc:276] 0709 12:12:07.711808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:07.712713 (+   905us) service_pool.cc:224] Handling call
0709 12:12:07.713208 (+   495us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:07.725181 (+ 11973us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:07.725218 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:07.726511 (+  1293us) log.cc:844] Serialized 26 byte log entry
0709 12:12:08.624866 (+898355us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:08.624908 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:08.624976 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:08.753436 (+128460us) raft_consensus.cc:1685] finished
0709 12:12:08.753472 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:08.753683 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20059,"raft.queue_time_us":41167,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":8600,"spinlock_wait_cycles":1617664,"thread_start_us":897913,"threads_started":1,"wal-append.queue_time_us":977716}
I20260709 12:12:08.917191 19450 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:08.920089 19448 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.836629 19514 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.905860 19166 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:08.748242 19425 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:08.888418 19384 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:08.764101 19582 raft_consensus.cc:2749] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:08.744637 19473 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:08.841724 19571 raft_consensus.cc:697] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 14 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:08.970314 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:08.905763 19632 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.920367 19498 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:08.914410 19513 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.905966 19440 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.934338 19624 consensus_queue.cc:1048] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 12:12:08.751488 19373 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:08.908322 19451 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:08.984369 19498 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:08.990243 19451 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:08.992288 19498 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:08.992594 19451 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:08.934988 19502 consensus_meta.cc:287] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.590s	user 0.008s	sys 0.004s
I20260709 12:12:08.855527 19634 consensus_queue.cc:1059] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.086s
I20260709 12:12:08.935153 19470 raft_consensus.cc:3055] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:08.993747 19470 raft_consensus.cc:740] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:08.968825 19514 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:08.994959 19470 consensus_queue.cc:260] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:08.996274 19470 raft_consensus.cc:3060] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:08.997092 19514 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:08.965288 19195 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:08.983946 19183 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.981251 19611 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:08.998312 19183 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:08.998529 19611 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:08.998597 19571 consensus_queue.cc:237] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:09.000077 19373 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:08.905460 14414 rpcz_store.cc:276] 0709 12:12:07.215976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:07.239446 (+ 23470us) service_pool.cc:224] Handling call
0709 12:12:07.251898 (+ 12452us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:08.643828 (+1391930us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:08.757050 (+113222us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b54006b0dd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:08.757314 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3192369536}
I20260709 12:12:08.762692 19504 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:09.001106 19183 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:09.001286 19611 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:08.972910 19473 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:09.003144 19504 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:08.886183 19471 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:08.904593 13835 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:09.005184 19473 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:08.966722 19606 consensus_queue.cc:237] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:08.981158 19421 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:09.012360 19550 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:09.013375 19550 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.769327 13828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 2793) took 1682 ms. Trace:
I20260709 12:12:08.942741 19608 consensus_queue.cc:1059] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:12:08.952785 19556 raft_consensus.cc:2749] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:08.953289 19335 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:08.761307 19567 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:08.947492 19463 consensus_queue.cc:1059] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 12:12:08.981451 19425 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
W20260709 12:12:09.015967 19626 log.cc:927] Time spent T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 12:12:09.016384 19330 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:08.961068 19554 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:08.975409 19632 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:08.969421 19166 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:08.965801 19448 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:08.904968 14409 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 16.
W20260709 12:12:09.021008 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:08.972378 19646 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.023612 13828 rpcz_store.cc:276] 0709 12:12:07.087113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:07.087254 (+   141us) service_pool.cc:224] Handling call
0709 12:12:07.667301 (+580047us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:07.770705 (+103404us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:08.769030 (+998325us) spinlock_profiling.cc:243] Waited 580 ms on lock 0x7b540002d350. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:08.769243 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1333337856}
I20260709 12:12:09.026831 13830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 2806) took 1342 ms. Trace:
W20260709 12:12:09.027650 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:09.017813 19591 log.cc:927] Time spent T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 1.261s	user 0.003s	sys 0.011s
W20260709 12:12:09.029960 19415 consensus_meta.cc:287] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.537s	user 0.007s	sys 0.006s
I20260709 12:12:09.038574 13830 rpcz_store.cc:276] 0709 12:12:07.684855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:07.844735 (+159880us) service_pool.cc:224] Handling call
0709 12:12:07.878816 (+ 34081us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:07.879294 (+   478us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:07.879334 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:07.900596 (+ 21262us) log.cc:844] Serialized 26 byte log entry
0709 12:12:08.763916 (+863320us) spinlock_profiling.cc:243] Waited 2.78 ms on lock 0x7b1800015f40. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e82e07 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9fc02 00007fa927b2720b 00007fa927b2cd23 00007fa927b2d0d1 00007fa927f48a0f
0709 12:12:08.952436 (+188520us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:08.952474 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:08.952539 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:09.020517 (+ 67978us) raft_consensus.cc:1685] finished
0709 12:12:09.020538 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:09.026708 (+  6170us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16659,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":6593,"spinlock_wait_cycles":6392192,"thread_start_us":188337,"threads_started":1,"wal-append.queue_time_us":1101595}
W20260709 12:12:09.041002 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 71108.5us
I20260709 12:12:09.052713 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:08.986805 19513 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:09.055167 13727 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:09.061228 13835 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 15.
I20260709 12:12:09.061544 13688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 1995) took 2245 ms. Trace:
I20260709 12:12:09.020166 19440 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:09.063143 13688 rpcz_store.cc:276] 0709 12:12:06.803574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.837600 (+ 34026us) service_pool.cc:224] Handling call
0709 12:12:06.838011 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:06.838267 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:12:06.971117 (+132850us) log.cc:844] Serialized 14 byte log entry
0709 12:12:08.653307 (+1682190us) spinlock_profiling.cc:243] Waited 5.85 ms on lock 0x7b18002bad40. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e82e07 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9d455 00007fa92b9853c7 00007fa927f979a7 00007fa927fa70bf 00007fa927fa7038
0709 12:12:08.898871 (+245564us) log.cc:844] Serialized 14 byte log entry
0709 12:12:09.048254 (+149383us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:09.048313 (+    59us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:09.048365 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:09.048445 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:09.048581 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":155189,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":63,"raft.queue_time_us":839,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":8188,"spinlock_wait_cycles":13458048,"thread_start_us":585096,"threads_started":3,"wal-append.queue_time_us":291333,"wal-append.run_cpu_time_us":2940,"wal-append.run_wall_time_us":1065240}
W20260709 12:12:09.055572 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 106120us
I20260709 12:12:09.031661 19567 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:09.073957 13800 leader_election.cc:400] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 14. Current term is 15.
I20260709 12:12:09.036454 19425 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:09.029049 19550 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:09.065204 19510 consensus_meta.cc:287] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.718s	user 0.008s	sys 0.005s
I20260709 12:12:09.051669 19435 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:09.047885 19646 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:09.082998 19449 raft_consensus.cc:2804] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:09.086366 19510 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:09.101154 19513 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:09.101387 19553 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:09.110922 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:09.114002 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:09.114945 13685 raft_consensus.cc:2368] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 14. Current term is 15.
I20260709 12:12:09.115537 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:09.116199 13681 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:09.096938 19449 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:09.119329 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:09.120072 13682 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:09.125401 19567 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:09.126196 19554 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:09.127379 19646 leader_election.cc:290] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:09.122071 19449 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:09.135296 19550 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:09.139297 19448 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:09.139842 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:09.141114 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:09.141229 19294 raft_consensus.cc:3055] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:09.141682 19294 raft_consensus.cc:740] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:09.142647 19294 consensus_queue.cc:260] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:09.143733 19294 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:09.141692 13685 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:09.146529 19642 log.cc:927] Time spent T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 12:12:09.147145 19440 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:09.151234 13800 leader_election.cc:400] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 election: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 14. Current term is 15.
I20260709 12:12:09.151717 13800 leader_election.cc:403] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:12:09.088616 19435 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:09.163306 13685 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 14.
I20260709 12:12:09.175627 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:09.176826 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:09.166792 19166 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:09.180310 13684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 998) took 1470 ms. Trace:
I20260709 12:12:09.168349 19632 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:09.170492 13681 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 16.
I20260709 12:12:09.185935 13800 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:09.189360 13761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 872) took 1312 ms. Trace:
I20260709 12:12:09.189987 13761 rpcz_store.cc:276] 0709 12:12:07.876716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:07.876879 (+   163us) service_pool.cc:224] Handling call
0709 12:12:07.877199 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:08.706834 (+829635us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:09.188987 (+482153us) spinlock_profiling.cc:243] Waited 807 ms on lock 0x7b54000a0fd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:09.189271 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1856538368}
I20260709 12:12:09.195333 13800 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:09.180797 13684 rpcz_store.cc:276] 0709 12:12:07.710315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:07.710479 (+   164us) service_pool.cc:224] Handling call
0709 12:12:07.715589 (+  5110us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:07.813530 (+ 97941us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:07.813564 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:07.822213 (+  8649us) log.cc:844] Serialized 26 byte log entry
0709 12:12:08.624285 (+802072us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:08.624341 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:09.179866 (+555525us) spinlock_profiling.cc:243] Waited 9.34 ms on lock 0x7b5400199954. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:09.179915 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:09.179966 (+    51us) raft_consensus.cc:1685] finished
0709 12:12:09.179981 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:09.180245 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16323,"raft.queue_time_us":75987,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":3602,"spinlock_wait_cycles":21479296,"thread_start_us":866812,"threads_started":2,"wal-append.queue_time_us":821659}
I20260709 12:12:09.206136 19567 raft_consensus.cc:2804] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:09.206759 19567 raft_consensus.cc:697] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 16 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
W20260709 12:12:09.207064 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:09.207671 19567 consensus_queue.cc:237] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:09.186964 19555 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:09.223547 19632 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:09.225697 19632 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:09.228039 19632 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:09.229803 19513 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.230485 19513 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:09.231169 13760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2937) took 1305 ms. Trace:
I20260709 12:12:09.231763 13760 rpcz_store.cc:276] 0709 12:12:07.925301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:07.925417 (+   116us) service_pool.cc:224] Handling call
0709 12:12:07.925736 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:08.691869 (+766133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:09.230808 (+538939us) spinlock_profiling.cc:243] Waited 738 ms on lock 0x7b540035edd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:09.231086 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1698217216}
I20260709 12:12:09.233810 19513 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:09.237273 13684 raft_consensus.cc:1240] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:09.192363 19554 raft_consensus.cc:2749] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 14. Current term is 15.
I20260709 12:12:09.210357 19571 raft_consensus.cc:2804] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:09.247431 13829 raft_consensus.cc:1240] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 15 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 12:12:09.221328 13682 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 20.
I20260709 12:12:09.249197 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:09.250288 13682 raft_consensus.cc:2393] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 16: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:09.251567 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:09.250603 13800 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:09.254421 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:09.255287 13828 raft_consensus.cc:2393] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 20: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:09.257392 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:09.258831 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:09.259485 13833 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:09.259598 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:09.260303 13682 raft_consensus.cc:2468] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 11.
I20260709 12:12:09.261083 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:09.262113 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:09.263698 13682 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 10.
I20260709 12:12:09.268049 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:09.268181 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:09.268843 13832 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 12.
I20260709 12:12:09.271306 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:09.270589 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:09.278019 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:09.247267 19555 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:09.282291 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:09.283478 19555 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:09.286168 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:09.287079 14412 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 13.
I20260709 12:12:09.271009 19635 raft_consensus.cc:2804] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:09.287927 19635 raft_consensus.cc:697] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 20 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:09.292913 19425 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:09.278791 14411 raft_consensus.cc:2468] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 11.
I20260709 12:12:09.294838 14413 raft_consensus.cc:1240] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 15 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:12:09.296001 14379 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:09.296095 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:09.297539 13835 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 18.
I20260709 12:12:09.253293 19571 raft_consensus.cc:697] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 14 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:09.300189 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:09.302371 13684 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 18.
I20260709 12:12:09.303622 13800 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:09.312983 13685 raft_consensus.cc:1275] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 12:12:09.313441 13685 pending_rounds.cc:85] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 11
I20260709 12:12:09.313665 13685 pending_rounds.cc:107] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 12:12:09.313947 13685 raft_consensus.cc:2889] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:09.314337 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:09.315327 13682 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 15.
I20260709 12:12:09.311297 19650 raft_consensus.cc:2804] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:09.313925 19421 consensus_queue.cc:1048] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 12:12:09.329821 19650 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:09.330380 19650 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:09.330574 19654 log.cc:927] Time spent T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 12:12:09.289044 19635 consensus_queue.cc:237] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:09.349933 14414 raft_consensus.cc:1275] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:12:09.309183 19511 raft_consensus.cc:2804] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:12:09.352962 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 80399us
I20260709 12:12:09.354797 19611 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.355051 13652 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:09.355584 19611 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:09.356505 13652 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:09.356770 19330 raft_consensus.cc:2804] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:09.357228 19330 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:09.357592 19330 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:09.358798 19611 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:09.359725 19611 raft_consensus.cc:2749] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:09.359958 13652 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:09.361909 19611 raft_consensus.cc:2804] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:09.362547 19611 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:12:09.362914 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:09.363184 19611 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:09.363642 19440 consensus_queue.cc:1059] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:09.364568 19450 consensus_queue.cc:1048] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:12:09.365264 19440 raft_consensus.cc:3055] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:09.365988 19440 raft_consensus.cc:740] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:09.367233 19440 consensus_queue.cc:260] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:09.368979 19440 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:09.370110 19554 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:09.370692 19554 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:09.381166 19554 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:09.384344 19571 consensus_queue.cc:237] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:09.385499 19554 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:09.386231 19554 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:09.386968 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:09.388321 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:09.389122 19554 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:09.364151 13652 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:12:09.405288 14380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:09.405140 13652 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:09.410044 19611 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:09.412729 19611 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:09.413556 19608 raft_consensus.cc:2804] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:12:09.418812 19595 log.cc:927] Time spent T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 1.774s	user 0.003s	sys 0.009s
I20260709 12:12:09.418941 19608 raft_consensus.cc:697] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 15 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:09.420025 19608 consensus_queue.cc:237] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:09.415019 19624 consensus_queue.cc:1059] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:12:09.422442 19624 consensus_queue.cc:1243] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer 96701a74fdee481fb5f54aac841e17dd log is divergent from this leader: its last log entry 15.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:12:09.416065 19449 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:09.424106 13687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 3006) took 1481 ms. Trace:
I20260709 12:12:09.424568 13687 rpcz_store.cc:276] 0709 12:12:07.945257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:08.201833 (+256576us) service_pool.cc:224] Handling call
0709 12:12:08.202214 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:08.394750 (+192536us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:08.394796 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:08.394859 (+    63us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:08.394907 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:09.423833 (+1028926us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b540031e7d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:09.423879 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:09.424036 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":442171264}
I20260709 12:12:09.425861 19450 raft_consensus.cc:2804] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:09.426373 19450 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:09.426741 19450 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:09.426973 13679 raft_consensus.cc:3055] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:09.427357 13679 raft_consensus.cc:740] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:09.351104 19294 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.428095 19294 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:09.404388 19511 raft_consensus.cc:697] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 16 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:09.430578 19511 consensus_queue.cc:237] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:09.437330 13833 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 18.
I20260709 12:12:09.417757 13652 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:09.413424 19650 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:09.459975 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 151549us
I20260709 12:12:09.462029 14379 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:09.438975 19449 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:09.449077 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:09.448192 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:09.444759 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:12:09.458479 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:09.393139 19435 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:09.473898 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
W20260709 12:12:09.475553 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:09.468369 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 50675.4us
I20260709 12:12:09.468456 19183 raft_consensus.cc:2804] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:09.477294 13652 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:09.489838 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:09.491024 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:09.491925 13837 raft_consensus.cc:2376] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 15. Re-sending same reply.
I20260709 12:12:09.494998 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:09.497078 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:09.500265 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:09.500604 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:09.478816 19183 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:09.483981 19415 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.503481 13652 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:09.484050 19611 raft_consensus.cc:2804] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:09.514624 13681 raft_consensus.cc:1275] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:12:09.504020 19648 consensus_queue.cc:1059] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.016s
I20260709 12:12:09.525966 19664 raft_consensus.cc:2804] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:09.526559 19664 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:09.526955 19664 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:09.527592 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:09.528972 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:09.514936 19624 raft_consensus.cc:2749] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:09.531780 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:12:09.534713 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 64494.1us
I20260709 12:12:09.505013 19183 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:12:09.551671 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:09.555393 19650 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:12:09.557229 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:09.558331 13833 raft_consensus.cc:1275] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 12:12:09.560075 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:09.563462 13828 raft_consensus.cc:1240] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:09.542079 19611 raft_consensus.cc:697] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 18 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:09.674233 19664 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:09.676618 19664 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:09.678401 19611 consensus_queue.cc:237] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:09.680971 19644 log.cc:927] Time spent T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.579s	user 0.002s	sys 0.000s
W20260709 12:12:09.682814 13683 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 2014) took 1740 ms (client timeout 1595 ms). Trace:
I20260709 12:12:09.673323 19450 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:09.683295 13683 rpcz_store.cc:269] 0709 12:12:07.941929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:07.945348 (+  3419us) service_pool.cc:224] Handling call
0709 12:12:09.682620 (+1737272us) spinlock_profiling.cc:243] Waited 464 ms on lock 0x7b54002c2754. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:09.682742 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1067931904}
I20260709 12:12:09.689993 13833 raft_consensus.cc:1275] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:12:09.690615 19450 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:09.546998 19567 consensus_queue.cc:1048] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.141s
I20260709 12:12:09.516124 19415 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:09.695245 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 231786us
I20260709 12:12:09.698241 14379 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:09.606456 19554 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:09.703235 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:09.714986 13833 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:09.715394 13837 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 16.
I20260709 12:12:09.694631 19567 consensus_queue.cc:1243] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer b98d2519bb504dc6905ed2ede4571835 log is divergent from this leader: its last log entry 17.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:12:09.747226 13828 raft_consensus.cc:1240] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 15 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
W20260709 12:12:09.738322 19631 log.cc:927] Time spent T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.844s	user 0.000s	sys 0.005s
I20260709 12:12:09.730495 19671 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.750276 19330 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:09.754971 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:09.755602 13828 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:09.757033 19563 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:09.757625 19563 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:09.759816 19563 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:09.713021 19554 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:09.692495 19183 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:09.776770 13833 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 18.
I20260709 12:12:09.778651 13828 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 17.
W20260709 12:12:09.780088 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 244171us
I20260709 12:12:09.773331 19448 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.764474 19330 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:09.763502 19671 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:09.816848 19448 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:09.826010 19448 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:09.826870 19294 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:09.794770 19673 raft_consensus.cc:2804] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:12:09.821079 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 122946us
I20260709 12:12:09.831151 19294 consensus_queue.cc:1059] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 12:12:09.833815 14379 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:12:09.842859 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:09.844422 19677 raft_consensus.cc:2804] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:12:09.844956 19677 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:09.845326 19677 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:09.845506 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:09.847751 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:09.848891 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:09.849323 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:09.850512 13688 raft_consensus.cc:1275] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:12:09.850672 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:09.851192 13834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 2797) took 2762 ms. Trace:
I20260709 12:12:09.851455 13681 raft_consensus.cc:2368] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 17. Current term is 18.
I20260709 12:12:09.851538 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:09.852353 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:09.853412 13683 raft_consensus.cc:1275] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:12:09.853523 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:09.852519 13688 raft_consensus.cc:2410] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:12:09.854251 13687 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 14.
I20260709 12:12:09.849463 13682 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 16.
I20260709 12:12:09.854746 19439 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:09.855644 13684 raft_consensus.cc:1275] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:12:09.859779 19538 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:09.860284 13833 raft_consensus.cc:1275] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:12:09.860613 19538 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:09.861984 19567 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.862732 19567 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:09.851647 13834 rpcz_store.cc:276] 0709 12:12:07.089358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:07.186623 (+ 97265us) service_pool.cc:224] Handling call
0709 12:12:07.189933 (+  3310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:07.460774 (+270841us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:09.850966 (+2390192us) spinlock_profiling.cc:243] Waited 247 ms on lock 0x7b54000af5d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:09.851135 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":567621888}
W20260709 12:12:09.867201 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:09.869763 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:09.870188 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:09.870559 13684 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 11.
I20260709 12:12:09.870397 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:09.871455 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:09.871994 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:09.881794 13684 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:09.872077 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:09.884496 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:09.880604 19555 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:12:09.874226 19667 log.cc:927] Time spent T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.378s	user 0.000s	sys 0.003s
I20260709 12:12:09.889052 13832 raft_consensus.cc:1240] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 14 LEADER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:12:09.880378 13679 consensus_queue.cc:260] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:09.897835 13679 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:09.882027 19556 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:09.835178 19673 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:09.903918 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:09.906522 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:12:09.872862 19670 log.cc:927] Time spent T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:12:09.906939 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:09.912092 13836 raft_consensus.cc:2368] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 17. Current term is 18.
I20260709 12:12:09.908181 13828 raft_consensus.cc:1275] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:12:09.919927 13679 raft_consensus.cc:1275] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 12:12:09.920500 13679 pending_rounds.cc:85] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 7
I20260709 12:12:09.920797 13679 pending_rounds.cc:107] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 12:12:09.921093 13679 raft_consensus.cc:2889] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:09.922201 19673 raft_consensus.cc:3060] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:09.922791 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:09.923596 13833 raft_consensus.cc:2393] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 15: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:09.910262 19449 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:09.926224 19449 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:09.928359 19449 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:09.929104 19449 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.908177 19447 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.932006 19447 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:09.932893 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:09.888033 19322 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.881603 19636 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:09.934883 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:09.865329 19567 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:09.872642 19563 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.872500 19448 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.876407 19554 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:09.939682 13679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 2013) took 1998 ms. Trace:
I20260709 12:12:09.887688 19166 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:09.943256 13679 rpcz_store.cc:276] 0709 12:12:07.941620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:07.941730 (+   110us) service_pool.cc:224] Handling call
0709 12:12:07.942124 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:09.426876 (+1484752us) spinlock_profiling.cc:243] Waited 951 ms on lock 0x7b54002047a0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f04dc0 00007fa927f8f1c0 00007fa927f90231 00007fa927f8cd8f 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c
0709 12:12:09.879846 (+452970us) spinlock_profiling.cc:243] Waited 6.93 ms on lock 0x7b4c001c71c0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa926259a20 00007fa92626aa29 00007fa926230644 00007fa926257f2d 00007fa926257b93 00007fa927f8818b 00007fa927f88cb5 00007fa927f83f30 00007fa927f857de 00007fa927f8fb49 00007fa927f90416
0709 12:12:09.921640 (+ 41794us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:09.939624 (+ 17984us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2204006528}
I20260709 12:12:09.947647 19447 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:09.949842 13680 raft_consensus.cc:2410] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 12:12:09.942890 19563 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:09.956763 19671 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:09.940037 19598 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.958550 19183 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:09.960278 19538 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:12:09.922138 19602 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 12:12:09.964129 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:09.965183 14416 raft_consensus.cc:1240] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:09.965847 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:09.994246 14413 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:09.966023 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:09.995609 13834 raft_consensus.cc:2393] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 15: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:09.941073 19636 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:09.949590 19166 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:09.896391 19555 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:09.945111 19448 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:09.934929 19556 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:09.934144 19322 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:09.939968 19677 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:09.967545 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:10.009802 13835 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:09.969370 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:09.970489 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:09.970778 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:12:10.014325 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:09.975924 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 137160us
I20260709 12:12:09.977643 13684 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 17.
I20260709 12:12:09.978734 13831 raft_consensus.cc:1275] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 13 index: 5. Preceding OpId from leader: term: 15 index: 6. (index mismatch)
W20260709 12:12:09.987564 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 153846us
I20260709 12:12:09.989024 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:09.929587 19449 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:10.010546 13837 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 16.
W20260709 12:12:10.007053 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:10.020117 13836 raft_consensus.cc:2393] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 18: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:09.981854 19606 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.988016 19583 consensus_queue.cc:1048] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:12:09.985347 19673 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:10.005417 19447 consensus_queue.cc:1048] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 12:12:10.009656 19607 consensus_queue.cc:260] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:09.990883 19598 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:10.081228 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:10.082597 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:10.081048 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:10.155635 13762 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 18.
I20260709 12:12:10.158420 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:10.042945 14379 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
W20260709 12:12:10.161818 19604 log.cc:927] Time spent T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.922s	user 0.004s	sys 0.003s
W20260709 12:12:10.161945 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 119094us
I20260709 12:12:10.162209 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:10.162943 13829 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 19.
W20260709 12:12:10.098286 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:10.163966 19675 consensus_queue.cc:1048] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:10.164393 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:10.165040 13758 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:10.166116 13757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 866) took 2935 ms. Trace:
I20260709 12:12:10.166319 13652 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:10.167629 13652 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:10.166553 13757 rpcz_store.cc:276] 0709 12:12:07.230715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:07.230882 (+   167us) service_pool.cc:224] Handling call
0709 12:12:07.231205 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:07.231543 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:07.231592 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:07.671953 (+440361us) spinlock_profiling.cc:243] Waited 1.85 ms on lock 0x7b1800310120. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e6e2a6 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa926886a11 00007fa926896372 00007fa927fc8a01 00007fa927f8d43a
0709 12:12:07.673047 (+  1094us) spinlock_profiling.cc:243] Waited 7.46 ms on lock 0x7b2c00010828. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa926886a11 00007fa926896372 00007fa927fc8a01 00007fa927f8d43a 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2
0709 12:12:07.673585 (+   538us) log.cc:844] Serialized 26 byte log entry
0709 12:12:07.766008 (+ 92423us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:07.777442 (+ 11434us) log.cc:844] Serialized 14 byte log entry
0709 12:12:07.789973 (+ 12531us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:07.790046 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:09.238931 (+1448885us) spinlock_profiling.cc:243] Waited 3.78 ms on lock 0x7b1800310120. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924ea03f3 00007fa924ea27c1 00007fa924ea2779 00007fa924ea2709 00007fa924ea26d1 00007fa924ea19cd 0000000000388634 0000000000388479 00007fa924e8383a
0709 12:12:09.666857 (+427926us) spinlock_profiling.cc:243] Waited 4.84 ms on lock 0x7b1800310120. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e6e2a6 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924ea0522 00007fa924ea27c1
0709 12:12:09.684852 (+ 17995us) spinlock_profiling.cc:243] Waited 3.9 ms on lock 0x7b1800310120. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924ea0522 00007fa924ea27c1 00007fa924ea2779 00007fa924ea2709 00007fa924ea26d1 00007fa924ea19cd 0000000000388634 0000000000388479 00007fa924e8383a
0709 12:12:10.161220 (+476368us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:12:10.165871 (+  4651us) raft_consensus.cc:1685] finished
0709 12:12:10.165902 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:10.166032 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30807,"prepare.queue_time_us":19210,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":3993,"raft.queue_time_us":16266,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":22400,"spinlock_wait_cycles":74851584,"thread_start_us":92028,"threads_started":1,"wal-append.queue_time_us":125937}
I20260709 12:12:10.159384 13837 raft_consensus.cc:1240] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:10.167909 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:10.172770 13762 raft_consensus.cc:2410] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 20 because replica has last-logged OpId of term: 19 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 12:12:10.173595 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:10.157610 19166 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:10.174252 13762 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 16.
I20260709 12:12:10.174388 19166 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:10.174932 19166 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:10.175310 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:10.177225 19166 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:10.179734 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:10.169337 19576 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:10.168550 13652 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:10.182610 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:10.183473 14409 raft_consensus.cc:2410] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 12:12:10.170161 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:10.184674 14416 raft_consensus.cc:2410] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 17 because replica has last-logged OpId of term: 15 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
I20260709 12:12:10.083426 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:10.170461 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:10.085618 14407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41700 (request call id 849) took 2177 ms. Trace:
I20260709 12:12:10.186156 14414 raft_consensus.cc:2393] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 11: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:12:10.084236 13760 raft_consensus.cc:1275] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:12:10.188756 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:10.189625 13760 raft_consensus.cc:2410] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 17 because replica has last-logged OpId of term: 15 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
I20260709 12:12:10.189828 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:10.086302 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:10.175905 13762 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 14.
I20260709 12:12:10.190586 14410 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:10.191813 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:10.187146 13684 raft_consensus.cc:1275] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:12:10.185376 13754 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:10.192556 13755 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 9.
I20260709 12:12:10.169130 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:12:10.114813 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:10.194159 13757 raft_consensus.cc:2393] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 18: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:10.195384 13679 raft_consensus.cc:1240] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:10.196563 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:10.197666 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:10.198343 13683 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:10.155289 13756 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 16.
I20260709 12:12:10.199398 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:10.148769 13835 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 13.
I20260709 12:12:10.186086 14407 rpcz_store.cc:276] 0709 12:12:07.908622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:07.908790 (+   168us) service_pool.cc:224] Handling call
0709 12:12:07.909200 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:07.934066 (+ 24866us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:12:08.879616 (+945550us) log.cc:844] Serialized 14 byte log entry
0709 12:12:08.951866 (+ 72250us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:08.951938 (+    72us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:08.952011 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:09.989423 (+1037412us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b180042cb20. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e6e2a6 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419
0709 12:12:10.085351 (+ 95928us) spinlock_profiling.cc:243] Waited 24.6 ms on lock 0x7b54004d6054. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:10.085404 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:10.085533 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":913430,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":119,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":5215,"spinlock_wait_cycles":80419968,"thread_start_us":858542,"threads_started":2,"wal-append.queue_time_us":74344,"wal-append.run_cpu_time_us":1119,"wal-append.run_wall_time_us":1001586}
I20260709 12:12:10.198338 13758 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 15.
I20260709 12:12:10.083005 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:10.082139 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:10.191737 14413 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 17.
I20260709 12:12:10.216986 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:12:10.217800 14380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:10.217963 13762 raft_consensus.cc:2410] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:12:10.219971 13652 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:10.220098 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:10.222155 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:10.222673 13760 raft_consensus.cc:1240] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
W20260709 12:12:10.083868 19652 log.cc:927] Time spent T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.987s	user 0.004s	sys 0.002s
I20260709 12:12:10.231066 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:10.231911 14411 raft_consensus.cc:2393] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 16: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:12:10.223922 13686 raft_consensus.cc:2393] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 17: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:10.220984 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:10.225739 13762 raft_consensus.cc:1275] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:12:10.232646 13760 raft_consensus.cc:1240] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 11. Current term is 12. Ops: []
W20260709 12:12:10.192070 13726 connection.cc:256] RPC call timeout handler was delayed by -1.2675373330000639s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1577s for a response
W20260709 12:12:10.233742 13726 connection.cc:256] RPC call timeout handler was delayed by -1.2675373330000639s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1577s for a response
I20260709 12:12:10.234227 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
W20260709 12:12:10.234409 13726 connection.cc:256] RPC call timeout handler was delayed by -1.1703373330001341s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1685s for a response
W20260709 12:12:10.235164 13726 connection.cc:256] RPC call timeout handler was delayed by -1.0992373330000191s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1764s for a response
W20260709 12:12:10.235477 13726 connection.cc:256] RPC call timeout handler was delayed by -1.0344373330001417s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1836s for a response
I20260709 12:12:10.235868 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:10.083307 19448 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:10.087059 19677 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:10.088706 19322 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:10.037626 19606 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:10.235775 13726 connection.cc:256] RPC call timeout handler was delayed by -1.0029373330000908s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18710000000000002s for a response
I20260709 12:12:10.259023 14410 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 17.
W20260709 12:12:10.249754 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 46397.6us
I20260709 12:12:10.260469 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:10.249956 14408 raft_consensus.cc:1240] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 16 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 12:12:10.171448 19449 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:10.090718 19636 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:10.217267 19166 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.170125 19435 raft_consensus.cc:2804] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:10.192358 19447 consensus_queue.cc:1243] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer 96701a74fdee481fb5f54aac841e17dd log is divergent from this leader: its last log entry 18.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:12:10.165041 19682 raft_consensus.cc:3055] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:10.288086 19682 raft_consensus.cc:740] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:10.085294 19563 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:10.275840 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:10.296087 13762 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:12:10.264643 13754 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 18.
I20260709 12:12:10.282061 13683 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 11.
I20260709 12:12:10.283490 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:10.161859 19683 raft_consensus.cc:2749] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:10.303869 13682 pending_rounds.cc:85] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 10
I20260709 12:12:10.304250 13682 pending_rounds.cc:107] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 12:12:10.304488 13682 raft_consensus.cc:2889] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:10.304708 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:10.305424 13683 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 15.
I20260709 12:12:10.284281 13761 raft_consensus.cc:1275] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:12:10.277364 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:10.282351 13756 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 19.
I20260709 12:12:10.216869 19425 raft_consensus.cc:2804] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:10.311056 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:10.092530 19555 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:10.256170 19598 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:10.277591 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:10.298483 13687 raft_consensus.cc:1275] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:12:10.230710 19632 raft_consensus.cc:2804] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:10.234416 19607 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:10.300554 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:10.329553 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:10.330018 13837 raft_consensus.cc:2393] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 17: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:10.300660 13836 raft_consensus.cc:1240] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:10.089457 19556 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:10.310225 13761 raft_consensus.cc:1275] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:12:10.307822 14379 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:10.310320 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:10.338928 13683 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 16.
I20260709 12:12:10.306947 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:10.290146 19435 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:10.326876 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:10.307062 19471 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.327996 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:10.355476 19471 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:10.360206 13762 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 18.
I20260709 12:12:10.361820 19435 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:10.362859 13680 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 2008) took 2431 ms (client timeout 2996 ms). Trace:
I20260709 12:12:10.365872 13651 leader_election.cc:304] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:10.329381 19632 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:10.367561 19632 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:10.367637 19598 raft_consensus.cc:2749] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:12:10.363415 13680 rpcz_store.cc:269] 0709 12:12:07.931632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:07.931757 (+   125us) service_pool.cc:224] Handling call
0709 12:12:10.362569 (+2430812us) spinlock_profiling.cc:243] Waited 1.99 s on lock 0x7b54002c2c54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:10.362745 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4582193536}
I20260709 12:12:10.371222 13651 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:10.372980 13651 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:10.376669 13651 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:10.289091 19448 consensus_queue.cc:1048] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 12:12:10.301311 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:10.250563 19421 consensus_queue.cc:1059] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.058s
I20260709 12:12:10.332679 13831 raft_consensus.cc:1240] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:10.251462 19669 consensus_queue.cc:1048] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.061s
I20260709 12:12:10.317341 13759 raft_consensus.cc:1275] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:12:10.298947 19449 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.266721 19675 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:10.326757 19425 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:10.354219 19582 raft_consensus.cc:3055] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:10.301923 19166 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:10.354826 19671 raft_consensus.cc:2804] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:12:10.380187 13651 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:10.413385 13651 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:10.415302 13651 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:10.380196 19471 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:10.417663 13651 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:10.380887 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:10.344926 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:10.380338 19602 raft_consensus.cc:2749] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:10.378768 19598 raft_consensus.cc:2749] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:12:10.428557 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:10.428589 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:10.425145 13801 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:10.432060 19183 raft_consensus.cc:2749] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:12:10.433856 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 102612us
I20260709 12:12:10.434930 13651 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:10.405993 19425 raft_consensus.cc:3060] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:10.435187 13760 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 15.
I20260709 12:12:10.220969 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:10.386483 19330 consensus_queue.cc:1048] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:12:10.404935 19582 raft_consensus.cc:740] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:10.441309 13762 raft_consensus.cc:1240] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 12:12:10.264706 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:10.443806 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:10.404484 19675 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:10.446763 19687 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.446412 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:10.447924 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:10.448640 19166 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:10.433167 19671 raft_consensus.cc:697] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 11 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:10.450214 13759 raft_consensus.cc:1275] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:12:10.341185 19682 consensus_queue.cc:260] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:10.433990 19450 raft_consensus.cc:2764] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:12:10.463666 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:10.456641 13762 raft_consensus.cc:2468] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 16.
I20260709 12:12:10.426262 19624 raft_consensus.cc:2804] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:10.466104 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:10.466248 19624 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:10.466813 19624 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:10.402446 19449 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:10.455816 13761 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 9.
I20260709 12:12:10.434918 13652 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:10.438906 19598 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:10.461503 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:10.477861 13756 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 16.
I20260709 12:12:10.478314 14410 raft_consensus.cc:2410] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:12:10.461863 19671 consensus_queue.cc:237] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:10.469930 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:10.513867 13757 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:12:10.473361 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:12:10.479460 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 44633.9us
I20260709 12:12:10.515471 13652 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:10.488059 13761 raft_consensus.cc:1275] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:12:10.453483 19471 raft_consensus.cc:2749] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:10.519654 13759 raft_consensus.cc:1275] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:12:10.521103 14380 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:10.529904 13755 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 15.
I20260709 12:12:10.474651 19673 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:10.544677 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:12:10.553875 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:10.512425 19450 raft_consensus.cc:2804] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:10.459714 19687 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:10.559533 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:10.559662 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:10.577018 13761 raft_consensus.cc:2368] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 14. Current term is 15.
I20260709 12:12:10.560834 19471 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.560806 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:10.562815 13757 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 11.
I20260709 12:12:10.567174 19648 consensus_queue.cc:1048] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:12:10.570328 14413 raft_consensus.cc:1240] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 14. Current term is 15. Ops: [14.14-14.14]
I20260709 12:12:10.570843 19583 consensus_queue.cc:1048] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:10.572896 19449 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:10.573868 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:10.529271 19669 raft_consensus.cc:2749] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:10.579406 13762 raft_consensus.cc:2393] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 15: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:10.584488 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:10.585933 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:10.596997 13756 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 22.
I20260709 12:12:10.512684 19636 consensus_queue.cc:1059] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.064s
I20260709 12:12:10.600418 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:10.576640 19576 raft_consensus.cc:2749] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:10.578188 13800 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:10.525092 19448 raft_consensus.cc:2804] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:10.598228 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:10.599869 19611 consensus_queue.cc:1048] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 12:12:10.606076 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:10.607646 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:10.609066 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:10.587816 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:10.610826 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:10.611145 19675 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199)
I20260709 12:12:10.611660 13761 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 17.
I20260709 12:12:10.590245 13759 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:10.555336 19683 consensus_queue.cc:1059] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 12:12:10.615477 19683 raft_consensus.cc:3055] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:10.615960 19683 raft_consensus.cc:740] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:10.613483 13761 raft_consensus.cc:1240] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 12:12:10.579633 19555 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.603932 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:10.602283 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:12:10.620388 13727 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.043s	sys 0.159s
I20260709 12:12:10.586869 19568 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.622740 13757 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:10.623203 13727 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.044s	sys 0.160s
I20260709 12:12:10.623302 13685 raft_consensus.cc:1240] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 15. Current term is 16. Ops: []
W20260709 12:12:10.632827 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 660907us
I20260709 12:12:10.525422 19684 consensus_queue.cc:1059] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.074s
I20260709 12:12:10.523306 19435 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:10.642657 13759 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 16.
I20260709 12:12:10.530318 19582 consensus_queue.cc:260] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:10.634690 13727 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:10.589452 19471 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:10.617112 19683 consensus_queue.cc:260] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:10.669592 13684 raft_consensus.cc:2393] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 14: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
W20260709 12:12:10.666193 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 398812us
I20260709 12:12:10.665759 13727 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:10.671012 13726 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:10.666986 19449 raft_consensus.cc:2749] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:10.671898 19322 raft_consensus.cc:2749] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:10.629586 19555 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:10.693964 13726 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:10.673475 19166 consensus_queue.cc:1059] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:10.675050 13757 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 15.
I20260709 12:12:10.684926 19582 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:10.684607 19556 consensus_queue.cc:1175] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b98d2519bb504dc6905ed2ede4571835" responder_term: 17 status { last_received { term: 17 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 17 index: 10 } }
W20260709 12:12:10.714682 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 373069us
W20260709 12:12:10.715346 14379 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.56.194:39545 timed out after 1.684s (SENT) [suppressed 12 similar messages]
I20260709 12:12:10.717712 13686 raft_consensus.cc:1240] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:10.682749 13727 leader_election.cc:400] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 17. Current term is 18.
I20260709 12:12:10.634479 19568 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:10.702792 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:10.675879 13759 raft_consensus.cc:1275] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:12:10.723572 14413 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 16.
I20260709 12:12:10.724741 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:10.726500 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:10.727167 13759 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 16.
I20260709 12:12:10.737293 13726 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:10.740063 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:10.702742 19415 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:10.714570 19683 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:10.692270 19583 raft_consensus.cc:2749] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:10.703567 19684 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:10.724684 19513 raft_consensus.cc:2804] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:10.719132 13727 leader_election.cc:403] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:10.730840 19687 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:10.757226 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:10.762034 19564 consensus_queue.cc:1059] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:10.763429 19680 raft_consensus.cc:3055] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:12:10.763862 19680 raft_consensus.cc:740] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:10.742622 19322 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:12:10.775943 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:10.776867 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:10.778715 13680 raft_consensus.cc:2468] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 13.
I20260709 12:12:10.744294 19439 raft_consensus.cc:2749] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:10.738622 19449 consensus_queue.cc:1059] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
W20260709 12:12:10.803160 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 365684us
I20260709 12:12:10.802191 13759 raft_consensus.cc:1240] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 12:12:10.818385 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:10.819675 13759 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 16.
I20260709 12:12:10.750409 19684 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:10.841049 19449 consensus_queue.cc:1243] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer 96701a74fdee481fb5f54aac841e17dd log is divergent from this leader: its last log entry 14.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:12:10.856473 19463 consensus_queue.cc:1048] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:10.858685 19568 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:10.860194 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:10.862872 19606 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:10.863940 19606 consensus_queue.cc:1048] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:12:10.815707 19681 log.cc:927] Time spent T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:12:10.868604 19555 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:10.869493 19435 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:10.870244 19435 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.870970 19513 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:10.871477 19513 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:10.872104 19677 raft_consensus.cc:3055] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:10.872550 19677 raft_consensus.cc:740] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:10.858803 19471 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:10.877095 14379 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
W20260709 12:12:10.906625 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:10.929049 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 52089.2us
I20260709 12:12:10.936571 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:10.935381 19673 raft_consensus.cc:2749] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:12:10.857307 19632 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:10.965350 13763 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.005s	sys 0.039s
I20260709 12:12:10.941515 14379 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:10.897683 19449 raft_consensus.cc:2749] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:10.970841 13759 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 12.
I20260709 12:12:10.870771 19435 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:10.764993 19680 consensus_queue.cc:260] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:10.963256 19689 raft_consensus.cc:2749] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:10.866897 19624 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:10.973136 19463 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.936739 19322 consensus_queue.cc:1048] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.054s
W20260709 12:12:10.973152 13763 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.005s	sys 0.039s
W20260709 12:12:10.989818 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 472293us
I20260709 12:12:11.011139 13652 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:11.004515 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:11.022485 13652 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:10.994589 19583 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:10.996009 19564 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:11.025624 13652 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:11.010229 19450 raft_consensus.cc:697] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 17 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:10.998153 19421 raft_consensus.cc:2804] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:12:11.045691 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:11.005282 19448 raft_consensus.cc:697] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 18 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:10.986893 19692 raft_consensus.cc:2749] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 17. Current term is 18.
I20260709 12:12:11.059157 19439 raft_consensus.cc:2804] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:11.072017 19677 consensus_queue.cc:260] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:11.073009 13755 raft_consensus.cc:1275] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:12:11.029029 19689 raft_consensus.cc:3055] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:11.011673 19463 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:11.077199 19682 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:11.074157 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:11.103636 13757 raft_consensus.cc:2410] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 16 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:12:11.105432 19513 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:11.108388 19513 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:11.110088 19513 raft_consensus.cc:2804] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:11.110759 19513 raft_consensus.cc:697] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 13 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
W20260709 12:12:11.072017 19607 consensus_meta.cc:287] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.731s	user 0.008s	sys 0.003s
I20260709 12:12:11.111987 19452 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:11.112448 19452 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:11.089946 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 511843us
I20260709 12:12:11.114130 13800 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:11.115185 19471 raft_consensus.cc:2804] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:11.115669 19471 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:11.116086 19471 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:11.126894 19471 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:11.097127 19636 consensus_queue.cc:1243] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer ca9fbbc2c0a94897897d502d42f3951f log is divergent from this leader: its last log entry 16.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:12:11.079001 19684 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:11.078912 19632 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:11.083877 19421 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:12:11.091638 19425 consensus_meta.cc:287] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.647s	user 0.012s	sys 0.000s
I20260709 12:12:11.087373 19439 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:11.098188 19680 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:11.092110 19330 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:11.144587 13800 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:11.092942 19689 raft_consensus.cc:740] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:11.079398 19564 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:11.128659 19677 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:11.147505 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 339591us
W20260709 12:12:11.206279 13835 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.016s	sys 0.033s
W20260709 12:12:11.142297 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 459706us
I20260709 12:12:11.097097 19611 consensus_queue.cc:1059] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
W20260709 12:12:11.158455 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 421256us
I20260709 12:12:11.208935 13727 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:11.212419 13726 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:11.166067 19669 raft_consensus.cc:3055] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:11.213529 19669 raft_consensus.cc:740] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
W20260709 12:12:11.213626 13835 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.017s	sys 0.034s
I20260709 12:12:11.214753 19669 consensus_queue.cc:260] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:11.216048 19669 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:11.176614 13801 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:11.218403 19415 raft_consensus.cc:2804] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:11.218958 19415 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:11.219331 19415 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:11.201889 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:11.220935 13837 raft_consensus.cc:1240] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 14. Current term is 15. Ops: []
W20260709 12:12:11.202461 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 58004us
I20260709 12:12:11.206139 13651 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:11.060894 19583 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:11.224918 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:11.225297 19583 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:11.226354 13833 raft_consensus.cc:3055] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:11.226460 13760 raft_consensus.cc:1275] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:12:11.226784 13833 raft_consensus.cc:740] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:11.227152 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:11.229223 13836 raft_consensus.cc:1275] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:12:11.195046 19439 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:11.209766 19555 raft_consensus.cc:2749] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:11.234112 19611 raft_consensus.cc:3055] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:11.234567 19611 raft_consensus.cc:740] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:11.235384 19611 consensus_queue.cc:260] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:11.236572 19611 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:11.197023 19330 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:11.238057 19330 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:11.239805 19689 consensus_queue.cc:260] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:11.241062 19689 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:11.241479 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:11.242283 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:11.242449 19583 consensus_queue.cc:1048] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:12:11.242955 13829 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 18.
I20260709 12:12:11.241479 13832 raft_consensus.cc:1275] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
W20260709 12:12:11.244026 19695 log.cc:927] Time spent T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:12:11.244350 13800 leader_election.cc:304] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:11.245157 19583 raft_consensus.cc:2749] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:11.245342 19632 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:11.245878 19632 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:11.246232 19632 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:11.246641 19583 consensus_queue.cc:1048] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:11.247520 19564 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:11.248672 13800 leader_election.cc:400] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 election: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 14. Current term is 15.
I20260709 12:12:11.249977 19708 consensus_queue.cc:1048] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:12:11.255296 13800 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:11.256659 13800 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:11.256780 19452 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:11.257470 19583 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:11.257941 19583 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:11.258356 19583 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:11.260627 19435 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:11.265316 19598 consensus_meta.cc:287] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.752s	user 0.008s	sys 0.000s
I20260709 12:12:11.266386 19568 raft_consensus.cc:2749] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:11.228629 19692 consensus_queue.cc:1048] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.038s
W20260709 12:12:11.266450 19709 log.cc:927] Time spent T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:12:11.267887 13758 raft_consensus.cc:3055] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:11.268301 13758 raft_consensus.cc:740] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:11.269014 13758 consensus_queue.cc:260] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:11.270493 13758 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:11.272207 19624 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:11.273824 13651 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:11.274935 13651 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:11.275882 19602 raft_consensus.cc:2804] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:11.276283 19602 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:11.276630 19602 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:11.277346 19683 consensus_meta.cc:287] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.525s	user 0.005s	sys 0.003s
I20260709 12:12:11.189147 19450 consensus_queue.cc:237] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:11.195878 19421 raft_consensus.cc:3060] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:11.281623 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 72774.9us
W20260709 12:12:11.287842 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 346439us
I20260709 12:12:11.227659 13833 consensus_queue.cc:260] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:11.289347 13833 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:11.282051 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 69732.8us
W20260709 12:12:11.285277 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:11.281411 13800 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:11.227761 13759 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 15.
I20260709 12:12:11.300132 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:11.301123 13682 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 12.
I20260709 12:12:11.301764 13800 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:11.306519 13800 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:12:11.309991 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:11.318934 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:11.269731 19471 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:11.335503 13688 raft_consensus.cc:1240] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:11.332106 13726 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:11.324783 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:12:11.323421 14380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:11.335861 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:11.340446 13679 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 17.
I20260709 12:12:11.340656 13685 raft_consensus.cc:1275] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:12:11.286459 19598 raft_consensus.cc:2749] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:11.156359 19448 consensus_queue.cc:237] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:11.347101 13800 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:11.192912 19636 consensus_queue.cc:1059] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.113s
I20260709 12:12:11.198019 19425 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:11.305397 19183 raft_consensus.cc:2804] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:11.311110 19563 raft_consensus.cc:2804] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:12:11.336920 19705 log.cc:927] Time spent T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:12:11.321079 19556 raft_consensus.cc:2749] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:11.349529 13800 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:11.366811 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:11.350044 14379 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:11.367532 13759 raft_consensus.cc:2468] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 16.
I20260709 12:12:11.369065 13800 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:11.356216 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:11.357339 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:11.371927 13833 raft_consensus.cc:1275] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 12:12:11.348364 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:11.347771 13758 raft_consensus.cc:1275] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:12:11.351512 13686 raft_consensus.cc:1240] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:11.352434 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:11.364202 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:11.376757 13679 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 15.
I20260709 12:12:11.337400 19715 raft_consensus.cc:2749] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 12:12:11.379326 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:11.380856 13833 pending_rounds.cc:85] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 11
I20260709 12:12:11.381402 13833 pending_rounds.cc:107] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 12:12:11.381903 13833 raft_consensus.cc:2889] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:11.382876 14415 raft_consensus.cc:2393] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 14: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:12:11.385367 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:11.387758 13652 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:11.355512 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:12:11.404398 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 54443us
I20260709 12:12:11.406914 14379 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:12:11.402856 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 70847.2us
I20260709 12:12:11.409329 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:11.409476 13726 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:11.410079 13686 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 16.
I20260709 12:12:11.413295 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:11.414136 13763 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:11.360889 19183 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:11.353166 19555 raft_consensus.cc:2749] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:11.348744 19568 raft_consensus.cc:2749] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:11.351056 13581 catalog_manager.cc:5697] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 11 to 17. New cstate: current_term: 17 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
W20260709 12:12:11.397475 19687 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 20 current term: 20 is higher.
I20260709 12:12:11.425122 13652 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:11.361438 19563 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:12:11.471813 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 59394.8us
I20260709 12:12:11.476770 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:11.345923 19712 raft_consensus.cc:2749] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:12:11.489369 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 64300.5us
W20260709 12:12:11.404367 19648 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 16 current term: 16 is higher.
I20260709 12:12:11.399880 19471 raft_consensus.cc:2804] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:11.402698 19636 raft_consensus.cc:2749] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:11.411689 19692 raft_consensus.cc:2749] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:11.352018 19166 consensus_queue.cc:1048] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.077s
W20260709 12:12:11.479278 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 69903us
I20260709 12:12:11.428469 19463 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:11.366050 19384 consensus_queue.cc:1048] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.063s
I20260709 12:12:11.489369 19563 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:11.477664 13758 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 18.
I20260709 12:12:11.490916 13652 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:11.419951 19511 raft_consensus.cc:2749] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:11.426082 19183 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:11.496445 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:11.399339 19683 consensus_queue.cc:1048] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.074s
I20260709 12:12:11.506616 13754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 879) took 1053 ms. Trace:
I20260709 12:12:11.484124 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:11.473754 19598 raft_consensus.cc:2749] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:12:11.514467 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 107650us
I20260709 12:12:11.536871 13754 rpcz_store.cc:276] 0709 12:12:10.452840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:10.453403 (+   563us) service_pool.cc:224] Handling call
0709 12:12:10.468594 (+ 15191us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:10.468933 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:10.468959 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:10.477293 (+  8334us) log.cc:844] Serialized 26 byte log entry
0709 12:12:11.012752 (+535459us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:11.012813 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:11.012907 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:11.487918 (+475011us) raft_consensus.cc:1685] finished
0709 12:12:11.487944 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:11.493405 (+  5461us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b54000924d0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:11.506514 (+ 13109us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":446,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":2434,"spinlock_wait_cycles":34146560,"thread_start_us":435047,"threads_started":1,"wal-append.queue_time_us":664551}
W20260709 12:12:11.543402 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 155232us
I20260709 12:12:11.366110 19513 consensus_queue.cc:237] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:11.468261 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:11.550343 13759 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:11.551859 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:11.502053 19471 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:11.534212 13651 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:12:11.536931 13582 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45620 (request call id 248) took 58947 ms (client timeout 15000 ms). Trace:
I20260709 12:12:11.559036 19471 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:11.537102 13755 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 12.
W20260709 12:12:11.560055 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:11.560904 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:11.415210 19717 consensus_queue.cc:1048] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.101s
W20260709 12:12:11.539347 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 48526.5us
I20260709 12:12:11.505203 19725 raft_consensus.cc:2749] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:11.516764 13581 catalog_manager.cc:5697] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: config changed from index -1 to 8, term changed from 11 to 14, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to <none>, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added, now has a pending config: VOTER b98d2519bb504dc6905ed2ede4571835 (127.12.56.193), VOTER 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194), VOTER 96701a74fdee481fb5f54aac841e17dd (127.12.56.195), VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 14 committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } } pending_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:12:11.491401 19555 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:11.544157 13800 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:11.544094 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:11.497242 19583 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:11.572834 13833 raft_consensus.cc:1240] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 22. Current term is 23. Ops: []
I20260709 12:12:11.572049 13754 raft_consensus.cc:2376] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 11. Re-sending same reply.
I20260709 12:12:11.533874 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:11.508464 19624 raft_consensus.cc:2749] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:11.587199 14379 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
W20260709 12:12:11.587260 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 76734.8us
I20260709 12:12:11.545023 19712 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:11.592056 13726 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:11.517379 19322 raft_consensus.cc:2749] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:11.563491 13651 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:11.552865 13760 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 19.
I20260709 12:12:11.578285 13581 catalog_manager.cc:5697] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 10 to 15, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 15 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:12:11.558255 13582 rpcz_store.cc:269] 0709 12:11:12.589364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.589680 (+   316us) service_pool.cc:224] Handling call
0709 12:12:11.536828 (+58947148us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:05.116460 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:05.117309 (+   849us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:05.117357 (+    48us) write_op.cc:435] Acquired schema lock
0709 12:12:05.117389 (+    32us) tablet.cc:662] Decoding operations
0709 12:12:05.182452 (+ 65063us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:05.210798 (+ 28346us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:05.245033 (+ 34235us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:12:05.389670 (+144637us) tablet.cc:701] Row locks acquired
0709 12:12:05.406125 (+ 16455us) write_op.cc:260] PREPARE: finished
0709 12:12:05.425825 (+ 19700us) write_op.cc:270] Start()
0709 12:12:05.443408 (+ 17583us) write_op.cc:276] Timestamp: P: 1783599125419428 usec, L: 0
0709 12:12:05.443477 (+    69us) op_driver.cc:348] REPLICATION: starting
0709 12:12:05.444529 (+  1052us) log.cc:844] Serialized 2094 byte log entry
0709 12:12:05.738305 (+293776us) op_driver.cc:464] REPLICATION: finished
0709 12:12:06.114516 (+376211us) write_op.cc:301] APPLY: starting
0709 12:12:06.114637 (+   121us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:06.498200 (+383563us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:06.498348 (+   148us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:06.545589 (+ 47241us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:06.573435 (+ 27846us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 12:12:06.573540 (+   105us) write_op.cc:312] APPLY: finished
0709 12:12:06.574241 (+   701us) log.cc:844] Serialized 57 byte log entry
0709 12:12:06.574513 (+   272us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:06.574679 (+   166us) write_op.cc:454] Released schema lock
0709 12:12:06.574782 (+   103us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:06.575374 (+   592us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:06.575419 (+    45us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":70003,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":303423,"apply.run_cpu_time_us":16302,"apply.run_wall_time_us":460802,"cfile_cache_hit":22,"cfile_cache_hit_bytes":25027,"num_ops":5,"prepare.queue_time_us":87348,"prepare.run_cpu_time_us":35762,"prepare.run_wall_time_us":550111,"raft.queue_time_us":104803,"raft.run_cpu_time_us":16776,"raft.run_wall_time_us":238305,"replication_time_us":294635,"spinlock_wait_cycles":198912,"thread_start_us":470726,"threads_started":4,"wal-append.queue_time_us":166147,"wal-append.run_cpu_time_us":15218,"wal-append.run_wall_time_us":1974747}]]}
I20260709 12:12:11.579775 13762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 2186) took 1014 ms. Trace:
I20260709 12:12:11.556555 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:11.549640 19606 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:11.542227 19636 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:11.605264 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 92989.9us
I20260709 12:12:11.583292 13758 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 15.
I20260709 12:12:11.595738 13754 raft_consensus.cc:1275] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:12:11.600790 13756 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 15.
I20260709 12:12:11.581560 19415 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:11.615998 13759 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 19.
I20260709 12:12:11.600587 13762 rpcz_store.cc:276] 0709 12:12:10.564275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:10.632426 (+ 68151us) service_pool.cc:224] Handling call
0709 12:12:10.632869 (+   443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:10.633118 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:12:11.131995 (+498877us) log.cc:844] Serialized 14 byte log entry
0709 12:12:11.576356 (+444361us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:11.576475 (+   119us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:11.577813 (+  1338us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:11.577951 (+   138us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:11.578121 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":87021,"prepare.queue_time_us":445268,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":25,"raft.queue_time_us":92408,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":14459,"thread_start_us":834624,"threads_started":3,"wal-append.queue_time_us":438279}
I20260709 12:12:11.574954 19598 raft_consensus.cc:2804] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:11.613762 13581 catalog_manager.cc:5697] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 11 to 17, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 17 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:11.615557 13651 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:11.622370 13651 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:11.591441 19710 raft_consensus.cc:2804] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:11.627517 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:11.630281 13651 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:12:11.629077 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 56445.3us
I20260709 12:12:11.637537 13800 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:11.569217 19449 consensus_queue.cc:1048] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.044s
I20260709 12:12:11.596267 19583 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:11.653287 19583 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:11.618408 19598 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:11.591527 19564 consensus_queue.cc:1048] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
W20260709 12:12:11.694299 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 45472.9us
I20260709 12:12:11.575644 19439 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:11.582938 19555 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:11.627789 19624 raft_consensus.cc:2804] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:11.652169 14412 raft_consensus.cc:1240] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 14. Current term is 15. Ops: [14.14-14.14]
W20260709 12:12:11.643481 19714 log.cc:927] Time spent T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.280s	user 0.001s	sys 0.000s
I20260709 12:12:11.632582 19463 raft_consensus.cc:2804] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:11.651340 19701 raft_consensus.cc:2804] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:11.636533 19568 consensus_queue.cc:1048] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 12:12:11.706404 13824 tablet_service.cc:1558] Processing DeleteTablet for tablet a34b21ec197b4241a780a8ae562e4602 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 5)) from {username='slave'} at 127.0.0.1:54808
W20260709 12:12:11.707087 19728 log.cc:927] Time spent T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 12:12:11.670619 19598 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:11.707701 19746 raft_consensus.cc:2749] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:11.708797 19555 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:11.703843 19624 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:11.712533 19439 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:12:11.714349 19729 log.cc:927] Time spent T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:12:11.643165 19722 raft_consensus.cc:2804] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:11.720294 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:12:11.756588 19694 log.cc:927] Time spent T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:12:11.601006 19712 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:11.654094 19583 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:11.728719 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 91260.9us
I20260709 12:12:11.702913 14379 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:12:11.790695 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 87868.5us
I20260709 12:12:11.791245 13800 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:11.791659 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:11.792362 14412 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 17.
I20260709 12:12:11.792636 13800 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:11.650887 19738 raft_consensus.cc:2804] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:11.775940 19624 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:11.627125 19636 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:11.698784 19425 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:11.764536 13581 catalog_manager.cc:5697] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 11 to 13, leader changed from ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 13 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
W20260709 12:12:11.773579 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:11.643474 19721 consensus_queue.cc:1048] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.122s
I20260709 12:12:11.729075 19463 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:11.757967 19322 raft_consensus.cc:2749] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:11.794481 13652 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:11.713688 19632 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:11.793732 14379 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:11.816618 13581 catalog_manager.cc:5697] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 6 to 11, leader changed from ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 11 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:12:11.822665 13762 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 16.
I20260709 12:12:11.796540 13763 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 15.
I20260709 12:12:11.792188 19568 raft_consensus.cc:2804] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:11.769634 19701 raft_consensus.cc:697] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 19 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:11.795073 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:11.781072 19722 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:11.826889 13758 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 16.
I20260709 12:12:11.778822 19716 consensus_queue.cc:1059] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
W20260709 12:12:11.828958 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 236991us
I20260709 12:12:11.831907 13581 catalog_manager.cc:5697] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 9 to 13, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 13 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:11.798938 13800 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
W20260709 12:12:11.815537 19732 log.cc:927] Time spent T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 12:12:11.794068 19738 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:11.799860 19294 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:11.799095 19746 raft_consensus.cc:2804] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:11.842371 13581 catalog_manager.cc:5697] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
W20260709 12:12:11.835040 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 58192.6us
I20260709 12:12:11.845427 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:11.858246 14412 raft_consensus.cc:2393] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 12: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:12:11.845803 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:11.800313 19741 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:12:11.797580 19582 consensus_meta.cc:287] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 1.083s	user 0.010s	sys 0.003s
I20260709 12:12:11.819196 19463 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:11.801985 19555 consensus_queue.cc:1048] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 12:12:11.838968 19722 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:11.876139 13581 catalog_manager.cc:5697] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 10 to 13, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 13 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:12:11.852178 13726 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
W20260709 12:12:11.831300 19734 log.cc:927] Time spent T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
I20260709 12:12:11.802237 19675 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:11.861514 14416 raft_consensus.cc:2393] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 16: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:12:11.830924 19725 raft_consensus.cc:2804] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:11.816274 19745 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:11.858423 13651 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:11.826133 19568 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:11.831120 19425 raft_consensus.cc:2749] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:11.851197 13685 raft_consensus.cc:2393] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 20: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:11.852849 19294 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:11.883286 13581 catalog_manager.cc:5697] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 6 to 10, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 10 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:11.856884 19746 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:11.853416 19738 raft_consensus.cc:3060] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:11.897974 19739 log.cc:927] Time spent T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
W20260709 12:12:11.894958 19680 consensus_meta.cc:287] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.698s	user 0.008s	sys 0.002s
W20260709 12:12:11.907953 19735 log.cc:927] Time spent T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:12:11.895308 19568 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:11.908924 19736 log.cc:927] Time spent T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 12:12:11.911823 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 59737.4us
I20260709 12:12:11.915400 13581 catalog_manager.cc:5697] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 13 to 14, leader changed from ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 14 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:12:11.963347 13726 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:11.965869 13726 leader_election.cc:400] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 17. Current term is 18.
I20260709 12:12:11.967155 13726 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:11.900291 19270 raft_consensus.cc:3055] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:11.916843 19715 raft_consensus.cc:2749] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:11.921658 19582 consensus_queue.cc:1048] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:11.874046 19741 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:11.927871 19632 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:11.929801 19712 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:11.931552 19746 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:12:11.931893 19730 log.cc:927] Time spent T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.344s	user 0.004s	sys 0.000s
I20260709 12:12:11.998027 19751 consensus_queue.cc:1048] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:11.998651 19463 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:12.001307 19463 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:11.900372 19555 raft_consensus.cc:2804] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:11.890352 19675 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:11.890905 19725 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:12:11.919714 19602 consensus_meta.cc:287] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.636s	user 0.011s	sys 0.000s
I20260709 12:12:11.911521 19721 raft_consensus.cc:2804] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:11.912510 19294 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:11.978758 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:11.938608 19576 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
W20260709 12:12:11.979087 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 354766us
I20260709 12:12:11.987811 13726 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:11.972983 19166 raft_consensus.cc:2749] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:11.991614 19718 raft_consensus.cc:2749] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:12:11.938725 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:12:12.011751 19682 consensus_meta.cc:287] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.880s	user 0.011s	sys 0.000s
I20260709 12:12:11.982422 13581 catalog_manager.cc:5697] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 11 to 12, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 12 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:12:12.001711 19330 consensus_meta.cc:287] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.763s	user 0.006s	sys 0.004s
I20260709 12:12:11.985715 19680 consensus_queue.cc:1059] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.006s
I20260709 12:12:12.006435 19583 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:11.971102 19270 raft_consensus.cc:740] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
W20260709 12:12:12.047230 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 59546.1us
W20260709 12:12:11.990257 19677 consensus_meta.cc:287] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.762s	user 0.008s	sys 0.004s
I20260709 12:12:12.050545 13755 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:11.977094 19322 consensus_queue.cc:1048] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 12:12:11.978847 14379 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
W20260709 12:12:12.028452 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 191197us
I20260709 12:12:12.014245 19555 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:12.016000 19725 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:12.015777 19675 leader_election.cc:290] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:12.133767 13755 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 20.
I20260709 12:12:12.142618 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:12.143231 13688 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:12.052459 13727 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:12.080932 14413 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 16.
I20260709 12:12:11.912207 19745 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:12.147333 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:12.148080 19745 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:12.148545 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:12.019796 19741 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:12.149731 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:12.150449 13681 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:12.150967 19624 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:12.151268 19717 raft_consensus.cc:3055] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:12.151791 19717 raft_consensus.cc:740] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:12.152705 19717 consensus_queue.cc:260] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:12.021853 19450 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:12.153859 19738 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:12.154027 19450 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:12.156136 19738 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:12.156404 19450 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:12.156574 13686 raft_consensus.cc:1240] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:12.153110 19624 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:12.018474 19721 raft_consensus.cc:697] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 15 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:12.087461 13726 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:12.087842 13581 catalog_manager.cc:5697] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:12:12.163177 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 110819us
I20260709 12:12:12.163388 13581 catalog_manager.cc:5697] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 13 to 15, leader changed from ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 15 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:12:12.017292 19746 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:12.139413 19555 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:12.167133 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:12:12.099649 19471 consensus_meta.cc:287] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.539s	user 0.008s	sys 0.004s
W20260709 12:12:12.102125 19611 consensus_meta.cc:287] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.865s	user 0.014s	sys 0.000s
I20260709 12:12:11.918087 19701 consensus_queue.cc:237] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:12.105330 19511 raft_consensus.cc:2804] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:12.194327 19511 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:12.194780 19511 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:12.179369 19648 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.198930 19648 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:12.201134 19648 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:12.174523 19294 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:12.108129 19415 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:12.110594 19270 consensus_queue.cc:260] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:12.084815 19330 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:12.114751 19722 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:12.115507 14410 raft_consensus.cc:2468] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 17.
I20260709 12:12:12.084921 19761 raft_consensus.cc:2749] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:12:12.095431 19689 consensus_meta.cc:287] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.854s	user 0.004s	sys 0.007s
I20260709 12:12:12.213935 13757 raft_consensus.cc:1275] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 12:12:12.214327 19722 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:12.115990 13761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 2180) took 1553 ms. Trace:
I20260709 12:12:12.117425 13571 catalog_manager.cc:5028] TS 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): tablet a34b21ec197b4241a780a8ae562e4602 (table test-workload [id=d6bd67d42f0847a3b08fa72b2b985fc2]) successfully deleted
W20260709 12:12:12.215454 13571 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 98169.3us
I20260709 12:12:12.055020 19576 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:12.215093 13761 rpcz_store.cc:276] 0709 12:12:10.562608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:10.618898 (+ 56290us) service_pool.cc:224] Handling call
0709 12:12:10.703887 (+ 84989us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:11.087609 (+383722us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:11.089281 (+  1672us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:11.128164 (+ 38883us) log.cc:844] Serialized 52 byte log entry
0709 12:12:11.419399 (+291235us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:12:11.419661 (+   262us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:11.420933 (+  1272us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:11.930883 (+509950us) spinlock_profiling.cc:243] Waited 8.74 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:12:11.994933 (+ 64050us) raft_consensus.cc:1685] finished
0709 12:12:11.994957 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:12.115807 (+120850us) spinlock_profiling.cc:243] Waited 84.5 ms on lock 0x7b54000898d0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:12.115931 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25503,"raft.queue_time_us":128293,"raft.run_cpu_time_us":333,"raft.run_wall_time_us":91523,"spinlock_wait_cycles":214371328,"thread_start_us":623948,"threads_started":2,"wal-append.queue_time_us":370802}
I20260709 12:12:12.018110 19602 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:12.096401 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 117685us
I20260709 12:12:12.218297 19576 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:12:12.122427 19183 consensus_meta.cc:287] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.544s	user 0.009s	sys 0.001s
I20260709 12:12:12.218946 13679 raft_consensus.cc:1240] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:12.219099 19183 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:12.127017 19720 log.cc:927] Time spent T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.633s	user 0.000s	sys 0.002s
W20260709 12:12:12.129937 19563 consensus_meta.cc:287] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.579s	user 0.009s	sys 0.001s
W20260709 12:12:12.221174 19556 consensus_queue.cc:1175] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ca9fbbc2c0a94897897d502d42f3951f" responder_term: 15 status { last_received { term: 13 index: 13 } last_committed_idx: 13 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 14. Current term is 15. Ops: [14.14-14.14]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:12:12.127736 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:12.221748 19563 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:12.222977 13680 raft_consensus.cc:1240] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 12:12:12.223448 19682 raft_consensus.cc:3055] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:12:12.223865 19682 raft_consensus.cc:740] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 22 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:12.224035 19563 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:12:12.131110 19719 log.cc:927] Time spent T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.659s	user 0.002s	sys 0.000s
I20260709 12:12:12.138067 13801 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:12.137131 19636 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:12.145079 13682 raft_consensus.cc:1275] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:12:12.145418 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:12.156163 14413 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41692 (request call id 939) took 1296 ms. Trace:
I20260709 12:12:12.154129 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:12.165310 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:12.166450 13681 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 17.
I20260709 12:12:12.166958 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:12.239766 13835 raft_consensus.cc:2393] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 13: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:12.167969 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:12.240377 13828 raft_consensus.cc:2393] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 15: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:12.168809 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:12.240902 13831 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 16.
I20260709 12:12:12.153959 19463 consensus_queue.cc:1048] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 12:12:12.170393 13829 raft_consensus.cc:1240] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:12.249107 13683 raft_consensus.cc:2393] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 17: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:12.249931 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:12.170874 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:12.250223 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:12.171514 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:12.251148 14410 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 11.
I20260709 12:12:12.252579 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:12:12.162415 19421 consensus_meta.cc:287] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.825s	user 0.006s	sys 0.006s
I20260709 12:12:12.174805 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:12.179688 13581 catalog_manager.cc:5697] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 6 to 9, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 9 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:12.182322 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:12.182644 13837 raft_consensus.cc:1240] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:12.267634 13834 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 15.
I20260709 12:12:12.179347 19471 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:12.185105 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:12.251766 14412 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 15.
W20260709 12:12:12.171672 19724 log.cc:927] Time spent T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.683s	user 0.000s	sys 0.003s
I20260709 12:12:12.177893 19707 consensus_queue.cc:1048] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:12:12.186270 19762 raft_consensus.cc:2764] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:12:12.187188 13836 pending_rounds.cc:85] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 9
I20260709 12:12:12.176153 19741 raft_consensus.cc:2804] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:12.190122 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:12.275488 13836 pending_rounds.cc:107] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 18.10
I20260709 12:12:12.206552 13800 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:12.275887 13836 raft_consensus.cc:2889] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:12:12.276381 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 69958.1us
I20260709 12:12:12.178529 19717 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:12.210419 19270 raft_consensus.cc:3060] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:12.210793 19294 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:12.212175 19330 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:12.289106 13833 raft_consensus.cc:2393] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 18: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:12.248683 19415 raft_consensus.cc:2804] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:12:12.138238 19726 log.cc:927] Time spent T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.593s	user 0.000s	sys 0.003s
W20260709 12:12:12.225682 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 87681us
I20260709 12:12:12.228165 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:12.285261 13800 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:12.234150 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:12.242184 13727 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:12.242596 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:12.250555 13758 raft_consensus.cc:1275] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:12:12.294888 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:12.296360 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:12.297008 13758 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:12.171675 19721 consensus_queue.cc:237] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:12.174531 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 87203.2us
I20260709 12:12:12.268841 19636 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.306934 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:12.310786 14409 raft_consensus.cc:1240] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:12.250586 13829 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:12.263352 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:12.313530 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:12.314875 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:12.271714 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:12.208379 19648 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:12.271297 13652 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:12.205194 13688 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 17.
I20260709 12:12:12.316354 13762 raft_consensus.cc:2393] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 11: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:12.279423 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:12.275213 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:12.319751 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:12.320070 13686 raft_consensus.cc:2393] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 16: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:12.221674 19183 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:12.280164 13581 catalog_manager.cc:5697] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 8 to 10, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 10 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:12.286427 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:12.321156 14416 raft_consensus.cc:2393] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 20: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:12:12.307976 19449 raft_consensus.cc:2804] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:12.321797 19449 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:12.322232 19449 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:12.321947 13581 catalog_manager.cc:5697] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 10 to 14, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 14 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:12.287420 19760 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.287550 19602 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:12.289336 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:12.326627 13683 raft_consensus.cc:2393] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 20: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:12.214375 13757 pending_rounds.cc:85] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting all ops after (but not including) 7
I20260709 12:12:12.224889 19682 consensus_queue.cc:260] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:12.326184 19760 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:12.217619 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:12.327868 13761 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:12.327431 13757 pending_rounds.cc:107] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 12:12:12.328356 13757 raft_consensus.cc:2889] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:12.331763 19760 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:12.253611 14410 raft_consensus.cc:2393] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 15: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
W20260709 12:12:12.293617 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 51547.9us
I20260709 12:12:12.237280 14413 rpcz_store.cc:276] 0709 12:12:10.859604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:10.859848 (+   244us) service_pool.cc:224] Handling call
0709 12:12:12.155993 (+1296145us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54003ebf54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:12.156103 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2753452928}
I20260709 12:12:12.300993 13726 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:12.334466 19761 raft_consensus.cc:2804] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:12.334911 13726 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:12.336263 13726 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:12.315573 13755 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:12.320245 13762 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:12.298188 19741 raft_consensus.cc:697] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:12.342684 19741 consensus_queue.cc:237] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:12.313567 19447 consensus_queue.cc:1048] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:12:12.238077 19568 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:12.280737 19583 raft_consensus.cc:2749] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:12.270726 19421 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:12.316272 13801 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:12.331995 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:12.354822 13829 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 17.
W20260709 12:12:12.376803 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 105590us
I20260709 12:12:12.378021 13837 raft_consensus.cc:1240] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 16. Current term is 17. Ops: []
W20260709 12:12:12.382083 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 46376.8us
I20260709 12:12:12.324918 13581 catalog_manager.cc:5697] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 10 to 11, leader changed from ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 11 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:12:12.384135 13755 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 13.
I20260709 12:12:12.394083 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:12.394912 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:12.388527 13758 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 16.
I20260709 12:12:12.373262 13761 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 16.
W20260709 12:12:12.313892 19598 consensus_meta.cc:287] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.540s	user 0.011s	sys 0.000s
I20260709 12:12:12.409363 13762 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 17.
I20260709 12:12:12.299739 19415 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:12.335083 19761 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
W20260709 12:12:12.411417 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 75242.9us
I20260709 12:12:12.442692 13726 leader_election.cc:304] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:12.391764 13727 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:12.405377 13581 catalog_manager.cc:5697] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:12:12.405244 19769 log.cc:927] Time spent T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:12:12.413313 19166 raft_consensus.cc:2749] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:12.389411 19449 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:12.426160 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:12.456379 13756 raft_consensus.cc:2468] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 16.
W20260709 12:12:12.428861 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 127224us
I20260709 12:12:12.458887 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:12.408896 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:12.435891 13835 raft_consensus.cc:1240] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:12.436888 14414 raft_consensus.cc:1240] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 13. Current term is 14. Ops: []
W20260709 12:12:12.408064 19673 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.028s	sys 0.038s
I20260709 12:12:12.413285 19766 consensus_queue.cc:1059] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 12:12:12.450078 13651 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:12:12.450956 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 67852.2us
I20260709 12:12:12.452414 13726 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:12.314360 19669 consensus_queue.cc:1059] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.118s
I20260709 12:12:12.390969 19737 raft_consensus.cc:2749] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:12.455652 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:12.404560 19602 raft_consensus.cc:2804] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:12:12.488785 13763 raft_consensus.cc:1240] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 12:12:12.459005 13800 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:12:12.630059 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 171126us
I20260709 12:12:12.631402 13800 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
W20260709 12:12:12.433957 19770 log.cc:927] Time spent T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 12:12:12.317646 19636 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:12.376492 19648 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:12.424304 19563 consensus_queue.cc:1059] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.073s
I20260709 12:12:12.449257 19761 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:12.406383 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:12.628680 13759 raft_consensus.cc:2393] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 20: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:12.454164 19322 raft_consensus.cc:2749] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:12.410516 19746 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:12.517486 13755 raft_consensus.cc:1240] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 18. Current term is 19. Ops: [15.11-18.12]
I20260709 12:12:12.634646 13800 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:12.458506 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:12:12.473312 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:12.428726 19718 raft_consensus.cc:2749] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:12.460186 19582 raft_consensus.cc:2804] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:12.427882 19415 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:12.630539 13727 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:12.437650 19583 consensus_queue.cc:1048] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.215s
W20260709 12:12:12.688354 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 53818.9us
I20260709 12:12:12.631482 19602 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:12.459697 19330 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:12.632761 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 316574us
I20260709 12:12:12.650389 19742 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:12.631017 19689 raft_consensus.cc:2804] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:12:12.648851 19768 log.cc:927] Time spent T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
W20260709 12:12:12.655293 19756 log.cc:927] Time spent T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 12:12:12.429277 19598 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:12.649808 19471 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:12:12.634016 19673 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.919s	user 0.028s	sys 0.044s
I20260709 12:12:12.536062 19687 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.656929 19737 raft_consensus.cc:2749] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:12.658391 19576 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:12.483881 19725 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:12.512909 19511 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:12.683526 19582 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:12.692376 19602 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:12.696228 19746 raft_consensus.cc:2804] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:12.697139 19718 raft_consensus.cc:2749] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:12:12.716269 19710 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.000s	user 0.013s	sys 0.020s
I20260709 12:12:12.695675 19330 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:12.723910 19582 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:12.718125 19782 raft_consensus.cc:2804] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:12.722828 19746 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:12.697124 19777 consensus_queue.cc:1059] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 12:12:12.697742 19742 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:12.811131 19746 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:12.812867 19742 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:12.731004 19576 raft_consensus.cc:697] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 20 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:12.735231 19741 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.720825 19687 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:12.741194 19568 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:12.817674 19636 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:12.822757 19689 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:12.841326 19689 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:12.830440 19725 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:12.827179 19741 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:12.848471 19741 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:12.831554 19648 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:12.832329 19777 raft_consensus.cc:3055] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:12.849788 19777 raft_consensus.cc:740] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:12.851217 19777 consensus_queue.cc:260] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:12.852900 19777 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:12.836839 19717 consensus_meta.cc:287] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.553s	user 0.010s	sys 0.000s
I20260709 12:12:12.799083 19718 raft_consensus.cc:2804] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:12.890172 19782 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:12.890348 19761 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:12.906915 19761 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:12.891989 19782 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:12.962402 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:12:12.653301 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 203319us
I20260709 12:12:12.976505 13754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 2987) took 1603 ms. Trace:
I20260709 12:12:12.977385 13754 rpcz_store.cc:276] 0709 12:12:11.372861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:11.615832 (+242971us) service_pool.cc:224] Handling call
0709 12:12:11.616221 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:12.083161 (+466940us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:12:12.083206 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:12.093643 (+ 10437us) log.cc:844] Serialized 26 byte log entry
0709 12:12:12.595344 (+501701us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:12:12.595387 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:12.595472 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:12.975577 (+380105us) raft_consensus.cc:1685] finished
0709 12:12:12.975630 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:12.976104 (+   474us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22643,"raft.queue_time_us":152243,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":9193,"thread_start_us":896117,"threads_started":2,"wal-append.queue_time_us":634221}
I20260709 12:12:12.982035 13763 raft_consensus.cc:1240] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:12.982707 13758 raft_consensus.cc:1240] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 12:12:12.680195 13761 raft_consensus.cc:1275] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:12:12.984690 13760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 897) took 1009 ms. Trace:
I20260709 12:12:12.985386 13760 rpcz_store.cc:276] 0709 12:12:11.975227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:11.975502 (+   275us) service_pool.cc:224] Handling call
0709 12:12:11.975953 (+   451us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:11.986942 (+ 10989us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:11.986976 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:11.987473 (+   497us) log.cc:844] Serialized 26 byte log entry
0709 12:12:12.181932 (+194459us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:12.197675 (+ 15743us) log.cc:844] Serialized 14 byte log entry
0709 12:12:12.197908 (+   233us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:12.197981 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:12.983954 (+785973us) raft_consensus.cc:1685] finished
0709 12:12:12.984018 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:12.984399 (+   381us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21761,"prepare.queue_time_us":10414,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":12906,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":209,"thread_start_us":179756,"threads_started":1,"wal-append.queue_time_us":265929}
W20260709 12:12:12.990942 13831 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.017s	sys 0.033s
W20260709 12:12:12.991623 13831 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.017s	sys 0.033s
I20260709 12:12:12.997011 19183 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:12.998397 19183 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:13.002242 19450 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:13.003809 19450 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:12.825630 19576 consensus_queue.cc:237] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:12.831141 19682 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:12.833236 19687 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:12.982790 13759 raft_consensus.cc:1240] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:12.739880 19421 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199)
I20260709 12:12:12.983673 13757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 2203) took 1760 ms. Trace:
W20260709 12:12:12.736282 19710 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.032s	user 0.014s	sys 0.020s
I20260709 12:12:13.092259 19710 raft_consensus.cc:697] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 15 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:13.095073 19710 consensus_queue.cc:237] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:13.096314 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:12.998397 19270 consensus_meta.cc:287] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.709s	user 0.007s	sys 0.011s
I20260709 12:12:13.099078 19716 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.100162 19716 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:13.017344 19330 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:13.103649 19294 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.032945 19183 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:13.068398 19463 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
W20260709 12:12:13.071278 19747 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.045s	sys 0.046s
I20260709 12:12:13.071795 14415 raft_consensus.cc:2393] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 17: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
W20260709 12:12:13.005914 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 695241us
I20260709 12:12:13.071048 19782 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:13.081604 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 450933us
I20260709 12:12:13.076542 19598 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:12.886386 19718 raft_consensus.cc:697] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:12:13.078517 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 625944us
W20260709 12:12:13.089443 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 115645us
I20260709 12:12:13.104952 19294 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:12.828460 19511 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 17 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:13.084471 13757 rpcz_store.cc:276] 0709 12:12:11.223041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:11.223547 (+   506us) service_pool.cc:224] Handling call
0709 12:12:11.223820 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:12.329019 (+1105199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:12.982893 (+653874us) spinlock_profiling.cc:243] Waited 990 ms on lock 0x7b54000889d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:12.983391 (+   498us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2275862784}
W20260709 12:12:13.119812 19747 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.045s	sys 0.046s
I20260709 12:12:13.141549 19636 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.142541 19636 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:13.144248 19294 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:13.153875 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 646598us
I20260709 12:12:13.154531 19606 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:13.154722 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:13.155689 19606 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:13.157846 19741 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.158814 19741 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:13.160802 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:13.162146 13651 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:13.162200 19463 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:13.163057 19449 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:13.163885 13651 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:12:13.164264 19555 consensus_meta.cc:287] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.929s	user 0.010s	sys 0.003s
I20260709 12:12:13.165311 19555 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:13.168107 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:13.169734 13683 raft_consensus.cc:3060] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:13.170246 13834 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.012s	sys 0.008s
I20260709 12:12:13.172632 19782 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:13.173579 14415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41692 (request call id 944) took 1046 ms. Trace:
I20260709 12:12:13.161753 19718 consensus_queue.cc:237] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:13.174365 14415 rpcz_store.cc:276] 0709 12:12:12.127283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:12.127445 (+   162us) service_pool.cc:224] Handling call
0709 12:12:13.173213 (+1045768us) spinlock_profiling.cc:243] Waited 769 ms on lock 0x7b54005f1ed4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:13.173468 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1769380096}
I20260709 12:12:13.169363 19555 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:13.169438 14412 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 13.
I20260709 12:12:13.165354 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:13.202338 13832 raft_consensus.cc:1240] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:13.207517 19421 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.210700 19421 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:13.211483 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:13.208230 19564 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.214341 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:13.215070 19564 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:13.218987 14412 raft_consensus.cc:1240] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:13.219027 19183 raft_consensus.cc:2804] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:13.220858 14410 raft_consensus.cc:1275] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:12:13.221194 19183 raft_consensus.cc:697] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 13 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:13.222839 19183 consensus_queue.cc:237] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:13.192806 19166 raft_consensus.cc:3055] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:13.205708 14414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41700 (request call id 870) took 1028 ms. Trace:
I20260709 12:12:13.226613 19166 raft_consensus.cc:740] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:13.226886 14414 rpcz_store.cc:276] 0709 12:12:12.177465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:12.177593 (+   128us) service_pool.cc:224] Handling call
0709 12:12:12.177922 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:12.635062 (+457140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:13.205110 (+570048us) spinlock_profiling.cc:243] Waited 259 ms on lock 0x7b54006d0e54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:13.205470 (+   360us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":594989952}
I20260709 12:12:13.228036 19166 consensus_queue.cc:260] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:13.229993 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:13.230584 13727 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:13.232056 19447 raft_consensus.cc:2804] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:13.232630 19447 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:13.233155 19447 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:13.233086 13727 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:13.230826 19564 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:13.229555 19166 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:13.183189 19636 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:13.218355 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:12:13.266490 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 506013us
I20260709 12:12:13.268071 19606 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:13.272641 19795 log.cc:927] Time spent T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.181s	user 0.001s	sys 0.004s
I20260709 12:12:13.278041 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:13.282958 13688 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:13.283146 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:13.284366 13680 raft_consensus.cc:2410] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for term 16 because replica has last-logged OpId of term: 14 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 13.
I20260709 12:12:13.315019 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:13.314766 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:13.297331 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:13.319880 13759 raft_consensus.cc:2393] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 17: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:13.319890 13829 raft_consensus.cc:2410] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for term 16 because replica has last-logged OpId of term: 14 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 13.
I20260709 12:12:13.320426 13834 raft_consensus.cc:2393] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 23: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:13.286005 19791 raft_consensus.cc:2749] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:13.319967 19564 raft_consensus.cc:3055] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:13.321362 19564 raft_consensus.cc:740] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:13.286386 19421 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:13.322239 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:13.289728 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:13.323477 13828 raft_consensus.cc:2393] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 17: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:13.322908 19564 consensus_queue.cc:260] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:13.324056 19701 raft_consensus.cc:2804] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:13.324158 19564 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:13.324860 19701 raft_consensus.cc:697] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 16 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:13.311975 13832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 1091) took 1020 ms. Trace:
I20260709 12:12:13.323637 13685 raft_consensus.cc:2393] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 17: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:13.297909 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:13.314495 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:13.333361 13651 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:12:13.335363 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 60015.5us
I20260709 12:12:13.327615 13832 rpcz_store.cc:276] 0709 12:12:12.291969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:12.300166 (+  8197us) service_pool.cc:224] Handling call
0709 12:12:13.201555 (+901389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:13.203097 (+  1542us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:13.311659 (+108562us) spinlock_profiling.cc:243] Waited 877 ms on lock 0x7b540020e250. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:13.311904 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2016433920}
I20260709 12:12:13.298804 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:13.299636 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:12:13.282101 19707 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.018s	sys 0.019s
I20260709 12:12:13.295598 19450 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:13.340137 19737 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:13.313886 19782 consensus_queue.cc:1059] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:12:13.292249 19322 raft_consensus.cc:3055] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:13.344373 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:13.347360 13837 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:13.350991 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 114719us
I20260709 12:12:13.312538 19555 consensus_queue.cc:1059] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
W20260709 12:12:13.349936 19707 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.836s	user 0.019s	sys 0.019s
I20260709 12:12:13.349211 19322 raft_consensus.cc:740] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:13.358992 19737 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:13.389540 13830 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 13.
I20260709 12:12:13.407297 13836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 3115) took 1149 ms. Trace:
I20260709 12:12:13.376071 19450 raft_consensus.cc:2804] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:13.410750 13688 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 18.
W20260709 12:12:13.413271 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 180487us
I20260709 12:12:13.393846 19716 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:13.407840 13836 rpcz_store.cc:276] 0709 12:12:12.183016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:12.186645 (+  3629us) service_pool.cc:224] Handling call
0709 12:12:12.186976 (+   331us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:12.276561 (+ 89585us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:12.276591 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:12.277154 (+   563us) log.cc:844] Serialized 52 byte log entry
0709 12:12:12.993201 (+716047us) spinlock_profiling.cc:243] Waited 2 ms on lock 0x7b18003791e0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e82e07 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9fc02 00007fa927b2720b 00007fa927b2cd23 00007fa927b2d0d1 00007fa927f48a0f
0709 12:12:13.258082 (+264881us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:13.268872 (+ 10790us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:13.268980 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:13.315508 (+ 46528us) raft_consensus.cc:1685] finished
0709 12:12:13.315543 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:13.331902 (+ 16359us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3984,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":13043,"spinlock_wait_cycles":4592384,"thread_start_us":119145,"threads_started":1,"wal-append.queue_time_us":992428}
I20260709 12:12:13.365840 19701 consensus_queue.cc:237] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:13.425983 19415 consensus_meta.cc:287] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.730s	user 0.015s	sys 0.003s
I20260709 12:12:13.442586 19415 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:13.426026 19746 consensus_meta.cc:287] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.614s	user 0.010s	sys 0.019s
W20260709 12:12:13.455349 19582 consensus_meta.cc:287] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.635s	user 0.009s	sys 0.010s
I20260709 12:12:13.455907 19582 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:13.464018 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 139579us
W20260709 12:12:13.465246 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 119588us
I20260709 12:12:13.466682 13837 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 17.
I20260709 12:12:13.439209 19450 raft_consensus.cc:697] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 16 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:13.475276 13651 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:13.475446 19777 consensus_queue.cc:1059] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 12:12:13.469754 19710 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.479012 19710 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:13.480346 19741 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:13.414780 19636 consensus_queue.cc:1048] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:12:13.486372 13683 raft_consensus.cc:2468] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 14.
I20260709 12:12:13.488503 13758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 2211) took 1227 ms. Trace:
I20260709 12:12:13.469590 19737 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:13.489063 13758 rpcz_store.cc:276] 0709 12:12:12.261510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:12.627861 (+366351us) service_pool.cc:224] Handling call
0709 12:12:12.628452 (+   591us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:12.983462 (+355010us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:13.488068 (+504606us) spinlock_profiling.cc:243] Waited 353 ms on lock 0x7b540038c2d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:13.488406 (+   338us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":812681088}
I20260709 12:12:13.468851 19746 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:13.488425 13800 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:13.493572 19746 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:13.497300 19330 raft_consensus.cc:2749] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:13.498116 19415 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:12:13.563043 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 55449us
W20260709 12:12:13.564301 19602 consensus_meta.cc:287] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.769s	user 0.011s	sys 0.009s
I20260709 12:12:13.564531 19322 consensus_queue.cc:260] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:13.564862 19602 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:13.566305 19322 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:13.567116 19801 log.cc:927] Time spent T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 12:12:13.567679 19602 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:13.564357 19183 consensus_queue.cc:1048] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
W20260709 12:12:13.569859 19802 log.cc:927] Time spent T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 12:12:13.571786 19710 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:13.572150 19450 consensus_queue.cc:237] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:13.574905 14411 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 23.
I20260709 12:12:13.575819 19463 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:13.574026 19721 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.577241 19721 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:13.580497 19721 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:13.581068 19583 raft_consensus.cc:3055] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:13.586287 19421 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.581672 19583 raft_consensus.cc:740] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:13.609344 14379 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:13.598567 19746 raft_consensus.cc:2804] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:13.598060 19721 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:13.623538 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:13.628624 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:13.630417 14380 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:13.623662 19746 raft_consensus.cc:697] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 17 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:13.624250 19707 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.641827 19583 consensus_queue.cc:260] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:13.642549 13756 raft_consensus.cc:1240] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 LEADER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:13.637933 19683 consensus_queue.cc:1059] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.004s
I20260709 12:12:13.616575 19682 consensus_queue.cc:1059] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 12:12:13.650554 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:13.633756 14379 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:12:13.645681 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 138684us
I20260709 12:12:13.652608 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:13.652782 14380 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:13.635056 19582 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:13.625380 19421 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:13.683228 19707 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:13.685012 19421 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:13.654217 13837 raft_consensus.cc:2393] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 19: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:13.657519 19564 raft_consensus.cc:3055] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:13.659937 14411 raft_consensus.cc:1275] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:12:13.661535 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:13.662329 19745 raft_consensus.cc:2749] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:13.636307 19602 consensus_queue.cc:1059] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 12:12:13.662503 19746 consensus_queue.cc:237] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:13.637977 19721 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:13.665149 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:12:13.666602 19803 log.cc:927] Time spent T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 12:12:13.668601 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
W20260709 12:12:13.668793 19689 consensus_meta.cc:287] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.827s	user 0.003s	sys 0.015s
I20260709 12:12:13.661561 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:12:13.676203 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:13.679031 19712 raft_consensus.cc:3055] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:12:13.680339 13727 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:13.680555 19741 consensus_queue.cc:1048] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:13.680410 19166 consensus_queue.cc:1059] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:13.681090 19716 consensus_queue.cc:1059] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:13.708894 19716 raft_consensus.cc:3055] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:12:13.687027 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:13.709584 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:13.693506 19564 raft_consensus.cc:740] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:13.712110 19760 raft_consensus.cc:2804] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:13.713207 13830 raft_consensus.cc:2393] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 13: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:13.713730 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:13.732944 13761 raft_consensus.cc:2393] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 12: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:13.713238 19744 raft_consensus.cc:2804] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:13.715083 19721 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:13.708091 19166 raft_consensus.cc:3055] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:13.668813 19583 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:13.715247 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:13.716270 19447 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:13.713307 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:13.718227 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:13.719223 13836 raft_consensus.cc:2410] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 12:12:13.720039 19673 consensus_queue.cc:1048] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 12:12:13.701009 19712 raft_consensus.cc:740] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:13.714205 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:12:13.722415 19810 log.cc:927] Time spent T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:12:13.724628 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:13.725073 13727 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:13.725461 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:13.725714 19322 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:13.726153 19800 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:13.702612 14410 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 14.
I20260709 12:12:13.726536 13762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 2212) took 1464 ms. Trace:
W20260709 12:12:13.730826 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:13.733331 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 95879.2us
I20260709 12:12:13.743360 19602 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.776141 19800 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:13.776590 19602 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:13.776938 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:12:13.778098 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 53123.7us
I20260709 12:12:13.730472 19716 raft_consensus.cc:740] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:13.780244 19791 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:13.779675 13762 rpcz_store.cc:276] 0709 12:12:12.261736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:12.636650 (+374914us) service_pool.cc:224] Handling call
0709 12:12:12.637095 (+   445us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:12.637602 (+   507us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:12.637643 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:12.649169 (+ 11526us) log.cc:844] Serialized 26 byte log entry
0709 12:12:13.150616 (+501447us) spinlock_profiling.cc:243] Waited 3.7 ms on lock 0x7b1800331ea0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e82e07 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9fc02 00007fa927b2720b 00007fa927b2cd23 00007fa927b2d0d1 00007fa927f48a0f
0709 12:12:13.349971 (+199355us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:13.353679 (+  3708us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:13.357080 (+  3401us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:13.726088 (+369008us) raft_consensus.cc:1685] finished
0709 12:12:13.726113 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:13.726345 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3069,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":7031,"spinlock_wait_cycles":8512384,"thread_start_us":109061,"threads_started":1,"wal-append.queue_time_us":795771}
I20260709 12:12:13.780092 19716 consensus_queue.cc:260] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:13.785039 19716 raft_consensus.cc:3060] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:13.786392 13763 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:13.789211 13831 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 18.
I20260709 12:12:13.734676 14414 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 11.
I20260709 12:12:13.735456 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:13.791165 13834 raft_consensus.cc:2368] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 16. Current term is 17.
I20260709 12:12:13.736058 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:13.792403 13761 raft_consensus.cc:2393] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 11: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:13.731532 19582 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:13.736903 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:13.796921 13757 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 14.
I20260709 12:12:13.737156 19421 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:13.741819 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:13.796603 19582 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:13.804095 19800 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:13.805963 19800 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:13.807010 19800 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:13.801645 19582 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:13.824342 13763 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 19.
I20260709 12:12:13.816105 19721 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:13.816499 13755 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 19.
I20260709 12:12:13.773973 19744 raft_consensus.cc:697] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 18 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
W20260709 12:12:13.830180 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:13.831298 14380 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:13.831825 19602 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:13.831235 19421 consensus_queue.cc:1059] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:13.832460 19790 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:13.828876 19606 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:13.835345 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:13.836122 13834 raft_consensus.cc:1240] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:13.738037 19683 raft_consensus.cc:3055] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:13.826973 13754 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 16.
I20260709 12:12:13.739746 19166 raft_consensus.cc:740] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:13.840222 13837 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 15.
I20260709 12:12:13.836920 14379 leader_election.cc:304] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:13.740919 19183 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.846154 13760 raft_consensus.cc:1275] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:12:13.818615 19322 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:13.842732 13759 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 20.
I20260709 12:12:13.867416 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:13.817384 19760 raft_consensus.cc:697] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 14 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:13.837149 19707 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:13.731127 19689 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:13.868244 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:13.816231 19463 raft_consensus.cc:3055] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:13.833788 13828 raft_consensus.cc:1240] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:13.904877 19710 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:13.909987 13833 raft_consensus.cc:1240] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:13.955809 13831 raft_consensus.cc:2393] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 13: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:13.956768 13830 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:13.963419 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 183653us
I20260709 12:12:13.965816 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:13.969439 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:13.970443 13837 raft_consensus.cc:2468] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 15.
I20260709 12:12:13.898450 19791 raft_consensus.cc:2749] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:13.907526 19582 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:13.909677 19800 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:13.909345 19683 raft_consensus.cc:740] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:13.959848 19322 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:13.995255 13837 raft_consensus.cc:1275] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 12:12:13.989502 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:13.960063 19463 raft_consensus.cc:740] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:13.996411 13762 raft_consensus.cc:1240] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:13.923929 19716 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:14.011574 19511 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.012490 19511 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:14.014707 19683 consensus_queue.cc:260] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:14.016353 13828 raft_consensus.cc:1275] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:12:14.016579 19683 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:14.018752 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:14.022598 19270 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:14.023407 19270 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:14.026845 19682 raft_consensus.cc:2804] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:14.027402 19682 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:14.027813 19682 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:14.018055 19744 consensus_queue.cc:237] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:13.971434 19721 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:13.990154 19576 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:14.104650 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:14.107553 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:14.112596 13832 raft_consensus.cc:1240] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 17 LEADER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 12:12:14.050608 19582 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:14.107154 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:14.114027 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:13.990794 19606 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:13.996873 19183 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:13.969457 19564 consensus_queue.cc:260] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:14.031723 19710 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:14.149324 19463 consensus_queue.cc:260] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:14.150619 19710 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:14.151166 19463 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:14.153007 13833 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:14.158020 19576 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:14.162039 19166 consensus_queue.cc:260] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:14.002749 19790 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:14.165114 19790 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:14.169884 19447 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:14.170238 19606 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:14.179710 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:14.141249 19760 consensus_queue.cc:237] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:14.189738 19818 log.cc:927] Time spent T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 12:12:14.140514 19712 consensus_queue.cc:260] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:14.193163 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:14.194094 19712 raft_consensus.cc:3060] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:14.194386 19582 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:14.196118 19689 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:14.196933 19183 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:14.197814 19511 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:14.198827 19684 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.199501 19684 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:14.202171 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:14.203075 19745 raft_consensus.cc:2749] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:14.203608 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:14.204641 13837 raft_consensus.cc:2393] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 13: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:14.194700 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:14.205482 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:14.214383 13828 raft_consensus.cc:2410] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 12:12:14.206332 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:14.213392 19721 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:14.217305 13837 raft_consensus.cc:2393] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 16: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
W20260709 12:12:14.216392 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 44434.5us
I20260709 12:12:14.062575 19716 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:14.218475 13835 raft_consensus.cc:2468] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 12.
I20260709 12:12:14.231220 13829 raft_consensus.cc:2410] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 16 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 12:12:14.232805 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:14.235349 13727 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:14.218246 19576 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:14.241360 13727 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:14.245102 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:14.246059 13828 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 18.
I20260709 12:12:14.250876 13832 raft_consensus.cc:1275] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 12:12:14.251310 13832 pending_rounds.cc:85] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 7
I20260709 12:12:14.251574 13832 pending_rounds.cc:107] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 12:12:14.251888 13832 raft_consensus.cc:2889] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:14.257495 19270 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:14.261584 13837 raft_consensus.cc:3055] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:14.262722 13837 raft_consensus.cc:740] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:14.278513 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
W20260709 12:12:14.282298 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:14.248356 19689 raft_consensus.cc:2804] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:14.260284 19800 raft_consensus.cc:2804] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:14.286793 13835 raft_consensus.cc:1240] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:14.261265 19684 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:14.304809 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:14.303722 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:14.307539 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:14.308337 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:14.275787 19576 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:14.300421 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:14.311002 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:14.339902 13837 consensus_queue.cc:260] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:14.351322 13837 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:14.300283 19800 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:14.353338 13836 raft_consensus.cc:1275] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:12:14.355063 13833 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 19.
I20260709 12:12:14.358968 13835 raft_consensus.cc:2393] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 15: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:14.308547 19689 raft_consensus.cc:697] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:12:14.363585 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:14.341765 19721 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:14.369031 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 537764us
I20260709 12:12:14.386936 14414 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 15.
I20260709 12:12:14.350461 19576 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:14.354604 19800 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:14.363701 19270 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:14.402029 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 670987us
W20260709 12:12:14.403096 13651 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.004s	sys 0.018s
W20260709 12:12:14.404582 13651 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.005s	sys 0.018s
I20260709 12:12:14.411579 13837 raft_consensus.cc:1275] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
W20260709 12:12:14.413352 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 301344us
I20260709 12:12:14.415979 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:14.418552 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:14.419824 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:12:14.422879 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:14.423527 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:14.420836 14412 raft_consensus.cc:2468] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 15.
W20260709 12:12:14.429042 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 320735us
I20260709 12:12:14.431905 14414 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:14.418756 19834 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.403249 19721 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:14.443872 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:14.433125 19669 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.002s	sys 0.008s
I20260709 12:12:14.433429 19828 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.415165 19270 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:14.470302 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:14.459724 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:14.459915 14379 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:14.466423 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:14.468145 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:12:14.465970 19669 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.739s	user 0.003s	sys 0.009s
I20260709 12:12:14.488692 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:14.495452 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:14.465473 19716 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:14.458647 19834 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:14.500820 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:14.506173 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:14.468580 19830 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.542861 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:14.543053 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:14.543772 13680 raft_consensus.cc:2393] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 16: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:14.543308 19830 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:14.546187 19830 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:14.547322 14407 raft_consensus.cc:2468] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 17.
I20260709 12:12:14.517535 19683 raft_consensus.cc:2804] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:14.494843 19793 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.519774 19834 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:14.523123 19721 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:14.568320 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:12:14.530695 19833 log.cc:927] Time spent T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:12:14.530957 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:12:14.531229 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 103722us
I20260709 12:12:14.537075 13837 raft_consensus.cc:2468] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 12.
I20260709 12:12:14.537317 14414 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 17.
I20260709 12:12:14.537530 13685 raft_consensus.cc:2393] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 16: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
W20260709 12:12:14.542083 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:14.532339 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:14.542606 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:14.576483 13835 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 15.
I20260709 12:12:14.587829 13682 raft_consensus.cc:1240] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 12:12:14.588066 13684 raft_consensus.cc:1240] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:12:14.589708 13684 raft_consensus.cc:1240] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 18. Current term is 19. Ops: []
W20260709 12:12:14.590108 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:14.590143 19830 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
W20260709 12:12:14.590761 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:14.592677 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:14.592969 13680 raft_consensus.cc:1240] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:14.593920 13834 raft_consensus.cc:1240] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:14.583529 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:14.589417 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:14.590989 19830 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:14.486284 19828 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:14.600637 13682 raft_consensus.cc:2410] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:12:14.601190 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:14.609849 14414 raft_consensus.cc:1275] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:12:14.658703 13837 raft_consensus.cc:2468] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 17.
I20260709 12:12:14.610509 13801 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:12:14.660181 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 49755.2us
I20260709 12:12:14.610948 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:14.661207 13684 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:14.610556 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:14.612030 19832 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.632742 13679 raft_consensus.cc:2393] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 16: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:14.602073 13685 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 20.
I20260709 12:12:14.638164 13680 raft_consensus.cc:1240] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 16. Current term is 17. Ops: [12.7-16.9]
I20260709 12:12:14.638628 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:14.642024 19760 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:14.642159 19840 log.cc:927] Time spent T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 12:12:14.643072 13681 raft_consensus.cc:1240] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 12:12:14.574156 19683 raft_consensus.cc:697] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 16 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:14.649395 13727 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:14.495329 19689 consensus_queue.cc:237] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:14.582898 19793 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:14.654022 19833 log.cc:927] Time spent T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 12:12:14.637470 19718 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:14.676771 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:14.642313 19716 consensus_queue.cc:1059] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 15.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:12:14.679040 14379 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:14.686064 19835 consensus_queue.cc:1048] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:12:14.690111 19817 log.cc:927] Time spent T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.336s	user 0.004s	sys 0.000s
I20260709 12:12:14.678886 19741 raft_consensus.cc:2804] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:14.693307 19793 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:14.694028 19718 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:14.711053 13726 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:14.695398 19166 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:14.684589 13685 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 14.
I20260709 12:12:14.703449 13684 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 12.
I20260709 12:12:14.666332 19712 raft_consensus.cc:2804] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:14.712666 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:14.735777 13682 raft_consensus.cc:2410] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
W20260709 12:12:14.719616 13830 consensus_meta.cc:287] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.758s	user 0.012s	sys 0.001s
I20260709 12:12:14.706703 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:14.720373 13686 raft_consensus.cc:1275] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 13 index: 5. Preceding OpId from leader: term: 15 index: 6. (index mismatch)
I20260709 12:12:14.726545 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:14.738140 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:14.731069 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:14.740594 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:14.731930 13801 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:14.745100 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:14.745429 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:14.738628 13679 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 19.
I20260709 12:12:14.737682 19583 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:14.727448 19673 raft_consensus.cc:3055] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:14.749431 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:14.750133 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:14.750379 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:14.779368 13679 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:14.751623 13684 raft_consensus.cc:1275] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:12:14.780066 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:12:14.764174 14380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:14.749187 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:12:14.768267 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 86368.8us
I20260709 12:12:14.733068 19832 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:14.786630 19832 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:14.733747 19712 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:14.754284 14411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41700 (request call id 880) took 1027 ms. Trace:
I20260709 12:12:14.782155 13682 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 18.
I20260709 12:12:14.791697 13685 raft_consensus.cc:1240] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:14.784432 13726 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:14.793634 13830 raft_consensus.cc:2410] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 12:12:14.777619 13686 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 13.
I20260709 12:12:14.787313 19712 raft_consensus.cc:3060] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:14.795169 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 131777us
I20260709 12:12:14.795805 13679 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 17.
I20260709 12:12:14.746392 19741 raft_consensus.cc:697] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:14.683465 19760 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:14.799162 13829 raft_consensus.cc:1240] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 19. Current term is 20. Ops: []
W20260709 12:12:14.796020 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 53108.5us
W20260709 12:12:14.756316 19848 log.cc:927] Time spent T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
W20260709 12:12:14.754772 19857 log.cc:927] Time spent T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:12:14.746659 19576 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:14.795943 19817 log.cc:927] Time spent T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:12:14.749295 19854 raft_consensus.cc:2749] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:14.768352 19564 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:14.811441 19858 raft_consensus.cc:2749] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:14.813243 19760 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:14.788604 14411 rpcz_store.cc:276] 0709 12:12:13.727231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:13.731741 (+  4510us) service_pool.cc:224] Handling call
0709 12:12:13.736277 (+  4536us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:13.741050 (+  4773us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:12:13.836052 (+ 95002us) log.cc:844] Serialized 14 byte log entry
0709 12:12:14.021218 (+185166us) spinlock_profiling.cc:243] Waited 3.39 ms on lock 0x7b1800057fa0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924ea03f3 00007fa924ea27c1 00007fa924ea2779 00007fa924ea2709 00007fa924ea26d1 00007fa924ea19cd 0000000000388634 0000000000388479 00007fa924e8383a
0709 12:12:14.262364 (+241146us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:14.302365 (+ 40001us) log.cc:844] Serialized 26 byte log entry
0709 12:12:14.302589 (+   224us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:14.302641 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:14.302761 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:14.753862 (+451101us) raft_consensus.cc:1685] finished
0709 12:12:14.754009 (+   147us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:14.754189 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4342,"prepare.queue_time_us":66909,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":57,"raft.queue_time_us":7200,"raft.run_cpu_time_us":342,"raft.run_wall_time_us":82455,"spinlock_wait_cycles":7798528,"thread_start_us":355322,"threads_started":1,"wal-append.queue_time_us":543730}
W20260709 12:12:14.800590 19330 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.043s	sys 0.054s
I20260709 12:12:14.780932 19859 raft_consensus.cc:2749] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:14.758178 19673 raft_consensus.cc:740] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:14.755600 19583 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:14.826118 13800 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:14.824642 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:14.836221 14414 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 11.
W20260709 12:12:14.838442 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:14.827875 13679 raft_consensus.cc:1240] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 19 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:14.819060 19270 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:14.819334 19828 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:12:14.842085 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:14.767241 19683 consensus_queue.cc:237] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:14.845357 14379 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:12:14.848907 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 64604us
W20260709 12:12:14.834213 19330 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.044s	sys 0.055s
I20260709 12:12:14.854434 13727 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:14.855924 13679 raft_consensus.cc:1240] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 16 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:14.851403 19270 raft_consensus.cc:2804] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:14.864636 19718 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:14.860330 19828 raft_consensus.cc:2804] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:14.887923 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:14.890153 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:12:14.893729 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 44036.6us
I20260709 12:12:14.894728 13726 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:14.886847 19828 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:14.872913 19854 raft_consensus.cc:2749] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:14.896819 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:14.900138 13685 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:14.879099 19270 raft_consensus.cc:697] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 17 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:14.898815 19828 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:14.907539 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:14.908420 13679 raft_consensus.cc:2468] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 14.
W20260709 12:12:14.916904 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 185099us
I20260709 12:12:14.918027 13801 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:14.920624 13763 raft_consensus.cc:1275] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:12:14.923965 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:14.924556 13726 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:14.924873 13759 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 18.
I20260709 12:12:14.928190 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:14.933195 13679 raft_consensus.cc:1240] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:14.933561 13726 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:14.901736 19830 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:14.930310 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:14.929021 13760 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 16.
W20260709 12:12:14.935736 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 106641us
I20260709 12:12:14.940454 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:12:14.929939 19846 log.cc:927] Time spent T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.230s	user 0.000s	sys 0.002s
I20260709 12:12:14.943610 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:14.948220 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:14.953606 13681 raft_consensus.cc:2393] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 17: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:14.935647 19791 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.920509 19842 consensus_queue.cc:1059] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 12:12:14.891006 19741 consensus_queue.cc:237] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:14.957468 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:14.940189 19166 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.960843 13755 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 11.
I20260709 12:12:14.971463 13679 raft_consensus.cc:1275] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 12:12:14.962790 13756 raft_consensus.cc:1275] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:12:14.963701 13760 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 15.
W20260709 12:12:14.970017 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 149679us
I20260709 12:12:14.929733 19330 consensus_queue.cc:1059] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.024s
W20260709 12:12:14.975320 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:14.972123 13679 pending_rounds.cc:85] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 9
I20260709 12:12:14.947374 19855 raft_consensus.cc:2749] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:14.979372 13679 pending_rounds.cc:107] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 12:12:14.979892 13679 raft_consensus.cc:2889] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:14.978377 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:14.961850 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:14.991392 13761 raft_consensus.cc:2410] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:12:14.991654 13800 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:14.953994 19859 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:14.995697 13681 raft_consensus.cc:2393] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 20: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:14.945611 19576 consensus_queue.cc:1048] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 12:12:14.961627 19865 raft_consensus.cc:2749] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:12:15.010296 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:12:15.000177 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 82449.6us
I20260709 12:12:15.015322 13651 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:15.018090 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:15.019713 14380 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:14.981091 19830 raft_consensus.cc:2749] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:15.024192 14380 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:14.994041 19583 leader_election.cc:290] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:14.937282 19673 consensus_queue.cc:260] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:15.032567 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:14.961118 19721 consensus_queue.cc:1048] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 12:12:14.963500 19791 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:15.031383 14380 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:14.978214 19166 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:15.039134 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 105665us
I20260709 12:12:15.040848 13651 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:15.044879 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:15.048306 14414 raft_consensus.cc:2393] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 17: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:12:15.045437 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:15.033353 19330 raft_consensus.cc:3055] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:15.049018 13760 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:15.035564 19744 raft_consensus.cc:2804] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:12:15.046334 19682 consensus_meta.cc:287] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 1.014s	user 0.016s	sys 0.000s
I20260709 12:12:15.039402 19669 raft_consensus.cc:2804] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:12:15.058676 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 97310.5us
I20260709 12:12:15.057999 13651 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:15.056602 19744 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:15.037110 19866 raft_consensus.cc:2804] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:15.067847 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:15.057013 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:15.050575 19583 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:15.074726 13755 raft_consensus.cc:2393] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 13: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:15.048849 19760 raft_consensus.cc:2804] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:12:15.088339 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 97275.7us
W20260709 12:12:15.088729 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:15.090052 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:15.051512 19865 raft_consensus.cc:2749] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:15.055835 19330 raft_consensus.cc:740] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:15.078016 19744 raft_consensus.cc:3060] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:15.011053 19270 consensus_queue.cc:237] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:15.086948 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:15.068879 19669 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:15.074369 19870 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:15.104010 19855 consensus_queue.cc:1048] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 12:12:15.101477 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:15.140612 13829 raft_consensus.cc:2410] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 19 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
W20260709 12:12:15.125880 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:15.137542 13727 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:12:15.101655 19322 consensus_meta.cc:287] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 1.065s	user 0.011s	sys 0.003s
I20260709 12:12:15.146982 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:15.078020 19872 raft_consensus.cc:2804] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:12:15.152266 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 94409.7us
I20260709 12:12:15.133874 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:12:15.148263 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 59062.3us
I20260709 12:12:15.088214 19760 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:15.151844 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:15.095439 19447 raft_consensus.cc:3055] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:12:15.155398 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:15.136217 19800 consensus_meta.cc:287] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.723s	user 0.014s	sys 0.000s
I20260709 12:12:15.096446 19866 raft_consensus.cc:697] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 17 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:15.074201 19682 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:15.179491 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:15.168479 13831 raft_consensus.cc:1240] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:15.153071 13756 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 18.
I20260709 12:12:15.171963 13837 raft_consensus.cc:2393] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 16: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:15.137621 19673 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:15.137950 19669 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:15.168439 13651 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:15.147254 19832 raft_consensus.cc:2804] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:12:15.202840 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 211325us
I20260709 12:12:15.152628 19872 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:15.133901 19835 consensus_queue.cc:1059] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 12:12:15.158586 19793 raft_consensus.cc:2749] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:12:15.211117 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 44972.4us
W20260709 12:12:15.204414 19463 consensus_meta.cc:287] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 1.052s	user 0.017s	sys 0.000s
W20260709 12:12:15.245020 19871 log.cc:927] Time spent T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 12:12:15.174273 19576 raft_consensus.cc:2804] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:15.148396 19870 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:15.246055 19576 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:15.246698 19576 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:15.103775 19583 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:15.248453 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:15.169997 19447 raft_consensus.cc:740] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:15.249641 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:15.250459 13758 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 13.
I20260709 12:12:15.249939 19447 consensus_queue.cc:260] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.6, Last appended by leader: 6, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:15.251374 19447 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:15.251519 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:15.228451 14410 raft_consensus.cc:2393] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 14: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:12:15.252630 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:15.170605 19760 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:15.254966 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:15.217465 19872 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:15.257395 19866 consensus_queue.cc:237] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:15.261230 13754 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:12:15.262446 13754 raft_consensus.cc:606] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
W20260709 12:12:15.262562 19864 log.cc:927] Time spent T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.169s	user 0.000s	sys 0.000s
I20260709 12:12:15.262938 13754 raft_consensus.cc:614] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:12:15.264643 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:15.266009 19869 log.cc:927] Time spent T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
W20260709 12:12:15.267738 19861 log.cc:927] Time spent T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.516s	user 0.003s	sys 0.000s
I20260709 12:12:15.272265 19682 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:15.272483 13688 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 17.
I20260709 12:12:15.155818 19322 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:15.274811 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:15.275692 13833 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:15.280704 13800 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:15.281327 19870 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:15.238652 19791 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:15.216106 19330 consensus_queue.cc:260] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:15.283241 19330 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:15.283560 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:15.283958 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:15.284701 13759 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 16.
I20260709 12:12:15.242388 19166 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:15.275005 19322 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:15.206347 19832 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:15.292266 19832 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:15.186635 19858 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:15.305610 14380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:15.308537 19721 raft_consensus.cc:2804] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:15.335314 13761 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 18.
I20260709 12:12:15.308677 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:15.309383 13756 raft_consensus.cc:1275] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:12:15.311628 19712 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:15.178418 19800 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:15.314232 19882 log.cc:927] Time spent T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:12:15.315840 13685 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 16.
I20260709 12:12:15.318761 13760 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 17.
W20260709 12:12:15.352005 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 199014us
W20260709 12:12:15.365770 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 85144.4us
I20260709 12:12:15.365978 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:15.354566 13651 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
W20260709 12:12:15.367591 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 146023us
I20260709 12:12:15.369169 13754 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:12:15.366788 13758 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 19.
I20260709 12:12:15.369424 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:15.370194 13754 raft_consensus.cc:606] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:15.372869 13754 raft_consensus.cc:614] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:15.342532 19682 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:15.388718 13833 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 14.
W20260709 12:12:15.383782 13652 leader_election.cc:336] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 1.590s (SENT)
I20260709 12:12:15.390616 14380 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:15.353165 19721 raft_consensus.cc:697] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 19 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:15.342881 19877 raft_consensus.cc:2749] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:15.392577 14407 raft_consensus.cc:1275] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 14. (term mismatch)
I20260709 12:12:15.411509 14407 pending_rounds.cc:85] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f: Aborting all ops after (but not including) 13
I20260709 12:12:15.411900 14407 pending_rounds.cc:107] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260709 12:12:15.412253 14407 raft_consensus.cc:2889] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:12:15.393114 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:15.393743 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:15.401795 13800 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:15.407961 13684 raft_consensus.cc:1240] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:15.408707 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:15.417601 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:15.418397 13685 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 17.
W20260709 12:12:15.410974 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 232111us
W20260709 12:12:15.429860 19880 log.cc:927] Time spent T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 12:12:15.432093 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 48516.3us
I20260709 12:12:15.401376 19682 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:15.352509 19858 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:15.431362 19721 consensus_queue.cc:237] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:15.463980 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:15.464773 13683 raft_consensus.cc:2468] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 17.
I20260709 12:12:15.466105 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:15.466928 13681 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 16.
I20260709 12:12:15.467787 14379 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:15.468158 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:15.449566 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:15.469266 13833 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 15.
I20260709 12:12:15.451236 19856 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:15.470017 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:15.470798 13687 raft_consensus.cc:2468] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 12.
I20260709 12:12:15.470696 19856 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:15.452785 19741 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:15.473333 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:12:15.456861 19564 consensus_meta.cc:287] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.632s	user 0.014s	sys 0.000s
W20260709 12:12:15.458391 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 56768.1us
I20260709 12:12:15.461758 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:15.463070 19583 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:12:15.455412 19828 consensus_meta.cc:287] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.519s	user 0.007s	sys 0.002s
W20260709 12:12:15.473114 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:15.425699 19870 raft_consensus.cc:2804] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:15.487929 13836 raft_consensus.cc:2393] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 23: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:15.423961 19421 raft_consensus.cc:2804] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:15.482426 13756 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:12:15.495244 13756 raft_consensus.cc:606] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 LEADER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
W20260709 12:12:15.483680 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 93149.8us
W20260709 12:12:15.493110 19689 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.727s	user 0.007s	sys 0.007s
W20260709 12:12:15.494251 13652 leader_election.cc:336] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 1.626s (SENT)
I20260709 12:12:15.498241 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:15.498492 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:15.500382 13837 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 19.
I20260709 12:12:15.505573 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:15.507179 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:15.507725 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:15.508790 14412 raft_consensus.cc:2393] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 17: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:15.449754 19883 raft_consensus.cc:2804] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:15.511400 13832 raft_consensus.cc:2393] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 18: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:15.482352 19842 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:15.514196 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:12:15.499663 19689 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.008s	sys 0.007s
I20260709 12:12:15.519438 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:15.522918 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:15.526749 13836 raft_consensus.cc:1240] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:15.495168 19828 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:15.528596 19893 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:15.529290 19886 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:15.529206 19893 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:15.542227 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 48004us
I20260709 12:12:15.476902 19760 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:15.546403 19712 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:15.472919 19879 consensus_queue.cc:1048] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 12:12:15.531795 19888 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:15.499423 19683 raft_consensus.cc:2804] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:15.530030 19889 consensus_queue.cc:1059] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:12:15.522002 13757 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 14.
I20260709 12:12:15.534715 19842 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:15.531068 19856 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:15.530562 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:15.564468 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:15.510426 19421 raft_consensus.cc:697] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 14 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
W20260709 12:12:15.570062 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 183302us
I20260709 12:12:15.515592 19883 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:15.487634 19741 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:15.597856 19883 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:15.577976 19886 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:15.599592 19741 leader_election.cc:290] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:15.600360 19886 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:15.601046 19888 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:15.603632 19682 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:15.604293 19888 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:15.606832 19872 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:15.515792 19870 raft_consensus.cc:697] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 17 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
W20260709 12:12:15.575104 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 100831us
I20260709 12:12:15.573994 13756 raft_consensus.cc:1275] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:12:15.583868 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:15.577482 13758 raft_consensus.cc:1275] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:12:15.583642 19576 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:15.586963 14415 raft_consensus.cc:2393] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 18: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:12:15.577219 19877 consensus_queue.cc:1059] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:12:15.584340 13762 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 16.
I20260709 12:12:15.614832 13684 raft_consensus.cc:1275] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 12:12:15.579757 19683 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:15.591254 19875 raft_consensus.cc:3055] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:15.627169 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:15.636969 13837 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 15.
I20260709 12:12:15.628315 14379 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:15.630429 13651 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:15.631100 19891 consensus_queue.cc:1048] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:15.646018 13686 raft_consensus.cc:2393] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 15: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:15.611833 19800 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:15.631912 13652 leader_election.cc:336] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 1.740s (SENT)
I20260709 12:12:15.632031 19894 consensus_queue.cc:1048] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:12:15.633872 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:15.649381 14407 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 15.
I20260709 12:12:15.634831 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:15.649742 19894 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:15.650388 14414 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 20.
I20260709 12:12:15.651120 13760 raft_consensus.cc:1275] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 12:12:15.655900 13727 leader_election.cc:304] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:15.657605 13757 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:12:15.658340 13757 raft_consensus.cc:606] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:15.658712 13757 raft_consensus.cc:614] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:15.618357 19683 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:15.657079 13727 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:15.660745 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:15.609414 19889 consensus_queue.cc:1048] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 12:12:15.661469 14411 raft_consensus.cc:3060] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:15.662576 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:15.662480 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:15.636497 19875 raft_consensus.cc:740] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:15.680087 13837 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:15.650426 19894 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:15.677654 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:15.691332 19859 consensus_meta.cc:287] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.666s	user 0.003s	sys 0.008s
I20260709 12:12:15.691985 19859 raft_consensus.cc:2749] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:15.695580 14380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:15.650919 19898 raft_consensus.cc:2804] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:15.662838 19830 raft_consensus.cc:2804] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:15.643850 19583 consensus_queue.cc:1048] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 12:12:15.713794 13688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 3032) took 1191 ms. Trace:
W20260709 12:12:15.724807 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 44958.9us
I20260709 12:12:15.716324 13688 rpcz_store.cc:276] 0709 12:12:14.530425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:14.530621 (+   196us) service_pool.cc:224] Handling call
0709 12:12:15.708604 (+1177983us) spinlock_profiling.cc:243] Waited 697 ms on lock 0x7b54002bf7d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:15.708746 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1603241344}
I20260709 12:12:15.701244 19886 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:15.660976 19270 consensus_queue.cc:1059] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 12:12:15.771826 19270 raft_consensus.cc:3055] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:12:15.772260 19270 raft_consensus.cc:740] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
W20260709 12:12:15.775339 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 44129us
I20260709 12:12:15.724105 19894 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:15.713439 19421 consensus_queue.cc:237] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:15.742884 19890 raft_consensus.cc:2804] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:15.711712 19830 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:15.744952 19875 consensus_queue.cc:260] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:15.747782 19893 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:15.752259 19760 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:15.727640 19669 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:15.752861 19832 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:15.711916 19898 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:15.763852 19842 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:15.822680 13830 raft_consensus.cc:1275] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:12:15.780095 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:15.823755 19718 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:15.786798 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 143935us
I20260709 12:12:15.787065 13837 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 19.
I20260709 12:12:15.824360 19718 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:15.824962 19564 consensus_queue.cc:1048] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:15.826313 19682 consensus_queue.cc:1048] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:15.826443 19564 consensus_queue.cc:1048] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:15.798678 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:15.797147 19890 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:15.734556 19886 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:15.823933 13726 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.695s (SENT) [suppressed 21 similar messages]
I20260709 12:12:15.773142 19270 consensus_queue.cc:260] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:15.828130 13833 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 17.
I20260709 12:12:15.796890 19830 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:15.814966 13727 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:15.828868 19898 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:15.851472 19832 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:15.826368 14379 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:15.861318 14380 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:15.786743 19834 raft_consensus.cc:3055] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:15.842506 19890 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:15.805670 19576 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:15.733834 19870 consensus_queue.cc:237] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:15.853401 19447 raft_consensus.cc:2804] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:15.854028 13727 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:15.843538 14410 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 23.
I20260709 12:12:15.799010 19716 raft_consensus.cc:3055] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:15.836163 14411 raft_consensus.cc:2468] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 16.
I20260709 12:12:15.769481 19883 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:15.878392 19830 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:15.879459 19883 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:15.845306 19886 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:15.881011 19830 leader_election.cc:290] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:15.881956 19855 raft_consensus.cc:2804] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:15.882449 19855 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:15.882710 19858 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:15.882885 19855 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:15.883565 19858 consensus_queue.cc:1059] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:15.867244 14379 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:15.863827 19834 raft_consensus.cc:740] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:15.886792 19834 consensus_queue.cc:260] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:15.890090 19682 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:15.893748 19872 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:15.893654 19897 consensus_queue.cc:1048] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:15.898552 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:15.899340 13756 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 17.
I20260709 12:12:15.903864 13688 raft_consensus.cc:1275] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:12:15.905743 13687 raft_consensus.cc:1275] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:12:15.908082 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:15.908763 13684 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:15.910389 13763 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 16.
I20260709 12:12:15.910759 19718 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:15.875049 19716 raft_consensus.cc:740] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:12:15.911672 19744 consensus_meta.cc:287] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.765s	user 0.010s	sys 0.002s
I20260709 12:12:15.912048 19716 consensus_queue.cc:260] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:15.912151 19744 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:15.912781 13754 raft_consensus.cc:1240] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:15.913385 19716 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:15.914063 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 52843.7us
I20260709 12:12:15.914860 19744 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:15.915135 19669 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:15.915668 19744 raft_consensus.cc:2804] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:12:15.918087 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:15.918853 19875 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:15.919668 13801 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:15.921171 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:15.921975 13837 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:15.923594 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:15.774959 19683 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:15.927695 13763 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:12:15.924381 14414 raft_consensus.cc:2376] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 11. Re-sending same reply.
I20260709 12:12:15.928627 13763 raft_consensus.cc:606] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:15.928996 13763 raft_consensus.cc:614] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:15.929401 13727 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:15.929735 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:15.931006 13727 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:15.934544 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:15.935258 13833 raft_consensus.cc:3060] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:15.936525 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:15.872154 19564 raft_consensus.cc:2804] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:15.873593 19447 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:15.938980 14410 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 16.
I20260709 12:12:15.925143 19744 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:15.931627 19583 raft_consensus.cc:2804] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:12:15.945905 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 305407us
I20260709 12:12:15.950434 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:15.958039 13684 raft_consensus.cc:2468] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 18.
I20260709 12:12:15.941644 19563 raft_consensus.cc:2804] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:15.953471 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:15.950979 13651 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:15.982052 13652 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:15.996925 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:15.992403 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:12:15.943310 19447 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:15.943543 19564 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:15.948553 19744 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:15.950238 19718 raft_consensus.cc:2804] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:15.988150 19563 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:15.940272 19830 consensus_queue.cc:1048] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.082s
I20260709 12:12:16.013701 13837 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 16.
I20260709 12:12:16.019210 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:16.025454 13651 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:16.016876 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:16.026465 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:16.047806 13687 raft_consensus.cc:3060] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:12:16.026814 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 44878.7us
I20260709 12:12:16.028643 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:16.048208 14380 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:16.030615 13833 raft_consensus.cc:2468] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 13.
I20260709 12:12:15.998535 19583 raft_consensus.cc:697] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 16 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:16.045202 14379 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:16.051402 14380 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:16.052977 19905 raft_consensus.cc:2804] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:12:16.057183 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 242904us
I20260709 12:12:16.014375 19878 raft_consensus.cc:2804] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:16.027073 19564 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:16.044302 19563 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:16.071097 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 45735.3us
I20260709 12:12:16.033674 19842 raft_consensus.cc:2804] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:12:16.050504 19828 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:12:16.077710 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 133284us
I20260709 12:12:16.077530 13651 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:16.031512 19893 consensus_queue.cc:1048] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 12:12:16.058091 19908 raft_consensus.cc:2804] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:16.058023 19760 raft_consensus.cc:2804] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:16.058471 19718 raft_consensus.cc:697] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:16.071439 19878 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:16.100759 14415 raft_consensus.cc:1240] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 14 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 12:12:16.062134 19897 raft_consensus.cc:2804] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:16.095742 13727 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:16.067510 19741 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.098419 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:16.076571 19832 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:16.061568 19905 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:16.128494 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:16.129199 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:16.129910 13763 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 14.
I20260709 12:12:16.058109 19907 consensus_queue.cc:1048] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.057s
W20260709 12:12:16.133087 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:16.096964 19894 raft_consensus.cc:2804] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:16.114687 19878 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:16.130244 19905 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:16.138803 13830 raft_consensus.cc:1240] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 15. Current term is 16. Ops: [15.14-15.14]
I20260709 12:12:16.095192 19842 raft_consensus.cc:697] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 11 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:16.100816 19682 raft_consensus.cc:2749] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:16.146221 13757 raft_consensus.cc:1240] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:16.094695 19872 consensus_queue.cc:1048] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:12:16.154381 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:16.155282 13683 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 19.
I20260709 12:12:16.114482 19908 raft_consensus.cc:697] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 16 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:16.151018 13761 raft_consensus.cc:1275] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 12:12:16.149641 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 325715us
I20260709 12:12:16.111285 19760 raft_consensus.cc:697] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 13 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:16.159277 14416 raft_consensus.cc:1240] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:16.138612 19830 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:12:16.157069 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:12:16.142509 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 79016.4us
I20260709 12:12:16.166363 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:16.182590 13760 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 16.
I20260709 12:12:16.159714 19683 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:16.174849 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:16.176695 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:16.140369 19897 raft_consensus.cc:697] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 18 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:16.138849 19894 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:16.179284 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:16.180022 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:16.184347 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:16.184791 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:16.177395 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:16.183735 13652 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:16.141533 19832 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:16.189379 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:16.134224 19741 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:16.256742 19741 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:16.167339 19712 raft_consensus.cc:3055] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:16.257396 19712 raft_consensus.cc:740] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:16.258524 19712 consensus_queue.cc:260] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:16.191843 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:12:16.193202 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:16.195116 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:16.261744 14414 raft_consensus.cc:1275] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:12:16.261545 13685 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:16.202134 14409 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:16.201956 13682 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 16.
W20260709 12:12:16.207711 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:16.208577 19760 consensus_queue.cc:237] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:16.210022 19916 consensus_queue.cc:1059] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:16.220659 19270 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:16.272395 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:16.223526 19830 raft_consensus.cc:697] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:16.223634 19842 consensus_queue.cc:237] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:16.230822 19832 leader_election.cc:290] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:16.156461 19583 consensus_queue.cc:237] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:16.231890 19721 raft_consensus.cc:2804] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:16.232728 19921 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:16.233255 19800 consensus_queue.cc:1059] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:16.235293 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:16.204401 19894 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:16.235925 19718 consensus_queue.cc:237] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:16.241969 19914 log.cc:927] Time spent T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:12:16.298182 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:16.299522 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:16.299693 19878 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:16.300287 13761 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:16.301275 19921 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:16.245658 19890 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:16.303156 13688 raft_consensus.cc:2393] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 19: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:16.303704 19921 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:16.303467 19830 consensus_queue.cc:237] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:16.279835 19744 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:16.304807 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:16.306005 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:16.306246 19744 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:16.307265 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:16.307276 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:16.266515 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:16.310904 14414 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 17.
I20260709 12:12:16.222325 19908 consensus_queue.cc:237] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:16.273331 13754 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:16.267318 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 204869us
W20260709 12:12:16.274988 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:16.279666 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:16.284379 13687 raft_consensus.cc:2468] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 13.
W20260709 12:12:16.287506 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:16.294497 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:16.326826 13763 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:16.296909 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:16.243884 19828 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:16.310240 13686 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 17.
I20260709 12:12:16.330675 13685 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 18.
I20260709 12:12:16.323689 13800 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:16.335013 19912 raft_consensus.cc:2804] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:16.335455 13800 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:16.335948 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:16.336855 13800 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:16.272742 19913 consensus_queue.cc:1048] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.065s
I20260709 12:12:16.338420 13800 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:16.339361 14379 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:16.257315 19447 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:16.291774 19689 raft_consensus.cc:3055] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:16.288808 19721 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:16.292482 19712 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:16.354336 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:16.335515 19912 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:16.229641 19563 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:16.408064 13761 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 21.
I20260709 12:12:16.366516 13726 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:16.360152 19912 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:16.378590 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:16.412173 13830 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:16.362449 19800 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.379873 19834 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:16.384701 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:16.284077 19564 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:16.347852 19921 raft_consensus.cc:2804] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:16.386986 19447 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:16.356849 19721 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:16.351491 19669 raft_consensus.cc:2804] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:12:16.384769 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 78270.1us
W20260709 12:12:16.424446 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 64641.7us
I20260709 12:12:16.424641 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:16.388319 13758 raft_consensus.cc:1240] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:16.337141 19897 consensus_queue.cc:237] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:16.391374 19858 raft_consensus.cc:3055] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:16.447835 19858 raft_consensus.cc:740] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:16.449050 19858 consensus_queue.cc:260] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:16.450456 19858 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:16.433581 19800 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:16.394331 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:16.452776 13756 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:16.453611 19669 raft_consensus.cc:697] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 18 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:16.285678 19883 consensus_queue.cc:1059] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.066s
I20260709 12:12:16.415639 14409 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 12.
I20260709 12:12:16.280207 19898 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:16.454941 19883 consensus_queue.cc:1243] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer ca9fbbc2c0a94897897d502d42f3951f log is divergent from this leader: its last log entry 14.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:12:16.454730 19669 consensus_queue.cc:237] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:16.455547 19883 raft_consensus.cc:3055] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:16.455936 19883 raft_consensus.cc:740] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
W20260709 12:12:16.456175 19886 consensus_meta.cc:287] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.575s	user 0.007s	sys 0.003s
I20260709 12:12:16.357000 19689 raft_consensus.cc:740] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:16.456625 19886 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:16.456818 19883 consensus_queue.cc:260] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:16.457283 19689 consensus_queue.cc:260] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:16.458106 13759 raft_consensus.cc:1240] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:16.458374 19689 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:16.460613 14412 raft_consensus.cc:2393] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 15: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:12:16.465714 13727 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:16.414999 19878 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:16.474504 19883 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:16.477927 19856 raft_consensus.cc:2804] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:12:16.478579 19856 raft_consensus.cc:697] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:16.479771 19856 consensus_queue.cc:237] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:16.431910 13763 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 20.
I20260709 12:12:16.434682 13755 raft_consensus.cc:1240] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 12:12:16.356520 19928 raft_consensus.cc:2749] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:16.437806 13761 raft_consensus.cc:1275] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:12:16.439585 13726 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
W20260709 12:12:16.487737 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 48267us
I20260709 12:12:16.359170 19828 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:16.419123 19916 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:16.422209 19921 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:16.365696 13651 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:16.426409 19866 raft_consensus.cc:2804] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:16.507051 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:16.515537 13831 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:12:16.472028 19447 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:16.495785 13754 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 15.
I20260709 12:12:16.497123 13832 raft_consensus.cc:1240] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 15. Current term is 16. Ops: [15.14-15.14]
I20260709 12:12:16.509986 13726 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:16.494832 13830 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 18.
W20260709 12:12:16.520079 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:16.558398 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 48545us
W20260709 12:12:16.523927 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 159657us
I20260709 12:12:16.559361 13726 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:16.497715 19689 raft_consensus.cc:2749] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:16.498011 19913 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.560992 13651 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:16.501194 19921 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:16.577965 13652 leader_election.cc:336] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 1.504s (SENT)
I20260709 12:12:16.578361 13726 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:16.514842 19866 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:16.538712 19875 raft_consensus.cc:2749] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:12:16.587648 13652 leader_election.cc:336] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 1.504s (SENT)
I20260709 12:12:16.588305 13652 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:16.594960 13726 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:16.572872 19716 raft_consensus.cc:2764] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 12:12:16.576617 19832 raft_consensus.cc:2804] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:16.592581 19866 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:16.583910 19917 raft_consensus.cc:2749] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:16.606917 19832 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:16.592384 19800 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:16.591390 19918 raft_consensus.cc:2804] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:16.572856 19447 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:16.576517 19913 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:16.602696 19576 raft_consensus.cc:2749] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:16.604736 19916 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
W20260709 12:12:16.657956 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:16.660035 14413 raft_consensus.cc:1240] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 16 LEADER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:16.598031 19872 consensus_queue.cc:1059] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 12:12:16.664958 13760 raft_consensus.cc:1240] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 18. Current term is 19. Ops: []
W20260709 12:12:16.673465 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 335093us
I20260709 12:12:16.624714 19832 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:16.622126 19716 raft_consensus.cc:2749] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:16.619622 19870 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:16.679457 13800 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:16.625748 19918 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
W20260709 12:12:16.729538 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 137069us
I20260709 12:12:16.720747 14415 raft_consensus.cc:1240] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 18 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:16.614549 19875 consensus_queue.cc:1048] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.051s
W20260709 12:12:16.733593 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 54204.6us
W20260709 12:12:16.681663 19905 consensus_meta.cc:287] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.514s	user 0.003s	sys 0.008s
I20260709 12:12:16.744025 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:16.681520 19682 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.679869 19886 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:16.758894 13800 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:16.666706 19916 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:16.742923 19563 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:16.748185 19928 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:16.742899 19918 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:16.837414 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 242539us
I20260709 12:12:16.682634 19877 consensus_queue.cc:1048] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.088s
W20260709 12:12:16.806468 19930 log.cc:927] Time spent T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 12:12:16.807626 19932 log.cc:927] Time spent T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:12:16.808043 19890 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:16.808615 19934 log.cc:927] Time spent T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
W20260709 12:12:16.857940 19931 log.cc:927] Time spent T 00000000000000000000000000000000 P 17d79eae88f84be7a847d0cf544674cd: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
W20260709 12:12:16.809543 19927 log.cc:927] Time spent T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 12:12:16.838938 13726 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
W20260709 12:12:16.862876 19855 consensus_meta.cc:287] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.979s	user 0.009s	sys 0.002s
I20260709 12:12:16.863405 19855 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:16.866099 19886 raft_consensus.cc:2804] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:16.866679 19886 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:16.867112 19886 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:16.768816 19682 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:16.787489 19937 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.771937 19718 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:16.746760 19870 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:16.841270 13756 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 18.
I20260709 12:12:16.879079 13831 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 17.
W20260709 12:12:16.880545 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 149963us
I20260709 12:12:16.893159 13651 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:12:16.847882 19926 log.cc:927] Time spent T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
W20260709 12:12:16.899050 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 151281us
I20260709 12:12:16.900125 13800 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:16.839738 19928 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:12:16.870433 19270 consensus_meta.cc:287] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.594s	user 0.010s	sys 0.000s
I20260709 12:12:16.754884 19905 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:16.907518 19894 consensus_meta.cc:287] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.575s	user 0.010s	sys 0.000s
I20260709 12:12:16.951179 19270 raft_consensus.cc:2764] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader election decision vote started in defunct term 17: won
I20260709 12:12:16.883119 19828 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:16.832901 19721 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:16.971004 13682 raft_consensus.cc:1240] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 11. Current term is 12. Ops: []
W20260709 12:12:16.963689 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 63664.8us
I20260709 12:12:16.905968 19910 raft_consensus.cc:2804] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:16.974269 19910 raft_consensus.cc:697] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 18 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
W20260709 12:12:16.975530 19712 consensus_meta.cc:287] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.610s	user 0.007s	sys 0.003s
I20260709 12:12:16.975293 19910 consensus_queue.cc:237] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:16.914202 19928 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:16.982102 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 89071.7us
W20260709 12:12:17.016691 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 43768.6us
I20260709 12:12:16.916150 19718 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:17.011860 19912 consensus_meta.cc:287] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.593s	user 0.006s	sys 0.005s
I20260709 12:12:17.017985 19947 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:17.026559 19912 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:17.026767 19947 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:17.028806 19912 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:17.029091 19947 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:17.025609 19921 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:17.038662 19855 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:17.042218 13684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 1067) took 1061 ms. Trace:
I20260709 12:12:17.043783 13684 rpcz_store.cc:276] 0709 12:12:15.980644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:16.006510 (+ 25866us) service_pool.cc:224] Handling call
0709 12:12:16.006900 (+   390us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:16.040451 (+ 33551us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:16.040505 (+    54us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:16.228998 (+188493us) spinlock_profiling.cc:243] Waited 2.01 ms on lock 0x7b2c000014c8. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa926886a11 00007fa926896372 00007fa927fc8a01 00007fa927f8d43a 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2
0709 12:12:16.229701 (+   703us) log.cc:844] Serialized 52 byte log entry
0709 12:12:16.482037 (+252336us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:16.500276 (+ 18239us) log.cc:844] Serialized 14 byte log entry
0709 12:12:16.500587 (+   311us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:16.504592 (+  4005us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:17.041848 (+537256us) raft_consensus.cc:1685] finished
0709 12:12:17.041967 (+   119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:17.042119 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7927,"prepare.queue_time_us":17847,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":9731,"raft.queue_time_us":8296,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":9453,"spinlock_wait_cycles":9141376,"thread_start_us":241517,"threads_started":1,"wal-append.queue_time_us":379600}
I20260709 12:12:17.045595 19921 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:17.043776 19898 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:17.042353 19870 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:17.038565 19682 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:17.017565 13800 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:17.049211 13651 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:16.966958 19894 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:17.014652 19951 raft_consensus.cc:2749] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:17.064633 19832 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:17.072083 19564 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 17 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:12:17.102052 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 89065.4us
W20260709 12:12:17.079671 19883 consensus_meta.cc:287] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.605s	user 0.009s	sys 0.000s
I20260709 12:12:17.085017 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:17.085628 19721 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:17.088032 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:17.105659 13688 raft_consensus.cc:2393] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 17: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:17.091895 19905 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:17.094030 19718 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:17.066387 19877 raft_consensus.cc:2804] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:17.112877 19832 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:17.113090 19893 consensus_queue.cc:1059] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:12:17.113529 19936 log.cc:927] Time spent T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.189s	user 0.004s	sys 0.000s
I20260709 12:12:17.120535 19893 raft_consensus.cc:3055] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:12:17.120779 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:17.120982 19893 raft_consensus.cc:740] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:17.123178 14380 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:17.095150 19886 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:16.908519 19937 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:17.062737 19913 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:17.098097 19918 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:17.098884 19872 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:17.069424 13651 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:17.090553 19916 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:17.107183 13679 raft_consensus.cc:1275] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 12:12:17.146862 13679 pending_rounds.cc:85] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 11
I20260709 12:12:17.107869 13682 raft_consensus.cc:2393] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 15: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:17.126827 13832 raft_consensus.cc:1275] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:12:17.147121 13679 pending_rounds.cc:107] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 12:12:17.129045 14414 raft_consensus.cc:1275] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:12:17.147557 13679 raft_consensus.cc:2889] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:17.130326 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:12:17.134924 19858 consensus_meta.cc:287] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.684s	user 0.007s	sys 0.006s
I20260709 12:12:17.135660 13836 raft_consensus.cc:3055] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:17.149689 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:17.150120 13836 raft_consensus.cc:740] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:17.150418 14413 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 23.
I20260709 12:12:17.137601 19937 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:17.143203 14409 raft_consensus.cc:1240] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 18 LEADER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:17.121917 19893 consensus_queue.cc:260] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:17.130491 19877 raft_consensus.cc:697] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 16 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
W20260709 12:12:17.146270 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 76944.6us
I20260709 12:12:17.152072 13684 raft_consensus.cc:1275] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:12:17.150916 13836 consensus_queue.cc:260] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:17.166138 13836 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:17.150921 19905 raft_consensus.cc:2804] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:17.167431 19905 raft_consensus.cc:697] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 21 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:17.168437 19905 consensus_queue.cc:237] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:17.153865 19913 consensus_queue.cc:1048] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 12:12:17.173556 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:17.174618 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:17.174885 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:17.175341 13756 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 15.
W20260709 12:12:17.175062 19950 log.cc:927] Time spent T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:12:17.152434 19894 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:17.178966 19866 consensus_meta.cc:287] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.554s	user 0.010s	sys 0.000s
I20260709 12:12:17.179445 19866 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:17.180612 13837 raft_consensus.cc:1240] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:17.181350 19576 raft_consensus.cc:3055] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:17.182022 19957 raft_consensus.cc:2804] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:17.182838 19957 raft_consensus.cc:697] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 18 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
W20260709 12:12:17.182957 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:17.183718 19957 consensus_queue.cc:237] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:17.186587 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:17.188529 13757 raft_consensus.cc:2393] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 16: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:17.189261 19918 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:17.194046 13755 raft_consensus.cc:1275] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
I20260709 12:12:17.194543 13755 pending_rounds.cc:85] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting all ops after (but not including) 8
I20260709 12:12:17.194759 13755 pending_rounds.cc:107] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 12:12:17.194981 13755 raft_consensus.cc:2889] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:17.196432 19877 consensus_queue.cc:237] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 15.6, Last appended by leader: 6, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:17.202868 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:17.204202 13763 raft_consensus.cc:1240] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:17.201815 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:12:17.207978 13800 connection.cc:256] RPC call timeout handler was delayed by -1.4501584899999216s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1602s for a response
W20260709 12:12:17.225498 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:17.226060 13762 raft_consensus.cc:1240] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:17.209040 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:17.235301 13755 raft_consensus.cc:2393] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 20: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:17.235461 13829 raft_consensus.cc:2410] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 17 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
W20260709 12:12:17.234313 13800 connection.cc:256] RPC call timeout handler was delayed by -1.2638584900000751s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1809s for a response
I20260709 12:12:17.206267 13836 raft_consensus.cc:1275] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
W20260709 12:12:17.236050 13800 connection.cc:256] RPC call timeout handler was delayed by -1.216158489999998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18620000000000003s for a response
W20260709 12:12:17.236575 13800 connection.cc:256] RPC call timeout handler was delayed by -1.176558489999934s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1906s for a response
W20260709 12:12:17.236949 13800 connection.cc:256] RPC call timeout handler was delayed by -1.112658490000058s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19770000000000001s for a response
W20260709 12:12:17.237289 13800 connection.cc:256] RPC call timeout handler was delayed by -1.0946584900000289s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19970000000000002s for a response
W20260709 12:12:17.237934 13800 connection.cc:256] RPC call timeout handler was delayed by -1.0541584899999634s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2042s for a response
W20260709 12:12:17.238334 13800 connection.cc:256] RPC call timeout handler was delayed by -1.0343584899999314s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20640000000000003s for a response
I20260709 12:12:17.239066 13800 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:17.225306 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:17.236277 13836 pending_rounds.cc:85] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 12
I20260709 12:12:17.241464 13836 pending_rounds.cc:107] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 12:12:17.241498 13761 raft_consensus.cc:2393] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 16: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:17.241843 13836 raft_consensus.cc:2889] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:17.285463 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:17.208722 19893 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:17.313759 13758 raft_consensus.cc:1240] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:17.312088 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:17.317085 14415 raft_consensus.cc:2393] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 17: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:12:17.316851 13800 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:17.322574 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:17.200637 19576 raft_consensus.cc:740] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:17.335561 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:17.336388 13836 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:17.224727 19886 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:17.347806 13761 raft_consensus.cc:1275] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:12:17.353340 19270 raft_consensus.cc:2749] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:17.354734 19576 consensus_queue.cc:260] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:17.355949 19576 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:17.358155 19953 raft_consensus.cc:2749] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:12:17.359252 19938 log.cc:927] Time spent T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.307s	user 0.002s	sys 0.001s
I20260709 12:12:17.312279 19910 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:17.251811 19564 consensus_queue.cc:1048] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.089s
I20260709 12:12:17.220575 19858 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:17.220041 19912 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
W20260709 12:12:17.373188 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:17.374614 13836 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 16.
W20260709 12:12:17.376498 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 95904.3us
I20260709 12:12:17.382375 13800 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:17.251057 19928 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:17.392058 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:17.395258 13756 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:17.393416 13801 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:17.253033 19421 consensus_queue.cc:1048] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.136s
I20260709 12:12:17.397468 13800 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:17.387570 19583 raft_consensus.cc:2749] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:17.401535 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:17.383898 19866 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:17.400893 13800 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:17.411389 13756 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 19.
I20260709 12:12:17.368719 19910 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:17.413901 13836 raft_consensus.cc:1240] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:17.422624 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:17.423364 13763 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 18.
I20260709 12:12:17.423578 19870 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:17.424327 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:17.424171 19870 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:17.425114 13759 raft_consensus.cc:2393] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 15: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:17.428701 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:17.403673 19913 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:17.437631 19913 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:17.427189 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:17.438099 14379 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:17.439384 14379 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:17.438124 19913 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:17.380846 19858 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:17.431602 13800 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:17.443724 19910 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:17.443993 19858 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:17.413345 19907 consensus_queue.cc:1048] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 12:12:17.445550 19907 raft_consensus.cc:2804] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:17.445955 19907 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:17.446280 19907 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:17.446651 13800 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:17.448264 19270 raft_consensus.cc:2749] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:17.382772 19912 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:17.425839 19928 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:17.450585 19873 raft_consensus.cc:2749] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:17.450752 13829 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 15.
I20260709 12:12:17.404902 19877 raft_consensus.cc:2749] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:17.452860 19897 raft_consensus.cc:2749] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:17.431012 13758 raft_consensus.cc:1275] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 14. (term mismatch)
I20260709 12:12:17.458585 13758 pending_rounds.cc:85] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting all ops after (but not including) 13
I20260709 12:12:17.458925 13758 pending_rounds.cc:107] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting uncommitted NO_OP operation due to leader change: 15.14
I20260709 12:12:17.459242 13758 raft_consensus.cc:2889] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:17.431582 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:17.433343 19866 raft_consensus.cc:2749] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:12:17.462975 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:17.467435 19866 consensus_queue.cc:1048] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:17.469547 13800 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:17.471223 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:17.472105 13763 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:17.480110 13837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 1125) took 1063 ms. Trace:
I20260709 12:12:17.480501 13837 rpcz_store.cc:276] 0709 12:12:16.417162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:16.417812 (+   650us) service_pool.cc:224] Handling call
0709 12:12:16.464620 (+ 46808us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:17.180973 (+716353us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:17.479867 (+298894us) spinlock_profiling.cc:243] Waited 716 ms on lock 0x7b54000af0d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:17.480048 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1646225152}
I20260709 12:12:17.479935 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:17.483806 19912 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:12:17.484406 19963 log.cc:927] Time spent T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 12:12:17.486909 19967 log.cc:927] Time spent T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:12:17.448897 14415 raft_consensus.cc:2955] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 8 to 10, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:12:17.497622 13832 raft_consensus.cc:1275] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:12:17.500861 13831 raft_consensus.cc:1275] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:12:17.505141 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:17.505839 13831 raft_consensus.cc:2468] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 18.
I20260709 12:12:17.516875 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:17.517678 13763 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 17.
I20260709 12:12:17.515573 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:17.413234 19957 consensus_queue.cc:1048] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.090s
I20260709 12:12:17.522007 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:17.527127 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:17.522199 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:17.523509 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:12:17.544270 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 104948us
I20260709 12:12:17.495630 19583 raft_consensus.cc:2749] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:17.561563 13828 raft_consensus.cc:1240] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:17.562671 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:17.563724 19447 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:17.566718 19942 log.cc:927] Time spent T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.585s	user 0.003s	sys 0.000s
W20260709 12:12:17.569947 19962 log.cc:927] Time spent T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.152s	user 0.000s	sys 0.003s
W20260709 12:12:17.603341 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 50518.5us
I20260709 12:12:17.570158 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:17.578323 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:17.605461 13837 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 12.
I20260709 12:12:17.597725 13760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 3041) took 1448 ms. Trace:
I20260709 12:12:17.598157 13831 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 16.
I20260709 12:12:17.606169 13760 rpcz_store.cc:276] 0709 12:12:16.149183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:16.202430 (+ 53247us) service_pool.cc:224] Handling call
0709 12:12:16.202741 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:16.665399 (+462658us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:17.587239 (+921840us) spinlock_profiling.cc:243] Waited 462 ms on lock 0x7b5400087fd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:17.597645 (+ 10406us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1062579456}
I20260709 12:12:17.607960 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:17.608506 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:17.608783 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:17.609921 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:12:17.615000 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 408632us
I20260709 12:12:17.610668 13759 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 12.
I20260709 12:12:17.621125 13800 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:17.617547 13651 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:17.629128 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:17.632908 13758 raft_consensus.cc:1275] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:12:17.519912 19669 consensus_queue.cc:1059] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.105s
I20260709 12:12:17.642956 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:12:17.643471 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 454450us
I20260709 12:12:17.641975 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:17.645440 13832 raft_consensus.cc:2410] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 12:12:17.640650 19912 raft_consensus.cc:2804] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:17.625200 19875 consensus_queue.cc:1059] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 12:12:17.662879 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:17.665387 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:17.651681 19951 raft_consensus.cc:2804] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:17.668537 13651 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:17.666293 13834 raft_consensus.cc:2468] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 18.
I20260709 12:12:17.640854 19921 consensus_queue.cc:1048] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:12:17.680478 19842 raft_consensus.cc:2804] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:17.675199 14416 raft_consensus.cc:1275] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
W20260709 12:12:17.682938 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:17.683709 19947 consensus_queue.cc:1048] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:17.677029 19875 consensus_queue.cc:1059] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.008s
W20260709 12:12:17.660205 19923 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.022s	sys 0.015s
I20260709 12:12:17.677273 19870 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:17.672871 19883 consensus_queue.cc:1048] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 12:12:17.661463 19912 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:17.649978 19872 consensus_queue.cc:1048] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:12:17.655586 19877 consensus_queue.cc:1059] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 12:12:17.659780 19712 consensus_queue.cc:1059] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 12:12:17.659879 19905 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:17.678081 19890 raft_consensus.cc:3055] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:17.728334 19890 raft_consensus.cc:740] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:17.729231 19890 consensus_queue.cc:260] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:17.730679 19890 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:17.667222 19873 consensus_queue.cc:1059] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 12:12:17.695889 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:17.734304 19873 raft_consensus.cc:3055] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:17.696581 19912 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:17.734900 19873 raft_consensus.cc:740] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:17.736207 19873 consensus_queue.cc:260] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:17.714010 19877 raft_consensus.cc:3055] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:17.738121 19877 raft_consensus.cc:740] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:17.739144 19877 consensus_queue.cc:260] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:17.740425 19877 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:17.714897 19712 raft_consensus.cc:3055] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:17.722067 19905 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:17.741964 19712 raft_consensus.cc:740] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:17.743021 19712 consensus_queue.cc:260] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:17.743724 19905 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:17.716377 19872 raft_consensus.cc:3055] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:17.744493 19872 raft_consensus.cc:740] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:17.745452 19872 consensus_queue.cc:260] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:17.746747 19872 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:17.749888 19878 consensus_queue.cc:1059] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:12:17.750275 19270 consensus_queue.cc:1048] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:17.727751 14413 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 12.
I20260709 12:12:17.734486 13834 raft_consensus.cc:2393] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 19: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:17.689544 19951 raft_consensus.cc:697] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 20 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:17.754860 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:12:17.694416 19923 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.022s	sys 0.016s
I20260709 12:12:17.737520 19873 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:12:17.757061 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 94814.8us
W20260709 12:12:17.760056 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 80227us
I20260709 12:12:17.762218 13726 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:17.764943 13726 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
W20260709 12:12:17.763183 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 158085us
I20260709 12:12:17.769196 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:17.770623 13760 raft_consensus.cc:1240] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:17.772630 13759 raft_consensus.cc:2393] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 19: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:17.779218 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:17.777436 13800 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:17.779444 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:17.759622 19971 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:17.793273 14407 raft_consensus.cc:1275] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 12:12:17.755276 19893 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:17.800426 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:17.795831 13726 leader_election.cc:304] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:17.758376 19905 raft_consensus.cc:3055] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:17.798503 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:17.759431 19760 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:17.782572 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:17.780814 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:12:17.795336 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:17.787863 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:17.805896 13727 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:17.808372 13835 raft_consensus.cc:2368] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 16. Current term is 17.
I20260709 12:12:17.808894 13760 raft_consensus.cc:2393] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 17: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:12:17.810190 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:17.813858 14407 raft_consensus.cc:1275] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:12:17.765674 19741 raft_consensus.cc:2749] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:17.775254 19718 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:17.762660 19842 raft_consensus.cc:697] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 15 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:17.794265 19886 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:17.757180 19907 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:17.826054 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:17.831825 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:17.855569 13760 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 19.
I20260709 12:12:17.803164 19270 raft_consensus.cc:2804] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:17.799364 19858 raft_consensus.cc:2804] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:12:17.856298 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 183088us
I20260709 12:12:17.802997 19905 raft_consensus.cc:740] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:17.765741 19583 consensus_queue.cc:1048] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 12:12:17.815004 19916 raft_consensus.cc:2749] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:12:17.868851 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:17.814633 19856 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:17.873267 14416 raft_consensus.cc:1240] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 18. Current term is 19. Ops: []
W20260709 12:12:17.882000 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:17.803822 19971 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:17.870328 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 64497.6us
I20260709 12:12:17.871851 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:17.818393 19716 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
W20260709 12:12:17.870275 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 65842.3us
I20260709 12:12:17.809234 19893 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:17.868448 19741 raft_consensus.cc:2804] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:17.817265 19913 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:17.911101 14409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41700 (request call id 905) took 1390 ms. Trace:
I20260709 12:12:17.863384 19858 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:17.893541 13834 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 15.
I20260709 12:12:17.911655 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:17.911595 14409 rpcz_store.cc:276] 0709 12:12:16.508208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:16.508373 (+   165us) service_pool.cc:224] Handling call
0709 12:12:16.508692 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:17.153479 (+644787us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:17.898052 (+744573us) spinlock_profiling.cc:243] Waited 634 ms on lock 0x7b54007f0154. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:17.898232 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1458767104}
I20260709 12:12:17.897548 19842 consensus_queue.cc:237] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:17.891384 19270 raft_consensus.cc:697] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 19 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:17.862960 19976 consensus_queue.cc:1048] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.050s
I20260709 12:12:17.916141 19270 consensus_queue.cc:237] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:17.859262 19886 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:17.917550 19978 log.cc:927] Time spent T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 12:12:17.891484 19856 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:17.921798 13754 raft_consensus.cc:1275] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:12:17.899668 13727 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:17.776559 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:17.813906 19760 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:17.941279 19905 consensus_queue.cc:260] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:17.942903 19905 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:17.946491 19987 raft_consensus.cc:2804] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:17.947206 19987 raft_consensus.cc:697] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:17.854944 19718 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:17.948246 19987 consensus_queue.cc:237] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:17.951998 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 52415.1us
I20260709 12:12:17.913246 19858 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:17.954347 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:17.955651 13762 raft_consensus.cc:1275] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 15 index: 6. Preceding OpId from leader: term: 16 index: 7. (index mismatch)
I20260709 12:12:17.897146 19951 consensus_queue.cc:237] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:17.976015 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:17.908663 19716 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:17.963179 19741 raft_consensus.cc:697] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:12:18.037482 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 79173.2us
I20260709 12:12:18.038746 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:18.039904 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:17.963045 19883 consensus_queue.cc:1048] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:12:17.976116 19913 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:17.971861 19886 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:18.042510 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:18.071622 14409 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:18.047729 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:18.073643 13832 raft_consensus.cc:2393] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 13: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:17.968101 19918 consensus_queue.cc:1048] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.060s
I20260709 12:12:18.044903 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:18.080716 13757 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:18.079309 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 181560us
I20260709 12:12:18.083217 19718 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:18.082912 19741 consensus_queue.cc:237] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:18.089738 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:18.090464 13832 raft_consensus.cc:2376] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 19. Re-sending same reply.
I20260709 12:12:18.091415 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:18.091454 13757 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 19.
I20260709 12:12:18.092005 13832 raft_consensus.cc:2376] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 16. Re-sending same reply.
I20260709 12:12:18.092831 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:18.082119 13652 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:18.093549 13832 raft_consensus.cc:2393] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 19: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:17.975548 19984 consensus_queue.cc:1048] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.081s
I20260709 12:12:18.102860 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:18.071040 19893 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:18.113161 14409 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 24.
I20260709 12:12:18.109910 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:18.114498 13832 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 19.
I20260709 12:12:18.115425 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:18.119355 19995 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:18.080871 19916 consensus_queue.cc:1048] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 12:12:18.124176 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:18.128062 13829 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:18.125898 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:18.125656 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:18.130831 13832 raft_consensus.cc:2393] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 16: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:18.131958 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:18.111016 19971 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:18.136547 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:12:18.139607 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 57585.9us
I20260709 12:12:18.140758 13652 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:12:18.169404 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:18.172076 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:18.148715 19760 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:18.174032 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:12:18.174324 19985 log.cc:927] Time spent T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 12:12:18.174777 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:18.175384 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:18.176007 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:18.176436 19984 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:18.176800 19883 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:18.177951 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:18.178661 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:12:18.179683 19997 log.cc:927] Time spent T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.143s	user 0.000s	sys 0.003s
I20260709 12:12:18.184585 14379 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:18.161592 19872 raft_consensus.cc:2749] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:12:18.186749 13686 raft_consensus.cc:1275] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:12:18.185681 19858 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:18.189042 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:18.220589 13831 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 20.
I20260709 12:12:18.189256 19877 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:18.191232 13727 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:18.191196 13834 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 21.
I20260709 12:12:18.191965 13684 raft_consensus.cc:2410] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 16 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 12:12:18.197389 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:18.198908 13763 raft_consensus.cc:1275] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:12:18.217064 13687 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 19.
I20260709 12:12:18.217592 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:12:18.229138 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 88481.8us
I20260709 12:12:18.230026 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:18.230978 13652 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:18.225373 13685 raft_consensus.cc:3060] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:12:18.226824 13680 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 19.
I20260709 12:12:18.239344 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:18.227672 13682 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 16.
I20260709 12:12:18.242805 13652 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:18.245347 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:18.238265 19883 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:18.162096 19912 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:18.245983 14379 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:18.252058 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:18.248009 13685 raft_consensus.cc:2468] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 16.
I20260709 12:12:18.249718 13829 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 20.
W20260709 12:12:18.253633 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:18.254581 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 63432.9us
I20260709 12:12:18.255250 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:18.255429 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:18.256232 13832 raft_consensus.cc:2368] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 16. Current term is 17.
I20260709 12:12:18.249976 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:18.256580 13680 raft_consensus.cc:2393] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 19: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:18.257445 13759 raft_consensus.cc:1240] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 12:12:18.258208 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:18.258944 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:18.260577 13685 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:18.261386 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:18.255657 13727 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:18.263700 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:18.264364 13687 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 16.
I20260709 12:12:18.240947 19969 raft_consensus.cc:2804] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:18.265671 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:18.260844 19683 raft_consensus.cc:2804] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:18.269105 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:18.270921 13829 raft_consensus.cc:1240] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 12:12:18.266573 13837 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 13.
I20260709 12:12:18.272518 13829 raft_consensus.cc:1240] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 12:12:18.248812 19994 raft_consensus.cc:2764] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:12:18.238354 19877 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:18.287696 19877 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:18.289005 13686 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 12.
I20260709 12:12:18.248610 19744 consensus_queue.cc:1048] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
W20260709 12:12:18.290170 19929 log.cc:927] Time spent T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 1.451s	user 0.008s	sys 0.005s
I20260709 12:12:18.240206 19995 consensus_queue.cc:1059] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 12:12:18.291697 19995 consensus_queue.cc:1243] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer 3f37c9cc9dda46b4be21dd675ba78fb7 log is divergent from this leader: its last log entry 12.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:12:18.226207 19947 consensus_queue.cc:1059] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:12:18.275065 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:18.279146 19912 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:18.292774 19947 consensus_queue.cc:1243] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer 3f37c9cc9dda46b4be21dd675ba78fb7 log is divergent from this leader: its last log entry 19.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:12:18.293342 19947 raft_consensus.cc:3055] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:18.293802 19947 raft_consensus.cc:740] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:18.294472 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:18.294909 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:18.294718 19947 consensus_queue.cc:260] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:18.295531 13680 raft_consensus.cc:2393] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 17: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:18.295622 13687 raft_consensus.cc:2393] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 15: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:18.296000 19947 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:18.296792 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:18.296866 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:18.297959 13680 raft_consensus.cc:2393] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 16: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
W20260709 12:12:18.298669 19998 log.cc:927] Time spent T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:12:18.280303 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:18.299317 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:18.284798 19883 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:18.284126 13837 raft_consensus.cc:1240] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 12:12:18.300252 13680 raft_consensus.cc:2393] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 19: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:18.300897 13833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 3160) took 2164 ms. Trace:
I20260709 12:12:18.301206 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:18.301555 13837 raft_consensus.cc:1275] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:12:18.291796 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:18.305341 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:12:18.305605 19996 log.cc:927] Time spent T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 12:12:18.275593 19683 raft_consensus.cc:697] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 19 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:18.259274 19872 raft_consensus.cc:2749] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:18.301375 13833 rpcz_store.cc:276] 0709 12:12:16.136452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:16.136606 (+   154us) service_pool.cc:224] Handling call
0709 12:12:16.152426 (+ 15820us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:16.152647 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:16.152672 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:16.199963 (+ 47291us) log.cc:844] Serialized 26 byte log entry
0709 12:12:16.580534 (+380571us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:16.580599 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:16.580702 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:18.289323 (+1708621us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:12:18.300580 (+ 11257us) raft_consensus.cc:1685] finished
0709 12:12:18.300602 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:18.300811 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":475116928,"thread_start_us":366303,"threads_started":1,"wal-append.queue_time_us":529844}
I20260709 12:12:18.299365 13682 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 20.
I20260709 12:12:18.290979 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:18.275156 13829 raft_consensus.cc:1240] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:18.272580 13727 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:18.307528 19669 raft_consensus.cc:3055] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:18.322700 19669 raft_consensus.cc:740] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:18.323799 19669 consensus_queue.cc:260] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:18.326128 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 53606.3us
I20260709 12:12:18.327492 13727 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:18.329986 19987 raft_consensus.cc:2804] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:18.330791 19987 raft_consensus.cc:697] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:18.332020 19987 consensus_queue.cc:237] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:18.315121 13680 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:18.333580 19993 raft_consensus.cc:2804] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:18.325548 19669 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:18.336380 19712 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:18.276984 19999 raft_consensus.cc:2804] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:18.366652 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:18.368533 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:18.244083 19984 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:18.259124 19716 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:18.373723 13681 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 16.
I20260709 12:12:18.375871 19716 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:18.376408 19716 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:18.374377 19683 consensus_queue.cc:237] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:18.378788 19716 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:18.345260 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:18.377570 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:18.314869 13685 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 14.
I20260709 12:12:18.318377 13686 raft_consensus.cc:2376] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 12. Re-sending same reply.
I20260709 12:12:18.375092 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:18.383822 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:18.384335 13833 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 19.
I20260709 12:12:18.384725 13686 raft_consensus.cc:2410] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 21 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 12:12:18.356097 13687 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 16.
I20260709 12:12:18.365260 13679 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 17.
I20260709 12:12:18.261844 19916 raft_consensus.cc:2804] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:18.382445 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:18.386005 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:18.307747 19858 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:18.411123 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 168381us
I20260709 12:12:18.412021 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:18.396867 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:18.387233 13687 raft_consensus.cc:2410] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:12:18.412166 13727 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:18.414701 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:18.412806 13686 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 17.
W20260709 12:12:18.412662 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 164977us
I20260709 12:12:18.346772 19886 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:18.413257 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:18.416991 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:18.421519 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:18.412196 13652 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:18.418082 13686 raft_consensus.cc:1275] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:12:18.374989 19984 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:18.386660 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:18.354823 19993 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:18.430050 13681 raft_consensus.cc:2393] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 17: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:18.430539 13687 raft_consensus.cc:1275] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:12:18.388351 19916 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:18.431397 13679 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 18.
I20260709 12:12:18.452688 13685 raft_consensus.cc:1240] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 12:12:18.454766 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:18.455148 13652 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:18.455716 13760 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 16.
I20260709 12:12:18.457579 13682 raft_consensus.cc:1275] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 12:12:18.366742 19999 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:18.464830 13687 raft_consensus.cc:1240] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:18.477438 13681 raft_consensus.cc:3055] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:12:18.477764 13679 raft_consensus.cc:1275] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:12:18.478044 13652 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:18.478039 13681 raft_consensus.cc:740] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:18.488145 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:18.489287 13754 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 16.
I20260709 12:12:18.490813 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:18.491760 13679 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:18.491645 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:18.452574 19993 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:18.503909 13754 raft_consensus.cc:1240] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 11. Current term is 12. Ops: [11.12-11.12]
I20260709 12:12:18.506626 13651 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:18.502345 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:18.480598 13681 consensus_queue.cc:260] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:18.522063 13681 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:18.457314 19951 raft_consensus.cc:2749] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:12:18.523617 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 45680.7us
I20260709 12:12:18.457019 19916 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:18.525303 13652 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:18.435547 19890 consensus_queue.cc:1048] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.090s
I20260709 12:12:18.535620 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:18.478382 19999 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:18.536648 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:18.541244 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:18.538789 13755 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:12:18.424996 19886 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:18.545264 13651 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:12:18.548635 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 130116us
I20260709 12:12:18.536103 13679 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 18.
I20260709 12:12:18.526392 19872 raft_consensus.cc:2749] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:18.555971 13800 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:18.523926 20008 raft_consensus.cc:2749] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:18.549840 19984 raft_consensus.cc:2804] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:18.562336 13687 raft_consensus.cc:1240] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:18.562542 19984 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:18.562994 19984 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:18.564585 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:18.565722 13687 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:18.566128 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:18.572098 13800 leader_election.cc:304] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:18.574205 13800 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
W20260709 12:12:18.578034 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 52810.3us
I20260709 12:12:18.579293 13652 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:18.580910 13652 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:18.550268 19995 raft_consensus.cc:2804] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:12:18.586867 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:18.560890 19913 raft_consensus.cc:2749] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:18.558542 19937 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:18.586169 19928 raft_consensus.cc:2804] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:18.585335 19951 raft_consensus.cc:2749] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:18.587860 19995 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:18.584636 20007 raft_consensus.cc:2764] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 12:12:18.588068 19872 raft_consensus.cc:2749] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:18.608539 19937 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:18.638612 20011 log.cc:927] Time spent T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
W20260709 12:12:18.640602 20001 log.cc:927] Time spent T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.183s	user 0.000s	sys 0.000s
I20260709 12:12:18.642899 13837 raft_consensus.cc:1275] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:12:18.646263 19890 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:18.646842 19890 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:18.647768 13680 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 20.
I20260709 12:12:18.648940 19890 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:18.649915 19890 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:18.610352 19877 raft_consensus.cc:2764] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 12:12:18.651458 19886 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:18.616089 13831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54830 (request call id 2917) took 1051 ms. Trace:
I20260709 12:12:18.655761 13687 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 17.
I20260709 12:12:18.620752 19984 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:18.622156 14415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41692 (request call id 966) took 1225 ms. Trace:
W20260709 12:12:18.627128 20002 log.cc:927] Time spent T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.161s	user 0.000s	sys 0.000s
W20260709 12:12:18.628567 20004 log.cc:927] Time spent T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 12:12:18.585690 19270 consensus_queue.cc:1048] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 12:12:18.608248 19928 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:18.617883 19995 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:18.659058 13837 raft_consensus.cc:1240] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:18.661090 13835 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 14.
I20260709 12:12:18.661526 13755 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 17.
I20260709 12:12:18.655656 13831 rpcz_store.cc:276] 0709 12:12:17.564502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:17.911369 (+346867us) service_pool.cc:224] Handling call
0709 12:12:18.615904 (+704535us) spinlock_profiling.cc:243] Waited 287 ms on lock 0x7b54000d9b54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:18.616022 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":660289408}
I20260709 12:12:18.656430 14415 rpcz_store.cc:276] 0709 12:12:17.396624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:17.396802 (+   178us) service_pool.cc:224] Handling call
0709 12:12:17.412588 (+ 15786us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:17.413000 (+   412us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:12:17.604060 (+191060us) log.cc:844] Serialized 14 byte log entry
0709 12:12:17.897870 (+293810us) log.cc:844] Serialized 14 byte log entry
0709 12:12:17.898217 (+   347us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:17.912661 (+ 14444us) log.cc:844] Serialized 26 byte log entry
0709 12:12:17.921283 (+  8622us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:17.921323 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:17.921403 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:18.620135 (+698732us) spinlock_profiling.cc:243] Waited 41.9 ms on lock 0x7b5400531c20. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f02dbe 00007fa927f0d930 00007fa927f0d8d8 00007fa927f0d858 00007fa927f0d813 00007fa927f0ca9c 00007fa92ddf82f6 00007fa92ddf2aa8 00007fa927f497cb 00007fa927f4c2c0
0709 12:12:18.621929 (+  1794us) raft_consensus.cc:1685] finished
0709 12:12:18.621952 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:18.622094 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":176515,"prepare.queue_time_us":19536,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":51,"raft.queue_time_us":181452,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":4426,"spinlock_wait_cycles":101560832,"thread_start_us":69927,"threads_started":1,"wal-append.queue_time_us":198508}
I20260709 12:12:18.650468 19890 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:18.673563 19999 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:18.695935 13837 raft_consensus.cc:1275] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:12:18.697474 13837 raft_consensus.cc:1240] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 23. Current term is 24. Ops: []
W20260709 12:12:18.700174 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 119375us
I20260709 12:12:18.701153 13652 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:12:18.702608 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 128519us
I20260709 12:12:18.638654 19937 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:18.705704 13800 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:18.707736 13800 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
W20260709 12:12:18.691542 19994 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 12:12:18.708875 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:18.691111 19928 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:18.714042 13755 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:18.715651 13756 raft_consensus.cc:1240] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:18.717427 13800 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:18.730665 13755 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 17.
I20260709 12:12:18.731274 13652 leader_election.cc:400] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 16. Current term is 17.
I20260709 12:12:18.733304 13651 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:18.717381 19877 raft_consensus.cc:2804] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:18.722373 20008 raft_consensus.cc:2749] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:18.722676 19937 raft_consensus.cc:2804] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:18.724226 19913 raft_consensus.cc:2749] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:18.769596 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 54968.7us
I20260709 12:12:18.771001 13652 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:12:18.774709 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:18.747663 19877 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:18.775466 19270 consensus_queue.cc:1059] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 12:12:18.779090 13682 raft_consensus.cc:1275] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260709 12:12:18.780687 19975 log.cc:927] Time spent T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 1.058s	user 0.006s	sys 0.002s
I20260709 12:12:18.759435 19872 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:18.782054 19872 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:18.785097 13726 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:18.775720 19913 consensus_queue.cc:1048] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.010s
I20260709 12:12:18.775794 19916 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:18.755424 19912 consensus_queue.cc:1048] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 12:12:18.833979 19951 raft_consensus.cc:2804] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:18.834672 19951 raft_consensus.cc:697] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 17 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:18.756880 19712 consensus_queue.cc:1059] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 12:12:18.755769 19937 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:18.804030 13679 raft_consensus.cc:1240] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:18.795595 13832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54830 (request call id 2921) took 1230 ms. Trace:
I20260709 12:12:18.813621 13834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54830 (request call id 2918) took 1248 ms. Trace:
I20260709 12:12:18.805241 13836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 1132) took 1412 ms. Trace:
I20260709 12:12:18.760142 19984 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:18.786788 20014 log.cc:927] Time spent T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:12:18.819830 13801 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:18.839125 13832 rpcz_store.cc:276] 0709 12:12:17.565594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:18.134356 (+568762us) service_pool.cc:224] Handling call
0709 12:12:18.795237 (+660881us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b540002e754. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:18.795489 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":266472320}
I20260709 12:12:18.841737 13836 rpcz_store.cc:276] 0709 12:12:17.393101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:17.394174 (+  1073us) service_pool.cc:224] Handling call
0709 12:12:17.405826 (+ 11652us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:17.414376 (+  8550us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:18.804954 (+1390578us) spinlock_profiling.cc:243] Waited 7.84 ms on lock 0x7b5400167bd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:18.805165 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18028288}
W20260709 12:12:18.850210 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 72590us
I20260709 12:12:18.840860 13834 rpcz_store.cc:276] 0709 12:12:17.564799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:17.965230 (+400431us) service_pool.cc:224] Handling call
0709 12:12:18.813407 (+848177us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b54001680d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:18.813550 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":476463488}
W20260709 12:12:18.787603 19968 log.cc:927] Time spent T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 1.064s	user 0.000s	sys 0.004s
I20260709 12:12:18.851059 13800 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:12:18.861395 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 128207us
I20260709 12:12:18.875154 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:18.875526 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:18.876235 13760 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 16.
I20260709 12:12:18.812314 19907 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:18.763660 20019 consensus_queue.cc:1048] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.093s
I20260709 12:12:18.838131 19937 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:18.889647 13800 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:18.814916 19877 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:12:18.894376 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 74601.5us
I20260709 12:12:18.901925 13688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 1085) took 1006 ms. Trace:
I20260709 12:12:18.917026 13800 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:18.917897 13829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 1138) took 1182 ms. Trace:
I20260709 12:12:18.918421 13829 rpcz_store.cc:276] 0709 12:12:17.735482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:18.322038 (+586556us) service_pool.cc:224] Handling call
0709 12:12:18.384084 (+ 62046us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:18.384330 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:18.384353 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:18.386950 (+  2597us) log.cc:844] Serialized 26 byte log entry
0709 12:12:18.549564 (+162614us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:18.549621 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:18.549703 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:18.917597 (+367894us) raft_consensus.cc:1685] finished
0709 12:12:18.917621 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:18.917820 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":128128,"threads_started":1,"wal-append.queue_time_us":279160}
I20260709 12:12:18.892521 19712 raft_consensus.cc:3055] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:18.924602 13835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54820 (request call id 3177) took 1127 ms. Trace:
I20260709 12:12:18.902431 13688 rpcz_store.cc:276] 0709 12:12:17.895441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:17.895600 (+   159us) service_pool.cc:224] Handling call
0709 12:12:17.895983 (+   383us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:12:18.079679 (+183696us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:18.079726 (+    47us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:12:18.092971 (+ 13245us) log.cc:844] Serialized 78 byte log entry
0709 12:12:18.248535 (+155564us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:18.262139 (+ 13604us) log.cc:844] Serialized 14 byte log entry
0709 12:12:18.653988 (+391849us) spinlock_profiling.cc:243] Waited 7.61 ms on lock 0x7b18002c32c0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e1ac0a 00007fa92e55a219 00007fa924ea2a40 00007fa924e9d4e4 00007fa924e9d455 00007fa92b9853c7 00007fa927f979a7 00007fa927fa70bf 00007fa927fa7038
0709 12:12:18.656962 (+  2974us) log.cc:844] Serialized 14 byte log entry
0709 12:12:18.657257 (+   295us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:18.659971 (+  2714us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:18.901613 (+241642us) raft_consensus.cc:1685] finished
0709 12:12:18.901649 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:18.901858 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":398927,"prepare.queue_time_us":408196,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":80,"raft.queue_time_us":98005,"raft.run_cpu_time_us":406,"raft.run_wall_time_us":21799,"spinlock_wait_cycles":17493888,"thread_start_us":275396,"threads_started":2,"wal-append.queue_time_us":323232}
W20260709 12:12:18.955106 14413 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 1111) took 1680 ms (client timeout 1982 ms). Trace:
I20260709 12:12:18.925100 13835 rpcz_store.cc:276] 0709 12:12:17.796980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:17.954011 (+157031us) service_pool.cc:224] Handling call
0709 12:12:18.924427 (+970416us) spinlock_profiling.cc:243] Waited 673 ms on lock 0x7b54000b3bd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:18.924541 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1547509632}
W20260709 12:12:18.953610 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 182725us
W20260709 12:12:18.955770 14413 rpcz_store.cc:269] 0709 12:12:17.240809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:17.240973 (+   164us) service_pool.cc:224] Handling call
0709 12:12:18.921404 (+1680431us) spinlock_profiling.cc:243] Waited 270 ms on lock 0x7b54005a6c54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:18.921532 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":621795584}
I20260709 12:12:18.893978 19270 consensus_queue.cc:1059] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 12:12:18.835692 19951 consensus_queue.cc:237] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:18.969653 19913 raft_consensus.cc:3055] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:18.970741 19913 raft_consensus.cc:740] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:18.971359 13762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 2262) took 1112 ms. Trace:
I20260709 12:12:18.971625 19913 consensus_queue.cc:260] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:18.971997 13762 rpcz_store.cc:276] 0709 12:12:17.858474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:17.858639 (+   165us) service_pool.cc:224] Handling call
0709 12:12:17.890395 (+ 31756us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:17.956056 (+ 65661us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:18.970984 (+1014928us) spinlock_profiling.cc:243] Waited 64.9 ms on lock 0x7b54003a07d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:18.971253 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":149253376}
W20260709 12:12:18.974399 20025 log.cc:927] Time spent T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:12:18.978005 20038 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader election won for term 24
W20260709 12:12:18.978446 20030 log.cc:927] Time spent T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
W20260709 12:12:18.983002 20031 log.cc:927] Time spent T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:12:18.984453 19916 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:18.954469 19712 raft_consensus.cc:740] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:18.986737 19712 consensus_queue.cc:260] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:18.987358 19999 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:18.988180 19712 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:18.988090 19993 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:18.990620 20040 raft_consensus.cc:2804] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:19.003185 19987 raft_consensus.cc:2804] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:19.003911 19987 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:19.004333 19987 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:19.004979 19716 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:12:19.003324 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 218315us
I20260709 12:12:19.005589 19716 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:19.007561 19993 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:19.011370 13833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 3178) took 1207 ms. Trace:
I20260709 12:12:19.011921 13833 rpcz_store.cc:276] 0709 12:12:17.803892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:18.559566 (+755674us) service_pool.cc:224] Handling call
0709 12:12:18.589964 (+ 30398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:18.657901 (+ 67937us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:18.657951 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:18.658014 (+    63us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:18.658063 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:19.011070 (+353007us) spinlock_profiling.cc:243] Waited 67.6 ms on lock 0x7b540020dd54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:19.011134 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:19.011296 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":155566336}
W20260709 12:12:19.013896 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 55033.2us
I20260709 12:12:19.010591 13727 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:19.014295 13726 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:19.016856 19716 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:19.015666 20019 raft_consensus.cc:2749] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:19.020679 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 103743us
I20260709 12:12:19.021545 13800 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:19.021991 13726 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
W20260709 12:12:19.024763 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 124269us
I20260709 12:12:19.027050 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:19.030787 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:19.034880 13652 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:19.031482 13837 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 18.
I20260709 12:12:19.040591 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:19.042104 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:12:19.048094 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:19.048540 20043 raft_consensus.cc:2749] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:19.059456 13800 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:19.062177 13835 raft_consensus.cc:1275] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:12:19.063831 13800 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:19.065053 20042 consensus_queue.cc:1059] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.003s
I20260709 12:12:19.028368 19716 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:19.026767 20040 raft_consensus.cc:697] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 17 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:19.089645 20040 consensus_queue.cc:237] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:19.074745 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 52828.8us
I20260709 12:12:19.091450 13726 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:19.076082 20047 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:19.079442 19928 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:19.080842 19995 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:19.082074 20046 raft_consensus.cc:2749] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:19.020536 19886 consensus_queue.cc:1059] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.047s
I20260709 12:12:19.068065 20017 consensus_queue.cc:1048] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 12:12:19.099179 19886 raft_consensus.cc:3055] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:12:19.099591 19886 raft_consensus.cc:740] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:19.039534 19741 raft_consensus.cc:2804] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:19.084456 13761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 2249) took 1704 ms. Trace:
I20260709 12:12:19.100437 19886 consensus_queue.cc:260] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:19.086006 19712 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:19.087641 13686 raft_consensus.cc:1240] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 21 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:19.101711 19886 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:19.101001 13761 rpcz_store.cc:276] 0709 12:12:17.380355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:17.380504 (+   149us) service_pool.cc:224] Handling call
0709 12:12:17.380881 (+   377us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:17.381293 (+   412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:17.381323 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:17.381910 (+   587us) log.cc:844] Serialized 52 byte log entry
0709 12:12:17.543374 (+161464us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:17.612036 (+ 68662us) log.cc:844] Serialized 14 byte log entry
0709 12:12:17.612352 (+   316us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:17.612452 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:18.623503 (+1011051us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b18003cc9a0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924ea03f3 00007fa924ea27c1 00007fa924ea2779 00007fa924ea2709 00007fa924ea26d1 00007fa924ea19cd 0000000000388634 0000000000388479 00007fa924e8383a
0709 12:12:18.786653 (+163150us) spinlock_profiling.cc:243] Waited 34.3 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:12:19.084156 (+297503us) raft_consensus.cc:1685] finished
0709 12:12:19.084187 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:19.084382 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":71055,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":2732,"raft.queue_time_us":3460,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":3695,"spinlock_wait_cycles":105094784,"thread_start_us":144935,"threads_started":1,"wal-append.queue_time_us":330126}
I20260709 12:12:19.101495 19872 leader_election.cc:290] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:19.064812 20049 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:19.036646 20018 raft_consensus.cc:2804] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:19.095152 13800 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:19.098457 19918 raft_consensus.cc:2749] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:19.102615 19973 log.cc:927] Time spent T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 1.390s	user 0.003s	sys 0.008s
I20260709 12:12:19.121894 13800 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:19.124779 13726 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:19.127300 13726 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:19.111289 20007 raft_consensus.cc:2749] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:19.120347 20046 raft_consensus.cc:2749] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:19.101907 19712 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:19.138578 13726 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:19.125485 20018 raft_consensus.cc:697] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:19.123351 20038 raft_consensus.cc:697] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 24 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:19.130326 20017 raft_consensus.cc:2749] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:19.133625 19916 raft_consensus.cc:2749] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:19.144637 13726 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:19.096462 20047 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:19.162756 13830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 1133) took 1705 ms. Trace:
I20260709 12:12:19.168391 20038 consensus_queue.cc:237] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:19.171504 20042 raft_consensus.cc:2804] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:19.164153 13830 rpcz_store.cc:276] 0709 12:12:17.457488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:17.457683 (+   195us) service_pool.cc:224] Handling call
0709 12:12:17.458131 (+   448us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:17.467106 (+  8975us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:17.467136 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:17.467644 (+   508us) log.cc:844] Serialized 26 byte log entry
0709 12:12:17.630332 (+162688us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:17.630385 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:17.630807 (+   422us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:19.066167 (+1435360us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:12:19.147983 (+ 81816us) raft_consensus.cc:1685] finished
0709 12:12:19.148017 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:19.162536 (+ 14519us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6376,"raft.queue_time_us":8779,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":96,"spinlock_wait_cycles":25836416,"thread_start_us":162126,"threads_started":1,"wal-append.queue_time_us":197319}
I20260709 12:12:19.172642 20042 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:19.172433 20052 consensus_queue.cc:1048] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 12:12:19.173091 20042 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:19.174067 19916 raft_consensus.cc:2804] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:12:19.174623 19916 raft_consensus.cc:697] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:19.175545 19916 consensus_queue.cc:237] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:19.178642 20020 raft_consensus.cc:2749] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 12:12:19.178812 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 144034us
I20260709 12:12:19.140364 19937 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:19.179582 13652 leader_election.cc:304] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
W20260709 12:12:19.179903 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:19.180500 20029 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:19.179811 19872 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:19.181001 13651 leader_election.cc:304] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:19.181557 19872 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:19.183616 20007 raft_consensus.cc:2804] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:19.183894 19872 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:19.184080 20007 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:19.184466 20007 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:19.178061 19877 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:19.162914 19970 log.cc:927] Time spent T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 1.441s	user 0.000s	sys 0.004s
I20260709 12:12:19.181979 20047 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:19.180948 19937 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:19.161746 20046 raft_consensus.cc:2749] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:19.187846 13726 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:19.189841 13761 raft_consensus.cc:1275] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:12:19.181054 20029 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:19.211422 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:19.146790 20044 raft_consensus.cc:2749] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:19.215991 13685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 3082) took 1030 ms. Trace:
I20260709 12:12:19.216686 13757 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 21.
I20260709 12:12:19.220029 13651 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:19.224735 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:19.218482 13685 rpcz_store.cc:276] 0709 12:12:18.185338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:18.463685 (+278347us) service_pool.cc:224] Handling call
0709 12:12:18.464038 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:18.464320 (+   282us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:12:18.727260 (+262940us) log.cc:844] Serialized 14 byte log entry
0709 12:12:18.844489 (+117229us) log.cc:844] Serialized 14 byte log entry
0709 12:12:19.106169 (+261680us) spinlock_profiling.cc:243] Waited 3.65 ms on lock 0x7b18003cf280. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e1ac0a 00007fa92e55a219 00007fa924ea2a40 00007fa924e9d4e4 00007fa924e9d455 00007fa927f85060 00007fa927f97716 00007fa927fa8287 00007fa927fa8208
0709 12:12:19.185529 (+ 79360us) spinlock_profiling.cc:243] Waited 2.6 ms on lock 0x7b18003cf280. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924ea03f3 00007fa924ea27c1 00007fa924ea2779 00007fa924ea2709 00007fa924ea26d1 00007fa924ea19cd 0000000000388634 0000000000388479 00007fa924e8383a
0709 12:12:19.215680 (+ 30151us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:19.215729 (+    49us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:19.215770 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:19.215830 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:19.215935 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":259831,"prepare.queue_time_us":244885,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":97,"raft.queue_time_us":549079,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":5366,"spinlock_wait_cycles":14385280,"thread_start_us":289379,"threads_started":3,"wal-append.queue_time_us":167162}
I20260709 12:12:19.223742 20020 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:19.239897 13726 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:19.226825 19718 raft_consensus.cc:2804] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:12:19.242738 13652 connection.cc:256] RPC call timeout handler was delayed by -1.6333112689999325s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1902s for a response
W20260709 12:12:19.248091 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 122756us
I20260709 12:12:19.249270 13683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 1086) took 1348 ms. Trace:
I20260709 12:12:19.249487 19878 consensus_queue.cc:1048] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 12:12:19.250367 19712 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:19.251672 20056 consensus_queue.cc:1059] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:12:19.252054 20029 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:19.252599 20056 consensus_queue.cc:1048] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:12:19.252910 19995 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:19.253562 20044 raft_consensus.cc:3055] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:19.254005 20044 raft_consensus.cc:740] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:19.254930 20044 consensus_queue.cc:260] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:19.255632 19718 raft_consensus.cc:697] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:19.256306 20044 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:19.256734 19718 consensus_queue.cc:237] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:19.229067 19894 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:19.236665 19928 leader_election.cc:290] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:19.259661 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:19.260619 20039 consensus_queue.cc:1059] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 12:12:19.261359 20037 raft_consensus.cc:2804] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:19.262724 20018 consensus_queue.cc:237] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:19.263985 13685 raft_consensus.cc:1275] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 13 index: 5. Preceding OpId from leader: term: 16 index: 7. (index mismatch)
I20260709 12:12:19.267757 13761 raft_consensus.cc:1240] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:19.269032 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:19.239205 20020 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:19.270838 20033 consensus_queue.cc:1048] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 12:12:19.271653 20048 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:19.320868 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:19.277400 19741 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:19.299098 13762 raft_consensus.cc:1240] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 12:12:19.299947 13763 raft_consensus.cc:1275] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:12:19.249742 13683 rpcz_store.cc:276] 0709 12:12:17.900807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:17.900976 (+   169us) service_pool.cc:224] Handling call
0709 12:12:17.901326 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:18.102391 (+201065us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:18.102436 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:19.090016 (+987580us) spinlock_profiling.cc:243] Waited 1.43 ms on lock 0x7b2c000014c8. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa926886a11 00007fa926896372 00007fa927fc8a01 00007fa927f8d43a 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2
0709 12:12:19.090429 (+   413us) log.cc:844] Serialized 26 byte log entry
0709 12:12:19.228915 (+138486us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:19.228956 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:19.229178 (+   222us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:19.248975 (+ 19797us) raft_consensus.cc:1685] finished
0709 12:12:19.248999 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:19.249211 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63247,"raft.queue_time_us":69813,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":19073,"spinlock_wait_cycles":3283200,"thread_start_us":279635,"threads_started":2,"wal-append.queue_time_us":156749}
W20260709 12:12:19.243223 13652 connection.cc:256] RPC call timeout handler was delayed by -1.6135112689999005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19240000000000002s for a response
I20260709 12:12:19.328127 13652 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:19.306492 13679 raft_consensus.cc:1240] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 17. Current term is 18. Ops: [12.7-17.9]
I20260709 12:12:19.307551 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:19.249006 20060 raft_consensus.cc:2749] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:12:19.297866 19270 raft_consensus.cc:3055] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:19.317615 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:19.314407 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:19.315459 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:19.316530 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:12:19.334211 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 94417.1us
I20260709 12:12:19.320778 20020 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:19.320892 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:19.323506 20048 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:19.301671 19894 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:19.315641 20042 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:19.311172 19716 raft_consensus.cc:2749] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:19.330966 13759 raft_consensus.cc:2368] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 16. Current term is 17.
I20260709 12:12:19.331744 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:19.345120 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:19.346169 13830 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 16.
I20260709 12:12:19.347174 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:19.334162 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:19.335357 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:19.348188 13834 raft_consensus.cc:2393] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 14: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:19.336189 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:19.324566 20037 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:19.324496 19877 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:19.337368 13726 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:19.333438 13760 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 18.
I20260709 12:12:19.294935 20017 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:19.341367 13828 raft_consensus.cc:2410] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 12:12:19.352697 13726 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:19.312440 20055 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:19.348349 13830 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:19.350086 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:19.355813 13836 raft_consensus.cc:2410] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 12:12:19.331450 19741 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:19.351226 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:19.339715 19270 raft_consensus.cc:740] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
W20260709 12:12:19.358381 13828 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54830 (request call id 2930) took 1787 ms (client timeout 1798 ms). Trace:
I20260709 12:12:19.357165 13652 leader_election.cc:400] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 election: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 16. Current term is 17.
I20260709 12:12:19.360909 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:12:19.362322 19985 log.cc:927] Time spent T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 1.122s	user 0.003s	sys 0.000s
I20260709 12:12:19.362777 13832 raft_consensus.cc:2393] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 17: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:19.363179 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:19.365500 13652 leader_election.cc:403] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:12:19.343737 19984 raft_consensus.cc:2749] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:19.367605 13834 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:19.341326 20046 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:19.365391 13828 rpcz_store.cc:269] 0709 12:12:17.567987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:17.743819 (+175832us) service_pool.cc:224] Handling call
0709 12:12:19.320735 (+1576916us) spinlock_profiling.cc:243] Waited 2.56 ms on lock 0x7b5800034898. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924e68b71 00007fa924e68a22 00007fa92dd818d9 00007fa92cedbee0 00007fa92cfa50ab 00007fa92cfa5131 00007fa92cf530a0 00007fa92cf52984 00007fa9264cd6d4 00007fa9264cd662
0709 12:12:19.355367 (+ 34632us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5897472}
I20260709 12:12:19.394968 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:19.341918 20048 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:19.349046 20037 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:19.386591 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:19.386890 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:19.403996 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:19.404704 13832 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 18.
I20260709 12:12:19.409752 13800 leader_election.cc:400] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 election: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 16. Current term is 17.
I20260709 12:12:19.410351 13800 leader_election.cc:403] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
W20260709 12:12:19.412744 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 60143.6us
W20260709 12:12:19.412730 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 55690.2us
I20260709 12:12:19.414287 13726 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:19.412181 13800 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:19.367697 19716 raft_consensus.cc:2749] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:19.367900 20060 raft_consensus.cc:2804] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:19.419080 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:19.419734 13836 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:19.425702 13830 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 17.
I20260709 12:12:19.427726 19937 raft_consensus.cc:2804] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:19.428194 19937 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:19.428575 19937 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:19.430145 19712 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:19.430939 19712 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:19.434388 19712 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:19.403589 20038 consensus_queue.cc:1059] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.022s
I20260709 12:12:19.433432 13726 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:19.437811 13652 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:19.444824 13652 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:19.449350 20061 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:19.454063 13652 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:19.420740 20039 raft_consensus.cc:2749] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 16. Current term is 17.
I20260709 12:12:19.456821 13652 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:19.426627 20060 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:19.359002 20017 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:19.460891 20062 log.cc:927] Time spent T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 12:12:19.460897 20035 raft_consensus.cc:2749] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:19.467550 13836 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 16.
I20260709 12:12:19.455540 19984 raft_consensus.cc:2749] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:19.406421 20046 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:19.486044 20007 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:19.476457 19716 raft_consensus.cc:2749] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:19.502178 20007 leader_election.cc:290] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:19.435385 20043 raft_consensus.cc:2749] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 16. Current term is 17.
I20260709 12:12:19.359315 20055 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:19.472478 19937 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:19.480552 13727 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:19.487255 13828 raft_consensus.cc:1275] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:12:19.443485 19928 consensus_queue.cc:1048] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:12:19.455164 19951 raft_consensus.cc:2749] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:19.470582 13834 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 14.
I20260709 12:12:19.474016 20060 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:19.545486 13830 raft_consensus.cc:1240] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:12:19.499790 20046 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:19.505133 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:19.505654 13757 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 18.
I20260709 12:12:19.534847 13829 raft_consensus.cc:1275] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:12:19.473827 19992 raft_consensus.cc:2804] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:19.511579 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:19.518260 20061 raft_consensus.cc:2749] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:19.548454 13836 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:19.548765 13727 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:19.476730 20067 consensus_queue.cc:1048] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.061s
I20260709 12:12:19.523061 19741 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:19.524996 20017 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:19.525663 13833 raft_consensus.cc:2410] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:12:19.526885 13828 raft_consensus.cc:1275] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:12:19.533411 19890 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:19.534135 20007 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:12:19.534817 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 1.26016e+06us
I20260709 12:12:19.538878 19969 raft_consensus.cc:697] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 17 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:19.540491 19986 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:19.554873 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:19.555941 14415 raft_consensus.cc:1240] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 23. Current term is 24. Ops: [23.16-23.16]
I20260709 12:12:19.567857 20042 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:19.557953 19976 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:19.567319 13762 raft_consensus.cc:1275] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:12:19.568800 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:19.537065 19270 consensus_queue.cc:260] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:19.543792 19716 raft_consensus.cc:2804] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:19.543474 19858 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:19.551877 19992 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:19.577622 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:19.555945 19886 raft_consensus.cc:2804] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:19.581182 13688 raft_consensus.cc:1275] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 12:12:19.585023 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 125976us
W20260709 12:12:19.942925 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:19.943184 19741 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:19.943413 13800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:19.572407 20007 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:19.947480 20019 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:19.947952 19744 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:19.948755 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:19.949513 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:19.950328 19564 consensus_queue.cc:1048] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:19.951455 19760 consensus_queue.cc:1059] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:19.952195 19971 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
W20260709 12:12:20.001093 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:19.963234 20055 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:20.013200 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:19.964902 19894 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:19.966347 19937 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:19.568220 19669 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:19.587646 19976 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:19.973613 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 555049us
I20260709 12:12:19.973687 19947 raft_consensus.cc:3055] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:19.659483 19270 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:19.579380 19986 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:19.617023 19969 consensus_queue.cc:237] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:19.584082 13828 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 18.
W20260709 12:12:19.984689 20037 consensus_meta.cc:287] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.574s	user 0.010s	sys 0.005s
W20260709 12:12:19.610508 20063 log.cc:927] Time spent T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 12:12:20.003623 13800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:19.972795 20049 consensus_meta.cc:287] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.850s	user 0.010s	sys 0.004s
W20260709 12:12:20.011344 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 57112.7us
I20260709 12:12:20.010051 14413 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 17.
I20260709 12:12:20.008967 19886 raft_consensus.cc:697] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:12:19.977713 20020 consensus_meta.cc:287] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.628s	user 0.013s	sys 0.000s
W20260709 12:12:19.984422 20064 log.cc:927] Time spent T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.504s	user 0.000s	sys 0.009s
I20260709 12:12:20.045336 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:19.561691 19907 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
W20260709 12:12:20.011691 20072 log.cc:927] Time spent T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.416s	user 0.000s	sys 0.027s
I20260709 12:12:19.992614 19992 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:20.021066 13836 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 17.
I20260709 12:12:20.066004 13761 raft_consensus.cc:1240] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:20.066490 19760 raft_consensus.cc:3055] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:19.981600 19856 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:20.035470 19947 raft_consensus.cc:740] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:20.108229 19947 consensus_queue.cc:260] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:20.109265 19947 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:20.109378 19995 consensus_queue.cc:1048] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:20.092199 19907 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:20.111382 19886 consensus_queue.cc:237] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:20.112378 19907 leader_election.cc:290] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:20.036754 19971 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:19.986864 19716 raft_consensus.cc:697] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:20.000722 20051 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:20.006402 20061 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:20.030911 13726 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:20.057525 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:20.061640 14380 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:12:20.122524 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 60952.1us
I20260709 12:12:20.009043 19718 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:12:20.074388 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 76629.4us
I20260709 12:12:20.076737 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:20.040649 20035 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.080958 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:20.132611 13828 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 20.
I20260709 12:12:20.084355 14414 raft_consensus.cc:1275] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 12:12:20.133268 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 102996us
I20260709 12:12:20.096503 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:20.043727 19669 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:20.150209 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:20.097242 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:20.064435 20037 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:20.016009 20019 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:20.020367 19744 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:20.157236 13727 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:20.103161 19976 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:20.104274 20048 consensus_meta.cc:287] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.691s	user 0.012s	sys 0.005s
I20260709 12:12:20.104614 20007 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:12:20.105831 19987 consensus_meta.cc:287] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 1.101s	user 0.021s	sys 0.000s
I20260709 12:12:20.023730 20060 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:20.107270 19682 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:20.007983 19858 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:20.116946 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:20.134765 14408 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 18.
I20260709 12:12:20.136827 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:20.155423 14411 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 15.
I20260709 12:12:20.092171 19760 raft_consensus.cc:740] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:20.071657 20049 raft_consensus.cc:2749] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:20.095602 20020 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:20.178462 20037 leader_election.cc:290] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:20.180249 19744 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:20.117965 19856 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:20.182935 20019 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:20.184299 14415 raft_consensus.cc:2393] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 12: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:20.185350 14413 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 20.
I20260709 12:12:20.190479 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:20.183357 19669 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:20.156458 20018 raft_consensus.cc:2804] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:12:20.199674 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 130004us
I20260709 12:12:20.192878 20050 raft_consensus.cc:3055] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:20.153730 20061 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:20.154482 20051 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:20.210790 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:20.224004 14408 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 16.
I20260709 12:12:20.211076 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:20.218531 19856 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:20.160622 19741 consensus_queue.cc:1048] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 12:12:20.224905 19716 consensus_queue.cc:237] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:20.201344 19564 raft_consensus.cc:2804] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:20.226907 19856 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:20.190603 19987 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:20.228068 13760 raft_consensus.cc:1240] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 16. Current term is 17. Ops: [16.7-16.7]
I20260709 12:12:20.228324 20019 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.228919 20019 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:20.229235 20061 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:20.160712 19718 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:20.204735 19447 raft_consensus.cc:2749] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:20.183689 20048 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:20.233332 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:20.236510 13835 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 17.
I20260709 12:12:20.239264 13754 raft_consensus.cc:1275] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:12:20.241570 13761 raft_consensus.cc:1240] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:20.199651 19682 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:20.151572 20035 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:20.254943 13830 raft_consensus.cc:1240] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:20.255618 13835 raft_consensus.cc:1240] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 19. Current term is 20. Ops: [17.11-19.12]
I20260709 12:12:20.229291 19987 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:20.245167 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:20.268707 13836 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 14.
I20260709 12:12:20.269933 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:20.270843 13836 raft_consensus.cc:2393] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 20: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:20.232062 20018 raft_consensus.cc:697] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:20.247655 13652 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:20.263947 20060 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:20.245715 19937 consensus_queue.cc:1059] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 12:12:20.265122 20044 consensus_queue.cc:1048] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:12:20.265710 20019 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:20.267127 13830 raft_consensus.cc:1240] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:20.222236 20050 raft_consensus.cc:740] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:20.279686 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:20.248982 20041 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.224169 20037 consensus_queue.cc:1048] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 12:12:20.306258 13756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 3076) took 1647 ms. Trace:
I20260709 12:12:20.304639 13835 raft_consensus.cc:1275] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:12:20.249194 20042 consensus_queue.cc:1059] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 12:12:20.315769 13756 rpcz_store.cc:276] 0709 12:12:18.659316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:18.659840 (+   524us) service_pool.cc:224] Handling call
0709 12:12:18.661751 (+  1911us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:18.716217 (+ 54466us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:20.305727 (+1589510us) spinlock_profiling.cc:243] Waited 53.6 ms on lock 0x7b5400417654. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:20.306165 (+   438us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":123373952}
I20260709 12:12:20.291075 13652 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:12:20.324354 19916 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.998s	user 0.003s	sys 0.036s
I20260709 12:12:20.316674 19986 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:20.342569 13834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 3196) took 1004 ms. Trace:
I20260709 12:12:20.343176 13834 rpcz_store.cc:276] 0709 12:12:19.338409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:19.557088 (+218679us) service_pool.cc:224] Handling call
0709 12:12:19.573886 (+ 16798us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:19.584431 (+ 10545us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:19.584465 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:19.634565 (+ 50100us) log.cc:844] Serialized 52 byte log entry
0709 12:12:20.156648 (+522083us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:20.156699 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:20.156768 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:20.342219 (+185451us) raft_consensus.cc:1685] finished
0709 12:12:20.342250 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:20.342489 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":95,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":7160,"thread_start_us":122389,"threads_started":1,"wal-append.queue_time_us":244557}
I20260709 12:12:20.304999 20007 raft_consensus.cc:2804] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:20.333254 19883 consensus_queue.cc:1059] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
W20260709 12:12:20.335695 19916 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.012s	user 0.003s	sys 0.037s
I20260709 12:12:20.337953 19971 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:20.338793 19682 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:20.338937 13652 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:20.339263 20008 consensus_queue.cc:1059] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:20.334420 20082 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.330138 19947 raft_consensus.cc:2804] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:20.274111 19760 consensus_queue.cc:260] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:20.365935 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 180990us
I20260709 12:12:20.324518 20041 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:20.363246 20079 log.cc:927] Time spent T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 12:12:20.364940 19576 raft_consensus.cc:2804] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:20.335971 19842 consensus_queue.cc:1059] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 12:12:20.360754 19858 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:20.367290 19947 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:20.370296 20007 raft_consensus.cc:697] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 17 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:20.369868 20055 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:20.377472 19576 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:20.384191 19447 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:20.375294 19894 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.377314 20078 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:20.375154 19916 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.381044 20020 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:20.358523 20050 consensus_queue.cc:260] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:20.384539 19947 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:20.375094 19878 consensus_queue.cc:1048] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:12:20.358795 20018 consensus_queue.cc:237] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:20.391450 20042 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:20.382259 19682 consensus_queue.cc:1048] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.021s
I20260709 12:12:20.398262 19576 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:20.469218 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 312073us
I20260709 12:12:20.402082 20051 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:12:20.475905 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:20.404700 19718 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:20.368659 20082 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:20.405072 19741 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:20.402792 19447 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:20.491204 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:20.496688 13727 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
W20260709 12:12:20.500447 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:20.509805 13800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:20.409560 19916 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:20.398156 20055 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:20.405880 19894 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:20.483932 20035 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:20.525341 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 170538us
I20260709 12:12:20.526240 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:20.528079 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:20.534198 14408 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:20.481729 19907 consensus_queue.cc:1048] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 12:12:20.510659 20017 raft_consensus.cc:2804] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:20.535158 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:12:20.536899 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 105018us
I20260709 12:12:20.540102 20060 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.543608 13727 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:20.548869 20060 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:20.479513 20042 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:20.549655 20086 log.cc:927] Time spent T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:12:20.549672 19718 raft_consensus.cc:2804] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:20.550292 19718 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:20.550711 19718 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:20.551223 20060 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:20.551322 20083 log.cc:927] Time spent T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 12:12:20.552193 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:20.553447 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:20.554303 13685 raft_consensus.cc:2368] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for earlier term 21. Current term is 22.
I20260709 12:12:20.554338 13652 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:20.506349 19957 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.542019 20061 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.510875 20050 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:20.406858 20078 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:20.557648 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:20.563966 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:20.556988 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:20.560757 13652 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:20.561903 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:20.563179 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:20.566141 13688 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 12.
I20260709 12:12:20.564592 13683 raft_consensus.cc:2368] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for earlier term 16. Current term is 17.
I20260709 12:12:20.562985 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:20.567405 13761 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 11.
I20260709 12:12:20.569865 13762 raft_consensus.cc:2393] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 21: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:20.571673 13754 raft_consensus.cc:2393] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 16: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:20.485378 20007 consensus_queue.cc:237] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:20.545141 19682 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.514345 19741 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:20.573693 13652 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:20.544183 20017 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:20.595933 13833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54830 (request call id 2932) took 1263 ms. Trace:
I20260709 12:12:20.596439 13833 rpcz_store.cc:276] 0709 12:12:19.332581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:19.333928 (+  1347us) service_pool.cc:224] Handling call
0709 12:12:20.595716 (+1261788us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b5400166cd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:20.595868 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":408067968}
I20260709 12:12:20.519842 19992 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:20.565640 20020 raft_consensus.cc:2749] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:20.621248 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:20.580835 13829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 3191) took 1248 ms. Trace:
I20260709 12:12:20.622550 13829 rpcz_store.cc:276] 0709 12:12:19.332581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:19.332717 (+   136us) service_pool.cc:224] Handling call
0709 12:12:19.333021 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:19.547269 (+214248us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:20.580551 (+1033282us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b540020d854. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:20.580764 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":463339904}
I20260709 12:12:20.582096 13831 raft_consensus.cc:1240] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 12:12:20.559237 20096 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:20.599488 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:20.600339 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:20.620064 13758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48114 (request call id 3086) took 1366 ms. Trace:
I20260709 12:12:20.601390 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:20.603103 13757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48120 (request call id 2273) took 1281 ms. Trace:
I20260709 12:12:20.575202 19994 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:12:20.616670 20095 log.cc:927] Time spent T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 12:12:20.618011 20089 log.cc:927] Time spent T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 12:12:20.637197 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:20.561480 20035 consensus_queue.cc:1048] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.058s
I20260709 12:12:20.647774 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:20.627149 13758 rpcz_store.cc:276] 0709 12:12:19.223938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:19.224498 (+   560us) service_pool.cc:224] Handling call
0709 12:12:20.590295 (+1365797us) spinlock_profiling.cc:243] Waited 376 ms on lock 0x7b5400333bd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:20.590455 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":863737600}
I20260709 12:12:20.627949 13682 raft_consensus.cc:2410] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for term 13 because replica has last-logged OpId of term: 11 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 12:12:20.620503 20017 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:20.628903 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:20.570749 20061 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:20.626392 13754 raft_consensus.cc:2393] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 18: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:20.624397 20096 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:20.629586 20093 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.626291 20041 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:20.640956 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:12:20.627023 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:20.627624 13757 rpcz_store.cc:276] 0709 12:12:19.313705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:19.314143 (+   438us) service_pool.cc:224] Handling call
0709 12:12:20.594822 (+1280679us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b54003930d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:20.594991 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":394053504}
I20260709 12:12:20.594359 19878 raft_consensus.cc:2749] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:20.566751 19957 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:20.628664 14408 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 18.
I20260709 12:12:20.598688 19682 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:20.666438 19718 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:20.656807 20035 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.680635 14380 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:20.689399 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:20.691836 13833 raft_consensus.cc:1240] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 12:12:20.692898 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:20.695201 20041 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.698378 20041 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:20.700541 20041 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:20.695403 20065 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:20.695595 19716 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:20.702270 19716 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:20.704407 19716 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:20.676951 19993 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.704766 13830 raft_consensus.cc:1275] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:12:20.705185 19993 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:20.706188 13829 raft_consensus.cc:1275] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:12:20.707207 20041 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:20.707791 20041 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:20.710158 20041 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:20.711612 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:20.713042 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:20.707333 19993 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:20.714723 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:20.715579 13830 raft_consensus.cc:2393] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 20: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:20.717455 13837 raft_consensus.cc:1240] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:20.718497 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:20.718595 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:20.721803 13833 raft_consensus.cc:1240] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 12. Current term is 13. Ops: []
W20260709 12:12:20.712734 19270 consensus_meta.cc:287] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.659s	user 0.009s	sys 0.005s
I20260709 12:12:20.729038 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:20.733148 13835 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 16.
I20260709 12:12:20.729833 13830 raft_consensus.cc:1275] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:12:20.673552 20093 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:20.737756 14408 raft_consensus.cc:1240] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 19 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 12:12:20.734666 13760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 2277) took 1302 ms. Trace:
I20260709 12:12:20.740347 13760 rpcz_store.cc:276] 0709 12:12:19.432103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:19.432278 (+   175us) service_pool.cc:224] Handling call
0709 12:12:19.432657 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:20.228450 (+795793us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:20.734272 (+505822us) spinlock_profiling.cc:243] Waited 795 ms on lock 0x7b54003a07d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:20.734578 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1828749696}
I20260709 12:12:20.751302 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:20.717850 20055 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:20.720682 20104 raft_consensus.cc:2749] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:20.754231 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:20.757189 13835 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 17.
I20260709 12:12:20.687665 20035 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:20.760116 14409 raft_consensus.cc:1275] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:12:20.748631 19894 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:20.762467 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:20.763695 19894 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:20.764274 19894 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:20.766577 20051 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.749981 19576 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:20.767159 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:20.769202 19576 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:20.769345 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:20.767204 20051 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:20.770555 20103 log.cc:927] Time spent T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:12:20.772290 20051 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:20.786414 20108 consensus_queue.cc:1048] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:20.787990 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:20.788347 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:20.789134 13763 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 20.
I20260709 12:12:20.790293 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:20.792004 19870 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:20.701521 20065 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:20.795321 13800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:20.795382 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
W20260709 12:12:20.767098 20098 log.cc:927] Time spent T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 12:12:20.792879 19870 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:20.801666 13652 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:20.802081 20065 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:20.802981 19992 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:20.804420 13801 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:20.804986 20061 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:20.806816 19957 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:20.796813 13800 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:20.814565 13800 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:20.820596 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:20.825049 13837 raft_consensus.cc:1240] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:12:20.826151 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:20.828516 13837 raft_consensus.cc:1240] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 19. Current term is 20. Ops: [17.11-19.12]
I20260709 12:12:20.831729 13758 raft_consensus.cc:1240] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:20.819756 19270 consensus_queue.cc:1059] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 15.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 12:12:20.832912 19270 raft_consensus.cc:3055] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:20.833297 19270 raft_consensus.cc:740] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:20.833896 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:20.834558 13763 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 12.
I20260709 12:12:20.834848 20109 consensus_queue.cc:1059] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:12:20.835666 19878 consensus_queue.cc:1059] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:20.836619 20093 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:20.835772 13754 raft_consensus.cc:1240] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:20.821688 20065 raft_consensus.cc:2804] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:20.842355 20065 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:20.842907 20065 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:20.827010 13829 raft_consensus.cc:2468] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 12.
I20260709 12:12:20.846256 20019 raft_consensus.cc:2804] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:20.846933 20019 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:20.847396 20019 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:20.821098 19937 raft_consensus.cc:3055] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:20.850746 19894 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:20.850852 19937 raft_consensus.cc:740] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:20.808305 20042 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:12:20.859859 13801 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.56.196:46341 timed out after 1.793s (SENT) [suppressed 20 similar messages]
I20260709 12:12:20.853693 13652 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:20.816139 19576 raft_consensus.cc:2749] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:20.870096 19564 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:20.870690 19564 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:20.819742 19682 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:12:20.882810 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:20.883261 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:20.905743 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 49419us
I20260709 12:12:20.906837 13800 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:20.864187 19741 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:20.877128 19894 raft_consensus.cc:2804] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:20.898268 20055 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:20.956802 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 148109us
I20260709 12:12:20.958097 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:12:20.948273 19947 consensus_meta.cc:287] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.519s	user 0.015s	sys 0.001s
I20260709 12:12:20.958879 13754 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 16.
I20260709 12:12:20.852404 19937 consensus_queue.cc:260] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:20.946521 20093 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
W20260709 12:12:21.008309 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 148511us
I20260709 12:12:20.949849 19894 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:20.948154 20126 raft_consensus.cc:2804] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:12:21.013597 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 390958us
I20260709 12:12:20.950776 19866 consensus_queue.cc:1059] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.061s
I20260709 12:12:21.019086 14379 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:20.961591 19993 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:21.003727 20043 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.911105 19270 consensus_queue.cc:260] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 16.7, Last appended by leader: 7, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:21.016160 19937 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:21.025417 13800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:21.025884 19993 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:21.030694 20116 log.cc:927] Time spent T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 12:12:21.030786 19951 raft_consensus.cc:3055] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:21.031476 19951 raft_consensus.cc:740] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:21.032913 19951 consensus_queue.cc:260] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:21.016544 20035 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:21.006577 19947 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:21.015915 19870 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:21.015717 19894 raft_consensus.cc:3060] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:21.010957 20093 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:21.017458 20042 consensus_queue.cc:1175] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" responder_term: 17 status { last_received { term: 16 index: 10 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 16. Current term is 17. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:12:21.025463 20084 raft_consensus.cc:2804] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:21.044486 13684 raft_consensus.cc:1240] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:21.085253 13679 raft_consensus.cc:1275] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 8. (term mismatch)
I20260709 12:12:21.085736 13679 pending_rounds.cc:85] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 7
I20260709 12:12:21.086037 13679 pending_rounds.cc:107] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260709 12:12:21.086280 13679 raft_consensus.cc:2889] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:21.017705 20126 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:21.087445 20126 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:20.999195 20055 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:21.052968 13652 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:21.053654 20007 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:12:21.054651 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:21.055234 19866 consensus_queue.cc:1048] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:12:21.059686 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:21.103636 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:12:21.104236 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:21.030929 19993 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:21.079201 14379 leader_election.cc:400] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 21 pre-election: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for earlier term 21. Current term is 22.
I20260709 12:12:21.105742 14379 leader_election.cc:403] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:21.025736 19718 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:21.046396 20120 log.cc:927] Time spent T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.081s	user 0.001s	sys 0.004s
W20260709 12:12:21.101480 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 49009.7us
I20260709 12:12:21.026292 20017 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:21.073091 19872 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.112044 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:21.080528 19870 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.114235 20122 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Advancing to term 22
I20260709 12:12:21.099500 20033 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:21.116117 20093 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:21.106222 19951 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:21.084931 19576 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.079320 20035 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:21.118129 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:21.121309 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:21.100230 20084 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:21.124097 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:21.103948 19995 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:12:21.036121 20043 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:21.134346 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:21.136260 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:21.140837 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:21.142174 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:21.142829 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:21.146282 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:21.147576 13679 raft_consensus.cc:2393] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 12: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
W20260709 12:12:21.148641 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 69689.7us
I20260709 12:12:21.106705 20007 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:21.152861 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:21.158150 13686 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:21.159622 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:21.144837 20084 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:21.125562 19872 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:21.235612 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:21.222997 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:21.239478 13685 raft_consensus.cc:2393] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 16: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:21.161028 20133 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:21.127226 19870 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:21.250485 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:21.146301 19564 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:21.166352 19947 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:21.140214 19576 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:21.221006 20008 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.144299 20035 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:21.309974 13800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:21.337262 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 187665us
W20260709 12:12:21.325116 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:21.329350 20008 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:21.338928 14379 leader_election.cc:400] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 pre-election: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for earlier term 16. Current term is 17.
I20260709 12:12:21.340418 14379 leader_election.cc:403] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:21.340956 20008 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:21.329857 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:21.297164 20134 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.343216 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:21.346784 13681 raft_consensus.cc:1240] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 17 LEADER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:21.233167 13683 raft_consensus.cc:1275] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:12:21.348565 14379 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:21.354884 13685 raft_consensus.cc:1240] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:21.362520 14379 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:21.363888 13683 pending_rounds.cc:85] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 11
I20260709 12:12:21.364315 13683 pending_rounds.cc:107] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 11.12
I20260709 12:12:21.364809 13683 raft_consensus.cc:2889] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:21.372931 13685 raft_consensus.cc:1275] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:12:21.350366 19947 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.134441 20033 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:21.363343 20065 consensus_meta.cc:287] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.520s	user 0.012s	sys 0.003s
I20260709 12:12:21.342855 20134 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:21.362478 19682 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:21.385746 19447 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:21.388039 13684 raft_consensus.cc:3055] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:21.388615 13684 raft_consensus.cc:740] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:21.385156 19870 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:21.356643 20135 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:12:21.367642 19898 raft_consensus.cc:2749] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:21.393186 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:21.395787 13685 raft_consensus.cc:2410] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 20 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:12:21.389406 13684 consensus_queue.cc:260] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:21.388924 20122 raft_consensus.cc:2749] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for earlier term 21. Current term is 22.
W20260709 12:12:21.407363 13800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:21.382078 20055 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:21.412588 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 44127.7us
I20260709 12:12:21.383178 19947 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:21.274243 20133 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:21.444083 20055 consensus_queue.cc:1059] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:21.444768 20134 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:21.392838 20065 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:21.446195 14415 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41700 (request call id 916) took 1844 ms (client timeout 1551 ms). Trace:
W20260709 12:12:21.446640 14415 rpcz_store.cc:269] 0709 12:12:19.602089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:19.948491 (+346402us) service_pool.cc:224] Handling call
0709 12:12:21.445961 (+1497470us) spinlock_profiling.cc:243] Waited 174 ms on lock 0x7b54005a6c54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:21.446108 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":400919936}
W20260709 12:12:21.447296 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 83480.4us
I20260709 12:12:21.420545 20017 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:21.452201 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:21.430721 19912 raft_consensus.cc:2804] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:12:21.439221 20050 consensus_meta.cc:287] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.874s	user 0.013s	sys 0.000s
I20260709 12:12:21.445398 20055 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
W20260709 12:12:21.476318 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:21.468108 20019 consensus_meta.cc:287] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.620s	user 0.011s	sys 0.002s
I20260709 12:12:21.456652 19564 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:21.405509 20136 consensus_queue.cc:1059] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 12:12:21.471105 20007 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:21.483580 19872 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:21.493970 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:21.496209 13685 raft_consensus.cc:2393] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 20: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:21.481055 20043 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:21.489483 20035 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:21.491655 19576 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:21.510839 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:21.511016 13686 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 17.
I20260709 12:12:21.512403 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:21.513322 13686 raft_consensus.cc:2393] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 18: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:21.479184 20055 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:21.514212 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:21.454495 20092 consensus_queue.cc:1059] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 12:12:21.487695 20019 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:21.495039 19937 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:21.497490 20130 log.cc:927] Time spent T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 12:12:21.519654 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:21.518122 13686 raft_consensus.cc:2393] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 19: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:21.526005 19421 raft_consensus.cc:3055] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:21.526430 19421 raft_consensus.cc:740] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:21.527242 19421 consensus_queue.cc:260] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:21.538679 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:21.540107 13686 raft_consensus.cc:2393] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 15: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:21.541652 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:21.545624 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:21.542655 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:21.553176 13833 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:21.553232 13837 raft_consensus.cc:1240] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:21.554486 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:21.526829 20133 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:21.558992 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:21.568467 20140 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:21.568907 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:12:21.570286 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:21.569567 13834 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 16.
I20260709 12:12:21.561580 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:21.572631 13830 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:21.529949 19421 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:21.529059 19937 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:21.585247 13831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 2936) took 2249 ms. Trace:
I20260709 12:12:21.585734 13831 rpcz_store.cc:276] 0709 12:12:19.335875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:19.336012 (+   137us) service_pool.cc:224] Handling call
0709 12:12:20.581809 (+1245797us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:20.623759 (+ 41950us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:21.584989 (+961230us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b540020d850. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:21.585166 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2864243584}
I20260709 12:12:21.586611 19937 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:21.587301 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:21.578576 20065 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:12:21.588593 20126 consensus_meta.cc:287] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.501s	user 0.009s	sys 0.004s
I20260709 12:12:21.567931 13837 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 17.
I20260709 12:12:21.598946 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:21.599196 20078 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:21.599869 13837 raft_consensus.cc:2393] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 13: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:21.556348 20092 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:21.591241 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:21.601960 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:21.559449 20033 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:21.583964 20019 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:21.569413 20140 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:21.602856 13831 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 12.
I20260709 12:12:21.603647 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:21.601960 20092 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:21.611937 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:21.611630 13834 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:21.612957 13831 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 17.
I20260709 12:12:21.614522 13831 raft_consensus.cc:1240] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:21.591606 13833 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 15.
I20260709 12:12:21.618129 13831 raft_consensus.cc:1240] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:12:21.618819 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:12:21.613947 19894 consensus_meta.cc:287] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.512s	user 0.012s	sys 0.000s
I20260709 12:12:21.604485 20126 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:21.634156 13830 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 18.
W20260709 12:12:21.636363 20144 log.cc:927] Time spent T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:12:21.629334 19894 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:21.628284 20131 log.cc:927] Time spent T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.163s	user 0.000s	sys 0.002s
I20260709 12:12:21.643400 14407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41692 (request call id 974) took 1519 ms. Trace:
I20260709 12:12:21.643643 13834 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 19.
I20260709 12:12:21.643919 14407 rpcz_store.cc:276] 0709 12:12:20.123891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:20.124269 (+   378us) service_pool.cc:224] Handling call
0709 12:12:20.124663 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:20.290206 (+165543us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:20.290241 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:20.290289 (+    48us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:20.290319 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:21.643132 (+1352813us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b54003ebf54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:21.643186 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:21.643329 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":380152064}
I20260709 12:12:21.649058 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:21.649217 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:21.649914 14407 raft_consensus.cc:2393] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 19: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
W20260709 12:12:21.651418 19951 consensus_meta.cc:287] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.516s	user 0.009s	sys 0.003s
I20260709 12:12:21.654654 13687 raft_consensus.cc:1240] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:21.656119 13686 raft_consensus.cc:2410] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
W20260709 12:12:21.655423 20143 log.cc:927] Time spent T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 12:12:21.659828 20135 raft_consensus.cc:2749] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for earlier term 16. Current term is 17.
W20260709 12:12:21.658615 20139 log.cc:927] Time spent T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 12:12:21.661846 19947 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:21.663139 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:21.664387 13682 raft_consensus.cc:1275] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:12:21.664529 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:21.665611 13682 raft_consensus.cc:1240] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:21.676196 14380 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:21.677691 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:21.679071 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:21.682790 19421 raft_consensus.cc:2749] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:21.683724 19421 consensus_queue.cc:1059] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:21.685073 19923 raft_consensus.cc:3055] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:21.685567 19923 raft_consensus.cc:740] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:21.687889 14412 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 15.
I20260709 12:12:21.688222 14380 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:21.689697 14380 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:21.692878 20075 raft_consensus.cc:2749] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:12:21.694219 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:21.693032 19760 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:21.701423 13834 raft_consensus.cc:1240] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 14. Current term is 15. Ops: [14.12-14.12]
W20260709 12:12:21.702845 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:21.706073 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:21.710237 13833 raft_consensus.cc:1275] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 14. (term mismatch)
I20260709 12:12:21.710810 13833 pending_rounds.cc:85] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 13
I20260709 12:12:21.711091 13833 pending_rounds.cc:107] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260709 12:12:21.711349 13833 raft_consensus.cc:2889] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:21.711514 13831 raft_consensus.cc:2393] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 19: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:21.715399 13801 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:21.691444 19977 raft_consensus.cc:2749] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:12:21.718001 20107 log.cc:927] Time spent T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 1.018s	user 0.007s	sys 0.004s
I20260709 12:12:21.724768 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:12:21.826027 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:21.704752 20055 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:21.725955 19937 raft_consensus.cc:2749] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:21.724485 19894 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:21.720105 20044 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:21.719914 20065 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:21.859208 19870 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.686599 19923 consensus_queue.cc:260] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:21.896422 19913 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:21.814781 20042 consensus_queue.cc:1048] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.169s
I20260709 12:12:21.857708 20051 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.899003 20051 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:21.858192 20134 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.904219 20065 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:21.910576 20126 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:21.907193 20048 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:21.885279 20054 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.877337 20140 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:21.909670 20065 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:21.904193 19870 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:21.940258 20147 log.cc:927] Time spent T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.216s	user 0.001s	sys 0.000s
W20260709 12:12:21.945595 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:21.946156 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:21.952827 13586 catalog_manager.cc:5697] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 8 to 13, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 13 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:21.904057 20044 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:21.960282 20096 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:21.963202 14416 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 20.
I20260709 12:12:21.954875 13586 catalog_manager.cc:5697] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 3 to 5, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 5 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:12:21.913532 20134 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:21.976923 20134 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:21.933712 20054 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:21.974630 20084 consensus_meta.cc:287] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.725s	user 0.009s	sys 0.004s
I20260709 12:12:21.967293 19908 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.989914 14410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41700 (request call id 914) took 2428 ms. Trace:
I20260709 12:12:21.990526 14410 rpcz_store.cc:276] 0709 12:12:19.559000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:19.561929 (+  2929us) service_pool.cc:224] Handling call
0709 12:12:19.567954 (+  6025us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:20.078772 (+510818us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:20.078817 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:20.088343 (+  9526us) log.cc:844] Serialized 26 byte log entry
0709 12:12:20.317380 (+229037us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:20.317421 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:21.980732 (+1663311us) spinlock_profiling.cc:243] Waited 510 ms on lock 0x7b5400554954. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:21.980836 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:21.980900 (+    64us) raft_consensus.cc:1685] finished
0709 12:12:21.980918 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:21.987567 (+  6649us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":34195,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":85,"spinlock_wait_cycles":1173766528,"thread_start_us":150912,"threads_started":1,"wal-append.queue_time_us":268334,"wal-append.run_cpu_time_us":2619,"wal-append.run_wall_time_us":1120656}
I20260709 12:12:21.988741 20051 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:21.988463 20084 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:21.994275 19912 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:21.989531 19908 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:22.005232 19928 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.010852 19912 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:22.021488 19928 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:22.024541 19928 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:22.025274 13829 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 15.
I20260709 12:12:22.027644 20084 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:22.035723 19883 raft_consensus.cc:3055] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:22.036296 19883 raft_consensus.cc:740] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:22.037199 19883 consensus_queue.cc:260] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:22.042481 19883 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:22.043788 20054 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:12:22.052997 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 1.04759e+06us
I20260709 12:12:22.056439 20090 consensus_queue.cc:1048] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:12:22.057968 19993 consensus_queue.cc:1048] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:22.058977 20060 consensus_queue.cc:1059] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:22.059896 19993 raft_consensus.cc:3055] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:22.059854 20060 consensus_queue.cc:1059] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:22.060427 19993 raft_consensus.cc:740] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:22.058048 19718 consensus_queue.cc:1048] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 12:12:22.063593 19993 consensus_queue.cc:260] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:22.064604 20090 raft_consensus.cc:3055] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:12:22.066643 14416 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41700 (request call id 920) took 1537 ms (client timeout 1689 ms). Trace:
W20260709 12:12:22.067220 14416 rpcz_store.cc:269] 0709 12:12:20.528792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:20.528948 (+   156us) service_pool.cc:224] Handling call
0709 12:12:22.066411 (+1537463us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b54007c01d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:22.066565 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3207873792}
I20260709 12:12:22.072152 19916 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:22.065023 19993 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:22.077082 19908 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:22.072638 13727 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:22.065018 20090 raft_consensus.cc:740] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:22.082047 20044 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:22.082906 20090 consensus_queue.cc:260] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:22.084354 20090 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:12:22.093576 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:22.094241 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:22.096696 19718 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.097225 19718 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:22.099591 19718 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:22.100590 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:22.102051 20018 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:22.102218 13800 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:22.102690 20018 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:22.103484 20044 raft_consensus.cc:2804] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:22.104056 20044 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:22.104539 20044 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:22.105105 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:22.107969 19923 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:22.111593 13687 raft_consensus.cc:1275] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:12:22.112809 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:22.114110 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:22.114545 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:22.114645 20044 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:22.115573 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:22.115880 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:22.116168 13679 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 12.
I20260709 12:12:22.116762 13683 raft_consensus.cc:2393] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 13: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:22.111074 19912 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:22.117748 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:22.117293 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:22.119067 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:22.121206 13679 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 20.
I20260709 12:12:22.120050 19912 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:22.125123 13688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 1105) took 1079 ms. Trace:
I20260709 12:12:22.125396 20018 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:22.126415 13684 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:22.125605 13688 rpcz_store.cc:276] 0709 12:12:21.045529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:21.045711 (+   182us) service_pool.cc:224] Handling call
0709 12:12:21.046088 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:21.046475 (+   387us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:12:21.046780 (+   305us) log.cc:844] Serialized 14 byte log entry
0709 12:12:21.450085 (+403305us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:21.464929 (+ 14844us) log.cc:844] Serialized 26 byte log entry
0709 12:12:21.465144 (+   215us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:21.497642 (+ 32498us) log.cc:844] Serialized 14 byte log entry
0709 12:12:22.124793 (+627151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:22.124871 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:22.124911 (+    40us) raft_consensus.cc:1685] finished
0709 12:12:22.124925 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:22.125061 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":626844,"prepare.queue_time_us":20302,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":1192,"raft.queue_time_us":30763,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":9860,"thread_start_us":434677,"threads_started":3,"wal-append.queue_time_us":262493}
W20260709 12:12:22.127962 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 55383.1us
I20260709 12:12:22.128971 13727 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:22.129722 20049 raft_consensus.cc:2804] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:22.129935 19741 consensus_queue.cc:1048] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:22.130421 20049 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:22.130813 19893 consensus_queue.cc:1048] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:22.131861 19741 raft_consensus.cc:2804] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:22.132149 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:22.132436 19995 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.132936 19995 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:22.132251 20020 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.133893 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:22.134487 13682 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:22.135442 19995 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:22.132303 19741 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:22.138406 19741 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:22.138839 20060 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:22.139032 20090 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.139426 20060 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:22.139667 20090 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:22.133734 20020 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:22.141733 20060 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:22.155560 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:22.155926 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:22.142699 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:22.157619 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:22.142189 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:22.143028 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:22.160223 13837 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 14.
I20260709 12:12:22.160306 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:12:22.143522 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:22.161576 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:22.161929 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:22.142699 13830 raft_consensus.cc:1240] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:22.164202 13686 raft_consensus.cc:1240] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:22.164433 13830 raft_consensus.cc:1240] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:22.156669 13760 raft_consensus.cc:2410] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for term 25 because replica has last-logged OpId of term: 23 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 15.
I20260709 12:12:22.142189 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:22.167809 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:22.168418 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:22.169137 13833 raft_consensus.cc:2393] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 14: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:22.154143 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:22.143857 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:12:22.139518 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:22.170428 13688 raft_consensus.cc:2393] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 20: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:22.157692 13828 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 20.
I20260709 12:12:22.173983 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:22.175428 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:22.176167 13833 raft_consensus.cc:2393] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 20: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:22.156649 13763 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 15.
I20260709 12:12:22.178843 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:22.180428 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:22.183025 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:22.183668 14409 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 24.
I20260709 12:12:22.186964 13684 raft_consensus.cc:1275] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:12:22.194618 13828 raft_consensus.cc:2393] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 19: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:22.195447 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:22.176899 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:12:22.198279 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:22.199040 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:22.199416 13682 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 13.
I20260709 12:12:22.199860 14415 raft_consensus.cc:2368] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 12. Current term is 13.
I20260709 12:12:22.199111 13833 raft_consensus.cc:2393] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 17: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:22.201479 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:22.202699 13830 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:22.203274 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:22.207218 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:22.203919 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:22.208164 13834 raft_consensus.cc:3060] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:22.204372 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:22.209332 13836 raft_consensus.cc:2393] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 13: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:22.204932 14379 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:22.210214 13837 raft_consensus.cc:1275] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:12:22.210716 13726 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:22.217924 13726 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:22.130849 20049 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:22.143296 19992 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.233106 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:22.233808 13682 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 18.
I20260709 12:12:22.233891 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:22.235225 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:22.143919 20090 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:12:22.212800 20037 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260709 12:12:22.129897 20044 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:22.225526 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:22.143934 19912 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.151939 20082 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:22.271243 14409 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 17.
I20260709 12:12:22.231029 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:22.222612 13763 raft_consensus.cc:1275] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:12:22.146677 20020 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:22.236080 13682 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 14.
I20260709 12:12:22.237103 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:22.237440 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:22.237643 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:22.152567 19870 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:22.241070 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:22.244067 13831 raft_consensus.cc:1240] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 12:12:22.245021 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:22.293915 14407 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 17.
I20260709 12:12:22.291054 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:22.250916 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:22.295467 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:22.295821 13837 raft_consensus.cc:2410] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 12:12:22.132223 19893 consensus_queue.cc:1059] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.094s
I20260709 12:12:22.248983 13727 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:22.296283 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:22.297400 13680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 3110) took 1173 ms. Trace:
I20260709 12:12:22.256314 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:22.297921 13652 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:22.250173 13800 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:22.298432 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:22.153071 19741 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:22.314254 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 64169.1us
I20260709 12:12:22.315531 13800 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:22.255731 13726 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:22.300303 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:22.297912 13680 rpcz_store.cc:276] 0709 12:12:21.124038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:21.298400 (+174362us) service_pool.cc:224] Handling call
0709 12:12:21.352030 (+ 53630us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:21.352391 (+   361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:21.352419 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:21.363652 (+ 11233us) log.cc:844] Serialized 26 byte log entry
0709 12:12:21.446479 (+ 82827us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:21.456818 (+ 10339us) log.cc:844] Serialized 14 byte log entry
0709 12:12:21.598195 (+141377us) spinlock_profiling.cc:243] Waited 3.08 ms on lock 0x7b4800080358. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92ceb6aa1 00007fa92ceadb37 00007fa92cead9ca 00007fa92cfa526f 00007fa92cfa4f37 00007fa92cfb955c 00007fa92cfb9508 00007fa92cfb9488 00007fa92cfb9443 00007fa92cfb86ec 00007fa92bee2a96
0709 12:12:22.123898 (+525703us) spinlock_profiling.cc:243] Waited 1.35 ms on lock 0x7b1800358c00. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e1ac0a 00007fa92e55a219 00007fa924ea2a40 00007fa924e9d4e4 00007fa924e9d455 00007fa927f85060 00007fa927f97716 00007fa927fa8287 00007fa927fa8208
0709 12:12:22.297056 (+173158us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:22.297150 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:22.297200 (+    50us) raft_consensus.cc:1685] finished
0709 12:12:22.297215 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:22.297340 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":542661,"prepare.queue_time_us":14470,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":3136,"raft.queue_time_us":695975,"raft.run_cpu_time_us":2402,"raft.run_wall_time_us":217465,"spinlock_wait_cycles":10181376,"thread_start_us":212631,"threads_started":2,"wal-append.queue_time_us":139406}
I20260709 12:12:22.318327 14413 raft_consensus.cc:2393] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 18: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:22.296227 13682 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:22.319125 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:22.319979 13754 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:12:22.309438 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:12:22.323029 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 80106.9us
I20260709 12:12:22.323500 13688 raft_consensus.cc:2393] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 22: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:22.317381 13684 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 17.
I20260709 12:12:22.305425 13834 raft_consensus.cc:2468] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 13.
I20260709 12:12:22.225497 20157 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.229349 20060 raft_consensus.cc:2749] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:12:22.329030 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 73350.6us
I20260709 12:12:22.348495 13726 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:12:22.334033 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:22.249238 19981 raft_consensus.cc:2804] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:22.342821 13800 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:22.324733 13727 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:12:22.350371 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:22.254992 20061 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.361707 13727 leader_election.cc:400] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 12. Current term is 13.
I20260709 12:12:22.231549 19886 consensus_queue.cc:1048] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.082s
I20260709 12:12:22.255787 20018 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.352183 13726 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:22.370357 13800 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:22.362810 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:22.362936 13756 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:12:22.372578 13726 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:22.372860 13834 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 17.
I20260709 12:12:22.372991 13756 raft_consensus.cc:606] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:22.363768 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:22.364480 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:22.252266 20067 raft_consensus.cc:2749] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:22.365743 13727 leader_election.cc:403] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:22.367419 13682 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 21.
I20260709 12:12:22.270467 19858 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:22.362368 20132 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:22.291568 20140 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.243220 19992 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:22.335407 20082 raft_consensus.cc:2804] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:22.374922 13837 raft_consensus.cc:2393] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 19: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:22.375716 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:22.402462 14415 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 19.
I20260709 12:12:22.334275 19870 raft_consensus.cc:2804] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:22.355232 19918 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:22.354244 20048 raft_consensus.cc:2749] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:22.292742 20054 consensus_queue.cc:1048] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.098s
I20260709 12:12:22.354048 20042 raft_consensus.cc:2749] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:22.358062 20078 raft_consensus.cc:2749] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:22.380270 13756 raft_consensus.cc:1240] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:22.381676 13726 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:22.293725 19912 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:22.384584 13682 raft_consensus.cc:1275] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 12:12:22.368885 19999 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:12:22.386194 13680 raft_consensus.cc:1240] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:22.367764 13830 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 21.
I20260709 12:12:22.388222 13763 raft_consensus.cc:1240] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:22.387477 13800 leader_election.cc:304] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:22.373555 20134 raft_consensus.cc:2804] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:22.377409 20060 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:22.377142 20046 raft_consensus.cc:3055] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:22.394392 20132 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:22.395557 19741 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:22.396878 20151 log.cc:927] Time spent T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.316s	user 0.001s	sys 0.000s
I20260709 12:12:22.396982 13755 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "b98d2519bb504dc6905ed2ede4571835"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:12:22.586781 13755 raft_consensus.cc:606] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Received request to transfer leadership to TS b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:22.587154 13755 raft_consensus.cc:614] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:22.412648 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:12:22.414579 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:22.382753 19981 raft_consensus.cc:697] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 13 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
W20260709 12:12:22.577116 20156 log.cc:927] Time spent T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.197s	user 0.003s	sys 0.004s
I20260709 12:12:22.386197 20017 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:22.423874 13681 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 14.
I20260709 12:12:22.388619 20041 raft_consensus.cc:2749] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 12:12:22.427438 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 45902.8us
W20260709 12:12:22.565399 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:22.392943 19858 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:22.358448 20157 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:22.414996 19918 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:12:22.568096 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:22.639339 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:22.428638 19999 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:22.409987 19870 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:22.372452 20061 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:22.376209 20018 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:22.429796 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:22.401880 20140 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:22.638644 19741 consensus_queue.cc:1048] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 12:12:22.645324 19992 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:22.646776 20140 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:22.647437 19858 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:22.647555 13683 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 20.
I20260709 12:12:22.639292 20078 consensus_queue.cc:1048] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 12:12:22.642310 19999 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:22.651432 20061 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:22.641855 19918 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:22.653528 20157 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:22.639099 20060 consensus_queue.cc:1059] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:12:22.654949 20092 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:22.402333 20082 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:22.655421 20060 consensus_queue.cc:1243] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer b98d2519bb504dc6905ed2ede4571835 log is divergent from this leader: its last log entry 16.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:12:22.655766 20082 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:22.655966 20060 raft_consensus.cc:3055] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:22.656378 20060 raft_consensus.cc:740] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:22.629935 20044 raft_consensus.cc:2749] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:22.657209 20060 consensus_queue.cc:260] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:22.659196 20060 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:22.660034 20159 log.cc:927] Time spent T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.587s	user 0.003s	sys 0.000s
I20260709 12:12:22.662191 19981 consensus_queue.cc:237] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:22.663365 20018 leader_election.cc:290] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:22.663702 13761 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:22.667798 19842 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:22.661439 20132 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:22.574275 13756 raft_consensus.cc:1240] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:22.579181 13763 raft_consensus.cc:1275] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:12:22.580451 13836 raft_consensus.cc:1275] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 12:12:22.583767 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 201000us
I20260709 12:12:22.676383 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:22.676559 13727 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:22.418516 13754 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 13.
I20260709 12:12:22.593565 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:12:22.594241 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 206810us
I20260709 12:12:22.577888 20048 raft_consensus.cc:2749] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:22.577867 20134 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:22.599417 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:22.680657 13759 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:22.580272 20046 raft_consensus.cc:740] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:22.642227 19870 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:22.683503 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:22.668434 19842 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:22.678632 19447 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 12. Current term is 13.
W20260709 12:12:22.573377 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:22.678009 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:22.678292 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:12:22.678560 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:22.681478 13835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 2960) took 1858 ms. Trace:
I20260709 12:12:22.659114 19912 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:22.689651 13835 rpcz_store.cc:276] 0709 12:12:20.822815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:20.823003 (+   188us) service_pool.cc:224] Handling call
0709 12:12:20.854420 (+ 31417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:20.854835 (+   415us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:12:20.885056 (+ 30221us) log.cc:844] Serialized 14 byte log entry
0709 12:12:22.063602 (+1178546us) spinlock_profiling.cc:243] Waited 4.46 ms on lock 0x7b1800059bc0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e82e07 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9fc02 00007fa927b2720b 00007fa927b2cd23 00007fa927b2d23a 00007fa927f97a2a
0709 12:12:22.078786 (+ 15184us) log.cc:844] Serialized 14 byte log entry
0709 12:12:22.078909 (+   123us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:22.079223 (+   314us) log.cc:844] Serialized 26 byte log entry
0709 12:12:22.079302 (+    79us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:22.079320 (+    18us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:22.079365 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:22.154017 (+ 74652us) spinlock_profiling.cc:243] Waited 6.73 ms on lock 0x7b1800059bc0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924ea03f3 00007fa924ea27c1 00007fa924ea2779 00007fa924ea2709 00007fa924ea26d1 00007fa924ea19cd 0000000000388634 0000000000388479 00007fa924e8383a
0709 12:12:22.659409 (+505392us) spinlock_profiling.cc:243] Waited 8.35 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:12:22.681176 (+ 21767us) raft_consensus.cc:1685] finished
0709 12:12:22.681203 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:22.681397 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12298,"prepare.queue_time_us":105648,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":57,"raft.queue_time_us":3191,"raft.run_cpu_time_us":354,"raft.run_wall_time_us":16270,"spinlock_wait_cycles":44941184,"thread_start_us":14733,"threads_started":1,"wal-append.queue_time_us":1187146}
W20260709 12:12:22.682081 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:22.692072 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:22.643525 13726 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
W20260709 12:12:22.693221 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 50003.4us
I20260709 12:12:22.694655 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:22.695118 19842 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:22.695351 13834 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 20.
I20260709 12:12:22.696311 20061 raft_consensus.cc:2804] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:22.696902 20061 raft_consensus.cc:697] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:22.697897 20061 consensus_queue.cc:237] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.6, Last appended by leader: 6, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:22.701407 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:22.697906 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:22.702119 20082 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:22.702917 13834 raft_consensus.cc:2468] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 13.
I20260709 12:12:22.704605 20157 consensus_queue.cc:1059] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:22.706288 20018 raft_consensus.cc:3055] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:22.706761 20018 raft_consensus.cc:740] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:22.707973 19270 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:22.707731 20018 consensus_queue.cc:260] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:22.709944 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:22.711490 13727 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:22.715365 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:22.727103 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:22.733568 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:22.720743 13726 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:22.734754 13754 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 15.
I20260709 12:12:22.682965 20134 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:22.737452 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:22.738418 13758 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 17.
I20260709 12:12:22.741485 13726 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:22.743703 14379 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:22.749382 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:22.751390 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:22.752575 13754 raft_consensus.cc:2393] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 18: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:22.753057 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:22.753971 13755 raft_consensus.cc:2410] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:12:22.754127 20172 raft_consensus.cc:2804] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:22.754750 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:22.756743 13685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 1110) took 1302 ms. Trace:
I20260709 12:12:22.686143 20090 raft_consensus.cc:2804] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:22.753682 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:22.768543 13727 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:22.771027 13754 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 17.
I20260709 12:12:22.719936 13761 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 17.
I20260709 12:12:22.757347 13685 rpcz_store.cc:276] 0709 12:12:21.454368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:22.755557 (+1301189us) service_pool.cc:224] Handling call
0709 12:12:22.756006 (+   449us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:22.756262 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:22.756305 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:22.756374 (+    69us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:22.756427 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:22.756519 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:22.756663 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:22.779909 13726 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:22.782738 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:22.783459 13758 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 17.
W20260709 12:12:22.786954 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:22.764652 20049 consensus_meta.cc:287] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.522s	user 0.009s	sys 0.001s
W20260709 12:12:22.762161 20168 log.cc:927] Time spent T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:12:22.786386 13652 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:12:22.763140 19993 consensus_meta.cc:287] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.690s	user 0.013s	sys 0.002s
I20260709 12:12:22.792658 13652 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:22.764726 19893 raft_consensus.cc:2804] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:22.795225 13763 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "956300599d004370953188dd3ae3a256"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:12:22.795171 13652 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:22.766571 20082 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:22.754788 20172 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:22.785146 20093 raft_consensus.cc:2804] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:12:22.803254 13801 leader_election.cc:336] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Timed out: RequestConsensusVote RPC to 127.12.56.196:46341 timed out after 1.793s (SENT)
I20260709 12:12:22.803941 13801 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:22.797727 13763 raft_consensus.cc:606] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 LEADER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:22.799801 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:22.805691 14416 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:22.732452 19741 consensus_queue.cc:1048] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 12:12:22.799412 13652 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:22.801115 19993 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:22.809104 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:22.810395 13758 raft_consensus.cc:1240] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:22.812098 13652 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:22.761461 19918 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:22.798405 19894 raft_consensus.cc:2749] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:22.797529 19842 raft_consensus.cc:2804] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:22.808363 19912 raft_consensus.cc:2749] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:22.803336 20172 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:22.833596 20161 consensus_queue.cc:1059] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:22.834535 20161 raft_consensus.cc:3055] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:22.834875 20161 raft_consensus.cc:740] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:22.835737 20161 consensus_queue.cc:260] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:22.819551 20078 raft_consensus.cc:2749] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:22.820427 19870 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:22.846807 20051 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.847079 19999 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:22.847412 20051 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:22.821110 19918 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:22.848338 19870 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:22.809885 20017 consensus_queue.cc:1048] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 12:12:22.822737 13763 raft_consensus.cc:1275] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 12:12:22.797730 19893 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:22.849260 19999 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:22.801342 20140 raft_consensus.cc:2804] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:12:22.831452 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:22.761996 20046 consensus_queue.cc:260] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:22.830029 19842 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:22.866614 20046 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:22.796944 19971 consensus_queue.cc:1048] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 12:12:22.866698 19842 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:22.869202 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:22.790889 20049 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:22.849272 13763 pending_rounds.cc:85] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting all ops after (but not including) 10
I20260709 12:12:22.870260 13763 pending_rounds.cc:107] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 12:12:22.870648 13763 raft_consensus.cc:2889] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:22.849519 19893 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:22.851071 20109 raft_consensus.cc:2804] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:22.851490 20082 raft_consensus.cc:2804] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:22.853101 19993 raft_consensus.cc:2749] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:22.804723 20093 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:22.862946 13652 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:22.861547 14412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 1128) took 1316 ms. Trace:
I20260709 12:12:22.860558 13759 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 22.
I20260709 12:12:22.877331 14412 rpcz_store.cc:276] 0709 12:12:21.544878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:21.545087 (+   209us) service_pool.cc:224] Handling call
0709 12:12:22.861300 (+1316213us) spinlock_profiling.cc:243] Waited 96.2 ms on lock 0x7b54005e01d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:22.861464 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":221157120}
I20260709 12:12:22.864233 20140 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:22.887905 13754 raft_consensus.cc:1240] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:22.888747 13755 raft_consensus.cc:2410] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 12:12:22.887838 14416 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 18.
I20260709 12:12:22.894896 13756 raft_consensus.cc:2410] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 12:12:22.874027 20109 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:22.879731 20093 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:22.877879 20082 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:22.876546 20161 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:22.886232 19894 raft_consensus.cc:2804] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:22.894691 20140 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:22.918562 13652 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:22.901153 20109 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:22.904677 20082 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:22.948647 13832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 2947) took 3610 ms. Trace:
W20260709 12:12:22.949219 20160 log.cc:927] Time spent T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.367s	user 0.001s	sys 0.001s
I20260709 12:12:22.949178 13832 rpcz_store.cc:276] 0709 12:12:19.338660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:19.584573 (+245913us) service_pool.cc:224] Handling call
0709 12:12:20.043099 (+458526us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:20.043395 (+   296us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:12:20.068217 (+ 24822us) log.cc:844] Serialized 14 byte log entry
0709 12:12:21.414341 (+1346124us) spinlock_profiling.cc:243] Waited 3.71 ms on lock 0x7b18004a34a0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa927b354bc 00007fa924e8348b 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9d455 00007fa927f85060 00007fa927f97716 00007fa927fa8287
0709 12:12:21.414479 (+   138us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:21.414553 (+    74us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:21.414617 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:21.414725 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:22.948319 (+1533594us) spinlock_profiling.cc:243] Waited 458 ms on lock 0x7b54000d9150. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:22.948577 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":31113,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":24668,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":8379,"spinlock_wait_cycles":1062085760,"thread_start_us":324086,"threads_started":2,"wal-append.queue_time_us":323624,"wal-append.run_cpu_time_us":2083,"wal-append.run_wall_time_us":1155638}
I20260709 12:12:22.958444 20082 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:22.971913 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:22.972144 13829 raft_consensus.cc:1240] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:22.972961 13830 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 20.
I20260709 12:12:22.966073 20082 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:12:22.933662 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 303031us
W20260709 12:12:22.978466 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 60000us
I20260709 12:12:22.988665 13652 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:22.974642 13832 raft_consensus.cc:1240] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:22.916416 19894 raft_consensus.cc:697] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 15 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:22.990664 14415 raft_consensus.cc:1240] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:22.991855 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:22.996040 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:22.992906 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:22.980295 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:22.997745 13830 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 13.
I20260709 12:12:23.011597 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:23.003705 13652 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:12:23.015533 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 239161us
I20260709 12:12:23.017308 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:23.018498 14412 raft_consensus.cc:2393] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 19: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
W20260709 12:12:23.020063 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 240292us
I20260709 12:12:22.981925 20020 raft_consensus.cc:2804] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:22.975428 20097 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:23.021394 13726 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:22.983767 20108 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:23.031668 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:23.024585 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:23.033556 14412 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 17.
I20260709 12:12:23.028057 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:23.029517 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:23.019659 19883 consensus_queue.cc:1059] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 12:12:22.976255 20134 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:23.015765 20082 raft_consensus.cc:2804] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:23.042049 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:23.045257 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:23.046203 14413 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 20.
I20260709 12:12:23.051082 13726 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:23.032024 20061 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:23.061363 13726 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:23.069057 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:23.065136 13726 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:23.043855 20060 raft_consensus.cc:2749] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:12:23.082051 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:23.083436 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:23.086279 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:23.036434 20097 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:23.095009 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:23.096079 13758 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 17.
I20260709 12:12:23.097431 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:23.098767 13758 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:23.058852 19992 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.062991 19993 raft_consensus.cc:2749] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:23.071947 19918 raft_consensus.cc:2804] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:23.085052 19878 raft_consensus.cc:2804] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:23.117605 14413 raft_consensus.cc:1240] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:23.039806 20108 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:23.083645 20078 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:23.082674 20049 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:23.129838 20097 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:23.131489 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:23.131834 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:23.132812 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:23.132900 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:23.134517 14407 raft_consensus.cc:2393] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 19: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
W20260709 12:12:23.134678 20178 log.cc:927] Time spent T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:12:23.140129 20134 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:23.121932 20060 consensus_queue.cc:1059] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 12:12:23.120837 19992 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:23.148006 20108 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:23.148922 20108 consensus_queue.cc:1048] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:23.121948 19918 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:23.150431 19918 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:23.072189 19894 consensus_queue.cc:237] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:23.155158 14415 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:23.157955 20078 raft_consensus.cc:697] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:23.159394 20078 consensus_queue.cc:237] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:23.072955 20061 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:23.134290 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:23.179371 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:12:23.181416 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:23.124198 19893 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:23.183879 19893 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:23.122869 19878 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:23.184666 19878 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:23.191957 13679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 2143) took 1040 ms. Trace:
I20260709 12:12:23.192456 13679 rpcz_store.cc:276] 0709 12:12:22.151686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:22.157569 (+  5883us) service_pool.cc:224] Handling call
0709 12:12:22.158081 (+   512us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:22.158300 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:12:22.190089 (+ 31789us) log.cc:844] Serialized 14 byte log entry
0709 12:12:23.191403 (+1001314us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b180046ee80. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa927b354bc 00007fa924e8348b 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9fc02 00007fa927b2720b 00007fa927b2cd23 00007fa927b2d23a
0709 12:12:23.191580 (+   177us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:23.191628 (+    48us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:23.191696 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:23.191761 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:23.191898 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":77057,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":67,"spinlock_wait_cycles":203796992,"thread_start_us":102770,"threads_started":1,"wal-append.queue_time_us":197026}
I20260709 12:12:23.133646 14380 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:23.178614 20090 raft_consensus.cc:697] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:23.124060 19999 consensus_queue.cc:1048] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.071s
W20260709 12:12:23.199316 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 65776.3us
W20260709 12:12:23.207878 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 202723us
I20260709 12:12:23.193122 19992 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:23.208014 14380 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:23.216722 14415 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 17.
W20260709 12:12:23.220255 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 216659us
I20260709 12:12:23.222128 13652 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:23.197582 20046 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.228761 14380 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:23.207337 19893 raft_consensus.cc:2749] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:23.209002 20018 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:23.242395 19883 raft_consensus.cc:3055] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:23.243110 19883 raft_consensus.cc:740] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:23.244261 19883 consensus_queue.cc:260] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:23.237895 19971 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:23.233055 20046 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:23.256880 20046 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:23.230933 20093 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:23.260807 19878 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:23.224663 20172 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:23.265609 13727 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:23.234308 19421 consensus_queue.cc:1059] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 12:12:23.268182 20093 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:23.268774 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:23.275933 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:23.277560 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:23.253607 19971 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:23.281705 13761 raft_consensus.cc:2393] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 18: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:23.283090 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:23.285413 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:23.286391 14413 raft_consensus.cc:2410] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 22 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 12:12:23.287384 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:23.300174 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:23.250420 19842 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:23.301121 14407 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 17.
I20260709 12:12:23.279958 19971 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:23.272904 20020 raft_consensus.cc:697] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 18 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:23.305505 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:23.312767 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:23.317291 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:23.286690 20186 raft_consensus.cc:2804] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:23.280108 20037 consensus_queue.cc:1059] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.033s
I20260709 12:12:23.303295 20097 raft_consensus.cc:2749] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:12:23.322222 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:12:23.314507 20180 log.cc:927] Time spent T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.067s	user 0.001s	sys 0.001s
I20260709 12:12:23.269940 20090 consensus_queue.cc:237] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:23.306730 20082 raft_consensus.cc:697] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 19 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:23.326972 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:23.307843 19883 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:23.322656 20186 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:12:23.361980 20158 log.cc:927] Time spent T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 1.290s	user 0.005s	sys 0.002s
I20260709 12:12:23.366060 20082 consensus_queue.cc:237] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:23.367406 20061 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:23.369320 19878 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:23.379781 20051 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:23.346606 20186 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:23.394173 20172 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:23.351482 20020 consensus_queue.cc:237] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:23.403332 20140 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:23.408020 20163 log.cc:927] Time spent T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.734s	user 0.003s	sys 0.000s
I20260709 12:12:23.388978 20109 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:23.410724 20189 raft_consensus.cc:3055] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:23.411203 20189 raft_consensus.cc:740] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:23.412057 20189 consensus_queue.cc:260] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:23.412835 20109 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:23.414573 20140 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:23.414988 20092 raft_consensus.cc:3055] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:23.413264 20186 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:23.415387 20092 raft_consensus.cc:740] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:23.416222 20092 consensus_queue.cc:260] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:23.416922 20186 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:12:23.418918 20164 log.cc:927] Time spent T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.959s	user 0.000s	sys 0.002s
I20260709 12:12:23.421237 19971 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:23.423866 19971 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 21 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:23.430507 20092 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:12:23.470077 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 247814us
I20260709 12:12:23.473186 13652 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:12:23.475317 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:23.475587 13652 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:23.477829 13652 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:23.481045 13652 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:23.483165 13652 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:23.485164 13683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 3131) took 1247 ms. Trace:
I20260709 12:12:23.327925 13727 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:12:23.490725 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 161860us
I20260709 12:12:23.491101 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:23.492624 13727 leader_election.cc:304] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:12:23.493180 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:23.494179 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:23.495267 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:23.496639 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:23.497130 13652 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:23.497933 13683 rpcz_store.cc:276] 0709 12:12:22.237294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:22.237420 (+   126us) service_pool.cc:224] Handling call
0709 12:12:23.484544 (+1247124us) spinlock_profiling.cc:243] Waited 351 ms on lock 0x7b54002c2c54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:23.484840 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":807216000}
I20260709 12:12:23.504189 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:23.505662 13832 raft_consensus.cc:2393] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 13: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:23.507711 14407 raft_consensus.cc:2368] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 20. Current term is 21.
I20260709 12:12:23.509600 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:23.511045 19976 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.512460 19976 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:23.514364 19878 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.515360 19878 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:23.516811 19976 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:23.497195 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:23.518427 13761 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 15.
I20260709 12:12:23.520011 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:23.520958 19999 raft_consensus.cc:2749] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:23.511161 19842 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:23.522574 19842 consensus_queue.cc:1059] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:12:23.524078 19992 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:23.527025 19878 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:23.527853 19878 raft_consensus.cc:2804] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:23.528208 19878 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:23.528628 19878 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:23.518453 19894 raft_consensus.cc:2804] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:23.530377 19894 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:23.530791 19894 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:23.532426 19999 raft_consensus.cc:2764] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 12:12:23.527243 13586 catalog_manager.cc:5697] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 3 to 9, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 9 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:12:23.535264 19842 raft_consensus.cc:2804] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:23.536077 19842 raft_consensus.cc:697] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 13 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:23.538499 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:23.540630 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:23.541115 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:23.541693 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:23.543289 13829 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:23.543874 13581 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53318 (request call id 146) took 24764 ms (client timeout 15000 ms). Trace:
I20260709 12:12:23.544700 19992 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:23.546590 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:23.547484 13834 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:23.497969 13762 raft_consensus.cc:2393] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 19: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:23.551352 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:23.552424 13837 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:23.553115 13762 raft_consensus.cc:1240] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:23.554335 20191 raft_consensus.cc:2804] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:23.556694 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:23.557246 20191 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:23.557879 20191 raft_consensus.cc:3060] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:23.554731 20192 raft_consensus.cc:2804] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:23.562546 20192 raft_consensus.cc:697] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 18 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:23.564495 20192 consensus_queue.cc:237] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:23.565907 20020 raft_consensus.cc:3055] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:23.566347 20020 raft_consensus.cc:740] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:23.567821 20020 consensus_queue.cc:260] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:23.553726 20190 raft_consensus.cc:2804] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:23.569651 20190 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:23.569444 20112 consensus_queue.cc:1059] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:23.570127 20190 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:23.572156 20020 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:23.573419 13836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 2992) took 1350 ms. Trace:
I20260709 12:12:23.577996 13586 catalog_manager.cc:5697] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: config changed from index 8 to -1, term changed from 14 to 11, leader changed from <none> to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194), NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) evicted, no longer has a pending config: VOTER b98d2519bb504dc6905ed2ede4571835 (127.12.56.193), VOTER 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194), VOTER 96701a74fdee481fb5f54aac841e17dd (127.12.56.195), VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 11 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:23.580130 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:23.583029 13800 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:23.586777 14380 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
W20260709 12:12:23.601038 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 392221us
I20260709 12:12:23.601056 13686 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 12.
W20260709 12:12:23.603646 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:23.604758 19992 consensus_queue.cc:1059] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:23.606137 19928 raft_consensus.cc:2804] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:23.606626 13651 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:23.607519 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:23.607872 20193 raft_consensus.cc:3055] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:23.608461 20193 raft_consensus.cc:740] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:23.608737 13651 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:23.609057 19883 raft_consensus.cc:2749] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:23.610181 20197 raft_consensus.cc:2749] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:23.606731 19928 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:23.608655 13832 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 14.
I20260709 12:12:23.614058 13834 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 18.
I20260709 12:12:23.615248 13837 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 18.
I20260709 12:12:23.589967 13836 rpcz_store.cc:276] 0709 12:12:22.223070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:22.238067 (+ 14997us) service_pool.cc:224] Handling call
0709 12:12:22.238498 (+   431us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:22.675811 (+437313us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:23.572794 (+896983us) spinlock_profiling.cc:243] Waited 342 ms on lock 0x7b5400363654. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:23.573169 (+   375us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":785620224}
I20260709 12:12:23.611853 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:23.617622 13835 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 16.
I20260709 12:12:23.617233 19842 consensus_queue.cc:237] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:23.620263 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:23.623549 13829 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 16.
I20260709 12:12:23.621500 20112 raft_consensus.cc:2804] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:23.625519 20112 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:23.626109 20112 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:23.614038 19928 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:23.630959 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:23.614571 20193 consensus_queue.cc:260] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:23.632221 14413 raft_consensus.cc:1240] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 16. Current term is 17. Ops: []
W20260709 12:12:23.544348 13581 rpcz_store.cc:269] 0709 12:11:58.779292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:58.779633 (+   341us) service_pool.cc:224] Handling call
0709 12:12:23.543550 (+24763917us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:13.277276 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:13.282432 (+  5156us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:13.282491 (+    59us) write_op.cc:435] Acquired schema lock
0709 12:12:13.282525 (+    34us) tablet.cc:662] Decoding operations
0709 12:12:13.284412 (+  1887us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:13.284514 (+   102us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:13.284546 (+    32us) tablet.cc:685] Acquiring locks for 19 operations
0709 12:12:13.393076 (+108530us) tablet.cc:701] Row locks acquired
0709 12:12:13.409292 (+ 16216us) write_op.cc:260] PREPARE: finished
0709 12:12:13.429195 (+ 19903us) write_op.cc:270] Start()
0709 12:12:13.457113 (+ 27918us) write_op.cc:276] Timestamp: P: 1783599133422119 usec, L: 0
0709 12:12:13.466688 (+  9575us) op_driver.cc:348] REPLICATION: starting
0709 12:12:13.489863 (+ 23175us) log.cc:844] Serialized 7707 byte log entry
0709 12:12:14.162306 (+672443us) op_driver.cc:464] REPLICATION: finished
0709 12:12:14.662442 (+500136us) write_op.cc:301] APPLY: starting
0709 12:12:14.678260 (+ 15818us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:15.540120 (+861860us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:15.540269 (+   149us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:16.065882 (+525613us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:16.201116 (+135234us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=38,key_file_lookups=38,delta_file_lookups=38,mrs_lookups=0
0709 12:12:16.239757 (+ 38641us) write_op.cc:312] APPLY: finished
0709 12:12:16.240290 (+   533us) log.cc:844] Serialized 172 byte log entry
0709 12:12:16.612529 (+372239us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:16.625122 (+ 12593us) write_op.cc:454] Released schema lock
0709 12:12:16.674658 (+ 49536us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:16.762266 (+ 87608us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:16.769515 (+  7249us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2883507,"reported_tablets":26,"child_traces":[["op",{"apply.queue_time_us":434052,"apply.run_cpu_time_us":59067,"apply.run_wall_time_us":2084678,"cfile_cache_hit":78,"cfile_cache_hit_bytes":83547,"num_ops":19,"prepare.queue_time_us":294516,"prepare.run_cpu_time_us":41645,"prepare.run_wall_time_us":328311,"raft.queue_time_us":498617,"raft.run_cpu_time_us":25418,"raft.run_wall_time_us":284063,"replication_time_us":693552,"thread_start_us":1153627,"threads_started":5,"wal-append.queue_time_us":595191,"wal-append.run_cpu_time_us":33163,"wal-append.run_wall_time_us":2499814}]]}
I20260709 12:12:23.603659 13586 catalog_manager.cc:5697] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 3 to 10. New cstate: current_term: 10 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:23.646287 19854 raft_consensus.cc:3055] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:23.648263 19854 raft_consensus.cc:740] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:23.649032 13686 raft_consensus.cc:1275] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:12:23.649544 19854 consensus_queue.cc:260] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:23.654086 20193 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:23.658025 13586 catalog_manager.cc:5697] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 3 to 8, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 8 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:12:23.669764 19854 raft_consensus.cc:3060] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:23.675186 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:23.676688 13754 raft_consensus.cc:1240] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 24. Current term is 25. Ops: []
I20260709 12:12:23.681209 13756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48114 (request call id 3110) took 1006 ms. Trace:
I20260709 12:12:23.674185 13652 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:23.691431 20189 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:23.692989 13728 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.877s	user 0.033s	sys 0.037s
W20260709 12:12:23.693455 13728 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.877s	user 0.033s	sys 0.037s
I20260709 12:12:23.699221 20182 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.704073 13760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 972) took 1430 ms. Trace:
I20260709 12:12:23.704543 13760 rpcz_store.cc:276] 0709 12:12:22.273249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:22.275572 (+  2323us) service_pool.cc:224] Handling call
0709 12:12:22.276042 (+   470us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:22.669618 (+393576us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:12:22.681482 (+ 11864us) log.cc:844] Serialized 14 byte log entry
0709 12:12:22.897535 (+216053us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:22.897596 (+    61us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:22.897646 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:23.703607 (+805961us) spinlock_profiling.cc:243] Waited 393 ms on lock 0x7b540032e954. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:23.703673 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:23.703891 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7980,"prepare.queue_time_us":11706,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":9674,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":2012,"spinlock_wait_cycles":904548224,"thread_start_us":207529,"threads_started":1,"wal-append.queue_time_us":359720}
I20260709 12:12:23.708618 14413 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602"
dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
mode: GRACEFUL
new_leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
 from {username='slave'} at 127.0.0.1:46814
I20260709 12:12:23.709591 14413 raft_consensus.cc:606] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 13 LEADER]: Received request to transfer leadership to TS 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:23.681717 13756 rpcz_store.cc:276] 0709 12:12:22.674987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:22.676104 (+  1117us) service_pool.cc:224] Handling call
0709 12:12:23.680817 (+1004713us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x7b540035edd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:23.681040 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":500190592}
I20260709 12:12:23.722714 20092 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.723465 20092 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:23.724264 19886 raft_consensus.cc:2749] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:23.686048 19992 raft_consensus.cc:2804] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:23.733273 19992 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:23.733764 19992 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:23.734824 20185 raft_consensus.cc:993] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7: : Instructing follower 96701a74fdee481fb5f54aac841e17dd to start an election
I20260709 12:12:23.735234 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:23.735684 20185 raft_consensus.cc:1081] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 LEADER]: Signalling peer 96701a74fdee481fb5f54aac841e17dd to start an election
I20260709 12:12:23.724311 13760 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "b98d2519bb504dc6905ed2ede4571835"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:12:23.738873 13760 raft_consensus.cc:606] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Received request to transfer leadership to TS b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:23.739301 13760 raft_consensus.cc:614] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:23.732482 19741 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:12:23.743424 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 56658.6us
I20260709 12:12:23.700251 20182 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:23.762990 13652 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:23.759948 13586 catalog_manager.cc:5697] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 4 to 10. New cstate: current_term: 10 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:12:23.744345 19741 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:23.776836 13758 consensus_meta.cc:287] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.677s	user 0.013s	sys 0.011s
I20260709 12:12:23.777550 13758 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 21.
I20260709 12:12:23.779278 13756 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dabf40829555486da9d6b588472147ec"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:12:23.780009 13756 raft_consensus.cc:606] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:23.780387 13756 raft_consensus.cc:614] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:12:23.780467 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 132657us
I20260709 12:12:23.804742 20182 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:23.809888 20189 raft_consensus.cc:2804] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:23.810564 20189 raft_consensus.cc:697] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 18 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:23.811760 20189 consensus_queue.cc:237] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:23.815809 19741 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:12:23.817374 19918 consensus_meta.cc:287] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.666s	user 0.005s	sys 0.018s
I20260709 12:12:23.817963 19918 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:23.820259 19918 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:23.821101 13757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 2295) took 1417 ms. Trace:
I20260709 12:12:23.821520 13757 rpcz_store.cc:276] 0709 12:12:22.334825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:22.336026 (+  1201us) service_pool.cc:224] Handling call
0709 12:12:22.336353 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:22.336618 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:12:22.336934 (+   316us) log.cc:844] Serialized 14 byte log entry
0709 12:12:23.537249 (+1200315us) spinlock_profiling.cc:243] Waited 2.69 ms on lock 0x7b1800480460. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e82e07 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9fc02 00007fa927b2720b 00007fa927b2cd23 00007fa927b2d23a 00007fa927f97a2a
0709 12:12:23.687233 (+149984us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:23.719908 (+ 32675us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:23.723922 (+  4014us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:23.726379 (+  2457us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:23.752313 (+ 25934us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7036,"prepare.queue_time_us":20551,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":70,"raft.queue_time_us":27455,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":154,"spinlock_wait_cycles":6192896,"thread_start_us":98510,"threads_started":1,"wal-append.queue_time_us":1351382}
I20260709 12:12:23.827265 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:12:23.831578 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:12:23.833838 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:23.833956 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:23.837229 13727 leader_election.cc:400] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 election: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 20. Current term is 21.
I20260709 12:12:23.837649 13727 leader_election.cc:403] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 12:12:23.849754 20182 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:12:23.844524 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:23.858069 13832 raft_consensus.cc:1240] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 12:12:23.860453 13832 raft_consensus.cc:1240] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:23.807022 20092 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:23.850436 19886 consensus_queue.cc:1059] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:23.865168 19916 raft_consensus.cc:3055] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:23.865653 19916 raft_consensus.cc:740] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:23.865864 20020 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.866638 20020 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:23.867036 19916 consensus_queue.cc:260] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:23.871598 20020 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:23.875355 19916 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:23.892549 13832 raft_consensus.cc:1275] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 9. (term mismatch)
I20260709 12:12:23.893821 20092 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.894212 13832 pending_rounds.cc:85] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 8
I20260709 12:12:23.895481 20092 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:23.897138 13832 pending_rounds.cc:107] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 17.9
I20260709 12:12:23.931744 20054 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.932775 20054 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:23.840873 14413 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 19.
I20260709 12:12:23.937986 13651 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:12:23.942179 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:23.802608 13652 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:23.955900 20020 raft_consensus.cc:2804] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:23.956712 20020 raft_consensus.cc:697] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 18 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:23.958437 20020 consensus_queue.cc:237] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:23.964290 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:23.899005 13832 raft_consensus.cc:2889] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:23.787305 20190 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:23.985174 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 195482us
I20260709 12:12:23.977836 13727 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:23.990490 13829 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 21.
I20260709 12:12:24.008136 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:12:24.009020 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 47014.2us
I20260709 12:12:24.013293 19918 raft_consensus.cc:2804] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:24.013957 20082 raft_consensus.cc:2749] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:24.014237 19918 raft_consensus.cc:697] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:24.014448 14412 raft_consensus.cc:1275] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:12:24.016148 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:12:24.016764 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 109258us
I20260709 12:12:23.972076 20191 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:24.048468 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 404605us
I20260709 12:12:24.061453 13652 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:24.064143 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:12:24.080446 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 46846.7us
I20260709 12:12:24.081272 13652 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:12:24.091952 14380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:24.097393 13679 raft_consensus.cc:1240] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 13 LEADER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:24.099738 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:24.102408 13837 raft_consensus.cc:2393] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 18: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:24.097581 13686 raft_consensus.cc:1240] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:24.046710 19886 consensus_queue.cc:1048] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 12:12:24.070863 20092 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:24.114204 13832 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 19.
W20260709 12:12:24.119292 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 54319us
I20260709 12:12:24.093140 19918 consensus_queue.cc:237] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:24.126248 19928 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:24.129056 19928 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:12:24.131129 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 338906us
I20260709 12:12:24.099402 19883 raft_consensus.cc:2804] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:24.065100 20082 consensus_queue.cc:1048] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 12:12:24.145278 20020 raft_consensus.cc:2804] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:24.146056 20020 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:24.146584 20020 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:24.148667 19992 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:24.159438 19992 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:24.160422 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:24.153875 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:12:24.160670 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:24.164532 13651 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:24.165577 14412 raft_consensus.cc:1240] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:24.167423 14408 raft_consensus.cc:1275] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:12:24.168815 20054 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:24.172439 13758 raft_consensus.cc:1240] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:24.174285 19883 raft_consensus.cc:697] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 16 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:24.175472 19883 consensus_queue.cc:237] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:24.154620 20190 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:24.162689 13683 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 22.
I20260709 12:12:24.177414 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:24.181131 13837 raft_consensus.cc:2393] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 16: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:24.186604 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:12:24.187233 20216 log.cc:927] Time spent T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 12:12:24.187564 20037 raft_consensus.cc:2804] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:24.178200 19928 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:24.188061 20037 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:24.188660 20037 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:24.188588 19928 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:24.190661 20185 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:24.181878 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:24.191243 19928 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:24.191459 20185 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:24.192243 13756 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:24.180198 20054 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:24.200201 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:24.200408 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:24.201218 13836 raft_consensus.cc:2393] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 20: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:24.201357 13754 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 22.
I20260709 12:12:24.202992 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:24.207484 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:12:24.207950 14380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:24.204062 19878 consensus_meta.cc:287] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.669s	user 0.015s	sys 0.001s
I20260709 12:12:24.223928 19918 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:24.224459 14416 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 13.
I20260709 12:12:24.224939 19918 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:24.216847 20112 consensus_meta.cc:287] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.590s	user 0.014s	sys 0.002s
W20260709 12:12:24.230093 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 47775.6us
I20260709 12:12:24.200353 20054 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:24.248059 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:12:24.248766 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:24.230999 19918 leader_election.cc:290] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:24.249452 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:24.252725 20054 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:12:24.253922 20206 log.cc:927] Time spent T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.219s	user 0.004s	sys 0.000s
I20260709 12:12:24.222095 19878 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:24.256055 13651 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:24.239389 20112 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:24.257992 14407 raft_consensus.cc:1240] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:24.258821 20112 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:24.262094 19741 consensus_queue.cc:1059] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:24.263365 19741 raft_consensus.cc:3055] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:24.263763 19741 raft_consensus.cc:740] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:24.256213 19878 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:24.266218 20191 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:24.265021 19741 consensus_queue.cc:260] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:24.267515 19741 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:24.279541 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 71039.3us
I20260709 12:12:24.284369 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:24.285640 20020 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:24.298206 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:24.303399 13836 raft_consensus.cc:2393] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 17: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:24.289860 20191 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:24.296868 20189 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:12:24.320544 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 64648.2us
I20260709 12:12:24.323637 13834 raft_consensus.cc:1275] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 12:12:24.324841 19894 consensus_meta.cc:287] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.793s	user 0.011s	sys 0.007s
I20260709 12:12:24.317945 19918 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:24.335855 13756 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 16.
I20260709 12:12:24.318074 14379 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:24.337918 20185 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:24.350569 13837 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 16.
I20260709 12:12:24.352152 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:24.344362 19976 raft_consensus.cc:2804] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:24.357846 19976 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:24.358448 19976 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:24.325521 19894 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:24.356319 20020 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:24.361389 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:24.356479 20185 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:24.334795 19918 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:24.364547 13800 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:24.344971 20191 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:24.363684 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:24.378969 13651 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:24.381044 13837 raft_consensus.cc:2393] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 14: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:24.381665 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:24.383149 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:24.382406 13834 raft_consensus.cc:1240] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 16. Current term is 17. Ops: []
W20260709 12:12:24.379371 20182 consensus_meta.cc:287] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.528s	user 0.003s	sys 0.011s
I20260709 12:12:24.384945 13829 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:24.362676 20092 consensus_queue.cc:1048] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 12:12:24.393445 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:24.398893 13834 raft_consensus.cc:2393] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 19: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:24.393479 14379 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:12:24.391271 19916 consensus_meta.cc:287] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.515s	user 0.011s	sys 0.004s
I20260709 12:12:24.387311 20182 raft_consensus.cc:2749] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 20. Current term is 21.
I20260709 12:12:24.389164 20020 raft_consensus.cc:2749] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:24.392489 20222 raft_consensus.cc:2764] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 12:12:24.408806 13830 raft_consensus.cc:1275] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 16 index: 7. Preceding OpId from leader: term: 17 index: 7. (term mismatch)
I20260709 12:12:24.418285 13830 pending_rounds.cc:85] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 6
I20260709 12:12:24.412885 20223 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:24.420374 13830 pending_rounds.cc:107] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 16.7
I20260709 12:12:24.418777 13757 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 17.
I20260709 12:12:24.421600 13830 raft_consensus.cc:2889] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:24.424777 13759 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 21.
I20260709 12:12:24.390061 20185 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:24.437021 20037 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:24.440038 20037 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:24.446524 13833 raft_consensus.cc:1240] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:24.453042 13829 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 21.
I20260709 12:12:24.421557 20223 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:24.455405 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 82396.9us
W20260709 12:12:24.451297 20193 consensus_meta.cc:287] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.781s	user 0.015s	sys 0.000s
W20260709 12:12:24.474835 14380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:24.455149 20182 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:24.458299 20223 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:24.481711 20191 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:24.482756 13686 raft_consensus.cc:1240] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:24.485107 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:24.483757 13800 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:24.483359 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:12:24.490164 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:24.488700 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:24.493611 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:24.493073 13679 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 18.
I20260709 12:12:24.497138 13652 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:24.491765 13833 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "956300599d004370953188dd3ae3a256"
dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:54820
I20260709 12:12:24.502424 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:24.494853 13757 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 18.
I20260709 12:12:24.503053 13834 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 18.
I20260709 12:12:24.501596 20082 consensus_queue.cc:1059] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 12:12:24.506934 20082 raft_consensus.cc:3055] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:24.506745 20182 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:24.507413 20082 raft_consensus.cc:740] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:24.508522 20082 consensus_queue.cc:260] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:24.510465 20037 raft_consensus.cc:2804] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:24.511127 20037 raft_consensus.cc:697] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 13 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:24.512214 13801 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:24.513304 20054 raft_consensus.cc:2804] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:24.492043 19894 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:24.513710 20054 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:24.512233 20037 consensus_queue.cc:237] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:24.514333 20222 raft_consensus.cc:2804] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:24.514300 20054 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:24.515029 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:24.515210 20222 raft_consensus.cc:697] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 21 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:24.515848 13835 raft_consensus.cc:2393] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 18: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:24.516185 20222 consensus_queue.cc:237] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:24.516798 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:24.518596 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:24.519286 13831 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 15.
I20260709 12:12:24.522086 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:24.522742 13830 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 13.
I20260709 12:12:24.523690 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:24.524391 13830 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 20.
I20260709 12:12:24.512296 19976 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:24.526356 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:24.527284 13834 raft_consensus.cc:2393] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 17: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:24.528774 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:24.529218 13831 raft_consensus.cc:1275] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:12:24.529454 13760 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 18.
I20260709 12:12:24.530146 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:24.530982 20182 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:24.529454 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:24.467094 20020 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:24.530818 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:24.532182 13801 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:24.525367 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:24.530807 13754 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:24.524721 13758 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 14.
I20260709 12:12:24.536893 13763 raft_consensus.cc:2393] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 20: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:24.483764 19883 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:24.540253 13759 raft_consensus.cc:1275] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 12:12:24.541167 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 69636.9us
I20260709 12:12:24.545311 13833 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:24.545933 13833 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:24.549502 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:24.494813 20193 consensus_queue.cc:1048] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.048s
I20260709 12:12:24.550796 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:24.543747 20082 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:24.521881 20221 consensus_queue.cc:1059] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.066s
I20260709 12:12:24.555680 13835 raft_consensus.cc:3055] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:24.546984 19928 raft_consensus.cc:2764] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 12:12:24.562256 13835 raft_consensus.cc:740] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:24.567396 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:24.569307 13830 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:24.570560 13801 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:12:24.570941 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:24.570603 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:24.549909 19976 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:24.543830 20182 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:24.573287 13837 raft_consensus.cc:1275] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:12:24.576764 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:24.581573 13831 raft_consensus.cc:2393] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 16: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:24.588930 13829 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:24.573930 19854 consensus_queue.cc:1059] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.003s
I20260709 12:12:24.590520 13801 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:24.547173 20020 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:24.592468 19854 raft_consensus.cc:3055] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:24.593011 19854 raft_consensus.cc:740] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:24.594112 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:24.595551 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:24.596418 13837 raft_consensus.cc:2393] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 21: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:24.597319 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:24.602043 20185 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:24.576798 19883 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:24.603768 14379 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:24.605032 19883 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:24.608127 13754 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 18.
I20260709 12:12:24.611346 19976 raft_consensus.cc:2804] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:24.612027 19976 raft_consensus.cc:697] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 16 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:24.605037 14379 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:24.615154 14379 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:24.615769 13831 raft_consensus.cc:1240] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 12:12:24.618822 19886 consensus_queue.cc:1059] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:24.619983 13727 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:24.620496 20185 raft_consensus.cc:3055] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:24.620966 20185 raft_consensus.cc:740] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:24.620994 19886 raft_consensus.cc:2804] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:24.621762 19886 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:24.622201 19886 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:24.622252 20185 consensus_queue.cc:260] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:24.623960 20185 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:24.626360 20020 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:24.627008 20020 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:24.627626 20020 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:24.618229 13829 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 21.
I20260709 12:12:24.630329 20112 raft_consensus.cc:2764] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 12:12:24.631305 20112 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:24.630793 19854 consensus_queue.cc:260] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:24.631875 20112 raft_consensus.cc:697] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 21 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:24.632369 19854 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:24.638021 13837 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 18.
I20260709 12:12:24.613152 19976 consensus_queue.cc:237] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:24.638197 19886 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:24.648492 13833 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:24.650872 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 59713.3us
I20260709 12:12:24.655779 13830 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 17.
I20260709 12:12:24.588636 13835 consensus_queue.cc:260] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:24.633162 20112 consensus_queue.cc:237] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:24.666963 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 61197.7us
I20260709 12:12:24.668242 13830 raft_consensus.cc:1275] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 12:12:24.681617 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 88830us
I20260709 12:12:24.687029 20189 raft_consensus.cc:2749] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:24.689616 13837 raft_consensus.cc:1275] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:12:24.690397 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:24.690929 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:24.681672 20020 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:24.692765 13831 raft_consensus.cc:1275] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:12:24.691052 13829 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:24.675284 20191 consensus_queue.cc:1059] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:12:24.694819 20191 raft_consensus.cc:3055] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:24.695206 20191 raft_consensus.cc:740] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:24.696154 20191 consensus_queue.cc:260] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:24.685003 20220 raft_consensus.cc:2749] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:24.699643 19886 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:24.701855 13829 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 15.
I20260709 12:12:24.661502 19741 consensus_queue.cc:1048] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:12:24.697611 20191 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:24.666563 20182 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:24.711851 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:24.721901 20234 consensus_queue.cc:1059] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.009s
W20260709 12:12:24.728519 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 113477us
I20260709 12:12:24.730029 14379 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:24.735435 13833 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:24.741405 13801 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:24.746207 13835 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:24.745164 20193 consensus_queue.cc:1048] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:24.748423 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:24.756950 14416 raft_consensus.cc:1275] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 12:12:24.757638 20227 log.cc:927] Time spent T 00000000000000000000000000000000 P 17d79eae88f84be7a847d0cf544674cd: Append to log took a long time: real 0.281s	user 0.000s	sys 0.003s
I20260709 12:12:24.762964 14413 raft_consensus.cc:1275] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:12:24.763144 20182 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:24.738437 19854 raft_consensus.cc:2804] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:24.764415 19854 raft_consensus.cc:697] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 14 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:24.765169 20233 consensus_queue.cc:1048] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 12:12:24.765395 19854 consensus_queue.cc:237] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:24.767645 13651 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:24.772800 13835 raft_consensus.cc:1275] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:12:24.773481 20232 raft_consensus.cc:2749] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 12:12:24.782413 20226 log.cc:927] Time spent T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 12:12:24.785238 13727 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:24.774080 13651 leader_election.cc:304] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:24.746907 19918 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:24.787734 13652 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:24.791994 13652 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:12:24.792946 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 83794.5us
I20260709 12:12:24.786006 20193 raft_consensus.cc:2749] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:24.793991 20223 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:24.798559 20225 log.cc:927] Time spent T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.233s	user 0.002s	sys 0.000s
I20260709 12:12:24.799459 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:24.809840 14407 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 19.
I20260709 12:12:24.799737 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:24.800220 20037 raft_consensus.cc:2804] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:24.800499 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:24.801762 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:24.802076 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:24.811250 13683 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:24.812161 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:24.786303 20221 consensus_queue.cc:1243] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer 3f37c9cc9dda46b4be21dd675ba78fb7 log is divergent from this leader: its last log entry 23.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 12:12:24.791489 20182 raft_consensus.cc:2749] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:12:24.741807 20054 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:24.792938 20189 raft_consensus.cc:2804] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:24.816936 14379 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:12:24.813100 13800 leader_election.cc:336] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.603s (SENT)
I20260709 12:12:24.820511 13800 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:24.789356 20020 consensus_queue.cc:1048] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 12:12:24.814577 20191 consensus_queue.cc:1048] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 12:12:24.815104 19883 raft_consensus.cc:2804] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:24.794490 20082 consensus_queue.cc:1059] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 12:12:24.837539 13834 raft_consensus.cc:1240] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:24.824249 20037 raft_consensus.cc:697] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 17 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:24.810365 20193 consensus_queue.cc:1048] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 12:12:24.833252 20189 raft_consensus.cc:697] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 21 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:24.837396 20222 raft_consensus.cc:2749] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:24.854144 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 144890us
I20260709 12:12:24.808735 19976 consensus_queue.cc:1059] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
W20260709 12:12:24.857875 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 83967.5us
I20260709 12:12:24.838258 19916 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:24.860155 13727 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:24.823590 19894 consensus_queue.cc:1048] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 12:12:24.850378 20238 raft_consensus.cc:2804] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:12:24.870394 20240 log.cc:927] Time spent T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 12:12:24.874903 13801 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:24.876519 20239 raft_consensus.cc:2749] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:12:24.877985 20230 log.cc:927] Time spent T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.239s	user 0.003s	sys 0.000s
I20260709 12:12:24.881232 20054 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:24.882553 19886 raft_consensus.cc:2804] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:24.883399 19886 raft_consensus.cc:697] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:12:24.884282 20231 log.cc:927] Time spent T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.262s	user 0.000s	sys 0.003s
I20260709 12:12:24.854444 19992 consensus_queue.cc:1048] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 12:12:24.888996 20223 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 23 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:12:24.891651 14380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:24.863705 20182 consensus_queue.cc:1048] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 12:12:24.902033 13801 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:24.902140 20037 consensus_queue.cc:237] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:24.871371 20238 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:24.905159 20238 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:24.884738 19886 consensus_queue.cc:237] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:24.924448 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 58188us
I20260709 12:12:24.869220 20189 consensus_queue.cc:237] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:24.935010 13683 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 13.
W20260709 12:12:24.936729 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 129654us
W20260709 12:12:24.936519 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 112438us
I20260709 12:12:24.947124 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:24.947890 13755 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:24.947722 20185 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:24.949468 13652 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:24.911201 20054 raft_consensus.cc:2749] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:24.931309 20239 raft_consensus.cc:2749] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 12:12:24.958069 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:24.958273 13800 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:24.962168 13651 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:24.964375 13686 raft_consensus.cc:1240] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:24.964924 19928 raft_consensus.cc:3055] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:12:24.965363 19928 raft_consensus.cc:740] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:24.966423 19928 consensus_queue.cc:260] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:24.967105 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:24.967805 13687 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:24.967885 19928 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:24.911697 19916 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:24.985457 13652 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:24.990840 20242 raft_consensus.cc:2804] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:24.990929 20249 consensus_queue.cc:1048] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 12:12:24.997305 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:24.949515 19918 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:25.007597 13755 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 23.
I20260709 12:12:25.009980 13652 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:12:25.010226 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 108296us
I20260709 12:12:25.010596 19918 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:25.014297 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:25.015193 13758 raft_consensus.cc:3055] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:25.015626 13758 raft_consensus.cc:740] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:12:25.018033 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 63313.2us
W20260709 12:12:25.022806 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 67267.4us
I20260709 12:12:25.005810 20242 raft_consensus.cc:697] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 18 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:25.078730 13652 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:25.086918 20242 consensus_queue.cc:237] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:25.088321 19894 raft_consensus.cc:2804] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:25.088886 19894 raft_consensus.cc:697] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 15 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:25.090234 20250 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:25.090503 13800 leader_election.cc:336] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.761s (SENT)
I20260709 12:12:25.026731 20248 consensus_queue.cc:1048] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:12:25.073735 19916 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:25.016731 13758 consensus_queue.cc:260] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:25.074836 20092 raft_consensus.cc:3055] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:25.075948 20020 raft_consensus.cc:3055] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:24.961055 20185 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:25.020012 20191 raft_consensus.cc:2749] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:12:25.079370 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 56817.6us
I20260709 12:12:25.087481 19918 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:25.010030 20082 raft_consensus.cc:2749] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:25.089970 20190 consensus_queue.cc:1048] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:25.072853 20259 raft_consensus.cc:2804] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:25.090791 20250 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:25.021605 13727 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
W20260709 12:12:25.110270 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 88725.3us
I20260709 12:12:25.110987 13727 leader_election.cc:304] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:25.090685 19894 consensus_queue.cc:237] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:25.091912 13800 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:25.097482 13758 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:25.096100 20020 raft_consensus.cc:740] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
W20260709 12:12:25.103891 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:25.006417 19883 raft_consensus.cc:697] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 17 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:25.099014 13687 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 23.
I20260709 12:12:25.094861 20092 raft_consensus.cc:740] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:25.113754 13727 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:12:25.114621 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 141597us
I20260709 12:12:25.118733 13727 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:25.117478 14379 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:25.104424 20255 raft_consensus.cc:2749] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:25.106748 20259 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:25.109892 19976 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:25.114502 19918 raft_consensus.cc:2804] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:25.127138 13801 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:25.133870 20222 raft_consensus.cc:2749] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:12:25.134115 20054 raft_consensus.cc:2749] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:25.133911 19976 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:25.138259 19854 raft_consensus.cc:2804] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:25.138079 19883 consensus_queue.cc:237] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:25.139264 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:25.139698 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:25.140523 13679 raft_consensus.cc:2393] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 17: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:25.140800 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:25.141144 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:25.141280 19854 raft_consensus.cc:697] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 13 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:25.142472 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:25.142905 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:25.143244 13686 raft_consensus.cc:2393] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 15: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:25.143591 19854 consensus_queue.cc:237] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:25.144176 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:25.144853 13683 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 19.
I20260709 12:12:25.114233 19916 raft_consensus.cc:2804] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:25.146360 19916 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:25.146539 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:25.146870 19916 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:25.147341 13683 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 17.
I20260709 12:12:25.148226 14379 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:12:25.150715 13800 leader_election.cc:336] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.785s (SENT)
I20260709 12:12:25.151214 13800 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:25.151389 13687 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 13.
I20260709 12:12:25.154198 20223 consensus_queue.cc:1059] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:25.154039 20092 consensus_queue.cc:260] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:25.154376 20020 consensus_queue.cc:260] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:25.155225 20223 raft_consensus.cc:3055] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:25.155501 20092 raft_consensus.cc:3060] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:25.155601 20223 raft_consensus.cc:740] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:25.156680 20223 consensus_queue.cc:260] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:25.157222 20238 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:25.128584 19741 consensus_queue.cc:1048] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.033s
W20260709 12:12:25.158154 13800 leader_election.cc:336] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 2.110s (SENT)
I20260709 12:12:25.159032 13800 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:25.160257 20239 raft_consensus.cc:2749] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:25.160351 19928 raft_consensus.cc:2749] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:25.160454 19886 raft_consensus.cc:2749] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:12:25.163537 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:25.163705 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:12:25.164065 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:25.166189 20250 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:25.168244 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:25.170348 13684 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 21.
I20260709 12:12:25.172164 13688 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 13.
I20260709 12:12:25.177031 13758 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 15.
I20260709 12:12:25.123639 20182 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:25.180966 13683 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 18.
I20260709 12:12:25.129115 19918 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:25.185389 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 66719.2us
I20260709 12:12:25.155711 20020 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:25.128556 20259 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:25.160274 20238 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:25.199652 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:25.205451 13757 raft_consensus.cc:1275] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:12:25.199281 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:25.199568 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:25.204301 13684 raft_consensus.cc:1275] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:12:25.207059 13763 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:25.184105 20223 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:25.198163 13727 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:25.206357 13830 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 19.
I20260709 12:12:25.214493 20262 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:25.217929 20252 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:12:25.193229 19918 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:12:25.234972 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 130459us
I20260709 12:12:25.183578 19928 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:25.259526 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:25.261001 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:25.246760 19886 raft_consensus.cc:2804] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:25.279363 14407 raft_consensus.cc:1275] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:12:25.264714 13759 raft_consensus.cc:1275] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:12:25.275543 19918 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:25.281181 13763 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 19.
W20260709 12:12:25.277460 20260 log.cc:927] Time spent T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:12:25.309079 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:25.259491 20252 raft_consensus.cc:697] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 23 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:25.311208 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:25.278776 19886 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:25.312968 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:25.259155 19928 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:25.285037 20233 raft_consensus.cc:993] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f: : Instructing follower 3f37c9cc9dda46b4be21dd675ba78fb7 to start an election
I20260709 12:12:25.317248 13830 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:25.320021 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:25.262215 20248 consensus_queue.cc:1059] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.049s
I20260709 12:12:25.358681 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:25.314867 20190 consensus_queue.cc:1048] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 12:12:25.319192 19886 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:25.365520 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 137805us
I20260709 12:12:25.262286 20262 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:25.377375 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:25.373093 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:25.382691 14412 raft_consensus.cc:2393] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 19: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
W20260709 12:12:25.382596 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:25.356276 20185 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:25.395797 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:25.392613 13687 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 19.
I20260709 12:12:25.382524 13686 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 18.
I20260709 12:12:25.394182 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:25.364879 20233 raft_consensus.cc:1081] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 13 LEADER]: Signalling peer 3f37c9cc9dda46b4be21dd675ba78fb7 to start an election
I20260709 12:12:25.430359 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:25.432855 13829 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:25.434832 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:25.431504 13800 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:25.435721 13837 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 13.
I20260709 12:12:25.400135 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:25.438326 13652 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:25.443187 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:25.460659 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:25.462245 13727 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:25.462746 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:25.399348 19918 leader_election.cc:290] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:25.463587 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:25.464373 14413 raft_consensus.cc:1240] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 13 LEADER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:25.465023 13830 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 19.
I20260709 12:12:25.430166 20190 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:25.472239 13800 leader_election.cc:336] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.999s (SENT)
I20260709 12:12:25.472728 13800 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:25.480122 13829 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 22.
I20260709 12:12:25.463956 20185 raft_consensus.cc:3055] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:25.460287 19976 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:25.491878 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:25.493705 13759 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
 from {username='slave'} at 127.0.0.1:38932
W20260709 12:12:25.494683 20261 log.cc:927] Time spent T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 12:12:25.497339 13837 raft_consensus.cc:1240] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 12:12:25.465334 20250 raft_consensus.cc:2804] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:25.486091 20185 raft_consensus.cc:740] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:25.491112 13830 raft_consensus.cc:1275] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:12:25.494594 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:25.439607 13836 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 15.
I20260709 12:12:25.514952 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:25.514647 20185 consensus_queue.cc:260] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:25.516059 20185 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:25.518275 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:25.519186 13687 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 14.
W20260709 12:12:25.513453 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 46960.4us
I20260709 12:12:25.480006 19918 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:25.482151 20239 raft_consensus.cc:2804] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:25.590550 13759 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:25.593461 13759 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:25.595650 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:12:25.585887 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 123717us
I20260709 12:12:25.507946 20250 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:25.595009 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:25.607860 20238 consensus_queue.cc:1059] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:12:25.605636 14415 raft_consensus.cc:1275] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
W20260709 12:12:25.618441 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:25.486358 20190 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:25.588675 19741 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:25.624127 13686 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 16.
I20260709 12:12:25.588006 20274 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:25.597496 19854 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:25.605684 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:25.603924 20250 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:25.599745 20239 raft_consensus.cc:697] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 15 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:25.597054 19976 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
W20260709 12:12:25.637305 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:25.644932 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:25.645733 13683 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:25.463124 20252 consensus_queue.cc:237] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:25.594945 19918 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:25.634596 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:25.641438 13680 raft_consensus.cc:2393] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 21: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:25.641592 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:25.640532 13755 raft_consensus.cc:1275] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:12:25.660249 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:25.655336 13685 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 17.
I20260709 12:12:25.660410 13759 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:25.675949 20286 consensus_queue.cc:1059] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:25.676944 20286 consensus_queue.cc:1243] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer ca9fbbc2c0a94897897d502d42f3951f log is divergent from this leader: its last log entry 13.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:12:25.677484 20286 consensus_queue.cc:1048] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.002s
I20260709 12:12:25.679342 13755 raft_consensus.cc:2393] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 25: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:25.644301 19894 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:25.685038 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:12:25.684553 13800 leader_election.cc:336] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 2.612s (SENT)
I20260709 12:12:25.686822 13800 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:25.679807 20281 raft_consensus.cc:3055] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:25.705518 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:25.706856 13833 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:25.658131 19976 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:25.662106 19854 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:25.726459 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 127134us
I20260709 12:12:25.702265 20281 raft_consensus.cc:740] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:25.639194 20274 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:25.692957 20266 log.cc:927] Time spent T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.172s	user 0.000s	sys 0.001s
W20260709 12:12:25.693807 20267 log.cc:927] Time spent T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
W20260709 12:12:25.694656 20263 log.cc:927] Time spent T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.348s	user 0.000s	sys 0.001s
W20260709 12:12:25.696704 20092 consensus_meta.cc:287] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.541s	user 0.004s	sys 0.008s
I20260709 12:12:25.692240 13683 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 19.
I20260709 12:12:25.703322 19928 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:12:25.736799 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 85722.5us
I20260709 12:12:25.688807 20233 consensus_queue.cc:1048] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 12:12:25.686713 19894 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:25.750875 13727 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:25.724259 20262 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:25.778331 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 96373.6us
W20260709 12:12:25.769932 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 82186.2us
I20260709 12:12:25.761754 14380 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:25.775529 13833 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 21.
I20260709 12:12:25.786887 13727 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
W20260709 12:12:25.777221 20223 consensus_meta.cc:287] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.553s	user 0.011s	sys 0.000s
I20260709 12:12:25.740058 20259 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:25.803145 20290 raft_consensus.cc:2749] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:25.804267 20237 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:25.804858 20237 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:25.811357 14412 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 18.
W20260709 12:12:25.768932 19916 consensus_meta.cc:287] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.621s	user 0.012s	sys 0.000s
I20260709 12:12:25.826792 14380 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
W20260709 12:12:25.864701 20182 consensus_meta.cc:287] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.672s	user 0.011s	sys 0.000s
I20260709 12:12:25.732360 20239 consensus_queue.cc:237] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:25.817998 20272 raft_consensus.cc:3055] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 16 LEADER]: Stepping down as leader of term 16
W20260709 12:12:25.871505 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:25.871551 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 44853.4us
I20260709 12:12:25.871932 13688 raft_consensus.cc:1240] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 18 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:25.820230 20092 raft_consensus.cc:2804] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:25.876579 14380 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:12:25.879951 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 93120.3us
W20260709 12:12:25.893338 13726 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 2.738s (SENT) [suppressed 46 similar messages]
I20260709 12:12:25.905395 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:12:25.878587 20268 log.cc:927] Time spent T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.246s	user 0.001s	sys 0.000s
I20260709 12:12:25.908622 13757 raft_consensus.cc:2393] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 16: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
W20260709 12:12:25.947131 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 61318.6us
I20260709 12:12:25.875142 20182 raft_consensus.cc:2749] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:25.879890 20272 raft_consensus.cc:740] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:25.947265 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:25.880357 20092 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:25.909196 13755 raft_consensus.cc:1275] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:12:25.871028 19916 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:25.958048 20288 raft_consensus.cc:2804] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:25.958271 20300 raft_consensus.cc:2804] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:25.957937 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:12:25.952210 20020 consensus_meta.cc:287] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.709s	user 0.008s	sys 0.004s
I20260709 12:12:25.957854 20292 raft_consensus.cc:2749] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:25.978578 20092 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:25.997982 13684 raft_consensus.cc:2410] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
W20260709 12:12:25.979734 13726 leader_election.cc:336] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.806s (SENT)
I20260709 12:12:25.994508 20288 raft_consensus.cc:697] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 19 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:25.988427 20300 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:26.001119 20310 raft_consensus.cc:2804] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:26.004460 19883 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.026265 19883 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:25.992916 20275 log.cc:927] Time spent T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.254s	user 0.001s	sys 0.000s
W20260709 12:12:26.028844 20276 log.cc:927] Time spent T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.377s	user 0.001s	sys 0.000s
I20260709 12:12:26.017545 20300 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:26.017870 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:26.018115 20288 consensus_queue.cc:237] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:26.035260 13837 raft_consensus.cc:2393] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 17: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
W20260709 12:12:26.038031 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 79015.6us
I20260709 12:12:26.040148 13836 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:26.041127 13832 raft_consensus.cc:1275] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:12:26.037341 13726 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
W20260709 12:12:26.042145 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:26.042922 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:26.044173 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:26.045050 14409 raft_consensus.cc:2410] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 12:12:26.050519 20274 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:26.051957 13756 raft_consensus.cc:1240] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:26.052716 20237 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:26.054148 13727 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:26.043617 13837 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 25.
I20260709 12:12:26.071303 13801 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:26.072552 14380 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:26.061390 20304 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:12:26.088086 20295 log.cc:927] Time spent T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
I20260709 12:12:26.055759 20253 consensus_queue.cc:1059] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 12:12:26.060827 20182 consensus_queue.cc:1048] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.037s
W20260709 12:12:26.098240 20294 log.cc:927] Time spent T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:12:26.073839 20274 raft_consensus.cc:2804] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:12:26.098894 19886 consensus_meta.cc:287] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.699s	user 0.014s	sys 0.000s
I20260709 12:12:26.099249 20285 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:26.099381 20258 log.cc:927] Time spent T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.887s	user 0.003s	sys 0.000s
I20260709 12:12:26.100957 20250 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:26.104192 20304 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:26.049098 20281 consensus_queue.cc:260] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:26.107901 20274 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:26.112769 20112 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:12:26.112923 20290 raft_consensus.cc:2749] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:26.173566 20272 consensus_queue.cc:260] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:26.175338 20272 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:26.180222 20250 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:26.189527 20303 log.cc:927] Time spent T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
W20260709 12:12:26.194195 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 214486us
W20260709 12:12:26.196736 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:26.161260 20274 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:26.113184 20292 consensus_queue.cc:1048] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.051s
I20260709 12:12:26.113307 19886 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:26.210691 20316 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:26.160784 20112 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:26.146413 20092 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:26.208150 20281 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:12:26.279434 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 210863us
I20260709 12:12:26.280359 13836 raft_consensus.cc:1275] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:12:26.280611 13727 leader_election.cc:304] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:26.203586 20310 raft_consensus.cc:697] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:26.237107 13681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 1139) took 1436 ms. Trace:
W20260709 12:12:26.242513 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:26.258775 19886 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:26.265233 13759 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:12:26.282938 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:26.156056 20285 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:26.221381 20253 raft_consensus.cc:3055] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:26.278533 20112 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:12:26.301880 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:26.282637 13681 rpcz_store.cc:276] 0709 12:12:24.800977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:24.801170 (+   193us) service_pool.cc:224] Handling call
0709 12:12:24.815375 (+ 14205us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:24.946319 (+130944us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:24.946350 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:24.946919 (+   569us) log.cc:844] Serialized 26 byte log entry
0709 12:12:25.097822 (+150903us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:25.097869 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:25.097933 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:26.098784 (+1000851us) spinlock_profiling.cc:243] Waited 15.4 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:12:26.231143 (+132359us) raft_consensus.cc:1685] finished
0709 12:12:26.231165 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:26.236906 (+  5741us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":285,"raft.queue_time_us":48065,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":22257,"spinlock_wait_cycles":35361024,"thread_start_us":250511,"threads_started":2,"wal-append.queue_time_us":249645}
W20260709 12:12:26.447088 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:26.495359 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:26.556293 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 274506us
W20260709 12:12:26.562706 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:26.293251 20253 raft_consensus.cc:740] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:26.563283 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:26.302088 20221 raft_consensus.cc:2749] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 15 LEADER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:26.308943 19886 raft_consensus.cc:2804] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:26.589984 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:26.596180 13829 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 19.
I20260709 12:12:26.538980 20250 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.614825 13837 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 19.
I20260709 12:12:26.103543 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:26.584993 20280 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:26.613525 20185 consensus_meta.cc:287] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 1.097s	user 0.011s	sys 0.008s
I20260709 12:12:26.664968 13836 raft_consensus.cc:1275] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:12:26.600361 20262 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.676055 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:26.692435 20220 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
W20260709 12:12:26.693893 20311 log.cc:927] Time spent T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 12:12:26.695665 13688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 2164) took 1181 ms. Trace:
I20260709 12:12:26.695920 13831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 3274) took 1308 ms. Trace:
I20260709 12:12:26.696326 13831 rpcz_store.cc:276] 0709 12:12:25.387682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:25.492910 (+105228us) service_pool.cc:224] Handling call
0709 12:12:25.493284 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:25.510588 (+ 17304us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:12:25.818645 (+308057us) log.cc:844] Serialized 14 byte log entry
0709 12:12:26.034754 (+216109us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:26.039083 (+  4329us) log.cc:844] Serialized 26 byte log entry
0709 12:12:26.039218 (+   135us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:12:26.039248 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:26.039310 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:26.695700 (+656390us) raft_consensus.cc:1685] finished
0709 12:12:26.695724 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:26.695857 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":101623,"prepare.queue_time_us":123253,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":17126,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":6278,"thread_start_us":360058,"threads_started":2,"wal-append.queue_time_us":324340}
I20260709 12:12:26.697753 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:26.695940 20298 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.700605 20298 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:26.703845 20298 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:26.696072 13688 rpcz_store.cc:276] 0709 12:12:25.514116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:25.587798 (+ 73682us) service_pool.cc:224] Handling call
0709 12:12:25.599394 (+ 11596us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:25.877978 (+278584us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:26.693200 (+815222us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b5400200ba0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f04dc0 00007fa927f90a02 00007fa927f8cdd6 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2
0709 12:12:26.695228 (+  2028us) spinlock_profiling.cc:243] Waited 272 ms on lock 0x7b5400271d54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:26.695590 (+   362us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":656692352}
I20260709 12:12:26.713600 19918 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:26.653005 20242 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.742420 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:26.744386 13756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 993) took 1514 ms. Trace:
I20260709 12:12:26.745007 13756 rpcz_store.cc:276] 0709 12:12:25.187031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:25.189187 (+  2156us) service_pool.cc:224] Handling call
0709 12:12:25.189605 (+   418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:26.052429 (+862824us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:26.701468 (+649039us) spinlock_profiling.cc:243] Waited 862 ms on lock 0x7b54002ee854. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:26.701704 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1982596992}
I20260709 12:12:26.749169 13756 raft_consensus.cc:1275] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 12:12:26.617974 20288 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.036s	sys 0.121s
W20260709 12:12:26.697808 20315 log.cc:927] Time spent T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.394s	user 0.000s	sys 0.001s
I20260709 12:12:26.700501 20190 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:26.809211 13759 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 17.
I20260709 12:12:26.618932 20250 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:26.758134 20185 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:26.778551 20288 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.036s	sys 0.122s
I20260709 12:12:26.756204 20259 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:26.756907 19928 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:26.693338 20220 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:26.768357 20242 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:26.743075 20262 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:26.688681 20280 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:26.841964 20269 log.cc:927] Time spent T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 1.228s	user 0.002s	sys 0.008s
I20260709 12:12:26.836369 20314 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:26.846627 20251 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.007s	sys 0.007s
I20260709 12:12:26.883811 20185 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:26.893991 14412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41700 (request call id 956) took 1498 ms. Trace:
I20260709 12:12:26.893600 19928 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:26.895162 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:12:26.895759 20305 log.cc:927] Time spent T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.946s	user 0.003s	sys 0.000s
I20260709 12:12:26.898994 20220 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:12:26.901568 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:26.806654 20290 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:26.920799 14412 rpcz_store.cc:276] 0709 12:12:25.395360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:25.395527 (+   167us) service_pool.cc:224] Handling call
0709 12:12:26.893670 (+1498143us) spinlock_profiling.cc:243] Waited 415 ms on lock 0x7b540016b7d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:26.893862 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":953463168}
I20260709 12:12:26.924454 13684 raft_consensus.cc:2368] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 20. Current term is 21.
I20260709 12:12:26.877121 20285 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:26.919741 20251 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.322s	user 0.007s	sys 0.008s
I20260709 12:12:26.934242 13835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 3026) took 1762 ms. Trace:
W20260709 12:12:26.922860 20272 consensus_meta.cc:287] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.744s	user 0.008s	sys 0.004s
W20260709 12:12:26.933920 20274 consensus_meta.cc:287] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.656s	user 0.011s	sys 0.000s
I20260709 12:12:26.923362 20288 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:26.855768 20301 log.cc:927] Time spent T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.794s	user 0.000s	sys 0.009s
I20260709 12:12:26.863806 19854 leader_election.cc:290] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:26.940304 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:26.956168 13687 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:26.939461 13835 rpcz_store.cc:276] 0709 12:12:25.172219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:25.172386 (+   167us) service_pool.cc:224] Handling call
0709 12:12:25.172711 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:25.183539 (+ 10828us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:25.183588 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:25.195219 (+ 11631us) log.cc:844] Serialized 26 byte log entry
0709 12:12:25.307262 (+112043us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:25.307306 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:25.307401 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:26.841334 (+1533933us) spinlock_profiling.cc:243] Waited 30.9 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:12:26.926519 (+ 85185us) raft_consensus.cc:1685] finished
0709 12:12:26.926585 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:26.934171 (+  7586us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43681,"raft.queue_time_us":17729,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":7096,"spinlock_wait_cycles":71020928,"thread_start_us":83914,"threads_started":1,"wal-append.queue_time_us":250998}
I20260709 12:12:26.876195 20250 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:26.948318 20300 consensus_meta.cc:287] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.918s	user 0.009s	sys 0.002s
I20260709 12:12:26.876803 19916 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:26.870342 20239 consensus_queue.cc:1048] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.075s
I20260709 12:12:26.931063 20092 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:26.811014 20310 consensus_queue.cc:237] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:26.944614 20285 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:26.964346 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:26.966743 13830 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:26.976668 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:26.977628 13684 raft_consensus.cc:2410] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 12:12:26.980602 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:26.926187 20314 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:26.815955 20253 consensus_queue.cc:260] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:26.985695 13687 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 15.
W20260709 12:12:26.984817 13726 leader_election.cc:336] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.530s (SENT)
I20260709 12:12:26.989468 13727 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:26.960456 20248 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.952883 20274 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:27.005642 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:27.009166 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:27.009490 13684 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 17.
I20260709 12:12:27.009799 13687 raft_consensus.cc:2376] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 21. Re-sending same reply.
I20260709 12:12:27.010818 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:27.011698 14407 raft_consensus.cc:2468] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 14.
I20260709 12:12:26.956332 20288 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:27.021344 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:27.021852 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:26.994235 19741 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:26.949695 20290 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:26.983881 20285 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:26.963562 20300 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:27.042404 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 207866us
W20260709 12:12:27.027429 20323 log.cc:927] Time spent T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:12:27.022308 20182 raft_consensus.cc:2804] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:27.062461 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:27.007889 20092 consensus_queue.cc:1048] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.035s
I20260709 12:12:27.063282 13687 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 18.
I20260709 12:12:27.067021 13830 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 14.
I20260709 12:12:27.085500 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:27.087000 20314 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:27.087694 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:27.088588 13680 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 18.
I20260709 12:12:27.092404 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:27.096499 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:27.096880 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:27.097616 13830 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:27.097867 13835 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 14.
I20260709 12:12:27.068284 20274 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:27.072036 20285 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:27.072873 20242 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:27.073704 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:27.104638 13832 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:12:27.074231 20280 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:27.040100 19741 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:27.062656 20182 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:27.075223 20185 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:27.013722 20248 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:27.076488 20288 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:27.077667 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:27.077877 20300 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:27.078148 20290 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:27.082687 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:27.131433 13684 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 19.
I20260709 12:12:27.083729 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:27.132835 13688 raft_consensus.cc:2376] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 13. Re-sending same reply.
I20260709 12:12:27.084589 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:12:27.084790 20112 consensus_meta.cc:287] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.539s	user 0.008s	sys 0.000s
W20260709 12:12:27.085518 20316 consensus_meta.cc:287] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.790s	user 0.003s	sys 0.009s
I20260709 12:12:27.100075 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:27.102738 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:27.117645 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:27.139210 13683 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 16.
I20260709 12:12:27.139550 13679 raft_consensus.cc:2393] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 21: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:27.121546 13834 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 21.
I20260709 12:12:27.125988 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:27.140555 13680 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 16.
W20260709 12:12:27.117766 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 203711us
W20260709 12:12:27.130146 13726 leader_election.cc:336] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.561s (SENT)
W20260709 12:12:27.134066 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:27.144426 13726 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:27.133937 13681 raft_consensus.cc:2376] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 19. Re-sending same reply.
W20260709 12:12:27.126833 20328 log.cc:927] Time spent T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
W20260709 12:12:27.126596 20318 log.cc:927] Time spent T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.354s	user 0.000s	sys 0.001s
I20260709 12:12:27.121788 20182 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:27.153156 14412 raft_consensus.cc:3055] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:27.121476 20239 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.156075 13688 raft_consensus.cc:1275] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:12:27.126988 20330 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.155220 14412 raft_consensus.cc:740] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:27.131232 19886 raft_consensus.cc:697] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:27.130533 20280 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:27.144897 20335 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:27.157070 13830 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 14.
I20260709 12:12:27.142225 19928 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:27.150339 20316 raft_consensus.cc:2749] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:27.170382 20291 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.174118 20333 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:27.174857 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 44763.4us
I20260709 12:12:27.174283 19886 consensus_queue.cc:237] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:27.170728 20330 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:27.182538 20334 consensus_queue.cc:1048] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:27.183607 20280 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:27.167793 20262 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:27.191911 20337 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:27.152006 20274 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:27.202426 13832 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 17.
I20260709 12:12:27.156137 20290 consensus_queue.cc:1048] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 12:12:27.219806 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
W20260709 12:12:27.208417 13726 leader_election.cc:336] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.623s (SENT)
I20260709 12:12:27.242244 13726 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:27.223584 13688 raft_consensus.cc:1275] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 12:12:27.243109 13688 pending_rounds.cc:85] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 10
I20260709 12:12:27.243432 13688 pending_rounds.cc:107] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 12:12:27.243731 13688 raft_consensus.cc:2889] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:27.151068 20112 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:27.155329 20288 consensus_queue.cc:1048] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 12:12:27.159626 20285 consensus_queue.cc:1048] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.045s
I20260709 12:12:27.244690 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:12:27.302064 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 255162us
I20260709 12:12:27.208279 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:27.165145 20185 raft_consensus.cc:2749] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:27.203763 14407 raft_consensus.cc:1275] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:12:27.263494 20280 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:27.238322 13801 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:27.302982 14414 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 19.
I20260709 12:12:27.195802 20190 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:27.166630 20239 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:27.223045 20300 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.203552 20342 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.330361 20286 raft_consensus.cc:2749] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:27.330180 20342 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:27.331444 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 123063us
W20260709 12:12:27.332134 13726 leader_election.cc:336] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.713s (SENT)
I20260709 12:12:27.332517 13726 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
W20260709 12:12:27.306386 20318 log.cc:927] Time spent T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 12:12:27.333132 20330 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:27.336544 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:27.336997 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:27.337445 13679 raft_consensus.cc:2393] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 14: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:27.339195 19741 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:12:27.345271 13726 leader_election.cc:336] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.746s (SENT)
I20260709 12:12:27.332762 20342 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:27.271855 19894 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:27.345803 13726 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
W20260709 12:12:27.348882 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:27.351508 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:27.361588 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:27.351527 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:27.362241 13681 raft_consensus.cc:2468] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 16.
I20260709 12:12:27.356761 13680 raft_consensus.cc:2393] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 17: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:27.346138 20326 raft_consensus.cc:2749] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 12:12:27.357577 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 160281us
I20260709 12:12:27.378662 13681 raft_consensus.cc:1275] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:12:27.382861 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:12:27.386727 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 148512us
I20260709 12:12:27.388998 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:27.391860 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:27.393429 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:27.363749 20259 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.220479 20291 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:27.395937 13685 raft_consensus.cc:2468] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 14.
I20260709 12:12:27.398772 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:27.379443 19894 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.407020 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:27.407768 13830 raft_consensus.cc:2468] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 13.
I20260709 12:12:27.408166 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:27.408994 13833 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:27.316490 20274 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:27.409731 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:27.411970 13834 raft_consensus.cc:2410] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for term 19 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 12:12:27.319211 20190 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:27.408594 13800 leader_election.cc:336] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.572s (SENT)
I20260709 12:12:27.413546 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:27.265988 20337 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:27.360180 20300 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:27.391388 20340 raft_consensus.cc:2749] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:27.220889 20333 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:27.203872 20335 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:27.418855 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 73628.9us
W20260709 12:12:27.443570 13726 leader_election.cc:336] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.765s (SENT)
I20260709 12:12:27.444154 13726 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
W20260709 12:12:27.445313 13800 leader_election.cc:336] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.636s (SENT)
I20260709 12:12:27.445820 13800 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:27.405887 19918 raft_consensus.cc:2749] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:12:27.450986 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:27.458324 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:27.459170 13680 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 19.
I20260709 12:12:27.414794 20248 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:27.428782 20253 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:27.431296 20112 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:27.432618 20189 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:27.407788 20259 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:27.467849 20281 consensus_meta.cc:287] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 1.181s	user 0.007s	sys 0.007s
I20260709 12:12:27.470151 20304 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:27.419605 20345 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.479735 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:27.480314 13684 raft_consensus.cc:1240] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:12:27.423331 20239 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:27.482530 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:27.483399 13684 raft_consensus.cc:2393] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 16: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:27.484345 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:27.485888 13679 raft_consensus.cc:1240] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 16. Current term is 17. Ops: [16.8-16.8]
I20260709 12:12:27.487200 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:12:27.474866 13800 leader_election.cc:336] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.636s (SENT)
I20260709 12:12:27.466655 13683 raft_consensus.cc:1240] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 12:12:27.488782 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:27.465471 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:27.485584 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:27.478104 14379 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:27.479278 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:27.411656 19894 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:27.493597 14379 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:27.499801 13681 raft_consensus.cc:2410] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:12:27.473817 20326 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:27.497285 13688 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 20.
W20260709 12:12:27.504433 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:27.510003 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:27.547035 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:27.547547 13683 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:27.547857 13679 raft_consensus.cc:2393] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 19: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:27.496237 13833 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 16.
I20260709 12:12:27.471086 20342 raft_consensus.cc:2749] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:12:27.550449 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 56972.9us
I20260709 12:12:27.546821 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:27.552771 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:27.553413 13688 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:27.472688 20352 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.553633 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:27.554388 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:27.555378 13687 raft_consensus.cc:2393] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 16: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
W20260709 12:12:27.556636 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 82170.9us
I20260709 12:12:27.561218 14379 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:27.562150 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:12:27.563342 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 60508.8us
W20260709 12:12:27.564986 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:27.565558 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:27.563378 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:27.497817 19886 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.500898 20304 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:27.565449 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:27.583894 13830 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Advancing to term 21
I20260709 12:12:27.566012 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:27.570520 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:27.571538 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:27.584967 13684 raft_consensus.cc:2393] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 19: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:27.585937 14411 raft_consensus.cc:1275] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:12:27.586146 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:27.586915 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:27.573932 13833 raft_consensus.cc:1275] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:12:27.498965 20112 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:27.604425 20112 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:27.607092 20112 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:27.502275 20233 raft_consensus.cc:2804] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:27.609520 20233 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:27.610144 20233 raft_consensus.cc:3060] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:27.610864 20333 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:27.611366 20335 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:27.611853 19918 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.612380 19918 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:27.612468 20250 consensus_queue.cc:1048] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:12:27.579025 13800 leader_election.cc:336] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.644s (SENT)
I20260709 12:12:27.614015 13800 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:27.579857 13683 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 14.
I20260709 12:12:27.580087 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:27.581663 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:27.617394 13679 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 19.
I20260709 12:12:27.618122 13680 raft_consensus.cc:2410] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:12:27.596261 13681 raft_consensus.cc:2393] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 19: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:12:27.546332 20345 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:27.620817 13835 raft_consensus.cc:1275] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:12:27.597081 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:27.602447 20182 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:27.603633 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:27.574743 20292 raft_consensus.cc:2804] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:27.480581 20189 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:27.561381 20344 log.cc:927] Time spent T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 12:12:27.628809 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:27.630170 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:27.630903 13681 raft_consensus.cc:2393] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 21: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:27.629575 13687 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 21.
I20260709 12:12:27.626608 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:27.548456 20285 consensus_queue.cc:1048] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 12:12:27.635610 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:27.636241 13830 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 21.
I20260709 12:12:27.632850 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:27.639016 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:27.633736 13828 raft_consensus.cc:2393] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 17: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:27.633289 13688 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 21.
W20260709 12:12:27.628878 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 162863us
I20260709 12:12:27.588131 20339 raft_consensus.cc:2804] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:27.641270 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:27.642510 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:27.648249 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:27.644331 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:27.645150 13833 raft_consensus.cc:1275] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:12:27.643257 13652 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:27.642176 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:27.645509 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:27.650734 13681 raft_consensus.cc:2376] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 14. Re-sending same reply.
I20260709 12:12:27.651211 13688 raft_consensus.cc:2393] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 18: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:27.651610 13683 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 13.
I20260709 12:12:27.653653 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:27.627403 20112 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:27.663486 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 84470.3us
W20260709 12:12:27.663884 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:27.664366 13800 leader_election.cc:336] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.756s (SENT)
I20260709 12:12:27.664882 13800 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:27.625367 20292 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:27.659368 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:27.670061 13683 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:27.671128 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:27.671975 13684 raft_consensus.cc:2376] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 14. Re-sending same reply.
I20260709 12:12:27.662286 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:27.667598 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:27.661398 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:27.569626 20352 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:27.678885 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:12:27.677517 13800 leader_election.cc:336] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.824s (SENT)
I20260709 12:12:27.681583 13800 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:27.648572 20339 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:27.649183 20335 raft_consensus.cc:2749] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:27.678172 13679 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 16.
I20260709 12:12:27.689258 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:27.614100 20304 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:27.595546 19886 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:27.686252 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:27.690861 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:27.694859 13679 raft_consensus.cc:2410] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 22 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 10.
W20260709 12:12:27.696761 13800 leader_election.cc:336] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.871s (SENT)
I20260709 12:12:27.697382 13800 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:27.694155 13684 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 15.
I20260709 12:12:27.675663 20292 raft_consensus.cc:3060] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:27.700914 13683 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 14.
I20260709 12:12:27.701649 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:27.703420 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:27.673723 20333 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:27.708689 13759 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34a12e91341d4472be7460f1061495db"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "b98d2519bb504dc6905ed2ede4571835"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:12:27.709457 13759 raft_consensus.cc:606] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Received request to transfer leadership to TS b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:27.709952 13759 raft_consensus.cc:614] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:12:27.717555 13800 leader_election.cc:336] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.900s (SENT)
I20260709 12:12:27.718086 13800 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:27.683167 19976 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:27.687374 20248 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.687400 20339 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:27.721064 20259 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:27.714255 20190 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:27.723592 20189 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:27.724457 19894 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:27.726758 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:27.760823 13833 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 18.
I20260709 12:12:27.729104 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:27.761981 13688 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:27.757988 13684 raft_consensus.cc:1240] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 12:12:27.705154 20338 raft_consensus.cc:2749] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:27.758755 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 316505us
I20260709 12:12:27.760867 13685 raft_consensus.cc:1240] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 17 LEADER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:27.675894 20112 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:27.751358 20342 raft_consensus.cc:2749] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:12:27.787518 13726 leader_election.cc:336] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.590s (SENT)
I20260709 12:12:27.759831 20291 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:27.800832 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:27.760573 20353 raft_consensus.cc:2804] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:12:27.801944 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 84409.5us
W20260709 12:12:27.802881 13800 leader_election.cc:336] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 2.039s (SENT)
I20260709 12:12:27.803378 13800 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:12:27.786664 20344 log.cc:927] Time spent T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:12:27.806471 13684 raft_consensus.cc:2393] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 19: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:12:27.760977 20300 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:12:27.808394 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 149553us
I20260709 12:12:27.808394 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:27.787150 20335 raft_consensus.cc:2749] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:12:27.759292 20248 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:27.816490 13688 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 17.
I20260709 12:12:27.817572 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:27.818189 13688 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 18.
I20260709 12:12:27.783420 20190 consensus_queue.cc:1048] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 12:12:27.819214 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:12:27.820822 13726 leader_election.cc:336] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 2.116s (SENT)
I20260709 12:12:27.823328 13831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 3285) took 1260 ms. Trace:
I20260709 12:12:27.824213 19886 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:27.818522 20338 raft_consensus.cc:2749] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:27.825435 20352 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:27.822662 20182 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:27.827183 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:27.828017 13685 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 17.
I20260709 12:12:27.828869 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:27.823753 13831 rpcz_store.cc:276] 0709 12:12:26.562542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:26.698548 (+136006us) service_pool.cc:224] Handling call
0709 12:12:26.698947 (+   399us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:26.958020 (+259073us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:26.958054 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:26.958628 (+   574us) log.cc:844] Serialized 52 byte log entry
0709 12:12:27.165516 (+206888us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:27.313483 (+147967us) log.cc:844] Serialized 14 byte log entry
0709 12:12:27.381060 (+ 67577us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:27.381134 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:27.823079 (+441945us) raft_consensus.cc:1685] finished
0709 12:12:27.823100 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:27.823254 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85364,"prepare.queue_time_us":55145,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":50,"raft.queue_time_us":89317,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":5313,"thread_start_us":514806,"threads_started":3,"wal-append.queue_time_us":383922}
I20260709 12:12:27.825177 20248 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:27.844684 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:12:27.851224 13800 leader_election.cc:336] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 2.065s (SENT)
W20260709 12:12:27.855921 13800 leader_election.cc:336] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 2.107s (SENT)
I20260709 12:12:27.857435 13685 raft_consensus.cc:1240] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:27.857635 13684 raft_consensus.cc:1275] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 13 index: 5. Preceding OpId from leader: term: 17 index: 7. (index mismatch)
I20260709 12:12:27.856359 13800 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:27.842271 20353 raft_consensus.cc:697] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 19 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
W20260709 12:12:27.861631 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 49257.6us
I20260709 12:12:27.867019 13685 raft_consensus.cc:1275] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:12:27.868330 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:27.869212 13685 raft_consensus.cc:2393] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 15: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:27.873844 19883 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:27.874814 13727 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:27.875923 13727 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:27.877952 20345 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:27.878705 20304 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:27.879941 20112 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:27.894418 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:27.895284 13688 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 18.
I20260709 12:12:27.896286 13727 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:27.899884 13685 raft_consensus.cc:1275] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:12:27.882668 20338 raft_consensus.cc:2749] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:27.881426 20233 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:27.907269 14379 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:27.892084 20248 raft_consensus.cc:2804] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:27.887919 20300 raft_consensus.cc:2804] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:27.901321 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:27.908771 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:27.919814 20291 raft_consensus.cc:2804] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:27.920595 20291 raft_consensus.cc:697] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:27.924181 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:27.926474 13685 raft_consensus.cc:1275] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 12:12:27.895179 19886 consensus_queue.cc:1048] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 12:12:27.923451 20248 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:27.944314 20248 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:27.944429 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:27.922765 20298 raft_consensus.cc:2804] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:27.923180 20300 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:27.943315 13800 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:27.936916 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:27.955550 13800 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:27.971930 13685 raft_consensus.cc:1275] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:12:27.951681 20298 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:27.970176 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 73963us
I20260709 12:12:27.952512 20300 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:27.978142 13727 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:27.921710 20291 consensus_queue.cc:237] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:27.982299 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:27.984490 13726 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:27.954924 20326 raft_consensus.cc:2749] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:27.989879 13684 raft_consensus.cc:1275] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:12:27.955932 20335 raft_consensus.cc:2764] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 12:12:27.994881 13800 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:27.995795 20342 consensus_queue.cc:1048] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:12:28.005911 20370 log.cc:927] Time spent T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 12:12:28.008523 20233 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 17 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:27.981805 20298 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:27.941325 20353 consensus_queue.cc:237] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:27.981143 20340 raft_consensus.cc:2749] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:12:27.979751 20288 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.043004 13800 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:28.034871 19886 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.035256 20345 raft_consensus.cc:2749] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:12:28.065883 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:12:28.073900 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 89548.6us
W20260709 12:12:28.071348 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 93297.6us
I20260709 12:12:28.075547 13800 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:28.076627 13726 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:28.029469 20239 consensus_queue.cc:1048] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 12:12:28.056591 20335 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:28.086966 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:28.086776 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:28.038254 20339 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:28.095276 13754 raft_consensus.cc:1240] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:28.093340 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:28.097924 13756 raft_consensus.cc:2410] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 12:12:28.099568 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:28.099957 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:28.100803 13763 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:28.101625 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:28.102627 13758 raft_consensus.cc:2368] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 22. Current term is 23.
I20260709 12:12:28.103772 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:28.076748 20322 raft_consensus.cc:2804] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:28.107334 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:28.108176 13759 raft_consensus.cc:2468] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 16.
I20260709 12:12:28.110219 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:28.048112 20288 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:28.111235 13760 raft_consensus.cc:2393] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 18: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:28.115851 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:28.118399 13754 raft_consensus.cc:2410] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
W20260709 12:12:28.123586 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 48167.7us
I20260709 12:12:28.124963 13800 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:28.131397 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:28.132332 13757 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:12:28.134045 20374 log.cc:927] Time spent T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 12:12:28.135259 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:28.136229 13759 raft_consensus.cc:2410] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 12:12:28.139585 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:28.140491 13761 raft_consensus.cc:2393] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 19: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:28.141377 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:28.147349 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:28.168793 13762 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:28.168802 13761 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 21.
I20260709 12:12:28.158147 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:28.065632 20378 consensus_queue.cc:1059] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
W20260709 12:12:28.135151 20375 log.cc:927] Time spent T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 12:12:28.176334 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:28.177587 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:28.111531 20345 raft_consensus.cc:2804] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:28.080783 19886 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:28.115392 20322 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:28.185057 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 108571us
W20260709 12:12:28.185578 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 60695.4us
I20260709 12:12:28.187067 13800 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:28.188877 13726 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:28.192991 13756 raft_consensus.cc:2393] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 18: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:28.150828 20383 raft_consensus.cc:2804] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:28.202538 13760 raft_consensus.cc:1240] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 18. Current term is 19. Ops: []
W20260709 12:12:28.203239 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:28.199672 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 124471us
I20260709 12:12:28.199824 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:28.154321 20326 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.207190 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:28.205667 13727 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:28.205860 13761 raft_consensus.cc:2393] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 19: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:28.205871 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:28.204757 14412 consensus_queue.cc:260] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:28.217346 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:28.220196 14412 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:28.208282 13758 raft_consensus.cc:2468] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 14.
I20260709 12:12:28.180883 20340 raft_consensus.cc:2749] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:28.184183 20342 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.186170 20345 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:28.196059 20322 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:28.232534 13726 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:28.199959 20182 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.236490 13682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 2167) took 2721 ms. Trace:
I20260709 12:12:28.236833 20381 raft_consensus.cc:3055] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:28.196760 20338 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.208417 20383 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:28.250178 20182 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:28.219511 20239 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:28.192090 13763 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 18.
I20260709 12:12:28.246902 20381 raft_consensus.cc:740] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:28.250983 20383 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:28.241935 13755 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 16.
I20260709 12:12:28.251905 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:28.253262 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:28.266762 13761 raft_consensus.cc:2393] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 17: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
W20260709 12:12:28.254577 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 67610us
I20260709 12:12:28.257066 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:28.268409 20340 consensus_queue.cc:1048] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:28.269467 13763 raft_consensus.cc:1240] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 12:12:28.271498 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:28.272675 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:28.273738 13756 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 16.
I20260709 12:12:28.249019 13762 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 15.
I20260709 12:12:28.262316 14412 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 14.
I20260709 12:12:28.229164 20378 raft_consensus.cc:2749] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:28.255801 13759 raft_consensus.cc:1275] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:12:28.271507 13763 raft_consensus.cc:1275] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
I20260709 12:12:28.276079 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:28.245265 20345 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:28.244661 13682 rpcz_store.cc:276] 0709 12:12:25.515212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:25.518112 (+  2900us) service_pool.cc:224] Handling call
0709 12:12:25.518578 (+   466us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:25.519532 (+   954us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:12:25.519817 (+   285us) log.cc:844] Serialized 14 byte log entry
0709 12:12:26.011607 (+491790us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:27.937690 (+1926083us) spinlock_profiling.cc:243] Waited 2.15 ms on lock 0x7b2c000014c8. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa926886a11 00007fa926896372 00007fa927fc8a01 00007fa927f8d43a 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2
0709 12:12:27.944210 (+  6520us) log.cc:844] Serialized 52 byte log entry
0709 12:12:28.073685 (+129475us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:28.079820 (+  6135us) log.cc:844] Serialized 14 byte log entry
0709 12:12:28.083729 (+  3909us) log.cc:844] Serialized 14 byte log entry
0709 12:12:28.089153 (+  5424us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:28.115181 (+ 26028us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:28.231397 (+116216us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b1800392b60. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924ea0522 00007fa924ea27c1 00007fa924ea2779 00007fa924ea2709 00007fa924ea26d1 00007fa924ea19cd 0000000000388634 0000000000388479 00007fa924e8383a
0709 12:12:28.236041 (+  4644us) raft_consensus.cc:1685] finished
0709 12:12:28.236071 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:28.236258 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7914,"prepare.queue_time_us":106754,"prepare.run_cpu_time_us":104,"prepare.run_wall_time_us":108,"raft.queue_time_us":44131,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":16651,"spinlock_wait_cycles":81378944,"thread_start_us":604705,"threads_started":3,"wal-append.queue_time_us":411185,"wal-append.run_cpu_time_us":1171,"wal-append.run_wall_time_us":1001194}
I20260709 12:12:28.276809 13763 pending_rounds.cc:85] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting all ops after (but not including) 8
I20260709 12:12:28.280809 13763 pending_rounds.cc:107] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 12:12:28.281221 13763 raft_consensus.cc:2889] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:12:28.282485 20360 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.001s	sys 0.011s
W20260709 12:12:28.286239 20360 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.001s	sys 0.011s
I20260709 12:12:28.254588 20338 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:28.250181 20384 raft_consensus.cc:2749] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:28.292492 20378 raft_consensus.cc:2749] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:28.277881 20385 raft_consensus.cc:2804] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:28.294399 20385 raft_consensus.cc:697] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:28.295810 20392 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.296568 20392 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:28.299664 20392 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:28.301368 13761 raft_consensus.cc:1275] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 12:12:28.303784 20359 log.cc:927] Time spent T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.589s	user 0.002s	sys 0.000s
I20260709 12:12:28.304224 20338 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:28.304658 13755 raft_consensus.cc:1275] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:12:28.305280 13800 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:28.229705 20326 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:28.310463 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:28.310186 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:28.311151 13762 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 18.
W20260709 12:12:28.314905 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 67463.1us
I20260709 12:12:28.317107 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:28.317502 13727 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:28.317902 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:28.318179 13833 raft_consensus.cc:2393] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 14: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:28.323325 13761 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:12:28.324357 13761 raft_consensus.cc:606] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 LEADER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
W20260709 12:12:28.304260 20333 consensus_meta.cc:287] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.589s	user 0.011s	sys 0.000s
I20260709 12:12:28.247489 20342 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:28.327371 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:28.319535 13727 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:28.329886 13834 raft_consensus.cc:1275] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:12:28.313294 20340 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:28.330000 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:28.345597 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:28.315397 20338 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:28.319866 20392 raft_consensus.cc:2804] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:28.354434 13834 raft_consensus.cc:1240] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:28.351462 13727 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:28.364926 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:28.365976 13762 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 19.
I20260709 12:12:28.325860 20378 raft_consensus.cc:2804] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:28.341549 20333 raft_consensus.cc:2749] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:28.364384 20392 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:28.377677 13831 raft_consensus.cc:1275] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:12:28.349740 20253 raft_consensus.cc:2749] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:28.375973 20392 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:28.380558 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 148134us
I20260709 12:12:28.428174 13726 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:28.381083 20335 raft_consensus.cc:2749] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:28.382970 20342 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:28.318936 20385 consensus_queue.cc:237] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:28.442641 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:28.365101 20338 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:28.353453 20340 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:28.443590 13759 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 21.
W20260709 12:12:28.388365 14413 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41692 (request call id 1008) took 2497 ms (client timeout 2049 ms). Trace:
I20260709 12:12:28.409611 14409 raft_consensus.cc:1240] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 15. Current term is 16. Ops: []
W20260709 12:12:28.388984 20387 log.cc:927] Time spent T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:12:28.391213 20337 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:28.395852 19918 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:28.398211 20291 raft_consensus.cc:2804] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:28.399221 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:12:28.399806 20361 log.cc:927] Time spent T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.682s	user 0.001s	sys 0.001s
I20260709 12:12:28.415232 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:28.418434 19886 leader_election.cc:290] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:28.420145 20326 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:28.385690 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:12:28.444226 14413 rpcz_store.cc:269] 0709 12:12:25.890482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:25.903444 (+ 12962us) service_pool.cc:224] Handling call
0709 12:12:28.388062 (+2484618us) spinlock_profiling.cc:243] Waited 951 ms on lock 0x7b54005f1ed4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:28.388249 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2187184000}
I20260709 12:12:28.461311 13726 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:28.417260 20300 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:28.471958 13761 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 13.
I20260709 12:12:28.413132 20322 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:28.443506 20292 consensus_meta.cc:287] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.724s	user 0.012s	sys 0.002s
I20260709 12:12:28.469223 20342 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:28.484520 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:28.430229 20378 raft_consensus.cc:697] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:28.499188 13726 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:28.480587 13756 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 16.
I20260709 12:12:28.355247 20381 consensus_queue.cc:260] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:28.474471 20291 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:28.477494 14380 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:28.488229 13757 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 21.
W20260709 12:12:28.489676 20248 consensus_meta.cc:287] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.545s	user 0.013s	sys 0.000s
I20260709 12:12:28.503280 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:28.507469 13758 raft_consensus.cc:1275] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:12:28.507835 13756 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:12:28.482906 20335 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:28.509795 13760 raft_consensus.cc:2393] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 21: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:28.510933 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:28.516486 13761 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 16.
I20260709 12:12:28.518621 13757 raft_consensus.cc:1275] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:12:28.489639 20396 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.491770 20253 raft_consensus.cc:2804] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:28.515049 13759 raft_consensus.cc:2393] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 15: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:28.521601 13726 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:28.513847 13763 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 17.
W20260709 12:12:28.501924 20362 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.782s	user 0.012s	sys 0.017s
I20260709 12:12:28.526299 13836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 1183) took 1138 ms. Trace:
I20260709 12:12:28.530616 13763 raft_consensus.cc:1275] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:12:28.513979 20337 raft_consensus.cc:2749] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:28.508498 20291 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:28.547722 13836 rpcz_store.cc:276] 0709 12:12:27.390722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:27.390866 (+   144us) service_pool.cc:224] Handling call
0709 12:12:27.402199 (+ 11333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:27.420129 (+ 17930us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:27.420163 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:27.447988 (+ 27825us) log.cc:844] Serialized 26 byte log entry
0709 12:12:27.620772 (+172784us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:27.620811 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:27.620921 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:28.399092 (+778171us) spinlock_profiling.cc:243] Waited 34.7 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:12:28.517154 (+118062us) raft_consensus.cc:1685] finished
0709 12:12:28.517177 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:28.526219 (+  9042us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9256,"raft.queue_time_us":9430,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":15959,"spinlock_wait_cycles":79912832,"thread_start_us":123469,"threads_started":1,"wal-append.queue_time_us":183199}
I20260709 12:12:28.550699 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:28.552922 13761 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 17.
W20260709 12:12:28.545668 20362 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.825s	user 0.014s	sys 0.019s
I20260709 12:12:28.524048 20182 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:28.527892 20253 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:28.528803 20326 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:28.500864 20292 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:28.547343 20112 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:28.515798 20335 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:28.551093 19886 raft_consensus.cc:2749] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:28.568635 20378 consensus_queue.cc:237] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:28.570045 20253 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:28.570366 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:28.567481 13726 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:28.581920 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:28.530745 20396 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:28.507109 20342 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:28.585983 20342 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:28.586768 20342 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:28.557442 20381 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:28.589617 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:28.590500 13834 raft_consensus.cc:2393] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 18: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:28.590543 20396 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:28.591717 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:28.592485 13834 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 17.
I20260709 12:12:28.523293 20248 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:28.574065 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:28.595664 20248 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:28.587460 20342 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:28.597122 20389 raft_consensus.cc:2804] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:28.600786 20389 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:28.601209 20389 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:28.597745 20337 consensus_queue.cc:1048] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:12:28.608278 20337 consensus_queue.cc:1048] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:28.611296 20337 consensus_queue.cc:1048] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:28.620713 13761 raft_consensus.cc:2393] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 19: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
W20260709 12:12:28.527220 20384 consensus_queue.cc:1175] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "96701a74fdee481fb5f54aac841e17dd" responder_term: 16 status { last_received { term: 16 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 16 index: 8 } }
I20260709 12:12:28.626735 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:28.627954 13836 raft_consensus.cc:2410] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 26 because replica has last-logged OpId of term: 24 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 16.
I20260709 12:12:28.632630 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:28.636456 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:28.574154 20280 raft_consensus.cc:2749] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:28.649209 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 171807us
I20260709 12:12:28.651695 14380 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:28.654086 20252 raft_consensus.cc:2804] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:28.654785 20252 raft_consensus.cc:697] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 16 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:28.655985 20252 consensus_queue.cc:237] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:28.648900 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:28.660917 14416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41700 (request call id 962) took 1640 ms. Trace:
I20260709 12:12:28.661890 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:28.661628 14416 rpcz_store.cc:276] 0709 12:12:26.998711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:27.005658 (+  6947us) service_pool.cc:224] Handling call
0709 12:12:27.006141 (+   483us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:27.037760 (+ 31619us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:27.037836 (+    76us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:27.063966 (+ 26130us) log.cc:844] Serialized 26 byte log entry
0709 12:12:27.354143 (+290177us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:27.354183 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:28.620104 (+1265921us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b540068ced4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:28.620186 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:28.620243 (+    57us) raft_consensus.cc:1685] finished
0709 12:12:28.620255 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:28.639187 (+ 18932us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34057,"raft.queue_time_us":194,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":26390,"spinlock_wait_cycles":32773888,"thread_start_us":259858,"threads_started":1,"wal-append.queue_time_us":319771,"wal-append.run_cpu_time_us":2029,"wal-append.run_wall_time_us":1009104}
I20260709 12:12:28.661360 14409 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 17.
I20260709 12:12:28.660436 14380 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:28.680688 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:28.680795 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:12:28.678851 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 79891.9us
I20260709 12:12:28.682061 13836 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:28.682016 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:28.660706 20333 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.687948 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:28.688526 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:28.686784 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:28.684553 13831 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 17.
I20260709 12:12:28.690600 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:28.694391 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:12:28.694733 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:28.573938 20397 consensus_queue.cc:1059] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.110s
I20260709 12:12:28.695211 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:28.622381 20112 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:28.700982 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:28.698065 13680 raft_consensus.cc:2393] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 18: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:28.698088 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:28.700269 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:12:28.703675 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 97256.2us
I20260709 12:12:28.707160 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:28.708376 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:28.719851 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:28.722394 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:28.726295 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:28.726384 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:28.730530 14407 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 17.
I20260709 12:12:28.730737 13688 raft_consensus.cc:2376] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 17. Re-sending same reply.
I20260709 12:12:28.727375 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:28.701678 13679 raft_consensus.cc:2376] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 21. Re-sending same reply.
I20260709 12:12:28.737313 14415 raft_consensus.cc:2410] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 26 because replica has last-logged OpId of term: 24 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 16.
I20260709 12:12:28.740912 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:28.741796 13679 raft_consensus.cc:2376] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 14. Re-sending same reply.
I20260709 12:12:28.743207 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:28.743896 13688 raft_consensus.cc:2376] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 14. Re-sending same reply.
I20260709 12:12:28.745257 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:28.746059 13831 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:28.747766 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:28.748514 13680 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 19.
I20260709 12:12:28.749708 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:28.750622 13688 raft_consensus.cc:2393] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 21: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:28.754947 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:28.754930 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:28.756542 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:28.757238 13688 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:28.760186 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:28.784605 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:28.785346 13727 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:28.802424 13688 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 20.
I20260709 12:12:28.697420 20333 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:28.804615 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:28.806813 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:28.807047 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:28.748320 20408 raft_consensus.cc:2804] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:12:28.776075 20394 log.cc:927] Time spent T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.267s	user 0.001s	sys 0.000s
I20260709 12:12:28.807094 13680 raft_consensus.cc:2393] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 21: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:28.809832 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:28.756925 20300 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:28.816036 13836 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 20.
I20260709 12:12:28.821691 13726 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:28.824987 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:28.828822 13832 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 13.
I20260709 12:12:28.832002 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:28.809382 20408 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:28.832805 14414 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 25.
I20260709 12:12:28.830467 13726 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:28.836063 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:28.836995 13832 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 17.
I20260709 12:12:28.838135 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:28.838987 13832 raft_consensus.cc:2410] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for term 20 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 12:12:28.840162 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:28.842980 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:28.814442 20406 raft_consensus.cc:2804] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:28.847332 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:28.852982 13801 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:28.855069 14415 raft_consensus.cc:2368] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 14. Current term is 15.
I20260709 12:12:28.838002 20274 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:28.855772 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:28.862658 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:28.839669 20408 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:28.856631 20383 consensus_meta.cc:287] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.575s	user 0.012s	sys 0.000s
W20260709 12:12:28.864473 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 77412.9us
I20260709 12:12:28.849694 20406 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:28.865031 14414 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 19.
W20260709 12:12:28.865583 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:28.844446 20300 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.863829 13686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 1165) took 1396 ms. Trace:
I20260709 12:12:28.870105 13727 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:28.846315 20182 raft_consensus.cc:2749] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:28.828495 20389 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:28.877914 13727 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:28.886516 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:28.887756 13836 raft_consensus.cc:2393] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 21: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:28.886766 13727 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:28.858969 20333 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:28.860694 20335 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:12:28.877831 20399 log.cc:927] Time spent T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.227s	user 0.000s	sys 0.002s
I20260709 12:12:28.863430 20381 raft_consensus.cc:2804] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:28.913349 20185 raft_consensus.cc:2749] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:28.914458 20333 raft_consensus.cc:2749] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:28.924893 13761 raft_consensus.cc:1240] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 18. Current term is 19. Ops: [18.11-18.11]
W20260709 12:12:28.910035 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 57195.8us
I20260709 12:12:28.863641 20342 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:28.878700 20406 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:28.931774 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 45108.3us
I20260709 12:12:28.932765 13727 leader_election.cc:304] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:28.932860 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:28.883142 20248 raft_consensus.cc:2749] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:28.928051 13801 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:12:28.886786 20410 log.cc:927] Time spent T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 12:12:28.943710 13756 raft_consensus.cc:606] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 LEADER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:28.941519 13801 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:12:28.951581 20414 log.cc:927] Time spent T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 12:12:28.889325 20300 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:28.883821 20383 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:28.953212 20182 raft_consensus.cc:2749] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:28.952585 20381 raft_consensus.cc:697] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:29.043254 13754 raft_consensus.cc:2368] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 21. Current term is 22.
I20260709 12:12:28.955524 20425 raft_consensus.cc:2749] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:29.066485 20381 consensus_queue.cc:237] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:29.064733 20419 log.cc:927] Time spent T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 12:12:29.070888 20300 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:12:29.065366 20413 log.cc:927] Time spent T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
W20260709 12:12:29.050235 20415 log.cc:927] Time spent T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.200s	user 0.000s	sys 0.007s
I20260709 12:12:28.958767 20112 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:29.078184 13687 raft_consensus.cc:1275] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 12:12:29.010548 20414 log.cc:927] Time spent T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 12:12:29.053584 13831 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 15.
W20260709 12:12:29.055473 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 122801us
I20260709 12:12:28.944090 20342 raft_consensus.cc:2804] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:29.058943 13836 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 25.
I20260709 12:12:29.110711 20288 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:29.112263 13836 raft_consensus.cc:1275] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:12:29.113718 13836 raft_consensus.cc:1275] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:12:29.113933 20333 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:12:29.116134 20333 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:29.116647 20333 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:12:29.126937 20345 consensus_meta.cc:287] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.817s	user 0.007s	sys 0.005s
I20260709 12:12:29.127316 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:29.127854 20345 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:29.129351 13835 raft_consensus.cc:1240] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:29.129565 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:29.130192 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:29.130785 13762 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 19.
I20260709 12:12:29.131691 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:29.132359 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:29.133090 13758 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 17.
I20260709 12:12:29.133665 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:12:29.136502 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:29.140846 20416 log.cc:927] Time spent T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.336s	user 0.003s	sys 0.000s
I20260709 12:12:29.148094 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:29.152963 20338 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:12:29.159127 20291 consensus_meta.cc:287] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.597s	user 0.011s	sys 0.000s
W20260709 12:12:29.160302 20428 log.cc:927] Time spent T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 12:12:29.160111 20291 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:29.155897 20408 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:29.164086 13755 raft_consensus.cc:2368] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for earlier term 18. Current term is 19.
W20260709 12:12:29.086141 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 155541us
I20260709 12:12:29.087471 13682 raft_consensus.cc:3055] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 21 LEADER]: Stepping down as leader of term 21
W20260709 12:12:29.077823 20404 log.cc:927] Time spent T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.273s	user 0.007s	sys 0.000s
I20260709 12:12:29.088709 20427 raft_consensus.cc:476] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 15 LEADER]: Not starting pre-election -- already a leader
I20260709 12:12:29.077288 20425 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:29.090656 20298 consensus_meta.cc:287] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 1.080s	user 0.007s	sys 0.007s
I20260709 12:12:29.091776 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:12:29.093334 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:29.094662 20239 consensus_meta.cc:287] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.830s	user 0.009s	sys 0.004s
I20260709 12:12:29.097966 20422 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:29.242066 20239 raft_consensus.cc:2749] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:29.242944 13834 raft_consensus.cc:1240] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:29.242372 20422 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:29.243573 13683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 3152) took 1774 ms. Trace:
I20260709 12:12:29.243978 13683 rpcz_store.cc:276] 0709 12:12:27.469254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:27.713594 (+244340us) service_pool.cc:224] Handling call
0709 12:12:27.714119 (+   525us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:12:28.138305 (+424186us) spinlock_profiling.cc:243] Waited 6.18 ms on lock 0x7b180036c040. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa927b354bc 00007fa924e8348b 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9d455 00007fa927f85060 00007fa927f85bfb 00007fa927f9064b
0709 12:12:28.138477 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:28.138510 (+    33us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:12:28.198043 (+ 59533us) log.cc:844] Serialized 78 byte log entry
0709 12:12:28.572825 (+374782us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:12:28.622528 (+ 49703us) log.cc:844] Serialized 14 byte log entry
0709 12:12:28.622816 (+   288us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:28.622916 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:29.243152 (+620236us) raft_consensus.cc:1685] finished
0709 12:12:29.243251 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:29.243488 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4318,"prepare.queue_time_us":48720,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":64,"raft.queue_time_us":75829,"raft.run_cpu_time_us":341,"raft.run_wall_time_us":23653,"spinlock_wait_cycles":14204672,"thread_start_us":401994,"threads_started":2,"wal-append.queue_time_us":449978}
I20260709 12:12:29.098130 20352 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:29.246191 20352 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:29.249143 20393 log.cc:927] Time spent T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.697s	user 0.002s	sys 0.000s
I20260709 12:12:29.083057 20342 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:29.099653 20383 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:29.249586 19992 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:29.250054 20342 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:29.250335 19992 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:29.100775 20406 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:29.253077 13758 raft_consensus.cc:2393] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 18: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
W20260709 12:12:29.253747 20398 log.cc:927] Time spent T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.685s	user 0.001s	sys 0.001s
I20260709 12:12:29.254528 20406 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:29.255003 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:29.245592 20422 leader_election.cc:290] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:29.256320 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:29.256809 20352 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:29.102344 14380 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
W20260709 12:12:29.258440 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 156155us
I20260709 12:12:29.259791 14380 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:29.261258 14380 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:29.104923 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:29.106511 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:29.084406 13727 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:29.109364 20322 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:29.265305 13687 raft_consensus.cc:3060] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:29.110416 20392 consensus_meta.cc:287] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.644s	user 0.012s	sys 0.000s
I20260709 12:12:29.265990 13759 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 18.
I20260709 12:12:29.266081 20392 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:29.267511 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:29.269017 20392 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:29.264791 13760 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 17.
I20260709 12:12:29.270349 13833 raft_consensus.cc:1240] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:29.096247 20253 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:29.144304 20339 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:12:29.082927 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 232230us
I20260709 12:12:29.166147 14407 raft_consensus.cc:2393] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 18: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:12:29.167243 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:29.276332 13755 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 25.
I20260709 12:12:29.165719 20408 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:29.167320 20345 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:29.231971 20190 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:12:29.283743 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 199467us
I20260709 12:12:29.235846 20292 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:29.236766 20291 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:29.261586 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:29.290355 13683 raft_consensus.cc:3060] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:29.170472 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:29.231993 20425 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:29.291019 14379 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:29.103794 13831 raft_consensus.cc:1240] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 14. Current term is 15. Ops: [14.14-14.14]
I20260709 12:12:29.263434 20280 raft_consensus.cc:2804] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:29.263962 20233 raft_consensus.cc:2749] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:29.253033 19992 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:29.282744 13687 raft_consensus.cc:2468] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 17.
I20260709 12:12:29.284950 13727 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:29.269579 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:12:29.287885 13651 leader_election.cc:336] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Timed out: RequestConsensusVote RPC to 127.12.56.194:39545 timed out after 1.570s (SENT)
I20260709 12:12:29.322885 13651 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:29.293481 13762 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 17.
I20260709 12:12:29.294044 13801 leader_election.cc:400] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 14. Current term is 15.
I20260709 12:12:29.324092 13801 leader_election.cc:403] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:29.169325 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:29.170037 13682 raft_consensus.cc:740] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:29.170048 13800 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:29.170482 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:29.303364 14379 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:29.326684 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:29.327339 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:29.328013 13831 raft_consensus.cc:3060] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:12:29.329969 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:29.330587 13832 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:29.331437 13801 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:29.313064 13683 raft_consensus.cc:2468] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 15.
I20260709 12:12:29.257511 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:29.311652 13757 raft_consensus.cc:1240] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:29.283373 20288 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:12:29.341276 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:29.341921 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:29.342046 13762 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 18.
I20260709 12:12:29.340453 14379 leader_election.cc:400] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 pre-election: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for earlier term 18. Current term is 19.
I20260709 12:12:29.343367 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:29.343549 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:29.343988 13759 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:29.344328 13834 raft_consensus.cc:1275] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:12:29.343430 14379 leader_election.cc:403] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:12:29.345355 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 175376us
I20260709 12:12:29.342715 13758 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 17.
I20260709 12:12:29.356169 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:29.356606 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:29.356843 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:29.358968 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:29.360409 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:29.304563 20406 raft_consensus.cc:2749] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:12:29.362727 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:29.363296 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:29.367869 13836 raft_consensus.cc:1275] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:12:29.368491 13760 raft_consensus.cc:2393] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 18: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:29.353470 13727 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:29.364145 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:29.371029 13727 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
W20260709 12:12:29.378006 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:29.370496 13758 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 19.
I20260709 12:12:29.318917 20409 raft_consensus.cc:2804] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:29.305485 20280 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:29.389609 13761 raft_consensus.cc:2393] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 25: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:29.396615 13758 raft_consensus.cc:1275] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:12:29.286041 20112 consensus_queue.cc:1048] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.062s
I20260709 12:12:29.282495 20298 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:29.400091 13762 raft_consensus.cc:1275] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 12:12:29.387297 13682 consensus_queue.cc:260] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:29.415781 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:29.415870 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:29.416602 13758 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 19.
I20260709 12:12:29.416807 13762 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:29.417021 13832 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 18.
I20260709 12:12:29.310839 20337 consensus_queue.cc:1048] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 12:12:29.302635 20190 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:29.389902 20409 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:29.342582 20292 raft_consensus.cc:2749] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:29.418810 13800 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:29.362226 20392 raft_consensus.cc:2749] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:29.406399 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:29.455507 13836 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:29.407648 20417 raft_consensus.cc:2804] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:29.410149 20233 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:29.385623 20368 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:29.411304 20406 raft_consensus.cc:2749] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 12:12:29.413398 14412 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41700 (request call id 960) took 2433 ms (client timeout 2066 ms). Trace:
I20260709 12:12:29.362107 20422 raft_consensus.cc:2804] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:29.417666 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:12:29.456405 13652 connection.cc:256] RPC call timeout handler was delayed by -1.0332230789999812s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18730000000000002s for a response
W20260709 12:12:29.469511 14412 rpcz_store.cc:269] 0709 12:12:26.980151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:26.980326 (+   175us) service_pool.cc:224] Handling call
0709 12:12:28.204385 (+1224059us) spinlock_profiling.cc:243] Waited 36.3 ms on lock 0x7b54005a7420. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f0b06f 00007fa927f83f60 00007fa927f857de 00007fa927f9127c 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2
0709 12:12:29.413146 (+1208761us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b54005a6c54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:29.413302 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":478849536}
W20260709 12:12:29.418515 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 130671us
I20260709 12:12:29.369067 20288 raft_consensus.cc:697] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 25 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:29.406257 20253 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:29.418136 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:29.486876 13832 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:29.348636 20390 raft_consensus.cc:2749] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:29.362280 20339 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:12:29.362305 20352 raft_consensus.cc:2749] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:29.422971 13682 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:29.414464 20280 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:29.426570 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:29.427760 20190 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:29.428251 20409 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:29.436426 13762 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 19.
I20260709 12:12:29.522567 13762 raft_consensus.cc:1240] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 14. Current term is 15. Ops: [14.14-14.14]
I20260709 12:12:29.437808 13833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 3051) took 1065 ms. Trace:
I20260709 12:12:29.525950 13833 rpcz_store.cc:276] 0709 12:12:28.372118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:28.372271 (+   153us) service_pool.cc:224] Handling call
0709 12:12:28.426358 (+ 54087us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:29.270868 (+844510us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:29.437481 (+166613us) spinlock_profiling.cc:243] Waited 844 ms on lock 0x7b54000b40d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:29.437707 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1940514688}
I20260709 12:12:29.527875 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:29.528738 13833 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:29.439452 13830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 3047) took 1110 ms. Trace:
I20260709 12:12:29.438484 13578 catalog_manager.cc:5697] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 11 to 17, leader changed from ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 17 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:12:29.459725 13800 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
W20260709 12:12:29.536068 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 76456.9us
I20260709 12:12:29.537129 13800 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:29.461097 13829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 3041) took 1148 ms. Trace:
I20260709 12:12:29.410426 13727 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
W20260709 12:12:29.538513 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 128204us
I20260709 12:12:29.453379 13831 raft_consensus.cc:2468] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 15.
I20260709 12:12:29.464838 14408 raft_consensus.cc:2368] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 18. Current term is 19.
I20260709 12:12:29.464212 20233 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:29.463390 20417 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:29.465345 20420 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 12:12:29.468672 20385 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.017s	sys 0.011s
I20260709 12:12:29.468096 13681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 1169) took 1742 ms. Trace:
W20260709 12:12:29.474522 13651 leader_election.cc:336] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Timed out: RequestConsensusVote RPC to 127.12.56.194:39545 timed out after 1.591s (SENT)
I20260709 12:12:29.494495 13759 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 20.
I20260709 12:12:29.386579 20251 consensus_queue.cc:1048] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.077s
I20260709 12:12:29.537976 13829 rpcz_store.cc:276] 0709 12:12:28.312259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:28.312376 (+   117us) service_pool.cc:224] Handling call
0709 12:12:28.312644 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:28.313061 (+   417us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:12:28.527311 (+214250us) log.cc:844] Serialized 14 byte log entry
0709 12:12:28.679675 (+152364us) log.cc:844] Serialized 14 byte log entry
0709 12:12:29.094883 (+415208us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b18004722a0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924ea0522 00007fa924ea27c1 00007fa924ea2779 00007fa924ea2709 00007fa924ea26d1 00007fa924ea19cd 0000000000388634 0000000000388479 00007fa924e8383a
0709 12:12:29.412667 (+317784us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b18004722a0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924ea0522 00007fa924ea27c1 00007fa924ea2779 00007fa924ea2709 00007fa924ea26d1 00007fa924ea19cd 0000000000388634 0000000000388479 00007fa924e8383a
0709 12:12:29.432133 (+ 19466us) spinlock_profiling.cc:243] Waited 1.27 ms on lock 0x7b18004722a0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa927b354bc 00007fa924e8348b 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9d455 00007fa927f85060 00007fa927f97716 00007fa927fa8287
0709 12:12:29.432536 (+   403us) log.cc:844] Serialized 14 byte log entry
0709 12:12:29.460593 (+ 28057us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:29.460672 (+    79us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:29.460743 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:29.460839 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:29.461015 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46481,"prepare.queue_time_us":377683,"prepare.run_cpu_time_us":151,"prepare.run_wall_time_us":2304,"raft.queue_time_us":268120,"raft.run_cpu_time_us":508,"raft.run_wall_time_us":41503,"spinlock_wait_cycles":71941504,"thread_start_us":429095,"threads_started":3,"wal-append.queue_time_us":286857}
I20260709 12:12:29.490546 20422 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:29.556833 13760 raft_consensus.cc:1240] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:29.513682 13836 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 22.
I20260709 12:12:29.496040 13652 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:12:29.563617 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 67723.7us
I20260709 12:12:29.545933 13800 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:29.529736 13830 rpcz_store.cc:276] 0709 12:12:28.328893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:28.329084 (+   191us) service_pool.cc:224] Handling call
0709 12:12:28.329447 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:28.495282 (+165835us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:12:28.620382 (+125100us) log.cc:844] Serialized 14 byte log entry
0709 12:12:29.252243 (+631861us) spinlock_profiling.cc:243] Waited 3.31 ms on lock 0x7b48001bd758. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92ceb6aa1 00007fa92ceadb37 00007fa92cead9ca 00007fa92cfa526f 00007fa92cfa4f37 00007fa92cfb955c 00007fa92cfb9508 00007fa92cfb9488 00007fa92cfb9443 00007fa92cfb86ec 00007fa92bee2a96
0709 12:12:29.277581 (+ 25338us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:29.277664 (+    83us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:29.277735 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:29.439181 (+161446us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b54000b2cd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:29.439242 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:29.439388 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":166637,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":85335,"raft.run_cpu_time_us":2565,"raft.run_wall_time_us":334891,"spinlock_wait_cycles":388251904,"thread_start_us":755875,"threads_started":3,"wal-append.queue_time_us":442033}
I20260709 12:12:29.467098 20425 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:29.550619 13651 leader_election.cc:304] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:29.552620 13832 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 19.
I20260709 12:12:29.550451 13681 rpcz_store.cc:276] 0709 12:12:27.725872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:27.925151 (+199279us) service_pool.cc:224] Handling call
0709 12:12:27.949024 (+ 23873us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:27.955612 (+  6588us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:12:27.986542 (+ 30930us) log.cc:844] Serialized 14 byte log entry
0709 12:12:29.106186 (+1119644us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b18002f43a0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e82e07 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9fc02 00007fa927b2720b 00007fa927b2cd23 00007fa927b2d23a 00007fa927f97a2a
0709 12:12:29.348272 (+242086us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:29.385935 (+ 37663us) log.cc:844] Serialized 26 byte log entry
0709 12:12:29.386112 (+   177us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:29.386146 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:29.386221 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:29.467748 (+ 81527us) raft_consensus.cc:1685] finished
0709 12:12:29.467875 (+   127us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:29.468037 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13882,"prepare.queue_time_us":27433,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":61,"raft.queue_time_us":36028,"raft.run_cpu_time_us":278,"raft.run_wall_time_us":26744,"spinlock_wait_cycles":31095040,"thread_start_us":233937,"threads_started":1,"wal-append.queue_time_us":1466854}
I20260709 12:12:29.495157 19992 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:29.567610 13800 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:29.582796 13800 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:29.470070 20368 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:29.554793 20385 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.019s	sys 0.013s
I20260709 12:12:29.589705 13833 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 18.
I20260709 12:12:29.544157 20345 raft_consensus.cc:2749] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 14. Current term is 15.
I20260709 12:12:29.550230 20253 raft_consensus.cc:2804] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:29.554495 20392 raft_consensus.cc:2804] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:29.550046 20420 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:29.555562 20422 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:29.592500 13754 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48114 (request call id 3140) took 1450 ms (client timeout 1523 ms). Trace:
I20260709 12:12:29.604516 13756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:39554 (request call id 85) took 1210 ms. Trace:
I20260709 12:12:29.612329 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:28.870383 13686 rpcz_store.cc:276] 0709 12:12:27.466943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:27.467072 (+   129us) service_pool.cc:224] Handling call
0709 12:12:27.488332 (+ 21260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:27.488562 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:12:27.549198 (+ 60636us) log.cc:844] Serialized 14 byte log entry
0709 12:12:28.419541 (+870343us) spinlock_profiling.cc:243] Waited 9.13 ms on lock 0x7b18002f4220. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924ea0522 00007fa924ea27c1 00007fa924ea2779 00007fa924ea2709 00007fa924ea26d1 00007fa924ea19cd 0000000000388634 0000000000388479 00007fa924e8383a
0709 12:12:28.854621 (+435080us) spinlock_profiling.cc:243] Waited 4.21 ms on lock 0x7b18002f4220. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa927b354bc 00007fa924e8348b 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9d455 00007fa927f85060 00007fa927f97716 00007fa927fa8287
0709 12:12:28.863447 (+  8826us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:28.863519 (+    72us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:28.863568 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:28.863639 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:28.863774 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13712,"prepare.queue_time_us":60491,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":102848,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":6129,"spinlock_wait_cycles":30685824,"thread_start_us":204687,"threads_started":2,"wal-append.queue_time_us":240064,"wal-append.run_cpu_time_us":1574,"wal-append.run_wall_time_us":1070385}
I20260709 12:12:29.571269 20239 raft_consensus.cc:2764] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 12:12:29.554726 20383 consensus_queue.cc:1059] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 17.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:12:29.605894 13757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 2334) took 1222 ms. Trace:
I20260709 12:12:29.622999 13757 rpcz_store.cc:276] 0709 12:12:28.383920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:28.552043 (+168123us) service_pool.cc:224] Handling call
0709 12:12:28.552431 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:29.333305 (+780874us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:29.605464 (+272159us) spinlock_profiling.cc:243] Waited 759 ms on lock 0x7b54002b0cd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:29.605795 (+   331us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1745228032}
I20260709 12:12:29.568602 20352 raft_consensus.cc:2804] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:29.612238 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:29.613010 13756 rpcz_store.cc:276] 0709 12:12:28.385220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:28.507663 (+122443us) service_pool.cc:224] Handling call
0709 12:12:29.595082 (+1087419us) spinlock_profiling.cc:243] Waited 429 ms on lock 0x7b54000893d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f87853 00007fa92cf5560a 00007fa9264db7d4 00007fa9264db762 00007fa9264db691 00007fa9264db60c 00007fa9264da8c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:29.595173 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":987723136}
I20260709 12:12:29.551467 20417 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:29.555544 20433 consensus_queue.cc:1059] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 12:12:29.554067 20291 consensus_queue.cc:1048] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:12:29.616760 13763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 2337) took 1232 ms. Trace:
I20260709 12:12:29.618410 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:29.618749 13832 raft_consensus.cc:1240] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:29.617460 13727 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:29.619354 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:12:29.612932 13754 rpcz_store.cc:269] 0709 12:12:28.137841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:28.157718 (+ 19877us) service_pool.cc:224] Handling call
0709 12:12:29.584973 (+1427255us) spinlock_profiling.cc:243] Waited 872 ms on lock 0x7b54003336d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:29.587997 (+  3024us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2005162240}
I20260709 12:12:29.633845 13836 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 18.
I20260709 12:12:29.634294 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:29.625113 13834 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 19.
I20260709 12:12:29.632092 13763 rpcz_store.cc:276] 0709 12:12:28.384856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:28.555964 (+171108us) service_pool.cc:224] Handling call
0709 12:12:28.556468 (+   504us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:28.618971 (+ 62503us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:28.619003 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:28.619575 (+   572us) log.cc:844] Serialized 52 byte log entry
0709 12:12:28.918552 (+298977us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:28.918601 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:29.159526 (+240925us) spinlock_profiling.cc:243] Waited 7.41 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:12:29.616439 (+456913us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b5400393ad4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:29.616497 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:29.616553 (+    56us) raft_consensus.cc:1685] finished
0709 12:12:29.616565 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:29.616705 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5159,"raft.queue_time_us":137,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":42217,"spinlock_wait_cycles":51168896,"thread_start_us":244570,"threads_started":1,"wal-append.queue_time_us":305125}
W20260709 12:12:29.636045 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 288639us
I20260709 12:12:29.600801 20427 raft_consensus.cc:2749] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:29.597084 20392 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:29.570489 20190 consensus_queue.cc:1048] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 12:12:29.610225 20420 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:29.593961 19992 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:29.630146 20389 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:29.680424 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 63069.8us
I20260709 12:12:29.681353 14379 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:29.699260 13727 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:29.673175 20392 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:29.621160 20304 consensus_queue.cc:1059] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 12:12:29.626634 20390 consensus_queue.cc:1048] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.057s
I20260709 12:12:29.705026 14379 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:29.589955 20288 consensus_queue.cc:237] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:29.705808 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:29.696295 20381 raft_consensus.cc:3055] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:29.679579 20340 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:29.707141 13727 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:29.669649 20253 raft_consensus.cc:697] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:12:29.715781 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 126115us
I20260709 12:12:29.696631 20322 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:29.721680 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:12:29.707311 20333 consensus_meta.cc:287] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.590s	user 0.014s	sys 0.000s
I20260709 12:12:29.678259 20112 consensus_queue.cc:1048] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 12:12:29.707804 20421 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:29.732966 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:29.734277 14407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41692 (request call id 1021) took 1007 ms. Trace:
I20260709 12:12:29.729466 13756 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 18.
I20260709 12:12:29.705855 20354 consensus_queue.cc:1048] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.222s
W20260709 12:12:29.737756 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:29.707949 20407 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:29.741492 13727 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:29.722415 20298 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:29.732196 13800 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:29.708591 19886 raft_consensus.cc:3055] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:29.708005 20435 raft_consensus.cc:2804] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:29.718937 20436 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:29.740379 14407 rpcz_store.cc:276] 0709 12:12:28.726957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:28.744782 (+ 17825us) service_pool.cc:224] Handling call
0709 12:12:29.734074 (+989292us) spinlock_profiling.cc:243] Waited 410 ms on lock 0x7b54007102d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:29.734217 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":942784768}
I20260709 12:12:29.759706 13727 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:29.743862 13756 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:12:29.737329 20425 raft_consensus.cc:2804] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:29.721629 20381 raft_consensus.cc:740] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:29.744975 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:29.770080 13756 raft_consensus.cc:606] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:29.775779 13756 raft_consensus.cc:614] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:29.768409 13800 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:29.775770 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:29.707733 20418 consensus_queue.cc:1048] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.161s
I20260709 12:12:29.782094 14380 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:29.708189 20366 consensus_queue.cc:1048] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.241s
I20260709 12:12:29.760682 20251 raft_consensus.cc:2804] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:29.742027 20352 raft_consensus.cc:697] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 21 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:29.765919 20443 raft_consensus.cc:2804] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:29.776252 20406 raft_consensus.cc:2804] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:12:29.802536 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:29.779966 20304 raft_consensus.cc:2804] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:29.779284 20435 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:29.774889 19886 raft_consensus.cc:740] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:29.809893 13756 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e5274c30729744338992e7c7710e5266"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:12:29.810562 13756 raft_consensus.cc:606] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 LEADER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:29.801915 14380 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:29.788264 20436 raft_consensus.cc:2804] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:12:29.813375 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 43838.5us
I20260709 12:12:29.734948 20333 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:29.789825 20442 consensus_queue.cc:1059] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.024s
I20260709 12:12:29.824893 13682 raft_consensus.cc:1275] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:12:29.825729 13682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 3220) took 1006 ms. Trace:
I20260709 12:12:29.826123 13682 rpcz_store.cc:276] 0709 12:12:28.819090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:29.056011 (+236921us) service_pool.cc:224] Handling call
0709 12:12:29.083552 (+ 27541us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:29.825446 (+741894us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:29.825665 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:29.790740 20425 raft_consensus.cc:697] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:29.792733 20354 raft_consensus.cc:2749] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:29.812199 20435 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:29.827378 20342 consensus_meta.cc:287] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.577s	user 0.012s	sys 0.002s
I20260709 12:12:29.800360 20448 consensus_queue.cc:1048] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 12:12:29.834384 20342 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:29.789635 13578 catalog_manager.cc:5697] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: config changed from index -1 to 10, term changed from 11 to 18, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to <none>, VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New cstate: current_term: 18 committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:12:29.793670 20233 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:29.812237 20253 consensus_queue.cc:237] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:29.806335 20262 raft_consensus.cc:2749] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:29.843395 13828 raft_consensus.cc:2393] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 18: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:29.814086 20239 raft_consensus.cc:2804] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:29.809648 20304 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:29.813208 20251 raft_consensus.cc:697] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 17 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
W20260709 12:12:29.847095 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 372593us
W20260709 12:12:29.863554 13651 leader_election.cc:336] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Timed out: RequestConsensusVote RPC to 127.12.56.194:39545 timed out after 1.635s (SENT)
I20260709 12:12:29.863912 13651 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:12:29.851558 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 44533.6us
I20260709 12:12:29.852249 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:29.838109 20406 raft_consensus.cc:697] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:29.839959 20443 raft_consensus.cc:697] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 15 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
W20260709 12:12:29.852792 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 147857us
I20260709 12:12:29.855296 13801 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:29.775892 20407 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:29.845163 20342 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:29.829692 20381 consensus_queue.cc:260] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 17.7, Last appended by leader: 7, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:29.815438 20427 consensus_queue.cc:1059] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 12:12:29.841970 20436 raft_consensus.cc:697] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:29.858103 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:29.878715 13832 raft_consensus.cc:2468] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 13.
I20260709 12:12:29.858618 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:12:29.861470 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 108332us
I20260709 12:12:29.862074 14413 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226"
dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:46814
I20260709 12:12:29.883952 14413 raft_consensus.cc:606] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 13 LEADER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:29.885144 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:29.874179 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:29.886973 13756 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:29.856048 20368 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:29.858000 20438 log.cc:927] Time spent T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
I20260709 12:12:29.875846 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:29.818015 20190 consensus_queue.cc:1059] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 12:12:29.860036 20292 raft_consensus.cc:2804] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:12:29.896543 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:29.918709 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:29.919128 13830 raft_consensus.cc:1275] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:12:29.897504 13762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 1018) took 1037 ms. Trace:
I20260709 12:12:29.864521 20304 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:29.902810 13682 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:29.926015 14379 leader_election.cc:304] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:29.904295 13652 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:29.920774 13762 rpcz_store.cc:276] 0709 12:12:28.860026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:29.525025 (+664999us) service_pool.cc:224] Handling call
0709 12:12:29.525399 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:29.533329 (+  7930us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:29.533379 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:29.534023 (+   644us) log.cc:844] Serialized 26 byte log entry
0709 12:12:29.759431 (+225408us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:29.759478 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:29.759813 (+   335us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:29.897254 (+137441us) raft_consensus.cc:1685] finished
0709 12:12:29.897278 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:29.897440 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":115,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":107,"thread_start_us":197318,"threads_started":1,"wal-append.queue_time_us":254876}
I20260709 12:12:29.866832 20352 consensus_queue.cc:237] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:29.865409 13800 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:29.944314 13756 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 19.
I20260709 12:12:29.948125 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:29.953786 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:29.955163 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:29.950654 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:29.958438 14407 raft_consensus.cc:1240] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:29.959022 13683 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 22.
W20260709 12:12:29.959937 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 94634.1us
I20260709 12:12:29.960067 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:29.961670 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:29.962903 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:29.962348 13683 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 14.
I20260709 12:12:29.964991 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:29.963857 13762 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:29.965663 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:29.966799 13683 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 21.
I20260709 12:12:29.967979 13683 raft_consensus.cc:1240] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 16. Current term is 17. Ops: []
W20260709 12:12:29.951896 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 47716.1us
I20260709 12:12:29.968555 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:12:29.952253 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 97024.9us
I20260709 12:12:29.971415 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:29.878124 20451 raft_consensus.cc:2749] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:12:29.973955 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:29.974555 13801 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:29.978583 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:29.867149 19886 consensus_queue.cc:260] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:30.056180 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 99883.9us
I20260709 12:12:30.060858 13651 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:29.978171 20233 raft_consensus.cc:2804] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:29.958441 20190 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:12:29.971218 20416 log.cc:927] Time spent T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:12:30.009256 13682 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 19.
I20260709 12:12:30.069139 13762 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 18.
W20260709 12:12:30.032033 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 60798.5us
W20260709 12:12:30.079268 20440 log.cc:927] Time spent T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.457s	user 0.003s	sys 0.000s
W20260709 12:12:30.080874 20441 log.cc:927] Time spent T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.405s	user 0.000s	sys 0.000s
I20260709 12:12:30.082226 20253 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:29.957238 20251 consensus_queue.cc:237] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:29.978931 20292 raft_consensus.cc:697] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 18 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:29.994215 20448 raft_consensus.cc:2749] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:30.035288 19886 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:30.108785 14379 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
W20260709 12:12:30.135481 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 74732.9us
I20260709 12:12:30.024922 20465 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:30.143661 20333 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:30.144853 20407 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:29.998479 20409 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:30.146109 20450 raft_consensus.cc:2749] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:30.020330 20406 consensus_queue.cc:237] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:30.149837 20392 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:30.018237 20366 consensus_queue.cc:1048] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.124s
I20260709 12:12:30.037990 20442 consensus_queue.cc:1048] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.099s
W20260709 12:12:30.152631 20339 consensus_meta.cc:287] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.632s	user 0.007s	sys 0.001s
W20260709 12:12:30.155016 20460 log.cc:927] Time spent T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:12:30.159476 20435 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:30.160102 20280 consensus_meta.cc:287] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.615s	user 0.009s	sys 0.000s
I20260709 12:12:30.141438 20342 raft_consensus.cc:2749] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:30.045919 20443 consensus_queue.cc:237] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:30.161937 20292 consensus_queue.cc:237] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:30.036625 20436 consensus_queue.cc:237] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:30.085004 20449 raft_consensus.cc:2749] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:30.168205 19992 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:29.950519 20425 consensus_queue.cc:237] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:30.089041 20233 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
W20260709 12:12:30.176748 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:30.178619 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 204130us
I20260709 12:12:30.142035 20427 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.190554 13651 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:30.091748 20190 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:30.206401 14411 raft_consensus.cc:2393] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 18: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:12:30.137317 20112 consensus_queue.cc:1059] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.056s
I20260709 12:12:30.134984 20262 consensus_queue.cc:1048] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.052s
W20260709 12:12:30.229523 20422 consensus_meta.cc:287] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.602s	user 0.008s	sys 0.003s
I20260709 12:12:30.191818 20459 raft_consensus.cc:2804] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:30.140378 20253 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:30.217689 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 226267us
I20260709 12:12:30.227659 13727 leader_election.cc:400] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 election: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 18. Current term is 19.
I20260709 12:12:30.252867 13727 leader_election.cc:403] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 12:12:30.223268 13837 raft_consensus.cc:1240] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:30.195003 20445 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.208220 20339 raft_consensus.cc:2749] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for earlier term 18. Current term is 19.
W20260709 12:12:30.239240 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 48811.5us
I20260709 12:12:30.252594 20459 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:30.265904 20459 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:30.267071 13651 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:30.267935 20448 consensus_queue.cc:1059] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:30.268793 20448 consensus_queue.cc:1243] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer 3f37c9cc9dda46b4be21dd675ba78fb7 log is divergent from this leader: its last log entry 17.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:12:30.269426 20448 raft_consensus.cc:2804] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:30.274703 20448 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:30.274958 20392 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:30.275333 20448 raft_consensus.cc:3060] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:30.206434 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 240755us
I20260709 12:12:30.214228 20252 raft_consensus.cc:2804] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:30.282204 20252 raft_consensus.cc:697] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 20 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:30.282781 20342 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:30.283241 20252 consensus_queue.cc:237] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:30.179476 20465 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:30.285578 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:30.285823 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:30.286473 13756 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:12:30.287767 20465 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:30.288241 13652 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:30.227423 20322 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.263564 20456 consensus_queue.cc:1059] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:30.264158 20253 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:30.264591 20445 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:30.265055 20262 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:30.270051 20451 raft_consensus.cc:3055] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:30.271386 13651 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:30.271505 20190 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:30.274076 20464 raft_consensus.cc:3055] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:30.283402 20342 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:30.237109 20233 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:30.250321 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:30.253587 13835 raft_consensus.cc:1275] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:12:30.290844 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:30.293069 14409 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 19.
I20260709 12:12:30.236032 14380 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:30.297938 13756 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 26.
I20260709 12:12:30.211269 20280 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:30.307214 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 198559us
W20260709 12:12:30.340200 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 79725.7us
W20260709 12:12:30.374984 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:30.257145 19992 raft_consensus.cc:2804] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 12:12:30.362619 20398 log.cc:927] Time spent T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:12:30.380595 20280 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:30.381800 14408 raft_consensus.cc:1240] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:30.381922 14379 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:30.384827 20112 raft_consensus.cc:2804] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:30.308112 20366 raft_consensus.cc:2804] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:30.371587 13757 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:30.307168 20389 raft_consensus.cc:2749] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 18. Current term is 19.
I20260709 12:12:30.377661 13834 raft_consensus.cc:1240] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 14. Current term is 15. Ops: []
W20260709 12:12:30.378233 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 142269us
I20260709 12:12:30.378791 20288 raft_consensus.cc:2804] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:30.400727 20288 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:30.401211 20288 raft_consensus.cc:3060] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:30.378932 20281 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.402093 20281 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:30.402922 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:30.260757 20422 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:30.405118 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:30.359664 20451 raft_consensus.cc:740] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:30.425626 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:30.241540 20427 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:30.431814 13758 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.017s	sys 0.042s
I20260709 12:12:30.362747 20464 raft_consensus.cc:740] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:30.323374 20322 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:30.433748 20421 consensus_meta.cc:287] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.668s	user 0.011s	sys 0.000s
I20260709 12:12:30.385555 20112 raft_consensus.cc:697] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 19 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
W20260709 12:12:30.442415 13758 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.018s	sys 0.042s
I20260709 12:12:30.406080 20366 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:30.451735 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:30.429165 13757 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 17.
W20260709 12:12:30.479539 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 198801us
I20260709 12:12:30.306348 20239 raft_consensus.cc:697] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 19 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:30.472802 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:12:30.480602 13800 leader_election.cc:336] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.741s (SENT)
I20260709 12:12:30.480705 13835 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:30.481041 13800 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:30.365140 20262 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:30.484138 13755 raft_consensus.cc:2393] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 18: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:30.484825 13800 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
W20260709 12:12:30.458745 20463 log.cc:927] Time spent T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.242s	user 0.001s	sys 0.001s
I20260709 12:12:30.375340 20190 consensus_queue.cc:1059] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.074s
I20260709 12:12:30.502382 13800 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:30.539849 13800 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:30.483906 20366 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:30.483345 20421 raft_consensus.cc:2749] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:30.541431 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 230756us
I20260709 12:12:30.604339 13652 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:30.549124 20392 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader election won for term 26
W20260709 12:12:30.547246 20420 consensus_meta.cc:287] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.844s	user 0.015s	sys 0.001s
W20260709 12:12:30.582233 20472 log.cc:927] Time spent T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
W20260709 12:12:30.584086 20476 log.cc:927] Time spent T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 12:12:30.590644 20239 consensus_queue.cc:237] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:30.450522 20450 raft_consensus.cc:2749] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:30.504667 20469 raft_consensus.cc:2749] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:12:30.595916 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 56479.4us
I20260709 12:12:30.549196 14410 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 18.
I20260709 12:12:30.624507 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:30.538911 20467 raft_consensus.cc:2804] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:30.604592 20340 raft_consensus.cc:2804] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:30.545627 20451 consensus_queue.cc:260] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:30.602133 20281 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:30.552716 20459 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:30.657931 20420 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:30.605337 20435 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:12:30.705747 20417 consensus_meta.cc:287] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 1.034s	user 0.007s	sys 0.008s
I20260709 12:12:30.611023 20112 consensus_queue.cc:237] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:30.567688 20333 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:30.681762 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 410418us
W20260709 12:12:30.603758 20447 log.cc:927] Time spent T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:12:30.698696 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:30.772819 14407 raft_consensus.cc:2393] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 14: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:30.612556 20409 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:30.702420 20304 consensus_meta.cc:287] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.744s	user 0.012s	sys 0.001s
W20260709 12:12:30.727448 13800 leader_election.cc:336] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 2.049s (SENT)
I20260709 12:12:30.783599 13800 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:12:30.785912 20481 log.cc:927] Time spent T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:12:30.786617 20420 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:12:30.788004 20474 log.cc:927] Time spent T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
W20260709 12:12:30.789695 20478 log.cc:927] Time spent T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
I20260709 12:12:30.553479 20252 consensus_queue.cc:1048] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.102s
I20260709 12:12:30.697126 20392 raft_consensus.cc:697] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 26 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:30.782687 13836 raft_consensus.cc:1240] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:30.825385 13836 raft_consensus.cc:1275] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:12:30.784484 20333 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:30.829546 20333 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:12:30.792323 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 64912.1us
I20260709 12:12:30.792925 20449 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:30.830591 13800 leader_election.cc:336] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 2.058s (SENT)
I20260709 12:12:30.743513 20340 raft_consensus.cc:697] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 17 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:30.569713 20464 consensus_queue.cc:260] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:30.794269 20490 consensus_queue.cc:1059] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.029s
I20260709 12:12:30.798736 20451 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:30.804751 20459 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:30.775528 20450 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:12:30.809499 20470 log.cc:927] Time spent T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.256s	user 0.000s	sys 0.001s
I20260709 12:12:30.810520 20262 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:30.854827 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:30.812340 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:30.856309 13832 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 15.
I20260709 12:12:30.857503 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:30.814697 19992 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:30.790313 20304 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:30.826763 20392 consensus_queue.cc:237] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:30.734983 20467 raft_consensus.cc:697] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 18 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:30.833516 20445 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:30.739408 13835 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 14.
I20260709 12:12:30.854718 20464 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:30.875129 13831 raft_consensus.cc:1240] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:30.838778 20342 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:30.771377 20417 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:30.863171 19992 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:12:30.882606 19886 consensus_meta.cc:287] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.706s	user 0.011s	sys 0.002s
I20260709 12:12:30.883569 20417 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:30.884559 20304 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:30.895344 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:30.867950 20322 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:30.944914 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:30.946043 13682 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 13.
I20260709 12:12:30.885710 20450 raft_consensus.cc:3055] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:30.948352 13833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 1207) took 1172 ms. Trace:
I20260709 12:12:30.948973 13833 rpcz_store.cc:276] 0709 12:12:29.776153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:29.776736 (+   583us) service_pool.cc:224] Handling call
0709 12:12:29.789605 (+ 12869us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:29.808645 (+ 19040us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:29.808690 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:29.847312 (+ 38622us) log.cc:844] Serialized 26 byte log entry
0709 12:12:30.205980 (+358668us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:30.206045 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:30.206123 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:30.948054 (+741931us) raft_consensus.cc:1685] finished
0709 12:12:30.948084 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:30.948278 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10279,"raft.queue_time_us":16074,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":5708,"thread_start_us":338508,"threads_started":1,"wal-append.queue_time_us":585236}
I20260709 12:12:30.897030 20304 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:30.952421 20408 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:30.879025 20456 consensus_queue.cc:1048] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 12:12:30.903185 20427 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:30.961709 13835 raft_consensus.cc:1275] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
W20260709 12:12:30.968905 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 196812us
I20260709 12:12:30.951157 20450 raft_consensus.cc:740] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:30.962045 13833 raft_consensus.cc:1240] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:30.977329 13651 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:30.986230 13651 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:30.988951 14415 raft_consensus.cc:1240] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 17 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 16. Current term is 17. Ops: []
W20260709 12:12:30.990502 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:30.990976 13651 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:30.955374 20366 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:30.988879 20490 consensus_queue.cc:1048] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 12:12:31.098392 20490 raft_consensus.cc:2749] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:31.103135 20366 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:31.102794 19992 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:31.102815 13578 catalog_manager.cc:5697] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 10 to 16, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 16 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:12:31.104591 20497 log.cc:927] Time spent T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.140s	user 0.005s	sys 0.006s
I20260709 12:12:30.951273 20340 consensus_queue.cc:237] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:30.986627 20352 raft_consensus.cc:2804] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:30.991827 20338 raft_consensus.cc:3055] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 18 LEADER]: Stepping down as leader of term 18
W20260709 12:12:31.093456 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 102779us
I20260709 12:12:30.978638 20467 consensus_queue.cc:237] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:31.105741 19992 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:30.964968 20304 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:31.118294 20452 raft_consensus.cc:3055] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:31.117969 19992 consensus_queue.cc:1048] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:31.118793 20452 raft_consensus.cc:740] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:31.119801 20304 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:31.119953 20452 consensus_queue.cc:260] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:30.967931 20408 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:31.121331 13651 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:31.123829 20456 raft_consensus.cc:2749] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:12:31.124887 14409 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41700 (request call id 980) took 1768 ms (client timeout 1890 ms). Trace:
I20260709 12:12:31.110206 20338 raft_consensus.cc:740] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
W20260709 12:12:31.112337 20498 log.cc:927] Time spent T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.136s	user 0.006s	sys 0.004s
I20260709 12:12:31.126813 20338 consensus_queue.cc:260] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:31.128024 20338 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:31.128978 20456 consensus_queue.cc:1048] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:31.130240 20468 raft_consensus.cc:3055] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:31.130725 20468 raft_consensus.cc:740] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:30.992512 20492 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:31.131940 14380 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:31.131783 20468 consensus_queue.cc:260] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:31.132822 20456 consensus_queue.cc:1048] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:31.130774 13681 raft_consensus.cc:3055] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:31.134202 13681 raft_consensus.cc:740] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:31.134369 20339 consensus_queue.cc:1059] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:31.115428 20366 consensus_queue.cc:1048] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 12:12:31.135411 20339 raft_consensus.cc:2804] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:31.131527 20492 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:31.136081 20339 raft_consensus.cc:697] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 14 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:31.136009 20450 consensus_queue.cc:260] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:31.125342 14409 rpcz_store.cc:269] 0709 12:12:29.356201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:29.356341 (+   140us) service_pool.cc:224] Handling call
0709 12:12:31.124691 (+1768350us) spinlock_profiling.cc:243] Waited 913 ms on lock 0x7b54005e1ad4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:31.124817 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2099048832}
I20260709 12:12:31.137969 20262 raft_consensus.cc:3055] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:31.138409 20262 raft_consensus.cc:740] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 21 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:31.095234 13835 raft_consensus.cc:1240] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 12:12:31.102635 13830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 3328) took 1261 ms. Trace:
I20260709 12:12:31.135322 13681 consensus_queue.cc:260] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:31.139488 13830 rpcz_store.cc:276] 0709 12:12:29.841013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:29.841644 (+   631us) service_pool.cc:224] Handling call
0709 12:12:29.842016 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:29.919554 (+ 77538us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:31.102358 (+1182804us) spinlock_profiling.cc:243] Waited 61.5 ms on lock 0x7b54000db454. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:31.102560 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":141431040}
I20260709 12:12:31.106913 13831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 1210) took 1252 ms. Trace:
I20260709 12:12:31.140343 13681 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:31.133270 20468 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:31.141166 13830 raft_consensus.cc:1240] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:12:31.140720 13831 rpcz_store.cc:276] 0709 12:12:29.854114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:29.855991 (+  1877us) service_pool.cc:224] Handling call
0709 12:12:29.856260 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:30.880306 (+1024046us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:31.106644 (+226338us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540020e254. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:31.106852 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2342691584}
I20260709 12:12:31.134706 20408 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:30.986758 20503 consensus_queue.cc:1048] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:12:31.093554 13758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 1014) took 2281 ms. Trace:
I20260709 12:12:31.143498 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:31.227988 14409 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:31.113663 20488 log.cc:927] Time spent T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.217s	user 0.005s	sys 0.005s
I20260709 12:12:31.137259 20339 consensus_queue.cc:237] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:31.170680 13828 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35422 (request call id 1204) took 1769 ms (client timeout 2058 ms). Trace:
I20260709 12:12:31.238528 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:31.174710 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:31.143452 13651 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:31.143590 13830 raft_consensus.cc:1240] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 12:12:31.105237 13578 catalog_manager.cc:5697] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:12:31.110327 20495 log.cc:927] Time spent T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.180s	user 0.008s	sys 0.003s
W20260709 12:12:31.314272 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 170856us
W20260709 12:12:31.115350 20288 consensus_meta.cc:287] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.714s	user 0.011s	sys 0.000s
I20260709 12:12:31.237835 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:31.315812 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:31.339519 13830 raft_consensus.cc:2393] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 20: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
W20260709 12:12:31.307682 13828 rpcz_store.cc:269] 0709 12:12:29.326631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:29.328745 (+  2114us) service_pool.cc:224] Handling call
0709 12:12:31.010920 (+1682175us) spinlock_profiling.cc:243] Waited 471 ms on lock 0x7b540020ce54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:31.095652 (+ 84732us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1084439936}
W20260709 12:12:31.125661 20233 consensus_meta.cc:287] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.722s	user 0.007s	sys 0.001s
W20260709 12:12:31.226616 20448 consensus_meta.cc:287] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.951s	user 0.015s	sys 0.003s
I20260709 12:12:31.322288 14380 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:31.322971 14409 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 20.
I20260709 12:12:31.271221 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:31.336894 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:31.337903 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:31.297482 13758 rpcz_store.cc:276] 0709 12:12:28.812691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:29.473391 (+660700us) service_pool.cc:224] Handling call
0709 12:12:29.473748 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:29.574524 (+100776us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:12:29.732702 (+158178us) spinlock_profiling.cc:243] Waited 3.91 ms on lock 0x7b18002e97e0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e82e07 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9d455 00007fa92b9853c7 00007fa927f979a7 00007fa927fa70bf 00007fa927fa7038
0709 12:12:29.812795 (+ 80093us) log.cc:844] Serialized 14 byte log entry
0709 12:12:30.486533 (+673738us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:30.505453 (+ 18920us) log.cc:844] Serialized 26 byte log entry
0709 12:12:30.505649 (+   196us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:30.505704 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:31.010920 (+505216us) spinlock_profiling.cc:243] Waited 84.1 ms on lock 0x7b54003ca354. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:31.093214 (+ 82294us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:31.093296 (+    82us) raft_consensus.cc:1685] finished
0709 12:12:31.093310 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:31.093482 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37214,"prepare.queue_time_us":301070,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":3593,"raft.queue_time_us":36717,"raft.run_cpu_time_us":357,"raft.run_wall_time_us":22978,"spinlock_wait_cycles":202366464,"thread_start_us":692594,"threads_started":2,"wal-append.queue_time_us":702286}
I20260709 12:12:31.270736 20427 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:31.347018 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:31.113795 20352 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:31.234023 20459 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.110873 20422 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:31.372960 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:31.319367 20190 raft_consensus.cc:2749] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:31.374011 13682 raft_consensus.cc:1275] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
W20260709 12:12:31.381939 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:31.271981 20426 consensus_queue.cc:1059] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.136s
I20260709 12:12:31.368247 20408 raft_consensus.cc:2749] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:31.387925 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:31.389549 13687 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:31.397095 13829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 3329) took 1555 ms. Trace:
W20260709 12:12:31.404204 13800 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.604s (SENT) [suppressed 37 similar messages]
W20260709 12:12:31.404956 13800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:31.377439 20352 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:31.283576 20262 consensus_queue.cc:260] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:31.414724 13652 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:31.397609 13829 rpcz_store.cc:276] 0709 12:12:29.841389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:29.841543 (+   154us) service_pool.cc:224] Handling call
0709 12:12:29.854692 (+ 13149us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:29.854920 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:12:29.869905 (+ 14985us) log.cc:844] Serialized 14 byte log entry
0709 12:12:29.876221 (+  6316us) log.cc:844] Serialized 14 byte log entry
0709 12:12:31.396457 (+1520236us) spinlock_profiling.cc:243] Waited 7.06 ms on lock 0x7b1800392620. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa927b354bc 00007fa924e8348b 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9d455 00007fa927f85060 00007fa927f97716 00007fa927fa8287
0709 12:12:31.396563 (+   106us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:31.396614 (+    51us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:31.396668 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:31.396743 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:31.396871 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26715,"prepare.queue_time_us":104763,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":97,"raft.queue_time_us":208101,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":5408,"spinlock_wait_cycles":16238464,"thread_start_us":47534,"threads_started":1}
I20260709 12:12:31.413458 14413 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:46814 (request call id 8) took 1558 ms. Trace:
I20260709 12:12:31.420221 14413 rpcz_store.cc:276] 0709 12:12:29.838769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:29.838939 (+   170us) service_pool.cc:224] Handling call
0709 12:12:31.396820 (+1557881us) spinlock_profiling.cc:243] Waited 66.7 ms on lock 0x7b54006dfc20. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f0a520 00007fa927f87652 00007fa92cf5560a 00007fa9264db7d4 00007fa9264db762 00007fa9264db691 00007fa9264db60c 00007fa9264da8c2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:31.397089 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":153498368}
I20260709 12:12:31.411942 20507 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.355419 20288 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:31.422392 20499 log.cc:927] Time spent T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.311s	user 0.000s	sys 0.006s
I20260709 12:12:31.350629 20233 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:31.359858 20448 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:31.421309 20507 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:31.446731 20291 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:31.460258 20291 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:31.460587 20507 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:31.462158 20288 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:31.462565 20291 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:31.463294 20262 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:31.466255 13727 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:31.467077 20253 consensus_queue.cc:1048] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:31.468532 20253 raft_consensus.cc:2804] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:31.468883 20253 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:31.469224 20253 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:31.469347 20233 leader_election.cc:290] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:12:31.424260 20500 log.cc:927] Time spent T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.421s	user 0.005s	sys 0.000s
I20260709 12:12:31.373890 20427 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:31.471728 13834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 3334) took 1094 ms. Trace:
I20260709 12:12:31.473902 20468 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:31.395964 20506 raft_consensus.cc:2804] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:31.474483 20468 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:31.475083 20506 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:31.475495 20506 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:31.378687 20459 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:31.476696 20468 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:31.416870 20457 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:31.427163 13828 raft_consensus.cc:1275] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:12:31.479548 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:31.480147 13828 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 17.
W20260709 12:12:31.427747 20504 log.cc:927] Time spent T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.245s	user 0.000s	sys 0.006s
W20260709 12:12:31.428088 20491 log.cc:927] Time spent T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.455s	user 0.007s	sys 0.000s
I20260709 12:12:31.428573 13756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 1030) took 1036 ms. Trace:
I20260709 12:12:31.487790 13756 rpcz_store.cc:276] 0709 12:12:30.391823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:30.392035 (+   212us) service_pool.cc:224] Handling call
0709 12:12:30.392443 (+   408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:30.392758 (+   315us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:12:30.392795 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:30.441522 (+ 48727us) log.cc:844] Serialized 26 byte log entry
0709 12:12:30.836191 (+394669us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:30.836246 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:30.836320 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:31.428261 (+591941us) raft_consensus.cc:1685] finished
0709 12:12:31.428280 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:31.428456 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":325860,"threads_started":1,"wal-append.queue_time_us":468616}
W20260709 12:12:31.428758 20508 log.cc:927] Time spent T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
I20260709 12:12:31.429180 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
W20260709 12:12:31.429721 20501 log.cc:927] Time spent T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.197s	user 0.000s	sys 0.001s
I20260709 12:12:31.430119 20492 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:31.428602 13679 raft_consensus.cc:1275] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:12:31.432740 13687 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 22.
I20260709 12:12:31.508172 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:12:31.433115 20464 consensus_meta.cc:287] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.546s	user 0.007s	sys 0.000s
W20260709 12:12:31.434144 14411 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41692 (request call id 1030) took 1582 ms (client timeout 2002 ms). Trace:
I20260709 12:12:31.435314 20396 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.440193 13762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 2360) took 1156 ms. Trace:
I20260709 12:12:31.536031 13762 rpcz_store.cc:276] 0709 12:12:30.283775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:30.284232 (+   457us) service_pool.cc:224] Handling call
0709 12:12:30.284602 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:30.284813 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:12:30.285152 (+   339us) log.cc:844] Serialized 14 byte log entry
0709 12:12:31.439605 (+1154453us) log.cc:844] Serialized 14 byte log entry
0709 12:12:31.439795 (+   190us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:31.439843 (+    48us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:31.439893 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:31.439986 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:31.440118 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":840291,"prepare.queue_time_us":18087,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":78,"raft.queue_time_us":844030,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":154,"thread_start_us":313488,"threads_started":1,"wal-append.queue_time_us":576648}
I20260709 12:12:31.442147 20514 consensus_queue.cc:1059] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:31.443408 20452 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:31.445036 20454 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:31.446094 13837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 3053) took 1829 ms. Trace:
I20260709 12:12:31.446841 20455 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.448755 20502 raft_consensus.cc:3055] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:31.449949 14412 raft_consensus.cc:1240] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:31.450153 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:31.451305 14414 raft_consensus.cc:1275] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 12:12:31.452868 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:31.453959 20406 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.403034 20304 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:31.568622 13687 raft_consensus.cc:1240] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 12:12:31.574800 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:31.576623 13688 raft_consensus.cc:1275] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:12:31.578215 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:31.579030 13688 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 17.
I20260709 12:12:31.580145 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:12:31.456326 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:31.456775 20385 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.427802 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:12:31.479815 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 52615.5us
I20260709 12:12:31.597468 20468 consensus_queue.cc:1059] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:31.598727 20468 raft_consensus.cc:3055] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:31.472152 13834 rpcz_store.cc:276] 0709 12:12:30.377049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:30.436630 (+ 59581us) service_pool.cc:224] Handling call
0709 12:12:30.436944 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:30.437478 (+   534us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:30.437517 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:30.477804 (+ 40287us) log.cc:844] Serialized 26 byte log entry
0709 12:12:30.848809 (+371005us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:30.848857 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:30.848936 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:31.394956 (+546020us) spinlock_profiling.cc:243] Waited 8.11 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:12:31.471355 (+ 76399us) raft_consensus.cc:1685] finished
0709 12:12:31.471385 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:31.471647 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":112,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":40329,"spinlock_wait_cycles":18647296,"thread_start_us":254978,"threads_started":1,"wal-append.queue_time_us":406314}
I20260709 12:12:31.480304 13680 raft_consensus.cc:1240] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:31.425307 20503 raft_consensus.cc:2749] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:12:31.482676 20451 consensus_meta.cc:287] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.608s	user 0.010s	sys 0.001s
I20260709 12:12:31.509099 13828 raft_consensus.cc:2393] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 18: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
W20260709 12:12:31.519258 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:31.514369 14411 rpcz_store.cc:269] 0709 12:12:29.851307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:29.851957 (+   650us) service_pool.cc:224] Handling call
0709 12:12:31.433867 (+1581910us) spinlock_profiling.cc:243] Waited 341 ms on lock 0x7b54004b41d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:31.434058 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":783917952}
I20260709 12:12:31.544008 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:31.552740 13756 raft_consensus.cc:1240] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 12:12:31.604650 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:31.611811 13760 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 17.
I20260709 12:12:31.612330 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:31.613929 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:31.615628 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:31.553516 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:31.616757 13758 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:31.542709 13837 rpcz_store.cc:276] 0709 12:12:29.617081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:29.617207 (+   126us) service_pool.cc:224] Handling call
0709 12:12:29.617484 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:30.253660 (+636176us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:31.445745 (+1192085us) spinlock_profiling.cc:243] Waited 605 ms on lock 0x7b5400323cd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:31.446018 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1392486272}
I20260709 12:12:31.558712 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:31.618002 13755 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:31.559741 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:31.619794 13759 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:31.620744 13837 raft_consensus.cc:1240] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:31.546418 20502 raft_consensus.cc:740] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:31.561208 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:31.626981 13679 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:31.564675 14410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41692 (request call id 1032) took 1162 ms. Trace:
I20260709 12:12:31.565953 20450 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:31.566152 20448 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:31.489753 20417 consensus_queue.cc:1048] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 12:12:31.478169 20457 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:31.585093 13762 raft_consensus.cc:1240] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 12:12:31.585340 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:31.583667 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:31.645256 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:31.646417 13687 raft_consensus.cc:2393] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 22: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:31.588773 13801 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:31.646728 13763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 1031) took 1225 ms. Trace:
I20260709 12:12:31.645397 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:31.648754 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:31.650177 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:31.592231 13681 raft_consensus.cc:1275] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:12:31.583626 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:31.585899 13727 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:31.598651 20456 consensus_queue.cc:1048] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:31.479907 20493 consensus_queue.cc:1059] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 12:12:31.600136 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:12:31.602798 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:31.600185 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:31.663968 13834 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:31.607870 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:31.542585 20396 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:31.622609 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:31.625718 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:31.584949 20300 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:31.584658 20291 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:31.711001 20291 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:31.712280 20396 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:31.627770 14410 rpcz_store.cc:276] 0709 12:12:30.402043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:30.402631 (+   588us) service_pool.cc:224] Handling call
0709 12:12:31.564504 (+1161873us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b54003ebf54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:31.564604 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":334591232}
I20260709 12:12:31.608867 20436 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:31.710055 20300 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:31.613385 20397 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:31.636129 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:31.637931 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:31.606087 20389 consensus_queue.cc:1048] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 12:12:31.594570 20304 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:31.567790 20455 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:31.594238 20406 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:31.651131 13681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 1184) took 1766 ms. Trace:
W20260709 12:12:31.651762 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 63116.4us
I20260709 12:12:31.647543 13763 rpcz_store.cc:276] 0709 12:12:30.421311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:30.421557 (+   246us) service_pool.cc:224] Handling call
0709 12:12:30.439790 (+ 18233us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:30.484298 (+ 44508us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:30.484337 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:30.539765 (+ 55428us) log.cc:844] Serialized 52 byte log entry
0709 12:12:30.872073 (+332308us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:31.149313 (+277240us) log.cc:844] Serialized 14 byte log entry
0709 12:12:31.451872 (+302559us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:31.452007 (+   135us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:31.646403 (+194396us) raft_consensus.cc:1685] finished
0709 12:12:31.646435 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:31.646647 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":350667,"prepare.queue_time_us":478350,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":2099,"raft.queue_time_us":335761,"raft.run_cpu_time_us":283,"raft.run_wall_time_us":13741,"thread_start_us":478993,"threads_started":2,"wal-append.queue_time_us":410162}
W20260709 12:12:31.660411 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 74598.1us
I20260709 12:12:31.599334 20468 raft_consensus.cc:740] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:31.599635 19918 consensus_queue.cc:1059] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.022s
I20260709 12:12:31.621234 20326 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.666196 13756 raft_consensus.cc:2410] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 17 because replica has last-logged OpId of term: 16 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 12:12:31.774787 20493 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.775171 20457 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:31.775470 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:31.775779 20514 raft_consensus.cc:3055] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:31.776238 20514 raft_consensus.cc:740] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:31.676292 13800 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
W20260709 12:12:31.781912 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 105732us
W20260709 12:12:31.733341 20338 consensus_meta.cc:287] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.605s	user 0.008s	sys 0.000s
I20260709 12:12:31.682392 13759 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 20.
I20260709 12:12:31.684729 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:31.690255 13754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 1032) took 1268 ms. Trace:
I20260709 12:12:31.720031 20492 raft_consensus.cc:3055] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:31.666326 20383 consensus_queue.cc:1048] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 12:12:31.613471 20385 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:31.693915 13833 raft_consensus.cc:2393] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 20: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:31.642400 20459 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:31.702205 13680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 1186) took 1314 ms. Trace:
I20260709 12:12:31.802654 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:31.735831 14415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41692 (request call id 1027) took 2006 ms. Trace:
I20260709 12:12:31.751552 14407 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 22.
I20260709 12:12:31.763763 13681 rpcz_store.cc:276] 0709 12:12:29.885103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:29.885718 (+   615us) service_pool.cc:224] Handling call
0709 12:12:29.886141 (+   423us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:31.130669 (+1244528us) spinlock_profiling.cc:243] Waited 60.8 ms on lock 0x7b54002510a0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f04dc0 00007fa927f8f1c0 00007fa927f90231 00007fa927f8cd8f 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c
0709 12:12:31.650850 (+520181us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:31.651077 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":139901824}
I20260709 12:12:31.804905 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:31.806470 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:31.715185 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:31.765602 13829 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 18.
I20260709 12:12:31.766242 13760 raft_consensus.cc:2393] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 19: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:31.722191 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:31.809070 13837 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 16.
W20260709 12:12:31.744364 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:31.762554 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:31.769286 13727 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:31.748097 13758 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 17.
I20260709 12:12:31.718241 13686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 1182) took 1844 ms. Trace:
I20260709 12:12:31.771179 13834 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 19.
I20260709 12:12:31.713498 20291 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:31.775410 20493 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:31.776783 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:31.569814 20454 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:31.674760 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:31.777050 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:12:31.776826 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 88202.4us
I20260709 12:12:31.833006 13761 raft_consensus.cc:2393] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 16: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:31.778964 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:31.774807 20326 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:31.734511 20354 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 16 current term: 16 is higher.
I20260709 12:12:31.667285 20392 raft_consensus.cc:2804] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:31.785741 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:12:31.851496 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 84249.5us
I20260709 12:12:31.786139 13800 leader_election.cc:304] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:31.852365 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:31.786610 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:31.790908 14379 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:31.791118 13828 raft_consensus.cc:2410] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 12:12:31.734236 20381 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:31.859432 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:31.859754 20326 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:31.860430 20326 raft_consensus.cc:2749] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:31.860841 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:31.690420 13679 raft_consensus.cc:2410] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:12:31.792599 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:31.788089 13754 rpcz_store.cc:276] 0709 12:12:30.422298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:30.422427 (+   129us) service_pool.cc:224] Handling call
0709 12:12:30.422762 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:30.432165 (+  9403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:30.432194 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:30.435223 (+  3029us) log.cc:844] Serialized 26 byte log entry
0709 12:12:30.839140 (+403917us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:30.986557 (+147417us) log.cc:844] Serialized 14 byte log entry
0709 12:12:31.454191 (+467634us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:31.454291 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:31.687078 (+232787us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b24002bbf68. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924d269c4 00007fa924d24acb 00007fa924edfdc9 00007fa924edfa55 00007fa924edefb0 00007fa927b55488 00007fa927b55be8 00007fa927b2d398 00007fa927b2876a 00007fa927b27bb6
0709 12:12:31.689889 (+  2811us) raft_consensus.cc:1685] finished
0709 12:12:31.690016 (+   127us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:31.690178 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":489220,"prepare.queue_time_us":442700,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":47,"raft.queue_time_us":481328,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":18260,"spinlock_wait_cycles":277994240,"thread_start_us":467619,"threads_started":2,"wal-append.queue_time_us":446497}
I20260709 12:12:31.739393 20506 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:31.740095 20427 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:31.803916 14415 rpcz_store.cc:276] 0709 12:12:29.731551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:29.731702 (+   151us) service_pool.cc:224] Handling call
0709 12:12:29.761856 (+ 30154us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:30.989451 (+1227595us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:31.735579 (+746128us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54006b0dd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:31.735770 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2817050496}
I20260709 12:12:31.812121 13686 rpcz_store.cc:276] 0709 12:12:29.874057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:29.874297 (+   240us) service_pool.cc:224] Handling call
0709 12:12:29.899587 (+ 25290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:30.061886 (+162299us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:30.061942 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:30.089033 (+ 27091us) log.cc:844] Serialized 26 byte log entry
0709 12:12:30.446020 (+356987us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:30.446095 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:31.717661 (+1271566us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b5400246dd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:31.717729 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:31.717835 (+   106us) raft_consensus.cc:1685] finished
0709 12:12:31.717856 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:31.718155 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9365,"raft.queue_time_us":67747,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":47019,"spinlock_wait_cycles":286663424,"thread_start_us":277052,"threads_started":1,"wal-append.queue_time_us":447393,"wal-append.run_cpu_time_us":1920,"wal-append.run_wall_time_us":1005066}
I20260709 12:12:31.815888 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:31.771553 20436 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:31.779093 20281 raft_consensus.cc:2804] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:31.802783 13680 rpcz_store.cc:276] 0709 12:12:30.387476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:30.387644 (+   168us) service_pool.cc:224] Handling call
0709 12:12:30.388037 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:31.604203 (+1216166us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:31.701893 (+ 97690us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54002841d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:31.702127 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2511526656}
I20260709 12:12:31.789793 20448 consensus_queue.cc:1059] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 12:12:31.870359 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:31.871146 13680 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 17.
I20260709 12:12:31.872159 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:31.817694 13834 raft_consensus.cc:1275] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 12:12:31.820446 14409 raft_consensus.cc:1275] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 15 index: 14. (term mismatch)
I20260709 12:12:31.874295 14409 pending_rounds.cc:85] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f: Aborting all ops after (but not including) 13
I20260709 12:12:31.874563 14409 pending_rounds.cc:107] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f: Aborting uncommitted NO_OP operation due to leader change: 14.14
I20260709 12:12:31.874873 14409 raft_consensus.cc:2889] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:12:31.875545 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:31.835307 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:31.789601 20190 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.845944 13837 raft_consensus.cc:1275] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:12:31.799376 20220 raft_consensus.cc:2804] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:31.771795 20396 consensus_queue.cc:1048] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.050s
W20260709 12:12:31.848755 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:31.850124 13836 raft_consensus.cc:1240] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:31.678432 13755 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 19.
I20260709 12:12:31.713701 20502 consensus_queue.cc:260] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:31.907003 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:31.907946 13755 raft_consensus.cc:2393] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 14: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
W20260709 12:12:31.870283 20470 log.cc:927] Time spent T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:12:31.858557 20456 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.858726 20507 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:31.821622 13578 catalog_manager.cc:5697] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 13 to 17, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 17 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:31.862478 13762 raft_consensus.cc:2410] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 12:12:31.796649 20492 raft_consensus.cc:740] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:31.784686 20322 consensus_queue.cc:1059] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.057s
I20260709 12:12:31.866290 13727 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:31.866178 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:31.869055 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:12:31.877990 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 87157.1us
I20260709 12:12:31.878542 20452 raft_consensus.cc:2804] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:31.879110 20454 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:31.880089 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:31.881212 13757 raft_consensus.cc:2410] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 12:12:31.954326 13763 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 14.
I20260709 12:12:31.882323 20436 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:31.884438 20253 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:31.887878 20352 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:31.862473 20514 consensus_queue.cc:260] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:31.965888 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:31.900758 13759 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:31.903638 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:31.858181 20291 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:31.902778 20190 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:31.914368 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:31.786758 20397 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:31.918992 13837 raft_consensus.cc:1240] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 14. Current term is 15. Ops: [14.14-14.14]
I20260709 12:12:31.910527 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:12:31.926345 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 311484us
I20260709 12:12:31.934109 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:31.984597 13754 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:31.935943 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:12:31.938300 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 327230us
I20260709 12:12:31.951625 14407 raft_consensus.cc:1240] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 16 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 15. Current term is 16. Ops: []
W20260709 12:12:31.951867 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 85680.9us
I20260709 12:12:31.899689 20220 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:31.958195 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:31.989087 13687 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 17.
I20260709 12:12:31.990123 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:31.990720 13687 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 15.
I20260709 12:12:31.962590 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:31.964290 14415 raft_consensus.cc:1240] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:31.965111 14410 raft_consensus.cc:1240] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:31.975886 13759 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 18.
I20260709 12:12:31.995144 13759 raft_consensus.cc:1240] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 12:12:31.869735 20468 consensus_queue.cc:260] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:31.995853 20220 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:31.954957 20452 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:32.006209 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:12:32.006683 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:32.007084 13679 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 21.
I20260709 12:12:31.996963 13651 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:31.982108 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:32.001565 13759 raft_consensus.cc:1240] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 12:12:31.959161 20385 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:31.959743 20337 raft_consensus.cc:2749] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:32.009697 13759 raft_consensus.cc:1240] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 12:12:32.017343 13761 raft_consensus.cc:1240] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 12:12:32.021571 13681 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 22.
I20260709 12:12:31.989329 20502 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:32.033468 13756 raft_consensus.cc:3060] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:32.034168 13831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 3062) took 1193 ms. Trace:
I20260709 12:12:32.023316 13837 raft_consensus.cc:1240] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 26 LEADER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 25. Current term is 26. Ops: []
W20260709 12:12:32.036895 14380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:32.045122 13759 raft_consensus.cc:1240] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 12:12:31.947748 20507 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:31.942276 20456 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:32.042914 13763 raft_consensus.cc:1240] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 25. Current term is 26. Ops: []
I20260709 12:12:32.044479 13831 rpcz_store.cc:276] 0709 12:12:30.840448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:31.142060 (+301612us) service_pool.cc:224] Handling call
0709 12:12:31.142390 (+   330us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:12:31.234950 (+ 92560us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:31.235000 (+    50us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:12:31.273517 (+ 38517us) log.cc:844] Serialized 78 byte log entry
0709 12:12:31.788979 (+515462us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:31.801942 (+ 12963us) log.cc:844] Serialized 14 byte log entry
0709 12:12:31.818243 (+ 16301us) log.cc:844] Serialized 14 byte log entry
0709 12:12:31.818556 (+   313us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:31.818658 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:32.033878 (+215220us) raft_consensus.cc:1685] finished
0709 12:12:32.033907 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:32.034098 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7487,"prepare.queue_time_us":191589,"prepare.run_cpu_time_us":104,"prepare.run_wall_time_us":4015,"raft.queue_time_us":98061,"raft.run_cpu_time_us":308,"raft.run_wall_time_us":39303,"spinlock_wait_cycles":56856576,"thread_start_us":453268,"threads_started":1,"wal-append.queue_time_us":606872}
I20260709 12:12:32.047899 13759 raft_consensus.cc:1240] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:32.018035 20452 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:32.022724 20468 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:32.025043 20451 raft_consensus.cc:2749] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:12:31.992565 20291 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:32.058722 13828 raft_consensus.cc:1275] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:12:32.062776 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:32.007753 20436 consensus_queue.cc:1048] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 12:12:32.066227 13754 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 19.
I20260709 12:12:32.069826 13763 raft_consensus.cc:1275] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:12:32.072150 13754 raft_consensus.cc:1275] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 12:12:32.066416 13687 raft_consensus.cc:1275] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 12:12:32.066838 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:32.077322 13756 raft_consensus.cc:2468] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 15.
I20260709 12:12:32.042652 20385 consensus_queue.cc:1048] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 12:12:32.094897 13763 raft_consensus.cc:1240] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 LEADER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 14. Current term is 15. Ops: [14.14-14.14]
I20260709 12:12:32.100602 13763 raft_consensus.cc:1275] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:12:32.019845 20492 consensus_queue.cc:260] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:32.008800 20513 consensus_queue.cc:1175] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ca9fbbc2c0a94897897d502d42f3951f" responder_term: 14 status { last_received { term: 13 index: 11 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 13. Current term is 14. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 12:12:32.118325 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 131183us
W20260709 12:12:32.146554 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 149714us
I20260709 12:12:32.148262 13651 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:32.149852 13651 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:32.165009 13726 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:12:32.152247 20528 log.cc:927] Time spent T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:12:32.118409 20451 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:32.222589 20529 log.cc:927] Time spent T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 12:12:32.222303 20418 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:12:32.223716 20536 log.cc:927] Time spent T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:12:32.224356 20385 raft_consensus.cc:2749] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:12:32.230476 20397 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:12:32.231607 20526 log.cc:927] Time spent T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
I20260709 12:12:32.160498 20366 raft_consensus.cc:2749] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:12:32.153403 20304 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:32.162007 20492 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:32.144624 20493 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:32.166119 20352 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:32.160593 13651 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:12:32.236605 20524 log.cc:927] Time spent T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.218s	user 0.000s	sys 0.016s
W20260709 12:12:32.247720 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:32.220357 20190 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:32.244519 20384 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.240252 20542 raft_consensus.cc:2749] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:32.232849 20425 consensus_queue.cc:1048] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 12:12:32.255744 20253 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:32.288465 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 123585us
I20260709 12:12:32.283278 20366 raft_consensus.cc:2749] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 12:12:32.282765 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 122291us
I20260709 12:12:32.290411 13651 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:32.291589 14379 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:32.291821 13651 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:32.292841 13651 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:32.260061 20456 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:32.253484 20451 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:32.293744 20522 log.cc:927] Time spent T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.210s	user 0.000s	sys 0.001s
I20260709 12:12:32.295930 20457 raft_consensus.cc:2749] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:32.288213 20384 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:32.296831 20190 raft_consensus.cc:2749] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:32.301050 20326 consensus_queue.cc:1048] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:32.305615 13761 raft_consensus.cc:1240] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 12:12:32.255534 20418 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:32.293913 20525 log.cc:927] Time spent T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
I20260709 12:12:32.309278 13651 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:32.284533 20507 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:32.310544 14379 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
W20260709 12:12:32.315191 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:32.306804 20352 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:32.321256 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:32.326364 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:32.326642 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:32.329147 13681 raft_consensus.cc:1275] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:12:32.331053 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:32.332026 13681 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 15.
I20260709 12:12:32.333657 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:32.336850 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:32.337636 13680 raft_consensus.cc:2393] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 19: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:32.338651 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:32.339462 13686 raft_consensus.cc:2410] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 12:12:32.347105 14379 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
W20260709 12:12:32.349645 20537 log.cc:927] Time spent T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:12:32.350365 13680 raft_consensus.cc:1240] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:32.343387 20253 consensus_queue.cc:1048] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 12:12:32.353233 20262 consensus_queue.cc:1059] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:32.354528 20262 raft_consensus.cc:3055] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:32.315910 20252 consensus_queue.cc:1048] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 12:12:32.354971 20262 raft_consensus.cc:740] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:32.356092 20262 consensus_queue.cc:260] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:32.357963 20450 consensus_meta.cc:287] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.715s	user 0.006s	sys 0.006s
I20260709 12:12:32.344691 20442 raft_consensus.cc:2749] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:32.358914 13682 raft_consensus.cc:1275] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 15. (term mismatch)
I20260709 12:12:32.359308 13682 pending_rounds.cc:85] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 14
I20260709 12:12:32.359556 13682 pending_rounds.cc:107] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 19.15
I20260709 12:12:32.359802 13682 raft_consensus.cc:2889] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:32.350150 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:32.334419 20456 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:32.311800 20354 raft_consensus.cc:2749] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:32.373973 20368 raft_consensus.cc:3055] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:32.374503 20368 raft_consensus.cc:740] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
W20260709 12:12:32.374629 20540 log.cc:927] Time spent T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:12:32.374794 20451 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:32.375433 20368 consensus_queue.cc:260] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:32.376538 20368 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:32.379127 20220 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:32.380311 13754 raft_consensus.cc:1240] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:32.345724 13726 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:32.316881 20291 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:32.357622 20262 raft_consensus.cc:3060] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:32.385291 13726 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:32.373852 20418 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:32.387249 20292 raft_consensus.cc:2749] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:32.391690 20352 raft_consensus.cc:2749] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:32.396023 20406 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:32.396150 20292 consensus_queue.cc:1059] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.004s
I20260709 12:12:32.401202 13726 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:32.419749 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:32.421110 13763 raft_consensus.cc:1240] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:32.390610 20545 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:32.387310 20291 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:32.410730 20190 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:32.437996 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:32.438197 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:12:32.440186 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 654100us
I20260709 12:12:32.403668 20292 raft_consensus.cc:3055] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:12:32.450212 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:32.450562 13835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 1216) took 1306 ms. Trace:
I20260709 12:12:32.426939 20354 consensus_queue.cc:1059] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 12:12:32.454528 13830 raft_consensus.cc:1275] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:12:32.455751 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:32.456561 13830 raft_consensus.cc:2410] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
W20260709 12:12:32.458659 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:32.437638 20190 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:32.428112 20396 raft_consensus.cc:2804] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:32.451102 13835 rpcz_store.cc:276] 0709 12:12:31.143765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:31.360780 (+217015us) service_pool.cc:224] Handling call
0709 12:12:31.361321 (+   541us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:12:31.361893 (+   572us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:31.361931 (+    38us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:12:31.383264 (+ 21333us) log.cc:844] Serialized 78 byte log entry
0709 12:12:31.799021 (+415757us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:32.007138 (+208117us) log.cc:844] Serialized 14 byte log entry
0709 12:12:32.450139 (+443001us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:32.450233 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:32.450282 (+    49us) raft_consensus.cc:1685] finished
0709 12:12:32.450297 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:32.450486 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":445985,"prepare.queue_time_us":116641,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":839,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":7762,"thread_start_us":508530,"threads_started":2,"wal-append.queue_time_us":540601}
I20260709 12:12:32.445200 20427 raft_consensus.cc:2804] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:32.394464 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:32.458262 14379 leader_election.cc:304] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:32.463788 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:32.454685 20292 raft_consensus.cc:740] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:32.474803 20292 consensus_queue.cc:260] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:32.474540 13578 catalog_manager.cc:5697] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 11 to 14, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 14 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:32.476053 20292 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:32.476433 13578 catalog_manager.cc:5697] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 13 to 15, leader changed from ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 15 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:12:32.471110 20383 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:32.424659 20220 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:32.460165 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:32.471843 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:32.483393 13830 raft_consensus.cc:2393] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 19: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:32.484293 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:12:32.485908 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:32.403322 20406 consensus_queue.cc:1048] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 12:12:32.490223 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:32.502868 13755 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:32.481866 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:32.499145 13760 raft_consensus.cc:1240] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:32.499681 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:32.505421 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:32.506073 13828 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 15.
I20260709 12:12:32.510172 13755 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 14.
I20260709 12:12:32.512255 20546 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.512462 20545 raft_consensus.cc:2749] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:32.443485 20392 raft_consensus.cc:697] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 20 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:32.522027 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:32.526959 13760 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 23.
I20260709 12:12:32.522940 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:32.528973 13756 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 19.
I20260709 12:12:32.530583 13756 raft_consensus.cc:1275] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:12:32.428385 20451 consensus_queue.cc:1059] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.063s
I20260709 12:12:32.423343 20452 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:32.473434 20396 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:32.533209 13830 raft_consensus.cc:1275] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:12:32.536468 13684 raft_consensus.cc:2410] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 12:12:32.480067 20427 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:32.512872 20546 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:32.542232 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:32.552277 20427 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:32.537283 13829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 3348) took 1025 ms. Trace:
I20260709 12:12:32.540715 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:32.481793 20467 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:12:32.537257 20552 log.cc:927] Time spent T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 12:12:32.525010 20445 raft_consensus.cc:2804] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:32.553817 13829 rpcz_store.cc:276] 0709 12:12:31.511811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:31.807942 (+296131us) service_pool.cc:224] Handling call
0709 12:12:31.840153 (+ 32211us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:31.840432 (+   279us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:12:31.888998 (+ 48566us) log.cc:844] Serialized 14 byte log entry
0709 12:12:32.536964 (+647966us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:32.537019 (+    55us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:32.537062 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:32.537123 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:32.537230 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":397934,"prepare.queue_time_us":75676,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":389725,"spinlock_wait_cycles":39951104,"thread_start_us":274466,"threads_started":2,"wal-append.queue_time_us":223836}
I20260709 12:12:32.534302 20291 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.538287 20396 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:32.564308 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:32.564855 13727 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:32.546980 20468 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.525339 20465 consensus_queue.cc:1059] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.040s
I20260709 12:12:32.498803 20383 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:32.535044 20523 consensus_queue.cc:1059] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.039s
I20260709 12:12:32.571171 13727 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:32.543498 20252 consensus_queue.cc:1048] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.027s
W20260709 12:12:32.579175 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:32.534854 20457 consensus_queue.cc:1048] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 12:12:32.566800 20422 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:32.582137 20326 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.575850 20418 raft_consensus.cc:2749] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:12:32.587832 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 108529us
I20260709 12:12:32.606494 13800 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:32.587828 20433 raft_consensus.cc:2749] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:32.609193 13801 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:32.565672 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:32.612483 13800 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:32.613446 13727 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:12:32.611797 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 76422.6us
I20260709 12:12:32.594108 20338 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.559926 20467 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:32.567857 20291 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:32.593904 20523 consensus_queue.cc:1243] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer 96701a74fdee481fb5f54aac841e17dd log is divergent from this leader: its last log entry 26.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 12:12:32.593328 20385 consensus_queue.cc:1048] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 12:12:32.577245 20468 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:32.630784 20281 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:32.573625 20545 consensus_queue.cc:1048] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.060s
W20260709 12:12:32.646124 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:32.618873 13800 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:32.662954 20532 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.663594 20532 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:32.657413 20455 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:32.667313 20514 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:32.669114 13578 catalog_manager.cc:5697] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 15 to 19, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 19 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:32.675174 13578 catalog_manager.cc:5697] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:32.676084 13758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 2375) took 1107 ms. Trace:
I20260709 12:12:32.676499 13758 rpcz_store.cc:276] 0709 12:12:31.569104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:31.948185 (+379081us) service_pool.cc:224] Handling call
0709 12:12:31.948470 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:32.088865 (+140395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:32.088910 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:32.088981 (+    71us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:32.089025 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:32.675838 (+586813us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b540038d1d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:32.675883 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:32.676024 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":322359680}
I20260709 12:12:32.678814 20532 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:32.680873 20417 raft_consensus.cc:3055] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:32.683789 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:32.684520 20354 raft_consensus.cc:3055] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:32.677134 13578 catalog_manager.cc:5697] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 13 to 16, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 16 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:32.635339 20220 raft_consensus.cc:3055] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:32.641000 20465 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:32.603067 20422 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:32.645490 20544 log.cc:927] Time spent T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.243s	user 0.001s	sys 0.000s
I20260709 12:12:32.698110 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:32.691357 13757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48114 (request call id 3176) took 1068 ms. Trace:
I20260709 12:12:32.728466 13837 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 18.
I20260709 12:12:32.728402 13757 rpcz_store.cc:276] 0709 12:12:31.622782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:31.762233 (+139451us) service_pool.cc:224] Handling call
0709 12:12:32.691122 (+928889us) spinlock_profiling.cc:243] Waited 69.7 ms on lock 0x7b54003ca354. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:32.691293 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":160317696}
I20260709 12:12:32.729998 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:32.605046 20326 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:32.736104 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:32.650002 20281 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:32.717384 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:32.649068 20322 raft_consensus.cc:2749] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:32.641239 20482 consensus_queue.cc:1059] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.064s
I20260709 12:12:32.637204 20338 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:32.731828 13727 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
W20260709 12:12:32.704622 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 85853.2us
I20260709 12:12:32.703696 20220 raft_consensus.cc:740] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:32.691453 20445 raft_consensus.cc:697] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 18 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:32.699169 20417 raft_consensus.cc:740] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:32.749136 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:32.735992 20425 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.695412 20354 raft_consensus.cc:740] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
W20260709 12:12:32.738791 20551 log.cc:927] Time spent T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
I20260709 12:12:32.608310 20392 consensus_queue.cc:237] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:32.704123 20557 raft_consensus.cc:2749] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:12:32.748342 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 131686us
I20260709 12:12:32.772009 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:32.810685 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:32.771492 13800 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:32.726540 20554 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:32.688042 20384 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:32.704376 20253 consensus_queue.cc:1048] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.075s
I20260709 12:12:32.737748 20464 consensus_queue.cc:1059] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.042s
W20260709 12:12:32.766624 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:32.738274 20465 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:32.782150 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:32.747727 20397 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:32.816717 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 175093us
I20260709 12:12:32.792757 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:32.772754 20482 consensus_queue.cc:1243] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer 3f37c9cc9dda46b4be21dd675ba78fb7 log is divergent from this leader: its last log entry 23.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 12:12:32.778487 20442 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.755697 20558 raft_consensus.cc:2749] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:32.832644 14415 raft_consensus.cc:1240] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:32.825088 13801 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:32.750771 20452 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:12:32.808681 20501 log.cc:927] Time spent T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 12:12:32.850582 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:32.827787 13759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 3189) took 1165 ms. Trace:
I20260709 12:12:32.835242 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:32.837220 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:32.800542 20451 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:32.810272 20457 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.842294 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:32.854333 13757 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:32.856642 14413 raft_consensus.cc:1240] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:32.851815 13759 rpcz_store.cc:276] 0709 12:12:31.661932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.050179 (+388247us) service_pool.cc:224] Handling call
0709 12:12:32.050520 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:32.054427 (+  3907us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:32.054455 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:32.065069 (+ 10614us) log.cc:844] Serialized 26 byte log entry
0709 12:12:32.259110 (+194041us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:32.259168 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:32.259269 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:32.393749 (+134480us) spinlock_profiling.cc:243] Waited 2.47 ms on lock 0x7b48001a01d8. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92ceb6aa1 00007fa92ceadb37 00007fa92cead9ca 00007fa92cfa526f 00007fa92cfa4f37 00007fa92cfb955c 00007fa92cfb9508 00007fa92cfb9488 00007fa92cfb9443 00007fa92cfb86ec 00007fa92bee2a96
0709 12:12:32.819038 (+425289us) raft_consensus.cc:1685] finished
0709 12:12:32.819086 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:32.827684 (+  8598us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15348,"raft.queue_time_us":5525,"raft.run_cpu_time_us":4830,"raft.run_wall_time_us":336508,"spinlock_wait_cycles":5683584,"thread_start_us":159806,"threads_started":1,"wal-append.queue_time_us":293832}
I20260709 12:12:32.838243 20464 consensus_queue.cc:1243] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer ca9fbbc2c0a94897897d502d42f3951f log is divergent from this leader: its last log entry 17.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 12:12:32.781107 20190 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:32.822156 20556 raft_consensus.cc:2749] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:32.808810 20425 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:32.885514 13757 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 15.
W20260709 12:12:32.871537 20550 log.cc:927] Time spent T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.259s	user 0.001s	sys 0.000s
I20260709 12:12:32.861055 20557 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:32.837623 20397 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:32.893559 13832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 3347) took 1445 ms. Trace:
W20260709 12:12:32.887730 20548 log.cc:927] Time spent T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.254s	user 0.001s	sys 0.000s
I20260709 12:12:32.867092 20558 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.866228 20546 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:32.837348 20442 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:32.850885 20564 consensus_queue.cc:1048] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.055s
I20260709 12:12:32.890507 20464 raft_consensus.cc:2804] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:32.902671 13832 rpcz_store.cc:276] 0709 12:12:31.448479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:31.748693 (+300214us) service_pool.cc:224] Handling call
0709 12:12:31.748963 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:31.749238 (+   275us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:12:31.783028 (+ 33790us) log.cc:844] Serialized 14 byte log entry
0709 12:12:32.659254 (+876226us) spinlock_profiling.cc:243] Waited 6.1 ms on lock 0x7b48001bd758. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92ceb6aa1 00007fa92ceadb37 00007fa92cead9ca 00007fa92cfa526f 00007fa92cfa4f37 00007fa92cfb955c 00007fa92cfb9508 00007fa92cfb9488 00007fa92cfb9443 00007fa92cfb86ec 00007fa92bee2a96
0709 12:12:32.891295 (+232041us) log.cc:844] Serialized 14 byte log entry
0709 12:12:32.891568 (+   273us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:32.891638 (+    70us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:32.891725 (+    87us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:32.891825 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:32.893472 (+  1647us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":481964,"prepare.queue_time_us":35344,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":434781,"raft.run_cpu_time_us":2020,"raft.run_wall_time_us":184581,"spinlock_wait_cycles":14031104,"thread_start_us":692883,"threads_started":3,"wal-append.queue_time_us":386354}
I20260709 12:12:32.863076 20451 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:32.918030 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 93035.4us
I20260709 12:12:32.869146 20457 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:32.920372 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 149003us
I20260709 12:12:32.921957 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:32.849445 20417 consensus_queue.cc:260] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:32.907015 20467 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:32.908385 20291 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:32.911710 20468 leader_election.cc:290] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:32.927846 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:32.968924 13831 raft_consensus.cc:1275] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:12:32.971392 13651 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:32.972267 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:32.972764 20368 consensus_queue.cc:1059] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:32.973335 20503 consensus_queue.cc:1059] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:32.973794 20190 raft_consensus.cc:2804] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:32.974121 20368 consensus_queue.cc:1048] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:32.932560 20457 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:32.920634 20464 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:32.924556 13800 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:32.934162 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:32.975230 20464 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:32.976593 20561 log.cc:927] Time spent T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:12:32.974354 20503 raft_consensus.cc:3055] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:12:32.925004 20502 consensus_meta.cc:287] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.874s	user 0.002s	sys 0.011s
I20260709 12:12:32.934731 13754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 1039) took 1148 ms. Trace:
I20260709 12:12:32.977767 20503 raft_consensus.cc:740] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:32.935375 13834 raft_consensus.cc:1275] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:12:32.936237 20425 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:32.978976 20503 consensus_queue.cc:260] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:32.937229 20338 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:32.928787 20492 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:32.980474 20503 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:32.980722 20492 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:32.943503 20397 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:32.945667 20442 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:32.984313 20492 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:32.990516 20553 log.cc:927] Time spent T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.254s	user 0.001s	sys 0.000s
I20260709 12:12:32.952143 20300 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:32.954375 20326 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:32.956410 20451 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:32.961108 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 229383us
I20260709 12:12:32.991811 13833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 3353) took 1450 ms. Trace:
I20260709 12:12:32.996245 14410 raft_consensus.cc:3055] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:12:32.996824 14410 raft_consensus.cc:740] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 25 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:32.999761 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:33.000733 14411 raft_consensus.cc:2393] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 22: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:33.001822 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:33.003211 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:33.004573 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:32.913094 20558 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:32.992386 13833 rpcz_store.cc:276] 0709 12:12:31.541910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:31.835860 (+293950us) service_pool.cc:224] Handling call
0709 12:12:31.866751 (+ 30891us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:32.443661 (+576910us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:32.443694 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:32.445928 (+  2234us) log.cc:844] Serialized 26 byte log entry
0709 12:12:32.547786 (+101858us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:32.547827 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:32.547894 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:32.991572 (+443678us) raft_consensus.cc:1685] finished
0709 12:12:32.991595 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:32.991747 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":576516,"raft.queue_time_us":580089,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":76,"thread_start_us":101281,"threads_started":1,"wal-append.queue_time_us":186684}
I20260709 12:12:33.007489 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:33.008036 20558 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:32.905964 20557 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:33.008702 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:33.010869 20557 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:32.918555 20567 raft_consensus.cc:2749] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:33.012494 20465 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:12:32.932380 20563 log.cc:927] Time spent T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 12:12:32.973012 13651 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:12:32.931641 20560 log.cc:927] Time spent T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:12:33.015413 13651 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:32.974524 20352 raft_consensus.cc:3055] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:33.016623 13651 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:32.974344 20190 raft_consensus.cc:697] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 19 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:33.017019 20352 raft_consensus.cc:740] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:33.009498 13833 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 21.
I20260709 12:12:33.018087 20352 consensus_queue.cc:260] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:33.018033 20190 consensus_queue.cc:237] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:33.019765 20352 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:32.936738 20417 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:32.985383 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:32.949939 20396 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:32.942755 13682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 1195) took 1232 ms. Trace:
I20260709 12:12:33.022033 13682 rpcz_store.cc:276] 0709 12:12:31.710163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:31.714480 (+  4317us) service_pool.cc:224] Handling call
0709 12:12:31.714769 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:32.360275 (+645506us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:32.942454 (+582179us) spinlock_profiling.cc:243] Waited 644 ms on lock 0x7b54003129d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:32.942680 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1480323840}
I20260709 12:12:33.023412 20448 raft_consensus.cc:2804] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:33.024066 20448 raft_consensus.cc:697] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 15 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:32.962059 20433 raft_consensus.cc:2804] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:32.978377 13754 rpcz_store.cc:276] 0709 12:12:31.786788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.072885 (+286097us) service_pool.cc:224] Handling call
0709 12:12:32.073176 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:32.380780 (+307604us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:32.934470 (+553690us) spinlock_profiling.cc:243] Waited 307 ms on lock 0x7b540032e954. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:32.934671 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":705934208}
W20260709 12:12:33.028031 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:32.860265 20354 consensus_queue.cc:260] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:33.029654 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:33.039441 13757 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 19.
W20260709 12:12:33.031019 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:33.040619 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:33.031471 14410 consensus_queue.cc:260] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.17, Last appended by leader: 17, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:32.996047 13727 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:33.024067 13651 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:33.041977 14410 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:12:33.042793 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 46886.1us
I20260709 12:12:33.043066 13651 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:33.043673 13727 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:33.045974 14407 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 14.
W20260709 12:12:33.032687 20456 consensus_meta.cc:287] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.620s	user 0.008s	sys 0.001s
W20260709 12:12:33.055347 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 130873us
I20260709 12:12:32.894806 20445 consensus_queue.cc:237] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:33.023393 20396 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:33.067221 13727 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:33.039585 20492 raft_consensus.cc:2804] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:33.036166 20433 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:33.041507 20493 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:33.040459 20451 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:33.078836 13727 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:33.080541 20454 raft_consensus.cc:2804] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:33.081003 20454 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:33.081418 20454 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:33.072826 13685 raft_consensus.cc:1275] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:12:33.046805 20406 raft_consensus.cc:2749] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:33.049202 20468 raft_consensus.cc:2804] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:33.055284 20338 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:33.056754 20368 raft_consensus.cc:2749] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:33.055100 20532 raft_consensus.cc:2749] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:33.100953 14380 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:33.064961 20456 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:33.047138 20546 consensus_queue.cc:1059] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 12:12:33.157733 14410 raft_consensus.cc:1275] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 26 index: 17. (term mismatch)
W20260709 12:12:33.140183 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 297916us
I20260709 12:12:33.141182 20583 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:33.158259 14410 pending_rounds.cc:85] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f: Aborting all ops after (but not including) 16
I20260709 12:12:33.158878 14410 pending_rounds.cc:107] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f: Aborting uncommitted NO_OP operation due to leader change: 25.17
I20260709 12:12:33.159288 14410 raft_consensus.cc:2889] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:32.957639 20220 consensus_queue.cc:260] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:33.161931 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:33.163564 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 106634us
I20260709 12:12:33.164258 13800 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
W20260709 12:12:33.143508 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 100545us
I20260709 12:12:33.039884 20464 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:33.165614 13651 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:33.165614 13800 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:33.091507 20492 raft_consensus.cc:697] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 14 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:33.149070 20252 consensus_queue.cc:1048] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:12:33.149992 20262 consensus_meta.cc:287] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.764s	user 0.013s	sys 0.000s
I20260709 12:12:33.076081 20433 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:33.084646 20467 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:33.194666 14414 raft_consensus.cc:2468] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 15.
I20260709 12:12:33.195135 13800 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:33.150269 20457 consensus_queue.cc:1048] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:33.075608 20557 raft_consensus.cc:2804] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:33.086192 20451 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:33.086052 20493 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:33.152176 20570 log.cc:927] Time spent T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 12:12:33.094501 20554 raft_consensus.cc:697] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 22 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:33.084656 20455 raft_consensus.cc:2749] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:33.136158 20468 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:33.148110 20502 raft_consensus.cc:2749] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:33.147480 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:33.166256 20565 consensus_queue.cc:1048] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 12:12:33.168731 20514 raft_consensus.cc:2749] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:33.168982 20575 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:33.169302 20566 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:33.169695 13684 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:33.143307 20338 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:33.186991 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:33.188776 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:33.173949 13651 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:33.229135 13763 raft_consensus.cc:1275] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:12:33.234620 20465 raft_consensus.cc:2804] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:33.218389 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:33.234134 20459 raft_consensus.cc:2749] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:33.224393 13762 raft_consensus.cc:1240] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:33.226169 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:33.233435 14379 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:33.272014 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:33.250214 13830 raft_consensus.cc:1240] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 20 LEADER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:33.273144 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:33.235005 20451 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:33.263739 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:33.215286 13754 raft_consensus.cc:1275] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:12:33.266678 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:33.220573 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:33.161931 20448 consensus_queue.cc:237] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:33.228359 20557 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:33.273844 13757 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 19.
I20260709 12:12:33.245383 20220 raft_consensus.cc:3060] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:33.280426 13763 raft_consensus.cc:2393] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 16: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:33.249055 20468 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:33.205057 20467 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:33.233253 20559 consensus_queue.cc:1048] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.069s
I20260709 12:12:33.166497 20583 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:33.238315 20572 consensus_queue.cc:1048] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.092s
I20260709 12:12:33.261329 20575 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:12:33.299408 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:33.301875 20554 consensus_queue.cc:237] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:33.302604 20427 consensus_meta.cc:287] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.744s	user 0.012s	sys 0.000s
I20260709 12:12:33.302729 20558 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:33.303179 20464 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:33.292197 20190 consensus_queue.cc:1059] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.012s
I20260709 12:12:33.269629 20392 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:33.290648 20557 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:33.308552 20534 log.cc:927] Time spent T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 1.167s	user 0.004s	sys 0.002s
W20260709 12:12:33.313799 20523 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 26 current term: 26 is higher.
I20260709 12:12:33.319337 20338 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:33.324575 13684 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 15.
W20260709 12:12:33.340521 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:33.272799 20465 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:33.274010 20406 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:33.373615 20454 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:33.374531 20406 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:33.375965 20454 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:33.376637 20406 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:33.359427 13832 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 15.
I20260709 12:12:33.290894 20514 raft_consensus.cc:2804] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:33.377605 20514 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:33.360986 20558 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:33.378072 20514 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:33.344246 20507 raft_consensus.cc:3055] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:33.281039 20577 raft_consensus.cc:2804] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:12:33.355819 20281 consensus_meta.cc:287] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.601s	user 0.010s	sys 0.002s
W20260709 12:12:33.369252 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 86141.5us
I20260709 12:12:33.345762 20575 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:33.377606 13762 raft_consensus.cc:2393] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 22: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:33.382413 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:33.320972 20451 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:33.388026 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 206940us
I20260709 12:12:33.369930 20493 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:33.361218 20464 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:33.379949 20465 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:33.370194 20556 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:33.281682 20492 consensus_queue.cc:237] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:33.357411 20427 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:33.455786 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 281907us
I20260709 12:12:33.383167 20507 raft_consensus.cc:740] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:33.461529 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:33.464380 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:33.465746 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:33.465931 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:33.468973 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:33.470260 13686 raft_consensus.cc:2410] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 12:12:33.270963 20566 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:33.473282 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:33.367956 20392 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:33.474653 13686 raft_consensus.cc:2410] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:12:33.444669 20591 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:33.445420 20577 raft_consensus.cc:697] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 15 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:33.484412 20577 consensus_queue.cc:237] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:33.486119 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:33.486846 13679 raft_consensus.cc:2376] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 22. Re-sending same reply.
I20260709 12:12:33.476649 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:33.488445 13680 raft_consensus.cc:2410] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
W20260709 12:12:33.479296 20587 log.cc:927] Time spent T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
W20260709 12:12:33.480232 20581 log.cc:927] Time spent T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:12:33.482208 20591 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:33.493121 13726 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:33.482589 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:33.498540 13836 raft_consensus.cc:1240] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:33.510586 20417 raft_consensus.cc:2749] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:33.511175 20506 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:33.475184 20558 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:33.515223 20422 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:12:33.516624 20503 consensus_meta.cc:287] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.535s	user 0.012s	sys 0.000s
I20260709 12:12:33.523777 20566 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:33.523525 20433 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:33.457618 20464 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:33.470208 20556 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:33.526592 20464 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:33.528353 20556 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:33.527902 20507 consensus_queue.cc:260] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:33.532984 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:33.533566 13681 raft_consensus.cc:2410] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:12:33.534274 13684 raft_consensus.cc:2393] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 20: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:33.535885 13686 raft_consensus.cc:1275] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 9. (term mismatch)
I20260709 12:12:33.536629 13686 pending_rounds.cc:85] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 8
I20260709 12:12:33.537117 13686 pending_rounds.cc:107] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 17.9
I20260709 12:12:33.539878 13686 raft_consensus.cc:2889] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:33.526650 20383 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:12:33.541584 20352 consensus_meta.cc:287] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.519s	user 0.014s	sys 0.002s
I20260709 12:12:33.551019 20591 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:33.551257 13828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 3367) took 1067 ms. Trace:
I20260709 12:12:33.515224 20427 leader_election.cc:290] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:33.537106 20507 raft_consensus.cc:3060] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:33.563046 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:33.565791 20503 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
W20260709 12:12:33.571403 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 131466us
W20260709 12:12:33.576120 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:33.579473 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:33.580260 13762 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 20.
I20260709 12:12:33.554558 20452 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:33.566408 20503 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:33.549094 20281 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:33.613003 14379 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:33.589674 20433 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:33.608771 20593 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:33.621467 20392 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:33.621870 20593 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:33.600227 20467 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:33.638235 20281 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:33.639470 13758 raft_consensus.cc:2393] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 18: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:33.640156 20593 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:33.648394 13800 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:12:33.651513 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:33.675782 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:33.676359 13800 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:33.678634 13800 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:33.676786 13763 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 18.
I20260709 12:12:33.681631 14379 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:33.601280 20452 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:33.635155 20559 raft_consensus.cc:2804] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:33.682699 20577 raft_consensus.cc:2804] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:33.719611 13800 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:33.723083 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:33.725921 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:33.726656 13762 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 19.
I20260709 12:12:33.727200 13759 raft_consensus.cc:1275] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:12:33.733047 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:33.744052 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:12:33.678802 20574 log.cc:927] Time spent T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:12:33.696660 20559 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:33.715409 20577 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:33.730683 20583 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:33.875427 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:33.713483 20427 consensus_queue.cc:1048] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.134s
I20260709 12:12:33.684396 20392 raft_consensus.cc:2804] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:33.680174 20467 raft_consensus.cc:2804] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:33.886427 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:12:33.886924 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:33.895110 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:33.686707 20599 raft_consensus.cc:2804] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:33.916311 13759 raft_consensus.cc:1275] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:12:33.914839 13800 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:33.764533 20572 consensus_queue.cc:1059] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.116s
I20260709 12:12:33.872625 20464 raft_consensus.cc:2804] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:12:33.899569 20598 log.cc:927] Time spent T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.260s	user 0.003s	sys 0.000s
I20260709 12:12:33.735497 20459 consensus_queue.cc:1048] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.139s
I20260709 12:12:33.803800 20422 consensus_queue.cc:1048] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.092s
I20260709 12:12:33.937461 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:33.872243 20558 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:33.919201 20606 log.cc:927] Time spent T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.235s	user 0.003s	sys 0.000s
I20260709 12:12:33.910982 20559 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:33.911279 20577 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:33.917878 20427 consensus_queue.cc:1243] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer 3f37c9cc9dda46b4be21dd675ba78fb7 log is divergent from this leader: its last log entry 23.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
W20260709 12:12:33.983606 20605 log.cc:927] Time spent T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.248s	user 0.000s	sys 0.007s
W20260709 12:12:34.008934 20220 consensus_meta.cc:287] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.686s	user 0.008s	sys 0.008s
I20260709 12:12:33.954453 20591 raft_consensus.cc:2804] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:33.949725 20464 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:34.041612 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:33.948930 20583 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:33.948820 20190 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:34.042472 13755 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 21.
I20260709 12:12:34.046784 13763 raft_consensus.cc:1275] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:12:34.007364 20599 raft_consensus.cc:697] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 19 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:34.049886 13829 raft_consensus.cc:1275] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
W20260709 12:12:34.051118 20608 log.cc:927] Time spent T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:12:34.050678 20599 consensus_queue.cc:237] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:34.053184 20602 log.cc:927] Time spent T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:12:34.026973 20281 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:34.054801 20281 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:34.056386 13836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 3359) took 1604 ms. Trace:
I20260709 12:12:34.067307 20503 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:34.023638 20558 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:34.067365 20451 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:34.056921 13836 rpcz_store.cc:276] 0709 12:12:32.451764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.456884 (+  5120us) service_pool.cc:224] Handling call
0709 12:12:32.457148 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:33.499117 (+1041969us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:34.056047 (+556930us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54003ba1d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:34.056302 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2381504256}
W20260709 12:12:34.078577 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 139022us
I20260709 12:12:34.075198 14379 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:34.079294 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:34.085434 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:34.244342 13836 raft_consensus.cc:2393] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 22: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:34.221828 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:34.225481 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:34.107115 20112 consensus_queue.cc:1048] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.145s
I20260709 12:12:34.252347 13684 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 17.
I20260709 12:12:34.253901 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:34.255748 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:34.078696 20190 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:34.143386 20281 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:34.259481 20281 consensus_queue.cc:1059] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:34.118695 20262 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:34.227421 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:34.228577 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:34.231174 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:34.231853 13755 raft_consensus.cc:1240] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 21. Current term is 22. Ops: [21.14-21.14]
I20260709 12:12:34.233548 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:34.234404 13754 raft_consensus.cc:1275] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:12:34.235401 13761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 1056) took 1042 ms. Trace:
I20260709 12:12:34.235808 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:34.236877 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:34.236907 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:12:34.239097 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 151474us
W20260709 12:12:34.227191 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:34.092700 20422 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:34.143389 20452 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:34.087200 20457 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:34.043680 20464 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:34.310775 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:34.310665 20262 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:34.312325 20427 consensus_queue.cc:1048] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:12:34.139937 20467 raft_consensus.cc:697] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 20 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
W20260709 12:12:34.142604 20468 consensus_meta.cc:287] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.822s	user 0.009s	sys 0.005s
I20260709 12:12:34.339125 20468 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:34.140841 20465 consensus_meta.cc:287] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.669s	user 0.010s	sys 0.001s
I20260709 12:12:34.342079 20451 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:34.342657 20465 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:34.343106 20451 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:34.165020 20507 consensus_meta.cc:287] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.597s	user 0.003s	sys 0.008s
W20260709 12:12:34.178951 20514 consensus_meta.cc:287] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.800s	user 0.013s	sys 0.009s
I20260709 12:12:34.347229 20514 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:34.016512 20554 consensus_queue.cc:1048] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.063s
I20260709 12:12:34.173549 20558 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:12:34.160436 20575 consensus_meta.cc:287] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.704s	user 0.006s	sys 0.005s
I20260709 12:12:34.309170 20422 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:34.351743 20575 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:34.352699 13830 raft_consensus.cc:1240] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 22. Current term is 23. Ops: []
I20260709 12:12:34.353380 13835 raft_consensus.cc:1240] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 21. Current term is 22. Ops: []
W20260709 12:12:34.078657 20581 log.cc:927] Time spent T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:12:34.043869 20591 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:34.373950 13683 raft_consensus.cc:2393] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 20: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
W20260709 12:12:34.173043 20604 log.cc:927] Time spent T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.262s	user 0.000s	sys 0.002s
W20260709 12:12:34.181587 20557 consensus_meta.cc:287] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.809s	user 0.010s	sys 0.007s
I20260709 12:12:34.373714 20467 consensus_queue.cc:237] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:34.375733 20557 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:34.377156 20507 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:34.140177 20392 raft_consensus.cc:697] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 17 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:34.377995 20507 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:34.292143 20190 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:34.290424 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:34.307806 20220 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:34.318913 13762 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 17.
I20260709 12:12:34.321157 20457 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:34.292762 20456 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:34.330049 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:12:34.334496 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 73225.7us
I20260709 12:12:34.334519 20262 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:34.075208 20583 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:34.384085 20457 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:34.390571 20482 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:34.391043 13831 raft_consensus.cc:2393] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 16: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:34.391628 20482 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:34.331023 13680 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 20.
I20260709 12:12:34.392437 20456 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:34.392972 20557 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:34.393522 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:34.394419 13680 raft_consensus.cc:2468] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 14.
I20260709 12:12:34.395254 20456 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:34.374266 20591 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:34.365036 13687 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 17.
I20260709 12:12:34.365068 13763 raft_consensus.cc:2368] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 18. Current term is 19.
I20260709 12:12:34.401981 13679 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:34.402441 20583 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:34.402079 14379 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:34.390157 20220 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:34.392022 20262 consensus_queue.cc:1048] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:34.357391 13682 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:34.349248 20577 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:34.353878 20422 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:34.410914 20442 raft_consensus.cc:2804] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:34.411660 20442 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:34.412123 20442 raft_consensus.cc:3060] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:34.414341 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:34.416052 20575 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:34.291277 13761 rpcz_store.cc:276] 0709 12:12:33.192514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:33.192743 (+   229us) service_pool.cc:224] Handling call
0709 12:12:33.193094 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:33.254420 (+ 61326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:33.254468 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:33.266435 (+ 11967us) log.cc:844] Serialized 26 byte log entry
0709 12:12:33.685346 (+418911us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:33.685394 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:33.685461 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:34.052464 (+367003us) spinlock_profiling.cc:243] Waited 40.9 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:12:34.234618 (+182154us) raft_consensus.cc:1685] finished
0709 12:12:34.234660 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:34.235152 (+   492us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61123,"raft.queue_time_us":67332,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":9146,"spinlock_wait_cycles":93963008,"thread_start_us":363152,"threads_started":1,"wal-append.queue_time_us":463049}
I20260709 12:12:34.427924 20220 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:12:34.429900 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:34.429379 20591 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:34.430992 13836 raft_consensus.cc:2393] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 20: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:34.453466 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:34.444197 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:34.444579 20468 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:34.467733 13755 raft_consensus.cc:1275] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:12:34.477610 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:34.477533 20464 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:34.478628 13680 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:34.382102 20392 consensus_queue.cc:237] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:34.464151 20465 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:34.490264 20559 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:34.492695 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:34.493046 20559 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 21 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:34.452369 20451 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:34.461948 20514 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:34.513825 13682 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 16.
I20260709 12:12:34.514436 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:34.515339 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:34.515529 13687 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 18.
I20260709 12:12:34.516335 13682 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 19.
I20260709 12:12:34.516889 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:34.517627 13761 pending_rounds.cc:85] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting all ops after (but not including) 15
W20260709 12:12:34.518018 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:34.519398 20559 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:34.519939 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:34.520095 20559 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:34.520782 13682 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 16.
I20260709 12:12:34.518041 13761 pending_rounds.cc:107] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting uncommitted NO_OP operation due to leader change: 23.16
I20260709 12:12:34.522439 13761 raft_consensus.cc:2889] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:34.522924 20559 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:34.534371 13679 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 18.
I20260709 12:12:34.543396 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:34.527302 20492 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:34.548604 13687 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 19.
I20260709 12:12:34.551963 20492 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:34.552673 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:34.553072 20457 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:34.554448 13687 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 19.
I20260709 12:12:34.555356 20492 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:34.561460 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:34.582288 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:34.586634 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:34.587298 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:34.588797 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:34.587486 13759 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 16.
W20260709 12:12:34.582917 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 427394us
I20260709 12:12:34.603190 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:34.603190 20457 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 23 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:34.604930 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:34.606267 13687 raft_consensus.cc:2393] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 20: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:34.589560 20464 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:34.622166 20577 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:34.626225 13680 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 18.
I20260709 12:12:34.608336 20467 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:34.630300 20467 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:34.639539 13685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 1208) took 2318 ms. Trace:
I20260709 12:12:34.640014 13685 rpcz_store.cc:276] 0709 12:12:32.321165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.321291 (+   126us) service_pool.cc:224] Handling call
0709 12:12:32.321592 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:33.084671 (+763079us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:34.633718 (+1549047us) spinlock_profiling.cc:243] Waited 746 ms on lock 0x7b540006f754. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:34.639345 (+  5627us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1714759552}
I20260709 12:12:34.642153 20507 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:34.647006 13681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 3252) took 1182 ms. Trace:
I20260709 12:12:34.648604 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:34.649979 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:34.651021 13756 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:34.651068 13758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48120 (request call id 2382) took 1431 ms. Trace:
I20260709 12:12:34.657920 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:34.641408 20467 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:34.641541 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:34.649557 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:34.647621 13681 rpcz_store.cc:276] 0709 12:12:33.464981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:33.465394 (+   413us) service_pool.cc:224] Handling call
0709 12:12:34.646561 (+1181167us) spinlock_profiling.cc:243] Waited 54.9 ms on lock 0x7b54003f07d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:34.646787 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":126364544}
I20260709 12:12:34.657469 13758 rpcz_store.cc:276] 0709 12:12:33.219989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:33.220212 (+   223us) service_pool.cc:224] Handling call
0709 12:12:34.650456 (+1430244us) spinlock_profiling.cc:243] Waited 361 ms on lock 0x7b540038c2d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:34.650783 (+   327us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":830210304}
I20260709 12:12:34.662209 20326 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:34.686008 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:34.691876 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:34.696385 20326 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:34.706836 13763 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Advancing to term 23
I20260709 12:12:34.708139 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:34.714490 13681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 1226) took 1079 ms. Trace:
I20260709 12:12:34.714987 13681 rpcz_store.cc:276] 0709 12:12:33.635008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:34.687903 (+1052895us) service_pool.cc:224] Handling call
0709 12:12:34.690329 (+  2426us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:34.714080 (+ 23751us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:34.714113 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:34.714178 (+    65us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:34.714218 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:34.714303 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:34.714415 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:34.716447 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:34.716683 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:34.719667 13679 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:34.718736 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:34.717163 13681 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 17.
I20260709 12:12:34.709442 13834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54830 (request call id 3089) took 1061 ms. Trace:
I20260709 12:12:34.720752 13834 rpcz_store.cc:276] 0709 12:12:33.648103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:34.707511 (+1059408us) service_pool.cc:224] Handling call
0709 12:12:34.709330 (+  1819us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:34.718137 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:34.695917 20467 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:34.724288 20467 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:34.726866 20467 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:12:34.727622 20631 log.cc:927] Time spent T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 12:12:34.730608 14380 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:34.713656 20442 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:34.739179 20442 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:34.743821 20326 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:34.744617 20523 raft_consensus.cc:2749] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:34.751250 14414 raft_consensus.cc:1240] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 18. Current term is 19. Ops: [18.15-18.15]
I20260709 12:12:34.751597 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:12:34.751914 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:34.752458 13685 raft_consensus.cc:2468] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 14.
I20260709 12:12:34.765352 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:34.766638 13834 raft_consensus.cc:2410] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:12:34.767127 13834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54830 (request call id 3088) took 1135 ms. Trace:
I20260709 12:12:34.767462 13834 rpcz_store.cc:276] 0709 12:12:33.632063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:34.764909 (+1132846us) service_pool.cc:224] Handling call
0709 12:12:34.767038 (+  2129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:34.768764 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:34.771056 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:34.771842 13681 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 19.
I20260709 12:12:34.772784 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:34.780145 20392 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:34.780452 13800 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:34.784111 13800 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:34.785300 20567 raft_consensus.cc:2804] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:34.786022 20467 raft_consensus.cc:2764] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 12:12:34.785705 20567 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:34.787258 20567 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:34.793023 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:34.793853 13763 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 23.
W20260709 12:12:34.790031 20627 log.cc:927] Time spent T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.167s	user 0.000s	sys 0.005s
I20260709 12:12:34.798585 13681 raft_consensus.cc:2393] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 16: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:34.798449 13836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54830 (request call id 3084) took 1199 ms. Trace:
I20260709 12:12:34.800585 13756 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 21.
I20260709 12:12:34.769634 13834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35422 (request call id 1239) took 1209 ms. Trace:
I20260709 12:12:34.801991 13834 rpcz_store.cc:276] 0709 12:12:33.559940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:34.768275 (+1208335us) service_pool.cc:224] Handling call
0709 12:12:34.769569 (+  1294us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:34.799110 13836 rpcz_store.cc:276] 0709 12:12:33.591684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:34.312759 (+721075us) service_pool.cc:224] Handling call
0709 12:12:34.790066 (+477307us) spinlock_profiling.cc:243] Waited 44.9 ms on lock 0x7b54002a7454. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:34.790256 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":103328000}
I20260709 12:12:34.760296 13679 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 20.
I20260709 12:12:34.805343 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:34.806680 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:34.808820 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:34.810832 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:34.813246 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:34.815660 13758 raft_consensus.cc:2393] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 18: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:34.816396 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:34.817998 13679 raft_consensus.cc:2393] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 20: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:34.819025 14410 raft_consensus.cc:1275] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
W20260709 12:12:34.819474 20641 log.cc:927] Time spent T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:12:34.820535 13685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 3274) took 1174 ms. Trace:
I20260709 12:12:34.824847 13685 rpcz_store.cc:276] 0709 12:12:33.646736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:34.817177 (+1170441us) service_pool.cc:224] Handling call
0709 12:12:34.819917 (+  2740us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:34.820183 (+   266us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:34.820221 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:34.820265 (+    44us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:34.820300 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:34.820360 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:34.820466 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:34.821393 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:34.822412 13756 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:34.823495 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:34.830744 13758 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 19.
I20260709 12:12:34.831728 20464 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:34.832399 20464 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:34.817269 20467 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:34.833946 20392 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:34.834399 20467 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:34.836745 20392 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:34.837007 20467 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:34.828547 13681 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 16.
I20260709 12:12:34.844316 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:34.852035 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:34.850492 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:12:34.854997 20636 log.cc:927] Time spent T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 12:12:34.856383 13685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 3277) took 1038 ms. Trace:
I20260709 12:12:34.857349 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:34.858253 13760 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:34.858608 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:34.859452 14414 raft_consensus.cc:2368] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 14. Current term is 15.
I20260709 12:12:34.856906 13685 rpcz_store.cc:276] 0709 12:12:33.818621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:34.843906 (+1025285us) service_pool.cc:224] Handling call
0709 12:12:34.855834 (+ 11928us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:34.856029 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:34.856053 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:34.856096 (+    43us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:34.856133 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:34.856195 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:34.856330 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:34.859907 13682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 1225) took 1272 ms. Trace:
I20260709 12:12:34.860833 13836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54830 (request call id 3078) took 1304 ms. Trace:
I20260709 12:12:34.861343 13836 rpcz_store.cc:276] 0709 12:12:33.556054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:34.808776 (+1252722us) service_pool.cc:224] Handling call
0709 12:12:34.860768 (+ 51992us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:34.862834 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:34.863950 13836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54830 (request call id 3085) took 1263 ms. Trace:
I20260709 12:12:34.864411 13836 rpcz_store.cc:276] 0709 12:12:33.600342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:34.862321 (+1261979us) service_pool.cc:224] Handling call
0709 12:12:34.863865 (+  1544us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:34.869336 13760 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 20.
I20260709 12:12:34.875761 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:34.879277 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:12:34.879377 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:34.880654 20354 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:34.880970 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:34.882676 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:34.883540 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:34.897368 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:34.884167 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:12:34.884529 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:34.884615 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:34.884981 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:34.860376 13682 rpcz_store.cc:276] 0709 12:12:33.592723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:34.521543 (+928820us) service_pool.cc:224] Handling call
0709 12:12:34.532116 (+ 10573us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:34.561272 (+ 29156us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:34.561313 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:34.565171 (+  3858us) log.cc:844] Serialized 26 byte log entry
0709 12:12:34.719729 (+154558us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:34.719769 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:34.719833 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:34.859632 (+139799us) raft_consensus.cc:1685] finished
0709 12:12:34.859653 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:34.859810 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5916,"raft.queue_time_us":18756,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":21012,"thread_start_us":146849,"threads_started":1,"wal-append.queue_time_us":288438}
W20260709 12:12:34.901199 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:34.901378 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:34.901762 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:34.903055 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:34.903761 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:34.903929 14411 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 17.
I20260709 12:12:34.904490 14408 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 19.
I20260709 12:12:34.904759 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:33.551863 13828 rpcz_store.cc:276] 0709 12:12:32.483847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.521847 (+ 38000us) service_pool.cc:224] Handling call
0709 12:12:32.551046 (+ 29199us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:32.551400 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:32.551434 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:32.552039 (+   605us) log.cc:844] Serialized 52 byte log entry
0709 12:12:33.530404 (+978365us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b18003dc120. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa927b354bc 00007fa924e8348b 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9fc02 00007fa927b2720b 00007fa927b2cd23 00007fa927b2d0d1
0709 12:12:33.530601 (+   197us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:33.547668 (+ 17067us) log.cc:844] Serialized 14 byte log entry
0709 12:12:33.547956 (+   288us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:33.548063 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:33.548115 (+    52us) raft_consensus.cc:1685] finished
0709 12:12:33.551036 (+  2921us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:33.551195 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":18665,"raft.queue_time_us":59580,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":7030,"spinlock_wait_cycles":27504896,"thread_start_us":45707,"threads_started":1,"wal-append.queue_time_us":183115}
I20260709 12:12:34.903144 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:34.887583 20467 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:33.674753 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:12:34.914609 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 117059us
I20260709 12:12:34.915376 13681 raft_consensus.cc:1275] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:12:34.917744 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:34.912923 14410 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 15.
I20260709 12:12:34.923565 14412 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 19.
I20260709 12:12:34.931025 13834 raft_consensus.cc:2410] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 21 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 12:12:34.932272 20576 consensus_queue.cc:1059] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:34.933610 20576 raft_consensus.cc:3055] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:34.934087 20576 raft_consensus.cc:740] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:34.934875 20253 raft_consensus.cc:3055] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:34.935317 20253 raft_consensus.cc:740] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:34.935384 20576 consensus_queue.cc:260] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:34.936309 20253 consensus_queue.cc:260] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:34.936875 20576 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:34.939708 20585 log.cc:927] Time spent T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 1.484s	user 0.007s	sys 0.006s
W20260709 12:12:34.940544 13831 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54820 (request call id 3386) took 1858 ms (client timeout 2102 ms). Trace:
W20260709 12:12:34.941126 13831 rpcz_store.cc:269] 0709 12:12:33.082066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:33.382078 (+300012us) service_pool.cc:224] Handling call
0709 12:12:34.940240 (+1558162us) spinlock_profiling.cc:243] Waited 941 ms on lock 0x7b5400362254. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:34.940438 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2163363712}
I20260709 12:12:34.942605 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:34.944145 20482 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:34.944334 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:12:34.945403 13683 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 3250) took 1481 ms (client timeout 1540 ms). Trace:
I20260709 12:12:34.945971 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:12:34.945876 13683 rpcz_store.cc:269] 0709 12:12:33.463780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:33.464029 (+   249us) service_pool.cc:224] Handling call
0709 12:12:34.945175 (+1481146us) spinlock_profiling.cc:243] Waited 889 ms on lock 0x7b54001b03d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:34.945330 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2044264192}
I20260709 12:12:34.947041 13831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54830 (request call id 3079) took 1390 ms. Trace:
I20260709 12:12:34.947762 13683 raft_consensus.cc:1275] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:12:34.949391 14415 raft_consensus.cc:1240] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 22. Current term is 23. Ops: []
I20260709 12:12:34.947523 13831 rpcz_store.cc:276] 0709 12:12:33.556392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:34.945628 (+1389236us) service_pool.cc:224] Handling call
0709 12:12:34.946974 (+  1346us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:34.940524 13834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54830 (request call id 3077) took 1384 ms. Trace:
I20260709 12:12:34.953418 13685 raft_consensus.cc:1240] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:34.953115 13834 rpcz_store.cc:276] 0709 12:12:33.555793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:34.812288 (+1256495us) service_pool.cc:224] Handling call
0709 12:12:34.940437 (+128149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:34.954686 20338 raft_consensus.cc:3055] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:34.955354 20338 raft_consensus.cc:740] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:34.955003 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:34.956744 20338 consensus_queue.cc:260] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:34.958891 13727 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:34.963796 13760 raft_consensus.cc:2393] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 16: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:34.957423 20523 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:34.961124 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:34.937511 20253 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:34.967679 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:34.968006 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:34.970172 20338 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:34.971418 20384 raft_consensus.cc:2764] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
W20260709 12:12:34.971881 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:34.989116 20591 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:34.989842 13727 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:34.972260 20392 consensus_queue.cc:1048] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 12:12:34.992082 20632 log.cc:927] Time spent T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.230s	user 0.000s	sys 0.003s
W20260709 12:12:34.973055 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:34.973798 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:34.994329 13755 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:34.974646 20642 log.cc:927] Time spent T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 12:12:34.977358 13834 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 17.
I20260709 12:12:34.995837 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:34.996731 13834 raft_consensus.cc:2393] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 18: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:34.997591 13680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 3273) took 1398 ms. Trace:
I20260709 12:12:34.998025 13680 rpcz_store.cc:276] 0709 12:12:33.599372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:34.687910 (+1088538us) service_pool.cc:224] Handling call
0709 12:12:34.696700 (+  8790us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:34.697236 (+   536us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:34.697263 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:34.698112 (+   849us) log.cc:844] Serialized 52 byte log entry
0709 12:12:34.827817 (+129705us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:34.827910 (+    93us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:34.828051 (+   141us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:34.997360 (+169309us) raft_consensus.cc:1685] finished
0709 12:12:34.997381 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:34.997536 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12819,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":120,"thread_start_us":117665,"threads_started":1,"wal-append.queue_time_us":141683}
I20260709 12:12:35.000344 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:35.000612 20482 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.001219 13680 raft_consensus.cc:3060] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:34.982802 13652 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:34.983430 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:35.001989 20326 raft_consensus.cc:2749] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:35.003188 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:34.984328 13801 leader_election.cc:400] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 14. Current term is 15.
I20260709 12:12:35.003768 13835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 3385) took 1922 ms. Trace:
I20260709 12:12:35.004137 13801 leader_election.cc:403] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:34.982867 13578 catalog_manager.cc:5697] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:35.004202 13835 rpcz_store.cc:276] 0709 12:12:33.080951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:33.530947 (+449996us) service_pool.cc:224] Handling call
0709 12:12:33.531371 (+   424us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:34.353934 (+822563us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:35.003421 (+649487us) spinlock_profiling.cc:243] Waited 821 ms on lock 0x7b5400361d54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:35.003656 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1889282816}
W20260709 12:12:35.005738 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 43581.8us
I20260709 12:12:34.999231 20593 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:35.006759 13651 leader_election.cc:400] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 18. Current term is 19.
I20260709 12:12:35.007429 13829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 1225) took 2085 ms. Trace:
I20260709 12:12:35.007182 20593 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:35.007862 13829 rpcz_store.cc:276] 0709 12:12:32.921832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.921987 (+   155us) service_pool.cc:224] Handling call
0709 12:12:32.922358 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:34.050309 (+1127951us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:35.006941 (+956632us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54000b27d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:35.007247 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2589061376}
I20260709 12:12:35.010411 13830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 3383) took 2011 ms. Trace:
W20260709 12:12:35.010682 20629 log.cc:927] Time spent T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.204s	user 0.000s	sys 0.002s
I20260709 12:12:35.010914 13830 rpcz_store.cc:276] 0709 12:12:32.998797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:33.496051 (+497254us) service_pool.cc:224] Handling call
0709 12:12:33.496335 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:34.353360 (+857025us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:35.010119 (+656759us) spinlock_profiling.cc:243] Waited 856 ms on lock 0x7b54001680d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:35.010335 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1968588672}
I20260709 12:12:35.011920 20456 consensus_queue.cc:1059] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:35.012732 13686 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:35.012923 20454 consensus_queue.cc:1059] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:35.013993 20456 raft_consensus.cc:3055] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:35.014497 20456 raft_consensus.cc:740] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:35.014674 20454 raft_consensus.cc:3055] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:35.015164 20454 raft_consensus.cc:740] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:12:35.016144 20638 log.cc:927] Time spent T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.242s	user 0.002s	sys 0.000s
I20260709 12:12:35.019387 13754 raft_consensus.cc:1240] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 22. Current term is 23. Ops: []
I20260709 12:12:35.022162 13683 raft_consensus.cc:1240] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:35.016296 20454 consensus_queue.cc:260] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:35.017508 13837 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54820 (request call id 3378) took 2290 ms (client timeout 1934 ms). Trace:
W20260709 12:12:35.023900 13837 rpcz_store.cc:269] 0709 12:12:32.726707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.729633 (+  2926us) service_pool.cc:224] Handling call
0709 12:12:35.017045 (+2287412us) spinlock_profiling.cc:243] Waited 831 ms on lock 0x7b5400167bd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:35.017259 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1910280064}
I20260709 12:12:34.982117 20464 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:35.025914 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:35.007218 13651 leader_election.cc:403] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:35.027135 13835 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 19.
I20260709 12:12:35.027912 13651 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:35.030164 20190 raft_consensus.cc:2804] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:35.001447 20482 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:35.030745 20190 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:35.031317 20190 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:35.031823 13832 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35422 (request call id 1233) took 1943 ms (client timeout 1766 ms). Trace:
W20260709 12:12:35.032310 13832 rpcz_store.cc:269] 0709 12:12:33.087811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:33.147205 (+ 59394us) service_pool.cc:224] Handling call
0709 12:12:35.031433 (+1884228us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b54000da554. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:35.031620 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":255577472}
I20260709 12:12:35.037192 13684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 1223) took 1472 ms. Trace:
W20260709 12:12:35.041133 20588 log.cc:927] Time spent T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 1.601s	user 0.004s	sys 0.000s
W20260709 12:12:35.041392 20640 log.cc:927] Time spent T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.317s	user 0.002s	sys 0.000s
W20260709 12:12:35.047293 20626 log.cc:927] Time spent T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.209s	user 0.001s	sys 0.001s
W20260709 12:12:35.051299 20637 log.cc:927] Time spent T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.213s	user 0.002s	sys 0.000s
I20260709 12:12:35.050631 13578 catalog_manager.cc:5697] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:12:35.054430 20514 raft_consensus.cc:2804] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:35.055056 20514 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:35.056052 13833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 1231) took 2119 ms. Trace:
I20260709 12:12:35.061468 20507 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:35.021515 13754 raft_consensus.cc:1275] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:12:35.064316 20523 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:35.022822 20456 consensus_queue.cc:260] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:35.030479 13726 leader_election.cc:336] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.656s (SENT)
I20260709 12:12:35.000366 14379 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:12:35.077558 20607 log.cc:927] Time spent T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.980s	user 0.005s	sys 0.002s
I20260709 12:12:35.067744 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:35.079260 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:12:35.078529 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 95875.8us
I20260709 12:12:35.075448 13836 raft_consensus.cc:2468] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 13.
I20260709 12:12:35.083443 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:35.082001 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:35.055531 20514 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:35.092944 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:35.056608 13833 rpcz_store.cc:276] 0709 12:12:32.936823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:33.018277 (+ 81454us) service_pool.cc:224] Handling call
0709 12:12:33.018658 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:33.069234 (+ 50576us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:33.069276 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:33.069842 (+   566us) log.cc:844] Serialized 26 byte log entry
0709 12:12:33.233330 (+163488us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:33.233368 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:33.233440 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:34.903919 (+1670479us) spinlock_profiling.cc:243] Waited 47.8 ms on lock 0x7b48001bd758. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92ceb6aa1 00007fa92ceadb37 00007fa92cead9ca 00007fa92cfa526f 00007fa92cfa4f37 00007fa92cfb955c 00007fa92cfb9508 00007fa92cfb9488 00007fa92cfb9443 00007fa92cfb86ec 00007fa92bee2a96
0709 12:12:35.039978 (+136059us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:12:35.055605 (+ 15627us) raft_consensus.cc:1685] finished
0709 12:12:35.055627 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:35.055850 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50174,"raft.queue_time_us":56651,"raft.run_cpu_time_us":4103,"raft.run_wall_time_us":1819564,"spinlock_wait_cycles":135411968,"thread_start_us":71678,"threads_started":1,"wal-append.queue_time_us":216639}
I20260709 12:12:35.062172 20467 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:35.096096 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:35.103353 20456 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:35.103820 20467 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:35.055497 13684 rpcz_store.cc:276] 0709 12:12:33.564756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:34.256839 (+692083us) service_pool.cc:224] Handling call
0709 12:12:34.257435 (+   596us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:34.263969 (+  6534us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:12:34.328410 (+ 64441us) log.cc:844] Serialized 14 byte log entry
0709 12:12:34.506398 (+177988us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:34.506621 (+   223us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:34.511528 (+  4907us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:35.035818 (+524290us) spinlock_profiling.cc:243] Waited 1.43 ms on lock 0x7b18000c1e40. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e6e2a6 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419
0709 12:12:35.036831 (+  1013us) spinlock_profiling.cc:243] Waited 4.92 ms on lock 0x7b54002846d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:35.036901 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:35.037102 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10040,"prepare.queue_time_us":57104,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":62,"raft.queue_time_us":44707,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":27110,"spinlock_wait_cycles":14594688,"thread_start_us":79400,"threads_started":1,"wal-append.queue_time_us":233283}
W20260709 12:12:35.105988 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 105695us
I20260709 12:12:35.106820 14379 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:35.108096 20566 raft_consensus.cc:2804] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:35.108697 20566 raft_consensus.cc:697] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 21 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:35.109016 13680 raft_consensus.cc:2468] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 15.
I20260709 12:12:35.109869 20451 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.110566 20451 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:35.112694 20112 consensus_queue.cc:1048] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:35.098167 13578 catalog_manager.cc:5697] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 9 to 18, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 18 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:35.118613 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:12:35.098539 20630 log.cc:927] Time spent T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 12:12:35.109964 20442 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:12:35.096276 20617 raft_consensus.cc:3060] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:12:35.077965 20507 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:35.134804 13578 catalog_manager.cc:5697] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
W20260709 12:12:35.138116 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 59249.7us
W20260709 12:12:35.099351 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 68964.2us
I20260709 12:12:35.109982 20566 consensus_queue.cc:237] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:35.156034 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:35.156828 14410 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 14.
I20260709 12:12:35.161816 13835 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:35.162711 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:35.165452 13755 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 19.
I20260709 12:12:35.166258 13831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54830 (request call id 3087) took 1548 ms. Trace:
I20260709 12:12:35.166797 13831 rpcz_store.cc:276] 0709 12:12:33.618353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:34.979128 (+1360775us) service_pool.cc:224] Handling call
0709 12:12:35.166195 (+187067us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:35.168217 13758 raft_consensus.cc:1240] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 18. Current term is 19. Ops: [18.15-18.15]
I20260709 12:12:35.169423 13834 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:35.162559 20454 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:35.180688 13754 raft_consensus.cc:1240] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:35.174198 20354 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.182979 20451 leader_election.cc:290] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:35.182888 20354 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:35.183844 20457 consensus_queue.cc:1048] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:35.184245 13688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 3262) took 1636 ms. Trace:
I20260709 12:12:35.155280 20442 raft_consensus.cc:697] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 23 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:35.098573 20326 consensus_queue.cc:1059] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.095s
I20260709 12:12:35.185415 20354 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:12:35.194492 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:35.193120 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:35.194900 13835 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 22.
W20260709 12:12:35.195858 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 300076us
I20260709 12:12:35.203001 20326 raft_consensus.cc:3055] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:12:35.203583 20326 raft_consensus.cc:740] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:35.203365 13578 catalog_manager.cc:5697] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:35.204704 20326 consensus_queue.cc:260] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:35.203398 13800 leader_election.cc:336] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.604s (SENT)
I20260709 12:12:35.212066 13756 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 20.
I20260709 12:12:35.213644 13836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 3388) took 2115 ms. Trace:
I20260709 12:12:35.215692 13800 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:35.214128 13836 rpcz_store.cc:276] 0709 12:12:33.083983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.122752 (+2038769us) service_pool.cc:224] Handling call
0709 12:12:35.195698 (+ 72946us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:35.198805 (+  3107us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:35.198837 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:35.198889 (+    52us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:35.198923 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:35.199003 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:35.199126 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:12:35.203002 20644 log.cc:927] Time spent T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 12:12:35.215495 20467 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:35.236847 20326 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:12:35.224011 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 72487.1us
I20260709 12:12:35.237859 13837 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 22.
I20260709 12:12:35.213282 20354 consensus_queue.cc:1048] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:12:35.237324 20467 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:35.242504 20467 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:12:35.229913 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:35.243608 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:35.229679 14380 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:35.236205 13830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 1235) took 1996 ms. Trace:
I20260709 12:12:35.244607 13830 rpcz_store.cc:276] 0709 12:12:33.239393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.198987 (+1959594us) service_pool.cc:224] Handling call
0709 12:12:35.235478 (+ 36491us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:35.235742 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:35.235772 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:35.235867 (+    95us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:35.235904 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:35.235973 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:35.236111 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:35.246984 13830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 1237) took 1940 ms. Trace:
I20260709 12:12:35.247072 20507 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:35.247960 13830 rpcz_store.cc:276] 0709 12:12:33.306837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.245617 (+1938780us) service_pool.cc:224] Handling call
0709 12:12:35.246266 (+   649us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:35.246593 (+   327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:35.246618 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:35.246666 (+    48us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:35.246699 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:35.246783 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:35.246903 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:12:35.251286 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:35.251693 13727 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:35.253151 20384 raft_consensus.cc:2764] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:12:35.253261 13727 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:35.255208 13726 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
W20260709 12:12:35.258155 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 50246.5us
I20260709 12:12:35.258387 20593 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:35.199054 20482 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:12:35.260524 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 46213.8us
I20260709 12:12:35.269979 14379 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:12:35.273419 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 43792.9us
I20260709 12:12:35.298406 13828 raft_consensus.cc:2410] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for term 19 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 12:12:35.305222 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:35.184716 13688 rpcz_store.cc:276] 0709 12:12:33.547407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:33.547537 (+   130us) service_pool.cc:224] Handling call
0709 12:12:33.547985 (+   448us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:33.548473 (+   488us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:33.548522 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:33.549193 (+   671us) log.cc:844] Serialized 26 byte log entry
0709 12:12:33.599359 (+ 50166us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:33.599414 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:33.599599 (+   185us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:34.869358 (+1269759us) spinlock_profiling.cc:243] Waited 5.97 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:12:35.183728 (+314370us) raft_consensus.cc:1685] finished
0709 12:12:35.183752 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:35.184033 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3525,"raft.queue_time_us":6695,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":7362,"spinlock_wait_cycles":13736320,"thread_start_us":49650,"threads_started":1,"wal-append.queue_time_us":214775}
I20260709 12:12:35.308719 13834 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 19.
I20260709 12:12:35.286379 20384 raft_consensus.cc:2749] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:35.311054 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:12:35.312525 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 59375.4us
I20260709 12:12:35.312805 13652 leader_election.cc:304] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:35.313663 13727 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:35.313869 20354 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:35.314630 13652 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:12:35.315052 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:35.310683 13755 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 14.
I20260709 12:12:35.277263 13578 catalog_manager.cc:5697] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 15 to 17, leader changed from ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 17 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:12:35.322649 13685 raft_consensus.cc:1275] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:12:35.325031 14379 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:35.317647 13682 raft_consensus.cc:1240] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 23. Current term is 24. Ops: []
I20260709 12:12:35.340471 13686 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 19.
W20260709 12:12:35.332406 13586 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45618 (request call id 234) took 74253 ms (client timeout 15000 ms). Trace:
I20260709 12:12:35.323040 13801 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:35.324509 13578 catalog_manager.cc:5697] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 11 to 16, leader changed from ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 16 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:12:35.353312 20523 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:35.316892 20190 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:35.354619 20546 raft_consensus.cc:2749] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 18. Current term is 19.
I20260709 12:12:35.325383 20354 raft_consensus.cc:2749] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:35.356747 20354 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:35.357076 20546 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:35.357296 20354 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:35.359552 13758 raft_consensus.cc:1275] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:12:35.359746 20354 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:35.360853 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:35.361189 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:35.362331 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:35.278117 20482 raft_consensus.cc:2804] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:35.360853 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:35.364681 13682 raft_consensus.cc:2393] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 20: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:35.316843 13652 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:35.365832 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:35.348886 13801 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:35.367395 13801 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:35.341535 13686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 3279) took 1330 ms. Trace:
I20260709 12:12:35.236862 20567 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:35.318676 20384 raft_consensus.cc:2804] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:35.317014 20464 raft_consensus.cc:2749] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:35.324690 19918 raft_consensus.cc:2749] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:12:35.377570 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:35.378012 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:35.356027 20190 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:35.334568 20593 raft_consensus.cc:2804] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:35.378052 13686 rpcz_store.cc:276] 0709 12:12:34.011552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:34.230689 (+219137us) service_pool.cc:224] Handling call
0709 12:12:35.012540 (+781851us) spinlock_profiling.cc:243] Waited 3.79 ms on lock 0x7b5400245328. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd6a5f4 00007fa92cf53227 00007fa92cf52ab8 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:35.341452 (+328912us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8726400}
I20260709 12:12:35.369061 20576 raft_consensus.cc:2804] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:35.319342 20507 raft_consensus.cc:2749] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:35.352907 13578 catalog_manager.cc:5697] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:35.399639 13801 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:12:35.402119 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 85372.7us
I20260709 12:12:35.392581 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:35.369109 20482 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:35.406389 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:35.407958 13680 raft_consensus.cc:1240] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:35.379756 20617 raft_consensus.cc:2749] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 14. Current term is 15.
I20260709 12:12:35.326673 20339 consensus_queue.cc:1048] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.060s
I20260709 12:12:35.385425 20451 raft_consensus.cc:2749] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:35.419481 13801 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:35.420811 13652 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:35.387368 13688 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 22.
I20260709 12:12:35.419536 20564 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.429940 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:35.425596 13726 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:35.312561 20442 consensus_queue.cc:237] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:35.434082 13685 raft_consensus.cc:1275] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:12:35.435174 13834 raft_consensus.cc:1240] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 21. Current term is 22. Ops: [21.14-21.14]
I20260709 12:12:35.417248 20523 raft_consensus.cc:2804] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:35.357695 20546 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:35.415589 20482 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:35.407519 20576 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:35.445689 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:35.419662 20572 raft_consensus.cc:2804] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:35.419418 20467 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:35.417053 20593 raft_consensus.cc:697] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 15 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:35.452392 13834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 3075) took 1905 ms. Trace:
I20260709 12:12:35.503337 13834 rpcz_store.cc:276] 0709 12:12:33.540273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.382466 (+1842193us) service_pool.cc:224] Handling call
0709 12:12:35.434851 (+ 52385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:35.444694 (+  9843us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:35.445078 (+   384us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:35.447500 20507 raft_consensus.cc:2749] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:35.455214 13828 raft_consensus.cc:1240] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 17 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:35.504460 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:12:35.520993 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:35.522559 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:35.523272 13754 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:35.530426 13679 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.022s	sys 0.016s
W20260709 12:12:35.538908 13679 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.022s	sys 0.016s
I20260709 12:12:35.525962 13651 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:35.542584 13828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 3081) took 1978 ms. Trace:
I20260709 12:12:35.543125 13828 rpcz_store.cc:276] 0709 12:12:33.564089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.399137 (+1835048us) service_pool.cc:224] Handling call
0709 12:12:35.404418 (+  5281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:35.542287 (+137869us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:35.542517 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:35.496129 20576 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:35.494831 20564 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:35.495541 20523 raft_consensus.cc:697] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 19 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
W20260709 12:12:35.594332 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 177874us
W20260709 12:12:35.595996 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 176604us
I20260709 12:12:35.602265 20406 raft_consensus.cc:2749] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:35.494057 20572 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:35.667984 13801 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:12:35.676003 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 79067.3us
I20260709 12:12:35.602311 20593 consensus_queue.cc:237] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:35.679864 13726 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
W20260709 12:12:35.685624 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 159958us
I20260709 12:12:35.686075 13828 raft_consensus.cc:1240] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 13. Current term is 15. Ops: []
I20260709 12:12:35.688292 20451 raft_consensus.cc:2804] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:35.688130 20338 consensus_queue.cc:1059] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:35.689003 20451 raft_consensus.cc:697] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 20 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:35.671799 20492 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.678517 20572 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:35.691565 13828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 3083) took 2126 ms. Trace:
I20260709 12:12:35.698844 13828 rpcz_store.cc:276] 0709 12:12:33.565688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.543969 (+1978281us) service_pool.cc:224] Handling call
0709 12:12:35.685817 (+141848us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:35.691211 (+  5394us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:35.691481 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:12:35.697597 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 276880us
I20260709 12:12:35.679648 20467 raft_consensus.cc:2804] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:12:35.699705 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 459885us
W20260709 12:12:35.710753 13800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:35.696949 20392 raft_consensus.cc:2749] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:35.721112 14410 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.009s	sys 0.042s
W20260709 12:12:35.727916 14410 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.009s	sys 0.042s
I20260709 12:12:35.709240 20465 raft_consensus.cc:2804] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:12:35.347352 13586 rpcz_store.cc:269] 0709 12:11:21.078667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.079125 (+   458us) service_pool.cc:224] Handling call
0709 12:12:35.332134 (+74253009us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:24.189074 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:24.189764 (+   690us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:24.189844 (+    80us) write_op.cc:435] Acquired schema lock
0709 12:12:24.189865 (+    21us) tablet.cc:662] Decoding operations
0709 12:12:24.190801 (+   936us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:24.190895 (+    94us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:24.190923 (+    28us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:12:24.191730 (+   807us) tablet.cc:701] Row locks acquired
0709 12:12:24.191774 (+    44us) write_op.cc:260] PREPARE: finished
0709 12:12:24.191975 (+   201us) write_op.cc:270] Start()
0709 12:12:24.192147 (+   172us) write_op.cc:276] Timestamp: P: 1783599144191911 usec, L: 0
0709 12:12:24.192204 (+    57us) op_driver.cc:348] REPLICATION: starting
0709 12:12:24.217024 (+ 24820us) log.cc:844] Serialized 2870 byte log entry
0709 12:12:24.384206 (+167182us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa924e830ac 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9fc02 00007fa927b2720b
0709 12:12:24.747073 (+362867us) spinlock_profiling.cc:243] Waited 1.01 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:12:24.830841 (+ 83768us) op_driver.cc:464] REPLICATION: finished
0709 12:12:25.167323 (+336482us) write_op.cc:301] APPLY: starting
0709 12:12:25.179714 (+ 12391us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:25.308930 (+129216us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:25.315834 (+  6904us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:25.676800 (+360966us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:25.677101 (+   301us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 12:12:25.677168 (+    67us) write_op.cc:312] APPLY: finished
0709 12:12:25.677541 (+   373us) log.cc:844] Serialized 73 byte log entry
0709 12:12:25.677743 (+   202us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:25.682276 (+  4533us) write_op.cc:454] Released schema lock
0709 12:12:25.688682 (+  6406us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:25.732762 (+ 44080us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:25.736342 (+  3580us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2505390,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":278264,"apply.run_cpu_time_us":15764,"apply.run_wall_time_us":596030,"cfile_cache_hit":30,"cfile_cache_hit_bytes":33387,"num_ops":7,"prepare.queue_time_us":370859,"prepare.run_cpu_time_us":16079,"prepare.run_wall_time_us":287172,"raft.queue_time_us":71466,"raft.run_cpu_time_us":7872,"raft.run_wall_time_us":117105,"replication_time_us":638386,"spinlock_wait_cycles":29390336,"thread_start_us":621271,"threads_started":4,"wal-append.queue_time_us":241566,"wal-append.run_cpu_time_us":20398,"wal-append.run_wall_time_us":2210388}]]}
I20260709 12:12:35.706482 20467 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
W20260709 12:12:35.735214 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 416223us
W20260709 12:12:35.722838 20514 consensus_meta.cc:287] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.584s	user 0.000s	sys 0.015s
I20260709 12:12:35.736454 13727 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
W20260709 12:12:35.749953 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 424971us
I20260709 12:12:35.724210 20384 raft_consensus.cc:697] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:35.775277 13828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 1241) took 1532 ms. Trace:
I20260709 12:12:35.775883 13828 rpcz_store.cc:276] 0709 12:12:34.243238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.709190 (+1465952us) service_pool.cc:224] Handling call
0709 12:12:35.730412 (+ 21222us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:35.751784 (+ 21372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:35.751832 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:35.751901 (+    69us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:35.774908 (+ 23007us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:35.775010 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:35.775193 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:35.732141 20406 raft_consensus.cc:2749] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:35.733562 20567 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:12:35.750870 20456 consensus_meta.cc:287] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.642s	user 0.011s	sys 0.004s
W20260709 12:12:35.774320 20326 consensus_meta.cc:287] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.537s	user 0.012s	sys 0.003s
W20260709 12:12:35.781527 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:35.786430 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 112249us
I20260709 12:12:35.738096 20467 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:35.805217 13834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 3082) took 2225 ms. Trace:
I20260709 12:12:35.812220 14409 raft_consensus.cc:1240] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 21 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:35.812103 20384 consensus_queue.cc:237] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:35.780025 13836 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.014s	sys 0.032s
I20260709 12:12:35.725103 20507 consensus_queue.cc:1048] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.049s
W20260709 12:12:35.817621 13836 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.014s	sys 0.032s
I20260709 12:12:35.811167 13834 rpcz_store.cc:276] 0709 12:12:33.564328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.518482 (+1954154us) service_pool.cc:224] Handling call
0709 12:12:35.715131 (+196649us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:35.789491 (+ 74360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:35.789535 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:35.789595 (+    60us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:35.789628 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:35.789718 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:35.789900 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:35.820320 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:35.733271 20492 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:35.690884 13578 catalog_manager.cc:5697] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:35.748577 20514 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:35.726949 20523 consensus_queue.cc:237] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:35.819310 20546 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:35.857059 13828 raft_consensus.cc:1240] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:35.861210 13679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 3275) took 2177 ms. Trace:
I20260709 12:12:35.858851 13834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 3393) took 1125 ms. Trace:
W20260709 12:12:35.866439 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 157304us
I20260709 12:12:35.866046 13834 rpcz_store.cc:276] 0709 12:12:34.725139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.823183 (+1098044us) service_pool.cc:224] Handling call
0709 12:12:35.842857 (+ 19674us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:35.850396 (+  7539us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:35.850438 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:35.850497 (+    59us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:35.850542 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:35.850628 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:35.850954 (+   326us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:12:35.870538 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 134270us
I20260709 12:12:35.874310 13727 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:35.876387 13828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 3392) took 1151 ms. Trace:
I20260709 12:12:35.879509 13828 rpcz_store.cc:276] 0709 12:12:34.724785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.777187 (+1052402us) service_pool.cc:224] Handling call
0709 12:12:35.804656 (+ 27469us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:35.875952 (+ 71296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:35.876296 (+   344us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:35.869057 20406 raft_consensus.cc:2804] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:35.892755 20406 raft_consensus.cc:697] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:35.893822 20406 consensus_queue.cc:237] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 17.7, Last appended by leader: 7, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:35.864283 13679 rpcz_store.cc:276] 0709 12:12:33.683428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:34.824169 (+1140741us) service_pool.cc:224] Handling call
0709 12:12:34.867748 (+ 43579us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:34.896936 (+ 29188us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:12:34.914180 (+ 17244us) log.cc:844] Serialized 14 byte log entry
0709 12:12:35.851217 (+937037us) log.cc:844] Serialized 14 byte log entry
0709 12:12:35.860738 (+  9521us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:35.860818 (+    80us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:35.860878 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:35.860980 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:35.861131 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":137911,"prepare.queue_time_us":12944,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":57,"raft.queue_time_us":157531,"raft.run_cpu_time_us":267,"raft.run_wall_time_us":4805,"thread_start_us":679930,"threads_started":2,"wal-append.queue_time_us":836184}
W20260709 12:12:35.895046 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:35.895673 13830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 1238) took 2529 ms. Trace:
W20260709 12:12:35.896634 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:35.897533 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:35.896154 13830 rpcz_store.cc:276] 0709 12:12:33.366387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.249719 (+1883332us) service_pool.cc:224] Handling call
0709 12:12:35.250323 (+   604us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:35.251502 (+  1179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:35.251528 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:35.252093 (+   565us) log.cc:844] Serialized 26 byte log entry
0709 12:12:35.695993 (+443900us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:35.696043 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:35.696114 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:35.895434 (+199320us) raft_consensus.cc:1685] finished
0709 12:12:35.895453 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:35.895590 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":151,"raft.run_cpu_time_us":314,"raft.run_wall_time_us":315,"thread_start_us":443487,"threads_started":1,"wal-append.queue_time_us":574211}
I20260709 12:12:35.780681 20451 consensus_queue.cc:237] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:35.880004 20253 consensus_meta.cc:287] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.788s	user 0.013s	sys 0.001s
W20260709 12:12:35.916939 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 230332us
W20260709 12:12:35.928194 20648 log.cc:927] Time spent T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
I20260709 12:12:35.896659 13578 catalog_manager.cc:5697] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 14 to 18, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 18 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:35.939461 13652 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:12:35.890041 20454 consensus_meta.cc:287] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.718s	user 0.013s	sys 0.010s
I20260709 12:12:35.941285 13837 raft_consensus.cc:1217] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Deduplicated request from leader. Original: 15.8->[17.9-17.9]   Dedup: 17.9->[]
I20260709 12:12:35.941236 13832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 3387) took 2858 ms. Trace:
I20260709 12:12:35.952358 13837 raft_consensus.cc:1240] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 12:12:35.979068 13830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 3398) took 1200 ms. Trace:
I20260709 12:12:35.979807 13830 rpcz_store.cc:276] 0709 12:12:34.778373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.898467 (+1120094us) service_pool.cc:224] Handling call
0709 12:12:35.919337 (+ 20870us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:35.952331 (+ 32994us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:35.952379 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:35.969552 (+ 17173us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:35.978692 (+  9140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:35.978794 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:35.978965 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:12:35.982718 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:35.950065 13832 rpcz_store.cc:276] 0709 12:12:33.082992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.033527 (+1950535us) service_pool.cc:224] Handling call
0709 12:12:35.080768 (+ 47241us) spinlock_profiling.cc:243] Waited 20.4 ms on lock 0x7b5800034898. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924e68b71 00007fa924e68a22 00007fa92dd818d9 00007fa92cedbee0 00007fa92cfa50ab 00007fa92cfa5131 00007fa92cf66fc0 00007fa92cf51929 00007fa92cf513d2 00007fa9264c8bd4
0709 12:12:35.081037 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:35.185965 (+104928us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:12:35.238535 (+ 52570us) log.cc:844] Serialized 14 byte log entry
0709 12:12:35.940836 (+702301us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:35.940893 (+    57us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:35.940956 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:35.941049 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:35.941173 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":879,"prepare.queue_time_us":64966,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":185362,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":104,"spinlock_wait_cycles":46843136,"thread_start_us":694377,"threads_started":2}
W20260709 12:12:35.997237 20646 log.cc:927] Time spent T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
W20260709 12:12:35.997684 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 77011.8us
I20260709 12:12:35.998783 13652 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:35.990070 20190 raft_consensus.cc:2749] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:36.001878 20666 consensus_queue.cc:1048] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.092s
I20260709 12:12:36.002789 20190 raft_consensus.cc:2749] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:36.006314 13836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 1236) took 2699 ms. Trace:
I20260709 12:12:36.006944 13836 rpcz_store.cc:276] 0709 12:12:33.306446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.217564 (+1911118us) service_pool.cc:224] Handling call
0709 12:12:35.225514 (+  7950us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:35.240623 (+ 15109us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:35.240654 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:35.241388 (+   734us) log.cc:844] Serialized 52 byte log entry
0709 12:12:35.822092 (+580704us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:35.849292 (+ 27200us) log.cc:844] Serialized 14 byte log entry
0709 12:12:35.850037 (+   745us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:35.850192 (+   155us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:36.005960 (+155768us) raft_consensus.cc:1685] finished
0709 12:12:36.005993 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:36.006227 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14511,"prepare.queue_time_us":30208,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":46,"raft.queue_time_us":15896,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"thread_start_us":580167,"threads_started":1,"wal-append.queue_time_us":678108}
W20260709 12:12:36.019363 20649 log.cc:927] Time spent T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 12:12:36.020841 20661 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:36.021595 20661 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:36.025535 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:36.026235 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:36.033898 13837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 3076) took 2478 ms. Trace:
I20260709 12:12:36.034582 13837 rpcz_store.cc:276] 0709 12:12:33.555483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.355497 (+1800014us) service_pool.cc:224] Handling call
0709 12:12:35.941175 (+585678us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:35.971650 (+ 30475us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:36.033576 (+ 61926us) spinlock_profiling.cc:243] Waited 585 ms on lock 0x7b540002e250. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:36.033804 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1345956096}
I20260709 12:12:35.987193 20253 raft_consensus.cc:2804] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:36.078035 13833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 3390) took 2913 ms. Trace:
I20260709 12:12:36.088330 13833 rpcz_store.cc:276] 0709 12:12:33.165042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.172679 (+2007637us) service_pool.cc:224] Handling call
0709 12:12:35.206702 (+ 34023us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:35.207038 (+   336us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:12:35.693294 (+486256us) log.cc:844] Serialized 14 byte log entry
0709 12:12:36.077579 (+384285us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:36.077638 (+    59us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:36.077707 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:36.077804 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:36.077940 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43240,"prepare.queue_time_us":45303,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"thread_start_us":789860,"threads_started":2}
I20260709 12:12:35.995142 20564 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199)
W20260709 12:12:36.101945 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 287178us
I20260709 12:12:36.108310 13836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 3403) took 1327 ms. Trace:
I20260709 12:12:36.113377 13836 rpcz_store.cc:276] 0709 12:12:34.782706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:36.009496 (+1226790us) service_pool.cc:224] Handling call
0709 12:12:36.050218 (+ 40722us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:36.107561 (+ 57343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:36.107594 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:36.107659 (+    65us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:36.107701 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:36.107772 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:36.108012 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:12:36.098599 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 406422us
I20260709 12:12:36.116017 13830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 3400) took 1337 ms. Trace:
W20260709 12:12:36.118192 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 367016us
I20260709 12:12:36.118605 13830 rpcz_store.cc:276] 0709 12:12:34.779039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.981022 (+1201983us) service_pool.cc:224] Handling call
0709 12:12:36.050334 (+ 69312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:36.115499 (+ 65165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:36.115557 (+    58us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:36.115627 (+    70us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:36.115684 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:36.115776 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:36.115938 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:36.087677 20253 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:36.121331 13835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 3391) took 2843 ms. Trace:
I20260709 12:12:36.119329 13800 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:36.142331 13835 rpcz_store.cc:276] 0709 12:12:33.277832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.195699 (+1917867us) service_pool.cc:224] Handling call
0709 12:12:35.213535 (+ 17836us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:35.238516 (+ 24981us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:12:35.707533 (+469017us) log.cc:844] Serialized 14 byte log entry
0709 12:12:36.120816 (+413283us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:36.120900 (+    84us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:36.120972 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:36.121074 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:36.121250 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16745,"prepare.queue_time_us":14068,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"thread_start_us":770030,"threads_started":2}
W20260709 12:12:36.160540 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:36.161388 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:36.164456 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 45187.4us
I20260709 12:12:36.139273 20661 leader_election.cc:290] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:36.148280 20253 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:36.113556 20679 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:12:36.188992 20452 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.045s	sys 0.079s
W20260709 12:12:36.202180 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 291907us
I20260709 12:12:36.171247 20514 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:36.232455 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 44081.4us
I20260709 12:12:36.249569 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:36.268627 20675 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:36.268972 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:36.269377 20675 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:36.223302 20452 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.045s	sys 0.080s
I20260709 12:12:36.270648 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:12:36.271345 20672 log.cc:927] Time spent T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 12:12:36.271445 13760 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 16.
I20260709 12:12:36.272056 20675 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:36.248103 20669 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:36.279929 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:36.184597 20661 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:36.277758 13651 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:12:36.281803 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 483039us
I20260709 12:12:36.287981 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:36.181540 20679 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:36.281050 20546 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:36.245347 20326 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:36.283409 20492 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:36.323246 14379 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:12:36.324703 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 158760us
I20260709 12:12:36.292091 20675 raft_consensus.cc:2804] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:36.272997 20669 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:36.354156 13754 consensus_meta.cc:287] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.680s	user 0.015s	sys 0.000s
I20260709 12:12:36.354841 13754 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 18.
I20260709 12:12:36.295711 20661 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:36.339314 20675 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:36.398171 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:36.376789 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 53658.6us
W20260709 12:12:36.404299 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:36.371146 13652 connection.cc:256] RPC call timeout handler was delayed by -1.6964815919998273s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21080000000000002s for a response
I20260709 12:12:36.330946 20546 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:36.375761 20675 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:36.348872 20326 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:36.462102 20661 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:36.463690 20326 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:12:36.467947 13652 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 2.108s (SENT) [suppressed 17 similar messages]
I20260709 12:12:36.439024 20190 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:36.372336 20514 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:36.469136 20514 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:36.472021 20514 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:36.459000 13651 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:36.468202 20452 raft_consensus.cc:2804] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:36.472961 20452 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:36.473452 20452 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:36.474336 20456 raft_consensus.cc:2804] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:36.474931 20456 raft_consensus.cc:697] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 18 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:36.384182 20676 raft_consensus.cc:2804] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:36.477052 20676 raft_consensus.cc:697] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 20 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:36.469089 20190 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:36.478452 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:36.479112 13760 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 22.
I20260709 12:12:36.479913 20326 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:36.357748 20507 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:36.476084 20456 consensus_queue.cc:237] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:36.515976 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:36.522189 20682 log.cc:927] Time spent T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 12:12:36.503978 13837 raft_consensus.cc:1240] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:36.524887 13837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 3406) took 1636 ms. Trace:
I20260709 12:12:36.525344 13837 rpcz_store.cc:276] 0709 12:12:34.893736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:36.035883 (+1142147us) service_pool.cc:224] Handling call
0709 12:12:36.503360 (+467477us) spinlock_profiling.cc:243] Waited 8.61 ms on lock 0x7b5800034898. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924e68b71 00007fa924e68a22 00007fa92dd818d9 00007fa92cedbee0 00007fa92cfa50ab 00007fa92cfa5131 00007fa92cf66fc0 00007fa92cf51929 00007fa92cf513d2 00007fa9264c8bd4
0709 12:12:36.503669 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:36.524573 (+ 20904us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:36.524818 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19809536}
W20260709 12:12:36.526391 20654 log.cc:927] Time spent T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.213s	user 0.000s	sys 0.001s
I20260709 12:12:36.505414 20465 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:36.522233 20190 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:36.492133 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 75816us
I20260709 12:12:36.528151 13831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 3389) took 3365 ms. Trace:
I20260709 12:12:36.480438 20326 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:36.528867 13831 rpcz_store.cc:276] 0709 12:12:33.163047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.167711 (+2004664us) service_pool.cc:224] Handling call
0709 12:12:35.234372 (+ 66661us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:35.240541 (+  6169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:35.240572 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:35.241182 (+   610us) log.cc:844] Serialized 26 byte log entry
0709 12:12:35.699486 (+458304us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:35.699549 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:35.699632 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:36.527899 (+828267us) raft_consensus.cc:1685] finished
0709 12:12:36.527927 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:36.528087 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5539,"raft.queue_time_us":6918,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":168,"thread_start_us":457856,"threads_started":1,"wal-append.queue_time_us":941183}
W20260709 12:12:36.527237 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 173042us
I20260709 12:12:36.530918 20326 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:36.511900 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 43978.1us
W20260709 12:12:36.533174 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:36.497391 20676 consensus_queue.cc:237] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:36.446036 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 114191us
I20260709 12:12:36.491185 13834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 3396) took 1764 ms. Trace:
W20260709 12:12:36.506384 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 140116us
I20260709 12:12:36.540942 13834 rpcz_store.cc:276] 0709 12:12:34.726190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.893042 (+1166852us) service_pool.cc:224] Handling call
0709 12:12:35.893451 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:35.893694 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:12:35.894507 (+   813us) log.cc:844] Serialized 14 byte log entry
0709 12:12:36.485625 (+591118us) log.cc:844] Serialized 14 byte log entry
0709 12:12:36.487536 (+  1911us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:36.488059 (+   523us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:36.488581 (+   522us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:36.489180 (+   599us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:36.490730 (+  1550us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2279,"prepare.queue_time_us":87170,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":95,"raft.queue_time_us":320709,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":313,"thread_start_us":478083,"threads_started":2}
I20260709 12:12:36.480571 13651 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:12:36.548794 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 68270.6us
I20260709 12:12:36.550237 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:36.552388 20514 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:36.552911 20514 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:36.491079 20452 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:36.553332 20514 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:36.555259 20452 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:36.527316 20465 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:36.556617 20546 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:36.558539 20685 log.cc:927] Time spent T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
I20260709 12:12:36.376036 20406 consensus_queue.cc:1059] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.168s
I20260709 12:12:36.568807 13755 raft_consensus.cc:1275] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:12:36.570899 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:36.572077 13758 raft_consensus.cc:2410] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
W20260709 12:12:36.572463 20680 log.cc:927] Time spent T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.265s	user 0.000s	sys 0.001s
W20260709 12:12:36.586340 20671 log.cc:927] Time spent T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.363s	user 0.000s	sys 0.001s
I20260709 12:12:36.587620 20679 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:36.594070 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:36.560228 20507 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:36.597671 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:36.628201 13726 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:36.596319 20190 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:36.526520 20392 consensus_queue.cc:1059] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.071s
I20260709 12:12:36.642524 13829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 1234) took 3485 ms. Trace:
I20260709 12:12:36.645493 20190 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:36.636480 20576 consensus_meta.cc:287] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 1.046s	user 0.005s	sys 0.011s
I20260709 12:12:36.641302 20406 raft_consensus.cc:2749] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:36.640782 20669 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:36.647580 13829 rpcz_store.cc:276] 0709 12:12:33.157534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.156293 (+1998759us) service_pool.cc:224] Handling call
0709 12:12:35.202447 (+ 46154us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:35.202834 (+   387us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:12:35.728116 (+525282us) log.cc:844] Serialized 14 byte log entry
0709 12:12:36.226594 (+498478us) log.cc:844] Serialized 14 byte log entry
0709 12:12:36.591984 (+365390us) spinlock_profiling.cc:243] Waited 16.2 ms on lock 0x7b1800420580. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e82e07 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9d455 00007fa927f85060 00007fa927f97716 00007fa927fa8287 00007fa927fa8208
0709 12:12:36.640900 (+ 48916us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:36.641278 (+   378us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:36.641548 (+   270us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:36.641953 (+   405us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:36.642447 (+   494us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54389,"prepare.queue_time_us":59324,"prepare.run_cpu_time_us":142,"prepare.run_wall_time_us":3752,"raft.queue_time_us":447074,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":9737,"spinlock_wait_cycles":37161344,"thread_start_us":818437,"threads_started":3,"wal-append.queue_time_us":624718}
I20260709 12:12:36.615959 20253 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:36.679497 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:36.671203 20576 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:36.683399 20190 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:36.683564 20507 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:36.683947 20576 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:36.684128 20677 consensus_queue.cc:1048] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 12:12:36.684238 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:36.684780 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:36.685094 14407 raft_consensus.cc:2368] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 14. Current term is 15.
I20260709 12:12:36.685961 13832 raft_consensus.cc:1240] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:36.687714 20465 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:36.689522 20465 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:12:36.691438 20467 consensus_meta.cc:287] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.876s	user 0.004s	sys 0.008s
I20260709 12:12:36.693233 20467 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:36.695719 20467 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:36.696362 20679 raft_consensus.cc:3055] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:36.699950 20679 raft_consensus.cc:740] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:12:36.700475 20572 consensus_meta.cc:287] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.978s	user 0.009s	sys 0.002s
I20260709 12:12:36.700343 20514 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:36.701022 20572 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:36.701038 20679 consensus_queue.cc:260] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:36.683887 20190 consensus_queue.cc:1048] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
I20260709 12:12:36.706310 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:36.707556 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:36.709224 20514 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:36.727921 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 154228us
I20260709 12:12:36.717360 13760 raft_consensus.cc:1275] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
W20260709 12:12:36.733124 20662 log.cc:927] Time spent T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.260s	user 0.003s	sys 0.000s
I20260709 12:12:36.733950 13834 raft_consensus.cc:3055] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:36.734364 13834 raft_consensus.cc:740] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:36.735080 13834 consensus_queue.cc:260] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:36.736152 13834 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:36.736395 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:12:36.724704 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 89748.7us
I20260709 12:12:36.748308 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:36.751597 13828 raft_consensus.cc:1240] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:36.743981 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:36.753499 13800 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:36.766512 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:36.743038 20467 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:36.769917 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:36.770416 20467 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:36.771538 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:36.743172 20507 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:36.772818 20467 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:36.773658 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:36.791704 13757 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 22.
I20260709 12:12:36.793560 13651 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:36.795320 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:36.800385 13830 raft_consensus.cc:1275] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 17 index: 7. Preceding OpId from leader: term: 19 index: 8. (index mismatch)
I20260709 12:12:36.805699 13726 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:36.821591 14415 raft_consensus.cc:1240] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:36.824957 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:36.804111 20679 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:36.825734 13830 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 22.
I20260709 12:12:36.832964 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:36.835671 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:36.811329 20690 raft_consensus.cc:2804] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:36.772866 20507 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:36.840533 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:36.816802 20546 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:36.847952 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:36.851176 13834 raft_consensus.cc:1275] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 15. (term mismatch)
I20260709 12:12:36.851722 13834 pending_rounds.cc:85] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 14
I20260709 12:12:36.852056 13834 pending_rounds.cc:107] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 20.15
I20260709 12:12:36.852495 13834 raft_consensus.cc:2889] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:12:36.856307 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 80890.6us
I20260709 12:12:36.825034 20354 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:36.832319 20674 raft_consensus.cc:2804] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:36.866308 13759 raft_consensus.cc:1275] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:12:36.875224 14410 raft_consensus.cc:1275] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:12:36.828775 20675 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:36.841719 20690 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:36.846433 20702 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:36.878940 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:36.846501 20190 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:36.850449 20326 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:36.885689 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 163111us
I20260709 12:12:36.868922 20546 raft_consensus.cc:697] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 22 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:36.874549 20674 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:36.887029 20690 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:36.902760 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:36.874802 20354 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:36.905822 20546 consensus_queue.cc:237] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:36.907992 20482 consensus_meta.cc:287] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 1.401s	user 0.015s	sys 0.001s
W20260709 12:12:36.910925 20695 log.cc:927] Time spent T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:12:36.911340 13726 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:12:36.911756 20670 log.cc:927] Time spent T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:12:36.911983 13800 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:36.904106 20253 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:36.925293 20709 log.cc:927] Time spent T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
W20260709 12:12:36.912818 20700 log.cc:927] Time spent T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 12:12:36.897459 20326 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:36.927937 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:36.900154 20451 consensus_queue.cc:1048] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 12:12:36.901738 20674 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:36.895040 20190 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:36.946991 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:36.922669 20572 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:36.951399 20326 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:36.952721 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:36.953063 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:36.953789 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:36.962742 13727 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:36.943686 20253 raft_consensus.cc:2804] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:36.970216 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:36.955353 20663 consensus_queue.cc:1059] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.006s
I20260709 12:12:36.971138 13830 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:36.922345 20482 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:36.979499 19918 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:36.957859 20492 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:36.982218 13727 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:36.983835 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:36.946522 20451 consensus_queue.cc:1243] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer 3f37c9cc9dda46b4be21dd675ba78fb7 log is divergent from this leader: its last log entry 17.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:12:36.985647 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:36.986397 13652 leader_election.cc:400] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 election: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 14. Current term is 15.
I20260709 12:12:36.968206 20406 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:36.987257 20617 raft_consensus.cc:3055] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:12:36.894402 20702 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:36.955415 20577 consensus_queue.cc:1048] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.027s
W20260709 12:12:36.990578 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 78705.9us
I20260709 12:12:36.967905 20467 raft_consensus.cc:2749] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:36.968374 20253 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:36.994051 13726 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:36.982071 20683 consensus_queue.cc:1048] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:12:36.994441 13829 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 23.
I20260709 12:12:37.000165 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:37.002251 13760 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:37.006920 13652 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:12:37.010456 20715 log.cc:927] Time spent T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:12:37.013545 13652 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:12:37.015127 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:37.019301 13680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 1242) took 1500 ms. Trace:
I20260709 12:12:37.019764 13680 rpcz_store.cc:276] 0709 12:12:35.518919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.524501 (+  5582us) service_pool.cc:224] Handling call
0709 12:12:35.667849 (+143348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:36.695204 (+1027355us) spinlock_profiling.cc:243] Waited 3.72 ms on lock 0x7b4800080358. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92ceb6aa1 00007fa92ceadb37 00007fa92cead9ca 00007fa92cfa526f 00007fa92cfa4f37 00007fa92cfb955c 00007fa92cfb9508 00007fa92cfb9488 00007fa92cfb9443 00007fa92cfb86ec 00007fa92bee2a96
0709 12:12:36.699955 (+  4751us) spinlock_profiling.cc:243] Waited 3.05 ms on lock 0x7b18003e0500. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e82e07 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9d455 00007fa927f85060 00007fa927f85bfb 00007fa927f9064b 00007fa927f8cd8f
0709 12:12:36.835449 (+135494us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:36.835484 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:36.871202 (+ 35718us) log.cc:844] Serialized 26 byte log entry
0709 12:12:36.955863 (+ 84661us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:36.955899 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:36.956033 (+   134us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:37.019032 (+ 62999us) raft_consensus.cc:1685] finished
0709 12:12:37.019057 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:37.019228 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13469,"raft.queue_time_us":17518,"raft.run_cpu_time_us":6887,"raft.run_wall_time_us":1002509,"spinlock_wait_cycles":15591040,"thread_start_us":182688,"threads_started":2,"wal-append.queue_time_us":110642}
I20260709 12:12:37.027549 13652 leader_election.cc:304] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:36.993597 20406 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:37.033008 13830 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 23.
I20260709 12:12:36.992487 20617 raft_consensus.cc:740] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:36.997670 20454 raft_consensus.cc:2749] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:12:37.004879 20697 log.cc:927] Time spent T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.153s	user 0.000s	sys 0.002s
I20260709 12:12:37.000926 20253 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:12:37.047629 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:37.049096 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 55159.4us
I20260709 12:12:37.051347 20451 raft_consensus.cc:2749] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:37.051455 20617 consensus_queue.cc:260] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:36.985615 19918 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:36.995569 20492 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:37.056593 20701 log.cc:927] Time spent T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.324s	user 0.000s	sys 0.002s
I20260709 12:12:37.043468 20326 raft_consensus.cc:2804] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:37.058733 13800 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:37.059120 20326 raft_consensus.cc:697] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:37.060289 13800 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:37.060192 20326 consensus_queue.cc:237] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:37.061525 20684 raft_consensus.cc:3055] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:12:37.061969 20464 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:37.062269 20567 raft_consensus.cc:2749] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:37.062497 20190 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:37.063498 20716 consensus_queue.cc:1059] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 12:12:37.064504 20716 raft_consensus.cc:3055] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:37.064884 20716 raft_consensus.cc:740] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:37.036880 20514 consensus_queue.cc:1048] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 12:12:37.065905 20714 raft_consensus.cc:2749] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
W20260709 12:12:37.066862 20691 log.cc:927] Time spent T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.399s	user 0.001s	sys 0.001s
I20260709 12:12:37.032203 20456 raft_consensus.cc:2749] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:37.053401 20617 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:37.061729 13800 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:37.058763 13726 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:37.037276 20406 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:12:37.071146 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 89345.2us
W20260709 12:12:37.049527 20688 log.cc:927] Time spent T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
W20260709 12:12:37.091466 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 64046.6us
I20260709 12:12:37.092511 13652 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:37.094969 13652 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:37.061967 20684 raft_consensus.cc:740] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 23 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:37.097384 13837 raft_consensus.cc:1240] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 15. Current term is 16. Ops: []
W20260709 12:12:37.097467 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 85812.8us
I20260709 12:12:37.100128 13760 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 17.
W20260709 12:12:37.111759 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:37.114220 13832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 3401) took 2334 ms. Trace:
I20260709 12:12:37.114706 13832 rpcz_store.cc:276] 0709 12:12:34.779461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.990385 (+1210924us) service_pool.cc:224] Handling call
0709 12:12:35.999117 (+  8732us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:36.686388 (+687271us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:37.114000 (+427612us) spinlock_profiling.cc:243] Waited 687 ms on lock 0x7b54000afad4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:37.114159 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1579087232}
W20260709 12:12:37.115437 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:37.143751 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:12:37.145679 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:37.096724 20546 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:37.099053 20190 raft_consensus.cc:2749] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:37.092170 20567 raft_consensus.cc:2749] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:37.148914 13837 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 18.
I20260709 12:12:37.102089 20703 raft_consensus.cc:2749] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:12:37.143719 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 43813.6us
W20260709 12:12:37.152360 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 93688.9us
I20260709 12:12:37.166307 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:37.177461 13652 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:37.163636 13828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 3407) took 2175 ms. Trace:
I20260709 12:12:37.163447 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:37.178380 13828 rpcz_store.cc:276] 0709 12:12:34.988299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:36.044526 (+1056227us) service_pool.cc:224] Handling call
0709 12:12:36.080742 (+ 36216us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:36.755325 (+674583us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:37.163398 (+408073us) spinlock_profiling.cc:243] Waited 671 ms on lock 0x7b54000af0d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:37.163576 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1542164864}
W20260709 12:12:37.144734 20688 log.cc:927] Time spent T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:12:37.159858 14379 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:37.186439 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:12:37.191512 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:37.194617 14380 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:37.068400 20716 consensus_queue.cc:260] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:37.143551 20456 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:37.146538 20384 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:37.176105 20721 log.cc:927] Time spent T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
W20260709 12:12:37.159444 20697 log.cc:927] Time spent T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:12:37.154546 19918 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:37.204792 20727 raft_consensus.cc:2749] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:12:37.205663 20722 log.cc:927] Time spent T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 12:12:37.206286 13726 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
W20260709 12:12:37.206887 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 145230us
W20260709 12:12:37.207974 20725 log.cc:927] Time spent T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:12:37.209581 20675 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:37.210297 20384 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:37.211519 20456 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:37.154728 20577 consensus_queue.cc:1048] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.057s
I20260709 12:12:37.202700 20669 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:37.197336 20339 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:37.197696 20729 raft_consensus.cc:2749] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:12:37.229163 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:37.222343 20482 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:37.237527 13830 raft_consensus.cc:1275] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 15. (term mismatch)
I20260709 12:12:37.240490 13830 pending_rounds.cc:85] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 14
I20260709 12:12:37.240767 13830 pending_rounds.cc:107] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 22.15
I20260709 12:12:37.241012 13830 raft_consensus.cc:2889] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:37.240784 13800 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:37.239540 13760 raft_consensus.cc:1275] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 12:12:37.228387 20714 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:37.229841 20733 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:37.230409 20546 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:37.221942 20684 consensus_queue.cc:260] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:37.247776 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 53248.4us
I20260709 12:12:37.234061 19918 raft_consensus.cc:2804] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:37.233891 20716 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:37.236276 20702 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:37.253899 14380 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:37.226121 20690 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:37.233879 20669 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:37.260295 20669 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:37.246163 20567 raft_consensus.cc:2749] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:12:37.296514 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 61592.4us
I20260709 12:12:37.304049 14380 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:37.309630 13800 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:37.300922 20442 raft_consensus.cc:2749] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:37.296569 19918 raft_consensus.cc:697] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:37.253134 20546 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:37.317126 13726 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:37.310633 20684 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:37.312379 20734 raft_consensus.cc:2749] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:37.331470 20546 leader_election.cc:290] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:37.333936 13726 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:37.336702 20669 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:37.344269 20674 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:37.345101 20507 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:37.252226 20733 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:37.359264 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 61277.7us
I20260709 12:12:37.320104 20567 raft_consensus.cc:2749] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:37.363664 19918 consensus_queue.cc:237] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:37.368162 20406 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:37.368885 20708 log.cc:927] Time spent T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.501s	user 0.000s	sys 0.004s
I20260709 12:12:37.369247 20674 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:37.370007 13762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 3223) took 1991 ms. Trace:
I20260709 12:12:37.370206 20702 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:37.377132 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:37.377414 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:37.377115 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:37.379407 14415 raft_consensus.cc:2393] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 18: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:12:37.338094 20689 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:37.294620 20714 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:37.380066 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 184850us
I20260709 12:12:37.383814 14407 raft_consensus.cc:1240] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 23 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260709 12:12:37.384940 20354 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:37.385000 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:37.391180 20733 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:37.391796 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:37.396517 20384 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:37.370741 20702 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:37.399343 20714 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:37.400017 20702 leader_election.cc:290] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:37.402566 20456 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:37.404472 20690 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:37.404814 20464 raft_consensus.cc:2749] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:37.374658 20482 consensus_queue.cc:1048] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.031s
W20260709 12:12:37.380473 20679 consensus_meta.cc:287] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.547s	user 0.012s	sys 0.001s
I20260709 12:12:37.375614 20669 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:37.412505 13835 raft_consensus.cc:2393] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 18: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:37.413702 20669 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:37.416373 20669 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:37.370419 13762 rpcz_store.cc:276] 0709 12:12:35.358473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.361947 (+  3474us) service_pool.cc:224] Handling call
0709 12:12:35.362300 (+   353us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:35.791743 (+429443us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:12:36.150324 (+358581us) log.cc:844] Serialized 14 byte log entry
0709 12:12:36.594483 (+444159us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b180033d1e0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa927b354bc 00007fa924e8348b 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9fc02 00007fa927b2720b 00007fa927b2cd23 00007fa927b2d23a
0709 12:12:36.594913 (+   430us) log.cc:844] Serialized 14 byte log entry
0709 12:12:36.617490 (+ 22577us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:36.638023 (+ 20533us) log.cc:844] Serialized 52 byte log entry
0709 12:12:36.638233 (+   210us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:36.641270 (+  3037us) log.cc:844] Serialized 14 byte log entry
0709 12:12:36.662552 (+ 21282us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:36.667955 (+  5403us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:36.698304 (+ 30349us) spinlock_profiling.cc:243] Waited 4.1 ms on lock 0x7b180033d1e0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924ea0522 00007fa924ea27c1 00007fa924ea2779 00007fa924ea2709 00007fa924ea26d1 00007fa924ea19cd 0000000000388634 0000000000388479 00007fa924e8383a
0709 12:12:37.349698 (+651394us) raft_consensus.cc:1685] finished
0709 12:12:37.349720 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:37.349867 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46027,"prepare.queue_time_us":516724,"prepare.run_cpu_time_us":143,"prepare.run_wall_time_us":147,"raft.queue_time_us":176684,"raft.run_cpu_time_us":533,"raft.run_wall_time_us":61692,"spinlock_wait_cycles":38685952,"thread_start_us":862335,"threads_started":3,"wal-append.queue_time_us":645541}
W20260709 12:12:37.426807 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 66231.7us
I20260709 12:12:37.427767 13800 leader_election.cc:304] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:37.429234 13800 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:37.430080 20674 raft_consensus.cc:2749] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:12:37.430480 13800 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:37.430969 20674 raft_consensus.cc:2749] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:37.431847 13800 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:37.431952 20674 raft_consensus.cc:2749] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:37.432659 20617 raft_consensus.cc:2749] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:37.433127 13800 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:37.435978 13680 raft_consensus.cc:2410] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for term 15 because replica has last-logged OpId of term: 14 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 13.
I20260709 12:12:37.440745 20669 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:37.441509 20669 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:37.444270 20669 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:37.445036 20679 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:37.445753 20679 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:37.397179 20253 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:37.455168 13755 raft_consensus.cc:1240] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 20. Current term is 21. Ops: []
W20260709 12:12:37.475100 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:37.482445 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:37.474442 20464 raft_consensus.cc:2804] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:37.488253 20464 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:37.488675 20464 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:37.489140 20679 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:37.492062 13651 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:37.495297 20675 raft_consensus.cc:2804] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:37.495859 20675 raft_consensus.cc:697] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 17 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
W20260709 12:12:37.506003 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 94349.8us
I20260709 12:12:37.524802 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:37.526302 13727 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:37.532594 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:37.531131 13727 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:37.538938 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:37.540341 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:37.541126 13835 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 23.
I20260709 12:12:37.548277 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:37.549161 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:37.554674 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:37.556526 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:37.518335 20456 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:37.527549 20617 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:37.571833 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 51109.3us
I20260709 12:12:37.527369 20514 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:37.532567 20406 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:37.587874 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 54127.4us
I20260709 12:12:37.539697 20683 raft_consensus.cc:2804] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:37.548056 20669 raft_consensus.cc:2804] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader election won for term 23
W20260709 12:12:37.608835 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:37.617153 13727 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:12:37.595685 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 51678.1us
I20260709 12:12:37.593302 13837 raft_consensus.cc:1275] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 15. (term mismatch)
W20260709 12:12:37.618736 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:37.557407 13828 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 22.
I20260709 12:12:37.599061 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:37.612515 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:37.620814 14412 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 24.
I20260709 12:12:37.636041 20689 raft_consensus.cc:2749] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:37.644562 20716 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:37.645411 20716 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:37.597649 20384 consensus_queue.cc:1059] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.049s
I20260709 12:12:37.591904 20456 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:37.648175 20661 raft_consensus.cc:3055] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:37.648656 20661 raft_consensus.cc:740] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:37.590579 20514 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:37.618672 13837 pending_rounds.cc:85] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 14
W20260709 12:12:37.657737 13652 leader_election.cc:336] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 1.520s (SENT)
I20260709 12:12:37.678191 13837 pending_rounds.cc:107] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 18.15
I20260709 12:12:37.678560 13652 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:37.678820 13837 raft_consensus.cc:2889] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:37.657960 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:37.661129 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:37.676692 14379 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:37.685714 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:37.688735 13800 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:37.597574 20683 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:37.649442 20456 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:37.698563 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:37.651346 20726 raft_consensus.cc:2804] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:37.700489 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:37.653475 20492 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:37.708498 13800 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:37.652369 20669 raft_consensus.cc:697] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:37.684151 20716 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:37.598043 20617 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:37.654103 20442 consensus_queue.cc:1059] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.066s
I20260709 12:12:37.697479 20683 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:37.690378 20339 raft_consensus.cc:2749] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:37.700090 20676 raft_consensus.cc:2749] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:12:37.747888 13800 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:37.660465 20703 consensus_queue.cc:1059] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.064s
I20260709 12:12:37.690428 20689 consensus_queue.cc:1059] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.062s
I20260709 12:12:37.718823 20726 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:37.717878 20451 raft_consensus.cc:2749] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:37.718585 13727 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:37.612329 20675 consensus_queue.cc:237] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:37.788852 13834 raft_consensus.cc:1275] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:12:37.761157 20567 raft_consensus.cc:2749] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:37.783829 13800 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:37.649626 20661 consensus_queue.cc:260] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:37.550597 20684 consensus_queue.cc:1048] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.229s
I20260709 12:12:37.760051 20253 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:37.657718 14406 tablet_service.cc:1558] Processing DeleteTablet for tablet d2f365337b324999a073edacbe6c6e09 with delete_type TABLET_DATA_TOMBSTONED (TS ca9fbbc2c0a94897897d502d42f3951f not found in new config with opid_index -1) from {username='slave'} at 127.0.0.1:55472
W20260709 12:12:37.794452 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 199418us
I20260709 12:12:37.807569 14380 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:37.785585 20726 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:37.788435 20674 raft_consensus.cc:2749] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 12:12:37.811530 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 153798us
I20260709 12:12:37.832417 20689 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:37.833244 20689 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:37.833936 20689 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:37.809598 20676 raft_consensus.cc:2749] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:37.817695 20567 consensus_queue.cc:1048] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
W20260709 12:12:37.847028 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 128491us
W20260709 12:12:37.847267 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:37.848239 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:37.840561 20406 raft_consensus.cc:3055] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 LEADER]: Stepping down as leader of term 19
W20260709 12:12:37.859591 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:37.861416 13727 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:37.821969 20464 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:37.862337 13727 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:37.864368 20758 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:37.866776 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:37.840404 20748 raft_consensus.cc:2749] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:37.869674 13727 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:37.822422 20669 consensus_queue.cc:237] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:37.865470 20757 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 12:12:37.876891 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 64486.9us
I20260709 12:12:37.880234 20676 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:37.880901 20676 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:37.882831 20757 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:37.883204 20676 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:37.883476 20757 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:37.887993 20756 consensus_queue.cc:1059] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 12:12:37.889060 20756 consensus_queue.cc:1243] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer b98d2519bb504dc6905ed2ede4571835 log is divergent from this leader: its last log entry 18.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:12:37.874680 20384 raft_consensus.cc:2749] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:12:37.891184 20464 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:37.874936 20684 consensus_queue.cc:1048] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.017s
I20260709 12:12:37.892108 20617 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:37.889647 20756 raft_consensus.cc:3055] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:37.894285 20756 raft_consensus.cc:740] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:37.895123 20756 consensus_queue.cc:260] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:37.896301 20756 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:37.897997 13800 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:37.899865 13829 raft_consensus.cc:1240] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:37.862336 20406 raft_consensus.cc:740] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:37.900283 13800 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:12:37.934716 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 65128.6us
I20260709 12:12:37.852597 20749 consensus_queue.cc:1048] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.048s
W20260709 12:12:37.937489 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 80838us
I20260709 12:12:37.938694 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:12:37.937842 13652 leader_election.cc:336] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 1.729s (SENT)
I20260709 12:12:37.941241 13652 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:37.900493 20514 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:37.936462 20464 raft_consensus.cc:2749] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:37.938194 20676 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:37.947604 20742 raft_consensus.cc:2749] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:37.903080 20757 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:37.878544 20758 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:37.947160 20755 raft_consensus.cc:2749] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:37.942458 20674 consensus_queue.cc:1059] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 12:12:37.977044 20676 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:38.036320 20758 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:38.038120 20762 log.cc:927] Time spent T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:12:38.041679 20674 raft_consensus.cc:3055] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:38.042135 20674 raft_consensus.cc:740] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
W20260709 12:12:38.043105 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:38.043026 20674 consensus_queue.cc:260] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:38.044283 20674 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:38.050203 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:38.050906 13832 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:38.052312 13837 raft_consensus.cc:1240] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:38.054464 13727 leader_election.cc:304] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:38.055018 20669 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:38.055521 20669 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:38.056017 20753 log.cc:927] Time spent T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
I20260709 12:12:37.970611 20567 raft_consensus.cc:2749] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:38.058106 20703 raft_consensus.cc:2804] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:38.058673 20703 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:38.059110 20703 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:38.060680 20757 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:38.061939 20676 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:12:38.062292 13571 catalog_manager.cc:5002] TS ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): delete failed for tablet d2f365337b324999a073edacbe6c6e09 because of a CAS failure. No further retry: Illegal state: Request specified cas_config_opid_index_less_or_equal of 8 but the committed config has opid_index of 10
I20260709 12:12:38.062801 20689 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:38.065054 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 132090us
I20260709 12:12:38.072731 13837 raft_consensus.cc:1275] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:12:38.036095 20726 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:38.087664 13832 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 23.
W20260709 12:12:38.118157 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:38.120532 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:38.121713 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:38.122524 13833 raft_consensus.cc:2393] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 17: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:38.037274 20683 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:38.125480 20683 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:38.125878 20514 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.126199 20726 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:38.126462 20514 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:38.127215 20758 consensus_queue.cc:1059] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:38.129866 20514 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:38.126293 20669 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:38.132933 14409 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 24.
W20260709 12:12:38.150324 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 250121us
I20260709 12:12:38.099628 20742 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:37.962417 20406 consensus_queue.cc:260] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:38.159723 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 204913us
W20260709 12:12:38.164633 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:38.166863 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 209425us
I20260709 12:12:38.178969 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:38.185204 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:38.190853 20452 raft_consensus.cc:3055] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:38.191535 20452 raft_consensus.cc:740] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:38.192816 20452 consensus_queue.cc:260] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:38.201761 20746 log.cc:927] Time spent T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.347s	user 0.000s	sys 0.003s
I20260709 12:12:38.223707 20689 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:38.158453 20756 consensus_queue.cc:1048] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 12:12:38.167009 20742 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:38.242612 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 127480us
I20260709 12:12:38.244240 13727 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:38.262866 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:38.263808 13831 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:38.266242 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:38.266917 13830 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:38.270716 13727 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:38.276036 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:38.278077 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:38.278867 13833 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 21.
I20260709 12:12:38.284394 13830 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 24.
I20260709 12:12:38.235980 20703 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:38.273990 20326 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.286666 20326 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:38.272239 20689 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:12:38.316388 13727 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:38.257716 20726 consensus_queue.cc:1048] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.047s
I20260709 12:12:38.290728 20742 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:38.304519 20758 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:12:38.324708 13836 raft_consensus.cc:1275] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:12:38.325405 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:38.326012 13834 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 18.
W20260709 12:12:38.325642 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 157795us
I20260709 12:12:38.327400 14380 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:38.289633 20326 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:38.346359 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:38.321056 20689 raft_consensus.cc:697] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:38.351989 13836 raft_consensus.cc:1240] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 23. Current term is 24. Ops: [23.15-23.15]
I20260709 12:12:38.293861 20675 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:38.333341 20663 raft_consensus.cc:2749] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:12:38.330760 20384 raft_consensus.cc:2804] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:38.361449 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:38.375252 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:38.376158 13836 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:38.363467 20703 leader_election.cc:290] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:38.339888 20758 raft_consensus.cc:697] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:12:38.365914 14441 heartbeater.cc:646] Failed to heartbeat to 127.12.56.254:40645 (1 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.12.56.254:40645 timed out after 15.000s (SENT)
I20260709 12:12:38.373040 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:38.378553 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:38.383967 13834 raft_consensus.cc:2368] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 16. Current term is 17.
I20260709 12:12:38.378669 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:12:38.380164 20741 log.cc:927] Time spent T 00000000000000000000000000000000 P 17d79eae88f84be7a847d0cf544674cd: Append to log took a long time: real 0.744s	user 0.010s	sys 0.008s
I20260709 12:12:38.382210 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:38.390662 13837 raft_consensus.cc:2393] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 17: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:38.394815 20758 consensus_queue.cc:237] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:38.399663 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:38.401140 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:38.402050 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:38.403535 20252 consensus_queue.cc:1059] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:38.404342 20689 consensus_queue.cc:237] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:38.406169 20776 raft_consensus.cc:3055] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:12:38.406826 20776 raft_consensus.cc:740] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 23 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:38.410537 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:38.411960 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:38.412853 13837 raft_consensus.cc:2393] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 20: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:38.382622 20384 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:38.414256 20384 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:38.416347 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:38.418401 20757 raft_consensus.cc:3055] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:38.418604 13727 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:38.418929 20757 raft_consensus.cc:740] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:38.419977 13727 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:38.402139 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:38.421900 13834 raft_consensus.cc:2393] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 18: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:38.421696 14408 raft_consensus.cc:1240] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:38.417564 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:38.422972 13830 raft_consensus.cc:2410] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 12:12:38.389314 13831 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 24.
I20260709 12:12:38.413719 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:38.425725 13727 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:38.425406 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:38.426450 13828 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 19.
I20260709 12:12:38.426700 13727 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:38.428333 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:38.428674 13831 raft_consensus.cc:1240] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:38.430231 20726 raft_consensus.cc:2804] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:38.430730 20726 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:38.430889 20770 raft_consensus.cc:2804] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:12:38.431113 20726 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:38.431490 20770 raft_consensus.cc:697] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:38.419917 20757 consensus_queue.cc:260] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:38.433501 20757 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:38.436508 13651 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.944s	user 0.034s	sys 0.059s
W20260709 12:12:38.436868 13651 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.944s	user 0.034s	sys 0.059s
W20260709 12:12:38.437126 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 945098us
I20260709 12:12:38.445755 13837 raft_consensus.cc:1275] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:12:38.454734 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:38.425868 20454 raft_consensus.cc:2749] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:38.441181 20703 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:12:38.383738 20675 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:38.408190 20776 consensus_queue.cc:260] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:38.469868 20776 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:38.472451 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:38.473270 13833 raft_consensus.cc:2393] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 18: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:38.475520 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:38.476109 13833 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 16.
I20260709 12:12:38.477135 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:38.478142 13830 raft_consensus.cc:2368] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 22. Current term is 23.
W20260709 12:12:38.489491 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:38.356487 20771 consensus_queue.cc:1048] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.120s
I20260709 12:12:38.467383 20703 raft_consensus.cc:697] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:12:38.532842 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:38.432535 20770 consensus_queue.cc:237] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:38.651571 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 92300.4us
I20260709 12:12:38.655767 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:38.491557 20775 consensus_queue.cc:1059] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.163s
W20260709 12:12:38.683554 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 245833us
I20260709 12:12:38.702783 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:38.683394 20773 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
W20260709 12:12:38.720259 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:38.730012 20786 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.730862 20786 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:38.732812 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:38.733736 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:38.734508 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:38.735025 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:38.735320 13831 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:38.740635 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:38.743831 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:38.746199 13835 raft_consensus.cc:1275] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:12:38.746584 13834 raft_consensus.cc:2368] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 22. Current term is 23.
I20260709 12:12:38.747689 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:38.743906 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:38.753270 13834 raft_consensus.cc:3055] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:38.753718 13834 raft_consensus.cc:740] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:38.757977 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:38.760874 13834 consensus_queue.cc:260] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:38.762816 13834 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:38.763990 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:38.786854 13834 raft_consensus.cc:1275] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:12:38.794456 13831 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 17.
I20260709 12:12:38.739003 20726 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:38.726024 20773 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:38.815407 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:38.816628 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:38.818280 13680 raft_consensus.cc:1240] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 18 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:38.817459 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:38.819958 13681 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:38.810783 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:38.821077 13687 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 19.
I20260709 12:12:38.822525 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:38.823170 13688 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:38.823212 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:38.824391 13683 raft_consensus.cc:1275] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:12:38.827589 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:38.829300 13685 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 14.
I20260709 12:12:38.831827 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:38.832551 13687 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:38.834383 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:38.738673 20703 consensus_queue.cc:237] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:38.837913 13680 raft_consensus.cc:2393] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 19: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:38.840389 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:38.841573 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:38.838900 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:38.842869 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:38.842979 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:38.844410 13683 raft_consensus.cc:2393] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 20: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:38.843832 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:38.845825 13684 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 15.
I20260709 12:12:38.849315 13828 raft_consensus.cc:2410] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 17 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 12:12:38.850200 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:38.851305 13680 raft_consensus.cc:2410] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 12:12:38.873745 13836 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 23.
W20260709 12:12:38.873922 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:38.877245 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:38.878499 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:38.878957 20773 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:38.879117 13685 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 22.
I20260709 12:12:38.880198 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:38.880616 20726 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:38.880760 13685 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:38.881810 20759 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:38.882403 20759 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:38.884822 20759 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:38.888123 20786 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:38.842610 20792 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.891041 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:12:38.901434 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:38.892694 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:38.893399 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:38.903620 13835 raft_consensus.cc:2393] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 20: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:38.894709 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:38.902275 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:38.905414 14408 raft_consensus.cc:2393] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 15: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:12:38.892467 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:38.894151 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:38.907541 13831 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 20.
I20260709 12:12:38.908735 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:38.893030 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:38.899943 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:38.889752 13687 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 18.
I20260709 12:12:38.903991 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:38.915469 13688 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 17.
I20260709 12:12:38.917698 13829 raft_consensus.cc:2368] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 23. Current term is 24.
I20260709 12:12:38.919364 13836 raft_consensus.cc:1240] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 22. Current term is 23. Ops: []
I20260709 12:12:38.873845 20795 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:38.923894 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:38.922966 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:38.922076 13832 raft_consensus.cc:2393] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 18: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:38.925191 13680 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:38.925187 13831 raft_consensus.cc:2410] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 12:12:38.891116 20452 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:38.922315 13681 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 17.
W20260709 12:12:38.893306 20789 log.cc:927] Time spent T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:12:38.930377 14414 raft_consensus.cc:1275] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:12:38.839336 20384 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:38.932224 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:38.935132 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:38.935864 13831 raft_consensus.cc:2410] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 12:12:38.936826 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:38.938048 13681 raft_consensus.cc:2393] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 24: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:38.896855 20675 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:38.940449 13682 raft_consensus.cc:2393] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 17: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:38.947212 13680 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 23.
I20260709 12:12:38.947805 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:38.948401 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:38.948798 13679 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 22.
I20260709 12:12:38.952324 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:38.954704 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:38.955786 13681 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 17.
I20260709 12:12:38.955789 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:38.962318 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:38.963574 13679 raft_consensus.cc:2393] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 24: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:38.960191 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:38.964443 13682 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Advancing to term 24
I20260709 12:12:39.036787 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:38.895236 20792 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:39.023260 13652 leader_election.cc:336] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 2.108s (SENT)
I20260709 12:12:39.040606 13652 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:39.066160 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:39.067305 13829 raft_consensus.cc:2393] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 18: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:38.938814 13760 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34a12e91341d4472be7460f1061495db"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "b98d2519bb504dc6905ed2ede4571835"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:12:39.091928 13760 raft_consensus.cc:606] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Received request to transfer leadership to TS b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:39.092454 13760 raft_consensus.cc:614] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:39.098776 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:39.099997 13679 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:38.930781 20795 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:39.107870 13681 raft_consensus.cc:2410] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 21 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 12:12:39.040067 20755 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:39.068974 20778 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:39.121378 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:39.144354 13683 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 17.
I20260709 12:12:39.067764 20679 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:39.091041 20675 raft_consensus.cc:2749] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:39.154704 13685 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 18.
I20260709 12:12:39.157656 13684 raft_consensus.cc:1240] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 17. Current term is 18. Ops: [17.10-17.10]
W20260709 12:12:39.166046 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 142843us
I20260709 12:12:39.169263 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:39.177726 13685 raft_consensus.cc:1240] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:39.184811 13682 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 24.
I20260709 12:12:39.186779 13679 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 23.
I20260709 12:12:39.187927 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:39.188386 13679 raft_consensus.cc:1240] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:39.191751 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:39.150871 20797 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:39.199898 13831 raft_consensus.cc:2393] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 23: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
W20260709 12:12:39.195842 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:39.254709 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:12:39.304333 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:39.189693 20773 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:39.307776 13679 raft_consensus.cc:1275] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 14. (term mismatch)
I20260709 12:12:39.304951 13682 raft_consensus.cc:1275] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 12:12:39.308239 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:39.158708 20679 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:39.186417 20759 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:39.312409 13831 raft_consensus.cc:1275] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 12:12:39.314860 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:39.307965 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 433104us
I20260709 12:12:39.322561 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:39.312947 13679 pending_rounds.cc:85] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 13
I20260709 12:12:39.322008 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:39.324836 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:39.328562 13834 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:39.328529 13836 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 19.
I20260709 12:12:39.156580 20778 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:39.256836 20800 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:39.365370 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:39.364687 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:12:39.365087 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:39.372213 13833 raft_consensus.cc:1240] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 17. Current term is 18. Ops: []
W20260709 12:12:39.302083 13635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 45670.8us
I20260709 12:12:39.337235 13679 pending_rounds.cc:107] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 21.14
I20260709 12:12:39.366477 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:39.375420 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:39.334085 20773 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:39.380569 13679 raft_consensus.cc:2889] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:39.390208 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:39.381570 13829 raft_consensus.cc:2376] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 17. Re-sending same reply.
W20260709 12:12:39.391433 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:39.398655 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:39.399385 13832 raft_consensus.cc:2368] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 22. Current term is 23.
W20260709 12:12:39.358592 20794 log.cc:927] Time spent T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.404s	user 0.000s	sys 0.001s
I20260709 12:12:39.403565 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:39.401000 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:39.175603 20755 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:39.407060 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:39.319651 20748 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:39.409561 13834 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 19.
I20260709 12:12:39.412801 20792 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:39.415100 20679 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:39.415742 20679 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:39.416378 20679 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:39.379295 20684 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:39.418107 20684 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:39.420272 20684 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:39.420388 20795 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:39.320516 20770 consensus_queue.cc:1059] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.078s
I20260709 12:12:39.422458 20752 raft_consensus.cc:3055] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:39.422870 20752 raft_consensus.cc:740] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:39.424198 20755 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:39.389235 20253 raft_consensus.cc:3055] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:39.253307 20797 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:39.425024 20253 raft_consensus.cc:740] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:39.425973 20253 consensus_queue.cc:260] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:39.426429 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:39.426994 20253 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:39.427350 20797 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:39.427888 13688 raft_consensus.cc:1240] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:39.396018 20800 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:39.429255 13688 raft_consensus.cc:1275] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 17 index: 7. Preceding OpId from leader: term: 19 index: 8. (index mismatch)
I20260709 12:12:39.431456 20800 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:39.379554 20384 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:39.364941 20759 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:39.435343 20759 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:39.332412 20757 consensus_queue.cc:1048] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.074s
I20260709 12:12:39.440027 13687 raft_consensus.cc:1275] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:12:39.385923 20778 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199)
I20260709 12:12:39.446301 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:39.367980 20796 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:39.441630 13687 raft_consensus.cc:3055] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:12:39.458642 13687 raft_consensus.cc:740] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:39.459610 13681 raft_consensus.cc:1275] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:12:39.406025 20786 consensus_queue.cc:1048] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 12:12:39.425084 20661 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:39.389128 20773 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:39.464507 13687 consensus_queue.cc:260] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:39.472874 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:39.473419 13687 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:39.457053 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:39.464668 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:39.475757 13683 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 15.
I20260709 12:12:39.477154 13682 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:12:39.482321 13830 raft_consensus.cc:2393] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 20: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:39.481678 13800 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:39.491261 20807 consensus_queue.cc:1048] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:39.498093 20679 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:39.423767 20752 consensus_queue.cc:260] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:39.478727 20806 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:39.526693 13652 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:39.488802 20674 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:39.460932 20796 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:39.544976 13652 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:39.550936 13652 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:39.470099 20800 consensus_queue.cc:1059] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.056s
I20260709 12:12:39.466641 20748 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:39.554993 13652 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:39.534644 20808 raft_consensus.cc:2749] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:39.577638 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 256094us
I20260709 12:12:39.558235 20807 raft_consensus.cc:2804] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:39.553876 20810 raft_consensus.cc:2749] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:39.558954 20768 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:39.586007 13652 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:12:39.579306 20452 consensus_meta.cc:287] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.650s	user 0.017s	sys 0.001s
I20260709 12:12:39.593686 13652 leader_election.cc:400] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 23. Current term is 24.
I20260709 12:12:39.594308 13652 leader_election.cc:403] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:39.554983 20674 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:39.575282 20752 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:39.532800 20806 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:39.556154 20795 consensus_queue.cc:1048] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:12:39.581034 13727 leader_election.cc:304] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:39.584203 13687 raft_consensus.cc:1275] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 13. (term mismatch)
I20260709 12:12:39.604431 13687 pending_rounds.cc:85] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 12
I20260709 12:12:39.604808 13687 pending_rounds.cc:107] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 22.13
I20260709 12:12:39.604758 13727 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:39.584956 20807 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:39.586130 20786 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:39.610848 20679 raft_consensus.cc:2804] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:39.613384 20679 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:39.613859 20679 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:39.614144 20812 raft_consensus.cc:2749] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:39.615005 20812 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:39.615522 20812 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:39.599257 20514 raft_consensus.cc:2749] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 23. Current term is 24.
I20260709 12:12:39.605767 13687 raft_consensus.cc:2889] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:12:39.620153 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:39.596873 20800 raft_consensus.cc:2749] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:39.621062 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:39.621858 13760 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 19.
I20260709 12:12:39.610365 13682 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 19.
W20260709 12:12:39.628065 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:39.629009 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:12:39.631678 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:39.633085 13761 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:12:39.611737 20775 raft_consensus.cc:2804] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:12:39.611614 20807 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:39.636871 13760 pending_rounds.cc:85] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting all ops after (but not including) 8
I20260709 12:12:39.637339 13760 pending_rounds.cc:107] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting uncommitted NO_OP operation due to leader change: 17.9
I20260709 12:12:39.637679 13760 raft_consensus.cc:2889] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:39.609692 20795 consensus_queue.cc:1243] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer 96701a74fdee481fb5f54aac841e17dd log is divergent from this leader: its last log entry 17.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:12:39.591565 20768 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:39.649320 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 169025us
W20260709 12:12:39.652099 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 58668.8us
I20260709 12:12:39.652938 13652 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:39.652938 13726 leader_election.cc:304] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:39.656098 13800 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:39.650492 13727 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:39.666898 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:39.668354 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:39.669299 13834 raft_consensus.cc:2410] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 21 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 12:12:39.673324 13835 raft_consensus.cc:1275] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:12:39.675001 13726 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:39.675765 13831 raft_consensus.cc:1275] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 12:12:39.675915 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:39.679883 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:39.680615 13762 raft_consensus.cc:1275] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:12:39.682576 13652 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:39.685566 13686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 1268) took 1346 ms. Trace:
I20260709 12:12:39.686156 13686 rpcz_store.cc:276] 0709 12:12:38.338997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:38.345541 (+  6544us) service_pool.cc:224] Handling call
0709 12:12:38.362368 (+ 16827us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:38.511322 (+148954us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:38.511371 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:38.511431 (+    60us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:12:38.511480 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:39.685297 (+1173817us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b54003129d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:39.685347 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:39.685487 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":341936896}
I20260709 12:12:39.687280 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:39.688108 13758 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 16.
I20260709 12:12:39.658877 20825 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:39.693488 13800 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:39.652297 20482 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:39.695035 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:39.693394 13652 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:39.654783 20690 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:39.698172 13758 raft_consensus.cc:1240] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 22. Current term is 23. Ops: []
I20260709 12:12:39.698686 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:39.700505 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:12:39.697182 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:39.704149 20755 consensus_queue.cc:1048] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:12:39.674542 20384 raft_consensus.cc:2749] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:39.659451 20775 raft_consensus.cc:697] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:39.706641 13652 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:39.707130 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:39.659663 19918 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:39.710441 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:39.710929 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:39.716292 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:39.717056 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:39.673879 20824 raft_consensus.cc:2749] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:39.679783 20814 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:39.743206 20814 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:39.733459 13756 raft_consensus.cc:1240] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:39.701135 20786 raft_consensus.cc:2749] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:39.748692 19918 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:39.706314 20812 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:39.720818 20751 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:39.749195 20814 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:39.742214 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:39.735345 20690 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:39.720541 20808 raft_consensus.cc:2749] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:12:39.758299 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 83385.1us
I20260709 12:12:39.768743 13726 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
W20260709 12:12:39.769562 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 63000.4us
I20260709 12:12:39.770390 13652 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:39.695173 20818 raft_consensus.cc:2804] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:39.763474 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:39.725999 20821 raft_consensus.cc:2804] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:39.765432 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:39.835968 13763 raft_consensus.cc:2393] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 21: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:39.767274 13759 raft_consensus.cc:1275] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:12:39.720286 20796 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:39.764281 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:39.837898 13759 raft_consensus.cc:1240] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 LEADER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 23. Current term is 24. Ops: [23.15-23.15]
I20260709 12:12:39.758378 13754 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 20.
I20260709 12:12:39.756274 20757 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:39.786295 20812 raft_consensus.cc:2749] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 12:12:39.791359 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 95859.2us
I20260709 12:12:39.705196 20482 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:39.752645 20813 consensus_queue.cc:1048] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 12:12:39.799546 20761 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:39.799930 20775 consensus_queue.cc:237] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:39.802673 19918 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:39.806059 20806 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:39.763243 20795 raft_consensus.cc:2749] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:39.807231 20768 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:39.808012 20820 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:39.792600 20748 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:39.809335 13652 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:39.784881 20821 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:39.816833 20751 raft_consensus.cc:2749] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:39.819701 20690 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:39.699536 20825 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:39.874017 20820 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:39.875341 20825 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:39.830086 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:39.877164 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:39.877933 13757 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:39.878310 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:12:39.879899 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 70646.4us
I20260709 12:12:39.771296 13760 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 15.
I20260709 12:12:39.882009 20824 consensus_queue.cc:1048] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:39.883282 20810 raft_consensus.cc:2749] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:39.884989 13652 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:12:39.840628 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 135143us
I20260709 12:12:39.795166 20786 raft_consensus.cc:2749] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:39.838284 13762 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 14.
I20260709 12:12:39.855926 20757 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:39.887313 13761 raft_consensus.cc:606] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:39.887836 13761 raft_consensus.cc:614] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:39.893642 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:39.894101 20482 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:39.894423 14408 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 21.
I20260709 12:12:39.894134 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:39.895407 14414 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 15.
W20260709 12:12:39.896762 20822 log.cc:927] Time spent T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.106s	user 0.002s	sys 0.000s
W20260709 12:12:39.898684 20804 log.cc:927] Time spent T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.561s	user 0.002s	sys 0.000s
I20260709 12:12:39.907657 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:39.908075 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:39.912335 20406 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:39.913105 20799 log.cc:927] Time spent T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.802s	user 0.006s	sys 0.000s
I20260709 12:12:39.856565 20675 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:39.914379 20675 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:39.864292 20761 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:39.908450 14408 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 24.
I20260709 12:12:39.919030 13758 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 20.
I20260709 12:12:39.917436 13837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 1282) took 1210 ms. Trace:
I20260709 12:12:39.929885 13757 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 17.
W20260709 12:12:39.835698 20829 log.cc:927] Time spent T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:12:39.861127 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:39.929426 13652 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:39.836328 20674 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:39.805576 20679 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:39.944720 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 251327us
I20260709 12:12:39.871990 20821 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:39.864187 20808 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:39.919272 20786 raft_consensus.cc:2749] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:39.950264 13800 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:39.933176 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:39.839224 20807 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:39.854751 13763 raft_consensus.cc:1240] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:39.916745 20675 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:12:39.916388 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:39.868527 20806 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:39.877406 20820 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:39.860051 20796 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:39.946468 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:39.931682 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:39.948758 13759 raft_consensus.cc:1240] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:39.948217 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:39.923568 13837 rpcz_store.cc:276] 0709 12:12:38.706699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:38.706845 (+   146us) service_pool.cc:224] Handling call
0709 12:12:38.709931 (+  3086us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:38.710298 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:38.710327 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:38.717689 (+  7362us) log.cc:844] Serialized 26 byte log entry
0709 12:12:38.842164 (+124475us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:38.842227 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:38.842326 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:39.889128 (+1046802us) spinlock_profiling.cc:243] Waited 4.91 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:12:39.917141 (+ 28013us) raft_consensus.cc:1685] finished
0709 12:12:39.917165 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:39.917376 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":96,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":7478,"spinlock_wait_cycles":11297536,"thread_start_us":106791,"threads_started":1,"wal-append.queue_time_us":209849}
I20260709 12:12:39.918853 20761 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:39.949452 13652 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:39.956509 20812 raft_consensus.cc:2804] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:39.959599 13651 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
W20260709 12:12:40.019991 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 60501.4us
I20260709 12:12:40.021329 13651 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:39.966270 13757 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 18.
I20260709 12:12:40.023262 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:12:39.972985 20830 log.cc:927] Time spent T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:12:39.973065 13800 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:39.955253 20808 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:40.027434 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 54481.4us
I20260709 12:12:39.987675 13756 raft_consensus.cc:1240] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:39.989120 20679 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:39.990528 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:39.947798 20742 raft_consensus.cc:2804] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:39.992983 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:39.993638 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:39.993875 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:39.994728 14409 raft_consensus.cc:1240] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:39.995410 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:39.996174 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:39.998520 20806 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:40.015226 13686 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 24.
W20260709 12:12:40.015202 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 65842.7us
I20260709 12:12:40.016724 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:40.025731 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:40.028748 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:40.028885 13800 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:40.029094 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:40.025090 20786 raft_consensus.cc:2804] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:40.039291 13800 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:40.019091 20812 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:40.026926 20675 raft_consensus.cc:2804] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:12:40.098284 14380 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.001s	sys 0.017s
I20260709 12:12:40.030807 20810 raft_consensus.cc:2749] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:40.031054 20768 raft_consensus.cc:2749] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:39.954217 20674 consensus_queue.cc:1048] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.080s
W20260709 12:12:40.138867 14380 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.002s	sys 0.017s
I20260709 12:12:40.004357 20796 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:40.141566 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:40.030157 20742 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:40.051057 20786 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:40.138263 20812 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:40.043605 20825 raft_consensus.cc:2749] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:40.167671 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 695919us
I20260709 12:12:40.138727 20675 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:40.159994 20834 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:40.187954 20835 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:40.150220 13757 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 16.
I20260709 12:12:40.183295 20742 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:40.188995 20786 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:40.213018 20836 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:40.204166 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 168611us
I20260709 12:12:40.242072 20836 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:40.245188 20836 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:40.215288 20808 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:40.221856 20675 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:40.228392 20806 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:40.229336 20807 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:40.229629 20835 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:40.271988 20835 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:40.230489 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:40.233174 20834 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:40.276122 20834 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:40.239102 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 199934us
I20260709 12:12:40.208180 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:40.277789 13800 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:40.279165 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:40.291705 13757 raft_consensus.cc:1240] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:40.294504 13757 raft_consensus.cc:1240] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:40.305649 20674 raft_consensus.cc:2749] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:40.139878 20795 consensus_queue.cc:1048] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 12:12:40.315212 13763 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 17.
I20260709 12:12:40.314775 13800 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:12:40.364666 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 50028.4us
W20260709 12:12:40.386650 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 358960us
I20260709 12:12:40.391108 13651 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:40.369446 13800 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:12:40.416047 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 46706.6us
I20260709 12:12:40.416069 13651 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:40.421710 13651 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:12:40.416623 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 174228us
W20260709 12:12:40.402451 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 197758us
I20260709 12:12:40.401511 20836 raft_consensus.cc:2804] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:40.377626 20806 raft_consensus.cc:2804] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:12:40.468258 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 46640.6us
I20260709 12:12:40.469169 13651 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:40.424873 13652 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:40.428440 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:40.431226 20757 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:40.433235 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:40.435500 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:40.473573 13834 raft_consensus.cc:2393] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 20: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:40.474169 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:40.440469 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:40.442957 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:40.475023 14416 raft_consensus.cc:2410] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 25 because replica has last-logged OpId of term: 23 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 14.
I20260709 12:12:40.475301 13835 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 24.
I20260709 12:12:40.452073 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:40.476313 13828 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 18.
I20260709 12:12:40.475023 13830 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 18.
I20260709 12:12:40.363870 20835 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:12:40.475736 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 52431.2us
I20260709 12:12:40.489449 13837 raft_consensus.cc:2393] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 16: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:40.419847 20768 raft_consensus.cc:2804] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:40.420827 20846 raft_consensus.cc:2804] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:12:40.478080 20406 consensus_meta.cc:287] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.565s	user 0.009s	sys 0.001s
I20260709 12:12:40.524304 13754 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 20.
W20260709 12:12:40.506278 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 85869.7us
I20260709 12:12:40.531690 13652 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:40.485852 20845 raft_consensus.cc:2749] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:40.535523 20853 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 12:12:40.537230 20821 consensus_meta.cc:287] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.572s	user 0.014s	sys 0.002s
I20260709 12:12:40.490417 20806 raft_consensus.cc:697] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 18 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
W20260709 12:12:40.539717 13759 consensus_meta.cc:287] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.503s	user 0.008s	sys 0.000s
I20260709 12:12:40.539608 13652 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:40.541198 14380 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:40.500754 20846 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:40.543494 13759 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 18.
I20260709 12:12:40.546842 14380 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:40.548768 14380 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:40.559536 13759 raft_consensus.cc:1275] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:12:40.517937 20835 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:40.608778 13800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:40.608922 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:40.558818 14380 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:40.542503 20853 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:40.541692 20795 raft_consensus.cc:2749] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:40.611771 13759 raft_consensus.cc:1240] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:40.613085 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:40.616019 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:40.558497 20482 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 12:12:40.634898 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 76184.2us
I20260709 12:12:40.641485 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:40.646059 13835 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:40.634246 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:40.558883 20814 raft_consensus.cc:2804] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:40.607573 20577 raft_consensus.cc:2804] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:12:40.642885 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 173817us
I20260709 12:12:40.644783 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:40.549441 20846 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:40.666343 13836 raft_consensus.cc:2368] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 22. Current term is 23.
I20260709 12:12:40.668133 20857 raft_consensus.cc:2749] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:40.538101 20675 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:40.649394 13832 pending_rounds.cc:85] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 8
I20260709 12:12:40.673926 13832 pending_rounds.cc:107] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 17.9
I20260709 12:12:40.674252 13832 raft_consensus.cc:2889] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:40.650434 20814 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:40.635516 20853 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:40.639093 20834 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:40.645608 20482 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:40.547055 20821 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:40.683462 13679 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.016s	sys 0.011s
I20260709 12:12:40.672390 13651 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:12:40.700641 13679 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.017s	sys 0.011s
W20260709 12:12:40.703509 20817 log.cc:927] Time spent T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.875s	user 0.018s	sys 0.007s
I20260709 12:12:40.720774 20810 raft_consensus.cc:2749] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:40.721120 20807 consensus_queue.cc:1059] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:40.723095 20807 raft_consensus.cc:3055] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:40.723595 20807 raft_consensus.cc:740] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:40.700765 13835 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 21.
I20260709 12:12:40.735695 13761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:39554 (request call id 89) took 1105 ms. Trace:
I20260709 12:12:40.736327 13761 rpcz_store.cc:276] 0709 12:12:39.629925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:39.630076 (+   151us) service_pool.cc:224] Handling call
0709 12:12:40.735383 (+1105307us) spinlock_profiling.cc:243] Waited 253 ms on lock 0x7b54003101d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f87853 00007fa92cf5560a 00007fa9264db7d4 00007fa9264db762 00007fa9264db691 00007fa9264db60c 00007fa9264da8c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:40.735563 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":582620032}
I20260709 12:12:40.738672 13684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 2283) took 1929 ms. Trace:
I20260709 12:12:40.739424 13684 rpcz_store.cc:276] 0709 12:12:38.808828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:38.848380 (+ 39552us) service_pool.cc:224] Handling call
0709 12:12:39.157231 (+308851us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:39.158760 (+  1529us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:40.738361 (+1579601us) spinlock_profiling.cc:243] Waited 270 ms on lock 0x7b54002c3b50. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:40.738567 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":621887232}
I20260709 12:12:40.715548 20796 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:40.664508 20577 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:40.724805 20807 consensus_queue.cc:260] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:40.749424 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 77124.3us
W20260709 12:12:40.701268 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 161756us
I20260709 12:12:40.680721 20814 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:40.700244 20482 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:40.698386 20836 raft_consensus.cc:697] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 17 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:40.698791 20845 raft_consensus.cc:2749] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:40.758615 13651 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:12:40.764060 20850 log.cc:927] Time spent T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 12:12:40.764436 13680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 3293) took 1888 ms. Trace:
W20260709 12:12:40.770557 20851 log.cc:927] Time spent T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 12:12:40.775086 20835 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:40.775887 20862 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:40.749115 20577 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:40.781980 13651 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:12:40.803444 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 157103us
I20260709 12:12:40.816417 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:40.817269 13682 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 22.
I20260709 12:12:40.819281 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:40.819922 13682 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 23.
I20260709 12:12:40.821599 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:40.823326 13682 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 18.
I20260709 12:12:40.782227 13652 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:40.785667 13680 rpcz_store.cc:276] 0709 12:12:38.875987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:39.178982 (+302995us) service_pool.cc:224] Handling call
0709 12:12:39.191400 (+ 12418us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:39.316509 (+125109us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:39.316549 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:40.612303 (+1295754us) spinlock_profiling.cc:243] Waited 3.2 ms on lock 0x7b2c000014c8. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa926886a11 00007fa926896372 00007fa927fc8a01 00007fa927f8d43a 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2
0709 12:12:40.612683 (+   380us) log.cc:844] Serialized 26 byte log entry
0709 12:12:40.715452 (+102769us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:40.717700 (+  2248us) log.cc:844] Serialized 14 byte log entry
0709 12:12:40.720214 (+  2514us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:40.723470 (+  3256us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:40.764048 (+ 40578us) raft_consensus.cc:1685] finished
0709 12:12:40.764171 (+   123us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:40.764346 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":952,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":58,"raft.queue_time_us":84156,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":11830,"spinlock_wait_cycles":7361792,"thread_start_us":120326,"threads_started":2,"wal-append.queue_time_us":113341}
I20260709 12:12:40.754942 20768 raft_consensus.cc:697] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 17 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:40.756727 20800 raft_consensus.cc:2749] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:12:40.803840 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 71172us
I20260709 12:12:40.827567 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:12:40.829383 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:40.830046 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:40.836382 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:40.837298 13680 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 20.
I20260709 12:12:40.839807 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:40.840600 13684 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 20.
I20260709 12:12:40.812464 20845 raft_consensus.cc:2804] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:40.843832 13681 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 19.
I20260709 12:12:40.847695 20864 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:40.851045 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:40.851243 20768 consensus_queue.cc:237] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:40.745434 20806 consensus_queue.cc:237] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:40.770560 20796 consensus_queue.cc:1048] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 12:12:40.833329 20795 raft_consensus.cc:2804] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:12:40.877118 20856 log.cc:927] Time spent T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:12:40.877521 20810 raft_consensus.cc:2749] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:40.815173 20862 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:40.896749 20862 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:40.861492 20845 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:40.898132 20863 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:40.898999 20863 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:40.902037 20836 consensus_queue.cc:237] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:40.903414 20795 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:40.904031 20795 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:40.898241 20845 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:40.866379 20864 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:40.916038 20482 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:41.064090 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 193596us
I20260709 12:12:40.996992 20863 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:41.044756 20675 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:41.262668 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:41.288128 13800 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.004s	sys 0.028s
W20260709 12:12:41.358989 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:41.361464 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 579250us
I20260709 12:12:40.966878 20859 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:41.096951 20871 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:41.364763 20834 consensus_meta.cc:287] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.664s	user 0.009s	sys 0.014s
W20260709 12:12:41.366734 13800 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.004s	sys 0.028s
I20260709 12:12:41.380048 13652 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:12:41.397040 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 699354us
W20260709 12:12:41.372294 20846 consensus_meta.cc:287] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.706s	user 0.007s	sys 0.010s
W20260709 12:12:41.374714 20814 consensus_meta.cc:287] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.595s	user 0.012s	sys 0.002s
I20260709 12:12:41.407354 13652 leader_election.cc:400] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 election: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 22. Current term is 23.
I20260709 12:12:41.416792 13652 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:12:41.374711 20786 consensus_meta.cc:287] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 1.140s	user 0.006s	sys 0.015s
W20260709 12:12:41.464449 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 399230us
W20260709 12:12:41.391482 20742 consensus_meta.cc:287] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 1.147s	user 0.022s	sys 0.007s
W20260709 12:12:41.393497 20812 consensus_meta.cc:287] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 1.156s	user 0.017s	sys 0.003s
W20260709 12:12:41.409271 13800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:41.410113 14379 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.002s	sys 0.011s
I20260709 12:12:41.369854 20796 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:41.369807 20835 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:41.415537 20800 raft_consensus.cc:2749] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:41.413074 20834 raft_consensus.cc:2749] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:41.365061 20795 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:41.403952 20871 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:41.392143 20821 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:41.377110 20863 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:41.396298 20859 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:41.411083 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 97297.8us
W20260709 12:12:41.476253 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 59536.5us
W20260709 12:12:41.482479 14379 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.003s	sys 0.011s
I20260709 12:12:41.372298 20845 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:41.430356 20814 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:41.428586 20846 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:41.371858 20849 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:41.542686 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:12:41.553453 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 87345.4us
I20260709 12:12:41.541887 13652 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:12:41.541543 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 672573us
I20260709 12:12:41.552904 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:41.552579 13688 raft_consensus.cc:1240] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:41.555840 13680 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 24.
I20260709 12:12:41.543257 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:41.495036 20881 raft_consensus.cc:2749] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:41.559142 14379 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:41.562480 13682 raft_consensus.cc:1240] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 12:12:41.508522 20835 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:41.496577 20812 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:41.570396 20800 raft_consensus.cc:2749] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:41.573503 20845 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:41.575403 20814 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:41.576797 20577 consensus_meta.cc:287] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.744s	user 0.012s	sys 0.005s
I20260709 12:12:41.578461 20846 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:41.562793 20674 consensus_queue.cc:1059] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 12:12:41.579505 20876 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:41.489266 20742 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:41.540484 20821 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:41.595438 13685 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:41.508977 20796 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:41.560762 20863 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:41.488293 20786 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:41.598349 20812 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:12:41.600827 20883 log.cc:927] Time spent T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
W20260709 12:12:41.602706 20880 log.cc:927] Time spent T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 12:12:41.603127 20853 consensus_meta.cc:287] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.903s	user 0.015s	sys 0.000s
I20260709 12:12:41.607144 20482 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:41.594767 20869 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:41.619491 20866 raft_consensus.cc:3055] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:41.636111 20866 raft_consensus.cc:740] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:41.637185 20866 consensus_queue.cc:260] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:41.609252 20873 log.cc:927] Time spent T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.522s	user 0.000s	sys 0.011s
W20260709 12:12:41.619059 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 59987.9us
I20260709 12:12:41.639345 13828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 3159) took 1027 ms. Trace:
I20260709 12:12:41.639786 13828 rpcz_store.cc:276] 0709 12:12:40.612405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:40.614790 (+  2385us) service_pool.cc:224] Handling call
0709 12:12:40.615249 (+   459us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:40.644726 (+ 29477us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:40.644757 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:40.649309 (+  4552us) log.cc:844] Serialized 26 byte log entry
0709 12:12:41.366208 (+716899us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:41.509333 (+143125us) log.cc:844] Serialized 14 byte log entry
0709 12:12:41.565199 (+ 55866us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:41.565353 (+   154us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:41.639092 (+ 73739us) raft_consensus.cc:1685] finished
0709 12:12:41.639123 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:41.639282 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9304,"prepare.queue_time_us":39698,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":270518,"raft.run_cpu_time_us":408,"raft.run_wall_time_us":25966,"thread_start_us":406751,"threads_started":3,"wal-append.queue_time_us":729077}
I20260709 12:12:41.563385 20849 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:41.630926 20853 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:41.643503 20853 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:41.614547 20577 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:41.645677 20577 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:41.650393 20796 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:41.653270 20869 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:41.567759 13652 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:41.596912 20886 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:41.656229 20869 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:41.657585 20869 raft_consensus.cc:2749] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:41.657919 20795 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:41.639397 13832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 3161) took 1004 ms. Trace:
I20260709 12:12:41.658946 13832 rpcz_store.cc:276] 0709 12:12:40.634883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:40.635752 (+   869us) service_pool.cc:224] Handling call
0709 12:12:40.649178 (+ 13426us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:40.675144 (+ 25966us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:40.675192 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:40.675902 (+   710us) log.cc:844] Serialized 52 byte log entry
0709 12:12:40.798669 (+122767us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:12:40.798707 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:40.798795 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:41.639142 (+840347us) raft_consensus.cc:1685] finished
0709 12:12:41.639169 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:41.639334 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":171092,"spinlock_wait_cycles":11214592,"thread_start_us":118875,"threads_started":1,"wal-append.queue_time_us":163517}
W20260709 12:12:41.658812 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 91205.2us
I20260709 12:12:41.661158 13652 leader_election.cc:400] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 pre-election: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 22. Current term is 23.
I20260709 12:12:41.662781 20863 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:12:41.634473 20878 log.cc:927] Time spent T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:12:41.671685 13688 raft_consensus.cc:1240] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:41.673476 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:41.674407 13685 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 20.
I20260709 12:12:41.674856 13652 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:12:41.677302 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 117860us
I20260709 12:12:41.621095 20821 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:41.675580 20252 consensus_queue.cc:1059] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 12:12:41.682786 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:41.683120 20863 raft_consensus.cc:2804] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:41.683858 20863 raft_consensus.cc:697] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 21 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:41.618206 20876 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:41.685534 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:41.686236 13831 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:41.686589 20876 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:41.687212 20252 raft_consensus.cc:3055] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:41.687654 20252 raft_consensus.cc:740] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:41.688598 20252 consensus_queue.cc:260] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:41.690414 20252 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:41.692615 20835 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:41.694366 13830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 3158) took 1082 ms. Trace:
I20260709 12:12:41.695222 13831 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 19.
I20260709 12:12:41.695523 20871 leader_election.cc:290] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:41.696027 20795 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:41.696552 20795 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:41.697156 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:41.700321 20795 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:41.701052 13686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 1285) took 1496 ms. Trace:
I20260709 12:12:41.701292 20869 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:41.701486 13686 rpcz_store.cc:276] 0709 12:12:40.204627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:40.204779 (+   152us) service_pool.cc:224] Handling call
0709 12:12:40.209233 (+  4454us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:40.745521 (+536288us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:40.745558 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:40.745601 (+    43us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:40.745631 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:41.697744 (+952113us) spinlock_profiling.cc:243] Waited 536 ms on lock 0x7b5400199954. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:41.700860 (+  3116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:41.700992 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1232860544}
I20260709 12:12:41.701891 20869 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:41.704453 20869 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:41.691026 20863 consensus_queue.cc:237] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:41.694788 13830 rpcz_store.cc:276] 0709 12:12:40.612124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:40.614205 (+  2081us) service_pool.cc:224] Handling call
0709 12:12:40.614677 (+   472us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:40.799019 (+184342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:40.799050 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:40.812567 (+ 13517us) log.cc:844] Serialized 26 byte log entry
0709 12:12:40.966572 (+154005us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:40.966662 (+    90us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:40.968524 (+  1862us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:41.694138 (+725614us) raft_consensus.cc:1685] finished
0709 12:12:41.694159 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:41.694294 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21239,"raft.queue_time_us":206060,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":19466,"thread_start_us":251785,"threads_started":2,"wal-append.queue_time_us":644368}
I20260709 12:12:41.706601 20807 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:41.700968 20795 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:41.707832 20795 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:41.685822 14379 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:41.710026 20837 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:12:41.710438 20837 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:41.710796 20837 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:12:41.718405 13651 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.56.194:39545 timed out after 1.771s (SENT) [suppressed 35 similar messages]
I20260709 12:12:41.718854 20792 raft_consensus.cc:3055] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:41.679808 20742 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:41.720053 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:41.723716 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:41.724429 13828 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:41.727075 13652 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:41.719331 20792 raft_consensus.cc:740] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
W20260709 12:12:41.742147 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 260099us
I20260709 12:12:41.718904 20786 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:41.738677 20869 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:41.744791 14380 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:12:41.748049 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 1.9792e+06us
I20260709 12:12:41.740734 20864 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:41.751873 13726 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:41.746649 14379 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:41.749359 13800 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:41.746436 20742 raft_consensus.cc:2749] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:41.774518 20821 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:41.772621 20818 raft_consensus.cc:697] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:41.776072 20795 leader_election.cc:290] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:41.783304 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:12:41.789960 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 1.94858e+06us
I20260709 12:12:41.784273 14416 raft_consensus.cc:1240] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:41.791280 19918 consensus_queue.cc:1048] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:41.774557 20253 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:41.773133 20457 raft_consensus.cc:2749] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:41.793512 20253 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:41.786003 20814 consensus_queue.cc:1059] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:41.780134 20786 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:41.788726 20818 consensus_queue.cc:237] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:41.777158 20864 raft_consensus.cc:2804] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:41.781972 13800 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:41.802937 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:41.798161 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:41.766523 20886 raft_consensus.cc:2804] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:41.801437 14416 raft_consensus.cc:1240] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 18. Current term is 19. Ops: []
W20260709 12:12:41.809885 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:41.814494 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:41.816718 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:41.817369 13759 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:41.824430 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:41.817240 13800 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:41.824461 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:41.828624 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:41.829370 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:41.829880 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:41.829973 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:41.824965 20768 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:41.832250 20768 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:41.834445 20768 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:41.835913 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:41.836555 13837 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 16.
I20260709 12:12:41.838129 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:41.838449 13760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 1119) took 2025 ms. Trace:
I20260709 12:12:41.838613 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:41.839229 14412 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:41.800246 20795 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:41.838945 14413 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 21.
I20260709 12:12:41.827366 13761 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 18.
I20260709 12:12:41.860379 13800 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:41.861728 13762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 1120) took 2048 ms. Trace:
I20260709 12:12:41.864987 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:41.866082 13754 raft_consensus.cc:2468] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 16.
I20260709 12:12:41.858629 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:41.839035 13760 rpcz_store.cc:276] 0709 12:12:39.812839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:39.884705 (+ 71866us) service_pool.cc:224] Handling call
0709 12:12:39.887209 (+  2504us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:39.887424 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 12:12:40.047555 (+160131us) log.cc:844] Serialized 14 byte log entry
0709 12:12:41.837994 (+1790439us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:41.838067 (+    73us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:12:41.838140 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:41.838231 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:41.838379 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1524945,"prepare.queue_time_us":117137,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":46,"thread_start_us":387931,"threads_started":2,"wal-append.queue_time_us":442364,"wal-append.run_cpu_time_us":1273,"wal-append.run_wall_time_us":1043007}
I20260709 12:12:41.848434 13759 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 21.
W20260709 12:12:41.868741 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:41.869037 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:41.846446 13828 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 25.
I20260709 12:12:41.812561 20253 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:41.808173 20864 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:41.875248 13763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 2425) took 1986 ms. Trace:
I20260709 12:12:41.876811 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:41.862315 13762 rpcz_store.cc:276] 0709 12:12:39.813079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:39.886415 (+ 73336us) service_pool.cc:224] Handling call
0709 12:12:39.886786 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:39.887068 (+   282us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 12:12:40.241568 (+354500us) log.cc:844] Serialized 14 byte log entry
0709 12:12:41.861259 (+1619691us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:41.861335 (+    76us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:12:41.861406 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:41.861497 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:41.861652 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1423313,"prepare.queue_time_us":52773,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"thread_start_us":526797,"threads_started":2,"wal-append.queue_time_us":264757,"wal-append.run_cpu_time_us":1149,"wal-append.run_wall_time_us":1013429}
I20260709 12:12:41.871948 14380 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:41.878840 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:41.873056 13800 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:41.873862 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:41.762676 20869 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:41.875686 13763 rpcz_store.cc:276] 0709 12:12:39.888893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:40.364263 (+475370us) service_pool.cc:224] Handling call
0709 12:12:40.364695 (+   432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:40.364942 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 12:12:40.422291 (+ 57349us) log.cc:844] Serialized 14 byte log entry
0709 12:12:41.874905 (+1452614us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:41.874960 (+    55us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:12:41.875006 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:41.875070 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:41.875188 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1239486,"prepare.queue_time_us":58644,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"thread_start_us":261443,"threads_started":1,"wal-append.queue_time_us":339581,"wal-append.run_cpu_time_us":1262,"wal-append.run_wall_time_us":1002480}
I20260709 12:12:41.882077 13829 raft_consensus.cc:1240] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:41.889015 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:41.889834 13754 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:12:41.882814 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:41.880066 13800 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:41.880476 20807 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:41.884155 20808 consensus_queue.cc:1059] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:41.893287 20808 raft_consensus.cc:3055] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:41.893702 20808 raft_consensus.cc:740] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:41.894701 20808 consensus_queue.cc:260] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:41.896287 20808 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:41.884941 20835 raft_consensus.cc:2804] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:41.897550 20835 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:41.898078 20835 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:41.885128 20755 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:41.876569 20768 raft_consensus.cc:2749] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:41.886161 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 134368us
I20260709 12:12:41.886487 20758 raft_consensus.cc:2749] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:41.890877 13761 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:41.803228 20786 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:41.891736 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:41.891971 20807 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:41.825642 20886 raft_consensus.cc:697] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 19 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:41.909204 20752 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:41.911895 20752 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:41.912177 20886 consensus_queue.cc:237] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:41.908887 20821 raft_consensus.cc:2804] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:41.914163 20768 raft_consensus.cc:2804] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:41.914675 20768 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:41.915068 20768 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:41.916036 20821 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:41.916635 20821 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:41.920061 20869 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:41.920739 20752 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:41.872642 20795 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:41.923256 20795 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:41.925326 20786 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:41.917454 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:41.926749 13763 raft_consensus.cc:2376] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 21. Re-sending same reply.
I20260709 12:12:41.903540 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:41.903613 13726 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:41.908285 13727 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:41.902006 20814 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:12:41.840823 20896 raft_consensus.cc:2804] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:41.909842 13759 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:41.930478 13651 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:41.881246 20864 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:41.943480 13727 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:41.933266 13726 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:41.927978 13760 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 18.
I20260709 12:12:41.908746 13762 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 18.
I20260709 12:12:41.939272 20871 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:12:41.941943 13755 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48114 (request call id 3245) took 2276 ms (client timeout 2824 ms). Trace:
W20260709 12:12:41.949790 13755 rpcz_store.cc:269] 0709 12:12:39.659751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:39.660171 (+   420us) service_pool.cc:224] Handling call
0709 12:12:41.933167 (+2272996us) spinlock_profiling.cc:243] Waited 626 ms on lock 0x7b540038b8d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:41.935980 (+  2813us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1439700224}
I20260709 12:12:41.876129 20742 consensus_queue.cc:1059] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.066s
I20260709 12:12:41.935909 20752 raft_consensus.cc:2749] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 12:12:41.964439 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 84449.4us
I20260709 12:12:41.936441 20896 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:41.971102 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:41.961730 13727 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:41.977551 13755 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:41.949929 20454 raft_consensus.cc:2749] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:41.948004 20758 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:41.971645 13800 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:41.987699 13800 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:41.950564 20786 raft_consensus.cc:2804] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:41.979212 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:41.950171 20814 raft_consensus.cc:697] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 25 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:41.979239 13759 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 16.
I20260709 12:12:41.925949 20755 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:41.966686 13726 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
W20260709 12:12:42.014532 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 47949us
I20260709 12:12:41.975159 13754 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 16.
I20260709 12:12:42.017961 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:42.018996 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:12:42.019424 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:41.983297 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 140731us
I20260709 12:12:41.916911 20837 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:41.995530 20742 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:41.976037 20689 raft_consensus.cc:2804] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:41.999348 20759 raft_consensus.cc:2804] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:42.000016 20454 consensus_queue.cc:1059] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:42.002769 13761 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 17.
I20260709 12:12:42.030110 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:42.030376 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:42.006610 13755 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 19.
I20260709 12:12:42.012897 14412 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 16.
I20260709 12:12:42.020254 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:42.037901 13759 raft_consensus.cc:2393] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 21: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:42.038878 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:42.039529 13759 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 19.
I20260709 12:12:42.040357 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:42.040257 20792 consensus_queue.cc:260] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:42.041030 13759 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 19.
I20260709 12:12:42.042003 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:41.980275 20896 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:42.023284 13652 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:42.043682 20863 raft_consensus.cc:2804] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:42.044224 20863 raft_consensus.cc:697] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 21 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:42.026240 20758 consensus_queue.cc:1048] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:12:42.026217 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:42.030983 20906 raft_consensus.cc:2749] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:42.031262 20775 consensus_queue.cc:1048] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:42.024077 20689 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:42.023804 20770 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:42.027869 20759 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:42.028432 20742 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:42.021831 20253 consensus_queue.cc:1059] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 12:12:42.036545 20384 raft_consensus.cc:3055] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:42.022655 13758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 2428) took 2082 ms. Trace:
W20260709 12:12:42.042250 20903 log.cc:927] Time spent T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:12:42.044826 13759 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:42.009765 20786 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:42.010464 20812 raft_consensus.cc:2804] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:12:42.045732 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:42.047178 13726 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:41.964671 20871 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:42.012298 20835 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:42.021590 20702 raft_consensus.cc:2804] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:12:42.127316 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 75060.5us
I20260709 12:12:42.152976 13756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 3258) took 2436 ms. Trace:
I20260709 12:12:42.130638 20759 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:42.128387 14414 raft_consensus.cc:2393] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 25: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:12:42.130483 13761 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:12:42.025313 20755 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:42.044427 20876 raft_consensus.cc:3055] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:12:42.158367 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 141186us
W20260709 12:12:42.140197 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 141453us
I20260709 12:12:42.138054 20384 raft_consensus.cc:740] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:42.166390 20384 consensus_queue.cc:260] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:42.167805 20384 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:42.159399 20876 raft_consensus.cc:740] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:42.171445 20742 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:42.171792 13759 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 21.
I20260709 12:12:42.175288 20906 consensus_queue.cc:1059] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:42.176409 20906 raft_consensus.cc:3055] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:42.176821 20906 raft_consensus.cc:740] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:42.164153 13800 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:42.180054 20835 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:42.180833 20835 raft_consensus.cc:2804] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:42.181223 20835 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:42.183863 20871 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:42.187023 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:42.187505 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:42.187753 13679 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 23.
I20260709 12:12:42.188079 13688 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:42.147997 20812 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:42.188838 20812 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:42.190196 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:42.190925 13687 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 18.
I20260709 12:12:42.147838 20786 raft_consensus.cc:3060] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:42.194171 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:42.194962 13684 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 16.
I20260709 12:12:42.195945 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:42.196610 13680 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 23.
I20260709 12:12:42.197080 13757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 2427) took 2266 ms. Trace:
I20260709 12:12:42.197569 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:42.198371 13686 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 22.
I20260709 12:12:42.200884 13688 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 15.
I20260709 12:12:42.177731 20906 consensus_queue.cc:260] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:42.133484 20816 raft_consensus.cc:2749] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:12:42.154593 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 107564us
I20260709 12:12:42.155181 13761 raft_consensus.cc:606] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 LEADER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:42.130484 20689 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:42.153641 13756 rpcz_store.cc:276] 0709 12:12:39.711568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:39.749938 (+ 38370us) service_pool.cc:224] Handling call
0709 12:12:39.750344 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:40.028129 (+277785us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:42.147305 (+2119176us) spinlock_profiling.cc:243] Waited 237 ms on lock 0x7b54000efe54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:42.147562 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":545080192}
I20260709 12:12:42.041649 20792 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:42.143918 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:42.156059 13652 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:42.208343 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:42.138370 13758 rpcz_store.cc:276] 0709 12:12:39.940555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:40.478397 (+537842us) service_pool.cc:224] Handling call
0709 12:12:40.488086 (+  9689us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:40.488335 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 12:12:40.506053 (+ 17718us) log.cc:844] Serialized 14 byte log entry
0709 12:12:41.926168 (+1420115us) log.cc:844] Serialized 14 byte log entry
0709 12:12:42.022259 (+ 96091us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:42.022332 (+    73us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:12:42.022388 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:42.022461 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:42.022583 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1235644,"prepare.queue_time_us":164106,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":89,"raft.queue_time_us":1240872,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":4746,"spinlock_wait_cycles":11001088,"thread_start_us":279300,"threads_started":3,"wal-append.queue_time_us":160517,"wal-append.run_cpu_time_us":1229,"wal-append.run_wall_time_us":1008778}
I20260709 12:12:42.197465 13757 rpcz_store.cc:276] 0709 12:12:39.930365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:40.366442 (+436077us) service_pool.cc:224] Handling call
0709 12:12:40.419606 (+ 53164us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:41.871780 (+1452174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:41.871816 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:41.880203 (+  8387us) log.cc:844] Serialized 52 byte log entry
0709 12:12:42.042812 (+162609us) spinlock_profiling.cc:243] Waited 4.87 ms on lock 0x7b48001a01d8. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92ceb6aa1 00007fa92ceadb37 00007fa92cead9ca 00007fa92cfa526f 00007fa92cfa4f37 00007fa92cfb955c 00007fa92cfb9508 00007fa92cfb9488 00007fa92cfb9443 00007fa92cfb86ec 00007fa92bee2a96
0709 12:12:42.048094 (+  5282us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:42.126153 (+ 78059us) log.cc:844] Serialized 14 byte log entry
0709 12:12:42.130475 (+  4322us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:42.130562 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:42.196777 (+ 66215us) raft_consensus.cc:1685] finished
0709 12:12:42.196875 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:42.197018 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1455445,"prepare.queue_time_us":80119,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":1453745,"raft.run_cpu_time_us":1767,"raft.run_wall_time_us":171430,"spinlock_wait_cycles":23034624,"thread_start_us":105449,"threads_started":1,"wal-append.queue_time_us":283782}
I20260709 12:12:42.209851 13686 raft_consensus.cc:1275] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:12:42.213591 13754 raft_consensus.cc:2376] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 19. Re-sending same reply.
I20260709 12:12:42.141650 20770 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:42.211638 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:42.217347 13688 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 19.
W20260709 12:12:42.214277 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 58302.9us
I20260709 12:12:42.214197 13680 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:42.181615 20835 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:42.220479 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:42.222291 13726 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:42.157477 20758 raft_consensus.cc:2749] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:12:42.228783 13757 raft_consensus.cc:1240] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:42.240450 13680 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 21.
I20260709 12:12:42.249002 20689 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:42.254025 20689 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:42.261190 20859 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:42.157111 20863 consensus_queue.cc:237] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:42.209533 20871 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:42.261976 20835 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:42.263950 20768 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:42.221446 20906 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:42.299863 20871 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:42.302525 20871 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:42.217649 20825 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:42.239759 20807 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:42.264627 20866 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:42.151243 20814 consensus_queue.cc:237] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:42.220041 20742 raft_consensus.cc:2804] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:42.305832 20864 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:42.318718 20849 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:42.320608 20835 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:42.298803 20859 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:42.366106 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:42.322774 20876 consensus_queue.cc:260] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:42.370568 20876 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:42.323679 20768 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:42.296092 20896 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:42.376055 20896 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:42.325537 20786 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:42.345446 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 140466us
I20260709 12:12:42.376804 20864 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:42.363687 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:42.377622 14413 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 15.
I20260709 12:12:42.361109 20871 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:42.378142 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:42.378258 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:42.364398 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:42.368610 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:42.369084 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:42.339509 20825 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:42.384804 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:42.385996 20864 consensus_queue.cc:1048] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:42.388345 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:42.378696 20871 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:42.389716 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:42.390178 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:42.390501 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:42.403738 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:42.403740 13829 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 20.
I20260709 12:12:42.390801 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:42.404500 13687 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:42.397823 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:42.404867 13833 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 19.
I20260709 12:12:42.397891 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:42.401257 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:42.404325 13828 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 23.
I20260709 12:12:42.406639 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:42.407330 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:42.408108 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:42.408514 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:42.408720 13680 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:42.409099 13679 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:42.406601 13686 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 19.
I20260709 12:12:42.364107 20742 raft_consensus.cc:697] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 16 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:42.421306 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:42.422034 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:42.424746 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:42.428117 13684 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:42.425153 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:42.428192 13833 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 14.
I20260709 12:12:42.425271 13830 raft_consensus.cc:1240] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:42.437602 13680 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 24.
I20260709 12:12:42.437805 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:42.439396 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:42.403128 20837 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:42.444475 20786 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:42.449801 13687 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 21.
I20260709 12:12:42.452102 20742 consensus_queue.cc:237] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:42.458484 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:42.462052 14407 raft_consensus.cc:1240] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 24. Current term is 25. Ops: [24.16-24.16]
I20260709 12:12:42.462245 20702 raft_consensus.cc:697] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:42.463364 20702 consensus_queue.cc:237] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:42.465754 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 243531us
I20260709 12:12:42.466161 20384 raft_consensus.cc:2749] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:42.466946 20384 consensus_queue.cc:1048] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:42.468106 13726 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:42.468457 20384 consensus_queue.cc:1048] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:12:42.469450 13684 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 20.
I20260709 12:12:42.470166 20757 raft_consensus.cc:2764] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:12:42.470938 20757 consensus_queue.cc:1048] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:42.469993 20253 consensus_queue.cc:1048] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 12:12:42.475760 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 51389.6us
I20260709 12:12:42.477922 13679 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 23.
I20260709 12:12:42.381906 20859 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:42.484454 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:42.483433 13800 leader_election.cc:304] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:42.487720 13800 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:42.491005 13727 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:42.492646 14407 raft_consensus.cc:2393] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 19: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:12:42.494665 13762 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "956300599d004370953188dd3ae3a256"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:12:42.495329 13762 raft_consensus.cc:606] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:42.495657 13762 raft_consensus.cc:614] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:12:42.497506 20821 consensus_meta.cc:287] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.580s	user 0.011s	sys 0.000s
I20260709 12:12:42.497975 20821 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:42.506053 20797 raft_consensus.cc:3055] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:42.506556 20797 raft_consensus.cc:740] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:42.506968 20674 raft_consensus.cc:2804] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:42.507400 20674 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:42.507786 20674 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:42.508565 20774 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:42.509143 20774 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:42.512140 20774 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:42.512279 20812 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:42.489359 13800 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:42.514420 13800 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:42.516072 13800 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:42.526664 13800 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:42.491323 20726 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:42.513975 20806 raft_consensus.cc:2804] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:42.537508 20806 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:42.530943 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:42.538609 14414 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 19.
I20260709 12:12:42.535729 20825 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:42.519795 20689 raft_consensus.cc:2749] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:42.540907 20914 raft_consensus.cc:2804] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:42.550369 20871 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:42.555030 20859 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:42.529959 20768 raft_consensus.cc:2804] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:42.555929 20768 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:42.556442 20768 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:42.550434 20726 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:42.559641 20726 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:42.507413 20797 consensus_queue.cc:260] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:42.538626 13800 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:42.561555 20797 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:42.537999 20806 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:42.566190 20661 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:42.566958 20661 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:42.569370 20661 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:42.519541 20866 raft_consensus.cc:2804] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:42.542752 13759 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e5274c30729744338992e7c7710e5266"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:12:42.546145 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:42.521976 20864 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:42.542717 20835 consensus_queue.cc:1048] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:42.570025 20770 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:42.570603 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:42.571405 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:42.583669 20906 raft_consensus.cc:2804] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:42.586123 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:42.586824 13760 raft_consensus.cc:2376] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 18. Re-sending same reply.
I20260709 12:12:42.587451 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:42.587746 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:42.572239 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:42.588963 13754 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 20.
I20260709 12:12:42.578097 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:42.573726 20866 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:42.579071 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:42.579784 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:42.595468 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:42.595736 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:42.596561 13685 raft_consensus.cc:2393] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 17: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
W20260709 12:12:42.579999 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:42.579809 13800 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:42.598237 13800 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:42.601190 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:42.601334 13686 raft_consensus.cc:1275] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 12:12:42.602815 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:42.603766 13679 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 19.
I20260709 12:12:42.604132 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:42.605104 13680 raft_consensus.cc:2393] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 17: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:42.605195 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:42.588307 13760 raft_consensus.cc:2376] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 17. Re-sending same reply.
I20260709 12:12:42.607462 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:42.608945 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:42.609299 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:42.578994 20914 raft_consensus.cc:697] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 15 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:42.606532 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:42.585909 20906 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:42.610844 14414 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 19.
I20260709 12:12:42.611141 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:42.611763 13687 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 23.
I20260709 12:12:42.606140 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:42.612901 13727 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:42.613530 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:42.613725 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:42.613961 13830 raft_consensus.cc:1240] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 24. Current term is 25. Ops: []
I20260709 12:12:42.614527 13680 raft_consensus.cc:2393] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 21: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:42.608494 13800 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:42.615804 13685 raft_consensus.cc:1275] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:12:42.619624 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:42.621620 13680 raft_consensus.cc:1275] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:12:42.665761 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:42.622870 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:42.667927 13832 raft_consensus.cc:2393] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 21: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:42.623107 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:42.669394 13757 raft_consensus.cc:2410] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 20 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
I20260709 12:12:42.580703 20864 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:42.623783 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:12:42.673341 14380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:42.625597 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:42.530432 20774 consensus_queue.cc:1059] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.081s
I20260709 12:12:42.627286 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:42.627709 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:42.628034 13727 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:42.627733 20770 raft_consensus.cc:2804] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:12:42.628042 20924 log.cc:927] Time spent T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:12:42.629668 13837 raft_consensus.cc:1240] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 24. Current term is 25. Ops: []
I20260709 12:12:42.588959 20759 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:42.638605 20921 log.cc:927] Time spent T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:12:42.642406 13829 raft_consensus.cc:1240] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 22. Current term is 23. Ops: []
I20260709 12:12:42.641834 20674 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:42.643036 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:42.643631 20871 raft_consensus.cc:2804] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:42.644446 20812 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:42.650936 20726 raft_consensus.cc:993] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7: : Instructing follower 96701a74fdee481fb5f54aac841e17dd to start an election
I20260709 12:12:42.606750 20866 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:42.654718 13834 raft_consensus.cc:1240] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 23. Current term is 24. Ops: []
I20260709 12:12:42.655846 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:42.706774 14411 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 19.
I20260709 12:12:42.618913 20906 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:42.659202 20821 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:42.624635 20836 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:12:42.723461 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 115030us
I20260709 12:12:42.628544 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:42.670948 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:42.680816 13688 raft_consensus.cc:2393] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 16: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:42.723358 13801 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:42.625260 20859 raft_consensus.cc:2804] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader election won for term 21
W20260709 12:12:42.695962 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 68016.7us
I20260709 12:12:42.697149 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:42.702080 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:42.700441 13760 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 20.
I20260709 12:12:42.679785 20864 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:42.682317 20770 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:42.724970 13800 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:42.685318 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:42.725071 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:42.725852 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:42.742544 13800 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:42.730194 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:42.746340 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:42.741837 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:42.734232 13833 raft_consensus.cc:2410] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:12:42.735008 14411 raft_consensus.cc:1240] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 25 LEADER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 24. Current term is 25. Ops: []
I20260709 12:12:42.738754 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:42.739223 20406 consensus_queue.cc:1059] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:42.744148 13837 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 20.
I20260709 12:12:42.748298 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:42.749750 13800 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:42.753248 13832 raft_consensus.cc:1240] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:42.723213 20253 raft_consensus.cc:1081] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 LEADER]: Signalling peer 96701a74fdee481fb5f54aac841e17dd to start an election
I20260709 12:12:42.749854 13828 raft_consensus.cc:1240] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:42.628409 20914 consensus_queue.cc:237] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:42.708081 13763 raft_consensus.cc:2368] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for earlier term 16. Current term is 17.
I20260709 12:12:42.690505 20806 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:42.752800 20893 raft_consensus.cc:2804] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:42.753465 13800 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:42.740134 13727 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:42.759130 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:42.737027 20911 raft_consensus.cc:2804] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:42.763407 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:42.796064 13830 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 18.
I20260709 12:12:42.758996 20384 raft_consensus.cc:3055] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:12:42.763688 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:42.753094 20836 raft_consensus.cc:2804] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:12:42.764971 13836 raft_consensus.cc:1240] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:42.741079 20774 raft_consensus.cc:2804] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:42.798115 20384 raft_consensus.cc:740] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:42.745424 20770 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:42.799137 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:42.800400 20893 raft_consensus.cc:697] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 21 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:42.800639 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:42.801395 20893 consensus_queue.cc:237] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:42.802903 20759 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:42.804291 20742 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:42.804859 20742 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:42.805732 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:42.764447 20835 raft_consensus.cc:2804] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:42.808171 20742 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:42.808853 20835 raft_consensus.cc:697] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 20 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:42.809836 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:42.809921 20768 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:42.810521 14411 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:12:42.812566 20768 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:42.815186 20836 raft_consensus.cc:697] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 24 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:42.817480 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:42.817864 13760 raft_consensus.cc:1275] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:12:42.771221 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:42.818758 13756 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:42.777976 20406 raft_consensus.cc:2749] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:42.779974 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:42.780025 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:42.820585 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:42.781021 20689 consensus_queue.cc:1059] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:42.781963 20661 consensus_queue.cc:1059] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:42.782829 20816 consensus_queue.cc:1059] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:42.789018 20674 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:42.791885 13761 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 19.
I20260709 12:12:42.751209 20896 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:42.773392 13800 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:42.837740 13759 raft_consensus.cc:606] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:42.838179 13759 raft_consensus.cc:614] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:12:42.838197 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 64885.7us
I20260709 12:12:42.842085 13652 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:42.843494 13652 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:42.751832 20859 raft_consensus.cc:697] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 21 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:42.785616 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:42.747774 20812 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:42.770771 13757 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 15.
I20260709 12:12:42.823390 14411 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 17.
I20260709 12:12:42.851595 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:42.852576 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:42.853157 13754 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 17.
I20260709 12:12:42.853302 13757 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 18.
I20260709 12:12:42.854074 13727 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:42.826040 13682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 2293) took 2000 ms. Trace:
I20260709 12:12:42.826483 13760 raft_consensus.cc:1240] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 20. Current term is 21. Ops: [18.11-20.12]
I20260709 12:12:42.854688 13682 rpcz_store.cc:276] 0709 12:12:40.825573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:40.825812 (+   239us) service_pool.cc:224] Handling call
0709 12:12:40.826195 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:41.562938 (+736743us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:42.825746 (+1262808us) spinlock_profiling.cc:243] Waited 736 ms on lock 0x7b540021fa54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:42.825985 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1692746496}
I20260709 12:12:42.704639 20871 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:42.831295 13758 raft_consensus.cc:2368] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 18. Current term is 19.
I20260709 12:12:42.816270 20836 consensus_queue.cc:237] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:42.832379 13829 raft_consensus.cc:1240] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 23. Current term is 24. Ops: []
I20260709 12:12:42.847606 13762 raft_consensus.cc:1275] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:12:42.849192 13652 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:42.824764 20911 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:42.860962 13652 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:42.863461 13756 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 21.
I20260709 12:12:42.826834 20929 raft_consensus.cc:2804] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:12:42.865697 20808 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:42.866173 20808 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:42.866545 20808 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:42.840104 20835 consensus_queue.cc:237] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 19.8, Last appended by leader: 8, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:42.870425 13832 raft_consensus.cc:1275] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:12:42.849912 20742 raft_consensus.cc:2804] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:42.883701 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:42.882156 13652 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:42.843878 20854 raft_consensus.cc:2804] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:42.885812 20796 raft_consensus.cc:2749] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:42.864076 20849 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:42.871414 20253 raft_consensus.cc:2804] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:42.857054 20786 raft_consensus.cc:2749] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:42.843076 20896 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:42.858300 20857 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:42.799190 20384 consensus_queue.cc:260] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:42.847134 20326 consensus_queue.cc:1059] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.046s
W20260709 12:12:42.893430 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:42.893369 14411 raft_consensus.cc:1240] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 24. Current term is 25. Ops: [24.16-24.16]
I20260709 12:12:42.859494 20812 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:42.885237 13652 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:42.887466 20702 raft_consensus.cc:3055] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:12:42.964517 20702 raft_consensus.cc:740] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:42.965632 20702 consensus_queue.cc:260] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:42.966919 20702 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:42.856639 20871 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:42.889575 20864 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:42.971180 13835 raft_consensus.cc:1240] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 23. Current term is 24. Ops: [23.13-23.13]
I20260709 12:12:42.913574 14379 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:42.923319 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:42.973793 13836 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 21.
W20260709 12:12:42.974038 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 60621.2us
I20260709 12:12:42.942827 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:42.943620 20876 consensus_queue.cc:1048] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:42.884426 13758 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 17.
I20260709 12:12:42.893394 13756 raft_consensus.cc:1275] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:12:42.872143 20911 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:42.962604 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 77518.5us
I20260709 12:12:42.884003 20863 raft_consensus.cc:2749] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:42.902324 20742 raft_consensus.cc:697] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 20 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:42.988823 20859 consensus_queue.cc:237] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:42.990259 20742 consensus_queue.cc:237] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:42.994771 20864 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:42.999447 20896 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:43.000167 13763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38932 (request call id 1126) took 1106 ms. Trace:
I20260709 12:12:42.987115 20384 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:43.000663 13763 rpcz_store.cc:276] 0709 12:12:41.894107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:42.016059 (+121952us) service_pool.cc:224] Handling call
0709 12:12:42.999960 (+983901us) spinlock_profiling.cc:243] Waited 677 ms on lock 0x7b54003101d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:43.000106 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1557106048}
I20260709 12:12:42.969468 20796 raft_consensus.cc:2804] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:43.009545 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:43.010320 20796 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:43.010798 13829 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:43.013422 13727 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:43.014374 20752 raft_consensus.cc:2749] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:12:43.016320 20757 consensus_queue.cc:1059] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:43.017504 20757 consensus_queue.cc:1059] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 19.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:43.018296 20806 leader_election.cc:290] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:43.018528 20757 consensus_queue.cc:1059] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:42.945186 20854 raft_consensus.cc:697] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 20 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:42.892727 20929 raft_consensus.cc:697] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 23 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:42.985186 20674 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:43.022411 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 45912.4us
I20260709 12:12:42.982770 13800 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:42.957427 20253 raft_consensus.cc:697] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:43.035418 20812 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:42.984226 20771 raft_consensus.cc:2749] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:12:43.037145 20755 consensus_queue.cc:1059] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:43.037653 20854 consensus_queue.cc:237] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:43.038048 20870 consensus_queue.cc:1059] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:43.039311 20870 raft_consensus.cc:3055] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:43.039201 20929 consensus_queue.cc:237] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:42.962036 20857 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:42.979599 20326 consensus_queue.cc:1243] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer ca9fbbc2c0a94897897d502d42f3951f log is divergent from this leader: its last log entry 25.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 12:12:43.042956 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:43.027266 20758 raft_consensus.cc:3055] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:43.043670 20758 raft_consensus.cc:740] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:43.043726 14411 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 20.
I20260709 12:12:43.044806 20758 consensus_queue.cc:260] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 19.8, Last appended by leader: 8, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:43.045956 20674 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:43.039855 20870 raft_consensus.cc:740] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:43.010807 20796 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:43.048305 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 65704.8us
I20260709 12:12:43.139140 13800 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:43.046902 13801 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:42.918546 20849 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:43.140393 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 93626.6us
I20260709 12:12:43.024637 20683 raft_consensus.cc:3055] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:43.168182 20683 raft_consensus.cc:740] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:43.169247 20683 consensus_queue.cc:260] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:43.170528 20683 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:43.173946 13755 raft_consensus.cc:2410] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 25 because replica has last-logged OpId of term: 24 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 13.
I20260709 12:12:43.160291 20758 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:43.192073 20857 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:43.194131 20253 consensus_queue.cc:237] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:43.198643 20770 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:43.203529 20870 consensus_queue.cc:260] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:43.204854 20870 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:43.202258 20770 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:43.218169 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:43.220135 14411 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:43.164110 20674 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:43.166910 20849 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:43.167500 20806 raft_consensus.cc:2804] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:12:43.230593 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 91573.9us
I20260709 12:12:43.241164 13800 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:43.260562 13829 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 17.
W20260709 12:12:43.266631 14380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:43.318809 14411 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 20.
W20260709 12:12:43.322439 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 81272.4us
I20260709 12:12:43.324572 13800 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:12:43.348016 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:43.231585 20896 raft_consensus.cc:2749] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:43.394731 13833 raft_consensus.cc:1275] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 12:12:43.238679 20806 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:43.375881 20797 raft_consensus.cc:3055] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:12:43.378374 13836 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7"
dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:54820
I20260709 12:12:43.264978 20812 raft_consensus.cc:2749] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:43.396849 13800 leader_election.cc:400] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 election: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 18. Current term is 19.
I20260709 12:12:43.409468 13800 leader_election.cc:403] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 12:12:43.372850 20759 raft_consensus.cc:3055] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 LEADER]: Stepping down as leader of term 23
W20260709 12:12:43.403656 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:43.205655 20866 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:43.353178 20849 raft_consensus.cc:2804] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:43.416527 13727 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:43.405226 20806 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:43.327652 20808 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:43.430963 20876 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:43.441843 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:43.442210 13837 raft_consensus.cc:1240] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:43.442750 13682 raft_consensus.cc:2393] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 25: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:43.397218 20864 consensus_queue.cc:1048] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:12:43.446523 13836 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:43.417526 20759 raft_consensus.cc:740] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:43.405866 20797 raft_consensus.cc:740] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:43.424099 20703 raft_consensus.cc:2804] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:43.447212 13836 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:43.406587 20768 consensus_queue.cc:1059] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 12:12:43.408640 20821 consensus_queue.cc:1048] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 12:12:43.439347 20857 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:43.417752 20457 consensus_queue.cc:1048] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.027s
I20260709 12:12:43.463392 13833 raft_consensus.cc:1240] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 20 LEADER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:43.433851 20871 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:43.481890 20726 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.014s	sys 0.010s
I20260709 12:12:43.453183 20876 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:43.500710 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:43.465569 20703 raft_consensus.cc:697] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:43.478137 20854 raft_consensus.cc:3055] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:43.511734 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:12:43.512835 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:43.465742 20911 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:43.519640 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:43.515018 13836 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:43.466315 20857 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:43.507818 20742 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.013s	sys 0.017s
I20260709 12:12:43.533556 13686 raft_consensus.cc:1240] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:43.531561 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:43.537827 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:43.554847 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:43.549497 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:43.556243 13756 raft_consensus.cc:2410] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for term 25 because replica has last-logged OpId of term: 24 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 15.
I20260709 12:12:43.549881 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:43.531183 13758 raft_consensus.cc:1240] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:43.550729 13759 raft_consensus.cc:1275] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:12:43.558390 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:43.558840 20871 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:43.559583 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:43.559701 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:43.560002 20808 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:43.561218 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:43.551535 14379 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:43.535264 13682 raft_consensus.cc:1240] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:43.563922 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:43.565900 13755 raft_consensus.cc:2393] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 20: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:43.567143 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:43.568661 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:43.570078 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:43.574388 13761 raft_consensus.cc:1275] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:12:43.576676 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:43.576921 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:43.515358 20854 raft_consensus.cc:740] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:43.585315 13758 raft_consensus.cc:2410] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 25 because replica has last-logged OpId of term: 24 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 13.
I20260709 12:12:43.588554 13757 raft_consensus.cc:1240] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 17. Current term is 18. Ops: []
W20260709 12:12:43.551748 20742 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.013s	sys 0.017s
I20260709 12:12:43.561739 20876 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:43.595580 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:43.596524 13762 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 21.
I20260709 12:12:43.598274 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:43.576269 20890 raft_consensus.cc:2749] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:43.587922 20906 consensus_meta.cc:287] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.850s	user 0.012s	sys 0.001s
I20260709 12:12:43.507884 20797 consensus_queue.cc:260] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:43.615136 13686 raft_consensus.cc:1240] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 23. Current term is 24. Ops: [23.13-23.13]
I20260709 12:12:43.618374 13683 raft_consensus.cc:1240] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:43.619113 13683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 3342) took 1003 ms. Trace:
I20260709 12:12:43.619500 13683 rpcz_store.cc:276] 0709 12:12:42.616430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:43.610655 (+994225us) service_pool.cc:224] Handling call
0709 12:12:43.610996 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:43.618879 (+  7883us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:43.619059 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:43.625636 13687 raft_consensus.cc:1240] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:43.633737 13688 raft_consensus.cc:1240] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 19. Current term is 20. Ops: [19.8-19.8]
I20260709 12:12:43.634966 13686 raft_consensus.cc:1275] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:12:43.605238 20849 raft_consensus.cc:697] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 20 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:43.644299 13833 raft_consensus.cc:1240] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 22. Current term is 23. Ops: []
I20260709 12:12:43.651130 20821 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:43.652076 20821 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:43.655427 20821 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:43.680868 14414 raft_consensus.cc:1240] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 25 LEADER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 24. Current term is 25. Ops: [24.15-24.15]
I20260709 12:12:43.683249 13833 raft_consensus.cc:1275] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:12:43.687769 13763 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 19.
I20260709 12:12:43.618867 20906 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:43.740356 13686 raft_consensus.cc:1240] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 24. Current term is 25. Ops: [24.16-24.16]
I20260709 12:12:43.831240 13831 raft_consensus.cc:1240] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:43.832566 13686 raft_consensus.cc:1240] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 23. Current term is 24. Ops: [23.13-23.13]
I20260709 12:12:43.744071 20683 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:43.623556 20703 consensus_queue.cc:237] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:43.916735 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:43.915747 20796 consensus_meta.cc:287] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.737s	user 0.010s	sys 0.002s
I20260709 12:12:43.927114 13682 raft_consensus.cc:1240] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:43.929273 13681 raft_consensus.cc:1275] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:12:43.930188 13683 raft_consensus.cc:1240] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:43.930860 13687 raft_consensus.cc:1240] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 22. Current term is 23. Ops: []
I20260709 12:12:43.691156 20806 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:43.934480 13726 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:12:43.950843 20939 log.cc:927] Time spent T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.315s	user 0.000s	sys 0.000s
I20260709 12:12:43.674553 20854 consensus_queue.cc:260] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:43.737002 20253 consensus_queue.cc:1059] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.159s
W20260709 12:12:43.856594 20941 log.cc:927] Time spent T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 12:12:44.008167 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:12:43.980988 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 47125.2us
I20260709 12:12:44.011904 13726 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:43.982528 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:44.013641 13686 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 17.
I20260709 12:12:43.928634 20796 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:44.022096 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 449383us
W20260709 12:12:44.022799 13651 connection.cc:256] RPC call timeout handler was delayed by -1.108792418000121s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22280000000000003s for a response
W20260709 12:12:43.992447 20938 log.cc:927] Time spent T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.357s	user 0.000s	sys 0.001s
W20260709 12:12:44.023296 13651 connection.cc:256] RPC call timeout handler was delayed by -1.0338091210001039s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22130000000000002s for a response
W20260709 12:12:44.026794 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:43.972592 20684 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:43.973690 20742 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:44.028571 13829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 3181) took 1153 ms. Trace:
I20260709 12:12:43.998854 20816 raft_consensus.cc:3060] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:44.042868 13829 rpcz_store.cc:276] 0709 12:12:42.876639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:43.261757 (+385118us) service_pool.cc:224] Handling call
0709 12:12:43.262181 (+   424us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:43.262435 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:12:43.571783 (+309348us) log.cc:844] Serialized 14 byte log entry
0709 12:12:44.028032 (+456249us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:44.028094 (+    62us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:44.028143 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:44.028351 (+   208us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:44.028504 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4515,"thread_start_us":698247,"threads_started":2}
I20260709 12:12:43.853368 20683 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:44.060197 20940 log.cc:927] Time spent T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.423s	user 0.000s	sys 0.001s
I20260709 12:12:44.062439 20808 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:44.063088 20808 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:44.063400 20806 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:44.054049 20742 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:44.029826 20253 consensus_queue.cc:1243] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer ca9fbbc2c0a94897897d502d42f3951f log is divergent from this leader: its last log entry 25.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 12:12:44.069463 20742 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:44.028568 20674 raft_consensus.cc:2749] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:44.065454 20808 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:44.039594 20854 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:44.039727 20934 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:44.034420 20911 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:44.075037 13688 raft_consensus.cc:1240] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:44.052296 20857 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:44.070957 20326 raft_consensus.cc:2749] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:12:44.074689 20870 consensus_meta.cc:287] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.869s	user 0.014s	sys 0.001s
I20260709 12:12:44.093299 20683 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:44.095454 20866 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:44.100174 20774 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:44.100718 20774 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:44.101722 20951 consensus_queue.cc:1048] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:12:44.102739 20937 log.cc:927] Time spent T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.327s	user 0.004s	sys 0.000s
I20260709 12:12:44.103827 20906 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:44.084476 20893 raft_consensus.cc:2749] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 18. Current term is 19.
W20260709 12:12:44.100117 20758 consensus_meta.cc:287] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.899s	user 0.008s	sys 0.004s
I20260709 12:12:44.048765 20684 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:44.108068 20684 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:44.108547 13759 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 20.
I20260709 12:12:44.107914 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:44.003681 20849 consensus_queue.cc:237] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:44.119976 20774 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:44.083880 20934 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:44.122342 20816 raft_consensus.cc:2749] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:44.126107 20774 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:44.127447 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:44.128361 14411 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Advancing to term 21
I20260709 12:12:44.131078 13830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 3179) took 1256 ms. Trace:
I20260709 12:12:44.131574 13830 rpcz_store.cc:276] 0709 12:12:42.874336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:43.011520 (+137184us) service_pool.cc:224] Handling call
0709 12:12:43.011845 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:43.012080 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:12:43.434236 (+422156us) log.cc:844] Serialized 14 byte log entry
0709 12:12:44.130563 (+696327us) log.cc:844] Serialized 14 byte log entry
0709 12:12:44.130746 (+   183us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:44.130785 (+    39us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:44.130822 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:44.130876 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:44.131006 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":445788,"prepare.queue_time_us":598873,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":7410,"raft.queue_time_us":3002,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":5517,"thread_start_us":650842,"threads_started":2,"wal-append.queue_time_us":631626}
I20260709 12:12:44.124447 20934 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:44.165249 20870 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:44.179729 20816 consensus_queue.cc:1059] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.008s
I20260709 12:12:44.187965 20816 raft_consensus.cc:3055] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:12:44.188380 20816 raft_consensus.cc:740] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:44.188555 20454 raft_consensus.cc:3055] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:44.189091 20454 raft_consensus.cc:740] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:44.189253 20816 consensus_queue.cc:260] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:44.190728 20816 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:44.196712 13837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 3492) took 1451 ms. Trace:
I20260709 12:12:44.197156 13837 rpcz_store.cc:276] 0709 12:12:42.744914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:42.770700 (+ 25786us) service_pool.cc:224] Handling call
0709 12:12:42.787676 (+ 16976us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:43.446171 (+658495us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:44.196460 (+750289us) spinlock_profiling.cc:243] Waited 652 ms on lock 0x7b5400362254. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:44.196646 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1499649408}
I20260709 12:12:44.203382 13837 raft_consensus.cc:1275] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
W20260709 12:12:44.205854 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:44.207743 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:44.209008 14411 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 21.
I20260709 12:12:44.207214 13651 leader_election.cc:304] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:44.179876 20774 consensus_queue.cc:1059] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 12:12:44.215507 13727 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:44.181427 20726 consensus_queue.cc:1048] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 12:12:44.214299 13651 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:44.224310 13651 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:44.201220 20946 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:44.229650 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:44.230306 13828 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:44.230664 13651 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:44.225514 20742 raft_consensus.cc:2804] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:44.232355 13651 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:44.220908 20758 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:44.223205 20326 raft_consensus.cc:2804] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:44.221205 20808 raft_consensus.cc:2804] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:44.198019 20870 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:44.211408 20857 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:44.250174 20857 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:44.252743 20857 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:44.253417 20857 raft_consensus.cc:2804] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:44.245450 20759 consensus_queue.cc:260] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:44.246796 14411 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226"
dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:46814
I20260709 12:12:44.281298 14411 raft_consensus.cc:606] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 13 LEADER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:44.244175 20253 consensus_queue.cc:1059] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 12:12:44.247933 13834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 1331) took 1247 ms. Trace:
I20260709 12:12:44.285066 13834 rpcz_store.cc:276] 0709 12:12:43.000437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:43.373889 (+373452us) service_pool.cc:224] Handling call
0709 12:12:43.374358 (+   469us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:43.602035 (+227677us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:43.602072 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:43.606963 (+  4891us) log.cc:844] Serialized 26 byte log entry
0709 12:12:44.082445 (+475482us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:44.082482 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:44.082602 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:44.247635 (+165033us) raft_consensus.cc:1685] finished
0709 12:12:44.247661 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:44.247861 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30670,"raft.queue_time_us":32718,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":9841,"thread_start_us":635981,"threads_started":2,"wal-append.queue_time_us":611625}
I20260709 12:12:44.244006 20758 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:44.217134 20454 consensus_queue.cc:260] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:44.254166 20934 raft_consensus.cc:2804] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:44.259387 20797 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:44.260316 20796 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:44.234565 20742 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:44.232728 20946 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:44.305533 20742 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:44.306264 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:12:44.307384 20946 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:44.309597 20758 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:44.280273 20808 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:44.265658 20661 raft_consensus.cc:3055] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:12:44.266368 13832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 3180) took 1391 ms. Trace:
I20260709 12:12:44.276923 13828 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 20.
I20260709 12:12:44.277289 13760 raft_consensus.cc:3055] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:12:44.313504 13760 raft_consensus.cc:740] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:44.277632 14407 raft_consensus.cc:1240] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 25 LEADER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 24. Current term is 25. Ops: [24.15-24.15]
W20260709 12:12:44.278704 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 267028us
I20260709 12:12:44.316285 13829 raft_consensus.cc:1240] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 21 LEADER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:44.316301 13726 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:44.234815 20774 consensus_queue.cc:1243] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer 96701a74fdee481fb5f54aac841e17dd log is divergent from this leader: its last log entry 20.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
W20260709 12:12:44.280288 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 232564us
I20260709 12:12:44.284045 13836 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:44.244113 20326 raft_consensus.cc:697] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:44.260757 13835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 3473) took 1662 ms. Trace:
I20260709 12:12:44.320549 13835 rpcz_store.cc:276] 0709 12:12:42.597971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:42.599060 (+  1089us) service_pool.cc:224] Handling call
0709 12:12:42.599379 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:42.971607 (+372228us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:44.260380 (+1288773us) spinlock_profiling.cc:243] Waited 371 ms on lock 0x7b5400361d54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:44.260678 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":854406528}
I20260709 12:12:44.297276 20759 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:44.319619 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:44.323055 14379 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:44.321431 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:44.324961 14379 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:44.286396 20857 raft_consensus.cc:697] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 16 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:44.314438 13760 consensus_queue.cc:260] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.15, Last appended by leader: 15, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:44.328769 13760 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:44.311472 13832 rpcz_store.cc:276] 0709 12:12:42.874681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:43.017962 (+143281us) service_pool.cc:224] Handling call
0709 12:12:43.018281 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:43.174848 (+156567us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:12:43.497623 (+322775us) log.cc:844] Serialized 14 byte log entry
0709 12:12:44.130281 (+632658us) spinlock_profiling.cc:243] Waited 921 us on lock 0x7b18001914a0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e1ac0a 00007fa92e55a219 00007fa924ea2a40 00007fa924e9d4e4 00007fa924e9d455 00007fa92b9853c7 00007fa927f979a7 00007fa927fa70bf 00007fa927fa7038
0709 12:12:44.130503 (+   222us) log.cc:844] Serialized 14 byte log entry
0709 12:12:44.130698 (+   195us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:44.130760 (+    62us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:44.130803 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:44.262339 (+131536us) spinlock_profiling.cc:243] Waited 2.72 ms on lock 0x7b18001914a0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924ea03f3 00007fa924ea27c1 00007fa924ea2779 00007fa924ea2709 00007fa924ea26d1 00007fa924ea19cd 0000000000388634 0000000000388479 00007fa924e8383a
0709 12:12:44.266065 (+  3726us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b54002a6a54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:44.266124 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:44.266295 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":425604,"prepare.queue_time_us":962077,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":73,"raft.queue_time_us":530,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":4036,"spinlock_wait_cycles":367691136,"thread_start_us":490540,"threads_started":2,"wal-append.queue_time_us":502152}
I20260709 12:12:44.330991 13832 raft_consensus.cc:1240] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 23. Current term is 24. Ops: [23.13-23.13]
I20260709 12:12:44.329514 13835 raft_consensus.cc:1240] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 24 LEADER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 23. Current term is 24. Ops: []
I20260709 12:12:44.331081 13828 raft_consensus.cc:1240] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 24. Current term is 25. Ops: [24.15-24.15]
I20260709 12:12:44.313740 20954 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:44.333099 13836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:54820 (request call id 3494) took 1314 ms. Trace:
I20260709 12:12:44.333890 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:44.335049 14411 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 16.
I20260709 12:12:44.335783 13726 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:44.333669 13836 rpcz_store.cc:276] 0709 12:12:43.004453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:43.378095 (+373642us) service_pool.cc:224] Handling call
0709 12:12:44.272810 (+894715us) spinlock_profiling.cc:243] Waited 28.2 ms on lock 0x7b5400362254. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f84a3d 00007fa92cf54cd0 00007fa9264d9254 00007fa9264d91e2 00007fa9264d9111 00007fa9264d908c 00007fa9264d8342 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:44.318398 (+ 45588us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":64956672}
I20260709 12:12:44.299089 20816 raft_consensus.cc:3055] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:44.327723 20957 raft_consensus.cc:2749] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:44.343986 20326 consensus_queue.cc:237] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:44.345974 20758 consensus_queue.cc:1059] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:44.347662 20758 raft_consensus.cc:3055] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:12:44.348173 20758 raft_consensus.cc:740] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:44.314849 20808 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:44.354283 13727 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:44.345046 20837 raft_consensus.cc:2804] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:44.354542 13726 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:44.314707 20661 raft_consensus.cc:740] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:44.363662 13760 raft_consensus.cc:1275] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 12:12:44.368566 14379 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:12:44.368884 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 136596us
I20260709 12:12:44.369659 13651 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:44.371575 13651 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:44.327898 20934 raft_consensus.cc:697] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 17 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:44.373103 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:44.383109 13726 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:44.380031 13834 raft_consensus.cc:1240] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 23 LEADER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 22. Current term is 23. Ops: []
I20260709 12:12:44.340098 20816 raft_consensus.cc:740] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:44.367210 20661 consensus_queue.cc:260] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:44.390260 20661 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:44.380090 13651 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:44.333345 20955 raft_consensus.cc:2804] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:44.357879 20837 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:44.357264 20253 raft_consensus.cc:2749] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:44.354684 20956 raft_consensus.cc:2804] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:44.395582 13726 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:44.401018 13651 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:44.349277 20758 consensus_queue.cc:260] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:44.383852 20457 raft_consensus.cc:2749] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:12:44.370477 20957 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:44.394381 20726 raft_consensus.cc:2749] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:44.389410 20961 raft_consensus.cc:2749] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:44.369860 20774 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:44.382380 20870 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:44.425616 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:44.402784 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:44.378911 20796 raft_consensus.cc:2804] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:44.427192 13726 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:44.399843 20837 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:44.354154 20954 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:44.431205 20253 raft_consensus.cc:2749] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:44.398488 20955 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:44.440817 13726 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:44.399881 20452 consensus_queue.cc:1059] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.037s
I20260709 12:12:44.402515 20956 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:44.452260 13726 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:44.396199 20703 consensus_queue.cc:1048] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:12:44.451263 20774 raft_consensus.cc:2749] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:44.456437 20703 raft_consensus.cc:2749] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 12:12:44.457726 20958 log.cc:927] Time spent T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 12:12:44.458617 20959 log.cc:927] Time spent T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 12:12:44.391189 20944 consensus_queue.cc:1175] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "96701a74fdee481fb5f54aac841e17dd" responder_term: 24 status { last_received { term: 21 index: 12 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 23. Current term is 24. Ops: [23.13-23.13]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:12:44.445261 20963 raft_consensus.cc:2749] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:44.438977 20796 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:44.467772 20796 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:44.434423 20962 raft_consensus.cc:2749] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
W20260709 12:12:44.470888 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:44.471989 20452 raft_consensus.cc:3055] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:44.431890 20857 consensus_queue.cc:237] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:44.472553 20452 raft_consensus.cc:740] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:44.473739 20452 consensus_queue.cc:260] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:44.447845 20955 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:44.476881 20956 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:44.478385 20683 raft_consensus.cc:3055] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 LEADER]: Stepping down as leader of term 19
W20260709 12:12:44.439961 20406 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 25 current term: 25 is higher.
I20260709 12:12:44.478813 20683 raft_consensus.cc:740] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:44.479161 20406 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:44.479600 20406 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:44.479709 20683 consensus_queue.cc:260] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:44.480897 20683 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:44.439462 20758 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:44.426478 20957 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:44.487433 13831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 3483) took 1806 ms. Trace:
I20260709 12:12:44.487893 13831 rpcz_store.cc:276] 0709 12:12:42.681045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:42.681175 (+   130us) service_pool.cc:224] Handling call
0709 12:12:42.681534 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:43.831743 (+1150209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:44.487162 (+655419us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54001671d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:44.487362 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2643587840}
I20260709 12:12:44.436869 20816 consensus_queue.cc:260] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:44.451723 20934 consensus_queue.cc:237] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:44.444782 20961 raft_consensus.cc:2804] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 12:12:44.505973 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 51307.2us
I20260709 12:12:44.534525 20954 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:44.541967 20808 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:44.542021 20837 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:44.544621 20808 leader_election.cc:290] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:44.544617 20837 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:44.518610 20966 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:44.549265 20966 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:44.550457 20957 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:44.551635 20966 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199)
I20260709 12:12:44.551882 20956 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:44.552215 20955 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:44.554620 20956 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:44.555217 20955 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:44.522024 20961 raft_consensus.cc:697] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 21 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:44.587466 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:44.590615 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:12:44.596899 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 195790us
I20260709 12:12:44.602837 13727 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:12:44.604753 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 152451us
I20260709 12:12:44.606470 13726 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:44.608326 13651 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:44.614892 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:44.637531 13754 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 18.
I20260709 12:12:44.639457 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:44.618296 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:44.641181 13758 raft_consensus.cc:2410] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 24 because replica has last-logged OpId of term: 23 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 12.
I20260709 12:12:44.620122 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:44.641275 13833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 1341) took 1056 ms. Trace:
I20260709 12:12:44.620626 13763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48120 (request call id 2480) took 1077 ms. Trace:
I20260709 12:12:44.642071 13760 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 21.
I20260709 12:12:44.641942 13763 rpcz_store.cc:276] 0709 12:12:43.543469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:43.560875 (+ 17406us) service_pool.cc:224] Handling call
0709 12:12:44.620033 (+1059158us) spinlock_profiling.cc:243] Waited 83.4 ms on lock 0x7b5400417654. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:44.620346 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":191754624}
I20260709 12:12:44.643467 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:44.644095 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:44.651719 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:44.621541 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:44.625039 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:12:44.630908 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 121720us
I20260709 12:12:44.655223 20808 consensus_queue.cc:1059] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:44.656103 20406 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:44.652943 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:12:44.631915 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:44.618710 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:44.641844 13833 rpcz_store.cc:276] 0709 12:12:43.584523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:43.800613 (+216090us) service_pool.cc:224] Handling call
0709 12:12:43.800891 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:44.639745 (+838854us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:44.639816 (+    71us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:44.639884 (+    68us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:12:44.639962 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:44.640801 (+   839us) spinlock_profiling.cc:243] Waited 838 ms on lock 0x7b540020ce54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:44.640859 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:44.641082 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1927795968}
I20260709 12:12:44.683115 20253 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:44.684830 13761 raft_consensus.cc:2393] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 20: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:44.686163 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:44.687323 13761 raft_consensus.cc:2410] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 24 because replica has last-logged OpId of term: 23 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 12.
I20260709 12:12:44.688321 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:44.692234 20454 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:44.693040 20684 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:44.693845 20816 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:44.694424 20684 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:44.695689 20679 raft_consensus.cc:2804] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:44.696264 20679 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:44.696681 20679 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:44.683216 20726 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:44.698195 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:44.698408 20726 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:44.699368 13688 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 19.
I20260709 12:12:44.699440 20726 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:44.703002 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:44.707046 13760 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 22.
I20260709 12:12:44.715349 20726 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:44.720811 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 76519.4us
I20260709 12:12:44.685595 20253 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:44.710738 20684 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:44.738267 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:44.738806 20406 consensus_queue.cc:1059] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:44.739028 20969 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:44.740072 20969 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:44.741446 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:12:44.744794 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:44.558291 20961 consensus_queue.cc:237] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:44.746492 14407 raft_consensus.cc:1240] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:44.748399 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:44.749187 14411 raft_consensus.cc:1275] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 12:12:44.751016 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:44.754426 13760 raft_consensus.cc:1275] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:12:44.758565 20452 raft_consensus.cc:3060] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:44.761026 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:12:44.764863 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 69750.3us
W20260709 12:12:44.769855 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 161887us
I20260709 12:12:44.769629 13579 catalog_manager.cc:5697] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 8 to 13, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 13 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:12:44.772469 20876 raft_consensus.cc:993] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f: : Instructing follower 96701a74fdee481fb5f54aac841e17dd to start an election
I20260709 12:12:44.772432 13651 leader_election.cc:304] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:44.774021 13763 raft_consensus.cc:1275] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:12:44.774950 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:44.738736 13800 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:44.776048 13756 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 16.
I20260709 12:12:44.790144 20954 raft_consensus.cc:3055] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:44.790544 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:44.790817 20954 raft_consensus.cc:740] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:44.792322 20954 consensus_queue.cc:260] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:44.774873 20771 raft_consensus.cc:1081] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 13 LEADER]: Signalling peer 96701a74fdee481fb5f54aac841e17dd to start an election
I20260709 12:12:44.799640 20906 raft_consensus.cc:2804] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:44.800011 14415 raft_consensus.cc:1275] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:12:44.800383 13760 raft_consensus.cc:1240] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:44.800716 20944 consensus_queue.cc:1048] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:44.801057 13686 raft_consensus.cc:1240] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:44.808614 13758 raft_consensus.cc:1275] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 19 index: 8. Preceding OpId from leader: term: 20 index: 9. (index mismatch)
I20260709 12:12:44.805871 20906 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:44.827112 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:44.828562 20808 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:44.830695 13762 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:44.828835 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:44.803455 20253 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:44.830346 20906 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:44.845742 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:44.866842 13761 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 19.
I20260709 12:12:44.856523 20954 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:44.871237 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:44.880497 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:44.881858 20934 raft_consensus.cc:2749] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:12:44.882161 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 109976us
I20260709 12:12:44.883323 13651 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:44.885864 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:44.886942 13832 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 21.
I20260709 12:12:44.888376 20890 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:44.889339 20890 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:44.892714 20969 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:44.893543 20969 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:44.894345 20969 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:44.896934 20969 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:44.860006 20684 consensus_queue.cc:1048] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.038s
I20260709 12:12:44.897886 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:44.898396 20684 consensus_queue.cc:1243] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer 3f37c9cc9dda46b4be21dd675ba78fb7 log is divergent from this leader: its last log entry 24.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 12:12:44.899045 13834 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 19.
I20260709 12:12:44.902642 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:44.903694 14411 raft_consensus.cc:2368] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 19. Current term is 20.
I20260709 12:12:44.906687 13801 leader_election.cc:400] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 election: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 19. Current term is 20.
I20260709 12:12:44.907044 13801 leader_election.cc:403] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 12:12:44.907339 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:44.907637 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:44.908263 13760 raft_consensus.cc:2468] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 15.
I20260709 12:12:44.909101 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:44.909893 14407 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:44.910631 20956 raft_consensus.cc:3055] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:44.911094 20956 raft_consensus.cc:740] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:44.912374 20956 consensus_queue.cc:260] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:44.913709 14380 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:44.914196 13652 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:44.914821 14409 raft_consensus.cc:1240] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 20. Current term is 21. Ops: []
W20260709 12:12:44.915122 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 50604.3us
I20260709 12:12:44.916096 20947 raft_consensus.cc:2749] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 19. Current term is 20.
I20260709 12:12:44.773375 13579 catalog_manager.cc:5697] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 12 to 15, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 15 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:12:44.917419 13727 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:44.918195 20977 consensus_queue.cc:1059] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:44.919094 20977 consensus_queue.cc:1243] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer 96701a74fdee481fb5f54aac841e17dd log is divergent from this leader: its last log entry 21.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:12:44.919898 20979 raft_consensus.cc:2804] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:44.920362 20979 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:44.920765 20979 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:44.920857 20774 raft_consensus.cc:3055] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:44.921370 20774 raft_consensus.cc:740] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:44.922542 20774 consensus_queue.cc:260] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:44.924058 20774 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:44.926100 20326 consensus_queue.cc:1048] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:12:44.926833 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 120760us
I20260709 12:12:44.928651 13800 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:44.887042 13833 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 25.
I20260709 12:12:44.929997 20976 raft_consensus.cc:2749] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:44.930711 20806 raft_consensus.cc:2749] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:12:44.931028 20976 raft_consensus.cc:2804] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:44.906853 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:44.931916 20808 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:44.932516 13761 raft_consensus.cc:1240] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:44.934113 13832 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226"
dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:35422
I20260709 12:12:44.934465 20808 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:44.881680 13763 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 17.
I20260709 12:12:44.930593 13579 catalog_manager.cc:5697] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 12 to 15, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 15 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:12:44.931553 20976 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:44.941855 14380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:44.937788 13832 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:44.885429 13651 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:44.942444 13832 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:44.942512 13727 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:44.897614 20969 raft_consensus.cc:2804] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:44.915124 20957 raft_consensus.cc:2804] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:44.971848 14407 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 21.
I20260709 12:12:44.973718 13579 catalog_manager.cc:5697] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 6 to 14. New cstate: current_term: 14 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
W20260709 12:12:44.977430 20661 consensus_meta.cc:287] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.583s	user 0.015s	sys 0.001s
I20260709 12:12:44.983623 20253 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:44.967710 20956 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:45.008767 13759 raft_consensus.cc:2410] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 24 because replica has last-logged OpId of term: 23 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 12.
I20260709 12:12:44.987398 20963 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:44.947053 20947 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.014488 20947 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:45.015256 13683 raft_consensus.cc:1240] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 19. Current term is 20. Ops: []
W20260709 12:12:44.988968 13578 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53318 (request call id 147) took 21524 ms (client timeout 15000 ms). Trace:
I20260709 12:12:44.989933 13836 raft_consensus.cc:1275] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:12:45.018675 20890 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:44.990150 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 85855.9us
W20260709 12:12:45.017841 13578 rpcz_store.cc:269] 0709 12:12:23.464627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:23.465055 (+   428us) service_pool.cc:224] Handling call
0709 12:12:23.697110 (+232055us) spinlock_profiling.cc:243] Waited 73.4 ms on lock 0x7b54002eff90. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924e68b71 00007fa924e690b2 00007fa92dde2759 00007fa92dd7aa76 00007fa92dd4bd58 00007fa92de4a04e 00007fa92c30b2a4 00007fa92c30b232 00007fa92c30b161 00007fa92c30b0dc
0709 12:12:44.988643 (+21291533us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:37.211245 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:37.347935 (+136690us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:37.347988 (+    53us) write_op.cc:435] Acquired schema lock
0709 12:12:37.348008 (+    20us) tablet.cc:662] Decoding operations
0709 12:12:37.408376 (+ 60368us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:37.408502 (+   126us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:37.408549 (+    47us) tablet.cc:685] Acquiring locks for 20 operations
0709 12:12:37.419123 (+ 10574us) tablet.cc:701] Row locks acquired
0709 12:12:37.419177 (+    54us) write_op.cc:260] PREPARE: finished
0709 12:12:37.437877 (+ 18700us) write_op.cc:270] Start()
0709 12:12:37.438068 (+   191us) write_op.cc:276] Timestamp: P: 1783599157419296 usec, L: 0
0709 12:12:37.438102 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 12:12:37.438884 (+   782us) log.cc:844] Serialized 7839 byte log entry
0709 12:12:38.358901 (+920017us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:12:38.886990 (+528089us) op_driver.cc:464] REPLICATION: finished
0709 12:12:39.361866 (+474876us) write_op.cc:301] APPLY: starting
0709 12:12:39.361977 (+   111us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:39.499413 (+137436us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:39.499468 (+    55us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:39.904326 (+404858us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:39.905368 (+  1042us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=40,key_file_lookups=40,delta_file_lookups=40,mrs_lookups=0
0709 12:12:39.905467 (+    99us) write_op.cc:312] APPLY: finished
0709 12:12:39.970041 (+ 64574us) log.cc:844] Serialized 180 byte log entry
0709 12:12:40.310937 (+340896us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:40.402730 (+ 91793us) write_op.cc:454] Released schema lock
0709 12:12:40.422709 (+ 19979us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:40.510968 (+ 88259us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:40.524033 (+ 13065us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5641234,"reported_tablets":29,"spinlock_wait_cycles":168864512,"child_traces":[["op",{"apply.queue_time_us":433320,"apply.run_cpu_time_us":55502,"apply.run_wall_time_us":1150430,"cfile_cache_hit":82,"cfile_cache_hit_bytes":87727,"num_ops":20,"prepare.queue_time_us":125255,"prepare.run_cpu_time_us":86401,"prepare.run_wall_time_us":435608,"raft.queue_time_us":428137,"raft.run_cpu_time_us":46845,"raft.run_wall_time_us":287360,"replication_time_us":1405187,"spinlock_wait_cycles":40842624,"thread_start_us":866011,"threads_started":5,"wal-append.queue_time_us":456342,"wal-append.run_cpu_time_us":56722,"wal-append.run_wall_time_us":3044578}]]}
W20260709 12:12:44.990839 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 48413.4us
I20260709 12:12:44.945416 20976 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:45.000453 20944 raft_consensus.cc:2804] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260709 12:12:45.000707 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 115512us
I20260709 12:12:45.000972 20774 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:45.002239 20683 consensus_meta.cc:287] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.520s	user 0.011s	sys 0.006s
I20260709 12:12:45.046888 20982 consensus_queue.cc:1048] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:45.048033 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:45.006487 13579 catalog_manager.cc:5697] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 18 to 20, leader changed from ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 20 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:45.017153 20947 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:45.018738 13762 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 22.
I20260709 12:12:45.028374 20963 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:45.029158 13832 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:45.030287 20253 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:45.030050 20893 consensus_queue.cc:1059] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.039s
I20260709 12:12:44.969877 20969 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:44.991956 14409 raft_consensus.cc:1275] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
W20260709 12:12:45.036092 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 107545us
I20260709 12:12:44.986769 20957 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:45.051343 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 222508us
I20260709 12:12:45.045284 20944 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:45.064425 13801 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:45.082549 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:45.088289 13832 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:45.066561 20969 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:45.069953 20957 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:45.071798 20683 consensus_queue.cc:1048] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 12:12:45.074555 20944 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:12:45.071298 20934 raft_consensus.cc:2804] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:45.105815 13579 catalog_manager.cc:5697] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 13 to 19, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 19 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:12:45.108903 13754 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:45.108249 13579 catalog_manager.cc:5697] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 10 to 14, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 14 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
W20260709 12:12:45.109933 20797 consensus_meta.cc:287] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.784s	user 0.010s	sys 0.010s
I20260709 12:12:45.114063 20661 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:45.114990 20703 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.115134 20661 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:45.115666 20703 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:45.116127 20253 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:45.114184 13755 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 23.
W20260709 12:12:45.120316 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 86967.1us
I20260709 12:12:45.117750 20661 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:45.124076 20253 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:45.124739 20806 raft_consensus.cc:2804] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:45.125348 20806 raft_consensus.cc:697] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 21 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:45.126506 20806 consensus_queue.cc:237] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:45.128974 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:45.135066 13651 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:45.118633 20934 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:45.095762 20774 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:45.157033 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:45.157939 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 64725.7us
I20260709 12:12:45.133759 20797 consensus_queue.cc:1048] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.016s
I20260709 12:12:45.153198 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:45.171155 14409 raft_consensus.cc:3055] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:45.167363 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:45.177448 20679 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:45.154542 20808 consensus_queue.cc:1059] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.026s
I20260709 12:12:45.181077 20679 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:45.181963 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:45.182893 13830 raft_consensus.cc:2393] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 20: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:45.183198 13762 pending_rounds.cc:85] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting all ops after (but not including) 14
I20260709 12:12:45.183519 13762 pending_rounds.cc:107] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting uncommitted NO_OP operation due to leader change: 24.15
I20260709 12:12:45.183799 13762 raft_consensus.cc:2889] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:45.145121 20661 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.184464 20966 consensus_queue.cc:1059] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.123s
I20260709 12:12:45.184532 20661 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:45.185725 20966 raft_consensus.cc:3055] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:45.186095 20966 raft_consensus.cc:740] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:45.187012 20966 consensus_queue.cc:260] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:45.188459 20966 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:45.189720 20893 consensus_queue.cc:1059] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:45.190943 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:45.191342 13800 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:45.171635 14409 raft_consensus.cc:740] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:45.153368 20934 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:45.200259 13754 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 18.
I20260709 12:12:45.186933 20661 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:45.159423 20253 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.147588 20906 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:45.208209 14379 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:45.218077 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:45.218251 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:45.219161 14407 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:45.223670 20253 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:45.224134 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 144526us
I20260709 12:12:45.225946 13651 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:45.226614 20992 consensus_queue.cc:1048] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.015s
I20260709 12:12:45.227196 20984 consensus_queue.cc:1048] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:45.228684 20992 raft_consensus.cc:2804] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:45.229223 20992 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:45.232092 13755 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48120 (request call id 2484) took 1687 ms (client timeout 2058 ms). Trace:
I20260709 12:12:45.222462 13579 catalog_manager.cc:5697] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd reported cstate change: config changed from index 10 to 8, term changed from 18 to 13, leader changed from <none> to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from VOTER to NON_VOTER, now has a pending config: VOTER b98d2519bb504dc6905ed2ede4571835 (127.12.56.193), VOTER 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194), VOTER 96701a74fdee481fb5f54aac841e17dd (127.12.56.195), VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 13 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } } pending_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
W20260709 12:12:45.232645 13755 rpcz_store.cc:269] 0709 12:12:43.544607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:43.568357 (+ 23750us) service_pool.cc:224] Handling call
0709 12:12:45.231775 (+1663418us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b54003336d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:45.231990 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3536744832}
I20260709 12:12:45.234532 13727 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:45.234089 13579 catalog_manager.cc:5697] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 8 to 11, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 11 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:12:45.238683 20812 consensus_queue.cc:1048] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.027s
W20260709 12:12:45.240711 20887 consensus_queue.cc:1175] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" responder_term: 18 status { last_received { term: 18 index: 14 } last_committed_idx: 14 last_received_current_leader { term: 18 index: 14 } }
I20260709 12:12:45.246899 13651 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:45.254562 20969 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:45.255314 20947 raft_consensus.cc:3055] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:45.255805 20947 raft_consensus.cc:740] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:45.256718 20947 consensus_queue.cc:260] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:45.258013 20947 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:45.258195 20962 raft_consensus.cc:2804] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:45.258821 20962 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:45.259330 20962 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:45.262494 20961 consensus_queue.cc:1048] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 12:12:45.266870 20983 log.cc:927] Time spent T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.293s	user 0.005s	sys 0.000s
I20260709 12:12:45.211506 14409 consensus_queue.cc:260] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:45.292018 13831 raft_consensus.cc:1240] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:45.257582 20969 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:45.298576 13836 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 19.
I20260709 12:12:45.249153 13579 catalog_manager.cc:5697] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 11 to 14, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 14 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:45.229715 20992 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:45.196569 20979 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:45.321437 14409 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:45.325053 13834 raft_consensus.cc:1275] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:12:45.325086 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:45.328980 14414 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 25.
I20260709 12:12:45.334121 20955 raft_consensus.cc:2749] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:45.334196 20961 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.335215 20961 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:45.335536 20683 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.335783 20837 raft_consensus.cc:2804] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:12:45.335911 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 164479us
I20260709 12:12:45.336447 20837 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:45.336411 20683 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:45.337085 20837 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:45.288874 20703 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:45.341259 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:45.296638 20454 raft_consensus.cc:2749] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:45.342510 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:45.321558 20797 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.363862 20906 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:12:45.368410 20989 log.cc:927] Time spent T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
I20260709 12:12:45.368312 20998 raft_consensus.cc:2804] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:45.355247 13687 raft_consensus.cc:1240] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 17. Current term is 18. Ops: [17.11-17.11]
W20260709 12:12:45.359160 20742 consensus_meta.cc:287] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 1.053s	user 0.008s	sys 0.008s
W20260709 12:12:45.361443 20796 consensus_meta.cc:287] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.893s	user 0.016s	sys 0.003s
I20260709 12:12:45.337342 14379 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:45.358320 13727 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:45.339578 20979 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:45.341001 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:45.402102 13684 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:45.342921 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:12:45.396998 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:45.411419 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:45.412581 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 54402.9us
I20260709 12:12:45.414120 20806 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:45.414081 20816 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:12:45.415057 20816 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:45.358376 20253 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:45.423254 14409 raft_consensus.cc:2468] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 14.
I20260709 12:12:45.423564 13686 raft_consensus.cc:2393] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 15: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:45.414799 20806 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:45.401971 20998 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
W20260709 12:12:45.440173 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 54081.3us
I20260709 12:12:45.372277 20961 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:45.420966 20816 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:12:45.441864 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:45.441133 14407 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 17.
I20260709 12:12:45.444630 13679 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:45.450848 13801 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:12:45.453742 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 116503us
I20260709 12:12:45.445232 20998 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:45.432301 20796 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:45.462716 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 271480us
I20260709 12:12:45.429867 20742 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:45.470098 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:45.434464 20797 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:45.447302 20969 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:12:45.471915 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:45.476538 20951 raft_consensus.cc:2749] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:12:45.476902 20995 log.cc:927] Time spent T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:12:45.478312 20969 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:45.481269 13727 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:45.481931 13687 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:45.482923 20703 raft_consensus.cc:2804] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:45.483425 20703 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:45.482724 13579 catalog_manager.cc:5697] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 10 to 11, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 11 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:12:45.483829 20703 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:45.484984 20796 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:45.485739 20683 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:45.468374 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:45.486773 13686 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:45.487385 14379 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:45.489342 14379 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:45.489871 13688 raft_consensus.cc:1240] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:45.489950 20684 consensus_queue.cc:1059] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.002s
I20260709 12:12:45.492043 20978 raft_consensus.cc:2804] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:45.492549 20684 raft_consensus.cc:3055] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:45.492995 20684 raft_consensus.cc:740] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:45.493599 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:45.482748 20253 consensus_queue.cc:1048] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.012s
I20260709 12:12:45.492581 20978 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:45.497360 20978 raft_consensus.cc:3060] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:45.496744 13682 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:45.505232 20684 consensus_queue.cc:260] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:45.507043 20684 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:45.507575 20774 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:45.511366 20982 raft_consensus.cc:3055] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:45.511860 20982 raft_consensus.cc:740] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:45.514197 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:45.515040 13836 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 19.
I20260709 12:12:45.517226 13800 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:45.466337 20893 raft_consensus.cc:2804] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:45.522927 13727 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:45.513013 20982 consensus_queue.cc:260] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:45.525563 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:45.526000 13679 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 19.
I20260709 12:12:45.530242 13681 raft_consensus.cc:1240] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:45.525656 14379 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:45.539464 20816 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:45.540104 20797 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:45.542301 21006 raft_consensus.cc:2804] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:45.542824 21006 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:45.543174 21006 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:45.550437 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:45.553268 13686 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 23.
I20260709 12:12:45.539297 20752 raft_consensus.cc:2804] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:45.555097 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:45.558848 13679 raft_consensus.cc:2393] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 24: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:45.558944 20982 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:45.560020 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:45.562018 20969 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:45.562306 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:45.552783 20893 raft_consensus.cc:697] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 14 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:45.563714 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:45.564365 13683 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:45.564903 13687 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 19.
I20260709 12:12:45.568481 13800 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:45.532675 20887 raft_consensus.cc:2804] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:45.586350 20887 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:45.586817 20887 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:45.591688 20976 consensus_meta.cc:287] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.523s	user 0.010s	sys 0.000s
I20260709 12:12:45.592283 20976 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:45.593492 20934 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:45.595986 20934 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:45.599222 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 73632.7us
I20260709 12:12:45.600180 14379 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:45.601101 13833 raft_consensus.cc:1275] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 15. (term mismatch)
I20260709 12:12:45.601526 13833 pending_rounds.cc:85] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 14
I20260709 12:12:45.601833 13833 pending_rounds.cc:107] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 20.15
I20260709 12:12:45.602089 13685 raft_consensus.cc:1240] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:45.602108 13833 raft_consensus.cc:2889] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:45.568872 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:45.575614 13679 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 19.
I20260709 12:12:45.604635 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:45.605229 13679 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 20.
I20260709 12:12:45.554893 20752 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:45.582864 20876 raft_consensus.cc:2804] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:45.584583 20742 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:12:45.610693 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 54819.5us
I20260709 12:12:45.621165 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:12:45.621908 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:45.617952 20876 raft_consensus.cc:697] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 22 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:45.637836 20876 consensus_queue.cc:237] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:45.484987 13579 catalog_manager.cc:5697] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 5 to 9, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 9 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:45.640144 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:45.640863 13688 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 20.
I20260709 12:12:45.642048 13579 catalog_manager.cc:5697] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 8 to 13, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 13 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:12:45.634337 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:45.646378 13681 raft_consensus.cc:1275] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:12:45.646523 13679 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:45.651060 20947 raft_consensus.cc:2804] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:45.651851 20947 raft_consensus.cc:697] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 19 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:45.654886 20976 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:45.655359 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:45.656111 13829 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Advancing to term 23
I20260709 12:12:45.657076 20837 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:45.610402 20752 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:45.661993 20661 consensus_queue.cc:1048] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:45.606725 20951 raft_consensus.cc:2749] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:12:45.688406 13679 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 20.
I20260709 12:12:45.689136 13682 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 24.
I20260709 12:12:45.694761 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:45.695504 14407 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:12:45.653075 20947 consensus_queue.cc:237] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:45.698561 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:45.556013 20944 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:45.700318 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:12:45.700583 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 83339.8us
I20260709 12:12:45.564352 20893 consensus_queue.cc:237] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:45.707479 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:45.708158 13686 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:45.635527 20963 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:45.708626 13727 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:45.622387 20452 consensus_queue.cc:1059] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.089s
I20260709 12:12:45.709966 13681 raft_consensus.cc:1275] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:12:45.709949 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:45.709906 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:45.711684 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:45.713522 13762 raft_consensus.cc:2410] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 21 because replica has last-logged OpId of term: 19 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 7.
I20260709 12:12:45.679823 20837 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 17 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:45.715551 13831 raft_consensus.cc:2410] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 22 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 12:12:45.736987 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:45.739171 13754 raft_consensus.cc:2410] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 19 because replica has last-logged OpId of term: 18 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 12:12:45.633054 20962 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:45.743919 13688 raft_consensus.cc:1275] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 17 index: 7. Preceding OpId from leader: term: 20 index: 9. (index mismatch)
I20260709 12:12:45.744038 13682 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 18.
I20260709 12:12:45.750046 20661 consensus_queue.cc:1048] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.003s
I20260709 12:12:45.750334 21002 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:45.770035 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:45.770785 13762 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 20.
I20260709 12:12:45.776222 14407 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 26.
I20260709 12:12:45.801893 13683 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 17.
I20260709 12:12:45.803771 13829 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 23.
I20260709 12:12:45.810796 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:45.811713 13756 raft_consensus.cc:2368] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 17. Current term is 18.
I20260709 12:12:45.812875 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:45.813091 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:45.814160 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:45.814356 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:45.815104 13757 raft_consensus.cc:2410] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 22 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 12:12:45.815315 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:45.697491 20978 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:45.818416 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:45.744877 20963 raft_consensus.cc:2804] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:12:45.748993 20957 consensus_meta.cc:287] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.650s	user 0.012s	sys 0.000s
I20260709 12:12:45.793700 13686 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 21.
I20260709 12:12:45.796062 20979 consensus_queue.cc:1059] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:45.715962 20703 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:45.832270 13684 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 25.
W20260709 12:12:45.832041 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 119514us
I20260709 12:12:45.839144 13756 raft_consensus.cc:2393] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 18: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:45.850565 13759 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:45.850904 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:45.780843 21002 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:45.854839 20679 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:45.869906 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:45.864601 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:45.837015 20957 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:45.876260 13756 raft_consensus.cc:2393] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 20: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:45.862725 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:12:45.879041 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 160238us
I20260709 12:12:45.881338 13684 raft_consensus.cc:2393] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 20: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:45.855924 20963 raft_consensus.cc:697] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:45.883920 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:45.888787 13756 raft_consensus.cc:2393] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 23: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:45.888636 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:45.889608 13686 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 25.
I20260709 12:12:45.890103 14415 raft_consensus.cc:2368] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 19. Current term is 20.
I20260709 12:12:45.874296 20806 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:45.857693 21007 consensus_queue.cc:1048] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 12:12:45.891937 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:45.892043 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:45.917850 13727 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:45.918879 13683 raft_consensus.cc:2393] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 20: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:45.882593 20979 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.897346 20963 consensus_queue.cc:237] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:45.882913 20944 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:45.904366 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:45.904635 21002 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:45.865252 20978 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199)
I20260709 12:12:45.877867 20679 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:45.908528 20684 raft_consensus.cc:3055] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:45.910140 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:45.980980 13760 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:45.910629 20816 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:45.911018 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:45.911801 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:45.986564 13688 raft_consensus.cc:2393] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 23: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
W20260709 12:12:45.987226 20992 consensus_meta.cc:287] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.636s	user 0.012s	sys 0.000s
I20260709 12:12:45.987484 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:45.987788 20992 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:45.989194 13680 raft_consensus.cc:1240] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 12:12:45.896328 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:45.990837 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:45.991071 20992 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:45.992527 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:12:45.948314 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:45.974457 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:12:45.981102 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 63402.5us
W20260709 12:12:45.982017 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 51859.3us
I20260709 12:12:45.980316 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:45.973150 20979 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:45.982771 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:45.983348 20876 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.983254 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:45.980615 20684 raft_consensus.cc:740] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:45.978259 20797 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.984017 20683 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:12:46.002153 13681 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 15.
I20260709 12:12:46.015519 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:46.016070 13727 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:45.993705 13684 raft_consensus.cc:2393] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 19: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:46.000293 13682 raft_consensus.cc:1240] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 12:12:45.989228 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:45.884063 20906 consensus_queue.cc:1048] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.090s
I20260709 12:12:46.009199 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:46.021658 13683 raft_consensus.cc:2393] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 20: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:46.000759 13756 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 15.
I20260709 12:12:46.019150 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:46.023898 14407 raft_consensus.cc:2393] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 21: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:46.048543 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:46.049710 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:45.894917 21006 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:45.999509 20957 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:46.055685 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:46.056104 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:46.056983 13679 raft_consensus.cc:2393] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 23: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:46.057439 13686 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 25.
I20260709 12:12:46.015750 20774 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:46.057399 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:46.065549 13684 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:12:46.017252 20962 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:46.066821 14414 raft_consensus.cc:1240] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:45.975407 21012 consensus_queue.cc:1059] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.089s
I20260709 12:12:46.042024 20683 raft_consensus.cc:697] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:46.093518 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:12:46.052948 20998 consensus_meta.cc:287] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.533s	user 0.007s	sys 0.007s
I20260709 12:12:46.084160 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:46.053263 20703 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:46.102406 13685 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:46.106909 13759 raft_consensus.cc:1275] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:12:46.103729 13761 raft_consensus.cc:3060] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:46.107517 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:46.108155 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:46.108554 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:46.108929 13829 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:12:46.063074 20956 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.016909 20752 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:46.113875 13681 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 24.
W20260709 12:12:46.136821 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 120829us
I20260709 12:12:46.123152 13684 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 26.
I20260709 12:12:46.138669 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:46.144320 13679 raft_consensus.cc:2393] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 20: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:46.042452 20797 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:46.155090 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:46.162138 13757 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:46.049338 20887 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:46.019670 20876 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:46.161096 13829 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 26.
I20260709 12:12:46.172369 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:46.173206 13834 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:46.110891 20812 raft_consensus.cc:3055] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:46.134001 20944 raft_consensus.cc:2804] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:12:46.187345 13754 raft_consensus.cc:2368] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 19. Current term is 20.
I20260709 12:12:46.092458 20774 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:46.191762 14408 raft_consensus.cc:1240] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:46.192878 14416 raft_consensus.cc:1240] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:46.198846 13651 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:46.113900 20998 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:46.182174 20703 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.182484 20812 raft_consensus.cc:740] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
W20260709 12:12:46.242406 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 354098us
I20260709 12:12:46.153057 20956 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:46.247897 13834 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 20.
W20260709 12:12:46.245505 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 53065.9us
I20260709 12:12:46.254477 13651 leader_election.cc:400] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 17. Current term is 18.
I20260709 12:12:46.254849 13651 leader_election.cc:403] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:46.257731 14410 raft_consensus.cc:1240] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 16. Current term is 17. Ops: [14.14-16.15]
I20260709 12:12:46.106150 20684 consensus_queue.cc:260] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:46.247517 20962 raft_consensus.cc:2804] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:46.262300 20962 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:46.264205 20962 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:46.264138 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:46.266894 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:46.267426 13726 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:46.268128 20253 raft_consensus.cc:3055] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:46.274377 20253 raft_consensus.cc:740] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:46.274670 20752 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:46.276269 13651 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:12:46.277182 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:46.267673 13763 raft_consensus.cc:2393] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 20: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:46.280946 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:46.281678 13763 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:46.291833 20876 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:46.292647 13800 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:46.297901 21021 raft_consensus.cc:2804] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:46.298013 13761 raft_consensus.cc:2468] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 16.
I20260709 12:12:46.298779 21021 raft_consensus.cc:697] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 18 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:46.299921 13761 raft_consensus.cc:1240] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 21. Current term is 22. Ops: [21.16-21.16]
I20260709 12:12:46.300282 21021 consensus_queue.cc:237] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:46.302289 13761 raft_consensus.cc:1275] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:12:46.304101 13761 raft_consensus.cc:1275] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:12:46.293583 13685 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 20.
I20260709 12:12:46.305979 20679 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:46.261190 20969 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:46.310043 13651 leader_election.cc:304] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:12:46.314006 21013 log.cc:927] Time spent T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 12:12:46.317418 20887 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:46.318392 21006 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:46.319216 20812 consensus_queue.cc:260] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:46.321262 20998 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:46.318611 20992 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:46.245126 20703 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:46.354075 20962 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:46.278726 20979 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:46.360517 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 257035us
I20260709 12:12:46.332377 13763 raft_consensus.cc:2410] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 18 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 12:12:46.328552 14379 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:46.352807 13760 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 19.
I20260709 12:12:46.365631 21014 raft_consensus.cc:2804] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:46.365973 13760 raft_consensus.cc:1240] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:46.366259 21014 raft_consensus.cc:697] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 20 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:46.367511 21014 consensus_queue.cc:237] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:46.249171 20683 consensus_queue.cc:237] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:46.358994 21016 log.cc:927] Time spent T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.106s	user 0.003s	sys 0.000s
W20260709 12:12:46.363328 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 53384us
I20260709 12:12:46.378132 13755 raft_consensus.cc:1240] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:46.359740 20976 raft_consensus.cc:2749] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:46.386374 13651 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:12:46.396258 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:46.416182 20890 raft_consensus.cc:3055] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:46.416791 20890 raft_consensus.cc:740] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:46.392041 20812 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:46.423089 21024 log.cc:927] Time spent T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:12:46.429257 14411 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 20.
I20260709 12:12:46.430672 13757 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 17.
I20260709 12:12:46.443358 13759 raft_consensus.cc:1240] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:46.418994 20976 raft_consensus.cc:2804] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:12:46.450181 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:46.454056 14380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:46.427471 20797 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:46.412185 20992 consensus_queue.cc:1059] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.058s
W20260709 12:12:46.492322 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 106055us
I20260709 12:12:46.453235 20976 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:46.505928 20976 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:46.506930 20956 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:46.524228 20962 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:46.525930 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:46.527292 20774 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:46.454547 20890 consensus_queue.cc:260] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:46.528949 20969 raft_consensus.cc:2749] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 17. Current term is 18.
I20260709 12:12:46.529801 14416 raft_consensus.cc:1275] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:12:46.529709 20969 consensus_queue.cc:1048] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:46.531143 20703 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:46.534263 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:46.535039 21039 consensus_queue.cc:1059] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:46.536269 21039 raft_consensus.cc:3055] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:46.536628 21039 raft_consensus.cc:740] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
W20260709 12:12:46.537573 14415 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41692 (request call id 1086) took 1655 ms (client timeout 2019 ms). Trace:
W20260709 12:12:46.538096 14415 rpcz_store.cc:269] 0709 12:12:44.901031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:44.906515 (+  5484us) service_pool.cc:224] Handling call
0709 12:12:46.537360 (+1630845us) spinlock_profiling.cc:243] Waited 956 ms on lock 0x7b54003ebf54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:46.537498 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2198521216}
I20260709 12:12:46.537520 21039 consensus_queue.cc:260] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:46.540206 21039 raft_consensus.cc:3060] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:46.549026 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 55855.7us
W20260709 12:12:46.551944 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:46.552304 13685 raft_consensus.cc:1275] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 16. (term mismatch)
I20260709 12:12:46.552891 13685 pending_rounds.cc:85] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 15
I20260709 12:12:46.553218 13685 pending_rounds.cc:107] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 21.16
I20260709 12:12:46.553526 13685 raft_consensus.cc:2889] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:46.550329 13652 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:46.592698 13684 raft_consensus.cc:1240] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:46.598275 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:46.599287 13833 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:46.602061 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 51813.7us
I20260709 12:12:46.602938 13652 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
W20260709 12:12:46.606307 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:46.615403 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:46.619059 13801 leader_election.cc:400] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 election: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 19. Current term is 20.
I20260709 12:12:46.619669 13801 leader_election.cc:403] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 12:12:46.604697 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:46.635972 20253 consensus_queue.cc:260] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:46.637136 20253 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:46.637925 20661 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.638525 20661 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:46.640837 20661 leader_election.cc:290] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:46.641439 20752 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:46.641953 20752 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:46.644073 20752 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:46.644897 20890 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:46.652980 20962 raft_consensus.cc:3055] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:46.653496 20962 raft_consensus.cc:740] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
W20260709 12:12:46.653548 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 386171us
I20260709 12:12:46.654554 20962 consensus_queue.cc:260] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:46.655064 13726 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:46.655872 20962 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:46.656710 20679 raft_consensus.cc:2749] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:46.657473 20679 raft_consensus.cc:2749] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:46.658077 21041 raft_consensus.cc:2804] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:46.658640 21041 raft_consensus.cc:697] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 20 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:46.659569 13726 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:46.659636 21041 consensus_queue.cc:237] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:46.631464 20992 raft_consensus.cc:2749] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:46.609688 21027 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.666092 13833 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 20.
I20260709 12:12:46.679759 13726 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:46.688621 14379 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:46.691967 13685 raft_consensus.cc:1275] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:12:46.693215 14379 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:46.694245 21014 raft_consensus.cc:2804] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:46.605600 21007 consensus_queue.cc:1048] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.058s
I20260709 12:12:46.697309 21014 raft_consensus.cc:697] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 17 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:46.698495 21014 consensus_queue.cc:237] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:46.690508 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 81863.2us
I20260709 12:12:46.621680 20806 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.693351 21015 raft_consensus.cc:2804] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:46.682289 21025 raft_consensus.cc:2804] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:46.682796 13680 raft_consensus.cc:2468] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 17.
I20260709 12:12:46.706259 13683 raft_consensus.cc:1275] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
W20260709 12:12:46.723960 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 113279us
I20260709 12:12:46.712005 20944 raft_consensus.cc:697] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:46.718061 21025 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:46.726608 21015 raft_consensus.cc:697] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 16 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:46.736929 21025 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:46.713474 21005 raft_consensus.cc:2749] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 19. Current term is 20.
I20260709 12:12:46.733709 14379 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:12:46.729758 13652 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 1.903s (SENT) [suppressed 16 similar messages]
I20260709 12:12:46.683022 20978 consensus_queue.cc:1048] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.051s
I20260709 12:12:46.689383 21027 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:46.745743 21015 consensus_queue.cc:237] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:46.735750 20684 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:46.754731 13727 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:46.755929 20963 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:46.755663 20944 consensus_queue.cc:237] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:46.781088 20963 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:46.756459 20683 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.783354 20683 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:46.783886 20963 leader_election.cc:290] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:46.756959 20703 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:46.757927 20834 raft_consensus.cc:2804] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:46.758309 21029 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.758698 13755 raft_consensus.cc:1240] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:46.759476 13754 raft_consensus.cc:1275] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:12:46.796048 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:46.796825 13754 raft_consensus.cc:2368] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 19. Current term is 20.
I20260709 12:12:46.797765 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:46.761098 13758 raft_consensus.cc:1275] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:12:46.762029 13756 raft_consensus.cc:1275] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:12:46.763792 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:46.764521 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:46.800037 13763 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 21.
W20260709 12:12:46.766415 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 86764.9us
W20260709 12:12:46.801985 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:46.719856 13800 connection.cc:256] RPC call timeout handler was delayed by -2.0991362190002292s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1519s for a response
W20260709 12:12:46.771399 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:46.799235 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:12:46.802409 13800 connection.cc:256] RPC call timeout handler was delayed by -2.0073362190000807s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16210000000000002s for a response
W20260709 12:12:46.804611 13800 connection.cc:256] RPC call timeout handler was delayed by -1.9857362190002732s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1645s for a response
W20260709 12:12:46.805052 13800 connection.cc:256] RPC call timeout handler was delayed by -1.9488362190002135s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1686s for a response
W20260709 12:12:46.805457 13800 connection.cc:256] RPC call timeout handler was delayed by -1.8707252499998503s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1637s for a response
W20260709 12:12:46.805740 13800 connection.cc:256] RPC call timeout handler was delayed by -1.8147362190002241s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1835s for a response
I20260709 12:12:46.806895 13756 raft_consensus.cc:1240] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:46.662797 20992 consensus_queue.cc:1059] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.063s
I20260709 12:12:46.788470 13759 raft_consensus.cc:1275] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:12:46.730680 21047 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:46.724355 20806 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:46.813994 20992 raft_consensus.cc:3055] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:46.814669 20992 raft_consensus.cc:740] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:46.814199 21047 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:46.801869 13726 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:46.765507 13760 raft_consensus.cc:1240] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 12:12:46.671725 21043 consensus_queue.cc:1059] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.102s
I20260709 12:12:46.819029 21043 raft_consensus.cc:3055] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:46.819545 21043 raft_consensus.cc:740] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:46.820600 21043 consensus_queue.cc:260] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:46.821641 21043 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:46.824060 13800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:46.828495 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:46.830729 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:46.831766 13834 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 24.
I20260709 12:12:46.792377 20834 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:46.796326 20963 raft_consensus.cc:2749] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:46.835004 13757 raft_consensus.cc:1240] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:46.835697 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:12:46.836127 13800 connection.cc:256] RPC call timeout handler was delayed by -1.4947879750000084s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15500000000000003s for a response
W20260709 12:12:46.836588 13800 connection.cc:256] RPC call timeout handler was delayed by -1.0969879750000473s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19920000000000002s for a response
W20260709 12:12:46.836988 13800 connection.cc:256] RPC call timeout handler was delayed by -1.072687975000008s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20190000000000002s for a response
W20260709 12:12:46.828140 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 128649us
W20260709 12:12:46.837318 13800 connection.cc:256] RPC call timeout handler was delayed by -1.0542362190001313s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.268s for a response
W20260709 12:12:46.838035 13800 connection.cc:256] RPC call timeout handler was delayed by -1.0150879749999149s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20830000000000004s for a response
I20260709 12:12:46.838300 13651 leader_election.cc:400] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 19. Current term is 20.
I20260709 12:12:46.839370 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:46.840059 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:46.840978 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:46.841154 21049 consensus_queue.cc:1048] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 12:12:46.841809 13829 raft_consensus.cc:2393] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 24: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:46.816051 20806 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:46.840909 13837 raft_consensus.cc:2393] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 20: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:46.796960 21039 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:46.842267 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:46.836593 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:46.847077 13832 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 20.
I20260709 12:12:46.847009 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:46.840849 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:46.845116 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:46.846199 13830 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 23.
I20260709 12:12:46.848290 13831 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 18.
I20260709 12:12:46.794664 21025 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:46.828296 20679 raft_consensus.cc:2749] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:46.865348 13761 raft_consensus.cc:1240] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:46.825959 21005 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:46.867082 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:46.844724 13651 leader_election.cc:403] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:46.864679 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:46.843210 20834 raft_consensus.cc:3060] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:46.796763 20703 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:46.868636 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:46.870199 13837 raft_consensus.cc:2393] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 19: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:46.871212 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:46.842578 21002 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.815641 20992 consensus_queue.cc:260] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:46.873710 13831 raft_consensus.cc:1275] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:12:46.863873 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:46.801175 21029 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:46.875957 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:46.902825 21027 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:46.906284 21042 consensus_queue.cc:1048] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:46.908476 21025 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:46.915135 14412 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 20.
I20260709 12:12:46.919190 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:46.921598 13762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 3309) took 1105 ms. Trace:
W20260709 12:12:46.917610 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:46.865243 20683 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:46.931289 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:46.923717 13762 rpcz_store.cc:276] 0709 12:12:45.815875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:45.817367 (+  1492us) service_pool.cc:224] Handling call
0709 12:12:45.817678 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:45.817930 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:12:46.052463 (+234533us) log.cc:844] Serialized 14 byte log entry
0709 12:12:46.797180 (+744717us) log.cc:844] Serialized 14 byte log entry
0709 12:12:46.797709 (+   529us) log.cc:844] Serialized 14 byte log entry
0709 12:12:46.899956 (+102247us) spinlock_profiling.cc:243] Waited 8.8 ms on lock 0x7b18004530a0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924ea0522 00007fa924ea27c1 00007fa924ea2779 00007fa924ea2709 00007fa924ea26d1 00007fa924ea19cd 0000000000388634 0000000000388479 00007fa924e8383a
0709 12:12:46.921059 (+ 21103us) spinlock_profiling.cc:243] Waited 4 ms on lock 0x7b18004530a0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e1ac0a 00007fa92e55a219 00007fa924ea2a40 00007fa924e9d4e4 00007fa924e9d455 00007fa927f85060 00007fa927f97716 00007fa927fa8287 00007fa927fa8208
0709 12:12:46.921234 (+   175us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:46.921294 (+    60us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:46.921337 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:46.921402 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:46.921522 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":398347,"prepare.queue_time_us":156432,"prepare.run_cpu_time_us":122,"prepare.run_wall_time_us":127,"raft.queue_time_us":543796,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":14859,"spinlock_wait_cycles":29438080,"thread_start_us":455376,"threads_started":3,"wal-append.queue_time_us":189568}
I20260709 12:12:46.879541 13651 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:12:46.936651 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 61788.7us
I20260709 12:12:46.931655 13830 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 24.
I20260709 12:12:46.939038 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:46.873588 21041 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:46.945643 14415 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 19.
I20260709 12:12:46.940716 21056 raft_consensus.cc:2804] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:46.862217 20976 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:46.967090 13727 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:46.970059 20963 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.970861 20963 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:46.973388 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:46.973981 21027 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:46.974617 21027 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:46.974920 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:46.975021 21047 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:46.975783 21047 raft_consensus.cc:2804] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:12:46.976342 21047 raft_consensus.cc:697] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:46.976581 13835 raft_consensus.cc:1240] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 12:12:46.976240 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:46.980216 13834 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 18.
I20260709 12:12:46.877570 21039 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:46.992237 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 49659us
I20260709 12:12:46.992812 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:46.993345 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:46.990902 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:46.878808 21005 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:46.999966 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:12:47.006598 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 204833us
I20260709 12:12:47.008433 13726 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:47.011329 13726 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:46.930183 21002 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:47.016039 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:46.976765 21027 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:47.018472 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:47.019872 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:47.024477 13727 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:47.000484 20963 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:47.031611 13829 raft_consensus.cc:1275] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:12:47.029740 13727 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:47.017642 20992 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:47.020671 21052 raft_consensus.cc:2749] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:47.037585 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:47.024286 20703 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:47.040200 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:47.044122 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:47.044276 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:47.044553 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:47.045063 13679 raft_consensus.cc:2368] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 19. Current term is 20.
I20260709 12:12:47.039219 13727 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:47.045210 13682 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:47.026038 21056 raft_consensus.cc:697] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 19 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:47.047569 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:47.048540 13687 raft_consensus.cc:2468] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 17.
I20260709 12:12:47.049628 13684 raft_consensus.cc:2393] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 20: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:47.028673 21027 raft_consensus.cc:2804] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:12:47.051401 13727 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:47.055409 13727 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:47.056424 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:47.057698 21064 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.057898 21039 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:47.058297 21064 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:47.058918 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:47.059883 20834 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:47.066537 13829 raft_consensus.cc:1240] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:47.066977 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:47.060551 21064 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:47.060696 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:47.061949 21048 raft_consensus.cc:2749] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:47.085268 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:47.086199 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:47.040479 20661 raft_consensus.cc:2804] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:47.088599 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:47.089147 13683 raft_consensus.cc:1275] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:12:47.089340 13687 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 23.
W20260709 12:12:47.067823 21053 log.cc:927] Time spent T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:12:47.092267 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:47.067651 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:47.080049 13686 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 19.
I20260709 12:12:47.093086 13687 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 20.
I20260709 12:12:47.081379 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:47.082329 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:47.082643 13831 raft_consensus.cc:2393] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 23: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:47.077669 13682 raft_consensus.cc:2468] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 14.
I20260709 12:12:47.083781 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:47.084050 13727 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:47.090258 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:47.094597 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:47.090279 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:47.041695 20963 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:12:46.977694 21047 consensus_queue.cc:237] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:47.092188 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:47.092586 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:47.096287 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:47.062034 21002 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:47.054680 21027 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:47.098690 13727 leader_election.cc:304] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:47.120096 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:47.120621 13727 leader_election.cc:304] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:47.120828 13684 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 20.
I20260709 12:12:47.096856 13683 raft_consensus.cc:2393] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 18: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:47.081962 20816 raft_consensus.cc:2804] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:47.116847 14410 raft_consensus.cc:2393] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 18: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:12:47.123384 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:47.117012 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:47.078796 20703 raft_consensus.cc:2804] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:47.122327 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:47.101686 13834 raft_consensus.cc:1275] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 12. (term mismatch)
I20260709 12:12:47.122794 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:47.127266 20703 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:47.124107 13686 raft_consensus.cc:2393] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 19: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:47.099218 20661 raft_consensus.cc:697] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:47.141896 20661 consensus_queue.cc:237] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:47.145169 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:47.146306 21046 raft_consensus.cc:2804] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:12:47.146814 21046 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:47.147186 21046 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:47.147361 20976 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:47.126807 20253 raft_consensus.cc:2804] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:47.150148 20253 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:47.150537 20253 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:47.122892 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:47.095604 20963 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:47.153523 13682 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 21.
I20260709 12:12:47.126530 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:47.078399 21023 raft_consensus.cc:2804] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:47.140192 20703 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:47.154723 13755 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:47.154994 13679 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 24.
I20260709 12:12:47.125583 13835 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 20.
I20260709 12:12:47.156092 13834 pending_rounds.cc:85] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 11
I20260709 12:12:47.160686 14408 raft_consensus.cc:1275] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:12:47.170404 13834 pending_rounds.cc:107] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 20.12
I20260709 12:12:47.170760 13834 raft_consensus.cc:2889] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:47.154191 14415 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 19.
I20260709 12:12:47.171933 13687 raft_consensus.cc:2393] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 19: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:47.172087 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:47.172686 20834 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:47.172860 13681 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 24.
I20260709 12:12:47.173550 13830 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 19.
I20260709 12:12:47.177954 21030 consensus_queue.cc:1048] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:47.180783 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:12:47.184386 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:47.186635 14408 raft_consensus.cc:1275] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:12:47.124720 21027 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:47.190734 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:47.194458 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:47.182427 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:47.197608 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:47.229684 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:47.230022 13727 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:47.190636 21056 consensus_queue.cc:237] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:47.225342 13685 raft_consensus.cc:1275] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:12:47.117205 20944 raft_consensus.cc:2749] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:12:47.230789 13682 raft_consensus.cc:2393] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 16: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:47.127046 20816 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:47.232740 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 51301.9us
I20260709 12:12:47.159804 20963 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:47.234138 13686 raft_consensus.cc:1240] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:47.235843 13828 raft_consensus.cc:2393] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 20: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:47.240862 13679 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 19.
I20260709 12:12:47.117014 20774 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:47.239409 13727 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:47.171411 21023 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:47.249231 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:47.253764 13834 raft_consensus.cc:2393] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 24: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:47.243635 20679 raft_consensus.cc:2749] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:47.227772 20834 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:47.245896 20816 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:47.233445 21029 leader_election.cc:290] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:47.265877 20661 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.248730 21014 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.262939 20944 raft_consensus.cc:2804] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:47.272989 20944 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:47.273435 20944 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:47.275774 20962 consensus_meta.cc:287] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.619s	user 0.009s	sys 0.008s
I20260709 12:12:47.276934 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:47.277340 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:47.269003 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:47.278028 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:47.256153 21023 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:47.278877 13835 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 18.
I20260709 12:12:47.277959 20661 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:47.256389 20774 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:47.279884 21014 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:47.258256 20969 consensus_queue.cc:1048] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.024s
I20260709 12:12:47.305383 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:47.306432 13758 raft_consensus.cc:2393] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 16: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:47.286600 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:47.271147 20834 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:47.322299 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:47.287057 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:47.324440 21005 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:47.353479 13755 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 21.
I20260709 12:12:47.378505 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:12:47.378250 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 138907us
W20260709 12:12:47.351049 21043 consensus_meta.cc:287] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.529s	user 0.010s	sys 0.006s
I20260709 12:12:47.324270 21014 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:47.336740 21052 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:47.384307 13727 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:47.389146 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:47.391947 13727 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:47.360181 21041 raft_consensus.cc:2749] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 19. Current term is 20.
I20260709 12:12:47.397368 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:47.397501 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:47.398371 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:47.399834 14409 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 17.
I20260709 12:12:47.401103 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:47.402415 14409 raft_consensus.cc:1275] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:12:47.406158 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:47.402459 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:47.409168 13755 raft_consensus.cc:2468] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 17.
I20260709 12:12:47.407140 13759 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 23.
W20260709 12:12:47.415647 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:47.418823 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:47.331351 21046 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:47.424201 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:47.424669 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:47.431164 13835 raft_consensus.cc:2393] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 20: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:47.424615 13800 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:47.425962 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:47.391115 20834 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:47.433050 13829 raft_consensus.cc:2393] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 23: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:47.396682 20679 raft_consensus.cc:2804] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:47.400303 20979 raft_consensus.cc:2804] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:47.361866 20944 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:47.443460 13833 raft_consensus.cc:1275] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 12:12:47.429345 13801 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:47.382673 21005 consensus_queue.cc:1048] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 12:12:47.459923 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:47.437497 20679 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:47.444711 20979 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:47.478248 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:47.401104 21052 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:47.455475 20893 raft_consensus.cc:2749] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:47.480474 13758 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:47.471244 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 46619.9us
I20260709 12:12:47.434515 21026 consensus_queue.cc:1048] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.038s
I20260709 12:12:47.460942 21002 raft_consensus.cc:2804] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:47.484915 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:47.487802 21002 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:47.488471 21002 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:47.479677 20679 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:47.482283 20979 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:47.507056 13800 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:12:47.504140 21073 log.cc:927] Time spent T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:12:47.529142 13755 raft_consensus.cc:1275] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:12:47.533402 13688 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 20.
I20260709 12:12:47.548308 13755 raft_consensus.cc:1240] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 18. Current term is 19. Ops: []
W20260709 12:12:47.540503 20992 consensus_meta.cc:287] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.502s	user 0.011s	sys 0.001s
W20260709 12:12:47.548441 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 54920.9us
I20260709 12:12:47.554951 20253 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:47.559005 21023 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:47.536319 20893 consensus_queue.cc:1059] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.026s
W20260709 12:12:47.562749 21079 log.cc:927] Time spent T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:12:47.564551 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:47.565654 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:47.566016 13755 raft_consensus.cc:1275] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:12:47.578398 13759 raft_consensus.cc:3060] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:47.566540 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:47.580312 13684 raft_consensus.cc:1275] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:12:47.568394 13758 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 18.
I20260709 12:12:47.537668 14411 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3f29dda715314a93a03981264972c4c3"
dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:46814
I20260709 12:12:47.570916 13651 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:47.524085 21027 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:47.522051 20703 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:47.543293 21005 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:47.577416 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:47.577461 13679 raft_consensus.cc:1275] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 12. (term mismatch)
I20260709 12:12:47.586344 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:47.586484 21039 raft_consensus.cc:2804] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:47.589468 21027 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:47.581920 13651 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:47.581451 14411 raft_consensus.cc:606] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 16 LEADER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:47.618656 13681 raft_consensus.cc:3060] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:47.618561 13679 pending_rounds.cc:85] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 11
I20260709 12:12:47.619602 13679 pending_rounds.cc:107] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260709 12:12:47.619877 13679 raft_consensus.cc:2889] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:47.591096 13757 raft_consensus.cc:1275] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:12:47.621392 13686 raft_consensus.cc:2468] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 14.
I20260709 12:12:47.591173 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:12:47.633807 21076 log.cc:927] Time spent T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:12:47.635253 21046 leader_election.cc:290] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:47.614087 13760 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 19.
I20260709 12:12:47.642381 21052 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:47.643270 20944 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:47.645605 13761 raft_consensus.cc:1240] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:47.646754 21031 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.647330 21031 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:47.648536 13757 raft_consensus.cc:1275] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:12:47.650063 20457 consensus_queue.cc:1048] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:12:47.650872 21012 consensus_queue.cc:1048] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:47.649610 21031 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:47.651906 21039 raft_consensus.cc:697] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 21 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:47.652920 21039 consensus_queue.cc:237] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:47.655915 13681 raft_consensus.cc:2468] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 18.
I20260709 12:12:47.657279 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:47.659114 13759 raft_consensus.cc:2468] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 18.
I20260709 12:12:47.660198 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:47.660821 13835 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:47.631160 20992 raft_consensus.cc:2804] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:47.663909 14412 raft_consensus.cc:1275] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 12:12:47.666337 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:47.590775 21048 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:47.687783 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 185506us
I20260709 12:12:47.667271 20992 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:47.690026 14379 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:47.696358 13800 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:47.697221 14379 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:47.700462 21005 raft_consensus.cc:2749] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:47.689096 21052 consensus_queue.cc:1048] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.012s
I20260709 12:12:47.667480 21066 consensus_queue.cc:1059] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 12:12:47.673296 21049 consensus_queue.cc:1048] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.023s
I20260709 12:12:47.713099 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:47.716710 13679 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 18.
I20260709 12:12:47.712042 13726 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:47.713678 13681 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:12:47.696431 20992 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:47.729524 20806 raft_consensus.cc:3055] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:47.730052 20806 raft_consensus.cc:740] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:47.729674 20679 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:47.731380 21026 raft_consensus.cc:2764] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 12:12:47.717567 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:47.732151 20679 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:47.732594 13684 raft_consensus.cc:2393] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 19: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:47.712637 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:47.733705 13686 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:47.712463 21046 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:47.735270 13726 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:47.735898 21046 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:47.736680 20703 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:47.705636 20452 raft_consensus.cc:2749] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:12:47.738708 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:47.740036 21026 raft_consensus.cc:2804] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:47.740486 21026 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:47.740830 21026 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:47.741376 21005 raft_consensus.cc:2804] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:47.742064 21005 raft_consensus.cc:697] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 19 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:47.743091 21005 consensus_queue.cc:237] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:47.743839 20963 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:47.723627 21083 log.cc:927] Time spent T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:12:47.724088 13682 raft_consensus.cc:1275] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 12:12:47.726344 21041 raft_consensus.cc:3055] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:47.731024 20806 consensus_queue.cc:260] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:47.744993 14408 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b"
dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:46814
I20260709 12:12:47.712834 21015 raft_consensus.cc:2804] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:47.745909 21023 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:47.714334 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:47.723423 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:47.806607 13685 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:47.682468 21048 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:47.792809 13681 raft_consensus.cc:1275] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
W20260709 12:12:47.768085 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 71797.3us
I20260709 12:12:47.765463 13686 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 25.
I20260709 12:12:47.753543 13726 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:47.778255 14415 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 19.
I20260709 12:12:47.775642 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:47.749375 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:47.751668 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:47.750206 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:47.802659 14408 raft_consensus.cc:606] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 19 LEADER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:47.808741 13727 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:47.808924 13832 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:47.798903 21041 raft_consensus.cc:740] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:47.766415 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:47.809981 13829 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:47.780830 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:12:47.810845 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 57386.9us
W20260709 12:12:47.806763 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 89722.3us
I20260709 12:12:47.812777 13726 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:47.812816 14379 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:47.810163 14410 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 20.
I20260709 12:12:47.815580 14379 leader_election.cc:304] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:47.819269 13726 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:47.820667 13726 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:47.753299 20774 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:47.867692 13685 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 25.
I20260709 12:12:47.869059 21091 consensus_queue.cc:1048] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:47.825611 13800 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:47.758855 21046 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:47.785758 20703 consensus_queue.cc:1048] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.080s
I20260709 12:12:47.867064 21048 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:47.751488 20816 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:47.809049 21043 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.883199 14379 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
W20260709 12:12:47.845115 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:47.825171 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:47.891271 13832 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 24.
I20260709 12:12:47.879200 13726 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:47.748915 21026 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:47.893563 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:47.816128 21047 raft_consensus.cc:2804] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:47.894667 13727 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:47.822933 20944 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:47.897426 13685 raft_consensus.cc:1275] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 17 index: 15. (term mismatch)
I20260709 12:12:47.862442 21052 raft_consensus.cc:2804] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:47.901846 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:47.822511 21084 raft_consensus.cc:2749] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:12:47.876778 21076 log.cc:927] Time spent T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:12:47.903046 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:47.862131 20253 leader_election.cc:290] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:47.764858 20979 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:47.863677 21088 log.cc:927] Time spent T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:12:47.823318 21015 raft_consensus.cc:697] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 18 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:47.816428 20679 raft_consensus.cc:2804] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:47.960843 13685 pending_rounds.cc:85] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 14
I20260709 12:12:48.030112 13685 pending_rounds.cc:107] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 16.15
I20260709 12:12:48.030426 13685 raft_consensus.cc:2889] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:47.876917 20837 raft_consensus.cc:2804] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:47.880889 21056 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.823467 21029 raft_consensus.cc:2804] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:48.021548 13687 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:48.022111 21052 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:47.981048 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:48.049885 13684 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:47.893278 20774 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.893036 20457 consensus_queue.cc:1048] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.137s
I20260709 12:12:48.028309 13682 raft_consensus.cc:1275] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 12:12:47.903594 20452 raft_consensus.cc:2804] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:47.960582 20893 raft_consensus.cc:2764] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader election decision vote started in defunct term 23: won
I20260709 12:12:48.032948 20837 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:47.885743 21046 consensus_queue.cc:1048] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.150s
I20260709 12:12:47.961364 21023 raft_consensus.cc:2749] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:47.963167 13829 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 21.
I20260709 12:12:48.045676 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:47.980212 21078 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:48.053063 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:48.080607 13683 raft_consensus.cc:2393] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 19: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
W20260709 12:12:48.055029 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 241062us
I20260709 12:12:48.026846 21047 raft_consensus.cc:697] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:47.814355 21030 consensus_queue.cc:1048] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.148s
I20260709 12:12:48.052405 13726 leader_election.cc:304] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:48.058070 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:47.903496 21043 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:48.032725 20679 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:47.902511 20806 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:48.060801 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:48.066740 20661 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:48.072242 13687 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 24.
I20260709 12:12:48.048879 21084 raft_consensus.cc:2804] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:12:48.054447 21052 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:48.076287 21015 consensus_queue.cc:237] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:48.081559 13685 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 20.
I20260709 12:12:48.090874 13686 raft_consensus.cc:2393] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 20: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:48.094261 13726 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:48.102200 13684 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 21.
I20260709 12:12:48.116871 21026 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:48.117033 13800 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:48.091218 21078 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:48.118093 20816 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:48.118342 21089 log.cc:927] Time spent T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 12:12:48.110733 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 27 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:48.077857 20837 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:48.058631 21029 raft_consensus.cc:697] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 18 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:48.063149 20452 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:48.120529 13687 raft_consensus.cc:1275] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
W20260709 12:12:48.126255 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:48.103250 20679 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:12:48.120669 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 226055us
I20260709 12:12:48.120882 13683 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 26.
I20260709 12:12:48.109622 21048 raft_consensus.cc:2804] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:12:48.044840 21056 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:48.121906 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:47.982267 21041 consensus_queue.cc:260] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:48.061209 20774 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:48.125984 21002 consensus_meta.cc:287] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.632s	user 0.012s	sys 0.000s
W20260709 12:12:48.137329 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 81969.6us
I20260709 12:12:48.146904 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:48.125690 20452 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:48.150786 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:48.121590 21084 raft_consensus.cc:697] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:48.131837 21078 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:48.113217 21023 consensus_queue.cc:1048] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.024s
I20260709 12:12:48.132264 21026 raft_consensus.cc:2804] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:12:48.154567 13832 raft_consensus.cc:2393] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 19: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:48.156234 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:48.161068 13836 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Advancing to term 21
I20260709 12:12:48.160369 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:48.161746 13833 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:48.140406 20893 raft_consensus.cc:2749] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:12:48.134174 20683 consensus_queue.cc:1048] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.027s
I20260709 12:12:48.152922 20963 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:48.140264 21055 consensus_queue.cc:1048] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 12:12:48.157902 21048 raft_consensus.cc:697] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:12:48.193717 13835 consensus_meta.cc:287] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.530s	user 0.012s	sys 0.000s
I20260709 12:12:48.199352 13835 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 25.
W20260709 12:12:48.198422 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 50753.6us
I20260709 12:12:48.148069 21002 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:48.172889 21026 raft_consensus.cc:697] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:12:48.212555 13652 leader_election.cc:336] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 1.507s (SENT)
I20260709 12:12:48.214260 13652 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:48.220031 13828 raft_consensus.cc:1240] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:48.228750 21084 consensus_queue.cc:237] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:48.191684 20992 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:48.259193 13833 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 19.
I20260709 12:12:48.261042 13836 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 21.
W20260709 12:12:48.261237 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 51142.2us
I20260709 12:12:48.267210 21023 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:48.267897 21023 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:48.269941 21049 raft_consensus.cc:2749] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
W20260709 12:12:48.271595 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:48.160606 21047 consensus_queue.cc:237] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:48.194558 21029 consensus_queue.cc:237] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:48.306435 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 93935us
W20260709 12:12:48.307588 13652 leader_election.cc:336] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 1.590s (SENT)
I20260709 12:12:48.316875 21104 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.339190 21056 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:48.321379 21048 consensus_queue.cc:237] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:48.321746 21026 consensus_queue.cc:237] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:48.350347 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:48.335109 21104 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:48.356237 20774 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:48.339253 20452 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:48.359081 20992 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:48.359513 21043 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:48.364531 20679 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:48.357509 20837 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:48.370067 13800 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:48.330513 21023 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:48.395403 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:48.378393 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:48.410777 13686 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:48.418605 21095 raft_consensus.cc:2764] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 12:12:48.427462 20837 leader_election.cc:290] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:48.428194 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:48.428561 14410 raft_consensus.cc:2368] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 19. Current term is 20.
I20260709 12:12:48.428942 13682 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:48.429984 20452 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:48.405723 21043 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:48.434125 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 98775.1us
I20260709 12:12:48.434233 21043 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:48.435015 13800 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:48.436757 13682 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 20.
I20260709 12:12:48.438078 14379 leader_election.cc:304] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:48.439273 20679 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:48.445974 21104 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:48.436791 20944 raft_consensus.cc:2749] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:48.420724 21052 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:48.449806 21104 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.450542 21104 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:48.453811 21052 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:48.458448 13726 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:48.459213 21095 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:48.460583 21095 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:48.463229 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:48.464053 13683 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:48.463157 13726 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:48.465549 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:48.466308 13682 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:48.466809 13686 raft_consensus.cc:2468] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 15.
I20260709 12:12:48.469216 13800 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:48.469317 14379 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:48.471379 20876 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:12:48.471791 20452 raft_consensus.cc:2804] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:48.472448 21082 consensus_queue.cc:1048] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 12:12:48.472980 20979 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:48.471199 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:48.474452 13685 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:12:48.470582 13726 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:48.470414 14379 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:48.461329 21005 raft_consensus.cc:2749] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:48.483901 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:48.491035 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:48.491942 13686 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:48.496649 13685 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 19.
I20260709 12:12:48.496874 13682 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 20.
I20260709 12:12:48.498809 13683 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 21.
I20260709 12:12:48.472482 20452 raft_consensus.cc:697] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 20 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:48.498694 13726 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:48.465673 20944 raft_consensus.cc:2804] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:48.463697 21052 consensus_queue.cc:1048] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
I20260709 12:12:48.508405 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:48.505546 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:48.512022 13683 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:48.500411 20979 raft_consensus.cc:2804] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:48.471803 20876 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:48.507797 20944 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:48.567075 20944 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:48.513347 21039 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:48.570237 21039 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:48.514612 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:48.573385 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:48.480608 20679 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:48.516844 20774 raft_consensus.cc:2804] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:48.500568 20978 raft_consensus.cc:2804] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:48.484930 21082 raft_consensus.cc:2764] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader election decision vote started in defunct term 20: won
I20260709 12:12:48.502912 21023 consensus_queue.cc:1048] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.060s
W20260709 12:12:48.528424 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 59280.9us
I20260709 12:12:48.509127 13726 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:12:48.588155 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 79102.6us
I20260709 12:12:48.588615 21104 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:48.588902 13726 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:48.590844 21026 raft_consensus.cc:2804] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:48.591387 21026 raft_consensus.cc:697] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:48.592304 21026 consensus_queue.cc:237] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:48.594008 21048 raft_consensus.cc:2804] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:48.595773 13800 leader_election.cc:304] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:48.510874 14408 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 20.
I20260709 12:12:48.539989 21041 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:48.540571 20992 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.594635 21048 raft_consensus.cc:697] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:48.610334 14409 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e"
dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:46814
W20260709 12:12:48.578791 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:48.580271 20774 raft_consensus.cc:697] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:48.553262 21095 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:48.593909 20978 raft_consensus.cc:697] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 15 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:48.565632 20876 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Advancing to term 27
W20260709 12:12:48.625880 13688 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 3378) took 1578 ms (client timeout 1583 ms). Trace:
W20260709 12:12:48.626437 13688 rpcz_store.cc:269] 0709 12:12:47.047559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:47.054199 (+  6640us) service_pool.cc:224] Handling call
0709 12:12:48.625621 (+1571422us) spinlock_profiling.cc:243] Waited 377 ms on lock 0x7b5400285ad4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:48.625790 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":866693376}
I20260709 12:12:48.627552 21048 consensus_queue.cc:237] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:48.628437 13680 raft_consensus.cc:1240] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:48.599035 20979 raft_consensus.cc:697] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:48.501859 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:48.616463 13683 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 19.
I20260709 12:12:48.611148 14409 raft_consensus.cc:606] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 21 LEADER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:48.620030 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:48.529704 20452 consensus_queue.cc:237] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:48.647347 13800 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:48.648240 21085 raft_consensus.cc:2804] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:48.648628 21085 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:48.649107 21085 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:48.649163 13800 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:48.522646 13686 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 25.
I20260709 12:12:48.640714 13727 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:48.610169 21005 raft_consensus.cc:2764] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader election decision vote started in defunct term 24: won
I20260709 12:12:48.644474 13685 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:48.645738 13763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 3328) took 1459 ms. Trace:
I20260709 12:12:48.655921 20893 raft_consensus.cc:2764] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 18 LEADER]: Leader election decision vote started in defunct term 17: won
I20260709 12:12:48.646687 20457 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:48.656746 20457 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:48.659384 20457 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:48.688462 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 47836.9us
W20260709 12:12:48.691988 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:48.698048 13652 leader_election.cc:336] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 1.903s (SENT)
I20260709 12:12:48.698626 13652 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:12:48.700456 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 51380.9us
I20260709 12:12:48.617450 21082 consensus_queue.cc:1048] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 12:12:48.650107 20806 consensus_queue.cc:1048] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.005s
W20260709 12:12:48.706106 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:48.642604 21095 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:48.654590 13763 rpcz_store.cc:276] 0709 12:12:47.186003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:47.189149 (+  3146us) service_pool.cc:224] Handling call
0709 12:12:47.189628 (+   479us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:47.566971 (+377343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:47.567000 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:47.567555 (+   555us) log.cc:844] Serialized 52 byte log entry
0709 12:12:47.695992 (+128437us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:47.771520 (+ 75528us) log.cc:844] Serialized 14 byte log entry
0709 12:12:47.781400 (+  9880us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:48.621055 (+839655us) spinlock_profiling.cc:243] Waited 339 ms on lock 0x7b5400333bd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:48.621111 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:48.621160 (+    49us) raft_consensus.cc:1685] finished
0709 12:12:48.645519 (+ 24359us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:48.645678 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16601,"prepare.queue_time_us":73110,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":59,"raft.queue_time_us":10958,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":4509,"spinlock_wait_cycles":778883968,"thread_start_us":69063,"threads_started":1,"wal-append.queue_time_us":170167}
I20260709 12:12:48.712831 13685 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 22.
I20260709 12:12:48.617758 20992 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:48.717278 21078 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:48.740226 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:48.741904 20979 consensus_queue.cc:237] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:48.744082 13763 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca94d8f3109143599733e3a684149726"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:12:48.744762 13763 raft_consensus.cc:606] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:48.745108 13763 raft_consensus.cc:614] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:48.749049 13800 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:48.784826 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:48.790094 20679 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:48.792793 21005 raft_consensus.cc:2764] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader election decision vote started in defunct term 25: won
I20260709 12:12:48.793649 21005 consensus_queue.cc:1059] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:48.794539 21005 consensus_queue.cc:1059] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:48.795282 20992 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:48.798890 13727 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:48.737600 21042 raft_consensus.cc:2749] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:48.726040 21095 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:48.810936 20893 raft_consensus.cc:3055] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:48.809432 21084 raft_consensus.cc:2749] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:48.806319 20963 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:48.732182 20978 consensus_queue.cc:237] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:48.737365 20774 consensus_queue.cc:237] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:48.827971 21039 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:48.827795 20893 raft_consensus.cc:740] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:48.832572 21082 raft_consensus.cc:3055] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:48.852389 21048 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.870868 14412 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08"
dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:46814
I20260709 12:12:48.871682 14412 raft_consensus.cc:606] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:48.872069 14412 raft_consensus.cc:614] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:48.878334 20893 consensus_queue.cc:260] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:48.879956 20893 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:48.849303 20963 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:48.882325 21048 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:48.891443 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:12:48.894838 14410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41700 (request call id 1084) took 1070 ms. Trace:
I20260709 12:12:48.895458 14410 rpcz_store.cc:276] 0709 12:12:47.824643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:47.824859 (+   216us) service_pool.cc:224] Handling call
0709 12:12:48.894524 (+1069665us) spinlock_profiling.cc:243] Waited 536 ms on lock 0x7b54006301d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:48.894730 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1233740672}
I20260709 12:12:48.896814 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:48.897943 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:48.899036 21005 consensus_queue.cc:1048] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:48.905012 21095 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:48.905825 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:48.906095 21002 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:48.906625 13682 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 21.
I20260709 12:12:48.908120 13680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 2353) took 1862 ms. Trace:
I20260709 12:12:48.909421 13687 raft_consensus.cc:1275] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 12:12:48.912235 21039 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.912823 21039 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:48.852965 20806 consensus_queue.cc:1048] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 12:12:48.915858 20806 consensus_queue.cc:1243] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer b98d2519bb504dc6905ed2ede4571835 log is divergent from this leader: its last log entry 18.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:12:48.855805 21082 raft_consensus.cc:740] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:48.918284 21082 consensus_queue.cc:260] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:48.908296 13685 raft_consensus.cc:1275] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 14. (term mismatch)
I20260709 12:12:48.919415 13685 pending_rounds.cc:85] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 13
I20260709 12:12:48.919746 13685 pending_rounds.cc:107] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 12:12:48.919993 13685 raft_consensus.cc:2889] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:12:48.917291 13652 leader_election.cc:336] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 2.017s (SENT)
W20260709 12:12:48.921494 21121 log.cc:927] Time spent T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.437s	user 0.005s	sys 0.000s
W20260709 12:12:48.939653 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:48.908778 13680 rpcz_store.cc:276] 0709 12:12:47.046001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:47.046102 (+   101us) service_pool.cc:224] Handling call
0709 12:12:48.628252 (+1582150us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:48.628920 (+   668us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:48.907825 (+278905us) spinlock_profiling.cc:243] Waited 1.56 s on lock 0x7b5400285ad0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:48.908010 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3589436672}
I20260709 12:12:48.943274 13829 raft_consensus.cc:1275] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 12:12:48.945190 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:12:48.945133 13652 leader_election.cc:336] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 1.584s (SENT)
I20260709 12:12:48.946256 13652 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:48.947691 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:48.948175 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:12:48.947788 13652 leader_election.cc:336] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 1.912s (SENT)
I20260709 12:12:48.919457 21082 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:48.949348 13652 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:48.955900 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:12:49.002416 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 54586us
I20260709 12:12:49.002032 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:49.026047 13828 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:48.949138 21122 raft_consensus.cc:2749] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:12:49.020423 21105 raft_consensus.cc:2749] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:49.019240 20963 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:49.054982 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 212910us
I20260709 12:12:49.056095 13800 leader_election.cc:400] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 election: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 19. Current term is 20.
I20260709 12:12:49.056582 13800 leader_election.cc:403] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 12:12:49.058079 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:49.063268 21130 raft_consensus.cc:2749] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 19. Current term is 20.
W20260709 12:12:49.069621 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 65902us
I20260709 12:12:49.070979 13763 raft_consensus.cc:1275] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:12:49.076653 13685 raft_consensus.cc:1275] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 12:12:49.076653 13763 raft_consensus.cc:1275] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:12:49.078007 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:49.078948 14412 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 19.
I20260709 12:12:49.090909 21031 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:49.091581 21031 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:49.094636 21030 consensus_queue.cc:1048] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:12:49.095633 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:12:49.098785 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:49.099052 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 298114us
W20260709 12:12:49.100905 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:49.102229 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 199040us
I20260709 12:12:49.106041 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:49.107121 13763 raft_consensus.cc:2468] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 16.
I20260709 12:12:49.111596 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:49.116489 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:49.117610 13763 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:49.127682 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:49.129259 13759 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 20.
I20260709 12:12:49.100478 13727 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:49.071192 21130 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:49.069242 21039 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:49.135633 13685 raft_consensus.cc:1240] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:49.056221 20876 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:49.095649 21031 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:49.142423 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:49.140472 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:49.098297 21048 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:49.127638 21078 raft_consensus.cc:2749] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:49.102213 20816 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:49.161818 13758 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 18.
I20260709 12:12:49.162467 13760 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 17.
I20260709 12:12:49.171586 21012 raft_consensus.cc:993] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f: : Instructing follower 96701a74fdee481fb5f54aac841e17dd to start an election
I20260709 12:12:49.172853 13763 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 24.
I20260709 12:12:49.152609 13685 raft_consensus.cc:1275] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:12:49.081017 21015 consensus_queue.cc:1048] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.059s
I20260709 12:12:49.103086 20806 consensus_queue.cc:1048] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.046s
I20260709 12:12:49.181828 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:49.196738 13763 raft_consensus.cc:1240] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:49.136130 21002 consensus_queue.cc:1059] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
W20260709 12:12:49.198171 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 97766.3us
W20260709 12:12:49.204107 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 310830us
I20260709 12:12:49.206532 13727 leader_election.cc:400] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 election: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 19. Current term is 20.
I20260709 12:12:49.207002 13727 leader_election.cc:403] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 12:12:49.191847 21012 raft_consensus.cc:1081] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 16 LEADER]: Signalling peer 96701a74fdee481fb5f54aac841e17dd to start an election
I20260709 12:12:49.179584 20816 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:49.187379 21134 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:49.212615 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:49.144178 21130 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:49.202366 20944 consensus_meta.cc:287] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.635s	user 0.014s	sys 0.000s
W20260709 12:12:49.205294 21041 consensus_meta.cc:287] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.595s	user 0.012s	sys 0.000s
I20260709 12:12:49.220307 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:49.206923 21027 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:49.227088 13681 raft_consensus.cc:1240] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:49.216460 21137 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:49.216017 20876 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:49.242897 13679 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 21.
I20260709 12:12:49.223825 21026 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:49.253666 13652 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:49.255251 20816 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:49.255813 13652 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:12:49.257690 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:49.231081 21027 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:49.258455 13681 raft_consensus.cc:1240] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 21 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 12:12:49.259617 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:49.260111 21027 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:49.261039 20806 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.261579 20806 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:49.263820 20806 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:12:49.272540 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:49.235961 21133 log.cc:927] Time spent T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.211s	user 0.001s	sys 0.001s
I20260709 12:12:49.282828 13687 raft_consensus.cc:1240] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 17. Current term is 18. Ops: [17.12-17.12]
W20260709 12:12:49.294718 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:49.301388 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:12:49.302522 13800 connection.cc:256] RPC call timeout handler was delayed by -1.3958645189998151s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1585s for a response
W20260709 12:12:49.303015 13800 connection.cc:256] RPC call timeout handler was delayed by -1.3004645189998882s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16910000000000003s for a response
W20260709 12:12:49.303375 13800 connection.cc:256] RPC call timeout handler was delayed by -1.2212645189997602s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1779s for a response
W20260709 12:12:49.303691 13800 connection.cc:256] RPC call timeout handler was delayed by -1.0277645189999021s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19940000000000002s for a response
I20260709 12:12:49.223415 20944 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:49.221944 21134 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:49.281456 21085 consensus_meta.cc:287] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.632s	user 0.012s	sys 0.001s
I20260709 12:12:49.267874 21043 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:49.278128 21039 raft_consensus.cc:2804] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:49.310618 13682 pending_rounds.cc:85] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 10
I20260709 12:12:49.333927 13682 pending_rounds.cc:107] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 12:12:49.280586 20992 raft_consensus.cc:2749] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:49.309448 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 27 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:49.309074 13681 raft_consensus.cc:1240] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 15. Current term is 16. Ops: [15.9-15.9]
W20260709 12:12:49.338868 13679 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 3403) took 1441 ms (client timeout 1709 ms). Trace:
I20260709 12:12:49.326180 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:12:49.305160 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 49435us
I20260709 12:12:49.309852 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:49.329975 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:49.330621 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:49.332288 13835 raft_consensus.cc:1275] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 12:12:49.333108 13832 raft_consensus.cc:3055] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:12:49.341347 13832 raft_consensus.cc:740] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:49.340840 13834 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 15.
I20260709 12:12:49.344835 14409 raft_consensus.cc:1240] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 26. Current term is 27. Ops: []
W20260709 12:12:49.339331 13679 rpcz_store.cc:269] 0709 12:12:47.897867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:47.898002 (+   135us) service_pool.cc:224] Handling call
0709 12:12:49.338663 (+1440661us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b5400285fd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:49.338804 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2765232000}
I20260709 12:12:49.304654 13828 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 25.
I20260709 12:12:49.334300 13682 raft_consensus.cc:2889] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:49.336021 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:49.347216 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:49.347968 13836 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 21.
I20260709 12:12:49.342180 13832 consensus_queue.cc:260] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:49.348858 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 44583.8us
I20260709 12:12:49.353369 13800 leader_election.cc:400] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 election: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 19. Current term is 20.
I20260709 12:12:49.354226 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:49.334455 21039 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:49.384994 14411 raft_consensus.cc:1275] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:12:49.379556 13800 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:49.404004 13727 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:49.333469 21085 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:49.356472 21105 consensus_queue.cc:1048] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 12:12:49.375730 21039 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:49.417950 13800 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
W20260709 12:12:49.395213 20979 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.013s	sys 0.006s
I20260709 12:12:49.348058 21043 consensus_queue.cc:1059] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 12:12:49.418865 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:12:49.422657 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:49.389832 20679 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.428624 13684 raft_consensus.cc:1275] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:12:49.433246 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:12:49.430354 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 76605.8us
I20260709 12:12:49.365964 21122 consensus_queue.cc:1059] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 12:12:49.446535 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:49.446952 13754 raft_consensus.cc:1275] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:12:49.435261 13727 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:49.443302 13726 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:49.449747 21027 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
W20260709 12:12:49.356019 21002 consensus_queue.cc:1175] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" responder_term: 24 status { last_received { term: 23 index: 13 } last_committed_idx: 13 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 12:12:49.454144 21145 log.cc:927] Time spent T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:12:49.454406 21002 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:49.419829 21136 consensus_queue.cc:1048] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 12:12:49.454047 21027 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:49.455786 21140 raft_consensus.cc:3055] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:49.456252 21140 raft_consensus.cc:740] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:49.457513 21027 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:49.458866 13727 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
W20260709 12:12:49.435075 20979 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.014s	sys 0.006s
I20260709 12:12:49.393460 20806 consensus_queue.cc:1048] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 12:12:49.460309 13727 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:49.462172 13726 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:49.426203 20816 raft_consensus.cc:2749] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:49.471617 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:49.467286 13652 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:49.467249 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:49.480137 13755 raft_consensus.cc:1275] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
W20260709 12:12:49.474905 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 57038us
I20260709 12:12:49.418819 21148 consensus_queue.cc:1059] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.058s
I20260709 12:12:49.447749 21141 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:12:49.485025 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:49.464435 21043 raft_consensus.cc:3055] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:49.492218 14379 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:12:49.468621 21125 log.cc:927] Time spent T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.612s	user 0.000s	sys 0.012s
I20260709 12:12:49.449404 21052 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:49.457082 21140 consensus_queue.cc:260] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:49.469496 21136 raft_consensus.cc:2804] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:49.495857 13652 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:12:49.497907 20978 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.002s	sys 0.002s
I20260709 12:12:49.497985 21162 raft_consensus.cc:2804] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:49.499238 13800 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:49.472998 21027 raft_consensus.cc:2804] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:49.442905 21078 consensus_queue.cc:1048] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 12:12:49.471208 20963 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:12:49.519099 13762 raft_consensus.cc:1240] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:49.521374 14379 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:49.580936 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:49.459817 20876 consensus_queue.cc:1048] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.038s
I20260709 12:12:49.519923 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:49.586419 13756 raft_consensus.cc:2410] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 21 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 12:12:49.451534 20679 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:49.537698 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:49.514775 20893 consensus_meta.cc:287] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.634s	user 0.011s	sys 0.004s
I20260709 12:12:49.591923 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:49.593501 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:49.488289 21130 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:12:49.596032 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 74924.3us
I20260709 12:12:49.596175 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:49.494689 21043 raft_consensus.cc:740] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:49.485869 21084 raft_consensus.cc:2804] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 12:12:49.555186 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:49.601804 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 122591us
I20260709 12:12:49.482151 21049 consensus_queue.cc:1048] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.100s
W20260709 12:12:49.610809 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 115073us
I20260709 12:12:49.614365 13652 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:49.611431 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:12:49.529671 20978 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.003s	sys 0.002s
I20260709 12:12:49.496747 21122 raft_consensus.cc:2749] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:49.515205 21136 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:49.618535 13836 raft_consensus.cc:1275] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 12:12:49.598491 21140 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:49.516044 21052 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:49.645442 21043 consensus_queue.cc:260] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:49.623828 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:49.647063 21043 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:49.523103 21162 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:49.648453 21162 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:49.626921 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:12:49.650563 21150 log.cc:927] Time spent T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
I20260709 12:12:49.596388 20944 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:49.629647 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:49.652199 21154 log.cc:927] Time spent T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:12:49.584692 21027 raft_consensus.cc:697] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:12:49.653280 21142 log.cc:927] Time spent T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.256s	user 0.001s	sys 0.000s
I20260709 12:12:49.653429 21160 raft_consensus.cc:2749] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:49.653730 21149 raft_consensus.cc:2804] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:49.654157 21027 consensus_queue.cc:237] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:49.655122 21151 log.cc:927] Time spent T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 12:12:49.604712 21030 raft_consensus.cc:2749] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:12:49.631171 14415 raft_consensus.cc:1240] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 15 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:49.631795 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:49.587590 21014 consensus_queue.cc:1048] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 12:12:49.612262 21084 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:49.635886 13652 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:49.630838 21136 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:49.514297 21141 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:49.626225 20893 raft_consensus.cc:2749] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:49.629112 21134 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:12:49.681734 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:49.664563 21148 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.617708 21055 consensus_queue.cc:1048] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.050s
W20260709 12:12:49.733331 21172 log.cc:927] Time spent T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.103s	user 0.001s	sys 0.001s
I20260709 12:12:49.733911 21159 raft_consensus.cc:2749] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:49.735853 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:49.736594 21085 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:12:49.737711 21144 log.cc:927] Time spent T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.345s	user 0.001s	sys 0.000s
I20260709 12:12:49.722004 21122 raft_consensus.cc:2749] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:49.745397 21141 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:12:49.748811 21026 consensus_meta.cc:287] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.503s	user 0.008s	sys 0.000s
I20260709 12:12:49.668573 21149 raft_consensus.cc:697] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:12:49.750113 21155 log.cc:927] Time spent T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.281s	user 0.000s	sys 0.001s
I20260709 12:12:49.750952 21149 consensus_queue.cc:237] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:49.750910 21148 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:49.755884 21082 consensus_meta.cc:287] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.734s	user 0.009s	sys 0.002s
I20260709 12:12:49.757243 21148 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:49.626000 20806 consensus_queue.cc:1048] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 12:12:49.665310 21084 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:49.749454 21026 raft_consensus.cc:2749] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 19. Current term is 20.
W20260709 12:12:49.779229 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 297911us
I20260709 12:12:49.745467 21002 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:12:49.802510 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 166712us
W20260709 12:12:49.802907 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 173354us
I20260709 12:12:49.796271 13726 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:49.773953 20963 raft_consensus.cc:697] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:12:49.810751 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 311592us
I20260709 12:12:49.856020 13757 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 20.
W20260709 12:12:49.820291 20774 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.951s	user 0.000s	sys 0.004s
W20260709 12:12:49.840863 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 489367us
I20260709 12:12:49.850172 13727 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:49.850914 21026 consensus_queue.cc:1059] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 26.17, Next index: 18, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:12:49.851711 21124 raft_consensus.cc:2749] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:12:49.858754 20774 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.990s	user 0.004s	sys 0.007s
W20260709 12:12:49.860221 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 64102.4us
I20260709 12:12:49.862128 13800 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:49.872450 13755 raft_consensus.cc:1240] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:49.874089 13800 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:49.882736 13762 raft_consensus.cc:1240] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:49.868929 21078 raft_consensus.cc:2804] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 12:12:49.906061 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:49.911072 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:49.879874 21005 raft_consensus.cc:2749] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:12:49.884706 21002 raft_consensus.cc:2749] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:49.891399 21026 consensus_queue.cc:1048] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.037s
I20260709 12:12:49.926421 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:49.929036 13829 raft_consensus.cc:3055] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:49.928997 13727 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:49.888942 21078 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:49.882107 21182 raft_consensus.cc:2749] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:12:49.924392 21169 log.cc:927] Time spent T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.071s	user 0.000s	sys 0.008s
I20260709 12:12:49.946213 13829 raft_consensus.cc:740] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:49.964056 13800 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:49.973131 13800 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:49.967123 13833 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3f29dda715314a93a03981264972c4c3"
dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:35422
I20260709 12:12:49.976284 13833 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:49.976811 13833 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:49.909627 21082 consensus_queue.cc:1048] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 12:12:49.959909 13829 consensus_queue.cc:260] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:49.993922 13829 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:49.980769 21177 log.cc:927] Time spent T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
W20260709 12:12:49.981623 21168 log.cc:927] Time spent T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
W20260709 12:12:49.982697 21179 log.cc:927] Time spent T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 12:12:49.986409 13687 raft_consensus.cc:1275] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
W20260709 12:12:49.987864 21176 log.cc:927] Time spent T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 12:12:49.974057 20774 raft_consensus.cc:2749] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:12:49.987915 21136 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:49.949373 21078 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:50.017318 13688 raft_consensus.cc:1275] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
W20260709 12:12:50.046994 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 74271.9us
I20260709 12:12:50.105574 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:49.966771 21180 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.052754 13651 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:50.242472 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:50.243170 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:50.047654 21042 consensus_queue.cc:1048] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.172s
I20260709 12:12:50.100553 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:50.048399 13726 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:50.106954 13835 raft_consensus.cc:1275] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 14. (term mismatch)
I20260709 12:12:50.107533 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:50.252233 13828 raft_consensus.cc:2410] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 12:12:50.108153 13688 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 18.
I20260709 12:12:50.252820 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:12:50.253170 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 204905us
I20260709 12:12:50.251538 13835 pending_rounds.cc:85] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 13
W20260709 12:12:50.222923 13652 leader_election.cc:336] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 2.102s (SENT)
I20260709 12:12:50.254014 13652 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:49.917529 20806 consensus_queue.cc:1059] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.108s
I20260709 12:12:49.949625 21174 consensus_queue.cc:1048] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.113s
I20260709 12:12:50.238818 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:50.239069 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:50.239595 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:50.178725 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:50.254776 13835 pending_rounds.cc:107] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260709 12:12:49.966460 20963 consensus_queue.cc:237] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:50.247639 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 194998us
I20260709 12:12:50.256309 13835 raft_consensus.cc:2889] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:12:50.247360 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 291628us
I20260709 12:12:50.248503 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:49.999307 21130 raft_consensus.cc:2749] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:50.256927 13651 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:50.057327 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:50.255879 13681 raft_consensus.cc:2376] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 20. Re-sending same reply.
I20260709 12:12:50.262629 13682 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 15.
I20260709 12:12:50.224131 21002 raft_consensus.cc:2749] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:12:50.267519 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 240190us
I20260709 12:12:50.271281 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:50.272207 13829 raft_consensus.cc:2410] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 18 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 12:12:50.249954 13833 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:50.259502 13688 raft_consensus.cc:1275] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
W20260709 12:12:50.239909 21179 log.cc:927] Time spent T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
I20260709 12:12:50.263422 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:50.265139 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:50.279134 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:50.265475 13651 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:50.269266 13652 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:50.281364 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:50.282105 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:50.277876 13831 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 20.
I20260709 12:12:50.288594 13833 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:50.261708 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:50.299432 13835 raft_consensus.cc:3055] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:50.299953 13835 raft_consensus.cc:740] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:50.299712 13800 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:50.228190 21122 consensus_queue.cc:1048] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 12:12:50.263412 21149 raft_consensus.cc:2804] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:50.270864 21049 raft_consensus.cc:2749] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:50.226763 21180 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:50.286181 21141 raft_consensus.cc:3055] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:50.314114 13828 raft_consensus.cc:1240] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:50.333457 14415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41692 (request call id 1113) took 1786 ms. Trace:
I20260709 12:12:50.343019 14415 rpcz_store.cc:276] 0709 12:12:48.547081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:48.547253 (+   172us) service_pool.cc:224] Handling call
0709 12:12:48.547683 (+   430us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:49.658009 (+1110326us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:50.333142 (+675133us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54006df454. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:50.333358 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2491289984}
I20260709 12:12:50.330067 21025 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:50.321161 21161 raft_consensus.cc:2804] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:50.302899 21030 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.301760 21130 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.270732 21182 consensus_queue.cc:1048] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.043s
W20260709 12:12:50.321956 21189 log.cc:927] Time spent T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
W20260709 12:12:50.319921 21184 log.cc:927] Time spent T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
W20260709 12:12:50.323241 21135 log.cc:927] Time spent T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 1.232s	user 0.000s	sys 0.012s
I20260709 12:12:50.325345 21012 raft_consensus.cc:993] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f: : Instructing follower 96701a74fdee481fb5f54aac841e17dd to start an election
I20260709 12:12:50.335554 21188 raft_consensus.cc:2749] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:12:50.361928 13686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 2361) took 1093 ms. Trace:
I20260709 12:12:50.305896 20876 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:50.331602 21160 raft_consensus.cc:2804] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:50.339956 21141 raft_consensus.cc:740] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:50.373215 13686 rpcz_store.cc:276] 0709 12:12:49.268714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:49.268836 (+   122us) service_pool.cc:224] Handling call
0709 12:12:49.269187 (+   351us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:49.377038 (+107851us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:49.377084 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:49.378306 (+  1222us) log.cc:844] Serialized 52 byte log entry
0709 12:12:49.668096 (+289790us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:49.749982 (+ 81886us) log.cc:844] Serialized 14 byte log entry
0709 12:12:49.750247 (+   265us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:49.889984 (+139737us) spinlock_profiling.cc:243] Waited 98.4 ms on lock 0x7b54002454d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:49.890059 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:50.342465 (+452406us) raft_consensus.cc:1685] finished
0709 12:12:50.361640 (+ 19175us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:50.361857 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13037,"prepare.queue_time_us":81983,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":43775,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":6633,"spinlock_wait_cycles":226326912,"thread_start_us":241623,"threads_started":1,"wal-append.queue_time_us":406790}
I20260709 12:12:50.340898 13727 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:50.306217 21005 consensus_queue.cc:1048] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.055s
I20260709 12:12:50.320744 21180 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:50.355444 21161 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:50.327764 21041 raft_consensus.cc:2749] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:50.310390 21082 consensus_queue.cc:1059] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 12:12:50.358850 21025 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:50.387684 21140 consensus_meta.cc:287] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.742s	user 0.012s	sys 0.000s
I20260709 12:12:50.390865 21160 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:50.426306 13685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 1386) took 1072 ms. Trace:
W20260709 12:12:50.432402 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:50.440331 21200 raft_consensus.cc:1081] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 21 LEADER]: Signalling peer 96701a74fdee481fb5f54aac841e17dd to start an election
W20260709 12:12:50.425575 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 154628us
I20260709 12:12:50.414041 21012 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:50.450466 14380 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:50.450382 21012 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:50.451540 21200 raft_consensus.cc:2749] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:50.452893 21012 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:50.450588 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:50.453742 21141 consensus_queue.cc:260] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:50.454497 13760 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 18.
I20260709 12:12:50.455152 21141 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:50.455701 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:50.391031 20876 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:50.458822 21052 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:50.459702 20876 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:50.461826 21167 consensus_queue.cc:1059] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.107s
I20260709 12:12:50.462069 21139 raft_consensus.cc:2749] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:50.462549 21148 raft_consensus.cc:3055] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:12:50.463006 20679 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:50.463280 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 122481us
I20260709 12:12:50.457151 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:50.465396 13755 raft_consensus.cc:1240] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 12:12:50.434350 13685 rpcz_store.cc:276] 0709 12:12:49.354258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:49.361022 (+  6764us) service_pool.cc:224] Handling call
0709 12:12:49.388126 (+ 27104us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:49.388524 (+   398us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:49.388564 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:49.389127 (+   563us) log.cc:844] Serialized 26 byte log entry
0709 12:12:49.794645 (+405518us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:49.794693 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:49.794779 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:50.426081 (+631302us) raft_consensus.cc:1685] finished
0709 12:12:50.426103 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:50.426242 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":55392,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":14078,"thread_start_us":405137,"threads_started":1,"wal-append.queue_time_us":602510}
I20260709 12:12:50.365305 21130 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:50.474290 21095 raft_consensus.cc:476] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 18 LEADER]: Not starting pre-election -- already a leader
I20260709 12:12:50.463016 21148 raft_consensus.cc:740] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:50.474730 13755 raft_consensus.cc:1240] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 23. Current term is 24. Ops: [23.13-23.13]
I20260709 12:12:50.475169 13834 raft_consensus.cc:2368] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 19. Current term is 20.
I20260709 12:12:50.475011 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:12:50.476904 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:50.497572 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:12:50.480229 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 177866us
I20260709 12:12:50.420761 21161 raft_consensus.cc:3060] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:50.367470 21030 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:50.506873 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 241459us
I20260709 12:12:50.500023 13755 raft_consensus.cc:1240] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 12:12:50.467034 21160 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:50.509220 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: true dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:50.512279 14410 raft_consensus.cc:3055] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:50.506050 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:50.512647 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:50.512985 13828 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e"
dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:35422
I20260709 12:12:50.513115 13831 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 18.
I20260709 12:12:50.513504 13828 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:50.513993 13828 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:50.515139 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:50.507723 13651 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:50.512681 14410 raft_consensus.cc:740] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:50.518718 13837 raft_consensus.cc:1275] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
W20260709 12:12:50.519757 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 250548us
I20260709 12:12:50.453655 21078 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:50.525833 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:50.505064 21136 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:50.501076 21167 consensus_queue.cc:1243] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer b98d2519bb504dc6905ed2ede4571835 log is divergent from this leader: its last log entry 21.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:12:50.526036 21041 raft_consensus.cc:2804] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:50.523406 13833 raft_consensus.cc:1275] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
W20260709 12:12:50.521016 21162 consensus_meta.cc:287] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.872s	user 0.010s	sys 0.002s
I20260709 12:12:50.521457 13652 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:50.530354 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:50.549811 13837 raft_consensus.cc:2393] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 18: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:50.529718 13651 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:50.533092 13801 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:50.509718 21095 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.538228 14410 consensus_queue.cc:260] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:50.553972 14410 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:50.529280 21039 consensus_meta.cc:287] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 1.091s	user 0.014s	sys 0.000s
I20260709 12:12:50.549628 13828 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:50.559002 13832 raft_consensus.cc:3060] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:50.561215 13651 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
W20260709 12:12:50.561841 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 61355.5us
W20260709 12:12:50.548151 21043 consensus_meta.cc:287] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.900s	user 0.016s	sys 0.000s
I20260709 12:12:50.575479 13755 raft_consensus.cc:1240] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:50.576924 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:50.578137 13651 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:50.598198 13832 raft_consensus.cc:1275] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 14. (term mismatch)
I20260709 12:12:50.598826 13832 pending_rounds.cc:85] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 13
I20260709 12:12:50.547950 21041 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:50.540222 21149 raft_consensus.cc:697] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:50.600642 13832 pending_rounds.cc:107] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 24.14
W20260709 12:12:50.668865 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 147484us
I20260709 12:12:50.670593 13652 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:50.672616 13832 raft_consensus.cc:2889] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:50.604171 13755 raft_consensus.cc:1240] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:50.578286 13833 raft_consensus.cc:1275] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:12:50.675103 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: true dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:50.676596 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:50.710031 13760 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:50.710515 13837 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 19.
I20260709 12:12:50.561100 21130 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:50.706765 13832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 3576) took 1349 ms. Trace:
W20260709 12:12:50.604180 21187 log.cc:927] Time spent T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.355s	user 0.000s	sys 0.001s
I20260709 12:12:50.594530 21188 raft_consensus.cc:2804] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:50.677688 13828 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:50.714998 13832 rpcz_store.cc:276] 0709 12:12:49.324184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:49.325566 (+  1382us) service_pool.cc:224] Handling call
0709 12:12:49.325856 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:50.540543 (+1214687us) spinlock_profiling.cc:243] Waited 88.1 ms on lock 0x7b54002e8720. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f02a1d 00007fa927ee91a4 00007fa927f6b447 00007fa927f83fe7 00007fa927f857de 00007fa927f8fb49 00007fa927f90416 00007fa927f8cd8f 00007fa927f8c83e 00007fa92cf51419
0709 12:12:50.673622 (+133079us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:50.673862 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":202670976}
I20260709 12:12:50.595363 21167 raft_consensus.cc:2749] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:50.555199 21162 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:50.598502 21042 raft_consensus.cc:2804] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:12:50.576014 21202 raft_consensus.cc:2749] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:50.602888 21041 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:50.603395 21049 raft_consensus.cc:2749] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:50.743106 21202 raft_consensus.cc:2749] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:50.556681 21095 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:50.741940 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 132755us
W20260709 12:12:50.749929 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:50.755807 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:50.751423 21147 log.cc:927] Time spent T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 1.316s	user 0.000s	sys 0.005s
I20260709 12:12:50.751513 21030 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:50.756347 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:50.554191 21148 consensus_queue.cc:260] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 17, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:50.777268 13837 raft_consensus.cc:1275] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:12:50.778334 21095 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:12:50.781961 21193 log.cc:927] Time spent T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.312s	user 0.000s	sys 0.001s
I20260709 12:12:50.783694 21207 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.734787 21188 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:50.802781 13828 raft_consensus.cc:1240] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:50.784435 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:50.804193 13832 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 20.
I20260709 12:12:50.804342 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:50.787420 13800 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:12:50.800381 21185 log.cc:927] Time spent T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.372s	user 0.000s	sys 0.001s
I20260709 12:12:50.817869 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:50.818464 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:50.819222 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:50.820039 13687 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 24.
I20260709 12:12:50.821051 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:50.806648 21207 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:50.795145 13830 raft_consensus.cc:1240] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 12:12:50.731282 21043 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:50.803509 13686 raft_consensus.cc:1240] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:50.806352 13800 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:50.812800 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:50.813663 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: true dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:50.847059 13683 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:50.603612 21122 consensus_queue.cc:1059] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.136s
I20260709 12:12:50.806828 21188 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:50.817445 21049 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:50.822819 13687 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 19.
I20260709 12:12:50.819283 13685 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 18.
I20260709 12:12:50.852442 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:50.825723 21025 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:50.754428 20806 raft_consensus.cc:2749] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:50.830307 13761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 1193) took 1384 ms. Trace:
I20260709 12:12:50.872219 13761 rpcz_store.cc:276] 0709 12:12:49.445533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:49.446290 (+   757us) service_pool.cc:224] Handling call
0709 12:12:49.458499 (+ 12209us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:49.458849 (+   350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:49.458877 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:49.459306 (+   429us) log.cc:844] Serialized 26 byte log entry
0709 12:12:49.823610 (+364304us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:49.823681 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:49.823832 (+   151us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:50.830019 (+1006187us) raft_consensus.cc:1685] finished
0709 12:12:50.830044 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:50.830226 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13607,"raft.queue_time_us":4905,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":2853,"thread_start_us":363811,"threads_started":1,"wal-append.queue_time_us":907416}
I20260709 12:12:50.568013 21039 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:50.841034 13760 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 22.
I20260709 12:12:50.885473 14410 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 17.
I20260709 12:12:50.853312 13832 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:50.785369 21042 raft_consensus.cc:697] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 24 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:50.860777 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:50.863575 13682 raft_consensus.cc:1240] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 21. Current term is 22. Ops: []
W20260709 12:12:50.868896 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 198362us
I20260709 12:12:50.828279 21095 raft_consensus.cc:2749] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:50.852564 20774 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:50.851545 21002 raft_consensus.cc:2804] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:50.901875 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:50.902601 13687 raft_consensus.cc:1275] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:12:50.904225 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:50.909660 13685 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:50.906128 13652 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:50.914757 13652 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:50.917106 13681 raft_consensus.cc:1275] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:12:50.928404 13832 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 16.
I20260709 12:12:50.932993 13683 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 17.
I20260709 12:12:50.933949 13652 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:50.895454 21136 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:50.861279 21140 consensus_queue.cc:1059] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 12:12:50.875057 21082 consensus_queue.cc:1059] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 12:12:50.948863 13685 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 16.
W20260709 12:12:50.936033 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 79388.6us
I20260709 12:12:50.899284 21049 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:50.854491 21043 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:50.907161 21002 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:50.942701 13727 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:50.935583 13686 raft_consensus.cc:1275] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:12:50.919715 21202 raft_consensus.cc:2749] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:50.952647 13832 raft_consensus.cc:1240] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:50.919096 21122 consensus_queue.cc:1048] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.035s
I20260709 12:12:50.959096 13727 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:50.931872 21203 raft_consensus.cc:2749] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:50.914279 20774 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:50.998397 20774 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:50.960382 20963 raft_consensus.cc:2749] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:12:51.002483 20893 consensus_queue.cc:1059] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 20.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:50.978418 21042 consensus_queue.cc:237] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:51.011880 21161 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:51.013765 21049 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:51.014966 13727 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:51.015637 21026 consensus_queue.cc:1048] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:51.017405 21188 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:50.948985 21136 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:51.024397 21136 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:51.025048 13683 raft_consensus.cc:1275] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:12:50.948900 21140 consensus_queue.cc:1243] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer 3f37c9cc9dda46b4be21dd675ba78fb7 log is divergent from this leader: its last log entry 20.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:12:50.862051 21149 consensus_queue.cc:237] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:50.975361 21167 consensus_queue.cc:1059] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 12:12:51.026257 21167 consensus_queue.cc:1243] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer 3f37c9cc9dda46b4be21dd675ba78fb7 log is divergent from this leader: its last log entry 22.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:12:51.026856 21026 raft_consensus.cc:2804] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:51.026932 21167 raft_consensus.cc:3055] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:51.027521 21167 raft_consensus.cc:740] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:50.983155 21025 raft_consensus.cc:2804] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:50.930189 21210 consensus_queue.cc:1059] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.089s
I20260709 12:12:50.976258 21095 consensus_queue.cc:1059] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 12:12:51.027451 21026 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:50.987794 21202 consensus_queue.cc:1059] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:12:50.991856 21141 consensus_meta.cc:287] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.536s	user 0.011s	sys 0.000s
I20260709 12:12:50.993793 21043 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:12:50.994462 21212 log.cc:927] Time spent T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:12:50.995970 21039 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:50.961633 21082 consensus_queue.cc:1059] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.066s
I20260709 12:12:51.039901 21227 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:51.074009 21161 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:50.983613 21213 consensus_queue.cc:1048] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:50.958989 21002 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:51.079448 13835 consensus_queue.cc:260] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:51.075376 21188 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:51.081086 13835 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:50.987071 21162 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:51.039157 21222 raft_consensus.cc:2749] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:51.039987 21095 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:51.061643 13727 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
W20260709 12:12:50.987201 21084 consensus_meta.cc:287] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 1.211s	user 0.013s	sys 0.001s
I20260709 12:12:51.037593 21025 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:51.069571 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:51.073587 21227 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:51.026126 21196 consensus_queue.cc:1048] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:51.046062 21210 consensus_queue.cc:1243] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer 3f37c9cc9dda46b4be21dd675ba78fb7 log is divergent from this leader: its last log entry 19.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 12:12:51.086755 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 150268us
I20260709 12:12:51.087685 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:51.038661 21140 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:51.113611 21140 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:51.052021 21026 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:51.103113 13652 leader_election.cc:336] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 2.102s (SENT)
I20260709 12:12:51.107604 21227 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:51.041252 21181 consensus_queue.cc:1059] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.052s
I20260709 12:12:51.090175 21025 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:51.093641 21213 raft_consensus.cc:2804] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:51.122100 20816 raft_consensus.cc:3055] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:51.122666 20816 raft_consensus.cc:740] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:51.090579 21084 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:51.089293 21095 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:51.028667 21167 consensus_queue.cc:260] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:51.130681 21167 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:51.039259 21136 consensus_queue.cc:1048] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.054s
I20260709 12:12:51.049469 21041 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:51.134971 21041 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:12:51.115510 21160 consensus_meta.cc:287] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.574s	user 0.011s	sys 0.000s
I20260709 12:12:51.125555 21084 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:51.136075 21160 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:51.136761 21181 consensus_queue.cc:1059] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:51.138170 21196 raft_consensus.cc:3055] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:51.138572 21196 raft_consensus.cc:740] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:51.138628 21140 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:51.139350 21160 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:51.139714 13680 raft_consensus.cc:1275] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:12:51.139796 21095 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:51.140018 21160 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.139508 21196 consensus_queue.cc:260] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:51.140581 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 56347.4us
I20260709 12:12:51.140901 13683 raft_consensus.cc:2393] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 21: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:51.142050 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:51.068917 13686 raft_consensus.cc:1240] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:51.153128 13835 raft_consensus.cc:1275] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 12. (term mismatch)
I20260709 12:12:51.165336 13835 pending_rounds.cc:85] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 11
I20260709 12:12:51.165609 13835 pending_rounds.cc:107] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 20.12
I20260709 12:12:51.167238 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:51.167033 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:51.168007 13681 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:51.167520 13835 raft_consensus.cc:2889] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:51.177093 13686 raft_consensus.cc:1275] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
W20260709 12:12:51.182899 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 211255us
I20260709 12:12:51.183833 13800 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:51.190984 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:51.139384 21213 raft_consensus.cc:697] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:51.194010 21122 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.177259 21041 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.151108 21160 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:51.193656 21186 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 21 current term: 21 is higher.
W20260709 12:12:51.204234 13800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:51.218240 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:51.193104 21196 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:51.218797 13800 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:51.220530 13800 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:51.222457 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:51.223119 13834 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:51.223836 13800 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:51.206727 21041 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:51.203377 21095 raft_consensus.cc:2804] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:51.203955 21136 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
W20260709 12:12:51.238039 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:51.248306 13834 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 21.
I20260709 12:12:51.211663 21227 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:51.235965 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:51.209523 21160 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:51.236713 21174 consensus_queue.cc:1048] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:51.259913 13681 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 22.
I20260709 12:12:51.215301 21039 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.231546 13726 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:51.212174 21197 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:51.217607 21140 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:51.223443 21005 raft_consensus.cc:2749] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:51.268253 13726 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:51.206125 21122 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:51.220815 21146 consensus_queue.cc:1048] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 12:12:51.257689 21231 raft_consensus.cc:2749] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:51.260617 21210 raft_consensus.cc:2804] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:12:51.229346 21025 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:51.341862 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:51.342247 13679 raft_consensus.cc:1240] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 24 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 23. Current term is 24. Ops: [23.13-23.13]
I20260709 12:12:51.282176 20774 raft_consensus.cc:2804] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:51.276012 21095 raft_consensus.cc:697] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 22 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
W20260709 12:12:51.333101 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 74949.5us
I20260709 12:12:51.232661 21229 consensus_queue.cc:1048] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.074s
I20260709 12:12:51.260572 21227 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:51.254076 21136 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:51.334512 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 132781us
I20260709 12:12:51.272663 21039 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:51.302011 21210 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:51.286098 20944 consensus_queue.cc:1048] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.082s
I20260709 12:12:51.313467 21005 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.286056 21041 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:51.365651 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:51.366302 20774 raft_consensus.cc:697] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:51.284214 21214 raft_consensus.cc:2749] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:12:51.363734 13800 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:51.281814 21140 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:51.373293 14379 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:51.301710 21047 consensus_queue.cc:1048] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 12:12:51.277535 21197 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:51.309755 21082 consensus_queue.cc:1059] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 12:12:51.383625 13680 raft_consensus.cc:1240] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:51.384415 13800 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:51.312230 21209 consensus_queue.cc:1048] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.076s
I20260709 12:12:51.281101 21213 consensus_queue.cc:237] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:51.374420 21210 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:51.388391 20992 raft_consensus.cc:3055] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:51.397960 20992 raft_consensus.cc:740] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:51.399313 21122 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:51.399072 20992 consensus_queue.cc:260] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:51.400586 20992 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:51.402122 13758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 1187) took 2035 ms. Trace:
I20260709 12:12:51.402567 13758 rpcz_store.cc:276] 0709 12:12:49.366413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:49.367538 (+  1125us) service_pool.cc:224] Handling call
0709 12:12:49.386704 (+ 19166us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:49.415418 (+ 28714us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:49.415449 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:50.576453 (+1161004us) spinlock_profiling.cc:243] Waited 1.11 ms on lock 0x7b18003799c0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e6e2a6 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa926886a11 00007fa926896372 00007fa927fc8a01 00007fa927f8d43a
0709 12:12:50.783441 (+206988us) spinlock_profiling.cc:243] Waited 6.3 ms on lock 0x7b2c00010828. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa926886a11 00007fa926896372 00007fa927fc8a01 00007fa927f8d43a 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2
0709 12:12:50.784019 (+   578us) log.cc:844] Serialized 26 byte log entry
0709 12:12:51.178484 (+394465us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:51.178545 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:51.178656 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:51.401862 (+223206us) raft_consensus.cc:1685] finished
0709 12:12:51.401887 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:51.402053 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34291,"raft.queue_time_us":31830,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":11732,"spinlock_wait_cycles":17035776,"thread_start_us":393860,"threads_started":1,"wal-append.queue_time_us":490779}
I20260709 12:12:51.382627 21005 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:51.407333 21005 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:51.385380 21231 raft_consensus.cc:3055] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:51.410146 21231 raft_consensus.cc:740] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:51.410976 21095 consensus_queue.cc:237] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:51.388340 21130 raft_consensus.cc:2804] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:12:51.416944 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 136078us
I20260709 12:12:51.374240 21124 consensus_queue.cc:1048] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 12:12:51.425936 13726 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:51.421871 13800 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:51.428224 21246 raft_consensus.cc:2804] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:51.428849 21246 raft_consensus.cc:697] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 17 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:51.429879 21246 consensus_queue.cc:237] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:51.431234 21124 raft_consensus.cc:2749] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:51.435513 21207 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:12:51.438292 21194 log.cc:927] Time spent T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 1.134s	user 0.004s	sys 0.003s
I20260709 12:12:51.454195 13759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 1200) took 1699 ms. Trace:
I20260709 12:12:51.438892 20944 raft_consensus.cc:2749] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:51.439280 21162 raft_consensus.cc:3055] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:12:51.421451 21130 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:51.441649 21209 consensus_queue.cc:1048] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:51.443492 21170 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.443642 21025 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:51.446381 21141 raft_consensus.cc:3055] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:51.411350 21231 consensus_queue.cc:260] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.9, Last appended by leader: 9, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:51.454636 13759 rpcz_store.cc:276] 0709 12:12:49.754806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:49.851901 (+ 97095us) service_pool.cc:224] Handling call
0709 12:12:49.852319 (+   418us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:49.852798 (+   479us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:49.852838 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:49.853431 (+   593us) log.cc:844] Serialized 26 byte log entry
0709 12:12:49.955978 (+102547us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:49.956021 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:49.956095 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:51.437607 (+1481512us) spinlock_profiling.cc:243] Waited 5.44 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:12:51.453879 (+ 16272us) raft_consensus.cc:1685] finished
0709 12:12:51.453902 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:51.454123 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":801,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":14795,"spinlock_wait_cycles":12509056,"thread_start_us":86699,"threads_started":1,"wal-append.queue_time_us":382333}
I20260709 12:12:51.405153 21026 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:51.491974 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:51.497402 13836 raft_consensus.cc:1240] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:51.424525 21082 raft_consensus.cc:2749] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:51.452039 21186 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.513039 21186 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:51.515373 21186 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:51.503896 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:51.505293 13829 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 25.
W20260709 12:12:51.497197 21235 log.cc:927] Time spent T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:12:51.507550 21039 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:51.488811 21162 raft_consensus.cc:740] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:51.489075 21229 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:51.550899 21229 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:51.551108 21162 consensus_queue.cc:260] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:51.552407 21162 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:51.553103 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:51.510946 21026 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:51.511125 21197 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:51.486620 21140 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:51.522095 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:51.516156 21002 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:51.553442 21229 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:51.521096 21136 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:51.504900 20774 consensus_queue.cc:237] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:51.560299 13829 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 21.
I20260709 12:12:51.498332 21130 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:51.505087 21170 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:51.543236 21219 log.cc:927] Time spent T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.533s	user 0.001s	sys 0.002s
W20260709 12:12:51.547619 13757 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38932 (request call id 1188) took 2153 ms (client timeout 2034 ms). Trace:
W20260709 12:12:51.565907 13757 rpcz_store.cc:269] 0709 12:12:49.393812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:49.394086 (+   274us) service_pool.cc:224] Handling call
0709 12:12:51.547192 (+2153106us) spinlock_profiling.cc:243] Waited 338 ms on lock 0x7b540032e454. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:51.547496 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":777993600}
I20260709 12:12:51.548481 13754 raft_consensus.cc:1275] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:12:51.566946 21170 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:51.551265 21025 consensus_queue.cc:1048] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:51.505801 21141 raft_consensus.cc:740] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:51.567539 13831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 3591) took 1042 ms. Trace:
I20260709 12:12:51.516212 13837 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 20.
I20260709 12:12:51.568305 21141 consensus_queue.cc:260] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:51.570864 21002 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:51.497560 21167 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:51.572590 21167 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:51.568105 13831 rpcz_store.cc:276] 0709 12:12:50.525508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:50.526930 (+  1422us) service_pool.cc:224] Handling call
0709 12:12:50.529464 (+  2534us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:50.546605 (+ 17141us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:50.546656 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:50.558929 (+ 12273us) log.cc:844] Serialized 52 byte log entry
0709 12:12:50.850165 (+291236us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:50.850246 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:50.850670 (+   424us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:51.542404 (+691734us) spinlock_profiling.cc:243] Waited 18.3 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:12:51.567139 (+ 24735us) raft_consensus.cc:1685] finished
0709 12:12:51.567171 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:51.567462 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7892,"raft.queue_time_us":7047,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":5712,"spinlock_wait_cycles":42033920,"thread_start_us":173262,"threads_started":1,"wal-append.queue_time_us":333888}
I20260709 12:12:51.554507 13763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 1191) took 2109 ms. Trace:
I20260709 12:12:51.588287 13763 rpcz_store.cc:276] 0709 12:12:49.444938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:49.461251 (+ 16313us) service_pool.cc:224] Handling call
0709 12:12:49.461565 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:49.648007 (+186442us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:49.648039 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:49.648084 (+    45us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:12:49.648116 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:51.554255 (+1906139us) spinlock_profiling.cc:243] Waited 186 ms on lock 0x7b540032ee54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:51.554299 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:51.554417 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":428320128}
I20260709 12:12:51.591777 13835 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 22.
I20260709 12:12:51.555779 13830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 3244) took 1289 ms. Trace:
I20260709 12:12:51.593291 13830 rpcz_store.cc:276] 0709 12:12:50.266088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:50.304239 (+ 38151us) service_pool.cc:224] Handling call
0709 12:12:50.304716 (+   477us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:50.842089 (+537373us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:51.555529 (+713440us) spinlock_profiling.cc:243] Waited 490 ms on lock 0x7b5400363654. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:51.555706 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1127343872}
W20260709 12:12:51.597381 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 44735.7us
I20260709 12:12:51.600929 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:51.601907 13835 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 20.
W20260709 12:12:51.603679 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:51.597714 21170 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.541594 20816 consensus_queue.cc:260] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:51.606402 21141 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:51.625430 21236 log.cc:927] Time spent T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.250s	user 0.003s	sys 0.000s
I20260709 12:12:51.606734 21167 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:51.627954 21251 consensus_queue.cc:1048] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 12:12:51.628320 21170 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:51.632509 21025 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.661268 13759 raft_consensus.cc:1240] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:51.634181 21227 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:51.634214 20816 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:51.639031 21178 raft_consensus.cc:3055] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:51.607503 21180 consensus_queue.cc:1048] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 12:12:51.644263 21210 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:51.648303 13652 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:51.659982 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:12:51.662894 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 289681us
I20260709 12:12:51.664775 13759 raft_consensus.cc:1240] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:51.682472 13755 raft_consensus.cc:1240] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 12:12:51.683135 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:51.658850 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:51.684398 13763 raft_consensus.cc:2393] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 22: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:51.669168 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:51.682204 13652 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:51.685858 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:51.674378 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:51.675441 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:51.679389 13757 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 19.
I20260709 12:12:51.686463 13760 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:51.667176 20963 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.686093 13652 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:51.670576 21214 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:51.697304 13761 raft_consensus.cc:1240] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 23. Current term is 24. Ops: [23.13-23.13]
I20260709 12:12:51.700606 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:51.672483 21178 raft_consensus.cc:740] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:51.704357 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:51.703120 13652 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:51.705042 13757 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 25.
I20260709 12:12:51.685276 21039 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:12:51.714394 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:51.669683 21025 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:51.733929 21188 consensus_queue.cc:1059] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:51.734566 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:51.734825 21188 raft_consensus.cc:3055] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:51.735288 21188 raft_consensus.cc:740] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:51.736229 21188 consensus_queue.cc:260] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:51.693974 21229 raft_consensus.cc:2804] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:51.719339 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:51.721004 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:12:51.738426 14379 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.56.194:39545 timed out after 2.034s (SENT) [suppressed 19 similar messages]
I20260709 12:12:51.722486 13652 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:51.726570 21043 raft_consensus.cc:2804] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:51.730973 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:51.738633 13758 raft_consensus.cc:3060] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:51.731766 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:51.731416 21178 consensus_queue.cc:260] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:51.732568 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:51.732941 21130 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:51.730247 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:51.743230 13760 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 19.
I20260709 12:12:51.698663 21023 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.730391 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:51.740968 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:51.742940 14414 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:51.745150 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:51.707047 21122 raft_consensus.cc:2804] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:51.719540 21039 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:51.751123 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:51.752974 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:51.739751 21229 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:51.701891 20963 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:51.759506 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:51.754189 21178 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:51.748673 21188 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:51.743950 21161 raft_consensus.cc:2804] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:51.748956 21122 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:51.741830 21043 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:51.777043 13758 raft_consensus.cc:2468] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 17.
W20260709 12:12:51.768920 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:51.777503 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:51.754021 21039 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:12:51.767951 21229 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:51.782728 13688 raft_consensus.cc:1240] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:51.785234 13686 raft_consensus.cc:1240] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:51.790542 20806 raft_consensus.cc:3055] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:51.790997 20806 raft_consensus.cc:740] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:51.791077 20963 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:51.785331 21043 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:51.791929 20806 consensus_queue.cc:260] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:51.792955 20806 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:51.794454 13685 raft_consensus.cc:1240] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:51.797631 14414 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 21.
I20260709 12:12:51.770062 21160 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.780368 21122 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:12:51.805919 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 67525.4us
I20260709 12:12:51.773291 21161 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:51.785504 21203 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.718551 21214 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:51.799013 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:51.808924 13834 raft_consensus.cc:1275] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 13. (term mismatch)
I20260709 12:12:51.810804 13834 pending_rounds.cc:85] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 12
I20260709 12:12:51.811177 13834 pending_rounds.cc:107] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 23.13
I20260709 12:12:51.811519 13834 raft_consensus.cc:2889] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:51.754128 21023 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:51.819382 13762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 3353) took 1831 ms. Trace:
I20260709 12:12:51.820009 13762 rpcz_store.cc:276] 0709 12:12:49.987611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:50.464470 (+476859us) service_pool.cc:224] Handling call
0709 12:12:50.464769 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:50.499307 (+ 34538us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:50.499336 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:50.499383 (+    47us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:50.499417 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:51.819072 (+1319655us) spinlock_profiling.cc:243] Waited 34.3 ms on lock 0x7b54000884d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:51.819131 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:51.819300 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":78854016}
I20260709 12:12:51.831918 13757 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:51.836961 13652 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:51.806080 21141 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.815994 21161 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:51.845758 21023 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:12:51.848816 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:51.858310 13757 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 21.
I20260709 12:12:51.861225 13652 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:51.867535 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:51.842908 21042 raft_consensus.cc:2749] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:51.808116 21160 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:51.884624 21214 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:51.859838 21201 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:51.886255 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:51.887071 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:51.818651 21203 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:51.895151 21055 consensus_queue.cc:1059] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:51.896216 21055 raft_consensus.cc:3055] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:51.896632 21055 raft_consensus.cc:740] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
W20260709 12:12:51.899458 21257 log.cc:927] Time spent T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
W20260709 12:12:51.906046 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 44902.5us
I20260709 12:12:51.855018 21141 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:51.920739 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:51.919085 13758 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 18.
I20260709 12:12:51.921440 13759 raft_consensus.cc:2376] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 20. Re-sending same reply.
I20260709 12:12:51.880360 20992 raft_consensus.cc:2804] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:51.921456 13762 raft_consensus.cc:1240] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:51.923856 13755 raft_consensus.cc:1240] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:51.926299 14379 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:51.925391 20816 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.933851 20816 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:51.936612 20816 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:51.908414 21201 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:51.932615 21015 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:51.930138 20992 raft_consensus.cc:697] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 21 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:51.893363 21124 consensus_queue.cc:1059] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 12:12:51.912196 21123 consensus_queue.cc:1059] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.025s
I20260709 12:12:51.897545 21055 consensus_queue.cc:260] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:51.933323 21130 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:51.995019 21203 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:51.998981 13754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 1196) took 2546 ms. Trace:
I20260709 12:12:51.998646 20992 consensus_queue.cc:237] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:51.999521 13754 rpcz_store.cc:276] 0709 12:12:49.452638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:49.452799 (+   161us) service_pool.cc:224] Handling call
0709 12:12:51.548084 (+2095285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:51.567186 (+ 19102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:51.998683 (+431497us) spinlock_profiling.cc:243] Waited 2.09 s on lock 0x7b540032e450. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:51.998893 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4817889536}
I20260709 12:12:52.002271 13726 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:52.003091 21201 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:52.003276 20679 raft_consensus.cc:2804] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 12:12:52.003830 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:52.004043 20679 raft_consensus.cc:697] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:52.004647 21160 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:52.006114 21141 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:52.006978 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:52.007529 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:52.008981 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:52.007643 13759 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 21.
I20260709 12:12:52.011135 13754 raft_consensus.cc:1240] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:52.005081 20679 consensus_queue.cc:237] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:52.021908 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:52.024791 21025 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:52.026383 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 97780.3us
W20260709 12:12:52.043465 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:52.045151 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:52.048112 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:52.051741 13830 raft_consensus.cc:1240] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 22 LEADER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:52.052085 21124 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:52.052654 21124 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:52.053073 21203 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:52.052984 21161 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:52.054783 21043 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:52.059194 21210 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:52.049767 21160 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:52.061528 13800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:52.047385 21254 consensus_queue.cc:1059] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.018s
W20260709 12:12:52.050077 21265 log.cc:927] Time spent T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
W20260709 12:12:52.078251 13800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:52.053725 21203 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:52.086086 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:52.088217 21043 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:52.095811 13679 raft_consensus.cc:1240] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:52.088956 21231 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:52.093482 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:52.105329 13681 raft_consensus.cc:1240] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 20. Current term is 21. Ops: []
W20260709 12:12:52.105836 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:52.106256 13836 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 21.
I20260709 12:12:52.112697 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:52.117162 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:52.118297 13679 raft_consensus.cc:2368] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 22. Current term is 23.
I20260709 12:12:52.120533 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:52.121299 13683 raft_consensus.cc:2393] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 17: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:52.121418 13800 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:52.096210 21267 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.124435 13800 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:52.095933 21130 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:52.098860 21202 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:52.127414 13800 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:52.099218 21041 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:52.132665 13800 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:52.090251 21160 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:52.133952 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:52.156194 13683 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:52.155054 21214 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:52.159811 21214 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:52.091099 21039 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:52.139496 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:52.168013 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:52.168681 13830 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:52.128211 21141 raft_consensus.cc:2804] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:52.128448 21178 raft_consensus.cc:2749] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:12:52.170210 13683 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 19.
I20260709 12:12:52.133463 21005 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:12:52.180431 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:52.182001 13688 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 22.
I20260709 12:12:52.164065 21162 raft_consensus.cc:2804] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:52.183303 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:52.129117 21267 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:52.133580 21130 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:52.175490 21141 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:52.136404 21041 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:52.194047 21162 raft_consensus.cc:697] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 19 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:52.137050 21202 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:52.215726 21202 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:52.194686 21124 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:52.166301 21122 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:52.195639 21267 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:52.196939 21214 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:52.227226 21170 leader_election.cc:290] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:52.232827 13831 raft_consensus.cc:1275] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 10. (term mismatch)
I20260709 12:12:52.233330 13831 pending_rounds.cc:85] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 9
I20260709 12:12:52.233568 13831 pending_rounds.cc:107] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 19.10
I20260709 12:12:52.233841 13831 raft_consensus.cc:2889] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:52.234133 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:52.234999 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:52.235733 13831 raft_consensus.cc:2393] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 22: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:52.198004 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:52.200210 21130 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:52.201129 21203 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:52.179054 21005 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:52.204598 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:52.182999 21043 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.209126 21014 raft_consensus.cc:3055] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:52.205369 21141 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:52.212203 21041 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:52.220518 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:52.241309 13684 raft_consensus.cc:2393] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 18: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:52.244197 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:52.248564 13833 raft_consensus.cc:1275] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 10. (term mismatch)
I20260709 12:12:52.249985 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:12:52.252821 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:52.239244 21078 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:52.213421 21162 consensus_queue.cc:237] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:52.269002 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:52.272131 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:52.260751 13833 pending_rounds.cc:85] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 9
I20260709 12:12:52.261916 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:52.261574 13651 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:52.296193 13833 pending_rounds.cc:107] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 18.10
I20260709 12:12:52.261118 13830 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 23.
I20260709 12:12:52.296646 13833 raft_consensus.cc:2889] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:52.297266 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:52.297741 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:52.260120 21043 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:52.258597 13835 raft_consensus.cc:2410] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 21 because replica has last-logged OpId of term: 19 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 9.
I20260709 12:12:52.247545 21178 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:52.298669 13830 raft_consensus.cc:2393] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 19: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:52.299100 13651 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:52.288841 21229 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:52.306766 13651 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:52.312588 13836 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 22.
I20260709 12:12:52.301465 13832 raft_consensus.cc:2368] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 22. Current term is 23.
I20260709 12:12:52.253433 21005 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:12:52.328313 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:52.329867 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:52.333117 13835 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:52.333633 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:52.334446 14416 raft_consensus.cc:2393] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 21: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:52.336175 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:52.284409 21268 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.338315 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:52.338183 21268 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:52.302563 21267 raft_consensus.cc:2749] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:52.331413 13651 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:52.340411 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:52.254333 21014 raft_consensus.cc:740] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:52.290997 21123 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:52.344657 13830 raft_consensus.cc:1240] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 12:12:52.305455 20893 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:52.352083 13835 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 19.
I20260709 12:12:52.303834 21130 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:52.355489 13651 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:52.355643 13835 raft_consensus.cc:1275] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 12:12:52.358050 13830 raft_consensus.cc:1240] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 24. Current term is 25. Ops: [24.15-24.15]
I20260709 12:12:52.305387 21161 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:12:52.345567 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 296073us
I20260709 12:12:52.565045 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:52.566715 13681 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 19.
I20260709 12:12:52.535053 21161 raft_consensus.cc:2749] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:52.357321 21123 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:52.328823 21042 raft_consensus.cc:2749] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:52.541965 21160 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:52.356621 21267 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 12:12:52.506935 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 132177us
I20260709 12:12:52.330371 21178 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:52.343551 21170 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:52.329463 21188 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
W20260709 12:12:52.540867 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 180183us
W20260709 12:12:52.538681 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:52.507296 13835 raft_consensus.cc:1275] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 12. (term mismatch)
I20260709 12:12:52.601670 13835 pending_rounds.cc:85] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 11
I20260709 12:12:52.602342 13835 pending_rounds.cc:107] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 21.12
I20260709 12:12:52.602682 13835 raft_consensus.cc:2889] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:52.604183 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:52.605024 13835 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 24.
I20260709 12:12:52.606848 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:52.608167 13835 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:52.573524 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:52.430950 20893 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:52.391182 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:52.389551 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:12:52.581966 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:52.589541 13727 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:52.560811 21015 raft_consensus.cc:3055] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:52.702160 21015 raft_consensus.cc:740] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:52.703543 21015 consensus_queue.cc:260] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:52.705003 21015 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:52.599334 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 46515.9us
I20260709 12:12:52.612651 13833 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 19.
W20260709 12:12:52.595861 20992 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.029s	sys 0.034s
I20260709 12:12:52.623944 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:52.625571 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:52.717159 13758 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 19.
I20260709 12:12:52.627244 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:52.629796 13762 raft_consensus.cc:1275] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:12:52.620744 13679 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 16.
I20260709 12:12:52.601291 21041 raft_consensus.cc:2804] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:52.664055 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:52.669097 20870 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.670403 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:52.615476 21161 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.672367 13835 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 21.
I20260709 12:12:52.600584 21160 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:52.561501 21130 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:52.621989 21267 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:52.679205 21043 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:52.679687 13683 raft_consensus.cc:1240] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 21. Current term is 22. Ops: [19.10-21.11]
I20260709 12:12:52.629181 21214 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:52.680572 21122 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:52.680967 21178 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:52.556916 21014 consensus_queue.cc:260] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:52.687691 21273 log.cc:927] Time spent T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
I20260709 12:12:52.624568 21170 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:52.729513 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:52.623490 21188 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:52.743700 20870 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:52.715732 20992 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.030s	sys 0.035s
I20260709 12:12:52.749475 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:52.827119 13835 raft_consensus.cc:2393] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 21: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:52.698060 21268 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:52.752039 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:12:52.752503 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 121264us
I20260709 12:12:52.745195 21130 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:52.746021 21041 raft_consensus.cc:697] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 17 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:52.722872 21229 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:52.781025 13688 raft_consensus.cc:1240] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 25. Current term is 26. Ops: []
I20260709 12:12:52.734762 21136 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.748430 21078 raft_consensus.cc:2749] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:52.860944 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:12:52.819394 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 50325.9us
W20260709 12:12:52.825461 13834 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.005s	sys 0.039s
I20260709 12:12:52.753091 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:12:52.817786 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 71024.1us
I20260709 12:12:52.862277 13652 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:12:52.862287 13834 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.006s	sys 0.039s
I20260709 12:12:52.860944 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:52.863549 14379 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
W20260709 12:12:52.811904 21272 log.cc:927] Time spent T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.293s	user 0.001s	sys 0.001s
I20260709 12:12:52.740449 21276 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:52.878562 13688 raft_consensus.cc:1275] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:12:52.749121 21161 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:52.885341 13683 raft_consensus.cc:1240] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:52.776618 21227 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.812491 21178 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:52.882789 13652 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:52.767382 21214 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:52.868460 21277 log.cc:927] Time spent T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.301s	user 0.001s	sys 0.000s
I20260709 12:12:52.748647 21160 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:52.833488 21197 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:52.913460 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:52.877099 21130 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.915077 13652 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:52.751924 21267 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:52.938068 21041 consensus_queue.cc:237] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:52.940923 21271 log.cc:927] Time spent T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.512s	user 0.002s	sys 0.000s
W20260709 12:12:52.904322 21281 log.cc:927] Time spent T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 12:12:52.875984 21268 consensus_queue.cc:1059] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.050s
I20260709 12:12:52.941720 20893 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:12:52.951933 21280 log.cc:927] Time spent T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:12:52.952922 21160 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:52.952888 21274 log.cc:927] Time spent T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.598s	user 0.004s	sys 0.005s
I20260709 12:12:52.953528 13687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 1407) took 1170 ms. Trace:
I20260709 12:12:52.954000 21039 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:52.904299 21123 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:52.955855 21123 raft_consensus.cc:2804] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:52.954694 13687 rpcz_store.cc:276] 0709 12:12:51.782782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:51.784036 (+  1254us) service_pool.cc:224] Handling call
0709 12:12:51.787560 (+  3524us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:51.919690 (+132130us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:51.919725 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:51.926609 (+  6884us) log.cc:844] Serialized 52 byte log entry
0709 12:12:52.127463 (+200854us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:52.127515 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:52.546253 (+418738us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b54003115d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:52.546327 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:52.940314 (+393987us) spinlock_profiling.cc:243] Waited 2.31 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:12:52.953252 (+ 12938us) raft_consensus.cc:1685] finished
0709 12:12:52.953280 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:52.953455 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":401,"raft.queue_time_us":1243,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":3650,"spinlock_wait_cycles":308229120,"thread_start_us":168198,"threads_started":1,"wal-append.queue_time_us":358408}
I20260709 12:12:52.956380 21123 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:52.957106 21123 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:52.880981 21254 consensus_queue.cc:1048] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.053s
I20260709 12:12:52.958930 13652 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:52.904162 20806 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.926061 21122 raft_consensus.cc:2804] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:12:52.873710 21136 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:52.890569 21276 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:52.888602 20992 consensus_queue.cc:1048] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.072s
I20260709 12:12:52.949350 21202 raft_consensus.cc:2804] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:52.956298 21170 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:52.926086 21178 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:52.947862 21130 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:52.950552 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 595052us
I20260709 12:12:52.952888 21267 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:52.989230 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:52.948100 21197 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:52.915495 21227 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:52.997746 21039 raft_consensus.cc:2749] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:53.064226 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 446827us
W20260709 12:12:53.005009 13682 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.016s	sys 0.007s
W20260709 12:12:53.078768 13682 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.017s	sys 0.007s
I20260709 12:12:52.996068 21122 raft_consensus.cc:697] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 23 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:53.001484 21030 raft_consensus.cc:3055] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:49.441171 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:12:53.095458 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:53.099689 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:53.003609 21202 raft_consensus.cc:697] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 21 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:52.986915 20806 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:53.063153 20679 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:53.099814 21282 log.cc:927] Time spent T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:12:53.113294 13833 raft_consensus.cc:2410] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 12:12:53.114070 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:53.011214 21160 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:53.102553 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: true dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
W20260709 12:12:53.130339 14415 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.004s	sys 0.012s
W20260709 12:12:53.130983 14415 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.004s	sys 0.013s
I20260709 12:12:53.105566 21042 raft_consensus.cc:2804] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 12:12:53.136176 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 546663us
I20260709 12:12:53.104420 21030 raft_consensus.cc:740] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 21 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:53.139477 13727 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
W20260709 12:12:53.144455 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:53.151736 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:53.119036 21240 consensus_queue.cc:1059] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.029s
I20260709 12:12:53.142249 21231 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:53.160045 21284 log.cc:927] Time spent T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.253s	user 0.000s	sys 0.002s
I20260709 12:12:53.144938 21170 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.143813 21246 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:53.163529 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 397125us
I20260709 12:12:53.164463 13800 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
W20260709 12:12:53.162034 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 298542us
I20260709 12:12:53.127846 20679 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:53.137468 21160 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:53.166553 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:53.153626 21295 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:53.162617 20870 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:53.174239 21283 log.cc:927] Time spent T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.270s	user 0.001s	sys 0.001s
I20260709 12:12:53.168967 21161 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:53.183382 21214 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:53.197381 21214 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:53.198035 21214 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:53.200639 21214 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:12:53.202096 21286 log.cc:927] Time spent T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 12:12:53.158929 21139 consensus_queue.cc:1048] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 12:12:53.203749 13686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 3451) took 1117 ms. Trace:
I20260709 12:12:53.171010 21170 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:53.205121 13682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 3454) took 1112 ms. Trace:
I20260709 12:12:53.204434 13686 rpcz_store.cc:276] 0709 12:12:52.085979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:52.086710 (+   731us) service_pool.cc:224] Handling call
0709 12:12:52.087129 (+   419us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:52.270079 (+182950us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:52.270129 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:52.287527 (+ 17398us) log.cc:844] Serialized 52 byte log entry
0709 12:12:52.695834 (+408307us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:52.695888 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:52.695973 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:53.203324 (+507351us) raft_consensus.cc:1685] finished
0709 12:12:53.203364 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:53.203630 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12196,"raft.queue_time_us":24930,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":7494,"thread_start_us":577667,"threads_started":2,"wal-append.queue_time_us":671403}
I20260709 12:12:53.207860 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:53.208901 13686 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 20.
I20260709 12:12:53.210251 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:53.211952 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:53.214444 21227 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:53.215221 21227 raft_consensus.cc:2804] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:53.215641 21227 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:53.216049 21227 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:53.174007 21246 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:53.220134 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:53.185042 21240 consensus_queue.cc:1243] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer 96701a74fdee481fb5f54aac841e17dd log is divergent from this leader: its last log entry 22.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 12:12:53.223155 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:53.213505 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:53.190305 20806 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:53.225082 20806 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.225646 20806 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:53.227012 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:53.228206 20806 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:53.169667 21202 consensus_queue.cc:237] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:53.229898 21188 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:53.181450 21295 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:53.170240 21231 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:53.232776 21295 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:53.192492 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:53.233568 21231 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:53.194686 14409 raft_consensus.cc:1275] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:12:53.214483 21197 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:53.225113 14407 raft_consensus.cc:1275] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:12:53.236161 13686 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 26.
I20260709 12:12:53.237282 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:53.237737 21160 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:53.238616 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:53.240994 13686 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:53.160890 21122 consensus_queue.cc:237] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:53.177431 21078 raft_consensus.cc:2749] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:53.195775 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:53.196017 21297 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.196220 21178 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:53.220319 21246 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:53.224098 14412 raft_consensus.cc:2393] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 27: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:12:53.193032 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:12:53.241362 21015 consensus_meta.cc:287] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.536s	user 0.010s	sys 0.002s
I20260709 12:12:53.189222 21276 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:53.188594 21130 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:53.194844 20679 leader_election.cc:290] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:53.205899 13682 rpcz_store.cc:276] 0709 12:12:52.092424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:52.094715 (+  2291us) service_pool.cc:224] Handling call
0709 12:12:52.095055 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:52.271027 (+175972us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:52.271075 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:52.285651 (+ 14576us) log.cc:844] Serialized 26 byte log entry
0709 12:12:53.103005 (+817354us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:53.103044 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:53.103111 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:53.204867 (+101756us) raft_consensus.cc:1685] finished
0709 12:12:53.204899 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:53.205057 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4817,"raft.queue_time_us":34693,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":4063,"thread_start_us":896532,"threads_started":2,"wal-append.queue_time_us":825369}
I20260709 12:12:53.259248 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:12:53.245391 13680 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.005s	sys 0.017s
I20260709 12:12:53.218291 21136 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:53.255753 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:53.255807 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:53.261765 13756 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 20.
I20260709 12:12:53.206589 21170 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:53.172240 21162 consensus_queue.cc:1048] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.081s
I20260709 12:12:53.251509 21300 consensus_queue.cc:1059] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.021s
I20260709 12:12:53.265471 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:12:53.263299 13680 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.005s	sys 0.017s
I20260709 12:12:53.269703 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:53.276986 13682 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 17.
I20260709 12:12:53.225306 21030 consensus_queue.cc:260] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:53.266150 21005 consensus_meta.cc:287] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.903s	user 0.009s	sys 0.004s
I20260709 12:12:53.253104 21160 consensus_queue.cc:1048] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 12:12:53.304333 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:53.300310 13680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 3455) took 1207 ms. Trace:
I20260709 12:12:53.273483 14379 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:12:53.295487 21141 consensus_meta.cc:287] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 1.012s	user 0.012s	sys 0.002s
I20260709 12:12:53.296536 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:53.334101 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:53.336683 13682 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 23.
W20260709 12:12:53.341253 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 67885.9us
I20260709 12:12:53.295241 21267 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:53.256362 21297 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:53.344521 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:53.353016 13686 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 19.
I20260709 12:12:53.356398 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:53.357352 13686 raft_consensus.cc:2393] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 22: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:53.358808 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:53.365180 13756 raft_consensus.cc:1275] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 12:12:53.303409 21005 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:53.368737 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:53.348582 21030 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:53.380498 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:53.382861 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:53.389204 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:53.398057 13756 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Advancing to term 23
I20260709 12:12:53.389570 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:53.398773 13758 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 19.
I20260709 12:12:53.390681 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:53.392639 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:53.400148 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:53.400907 13682 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 19.
I20260709 12:12:53.400934 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:53.402242 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:53.402839 13763 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 16.
I20260709 12:12:53.403272 13682 raft_consensus.cc:1240] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:53.404642 13682 raft_consensus.cc:1217] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Deduplicated request from leader. Original: 13.7->[16.8-19.10]   Dedup: 18.9->[19.10-19.10]
I20260709 12:12:53.427770 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:53.428231 13682 raft_consensus.cc:1240] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 19. Current term is 20. Ops: [16.8-19.10]
I20260709 12:12:53.428635 13757 raft_consensus.cc:2393] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 21: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:53.406235 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:12:53.429216 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:53.347616 21309 raft_consensus.cc:2804] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:53.417639 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:53.343978 21141 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:53.416381 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 277040us
I20260709 12:12:53.424211 13763 raft_consensus.cc:1240] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:53.426692 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:53.430649 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:53.429220 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:53.354880 21267 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:53.435154 13727 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:53.435695 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:12:53.436018 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 192349us
I20260709 12:12:53.439827 13727 leader_election.cc:400] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 22. Current term is 23.
I20260709 12:12:53.442147 13727 leader_election.cc:403] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:53.432454 21309 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:53.442085 21162 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.442379 21304 raft_consensus.cc:2749] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:53.494293 13681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 3460) took 1397 ms. Trace:
W20260709 12:12:53.495965 13653 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.970s	user 0.008s	sys 0.020s
W20260709 12:12:53.496374 13653 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.971s	user 0.008s	sys 0.021s
I20260709 12:12:53.443807 13726 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:53.466957 21141 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:12:53.469736 21307 log.cc:927] Time spent T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 12:12:53.499861 13727 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:53.470242 13578 catalog_manager.cc:5697] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 17 to 19, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 19 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:53.479967 21267 leader_election.cc:290] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:53.481191 21297 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:53.321746 13680 rpcz_store.cc:276] 0709 12:12:52.092777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:52.092996 (+   219us) service_pool.cc:224] Handling call
0709 12:12:52.107889 (+ 14893us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:12:52.112646 (+  4757us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:52.112693 (+    47us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:12:52.123841 (+ 11148us) log.cc:844] Serialized 78 byte log entry
0709 12:12:52.615315 (+491474us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:53.293961 (+678646us) log.cc:844] Serialized 14 byte log entry
0709 12:12:53.299310 (+  5349us) log.cc:844] Serialized 14 byte log entry
0709 12:12:53.299821 (+   511us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:53.299954 (+   133us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:53.300028 (+    74us) raft_consensus.cc:1685] finished
0709 12:12:53.300077 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:53.300246 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4124,"prepare.queue_time_us":605545,"prepare.run_cpu_time_us":102,"prepare.run_wall_time_us":3656,"raft.queue_time_us":50022,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":4796,"spinlock_wait_cycles":16735616,"thread_start_us":1044744,"threads_started":2,"wal-append.queue_time_us":606408}
W20260709 12:12:53.513866 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 70225.6us
I20260709 12:12:53.516858 13726 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:53.484700 21123 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:53.487447 20870 raft_consensus.cc:3055] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:53.492213 13834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 3612) took 1260 ms. Trace:
I20260709 12:12:53.447517 21139 consensus_queue.cc:1059] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.066s
W20260709 12:12:53.470427 21303 log.cc:927] Time spent T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 12:12:53.494808 13681 rpcz_store.cc:276] 0709 12:12:52.097114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:52.576652 (+479538us) service_pool.cc:224] Handling call
0709 12:12:52.577036 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:52.992083 (+415047us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:52.992121 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:53.003691 (+ 11570us) log.cc:844] Serialized 26 byte log entry
0709 12:12:53.421194 (+417503us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:53.421241 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:53.421363 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:53.493988 (+ 72625us) raft_consensus.cc:1685] finished
0709 12:12:53.494014 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:53.494224 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":37870,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":36619,"thread_start_us":703160,"threads_started":2,"wal-append.queue_time_us":394747}
I20260709 12:12:53.512890 21136 consensus_queue.cc:1059] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 12:12:53.508615 13756 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 23.
I20260709 12:12:53.454607 21309 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:53.522405 13834 rpcz_store.cc:276] 0709 12:12:52.231416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:52.239438 (+  8022us) service_pool.cc:224] Handling call
0709 12:12:52.248201 (+  8763us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:52.251895 (+  3694us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:12:52.863104 (+611209us) log.cc:844] Serialized 14 byte log entry
0709 12:12:53.274072 (+410968us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:53.275120 (+  1048us) log.cc:844] Serialized 26 byte log entry
0709 12:12:53.275324 (+   204us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:53.275379 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:53.275489 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:53.491947 (+216458us) raft_consensus.cc:1685] finished
0709 12:12:53.491971 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:53.492115 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48235,"prepare.queue_time_us":106872,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":6866,"raft.queue_time_us":13162,"raft.run_cpu_time_us":450,"raft.run_wall_time_us":39539,"thread_start_us":919545,"threads_started":2,"wal-append.queue_time_us":608447}
I20260709 12:12:53.492937 21162 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:53.446861 21078 consensus_queue.cc:1048] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 12:12:53.527916 13680 raft_consensus.cc:1275] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:12:53.516422 20679 raft_consensus.cc:2804] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:53.520596 21209 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:53.532341 21316 raft_consensus.cc:2749] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 22. Current term is 23.
I20260709 12:12:53.522293 20870 raft_consensus.cc:740] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:53.524679 21214 consensus_queue.cc:1059] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.013s
I20260709 12:12:53.524477 21149 consensus_queue.cc:1048] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.014s
W20260709 12:12:53.569494 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:53.573099 21005 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:53.576264 21042 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:53.580199 21306 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:53.582639 21042 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:53.583135 21214 raft_consensus.cc:3055] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:53.583799 21214 raft_consensus.cc:740] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:53.581143 21141 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:53.581830 21170 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:53.582911 21306 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:53.586311 21170 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:53.587935 21306 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:53.588416 21170 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:53.580667 21027 raft_consensus.cc:2749] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:53.589614 21027 raft_consensus.cc:3055] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:12:53.590030 21027 raft_consensus.cc:740] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:53.590827 21027 consensus_queue.cc:260] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:53.592118 21027 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:53.585413 21141 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:53.601536 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:53.596113 21141 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:53.608942 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:53.628984 13686 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 20.
W20260709 12:12:53.629020 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 112280us
W20260709 12:12:53.630834 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 109377us
I20260709 12:12:53.630957 13801 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:53.631865 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:53.611642 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: true dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:53.633759 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:53.613631 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:53.614634 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:53.619664 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:53.635603 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:53.636032 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:53.632125 13726 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:12:53.620536 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:53.612795 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:53.637279 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:53.637756 13685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 3452) took 1546 ms. Trace:
I20260709 12:12:53.637917 13836 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 21.
I20260709 12:12:53.639171 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:53.639784 13836 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:12:53.640769 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:53.641965 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:53.642781 13757 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 16.
I20260709 12:12:53.644225 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:53.644500 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:53.645051 13757 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 18.
I20260709 12:12:53.646198 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:53.647053 13761 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 19.
I20260709 12:12:53.647743 13727 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:53.649040 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:53.649065 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:53.651345 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:53.652122 13835 raft_consensus.cc:2393] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 20: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:53.652138 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:53.645200 13834 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Advancing to term 22
I20260709 12:12:53.638211 13685 rpcz_store.cc:276] 0709 12:12:52.091766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:52.093906 (+  2140us) service_pool.cc:224] Handling call
0709 12:12:52.094276 (+   370us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:52.179122 (+ 84846us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:52.179159 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:52.191156 (+ 11997us) log.cc:844] Serialized 52 byte log entry
0709 12:12:52.630191 (+439035us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:53.135928 (+505737us) log.cc:844] Serialized 14 byte log entry
0709 12:12:53.136163 (+   235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:53.606254 (+470091us) spinlock_profiling.cc:243] Waited 84.4 ms on lock 0x7b540006fc54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:53.606350 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:53.606440 (+    90us) raft_consensus.cc:1685] finished
0709 12:12:53.637543 (+ 31103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:53.637695 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71789,"prepare.queue_time_us":590876,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":6611,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":5811,"spinlock_wait_cycles":194173184,"thread_start_us":810662,"threads_started":2,"wal-append.queue_time_us":561440}
I20260709 12:12:53.652566 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:53.633332 13801 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:53.661865 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:53.662021 13727 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:53.664786 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:53.656045 13831 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 16.
I20260709 12:12:53.672309 13800 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:53.675119 13836 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 26.
I20260709 12:12:53.679883 13830 raft_consensus.cc:1240] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:53.685468 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:53.676657 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:53.674109 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:53.695365 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:53.696200 13686 raft_consensus.cc:2393] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 19: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:53.696563 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:53.696836 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:53.697548 13763 raft_consensus.cc:2393] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 20: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:53.699361 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:53.703202 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:53.655138 21005 raft_consensus.cc:2749] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:53.701874 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:53.642850 21202 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:53.585063 21214 consensus_queue.cc:260] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:53.688064 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:53.715397 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:53.716722 13759 raft_consensus.cc:1275] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:12:53.718410 13683 raft_consensus.cc:1275] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 12:12:53.716841 13762 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 21.
I20260709 12:12:53.716137 13652 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:53.710072 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:53.628458 21227 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:53.691970 14379 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:53.692777 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:53.654971 21306 consensus_queue.cc:1048] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.053s
I20260709 12:12:53.688838 21178 raft_consensus.cc:2749] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:53.707538 13688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 3474) took 1488 ms. Trace:
I20260709 12:12:53.720599 21202 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:53.740324 13688 rpcz_store.cc:276] 0709 12:12:52.219480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:52.885815 (+666335us) service_pool.cc:224] Handling call
0709 12:12:52.886205 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:52.886458 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 12:12:53.183864 (+297406us) log.cc:844] Serialized 14 byte log entry
0709 12:12:53.707187 (+523323us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:53.707243 (+    56us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:12:53.707294 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:53.707367 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:53.707483 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":273315,"prepare.queue_time_us":335015,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":277216,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":108,"thread_start_us":517510,"threads_started":2,"wal-append.queue_time_us":263284}
I20260709 12:12:53.677739 21246 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.742668 21246 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:53.743508 21202 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:53.746330 13652 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:53.726723 14379 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:53.687539 13800 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:53.705798 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:53.714819 13828 raft_consensus.cc:1240] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:53.726050 13835 raft_consensus.cc:1240] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 25. Current term is 26. Ops: []
I20260709 12:12:53.703069 21160 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:53.750012 14379 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:53.727388 13685 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 18.
I20260709 12:12:53.727896 21124 raft_consensus.cc:2749] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:53.728811 21214 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:53.715721 21141 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.733430 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:53.723944 13687 raft_consensus.cc:1275] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:12:53.733044 13578 catalog_manager.cc:5697] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: config changed from index 8 to 10, term changed from 13 to 19, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER b98d2519bb504dc6905ed2ede4571835 (127.12.56.193), VOTER 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194), VOTER 96701a74fdee481fb5f54aac841e17dd (127.12.56.195), VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 19 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:53.643558 20870 consensus_queue.cc:260] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:53.735749 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:53.737008 21123 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:53.712049 13680 raft_consensus.cc:1275] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:12:53.773811 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:53.686877 21210 raft_consensus.cc:2749] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:12:53.700488 21136 raft_consensus.cc:2804] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:12:53.794783 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:53.751380 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:12:53.749823 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 63036.3us
I20260709 12:12:53.755703 14380 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:53.759497 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:12:53.774720 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 84295.6us
I20260709 12:12:53.798409 13828 raft_consensus.cc:2393] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 18: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:53.749320 21292 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:53.775491 13651 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:53.776636 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:53.757257 21300 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:12:53.779438 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:53.755525 20679 raft_consensus.cc:697] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:53.780663 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:53.776670 21015 consensus_queue.cc:1059] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.018s
I20260709 12:12:53.795496 21136 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:53.794888 13834 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 22.
I20260709 12:12:53.796159 13688 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 16.
I20260709 12:12:53.752496 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:53.756204 21306 raft_consensus.cc:2749] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:12:53.777213 21141 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:53.793358 21291 raft_consensus.cc:2749] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:12:53.802206 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 46607.1us
I20260709 12:12:53.803665 13682 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 16.
I20260709 12:12:53.777246 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:53.785259 21042 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:53.806668 13681 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 18.
I20260709 12:12:53.793808 21278 raft_consensus.cc:2804] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:53.775048 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:53.808295 13651 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:53.824784 13651 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:53.798592 21268 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:53.792580 21229 consensus_queue.cc:1048] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:53.815719 21246 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:53.799743 21162 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:53.798808 21299 raft_consensus.cc:2804] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:53.809180 13800 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:53.757443 21160 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:53.827960 13687 raft_consensus.cc:2368] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 21. Current term is 22.
I20260709 12:12:53.828300 13651 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:53.820035 21136 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:53.805845 21300 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:53.707497 21331 consensus_queue.cc:1048] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.111s
I20260709 12:12:53.839572 21291 raft_consensus.cc:2804] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:53.851610 13651 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:53.819435 21141 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:53.824307 21298 raft_consensus.cc:2749] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:12:53.853430 13684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 3464) took 1722 ms. Trace:
I20260709 12:12:53.825258 21202 raft_consensus.cc:2804] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:53.857122 13651 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:53.853937 20992 raft_consensus.cc:2749] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:12:53.854138 21162 raft_consensus.cc:2749] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:53.859714 20679 consensus_queue.cc:237] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:53.861598 21297 raft_consensus.cc:2749] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:12:53.855458 21300 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:12:53.862831 21246 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:53.863284 21291 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:53.847009 21299 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:53.852383 13800 leader_election.cc:304] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:53.868230 21042 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:53.869530 21136 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:53.839977 21122 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:12:53.807314 21292 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:53.876411 21160 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:53.823674 21278 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:53.911222 21278 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:53.882040 13684 rpcz_store.cc:276] 0709 12:12:52.131425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:52.745474 (+614049us) service_pool.cc:224] Handling call
0709 12:12:52.746122 (+   648us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:52.748821 (+  2699us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:12:53.234340 (+485519us) spinlock_profiling.cc:243] Waited 3.98 ms on lock 0x7b18001f41a0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e82e07 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9d455 00007fa92b9853c7 00007fa927f979a7 00007fa927fa70bf 00007fa927fa7038
0709 12:12:53.439737 (+205397us) log.cc:844] Serialized 14 byte log entry
0709 12:12:53.677497 (+237760us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:53.678053 (+   556us) log.cc:844] Serialized 26 byte log entry
0709 12:12:53.678226 (+   173us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:53.678266 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:53.678347 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:53.847839 (+169492us) raft_consensus.cc:1685] finished
0709 12:12:53.853205 (+  5366us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:53.853359 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":155209,"prepare.queue_time_us":472446,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":162805,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":18797,"spinlock_wait_cycles":18379904,"thread_start_us":265363,"threads_started":2,"wal-append.queue_time_us":75595}
W20260709 12:12:53.886816 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 77366.6us
I20260709 12:12:53.888607 13651 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:53.888607 21188 raft_consensus.cc:2749] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:12:53.918402 21188 raft_consensus.cc:2749] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:12:53.889657 21294 consensus_queue.cc:1059] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:53.918884 13651 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:53.919430 21294 raft_consensus.cc:3055] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:53.919809 21294 raft_consensus.cc:740] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:53.920607 21294 consensus_queue.cc:260] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:53.921877 21294 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:53.926465 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:53.927831 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:53.891033 21304 raft_consensus.cc:3055] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:53.929958 21304 raft_consensus.cc:740] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:53.930099 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:53.930905 21304 consensus_queue.cc:260] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:53.932150 21304 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:53.891275 21298 consensus_queue.cc:1059] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 25.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:12:53.896996 21148 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:12:53.934331 21309 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:53.934844 13833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54820 (request call id 3626) took 1363 ms. Trace:
I20260709 12:12:53.935271 13833 rpcz_store.cc:276] 0709 12:12:52.571347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:52.750216 (+178869us) service_pool.cc:224] Handling call
0709 12:12:53.934559 (+1184343us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b54000db454. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:53.934749 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":576262912}
I20260709 12:12:53.935998 21195 raft_consensus.cc:3055] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:12:53.936442 21195 raft_consensus.cc:740] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 25 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:53.936750 21309 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 21 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:53.900913 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 48605.5us
I20260709 12:12:53.938591 13800 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:53.940304 13800 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:53.845834 21268 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:53.921401 13651 leader_election.cc:304] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:53.942819 21268 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:53.943156 21042 raft_consensus.cc:2749] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:53.943629 21330 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:53.943909 21306 raft_consensus.cc:2804] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:53.944397 21306 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:53.944783 21306 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:53.946393 21202 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:53.946902 21202 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:53.943921 21042 consensus_queue.cc:1048] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.004s
I20260709 12:12:53.947585 21122 raft_consensus.cc:2749] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:12:53.906291 21227 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:53.949322 21227 raft_consensus.cc:2749] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:53.907891 21136 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:53.900202 21299 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:53.950245 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 318162us
I20260709 12:12:53.904441 21055 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:53.951474 13726 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:53.952342 21048 raft_consensus.cc:2804] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:53.952777 21048 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:53.953150 21048 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:53.899977 21291 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:53.953758 21332 consensus_queue.cc:1059] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:53.954322 13800 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:53.955498 21332 consensus_queue.cc:1059] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:12:53.955789 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 158642us
I20260709 12:12:53.957101 21335 raft_consensus.cc:3055] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:53.957538 21335 raft_consensus.cc:740] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:53.958519 21335 consensus_queue.cc:260] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:53.902437 21162 raft_consensus.cc:2749] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:12:53.910578 21292 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:53.937340 21195 consensus_queue.cc:260] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:53.943686 21278 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:53.902225 21246 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:53.963729 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:12:53.964108 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:53.964743 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:53.967504 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:53.971163 13800 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:53.987417 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:54.012514 13684 raft_consensus.cc:2393] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 20: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
W20260709 12:12:53.992959 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 120913us
I20260709 12:12:54.006971 13683 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 21.
I20260709 12:12:54.011655 13679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 3462) took 1887 ms. Trace:
I20260709 12:12:54.015013 13679 rpcz_store.cc:276] 0709 12:12:52.124601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:52.733899 (+609298us) service_pool.cc:224] Handling call
0709 12:12:52.738524 (+  4625us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:52.935571 (+197047us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:52.935611 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:52.958434 (+ 22823us) log.cc:844] Serialized 26 byte log entry
0709 12:12:53.304659 (+346225us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:53.304719 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:53.963158 (+658439us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b5400312ed4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:53.963253 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:53.963327 (+    74us) raft_consensus.cc:1685] finished
0709 12:12:53.963350 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:54.011585 (+ 48235us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6582,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":7506,"spinlock_wait_cycles":452162176,"thread_start_us":310038,"threads_started":1,"wal-append.queue_time_us":461818}
I20260709 12:12:53.950280 21136 raft_consensus.cc:2804] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:53.993163 21227 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:53.994200 21161 raft_consensus.cc:2749] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:54.034821 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:54.025972 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:54.030323 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:54.037725 13763 raft_consensus.cc:1240] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 24. Current term is 25. Ops: [24.13-24.13]
I20260709 12:12:54.001760 20870 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:54.044932 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:54.045405 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:54.046077 14415 raft_consensus.cc:1240] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:54.048182 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:54.013669 21210 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.060699 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:54.061014 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:54.062040 13800 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:54.025607 21136 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:54.021674 21178 raft_consensus.cc:2804] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:54.068687 13829 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:54.072702 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:54.029286 21195 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:12:54.065276 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:54.005069 21306 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:54.075066 13801 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:54.064615 13763 raft_consensus.cc:1275] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:12:54.005867 21141 consensus_queue.cc:1048] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.046s
I20260709 12:12:54.079927 21231 raft_consensus.cc:2804] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:54.080392 21231 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:54.080734 21231 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:54.074044 21136 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:54.074891 21178 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:54.084498 21178 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:12:54.077093 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 79941.8us
I20260709 12:12:54.086681 13760 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 27.
I20260709 12:12:54.028698 21200 consensus_queue.cc:1059] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.049s
I20260709 12:12:54.018193 21197 consensus_queue.cc:1048] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 12:12:54.075853 13800 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:54.094950 13758 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 18.
I20260709 12:12:54.096118 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:54.099146 13756 raft_consensus.cc:2410] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 23 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 12:12:54.099362 21246 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:54.099860 21014 raft_consensus.cc:3060] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:54.095072 21300 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:54.100713 21200 raft_consensus.cc:3055] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:54.101205 21200 raft_consensus.cc:740] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:54.095456 21130 raft_consensus.cc:2749] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:54.055285 21162 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.005069 21299 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:54.105123 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:54.105973 14407 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 21.
I20260709 12:12:54.107282 13801 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:54.107643 21305 consensus_queue.cc:1059] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:12:54.087222 21182 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.108745 21182 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:54.111203 21291 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:54.117214 13800 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:54.119267 14408 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 22.
I20260709 12:12:54.126392 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:54.127076 14379 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:54.129462 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:12:54.121985 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 73556.4us
I20260709 12:12:54.132390 13829 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 22.
I20260709 12:12:54.136432 14410 raft_consensus.cc:1240] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 17. Current term is 18. Ops: [17.15-17.15]
I20260709 12:12:54.071887 21210 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:54.140117 13800 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:12:54.183641 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 43588.7us
W20260709 12:12:54.185411 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 228854us
I20260709 12:12:54.140923 21227 raft_consensus.cc:2749] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:54.190843 21227 raft_consensus.cc:2749] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:12:54.195848 21202 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:54.198338 14412 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 21.
W20260709 12:12:54.203877 14380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:54.156837 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 203487us
I20260709 12:12:54.215034 21122 consensus_queue.cc:1059] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:54.128087 21246 raft_consensus.cc:2804] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:12:54.231765 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 47337.6us
I20260709 12:12:54.137337 21124 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.234794 13726 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:12:54.332854 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 98129.3us
I20260709 12:12:54.160305 21305 raft_consensus.cc:2804] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:54.334685 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:54.335294 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:54.138216 21005 raft_consensus.cc:2804] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:54.237493 13800 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:12:54.246922 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:54.154253 21300 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 28 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:12:54.255111 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 68954.3us
I20260709 12:12:54.210011 21291 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:54.227250 21278 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:54.227758 21246 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:54.218039 21148 consensus_queue.cc:1059] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 12:12:54.116411 21162 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:54.326894 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:54.326618 21347 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:54.232594 21161 raft_consensus.cc:3055] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:12:54.240671 21316 consensus_queue.cc:1048] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.206s
I20260709 12:12:54.334709 21352 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:54.339993 21149 raft_consensus.cc:2804] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:54.338800 13681 raft_consensus.cc:2393] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 22: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:54.350483 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:54.565701 13684 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 20.
I20260709 12:12:54.350787 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:54.568081 13680 raft_consensus.cc:2410] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 23 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 12:12:54.352576 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:54.352969 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:54.382005 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:12:54.388902 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:54.367312 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:54.569624 13687 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:54.450785 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:12:54.338501 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 101094us
I20260709 12:12:54.571621 13800 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:54.328771 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:54.457162 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:54.471612 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:54.158632 21200 consensus_queue.cc:260] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:54.355695 21005 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:54.338647 21305 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:54.136838 20457 raft_consensus.cc:2749] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:12:54.457917 13759 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 20.
I20260709 12:12:54.466609 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:54.340059 21141 raft_consensus.cc:2749] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:54.204993 21254 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.365667 21124 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:54.471684 21202 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:54.474282 21161 raft_consensus.cc:740] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:54.564203 21149 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:54.644469 21305 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:54.456664 21246 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:54.634595 21005 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:54.367439 21328 consensus_queue.cc:1048] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.296s
I20260709 12:12:54.656523 21291 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:54.621656 13684 raft_consensus.cc:1240] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:54.454305 21048 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:54.668095 21276 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:54.684945 21149 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:54.676736 21306 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:54.702436 13687 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 20.
I20260709 12:12:54.685985 21202 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.514690 21347 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:54.712116 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 255018us
I20260709 12:12:54.618068 21352 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:54.722304 21328 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.722874 21328 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:54.674338 21254 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:54.723905 21352 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:54.724298 14413 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 19.
I20260709 12:12:54.725076 21328 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:54.726562 21346 log.cc:927] Time spent T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
I20260709 12:12:54.704489 21299 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:54.701431 21291 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:54.737587 21014 consensus_meta.cc:287] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.637s	user 0.012s	sys 0.000s
I20260709 12:12:54.732394 21306 raft_consensus.cc:2804] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:54.709635 21276 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:54.737929 21278 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:54.778296 21231 consensus_meta.cc:287] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.697s	user 0.010s	sys 0.001s
I20260709 12:12:54.716207 21202 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:54.787981 14416 raft_consensus.cc:1275] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
W20260709 12:12:54.769176 21351 log.cc:927] Time spent T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.441s	user 0.001s	sys 0.000s
I20260709 12:12:54.767545 21210 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:54.792029 21278 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:54.785919 21306 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:54.714211 21161 consensus_queue.cc:260] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.13, Last appended by leader: 13, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:54.814832 21347 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:54.797724 21268 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.796025 21276 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:54.806506 21306 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:54.830803 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:54.799572 21231 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:54.818975 21162 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:54.835142 13578 catalog_manager.cc:5697] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 14 to 19, leader changed from ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 19 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
W20260709 12:12:54.843798 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:54.824321 21357 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.824416 21161 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:54.846025 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:54.849903 13763 raft_consensus.cc:2393] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 17: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:54.850276 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:54.825487 21268 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:54.864095 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:54.865594 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:54.866762 13758 raft_consensus.cc:2393] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 21: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:54.883821 21202 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:54.850286 21357 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:54.887859 21357 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:54.889931 21048 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:54.890928 21202 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.891577 21202 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:54.896147 13760 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38932 (request call id 1214) took 2167 ms (client timeout 1732 ms). Trace:
W20260709 12:12:54.896634 13760 rpcz_store.cc:269] 0709 12:12:52.728948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:52.729131 (+   183us) service_pool.cc:224] Handling call
0709 12:12:54.895944 (+2166813us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54000a0ad4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:54.896069 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2928747776}
I20260709 12:12:54.856952 21124 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:12:54.905419 21136 consensus_meta.cc:287] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.821s	user 0.008s	sys 0.000s
I20260709 12:12:54.906574 21278 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:54.917433 21136 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:54.918706 13761 raft_consensus.cc:2393] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 20: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:54.922179 21136 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:54.908113 21305 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:54.909607 21042 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.910748 13652 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:54.913897 21202 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:54.914963 21231 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:54.915807 21291 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:54.930639 13652 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:54.938095 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:54.946971 13760 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 27.
W20260709 12:12:54.893608 21195 consensus_meta.cc:287] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.810s	user 0.009s	sys 0.000s
I20260709 12:12:54.952463 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:54.953402 13760 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 17.
W20260709 12:12:54.974383 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 43880.8us
I20260709 12:12:54.958876 14379 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:54.976595 13652 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
W20260709 12:12:54.950230 21178 consensus_meta.cc:287] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.862s	user 0.009s	sys 0.004s
I20260709 12:12:54.984546 13652 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:54.984612 14379 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:54.949941 21278 raft_consensus.cc:2749] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:55.009728 13652 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:54.986332 21202 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:55.004148 21195 raft_consensus.cc:2804] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:55.002898 21267 raft_consensus.cc:2804] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:54.955788 21042 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:55.018795 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 447218us
I20260709 12:12:55.020550 14379 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:55.024087 21130 consensus_queue.cc:1048] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:55.024437 13800 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:54.982632 21005 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:55.040099 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:54.989202 21178 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:55.025610 21162 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:55.063582 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:12:55.061865 13803 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.929s	user 0.003s	sys 0.018s
I20260709 12:12:55.066920 13800 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:55.019795 21267 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:55.067265 13803 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.935s	user 0.003s	sys 0.018s
I20260709 12:12:55.020870 21015 raft_consensus.cc:2804] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:55.070178 13800 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:55.019621 21358 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:55.072258 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:55.072584 21178 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:55.073275 21141 raft_consensus.cc:2749] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:55.073715 21149 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:55.076254 21149 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:55.077185 21358 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:55.079605 21005 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:12:55.080888 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 60416.4us
I20260709 12:12:55.083617 13829 raft_consensus.cc:1275] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:12:55.083577 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:55.085609 13835 raft_consensus.cc:1240] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 23. Current term is 24. Ops: []
I20260709 12:12:55.086278 20457 raft_consensus.cc:2804] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:55.086753 20457 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:55.087124 20457 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:55.088863 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:55.089601 13835 raft_consensus.cc:1275] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:12:55.090840 13829 raft_consensus.cc:1240] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 25. Current term is 26. Ops: [23.13-25.14]
I20260709 12:12:55.085623 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:55.079957 21202 raft_consensus.cc:2749] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:55.030668 21195 raft_consensus.cc:697] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 18 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:55.160944 21012 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:55.161731 21012 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:55.162217 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:55.162801 13830 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:55.164621 21012 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:55.166859 21195 consensus_queue.cc:237] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:55.167443 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:55.168722 21306 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:55.161147 21364 log.cc:927] Time spent T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 12:12:55.070533 21267 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:55.192399 21358 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:55.193830 21246 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:55.196242 21246 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:55.196830 21306 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:55.198194 13831 raft_consensus.cc:2393] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 20: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:55.200762 21042 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:55.070195 21015 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:55.208724 21305 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:55.209192 21275 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.157740 21178 raft_consensus.cc:2749] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:55.210055 21015 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:55.209841 21275 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:55.212126 21275 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:55.265903 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:55.334995 14410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41692 (request call id 1145) took 1305 ms. Trace:
I20260709 12:12:55.335656 14410 rpcz_store.cc:276] 0709 12:12:54.029600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:54.031250 (+  1650us) service_pool.cc:224] Handling call
0709 12:12:54.031674 (+   424us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:54.183679 (+152005us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:55.334611 (+1150932us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b54005e01d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:55.334903 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":240085376}
I20260709 12:12:55.332389 21339 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:55.354012 21339 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:55.356844 21339 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:55.376322 21015 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:55.448905 13651 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.817s	user 0.002s	sys 0.017s
W20260709 12:12:55.563407 13651 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.932s	user 0.003s	sys 0.018s
I20260709 12:12:55.566536 21149 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.567754 21275 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:55.567984 21149 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:55.454774 13654 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.005s	sys 0.005s
W20260709 12:12:55.570089 13654 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.005s	sys 0.005s
I20260709 12:12:55.573668 21291 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:55.574497 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:55.574795 21291 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:55.575692 13684 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Advancing to term 28
W20260709 12:12:55.455895 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:55.456748 13683 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.010s	sys 0.013s
W20260709 12:12:55.578647 13683 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.011s	sys 0.014s
W20260709 12:12:55.458806 13686 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.739s	user 0.008s	sys 0.011s
I20260709 12:12:55.065148 13727 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:12:55.481050 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:55.483621 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:55.493597 13757 raft_consensus.cc:2368] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 19. Current term is 20.
W20260709 12:12:55.504155 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 421595us
I20260709 12:12:55.507732 21385 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader election won for term 26
W20260709 12:12:55.510255 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 498614us
I20260709 12:12:55.513121 13829 raft_consensus.cc:1240] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:55.520730 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:55.523012 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:55.525309 14410 raft_consensus.cc:1240] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:55.527081 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:55.392797 21267 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:55.585942 13800 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:55.539707 21170 raft_consensus.cc:3055] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:55.613998 21170 raft_consensus.cc:740] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:55.615921 21170 consensus_queue.cc:260] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:55.542668 21027 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:55.627104 21027 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:55.628497 14408 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41692 (request call id 1125) took 2526 ms (client timeout 1640 ms). Trace:
I20260709 12:12:55.543882 21042 raft_consensus.cc:2804] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:55.562362 21178 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.630076 14414 raft_consensus.cc:1275] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
W20260709 12:12:55.630769 14412 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41692 (request call id 1147) took 1599 ms (client timeout 1882 ms). Trace:
I20260709 12:12:55.630594 21178 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:55.631313 14412 rpcz_store.cc:269] 0709 12:12:54.044503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:54.044650 (+   147us) service_pool.cc:224] Handling call
0709 12:12:55.630292 (+1585642us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b54003ebf54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:55.630562 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":350841600}
I20260709 12:12:55.632297 14413 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41700 (request call id 1114) took 1250 ms. Trace:
I20260709 12:12:55.632774 14413 rpcz_store.cc:276] 0709 12:12:54.381292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:54.381615 (+   323us) service_pool.cc:224] Handling call
0709 12:12:55.631868 (+1250253us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b54006400d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:55.632088 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":356487552}
I20260709 12:12:55.634438 13834 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 21.
I20260709 12:12:55.634804 21178 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:55.635602 21027 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:55.636018 21078 raft_consensus.cc:3055] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:55.636508 21078 raft_consensus.cc:740] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:12:55.637048 21355 log.cc:927] Time spent T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.928s	user 0.011s	sys 0.037s
I20260709 12:12:55.638594 21254 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:55.641763 21333 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
W20260709 12:12:55.642184 20457 consensus_meta.cc:287] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.554s	user 0.006s	sys 0.006s
I20260709 12:12:55.642760 21333 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:55.642876 20457 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:55.643628 21182 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:12:55.580760 13686 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.864s	user 0.009s	sys 0.012s
I20260709 12:12:55.593191 21304 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:55.645376 21333 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:55.648438 14415 raft_consensus.cc:1275] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:12:55.569061 21275 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:55.602476 13836 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 26.
I20260709 12:12:55.602141 21365 consensus_queue.cc:1059] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:55.604040 21372 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:12:55.655572 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 51831.9us
I20260709 12:12:55.580139 21376 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:55.657931 21042 raft_consensus.cc:697] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 22 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:55.660565 21376 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:55.662488 21042 consensus_queue.cc:237] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:55.663818 21376 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:55.624059 21161 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:55.664893 21161 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:55.666677 21278 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:55.667614 21278 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:55.668000 21161 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:55.624979 21370 raft_consensus.cc:2749] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:12:55.670459 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 84879.4us
I20260709 12:12:55.671633 21078 consensus_queue.cc:260] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:55.672348 13800 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:55.626015 21268 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199)
I20260709 12:12:55.595409 21015 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:55.645027 21304 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:55.539765 21162 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
W20260709 12:12:55.629068 14408 rpcz_store.cc:269] 0709 12:12:53.102108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:53.102242 (+   134us) service_pool.cc:224] Handling call
0709 12:12:55.628009 (+2525767us) spinlock_profiling.cc:243] Waited 766 ms on lock 0x7b54006d01d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:55.628240 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1761781504}
W20260709 12:12:55.647886 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 582603us
I20260709 12:12:55.659107 21372 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:55.604897 21358 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.659101 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:55.625504 21291 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:55.617702 21170 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:55.613641 21267 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:55.711264 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:55.712232 13762 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 18.
I20260709 12:12:55.712731 20457 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:55.715588 21275 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:55.717635 21278 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:55.718988 13761 raft_consensus.cc:1240] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 24. Current term is 25. Ops: [24.13-24.13]
I20260709 12:12:55.687215 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:55.687515 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:55.672484 21368 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.689692 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:55.690013 13801 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:55.701795 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:55.701292 21162 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:55.729104 13756 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 25.
I20260709 12:12:55.730412 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:55.731165 13682 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 21.
I20260709 12:12:55.732635 13727 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:55.732952 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:55.733920 13680 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 18.
I20260709 12:12:55.734256 21365 raft_consensus.cc:3055] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:55.675004 21178 raft_consensus.cc:2749] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:55.705093 14380 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:55.727758 21333 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.730608 21162 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:55.735102 21368 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:55.736451 21333 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:55.737185 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 47531.3us
I20260709 12:12:55.735415 13687 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:55.739769 21333 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:55.741858 21254 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:12:55.742524 21254 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:55.742995 21254 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:12:55.746062 13763 raft_consensus.cc:2468] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 17.
I20260709 12:12:55.746256 21162 raft_consensus.cc:2764] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 12:12:55.729193 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:55.747365 21162 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.703302 21149 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:55.734694 21365 raft_consensus.cc:740] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:55.678555 21385 raft_consensus.cc:697] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 26 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:55.720825 13726 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:55.787729 21333 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:55.789294 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:55.787773 13754 raft_consensus.cc:1275] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:12:55.790781 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:55.748082 21162 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:55.795998 21162 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:55.798504 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:55.799748 13754 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 22.
I20260709 12:12:55.803646 13684 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 28.
I20260709 12:12:55.805768 13683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 3491) took 1452 ms. Trace:
I20260709 12:12:55.805673 21385 consensus_queue.cc:237] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 13, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:55.807770 21333 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:55.811203 13757 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 18.
I20260709 12:12:55.812391 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:55.739663 21304 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:55.815135 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:55.816028 13754 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 18.
I20260709 12:12:55.816920 21278 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.817817 21278 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:55.820499 21214 raft_consensus.cc:3055] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:12:55.821126 21214 raft_consensus.cc:740] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:55.820622 21278 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:55.822494 21214 consensus_queue.cc:260] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 25.14, Last appended by leader: 14, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:55.823921 21214 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:12:55.821125 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:55.831465 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:55.832003 21365 consensus_queue.cc:260] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:55.835224 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:55.836551 13681 raft_consensus.cc:2393] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 17: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:55.837105 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:55.806450 13683 rpcz_store.cc:276] 0709 12:12:54.353593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:54.617293 (+263700us) service_pool.cc:224] Handling call
0709 12:12:54.617650 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:54.617908 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:12:54.807531 (+189623us) log.cc:844] Serialized 14 byte log entry
0709 12:12:55.805200 (+997669us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:55.805334 (+   134us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:55.805420 (+    86us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:55.805520 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:55.805678 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":185343,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":71374,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":274,"thread_start_us":1150966,"threads_started":3,"wal-append.queue_time_us":510297}
I20260709 12:12:55.832681 13682 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 19.
W20260709 12:12:55.838573 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 178164us
I20260709 12:12:55.808892 21231 raft_consensus.cc:2749] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:55.838501 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:55.838008 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:55.848948 13681 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 17.
I20260709 12:12:55.853334 13687 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 18.
I20260709 12:12:55.860937 13758 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 20.
I20260709 12:12:55.860356 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:55.863415 13682 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 20.
I20260709 12:12:55.863705 21368 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:12:55.864537 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 128846us
I20260709 12:12:55.863538 13652 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:55.864935 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:55.869058 21389 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:55.869818 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:55.869939 21389 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:55.870775 13761 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 20.
I20260709 12:12:55.872867 21389 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:55.872741 14379 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:55.872783 21278 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.838049 21358 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:55.878921 21278 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:55.879923 14379 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:55.880822 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:55.881155 21358 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:55.881897 13756 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 25.
I20260709 12:12:55.882814 20870 raft_consensus.cc:2804] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:55.883569 20870 raft_consensus.cc:697] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 20 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:55.888936 21372 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:55.890352 13758 raft_consensus.cc:1275] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 12:12:55.890949 14416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 1278) took 2274 ms. Trace:
I20260709 12:12:55.891407 14416 rpcz_store.cc:276] 0709 12:12:53.616977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:53.617116 (+   139us) service_pool.cc:224] Handling call
0709 12:12:53.617393 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:54.794004 (+1176611us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:55.890402 (+1096398us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54006d0e54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:55.890755 (+   353us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2685312384}
I20260709 12:12:55.680368 21306 consensus_queue.cc:1048] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.179s
I20260709 12:12:55.881415 21015 raft_consensus.cc:2804] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:55.863559 13685 raft_consensus.cc:2393] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 20: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:55.895542 14379 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:55.899468 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:55.896386 21015 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:55.925539 13683 raft_consensus.cc:1240] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 12:12:55.885083 20870 consensus_queue.cc:237] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:55.928956 21278 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:55.915302 20457 consensus_queue.cc:1048] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.015s
I20260709 12:12:55.930235 21014 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:55.925462 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:55.931012 21014 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:55.932044 21349 log.cc:927] Time spent T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 1.225s	user 0.035s	sys 0.011s
I20260709 12:12:55.932070 13682 raft_consensus.cc:2393] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 28: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:12:55.934557 13755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 3394) took 1942 ms. Trace:
I20260709 12:12:55.934715 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:55.935815 13682 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 19.
I20260709 12:12:55.934947 13755 rpcz_store.cc:276] 0709 12:12:53.992471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:53.992691 (+   220us) service_pool.cc:224] Handling call
0709 12:12:54.005571 (+ 12880us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:54.005849 (+   278us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:54.005872 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:54.006428 (+   556us) log.cc:844] Serialized 26 byte log entry
0709 12:12:54.154465 (+148037us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:54.154526 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:54.154639 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:55.931194 (+1776555us) spinlock_profiling.cc:243] Waited 1.98 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:12:55.934070 (+  2876us) raft_consensus.cc:1685] finished
0709 12:12:55.934091 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:55.934375 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4614912,"thread_start_us":147583,"threads_started":1,"wal-append.queue_time_us":634445}
I20260709 12:12:55.937067 21014 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:55.937170 21200 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:55.937464 21268 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:55.938251 21268 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:55.939695 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:55.940615 13828 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 20.
I20260709 12:12:55.941015 21268 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:55.936925 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:55.942366 13682 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:55.943051 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:55.942427 13578 catalog_manager.cc:5697] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 17 to 25. New cstate: current_term: 25 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:55.943981 13836 raft_consensus.cc:2393] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 22: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:55.899569 21376 raft_consensus.cc:2749] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:55.914937 21275 raft_consensus.cc:2804] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:55.946755 14380 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:12:55.958356 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:55.920219 21365 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:55.962531 13681 raft_consensus.cc:2393] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 20: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:55.945437 13578 catalog_manager.cc:5697] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:55.946973 21015 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:55.965742 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:12:55.980225 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 247895us
I20260709 12:12:55.959997 21275 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
W20260709 12:12:55.984915 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:55.976125 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 56405.2us
W20260709 12:12:55.988050 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 315929us
I20260709 12:12:55.995431 13687 raft_consensus.cc:1275] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:12:55.998953 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:55.988165 21275 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:56.001907 21123 raft_consensus.cc:2804] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:56.001943 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:56.002668 21123 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:56.003161 21123 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:56.004166 14379 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:56.007700 21231 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.008546 21231 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:56.009878 21348 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.010473 21373 raft_consensus.cc:2749] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:12:56.010704 21339 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:56.010172 13578 catalog_manager.cc:5697] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 14 to 15, leader changed from ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 15 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:12:56.011428 21231 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:56.013967 13833 raft_consensus.cc:1240] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:56.015901 20457 consensus_queue.cc:1059] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 12:12:56.016152 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 153938us
I20260709 12:12:56.017122 20457 raft_consensus.cc:3055] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:56.017623 20457 raft_consensus.cc:740] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:56.018951 20457 consensus_queue.cc:260] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:56.020610 20457 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:56.021051 21376 consensus_queue.cc:1048] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:12:55.987964 21306 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:56.023113 21306 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:56.010269 13651 leader_election.cc:400] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 election: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 19. Current term is 20.
I20260709 12:12:56.024430 13651 leader_election.cc:403] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
W20260709 12:12:56.025197 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:56.012604 13578 catalog_manager.cc:5697] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 15 to 18, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 18 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:56.025072 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:56.027904 21392 consensus_queue.cc:1048] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:56.034729 13685 raft_consensus.cc:1240] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 26 LEADER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 25. Current term is 26. Ops: [23.13-25.14]
I20260709 12:12:56.023730 21376 consensus_queue.cc:1048] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:56.012537 21254 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:56.026947 13651 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:12:55.995314 21387 log.cc:927] Time spent T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 12:12:56.039243 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 318712us
I20260709 12:12:56.039290 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:56.031754 13578 catalog_manager.cc:5697] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 13 to 16, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 16 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:56.045727 14416 raft_consensus.cc:2393] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 19: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
W20260709 12:12:56.041208 13579 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45620 (request call id 250) took 55437 ms (client timeout 15000 ms). Trace:
I20260709 12:12:56.056687 21393 raft_consensus.cc:2804] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:56.057219 21393 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:56.057569 21393 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:56.059983 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:56.060016 21278 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.060738 13685 raft_consensus.cc:2376] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 28. Re-sending same reply.
I20260709 12:12:56.061228 21278 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:56.062048 21348 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:56.064046 21278 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:56.064819 21348 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:56.064884 21389 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.065936 21254 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:56.054008 13579 rpcz_store.cc:269] 0709 12:12:00.596311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:00.598514 (+  2203us) service_pool.cc:224] Handling call
0709 12:12:56.017759 (+55419245us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:46.200168 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:46.456044 (+255876us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:46.465887 (+  9843us) write_op.cc:435] Acquired schema lock
0709 12:12:46.465913 (+    26us) tablet.cc:662] Decoding operations
0709 12:12:46.467581 (+  1668us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:46.467699 (+   118us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:46.467736 (+    37us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:12:46.469318 (+  1582us) tablet.cc:701] Row locks acquired
0709 12:12:46.469374 (+    56us) write_op.cc:260] PREPARE: finished
0709 12:12:46.469616 (+   242us) write_op.cc:270] Start()
0709 12:12:46.495739 (+ 26123us) write_op.cc:276] Timestamp: P: 1783599166469526 usec, L: 0
0709 12:12:46.497275 (+  1536us) op_driver.cc:348] REPLICATION: starting
0709 12:12:46.660558 (+163283us) log.cc:844] Serialized 5502 byte log entry
0709 12:12:46.820745 (+160187us) op_driver.cc:464] REPLICATION: finished
0709 12:12:46.949459 (+128714us) write_op.cc:301] APPLY: starting
0709 12:12:46.949613 (+   154us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:47.189988 (+240375us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:47.237526 (+ 47538us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:47.641626 (+404100us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:47.714432 (+ 72806us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=26,mrs_lookups=0
0709 12:12:47.754071 (+ 39639us) write_op.cc:312] APPLY: finished
0709 12:12:47.755187 (+  1116us) log.cc:844] Serialized 121 byte log entry
0709 12:12:47.756174 (+   987us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:47.756336 (+   162us) write_op.cc:454] Released schema lock
0709 12:12:47.756413 (+    77us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:47.756888 (+   475us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:47.756921 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1049085,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":128228,"apply.run_cpu_time_us":38792,"apply.run_wall_time_us":807437,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58467,"num_ops":13,"prepare.queue_time_us":336188,"prepare.run_cpu_time_us":38344,"prepare.run_wall_time_us":628147,"raft.queue_time_us":7813,"raft.run_cpu_time_us":84151,"raft.run_wall_time_us":120946,"replication_time_us":316405,"thread_start_us":457483,"threads_started":4,"wal-append.queue_time_us":148340,"wal-append.run_cpu_time_us":8336,"wal-append.run_wall_time_us":1974129}]]}
I20260709 12:12:56.066644 21389 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:56.069373 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:12:56.072989 13830 consensus_meta.cc:287] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.879s	user 0.015s	sys 0.008s
I20260709 12:12:56.072865 21335 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:56.075233 14414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41692 (request call id 1134) took 2882 ms. Trace:
I20260709 12:12:56.075769 13727 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:56.050127 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:56.082933 13837 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Advancing to term 27
W20260709 12:12:56.084111 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:56.086651 13651 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:56.091920 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:56.087661 14414 rpcz_store.cc:276] 0709 12:12:53.193098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:53.195421 (+  2323us) service_pool.cc:224] Handling call
0709 12:12:55.629121 (+2433700us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:55.630747 (+  1626us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:56.074940 (+444193us) spinlock_profiling.cc:243] Waited 2.43 s on lock 0x7b54006d01d0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:56.075152 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5595968256}
I20260709 12:12:56.082945 21042 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:56.103482 21389 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:56.095355 13651 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:56.103570 21042 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:56.090898 13686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 3488) took 1738 ms. Trace:
I20260709 12:12:56.098196 13682 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 20.
I20260709 12:12:56.099151 13800 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:56.100327 13578 catalog_manager.cc:5697] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:56.101194 13680 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:56.102056 13830 raft_consensus.cc:2410] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 25 because replica has last-logged OpId of term: 24 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 12.
I20260709 12:12:56.096175 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:56.105479 21078 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:56.114977 21394 raft_consensus.cc:2749] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 19. Current term is 20.
I20260709 12:12:56.116215 21306 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:56.118228 13830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54820 (request call id 3637) took 1028 ms. Trace:
I20260709 12:12:56.118871 13830 rpcz_store.cc:276] 0709 12:12:55.090014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:55.090128 (+   114us) service_pool.cc:224] Handling call
0709 12:12:56.118090 (+1027962us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:56.120472 21246 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.121387 21246 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:56.122501 13651 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:56.123775 21306 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:56.124042 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 72470.9us
I20260709 12:12:56.126345 21294 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:56.126546 14379 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:56.127113 21294 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:56.128084 21300 raft_consensus.cc:2804] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:56.128510 21300 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:56.128923 21300 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:56.132395 21294 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:56.125590 13800 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:56.136493 14379 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:56.099164 21376 raft_consensus.cc:2804] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:12:56.146973 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:56.107468 13686 rpcz_store.cc:276] 0709 12:12:54.352811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:54.352939 (+   128us) service_pool.cc:224] Handling call
0709 12:12:54.353271 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:54.353562 (+   291us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:12:54.715471 (+361909us) log.cc:844] Serialized 14 byte log entry
0709 12:12:56.030057 (+1314586us) log.cc:844] Serialized 14 byte log entry
0709 12:12:56.042648 (+ 12591us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:56.047803 (+  5155us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:56.047836 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:56.050589 (+  2753us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:56.090803 (+ 40214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16532,"prepare.queue_time_us":426554,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":1737,"raft.queue_time_us":44401,"raft.run_cpu_time_us":356,"raft.run_wall_time_us":8165,"thread_start_us":1490911,"threads_started":4,"wal-append.queue_time_us":444776}
W20260709 12:12:56.159426 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 110405us
I20260709 12:12:56.145347 21376 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:56.166303 20870 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.167164 20870 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:56.168704 21294 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:56.170015 21268 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:56.169610 21294 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:56.171528 21227 consensus_queue.cc:1048] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:12:56.175158 13680 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 19.
I20260709 12:12:56.177126 21197 raft_consensus.cc:2749] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:56.177953 21278 raft_consensus.cc:2764] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 12:12:56.177811 13578 catalog_manager.cc:5697] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 16 to 19. New cstate: current_term: 19 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:56.181672 13727 leader_election.cc:304] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:56.159060 21170 raft_consensus.cc:2749] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:12:56.186604 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 96985.4us
I20260709 12:12:56.184866 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:56.180282 13578 catalog_manager.cc:5697] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 20 to 26. New cstate: current_term: 26 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:12:56.161734 21376 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:56.150226 21015 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:56.207114 13578 catalog_manager.cc:5697] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:56.222038 21243 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.223021 21243 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:56.226130 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 89764.5us
I20260709 12:12:56.176627 21294 leader_election.cc:290] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:56.229833 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 104489us
I20260709 12:12:56.186847 21122 raft_consensus.cc:2804] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:12:56.161437 21123 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:56.234794 21170 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.235209 14415 raft_consensus.cc:2393] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 20: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:12:56.212206 21197 raft_consensus.cc:2749] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:56.236338 21015 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:56.258612 13578 catalog_manager.cc:5697] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:12:56.266312 14379 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:56.232578 21122 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:56.248689 21294 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.285043 21012 raft_consensus.cc:2804] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:56.285914 21012 raft_consensus.cc:697] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 18 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:56.262511 21339 raft_consensus.cc:2749] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:56.283551 13800 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:56.268571 21015 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.273720 21122 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:56.307637 13726 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:56.308125 21012 consensus_queue.cc:237] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:56.310477 21330 raft_consensus.cc:2804] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:56.310948 21330 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:56.311285 21330 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:56.318869 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 137350us
I20260709 12:12:56.309402 13726 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:56.320428 21015 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:56.326165 20679 consensus_queue.cc:1059] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:56.326440 13578 catalog_manager.cc:5697] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 16 to 17, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 17 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:56.271445 21170 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:56.265632 21393 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:56.329674 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 119690us
I20260709 12:12:56.331024 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:56.332037 13833 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 21.
W20260709 12:12:56.338308 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 83543.5us
I20260709 12:12:56.326483 21015 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:56.345589 14379 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:56.339399 21197 raft_consensus.cc:2804] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:56.350095 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:56.351651 21197 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:56.328939 21294 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:56.351929 13833 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 20.
I20260709 12:12:56.341662 21243 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:56.360219 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:56.354115 13578 catalog_manager.cc:5697] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:12:56.355353 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 85903.6us
I20260709 12:12:56.353267 21350 consensus_queue.cc:1059] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 12:12:56.341459 21231 raft_consensus.cc:2804] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:56.361588 13578 catalog_manager.cc:5697] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:56.352130 21197 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:56.377008 21391 consensus_queue.cc:1048] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 12:12:56.347874 21300 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:56.380005 13727 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:56.367571 21348 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:56.393697 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:56.393886 21348 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:56.394600 14414 raft_consensus.cc:2368] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 26. Current term is 27.
I20260709 12:12:56.395808 21042 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:56.396528 21348 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:56.397212 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:56.399322 13830 raft_consensus.cc:1240] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:56.400668 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:56.402395 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:56.403170 13829 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 20.
I20260709 12:12:56.403805 21227 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.404381 21227 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:56.400795 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:56.367750 21231 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:56.405997 21231 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:56.415063 20870 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:56.416169 13800 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:56.416471 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:56.416975 21246 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:56.401671 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:56.417737 21246 raft_consensus.cc:2749] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:56.422784 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:56.418527 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:56.424768 13834 raft_consensus.cc:2393] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 20: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:56.377681 21123 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 21 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:56.425686 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:56.426227 13830 raft_consensus.cc:1240] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:56.426625 13756 raft_consensus.cc:2410] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 21 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 12:12:56.397164 21348 raft_consensus.cc:2804] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:56.419441 13800 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:56.422086 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:56.422142 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:56.422444 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:56.420612 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:56.421758 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:56.420183 21347 raft_consensus.cc:3055] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:56.433859 21347 raft_consensus.cc:740] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:56.434859 13829 raft_consensus.cc:2393] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 17: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:56.376196 21339 raft_consensus.cc:2804] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:12:56.437242 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 55151.5us
W20260709 12:12:56.444270 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 60187.1us
I20260709 12:12:56.435467 13578 catalog_manager.cc:5697] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:56.454866 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:56.457628 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:56.457456 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:56.460816 13830 raft_consensus.cc:2393] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 20: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:56.459542 13762 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 20.
I20260709 12:12:56.461627 13828 raft_consensus.cc:2393] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 20: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:56.460196 14414 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 20.
I20260709 12:12:56.436033 21306 raft_consensus.cc:2749] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:56.435789 21348 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:56.439924 21339 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:56.456143 21246 raft_consensus.cc:2749] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:56.479570 13578 catalog_manager.cc:5697] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 18 to 20, leader changed from ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 20 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:12:56.475365 13726 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:56.470638 21348 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:56.499572 21294 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:56.500034 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:56.474699 21339 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:56.508085 14380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:56.481557 21170 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:12:56.510910 21365 consensus_meta.cc:287] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.546s	user 0.007s	sys 0.006s
I20260709 12:12:56.530150 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:12:56.528358 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 109086us
I20260709 12:12:56.513581 20679 raft_consensus.cc:2804] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:56.534168 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:12:56.543630 21275 consensus_meta.cc:287] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.541s	user 0.008s	sys 0.005s
I20260709 12:12:56.544129 21275 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:56.548851 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:12:56.551460 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:56.537847 14380 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:56.540874 13829 raft_consensus.cc:1275] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 10. (term mismatch)
I20260709 12:12:56.557015 14380 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:56.552362 14379 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:56.555066 13829 pending_rounds.cc:85] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 9
W20260709 12:12:56.557928 21402 log.cc:927] Time spent T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.190s	user 0.000s	sys 0.002s
I20260709 12:12:56.562072 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:56.562434 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:56.562703 13763 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:56.563127 13754 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 25.
I20260709 12:12:56.570086 21373 raft_consensus.cc:3055] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:56.570670 21373 raft_consensus.cc:740] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:56.570788 13763 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 23.
I20260709 12:12:56.576890 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:56.583514 21373 consensus_queue.cc:260] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:56.588245 13800 leader_election.cc:400] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 pre-election: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 21. Current term is 22.
I20260709 12:12:56.588666 13800 leader_election.cc:403] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:56.589986 21365 raft_consensus.cc:2749] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 21. Current term is 22.
I20260709 12:12:56.555435 21393 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:56.569128 21231 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:56.583621 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:56.600378 13837 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 27.
I20260709 12:12:56.559336 13829 pending_rounds.cc:107] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 19.10
I20260709 12:12:56.602185 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:12:56.598274 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 73063us
I20260709 12:12:56.551614 21370 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.602216 13829 raft_consensus.cc:2889] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:56.613209 13763 raft_consensus.cc:1275] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 26 index: 13. (term mismatch)
I20260709 12:12:56.615087 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:56.615974 13837 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 23.
I20260709 12:12:56.594588 21243 raft_consensus.cc:2804] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:56.613672 13763 pending_rounds.cc:85] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting all ops after (but not including) 12
I20260709 12:12:56.617656 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:56.600028 20457 raft_consensus.cc:2804] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:56.613721 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:56.630898 13763 pending_rounds.cc:107] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting uncommitted NO_OP operation due to leader change: 23.13
I20260709 12:12:56.631230 13763 raft_consensus.cc:2889] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:56.599434 21227 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:56.632364 14416 raft_consensus.cc:2393] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 28: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:12:56.601255 20679 raft_consensus.cc:697] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:56.628158 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:56.521988 21347 consensus_queue.cc:260] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:56.633956 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:56.645215 14408 raft_consensus.cc:2410] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 19 because replica has last-logged OpId of term: 18 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 15.
I20260709 12:12:56.645866 13837 raft_consensus.cc:2393] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 19: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:56.631923 13763 pending_rounds.cc:107] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting uncommitted NO_OP operation due to leader change: 25.14
I20260709 12:12:56.646608 13763 raft_consensus.cc:2889] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:56.638062 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:56.647825 13830 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 20.
I20260709 12:12:56.638825 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:56.636039 13651 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:56.599830 21214 consensus_queue.cc:1048] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 12:12:56.649576 14409 raft_consensus.cc:2468] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 17.
I20260709 12:12:56.630693 20457 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:56.659808 13828 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 17.
I20260709 12:12:56.633757 21300 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:56.638859 21078 consensus_meta.cc:287] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.502s	user 0.008s	sys 0.002s
W20260709 12:12:56.676046 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 73929.9us
I20260709 12:12:56.673592 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:56.677364 14410 raft_consensus.cc:1240] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:56.677007 13829 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 20.
I20260709 12:12:56.651363 20870 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:12:56.674978 13651 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:56.648000 21243 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:56.660374 21385 raft_consensus.cc:2804] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:56.682612 13755 raft_consensus.cc:1275] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 13. (term mismatch)
I20260709 12:12:56.686837 13755 pending_rounds.cc:85] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting all ops after (but not including) 12
I20260709 12:12:56.687105 13755 pending_rounds.cc:107] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting uncommitted NO_OP operation due to leader change: 21.13
I20260709 12:12:56.687356 13755 raft_consensus.cc:2889] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:12:56.683207 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 131906us
I20260709 12:12:56.683832 14413 raft_consensus.cc:1240] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 20. Current term is 21. Ops: []
W20260709 12:12:56.685269 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:56.614233 21370 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:56.667572 21275 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 21 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:56.673534 20457 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:56.690521 13651 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:56.704056 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:56.704859 13831 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 25.
I20260709 12:12:56.706475 20679 consensus_queue.cc:237] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:56.715288 21394 raft_consensus.cc:2804] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:12:56.715996 21394 raft_consensus.cc:697] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 23 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:56.717001 21394 consensus_queue.cc:237] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:56.717947 21122 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:56.720332 14380 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:56.685345 21243 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:56.686656 21385 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:56.724574 14379 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
W20260709 12:12:56.738819 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 182941us
I20260709 12:12:56.740530 13758 raft_consensus.cc:2410] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 23 because replica has last-logged OpId of term: 21 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 12:12:56.690075 21389 raft_consensus.cc:2804] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:12:56.689555 20870 raft_consensus.cc:697] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 28 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:56.756048 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:56.758464 13727 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:56.760210 14410 raft_consensus.cc:1240] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:56.761276 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:56.762327 21042 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:56.762862 21042 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:56.763469 13832 raft_consensus.cc:1240] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:56.765416 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:56.766053 13683 raft_consensus.cc:1275] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:12:56.766433 13688 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:56.767547 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:56.766091 21015 raft_consensus.cc:2804] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:56.768769 21015 raft_consensus.cc:697] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 19 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:56.769995 21231 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:56.769754 21015 consensus_queue.cc:237] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:56.765075 21042 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:56.773494 21012 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.774044 21012 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:56.775364 21197 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:56.753551 21385 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:56.776551 21012 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:56.779383 14379 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:56.780941 21254 raft_consensus.cc:2804] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:56.781366 21254 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:56.781708 21254 raft_consensus.cc:3060] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:56.782116 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:56.782625 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:56.782898 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:56.784602 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:12:56.784703 21376 consensus_meta.cc:287] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.532s	user 0.003s	sys 0.006s
I20260709 12:12:56.785956 21376 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:56.786345 21122 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:56.786643 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:12:56.802525 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 116194us
I20260709 12:12:56.802771 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:56.802515 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:56.812502 21416 raft_consensus.cc:2749] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:56.812214 20870 consensus_queue.cc:237] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.17, Last appended by leader: 17, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:56.813249 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:56.813621 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:56.814596 13754 raft_consensus.cc:2410] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for term 23 because replica has last-logged OpId of term: 22 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 15.
W20260709 12:12:56.812197 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 58956.9us
I20260709 12:12:56.817106 13836 raft_consensus.cc:1275] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 15. (term mismatch)
I20260709 12:12:56.817667 13836 pending_rounds.cc:85] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 14
I20260709 12:12:56.817977 13836 pending_rounds.cc:107] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 17.15
I20260709 12:12:56.818274 13836 raft_consensus.cc:2889] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:56.804351 13681 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 25.
I20260709 12:12:56.820151 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:56.820835 13756 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Advancing to term 27
I20260709 12:12:56.821576 13688 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 22.
I20260709 12:12:56.821766 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:56.755293 21389 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:56.827054 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:56.827900 13686 raft_consensus.cc:2393] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 20: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:56.828815 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:56.824488 21231 consensus_queue.cc:1059] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.006s
I20260709 12:12:56.788234 21123 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:12:56.830775 21123 raft_consensus.cc:697] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 27 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:56.830886 21231 raft_consensus.cc:3055] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:56.831363 21231 raft_consensus.cc:740] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:56.831760 21123 consensus_queue.cc:237] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:56.832252 21231 consensus_queue.cc:260] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:56.832940 21373 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:56.800326 21347 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:56.835886 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:56.836659 13758 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 20.
I20260709 12:12:56.757130 21393 consensus_queue.cc:1048] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.081s
I20260709 12:12:56.841519 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:56.837625 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:56.788079 21376 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:12:56.815186 21330 consensus_meta.cc:287] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.503s	user 0.010s	sys 0.003s
I20260709 12:12:56.845229 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:56.850965 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:56.846077 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:56.849507 13760 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 19.
I20260709 12:12:56.870626 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:56.874409 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:56.875625 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:56.874471 21278 consensus_queue.cc:1048] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
W20260709 12:12:56.883914 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:56.887858 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:56.844372 21231 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:56.841463 21389 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:12:56.897174 14413 raft_consensus.cc:1240] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:56.901949 13832 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 21.
I20260709 12:12:56.920286 13800 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:56.921993 13800 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:56.922883 21410 raft_consensus.cc:2804] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:56.924533 14380 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:56.934150 13726 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:56.857925 21330 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:56.852150 21339 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:56.947820 13800 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:56.950289 21350 consensus_queue.cc:1048] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 12:12:56.923350 21410 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:56.959579 13727 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:56.935905 21078 consensus_queue.cc:1059] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 23.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.018s
W20260709 12:12:56.977196 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:56.971789 13756 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 27.
I20260709 12:12:56.943199 21365 raft_consensus.cc:2749] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:57.002547 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:57.003681 13652 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:12:57.010556 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:57.012965 14415 raft_consensus.cc:1240] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:57.015157 13652 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:56.990705 21410 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:56.936031 21015 consensus_queue.cc:1048] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.067s
W20260709 12:12:57.025825 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 88864.8us
I20260709 12:12:57.028947 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:57.056550 13688 raft_consensus.cc:1275] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
W20260709 12:12:57.100431 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 177042us
I20260709 12:12:57.103410 14413 raft_consensus.cc:2393] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 20: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:12:57.013548 21294 raft_consensus.cc:2749] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:57.018268 21227 raft_consensus.cc:2749] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:57.019223 21122 raft_consensus.cc:2749] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:57.055007 21417 log.cc:927] Time spent T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:12:57.141213 21339 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:57.142585 21042 consensus_queue.cc:1059] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:12:57.088557 21197 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:57.144951 21278 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.148595 13800 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:57.056334 21348 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:57.028175 21414 raft_consensus.cc:2749] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:12:57.119753 21421 log.cc:927] Time spent T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 12:12:57.154529 21385 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:57.225092 21348 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:57.227197 21385 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:57.228133 13682 raft_consensus.cc:2393] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 21: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:57.228232 21243 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:57.230235 13761 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:57.229928 21278 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:57.232999 21278 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:57.234303 21370 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:57.156303 21420 log.cc:927] Time spent T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 12:12:57.024083 21170 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:57.157290 21330 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:57.119681 21055 consensus_queue.cc:1048] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.096s
I20260709 12:12:57.162457 13757 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 25.
W20260709 12:12:57.169790 21398 log.cc:927] Time spent T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:12:57.169632 21254 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:57.169634 20457 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:57.224598 21200 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:57.241386 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 72245.4us
W20260709 12:12:57.240242 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 209758us
W20260709 12:12:57.306972 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 158744us
W20260709 12:12:57.243637 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 216478us
W20260709 12:12:57.277451 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:57.308538 13652 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:57.310712 13761 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 20.
I20260709 12:12:57.315836 21394 raft_consensus.cc:2749] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:57.317111 21254 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199)
W20260709 12:12:57.318312 13652 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 3.032s (SENT) [suppressed 16 similar messages]
W20260709 12:12:57.322731 21424 log.cc:927] Time spent T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.218s	user 0.003s	sys 0.000s
I20260709 12:12:57.326916 14408 raft_consensus.cc:1240] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 17. Current term is 18. Ops: [17.15-17.15]
I20260709 12:12:57.329151 13800 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:57.331673 20457 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 21 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:57.241988 21170 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:57.333990 21231 raft_consensus.cc:2804] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:57.312665 21200 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:57.334647 21231 raft_consensus.cc:697] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 20 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:57.246840 21227 raft_consensus.cc:2749] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:57.335619 21231 consensus_queue.cc:237] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:57.336992 21200 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:57.245929 21413 raft_consensus.cc:2804] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:12:57.334647 21170 leader_election.cc:290] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:12:57.359889 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 51578us
I20260709 12:12:57.360970 14379 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
W20260709 12:12:57.365177 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 47449.9us
I20260709 12:12:57.363054 21300 raft_consensus.cc:2804] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 12:12:57.374773 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 68070.8us
I20260709 12:12:57.372859 21394 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:57.364794 21015 raft_consensus.cc:2804] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:57.381210 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:57.382128 13831 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:57.372503 21410 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:57.390825 21410 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:57.378261 21394 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:57.394164 21015 raft_consensus.cc:697] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 22 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:57.395306 21015 consensus_queue.cc:237] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:57.351436 21389 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:57.399441 14379 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:57.400727 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:57.401398 13829 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 19.
I20260709 12:12:57.393651 21394 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:57.405558 14379 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:57.406131 21367 raft_consensus.cc:2749] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:57.417237 20679 raft_consensus.cc:3055] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:12:57.417749 20679 raft_consensus.cc:740] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:57.418766 20679 consensus_queue.cc:260] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:57.419993 21300 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:57.420674 21300 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:57.421059 21328 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.421626 21328 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:57.420125 20679 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:57.425921 14380 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:12:57.440301 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:57.447228 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:57.447999 13833 raft_consensus.cc:1275] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:12:57.449990 13679 raft_consensus.cc:1275] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:12:57.430332 21200 raft_consensus.cc:2749] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:12:57.453075 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:57.454790 13829 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 20.
I20260709 12:12:57.453836 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:57.456401 21328 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:57.462404 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 147131us
I20260709 12:12:57.465260 13833 raft_consensus.cc:1275] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:12:57.451447 21339 raft_consensus.cc:2804] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:57.471932 13831 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 21.
I20260709 12:12:57.474881 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:57.476289 13829 raft_consensus.cc:2393] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 17: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:57.450742 21437 consensus_queue.cc:1059] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.023s
I20260709 12:12:57.482287 21376 raft_consensus.cc:3055] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:57.482726 21376 raft_consensus.cc:740] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:57.485095 13727 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:57.486652 21197 raft_consensus.cc:2749] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:12:57.483829 21376 consensus_queue.cc:260] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:57.487637 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:57.491279 13833 raft_consensus.cc:2368] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 21. Current term is 22.
I20260709 12:12:57.488708 21376 raft_consensus.cc:3060] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:57.466970 21339 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:57.515234 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:57.516166 13836 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 22.
I20260709 12:12:57.518289 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:57.518456 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:57.518676 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:57.519109 13829 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 22.
I20260709 12:12:57.519531 13828 raft_consensus.cc:2393] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 17: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:57.519764 21328 consensus_queue.cc:1059] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:12:57.519380 13834 raft_consensus.cc:2393] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 25: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:57.521152 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:57.522573 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:57.523207 13833 raft_consensus.cc:2368] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 19. Current term is 20.
I20260709 12:12:57.504149 21339 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:57.526662 13828 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 19.
I20260709 12:12:57.518697 21243 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:57.526099 21414 raft_consensus.cc:3055] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:57.530306 21414 raft_consensus.cc:740] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:57.530385 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:57.533056 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:57.533950 13829 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:57.534063 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:57.534868 21413 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:57.535336 21413 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:12:57.535449 13836 raft_consensus.cc:1275] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:12:57.535703 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:57.535449 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:57.531265 21414 consensus_queue.cc:260] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:57.538740 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:57.539544 21414 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:57.540004 14379 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:57.543893 13682 raft_consensus.cc:1275] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 28 index: 18. (index mismatch)
I20260709 12:12:57.544430 21294 raft_consensus.cc:3055] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:57.541579 14379 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:57.549067 13829 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 22.
I20260709 12:12:57.544855 21294 raft_consensus.cc:740] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:57.550038 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:57.556555 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:57.556860 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:57.557677 13763 raft_consensus.cc:2393] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 17: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:57.558776 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:57.561479 21389 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:57.564178 13760 raft_consensus.cc:1240] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 12:12:57.564283 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:57.565158 21200 raft_consensus.cc:2804] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:57.565356 13727 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:57.565867 21200 raft_consensus.cc:697] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 20 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:57.566012 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:57.567593 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:57.568559 13836 raft_consensus.cc:2410] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 23 because replica has last-logged OpId of term: 21 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 12:12:57.568813 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:57.567188 21200 consensus_queue.cc:237] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:57.569437 13833 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 20.
I20260709 12:12:57.571909 13836 raft_consensus.cc:1275] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 26 index: 13. (index mismatch)
I20260709 12:12:57.571966 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:57.573258 21452 raft_consensus.cc:2749] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:57.572642 21328 consensus_queue.cc:1059] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:57.574502 21328 raft_consensus.cc:3055] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:57.574887 21328 raft_consensus.cc:740] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:57.574165 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:57.577088 13727 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:57.575668 13829 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 25.
I20260709 12:12:57.592825 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:57.592545 21294 consensus_queue.cc:260] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:57.593358 13829 raft_consensus.cc:2376] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 22. Re-sending same reply.
I20260709 12:12:57.593861 21294 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:57.594216 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:57.594899 13829 raft_consensus.cc:2368] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 21. Current term is 22.
I20260709 12:12:57.595628 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:57.596145 13829 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 20.
I20260709 12:12:57.596881 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:57.575924 21328 consensus_queue.cc:260] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:57.598738 21328 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:12:57.580554 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:57.603535 21416 raft_consensus.cc:2749] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:57.582553 14415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41700 (request call id 1118) took 1189 ms. Trace:
I20260709 12:12:57.606881 14415 rpcz_store.cc:276] 0709 12:12:56.392755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:56.402178 (+  9423us) service_pool.cc:224] Handling call
0709 12:12:56.402471 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:57.020719 (+618248us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:57.582305 (+561586us) spinlock_profiling.cc:243] Waited 597 ms on lock 0x7b5400554954. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:57.582468 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1372913024}
I20260709 12:12:57.586434 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:57.608528 13837 raft_consensus.cc:2393] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 24: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:57.586798 13831 raft_consensus.cc:1275] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
I20260709 12:12:57.587616 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:57.608528 21275 consensus_queue.cc:1048] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:57.588428 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:57.609752 13833 raft_consensus.cc:2393] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 17: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:57.588613 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:57.603680 13727 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:57.610559 13755 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 24.
I20260709 12:12:57.610803 13835 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:57.589177 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:57.611812 13830 raft_consensus.cc:2368] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 19. Current term is 20.
I20260709 12:12:57.565419 13651 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:57.610128 13836 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 25.
I20260709 12:12:57.541724 21243 raft_consensus.cc:2749] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 12:12:57.617738 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 52389.7us
I20260709 12:12:57.590827 13834 raft_consensus.cc:1275] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:12:57.591545 14380 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:57.579622 21012 consensus_queue.cc:1048] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:12:57.624569 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:57.619349 13727 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:57.627170 13727 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:57.619472 13651 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:57.629258 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:57.630384 13831 raft_consensus.cc:2393] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 21: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:57.632648 13727 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
W20260709 12:12:57.634977 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 43538.6us
I20260709 12:12:57.639880 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:57.643203 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:57.635850 14380 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:57.645612 13685 raft_consensus.cc:1240] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 17. Current term is 18. Ops: [17.15-17.15]
I20260709 12:12:57.646562 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:57.647151 13755 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:57.649309 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:57.652518 13679 raft_consensus.cc:2393] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 17: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:57.649639 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:57.655298 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:57.655556 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:57.656148 13685 raft_consensus.cc:2393] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 20: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:57.657025 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:57.657658 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:57.653005 21431 raft_consensus.cc:2804] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:57.659206 21431 raft_consensus.cc:697] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 21 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:57.659614 13833 raft_consensus.cc:2393] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 25: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:57.649878 21122 raft_consensus.cc:2804] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:12:57.660190 21431 consensus_queue.cc:237] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:57.660929 21122 raft_consensus.cc:697] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 25 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:57.642050 21373 raft_consensus.cc:2804] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:57.662132 21373 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:57.662365 21445 raft_consensus.cc:2804] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:57.662590 21373 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:57.623500 20679 raft_consensus.cc:2804] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:57.663020 21445 raft_consensus.cc:697] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 22 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:12:57.663367 20679 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:57.663803 20679 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:57.664006 21445 consensus_queue.cc:237] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:57.665623 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:57.658511 21214 raft_consensus.cc:2804] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:57.679461 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:57.680954 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:57.681682 13759 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:57.635329 21370 raft_consensus.cc:2804] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:57.629058 21437 raft_consensus.cc:2749] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:57.691075 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:57.692029 13687 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:57.699455 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:57.704077 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:57.705024 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:57.707728 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:57.634334 21416 consensus_queue.cc:1048] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 12:12:57.674613 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:57.634536 21015 consensus_queue.cc:1048] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.055s
I20260709 12:12:57.705801 13830 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 22.
I20260709 12:12:57.676076 21214 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:57.738253 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:57.738492 21214 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:57.739642 13757 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25896261d1204b3d858fb5b478a89034"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:12:57.740522 13757 raft_consensus.cc:606] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 LEADER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:57.741115 21373 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:57.748737 13758 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 22.
I20260709 12:12:57.750725 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:57.751808 13758 raft_consensus.cc:2410] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 12:12:57.753226 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:57.753856 13829 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:57.753983 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:57.755901 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:57.756628 13830 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 22.
I20260709 12:12:57.755481 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:57.672217 13835 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 23.
I20260709 12:12:57.713060 13727 leader_election.cc:400] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 26. Current term is 27.
I20260709 12:12:57.771001 13727 leader_election.cc:403] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:57.689149 21370 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:57.674526 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:57.774312 13831 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:57.717232 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:57.721451 13836 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 22.
I20260709 12:12:57.725015 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:57.690994 21243 consensus_queue.cc:1048] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.035s
I20260709 12:12:57.778143 13834 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 22.
I20260709 12:12:57.730108 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:57.718106 21122 consensus_queue.cc:237] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:57.779874 13687 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 22.
I20260709 12:12:57.781545 13759 raft_consensus.cc:2410] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 19 because replica has last-logged OpId of term: 18 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 15.
I20260709 12:12:57.778095 13755 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 22.
I20260709 12:12:57.737557 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:57.784265 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:57.784751 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:57.784936 13761 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 19.
I20260709 12:12:57.785385 13759 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Advancing to term 21
I20260709 12:12:57.784269 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:12:57.738276 21459 log.cc:927] Time spent T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 12:12:57.786834 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:57.787989 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:57.789556 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:57.790973 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:57.790997 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:57.793660 13756 raft_consensus.cc:2393] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 21: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:57.793912 13833 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:12:57.794968 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:57.796758 13832 raft_consensus.cc:1275] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:12:57.796856 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:57.799121 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:57.799998 13763 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 25.
I20260709 12:12:57.691314 21413 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:57.802821 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 89904.4us
I20260709 12:12:57.803682 13727 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:57.810083 13762 raft_consensus.cc:2393] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 26: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
W20260709 12:12:57.823271 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:57.789244 21370 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:57.837487 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:57.832988 14379 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:57.845813 13680 raft_consensus.cc:2393] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 26: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:57.738536 21300 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:57.809528 21413 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:57.857016 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:57.870991 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:57.871284 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:57.874830 13760 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 20.
I20260709 12:12:57.870430 13831 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 21.
W20260709 12:12:57.878446 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 74853.2us
I20260709 12:12:57.879598 13727 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:57.801388 21373 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:57.805270 21414 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.891527 13759 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 21.
I20260709 12:12:57.894732 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:57.895110 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:57.877676 13800 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:57.899777 13727 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:57.902724 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:57.903095 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:57.903600 13758 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:12:57.910936 13683 raft_consensus.cc:2410] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 21 because replica has last-logged OpId of term: 19 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
W20260709 12:12:57.912300 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 69138us
I20260709 12:12:57.913451 13652 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:57.919123 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:57.919477 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:57.920395 13757 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 22.
I20260709 12:12:57.921643 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:57.922646 13680 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 22.
I20260709 12:12:57.924332 14415 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3f29dda715314a93a03981264972c4c3"
dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:46814
I20260709 12:12:57.925138 14415 raft_consensus.cc:606] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 18 LEADER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:57.927067 14409 raft_consensus.cc:1240] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 21. Current term is 22. Ops: []
W20260709 12:12:57.930877 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 98027.8us
I20260709 12:12:57.934515 13652 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:57.938381 13829 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 21.
I20260709 12:12:57.842187 21376 consensus_queue.cc:1048] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.082s
I20260709 12:12:57.896064 21078 raft_consensus.cc:2764] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 12:12:57.941763 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:57.947167 14379 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:57.943838 21410 raft_consensus.cc:2749] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:12:57.943931 13652 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:12:57.930275 21459 log.cc:927] Time spent T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:12:57.843201 21394 consensus_queue.cc:1048] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.090s
I20260709 12:12:57.916914 21328 raft_consensus.cc:2749] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:12:57.839305 21339 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:57.958544 13652 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:57.960909 13755 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Advancing to term 28
W20260709 12:12:57.961018 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 61372.9us
I20260709 12:12:57.941172 21042 raft_consensus.cc:2749] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 12:12:57.967056 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 104531us
W20260709 12:12:57.967682 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:57.985699 13758 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 26.
I20260709 12:12:57.994556 13727 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:58.001677 13727 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:58.003160 21413 raft_consensus.cc:2804] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:58.003733 21413 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:58.004200 21413 raft_consensus.cc:3060] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:58.004709 21373 raft_consensus.cc:2749] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:58.005689 21373 consensus_queue.cc:1059] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:58.006004 21416 consensus_queue.cc:1059] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:12:58.007308 21373 raft_consensus.cc:3055] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 LEADER]: Stepping down as leader of term 20
W20260709 12:12:57.998143 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:57.966162 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:58.009366 13680 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 25.
I20260709 12:12:57.997483 13652 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:57.943261 21055 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:58.014406 13652 leader_election.cc:304] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:58.007843 21373 raft_consensus.cc:740] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:58.017361 13756 raft_consensus.cc:1240] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:57.963482 21393 raft_consensus.cc:2749] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:57.955360 21231 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:58.041486 13682 raft_consensus.cc:2393] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 17: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:57.906656 21414 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:58.041155 13754 raft_consensus.cc:1275] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:12:58.044507 13652 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:58.041883 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:12:58.018009 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 70919.5us
I20260709 12:12:58.077709 13800 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:58.092861 13755 raft_consensus.cc:1275] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 28 index: 18. (index mismatch)
I20260709 12:12:58.016156 20457 raft_consensus.cc:2749] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:58.018005 21437 raft_consensus.cc:2749] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:58.017935 21389 raft_consensus.cc:2749] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:12:58.114174 13829 raft_consensus.cc:1275] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:12:58.066351 21331 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.116263 21451 raft_consensus.cc:2749] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader pre-election lost for term 26. Reason: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 26. Current term is 27.
I20260709 12:12:58.116832 21434 raft_consensus.cc:2804] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:58.116888 21436 consensus_queue.cc:1048] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.176s
I20260709 12:12:58.096022 21452 raft_consensus.cc:2749] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:12:58.097762 21042 raft_consensus.cc:2804] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:12:58.135035 13763 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:58.147428 13755 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:12:58.151371 13755 raft_consensus.cc:606] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:58.151849 13755 raft_consensus.cc:614] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:58.013171 21122 consensus_queue.cc:1048] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.101s
I20260709 12:12:58.158113 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:58.082182 21410 consensus_queue.cc:1059] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.055s
I20260709 12:12:58.155042 13757 raft_consensus.cc:1275] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
I20260709 12:12:58.174019 21445 consensus_queue.cc:1048] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.004s
W20260709 12:12:58.179666 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 135250us
I20260709 12:12:58.181053 13688 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 22.
I20260709 12:12:58.133136 21227 raft_consensus.cc:2804] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:12:58.136792 21434 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:58.195549 13652 leader_election.cc:400] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 election: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 21. Current term is 22.
I20260709 12:12:58.104542 21231 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:58.201520 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 88846us
I20260709 12:12:58.154700 21042 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:58.221410 13652 leader_election.cc:403] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 12:12:58.234426 13800 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:12:58.197395 21294 consensus_meta.cc:287] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.603s	user 0.008s	sys 0.006s
I20260709 12:12:58.146399 21331 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:58.234004 21466 log.cc:927] Time spent T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 12:12:58.231843 21042 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:12:58.230370 21434 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:58.260186 13763 raft_consensus.cc:1275] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:12:58.233935 21170 raft_consensus.cc:3055] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:58.198107 21373 consensus_queue.cc:260] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:58.246050 21300 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:58.274626 21170 raft_consensus.cc:740] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:58.278142 21339 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:58.279068 21470 raft_consensus.cc:2749] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:58.279358 21328 raft_consensus.cc:3055] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:58.279775 21328 raft_consensus.cc:740] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:58.280767 21328 consensus_queue.cc:260] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:58.283407 21331 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:58.283622 21393 raft_consensus.cc:2804] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:58.284240 21393 raft_consensus.cc:697] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 22 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
W20260709 12:12:58.285391 21468 log.cc:927] Time spent T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:12:58.286666 21170 consensus_queue.cc:260] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:58.288110 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 97801.7us
I20260709 12:12:58.288357 21170 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:58.288928 13652 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:58.290170 21294 raft_consensus.cc:2749] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 21. Current term is 22.
I20260709 12:12:58.291046 21294 raft_consensus.cc:2804] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:58.291437 21294 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:58.291837 21294 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:58.294615 13652 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:58.296398 21389 raft_consensus.cc:2749] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:58.297063 13652 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:58.302014 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:58.302284 21394 raft_consensus.cc:2749] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:58.303275 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:58.297683 21470 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.304399 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:58.304565 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:58.304234 21470 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:58.305135 13686 raft_consensus.cc:2368] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 19. Current term is 20.
I20260709 12:12:58.306007 13682 raft_consensus.cc:1275] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:12:58.306697 21470 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:58.299064 21231 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:12:58.308320 21460 log.cc:927] Time spent T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 12:12:58.285281 21393 consensus_queue.cc:237] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:58.313009 21370 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:58.314188 13760 raft_consensus.cc:1240] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:58.314956 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:58.315774 14408 raft_consensus.cc:2393] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 21: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:12:58.315657 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:58.300374 13759 raft_consensus.cc:1275] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
W20260709 12:12:58.274564 21462 log.cc:927] Time spent T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
W20260709 12:12:58.322011 13833 consensus_meta.cc:287] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.528s	user 0.005s	sys 0.005s
I20260709 12:12:58.322695 13833 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 26.
I20260709 12:12:58.293507 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:58.327975 13652 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:58.334029 13652 leader_election.cc:400] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 election: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 19. Current term is 20.
W20260709 12:12:58.334190 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 330245us
I20260709 12:12:58.337427 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:58.338160 13727 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:58.338265 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:58.338825 13830 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:12:58.339128 13727 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
W20260709 12:12:58.350626 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:58.332516 13651 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:58.370855 13651 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:58.373427 13727 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:58.261637 21444 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:58.384712 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 50818.3us
I20260709 12:12:58.386251 13652 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:58.391572 13836 raft_consensus.cc:1240] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 20. Current term is 21. Ops: [20.10-20.10]
W20260709 12:12:58.399632 21465 log.cc:927] Time spent T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 12:12:58.411175 21414 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:58.409054 21227 raft_consensus.cc:697] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 24 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:58.417414 21227 consensus_queue.cc:237] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:58.379633 21391 raft_consensus.cc:2749] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:58.379062 21389 raft_consensus.cc:2804] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:12:58.428970 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 58205.6us
I20260709 12:12:58.383582 21331 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:58.408191 21214 consensus_meta.cc:287] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.663s	user 0.013s	sys 0.000s
I20260709 12:12:58.387425 21479 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:12:58.443701 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 57523.4us
I20260709 12:12:58.445206 13652 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:12:58.446585 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 224168us
I20260709 12:12:58.449173 13652 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:58.432292 21389 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:58.401064 21444 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:58.542303 21483 raft_consensus.cc:2804] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:58.441166 21370 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:58.450160 21436 consensus_queue.cc:1048] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.099s
I20260709 12:12:58.550598 13830 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 26.
I20260709 12:12:58.554385 21437 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:58.554258 21476 consensus_queue.cc:1048] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.104s
I20260709 12:12:58.555060 13800 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:58.554752 21294 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:58.560014 21413 consensus_meta.cc:287] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.555s	user 0.011s	sys 0.000s
I20260709 12:12:58.442633 21214 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:58.439790 21414 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:58.567890 21170 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.567770 21376 consensus_queue.cc:1059] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:58.434551 21482 raft_consensus.cc:2749] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:58.435115 21122 raft_consensus.cc:2804] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader election won for term 26
W20260709 12:12:58.572956 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:58.445914 21331 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:58.594142 14415 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f"
dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:46814
I20260709 12:12:58.594026 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:12:58.615027 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 234473us
I20260709 12:12:58.615177 13761 raft_consensus.cc:2393] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 21: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:12:58.578775 21389 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:58.615943 13727 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
W20260709 12:12:58.602843 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 47873.5us
I20260709 12:12:58.618526 13800 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:58.620276 13800 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:58.580286 21483 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:58.580941 21451 raft_consensus.cc:2804] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:58.607455 13679 raft_consensus.cc:1240] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:58.614905 14415 raft_consensus.cc:606] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 14 LEADER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:58.626434 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:58.676875 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:12:58.632915 20679 consensus_meta.cc:287] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.965s	user 0.009s	sys 0.013s
I20260709 12:12:58.680398 13835 raft_consensus.cc:1275] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:12:58.628441 21470 raft_consensus.cc:2764] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election decision vote started in defunct term 25: won
I20260709 12:12:58.680397 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:58.628293 21483 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:58.683611 13836 raft_consensus.cc:2368] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 25. Current term is 26.
I20260709 12:12:58.597450 21413 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:58.711229 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:58.727316 13800 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:58.606496 21410 raft_consensus.cc:2804] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:58.603569 21414 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:12:58.730896 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 165773us
I20260709 12:12:58.628573 21391 raft_consensus.cc:2804] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:58.604646 21170 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:58.631645 21231 raft_consensus.cc:2804] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:58.685190 21376 raft_consensus.cc:3055] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:58.747359 13758 raft_consensus.cc:1240] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:58.749760 13726 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:58.609601 21393 consensus_queue.cc:1048] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.125s
I20260709 12:12:58.730630 21488 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.764954 13800 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:58.738951 21482 raft_consensus.cc:2749] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:58.771075 13726 leader_election.cc:400] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 election: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 19. Current term is 20.
I20260709 12:12:58.760412 21231 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:58.772753 13726 leader_election.cc:403] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 12:12:58.684847 21042 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:58.791795 13681 raft_consensus.cc:1240] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 25. Current term is 26. Ops: []
I20260709 12:12:58.771468 21376 raft_consensus.cc:740] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:58.735941 20679 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:58.796911 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 347621us
I20260709 12:12:58.808439 13652 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:58.813297 13800 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:58.818099 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:58.782255 21436 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.784654 21231 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:58.818945 13685 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 22.
I20260709 12:12:58.826861 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:58.828794 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:58.830325 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:58.780857 21487 raft_consensus.cc:2749] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:58.770522 21494 raft_consensus.cc:2749] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:58.818764 21122 raft_consensus.cc:697] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 26 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:58.771427 21391 raft_consensus.cc:697] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:58.850121 13652 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:58.854401 13800 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:58.859081 13652 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:58.800225 21042 leader_election.cc:290] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:58.868557 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:58.878451 13800 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:58.830888 21485 raft_consensus.cc:2749] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:58.780592 21488 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:58.889180 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 120813us
I20260709 12:12:58.855659 21197 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.855355 21444 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:58.896924 21434 consensus_meta.cc:287] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.563s	user 0.012s	sys 0.000s
I20260709 12:12:58.896124 21042 raft_consensus.cc:2804] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:58.855283 21470 raft_consensus.cc:2749] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:58.851446 21436 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:58.849977 21376 consensus_queue.cc:260] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:58.888034 21482 raft_consensus.cc:2804] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 12:12:58.944628 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:58.945557 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:58.894161 21294 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:58.894405 21393 raft_consensus.cc:2804] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:58.898095 21214 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:58.947321 21413 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:58.957456 14409 raft_consensus.cc:2393] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 18: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
W20260709 12:12:58.954855 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 63665.9us
I20260709 12:12:58.933430 21440 raft_consensus.cc:2749] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 19. Current term is 20.
I20260709 12:12:58.942870 21331 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:58.947079 21485 raft_consensus.cc:2749] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:58.934126 21434 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:58.959306 13726 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:58.949008 21509 consensus_queue.cc:1048] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 12:12:58.966122 21511 raft_consensus.cc:2749] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:12:58.966873 21495 log.cc:927] Time spent T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
I20260709 12:12:58.969964 21414 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:58.936729 21197 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:12:58.971393 21496 log.cc:927] Time spent T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 12:12:58.950314 21482 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:58.953725 21393 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:58.980238 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:58.986194 13682 raft_consensus.cc:1240] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:58.995467 14408 raft_consensus.cc:2393] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 22: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:12:58.987139 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:58.996400 14410 raft_consensus.cc:2393] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 21: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:12:58.960033 21170 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:58.993387 13726 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:58.978499 21506 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:59.000751 21440 raft_consensus.cc:2749] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:58.997524 21393 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:12:59.001518 21498 log.cc:927] Time spent T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:12:59.005674 21197 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:58.962244 21122 consensus_queue.cc:237] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.13, Last appended by leader: 13, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:59.008550 13726 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:59.016278 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:59.018149 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:59.020970 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:59.018034 21197 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:59.021677 13686 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 17.
I20260709 12:12:59.021122 21231 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:59.023159 21436 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:59.024194 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:59.023144 21437 raft_consensus.cc:2749] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:59.026563 21506 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:59.027238 13761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48114 (request call id 3445) took 1253 ms. Trace:
I20260709 12:12:59.027657 13761 rpcz_store.cc:276] 0709 12:12:57.773728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:57.785598 (+ 11870us) service_pool.cc:224] Handling call
0709 12:12:59.027003 (+1241405us) spinlock_profiling.cc:243] Waited 821 ms on lock 0x7b54001d2c54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:12:59.027149 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1888905600}
I20260709 12:12:59.029832 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:59.033299 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:12:59.025600 21464 log.cc:927] Time spent T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.821s	user 0.003s	sys 0.000s
I20260709 12:12:59.034035 13685 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 21.
I20260709 12:12:59.013629 21393 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:58.991076 21370 raft_consensus.cc:2749] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:58.993005 21376 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:58.996637 21482 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:58.956084 21391 consensus_queue.cc:237] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:59.000828 21501 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.026193 21231 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:12:59.037449 21490 log.cc:927] Time spent T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.236s	user 0.001s	sys 0.000s
W20260709 12:12:59.035889 21479 consensus_meta.cc:287] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.571s	user 0.006s	sys 0.006s
I20260709 12:12:59.033685 21170 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:12:59.056013 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 177678us
I20260709 12:12:59.056532 21042 raft_consensus.cc:697] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 21 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:59.057017 21488 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:59.057621 21485 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:59.057650 21471 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:59.058363 21485 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:59.058452 21471 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:59.060005 21434 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:59.060783 21485 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:59.061456 21471 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:59.061789 13800 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:59.062616 21485 raft_consensus.cc:2749] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:12:59.062546 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:59.058990 21506 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:59.062485 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:59.064085 13800 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:59.065572 21389 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:59.066735 13687 raft_consensus.cc:1240] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:59.067804 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:59.069994 21393 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:59.073804 21170 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:59.075099 21509 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:12:59.075716 21509 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:59.076483 21170 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:59.048753 21501 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:59.082826 13688 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:59.065164 21479 raft_consensus.cc:2749] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:12:59.064332 21042 consensus_queue.cc:237] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:59.081070 13762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 3443) took 1307 ms. Trace:
I20260709 12:12:59.081254 13726 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:59.094612 13726 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:59.067965 21389 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:59.093714 13762 rpcz_store.cc:276] 0709 12:12:57.773262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:57.940822 (+167560us) service_pool.cc:224] Handling call
0709 12:12:57.941090 (+   268us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:57.992171 (+ 51081us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:57.992211 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:57.992741 (+   530us) log.cc:844] Serialized 26 byte log entry
0709 12:12:58.576613 (+583872us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:58.576681 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:58.576812 (+   131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:58.847535 (+270723us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b48001a01d8. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92ceb6aa1 00007fa92ceadb37 00007fa92cead9ca 00007fa92cfa526f 00007fa92cfa4f37 00007fa92cfb955c 00007fa92cfb9508 00007fa92cfb9488 00007fa92cfb9443 00007fa92cfb86ec 00007fa92bee2a96
0709 12:12:59.036834 (+189299us) spinlock_profiling.cc:243] Waited 4.89 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:12:59.080748 (+ 43914us) raft_consensus.cc:1685] finished
0709 12:12:59.080783 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:59.080984 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53871,"raft.queue_time_us":51641,"raft.run_cpu_time_us":4466,"raft.run_wall_time_us":851084,"spinlock_wait_cycles":38148608,"thread_start_us":495260,"threads_started":1,"wal-append.queue_time_us":713651}
I20260709 12:12:59.100944 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:59.102711 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:59.101128 21170 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:59.104969 21170 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:59.107323 21170 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:59.083233 21506 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:59.086565 21485 raft_consensus.cc:2749] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:12:59.096760 21370 raft_consensus.cc:2804] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:59.117934 21501 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:59.118402 21370 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:59.118902 21370 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:59.080092 21436 consensus_queue.cc:1059] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.033s
I20260709 12:12:59.099256 21414 raft_consensus.cc:2804] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:12:59.115711 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 51711.6us
I20260709 12:12:59.098948 21483 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:59.122462 21414 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:59.122884 13800 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:59.123016 21414 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:59.123941 21328 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:59.124210 21483 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:59.124210 13800 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:59.125063 21506 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:59.125809 21170 raft_consensus.cc:2749] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:59.125950 21485 raft_consensus.cc:2749] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:12:59.136480 13800 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:59.137528 21170 raft_consensus.cc:2749] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:12:59.138531 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:59.139132 13681 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:59.139423 13800 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:59.140321 21170 raft_consensus.cc:2749] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:12:59.141449 13800 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:59.142222 21170 raft_consensus.cc:2749] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:59.143728 13800 leader_election.cc:304] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:12:59.144464 21170 raft_consensus.cc:2804] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:12:59.144824 21170 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:59.145176 21170 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:12:59.148659 13800 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:59.149493 21485 raft_consensus.cc:2749] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:12:59.150581 13800 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:59.102187 21509 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:59.170310 13688 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 21.
I20260709 12:12:59.170087 13686 raft_consensus.cc:2468] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 18.
I20260709 12:12:59.182052 13726 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:59.168643 21370 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:59.184338 21451 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:59.195634 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:59.172061 21416 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.167649 21231 raft_consensus.cc:2749] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:59.179563 21501 raft_consensus.cc:3055] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:59.171844 21436 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:59.160933 13800 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:59.186755 13686 raft_consensus.cc:1240] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 22. Current term is 23. Ops: []
I20260709 12:12:59.190963 21328 raft_consensus.cc:2804] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:59.192013 13762 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:39554
W20260709 12:12:59.223484 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 62628us
I20260709 12:12:59.223585 13762 raft_consensus.cc:606] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:59.224046 13762 raft_consensus.cc:614] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:59.224377 13652 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:59.228410 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:59.230355 21012 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.230911 21012 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:59.233172 21012 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:12:59.226034 21416 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:59.235606 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:59.235949 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:59.236164 21416 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:59.236704 13836 raft_consensus.cc:2393] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 21: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:12:59.237608 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:59.238080 13727 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:59.238858 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:59.239562 13830 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 17.
I20260709 12:12:59.239661 21413 consensus_queue.cc:1059] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:59.240660 21413 raft_consensus.cc:2804] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:12:59.241158 21413 raft_consensus.cc:697] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:59.241753 21483 raft_consensus.cc:3055] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:59.242264 21328 raft_consensus.cc:697] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:59.242086 21413 consensus_queue.cc:237] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:59.243278 21328 consensus_queue.cc:237] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:59.245298 21042 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.240013 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:12:59.235638 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:59.245955 21042 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:59.246668 13833 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:59.247557 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:59.248697 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:59.226056 21488 raft_consensus.cc:2804] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:59.250638 21488 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:59.250996 21488 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:59.238220 13835 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:59.242216 13680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 3521) took 1201 ms. Trace:
I20260709 12:12:59.239010 20679 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:59.198396 21451 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:59.195909 21506 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:59.263906 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:59.277505 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:59.261722 13833 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 21.
I20260709 12:12:59.267460 13681 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 23.
I20260709 12:12:59.278343 13836 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 22.
I20260709 12:12:59.255568 13680 rpcz_store.cc:276] 0709 12:12:58.040737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:58.040946 (+   209us) service_pool.cc:224] Handling call
0709 12:12:59.228252 (+1187306us) spinlock_profiling.cc:243] Waited 6.99 ms on lock 0x7b5800002798. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924e68b71 00007fa924e68a22 00007fa92dd818d9 00007fa92cedbee0 00007fa92cfa50ab 00007fa92cfa5131 00007fa92cf530a0 00007fa92cf52984 00007fa9264cd6d4 00007fa9264cd662
0709 12:12:59.242133 (+ 13881us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16078720}
I20260709 12:12:59.268782 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:59.269761 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:59.279498 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:59.280143 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:59.280817 13682 raft_consensus.cc:2468] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 18.
I20260709 12:12:59.273730 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:59.186110 21509 consensus_queue.cc:1059] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 25.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.043s
I20260709 12:12:59.276690 13652 leader_election.cc:400] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 25. Current term is 26.
I20260709 12:12:59.197774 21485 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:59.282523 13828 raft_consensus.cc:2368] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 21. Current term is 22.
I20260709 12:12:59.248340 21042 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:59.280417 13726 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:59.281332 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:59.284977 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:59.219003 21501 raft_consensus.cc:740] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:59.287461 13757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 1269) took 1538 ms. Trace:
I20260709 12:12:59.287531 13759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 1262) took 1540 ms. Trace:
I20260709 12:12:59.287981 13757 rpcz_store.cc:276] 0709 12:12:57.749330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:57.939437 (+190107us) service_pool.cc:224] Handling call
0709 12:12:57.939855 (+   418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:58.182145 (+242290us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:59.287237 (+1105092us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b540032ee54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:59.287406 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":493793664}
I20260709 12:12:59.285918 13836 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 20.
I20260709 12:12:59.290139 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:59.290700 13760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 3442) took 1517 ms. Trace:
I20260709 12:12:59.285763 13833 raft_consensus.cc:2393] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 23: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
W20260709 12:12:59.293109 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:59.293740 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:59.294421 13681 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 17.
I20260709 12:12:59.295269 13679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 3534) took 1014 ms. Trace:
I20260709 12:12:59.295629 13679 rpcz_store.cc:276] 0709 12:12:58.280354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:58.326349 (+ 45995us) service_pool.cc:224] Handling call
0709 12:12:58.326614 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:58.627735 (+301121us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:59.295054 (+667319us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x7b54003124d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:59.295214 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":645359488}
I20260709 12:12:59.297269 21435 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.282569 13727 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:59.297802 21435 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:59.300084 21435 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:59.282691 21437 consensus_queue.cc:1048] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 12:12:59.242188 21483 raft_consensus.cc:740] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:59.288031 13759 rpcz_store.cc:276] 0709 12:12:57.747407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:57.912498 (+165091us) service_pool.cc:224] Handling call
0709 12:12:57.940995 (+ 28497us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:58.318071 (+377076us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:59.287351 (+969280us) spinlock_profiling.cc:243] Waited 359 ms on lock 0x7b54002ef254. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:59.287479 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":825584000}
I20260709 12:12:59.301910 21042 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:59.302273 21470 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:59.309566 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:59.291069 13760 rpcz_store.cc:276] 0709 12:12:57.773005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:57.924168 (+151163us) service_pool.cc:224] Handling call
0709 12:12:57.944897 (+ 20729us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:58.314578 (+369681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:59.290479 (+975901us) spinlock_profiling.cc:243] Waited 369 ms on lock 0x7b54000884d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:59.290647 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":848885504}
I20260709 12:12:59.312835 13727 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:59.318892 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:59.320051 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:59.339983 13727 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:59.270138 21505 raft_consensus.cc:2749] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:59.275447 21231 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:59.256131 21493 consensus_queue.cc:1059] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.054s
I20260709 12:12:59.313617 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:59.345883 13836 raft_consensus.cc:2410] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 18 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 12:12:59.345737 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:12:59.346836 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:59.227116 21436 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:59.347575 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:59.304646 20679 raft_consensus.cc:2804] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:12:59.347958 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:12:59.350421 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:59.350100 21231 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:59.350704 21506 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:59.350991 21170 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:59.352784 13688 raft_consensus.cc:1275] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:12:59.318701 21511 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.353457 21501 consensus_queue.cc:260] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:59.341594 21042 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:59.355736 21505 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:59.401034 21511 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:59.401477 21505 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:59.403570 21511 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:59.362016 13835 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 24.
I20260709 12:12:59.405721 13832 raft_consensus.cc:1240] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 23. Current term is 24. Ops: [21.12-23.13]
I20260709 12:12:59.406241 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:59.367878 13681 raft_consensus.cc:1275] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:12:59.373126 21506 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:59.407948 21501 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:59.410097 21506 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:59.410282 21437 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:59.411008 21437 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:59.357250 21488 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:59.361564 13828 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:59.376586 21231 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:59.377890 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:59.312644 21485 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:59.380038 21373 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:59.381614 21414 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:59.381886 21012 consensus_queue.cc:1048] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:12:59.446557 13830 raft_consensus.cc:2393] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 26: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:12:59.383785 21365 consensus_queue.cc:1059] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:59.384208 21482 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:59.360985 13680 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 21.
I20260709 12:12:59.275839 21391 consensus_queue.cc:1059] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 12:12:59.346004 21470 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:59.403699 21505 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:59.376261 21483 consensus_queue.cc:260] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:59.340525 21197 raft_consensus.cc:2749] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:12:59.345813 21512 raft_consensus.cc:2804] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:59.436496 13683 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 14.
I20260709 12:12:59.435468 13727 leader_election.cc:400] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 21. Current term is 22.
I20260709 12:12:59.466169 13727 leader_election.cc:403] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:59.465601 21512 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:59.466902 21512 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:59.470863 21483 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:59.475837 21512 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:59.481035 21512 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:59.482738 21471 consensus_queue.cc:1048] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:12:59.436004 20679 raft_consensus.cc:697] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:59.388480 21494 raft_consensus.cc:2804] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 12:12:59.507890 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 161181us
I20260709 12:12:59.401127 21042 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:59.495890 13828 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 21.
I20260709 12:12:59.511214 13758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 3448) took 1731 ms. Trace:
W20260709 12:12:59.442693 21410 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.004s	sys 0.007s
I20260709 12:12:59.506414 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:12:59.512674 21410 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.005s	sys 0.008s
I20260709 12:12:59.512969 21410 raft_consensus.cc:697] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 22 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:59.514138 21410 consensus_queue.cc:237] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.9, Last appended by leader: 9, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:59.511660 13758 rpcz_store.cc:276] 0709 12:12:57.779332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:58.016880 (+237548us) service_pool.cc:224] Handling call
0709 12:12:58.017285 (+   405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:58.763135 (+745850us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:59.510943 (+747808us) spinlock_profiling.cc:243] Waited 730 ms on lock 0x7b5400139cd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:12:59.511136 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1678443648}
I20260709 12:12:59.523763 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:12:59.525342 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 225458us
I20260709 12:12:59.527112 13652 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:12:59.533891 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:59.539271 13828 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:59.540529 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:59.541209 13652 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:12:59.543097 21519 log.cc:927] Time spent T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.235s	user 0.000s	sys 0.004s
I20260709 12:12:59.521057 21413 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Advancing to term 22
I20260709 12:12:59.541181 13833 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:59.525110 21507 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.556025 21482 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:59.544695 21042 raft_consensus.cc:2804] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:59.551440 21488 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:59.562165 21414 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:59.570744 20679 consensus_queue.cc:237] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 21.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:59.571439 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:59.576026 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:59.548507 21376 raft_consensus.cc:2804] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:59.551199 21437 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:59.610944 21042 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:12:59.645299 21042 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:59.646786 21451 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:59.647709 21476 raft_consensus.cc:3055] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 LEADER]: Stepping down as leader of term 22
W20260709 12:12:59.648042 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:59.648228 21476 raft_consensus.cc:740] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:59.649169 21451 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:59.588101 21483 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:59.650611 21483 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:59.652748 21483 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:59.652834 13801 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:12:59.649170 21476 consensus_queue.cc:260] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:59.653880 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:59.654783 14415 raft_consensus.cc:2393] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 21: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:12:59.654888 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:12:59.658303 21505 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:59.658921 21505 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:59.661022 21505 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:59.663271 21376 raft_consensus.cc:697] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 21 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:12:59.664345 21376 consensus_queue.cc:237] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:59.654695 21476 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:59.674014 21509 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.674605 21509 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:59.676846 21509 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:59.607852 13727 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:59.552321 21331 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:59.590519 21370 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:59.580559 21197 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:12:59.679517 13836 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 18.
I20260709 12:12:59.690912 13837 raft_consensus.cc:2393] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 21: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
W20260709 12:12:59.704660 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 96938.6us
I20260709 12:12:59.741436 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:59.742148 13832 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:59.635999 21507 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:59.709507 21370 raft_consensus.cc:2804] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:12:59.713101 21416 raft_consensus.cc:3055] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:12:59.702020 21197 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:59.757164 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:59.758405 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:59.758986 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:59.759274 14415 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 18.
I20260709 12:12:59.759788 13830 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 19.
I20260709 12:12:59.749411 13828 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 20.
I20260709 12:12:59.767831 14380 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:59.702248 21331 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:59.780370 13727 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:59.782685 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:59.784698 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:59.785315 13830 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:59.745993 21437 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:59.752210 21416 raft_consensus.cc:740] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:12:59.759847 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 252584us
I20260709 12:12:59.754087 21365 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:59.783775 21370 raft_consensus.cc:697] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:59.786732 13727 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:59.781086 21451 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.817464 21483 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.817612 21451 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:59.818225 21483 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:59.820032 21451 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:12:59.783386 21506 raft_consensus.cc:3055] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:59.820653 21506 raft_consensus.cc:740] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:12:59.821563 21506 consensus_queue.cc:260] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:59.820034 21331 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:59.822361 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:59.822827 21506 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:59.825928 21445 consensus_queue.cc:1048] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:59.826830 21509 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.827987 21389 consensus_queue.cc:1059] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:59.752161 21523 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:59.784977 21435 raft_consensus.cc:2804] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:59.787411 21512 raft_consensus.cc:2804] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:59.798907 21391 raft_consensus.cc:2804] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:59.801162 21197 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:59.800709 21416 consensus_queue.cc:260] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:59.807756 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:59.811319 21507 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:12:59.832111 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:59.797024 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:59.781181 21436 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:59.862507 13837 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:12:59.848915 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 53691.5us
I20260709 12:12:59.784698 13828 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 14.
I20260709 12:12:59.864964 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:59.856027 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:59.852479 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:59.789354 21494 raft_consensus.cc:697] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:12:59.866884 13828 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 23.
I20260709 12:12:59.863914 14379 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:12:59.847924 21243 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.868746 13727 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:59.871421 13830 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 18.
I20260709 12:12:59.874236 13833 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 23.
I20260709 12:12:59.879726 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:59.896951 13726 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:12:59.898557 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:12:59.794540 21437 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:59.904831 13829 raft_consensus.cc:1240] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 25. Current term is 26. Ops: []
I20260709 12:12:59.852388 21512 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:12:59.897183 13727 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:12:59.855383 21391 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:59.906805 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:59.912017 14380 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:12:59.924798 13833 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 20.
I20260709 12:12:59.916577 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:59.848150 21365 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:12:59.931607 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:12:59.882241 21488 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:59.877833 21522 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.870294 21435 raft_consensus.cc:697] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 20 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
W20260709 12:12:59.912778 21526 log.cc:927] Time spent T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:12:59.882082 21436 raft_consensus.cc:3055] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:12:59.931517 21391 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:59.958916 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 47001us
I20260709 12:12:59.959901 13830 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 22.
I20260709 12:12:59.967607 13837 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 23.
I20260709 12:12:59.962225 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:12:59.963248 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:00.074036 13763 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 21.
I20260709 12:13:00.074136 13761 raft_consensus.cc:1275] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:12:59.963649 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:59.961939 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:00.075400 13757 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 22.
I20260709 12:13:00.069072 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:12:59.976679 13834 raft_consensus.cc:1240] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:00.076164 13758 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:00.036329 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:12:59.910022 21451 consensus_queue.cc:1059] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.137s
I20260709 12:13:00.038648 21300 consensus_queue.cc:1048] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:13:00.039559 21531 consensus_queue.cc:1048] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 12:12:59.916431 21328 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.006s	sys 0.020s
I20260709 12:12:59.910349 21373 raft_consensus.cc:2804] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:59.926962 21512 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:59.853145 21523 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:00.041347 21437 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:12:59.920671 21484 raft_consensus.cc:2804] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:00.059653 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:00.074409 21410 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.064523 13832 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 23.
I20260709 12:13:00.065821 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:00.090919 21452 raft_consensus.cc:2804] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:59.850625 21509 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:12:59.932310 21416 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:00.073411 13762 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 21.
W20260709 12:13:00.042413 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 301320us
I20260709 12:13:00.088372 13687 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 22.
I20260709 12:12:59.903283 21243 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:00.105510 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:13:00.072032 21524 log.cc:927] Time spent T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.151s	user 0.012s	sys 0.007s
I20260709 12:12:59.961073 21471 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:00.067212 21436 raft_consensus.cc:740] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:00.117370 13837 raft_consensus.cc:1240] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 22. Current term is 23. Ops: [22.16-22.16]
I20260709 12:13:00.077873 21414 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.066120 13760 raft_consensus.cc:1275] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:13:00.127353 13832 raft_consensus.cc:1275] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 12:13:00.126168 13756 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 21.
I20260709 12:13:00.135655 13758 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 20.
I20260709 12:13:00.095886 21508 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
W20260709 12:13:00.105484 21328 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.006s	sys 0.035s
I20260709 12:13:00.090369 21078 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:00.140010 13652 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:00.147879 13831 raft_consensus.cc:1240] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:00.124770 21501 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:00.128644 21484 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:00.111238 21373 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:00.128762 21452 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:00.037592 21522 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:00.167182 21493 raft_consensus.cc:3055] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:13:00.179008 14380 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:13:00.186894 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 46967us
I20260709 12:13:00.160218 21243 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199)
W20260709 12:13:00.206058 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 286973us
I20260709 12:13:00.189365 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:00.161809 21451 raft_consensus.cc:2804] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:13:00.207921 21451 raft_consensus.cc:697] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:00.193058 13758 raft_consensus.cc:1240] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:00.113025 21532 consensus_queue.cc:1048] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.081s
I20260709 12:13:00.041890 21370 consensus_queue.cc:237] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:00.199549 13831 raft_consensus.cc:1275] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:13:00.189352 21484 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:00.186103 21437 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:00.198894 21042 consensus_meta.cc:287] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.553s	user 0.012s	sys 0.003s
I20260709 12:13:00.191864 21373 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:00.227365 13831 raft_consensus.cc:1275] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:13:00.230448 20679 raft_consensus.cc:3055] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:13:00.237938 20679 raft_consensus.cc:740] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:00.198143 21452 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:00.163614 21410 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:00.117286 21494 consensus_queue.cc:237] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:00.171820 21414 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:00.242184 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:00.203967 21493 raft_consensus.cc:740] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:13:00.252948 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 48247.7us
I20260709 12:13:00.209213 21451 consensus_queue.cc:237] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:00.221505 20870 raft_consensus.cc:2804] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:00.187505 21078 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:00.255281 13831 raft_consensus.cc:1275] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 12:13:00.191207 21501 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:00.224177 21541 raft_consensus.cc:2804] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:00.182224 21508 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:00.164472 21435 consensus_queue.cc:237] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:00.280376 13837 raft_consensus.cc:1275] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:13:00.281345 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:00.281989 21365 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:00.300733 13758 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:13:00.283702 21529 log.cc:927] Time spent T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
W20260709 12:13:00.284617 21538 log.cc:927] Time spent T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:13:00.290719 13835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 3334) took 1022 ms. Trace:
I20260709 12:13:00.278067 20679 consensus_queue.cc:260] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:00.291503 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 394371us
I20260709 12:13:00.316130 13727 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:00.322460 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:13:00.322865 21540 log.cc:927] Time spent T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:13:00.324076 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:00.324815 13756 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 19.
I20260709 12:13:00.326100 21493 consensus_queue.cc:260] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:00.327317 21493 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:13:00.328086 21537 log.cc:927] Time spent T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 12:13:00.329908 21545 raft_consensus.cc:2804] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:00.338196 21545 raft_consensus.cc:697] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:00.290365 21541 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:00.339342 21545 consensus_queue.cc:237] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:00.339956 21541 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:00.300675 21546 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:00.331472 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:00.342453 21546 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:00.272259 20870 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:00.344515 20870 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:00.332388 20679 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:00.219623 21436 consensus_queue.cc:260] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:00.347095 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:00.242444 21042 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:00.313277 13835 rpcz_store.cc:276] 0709 12:12:59.268197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:59.576765 (+308568us) service_pool.cc:224] Handling call
0709 12:12:59.577167 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:59.577570 (+   403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:59.577598 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:59.587809 (+ 10211us) log.cc:844] Serialized 26 byte log entry
0709 12:13:00.096051 (+508242us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:13:00.096102 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:00.096165 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:00.285883 (+189718us) raft_consensus.cc:1685] finished
0709 12:13:00.285914 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:00.290654 (+  4740us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":723,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":6259,"thread_start_us":417795,"threads_started":1,"wal-append.queue_time_us":575973}
I20260709 12:13:00.327183 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:00.236044 21437 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:00.358443 21414 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:00.358812 21523 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:00.382081 21522 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:00.383903 14415 raft_consensus.cc:1275] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:13:00.384173 21541 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:00.385984 21501 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:00.386256 21483 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:00.387274 21557 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.388252 21557 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:00.391361 21557 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:00.387184 21541 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:00.360337 21543 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:00.394366 21543 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:00.396927 21543 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:00.361292 21509 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:00.365725 21042 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:00.368033 21506 consensus_meta.cc:287] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.545s	user 0.012s	sys 0.000s
I20260709 12:13:00.369048 21546 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:00.357249 13762 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 20.
I20260709 12:13:00.399503 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:00.400674 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:00.401307 13762 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 21.
I20260709 12:13:00.400700 21452 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:00.404345 21452 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:00.377255 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:00.412746 13756 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 22.
I20260709 12:13:00.413790 13687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48212 (request call id 1489) took 1115 ms. Trace:
I20260709 12:13:00.414368 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:00.414201 13687 rpcz_store.cc:276] 0709 12:12:59.298475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:59.310353 (+ 11878us) service_pool.cc:224] Handling call
0709 12:13:00.413618 (+1103265us) spinlock_profiling.cc:243] Waited 565 ms on lock 0x7b5400271d54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:00.413716 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1298778368}
I20260709 12:13:00.425915 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:13:00.435351 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 313337us
I20260709 12:13:00.436430 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:00.412358 21436 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:00.444933 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:00.449208 13758 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 21.
I20260709 12:13:00.424510 21509 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.481421 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:00.482021 14379 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:00.424292 21414 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.425026 21452 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.459772 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:00.459434 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:00.480202 13756 raft_consensus.cc:1240] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:00.480788 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:00.485360 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:00.481045 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:00.460450 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:00.488438 13679 raft_consensus.cc:2393] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 23: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:00.424664 21546 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:00.455544 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 29 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:00.489984 13680 raft_consensus.cc:2393] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 26: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:00.490289 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:00.500872 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:00.505762 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:00.426899 21484 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:00.474835 21543 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:00.457307 21042 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:00.508817 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:00.425751 21391 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:00.506927 13688 raft_consensus.cc:2410] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for term 19 because replica has last-logged OpId of term: 17 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 12:13:00.540696 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:00.515391 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:00.542127 13686 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:00.502211 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:13:00.516736 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:00.516939 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:00.548099 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:00.514779 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:00.518806 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:00.519807 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:00.520366 21562 consensus_queue.cc:1059] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:13:00.520856 21078 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:00.521850 13685 raft_consensus.cc:1240] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 18. Current term is 19. Ops: []
W20260709 12:13:00.521689 21560 log.cc:927] Time spent T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 12:13:00.489974 21413 consensus_meta.cc:287] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.931s	user 0.009s	sys 0.009s
I20260709 12:13:00.526187 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:00.494179 21509 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:00.532833 13760 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 23.
I20260709 12:13:00.534979 13755 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 26.
I20260709 12:13:00.546454 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:00.544559 14379 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:00.549664 13684 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 22.
I20260709 12:13:00.484192 21508 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:00.551100 21437 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:00.552145 20457 consensus_queue.cc:1048] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:00.517398 21243 raft_consensus.cc:2804] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:00.499378 21414 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:00.560612 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:00.558274 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:00.567999 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:00.568713 13681 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 21.
I20260709 12:13:00.569876 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 29 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:00.499434 21452 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:00.563526 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:00.567606 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:00.564397 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:00.508714 21546 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:00.580271 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:00.580955 13680 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:00.540232 21543 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:00.574561 21532 consensus_queue.cc:1048] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.009s
I20260709 12:13:00.574765 21015 consensus_queue.cc:1059] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:13:00.575604 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:00.576195 21541 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:00.616978 13758 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 21.
I20260709 12:13:00.583714 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:00.573364 13686 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 18.
I20260709 12:13:00.557674 21413 raft_consensus.cc:2749] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 21. Current term is 22.
I20260709 12:13:00.585654 13681 raft_consensus.cc:1240] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:00.591886 21391 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:00.596128 13687 raft_consensus.cc:1275] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 12:13:00.578940 21243 raft_consensus.cc:697] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 22 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:00.598997 21485 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:00.599792 21509 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:00.600263 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:00.601459 21564 log.cc:927] Time spent T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.137s	user 0.000s	sys 0.003s
I20260709 12:13:00.602334 13727 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:00.602931 13684 raft_consensus.cc:1240] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:00.603250 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:13:00.650679 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 48437.6us
I20260709 12:13:00.603941 13762 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 27.
I20260709 12:13:00.597563 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:00.562075 21531 raft_consensus.cc:2804] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:00.546548 21042 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:00.610579 13682 raft_consensus.cc:1240] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:00.612860 13651 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:00.614109 13757 raft_consensus.cc:1240] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:00.622112 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:00.709106 14409 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:00.638154 13759 raft_consensus.cc:1275] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 12:13:00.597362 21373 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:00.639286 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:00.641793 13679 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 21.
W20260709 12:13:00.621172 21488 consensus_meta.cc:287] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.641s	user 0.009s	sys 0.004s
I20260709 12:13:00.624294 21452 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:13:00.645288 21512 consensus_meta.cc:287] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.516s	user 0.010s	sys 0.002s
I20260709 12:13:00.690879 21543 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:00.714486 13763 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 21.
W20260709 12:13:00.657577 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:00.684515 21509 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:00.683650 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:00.696264 13829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 3687) took 1421 ms. Trace:
I20260709 12:13:00.714156 21531 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:00.698298 21567 log.cc:927] Time spent T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:13:00.722681 13755 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 18.
I20260709 12:13:00.703500 21484 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:00.679535 21470 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:00.693864 21170 leader_election.cc:290] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:00.723567 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:00.696853 21410 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:00.682168 21243 consensus_queue.cc:237] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:00.706348 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 54966.6us
I20260709 12:13:00.725131 21493 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.725648 21493 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:00.724277 13763 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 28.
I20260709 12:13:00.727021 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:00.722975 21531 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:00.727885 21493 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:00.728443 21493 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.728876 21493 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:00.722651 13829 rpcz_store.cc:276] 0709 12:12:59.274963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:59.911090 (+636127us) service_pool.cc:224] Handling call
0709 12:12:59.911522 (+   432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:59.911995 (+   473us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:59.912041 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:59.931578 (+ 19537us) log.cc:844] Serialized 26 byte log entry
0709 12:13:00.345478 (+413900us) spinlock_profiling.cc:243] Waited 2.43 ms on lock 0x7b1800475f60. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e82e07 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9fc02 00007fa927b2720b 00007fa927b2cd23 00007fa927b2d0d1 00007fa927f48a0f
0709 12:13:00.566275 (+220797us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:13:00.566326 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:00.566402 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:00.695932 (+129530us) raft_consensus.cc:1685] finished
0709 12:13:00.695953 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:00.696192 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85,"raft.queue_time_us":120,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":9849,"spinlock_wait_cycles":5597440,"thread_start_us":220514,"threads_started":1,"wal-append.queue_time_us":662402}
I20260709 12:13:00.731782 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:00.727516 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:00.706861 13680 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 18.
I20260709 12:13:00.619840 21501 consensus_queue.cc:1059] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.066s
I20260709 12:13:00.702312 21413 consensus_queue.cc:1048] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:00.717895 13756 raft_consensus.cc:2393] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 21: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:00.735661 13761 raft_consensus.cc:1240] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 23. Current term is 24. Ops: [23.13-23.13]
W20260709 12:13:00.719101 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 106309us
I20260709 12:13:00.620193 21541 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:00.693934 21558 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.734089 13688 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 17.
I20260709 12:13:00.723722 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:00.720445 21482 raft_consensus.cc:2749] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:13:00.751353 21373 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:00.752422 21042 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:00.754089 20870 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:00.756412 20870 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:00.758491 21501 consensus_queue.cc:1243] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer 3f37c9cc9dda46b4be21dd675ba78fb7 log is divergent from this leader: its last log entry 26.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 12:13:00.759196 21501 raft_consensus.cc:3055] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:13:00.759588 21501 raft_consensus.cc:740] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:00.760504 21501 consensus_queue.cc:260] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.16, Last appended by leader: 16, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:00.736860 13651 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:00.707906 21546 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:00.720651 21512 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:00.720731 21488 raft_consensus.cc:2749] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:00.762943 13651 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:00.765358 13754 raft_consensus.cc:1240] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:00.766954 14415 raft_consensus.cc:2393] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 22: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:13:00.773346 20457 consensus_queue.cc:1059] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:13:00.774399 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:00.775643 13832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 1510) took 1125 ms. Trace:
I20260709 12:13:00.775548 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:00.777902 14409 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 19.
I20260709 12:13:00.776067 13832 rpcz_store.cc:276] 0709 12:12:59.650713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:00.166513 (+515800us) service_pool.cc:224] Handling call
0709 12:13:00.166850 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:00.167090 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 12:13:00.188241 (+ 21151us) log.cc:844] Serialized 14 byte log entry
0709 12:13:00.765105 (+576864us) spinlock_profiling.cc:243] Waited 2.15 ms on lock 0x7b180046e700. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa927b354bc 00007fa924e8348b 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9fc02 00007fa927b2720b 00007fa927b2cd23 00007fa927b2d23a
0709 12:13:00.775297 (+ 10192us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:00.775351 (+    54us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:13:00.775394 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:00.775466 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:00.775591 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9950,"prepare.queue_time_us":20937,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"spinlock_wait_cycles":4940672,"thread_start_us":37659,"threads_started":1,"wal-append.queue_time_us":93718}
I20260709 12:13:00.780251 13651 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:00.782505 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:00.783215 13832 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Advancing to term 22
I20260709 12:13:00.783128 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:00.793922 13832 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 22.
I20260709 12:13:00.764715 21541 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:00.761763 21501 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:00.801470 14380 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:00.745324 21410 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:00.802745 20457 raft_consensus.cc:2804] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:00.762612 21042 raft_consensus.cc:2749] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:00.801293 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:00.806514 20457 raft_consensus.cc:697] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 22 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:00.806608 13651 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:00.794997 21482 raft_consensus.cc:2804] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:00.810223 13651 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:00.810557 21482 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:00.811002 21482 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:00.811529 13651 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:00.813227 21569 raft_consensus.cc:2804] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:00.813623 21541 raft_consensus.cc:2749] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:00.813892 21569 raft_consensus.cc:697] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 21 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:00.810334 21042 raft_consensus.cc:2804] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:00.814728 21042 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:00.815148 21042 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:00.815240 21569 consensus_queue.cc:237] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:00.799039 21549 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:00.817595 21549 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:00.776211 21558 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:00.822868 21531 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:00.823592 21558 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:00.824921 21549 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:00.825263 21531 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 23 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:00.766439 21512 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:00.827513 21042 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:00.829807 21042 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:00.825565 21549 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.831118 21493 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:00.794652 21445 consensus_queue.cc:1048] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.037s
I20260709 12:13:00.831537 21549 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:00.812718 13651 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:13:00.834952 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:00.836246 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:00.836870 13832 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:00.834403 13651 leader_election.cc:304] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:00.837878 14412 raft_consensus.cc:2393] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 23: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:13:00.838610 20457 consensus_queue.cc:237] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:00.839459 13651 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:00.846735 21549 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:00.846848 13832 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 23.
I20260709 12:13:00.847743 21170 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:00.850668 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:00.786448 21444 consensus_queue.cc:1048] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.053s
I20260709 12:13:00.851393 14380 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:00.852514 14414 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 21.
I20260709 12:13:00.841179 21042 raft_consensus.cc:2804] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:00.862578 13651 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:00.843240 21558 raft_consensus.cc:2804] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:00.872133 13726 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:00.860488 21532 raft_consensus.cc:2804] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:00.834172 21410 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:00.887682 13726 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:00.892454 13726 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:00.897228 13726 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:00.858049 21170 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:00.886130 21562 raft_consensus.cc:2804] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:00.869619 21573 raft_consensus.cc:2804] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:00.902956 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:00.890405 21452 raft_consensus.cc:2749] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:13:00.904861 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:00.907419 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:00.910013 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:13:00.910327 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:00.911525 13726 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:00.897372 21532 raft_consensus.cc:697] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 23 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:00.905305 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:00.890544 21042 raft_consensus.cc:697] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 23 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:00.896565 21413 raft_consensus.cc:2804] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:00.938766 21413 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:00.939298 21413 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:00.943118 21410 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:00.898629 21558 raft_consensus.cc:697] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 26 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:00.900133 21546 raft_consensus.cc:2804] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:00.944641 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:13:00.948840 13800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:00.974484 13800 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:13:00.974680 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 63235.8us
I20260709 12:13:00.945802 13652 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:00.896077 21574 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:00.954638 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:00.956070 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:00.957660 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:00.959704 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:00.949517 13727 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:00.961489 13762 raft_consensus.cc:1275] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 12:13:00.915208 21493 raft_consensus.cc:2749] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:00.966094 13684 raft_consensus.cc:1275] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 20 index: 9. Preceding OpId from leader: term: 22 index: 10. (index mismatch)
I20260709 12:13:00.953836 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:00.983887 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:00.971941 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:00.990604 13687 raft_consensus.cc:2393] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 18: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:00.918613 21505 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.913394 21436 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:00.913933 21573 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:00.983752 13652 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:13:00.999004 13726 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:01.004705 13762 raft_consensus.cc:1275] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:13:00.978348 13679 raft_consensus.cc:2410] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 21 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 12:13:00.971436 21546 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:00.979965 21331 raft_consensus.cc:2749] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:00.982308 21563 raft_consensus.cc:2804] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:13:00.981915 21470 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.980378 21410 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:00.990921 21549 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.019930 13762 raft_consensus.cc:1275] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:13:01.010841 21569 raft_consensus.cc:2804] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:01.001695 21573 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:00.982357 21574 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:00.994367 21365 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:00.997964 21543 consensus_queue.cc:1059] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 12:13:00.993966 21078 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.023476 13726 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:01.003613 21476 consensus_queue.cc:1048] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.019s
I20260709 12:13:00.991302 21485 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.021064 21546 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:00.995052 21391 raft_consensus.cc:2804] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:13:01.003988 21436 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:01.067932 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 44576us
I20260709 12:13:01.003443 21370 consensus_queue.cc:1059] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 12:13:01.027052 21328 raft_consensus.cc:2804] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:01.002031 21505 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:01.093513 13756 raft_consensus.cc:1240] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:01.095912 13726 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:01.022559 21563 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:01.057521 21574 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:01.059304 21569 raft_consensus.cc:697] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 23 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:01.106415 13685 raft_consensus.cc:3055] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:01.108325 13685 raft_consensus.cc:740] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
W20260709 12:13:01.108738 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 103128us
I20260709 12:13:01.028743 21470 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:01.074396 21545 raft_consensus.cc:2804] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:13:01.034781 21410 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:01.113495 13687 raft_consensus.cc:1275] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:13:01.093923 21391 raft_consensus.cc:697] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:01.062448 21365 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:01.055034 21549 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:01.109217 13685 consensus_queue.cc:260] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:01.134977 13685 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:01.105722 21563 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:13:01.020447 21532 consensus_queue.cc:237] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:01.128265 13679 raft_consensus.cc:1275] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:13:01.103755 21328 raft_consensus.cc:697] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:01.028175 21541 consensus_queue.cc:1048] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.083s
I20260709 12:13:01.072647 21078 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:01.125342 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 150926us
I20260709 12:13:01.035127 21042 consensus_queue.cc:237] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:01.142972 13800 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:01.145531 21078 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:01.147089 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:01.147805 13682 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 20.
I20260709 12:13:01.073963 21485 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:01.060914 21558 consensus_queue.cc:237] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:01.149045 21545 raft_consensus.cc:697] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:01.151091 21551 raft_consensus.cc:3055] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:01.172703 13726 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:01.158679 21170 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:13:01.170464 21575 log.cc:927] Time spent T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
I20260709 12:13:01.203464 21551 raft_consensus.cc:740] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 22 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:01.254536 21551 consensus_queue.cc:260] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:01.258617 21551 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:01.290426 13761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 3455) took 1183 ms. Trace:
I20260709 12:13:01.314410 13761 rpcz_store.cc:276] 0709 12:13:00.106888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:00.107044 (+   156us) service_pool.cc:224] Handling call
0709 12:13:00.128537 (+ 21493us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:00.736150 (+607613us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:01.290021 (+553871us) spinlock_profiling.cc:243] Waited 607 ms on lock 0x7b5400333bd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:01.290336 (+   315us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1395667328}
W20260709 12:13:01.320245 21583 log.cc:927] Time spent T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.168s	user 0.000s	sys 0.000s
I20260709 12:13:01.319757 21545 consensus_queue.cc:237] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:01.322031 21581 log.cc:927] Time spent T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 12:13:01.167428 21476 consensus_queue.cc:1048] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.122s
I20260709 12:13:01.325654 21476 raft_consensus.cc:2804] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:01.326139 21476 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:01.326499 21476 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:13:01.328171 21579 log.cc:927] Time spent T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.270s	user 0.000s	sys 0.001s
I20260709 12:13:01.235584 21569 consensus_queue.cc:237] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:01.286693 21170 raft_consensus.cc:2764] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 12:13:01.228940 21370 consensus_queue.cc:1048] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.158s
I20260709 12:13:01.228148 21078 consensus_queue.cc:1048] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.157s
I20260709 12:13:01.410068 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:01.410941 13829 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 21.
W20260709 12:13:01.408237 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:01.413440 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:01.415539 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:01.417806 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:01.418210 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:01.418959 13828 raft_consensus.cc:2393] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 22: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:13:01.419127 13836 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:01.416386 13829 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 26.
I20260709 12:13:01.225553 21493 consensus_queue.cc:1048] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.175s
I20260709 12:13:01.370484 21328 consensus_queue.cc:237] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:01.439208 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:01.434983 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:01.436529 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:01.436846 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:01.370831 21585 raft_consensus.cc:2749] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:13:01.447381 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:01.401176 21436 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:01.457718 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:01.458675 13835 raft_consensus.cc:2410] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 21 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 12:13:01.238891 21391 consensus_queue.cc:237] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:01.466041 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 162729us
I20260709 12:13:01.466735 14379 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:13:01.466941 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 294291us
I20260709 12:13:01.473246 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:01.474171 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:01.462248 21585 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.478999 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:01.479266 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
W20260709 12:13:01.476668 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:01.486637 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 312950us
I20260709 12:13:01.488082 13800 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:01.489001 14412 raft_consensus.cc:2368] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 18. Current term is 19.
I20260709 12:13:01.457224 21373 raft_consensus.cc:2749] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:01.498136 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:01.495738 13800 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:13:01.510406 21582 log.cc:927] Time spent T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.272s	user 0.000s	sys 0.001s
I20260709 12:13:01.511097 21531 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:01.494621 21591 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:01.477447 21470 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:01.519555 13836 raft_consensus.cc:2410] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 18 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 12:13:01.521147 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:13:01.521962 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 55368.9us
I20260709 12:13:01.496892 21505 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:01.498261 21410 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:01.478806 21436 consensus_queue.cc:1048] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 12:13:01.531208 13832 raft_consensus.cc:1275] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:13:01.515018 21549 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:01.543419 13652 leader_election.cc:400] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 18. Current term is 19.
I20260709 12:13:01.516219 21365 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:01.491200 21585 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:01.523281 21470 raft_consensus.cc:2749] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:01.530551 21485 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:01.538496 21376 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:01.512404 21591 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:01.530766 21561 consensus_queue.cc:1048] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.030s
I20260709 12:13:01.530942 21015 consensus_queue.cc:1059] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.027s
I20260709 12:13:01.544581 21599 raft_consensus.cc:2749] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:01.549422 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:01.550652 13652 leader_election.cc:403] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:01.590865 13687 raft_consensus.cc:1240] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 23 LEADER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 22. Current term is 23. Ops: []
W20260709 12:13:01.591276 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 48018.2us
I20260709 12:13:01.591967 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:13:01.578217 21413 consensus_meta.cc:287] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.638s	user 0.011s	sys 0.001s
I20260709 12:13:01.547179 21569 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:01.596679 21413 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:01.597015 21569 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:01.599627 21413 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:01.570310 21563 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:01.587955 13685 raft_consensus.cc:1275] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 13. (term mismatch)
I20260709 12:13:01.602228 13685 pending_rounds.cc:85] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 12
I20260709 12:13:01.602556 13685 pending_rounds.cc:107] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 22.13
I20260709 12:13:01.602667 21563 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:01.602900 13685 raft_consensus.cc:2889] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:01.588922 21598 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:01.606532 21598 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:01.607033 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:01.564507 21585 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:01.573392 13681 raft_consensus.cc:1275] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 12:13:01.575106 21606 consensus_queue.cc:1048] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 12:13:01.610337 21436 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.610805 21436 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:01.611141 21574 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:01.611545 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:01.578011 21015 raft_consensus.cc:3055] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 19 LEADER]: Stepping down as leader of term 19
W20260709 12:13:01.579502 21482 consensus_meta.cc:287] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.768s	user 0.010s	sys 0.002s
I20260709 12:13:01.599682 21569 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:01.580672 21414 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:13:01.585736 21501 consensus_meta.cc:287] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.778s	user 0.003s	sys 0.007s
I20260709 12:13:01.639485 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:13:01.630043 21573 consensus_meta.cc:287] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.567s	user 0.013s	sys 0.008s
I20260709 12:13:01.614462 13832 raft_consensus.cc:1275] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:13:01.592890 13835 raft_consensus.cc:2410] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 27 because replica has last-logged OpId of term: 24 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 12.
I20260709 12:13:01.615592 13829 raft_consensus.cc:1275] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:13:01.612869 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:01.612870 13833 raft_consensus.cc:1275] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:13:01.673498 13830 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 21.
I20260709 12:13:01.605625 21476 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:01.609454 21598 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:01.650035 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:01.679932 13763 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 20.
I20260709 12:13:01.649403 13759 raft_consensus.cc:1240] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:01.653855 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:13:01.660028 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 164383us
I20260709 12:13:01.650327 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:01.683038 13758 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 22.
I20260709 12:13:01.683319 13761 raft_consensus.cc:2393] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 26: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:01.663332 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:01.683290 13800 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:01.545958 13836 raft_consensus.cc:1240] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:01.684674 13800 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:01.627942 21505 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:13:01.579977 21602 consensus_queue.cc:1048] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.082s
I20260709 12:13:01.678380 13680 raft_consensus.cc:1275] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 26 index: 16. (term mismatch)
I20260709 12:13:01.678601 13762 raft_consensus.cc:2393] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 23: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:01.688664 13680 pending_rounds.cc:85] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 15
I20260709 12:13:01.689091 13680 pending_rounds.cc:107] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 25.16
I20260709 12:13:01.689429 13680 raft_consensus.cc:2889] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:01.627413 21585 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:01.662946 13756 raft_consensus.cc:1275] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 12:13:01.581580 21591 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:01.630158 21015 raft_consensus.cc:740] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:01.659404 21563 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:01.685591 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:01.682272 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:01.716081 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:01.716622 13759 raft_consensus.cc:2393] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 20: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:01.691244 13836 raft_consensus.cc:1275] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 12:13:01.717082 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:01.717809 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:01.691553 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:01.692310 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:01.692651 13831 raft_consensus.cc:1240] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:01.576411 21376 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:01.697270 13800 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:01.702208 21328 consensus_queue.cc:1048] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:13:01.719151 13832 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 17.
I20260709 12:13:01.724417 13800 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:01.720940 13762 raft_consensus.cc:1240] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:01.718595 13836 raft_consensus.cc:2393] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 21: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:01.721840 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:01.722067 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:01.723290 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:01.713584 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:01.727664 13759 raft_consensus.cc:2393] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 23: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:01.727936 13756 raft_consensus.cc:2368] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 21. Current term is 22.
I20260709 12:13:01.718859 13829 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:01.712385 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:01.732997 13834 raft_consensus.cc:1275] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:13:01.735893 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:01.736743 13836 raft_consensus.cc:2468] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 15.
I20260709 12:13:01.737206 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:01.737897 13831 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 20.
I20260709 12:13:01.687342 21599 raft_consensus.cc:2804] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:01.663362 21482 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:01.743196 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:13:01.746750 21546 consensus_meta.cc:287] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.653s	user 0.007s	sys 0.014s
I20260709 12:13:01.747300 21546 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:01.751375 21476 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:01.751587 21546 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:01.753754 21376 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:01.757392 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:01.757603 21015 consensus_queue.cc:260] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:01.759107 21015 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:01.759217 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:01.762138 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:01.764163 13756 raft_consensus.cc:1275] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:13:01.709515 21585 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:01.766429 13684 raft_consensus.cc:3055] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:13:01.766867 13684 raft_consensus.cc:740] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:01.708214 21485 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:01.767573 21485 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:01.767980 13688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 3559) took 1261 ms. Trace:
I20260709 12:13:01.772421 13759 raft_consensus.cc:1275] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:13:01.775332 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:01.768445 13688 rpcz_store.cc:276] 0709 12:13:00.506895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:00.540319 (+ 33424us) service_pool.cc:224] Handling call
0709 12:13:01.767805 (+1227486us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b54002c4054. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:01.767923 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":442675072}
I20260709 12:13:01.694293 21501 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:01.680198 21573 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:01.779054 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:01.697189 21365 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:01.783509 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:01.784188 13688 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:13:01.786972 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 62644.8us
I20260709 12:13:01.788793 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:01.792493 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:01.791743 13800 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:01.767690 13684 consensus_queue.cc:260] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:01.792790 13762 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:01.718137 21598 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:01.802757 13684 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:01.718600 21607 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:01.803719 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:01.767793 21585 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:01.801338 13800 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:01.797509 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:13:01.806114 21614 log.cc:927] Time spent T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:13:01.710548 21391 consensus_queue.cc:1059] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.093s
I20260709 12:13:01.778132 21485 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:01.806808 21562 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:01.808709 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:01.742288 21488 raft_consensus.cc:2749] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:01.814021 13830 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:13:01.802428 21365 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:01.817953 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:01.823004 13688 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 23.
I20260709 12:13:01.815357 21470 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.778388 21389 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.769227 21599 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:01.824891 13800 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:01.826928 13686 raft_consensus.cc:2368] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 18. Current term is 19.
W20260709 12:13:01.859702 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:01.730463 21563 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:01.785751 21476 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:01.795257 21549 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:01.879336 13755 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:13:01.919245 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:01.817009 21598 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:01.907581 13832 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 19.
I20260709 12:13:01.951771 13684 raft_consensus.cc:1275] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:13:01.796962 21501 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:01.970294 13651 leader_election.cc:400] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 21. Current term is 22.
I20260709 12:13:01.970902 13651 leader_election.cc:403] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:01.885301 13829 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 19.
I20260709 12:13:01.910018 21365 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:01.859059 21562 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:01.817224 21607 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:01.911657 21476 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:01.796411 21593 raft_consensus.cc:2804] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:01.974331 13755 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 23.
I20260709 12:13:01.955943 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:01.917420 21609 raft_consensus.cc:2749] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:13:01.908145 21599 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:13:01.882047 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 57246.5us
I20260709 12:13:01.990634 13684 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:01.993866 13800 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:01.995326 13800 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:01.917694 21389 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:01.918056 21470 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:02.011638 13679 raft_consensus.cc:1240] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 14. Current term is 15. Ops: []
I20260709 12:13:02.016325 13762 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 22.
I20260709 12:13:01.927471 21549 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:01.998724 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:02.000025 21598 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:01.993542 13830 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 15.
I20260709 12:13:01.986335 13829 raft_consensus.cc:1240] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:01.957604 21569 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.954671 21042 consensus_queue.cc:1059] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.044s
I20260709 12:13:01.956672 21391 consensus_queue.cc:1243] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer b98d2519bb504dc6905ed2ede4571835 log is divergent from this leader: its last log entry 23.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:13:01.975121 21410 raft_consensus.cc:2749] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:02.057757 13755 raft_consensus.cc:1275] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 12:13:02.066447 13833 raft_consensus.cc:1275] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 11. (term mismatch)
I20260709 12:13:02.066882 13833 pending_rounds.cc:85] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 10
I20260709 12:13:02.067116 13833 pending_rounds.cc:107] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 20.11
I20260709 12:13:02.067369 13833 raft_consensus.cc:2889] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:02.067490 13755 raft_consensus.cc:1275] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:13:02.068687 13757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 3456) took 1930 ms. Trace:
I20260709 12:13:02.069074 13757 rpcz_store.cc:276] 0709 12:13:00.138280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:00.138444 (+   164us) service_pool.cc:224] Handling call
0709 12:13:00.138788 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:00.708834 (+570046us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:02.068455 (+1359621us) spinlock_profiling.cc:243] Waited 475 ms on lock 0x7b540038d1d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:02.068629 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1092306176}
I20260709 12:13:02.054219 13684 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 22.
I20260709 12:13:01.987866 21593 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:02.019837 21574 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:13:02.122032 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:02.070708 21611 log.cc:927] Time spent T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.213s	user 0.000s	sys 0.001s
I20260709 12:13:02.058110 21591 raft_consensus.cc:2764] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:13:02.127597 20457 consensus_queue.cc:1059] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.009s
W20260709 12:13:02.127264 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 153374us
I20260709 12:13:02.059444 21609 raft_consensus.cc:2749] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:13:02.064788 21123 raft_consensus.cc:3055] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:13:02.132756 13684 raft_consensus.cc:1240] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:02.053665 21619 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Advancing to term 22
I20260709 12:13:02.135730 14379 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:13:02.120568 21593 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:02.085085 21602 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:02.140143 13651 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:13:02.147406 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 152202us
I20260709 12:13:02.149665 20457 raft_consensus.cc:3055] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:13:02.150339 20457 raft_consensus.cc:740] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:02.151365 13800 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:13:02.156721 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:02.203459 21609 raft_consensus.cc:2749] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:13:02.135800 21482 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:02.204280 21549 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:02.204425 21609 consensus_queue.cc:1048] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:13:02.205830 21563 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:02.068238 21569 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:02.154508 21602 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:02.208344 21569 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:02.205739 21573 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:02.158731 21598 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.214721 21598 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:02.217442 21622 log.cc:927] Time spent T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 12:13:02.153167 21608 log.cc:927] Time spent T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.421s	user 0.001s	sys 0.000s
I20260709 12:13:02.147686 21585 raft_consensus.cc:2749] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:02.222012 21607 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:02.222704 21607 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:13:02.224401 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 61409.9us
I20260709 12:13:02.224506 21482 consensus_queue.cc:1048] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:13:02.224933 20457 consensus_queue.cc:260] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:02.225449 13651 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:02.225963 21482 consensus_queue.cc:1048] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:13:02.226344 13679 raft_consensus.cc:1240] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:02.227653 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:02.224514 21470 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:02.227738 21482 raft_consensus.cc:2749] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:13:02.226249 20457 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:13:02.157738 21437 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:02.203662 21501 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:02.234324 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:02.235035 13683 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:02.113611 21620 consensus_queue.cc:1059] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.084s
I20260709 12:13:02.143101 21123 raft_consensus.cc:740] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
W20260709 12:13:02.231367 21613 log.cc:927] Time spent T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.421s	user 0.001s	sys 0.000s
I20260709 12:13:02.158038 21561 raft_consensus.cc:2804] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:02.230042 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:02.209542 21602 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:02.255640 21615 log.cc:927] Time spent T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.335s	user 0.001s	sys 0.000s
W20260709 12:13:02.282605 21592 log.cc:927] Time spent T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.807s	user 0.007s	sys 0.000s
I20260709 12:13:02.284736 13682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 3585) took 1128 ms. Trace:
I20260709 12:13:02.285312 13682 rpcz_store.cc:276] 0709 12:13:01.156438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:01.156599 (+   161us) service_pool.cc:224] Handling call
0709 12:13:01.156945 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:01.162239 (+  5294us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:01.162288 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:01.162916 (+   628us) log.cc:844] Serialized 26 byte log entry
0709 12:13:01.405852 (+242936us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:13:01.405896 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:01.405966 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:02.236269 (+830303us) spinlock_profiling.cc:243] Waited 3.44 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:13:02.284284 (+ 48015us) raft_consensus.cc:1685] finished
0709 12:13:02.284320 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:02.284648 (+   328us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10741,"raft.queue_time_us":244746,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":17441,"spinlock_wait_cycles":9863296,"thread_start_us":241607,"threads_started":1,"wal-append.queue_time_us":281366}
I20260709 12:13:02.289019 13682 raft_consensus.cc:1275] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
W20260709 12:13:02.290661 21621 log.cc:927] Time spent T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.228s	user 0.000s	sys 0.001s
I20260709 12:13:02.242336 21437 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:02.256620 21561 raft_consensus.cc:697] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 22 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:02.267632 21598 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:02.336906 13652 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 1.567s (SENT) [suppressed 6 similar messages]
W20260709 12:13:02.350111 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 214464us
I20260709 12:13:02.341245 21476 leader_election.cc:290] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:13:02.352523 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 50301.4us
I20260709 12:13:02.333015 21123 consensus_queue.cc:260] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:02.354724 21123 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:02.355319 21437 leader_election.cc:290] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:02.357231 21389 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:02.362309 21328 raft_consensus.cc:3055] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:02.362808 21328 raft_consensus.cc:740] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:02.363679 21328 consensus_queue.cc:260] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:02.364778 21328 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:02.365711 13681 raft_consensus.cc:1275] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:13:02.370905 13759 raft_consensus.cc:1240] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:02.375059 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:02.379451 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:02.379696 13759 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:02.380311 13763 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:02.387079 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:13:02.388547 14380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:02.393117 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:02.393026 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:02.406791 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:02.408571 13760 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 24.
I20260709 12:13:02.415886 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:02.416314 13763 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 19.
I20260709 12:13:02.399490 21633 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:02.418888 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:02.418990 13761 raft_consensus.cc:2393] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 22: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
W20260709 12:13:02.422351 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:02.419237 13759 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 20.
W20260709 12:13:02.420553 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 83673.7us
I20260709 12:13:02.423882 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
W20260709 12:13:02.406296 21612 log.cc:927] Time spent T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.386s	user 0.000s	sys 0.001s
I20260709 12:13:02.424391 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:02.429354 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:13:02.426234 21485 consensus_meta.cc:287] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.548s	user 0.010s	sys 0.000s
I20260709 12:13:02.399740 21200 consensus_queue.cc:1059] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 12:13:02.442322 13683 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 22.
W20260709 12:13:02.442979 13828 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.006s	sys 0.015s
W20260709 12:13:02.451591 13828 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.006s	sys 0.015s
I20260709 12:13:02.442240 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:02.454366 13828 raft_consensus.cc:1240] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 22. Current term is 23. Ops: [22.16-22.16]
W20260709 12:13:02.456290 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 300288us
I20260709 12:13:02.458117 13800 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:02.456530 13828 raft_consensus.cc:1275] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
W20260709 12:13:02.462670 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:02.469959 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:02.470829 13760 raft_consensus.cc:2368] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 18. Current term is 19.
I20260709 12:13:02.427042 21633 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:02.476547 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:02.407032 21561 consensus_queue.cc:237] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:02.469696 21585 raft_consensus.cc:2749] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:13:02.437901 21638 consensus_queue.cc:1048] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.054s
W20260709 12:13:02.475600 21505 consensus_meta.cc:287] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.781s	user 0.008s	sys 0.004s
I20260709 12:13:02.486212 21505 raft_consensus.cc:2749] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 18. Current term is 19.
I20260709 12:13:02.468869 21630 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.487290 13684 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 19.
I20260709 12:13:02.487975 21633 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:13:02.480912 21015 consensus_meta.cc:287] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.721s	user 0.007s	sys 0.007s
I20260709 12:13:02.486981 21630 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:02.490926 21630 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:13:02.495620 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:02.446859 21485 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:02.469169 21593 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:02.497581 21619 raft_consensus.cc:2749] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 21. Current term is 22.
I20260709 12:13:02.518445 21389 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.519600 21389 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:02.522948 13763 raft_consensus.cc:1275] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 12:13:02.523234 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:02.523981 13755 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 20.
I20260709 12:13:02.525290 13835 raft_consensus.cc:2393] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 19: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:02.527733 21593 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:02.530308 21485 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:02.531934 13679 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 22.
I20260709 12:13:02.532096 13828 raft_consensus.cc:1240] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 27. Current term is 28. Ops: []
W20260709 12:13:02.533250 21562 consensus_meta.cc:287] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.530s	user 0.008s	sys 0.001s
I20260709 12:13:02.537650 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:02.536347 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:02.538748 13681 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 26.
I20260709 12:13:02.540526 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:02.541285 13757 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 26.
I20260709 12:13:02.541908 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:02.543324 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:02.545011 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:02.545732 13681 raft_consensus.cc:2393] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 20: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:02.546805 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:02.547667 21501 raft_consensus.cc:3055] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:02.548185 21501 raft_consensus.cc:740] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:02.547784 13681 raft_consensus.cc:2393] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 21: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:02.556380 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:02.557387 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:02.560304 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:02.562412 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:02.563779 21501 consensus_queue.cc:260] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:02.565188 21501 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:13:02.569139 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:02.571889 21599 consensus_meta.cc:287] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.517s	user 0.011s	sys 0.000s
I20260709 12:13:02.572634 21599 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:02.543396 21562 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:02.574294 13837 raft_consensus.cc:1240] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:02.574452 13687 raft_consensus.cc:1240] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:02.575536 13686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 2458) took 1616 ms. Trace:
I20260709 12:13:02.575945 13686 rpcz_store.cc:276] 0709 12:13:00.958933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:00.983502 (+ 24569us) service_pool.cc:224] Handling call
0709 12:13:02.575302 (+1591800us) spinlock_profiling.cc:243] Waited 836 ms on lock 0x7b54003f07d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:02.575468 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1923585408}
I20260709 12:13:02.577168 21599 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:02.579480 21485 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:02.581003 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:02.586654 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:02.587129 13757 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 20.
I20260709 12:13:02.581969 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:02.583412 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:13:02.588243 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 185364us
I20260709 12:13:02.588704 13685 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 19.
I20260709 12:13:02.598219 21587 raft_consensus.cc:3055] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:02.598879 21587 raft_consensus.cc:740] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:02.599996 21587 consensus_queue.cc:260] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:02.605720 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:02.607434 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:02.601554 21587 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:02.610797 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:02.611855 13757 raft_consensus.cc:2393] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 22: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
W20260709 12:13:02.613567 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:02.614470 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:02.615645 13800 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:02.586661 21389 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:02.617915 13800 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:02.618527 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:02.619494 21630 raft_consensus.cc:2804] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:02.619957 21630 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:02.620388 21630 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:02.616667 21593 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:02.622253 21555 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 21 current term: 21 is higher.
I20260709 12:13:02.622344 21593 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:02.616415 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 189068us
I20260709 12:13:02.624541 13800 leader_election.cc:304] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:02.628798 13686 raft_consensus.cc:1240] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 28. Current term is 29. Ops: []
I20260709 12:13:02.630035 13686 raft_consensus.cc:1240] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:02.634608 13833 raft_consensus.cc:1240] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 14. Current term is 15. Ops: []
I20260709 12:13:02.602582 21485 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:02.639302 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:02.640168 21640 raft_consensus.cc:2749] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:13:02.642812 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:02.646652 13680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 3573) took 1769 ms. Trace:
I20260709 12:13:02.647058 13680 rpcz_store.cc:276] 0709 12:13:00.877517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:00.877706 (+   189us) service_pool.cc:224] Handling call
0709 12:13:00.878165 (+   459us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:01.690025 (+811860us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:02.646403 (+956378us) spinlock_profiling.cc:243] Waited 786 ms on lock 0x7b54002bf2d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:02.646591 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1807549824}
I20260709 12:13:02.625617 21585 raft_consensus.cc:2764] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 22: won
I20260709 12:13:02.642828 13757 raft_consensus.cc:2393] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 24: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:02.654433 21630 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:02.655526 21436 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:02.656582 21630 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:02.641808 13833 raft_consensus.cc:1240] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:02.651654 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:02.659507 13800 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:13:02.660490 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:02.660797 13800 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:02.625877 21633 consensus_queue.cc:1059] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:13:02.657657 21640 consensus_queue.cc:1048] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.004s
I20260709 12:13:02.662076 21599 raft_consensus.cc:2749] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:02.662153 21633 raft_consensus.cc:3055] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:02.662688 21633 raft_consensus.cc:740] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:02.664667 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:02.665915 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:02.666293 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:02.671698 13835 raft_consensus.cc:1275] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 12:13:02.672951 13830 raft_consensus.cc:1240] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:02.673454 13800 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:02.675230 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:02.677119 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:02.677448 21585 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:02.680371 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:02.681598 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:02.699402 13757 raft_consensus.cc:2393] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 23: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:02.680564 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:02.677734 13830 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:02.700518 13727 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:02.702106 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:02.702026 21200 consensus_queue.cc:1059] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 28.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:13:02.702981 21561 raft_consensus.cc:3055] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 28 LEADER]: Stepping down as leader of term 28
I20260709 12:13:02.703357 21561 raft_consensus.cc:740] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 28 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:02.704221 21561 consensus_queue.cc:260] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 28.18, Last appended by leader: 18, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:02.705446 21561 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:02.709715 13727 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:02.714241 13833 raft_consensus.cc:1275] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:13:02.708446 13651 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:02.716113 13651 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:02.642977 21652 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:02.717128 13651 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:02.729175 13762 raft_consensus.cc:1240] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 23. Current term is 24. Ops: [23.13-23.13]
I20260709 12:13:02.728380 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:02.730556 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:02.731177 14412 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 23.
W20260709 12:13:02.734808 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 61428.9us
I20260709 12:13:02.679919 21170 raft_consensus.cc:2749] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:02.739845 21593 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:02.741569 13681 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 23.
I20260709 12:13:02.742617 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:02.677915 21452 raft_consensus.cc:3055] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:13:02.744369 13833 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:02.743553 13727 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:02.746381 21413 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:02.679659 21485 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:02.718708 21373 raft_consensus.cc:2749] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:02.762214 13727 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:02.720532 21555 raft_consensus.cc:2804] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:13:02.743148 21558 raft_consensus.cc:2804] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:13:02.767460 13651 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:02.768118 13830 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 22.
I20260709 12:13:02.778457 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:02.779436 13830 raft_consensus.cc:2368] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 21. Current term is 22.
I20260709 12:13:02.780565 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:02.781939 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:02.782693 13830 raft_consensus.cc:2368] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 20. Current term is 21.
I20260709 12:13:02.773504 13727 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:02.776120 13800 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:02.719471 21200 consensus_queue.cc:1059] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.047s
I20260709 12:13:02.750385 21452 raft_consensus.cc:740] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:02.753958 21507 raft_consensus.cc:2749] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:02.787731 13800 leader_election.cc:400] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 18. Current term is 19.
I20260709 12:13:02.792214 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:02.751061 21413 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:02.787107 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:02.792654 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:02.793399 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:02.776247 21541 raft_consensus.cc:2804] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:02.791481 21485 raft_consensus.cc:2804] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election won for term 27
W20260709 12:13:02.822111 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 66346.7us
I20260709 12:13:02.823889 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:02.824702 13756 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:02.822417 21485 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:02.825385 21485 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:02.826002 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:02.814579 21505 raft_consensus.cc:2804] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:02.794756 13727 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:02.830376 21505 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:02.831013 21505 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:02.832196 13727 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:02.833985 21545 raft_consensus.cc:2749] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:02.835338 21545 raft_consensus.cc:2749] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:02.833551 13727 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:02.837639 13727 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:02.838680 21507 raft_consensus.cc:2749] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:13:02.797765 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:02.798822 21413 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:02.798928 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:02.795447 13800 leader_election.cc:403] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:02.799503 21555 raft_consensus.cc:697] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 19 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
W20260709 12:13:02.805418 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:02.807614 21200 raft_consensus.cc:3055] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:02.808573 21452 consensus_queue.cc:260] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:02.775796 21331 raft_consensus.cc:2749] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:02.828739 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:02.841698 13727 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:02.796676 21476 raft_consensus.cc:2749] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:02.742589 21652 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:02.854571 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:02.855018 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:13:02.854301 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 66766.7us
I20260709 12:13:02.856722 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:02.871675 13830 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 22.
I20260709 12:13:02.864030 13833 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 22.
I20260709 12:13:02.867970 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:02.869696 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:02.873901 13683 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Advancing to term 21
I20260709 12:13:02.875734 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:02.871018 13800 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:02.878803 13800 leader_election.cc:400] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 18. Current term is 19.
I20260709 12:13:02.879940 13800 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:02.882597 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:02.886435 13800 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:02.887825 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:02.900887 13800 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:02.900233 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:02.900473 13756 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 21.
I20260709 12:13:02.903635 13830 raft_consensus.cc:2393] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 23: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:02.901540 13682 raft_consensus.cc:1240] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 22. Current term is 23. Ops: [22.10-22.10]
I20260709 12:13:02.861475 21200 raft_consensus.cc:740] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 22 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:02.942739 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:13:02.927014 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 63546.2us
I20260709 12:13:02.865255 21593 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:13:02.890411 21452 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:02.890101 21545 raft_consensus.cc:2749] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:13:02.950402 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:02.955263 13683 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 21.
I20260709 12:13:02.901921 21170 raft_consensus.cc:2804] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:02.939049 21585 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:02.890515 21445 consensus_queue.cc:1048] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.074s
I20260709 12:13:02.855659 21507 consensus_queue.cc:1048] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.093s
I20260709 12:13:02.875188 21647 consensus_queue.cc:1048] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.091s
I20260709 12:13:02.882266 21509 consensus_queue.cc:1048] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.075s
I20260709 12:13:02.963788 21170 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:02.951303 21373 raft_consensus.cc:2749] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:02.966526 21585 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:02.986691 21640 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.985322 21170 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:13:03.018699 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:03.014909 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 143317us
I20260709 12:13:03.000339 21365 raft_consensus.cc:2749] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:03.044183 13727 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:03.002095 21558 raft_consensus.cc:697] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 20 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:03.010870 21585 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Advancing to term 27
W20260709 12:13:03.050240 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 108721us
I20260709 12:13:02.998297 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:03.060766 13830 raft_consensus.cc:2393] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 22: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
W20260709 12:13:03.062903 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:03.014536 21597 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.058513 13727 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:02.969998 21555 consensus_queue.cc:237] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:03.073577 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:03.049641 21476 raft_consensus.cc:2749] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:03.086305 13830 raft_consensus.cc:1275] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
W20260709 12:13:03.095089 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 194270us
I20260709 12:13:03.097034 13800 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:03.116966 13834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 3365) took 1422 ms. Trace:
I20260709 12:13:03.078841 21505 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:03.117437 13834 rpcz_store.cc:276] 0709 12:13:01.694812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:01.771165 (+ 76353us) service_pool.cc:224] Handling call
0709 12:13:01.798318 (+ 27153us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:02.075760 (+277442us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:13:02.125067 (+ 49307us) log.cc:844] Serialized 14 byte log entry
0709 12:13:02.405619 (+280552us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:02.405736 (+   117us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:13:02.405830 (+    94us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:03.116681 (+710851us) spinlock_profiling.cc:243] Waited 277 ms on lock 0x7b54002a7454. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:03.116728 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:03.116868 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":49280,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":4634,"raft.queue_time_us":9787,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":127,"spinlock_wait_cycles":637520768,"thread_start_us":270103,"threads_started":1,"wal-append.queue_time_us":313088}
I20260709 12:13:03.119926 21505 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:03.122244 21652 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:03.044317 21640 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:03.070457 21331 consensus_queue.cc:1048] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 12:13:03.066838 21545 consensus_queue.cc:1048] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.052s
W20260709 12:13:03.132352 21660 log.cc:927] Time spent T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 12:13:03.083381 21597 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:03.125082 21365 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:03.121665 21668 raft_consensus.cc:2804] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:03.123148 21562 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:13:03.152256 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 55327us
W20260709 12:13:03.147372 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 88974.5us
I20260709 12:13:03.148319 13830 raft_consensus.cc:1275] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 9. (term mismatch)
I20260709 12:13:03.155179 13800 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:03.156876 21365 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:03.159392 21365 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:13:03.165892 21662 log.cc:927] Time spent T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:13:03.168186 21638 raft_consensus.cc:3055] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:13:03.168712 21638 raft_consensus.cc:740] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:03.136811 21630 raft_consensus.cc:2749] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:03.155570 13727 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:03.155992 13830 pending_rounds.cc:85] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 8
I20260709 12:13:03.177073 13830 pending_rounds.cc:107] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 12:13:03.178334 13830 raft_consensus.cc:2889] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:13:03.155164 21659 log.cc:927] Time spent T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
I20260709 12:13:03.174932 13800 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:13:03.182127 21656 log.cc:927] Time spent T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
I20260709 12:13:03.186340 21391 raft_consensus.cc:2804] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 12:13:03.175642 21661 log.cc:927] Time spent T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 12:13:03.197880 21668 raft_consensus.cc:697] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:03.180099 21365 raft_consensus.cc:2804] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:03.202342 13687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 1527) took 1089 ms. Trace:
I20260709 12:13:03.209447 21413 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:03.209867 21200 consensus_queue.cc:260] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:03.154692 21591 raft_consensus.cc:2749] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:03.213821 13837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 3367) took 1518 ms. Trace:
I20260709 12:13:03.243660 13830 raft_consensus.cc:1275] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
W20260709 12:13:03.244369 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 65299.3us
I20260709 12:13:03.247884 13829 raft_consensus.cc:1275] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:13:03.250697 13687 rpcz_store.cc:276] 0709 12:13:02.113686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:02.292911 (+179225us) service_pool.cc:224] Handling call
0709 12:13:02.293315 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:02.575004 (+281689us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:03.202064 (+627060us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x7b540031e7d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:03.202271 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":645997440}
W20260709 12:13:03.241750 21663 log.cc:927] Time spent T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
W20260709 12:13:03.266296 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 91449.4us
I20260709 12:13:03.147892 21558 consensus_queue.cc:237] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:03.263321 21365 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:03.240288 21509 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.267490 13837 rpcz_store.cc:276] 0709 12:13:01.695254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:01.807945 (+112691us) service_pool.cc:224] Handling call
0709 12:13:01.808271 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:02.574719 (+766448us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:03.213547 (+638828us) spinlock_profiling.cc:243] Waited 766 ms on lock 0x7b54002a6054. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:03.213736 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1761283456}
I20260709 12:13:03.281884 13727 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:03.287602 13800 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:13:03.331491 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 43992.4us
I20260709 12:13:03.332376 13800 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:13:03.291442 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:03.265700 21507 consensus_queue.cc:1048] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 12:13:03.298498 21640 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:03.301342 21597 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:03.302407 21665 log.cc:927] Time spent T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 12:13:03.282821 21609 raft_consensus.cc:2749] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:03.308889 21668 consensus_queue.cc:237] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:03.267248 21391 raft_consensus.cc:697] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:03.319495 13757 raft_consensus.cc:1240] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 26. Current term is 27. Ops: []
W20260709 12:13:03.338373 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 56608.9us
I20260709 12:13:03.169687 21638 consensus_queue.cc:260] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:03.330180 21365 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:03.360425 13754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 1286) took 2849 ms. Trace:
I20260709 12:13:03.361045 13754 rpcz_store.cc:276] 0709 12:13:00.503104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:00.960597 (+457493us) service_pool.cc:224] Handling call
0709 12:13:00.962378 (+  1781us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:01.012555 (+ 50177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:01.012584 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:01.014348 (+  1764us) log.cc:844] Serialized 26 byte log entry
0709 12:13:02.704946 (+1690598us) spinlock_profiling.cc:243] Waited 9.4 ms on lock 0x7b1800402c40. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e82e07 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9fc02 00007fa927b2720b 00007fa927b2cd23 00007fa927b2d0d1 00007fa927f48a0f
0709 12:13:02.756086 (+ 51140us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:13:02.783626 (+ 27540us) log.cc:844] Serialized 14 byte log entry
0709 12:13:02.783905 (+   279us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:02.783978 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:03.340491 (+556513us) raft_consensus.cc:1685] finished
0709 12:13:03.352183 (+ 11692us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:03.352373 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57798,"prepare.queue_time_us":27332,"prepare.run_cpu_time_us":208,"prepare.run_wall_time_us":3526,"raft.queue_time_us":50252,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":10417,"spinlock_wait_cycles":21616896,"thread_start_us":50904,"threads_started":1,"wal-append.queue_time_us":1919531}
I20260709 12:13:03.336071 21599 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:03.335813 21591 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:13:03.345373 21587 consensus_meta.cc:287] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.729s	user 0.001s	sys 0.016s
I20260709 12:13:03.376282 21200 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:03.387811 21365 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:03.374382 21667 raft_consensus.cc:2749] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:03.393251 13836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 3364) took 1698 ms. Trace:
W20260709 12:13:03.392735 21485 consensus_meta.cc:287] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.567s	user 0.013s	sys 0.001s
I20260709 12:13:03.401540 21485 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:03.416615 21585 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:03.395663 13836 rpcz_store.cc:276] 0709 12:13:01.694586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:01.738760 (+ 44174us) service_pool.cc:224] Handling call
0709 12:13:01.739080 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:01.768797 (+ 29717us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:13:01.802261 (+ 33464us) log.cc:844] Serialized 14 byte log entry
0709 12:13:02.053297 (+251036us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:02.053344 (+    47us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:13:02.053383 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:03.392928 (+1339545us) spinlock_profiling.cc:243] Waited 29.5 ms on lock 0x7b5400363654. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:03.393000 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:03.393175 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":168814,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":150235,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":89,"spinlock_wait_cycles":67742976,"thread_start_us":280179,"threads_started":2,"wal-append.queue_time_us":355177,"wal-append.run_cpu_time_us":1415,"wal-append.run_wall_time_us":1001437}
I20260709 12:13:03.398298 13688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 1515) took 1458 ms. Trace:
I20260709 12:13:03.335265 21509 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:03.426769 13688 rpcz_store.cc:276] 0709 12:13:01.939951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:01.940090 (+   139us) service_pool.cc:224] Handling call
0709 12:13:01.940441 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:02.050407 (+109966us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 12:13:02.395570 (+345163us) log.cc:844] Serialized 14 byte log entry
0709 12:13:02.495110 (+ 99540us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:02.495183 (+    73us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:13:02.495244 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:03.398026 (+902782us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b5400311fd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:03.398087 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:03.398238 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":380712,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":2053,"raft.queue_time_us":123,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":2139,"spinlock_wait_cycles":252398464,"thread_start_us":417899,"threads_started":2,"wal-append.queue_time_us":208431}
I20260709 12:13:03.378311 21678 consensus_queue.cc:1048] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:13:03.440703 13828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 1526) took 1048 ms. Trace:
I20260709 12:13:03.441280 13828 rpcz_store.cc:276] 0709 12:13:02.391858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:02.469789 (+ 77931us) service_pool.cc:224] Handling call
0709 12:13:02.520075 (+ 50286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:02.532823 (+ 12748us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:03.440312 (+907489us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b5400167bd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:03.440613 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27052288}
I20260709 12:13:03.434329 21593 raft_consensus.cc:2749] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 18. Current term is 19.
I20260709 12:13:03.454692 13763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 3503) took 1036 ms. Trace:
W20260709 12:13:03.456076 13832 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54830 (request call id 3363) took 1758 ms (client timeout 1893 ms). Trace:
I20260709 12:13:03.456377 13828 raft_consensus.cc:1240] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 26. Current term is 27. Ops: []
W20260709 12:13:03.456542 13832 rpcz_store.cc:269] 0709 12:13:01.694360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:01.741633 (+ 47273us) service_pool.cc:224] Handling call
0709 12:13:03.452795 (+1711162us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b54002a6f54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:03.452975 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":376424192}
I20260709 12:13:03.455325 13763 rpcz_store.cc:276] 0709 12:13:02.417913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:02.421073 (+  3160us) service_pool.cc:224] Handling call
0709 12:13:02.421537 (+   464us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:02.523434 (+101897us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:03.453641 (+930207us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b54003340d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:03.454623 (+   982us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":232361216}
W20260709 12:13:03.451819 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 116472us
I20260709 12:13:03.459951 13800 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:03.467209 13800 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:03.474509 13833 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 19.
I20260709 12:13:03.465349 21593 raft_consensus.cc:2749] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:03.485302 21170 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:03.491636 13830 raft_consensus.cc:1240] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:03.454703 21365 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:03.459730 21485 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:03.495638 21170 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:03.498993 13726 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:03.504004 21410 raft_consensus.cc:2804] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:03.502262 21476 consensus_queue.cc:1048] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 12:13:03.508131 21413 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:03.516196 21678 consensus_queue.cc:1048] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.010s
I20260709 12:13:03.506834 21507 raft_consensus.cc:2804] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:03.518173 21509 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:03.438270 21391 consensus_queue.cc:237] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:03.523512 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:03.531523 21545 consensus_queue.cc:1048] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.004s
W20260709 12:13:03.542375 14380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:03.543157 14380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:03.535162 21410 raft_consensus.cc:697] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 21 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:03.544039 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:03.544167 21410 consensus_queue.cc:237] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:03.544929 13833 raft_consensus.cc:2393] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 27: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
W20260709 12:13:03.545400 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 490156us
I20260709 12:13:03.545964 21507 raft_consensus.cc:697] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:03.547068 21507 consensus_queue.cc:237] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 20.9, Last appended by leader: 9, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:03.538286 13834 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 20.
I20260709 12:13:03.549757 14408 raft_consensus.cc:1240] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 22 LEADER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:03.549894 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:03.537933 21451 consensus_queue.cc:1048] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.006s
I20260709 12:13:03.551591 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:03.552013 13727 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:03.553066 21509 raft_consensus.cc:2804] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:03.553332 14415 raft_consensus.cc:1275] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:13:03.553534 21509 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:03.554031 21509 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:03.555473 13687 raft_consensus.cc:1275] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
W20260709 12:13:03.559830 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:03.562172 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 57238.4us
I20260709 12:13:03.562430 13759 raft_consensus.cc:1240] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:03.572260 13800 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:13:03.573948 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:03.575318 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:03.577019 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:03.582326 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:03.584754 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:03.591068 21633 consensus_queue.cc:260] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 22.10, Last appended by leader: 10, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:03.592304 21633 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:13:03.602478 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:03.603080 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:03.605572 20457 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:03.606160 20457 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:03.607033 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:03.608016 13755 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 20.
W20260709 12:13:03.608652 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:03.608860 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:03.614104 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:03.615134 13685 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:03.617401 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:03.618736 13687 raft_consensus.cc:2368] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 20. Current term is 21.
I20260709 12:13:03.621538 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:03.622033 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:03.622530 13758 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:03.622965 13687 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:03.623420 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:03.506042 21690 consensus_queue.cc:1059] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 26.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.079s
I20260709 12:13:03.646067 13679 raft_consensus.cc:1240] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 20 LEADER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:03.646466 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:03.648819 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:03.651497 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:03.657907 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:03.658713 13681 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 21.
I20260709 12:13:03.659791 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:13:03.668907 13684 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 3595) took 1441 ms (client timeout 1756 ms). Trace:
W20260709 12:13:03.661267 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 55622.2us
I20260709 12:13:03.679306 13685 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 27.
I20260709 12:13:03.681742 20457 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:03.669396 13684 rpcz_store.cc:269] 0709 12:13:02.227522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:02.229745 (+  2223us) service_pool.cc:224] Handling call
0709 12:13:03.668731 (+1438986us) spinlock_profiling.cc:243] Waited 239 ms on lock 0x7b54002c4054. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:03.668843 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":548991872}
I20260709 12:13:03.684244 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:03.685037 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:03.685217 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:03.688694 13758 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 21.
I20260709 12:13:03.633435 21634 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:03.699819 13687 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 20.
W20260709 12:13:03.702487 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 57659.4us
I20260709 12:13:03.710728 21541 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
W20260709 12:13:03.711030 21693 log.cc:927] Time spent T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.210s	user 0.000s	sys 0.000s
I20260709 12:13:03.711428 21541 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:13:03.713231 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:03.670085 21243 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:03.714102 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:03.714190 21243 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:03.716928 21243 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:03.720988 13726 leader_election.cc:336] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.756s (SENT)
I20260709 12:13:03.722358 21452 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:13:03.722561 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 150395us
I20260709 12:13:03.723052 21452 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:03.723733 13800 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:03.725024 13800 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:03.726044 21593 raft_consensus.cc:2749] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:03.726136 21485 raft_consensus.cc:2749] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:13:03.726945 21593 raft_consensus.cc:2749] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:03.646931 21646 consensus_queue.cc:1059] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.065s
I20260709 12:13:03.731047 21646 raft_consensus.cc:3055] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:13:03.731537 21646 raft_consensus.cc:740] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:03.732614 21646 consensus_queue.cc:260] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:03.579102 21545 consensus_queue.cc:1059] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.104s
I20260709 12:13:03.653158 21678 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:03.746783 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:03.586079 21685 consensus_queue.cc:1048] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.101s
I20260709 12:13:03.754944 13651 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:03.760739 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:03.761541 13756 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 20.
I20260709 12:13:03.762097 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:03.766605 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:13:03.768879 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:03.773605 13688 raft_consensus.cc:1240] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:03.775177 13685 raft_consensus.cc:1275] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
W20260709 12:13:03.744015 21658 log.cc:927] Time spent T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:13:03.784060 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:03.760740 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:03.659193 21673 consensus_queue.cc:1048] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.127s
I20260709 12:13:03.782819 13685 raft_consensus.cc:1240] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:03.799540 13679 raft_consensus.cc:1240] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:03.803272 14379 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:03.709307 21558 consensus_queue.cc:1048] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.076s
I20260709 12:13:03.772815 21545 consensus_queue.cc:1243] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer ca9fbbc2c0a94897897d502d42f3951f log is divergent from this leader: its last log entry 22.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 12:13:03.818771 21243 consensus_queue.cc:1048] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.009s
I20260709 12:13:03.763805 21678 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:03.827400 21678 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:03.828171 21649 raft_consensus.cc:2804] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:03.830487 14379 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:03.807329 21646 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:03.778879 21587 raft_consensus.cc:2804] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:03.766762 21585 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:03.735352 21589 consensus_queue.cc:1059] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 26.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.054s
I20260709 12:13:03.784207 21485 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.706121 21634 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:03.787437 21012 consensus_queue.cc:1059] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 12:13:03.828783 21649 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:03.806492 21489 consensus_queue.cc:1048] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.059s
W20260709 12:13:03.846783 21688 log.cc:927] Time spent T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.267s	user 0.001s	sys 0.000s
W20260709 12:13:03.848702 21694 log.cc:927] Time spent T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 12:13:03.805932 21200 consensus_queue.cc:1059] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.050s
I20260709 12:13:03.857967 13685 raft_consensus.cc:1275] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 12:13:03.854182 13759 raft_consensus.cc:1240] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 22. Current term is 23. Ops: [22.10-22.10]
I20260709 12:13:03.863016 13679 raft_consensus.cc:1240] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 21. Current term is 22. Ops: []
W20260709 12:13:03.866842 21692 log.cc:927] Time spent T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.132s	user 0.000s	sys 0.002s
I20260709 12:13:03.814033 21670 consensus_queue.cc:1048] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.071s
I20260709 12:13:03.853626 21532 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:13:03.875304 21657 log.cc:927] Time spent T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 12:13:03.834429 21650 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.856014 21599 raft_consensus.cc:2749] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:13:03.881281 21686 log.cc:927] Time spent T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.153s	user 0.001s	sys 0.002s
I20260709 12:13:03.882719 21558 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:03.883639 21589 raft_consensus.cc:3055] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:03.884115 21587 raft_consensus.cc:697] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 21 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:03.900179 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:03.892882 21649 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:13:03.924157 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 244091us
I20260709 12:13:03.910000 21012 consensus_queue.cc:1243] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Peer b98d2519bb504dc6905ed2ede4571835 log is divergent from this leader: its last log entry 20.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:13:03.856650 21509 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:03.935469 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:03.891157 21485 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:03.936995 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:03.986970 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:03.927620 21589 raft_consensus.cc:740] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:03.924265 21650 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:03.941236 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 175217us
W20260709 12:13:03.966531 13652 connection.cc:256] RPC call timeout handler was delayed by -1.0342081180001514s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21450000000000002s for a response
I20260709 12:13:04.028723 13758 raft_consensus.cc:1275] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260709 12:13:04.051827 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 54495.3us
I20260709 12:13:04.019627 13763 raft_consensus.cc:1240] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 20. Current term is 21. Ops: [20.17-20.17]
I20260709 12:13:04.034884 13726 leader_election.cc:304] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:13:04.083376 13652 connection.cc:256] RPC call timeout handler was delayed by -1.0324081180001485s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2147s for a response
I20260709 12:13:04.093839 13686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 1533) took 1464 ms. Trace:
I20260709 12:13:04.094558 13686 rpcz_store.cc:276] 0709 12:13:02.629503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:02.630934 (+  1431us) service_pool.cc:224] Handling call
0709 12:13:02.631221 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:02.632836 (+  1615us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:02.635974 (+  3138us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:02.636587 (+   613us) log.cc:844] Serialized 26 byte log entry
0709 12:13:03.115726 (+479139us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b18004a9da0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa927b354bc 00007fa924e8348b 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9fc02 00007fa927b2720b 00007fa927b2cd23 00007fa927b2d0d1
0709 12:13:03.115907 (+   181us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:13:03.115945 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:03.116016 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:03.707029 (+591013us) spinlock_profiling.cc:243] Waited 16.2 ms on lock 0x7b18004a9da0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924ea03f3 00007fa924ea27c1 00007fa924ea2779 00007fa924ea2709 00007fa924ea26d1 00007fa924ea19cd 0000000000388634 0000000000388479 00007fa924e8383a
0709 12:13:04.093569 (+386540us) raft_consensus.cc:1685] finished
0709 12:13:04.093592 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:04.093741 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":708,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":7740,"spinlock_wait_cycles":71451136,"thread_start_us":5538,"threads_started":1,"wal-append.queue_time_us":5626}
I20260709 12:13:03.991102 21678 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:04.100608 21678 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:04.040071 21703 log.cc:927] Time spent T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:13:04.120083 21507 consensus_queue.cc:1048] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:03.996774 21545 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.997002 21668 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.931735 21558 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:04.107919 21696 log.cc:927] Time spent T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.319s	user 0.000s	sys 0.001s
I20260709 12:13:04.018178 21562 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:04.132223 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 49601.4us
I20260709 12:13:04.087108 21599 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.094188 21630 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:04.163762 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:04.028139 21373 consensus_queue.cc:1059] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.113s
I20260709 12:13:04.132004 21410 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:04.139460 21365 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:13:04.196929 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:04.158249 21555 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.262394 21555 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:04.193785 21591 consensus_meta.cc:287] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.810s	user 0.013s	sys 0.000s
I20260709 12:13:04.157647 21545 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:04.286909 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 252141us
W20260709 12:13:04.266055 21541 consensus_meta.cc:287] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.554s	user 0.013s	sys 0.000s
I20260709 12:13:04.300968 13652 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:04.155718 21668 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:04.297785 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 209968us
W20260709 12:13:04.272991 21696 log.cc:927] Time spent T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 12:13:04.142912 21587 consensus_queue.cc:237] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:04.284947 21591 raft_consensus.cc:2749] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:04.159611 21708 raft_consensus.cc:2749] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:04.188005 21532 consensus_queue.cc:1059] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 27.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.116s
I20260709 12:13:04.187088 21599 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:04.319950 13652 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:04.184803 21589 consensus_queue.cc:260] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 26.13, Last appended by leader: 13, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:04.180279 21562 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:04.191934 21630 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:04.333972 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 251007us
I20260709 12:13:04.259614 21410 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:04.342806 21705 log.cc:927] Time spent T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
W20260709 12:13:04.347951 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 622949us
I20260709 12:13:04.330484 21678 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:04.371667 13800 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:13:04.309264 21690 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:04.350119 13652 leader_election.cc:304] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:04.324214 21541 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:04.345845 21543 raft_consensus.cc:2749] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
W20260709 12:13:04.356235 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 199735us
I20260709 12:13:04.269362 21365 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:04.373901 13800 leader_election.cc:400] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 election: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 20. Current term is 21.
I20260709 12:13:04.383841 13800 leader_election.cc:403] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 12:13:04.385218 13800 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:04.386910 14380 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:13:04.391929 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:04.380301 13652 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:04.406155 13832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 3739) took 1124 ms. Trace:
I20260709 12:13:04.406744 13832 rpcz_store.cc:276] 0709 12:13:03.281685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:03.458003 (+176318us) service_pool.cc:224] Handling call
0709 12:13:03.458359 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:03.458734 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:13:03.489831 (+ 31097us) log.cc:844] Serialized 14 byte log entry
0709 12:13:03.526899 (+ 37068us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:03.527599 (+   700us) log.cc:844] Serialized 26 byte log entry
0709 12:13:03.527792 (+   193us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:13:03.527845 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:03.527959 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:04.405937 (+877978us) raft_consensus.cc:1685] finished
0709 12:13:04.405956 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:04.406092 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49388,"prepare.queue_time_us":30882,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":51,"raft.queue_time_us":25694,"raft.run_cpu_time_us":330,"raft.run_wall_time_us":9193,"thread_start_us":14505,"threads_started":1,"wal-append.queue_time_us":196388}
I20260709 12:13:04.368650 21650 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:04.366891 21509 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:13:04.398634 21646 consensus_meta.cc:287] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.539s	user 0.006s	sys 0.006s
I20260709 12:13:04.383522 21585 raft_consensus.cc:2804] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:04.379141 21485 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:04.399358 21589 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:04.400682 21711 raft_consensus.cc:2749] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:04.379356 21437 consensus_queue.cc:1048] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.080s
I20260709 12:13:04.400456 21709 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:04.384477 21690 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:04.460707 21585 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:04.476452 21485 raft_consensus.cc:2804] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 12:13:04.497730 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 117488us
W20260709 12:13:04.487143 14380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:04.496153 21712 log.cc:927] Time spent T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.240s	user 0.000s	sys 0.001s
I20260709 12:13:04.497654 21585 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:04.477824 21728 consensus_queue.cc:1059] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 26.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.027s
I20260709 12:13:04.523175 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:04.526260 14412 raft_consensus.cc:2410] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 24 because replica has last-logged OpId of term: 22 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 15.
I20260709 12:13:04.482422 21507 consensus_queue.cc:1059] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.032s
I20260709 12:13:04.481441 21509 consensus_queue.cc:1048] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:13:04.504498 21485 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:04.510586 21545 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:13:04.554461 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 222445us
I20260709 12:13:04.506790 21558 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:04.565934 13726 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
W20260709 12:13:04.582959 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:04.560933 21485 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:04.557125 21747 raft_consensus.cc:2749] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:13:04.632498 13654 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.016s	sys 0.034s
I20260709 12:13:04.520532 21725 consensus_queue.cc:1059] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.094s
W20260709 12:13:04.632989 13654 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.016s	sys 0.035s
I20260709 12:13:04.582332 21507 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
W20260709 12:13:04.599956 21718 log.cc:927] Time spent T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.256s	user 0.000s	sys 0.001s
I20260709 12:13:04.582715 21545 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
W20260709 12:13:04.610158 21707 log.cc:927] Time spent T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.261s	user 0.001s	sys 0.001s
W20260709 12:13:04.611897 21717 log.cc:927] Time spent T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 12:13:04.628520 21727 raft_consensus.cc:2749] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:04.609730 21015 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.631989 21738 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.661710 21738 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:04.664322 21738 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:04.664948 21015 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:04.667475 21015 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:04.652078 21630 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:04.668565 21630 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:04.669927 21725 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:04.670571 21725 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:04.671501 21633 consensus_meta.cc:287] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 1.079s	user 0.014s	sys 0.000s
I20260709 12:13:04.673098 21725 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:04.611018 21716 log.cc:927] Time spent T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:13:04.651480 21541 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:04.654385 21365 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:04.642513 21726 raft_consensus.cc:2804] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:04.669186 21630 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:04.608045 21728 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:04.599776 21668 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:04.657686 13681 raft_consensus.cc:1240] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 23 LEADER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 22. Current term is 23. Ops: []
W20260709 12:13:04.674717 21719 log.cc:927] Time spent T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 12:13:04.656941 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:04.646930 21562 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:04.649362 21599 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:04.645509 21451 raft_consensus.cc:2749] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:13:04.689046 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:04.689584 13831 raft_consensus.cc:1240] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:04.701444 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:04.702378 13834 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:04.642530 21507 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:04.677700 21736 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.678081 21726 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:04.701611 13830 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 22.
I20260709 12:13:04.717078 13831 raft_consensus.cc:1275] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 22 index: 10. Preceding OpId from leader: term: 23 index: 10. (term mismatch)
I20260709 12:13:04.717928 13831 pending_rounds.cc:85] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 9
I20260709 12:13:04.718319 13831 pending_rounds.cc:107] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 22.10
I20260709 12:13:04.718861 13831 raft_consensus.cc:2889] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:13:04.712205 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 327127us
I20260709 12:13:04.721469 13800 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:04.725634 13800 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:04.653146 21545 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:04.742887 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:04.744009 13754 raft_consensus.cc:2393] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 27: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:04.696856 21365 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:04.685040 21728 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:04.777156 13833 raft_consensus.cc:1240] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:04.719416 21726 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:13:04.755647 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 352790us
I20260709 12:13:04.770195 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:13:04.779841 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 120208us
I20260709 12:13:04.783965 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:04.786526 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:04.788491 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:04.790575 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:04.791464 13683 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 15.
I20260709 12:13:04.792606 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:04.795598 13686 raft_consensus.cc:1240] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:04.797457 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:04.747810 21599 raft_consensus.cc:2804] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader election won for term 27
W20260709 12:13:04.792752 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 75353.6us
I20260709 12:13:04.801525 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:04.803328 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:04.806061 13683 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 19.
I20260709 12:13:04.807286 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:13:04.810631 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 307557us
I20260709 12:13:04.768954 21633 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.812672 14408 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 21.
W20260709 12:13:04.831210 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:04.851035 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:04.778609 21749 raft_consensus.cc:2804] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:13:04.845913 13652 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:04.815392 13681 raft_consensus.cc:1275] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:13:04.853169 13652 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:04.794811 21690 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:04.719708 21736 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:04.812328 21587 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.859139 13652 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:04.754487 21365 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:04.908299 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 46055.3us
I20260709 12:13:04.815241 21743 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.909724 21735 consensus_queue.cc:1059] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 26.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.058s
I20260709 12:13:04.909971 21751 consensus_queue.cc:1048] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.056s
I20260709 12:13:04.845912 21633 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:04.911981 21545 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:04.909538 21752 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:04.856093 21719 log.cc:927] Time spent T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.055s	user 0.001s	sys 0.001s
I20260709 12:13:04.909567 13652 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:04.930765 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:04.929168 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:04.912858 21606 raft_consensus.cc:2749] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:04.913056 21541 raft_consensus.cc:2804] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:13:04.933347 21732 log.cc:927] Time spent T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
I20260709 12:13:04.934937 21753 consensus_queue.cc:1048] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:13:04.914430 21587 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:04.906718 21452 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:13:04.907251 21649 consensus_meta.cc:287] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.919s	user 0.014s	sys 0.000s
I20260709 12:13:04.950968 21630 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:13:04.951812 21745 log.cc:927] Time spent T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:13:04.908187 21562 raft_consensus.cc:2749] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:04.964895 21728 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:04.967098 13834 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 21.
I20260709 12:13:04.969102 13683 raft_consensus.cc:2393] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 23: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:04.971405 21752 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:04.973944 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 64479.8us
W20260709 12:13:04.993573 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:05.016914 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:13:05.026866 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 234462us
I20260709 12:13:05.037017 13652 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:05.043022 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:05.047307 13652 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:04.975066 21541 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:04.971669 21743 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:05.065804 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:05.082463 13652 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:13:05.106436 21754 log.cc:927] Time spent T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
W20260709 12:13:05.108314 21740 log.cc:927] Time spent T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 12:13:05.088577 21606 raft_consensus.cc:2804] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:13:05.111311 13688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 3608) took 1176 ms. Trace:
I20260709 12:13:05.111816 13688 rpcz_store.cc:276] 0709 12:13:03.934651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:03.934789 (+   138us) service_pool.cc:224] Handling call
0709 12:13:03.935133 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:03.965345 (+ 30212us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:13:04.247750 (+282405us) log.cc:844] Serialized 14 byte log entry
0709 12:13:04.633458 (+385708us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:04.643215 (+  9757us) log.cc:844] Serialized 26 byte log entry
0709 12:13:04.643382 (+   167us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:13:04.643672 (+   290us) log.cc:844] Serialized 14 byte log entry
0709 12:13:04.643866 (+   194us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:04.643979 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:05.111056 (+467077us) raft_consensus.cc:1685] finished
0709 12:13:05.111075 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:05.111236 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":340503,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":92,"raft.queue_time_us":48068,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":23654,"thread_start_us":573238,"threads_started":2,"wal-append.queue_time_us":542366}
I20260709 12:13:05.133232 13680 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 23.
I20260709 12:13:05.121354 13684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 1545) took 1233 ms. Trace:
I20260709 12:13:05.143779 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:05.145166 13688 raft_consensus.cc:2393] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 25: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:05.144018 13684 rpcz_store.cc:276] 0709 12:13:03.887538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:03.887782 (+   244us) service_pool.cc:224] Handling call
0709 12:13:03.913223 (+ 25441us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:03.913707 (+   484us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:03.913749 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:03.914347 (+   598us) log.cc:844] Serialized 26 byte log entry
0709 12:13:04.182196 (+267849us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:13:04.182242 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:04.182321 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:04.716822 (+534501us) raft_consensus.cc:1685] finished
0709 12:13:04.716848 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:05.120923 (+404075us) spinlock_profiling.cc:243] Waited 24.9 ms on lock 0x7b5400272750. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:05.121261 (+   338us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1729,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":4821,"spinlock_wait_cycles":57299840,"thread_start_us":248290,"threads_started":1,"wal-append.queue_time_us":457013}
I20260709 12:13:05.031138 21758 raft_consensus.cc:2749] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:05.156837 13760 raft_consensus.cc:3055] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:05.162806 13760 raft_consensus.cc:740] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:05.069716 21541 raft_consensus.cc:3060] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:13:05.118743 21736 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:05.235004 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:05.165804 21489 raft_consensus.cc:3055] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:13:05.236263 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:05.169595 21445 raft_consensus.cc:3055] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:13:05.236853 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:05.176909 21606 raft_consensus.cc:697] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 15 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:05.177027 21675 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:05.253530 13762 raft_consensus.cc:1275] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 12:13:05.178612 21700 log.cc:927] Time spent T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 1.149s	user 0.008s	sys 0.009s
I20260709 12:13:05.181581 21587 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:05.183705 21752 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:05.190635 21633 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:05.191777 14416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41700 (request call id 1156) took 1198 ms. Trace:
I20260709 12:13:05.195515 21630 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:05.127120 21638 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:05.115362 21689 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:05.115629 21763 raft_consensus.cc:2804] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:13:05.205642 21485 consensus_meta.cc:287] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.571s	user 0.011s	sys 0.001s
I20260709 12:13:05.207296 21365 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:13:05.210425 21709 consensus_meta.cc:287] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.716s	user 0.006s	sys 0.006s
I20260709 12:13:05.031917 21649 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:05.220134 21507 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:05.199186 21755 consensus_queue.cc:1048] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 12:13:05.222913 21743 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:05.228579 21757 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:13:05.096545 21589 consensus_meta.cc:287] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.624s	user 0.013s	sys 0.000s
W20260709 12:13:05.213511 21585 consensus_meta.cc:287] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.654s	user 0.010s	sys 0.000s
I20260709 12:13:05.163890 13760 consensus_queue.cc:260] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:05.146425 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:13:05.242630 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 160274us
I20260709 12:13:05.246372 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:05.256222 21597 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:05.272903 21413 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:05.246323 21445 raft_consensus.cc:740] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:05.266556 14416 rpcz_store.cc:276] 0709 12:13:03.993035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:03.993362 (+   327us) service_pool.cc:224] Handling call
0709 12:13:03.993866 (+   504us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:03.994354 (+   488us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:03.994402 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:04.054366 (+ 59964us) log.cc:844] Serialized 26 byte log entry
0709 12:13:04.515078 (+460712us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:13:04.515140 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:04.515801 (+   661us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:05.191562 (+675761us) raft_consensus.cc:1685] finished
0709 12:13:05.191583 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:05.191715 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4040,"raft.queue_time_us":2730,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":9599,"thread_start_us":368796,"threads_started":1,"wal-append.queue_time_us":533448}
I20260709 12:13:05.244848 21489 raft_consensus.cc:740] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 27 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:05.258466 21685 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:05.254715 21753 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:05.299435 21736 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:05.346838 21512 raft_consensus.cc:3055] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:05.304956 21485 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:05.358366 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:05.359277 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:05.355792 21451 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:13:05.368429 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:05.356052 21170 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.029s	sys 0.062s
I20260709 12:13:05.307183 21709 raft_consensus.cc:2749] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 20. Current term is 21.
I20260709 12:13:05.379844 13685 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 27.
I20260709 12:13:05.345748 21752 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:05.265789 21675 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:05.357559 13652 leader_election.cc:400] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 21. Current term is 22.
I20260709 12:13:05.356786 21585 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:05.305392 21689 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:05.384716 13683 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 21.
I20260709 12:13:05.426137 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:05.426744 13683 raft_consensus.cc:2468] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 15.
I20260709 12:13:05.427536 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:05.428071 13683 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 23.
I20260709 12:13:05.428828 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:05.308395 21763 raft_consensus.cc:697] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 19 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
W20260709 12:13:05.385159 13836 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.026s	sys 0.015s
W20260709 12:13:05.434758 13836 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.026s	sys 0.015s
W20260709 12:13:05.411995 21170 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.761s	user 0.030s	sys 0.063s
W20260709 12:13:05.411053 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:05.362824 21413 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:05.299847 21630 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:05.417420 21445 consensus_queue.cc:260] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:05.419286 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 70992.1us
I20260709 12:13:05.420575 21489 consensus_queue.cc:260] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 27.17, Last appended by leader: 17, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:05.417464 21451 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:05.424131 13835 raft_consensus.cc:1240] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:05.431540 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:05.380952 21512 raft_consensus.cc:740] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:05.409107 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:05.438041 13828 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 21.
I20260709 12:13:05.356500 21766 consensus_queue.cc:1048] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.069s
I20260709 12:13:05.353592 21757 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:05.408067 21749 raft_consensus.cc:697] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 20 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:05.447311 13652 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:05.462067 13652 leader_election.cc:400] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 20. Current term is 21.
I20260709 12:13:05.462529 13652 leader_election.cc:403] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:05.458185 13688 raft_consensus.cc:1275] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 12:13:05.383456 21736 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:05.466038 13683 raft_consensus.cc:1240] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:05.469333 13688 raft_consensus.cc:1240] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:05.469400 13683 raft_consensus.cc:1275] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
W20260709 12:13:05.444595 21599 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.009s	sys 0.013s
I20260709 12:13:05.471289 13683 raft_consensus.cc:1275] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 20 index: 9. Preceding OpId from leader: term: 23 index: 10. (index mismatch)
I20260709 12:13:05.423429 21752 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:05.473687 13652 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:05.381678 21753 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:05.511269 13652 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:13:05.481230 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:05.464450 21170 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:05.464118 21489 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:05.381346 21606 consensus_queue.cc:237] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:05.472468 21756 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:05.371870 21685 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:05.539578 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:05.540366 14412 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 23.
I20260709 12:13:05.541463 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:05.513751 21589 raft_consensus.cc:2749] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:13:05.466624 21445 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:05.467797 21633 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:05.478624 13681 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.033s	sys 0.069s
W20260709 12:13:05.559491 13681 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.037s	sys 0.080s
I20260709 12:13:05.523844 21587 raft_consensus.cc:2749] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 12:13:05.516201 13801 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.722s	user 0.003s	sys 0.035s
W20260709 12:13:05.473610 21599 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.010s	sys 0.013s
I20260709 12:13:05.471166 21760 raft_consensus.cc:2749] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:05.546579 13582 catalog_manager.cc:5697] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 15 to 19, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 19 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:05.550125 13578 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53318 (request call id 148) took 22773 ms (client timeout 15000 ms). Trace:
I20260709 12:13:05.551702 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:05.552628 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:05.553521 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:05.555310 21413 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:05.555985 21767 log.cc:927] Time spent T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 12:13:05.542268 21725 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:05.557969 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:05.475939 21755 raft_consensus.cc:2749] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 20. Current term is 21.
I20260709 12:13:05.562626 13652 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:13:05.563298 13801 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.769s	user 0.004s	sys 0.035s
I20260709 12:13:05.518728 14416 raft_consensus.cc:1240] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 22 LEADER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 21. Current term is 22. Ops: [21.16-21.16]
I20260709 12:13:05.594905 14415 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 29.
I20260709 12:13:05.630263 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:05.647972 13683 raft_consensus.cc:2410] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 25 because replica has last-logged OpId of term: 23 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 12.
I20260709 12:13:05.645113 14414 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 21.
I20260709 12:13:05.527469 21170 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:05.624541 13582 catalog_manager.cc:5697] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 15 to 18, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 18 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:05.560098 21649 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 21 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:05.665705 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:05.544667 21774 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:05.592677 13578 rpcz_store.cc:269] 0709 12:12:42.776991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:45.106023 (+2329032us) service_pool.cc:224] Handling call
0709 12:13:05.550023 (+20444000us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:56.921281 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:56.922005 (+   724us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:56.922062 (+    57us) write_op.cc:435] Acquired schema lock
0709 12:12:56.922080 (+    18us) tablet.cc:662] Decoding operations
0709 12:12:57.133978 (+211898us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:57.141884 (+  7906us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:57.141923 (+    39us) tablet.cc:685] Acquiring locks for 18 operations
0709 12:12:57.143606 (+  1683us) tablet.cc:701] Row locks acquired
0709 12:12:57.143660 (+    54us) write_op.cc:260] PREPARE: finished
0709 12:12:57.143913 (+   253us) write_op.cc:270] Start()
0709 12:12:57.144103 (+   190us) write_op.cc:276] Timestamp: P: 1783599177143810 usec, L: 0
0709 12:12:57.144142 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 12:12:57.144948 (+   806us) log.cc:844] Serialized 7107 byte log entry
0709 12:12:57.510828 (+365880us) op_driver.cc:464] REPLICATION: finished
0709 12:12:57.640876 (+130048us) write_op.cc:301] APPLY: starting
0709 12:12:57.641004 (+   128us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:57.827789 (+186785us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:57.870806 (+ 43017us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:59.077608 (+1206802us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:59.078041 (+   433us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=36,key_file_lookups=36,delta_file_lookups=36,mrs_lookups=0
0709 12:12:59.078119 (+    78us) write_op.cc:312] APPLY: finished
0709 12:12:59.078593 (+   474us) log.cc:844] Serialized 164 byte log entry
0709 12:12:59.165397 (+ 86804us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:59.188306 (+ 22909us) write_op.cc:454] Released schema lock
0709 12:12:59.222555 (+ 34249us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:59.297821 (+ 75266us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:59.297858 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4355933,"reported_tablets":29,"child_traces":[["op",{"apply.queue_time_us":129688,"apply.run_cpu_time_us":42272,"apply.run_wall_time_us":1633934,"cfile_cache_hit":74,"cfile_cache_hit_bytes":79367,"num_ops":18,"prepare.queue_time_us":217459,"prepare.run_cpu_time_us":37903,"prepare.run_wall_time_us":423305,"raft.queue_time_us":120741,"raft.run_cpu_time_us":23874,"raft.run_wall_time_us":142928,"replication_time_us":366419,"thread_start_us":541400,"threads_started":5,"wal-append.queue_time_us":327009,"wal-append.run_cpu_time_us":30930,"wal-append.run_wall_time_us":2174551}]]}
I20260709 12:13:05.540580 21541 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:05.667547 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:05.668897 13834 raft_consensus.cc:1240] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 20. Current term is 21. Ops: [18.16-20.17]
W20260709 12:13:05.657470 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 141698us
I20260709 12:13:05.567590 21690 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:05.666678 13836 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 21.
I20260709 12:13:05.754922 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:05.523464 21512 consensus_queue.cc:260] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:05.755759 13836 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 15.
I20260709 12:13:05.592015 21599 raft_consensus.cc:697] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 27 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:05.597725 21769 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:05.568524 21328 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:05.733755 13582 catalog_manager.cc:5697] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 14 to 15, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 15 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:05.537556 21756 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:05.738140 13832 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 19.
I20260709 12:13:05.567359 21633 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:05.669425 21743 raft_consensus.cc:2804] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:05.678503 13801 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:05.758340 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:05.675778 21766 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:05.766978 13652 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:05.538422 21763 consensus_queue.cc:237] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:05.779229 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 100847us
I20260709 12:13:05.787499 13801 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:05.789232 13801 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:05.736317 21768 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:05.662568 21725 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:05.784201 13652 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:05.779642 13834 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 23.
I20260709 12:13:05.567402 21749 consensus_queue.cc:237] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:05.860260 13582 catalog_manager.cc:5697] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 6 to 12, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 12 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
W20260709 12:13:05.857147 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 73078.6us
I20260709 12:13:05.734202 21774 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:05.780416 21562 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.009s	sys 0.064s
I20260709 12:13:05.778110 21743 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:05.781335 21765 raft_consensus.cc:2749] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 12:13:05.801666 21512 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:05.779526 21675 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:05.851109 21413 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:05.780377 21585 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:05.854420 21630 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:05.869601 21773 raft_consensus.cc:2749] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:05.878176 13582 catalog_manager.cc:5697] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 12 to 19, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 19 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:13:05.885983 21562 consensus_queue.cc:1059] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:13:05.886758 21633 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:13:05.887063 21775 log.cc:927] Time spent T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 12:13:05.863904 21606 raft_consensus.cc:2749] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:05.778615 21328 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:05.891367 21771 log.cc:927] Time spent T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.330s	user 0.000s	sys 0.001s
I20260709 12:13:05.872015 21736 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:05.892742 21753 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:05.854017 21689 leader_election.cc:290] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:05.798513 21451 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:05.815366 21778 raft_consensus.cc:2749] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:13:05.899734 13652 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
W20260709 12:13:05.883319 21770 log.cc:927] Time spent T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.363s	user 0.000s	sys 0.001s
I20260709 12:13:05.878271 21743 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:05.768144 21690 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:05.798988 21766 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:05.867542 21755 consensus_queue.cc:1048] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.033s
I20260709 12:13:05.899574 21765 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:05.944314 21765 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:05.897538 21685 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:05.899281 21413 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:05.930023 21784 raft_consensus.cc:2749] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:05.846057 21768 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:05.930354 21541 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:05.931236 21756 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:05.931737 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:05.967273 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:05.967893 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:05.933212 21772 log.cc:927] Time spent T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.192s	user 0.000s	sys 0.000s
I20260709 12:13:05.933733 21170 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:05.780027 21769 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:05.874460 21760 consensus_queue.cc:1048] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
W20260709 12:13:05.931277 21759 log.cc:927] Time spent T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.357s	user 0.001s	sys 0.001s
I20260709 12:13:05.957224 21690 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:05.948097 21752 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:13:05.960867 21726 consensus_meta.cc:287] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 1.156s	user 0.010s	sys 0.003s
I20260709 12:13:05.898388 21599 consensus_queue.cc:237] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:05.964129 21743 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:05.985687 21777 log.cc:927] Time spent T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.251s	user 0.000s	sys 0.001s
I20260709 12:13:05.994699 21766 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:05.995178 21410 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:05.995769 21765 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:05.997301 21726 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:05.998287 21761 log.cc:927] Time spent T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 1.029s	user 0.004s	sys 0.006s
I20260709 12:13:06.000710 21725 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:06.009423 21413 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:05.991928 21743 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:05.991824 21328 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:05.987068 21678 raft_consensus.cc:3055] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:13:06.010059 21726 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:06.022660 21769 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:06.022775 21485 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:06.020797 21678 raft_consensus.cc:740] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:13:06.032897 21638 consensus_meta.cc:287] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.740s	user 0.010s	sys 0.003s
I20260709 12:13:06.036387 21768 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:13:06.037144 21597 consensus_meta.cc:287] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.683s	user 0.009s	sys 0.002s
W20260709 12:13:06.040899 21746 log.cc:927] Time spent T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 1.195s	user 0.004s	sys 0.000s
I20260709 12:13:06.044461 21678 consensus_queue.cc:260] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:06.045193 21597 raft_consensus.cc:2749] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:06.045727 21678 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:06.046026 21646 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:06.046808 21646 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:05.891752 13571 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d2f365337b324999a073edacbe6c6e09 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER failed with leader ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica ca9fbbc2c0a94897897d502d42f3951f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 21 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
W20260709 12:13:06.087512 13571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 405389us
I20260709 12:13:05.917765 13582 catalog_manager.cc:5697] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 6 to 15, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 15 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:06.091130 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 207861us
I20260709 12:13:06.101666 13684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 3616) took 1149 ms. Trace:
I20260709 12:13:06.102231 13684 rpcz_store.cc:276] 0709 12:13:04.951812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:05.173914 (+222102us) service_pool.cc:224] Handling call
0709 12:13:05.174398 (+   484us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:05.236259 (+ 61861us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:05.236291 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:05.253698 (+ 17407us) log.cc:844] Serialized 26 byte log entry
0709 12:13:05.474484 (+220786us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:13:05.474524 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:05.474595 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:06.101035 (+626440us) raft_consensus.cc:1685] finished
0709 12:13:06.101102 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:06.101434 (+   332us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69495,"raft.queue_time_us":61923,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":11073,"thread_start_us":208928,"threads_started":1,"wal-append.queue_time_us":302626}
I20260709 12:13:06.101207 13582 catalog_manager.cc:5697] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 13 to 16, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 16 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:06.105526 13686 raft_consensus.cc:2393] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 29: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:06.107491 13687 raft_consensus.cc:2410] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 24 because replica has last-logged OpId of term: 22 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 15.
I20260709 12:13:06.107983 13755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 3523) took 2083 ms. Trace:
I20260709 12:13:06.108280 13652 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:13:06.109357 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:06.110812 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:06.108517 13755 rpcz_store.cc:276] 0709 12:13:04.024506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:04.025611 (+  1105us) service_pool.cc:224] Handling call
0709 12:13:04.026034 (+   423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:04.383886 (+357852us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:04.383952 (+    66us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:04.384940 (+   988us) log.cc:844] Serialized 26 byte log entry
0709 12:13:04.644907 (+259967us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:13:04.644944 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:04.645022 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:06.040274 (+1395252us) spinlock_profiling.cc:243] Waited 6.93 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:13:06.107063 (+ 66789us) raft_consensus.cc:1685] finished
0709 12:13:06.107119 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:06.107647 (+   528us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7781,"raft.queue_time_us":81118,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":137,"spinlock_wait_cycles":15927552,"thread_start_us":608924,"threads_started":2,"wal-append.queue_time_us":393926}
W20260709 12:13:05.956142 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 165682us
I20260709 12:13:06.127626 13801 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:13:06.130224 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:06.131049 14410 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 20.
I20260709 12:13:06.135931 21328 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:06.137339 21437 raft_consensus.cc:2764] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 12:13:06.137182 21328 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:06.140846 21437 raft_consensus.cc:2749] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:06.154588 13759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 2650) took 2577 ms. Trace:
I20260709 12:13:06.155455 13759 rpcz_store.cc:276] 0709 12:13:03.570456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:03.571070 (+   614us) service_pool.cc:224] Handling call
0709 12:13:03.571530 (+   460us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:03.911273 (+339743us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:06.147493 (+2236220us) spinlock_profiling.cc:243] Waited 276 ms on lock 0x7b54003a07d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:06.148103 (+   610us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":635770752}
W20260709 12:13:06.155455 21722 log.cc:927] Time spent T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 1.700s	user 0.006s	sys 0.000s
I20260709 12:13:06.148427 21328 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:06.170472 13682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 3611) took 2162 ms. Trace:
I20260709 12:13:06.153314 21768 raft_consensus.cc:2749] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:06.155506 21749 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:06.171049 13682 rpcz_store.cc:276] 0709 12:13:04.008065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:04.008487 (+   422us) service_pool.cc:224] Handling call
0709 12:13:04.008882 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:04.009315 (+   433us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:04.009345 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:04.010306 (+   961us) log.cc:844] Serialized 26 byte log entry
0709 12:13:04.247148 (+236842us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:13:04.247219 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:04.247332 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:05.170754 (+923422us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b4800080358. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92ceb6aa1 00007fa92ceadb37 00007fa92cead9ca 00007fa92cfa526f 00007fa92cfa4f37 00007fa92cfb955c 00007fa92cfb9508 00007fa92cfb9488 00007fa92cfb9443 00007fa92cfb86ec 00007fa92bee2a96
0709 12:13:06.148125 (+977371us) spinlock_profiling.cc:243] Waited 6.15 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:13:06.169176 (+ 21051us) raft_consensus.cc:1685] finished
0709 12:13:06.169205 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:06.170253 (+  1048us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60974,"raft.queue_time_us":3068,"raft.run_cpu_time_us":2288,"raft.run_wall_time_us":1152934,"spinlock_wait_cycles":41855616,"thread_start_us":217129,"threads_started":1,"wal-append.queue_time_us":324131}
I20260709 12:13:06.172183 21749 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:06.174768 13680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 3619) took 1219 ms. Trace:
I20260709 12:13:06.175307 13680 rpcz_store.cc:276] 0709 12:13:04.955396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:04.966210 (+ 10814us) service_pool.cc:224] Handling call
0709 12:13:06.174351 (+1208141us) spinlock_profiling.cc:243] Waited 96.1 ms on lock 0x7b5400285fd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:06.174561 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":221119232}
I20260709 12:13:06.176537 21749 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:06.177340 13687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 2485) took 1389 ms. Trace:
I20260709 12:13:06.178613 13687 rpcz_store.cc:276] 0709 12:13:04.787970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:04.788119 (+   149us) service_pool.cc:224] Handling call
0709 12:13:06.177053 (+1388934us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b5400311fd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:06.177257 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3028672768}
I20260709 12:13:06.179231 13801 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:06.180625 21634 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:06.183820 13760 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:06.188354 21555 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:06.190918 13800 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:06.192348 21768 raft_consensus.cc:2749] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:13:06.195199 21768 consensus_queue.cc:1059] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 24.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:06.196211 13756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 3528) took 1601 ms. Trace:
W20260709 12:13:06.198868 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:06.193349 21591 raft_consensus.cc:2804] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:13:06.199626 21365 raft_consensus.cc:3055] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:06.199872 21591 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:06.200223 21365 raft_consensus.cc:740] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:06.200484 21591 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:13:06.202373 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:06.202942 13763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 1305) took 2649 ms. Trace:
I20260709 12:13:06.203435 13763 rpcz_store.cc:276] 0709 12:13:03.553862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:03.557858 (+  3996us) service_pool.cc:224] Handling call
0709 12:13:03.558188 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:04.083447 (+525259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:06.202222 (+2118775us) spinlock_profiling.cc:243] Waited 461 ms on lock 0x7b54003101d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:06.202727 (+   505us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1060475648}
I20260709 12:13:06.204099 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:06.204278 21365 consensus_queue.cc:260] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:06.205853 21365 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:06.204113 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:06.210481 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:06.211449 13761 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 22.
I20260709 12:13:06.199050 13756 rpcz_store.cc:276] 0709 12:13:04.594597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:04.595063 (+   466us) service_pool.cc:224] Handling call
0709 12:13:04.595480 (+   417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:04.748324 (+152844us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:04.748366 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:04.748410 (+    44us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:13:04.748452 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:06.194726 (+1446274us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b540038bdd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:06.194821 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:06.195956 (+  1135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":350948096}
I20260709 12:13:06.214188 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:13:06.215384 14408 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 1322) took 2454 ms (client timeout 1719 ms). Trace:
I20260709 12:13:06.215775 13652 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:06.217183 21558 raft_consensus.cc:2749] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:06.220119 21709 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:06.221042 21709 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:06.224059 21709 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:13:06.215977 14408 rpcz_store.cc:269] 0709 12:13:03.760275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:03.760837 (+   562us) service_pool.cc:224] Handling call
0709 12:13:06.214900 (+2454063us) spinlock_profiling.cc:243] Waited 678 ms on lock 0x7b54006400d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:06.215090 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1559146880}
W20260709 12:13:06.226065 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 44385.8us
I20260709 12:13:06.234189 21452 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
W20260709 12:13:06.235147 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:06.235265 21452 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:06.236477 21328 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:06.238085 21452 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:06.237272 21328 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:06.243309 13758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 3529) took 1647 ms. Trace:
I20260709 12:13:06.243839 13758 rpcz_store.cc:276] 0709 12:13:04.596079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:04.596232 (+   153us) service_pool.cc:224] Handling call
0709 12:13:04.596573 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:04.779616 (+183043us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:04.779648 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:04.779692 (+    44us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:13:04.779728 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:06.242801 (+1463073us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b54003930d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:06.242873 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:06.243108 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":420479744}
W20260709 12:13:06.234561 21489 consensus_meta.cc:287] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.705s	user 0.014s	sys 0.010s
I20260709 12:13:06.149704 13582 catalog_manager.cc:5697] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 10 to 18, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 18 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:06.261059 21757 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:06.264580 21774 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:06.267233 21780 raft_consensus.cc:3055] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:06.270587 21780 raft_consensus.cc:740] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:06.276189 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:06.276412 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:06.278136 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:06.278792 13686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 3614) took 1351 ms. Trace:
I20260709 12:13:06.279368 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:06.279314 13686 rpcz_store.cc:276] 0709 12:13:04.927102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:04.928772 (+  1670us) service_pool.cc:224] Handling call
0709 12:13:06.278564 (+1349792us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b5400246dd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:06.278720 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2615404288}
I20260709 12:13:06.280728 13837 raft_consensus.cc:1275] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:13:06.271893 13828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54830 (request call id 3386) took 1502 ms. Trace:
I20260709 12:13:06.294834 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:06.294699 13828 rpcz_store.cc:276] 0709 12:13:04.769665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:04.769881 (+   216us) service_pool.cc:224] Handling call
0709 12:13:06.271231 (+1501350us) spinlock_profiling.cc:243] Waited 652 ms on lock 0x7b5400362254. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:06.271469 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1500336512}
I20260709 12:13:06.295822 13836 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 23.
I20260709 12:13:06.296249 21445 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:06.296592 13835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 3750) took 1603 ms. Trace:
I20260709 12:13:06.297080 21445 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:06.297200 13835 rpcz_store.cc:276] 0709 12:13:04.693318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:04.693479 (+   161us) service_pool.cc:224] Handling call
0709 12:13:04.708982 (+ 15503us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:05.449238 (+740256us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:06.295144 (+845906us) spinlock_profiling.cc:243] Waited 715 ms on lock 0x7b540002e754. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:06.296337 (+  1193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1644261760}
I20260709 12:13:06.299249 13800 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:06.300634 21445 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:06.301084 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:06.302616 14410 raft_consensus.cc:2393] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 21: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:06.305850 21512 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:06.306243 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:06.307025 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:06.245554 21328 leader_election.cc:290] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:06.322476 13686 raft_consensus.cc:1240] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 15. Current term is 16. Ops: []
I20260709 12:13:06.332176 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:06.314248 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:06.323289 13651 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:06.315243 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:06.272778 21780 consensus_queue.cc:260] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:06.321053 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:06.257251 13582 catalog_manager.cc:5697] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 14 to 19. New cstate: current_term: 19 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:06.338920 13831 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 21.
I20260709 12:13:06.320406 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:06.345615 13684 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 29.
I20260709 12:13:06.348484 13680 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 23.
I20260709 12:13:06.317497 21445 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
W20260709 12:13:06.344895 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 102520us
I20260709 12:13:06.330103 21646 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:06.355645 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:06.351212 13837 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 25.
I20260709 12:13:06.352203 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:13:06.356804 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 57742.9us
I20260709 12:13:06.316900 21710 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:06.321237 21727 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:06.357399 21587 raft_consensus.cc:2804] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:06.386941 14408 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 28.
I20260709 12:13:06.346547 21328 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:06.310128 21512 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:06.396397 13760 raft_consensus.cc:1275] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 16. (term mismatch)
I20260709 12:13:06.390129 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:06.397469 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:06.397993 21709 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:06.398085 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:06.398281 21365 raft_consensus.cc:2804] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:06.424229 13763 raft_consensus.cc:2410] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 27 because replica has last-logged OpId of term: 26 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 14.
I20260709 12:13:06.424057 21365 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:06.402884 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:06.403883 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:06.404774 21774 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:06.417562 13760 pending_rounds.cc:85] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting all ops after (but not including) 15
I20260709 12:13:06.405496 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:06.405699 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:06.407079 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:06.407775 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:06.410305 21445 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:06.411068 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:06.411433 21749 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:06.411720 21768 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:06.419202 13835 raft_consensus.cc:1275] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 12:13:06.420462 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:06.423038 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:06.423879 21709 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:06.402542 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:06.401042 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:06.406355 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:06.436841 13682 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 23.
I20260709 12:13:06.437084 13829 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 23.
I20260709 12:13:06.404670 21675 consensus_queue.cc:1059] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:06.437887 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:06.426432 21365 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:06.428838 13681 raft_consensus.cc:2410] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 23 because replica has last-logged OpId of term: 20 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 9.
I20260709 12:13:06.430060 21512 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:06.430246 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:06.406677 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:06.394392 21587 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:06.426877 13760 pending_rounds.cc:107] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting uncommitted NO_OP operation due to leader change: 21.16
I20260709 12:13:06.435505 13834 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 19.
I20260709 12:13:06.384414 21757 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:06.435063 13828 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Advancing to term 21
I20260709 12:13:06.452203 13760 raft_consensus.cc:2889] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:06.452840 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:06.454805 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:06.449348 14416 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 23.
I20260709 12:13:06.413870 21784 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:06.459272 13687 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:06.462386 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:06.467355 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:06.455196 21587 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:06.469266 13761 raft_consensus.cc:2393] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 20: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:06.473747 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:06.438483 21646 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:06.475396 13831 raft_consensus.cc:1240] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:06.415139 13582 catalog_manager.cc:5697] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 17 to 20, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 20 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:06.480927 13760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 1309) took 2733 ms. Trace:
I20260709 12:13:06.480935 13759 raft_consensus.cc:2393] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 23: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:06.481459 13760 rpcz_store.cc:276] 0709 12:13:03.747471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:03.749059 (+  1588us) service_pool.cc:224] Handling call
0709 12:13:03.749466 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:05.156695 (+1407229us) spinlock_profiling.cc:243] Waited 74.4 ms on lock 0x7b54003604a0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f04dc0 00007fa927f8f1c0 00007fa927f90231 00007fa927f8cd8f 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c
0709 12:13:06.182316 (+1025621us) spinlock_profiling.cc:243] Waited 835 ms on lock 0x7b580096c8d0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927ee90aa 00007fa927f6b447 00007fa927f83fe7 00007fa927f857de 00007fa927f8fb49 00007fa927f90416 00007fa927f8cd8f 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4
0709 12:13:06.475158 (+292842us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:06.480866 (+  5708us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2090591872}
I20260709 12:13:06.484899 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:06.481866 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:06.485610 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:06.487763 14408 raft_consensus.cc:1275] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:13:06.435657 21774 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:06.489427 13682 raft_consensus.cc:2393] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 21: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:06.490373 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:13:06.491259 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:06.491827 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:06.494047 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:06.498178 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:13:06.500643 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:06.462486 21768 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:06.492954 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:06.506942 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:06.465489 21328 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:06.510667 21476 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 22 current term: 22 is higher.
I20260709 12:13:06.514084 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:06.515275 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:06.516611 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:06.518874 21714 raft_consensus.cc:3055] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:13:06.519364 21714 raft_consensus.cc:740] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:06.520278 13834 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 23.
I20260709 12:13:06.520553 21714 consensus_queue.cc:260] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.17, Last appended by leader: 17, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:06.521845 14380 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:06.523028 13757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 2656) took 1786 ms. Trace:
I20260709 12:13:06.524374 13685 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 26.
I20260709 12:13:06.524482 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:06.525678 13679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 3607) took 2598 ms. Trace:
I20260709 12:13:06.526285 13832 raft_consensus.cc:2393] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 25: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:06.526058 13679 rpcz_store.cc:276] 0709 12:13:03.927013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:03.927882 (+   869us) service_pool.cc:224] Handling call
0709 12:13:03.928343 (+   461us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:04.191726 (+263383us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 12:13:06.222249 (+2030523us) spinlock_profiling.cc:243] Waited 30.9 ms on lock 0x7b1800400840. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa927b354bc 00007fa924e8348b 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9d455 00007fa92b9853c7 00007fa927f979a7 00007fa927fa70bf
0709 12:13:06.222484 (+   235us) log.cc:844] Serialized 14 byte log entry
0709 12:13:06.491673 (+269189us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:06.500341 (+  8668us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:13:06.524566 (+ 24225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:06.525314 (+   748us) spinlock_profiling.cc:243] Waited 263 ms on lock 0x7b54002841d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:06.525361 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:06.525505 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18497,"prepare.queue_time_us":191186,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":4007,"raft.queue_time_us":33753,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":129,"spinlock_wait_cycles":676288640,"thread_start_us":498427,"threads_started":2}
I20260709 12:13:06.524356 13759 raft_consensus.cc:1275] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:13:06.529899 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:06.530205 21646 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:06.532027 21780 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:06.533733 21646 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:06.534083 13829 raft_consensus.cc:1240] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 20 LEADER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:06.537552 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:06.466447 21784 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:06.546824 21784 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:06.489698 21749 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:06.547825 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:06.548645 13688 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 22.
I20260709 12:13:06.462260 21710 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:06.550518 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:06.551611 13754 raft_consensus.cc:2468] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 18.
I20260709 12:13:06.552532 21710 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199)
I20260709 12:13:06.552723 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:06.553263 21766 consensus_queue.cc:1048] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:13:06.464502 21727 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:06.559338 21711 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:06.550262 21589 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:06.560182 21711 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:06.561046 21589 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:06.501617 21757 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:06.563665 21589 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:06.553612 21774 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:06.565584 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:06.565557 21646 raft_consensus.cc:2804] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:13:06.568003 21646 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:06.568447 21646 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:13:06.549618 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:13:06.559391 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 133431us
I20260709 12:13:06.566027 13800 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:06.578804 13760 raft_consensus.cc:2410] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 24 because replica has last-logged OpId of term: 23 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 15.
I20260709 12:13:06.574927 14410 raft_consensus.cc:2468] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 18.
I20260709 12:13:06.537971 13758 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 23.
I20260709 12:13:06.593820 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:13:06.549512 13652 connection.cc:256] RPC call timeout handler was delayed by -1.0215940420000607s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17190000000000003s for a response
I20260709 12:13:06.598853 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:06.601636 13686 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 23.
I20260709 12:13:06.557096 21768 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:13:06.607651 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:06.549575 21749 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:06.608587 13688 raft_consensus.cc:2468] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 15.
I20260709 12:13:06.550554 21709 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:13:06.626989 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:06.619383 13681 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 23.
W20260709 12:13:06.623272 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 57379us
I20260709 12:13:06.651665 21591 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:06.655869 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 46505.8us
I20260709 12:13:06.661306 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:06.662267 13832 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 21.
I20260709 12:13:06.665673 13828 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 21.
I20260709 12:13:06.632464 21476 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:06.636057 21709 raft_consensus.cc:2804] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:13:06.684000 21709 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:06.684599 21709 raft_consensus.cc:3060] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:13:06.631058 21714 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:06.669942 13727 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:13:06.671037 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 73849.9us
I20260709 12:13:06.672108 21711 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:06.672796 13800 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:13:06.676707 21015 consensus_queue.cc:1048] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:06.677919 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:06.640501 21512 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:06.693228 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:06.661347 13582 catalog_manager.cc:5697] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 7 to 13, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 13 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:13:06.701469 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:06.657056 21727 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:06.713812 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:06.715426 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:06.730842 13832 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 21.
I20260709 12:13:06.718954 21768 raft_consensus.cc:2804] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:06.732252 21768 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:06.732601 21591 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:06.723312 21757 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:06.710505 13651 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:06.722790 14379 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:13:06.712728 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:06.725317 13763 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 28.
I20260709 12:13:06.523432 13757 rpcz_store.cc:276] 0709 12:13:04.736661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:04.738293 (+  1632us) service_pool.cc:224] Handling call
0709 12:13:04.738736 (+   443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:04.739043 (+   307us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 12:13:04.780857 (+ 41814us) log.cc:844] Serialized 14 byte log entry
0709 12:13:06.241826 (+1460969us) spinlock_profiling.cc:243] Waited 6.18 ms on lock 0x7b180037afe0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e82e07 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9fc02 00007fa927b2720b 00007fa927b2cd23 00007fa927b2d23a 00007fa927f97a2a
0709 12:13:06.495936 (+254110us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:06.522508 (+ 26572us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:13:06.522629 (+   121us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:06.522738 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:06.522877 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11759,"prepare.queue_time_us":41593,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":7650,"raft.queue_time_us":27966,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":7633,"spinlock_wait_cycles":14211840,"thread_start_us":208569,"threads_started":1,"wal-append.queue_time_us":1791226}
W20260709 12:13:06.758488 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 48101us
I20260709 12:13:06.754205 13828 raft_consensus.cc:1275] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 12:13:06.695676 21476 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:06.742398 21452 raft_consensus.cc:2804] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:06.732656 21768 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:06.742892 21328 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:13:06.766965 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 47775.2us
I20260709 12:13:06.770792 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:06.724228 21445 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:06.726830 13582 catalog_manager.cc:5697] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 9 to 16, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 16 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:13:06.768204 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:06.710072 13687 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 22.
I20260709 12:13:06.777190 13832 raft_consensus.cc:1240] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 27 LEADER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:06.726044 21512 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:06.792124 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:13:06.794200 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 146854us
I20260709 12:13:06.764635 21589 raft_consensus.cc:2804] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:06.789162 13756 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 24.
I20260709 12:13:06.789880 13582 catalog_manager.cc:5697] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:06.763721 21452 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:06.798812 13834 raft_consensus.cc:2410] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 25 because replica has last-logged OpId of term: 23 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 12.
I20260709 12:13:06.802383 21328 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:06.805972 21328 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:06.808135 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:06.808802 21328 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:06.799280 14379 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:06.815891 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:06.816746 13758 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:06.820423 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:13:06.821489 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 246796us
I20260709 12:13:06.810441 21452 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:13:06.841881 21796 log.cc:927] Time spent T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
W20260709 12:13:06.835043 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 55881.1us
I20260709 12:13:06.846063 21710 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:13:06.846681 21710 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:06.836421 13828 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 21.
I20260709 12:13:06.847122 21710 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:06.837121 13755 raft_consensus.cc:1275] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:13:06.799954 21589 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:06.817727 21675 raft_consensus.cc:2804] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 12:13:06.878002 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 61357.6us
I20260709 12:13:06.788657 21445 consensus_queue.cc:1059] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.033s
W20260709 12:13:06.881335 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 365093us
I20260709 12:13:06.882824 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:06.888969 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:06.890115 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:06.893893 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:06.895493 13800 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:06.877034 21589 raft_consensus.cc:3060] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:06.899847 13760 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 20.
I20260709 12:13:06.893932 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:06.902740 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:06.881224 21675 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:06.819306 21365 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:06.902030 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:06.904048 13651 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:06.913789 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:06.914407 13680 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 22.
I20260709 12:13:06.921176 13828 raft_consensus.cc:2393] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 28: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:06.919677 13681 raft_consensus.cc:2468] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 18.
W20260709 12:13:06.939867 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 86217.5us
I20260709 12:13:06.912091 21675 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:06.948421 13688 raft_consensus.cc:1240] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:06.958379 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:06.959627 13828 raft_consensus.cc:2393] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 22: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:06.967943 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:06.968099 21780 consensus_queue.cc:1048] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:13:06.969153 13682 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 19.
I20260709 12:13:06.969602 13727 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:06.970564 14416 raft_consensus.cc:1275] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:13:06.971043 21678 raft_consensus.cc:2804] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:06.971843 13727 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:06.973137 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:06.974206 21742 raft_consensus.cc:2804] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:06.974673 21742 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:06.974776 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:06.975153 21742 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:13:06.975847 21797 log.cc:927] Time spent T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.272s	user 0.002s	sys 0.000s
I20260709 12:13:06.977090 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:06.978252 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:06.978534 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:06.979043 13832 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 21.
I20260709 12:13:06.979368 13835 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 26.
I20260709 12:13:06.990033 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:06.991794 13651 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:06.955577 21591 raft_consensus.cc:2749] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:06.949515 21555 raft_consensus.cc:2804] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 12:13:07.002166 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 280079us
I20260709 12:13:06.915400 21587 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:07.023248 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:06.951301 21328 consensus_queue.cc:1048] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 12:13:06.998288 21780 raft_consensus.cc:2804] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 12:13:07.031780 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 399018us
I20260709 12:13:07.006459 21365 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:07.012900 21555 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:07.037835 21780 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:07.061609 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 230045us
W20260709 12:13:07.069175 21799 log.cc:927] Time spent T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:13:07.060261 13582 catalog_manager.cc:5697] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 8 to 15. New cstate: current_term: 15 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:07.077865 13726 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:07.048851 21555 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:07.060428 21512 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:07.065037 21780 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:13:07.096369 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 48238.7us
I20260709 12:13:07.097446 13800 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:07.053228 21591 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:07.088971 21476 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:07.118834 13762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 2664) took 1396 ms. Trace:
I20260709 12:13:07.121490 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:13:07.129416 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 60626.3us
I20260709 12:13:07.128461 13830 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 21.
W20260709 12:13:07.135739 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:07.146914 13652 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:07.116094 13582 catalog_manager.cc:5697] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 8 to 15, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 15 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
W20260709 12:13:07.152550 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 184761us
W20260709 12:13:07.159377 13754 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.005s	sys 0.045s
W20260709 12:13:07.160476 13754 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.005s	sys 0.045s
W20260709 12:13:07.063692 13571 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d2f365337b324999a073edacbe6c6e09 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER failed with leader ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica ca9fbbc2c0a94897897d502d42f3951f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 21 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:13:07.125341 21766 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:13:07.167317 13571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 103690us
I20260709 12:13:07.125756 21512 raft_consensus.cc:2804] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:07.127111 13762 rpcz_store.cc:276] 0709 12:13:05.598240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:05.598471 (+   231us) service_pool.cc:224] Handling call
0709 12:13:05.659017 (+ 60546us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:05.659410 (+   393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:05.659438 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:05.734976 (+ 75538us) log.cc:844] Serialized 52 byte log entry
0709 12:13:06.234062 (+499086us) spinlock_profiling.cc:243] Waited 3.29 ms on lock 0x7b18004093c0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e82e07 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9fc02 00007fa927b2720b 00007fa927b2cd23 00007fa927b2d0d1 00007fa927f48a0f
0709 12:13:06.519794 (+285732us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:13:06.519866 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:06.519967 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:06.975056 (+455089us) spinlock_profiling.cc:243] Waited 9.47 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:13:06.986713 (+ 11657us) raft_consensus.cc:1685] finished
0709 12:13:06.986744 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:06.994820 (+  8076us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7682,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":10029,"spinlock_wait_cycles":29339776,"thread_start_us":207394,"threads_started":1,"wal-append.queue_time_us":941852}
I20260709 12:13:07.114185 21591 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:07.178237 13800 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:13:07.183166 14379 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
W20260709 12:13:07.183111 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 176481us
W20260709 12:13:07.202085 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 230317us
I20260709 12:13:07.171720 21512 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:07.152303 21758 consensus_queue.cc:1048] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.162s
W20260709 12:13:07.207267 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 76685.5us
I20260709 12:13:07.216207 13582 catalog_manager.cc:5697] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 13 to 15, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 15 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:07.206370 21512 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:07.239475 21574 consensus_queue.cc:1048] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.005s
I20260709 12:13:07.240391 21815 consensus_queue.cc:1048] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 12:13:07.201113 21678 raft_consensus.cc:697] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:13:07.243680 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 60571.5us
W20260709 12:13:07.250931 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:07.249465 13652 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:13:07.213565 21587 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:13:07.242007 21646 consensus_meta.cc:287] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.666s	user 0.016s	sys 0.006s
I20260709 12:13:07.216146 21690 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:07.261965 14379 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
W20260709 12:13:07.263844 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:07.246675 21757 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader election won for term 27
W20260709 12:13:07.264227 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 69935.2us
I20260709 12:13:07.264081 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:13:07.270352 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 57260.5us
W20260709 12:13:07.272603 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 119382us
I20260709 12:13:07.265286 21646 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:07.288606 21646 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:07.267272 21489 raft_consensus.cc:2804] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:07.290102 21757 raft_consensus.cc:697] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 27 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:07.289693 13727 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:07.303960 13800 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:07.314209 21751 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:07.313719 21757 consensus_queue.cc:237] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 26.13, Last appended by leader: 13, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:07.315028 21751 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:07.316605 21328 consensus_queue.cc:1048] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:13:07.318508 21328 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:07.318994 21328 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:07.319489 21328 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Advancing to term 29
W20260709 12:13:07.320143 21801 log.cc:927] Time spent T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 12:13:07.308552 21646 raft_consensus.cc:2804] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:07.321342 21646 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:07.321756 21646 raft_consensus.cc:3060] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:07.325917 21816 raft_consensus.cc:2804] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:07.326658 21816 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:07.295470 21747 raft_consensus.cc:2749] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:07.297315 21489 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:07.338932 14380 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:07.355264 21589 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:07.359107 21452 consensus_meta.cc:287] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.521s	user 0.012s	sys 0.000s
I20260709 12:13:07.359694 21452 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:07.360853 13759 raft_consensus.cc:1240] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:07.346408 21489 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:07.270375 21690 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:07.367520 21591 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:07.368372 21690 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:07.369899 13836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 3398) took 1072 ms. Trace:
I20260709 12:13:07.370391 13836 rpcz_store.cc:276] 0709 12:13:06.297193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:06.297343 (+   150us) service_pool.cc:224] Handling call
0709 12:13:06.297827 (+   484us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:06.351883 (+ 54056us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:06.351924 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:06.431058 (+ 79134us) log.cc:844] Serialized 26 byte log entry
0709 12:13:06.883791 (+452733us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:13:06.908026 (+ 24235us) log.cc:844] Serialized 14 byte log entry
0709 12:13:06.908731 (+   705us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:06.908841 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:07.369648 (+460807us) raft_consensus.cc:1685] finished
0709 12:13:07.369668 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:07.369836 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":82601,"prepare.queue_time_us":23704,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":94020,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":11570,"thread_start_us":392588,"threads_started":1,"wal-append.queue_time_us":632097}
W20260709 12:13:07.382876 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 79929.8us
I20260709 12:13:07.327112 21816 raft_consensus.cc:3060] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:07.372725 13582 catalog_manager.cc:5697] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 13 to 19, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 19 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:13:07.317364 21751 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:07.399008 21811 log.cc:927] Time spent T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
W20260709 12:13:07.401646 21802 log.cc:927] Time spent T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.246s	user 0.000s	sys 0.000s
I20260709 12:13:07.385070 21591 raft_consensus.cc:2749] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:07.405071 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:13:07.410372 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 110170us
I20260709 12:13:07.411015 21824 raft_consensus.cc:2804] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:07.411809 21824 raft_consensus.cc:697] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 21 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:07.412159 13800 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:13:07.415655 21804 log.cc:927] Time spent T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.360s	user 0.001s	sys 0.001s
I20260709 12:13:07.415757 21675 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:07.417172 14412 raft_consensus.cc:2368] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 23. Current term is 24.
I20260709 12:13:07.419094 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:07.419945 14414 raft_consensus.cc:2393] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 16: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:13:07.421039 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:07.369894 21690 consensus_queue.cc:1048] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:13:07.422197 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:07.422642 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:07.423354 14413 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 21.
I20260709 12:13:07.396723 21678 consensus_queue.cc:237] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:07.413249 21824 consensus_queue.cc:237] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:07.425684 21768 consensus_meta.cc:287] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.631s	user 0.012s	sys 0.000s
I20260709 12:13:07.442414 21015 raft_consensus.cc:3055] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:13:07.442963 21015 raft_consensus.cc:740] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:07.442873 21768 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:07.444377 21710 consensus_meta.cc:287] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.597s	user 0.011s	sys 0.001s
I20260709 12:13:07.444228 21015 consensus_queue.cc:260] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:07.444909 21710 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 30 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:07.426928 21709 consensus_meta.cc:287] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.742s	user 0.014s	sys 0.001s
I20260709 12:13:07.446059 21768 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:07.427345 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:07.446755 21709 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:07.451264 21675 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 24 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:07.436471 13726 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:07.452541 21690 raft_consensus.cc:2804] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:07.453011 21690 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:07.453402 21690 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:07.428026 21780 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:07.409205 14410 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 19.
W20260709 12:13:07.459010 13758 consensus_meta.cc:287] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.641s	user 0.012s	sys 0.000s
I20260709 12:13:07.437922 13727 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:07.421591 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:07.457669 13837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 3756) took 1020 ms. Trace:
I20260709 12:13:07.430460 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:07.458148 13800 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:07.461740 13758 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 21.
I20260709 12:13:07.426841 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:07.463827 13800 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:07.459998 13837 rpcz_store.cc:276] 0709 12:13:06.413321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:06.413473 (+   152us) service_pool.cc:224] Handling call
0709 12:13:06.413864 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:06.418367 (+  4503us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:13:06.638419 (+220052us) log.cc:844] Serialized 14 byte log entry
0709 12:13:07.118192 (+479773us) log.cc:844] Serialized 14 byte log entry
0709 12:13:07.432883 (+314691us) spinlock_profiling.cc:243] Waited 4.56 ms on lock 0x7b18003d4c20. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e1ac0a 00007fa92e55a219 00007fa924ea2a40 00007fa924e9d4e4 00007fa924e9d455 00007fa92b9853c7 00007fa927f979a7 00007fa927fa70bf 00007fa927fa7038
0709 12:13:07.433135 (+   252us) log.cc:844] Serialized 14 byte log entry
0709 12:13:07.433332 (+   197us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:07.433383 (+    51us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:13:07.433440 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:07.433528 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:07.433732 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":336202,"prepare.queue_time_us":431818,"prepare.run_cpu_time_us":113,"prepare.run_wall_time_us":115,"raft.queue_time_us":31783,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":80,"spinlock_wait_cycles":71506944,"thread_start_us":563143,"threads_started":2,"wal-append.queue_time_us":522198}
I20260709 12:13:07.466634 14411 raft_consensus.cc:2393] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 16: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:13:07.466982 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:07.469750 13800 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:07.445705 21015 raft_consensus.cc:3060] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:13:07.451263 21589 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:07.467211 13582 catalog_manager.cc:5697] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 7 to 16. New cstate: current_term: 16 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:07.466725 21802 log.cc:927] Time spent T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:13:07.459041 21749 raft_consensus.cc:2804] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:07.481299 13800 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:07.475862 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:07.486812 14407 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:07.469695 21591 raft_consensus.cc:2804] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:07.467216 21757 raft_consensus.cc:2804] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election won for term 27
W20260709 12:13:07.494110 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 97868.1us
I20260709 12:13:07.499504 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:07.509101 13582 catalog_manager.cc:5697] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:07.513383 14411 raft_consensus.cc:2393] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 16: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:13:07.484508 21768 raft_consensus.cc:2804] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:07.524235 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:07.524420 13800 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:07.472291 21751 consensus_queue.cc:1048] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.028s
W20260709 12:13:07.526078 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 45799.1us
W20260709 12:13:07.525959 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 243503us
I20260709 12:13:07.491441 21591 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:07.527539 14379 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
W20260709 12:13:07.528656 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:07.476400 21646 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:07.529901 21675 raft_consensus.cc:2804] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:07.529901 21591 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:07.532063 13727 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:07.537853 21736 raft_consensus.cc:2749] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:07.538475 21768 raft_consensus.cc:697] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 23 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:07.541117 21780 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:07.542075 21742 consensus_meta.cc:287] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.566s	user 0.005s	sys 0.009s
I20260709 12:13:07.542443 21821 raft_consensus.cc:2804] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:13:07.542603 13801 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.56.196:46341 timed out after 2.756s (SENT) [suppressed 8 similar messages]
W20260709 12:13:07.542814 21822 log.cc:927] Time spent T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.102s	user 0.002s	sys 0.002s
I20260709 12:13:07.544571 21555 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:07.492278 21757 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:07.547325 21710 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 30 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:07.552047 21816 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:07.562741 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 53993us
I20260709 12:13:07.589146 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:07.567662 13833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 3395) took 1284 ms. Trace:
I20260709 12:13:07.585904 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:07.590605 13755 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:07.587793 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:07.591763 13760 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 27.
I20260709 12:13:07.586583 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:07.597807 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:07.598488 13682 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:07.590029 13833 rpcz_store.cc:276] 0709 12:13:06.283531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:06.313855 (+ 30324us) service_pool.cc:224] Handling call
0709 12:13:06.314299 (+   444us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:06.393898 (+ 79599us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:13:06.460504 (+ 66606us) log.cc:844] Serialized 14 byte log entry
0709 12:13:06.919643 (+459139us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:06.948428 (+ 28785us) log.cc:844] Serialized 26 byte log entry
0709 12:13:06.948588 (+   160us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:13:06.995508 (+ 46920us) log.cc:844] Serialized 14 byte log entry
0709 12:13:06.995767 (+   259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:06.995844 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:07.400768 (+404924us) spinlock_profiling.cc:243] Waited 3.3 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:13:07.567422 (+166654us) raft_consensus.cc:1685] finished
0709 12:13:07.567465 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:07.567600 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":96047,"prepare.queue_time_us":118420,"prepare.run_cpu_time_us":133,"prepare.run_wall_time_us":5638,"raft.queue_time_us":88335,"raft.run_cpu_time_us":431,"raft.run_wall_time_us":33969,"spinlock_wait_cycles":7597824,"thread_start_us":422736,"threads_started":1,"wal-append.queue_time_us":591642}
I20260709 12:13:07.603160 13726 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:07.604089 21831 raft_consensus.cc:2804] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:07.604585 21831 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:07.605028 21831 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:07.609402 21123 consensus_queue.cc:1059] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 15, Time since last communication: 0.053s
I20260709 12:13:07.610780 21814 raft_consensus.cc:2804] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:07.611413 21814 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:07.611797 21814 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:07.611711 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:07.612139 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:07.618279 21839 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:07.619046 21839 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:07.563119 21747 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:07.621809 21747 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:07.622402 21839 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:07.623142 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 50854.2us
I20260709 12:13:07.624370 21747 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:07.626633 21555 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:07.627418 21839 consensus_queue.cc:1059] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:13:07.629371 21827 raft_consensus.cc:3055] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:07.629825 21827 raft_consensus.cc:740] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 22 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:07.631407 21768 consensus_queue.cc:237] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:07.630952 21827 consensus_queue.cc:260] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:07.633101 21827 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:13:07.634205 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 102254us
I20260709 12:13:07.635838 13727 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:07.637012 21829 raft_consensus.cc:2749] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:07.638697 21690 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:07.641053 21690 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:07.583804 21821 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:07.643280 14414 raft_consensus.cc:1240] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 15. Current term is 16. Ops: []
I20260709 12:13:07.643734 21821 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:13:07.646232 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:07.646497 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:07.647174 14413 raft_consensus.cc:2376] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 21. Re-sending same reply.
I20260709 12:13:07.648346 21835 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:07.649205 21835 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:07.652191 21835 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:07.562346 21675 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:07.652940 21675 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:07.653719 21831 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:07.584260 21742 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:07.659548 13756 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:07.661095 21742 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:07.662158 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:07.662999 13685 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:07.665999 13800 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:07.589676 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:07.637387 13727 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:07.698194 13756 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 24.
W20260709 12:13:07.716049 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:07.725728 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:07.583604 21766 raft_consensus.cc:2804] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:07.731376 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:07.726801 13684 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 27.
I20260709 12:13:07.736545 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:07.744724 14411 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:07.745867 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:07.747738 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:07.748564 13684 raft_consensus.cc:2368] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 23. Current term is 24.
I20260709 12:13:07.749457 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:07.755095 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:07.755698 21835 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:07.756394 21835 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:07.758913 21835 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:07.759640 21835 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:07.758793 13684 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 22.
I20260709 12:13:07.761924 13651 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:07.761930 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:07.765336 13684 raft_consensus.cc:2393] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 24: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:07.767495 13726 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:07.768663 21833 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:07.768473 21328 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:07.763969 21838 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:07.769274 21833 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:07.770061 21838 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:07.770500 21838 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:07.772040 21833 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:07.774158 21831 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:07.767796 13684 raft_consensus.cc:1240] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 21. Current term is 22. Ops: []
W20260709 12:13:07.775627 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 138313us
I20260709 12:13:07.776985 13727 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:07.768476 21829 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:07.779186 13726 leader_election.cc:400] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 election: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 23. Current term is 24.
I20260709 12:13:07.779601 21829 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:07.779745 13726 leader_election.cc:403] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 election: Cancelling election due to peer responding with higher term
I20260709 12:13:07.780107 21829 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:07.780856 21815 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:07.782296 13682 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 30.
I20260709 12:13:07.593545 21757 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:07.586042 21709 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:07.789568 14411 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 24.
I20260709 12:13:07.796553 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:07.797221 13763 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:07.643271 21816 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:07.790923 13726 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:07.803459 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:07.804908 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:07.807337 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:07.808614 13758 raft_consensus.cc:2393] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 24: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:07.814272 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:07.729743 21452 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:07.760293 21835 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:07.815424 14416 raft_consensus.cc:2468] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 16.
I20260709 12:13:07.823426 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:07.836431 14414 raft_consensus.cc:2393] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 19: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:13:07.741375 21766 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:07.795166 21476 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:07.842746 14411 raft_consensus.cc:1240] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:07.841703 13652 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:07.795428 21736 raft_consensus.cc:2749] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader election lost for term 23. Reason: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 23. Current term is 24.
W20260709 12:13:07.880484 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:07.883191 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:07.884529 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:13:07.888598 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 46960.3us
I20260709 12:13:07.889487 13652 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:13:07.893648 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:13:07.892928 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 227011us
I20260709 12:13:07.902297 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:07.850741 21766 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:07.914223 13688 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 27.
I20260709 12:13:07.816653 21747 consensus_queue.cc:1059] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.099s
I20260709 12:13:07.885937 21709 raft_consensus.cc:2804] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:07.882480 21365 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:07.886883 21476 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:07.902222 21555 raft_consensus.cc:2749] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:13:07.935289 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:07.906911 21836 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:07.949549 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:07.926785 21574 raft_consensus.cc:2804] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:07.958388 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:07.959329 13837 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 23.
I20260709 12:13:07.959685 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:07.958647 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:07.969977 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:07.974346 13834 raft_consensus.cc:2393] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 21: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:13:07.948670 21476 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:07.983448 13837 raft_consensus.cc:1240] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 23. Current term is 24. Ops: [23.10-23.10]
I20260709 12:13:07.947068 21709 raft_consensus.cc:697] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 22 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:08.013336 21815 raft_consensus.cc:2749] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:08.014287 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:08.016486 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:08.027801 13833 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:07.963192 21751 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:08.022729 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:08.025701 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:13:07.989166 21714 consensus_meta.cc:287] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 1.295s	user 0.008s	sys 0.008s
W20260709 12:13:08.033926 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 144549us
I20260709 12:13:08.034818 13652 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:08.035768 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:08.037201 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:07.936142 21675 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:08.037890 21561 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:08.038441 21561 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:08.039491 21675 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:08.040997 21561 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:08.041575 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:08.042392 14415 raft_consensus.cc:2368] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 23. Current term is 24.
W20260709 12:13:08.042840 21842 log.cc:927] Time spent T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:13:08.043167 14414 raft_consensus.cc:1240] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:08.044211 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:08.044586 21749 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:08.045130 21749 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:08.047544 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:08.048338 13681 raft_consensus.cc:2468] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 19.
I20260709 12:13:08.049305 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:08.049844 21830 consensus_queue.cc:1059] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.164s
I20260709 12:13:08.050911 21830 raft_consensus.cc:3055] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:08.050922 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:08.051373 21830 raft_consensus.cc:740] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:08.051725 13683 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 24.
I20260709 12:13:08.052353 21830 consensus_queue.cc:260] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:07.948228 21365 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:08.060789 21749 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:08.033409 21328 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 29 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:08.052790 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:13:08.055356 14407 consensus_meta.cc:287] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.543s	user 0.008s	sys 0.001s
I20260709 12:13:08.070076 14407 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 20.
I20260709 12:13:08.056139 14412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 1331) took 1090 ms. Trace:
I20260709 12:13:08.070736 14412 rpcz_store.cc:276] 0709 12:13:06.965539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:06.974460 (+  8921us) service_pool.cc:224] Handling call
0709 12:13:08.055910 (+1081450us) spinlock_profiling.cc:243] Waited 441 ms on lock 0x7b54006b03d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:08.056055 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1015378304}
I20260709 12:13:08.028075 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:08.074566 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:08.075045 13835 raft_consensus.cc:2393] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 22: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:08.075904 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:08.077025 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:08.063660 21835 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:08.077889 21807 log.cc:927] Time spent T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.820s	user 0.000s	sys 0.004s
I20260709 12:13:08.077904 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:08.078598 14410 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 23.
I20260709 12:13:08.078927 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:08.079686 13759 raft_consensus.cc:1275] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 12:13:08.074590 13800 leader_election.cc:304] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:08.082804 13800 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:08.029585 13685 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 24.
I20260709 12:13:08.084584 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:13:08.085026 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 498002us
I20260709 12:13:08.085546 13685 raft_consensus.cc:2368] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 29. Current term is 30.
I20260709 12:13:08.067142 21709 consensus_queue.cc:237] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:08.056749 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:08.031044 21646 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199)
I20260709 12:13:08.062098 21365 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:08.095707 21784 raft_consensus.cc:2749] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:08.070222 13683 raft_consensus.cc:2393] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 25: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:08.086277 21849 raft_consensus.cc:2749] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:07.999629 21836 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:08.098883 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:08.099632 13683 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 18.
I20260709 12:13:08.100627 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:08.101049 21836 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:08.090086 21749 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:08.101738 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:08.106240 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:08.107028 13685 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:08.112207 21829 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:07.984076 21574 raft_consensus.cc:697] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 21 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
W20260709 12:13:08.125065 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 90334us
I20260709 12:13:08.032055 21545 raft_consensus.cc:2804] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 12:13:08.132220 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 249374us
I20260709 12:13:08.138239 13685 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 24.
W20260709 12:13:08.142194 13727 connection.cc:256] RPC call timeout handler was delayed by -1.2586818439999661s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17350000000000002s for a response
W20260709 12:13:08.142786 13727 connection.cc:256] RPC call timeout handler was delayed by -1.1253313229999549s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15860000000000002s for a response
W20260709 12:13:08.143179 13727 connection.cc:256] RPC call timeout handler was delayed by -1.0746092740000677s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1996s for a response
W20260709 12:13:08.143497 13727 connection.cc:256] RPC call timeout handler was delayed by -1.0738234860000375s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22210000000000002s for a response
W20260709 12:13:08.143793 13727 connection.cc:256] RPC call timeout handler was delayed by -1.0288234860001921s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2271s for a response
I20260709 12:13:08.144260 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:08.129398 13652 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:08.170246 13763 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 30.
I20260709 12:13:08.077656 13755 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 25.
I20260709 12:13:08.172609 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:08.164734 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:13:08.162106 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 76304.3us
I20260709 12:13:08.180887 21832 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:08.181715 21832 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:08.184173 21832 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:08.189136 14379 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:08.195771 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:08.196762 13685 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 22.
I20260709 12:13:08.198244 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:08.194458 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:08.200353 13763 raft_consensus.cc:1275] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:13:08.200776 13762 raft_consensus.cc:2410] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 22 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 12:13:08.203640 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:08.204370 13760 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 27.
I20260709 12:13:08.116665 21757 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:08.053730 21830 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:08.151847 21545 raft_consensus.cc:697] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:13:08.223533 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:08.242297 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 46708.9us
I20260709 12:13:08.222225 13758 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 21.
I20260709 12:13:08.189929 21015 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:08.257992 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 128705us
I20260709 12:13:08.259295 13652 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:08.262607 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:08.146822 21751 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:08.280321 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 78047.1us
W20260709 12:13:08.282038 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 196395us
W20260709 12:13:08.266109 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 68181.6us
I20260709 12:13:08.205936 21445 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 30 FOLLOWER]: Leader election won for term 30
I20260709 12:13:08.295928 13652 leader_election.cc:400] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 election: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 23. Current term is 24.
I20260709 12:13:08.296538 13652 leader_election.cc:403] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 election: Cancelling election due to peer responding with higher term
W20260709 12:13:08.283262 21489 consensus_meta.cc:287] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.920s	user 0.011s	sys 0.002s
I20260709 12:13:08.304519 13681 raft_consensus.cc:3060] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:13:08.306510 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:08.312167 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:08.282603 21727 raft_consensus.cc:2804] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:08.280067 21589 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:13:08.328738 13727 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
W20260709 12:13:08.330567 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 47768.9us
I20260709 12:13:08.332063 13800 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:13:08.333846 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 185317us
I20260709 12:13:08.335450 13801 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:08.280177 21015 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:08.340119 13685 raft_consensus.cc:2393] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 19: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
W20260709 12:13:08.340252 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 79219.5us
W20260709 12:13:08.323320 21814 consensus_meta.cc:287] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.707s	user 0.013s	sys 0.001s
I20260709 12:13:08.268517 21838 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:08.314607 21445 raft_consensus.cc:697] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 30 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:08.314268 21489 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:08.349370 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:13:08.351749 21512 consensus_meta.cc:287] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 1.082s	user 0.011s	sys 0.002s
I20260709 12:13:08.353368 21709 raft_consensus.cc:2749] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:13:08.353592 21843 log.cc:927] Time spent T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 12:13:08.354496 14414 raft_consensus.cc:1240] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 19. Current term is 20. Ops: [19.16-19.16]
I20260709 12:13:08.340411 21328 raft_consensus.cc:2804] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:08.357589 21816 raft_consensus.cc:3055] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:13:08.358146 21328 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:08.358866 21328 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:08.359558 13800 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:08.361011 13800 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:13:08.361912 13802 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.002s	sys 0.008s
W20260709 12:13:08.362346 13802 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.003s	sys 0.008s
I20260709 12:13:08.363637 21838 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:08.363559 21445 consensus_queue.cc:237] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 28.18, Last appended by leader: 18, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:08.365893 13727 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:08.367039 21751 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:08.308127 21742 consensus_queue.cc:1048] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 12:13:08.368170 13757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 3555) took 1176 ms. Trace:
I20260709 12:13:08.370240 14408 raft_consensus.cc:1240] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 12:13:08.337495 21829 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:08.367517 13727 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:08.370525 13757 rpcz_store.cc:276] 0709 12:13:07.191356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.191547 (+   191us) service_pool.cc:224] Handling call
0709 12:13:07.208204 (+ 16657us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:07.462947 (+254743us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:07.462981 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:07.478649 (+ 15668us) log.cc:844] Serialized 26 byte log entry
0709 12:13:07.838188 (+359539us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:13:07.838279 (+    91us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:07.839209 (+   930us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:08.367936 (+528727us) raft_consensus.cc:1685] finished
0709 12:13:08.367957 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:08.368106 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44421,"raft.queue_time_us":68853,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":11743,"thread_start_us":526263,"threads_started":2,"wal-append.queue_time_us":544171}
I20260709 12:13:08.372332 21452 raft_consensus.cc:2804] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:08.376273 13801 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:08.352375 21512 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:08.377401 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:08.367506 21489 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 21 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:08.379710 13686 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:08.373150 21749 raft_consensus.cc:2749] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:08.370054 21768 raft_consensus.cc:2749] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:08.346331 21814 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:08.344116 21747 raft_consensus.cc:2749] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader election lost for term 23. Reason: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 23. Current term is 24.
I20260709 12:13:08.343743 21727 raft_consensus.cc:697] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 24 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:08.388527 13684 raft_consensus.cc:1240] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 23. Current term is 24. Ops: [23.10-23.10]
I20260709 12:13:08.373013 21709 raft_consensus.cc:2749] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:08.303709 21574 consensus_queue.cc:237] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:08.400665 21814 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:08.402169 13756 raft_consensus.cc:1240] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 12:13:08.373517 21545 consensus_queue.cc:237] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:08.403923 21709 raft_consensus.cc:2749] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:13:08.404899 21854 raft_consensus.cc:2749] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:08.408238 13800 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:08.375442 21452 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:08.414901 21452 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:08.415386 21710 raft_consensus.cc:3055] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:08.415944 21710 raft_consensus.cc:740] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 22 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:08.384910 21815 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:13:08.423861 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:08.427296 14379 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:08.432834 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:08.436287 13681 raft_consensus.cc:2468] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 16.
I20260709 12:13:08.413482 13833 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 23.
I20260709 12:13:08.358266 21816 raft_consensus.cc:740] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
W20260709 12:13:08.446652 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 67537.5us
I20260709 12:13:08.447117 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:08.440932 14379 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:13:08.398339 21591 consensus_meta.cc:287] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.808s	user 0.007s	sys 0.006s
I20260709 12:13:08.449985 14379 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:08.397657 21862 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:08.458367 21862 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:08.464493 13687 raft_consensus.cc:1275] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:13:08.466903 21015 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:08.417002 21710 consensus_queue.cc:260] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:08.476683 13651 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:13:08.478229 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 70237.4us
I20260709 12:13:08.478940 13800 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:08.479302 13651 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:08.480001 13726 leader_election.cc:400] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 29 election: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 29. Current term is 30.
I20260709 12:13:08.480429 13726 leader_election.cc:403] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 29 election: Cancelling election due to peer responding with higher term
I20260709 12:13:08.467062 21476 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:08.486079 13684 raft_consensus.cc:1275] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 12:13:08.451746 21489 raft_consensus.cc:2804] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:08.494181 13686 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 20.
I20260709 12:13:08.456404 21675 raft_consensus.cc:2804] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:08.472509 21768 raft_consensus.cc:2749] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:08.495256 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:08.497681 13680 raft_consensus.cc:1240] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:08.500907 13684 raft_consensus.cc:1240] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:08.473251 21784 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:08.476275 21827 raft_consensus.cc:2804] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:08.502991 13684 raft_consensus.cc:1240] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:08.445675 21646 consensus_queue.cc:1048] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.046s
I20260709 12:13:08.518008 21827 raft_consensus.cc:697] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 24 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:08.519244 21827 consensus_queue.cc:237] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:08.504825 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:08.521023 13679 raft_consensus.cc:2393] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 28: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:08.522022 21512 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:08.482152 21780 raft_consensus.cc:2804] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:08.500553 21489 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:08.523977 21489 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:08.498865 21675 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:08.524156 21821 consensus_meta.cc:287] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.880s	user 0.013s	sys 0.000s
I20260709 12:13:08.524629 21675 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:08.524847 21821 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:08.505590 13687 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 20.
I20260709 12:13:08.498463 21747 raft_consensus.cc:2804] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:08.506871 21784 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:08.527634 21821 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:08.529400 21747 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:08.530000 21747 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:08.530318 21784 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:08.477715 21862 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:08.532147 21780 raft_consensus.cc:697] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 25 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:08.533568 21780 consensus_queue.cc:237] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:08.532145 13755 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 28.
W20260709 12:13:08.539652 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:08.539526 13800 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:08.515664 21476 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:08.515128 21816 consensus_queue.cc:260] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:08.516737 21727 consensus_queue.cc:237] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:08.530095 13727 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:08.544998 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:13:08.551606 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 103982us
I20260709 12:13:08.471916 21591 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:08.486720 21757 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:08.499413 21710 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:08.495783 21365 raft_consensus.cc:2749] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:08.553998 13652 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:13:08.554591 21871 raft_consensus.cc:2749] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:08.555018 21587 consensus_queue.cc:1048] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:13:08.501654 21829 raft_consensus.cc:2749] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Leader election lost for term 29. Reason: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 29. Current term is 30.
I20260709 12:13:08.524169 21452 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:08.596735 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 66770.9us
I20260709 12:13:08.564450 21675 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:08.566057 21862 consensus_queue.cc:1048] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:08.594414 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:08.603996 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:08.549712 13726 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:13:08.591536 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 213862us
I20260709 12:13:08.594414 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:08.606623 13829 raft_consensus.cc:3060] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:13:08.564615 21815 raft_consensus.cc:2749] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:08.611460 13835 raft_consensus.cc:2410] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 19 because replica has last-logged OpId of term: 18 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
W20260709 12:13:08.612461 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 62896.6us
I20260709 12:13:08.602595 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:08.607456 13801 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:08.616096 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:08.617184 13757 raft_consensus.cc:2393] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 28: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:08.617726 13761 raft_consensus.cc:1240] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:08.625310 13726 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:08.629385 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:08.631280 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:08.632143 13830 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:13:08.615545 21766 consensus_meta.cc:287] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.681s	user 0.006s	sys 0.005s
I20260709 12:13:08.569605 21830 consensus_queue.cc:1059] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 20.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 12:13:08.603729 21545 raft_consensus.cc:2749] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:08.646368 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:08.648203 13834 raft_consensus.cc:2393] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 23: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:08.625805 21476 raft_consensus.cc:2804] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:08.665064 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:08.646366 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:08.639371 21747 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:08.658314 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 104411us
I20260709 12:13:08.592768 21858 consensus_queue.cc:1059] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.045s
I20260709 12:13:08.625593 21866 raft_consensus.cc:2804] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:08.626075 21871 raft_consensus.cc:2804] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:13:08.668576 13727 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:08.668592 13652 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:13:08.671401 13836 raft_consensus.cc:2393] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 16: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:08.673558 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:08.674341 13836 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:08.687520 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:08.691687 13835 raft_consensus.cc:2468] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 19.
I20260709 12:13:08.665534 21476 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:08.721498 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:08.722321 13835 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 28.
W20260709 12:13:08.728201 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 59758.5us
I20260709 12:13:08.682211 21742 raft_consensus.cc:2804] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:08.646301 21766 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:08.689133 21871 raft_consensus.cc:697] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 20 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:08.724489 21476 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Advancing to term 28
W20260709 12:13:08.756160 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:08.670667 21328 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:08.723757 21736 raft_consensus.cc:3055] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:08.727638 21869 raft_consensus.cc:3055] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 20 LEADER]: Stepping down as leader of term 20
W20260709 12:13:08.773996 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 122390us
I20260709 12:13:08.762401 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:08.757891 21591 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:08.734663 21814 raft_consensus.cc:2804] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:08.732039 21866 raft_consensus.cc:697] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 21 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:08.801054 13763 raft_consensus.cc:1240] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:08.787783 13830 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 23.
I20260709 12:13:08.736157 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:08.803313 13832 raft_consensus.cc:1240] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:08.802609 13835 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 18.
W20260709 12:13:08.803207 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 177962us
I20260709 12:13:08.805047 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:08.805938 13835 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 24.
I20260709 12:13:08.786682 21814 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:08.806988 21814 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:08.807273 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:08.808180 13835 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 22.
I20260709 12:13:08.811060 13835 raft_consensus.cc:1240] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 15. Current term is 16. Ops: []
W20260709 12:13:08.814285 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 54591us
I20260709 12:13:08.817425 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:08.819703 13727 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:13:08.822587 21868 log.cc:927] Time spent T 00000000000000000000000000000000 P 17d79eae88f84be7a847d0cf544674cd: Append to log took a long time: real 0.111s	user 0.002s	sys 0.000s
I20260709 12:13:08.822893 21545 consensus_queue.cc:1048] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:13:08.825013 21876 log.cc:927] Time spent T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:13:08.762528 21736 raft_consensus.cc:740] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:08.762348 21869 raft_consensus.cc:740] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:08.828001 13727 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:08.829829 13830 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 21.
I20260709 12:13:08.732717 21742 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:08.761718 21589 raft_consensus.cc:2804] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:08.847244 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:08.847571 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:08.848449 14407 raft_consensus.cc:2393] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 20: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:13:08.847288 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:08.855168 13727 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:08.845634 14380 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:08.858553 14380 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:08.864496 13727 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:08.866705 14380 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:08.874799 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:08.875818 14410 raft_consensus.cc:2376] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 20. Re-sending same reply.
I20260709 12:13:08.882614 14380 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:08.885236 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:08.829460 21835 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:08.840133 21742 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:13:08.871948 21875 log.cc:927] Time spent T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.218s	user 0.000s	sys 0.002s
I20260709 12:13:08.908967 13828 raft_consensus.cc:1240] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 15. Current term is 16. Ops: []
I20260709 12:13:08.867012 21646 raft_consensus.cc:2749] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:08.882936 21015 raft_consensus.cc:2749] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 12:13:08.922412 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:08.887629 21365 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:08.887952 21452 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:08.885597 21824 raft_consensus.cc:2749] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:13:08.898754 21711 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Leader pre-election won for term 29
W20260709 12:13:08.946453 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 104625us
I20260709 12:13:08.943053 14408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 1338) took 1177 ms. Trace:
I20260709 12:13:08.861449 21838 consensus_queue.cc:1059] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.052s
I20260709 12:13:08.947252 14408 rpcz_store.cc:276] 0709 12:13:07.754235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:07.755086 (+   851us) service_pool.cc:224] Handling call
0709 12:13:07.755423 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:08.373114 (+617691us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:08.931639 (+558525us) spinlock_profiling.cc:243] Waited 613 ms on lock 0x7b54005a6c54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:08.931936 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1410921344}
I20260709 12:13:08.882411 21489 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:08.965727 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:08.940078 21832 raft_consensus.cc:2749] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:08.941411 21830 raft_consensus.cc:2804] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:08.977491 13688 raft_consensus.cc:1240] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 15. Current term is 16. Ops: []
I20260709 12:13:08.984161 13828 raft_consensus.cc:1240] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 15. Current term is 16. Ops: []
I20260709 12:13:08.948824 21711 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:08.988139 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:08.989828 13685 raft_consensus.cc:1240] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:08.946812 21758 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:08.961292 21747 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:08.946556 21561 consensus_queue.cc:1059] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.043s
I20260709 12:13:08.967033 21452 raft_consensus.cc:2804] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:08.959992 21884 raft_consensus.cc:2749] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:08.944484 21365 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:08.978513 21830 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:08.995174 21711 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:09.015134 13679 raft_consensus.cc:1275] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
W20260709 12:13:09.019292 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:08.949559 21835 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:09.008019 21780 raft_consensus.cc:3055] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:13:09.041072 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:13:09.022925 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 130882us
I20260709 12:13:09.045090 14380 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:13:09.013073 21452 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:08.940819 21871 consensus_queue.cc:237] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:08.959182 21736 consensus_queue.cc:260] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 23.10, Last appended by leader: 10, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:09.031000 21830 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:09.124094 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:09.103327 13829 raft_consensus.cc:2468] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 16.
I20260709 12:13:09.169365 13834 raft_consensus.cc:1240] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 15. Current term is 16. Ops: []
I20260709 12:13:09.034868 21328 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:09.033080 21589 raft_consensus.cc:697] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 25 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:09.169166 13828 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 21.
I20260709 12:13:08.950304 21869 consensus_queue.cc:260] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:09.222025 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:09.223107 13829 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:13:09.227056 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 182129us
I20260709 12:13:08.970183 21866 consensus_queue.cc:237] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:09.096653 21452 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:09.234453 13828 raft_consensus.cc:1275] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:13:09.019227 21758 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:09.241065 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:09.040062 21780 raft_consensus.cc:740] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:09.247321 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:09.254040 13828 raft_consensus.cc:1275] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:13:09.239362 21766 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:09.242390 21015 raft_consensus.cc:2804] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:09.264544 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:13:09.267964 13836 consensus_meta.cc:287] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.580s	user 0.012s	sys 0.000s
W20260709 12:13:09.271449 13571 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d2f365337b324999a073edacbe6c6e09 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER failed with leader ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica ca9fbbc2c0a94897897d502d42f3951f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 21 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:13:09.271610 13836 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 24.
I20260709 12:13:09.272439 13829 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 25.
I20260709 12:13:09.273981 13828 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 21.
W20260709 12:13:09.350327 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:09.352447 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:09.358506 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:09.360973 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:09.271037 21869 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:09.271296 21015 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:09.367338 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:09.249207 21897 consensus_queue.cc:1059] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.118s
W20260709 12:13:09.363049 21860 log.cc:927] Time spent T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 12:13:09.373014 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:09.367101 21015 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:09.388052 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:13:09.381300 21899 log.cc:927] Time spent T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 12:13:09.390584 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:09.372560 21489 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:09.391738 13833 raft_consensus.cc:2376] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 23. Re-sending same reply.
I20260709 12:13:09.393393 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:09.393954 13831 raft_consensus.cc:2393] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 16: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
W20260709 12:13:09.397938 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:09.402194 13758 raft_consensus.cc:1240] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:09.400472 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:09.405716 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:13:09.388981 21814 consensus_meta.cc:287] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.579s	user 0.013s	sys 0.000s
I20260709 12:13:09.403064 13763 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 22.
W20260709 12:13:09.419456 21885 log.cc:927] Time spent T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
I20260709 12:13:09.407207 21780 consensus_queue.cc:260] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:09.511430 21780 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:13:09.518570 21476 consensus_meta.cc:287] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.745s	user 0.007s	sys 0.006s
I20260709 12:13:09.519172 21476 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:09.385864 21589 consensus_queue.cc:237] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:09.524942 13754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48120 (request call id 2683) took 1560 ms. Trace:
I20260709 12:13:09.525452 13754 rpcz_store.cc:276] 0709 12:13:07.964763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:08.076792 (+112029us) service_pool.cc:224] Handling call
0709 12:13:09.524685 (+1447893us) spinlock_profiling.cc:243] Waited 521 ms on lock 0x7b5400087fd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:09.524839 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1198206720}
I20260709 12:13:09.526854 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:09.530419 13755 raft_consensus.cc:2393] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 28: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:09.532927 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:09.533761 13687 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:09.534022 13763 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 25.
I20260709 12:13:09.539466 21476 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:09.438722 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:09.469738 21814 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:09.545738 21904 log.cc:927] Time spent T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:13:09.548468 21814 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:09.491505 21835 leader_election.cc:290] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:09.407827 21365 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:09.498347 13833 raft_consensus.cc:1275] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
W20260709 12:13:09.447005 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:09.510228 21758 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:09.542176 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:09.471429 13758 raft_consensus.cc:1240] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 27. Current term is 28. Ops: []
I20260709 12:13:09.513116 21015 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:09.579006 13754 raft_consensus.cc:1240] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 27. Current term is 28. Ops: [27.16-27.16]
I20260709 12:13:09.579865 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:13:09.571377 13652 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.024s	sys 0.083s
W20260709 12:13:09.593653 13652 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.025s	sys 0.083s
I20260709 12:13:09.595837 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:09.596918 13755 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:13:09.581375 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:09.599961 13758 raft_consensus.cc:1275] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 28 index: 18. Preceding OpId from leader: term: 30 index: 19. (index mismatch)
W20260709 12:13:09.602681 13727 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.736s	user 0.005s	sys 0.013s
W20260709 12:13:09.603200 13727 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.005s	sys 0.013s
I20260709 12:13:09.603371 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:09.604018 13687 raft_consensus.cc:2468] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 20.
I20260709 12:13:09.469430 13800 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:13:09.608326 21365 raft_consensus.cc:2804] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:09.608821 21365 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:09.609225 21365 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:09.611687 21896 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:09.612334 21896 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:09.614769 13680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 3651) took 1936 ms. Trace:
I20260709 12:13:09.615195 13680 rpcz_store.cc:276] 0709 12:13:07.678229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:08.376948 (+698719us) service_pool.cc:224] Handling call
0709 12:13:08.497493 (+120545us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:08.499789 (+  2296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:09.614524 (+1114735us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b54002c4050. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:09.614681 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":264166272}
W20260709 12:13:09.607968 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 138602us
I20260709 12:13:09.596921 21897 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:09.617847 13800 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:09.613407 13652 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:09.621560 21858 raft_consensus.cc:2749] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:09.598201 21758 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:09.622795 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 758355us
I20260709 12:13:09.626219 13727 leader_election.cc:304] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:09.627133 13800 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:13:09.630862 13727 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:09.639128 13800 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:09.653821 13652 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:09.628480 21766 raft_consensus.cc:2749] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:09.659315 13755 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 22.
I20260709 12:13:09.639640 21476 raft_consensus.cc:2804] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:09.646282 21814 raft_consensus.cc:2749] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:09.667047 13727 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:09.662508 21835 raft_consensus.cc:2749] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:09.625361 21897 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:09.638599 21758 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:09.684175 21328 raft_consensus.cc:2804] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 12:13:09.685407 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 260816us
I20260709 12:13:09.664217 21476 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:09.686914 21766 raft_consensus.cc:2804] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:09.662508 21452 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:09.699245 21742 consensus_meta.cc:287] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.755s	user 0.011s	sys 0.003s
I20260709 12:13:09.664706 21751 consensus_queue.cc:1059] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 12:13:09.721501 21830 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:09.723500 21452 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:09.713194 21476 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:09.724452 21908 raft_consensus.cc:2749] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:09.725551 13727 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
W20260709 12:13:09.728076 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 66667.7us
W20260709 12:13:09.727520 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 88478.7us
I20260709 12:13:09.707787 21328 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:09.715656 21896 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:09.714524 21766 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:09.738298 13800 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
W20260709 12:13:09.739686 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:09.738555 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 269417us
W20260709 12:13:09.729682 21711 consensus_meta.cc:287] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.672s	user 0.011s	sys 0.001s
W20260709 12:13:09.747993 21574 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.345s	user 0.017s	sys 0.015s
I20260709 12:13:09.716517 21742 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:09.758817 13757 raft_consensus.cc:1240] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:09.760303 21742 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:09.745410 21766 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:09.770653 13727 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:09.776639 13727 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
W20260709 12:13:09.777071 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 170788us
I20260709 12:13:09.779433 13832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 1558) took 1119 ms. Trace:
I20260709 12:13:09.780886 13761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 3581) took 1209 ms. Trace:
I20260709 12:13:09.781832 13761 rpcz_store.cc:276] 0709 12:13:08.571707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:08.572057 (+   350us) service_pool.cc:224] Handling call
0709 12:13:08.601675 (+ 29618us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:08.627860 (+ 26185us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:09.780541 (+1152681us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b54003930d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:09.780803 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36387072}
I20260709 12:13:09.783057 14379 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:09.742285 21328 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:13:09.785836 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 48593.3us
I20260709 12:13:09.780673 13832 rpcz_store.cc:276] 0709 12:13:08.660317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:08.660475 (+   158us) service_pool.cc:224] Handling call
0709 12:13:08.803056 (+142581us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:08.813602 (+ 10546us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:09.779128 (+965526us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b540002dd50. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:09.779336 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":326939904}
I20260709 12:13:09.789645 13652 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:09.791879 13652 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:13:09.741940 21893 raft_consensus.cc:2804] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:09.773432 21452 raft_consensus.cc:2749] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
W20260709 12:13:09.752828 21574 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.350s	user 0.018s	sys 0.015s
I20260709 12:13:09.795781 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:09.800173 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:09.799172 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:09.796744 13836 raft_consensus.cc:1240] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 22. Current term is 23. Ops: [22.11-22.11]
I20260709 12:13:09.798786 13833 raft_consensus.cc:1275] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 12:13:09.801625 14408 raft_consensus.cc:1240] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:09.803828 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:09.804044 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:09.804641 14416 raft_consensus.cc:2393] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 21: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:13:09.805135 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:09.805800 13831 raft_consensus.cc:1240] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:09.806833 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:09.807021 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:09.793766 21866 raft_consensus.cc:2749] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:13:09.799204 21908 raft_consensus.cc:2804] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:09.808244 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:09.808799 21908 raft_consensus.cc:697] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 24 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:09.810083 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:09.810648 21916 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:09.811404 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:09.811183 21916 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:09.811605 21758 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:09.812634 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:09.812805 21830 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:09.813413 13836 raft_consensus.cc:2393] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 28: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
W20260709 12:13:09.814929 21872 log.cc:927] Time spent T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 1.060s	user 0.006s	sys 0.005s
I20260709 12:13:09.800544 21751 raft_consensus.cc:2804] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:09.816237 21751 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:09.816689 21751 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:09.818177 13682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 2512) took 1851 ms. Trace:
I20260709 12:13:09.818598 13682 rpcz_store.cc:276] 0709 12:13:07.966667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:08.450635 (+483968us) service_pool.cc:224] Handling call
0709 12:13:08.451142 (+   507us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:08.479349 (+ 28207us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:13:08.479381 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:08.484565 (+  5184us) log.cc:844] Serialized 26 byte log entry
0709 12:13:08.617865 (+133300us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:13:08.617905 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:08.617970 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:09.814101 (+1196131us) spinlock_profiling.cc:243] Waited 7.66 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:13:09.817844 (+  3743us) raft_consensus.cc:1685] finished
0709 12:13:09.817866 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:09.818108 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":103,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":18056,"spinlock_wait_cycles":17616768,"thread_start_us":131884,"threads_started":1,"wal-append.queue_time_us":191937}
I20260709 12:13:09.823226 21823 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:09.823931 21823 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:09.810000 21908 consensus_queue.cc:237] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.9, Last appended by leader: 10, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:09.794238 21893 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:09.808102 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:09.805707 13835 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:09.794508 13652 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:09.834844 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:09.750571 21711 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:09.809587 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:13:09.794638 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 79627.4us
I20260709 12:13:09.918182 13834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 1555) took 1259 ms. Trace:
W20260709 12:13:09.853416 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 58991us
I20260709 12:13:09.929590 13727 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:09.958110 13652 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:13:09.954161 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 215932us
I20260709 12:13:09.931492 13835 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 22.
I20260709 12:13:09.961125 13800 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:09.793175 21894 raft_consensus.cc:2804] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:09.964780 21574 raft_consensus.cc:2749] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:09.810022 21015 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:09.967988 13652 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:09.957548 13834 rpcz_store.cc:276] 0709 12:13:08.658877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:08.669695 (+ 10818us) service_pool.cc:224] Handling call
0709 12:13:09.169073 (+499378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:09.187703 (+ 18630us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:09.917905 (+730202us) spinlock_profiling.cc:243] Waited 499 ms on lock 0x7b54003241d0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:09.918101 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1147429760}
I20260709 12:13:09.832525 21916 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:09.841076 21893 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:09.909809 21587 raft_consensus.cc:2749] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:09.976112 14411 raft_consensus.cc:2368] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 28. Current term is 29.
I20260709 12:13:09.933616 21815 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:09.977641 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 194995us
W20260709 12:13:09.976704 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 204102us
I20260709 12:13:09.985514 14379 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:09.798748 21869 consensus_queue.cc:1048] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.167s
I20260709 12:13:09.983443 13800 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:09.962736 21918 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:09.894917 21898 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:13:09.914201 21897 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:09.994189 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:09.994926 21918 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:09.995429 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:09.996551 13833 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:09.995002 13835 raft_consensus.cc:2376] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 24. Re-sending same reply.
I20260709 12:13:10.005576 13833 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 22.
I20260709 12:13:09.972198 21574 raft_consensus.cc:2749] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 12:13:09.898434 21365 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:10.015177 13831 raft_consensus.cc:1240] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 15. Current term is 16. Ops: []
I20260709 12:13:10.028173 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:10.028549 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:13:10.028669 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 99234.3us
I20260709 12:13:10.028861 13833 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 23.
I20260709 12:13:10.029390 13835 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 23.
I20260709 12:13:10.028203 14379 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:13:10.031294 13727 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:10.039573 13727 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:09.983196 21015 consensus_queue.cc:1048] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.052s
I20260709 12:13:10.023133 21365 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:10.018850 21923 raft_consensus.cc:2749] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:10.014529 21574 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.072049 21574 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:10.074304 21926 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:10.074644 21574 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:10.019160 21823 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:10.050019 21814 raft_consensus.cc:2749] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:10.024533 21711 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:10.014402 21587 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:10.076651 21766 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:10.077134 21587 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:10.079387 21766 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:10.061484 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:10.081714 13760 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:10.007995 21476 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:10.083930 21476 leader_election.cc:290] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:10.046543 21894 raft_consensus.cc:697] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:10.030309 21830 raft_consensus.cc:2749] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:13:10.062991 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 79638.3us
I20260709 12:13:10.065640 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:10.086467 13800 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:10.066933 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:10.067492 21928 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:13:10.068063 21907 raft_consensus.cc:2749] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:10.070251 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:10.070894 21589 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:10.075183 21926 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:10.079466 21587 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:10.066231 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:10.036459 21914 raft_consensus.cc:2804] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader election won for term 20
W20260709 12:13:10.088008 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 48589.3us
I20260709 12:13:10.103798 21914 raft_consensus.cc:697] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 20 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:10.103848 13680 raft_consensus.cc:2468] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 16.
I20260709 12:13:10.104126 13727 leader_election.cc:400] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 election: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 23. Current term is 24.
I20260709 12:13:10.062991 21930 raft_consensus.cc:2804] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:10.106190 21930 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:10.106571 21930 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:10.044826 21897 consensus_queue.cc:1059] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 18.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.048s
I20260709 12:13:10.104993 21914 consensus_queue.cc:237] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:10.092070 13800 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:10.094884 14408 raft_consensus.cc:1240] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:10.035756 21328 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:10.094471 21766 raft_consensus.cc:2749] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:10.098255 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:10.118188 21328 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:10.118878 21919 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.119479 21919 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:10.098374 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:10.085615 21894 consensus_queue.cc:237] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:10.123504 13727 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:13:10.125385 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:10.126104 21924 consensus_queue.cc:1059] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:13:10.126384 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:10.098552 14410 raft_consensus.cc:1240] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 19. Current term is 20. Ops: [19.16-19.16]
I20260709 12:13:10.099831 21926 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:10.099977 21816 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:13:10.129066 21742 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:13:10.100744 13688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 1569) took 2318 ms. Trace:
I20260709 12:13:10.025550 21815 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:10.130345 13688 rpcz_store.cc:276] 0709 12:13:07.782655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:08.414667 (+632012us) service_pool.cc:224] Handling call
0709 12:13:08.974714 (+560047us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:08.992625 (+ 17911us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:10.100576 (+1107951us) spinlock_profiling.cc:243] Waited 560 ms on lock 0x7b54002c3650. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:10.100695 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1287039744}
I20260709 12:13:10.091611 13760 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 29.
I20260709 12:13:10.115020 21907 consensus_queue.cc:1059] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:13:10.115556 14412 raft_consensus.cc:1240] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:13:10.115765 21445 raft_consensus.cc:3055] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:13:10.116285 21830 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.130980 13727 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:10.138423 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:10.090494 13684 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 23.
W20260709 12:13:10.142200 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 50180.8us
I20260709 12:13:10.110613 21897 raft_consensus.cc:3055] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:13:10.146654 21123 consensus_queue.cc:1048] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:10.147473 21897 raft_consensus.cc:740] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:10.148613 21897 consensus_queue.cc:260] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:10.148829 21830 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:10.150099 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:10.150291 21897 raft_consensus.cc:3060] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:10.157454 13800 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:10.161849 13652 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:10.166469 13757 raft_consensus.cc:1275] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:13:10.168951 13652 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:10.121678 21919 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:10.126119 14415 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025"
dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:46814
I20260709 12:13:10.142467 21445 raft_consensus.cc:740] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:10.145084 21751 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:10.176162 21742 consensus_queue.cc:1059] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 12:13:10.141070 21814 consensus_queue.cc:1059] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.051s
I20260709 12:13:10.157269 14379 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:10.178023 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:10.195173 14379 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:10.183353 14415 raft_consensus.cc:606] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:10.153479 21766 raft_consensus.cc:2749] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:13:10.102988 21589 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:10.195969 14415 raft_consensus.cc:614] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:10.182199 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:10.183708 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:10.184012 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:10.200327 13684 raft_consensus.cc:1275] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 28 index: 18. Preceding OpId from leader: term: 30 index: 19. (index mismatch)
I20260709 12:13:10.196280 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:10.200995 13833 raft_consensus.cc:2376] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 16. Re-sending same reply.
I20260709 12:13:10.182521 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:10.202040 13831 raft_consensus.cc:2368] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 23. Current term is 24.
W20260709 12:13:10.182580 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:10.202451 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:10.194887 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:10.204906 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:10.205615 13757 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 24.
I20260709 12:13:10.204418 13834 raft_consensus.cc:2376] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 25. Re-sending same reply.
I20260709 12:13:10.210852 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:10.211750 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:10.212519 13833 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 22.
I20260709 12:13:10.212873 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:10.211974 13760 raft_consensus.cc:2393] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 20: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:10.175832 21926 consensus_queue.cc:1048] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 12:13:10.215301 21711 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:13:10.215962 21711 raft_consensus.cc:697] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 29 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:10.216372 21675 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:10.188923 21751 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:10.220089 21833 raft_consensus.cc:3055] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:13:10.220575 21833 raft_consensus.cc:740] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:10.221611 21833 consensus_queue.cc:260] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:10.204559 21922 raft_consensus.cc:2804] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:10.223379 21833 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:13:10.223601 21922 raft_consensus.cc:697] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 22 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:10.224095 21758 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:10.224814 21758 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:10.224655 21922 consensus_queue.cc:237] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:10.175647 21869 raft_consensus.cc:2749] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:13:10.226877 13683 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48212 (request call id 1571) took 2313 ms (client timeout 2056 ms). Trace:
I20260709 12:13:10.227084 21758 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:10.235186 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:10.193955 21591 raft_consensus.cc:2804] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:13:10.243651 13828 raft_consensus.cc:1275] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 12:13:10.238348 13687 raft_consensus.cc:1275] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 12:13:10.230662 14379 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:10.239351 13834 raft_consensus.cc:2393] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 24: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
W20260709 12:13:10.227392 13683 rpcz_store.cc:269] 0709 12:13:07.913125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:08.101485 (+188360us) service_pool.cc:224] Handling call
0709 12:13:10.226602 (+2125117us) spinlock_profiling.cc:243] Waited 1.85 s on lock 0x7b540031e7d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:10.226762 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4259769728}
I20260709 12:13:10.216969 21711 consensus_queue.cc:237] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 27.17, Last appended by leader: 17, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:10.247841 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:10.248746 21591 raft_consensus.cc:697] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 16 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:10.186831 21857 raft_consensus.cc:2804] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:10.249305 21751 consensus_queue.cc:1059] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 12:13:10.255923 21895 log.cc:927] Time spent T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.754s	user 0.003s	sys 0.000s
I20260709 12:13:10.181092 21849 consensus_queue.cc:1048] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.086s
I20260709 12:13:10.264365 13758 raft_consensus.cc:1240] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:10.265599 13762 raft_consensus.cc:1240] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:10.179584 21815 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:10.267493 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:10.267797 14379 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:10.240513 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:10.294476 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:10.295172 13833 raft_consensus.cc:2393] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 16: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:10.269388 13828 raft_consensus.cc:1240] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:10.270386 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:10.186412 21830 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:10.296360 13836 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:10.303897 13831 raft_consensus.cc:2393] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 19: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:10.304502 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:10.310808 14379 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:10.334787 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:10.338752 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:10.339841 13828 raft_consensus.cc:2393] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 27: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:10.341199 13836 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 22.
I20260709 12:13:10.299520 13800 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:10.240283 21893 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:10.342682 21675 raft_consensus.cc:2804] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:10.343163 21675 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:10.343520 21675 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:10.344477 21893 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:10.281392 21710 raft_consensus.cc:2804] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:13:10.343536 13763 raft_consensus.cc:1275] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 12:13:10.361599 21924 consensus_queue.cc:1059] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 26.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:13:10.308508 21123 raft_consensus.cc:2804] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:13:10.374154 13758 raft_consensus.cc:1275] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 12:13:10.185647 21445 consensus_queue.cc:260] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:10.402393 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:10.297838 21898 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:10.337087 21830 raft_consensus.cc:2749] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 12:13:10.337834 21857 raft_consensus.cc:697] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 23 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:10.309150 21862 consensus_queue.cc:1059] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.092s
W20260709 12:13:10.403483 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 104051us
I20260709 12:13:10.403780 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:10.410861 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:13:10.411578 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 216499us
I20260709 12:13:10.357733 21710 raft_consensus.cc:697] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 20 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:10.403019 21123 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:10.421449 21123 raft_consensus.cc:3060] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:10.422025 21710 consensus_queue.cc:237] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:10.405583 21930 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:10.425966 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:10.426757 21930 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:10.427222 14414 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 24.
I20260709 12:13:10.428365 21862 raft_consensus.cc:3055] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:10.428833 21862 raft_consensus.cc:740] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:10.429939 21927 consensus_queue.cc:1048] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.079s
I20260709 12:13:10.430486 21857 consensus_queue.cc:237] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:10.433382 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:10.396195 21365 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:10.444854 13758 raft_consensus.cc:1240] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:10.446614 13758 raft_consensus.cc:1240] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:10.420701 13800 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:10.399377 21757 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:10.358116 21823 consensus_queue.cc:1048] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.061s
W20260709 12:13:10.493584 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 72985.5us
W20260709 12:13:10.484098 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:10.496976 21933 raft_consensus.cc:3055] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:10.497460 21933 raft_consensus.cc:740] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:10.493412 21896 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.498522 21896 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:10.499521 13763 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "956300599d004370953188dd3ae3a256"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:13:10.500281 13763 raft_consensus.cc:606] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:10.500675 13763 raft_consensus.cc:614] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:10.434964 21862 consensus_queue.cc:260] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:10.502980 21862 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:10.504551 21933 consensus_queue.cc:260] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.16, Last appended by leader: 16, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:10.505863 21757 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:10.508697 21757 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:10.414819 21926 raft_consensus.cc:2804] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 12:13:10.512317 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:10.407554 21916 consensus_queue.cc:1059] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.078s
I20260709 12:13:10.447137 21751 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:10.540827 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 263953us
I20260709 12:13:10.544463 13727 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:13:10.587556 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:10.588264 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:10.512249 21816 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:10.594799 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 50430.8us
W20260709 12:13:10.591126 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 53252.2us
W20260709 12:13:10.598075 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:10.518419 21926 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:10.582350 21849 raft_consensus.cc:2804] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:10.493089 21365 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:10.582623 21933 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:10.586701 21574 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:10.436028 21898 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:10.643358 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:10.618320 21869 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.622999 21830 raft_consensus.cc:2804] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:10.624938 21926 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:10.582652 21757 consensus_queue.cc:1059] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.051s
I20260709 12:13:10.492873 21591 consensus_queue.cc:237] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:10.587023 21751 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:10.633466 21849 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:10.590170 21512 consensus_queue.cc:1059] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 18.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.052s
I20260709 12:13:10.590541 21930 consensus_queue.cc:1059] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.052s
I20260709 12:13:10.607704 21923 consensus_queue.cc:1048] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 12:13:10.662988 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:10.614562 21742 consensus_queue.cc:1048] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 12:13:10.656944 21830 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:10.617834 21816 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:10.648265 21589 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:13:10.670220 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:10.651551 21574 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:10.662004 21833 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:10.667241 21849 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:10.685592 14413 raft_consensus.cc:1275] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 12:13:10.684435 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:10.657253 21869 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:10.687608 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:10.688416 13682 raft_consensus.cc:2393] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 28: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:10.675676 21830 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:10.679219 13652 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:10.690280 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:10.698789 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:10.699638 13682 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 22.
I20260709 12:13:10.701062 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:10.701330 13685 raft_consensus.cc:1240] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:10.694960 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:10.679703 21757 raft_consensus.cc:3055] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:13:10.675417 21907 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:10.665704 21941 consensus_queue.cc:1059] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.026s
I20260709 12:13:10.681538 21857 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:10.707923 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:10.715646 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:10.708861 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:10.717810 13679 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:10.710340 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:13:10.726620 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:10.705227 21757 raft_consensus.cc:740] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:10.731941 21757 consensus_queue.cc:260] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:10.733392 21757 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:13:10.737620 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:10.739171 21869 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:10.686610 21833 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:10.730281 21949 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.742617 21949 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:10.743865 21833 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:10.725025 21907 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:10.751320 21869 raft_consensus.cc:2804] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:13:10.752208 21869 raft_consensus.cc:697] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 16 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:10.753247 21907 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:10.757014 13679 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 21.
I20260709 12:13:10.754112 21589 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.753615 21869 consensus_queue.cc:237] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:10.761540 21365 leader_election.cc:290] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:10.761642 21589 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:10.726011 21857 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:10.766103 21589 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:10.767341 21857 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:10.768427 21751 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:10.771580 21898 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:10.773165 21816 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:10.773860 21950 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.774384 21950 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:10.775460 21574 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:10.780030 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:10.780330 13679 raft_consensus.cc:1240] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 27. Current term is 28. Ops: []
I20260709 12:13:10.592557 21814 consensus_queue.cc:1243] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer ca9fbbc2c0a94897897d502d42f3951f log is divergent from this leader: its last log entry 20.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 12:13:10.844941 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:10.799700 21862 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.841131 21365 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:10.779007 21675 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:10.863876 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:10.863976 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:10.865008 13682 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:10.865207 13679 raft_consensus.cc:2393] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 20: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:13:10.847923 21328 consensus_queue.cc:1048] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.019s
I20260709 12:13:10.867312 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:10.868016 13686 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:13:10.870028 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:10.869760 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:10.871196 13758 raft_consensus.cc:2393] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 27: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
W20260709 12:13:10.872594 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 193438us
I20260709 12:13:10.875834 13831 raft_consensus.cc:1275] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 12:13:10.876384 13686 raft_consensus.cc:2468] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 16.
I20260709 12:13:10.886580 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:10.883219 13652 leader_election.cc:400] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 election: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 23. Current term is 24.
I20260709 12:13:10.894511 13679 raft_consensus.cc:1275] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:13:10.898985 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:10.900681 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:10.856050 21862 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:10.861845 21365 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:10.893317 21940 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:10.893260 21939 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:10.912650 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:10.914422 13679 raft_consensus.cc:1240] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:10.909920 13652 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:13:10.918376 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:10.926518 13682 raft_consensus.cc:2410] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 23 because replica has last-logged OpId of term: 22 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 10.
I20260709 12:13:10.884032 21123 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:10.931363 13652 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:10.943038 13682 raft_consensus.cc:1240] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 27. Current term is 28. Ops: [27.16-27.16]
I20260709 12:13:10.942998 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:10.942296 21959 raft_consensus.cc:2804] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:10.944907 13686 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:10.954687 14413 raft_consensus.cc:1275] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
W20260709 12:13:10.956485 21947 log.cc:927] Time spent T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 12:13:10.956422 13686 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 23.
I20260709 12:13:10.918366 21939 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:10.961905 21939 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:10.927711 21940 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:10.966334 21849 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:10.967882 21675 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 24 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:10.968446 21849 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:10.968544 21940 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:10.968720 21957 raft_consensus.cc:2749] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:10.971947 21950 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:10.972525 21959 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:10.973053 21959 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:13:10.977623 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:10.978367 13685 raft_consensus.cc:1240] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 12:13:10.943518 21830 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:10.983428 21558 raft_consensus.cc:3055] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:10.983906 21558 raft_consensus.cc:740] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:10.984486 21830 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:10.985709 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:10.986378 14415 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:10.994733 14413 raft_consensus.cc:1240] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 20 LEADER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:10.996236 21961 consensus_queue.cc:1048] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.018s
I20260709 12:13:11.006702 14412 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602"
dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
mode: GRACEFUL
new_leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
 from {username='slave'} at 127.0.0.1:46814
I20260709 12:13:11.007355 14412 raft_consensus.cc:606] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Received request to transfer leadership to TS 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:13:11.007694 14412 raft_consensus.cc:614] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:10.984727 21558 consensus_queue.cc:260] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:11.013955 14412 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3"
dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:46814
I20260709 12:13:11.009924 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:11.016530 14379 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
W20260709 12:13:11.006337 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 61151us
I20260709 12:13:11.013895 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:11.033138 13761 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:11.035310 13652 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:11.030906 14412 raft_consensus.cc:606] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 21 LEADER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:11.052189 13652 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:11.050619 13651 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:11.055667 21123 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 17 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:11.056300 13652 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:11.059866 21751 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:11.059687 21926 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:11.011762 21445 raft_consensus.cc:3060] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:13:11.064340 21857 consensus_queue.cc:1048] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:13:11.059672 21816 raft_consensus.cc:2804] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:11.067332 21589 raft_consensus.cc:2749] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:13:11.067497 21816 raft_consensus.cc:697] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 22 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:11.068842 21862 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:10.992748 21940 consensus_queue.cc:1048] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.077s
I20260709 12:13:11.051923 21558 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:11.090704 21751 raft_consensus.cc:2749] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:11.075848 21857 consensus_queue.cc:1059] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 12:13:11.034996 21452 consensus_queue.cc:1059] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.051s
I20260709 12:13:11.046073 21758 consensus_queue.cc:1059] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 12:13:11.073894 21869 raft_consensus.cc:2749] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 12:13:11.068833 21816 consensus_queue.cc:237] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:11.086511 21893 raft_consensus.cc:3055] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:11.086071 21574 consensus_queue.cc:1059] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:11.088178 13651 leader_election.cc:304] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:11.051776 21961 consensus_queue.cc:1059] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.064s
I20260709 12:13:11.128121 13683 raft_consensus.cc:1275] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 20 index: 9. Preceding OpId from leader: term: 24 index: 10. (index mismatch)
I20260709 12:13:11.130510 13761 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 26.
W20260709 12:13:11.074692 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 94247.4us
I20260709 12:13:11.133320 14415 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 25.
I20260709 12:13:11.139490 21857 raft_consensus.cc:3055] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:11.127234 21328 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:11.140465 21574 raft_consensus.cc:3055] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:11.141119 21758 raft_consensus.cc:3055] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:13:11.141340 21896 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:13:11.141880 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 54033us
I20260709 12:13:11.142103 21365 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:11.158068 13651 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:11.137394 21926 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:13:11.157343 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:11.138780 21893 raft_consensus.cc:740] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:11.142475 21957 raft_consensus.cc:2749] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:13:11.159133 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 99987us
I20260709 12:13:11.160178 13651 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:11.150112 21857 raft_consensus.cc:740] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:11.146428 21833 raft_consensus.cc:2764] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Leader pre-election decision vote started in defunct term 24: won
W20260709 12:13:11.171241 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:11.173739 13651 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:11.151099 21961 raft_consensus.cc:3055] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 21 LEADER]: Stepping down as leader of term 21
W20260709 12:13:11.177066 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:11.163298 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:11.152099 21829 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:11.153087 21936 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:11.153505 21574 raft_consensus.cc:740] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:11.176304 13761 raft_consensus.cc:1240] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 27. Current term is 28. Ops: [27.14-27.14]
I20260709 12:13:11.156997 21452 consensus_queue.cc:1243] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer ca9fbbc2c0a94897897d502d42f3951f log is divergent from this leader: its last log entry 20.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 12:13:11.185292 14410 raft_consensus.cc:1240] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:11.179957 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:11.186075 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:11.186609 14412 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 21.
I20260709 12:13:11.161927 21896 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:11.155578 21758 raft_consensus.cc:740] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:11.170154 21751 raft_consensus.cc:2749] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:11.182480 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:11.198730 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:11.199501 14412 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 16.
I20260709 12:13:11.199669 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:11.200385 13832 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 16.
I20260709 12:13:11.184398 21829 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:11.200146 21893 consensus_queue.cc:260] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:11.191576 21574 consensus_queue.cc:260] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:11.170785 21869 consensus_queue.cc:1048] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 12:13:11.176080 21589 consensus_queue.cc:1048] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.020s
I20260709 12:13:11.176981 21961 raft_consensus.cc:740] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:11.159917 21328 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:11.178711 14415 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 20.
I20260709 12:13:11.180159 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:11.188064 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:11.189265 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:11.189545 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:11.189924 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:11.190546 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:11.178257 21950 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:11.194286 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:11.211835 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:13:11.263311 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:11.210758 13754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 2700) took 1708 ms. Trace:
I20260709 12:13:11.267751 13833 raft_consensus.cc:2410] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 22 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 13.
I20260709 12:13:11.268710 13754 rpcz_store.cc:276] 0709 12:13:09.502701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:09.526587 (+ 23886us) service_pool.cc:224] Handling call
0709 12:13:09.555799 (+ 29212us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:09.600498 (+ 44699us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:11.210520 (+1610022us) spinlock_profiling.cc:243] Waited 28.8 ms on lock 0x7b540038d6d0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:11.210688 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":66163968}
I20260709 12:13:11.271318 13835 raft_consensus.cc:2393] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 24: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:11.269400 13836 raft_consensus.cc:2393] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 23: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:11.267004 13830 raft_consensus.cc:2393] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 23: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:11.201711 13832 raft_consensus.cc:1240] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 25. Current term is 26. Ops: [25.16-25.16]
W20260709 12:13:11.218233 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:11.197014 13800 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
W20260709 12:13:11.275722 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 78798us
I20260709 12:13:11.268772 13828 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 24.
W20260709 12:13:11.310196 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:11.346575 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 134056us
I20260709 12:13:11.187875 21957 consensus_queue.cc:1059] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.158s
I20260709 12:13:11.214294 21932 raft_consensus.cc:3055] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:13:11.208055 21766 raft_consensus.cc:3055] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:13:11.202718 21829 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:11.297828 21935 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:11.361397 21849 consensus_queue.cc:1059] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 26.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 12:13:11.206194 21857 consensus_queue.cc:260] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:11.378809 21815 raft_consensus.cc:3055] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:13:11.380376 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:13:11.388721 13837 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35422 (request call id 1551) took 2773 ms (client timeout 2095 ms). Trace:
I20260709 12:13:11.390810 13688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 1589) took 1179 ms. Trace:
W20260709 12:13:11.392352 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:11.433122 13760 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 22.
I20260709 12:13:11.394061 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:11.395808 21328 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:11.195642 21936 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:11.433487 13688 rpcz_store.cc:276] 0709 12:13:10.211330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:10.211522 (+   192us) service_pool.cc:224] Handling call
0709 12:13:10.211813 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:10.243029 (+ 31216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:10.243079 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:10.243140 (+    61us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:13:10.243188 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:11.390567 (+1147379us) spinlock_profiling.cc:243] Waited 30.9 ms on lock 0x7b54002c3154. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:11.390613 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:11.390745 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":71078784}
I20260709 12:13:11.396247 13829 raft_consensus.cc:1240] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 20 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:11.375142 21742 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:11.398245 13727 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:11.398263 21893 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:11.398801 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:11.403715 21894 raft_consensus.cc:3055] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:11.448053 14380 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:13:11.404166 21766 raft_consensus.cc:740] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:11.405582 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:13:11.411615 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:11.455576 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:11.409739 21574 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:11.275230 21959 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:11.431941 13680 raft_consensus.cc:1275] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:13:11.431835 21015 consensus_queue.cc:1048] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 12:13:11.433178 13837 rpcz_store.cc:269] 0709 12:13:08.615529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:08.615679 (+   150us) service_pool.cc:224] Handling call
0709 12:13:11.388462 (+2772783us) spinlock_profiling.cc:243] Waited 2.25 s on lock 0x7b54000d9654. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:11.388615 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5173981056}
I20260709 12:13:11.396708 13684 raft_consensus.cc:1275] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 12:13:11.439571 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:11.325702 21365 raft_consensus.cc:2804] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:11.400573 21932 raft_consensus.cc:740] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:13:11.446316 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 48154.7us
I20260709 12:13:11.471690 13727 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:11.460528 13652 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:11.202914 21587 consensus_queue.cc:1059] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.168s
I20260709 12:13:11.445133 13800 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:11.452844 13757 raft_consensus.cc:1240] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 21. Current term is 22. Ops: []
W20260709 12:13:11.453523 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 269575us
I20260709 12:13:11.485891 13835 raft_consensus.cc:1240] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:11.491010 13726 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
W20260709 12:13:11.492198 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:11.493968 14414 raft_consensus.cc:1240] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 22 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 21. Current term is 22. Ops: [21.16-21.16]
I20260709 12:13:11.451853 21328 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:13:11.469950 14380 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:13:11.467994 21936 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:11.327394 21918 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:11.432826 21815 raft_consensus.cc:740] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:11.431282 21757 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:13:11.476672 14411 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41700 (request call id 1180) took 1680 ms (client timeout 1630 ms). Trace:
I20260709 12:13:11.477567 13727 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:11.413057 21930 consensus_queue.cc:1059] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 26.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.044s
I20260709 12:13:11.438918 21935 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:11.512627 14411 rpcz_store.cc:269] 0709 12:13:09.796255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:09.796366 (+   111us) service_pool.cc:224] Handling call
0709 12:13:11.476448 (+1680082us) spinlock_profiling.cc:243] Waited 174 ms on lock 0x7b54007c01d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:11.476594 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":401189760}
I20260709 12:13:11.483744 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:11.502951 13761 raft_consensus.cc:1275] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 27 index: 17. Preceding OpId from leader: term: 29 index: 18. (index mismatch)
I20260709 12:13:11.455348 21561 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.450002 21894 raft_consensus.cc:740] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:13:11.504781 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 44346us
I20260709 12:13:11.440828 21591 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.509995 13828 raft_consensus.cc:1240] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:11.511116 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:11.511034 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:11.507112 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:11.482142 13833 raft_consensus.cc:1240] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:11.475790 21957 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.483270 21824 raft_consensus.cc:2804] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:11.502318 21829 raft_consensus.cc:2804] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:11.504061 21839 consensus_queue.cc:1048] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.040s
I20260709 12:13:11.543908 21932 consensus_queue.cc:260] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:11.554734 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:13:11.556433 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 79009.2us
I20260709 12:13:11.476779 21558 consensus_queue.cc:1048] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.039s
I20260709 12:13:11.546105 13800 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:11.520177 21757 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:11.547322 21827 consensus_queue.cc:1059] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:13:11.547731 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:11.548942 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:11.579481 13761 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 21.
I20260709 12:13:11.580827 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:11.452026 21742 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:11.536814 13652 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:13:11.552773 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 61916.1us
I20260709 12:13:11.422971 21758 consensus_queue.cc:260] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:11.555437 13837 raft_consensus.cc:2468] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 16.
I20260709 12:13:11.521399 21866 raft_consensus.cc:3055] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:11.645327 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:11.645695 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:11.645973 13761 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 21.
I20260709 12:13:11.562806 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:11.564479 13828 raft_consensus.cc:1240] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 15. Current term is 16. Ops: []
I20260709 12:13:11.515847 21711 raft_consensus.cc:2804] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:11.638248 13763 raft_consensus.cc:2393] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 22: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:11.516227 21968 raft_consensus.cc:2804] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:11.648628 13687 raft_consensus.cc:1240] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 22. Current term is 23. Ops: []
W20260709 12:13:11.649236 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 112510us
I20260709 12:13:11.640211 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:11.561286 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:11.650831 13836 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:11.652446 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:11.642899 13726 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:11.535362 21896 raft_consensus.cc:2749] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:11.502629 21869 consensus_queue.cc:1059] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.071s
I20260709 12:13:11.644560 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:11.683240 13835 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:11.683423 21869 raft_consensus.cc:3055] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:11.684065 21869 raft_consensus.cc:740] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:11.644944 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:11.689038 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:11.690429 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:11.691260 13684 raft_consensus.cc:2410] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 23 because replica has last-logged OpId of term: 22 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 10.
I20260709 12:13:11.691368 21935 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:11.692081 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:11.692783 21815 consensus_queue.cc:260] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:11.653590 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:13:11.647608 14380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:11.694062 13679 raft_consensus.cc:2376] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 16. Re-sending same reply.
I20260709 12:13:11.655790 13830 raft_consensus.cc:1240] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:11.694288 21815 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:11.694958 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:11.654904 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:11.695410 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:11.696326 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:11.696466 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:11.650465 13837 raft_consensus.cc:3060] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:11.696985 13830 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:11.656260 13726 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:11.657128 13834 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:11.649760 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:11.658629 21758 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:11.657291 13651 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:11.650224 21866 raft_consensus.cc:740] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:11.658960 21816 raft_consensus.cc:2804] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:13:11.659523 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:11.701668 13651 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:11.701495 21866 consensus_queue.cc:260] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:11.698872 13687 raft_consensus.cc:2393] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 19: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:11.660830 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:11.563170 21591 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:11.647257 21923 raft_consensus.cc:3055] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:13:11.706388 21923 raft_consensus.cc:740] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:11.706991 13686 raft_consensus.cc:1240] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:11.707722 21591 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:11.707823 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:13:11.661280 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 115264us
I20260709 12:13:11.555260 21561 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:11.650000 13652 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:11.709040 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:13:11.709576 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 59668.7us
I20260709 12:13:11.712095 21742 leader_election.cc:290] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:11.445323 21961 consensus_queue.cc:260] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:11.712968 21757 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:11.713320 21961 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:11.714200 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:11.714780 21589 raft_consensus.cc:2804] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:11.714946 14412 raft_consensus.cc:2393] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 17: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:13:11.715277 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:11.715700 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:11.715857 13652 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:11.716313 21959 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:11.716529 14410 raft_consensus.cc:1275] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
W20260709 12:13:11.662506 21970 log.cc:927] Time spent T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 12:13:11.663347 13680 raft_consensus.cc:1240] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260709 12:13:11.677721 13836 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 24.
I20260709 12:13:11.693287 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:11.701982 21816 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:11.702800 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:13:11.719650 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 63466.8us
I20260709 12:13:11.554190 21918 raft_consensus.cc:2804] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:11.660545 21930 raft_consensus.cc:2749] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:13:11.754268 13835 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 29.
I20260709 12:13:11.554468 21545 raft_consensus.cc:2749] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 12:13:11.703361 21587 raft_consensus.cc:2749] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:11.704520 21558 raft_consensus.cc:2804] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:11.713565 21757 consensus_queue.cc:1059] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.040s
I20260709 12:13:11.653409 21932 raft_consensus.cc:3060] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:11.662111 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:11.709622 13832 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:13:11.659241 21972 log.cc:927] Time spent T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
W20260709 12:13:11.645116 21954 log.cc:927] Time spent T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 12:13:11.562557 21941 raft_consensus.cc:2749] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:13:11.640383 21824 raft_consensus.cc:697] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 22 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:11.718921 21839 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:11.798549 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:11.799041 21839 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:11.799396 21824 consensus_queue.cc:237] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:11.800014 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:11.710392 21561 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:11.755612 21816 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:11.751820 13834 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 22.
I20260709 12:13:11.752156 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:11.802826 13836 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 21.
I20260709 12:13:11.804010 13836 raft_consensus.cc:1240] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:11.805300 13836 raft_consensus.cc:1240] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 22. Current term is 23. Ops: [22.11-22.11]
I20260709 12:13:11.755393 21675 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.656157 21711 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:11.702961 21866 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:11.710711 13800 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:11.806141 21675 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:11.806927 21839 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:11.807511 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 96857us
I20260709 12:13:11.772858 21935 consensus_queue.cc:1059] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.045s
I20260709 12:13:11.814168 21978 consensus_queue.cc:1048] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:13:11.719748 21940 raft_consensus.cc:2804] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:11.560640 21445 consensus_queue.cc:1048] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.162s
I20260709 12:13:11.816272 21940 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:11.809289 13800 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:11.769510 21918 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:11.818029 21918 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:13:11.770187 21967 log.cc:927] Time spent T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 12:13:11.640882 21829 raft_consensus.cc:697] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:11.757349 13726 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:11.757411 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:11.820644 13835 raft_consensus.cc:2468] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 16.
I20260709 12:13:11.819638 13800 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:11.821988 13835 raft_consensus.cc:1240] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 23. Current term is 24. Ops: []
W20260709 12:13:11.823257 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:11.719462 21974 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.705681 21950 raft_consensus.cc:2749] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:11.568272 21957 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:11.685155 21869 consensus_queue.cc:260] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.18, Last appended by leader: 18, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:11.653546 21968 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:11.722121 21883 raft_consensus.cc:2749] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:13:11.806571 21711 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:11.720149 13801 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:13:11.844285 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 124192us
I20260709 12:13:11.845110 13801 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:11.845264 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:11.730902 13837 raft_consensus.cc:2468] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 17.
I20260709 12:13:11.846506 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:11.847214 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:11.754354 13830 raft_consensus.cc:2468] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 20.
I20260709 12:13:11.819617 14414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 1351) took 1147 ms. Trace:
I20260709 12:13:11.823494 13835 raft_consensus.cc:1275] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 12:13:11.849086 13836 raft_consensus.cc:1275] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:13:11.824290 13800 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:13:11.824509 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 67320.5us
I20260709 12:13:11.715272 21589 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:11.752956 21862 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:11.817214 21940 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:11.787031 21558 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:11.774430 21959 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:13:11.842655 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:11.823045 21978 raft_consensus.cc:2749] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:13:11.808369 21675 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:11.931841 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:11.932559 14413 raft_consensus.cc:2468] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 19.
I20260709 12:13:11.724244 21896 consensus_queue.cc:1059] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 24.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.110s
I20260709 12:13:11.864776 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:11.831662 21871 raft_consensus.cc:2749] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:13:11.848632 14414 rpcz_store.cc:276] 0709 12:13:10.672560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:10.672739 (+   179us) service_pool.cc:224] Handling call
0709 12:13:10.683754 (+ 11015us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:11.494734 (+810980us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:11.819362 (+324628us) spinlock_profiling.cc:243] Waited 810 ms on lock 0x7b54006400d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:11.819541 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1862004608}
I20260709 12:13:11.836815 21941 raft_consensus.cc:2749] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:13:11.904850 13835 raft_consensus.cc:1240] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:11.914903 21589 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:13:11.914237 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 198444us
I20260709 12:13:11.945369 21862 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:11.925333 14410 raft_consensus.cc:1240] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:11.910830 13726 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:11.912955 21558 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:11.933243 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:11.934114 13755 raft_consensus.cc:2468] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 18.
I20260709 12:13:11.707221 21923 consensus_queue.cc:260] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 27.16, Last appended by leader: 16, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:11.971429 21923 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:11.973971 21935 raft_consensus.cc:2804] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:11.974610 21935 raft_consensus.cc:697] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:11.975543 21935 consensus_queue.cc:237] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:11.944015 14414 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024"
dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:46814
I20260709 12:13:11.978623 14414 raft_consensus.cc:606] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 24 LEADER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:11.842188 21974 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:11.941078 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:11.850229 21968 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:11.952884 13652 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:13:11.923743 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 99517.7us
I20260709 12:13:11.854540 21930 raft_consensus.cc:2749] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:11.947486 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:11.773670 21894 consensus_queue.cc:260] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:11.929014 13571 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d2f365337b324999a073edacbe6c6e09 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER failed with leader ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica ca9fbbc2c0a94897897d502d42f3951f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 21 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:13:11.905725 21926 raft_consensus.cc:2749] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 12:13:11.996708 13571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 67741.3us
W20260709 12:13:11.965181 21893 consensus_meta.cc:287] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.512s	user 0.008s	sys 0.002s
I20260709 12:13:11.912709 21591 raft_consensus.cc:2749] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:13:11.967053 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:11.969223 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 58536.3us
I20260709 12:13:11.991752 13800 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:13:11.992918 14408 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 26.
I20260709 12:13:11.939538 21869 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:11.994892 13835 raft_consensus.cc:1240] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:11.995182 13832 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 24.
I20260709 12:13:11.848023 21365 raft_consensus.cc:697] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 26 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:11.995637 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:13:12.002960 14379 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:11.980839 21978 raft_consensus.cc:2749] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:12.027050 13835 raft_consensus.cc:1240] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 21. Current term is 22. Ops: [18.16-21.17]
I20260709 12:13:12.028542 13800 leader_election.cc:304] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:12.029832 13679 raft_consensus.cc:2410] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
W20260709 12:13:12.047444 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:11.981427 21757 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:12.052819 13800 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:12.069029 13800 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:13:12.073031 21976 log.cc:927] Time spent T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.250s	user 0.001s	sys 0.000s
I20260709 12:13:12.073832 21894 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:12.026716 21829 consensus_queue.cc:237] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:12.049686 21675 raft_consensus.cc:2804] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:12.079725 21675 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:12.080272 21675 raft_consensus.cc:3060] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:12.076825 21757 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:12.080395 21950 raft_consensus.cc:2804] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:12.052991 21893 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:12.053321 21926 raft_consensus.cc:2804] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:12.083840 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:12.053973 21992 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:11.967666 21990 consensus_queue.cc:1048] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.095s
I20260709 12:13:12.098444 13684 raft_consensus.cc:2468] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 16.
I20260709 12:13:12.099133 13759 raft_consensus.cc:1240] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 25. Current term is 26. Ops: [25.16-25.16]
W20260709 12:13:12.105930 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 153161us
I20260709 12:13:12.107111 13652 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:12.110471 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:13:12.113077 14380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:12.112993 13759 raft_consensus.cc:1240] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:12.111409 13684 raft_consensus.cc:2468] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 19.
I20260709 12:13:12.091642 21978 raft_consensus.cc:2749] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:13:12.095419 21950 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:12.085815 21591 consensus_queue.cc:1048] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 12:13:12.053555 21328 consensus_queue.cc:1059] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.060s
W20260709 12:13:12.144299 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:12.170578 22002 raft_consensus.cc:2749] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:12.103511 21893 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:12.135615 21950 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:13:12.179740 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 65056.1us
W20260709 12:13:12.197082 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 128132us
I20260709 12:13:12.180295 21926 raft_consensus.cc:697] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 23 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:12.198913 13800 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:12.199491 13681 raft_consensus.cc:1240] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:12.185024 21941 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:12.201767 13727 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.003s	sys 0.012s
I20260709 12:13:12.203383 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:12.206099 13800 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:12.210186 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:13:12.210994 13727 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.004s	sys 0.012s
W20260709 12:13:12.212378 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 653569us
I20260709 12:13:12.196333 21978 raft_consensus.cc:2749] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:13:12.136624 21365 consensus_queue.cc:237] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:12.215898 13684 raft_consensus.cc:1240] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 22 LEADER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:12.214056 13727 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:12.218431 21757 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:12.211465 21941 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:12.221150 21941 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:12.221884 21986 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.222337 21893 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:12.222465 21986 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:12.223372 21951 raft_consensus.cc:3055] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:12.223781 21951 raft_consensus.cc:740] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:12.225297 21986 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199)
I20260709 12:13:12.215500 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:12.231982 13759 raft_consensus.cc:1275] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
W20260709 12:13:12.238252 21961 consensus_meta.cc:287] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.516s	user 0.009s	sys 0.001s
W20260709 12:13:12.247982 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:12.240439 21574 consensus_meta.cc:287] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.762s	user 0.010s	sys 0.001s
I20260709 12:13:12.272495 13682 raft_consensus.cc:2410] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 23 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 12:13:12.273948 13683 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 22.
I20260709 12:13:12.274205 13837 raft_consensus.cc:1240] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:12.250258 13800 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:12.250483 21990 raft_consensus.cc:2804] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:13:12.246752 13727 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:12.250576 22008 raft_consensus.cc:2749] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:13:12.251029 21591 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.251204 21918 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:12.303817 21950 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:12.305756 21918 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:12.254911 21988 consensus_queue.cc:1059] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 24.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:12.255811 21951 consensus_queue.cc:260] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:12.257983 22005 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:12.258358 22009 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.260259 22012 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.263789 21926 consensus_queue.cc:237] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:12.264801 21711 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:12.265717 13829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 3414) took 3305 ms. Trace:
I20260709 12:13:12.267302 21999 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:12.269300 21742 raft_consensus.cc:3055] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 LEADER]: Stepping down as leader of term 21
W20260709 12:13:12.270078 21983 log.cc:927] Time spent T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.257s	user 0.000s	sys 0.002s
I20260709 12:13:12.270382 21974 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:12.271303 22000 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.287091 13761 raft_consensus.cc:1240] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:12.245471 21757 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.327036 21932 raft_consensus.cc:2804] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:12.298837 13758 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 23.
I20260709 12:13:12.301883 21589 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:12.249394 21893 raft_consensus.cc:2804] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader election won for term 25
W20260709 12:13:12.330547 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 83888.3us
W20260709 12:13:12.330843 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 80678.4us
I20260709 12:13:12.343271 13727 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:12.343325 13800 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:12.275344 21961 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:12.303845 21591 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:12.333281 13829 rpcz_store.cc:276] 0709 12:13:08.959823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:09.278510 (+318687us) service_pool.cc:224] Handling call
0709 12:13:11.396067 (+2117557us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:11.435505 (+ 39438us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:12.265448 (+829943us) spinlock_profiling.cc:243] Waited 2.05 s on lock 0x7b54000d9650. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:12.265618 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4714933120}
I20260709 12:13:12.246429 21816 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:12.346977 14411 raft_consensus.cc:1240] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 23. Current term is 24. Ops: [23.18-23.18]
I20260709 12:13:12.348069 13727 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:12.324445 21990 raft_consensus.cc:697] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 16 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:12.333019 21829 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.308334 21558 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:12.335181 21923 raft_consensus.cc:2749] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:12.349998 21757 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:12.334880 22005 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:12.352499 21894 raft_consensus.cc:2749] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:12.354955 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:12.355505 21935 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:12.338507 21951 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:12.356339 21589 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:12.356819 21816 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:12.356385 21990 consensus_queue.cc:237] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:12.357302 21893 raft_consensus.cc:697] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:12.357939 13680 raft_consensus.cc:1240] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:12.366973 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:12.359447 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:12.347589 21932 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:12.373414 21932 raft_consensus.cc:3060] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:12.373103 21893 consensus_queue.cc:237] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:12.336506 21742 raft_consensus.cc:740] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:12.381445 22017 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:12.381623 21742 consensus_queue.cc:260] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:12.382265 22017 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:12.383020 21742 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:12.384371 22014 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:12.351595 21950 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:12.372160 21968 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:12.386345 13834 raft_consensus.cc:1240] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 16. Current term is 17. Ops: []
I20260709 12:13:12.361791 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:12.363633 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:12.388306 21992 raft_consensus.cc:2749] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:12.391343 21711 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 24 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:12.365160 22005 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:12.342298 21999 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:12.332697 22009 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:12.351430 21815 consensus_meta.cc:287] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.657s	user 0.010s	sys 0.005s
W20260709 12:13:12.363107 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:12.395720 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:12.395943 13756 raft_consensus.cc:1275] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 12:13:12.347041 21918 raft_consensus.cc:2749] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:12.373431 13829 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 26.
W20260709 12:13:12.367695 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:12.398715 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:12.399277 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:12.378471 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:12.365278 13831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 3457) took 1171 ms. Trace:
I20260709 12:13:12.350278 21961 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:12.404155 21961 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:12.401103 13831 rpcz_store.cc:276] 0709 12:13:11.194236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:11.287939 (+ 93703us) service_pool.cc:224] Handling call
0709 12:13:11.288487 (+   548us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:11.411801 (+123314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:11.411837 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:11.430334 (+ 18497us) log.cc:844] Serialized 26 byte log entry
0709 12:13:11.745381 (+315047us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:13:11.745446 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:11.745556 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:12.365048 (+619492us) raft_consensus.cc:1685] finished
0709 12:13:12.365069 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:12.365217 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":96132,"raft.queue_time_us":113642,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":9862,"thread_start_us":260420,"threads_started":1,"wal-append.queue_time_us":377794}
I20260709 12:13:12.399082 21815 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.406932 21938 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.406663 21815 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:12.407532 21938 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:12.381510 21591 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:12.335140 22012 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:12.412900 21938 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:12.388057 21968 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:12.414340 22012 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:12.350426 22000 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:12.369834 21829 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:12.412113 13754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 2718) took 1035 ms. Trace:
I20260709 12:13:12.364620 21757 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:12.419993 13754 rpcz_store.cc:276] 0709 12:13:11.376875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:11.377081 (+   206us) service_pool.cc:224] Handling call
0709 12:13:11.415967 (+ 38886us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:11.639827 (+223860us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:11.639857 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:11.639897 (+    40us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:13:11.639932 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:12.411845 (+771913us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b54002b0cd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:12.411900 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:12.412037 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":514341632}
I20260709 12:13:12.436483 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:12.437659 13832 raft_consensus.cc:2410] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 25 because replica has last-logged OpId of term: 23 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 13.
I20260709 12:13:12.438694 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:12.439309 13679 raft_consensus.cc:1240] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:12.409278 21815 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:12.422709 21558 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:12.423208 21932 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:12.366611 21935 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:12.424849 22005 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:12.426100 21949 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:12.426081 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:12.464279 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:12.465204 13684 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 27.
I20260709 12:13:12.427419 21999 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:12.473165 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:12.477562 14415 raft_consensus.cc:1217] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 22 LEADER]: Deduplicated request from leader. Original: 17.15->[18.16-21.17]   Dedup: 18.16->[21.17-21.17]
I20260709 12:13:12.430862 13831 raft_consensus.cc:1275] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:13:12.478325 14415 raft_consensus.cc:1240] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 22 LEADER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 21. Current term is 22. Ops: [18.16-21.17]
I20260709 12:13:12.479401 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:12.431504 21936 raft_consensus.cc:3055] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:12.432961 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:12.385087 22014 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:12.485031 13758 raft_consensus.cc:2393] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 22: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:12.427441 21957 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:12.485143 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:12.441596 13679 raft_consensus.cc:1240] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:12.446704 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 29 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:12.487375 13688 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 28.
I20260709 12:13:12.380544 21959 raft_consensus.cc:2749] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:12.459906 13651 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:12.461041 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:12.417025 22000 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:12.433471 21829 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:12.463338 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:12.472117 13727 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:12.463613 21935 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Advancing to term 27
W20260709 12:13:12.428251 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:12.468075 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:12.430442 21736 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:12.481580 13830 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:12.482705 22009 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:12.482610 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:12.485888 13754 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 24.
I20260709 12:13:12.491182 13829 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:12.505878 13726 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:12.499217 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:12.500710 13681 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 24.
I20260709 12:13:12.479111 21990 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.510479 21990 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:12.510943 13727 leader_election.cc:304] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:12.489271 21675 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:12.513214 21675 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:13:12.498428 21940 consensus_meta.cc:287] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.563s	user 0.010s	sys 0.005s
I20260709 12:13:12.514225 21940 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:12.517020 21940 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:12.519352 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:12.461880 21941 consensus_queue.cc:1059] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 24.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.038s
I20260709 12:13:12.507038 21957 raft_consensus.cc:2764] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 22: won
I20260709 12:13:12.522492 21924 raft_consensus.cc:2749] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:13:12.523361 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:12.524160 13681 raft_consensus.cc:2393] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 22: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:12.524768 21932 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:12.525072 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:12.526186 13831 raft_consensus.cc:2393] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 25: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:12.526996 13758 raft_consensus.cc:2393] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 22: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:12.530238 21829 raft_consensus.cc:2804] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:12.484371 21894 consensus_queue.cc:1059] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.049s
I20260709 12:13:12.530835 21829 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:12.483554 21936 raft_consensus.cc:740] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:12.531368 21829 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:12.531826 21857 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:12.532060 21936 consensus_queue.cc:260] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:12.533455 21936 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:12.536458 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:12.537163 13684 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 22.
I20260709 12:13:12.541638 13800 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:12.542315 13830 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 17.
I20260709 12:13:12.551288 13758 raft_consensus.cc:1240] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:12.554593 13760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 1368) took 1119 ms. Trace:
I20260709 12:13:12.555038 13760 rpcz_store.cc:276] 0709 12:13:11.434913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:11.440829 (+  5916us) service_pool.cc:224] Handling call
0709 12:13:11.461403 (+ 20574us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:11.711325 (+249922us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:11.711359 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:11.711399 (+    40us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:13:11.711431 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:12.554318 (+842887us) spinlock_profiling.cc:243] Waited 250 ms on lock 0x7b540032e454. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:12.554371 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:12.554534 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":574276480}
I20260709 12:13:12.560680 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:13:12.560976 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 50910.8us
W20260709 12:13:12.563714 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:12.564164 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 53310.5us
I20260709 12:13:12.598157 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:12.564517 13800 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:12.607090 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:12.563416 13652 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:12.544621 21992 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.480307 21815 consensus_queue.cc:1059] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 23.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.057s
I20260709 12:13:12.477875 22005 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:12.600659 13835 raft_consensus.cc:1240] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 26 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 25. Current term is 26. Ops: [25.16-25.16]
I20260709 12:13:12.601655 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:12.564352 21918 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:12.564662 13755 raft_consensus.cc:1240] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 26. Current term is 27. Ops: []
W20260709 12:13:12.608641 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 45298.1us
I20260709 12:13:12.620402 21949 consensus_queue.cc:1048] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:13:12.621253 13652 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:12.561506 13828 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:12.623564 21558 raft_consensus.cc:2804] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:13:12.630555 21994 log.cc:927] Time spent T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.685s	user 0.002s	sys 0.001s
I20260709 12:13:12.630981 21476 raft_consensus.cc:3055] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:13:12.631426 21476 raft_consensus.cc:740] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:12.632328 21476 consensus_queue.cc:260] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:12.625584 13758 raft_consensus.cc:1275] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 23 index: 10. Preceding OpId from leader: term: 24 index: 10. (term mismatch)
I20260709 12:13:12.634244 13758 pending_rounds.cc:85] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting all ops after (but not including) 9
I20260709 12:13:12.634490 13758 pending_rounds.cc:107] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting uncommitted NO_OP operation due to leader change: 23.10
I20260709 12:13:12.634382 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:12.634797 13758 raft_consensus.cc:2889] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:12.635625 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:12.636246 21675 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.636766 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:13:12.643774 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:12.614595 13829 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 24.
I20260709 12:13:12.633621 21476 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:12.597486 22017 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:12.553678 22000 consensus_queue.cc:1059] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.066s
W20260709 12:13:12.662349 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 97843.2us
I20260709 12:13:12.678851 13684 raft_consensus.cc:1240] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 27. Current term is 28. Ops: [27.14-27.14]
I20260709 12:13:12.679337 13726 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:12.680439 13726 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:12.680470 22028 consensus_queue.cc:1059] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:13:12.612187 22009 raft_consensus.cc:2749] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:13:12.662919 13754 raft_consensus.cc:1240] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 27. Current term is 28. Ops: [27.14-27.14]
W20260709 12:13:12.662926 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 55717.9us
I20260709 12:13:12.684022 13727 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:12.618598 21757 raft_consensus.cc:2804] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:12.665354 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:12.619199 21992 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:12.651175 13828 raft_consensus.cc:2410] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 22 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 13.
I20260709 12:13:12.638321 21956 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.674129 22014 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:12.652092 21558 raft_consensus.cc:697] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 17 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:12.687745 13727 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:12.688342 21940 raft_consensus.cc:2804] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:12.636812 21675 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:12.636278 21924 raft_consensus.cc:2749] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
W20260709 12:13:12.692071 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:12.692514 21926 consensus_queue.cc:1059] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 26.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.020s
I20260709 12:13:12.715706 13828 raft_consensus.cc:1240] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:12.735707 22005 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:12.688970 21893 raft_consensus.cc:2804] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:12.717142 13727 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:12.736649 21893 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:12.737092 21893 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:12.737607 13727 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:12.738716 21736 raft_consensus.cc:2749] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:12.739521 21736 raft_consensus.cc:2804] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:12.739939 21736 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:12.740360 21736 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:12.714767 21956 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:12.742265 21328 consensus_queue.cc:1048] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:13:12.742837 22027 consensus_queue.cc:1059] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:13:12.710937 21898 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.743922 21898 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:12.744922 13727 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:12.748050 13727 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:12.725997 22026 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:12.726286 21558 consensus_queue.cc:237] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:12.749460 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:12.751084 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:12.751953 13684 raft_consensus.cc:2393] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 19: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:12.727730 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:12.727747 21940 raft_consensus.cc:697] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:12.756821 21940 consensus_queue.cc:237] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:12.748560 21815 raft_consensus.cc:2804] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:12.722147 21675 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:12.753875 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:12.689709 21757 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:12.770855 13757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48114 (request call id 3604) took 1271 ms. Trace:
I20260709 12:13:12.774816 13757 rpcz_store.cc:276] 0709 12:13:11.499169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:12.753533 (+1254364us) service_pool.cc:224] Handling call
0709 12:13:12.770785 (+ 17252us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:12.719901 22028 raft_consensus.cc:2749] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:12.796679 21736 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:12.804926 21766 consensus_queue.cc:260] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 27.14, Last appended by leader: 14, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:12.776113 21757 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:12.830230 13829 raft_consensus.cc:1275] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 27 index: 17. Preceding OpId from leader: term: 29 index: 18. (index mismatch)
I20260709 12:13:12.830461 22009 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.830961 22009 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:12.831588 21766 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:12.833815 22028 raft_consensus.cc:2749] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:12.774107 21918 raft_consensus.cc:2749] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:12.837538 14380 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:12.840299 14380 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:12.835841 22009 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:12.836185 13685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 1597) took 1442 ms. Trace:
I20260709 12:13:12.848516 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:12.843372 13685 rpcz_store.cc:276] 0709 12:13:11.393902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:11.394535 (+   633us) service_pool.cc:224] Handling call
0709 12:13:11.394857 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:11.451315 (+ 56458us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 12:13:11.839908 (+388593us) log.cc:844] Serialized 14 byte log entry
0709 12:13:11.956840 (+116932us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:11.956917 (+    77us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:13:11.956985 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:12.835948 (+878963us) spinlock_profiling.cc:243] Waited 56 ms on lock 0x7b540031e7d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:12.836001 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:12.836129 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72988,"prepare.queue_time_us":363969,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":33,"raft.queue_time_us":127818,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":15815,"spinlock_wait_cycles":128774016,"thread_start_us":437002,"threads_started":2,"wal-append.queue_time_us":75159}
I20260709 12:13:12.835899 22028 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.842805 21561 raft_consensus.cc:2749] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:12.790710 21935 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:12.863057 21675 raft_consensus.cc:2749] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:12.871271 14380 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:12.882671 21015 raft_consensus.cc:2804] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:13:12.883152 21015 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:12.883495 21015 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:12.893997 13837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 1588) took 1183 ms. Trace:
I20260709 12:13:12.894403 14380 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:12.894560 13837 rpcz_store.cc:276] 0709 12:13:11.710472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:11.848050 (+137578us) service_pool.cc:224] Handling call
0709 12:13:12.274018 (+425968us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:12.274697 (+   679us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:12.893707 (+619010us) spinlock_profiling.cc:243] Waited 426 ms on lock 0x7b54000afad0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:12.893914 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":978787072}
I20260709 12:13:12.898085 13829 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 20.
I20260709 12:13:12.896587 14380 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:12.899389 21824 consensus_queue.cc:1059] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 23.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.007s
I20260709 12:13:12.907855 21824 raft_consensus.cc:3055] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:12.908304 21824 raft_consensus.cc:740] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 23 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:12.876530 21829 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:12.910663 21736 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:12.911387 21736 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.911900 21736 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:12.912398 21829 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:12.902113 21742 consensus_meta.cc:287] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.519s	user 0.010s	sys 0.004s
I20260709 12:13:12.915884 22009 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:12.916549 22009 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:12.916989 21736 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:12.917940 13687 raft_consensus.cc:1240] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:12.918717 13687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 3694) took 1275 ms. Trace:
I20260709 12:13:12.918907 22009 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:12.919466 22009 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.919116 13687 rpcz_store.cc:276] 0709 12:13:11.643324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:11.706444 (+ 63120us) service_pool.cc:224] Handling call
0709 12:13:12.917308 (+1210864us) spinlock_profiling.cc:243] Waited 3.11 ms on lock 0x7b5800002798. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924e68b71 00007fa924e68eee 000000000036eb39 00007fa92cedc1e0 00007fa92cfa50c4 00007fa92cfa5131 00007fa92cf66fc0 00007fa92cf51929 00007fa92cf513d2 00007fa9264c8bd4
0709 12:13:12.917502 (+   194us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:12.918443 (+   941us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:12.918656 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7160960}
W20260709 12:13:12.920043 13683 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48212 (request call id 1596) took 1526 ms (client timeout 1839 ms). Trace:
W20260709 12:13:12.920552 13683 rpcz_store.cc:269] 0709 12:13:11.393597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:11.393736 (+   139us) service_pool.cc:224] Handling call
0709 12:13:12.919844 (+1526108us) spinlock_profiling.cc:243] Waited 840 ms on lock 0x7b540021e654. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:12.919977 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1930920320}
I20260709 12:13:12.927023 21736 consensus_queue.cc:1059] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 22.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:13:12.927819 21959 raft_consensus.cc:3055] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:13:12.928505 21959 raft_consensus.cc:740] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:12.929826 21824 consensus_queue.cc:260] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:12.930290 21959 consensus_queue.cc:260] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:12.931223 21824 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:12.931593 21959 raft_consensus.cc:3060] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:12.927919 21896 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:12.934099 21896 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:12.934677 13756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 1370) took 1499 ms. Trace:
I20260709 12:13:12.935111 13756 rpcz_store.cc:276] 0709 12:13:11.435692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:11.449524 (+ 13832us) service_pool.cc:224] Handling call
0709 12:13:11.469001 (+ 19477us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:12.396448 (+927447us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:12.934435 (+537987us) spinlock_profiling.cc:243] Waited 926 ms on lock 0x7b54000a0fd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:12.934607 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2130911616}
I20260709 12:13:12.936380 21896 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:12.936569 13680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 2551) took 1282 ms. Trace:
I20260709 12:13:12.937280 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:12.937984 13687 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:12.940017 21898 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:12.873715 21833 consensus_queue.cc:1059] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.032s
I20260709 12:13:12.941768 21896 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:12.942775 21833 raft_consensus.cc:3055] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:12.943241 21833 raft_consensus.cc:740] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 22 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:12.943612 21328 raft_consensus.cc:3055] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:12.944020 21328 raft_consensus.cc:740] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:12.944217 21833 consensus_queue.cc:260] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:12.945036 21328 consensus_queue.cc:260] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:12.942510 21896 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:12.940073 14415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41700 (request call id 1191) took 1033 ms. Trace:
I20260709 12:13:12.953640 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:12.963337 13685 raft_consensus.cc:3060] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:12.953989 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:12.965080 13684 raft_consensus.cc:2468] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 16.
I20260709 12:13:12.956976 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:12.967960 14408 raft_consensus.cc:1240] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 24. Current term is 25. Ops: [24.17-24.17]
I20260709 12:13:12.969952 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:12.954334 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:12.972568 13679 raft_consensus.cc:2468] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 19.
I20260709 12:13:12.962939 14415 rpcz_store.cc:276] 0709 12:13:11.906487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:11.906715 (+   228us) service_pool.cc:224] Handling call
0709 12:13:11.938797 (+ 32082us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:12.478860 (+540063us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:12.939823 (+460963us) spinlock_profiling.cc:243] Waited 538 ms on lock 0x7b54006b0154. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:12.940011 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1238450560}
I20260709 12:13:12.936991 13680 rpcz_store.cc:276] 0709 12:13:11.656982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:11.753383 (+ 96401us) service_pool.cc:224] Handling call
0709 12:13:11.822045 (+ 68662us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:12.371981 (+549936us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:12.936347 (+564366us) spinlock_profiling.cc:243] Waited 536 ms on lock 0x7b54002846d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:12.936507 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1231852288}
W20260709 12:13:12.975072 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 78564.5us
I20260709 12:13:12.976118 14380 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:12.976850 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:12.970634 13687 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 28.
I20260709 12:13:12.977981 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:12.978689 14412 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:12.979691 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:12.980520 14410 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:12.948302 21896 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:12.985102 21823 raft_consensus.cc:2749] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:12.945756 21833 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:12.997658 21992 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:12.949952 21935 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:12.903632 21986 raft_consensus.cc:2804] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:13:12.999121 21986 raft_consensus.cc:697] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 17 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:13.000154 21986 consensus_queue.cc:237] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:12.905922 21951 consensus_meta.cc:287] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.534s	user 0.010s	sys 0.004s
I20260709 12:13:13.005710 21758 raft_consensus.cc:3055] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:13:13.006431 21758 raft_consensus.cc:740] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:13.007397 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:13.007524 21758 consensus_queue.cc:260] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.16, Last appended by leader: 16, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:13.008791 21758 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:13.009812 21918 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:13.010289 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:13.010411 21918 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:13.013156 21956 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:12.959844 21558 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.873172 22028 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:12.946514 21328 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:12.920065 22009 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:12.948588 22015 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:13.014605 21711 raft_consensus.cc:2804] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:13.009620 13685 raft_consensus.cc:2468] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 20.
I20260709 12:13:12.987735 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 26 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:13.020669 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:12.990087 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:12.988184 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:12.987814 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:13.010423 13836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 1585) took 1365 ms. Trace:
I20260709 12:13:13.029399 14407 raft_consensus.cc:2468] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 19.
I20260709 12:13:13.029932 13836 rpcz_store.cc:276] 0709 12:13:11.644730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:11.806021 (+161291us) service_pool.cc:224] Handling call
0709 12:13:11.848398 (+ 42377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:11.849629 (+  1231us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:13.010186 (+1160557us) spinlock_profiling.cc:243] Waited 42 ms on lock 0x7b54000b22d0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:13.010354 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":96700800}
I20260709 12:13:13.029419 14413 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:13.029696 14416 raft_consensus.cc:2468] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 16.
I20260709 12:13:13.032600 21015 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:12.986331 14380 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:13.023571 13686 raft_consensus.cc:1240] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:13.025594 13683 raft_consensus.cc:1240] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:12.990501 21914 raft_consensus.cc:993] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f: : Instructing follower 96701a74fdee481fb5f54aac841e17dd to start an election
I20260709 12:13:13.015426 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:13:13.034776 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 48565.7us
I20260709 12:13:13.028030 13726 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:13:13.039191 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:12.988942 22005 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:13:13.046276 13763 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38932 (request call id 1372) took 1609 ms (client timeout 1839 ms). Trace:
I20260709 12:13:13.047003 13651 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:13.057878 13682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 2550) took 1404 ms. Trace:
I20260709 12:13:13.059741 13682 rpcz_store.cc:276] 0709 12:13:11.653619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:11.696086 (+ 42467us) service_pool.cc:224] Handling call
0709 12:13:13.041429 (+1345343us) spinlock_profiling.cc:243] Waited 575 ms on lock 0x7b54002c3b54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:13.057805 (+ 16376us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1323044096}
I20260709 12:13:13.060555 14411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41700 (request call id 1188) took 1219 ms. Trace:
W20260709 12:13:13.058997 13763 rpcz_store.cc:269] 0709 12:13:11.436458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:11.440218 (+  3760us) service_pool.cc:224] Handling call
0709 12:13:13.045979 (+1605761us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b540038bdd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:13.046181 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":261940096}
I20260709 12:13:13.046011 13800 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:13.061031 14411 rpcz_store.cc:276] 0709 12:13:11.841472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:11.841721 (+   249us) service_pool.cc:224] Handling call
0709 12:13:11.844368 (+  2647us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:12.351082 (+506714us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:13.060285 (+709203us) spinlock_profiling.cc:243] Waited 502 ms on lock 0x7b540068ced4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:13.060475 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1155278080}
W20260709 12:13:13.060590 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 312739us
I20260709 12:13:13.062449 13761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 3609) took 1546 ms. Trace:
I20260709 12:13:13.025465 21918 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:13.062646 21015 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 17 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:13.026057 21999 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:13.066382 13727 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:13.066035 13761 rpcz_store.cc:276] 0709 12:13:11.515915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:11.927323 (+411408us) service_pool.cc:224] Handling call
0709 12:13:11.927592 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:12.340172 (+412580us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:13.062146 (+721974us) spinlock_profiling.cc:243] Waited 359 ms on lock 0x7b54003c9954. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:13.062363 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":826237824}
I20260709 12:13:13.067837 21999 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:13.072089 21015 consensus_queue.cc:1048] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:13.068125 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:13.073796 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:13.081981 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:13.082231 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 29 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:13.083292 13835 raft_consensus.cc:2410] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 29 because replica has last-logged OpId of term: 27 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 26 index: 13.
I20260709 12:13:13.083271 13830 raft_consensus.cc:1240] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 23. Current term is 24. Ops: [23.18-23.18]
I20260709 12:13:13.082836 13828 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:13.086735 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:13.038614 21823 raft_consensus.cc:2804] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:13.087608 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:13.082821 13651 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:13.084323 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:13.092737 14410 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 17.
I20260709 12:13:13.093214 13831 raft_consensus.cc:2410] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 25 because replica has last-logged OpId of term: 23 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 13.
I20260709 12:13:12.993103 21893 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:13.059432 21914 raft_consensus.cc:1081] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 24 LEADER]: Signalling peer 96701a74fdee481fb5f54aac841e17dd to start an election
I20260709 12:13:13.092026 13830 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 22.
I20260709 12:13:13.024120 21558 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:13.025966 21871 consensus_queue.cc:1059] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.047s
I20260709 12:13:13.064568 21935 raft_consensus.cc:2804] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:13:13.111989 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:13.071295 21857 raft_consensus.cc:2804] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:13.064632 21711 raft_consensus.cc:697] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 24 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:13.105739 13828 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 28.
I20260709 12:13:13.106858 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:13.107769 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:13.120503 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:13.057749 21815 raft_consensus.cc:697] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:13.105736 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:13.090755 21894 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:13.117827 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:13.118034 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:13.121915 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:13.122834 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:13.124343 13727 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:13.089999 21591 raft_consensus.cc:2749] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:13:13.095419 21742 raft_consensus.cc:2804] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:13.130759 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:13.103328 22000 raft_consensus.cc:2749] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:13.137878 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:13:13.138396 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:13.127830 13829 raft_consensus.cc:2376] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 28. Re-sending same reply.
I20260709 12:13:13.036604 22015 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:13.065747 21123 consensus_queue.cc:1059] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.046s
I20260709 12:13:13.065541 21675 consensus_queue.cc:1048] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.047s
I20260709 12:13:13.153807 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:13.156343 13727 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:13.087828 21839 consensus_queue.cc:1048] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.047s
I20260709 12:13:13.111346 21823 raft_consensus.cc:697] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 24 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:13.119221 21857 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:13.075248 22005 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:13.168294 14415 raft_consensus.cc:1240] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 16. Current term is 17. Ops: []
I20260709 12:13:13.100473 22017 consensus_queue.cc:1059] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 26.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.059s
I20260709 12:13:13.138020 21924 consensus_queue.cc:1059] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.042s
I20260709 12:13:13.130466 21936 consensus_queue.cc:1059] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 23.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.050s
I20260709 12:13:13.101154 21918 consensus_queue.cc:1048] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 12:13:13.171391 13801 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:13.138499 21871 consensus_queue.cc:1243] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer b98d2519bb504dc6905ed2ede4571835 log is divergent from this leader: its last log entry 19.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 12:13:13.155628 21935 raft_consensus.cc:697] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:13:13.204510 21476 consensus_meta.cc:287] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.528s	user 0.010s	sys 0.002s
I20260709 12:13:13.218214 22017 raft_consensus.cc:3055] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:13.218739 22017 raft_consensus.cc:740] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:13.219688 22017 consensus_queue.cc:260] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:13.220959 22017 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:13.222790 21924 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:13.223547 21924 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:13.153638 21742 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:13.225579 21935 consensus_queue.cc:237] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.16, Last appended by leader: 16, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:13.227033 21823 consensus_queue.cc:237] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:13.179718 22036 raft_consensus.cc:2749] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 12:13:13.231112 22036 raft_consensus.cc:2749] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:13.232005 22036 raft_consensus.cc:3055] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:13.232479 22036 raft_consensus.cc:740] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:13.226045 21742 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:13.238265 22014 raft_consensus.cc:2749] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:13:13.238529 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 67265us
I20260709 12:13:13.239720 14412 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 21.
I20260709 12:13:13.241037 13836 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024"
dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:35422
I20260709 12:13:13.178423 21999 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:13.272826 13801 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:13.254046 21711 consensus_queue.cc:237] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:13.260979 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:13.179462 22026 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:13.290796 22026 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:13.167454 21857 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:13.265353 21893 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:13.176635 22033 log.cc:927] Time spent T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 12:13:13.272282 14411 raft_consensus.cc:1240] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:13.273618 13836 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:13.302551 13836 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:13.244850 13829 raft_consensus.cc:1275] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 12:13:13.261102 14413 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 22.
I20260709 12:13:13.276120 13801 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:13.154345 21894 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:13.296030 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:13.308557 14415 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 21.
I20260709 12:13:13.310717 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:13.319545 21992 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:13.321878 21558 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:13.322161 21857 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:13.324445 21742 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:13.326200 21857 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:13.325850 21591 consensus_queue.cc:1059] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:13:13.327131 22005 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:13.320807 21992 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:13.328004 21675 consensus_queue.cc:1048] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:13.329972 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:13.285209 22014 raft_consensus.cc:2749] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:13.180018 21815 consensus_queue.cc:237] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:13.221218 21757 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:13.333467 21982 raft_consensus.cc:2749] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:13.361842 13837 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 19.
I20260709 12:13:13.233537 22036 consensus_queue.cc:260] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:13.337752 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:13.371829 13828 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:13.362898 22012 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:13.362993 22009 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:13.392056 13828 raft_consensus.cc:2410] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 25 because replica has last-logged OpId of term: 23 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 13.
I20260709 12:13:13.386317 13836 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:13.398211 13836 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:13.399616 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: true dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:13.400579 14413 raft_consensus.cc:3055] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:13.400995 14413 raft_consensus.cc:740] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 24 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:13.402186 14413 consensus_queue.cc:260] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:13.463037 14413 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:13.393009 21922 raft_consensus.cc:3055] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:13.489010 22035 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:13.498833 22035 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:13.501318 22035 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:13.494822 21893 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:13.502717 21893 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:13.505216 21893 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:13.507146 21757 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:13.508647 21742 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:13.525923 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
W20260709 12:13:13.514153 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:13.529899 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:13.529357 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:13.552754 14407 raft_consensus.cc:1275] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 12:13:13.552402 14412 raft_consensus.cc:2368] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 19. Current term is 20.
I20260709 12:13:13.529590 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:13.486570 21922 raft_consensus.cc:740] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 21 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:13.495019 21932 raft_consensus.cc:3055] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:13.396795 22012 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:13.561750 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:13.592334 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:13.608389 14379 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.006s	sys 0.013s
W20260709 12:13:13.612967 14379 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.006s	sys 0.014s
I20260709 12:13:13.621515 14413 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 25.
W20260709 12:13:13.623828 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:13.619918 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 547733us
W20260709 12:13:13.608842 21930 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.007s	sys 0.012s
I20260709 12:13:13.560608 21932 raft_consensus.cc:740] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:13:13.630353 21930 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.007s	sys 0.012s
I20260709 12:13:13.647518 21015 consensus_queue.cc:1048] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:13:13.652727 21015 consensus_queue.cc:1048] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:13:13.640007 21894 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:13:13.651705 21758 consensus_meta.cc:287] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.642s	user 0.006s	sys 0.010s
W20260709 12:13:13.668669 13727 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.014s	sys 0.018s
W20260709 12:13:13.674099 13727 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.014s	sys 0.019s
I20260709 12:13:13.650255 21742 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:13.674772 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 518476us
I20260709 12:13:13.675769 13727 leader_election.cc:304] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:13.653199 21893 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:13.664515 21992 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:13.653388 22035 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:13.688877 22027 raft_consensus.cc:2749] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:13.683696 21935 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:13.693182 13727 leader_election.cc:400] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 election: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 19. Current term is 20.
I20260709 12:13:13.694245 14379 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:13.692878 13833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 3813) took 2137 ms. Trace:
I20260709 12:13:13.713022 14408 raft_consensus.cc:1240] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 17 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 16. Current term is 17. Ops: []
I20260709 12:13:13.714025 14379 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:13.712138 13727 leader_election.cc:403] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
W20260709 12:13:13.753383 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:13.801026 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 85967.6us
I20260709 12:13:13.802706 21476 raft_consensus.cc:3060] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:13:13.802872 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 111970us
I20260709 12:13:13.806504 13832 raft_consensus.cc:1240] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:13.800477 21986 raft_consensus.cc:2804] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:13:13.688927 21742 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:13.853029 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:13.854482 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:13.854843 21742 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:13.674357 21932 consensus_queue.cc:260] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:13.857313 21932 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:13.859969 21862 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:13.862733 13801 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:13.864774 13828 raft_consensus.cc:1240] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:13.865208 21941 raft_consensus.cc:3055] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:13.671475 21922 consensus_queue.cc:260] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:13.865660 21941 raft_consensus.cc:740] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:13.866447 21922 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:13.866765 21941 consensus_queue.cc:260] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:13.868438 22008 raft_consensus.cc:2804] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:13.869093 22008 raft_consensus.cc:697] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 25 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:13.700688 22035 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:13.870347 22008 consensus_queue.cc:237] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:13.872745 22035 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:13.695159 21940 consensus_queue.cc:1048] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.179s
W20260709 12:13:13.875968 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:13.802035 14379 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:13.810133 21986 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
W20260709 12:13:13.810354 22038 log.cc:927] Time spent T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.315s	user 0.000s	sys 0.001s
I20260709 12:13:13.810626 21561 raft_consensus.cc:2804] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:13:13.811487 22026 consensus_meta.cc:287] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.520s	user 0.012s	sys 0.000s
I20260709 12:13:13.693074 21871 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:13.713634 13833 rpcz_store.cc:276] 0709 12:13:11.555432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:11.555564 (+   132us) service_pool.cc:224] Handling call
0709 12:13:11.556019 (+   455us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:11.658941 (+102922us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:11.658979 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:11.659603 (+   624us) log.cc:844] Serialized 52 byte log entry
0709 12:13:11.866503 (+206900us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:13:11.940838 (+ 74335us) log.cc:844] Serialized 14 byte log entry
0709 12:13:12.920771 (+979933us) spinlock_profiling.cc:243] Waited 3.44 ms on lock 0x7b180007dfe0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924ea0522 00007fa924ea27c1 00007fa924ea2779 00007fa924ea2709 00007fa924ea26d1 00007fa924ea19cd 0000000000388634 0000000000388479 00007fa924e8383a
0709 12:13:13.024129 (+103358us) spinlock_profiling.cc:243] Waited 2.52 ms on lock 0x7b180007dfe0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa927b354bc 00007fa924e8348b 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9d455 00007fa927f85060 00007fa927f97716 00007fa927fa8287
0709 12:13:13.379013 (+354884us) log.cc:844] Serialized 14 byte log entry
0709 12:13:13.687268 (+308255us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:13.692111 (+  4843us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:13.692285 (+   174us) raft_consensus.cc:1685] finished
0709 12:13:13.692350 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:13.692751 (+   401us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":155031,"prepare.queue_time_us":148064,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":102,"raft.queue_time_us":194295,"raft.run_cpu_time_us":372,"raft.run_wall_time_us":42831,"spinlock_wait_cycles":13710592,"thread_start_us":936521,"threads_started":4,"wal-append.queue_time_us":393924,"wal-append.run_cpu_time_us":2907,"wal-append.run_wall_time_us":1054680}
I20260709 12:13:13.822008 21758 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:13.822839 22039 log.cc:927] Time spent T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
W20260709 12:13:13.825045 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:13.825618 21476 raft_consensus.cc:2749] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 19. Current term is 20.
W20260709 12:13:13.845150 21833 consensus_meta.cc:287] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.850s	user 0.010s	sys 0.003s
I20260709 12:13:13.851136 22012 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:13.885288 13835 raft_consensus.cc:1275] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 12:13:13.887552 14408 raft_consensus.cc:1275] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 12:13:13.888266 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:13.930359 13828 raft_consensus.cc:2410] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 25 because replica has last-logged OpId of term: 23 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 13.
I20260709 12:13:13.891320 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:13.930361 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:13.932405 13835 raft_consensus.cc:2393] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 23: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:13.908447 13833 raft_consensus.cc:1240] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:13.912804 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:13:13.916343 13652 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.56.196:46341 timed out after 1.533s (SENT) [suppressed 15 similar messages]
I20260709 12:13:13.913676 13727 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:13.922827 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:13.891486 21986 raft_consensus.cc:3060] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:13.921182 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:13:13.925495 21328 consensus_meta.cc:287] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.898s	user 0.011s	sys 0.003s
I20260709 12:13:13.807415 21990 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:13:13.912266 22053 log.cc:927] Time spent T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.066s	user 0.000s	sys 0.004s
I20260709 12:13:13.895056 21561 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:13.910130 21938 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:13.694471 21894 consensus_queue.cc:1059] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.227s
I20260709 12:13:13.894814 22019 consensus_queue.cc:1059] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.047s
I20260709 12:13:13.946504 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:13.925635 21862 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:13.962430 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:13.974360 14408 raft_consensus.cc:2393] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 22: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:13.941314 21328 raft_consensus.cc:2749] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 12:13:13.967286 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:13.696810 21893 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:13.912878 22035 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:13.710311 21935 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:13.942621 21561 raft_consensus.cc:3060] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:13.975458 13836 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 20.
I20260709 12:13:13.942346 21990 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:13.982002 13834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 3481) took 1354 ms. Trace:
I20260709 12:13:14.002367 13834 rpcz_store.cc:276] 0709 12:13:12.627672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:12.708753 (+ 81081us) service_pool.cc:224] Handling call
0709 12:13:12.764436 (+ 55683us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:12.765093 (+   657us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:12.765130 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:12.765624 (+   494us) log.cc:844] Serialized 26 byte log entry
0709 12:13:13.181257 (+415633us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:13:13.181302 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:13.181380 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:13.981426 (+800046us) raft_consensus.cc:1685] finished
0709 12:13:13.981455 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:13.981901 (+   446us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1854,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":3855,"thread_start_us":415291,"threads_started":1,"wal-append.queue_time_us":630570}
I20260709 12:13:13.923704 21758 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:13.968568 21992 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:13.941888 22051 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:13.914878 22026 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:13.914958 21871 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:13.975376 21823 raft_consensus.cc:2804] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:13:13.954284 21476 consensus_queue.cc:1048] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.039s
I20260709 12:13:13.970321 21938 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:14.026346 21938 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:13.984033 21742 consensus_queue.cc:1059] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.027s
I20260709 12:13:13.978161 21862 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:14.014170 22051 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:14.035382 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:13:14.051043 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 134736us
I20260709 12:13:14.000471 22035 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:14.022588 21926 raft_consensus.cc:3055] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:13:14.008909 21990 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:14.062973 21758 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:14.064138 21942 raft_consensus.cc:3055] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:14.064740 21942 raft_consensus.cc:740] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:14.065827 21942 consensus_queue.cc:260] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:14.067833 21942 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:14.071074 13688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 2552) took 1569 ms. Trace:
I20260709 12:13:14.031386 21938 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:14.076630 21894 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.081103 21894 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:14.085232 21894 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:14.086684 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:14.087563 22026 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 29 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:14.089243 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 29 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:14.128270 13831 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 21.
I20260709 12:13:14.128662 13834 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:14.091861 21935 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:13:14.092537 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:14.058092 21926 raft_consensus.cc:740] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:14.094610 21893 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:14.100911 22035 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:14.103219 22051 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:14.097322 21990 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:14.105044 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:14.161221 14416 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 21.
I20260709 12:13:14.106079 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:14.106951 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:14.164800 13829 raft_consensus.cc:2410] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 29 because replica has last-logged OpId of term: 27 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 26 index: 15.
I20260709 12:13:14.108144 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:14.166108 13832 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 21.
I20260709 12:13:14.109683 21938 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:14.110989 22036 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:14.071786 13688 rpcz_store.cc:276] 0709 12:13:12.502139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:12.505008 (+  2869us) service_pool.cc:224] Handling call
0709 12:13:12.550741 (+ 45733us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:12.551244 (+   503us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:12.551286 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:12.597853 (+ 46567us) log.cc:844] Serialized 26 byte log entry
0709 12:13:13.030532 (+432679us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:13:13.380435 (+349903us) log.cc:844] Serialized 14 byte log entry
0709 12:13:13.382512 (+  2077us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:13.382594 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:14.066666 (+684072us) spinlock_profiling.cc:243] Waited 4.54 ms on lock 0x7b1800402d60. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924ea03f3 00007fa924ea27c1 00007fa924ea2779 00007fa924ea2709 00007fa924ea26d1 00007fa924ea19cd 0000000000388634 0000000000388479 00007fa924e8383a
0709 12:13:14.070723 (+  4057us) raft_consensus.cc:1685] finished
0709 12:13:14.070848 (+   125us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:14.070998 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11407,"prepare.queue_time_us":109373,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":4385,"raft.queue_time_us":89760,"raft.run_cpu_time_us":340,"raft.run_wall_time_us":42493,"spinlock_wait_cycles":10441984,"thread_start_us":735465,"threads_started":2,"wal-append.queue_time_us":572324}
I20260709 12:13:14.118702 21862 leader_election.cc:290] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:14.032011 21823 raft_consensus.cc:697] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 20 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:14.124850 21986 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:14.125461 21561 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:14.136164 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:14.012063 21992 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:14.182972 21561 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199)
I20260709 12:13:14.184124 14415 raft_consensus.cc:2393] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 20: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:13:14.187469 21938 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:14.188970 21926 consensus_queue.cc:260] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:14.190831 21926 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:13:14.199975 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:14.176409 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:14.174223 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 114114us
I20260709 12:13:14.176270 13834 raft_consensus.cc:2410] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 29 because replica has last-logged OpId of term: 27 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 26 index: 13.
I20260709 12:13:14.202373 13652 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:13:14.202404 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:14.203936 13652 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:14.204447 13763 raft_consensus.cc:1240] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 LEADER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:14.199779 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:14.206444 13762 raft_consensus.cc:2468] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 19.
I20260709 12:13:14.207057 21823 consensus_queue.cc:237] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:14.210676 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:14.211967 21992 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:14.180613 21990 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:14.215698 21990 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:14.206445 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:14.219027 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:14.222398 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:14.207841 22009 raft_consensus.cc:2804] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:14.228485 13831 raft_consensus.cc:1275] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 12:13:14.228793 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:14.214602 22012 raft_consensus.cc:2804] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:14.229714 13762 raft_consensus.cc:2393] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 22: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:14.231606 13754 raft_consensus.cc:1275] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 13. (term mismatch)
I20260709 12:13:14.233067 13754 pending_rounds.cc:85] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting all ops after (but not including) 12
I20260709 12:13:14.233454 13754 pending_rounds.cc:107] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting uncommitted NO_OP operation due to leader change: 22.13
I20260709 12:13:14.233836 13754 raft_consensus.cc:2889] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:14.233609 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:13:14.232476 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 430497us
I20260709 12:13:14.235450 14411 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 23.
I20260709 12:13:14.242225 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:14.243207 13763 raft_consensus.cc:2393] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 24: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:14.242971 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:14.243850 13834 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 21.
I20260709 12:13:14.244192 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:14.245869 13836 raft_consensus.cc:1275] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 26 index: 16. Preceding OpId from leader: term: 28 index: 17. (index mismatch)
I20260709 12:13:14.247761 13759 raft_consensus.cc:1275] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 12:13:14.227813 22009 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:14.230048 21935 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.251163 13832 raft_consensus.cc:1275] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:13:14.232733 22012 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:14.237552 22034 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.238308 21893 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:14.266450 13758 raft_consensus.cc:2468] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 20.
I20260709 12:13:14.267071 13682 pending_rounds.cc:85] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 15
I20260709 12:13:14.275139 13682 pending_rounds.cc:107] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 21.16
I20260709 12:13:14.275488 13682 raft_consensus.cc:2889] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:14.277323 21986 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 17 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:14.267891 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:14.278391 13759 raft_consensus.cc:2393] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 25: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:14.270581 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:14.279515 13688 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:14.273085 13686 raft_consensus.cc:1275] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 14. (term mismatch)
I20260709 12:13:14.282601 13686 pending_rounds.cc:85] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 13
I20260709 12:13:14.282951 13686 pending_rounds.cc:107] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 16.14
I20260709 12:13:14.283325 13686 raft_consensus.cc:2889] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:14.282758 21893 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:14.287475 21893 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:14.290910 21990 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:14.292011 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:14.292953 13763 raft_consensus.cc:2393] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 22: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
W20260709 12:13:14.293887 14379 connection.cc:256] RPC call timeout handler was delayed by -1.2011622239999724s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1839s for a response
I20260709 12:13:14.288761 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:14.290161 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:14.293826 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:14.287842 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:14.296375 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:14.297094 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:14.296382 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:14.304126 13832 raft_consensus.cc:2393] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 23: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:14.256976 22009 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:14.307125 13756 raft_consensus.cc:2393] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 22: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:14.307303 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:14.310457 13686 raft_consensus.cc:3060] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:14.295529 14411 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 23.
I20260709 12:13:14.304811 14414 raft_consensus.cc:2393] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 25: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:14.311915 14407 raft_consensus.cc:1275] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:13:14.315434 13727 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:14.271935 22012 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:14.268564 22015 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:14.324738 22074 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:14.323877 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 124718us
I20260709 12:13:14.326798 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:14.327535 13759 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 25.
I20260709 12:13:14.325889 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:14.328610 13763 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 24.
I20260709 12:13:14.329926 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:14.330636 13680 raft_consensus.cc:3060] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:14.332930 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:14.333326 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 29 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:14.333701 13759 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 28.
I20260709 12:13:14.305449 21956 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:14.336438 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:14.337333 13762 raft_consensus.cc:2393] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 29: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:14.337482 13759 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 27.
I20260709 12:13:14.339268 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:14.339941 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:14.268280 21935 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:14.341903 13832 raft_consensus.cc:1240] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:14.344390 13763 raft_consensus.cc:1240] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:14.347090 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:14.347822 13836 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 21.
I20260709 12:13:14.321376 21893 raft_consensus.cc:2804] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:14.348840 13759 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 22.
I20260709 12:13:14.294768 22034 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:14.306066 21986 consensus_queue.cc:1048] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.035s
I20260709 12:13:14.350940 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:14.353682 13762 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:14.334858 22015 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.360570 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:14.358160 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:14.361481 13763 raft_consensus.cc:2393] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 27: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:14.361610 13754 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 25.
I20260709 12:13:14.362923 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:14.363821 13760 raft_consensus.cc:2393] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 29: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:14.366115 21935 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:14.370244 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:14.357380 13756 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 22.
I20260709 12:13:14.345986 21926 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.360556 13688 raft_consensus.cc:2468] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 17.
I20260709 12:13:14.349519 21956 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:14.392345 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:14.393064 13755 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 20.
I20260709 12:13:14.385903 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:14.393954 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:14.395138 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:14.396494 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:14.397372 13832 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 23.
I20260709 12:13:14.349710 21893 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:14.398914 21893 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:14.385906 14379 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:14.403353 22070 raft_consensus.cc:2804] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:13:14.403510 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:14.404124 22070 raft_consensus.cc:697] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 17 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:14.382905 22015 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:14.407310 21924 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:14.408232 22015 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:14.408150 14379 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:14.391571 22034 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:14.395252 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:14.339035 22074 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:14.409907 13754 raft_consensus.cc:2468] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 19.
I20260709 12:13:14.415069 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:14.414812 21833 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:14.426723 13836 raft_consensus.cc:1240] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 23. Current term is 24. Ops: [23.18-23.18]
I20260709 12:13:14.428671 13680 raft_consensus.cc:2468] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 17.
I20260709 12:13:14.428866 13686 raft_consensus.cc:2468] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 20.
I20260709 12:13:14.430141 14379 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:14.430398 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:14.431198 13754 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 20.
I20260709 12:13:14.432274 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:14.434274 13762 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 22.
I20260709 12:13:14.433683 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:14.435212 13761 raft_consensus.cc:2410] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 22 because replica has last-logged OpId of term: 21 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 14.
I20260709 12:13:14.435523 13762 raft_consensus.cc:1240] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 25. Current term is 26. Ops: [25.16-25.16]
W20260709 12:13:14.451280 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:14.447589 21986 raft_consensus.cc:2804] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:13:14.435868 14379 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:14.390143 21926 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:14.437184 21990 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.482152 13727 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:14.475275 13800 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:14.466326 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:14.464597 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:14.490154 14413 raft_consensus.cc:2376] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 21. Re-sending same reply.
I20260709 12:13:14.490345 13727 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:14.490567 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 26 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:14.491321 13754 raft_consensus.cc:1275] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 12:13:14.493076 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:14.462374 21986 raft_consensus.cc:697] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 17 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:14.473945 13652 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:14.474643 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:14.495412 13762 raft_consensus.cc:3060] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:14.540055 14413 raft_consensus.cc:1275] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 12:13:14.489583 14414 raft_consensus.cc:2376] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 17. Re-sending same reply.
I20260709 12:13:14.488960 13800 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:14.498059 13727 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:14.405462 22070 consensus_queue.cc:237] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:14.503206 13763 raft_consensus.cc:1275] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:13:14.462267 21956 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:14.527375 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:13:14.543077 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 45122.7us
I20260709 12:13:14.533480 13801 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:14.539970 13834 raft_consensus.cc:1275] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:13:14.544471 13727 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:14.506788 14379 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:14.505903 21935 raft_consensus.cc:2749] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:13:14.512254 22083 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:14.541500 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 52620.5us
I20260709 12:13:14.547032 22008 raft_consensus.cc:2804] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:14.489200 22036 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.486502 21823 raft_consensus.cc:2804] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:13:14.554239 21757 raft_consensus.cc:2804] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:14.486219 21992 consensus_queue.cc:1048] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.069s
I20260709 12:13:14.555016 21824 raft_consensus.cc:2749] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:14.557298 22083 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:14.558219 21956 raft_consensus.cc:2749] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:13:14.560484 21941 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:14.463264 22051 consensus_queue.cc:1048] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.061s
I20260709 12:13:14.549918 13800 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:14.563413 13755 raft_consensus.cc:1240] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 24. Current term is 25. Ops: [24.17-24.17]
W20260709 12:13:14.547544 22077 log.cc:927] Time spent T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
W20260709 12:13:14.565001 22071 log.cc:927] Time spent T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:13:14.523077 22005 raft_consensus.cc:3055] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 16 LEADER]: Stepping down as leader of term 16
W20260709 12:13:14.572414 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 45481.8us
I20260709 12:13:14.498311 22034 raft_consensus.cc:2804] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:14.501123 21365 raft_consensus.cc:2804] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:14.506038 21924 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.600636 21757 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:14.605587 13762 raft_consensus.cc:2468] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 20.
I20260709 12:13:14.561967 22074 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:14.627790 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:14.628572 13762 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 24.
I20260709 12:13:14.612236 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:14.630329 13755 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 22.
I20260709 12:13:14.631567 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:14.632342 13755 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 23.
W20260709 12:13:14.614627 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 64829.9us
I20260709 12:13:14.562405 22008 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:14.620651 13727 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:14.602048 21558 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:14.619313 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 56363.8us
I20260709 12:13:14.634001 13800 leader_election.cc:304] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:14.623690 22034 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:14.607398 21922 consensus_queue.cc:1048] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 15, Time since last communication: 0.037s
I20260709 12:13:14.498584 21990 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:14.621206 22005 raft_consensus.cc:740] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:14.678503 22005 consensus_queue.cc:260] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:14.680171 22005 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:14.565093 22075 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.619156 21940 raft_consensus.cc:2749] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:14.600335 22036 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:14.623430 21365 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:14.726974 21365 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:14.703668 22051 consensus_queue.cc:1059] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 26.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.030s
I20260709 12:13:14.731341 22051 raft_consensus.cc:3055] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:14.731861 22051 raft_consensus.cc:740] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:14.622974 21742 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:14.734452 21742 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:14.736945 22076 log.cc:927] Time spent T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.393s	user 0.002s	sys 0.000s
I20260709 12:13:14.636495 21757 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:14.625466 21932 consensus_queue.cc:1048] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.036s
I20260709 12:13:14.661528 21862 raft_consensus.cc:2804] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:14.739552 21862 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:14.740000 21862 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:14.740614 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:14.650173 22008 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:14.742254 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:14.742903 13760 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 19.
I20260709 12:13:14.743813 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:14.744453 21871 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:14.654871 21918 raft_consensus.cc:2804] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:14.675781 22083 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:14.676980 21990 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:14.679957 22012 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:14.653228 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:14.629699 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:13:14.686705 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:14.687394 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:14.684712 13800 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:14.648958 22074 raft_consensus.cc:2804] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:14.639725 21924 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:14.720788 22036 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:14.704082 22075 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:14.746104 13757 raft_consensus.cc:1240] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 22. Current term is 23. Ops: []
W20260709 12:13:14.746851 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:14.627629 21824 consensus_queue.cc:1048] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 15, Time since last communication: 0.054s
I20260709 12:13:14.657969 21935 raft_consensus.cc:2804] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:14.659981 22034 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:14.703617 22015 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:14.737392 21742 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:14.648365 21561 consensus_queue.cc:1048] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.054s
W20260709 12:13:14.756273 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 71659us
I20260709 12:13:14.657311 21558 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:14.757575 22077 log.cc:927] Time spent T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
W20260709 12:13:14.714540 22062 log.cc:927] Time spent T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:13:14.744493 13760 raft_consensus.cc:2393] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 25: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:14.749022 21918 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:14.752715 22063 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:14.768567 21824 consensus_queue.cc:1243] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer 3f37c9cc9dda46b4be21dd675ba78fb7 log is divergent from this leader: its last log entry 21.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 12:13:14.733044 22051 consensus_queue.cc:260] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 17, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:14.782683 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:14.829912 13832 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 23.
I20260709 12:13:14.771387 21957 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.755343 22074 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:14.874068 22074 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:14.770426 22009 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:14.877907 22009 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:14.878634 22009 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.879045 21924 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:14.879165 22009 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:14.880286 21924 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.881016 21924 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:14.883718 21924 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:14.652942 21986 consensus_queue.cc:237] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:14.762430 21990 raft_consensus.cc:2804] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:14.757318 21926 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:14.759294 22028 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:14.793478 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 260128us
W20260709 12:13:14.825451 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:14.767679 21935 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:14.767307 22083 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.784446 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:14.829183 21871 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.843289 22012 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:14.843462 21452 raft_consensus.cc:3055] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 LEADER]: Stepping down as leader of term 23
W20260709 12:13:14.845216 22086 log.cc:927] Time spent T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:13:14.847244 13762 raft_consensus.cc:1240] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:14.778108 22015 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:14.859246 22075 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:14.863755 21893 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:14.847290 21558 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:14.866436 14409 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41692 (request call id 1230) took 1759 ms (client timeout 1746 ms). Trace:
I20260709 12:13:14.907766 21990 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:14.867426 22008 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:14.870610 14416 raft_consensus.cc:1240] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 24 LEADER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 23. Current term is 24. Ops: [23.18-23.18]
W20260709 12:13:14.937757 14409 rpcz_store.cc:269] 0709 12:13:13.106574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:13.106795 (+   221us) service_pool.cc:224] Handling call
0709 12:13:14.866144 (+1759349us) spinlock_profiling.cc:243] Waited 792 ms on lock 0x7b540068ced4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:14.866332 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1820920064}
I20260709 12:13:14.872138 21758 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:13:14.893647 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:14.904475 21924 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.906415 13829 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 23.
I20260709 12:13:14.790071 21918 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:14.828219 21833 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:14.910382 21935 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:14.895629 21957 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:14.948638 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 325410us
I20260709 12:13:14.832633 22063 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:14.914775 21452 raft_consensus.cc:740] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:14.919252 22088 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:14.966953 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 493061us
W20260709 12:13:14.949612 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 329026us
W20260709 12:13:14.968564 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 317196us
I20260709 12:13:14.975430 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:14.976254 14408 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 17.
I20260709 12:13:14.913530 22083 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:14.914906 21871 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:14.942309 22090 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.943388 21990 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:14.975698 13727 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:14.979627 13652 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:13:14.980240 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:14.992268 13727 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:14.970995 21926 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.967167 21758 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:14.998025 22012 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.016973 22012 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:15.018383 21758 leader_election.cc:290] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:15.020419 22012 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:14.998916 22015 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:15.010951 13651 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:15.000535 22008 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:15.001195 21926 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:15.024792 21957 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:15.025971 21926 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:14.978914 22088 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:15.026746 22097 raft_consensus.cc:2804] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:15.027323 22063 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:15.027482 22097 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:15.028190 22097 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:15.013002 21757 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:15.004595 14415 raft_consensus.cc:1240] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 17 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 16. Current term is 17. Ops: []
I20260709 12:13:15.030990 21757 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:15.006654 22074 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:15.033402 22074 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:15.008147 21365 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:15.036352 21365 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:15.028427 22088 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:15.039124 13651 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:14.985153 13652 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:13:15.041049 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 55984.3us
I20260709 12:13:14.999403 22083 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:14.980312 21558 consensus_queue.cc:1059] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.033s
I20260709 12:13:14.986827 22009 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:15.015930 21893 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:14.987195 22075 raft_consensus.cc:2749] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:15.008600 21871 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:14.994299 22047 raft_consensus.cc:2804] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:14.982247 21862 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:15.005398 22034 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:15.044955 22088 raft_consensus.cc:2764] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 12:13:14.967204 21924 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:15.069337 13682 raft_consensus.cc:1275] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 12:13:15.022332 21452 consensus_queue.cc:260] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.18, Last appended by leader: 18, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:15.046557 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 54510.6us
I20260709 12:13:15.074733 13727 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:15.044026 13652 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:15.044093 13651 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:14.977638 21823 raft_consensus.cc:697] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 20 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:15.078110 21558 consensus_queue.cc:1048] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:13:15.078768 21823 consensus_queue.cc:237] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:15.080364 13651 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:15.081342 21957 raft_consensus.cc:2804] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:15.081792 21957 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:15.050007 22083 raft_consensus.cc:3055] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:15.082334 22088 raft_consensus.cc:2749] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:13:15.082629 22075 raft_consensus.cc:2749] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:15.049899 22047 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:15.083377 22028 raft_consensus.cc:2804] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:15.083461 22047 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:15.083896 22028 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:15.084360 22028 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:15.084398 13727 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:15.045957 22074 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:14.989512 22090 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:15.090185 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:15.090338 21893 consensus_queue.cc:1048] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:13:15.090934 13836 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 19.
I20260709 12:13:15.091672 22090 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:15.092658 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
W20260709 12:13:15.093436 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:15.093286 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:15.096338 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:15.092247 13652 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:15.099800 22015 raft_consensus.cc:2749] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:13:15.089675 13829 raft_consensus.cc:1240] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:15.101292 13652 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:15.049341 22035 raft_consensus.cc:2804] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:15.102161 21941 consensus_queue.cc:1059] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:13:15.103169 21941 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.102387 22035 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:15.082234 13651 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:15.108983 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:15.111212 13835 raft_consensus.cc:2368] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 23. Current term is 24.
I20260709 12:13:15.114568 13651 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:15.115556 14408 raft_consensus.cc:1275] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:13:15.103670 21941 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:15.082199 21957 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:15.119969 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:15.120431 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:15.121969 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:15.126979 13762 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 23.
I20260709 12:13:15.122444 14414 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 23.
I20260709 12:13:15.122786 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:15.123776 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:15.092267 21893 raft_consensus.cc:2804] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:15.129160 13837 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 22.
I20260709 12:13:15.082391 22083 raft_consensus.cc:740] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:15.096378 21862 leader_election.cc:290] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:15.113987 22035 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:15.110811 22036 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.113098 22015 raft_consensus.cc:2804] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:15.138406 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:15.151247 13755 raft_consensus.cc:2410] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 22 because replica has last-logged OpId of term: 21 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 14.
I20260709 12:13:15.140002 13762 raft_consensus.cc:1217] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Deduplicated request from leader. Original: 17.15->[18.16-22.18]   Dedup: 18.16->[20.17-22.18]
I20260709 12:13:15.152382 13762 raft_consensus.cc:1240] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 22. Current term is 23. Ops: [18.16-22.18]
I20260709 12:13:15.120369 22075 raft_consensus.cc:2749] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:15.143748 13759 raft_consensus.cc:1275] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 12:13:15.129719 21452 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:15.139887 13727 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:15.145424 13651 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:15.161378 13727 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:15.156179 22009 raft_consensus.cc:2749] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:15.155829 22036 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:15.129238 21924 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:15.154261 21956 consensus_queue.cc:1048] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.026s
I20260709 12:13:15.132256 21893 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:15.161727 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:15.183753 13652 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:15.183928 13835 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 22.
I20260709 12:13:15.169451 13754 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 24.
I20260709 12:13:15.170534 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:15.188303 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:15.188892 14413 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:15.188987 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:15.191782 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:15.182771 13651 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:15.198827 13801 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:15.196175 21932 raft_consensus.cc:2804] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:15.167744 22097 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:15.204183 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:15.204507 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:15.207304 13727 leader_election.cc:400] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 election: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 23. Current term is 24.
I20260709 12:13:15.206710 13651 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:15.212934 14413 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 24.
I20260709 12:13:15.182989 22075 raft_consensus.cc:2749] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:15.182912 22098 raft_consensus.cc:2804] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:15.181679 21893 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:15.211388 13727 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:15.182778 22015 raft_consensus.cc:697] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 21 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:15.176569 22034 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:15.204066 21932 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:15.223153 13727 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:15.194509 21862 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:15.179411 21941 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:15.201406 22012 raft_consensus.cc:2804] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:15.245982 22015 consensus_queue.cc:237] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:15.246969 22012 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:15.247730 22012 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:15.233999 21328 raft_consensus.cc:2804] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:15.250128 21328 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:15.250672 21328 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:15.210922 21758 raft_consensus.cc:2804] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:15.241920 21932 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:15.193809 22009 consensus_queue.cc:1048] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 12:13:15.244577 22047 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:15.246150 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:15.254377 13757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 2732) took 1024 ms. Trace:
I20260709 12:13:15.261715 13757 rpcz_store.cc:276] 0709 12:13:14.230341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:14.230448 (+   107us) service_pool.cc:224] Handling call
0709 12:13:14.230737 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:14.764691 (+533954us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:15.254069 (+489378us) spinlock_profiling.cc:243] Waited 515 ms on lock 0x7b54000898d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:15.254300 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1184768768}
I20260709 12:13:15.242364 21862 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:15.265151 21328 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:15.225399 22102 raft_consensus.cc:2749] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:13:15.228535 22074 raft_consensus.cc:2749] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:15.232918 21940 raft_consensus.cc:2804] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:15.222714 21926 raft_consensus.cc:2804] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:13:15.205322 21871 consensus_queue.cc:1048] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.053s
I20260709 12:13:15.219825 21956 consensus_queue.cc:1059] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 12:13:15.295516 13756 raft_consensus.cc:2410] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 24 because replica has last-logged OpId of term: 23 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 17.
I20260709 12:13:15.178018 22083 consensus_queue.cc:260] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:15.255888 22098 raft_consensus.cc:697] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:15.241361 21918 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:15.325505 21328 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:15.345728 21935 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:15.288424 22068 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:15.361104 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 147481us
I20260709 12:13:15.310261 21940 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:15.321429 21926 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:15.363080 13651 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:13:15.369172 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 158983us
I20260709 12:13:15.370186 13651 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:15.371176 13801 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:15.374446 13651 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:15.376701 13651 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:15.379451 13651 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:15.374984 22074 raft_consensus.cc:2804] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:15.370283 21940 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:15.360733 21935 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:15.386726 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:15.359210 22075 consensus_queue.cc:1059] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 17, Time since last communication: 0.031s
I20260709 12:13:15.368553 22063 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:15.372319 21926 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:15.375595 22102 raft_consensus.cc:2749] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:15.368945 21758 raft_consensus.cc:697] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 22 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:15.381222 22015 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:15.367656 22068 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:15.391192 22074 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:15.412853 22121 raft_consensus.cc:2749] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:15.417321 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:15.430747 13757 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:15.430580 22098 consensus_queue.cc:237] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:15.432585 22051 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:15.434007 22088 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:15.418112 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:15.434696 22088 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:15.434971 13759 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 25.
I20260709 12:13:15.436684 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:15.436988 22088 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:15.437863 22097 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:15.439460 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:15.418393 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:13:15.450706 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 79659.1us
I20260709 12:13:15.451870 13758 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:15.390753 22036 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:15.450740 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:13:15.460150 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 79573.4us
I20260709 12:13:15.468746 13758 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 28.
W20260709 12:13:15.420900 22108 log.cc:927] Time spent T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:13:15.472884 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:15.482288 13828 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Advancing to term 24
I20260709 12:13:15.473476 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:15.485203 13682 raft_consensus.cc:2368] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 22. Current term is 23.
I20260709 12:13:15.486033 13687 raft_consensus.cc:1240] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 16. Current term is 17. Ops: []
I20260709 12:13:15.487883 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:15.427254 21918 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:15.490206 13687 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 22.
I20260709 12:13:15.473670 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:15.474308 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:15.474423 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:15.474792 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:13:15.475075 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 210114us
I20260709 12:13:15.492980 13833 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:15.494444 13682 raft_consensus.cc:1240] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 16. Current term is 17. Ops: []
I20260709 12:13:15.494836 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: true dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:15.475292 13836 raft_consensus.cc:1275] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:13:15.494499 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:15.475835 13680 raft_consensus.cc:1240] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 27. Current term is 29. Ops: [27.14-27.14]
I20260709 12:13:15.496034 13685 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 18.
I20260709 12:13:15.474241 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:15.412519 22075 consensus_queue.cc:1243] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Peer 3f37c9cc9dda46b4be21dd675ba78fb7 log is divergent from this leader: its last log entry 25.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 17
I20260709 12:13:15.425509 22074 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:15.495608 13684 raft_consensus.cc:2393] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 25: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:15.475937 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:15.497351 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:15.497542 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:15.498274 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:15.459282 22005 raft_consensus.cc:2804] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:15.513207 13727 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:15.514701 13679 raft_consensus.cc:1275] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:13:15.425745 22116 raft_consensus.cc:2749] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:13:15.519964 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:15.521111 13679 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 28.
I20260709 12:13:15.522380 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:15.481467 13800 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
W20260709 12:13:15.525005 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 43615.4us
I20260709 12:13:15.491492 13763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 3631) took 1098 ms. Trace:
I20260709 12:13:15.514422 13832 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 22.
I20260709 12:13:15.525740 13763 rpcz_store.cc:276] 0709 12:13:14.393409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:14.396443 (+  3034us) service_pool.cc:224] Handling call
0709 12:13:14.502723 (+106280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:14.541974 (+ 39251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:15.491296 (+949322us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b54000884d0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:15.491434 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":243451648}
I20260709 12:13:15.526702 13832 raft_consensus.cc:3055] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:13:15.527010 13727 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:15.517997 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 29 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:15.512683 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:15.528041 13685 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 29.
I20260709 12:13:15.424779 21957 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:15.532254 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:15.533375 13836 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 24.
I20260709 12:13:15.527191 13832 raft_consensus.cc:740] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:15.534600 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:15.461566 22090 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:15.440989 22063 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:15.528931 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:15.479398 21365 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:15.529229 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:15.525730 13800 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:15.530405 13687 raft_consensus.cc:1275] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 26 index: 16. (term mismatch)
I20260709 12:13:15.551429 13687 pending_rounds.cc:85] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 15
I20260709 12:13:15.530992 13688 raft_consensus.cc:2393] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 25: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:15.483242 21871 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:15.543135 13833 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 21.
W20260709 12:13:15.560066 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:15.547088 21941 raft_consensus.cc:2804] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:15.563848 21941 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:15.564436 21941 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:15.561376 21365 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:15.546826 13684 raft_consensus.cc:2393] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 23: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:15.514966 13680 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 24.
I20260709 12:13:15.477859 22097 consensus_queue.cc:1059] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.057s
I20260709 12:13:15.534698 13832 consensus_queue.cc:260] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:15.552011 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:15.487666 22106 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.528410 21452 raft_consensus.cc:2749] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:13:15.560599 13687 pending_rounds.cc:107] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 25.16
I20260709 12:13:15.575376 13687 raft_consensus.cc:2889] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:15.561367 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:15.535377 13679 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 25.
I20260709 12:13:15.579618 13833 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 21.
I20260709 12:13:15.580164 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:15.529548 21956 consensus_queue.cc:1048] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.045s
I20260709 12:13:15.547686 13828 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 24.
I20260709 12:13:15.589541 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:15.566973 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:15.591584 13680 raft_consensus.cc:2393] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 20: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:13:15.564330 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:15.569936 13682 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 22.
I20260709 12:13:15.570755 13685 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:15.570765 13832 raft_consensus.cc:3060] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:13:15.533038 22005 raft_consensus.cc:697] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 24 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:15.544277 22115 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.563292 22008 raft_consensus.cc:2749] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:15.583981 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:15.585160 21328 raft_consensus.cc:3055] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:15.596464 21328 raft_consensus.cc:740] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:15.597256 21328 consensus_queue.cc:260] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:15.566847 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:15.598312 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:15.599287 13684 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 30.
I20260709 12:13:15.600101 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:15.600315 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:15.600840 13682 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 26.
I20260709 12:13:15.601173 13684 raft_consensus.cc:2393] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 23: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:15.598583 21328 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:15.594964 22089 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.603325 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:15.603408 13757 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 25.
I20260709 12:13:15.561499 21862 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:15.609602 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:15.604398 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:15.549098 21932 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:15.614786 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:15.550199 22090 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:15.608250 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:15.566253 21871 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:15.618523 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:13:15.624352 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 86997.2us
I20260709 12:13:15.602233 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:15.602949 22089 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:15.630841 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:15.568377 22047 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:15.662859 22089 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:13:15.664011 22028 consensus_meta.cc:287] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.579s	user 0.006s	sys 0.008s
I20260709 12:13:15.663763 22005 consensus_queue.cc:237] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:15.664608 22028 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:15.666503 21957 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:13:15.667749 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:15.668370 21990 consensus_meta.cc:287] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.674s	user 0.011s	sys 0.000s
I20260709 12:13:15.669003 21990 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:15.611802 22115 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:15.671830 22115 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:15.673997 22035 consensus_meta.cc:287] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.518s	user 0.008s	sys 0.004s
I20260709 12:13:15.674516 22035 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:15.595782 21918 raft_consensus.cc:2764] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election decision vote started in defunct term 22: won
I20260709 12:13:15.621117 13685 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 28.
I20260709 12:13:15.544764 21758 consensus_queue.cc:237] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:15.637101 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:15.686116 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:15.686848 13680 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 22.
I20260709 12:13:15.687312 13687 raft_consensus.cc:1275] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
W20260709 12:13:15.687693 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:15.615042 22112 log.cc:927] Time spent T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.239s	user 0.001s	sys 0.000s
I20260709 12:13:15.637696 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:15.638621 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:15.690771 13833 raft_consensus.cc:2393] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 21: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:15.602085 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:15.685993 22012 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:15.640676 13684 raft_consensus.cc:2393] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 21: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:15.693738 13686 raft_consensus.cc:2368] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 24. Current term is 25.
I20260709 12:13:15.695823 22012 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:15.696477 21871 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:15.622253 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:15.697288 13757 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Advancing to term 29
W20260709 12:13:15.650501 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:15.622509 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:13:15.652213 22120 log.cc:927] Time spent T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
W20260709 12:13:15.653017 22118 log.cc:927] Time spent T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 12:13:15.655268 21365 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:13:15.660920 22111 log.cc:927] Time spent T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.288s	user 0.001s	sys 0.000s
I20260709 12:13:15.581295 22106 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:15.615624 13679 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 24.
W20260709 12:13:15.660974 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:15.721964 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:15.629433 13828 raft_consensus.cc:2393] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 25: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
W20260709 12:13:15.646401 22117 log.cc:927] Time spent T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.255s	user 0.003s	sys 0.000s
I20260709 12:13:15.726261 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:15.726922 13828 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 24.
I20260709 12:13:15.723273 13727 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:15.685122 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 29 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:15.699528 13684 raft_consensus.cc:1275] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 23 index: 18. Preceding OpId from leader: term: 24 index: 18. (term mismatch)
I20260709 12:13:15.730465 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:15.730868 13684 pending_rounds.cc:85] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 17
I20260709 12:13:15.730931 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:15.731346 13684 pending_rounds.cc:107] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 23.18
I20260709 12:13:15.731721 13684 raft_consensus.cc:2889] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:15.733234 13684 raft_consensus.cc:1240] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:15.733611 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:15.734635 22063 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:15.734987 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:15.736179 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:15.736718 21932 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:15.736892 13830 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 22.
W20260709 12:13:15.739230 22123 log.cc:927] Time spent T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 12:13:15.739936 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:15.740603 13830 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Advancing to term 23
I20260709 12:13:15.740792 22088 raft_consensus.cc:3055] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:15.741207 22088 raft_consensus.cc:740] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:15.742144 22088 consensus_queue.cc:260] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:15.744112 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:15.744513 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:15.745373 13833 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Advancing to term 23
I20260709 12:13:15.735985 21956 raft_consensus.cc:2804] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:15.712466 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:15.713704 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:15.714143 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:15.715262 21823 consensus_queue.cc:1048] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:13:15.716478 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:15.677675 22035 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:15.728873 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:15.727841 13727 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:15.731401 13828 raft_consensus.cc:2410] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for term 22 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
I20260709 12:13:15.739295 13682 raft_consensus.cc:1240] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:15.677621 22015 raft_consensus.cc:2749] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:15.649631 13832 raft_consensus.cc:1275] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:13:15.761266 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:15.748385 13684 raft_consensus.cc:1275] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 26 index: 16. Preceding OpId from leader: term: 28 index: 17. (index mismatch)
I20260709 12:13:15.762264 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:15.758827 14409 raft_consensus.cc:2376] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 22. Re-sending same reply.
I20260709 12:13:15.762274 13832 raft_consensus.cc:2393] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 29: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:15.764362 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:15.750464 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:15.754637 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:15.766765 13652 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:15.719851 13756 raft_consensus.cc:1275] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 12:13:15.756124 14415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41692 (request call id 1235) took 1230 ms. Trace:
I20260709 12:13:15.767782 14415 rpcz_store.cc:276] 0709 12:13:14.526189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:14.529334 (+  3145us) service_pool.cc:224] Handling call
0709 12:13:14.548022 (+ 18688us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:15.030093 (+482071us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:15.755876 (+725783us) spinlock_profiling.cc:243] Waited 456 ms on lock 0x7b54005fee54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:15.756058 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1049227520}
I20260709 12:13:15.758442 13836 raft_consensus.cc:2393] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 24: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:15.729143 22130 consensus_queue.cc:1059] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.039s
I20260709 12:13:15.767427 13680 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 28.
I20260709 12:13:15.753592 21956 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:15.771950 13763 raft_consensus.cc:2393] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 27: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
W20260709 12:13:15.771634 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 43866.1us
I20260709 12:13:15.773084 13727 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:15.763067 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:15.775945 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:15.776988 13682 raft_consensus.cc:1275] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
W20260709 12:13:15.789417 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:15.789649 13680 raft_consensus.cc:1275] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 12:13:15.773494 13833 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 23.
I20260709 12:13:15.797127 13685 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 29.
I20260709 12:13:15.781612 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:15.784732 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:15.801054 13828 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:13:15.785878 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 166363us
I20260709 12:13:15.778730 13757 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 29.
I20260709 12:13:15.757961 22088 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:15.770094 21871 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.816779 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:15.785295 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:13:15.774087 21893 consensus_meta.cc:287] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.519s	user 0.013s	sys 0.000s
I20260709 12:13:15.777017 21956 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:15.833091 13834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 3495) took 1055 ms. Trace:
W20260709 12:13:15.820971 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 50371.5us
I20260709 12:13:15.825619 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:15.786811 13679 raft_consensus.cc:1240] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:15.837040 14379 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:15.811244 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:15.838250 13652 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:15.839375 13652 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:15.835877 13834 rpcz_store.cc:276] 0709 12:13:14.778108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:14.783458 (+  5350us) service_pool.cc:224] Handling call
0709 12:13:14.833027 (+ 49569us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:14.889379 (+ 56352us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 12:13:14.889752 (+   373us) log.cc:844] Serialized 14 byte log entry
0709 12:13:14.896683 (+  6931us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:14.896753 (+    70us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:13:14.896817 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:15.832851 (+936034us) spinlock_profiling.cc:243] Waited 56 ms on lock 0x7b54000b2cd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:15.832901 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:15.833032 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4474,"prepare.queue_time_us":323,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":3058,"raft.queue_time_us":70961,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":9207,"spinlock_wait_cycles":128850816}
I20260709 12:13:15.790066 22012 raft_consensus.cc:2749] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:13:15.826486 13828 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 20.
I20260709 12:13:15.847429 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:15.824275 13830 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 23.
I20260709 12:13:15.811780 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:15.841250 13756 raft_consensus.cc:2393] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 22: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:15.787292 22098 raft_consensus.cc:2804] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:15.848373 13685 raft_consensus.cc:2393] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 20: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:15.788498 21932 raft_consensus.cc:2804] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:15.825809 22130 consensus_queue.cc:1243] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer 3f37c9cc9dda46b4be21dd675ba78fb7 log is divergent from this leader: its last log entry 21.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 12:13:15.849054 13652 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:15.785833 22095 consensus_queue.cc:1048] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.087s
I20260709 12:13:15.828835 22136 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.843888 22075 raft_consensus.cc:2804] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:15.847463 22097 raft_consensus.cc:2804] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:15.870780 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:15.828598 21986 consensus_queue.cc:1048] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.031s
W20260709 12:13:15.888638 22124 log.cc:927] Time spent T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.339s	user 0.000s	sys 0.001s
I20260709 12:13:15.890012 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:15.890879 13685 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 23.
I20260709 12:13:15.890763 21940 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:15.891714 22083 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:15.891884 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:15.892159 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:15.892786 13685 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 22.
I20260709 12:13:15.893127 21940 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:15.873417 22097 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:15.893682 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:15.864001 21957 raft_consensus.cc:2804] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:15.865861 21932 raft_consensus.cc:697] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:15.867393 22075 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:15.894840 21957 raft_consensus.cc:697] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 23 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:15.895288 22075 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:15.895501 21932 consensus_queue.cc:237] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:15.896103 21957 consensus_queue.cc:237] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:15.900568 13685 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 23.
I20260709 12:13:15.834873 21871 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:15.902377 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:15.872828 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:15.903234 13681 raft_consensus.cc:2393] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 21: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:15.904027 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:15.905107 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:15.883818 13835 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 27.
I20260709 12:13:15.830253 21893 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:15.907706 21941 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:15.884383 22106 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:15.858619 21922 consensus_queue.cc:1048] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.040s
I20260709 12:13:15.908712 21893 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:15.908877 22090 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:15.906111 21871 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:15.868767 22136 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:15.879693 21926 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:15.912222 22136 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:15.900892 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:15.913265 13680 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 30.
I20260709 12:13:15.909462 21893 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:15.913959 21893 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:15.914398 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:15.901712 21956 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:15.887281 22028 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:15.867661 22130 raft_consensus.cc:2749] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:15.917420 21893 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:15.918027 21956 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:15.894513 22097 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:15.901913 22098 raft_consensus.cc:697] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:15.912469 21926 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:15.921957 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:15.927516 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:15.929193 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:15.930292 13680 raft_consensus.cc:2393] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 20: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:13:15.934190 13685 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:15.943540 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:15.954689 13680 raft_consensus.cc:2393] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 20: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:15.957162 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:13:15.955147 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 119099us
I20260709 12:13:15.959527 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:15.974296 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:15.979369 13685 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 23.
I20260709 12:13:15.982046 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:15.984923 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:15.988864 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:15.990200 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:15.992890 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:15.994052 13757 raft_consensus.cc:2393] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 25: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:15.994120 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:15.995232 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:15.996150 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:15.996943 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:15.998018 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:15.997251 13726 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
W20260709 12:13:15.999884 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 139613us
I20260709 12:13:16.000677 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:16.001895 13756 raft_consensus.cc:2393] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 20: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:16.003202 13726 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:16.005146 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:16.006310 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:16.007050 13763 raft_consensus.cc:2393] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 29: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
W20260709 12:13:16.007584 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:16.007905 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:16.008279 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:16.009085 13757 raft_consensus.cc:2393] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 23: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:16.008488 13727 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:16.009078 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:16.010429 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:16.011031 13759 raft_consensus.cc:2393] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 23: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:16.013617 13726 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:16.018455 13758 raft_consensus.cc:1240] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 26. Current term is 27. Ops: []
W20260709 12:13:16.015444 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 178475us
I20260709 12:13:16.019850 13760 raft_consensus.cc:2393] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 23: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:16.017164 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:16.020023 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:16.020483 13687 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:16.020597 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:16.020901 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:16.019433 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:16.021510 13831 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:16.022433 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:16.022395 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:16.023255 13685 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 22.
I20260709 12:13:16.023773 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:16.024420 13837 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:16.024930 13651 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:16.020633 13834 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:16.026297 13651 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:16.027592 13651 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:15.925230 22098 consensus_queue.cc:237] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:16.014768 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:16.034960 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:16.009851 21893 raft_consensus.cc:2749] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:16.011821 13762 raft_consensus.cc:2393] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 25: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:16.002539 22088 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:16.041386 13687 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 29.
I20260709 12:13:16.028650 13651 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:16.017674 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:16.035337 13754 raft_consensus.cc:2393] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 23: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:16.016322 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:16.034240 13726 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:16.019618 22026 raft_consensus.cc:2749] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:13:16.031599 22116 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:16.019462 21935 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:16.051167 13726 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:16.051720 13831 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 25.
I20260709 12:13:16.029332 22125 raft_consensus.cc:2749] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:16.031600 22126 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:16.036422 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:16.019701 22015 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:16.053586 13651 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:16.059635 13652 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:16.060636 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 23 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:16.053046 21957 raft_consensus.cc:2749] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:13:16.066610 13837 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 23.
I20260709 12:13:16.070789 21941 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:16.072113 22097 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:16.074954 13758 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:16.009442 22074 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:16.031510 21561 consensus_queue.cc:1048] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.047s
I20260709 12:13:16.052572 21956 raft_consensus.cc:2749] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
W20260709 12:13:16.134042 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 74477us
W20260709 12:13:16.138895 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 51053.8us
I20260709 12:13:16.052505 21940 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:16.031601 21758 consensus_queue.cc:1048] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.046s
I20260709 12:13:16.140417 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 23 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:16.177978 13760 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 22.
I20260709 12:13:16.093348 13834 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 24.
I20260709 12:13:16.049619 22088 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:16.149724 13763 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 25.
I20260709 12:13:16.154860 13756 raft_consensus.cc:1240] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 21. Current term is 22. Ops: []
W20260709 12:13:16.161830 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 108293us
I20260709 12:13:16.168919 13726 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:16.192104 13683 raft_consensus.cc:1275] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 25 index: 17. (term mismatch)
I20260709 12:13:16.193331 13683 pending_rounds.cc:85] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 16
I20260709 12:13:16.188577 13758 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 25.
I20260709 12:13:16.191329 13651 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:16.193593 13683 pending_rounds.cc:107] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 24.17
I20260709 12:13:16.193917 13683 raft_consensus.cc:2889] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:16.083205 22149 raft_consensus.cc:2749] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:16.196960 13684 raft_consensus.cc:2393] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 24: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:16.197980 13682 raft_consensus.cc:2393] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 23: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:16.199080 13726 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:16.202778 13726 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:16.200730 13651 leader_election.cc:304] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:16.164929 21957 raft_consensus.cc:2749] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:13:16.261693 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 59013.9us
I20260709 12:13:16.297322 13726 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:16.299465 13726 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:16.300621 22036 raft_consensus.cc:2749] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:16.301467 22036 raft_consensus.cc:2749] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:16.269148 21935 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:13:16.302270 21935 raft_consensus.cc:697] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:16.303296 21935 consensus_queue.cc:237] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 26.13, Last appended by leader: 13, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:16.306324 13726 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:16.309914 21742 raft_consensus.cc:2804] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:16.310367 21742 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:16.310776 21742 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:16.310967 22097 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:16.205642 22121 raft_consensus.cc:2749] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:16.320899 21990 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:13:16.265403 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 64756.2us
I20260709 12:13:16.136801 22015 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:16.332760 22015 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:16.136778 22026 consensus_queue.cc:1048] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.059s
I20260709 12:13:16.337098 13651 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:16.096688 22143 consensus_queue.cc:1048] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.126s
W20260709 12:13:16.279088 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:16.207649 22123 log.cc:927] Time spent T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:13:16.269799 22035 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:16.364770 22148 log.cc:927] Time spent T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.212s	user 0.000s	sys 0.000s
I20260709 12:13:16.272399 22083 raft_consensus.cc:2749] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:13:16.365342 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:16.189710 21940 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:16.366230 21957 raft_consensus.cc:2749] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:16.367631 21957 consensus_queue.cc:1059] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 26.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:16.368754 21940 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:16.207289 22075 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:16.370736 13681 raft_consensus.cc:2393] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 25: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:16.348126 14413 raft_consensus.cc:1240] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:16.368839 21957 raft_consensus.cc:3055] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:16.374451 21957 raft_consensus.cc:740] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:16.345834 14414 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:16.348367 13726 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:16.354200 14379 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:16.349093 22088 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:16.364063 22035 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:16.210651 21956 raft_consensus.cc:2764] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Leader pre-election decision vote started in defunct term 28: won
I20260709 12:13:16.370555 22068 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:16.371845 22075 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:16.161811 21926 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:16.378410 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:13:16.293346 22142 log.cc:927] Time spent T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.240s	user 0.000s	sys 0.001s
I20260709 12:13:16.365121 13651 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:13:16.641114 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:16.386657 13726 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:16.408888 14414 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 23.
W20260709 12:13:16.407709 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 53616.3us
I20260709 12:13:16.674849 14379 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:16.386128 21328 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:13:16.276073 21941 raft_consensus.cc:2749] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:16.678547 21328 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:16.678700 21940 raft_consensus.cc:2749] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:13:16.679420 21328 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:16.589676 21742 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:16.582448 22035 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:16.398102 22047 consensus_queue.cc:1059] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.146s
I20260709 12:13:16.683637 22075 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:16.685598 22047 raft_consensus.cc:3055] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:16.686305 21839 consensus_queue.cc:1048] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:13:16.533142 21893 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:16.413333 21926 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:16.700600 13755 raft_consensus.cc:1217] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Deduplicated request from leader. Original: 17.15->[18.16-22.18]   Dedup: 18.16->[20.17-22.18]
I20260709 12:13:16.574030 22116 raft_consensus.cc:2749] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:16.701826 13679 raft_consensus.cc:1240] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:16.701692 13755 raft_consensus.cc:1240] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 22. Current term is 23. Ops: [18.16-22.18]
W20260709 12:13:16.598062 22126 consensus_meta.cc:287] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.512s	user 0.007s	sys 0.004s
I20260709 12:13:16.707108 22126 raft_consensus.cc:2749] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:16.686544 22075 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:16.412290 21957 consensus_queue.cc:260] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.14, Last appended by leader: 14, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:16.412021 21561 raft_consensus.cc:2749] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:13:16.580806 22158 log.cc:927] Time spent T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 12:13:16.709934 22075 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:16.712208 21957 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:16.686417 22047 raft_consensus.cc:740] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:16.689558 22125 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:16.690200 22161 raft_consensus.cc:2749] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:16.714641 22047 consensus_queue.cc:260] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:16.691053 21839 raft_consensus.cc:2804] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:16.716444 21839 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:16.717068 21839 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:16.693182 21893 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:16.695420 21742 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:16.714818 22125 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:16.694614 14407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41692 (request call id 1243) took 1240 ms. Trace:
I20260709 12:13:16.717365 22047 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:16.723497 13683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 3731) took 1148 ms. Trace:
I20260709 12:13:16.724010 13683 rpcz_store.cc:276] 0709 12:13:15.575382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:15.742856 (+167474us) service_pool.cc:224] Handling call
0709 12:13:15.743162 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:16.194386 (+451224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:16.718577 (+524191us) spinlock_profiling.cc:243] Waited 448 ms on lock 0x7b54003129d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:16.723281 (+  4704us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1031380864}
I20260709 12:13:16.725560 22125 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:13:16.726490 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 361343us
I20260709 12:13:16.730201 21893 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:16.731441 22075 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:13:16.734941 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 348261us
I20260709 12:13:16.763607 13726 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:16.764588 21926 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:16.765152 21742 raft_consensus.cc:2749] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:16.772015 13726 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:16.776383 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:16.777733 14413 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 26.
I20260709 12:13:16.779146 22035 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:13:16.793758 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:16.795480 13686 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 2562) took 1321 ms (client timeout 1568 ms). Trace:
I20260709 12:13:16.795352 21328 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:16.796021 13686 rpcz_store.cc:269] 0709 12:13:15.473400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:15.474046 (+   646us) service_pool.cc:224] Handling call
0709 12:13:16.794995 (+1320949us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b540021e154. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:16.795265 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":462177664}
I20260709 12:13:16.796554 13755 raft_consensus.cc:1240] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 30. Current term is 31. Ops: []
I20260709 12:13:16.801612 21839 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:16.807628 21839 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 23 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:16.810531 22015 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:16.811575 14414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41700 (request call id 1221) took 1087 ms. Trace:
I20260709 12:13:16.814670 22028 raft_consensus.cc:2804] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election won for term 27
W20260709 12:13:16.822031 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 50326.6us
I20260709 12:13:16.822069 14414 rpcz_store.cc:276] 0709 12:13:15.723909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:15.734735 (+ 10826us) service_pool.cc:224] Handling call
0709 12:13:16.811187 (+1076452us) spinlock_profiling.cc:243] Waited 550 ms on lock 0x7b54005f1ed4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:16.811353 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1264446208}
W20260709 12:13:16.835505 13571 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d2f365337b324999a073edacbe6c6e09 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER failed with leader ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica ca9fbbc2c0a94897897d502d42f3951f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 23 committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:13:16.722167 14407 rpcz_store.cc:276] 0709 12:13:15.454004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:15.454478 (+   474us) service_pool.cc:224] Handling call
0709 12:13:15.457740 (+  3262us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:15.462613 (+  4873us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:15.462675 (+    62us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:15.463330 (+   655us) log.cc:844] Serialized 26 byte log entry
0709 12:13:16.323462 (+860132us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b18004d1580. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e6e2a6 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e82e07 00007fa92dcdd9a9
0709 12:13:16.375985 (+ 52523us) spinlock_profiling.cc:243] Waited 1.38 ms on lock 0x7b18004d1580. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e82e07 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9fc02 00007fa927b2720b 00007fa927b2cd23 00007fa927b2d0d1 00007fa927f48a0f
0709 12:13:16.693186 (+317201us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:13:16.693310 (+   124us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:16.693432 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:16.693509 (+    77us) raft_consensus.cc:1685] finished
0709 12:13:16.694105 (+   596us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:16.694369 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4287,"raft.queue_time_us":13362,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":12993,"spinlock_wait_cycles":36115072,"thread_start_us":316612,"threads_started":1,"wal-append.queue_time_us":1131201}
W20260709 12:13:16.843220 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 114732us
I20260709 12:13:16.844569 13726 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
W20260709 12:13:16.850066 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:16.852813 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:16.853875 13832 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:16.858891 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:16.859958 13828 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 27.
I20260709 12:13:16.860163 22074 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:16.859170 13835 raft_consensus.cc:1240] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 24 LEADER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 23. Current term is 24. Ops: []
W20260709 12:13:16.862041 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:16.863029 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:16.874810 14380 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:13:16.878325 21328 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 31 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:16.869158 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:16.883797 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:13:16.894209 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:16.892414 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 48106.4us
I20260709 12:13:16.898104 21015 raft_consensus.cc:3055] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:16.898692 21015 raft_consensus.cc:740] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 22 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:16.898882 13761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 2755) took 1778 ms. Trace:
I20260709 12:13:16.900139 21015 consensus_queue.cc:260] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:16.903448 21015 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:16.903523 22028 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:16.918810 22028 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Advancing to term 27
W20260709 12:13:16.925863 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 97230.2us
I20260709 12:13:16.927744 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:16.928094 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:16.928628 14407 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 21.
I20260709 12:13:16.928730 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
W20260709 12:13:16.932307 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:16.918462 13651 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:16.936573 22144 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:16.937168 22144 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:16.937638 22144 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:16.937861 13726 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:16.938980 22068 raft_consensus.cc:2749] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:13:16.941885 22149 raft_consensus.cc:2749] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:13:16.941932 13651 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:16.944028 22098 raft_consensus.cc:2749] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:13:16.951224 13834 raft_consensus.cc:1275] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:13:16.894757 22015 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:16.955528 22015 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:16.955859 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:16.899446 13761 rpcz_store.cc:276] 0709 12:13:15.120470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:15.120619 (+   149us) service_pool.cc:224] Handling call
0709 12:13:15.120969 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:15.121329 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:15.121357 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:15.131560 (+ 10203us) log.cc:844] Serialized 26 byte log entry
0709 12:13:16.730567 (+1599007us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b1800108d00. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e82e07 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9fc02 00007fa927b2720b 00007fa927b2cd23 00007fa927b2d0d1 00007fa927f48a0f
0709 12:13:16.813980 (+ 83413us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:13:16.814034 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:16.815172 (+  1138us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:16.898358 (+ 83186us) raft_consensus.cc:1685] finished
0709 12:13:16.898385 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:16.898676 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2417,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":12269,"spinlock_wait_cycles":43470464,"thread_start_us":25068,"threads_started":1,"wal-append.queue_time_us":1744322}
I20260709 12:13:16.948876 21957 raft_consensus.cc:2804] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader election won for term 25
W20260709 12:13:16.958299 14380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:16.949541 13726 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:16.959232 21957 raft_consensus.cc:697] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 25 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:16.961530 13577 catalog_manager.cc:5697] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 9 to 14, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 14 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:16.967689 13834 raft_consensus.cc:1240] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 17. Current term is 18. Ops: [15.13-17.14]
I20260709 12:13:16.972128 22063 consensus_queue.cc:1059] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 20.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:13:16.973376 22063 raft_consensus.cc:3055] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:13:16.967020 21957 consensus_queue.cc:237] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:16.973883 22063 raft_consensus.cc:740] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:16.975306 22063 consensus_queue.cc:260] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:16.976856 22063 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:13:16.980964 13582 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45610 (request call id 258) took 59262 ms (client timeout 15000 ms). Trace:
I20260709 12:13:16.968587 13577 catalog_manager.cc:5697] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:13:16.949944 14410 raft_consensus.cc:1275] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:13:16.986474 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:16.986976 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:16.987830 13831 raft_consensus.cc:2393] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 25: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:16.987905 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:16.945647 13651 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:16.988867 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:16.989634 13837 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Advancing to term 25
I20260709 12:13:16.989787 22015 raft_consensus.cc:2804] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:16.990525 22015 raft_consensus.cc:697] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 25 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:16.991732 22015 consensus_queue.cc:237] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:16.995398 13829 raft_consensus.cc:1275] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
W20260709 12:13:16.997311 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 51937.9us
W20260709 12:13:16.981527 22171 log.cc:927] Time spent T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:13:17.011382 13832 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 23.
W20260709 12:13:17.014900 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 65756.5us
I20260709 12:13:17.026399 13726 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:17.026818 21893 raft_consensus.cc:2804] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:17.027730 21893 raft_consensus.cc:697] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:17.028570 13726 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:17.030047 21932 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:17.031337 21742 raft_consensus.cc:2749] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:17.032496 21452 raft_consensus.cc:2749] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:17.031047 21932 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:17.020959 13727 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:16.984558 13577 catalog_manager.cc:5697] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 12 to 21, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 21 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:17.015681 22149 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:17.010939 22068 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:17.053453 13829 raft_consensus.cc:1240] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 25. Current term is 26. Ops: []
W20260709 12:13:17.053766 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:17.053689 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:17.054775 22068 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:17.055780 21452 raft_consensus.cc:2804] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:17.056634 21452 raft_consensus.cc:697] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:17.057974 22149 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:17.058288 21452 consensus_queue.cc:237] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:17.061267 22149 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:17.063314 21932 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:17.029301 21893 consensus_queue.cc:237] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:17.075001 13577 catalog_manager.cc:5697] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 12 to 14, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 14 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:17.080485 13801 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:17.082386 21365 raft_consensus.cc:2804] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:17.082866 21365 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:17.083276 21365 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:17.055303 13830 raft_consensus.cc:2393] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 23: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
W20260709 12:13:17.045825 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 95073us
I20260709 12:13:17.121917 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:17.076313 22028 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:17.100713 22068 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:17.102020 13577 catalog_manager.cc:5697] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:17.139189 22149 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:17.139653 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:13:17.140446 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:17.141395 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:17.139212 13577 catalog_manager.cc:5697] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 18 to 19, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 19 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:17.145711 13832 raft_consensus.cc:1275] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 14. (term mismatch)
I20260709 12:13:17.146199 13832 pending_rounds.cc:85] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 13
I20260709 12:13:17.146432 13832 pending_rounds.cc:107] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 16.14
I20260709 12:13:17.146522 13762 raft_consensus.cc:1275] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 23 index: 18. Preceding OpId from leader: term: 24 index: 18. (term mismatch)
I20260709 12:13:17.140061 22149 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:17.146960 13762 pending_rounds.cc:85] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting all ops after (but not including) 17
I20260709 12:13:17.147370 13762 pending_rounds.cc:107] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting uncommitted NO_OP operation due to leader change: 23.18
I20260709 12:13:17.147599 13762 raft_consensus.cc:2889] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:17.139807 21935 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:17.146865 13832 raft_consensus.cc:2889] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:13:17.160519 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 80171.8us
I20260709 12:13:17.162956 13727 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:17.172936 13828 raft_consensus.cc:2393] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 25: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:17.178562 13686 raft_consensus.cc:1275] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:13:17.202643 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 23 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:17.203680 13758 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:13:17.204286 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 56191.4us
I20260709 12:13:17.205404 13727 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:17.207729 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:17.207980 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:17.220095 13837 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 25.
I20260709 12:13:17.222223 13727 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:17.213936 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:17.230340 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:17.243898 13829 raft_consensus.cc:2393] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 24: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:17.248472 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:13:17.002017 13582 rpcz_store.cc:269] 0709 12:12:17.718770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:17.719152 (+   382us) service_pool.cc:224] Handling call
0709 12:13:16.980540 (+59261388us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:08.001023 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:08.058795 (+ 57772us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:08.058857 (+    62us) write_op.cc:435] Acquired schema lock
0709 12:13:08.058894 (+    37us) tablet.cc:662] Decoding operations
0709 12:13:08.060635 (+  1741us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:08.060730 (+    95us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:08.060759 (+    29us) tablet.cc:685] Acquiring locks for 19 operations
0709 12:13:08.349746 (+288987us) tablet.cc:701] Row locks acquired
0709 12:13:08.349842 (+    96us) write_op.cc:260] PREPARE: finished
0709 12:13:08.351828 (+  1986us) write_op.cc:270] Start()
0709 12:13:08.352042 (+   214us) write_op.cc:276] Timestamp: P: 1783599188351751 usec, L: 0
0709 12:13:08.352079 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 12:13:08.352978 (+   899us) log.cc:844] Serialized 7517 byte log entry
0709 12:13:09.375855 (+1022877us) op_driver.cc:464] REPLICATION: finished
0709 12:13:09.731974 (+356119us) write_op.cc:301] APPLY: starting
0709 12:13:09.741668 (+  9694us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:10.016163 (+274495us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:10.016338 (+   175us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:10.116870 (+100532us) spinlock_profiling.cc:243] Waited 2.76 ms on lock 0x7b180044f380. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924ea0522 00007fa924ea27c1 00007fa924ea2779 00007fa924ea2709 00007fa924ea26d1 00007fa924ea19cd 0000000000388634 0000000000388479 00007fa924e8383a
0709 12:13:10.649663 (+532793us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:10.714112 (+ 64449us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=38,key_file_lookups=38,delta_file_lookups=38,mrs_lookups=0
0709 12:13:10.730475 (+ 16363us) write_op.cc:312] APPLY: finished
0709 12:13:10.776685 (+ 46210us) log.cc:844] Serialized 172 byte log entry
0709 12:13:10.851927 (+ 75242us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:10.876626 (+ 24699us) write_op.cc:454] Released schema lock
0709 12:13:10.896555 (+ 19929us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:10.924907 (+ 28352us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:10.925963 (+  1056us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2952810,"reported_tablets":50,"spinlock_wait_cycles":1469312,"child_traces":[["op",{"apply.queue_time_us":347384,"apply.run_cpu_time_us":45583,"apply.run_wall_time_us":1178134,"cfile_cache_hit":78,"cfile_cache_hit_bytes":83547,"num_ops":19,"prepare.queue_time_us":324622,"prepare.run_cpu_time_us":30590,"prepare.run_wall_time_us":559244,"raft.queue_time_us":445751,"raft.run_cpu_time_us":50178,"raft.run_wall_time_us":442584,"replication_time_us":1009792,"spinlock_wait_cycles":6337792,"thread_start_us":693426,"threads_started":5,"wal-append.queue_time_us":362468,"wal-append.run_cpu_time_us":29036,"wal-append.run_wall_time_us":2388218}]]}
I20260709 12:13:17.195497 21935 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:17.273912 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:17.293569 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 117621us
I20260709 12:13:17.286161 13762 raft_consensus.cc:1240] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:17.267745 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:17.270812 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:17.250905 13828 raft_consensus.cc:1275] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 12:13:17.276522 14415 raft_consensus.cc:1240] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:17.271876 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:13:17.293612 13582 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53318 (request call id 149) took 17627 ms (client timeout 15000 ms). Trace:
W20260709 12:13:17.304579 13582 rpcz_store.cc:269] 0709 12:12:59.666550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:17.293306 (+17626756us) service_pool.cc:211] Skipping call since client already timed out
0709 12:13:17.293513 (+   207us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:13:17.275106 13727 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:13:17.311844 22179 log.cc:927] Time spent T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:13:17.312888 21328 raft_consensus.cc:2749] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:13:17.289954 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:13:17.278425 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 94318.9us
W20260709 12:13:17.338408 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 128281us
I20260709 12:13:17.287045 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 23 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:17.291465 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:17.250159 21932 raft_consensus.cc:2804] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:17.288648 22098 raft_consensus.cc:2804] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:17.282063 22034 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:17.278879 22099 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:17.289139 22149 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:17.278229 22157 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:17.401533 13758 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 23.
I20260709 12:13:17.256750 22035 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:17.414250 21932 raft_consensus.cc:697] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:17.380705 22028 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:17.271185 21365 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:17.272710 22096 consensus_queue.cc:1059] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 30.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.137s
I20260709 12:13:17.436408 21932 consensus_queue.cc:237] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:17.437469 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:17.341718 22047 consensus_queue.cc:1048] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.075s
W20260709 12:13:17.439327 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 49019.2us
W20260709 12:13:17.440481 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 47286.4us
I20260709 12:13:17.404683 22034 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:17.437347 22130 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:17.426888 22068 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:13:17.452593 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:17.425944 22063 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:17.446966 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 134706us
I20260709 12:13:17.430879 22098 raft_consensus.cc:697] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:17.430310 22035 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:17.464879 22034 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:17.426364 22144 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:17.520534 13759 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 20.
I20260709 12:13:17.268401 13577 catalog_manager.cc:5697] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 15 to 17, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 17 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:17.524674 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:17.461248 22074 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:17.538419 13652 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:13:17.441218 22157 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:17.564747 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 55076.5us
I20260709 12:13:17.580225 13727 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:17.493739 22068 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:17.593796 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 56124.2us
W20260709 12:13:17.601984 22186 log.cc:927] Time spent T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.241s	user 0.002s	sys 0.000s
I20260709 12:13:17.608026 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:17.647186 13758 raft_consensus.cc:1240] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:17.612133 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:17.597877 21926 consensus_queue.cc:1048] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.006s
I20260709 12:13:17.616876 22074 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:17.618044 13577 catalog_manager.cc:5697] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 8 to 18. New cstate: current_term: 18 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:17.509895 22063 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:17.539026 22099 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:17.626859 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 88747.9us
I20260709 12:13:17.550664 22130 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:17.629494 21365 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:17.555410 22096 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:17.629841 22188 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:17.607583 21833 consensus_queue.cc:1048] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.152s
I20260709 12:13:17.618050 22015 raft_consensus.cc:2804] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:13:17.606444 22098 consensus_queue.cc:237] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:17.630627 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:17.666239 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 204427us
I20260709 12:13:17.597371 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:17.658931 13754 raft_consensus.cc:2410] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 24 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
W20260709 12:13:17.667521 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 68771.2us
I20260709 12:13:17.668529 14379 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:17.673312 21015 raft_consensus.cc:2804] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Leader election won for term 23
W20260709 12:13:17.662900 22190 log.cc:927] Time spent T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:13:17.633900 21893 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:17.688138 21935 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:17.705569 22193 log.cc:927] Time spent T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.209s	user 0.001s	sys 0.001s
W20260709 12:13:17.716480 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:17.713713 22063 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:17.717535 22162 consensus_queue.cc:1048] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:13:17.718766 21957 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:17.719364 21957 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:17.720736 22035 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:17.704617 22096 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:17.724069 22096 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:17.724895 22184 log.cc:927] Time spent T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 12:13:17.727034 22099 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:17.727707 13651 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:13:17.729123 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 68040us
I20260709 12:13:17.734113 22035 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:17.736692 22035 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:17.710734 21893 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:17.753495 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:17.756335 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:17.765883 13832 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 24.
I20260709 12:13:17.769235 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:17.737555 22149 consensus_queue.cc:1048] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.026s
I20260709 12:13:17.779492 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:17.787556 13829 raft_consensus.cc:1275] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 27 index: 14. Preceding OpId from leader: term: 29 index: 14. (term mismatch)
I20260709 12:13:17.731801 22188 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:17.793025 21015 raft_consensus.cc:697] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 23 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:17.792985 13837 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 23.
I20260709 12:13:17.794054 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:17.788102 13829 pending_rounds.cc:85] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 13
I20260709 12:13:17.795917 13829 pending_rounds.cc:107] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 27.14
I20260709 12:13:17.796245 13829 raft_consensus.cc:2889] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:17.776492 22144 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:17.798604 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:17.787766 21956 raft_consensus.cc:2804] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:17.805912 21015 consensus_queue.cc:237] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:17.810400 22151 consensus_queue.cc:1059] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.073s
I20260709 12:13:17.812047 13828 raft_consensus.cc:1275] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260709 12:13:17.786190 21935 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:17.801867 22157 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:17.742589 13577 catalog_manager.cc:5697] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 20 to 23, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 23 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:13:17.826921 22015 raft_consensus.cc:697] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 20 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:17.831637 22015 consensus_queue.cc:237] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:17.831573 13577 catalog_manager.cc:5697] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 10 to 17, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 17 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:13:17.817260 21742 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:17.833235 21935 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:17.841079 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 160507us
I20260709 12:13:17.814538 22047 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:17.827158 21956 raft_consensus.cc:697] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:13:17.857738 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 174287us
I20260709 12:13:17.852242 22034 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:17.845063 22068 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:17.915381 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 150068us
I20260709 12:13:17.853479 22130 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:17.954842 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 95780.3us
I20260709 12:13:17.958384 22209 consensus_queue.cc:1048] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:13:17.960258 22188 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:17.962204 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:17.962721 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:17.963399 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:17.963762 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:17.963960 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:17.964542 13836 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 25.
W20260709 12:13:17.965106 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:17.965996 13727 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:17.966123 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 24 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:17.967831 13727 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:17.968215 21932 raft_consensus.cc:2804] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:17.968889 21932 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:17.888732 21742 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:17.961458 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 44660.9us
I20260709 12:13:17.964928 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:17.969229 21328 raft_consensus.cc:2804] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 12:13:17.963433 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:17.974671 21328 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:17.975278 21328 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:13:17.979637 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 251968us
I20260709 12:13:17.969434 21932 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:17.989488 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:17.991012 14407 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:17.989368 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:18.002205 13683 raft_consensus.cc:2410] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 24 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 12:13:18.001415 22211 consensus_queue.cc:1048] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.010s
I20260709 12:13:17.964787 22047 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:18.006933 13652 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:17.984931 21452 consensus_queue.cc:1048] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.038s
I20260709 12:13:18.053337 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:18.052080 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 29 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:18.054478 22215 raft_consensus.cc:2804] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:18.054865 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:18.054986 22215 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:18.070204 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:18.054911 13686 raft_consensus.cc:2393] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 29: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:18.043823 22035 leader_election.cc:290] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:18.085943 13688 raft_consensus.cc:2393] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 25: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
W20260709 12:13:18.087093 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 90799.3us
I20260709 12:13:18.089124 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:18.050292 13577 catalog_manager.cc:5697] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 14 to 17, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 17 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:18.052847 22222 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:18.096240 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:18.096417 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:18.096915 21935 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:18.097208 13681 raft_consensus.cc:2368] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 22. Current term is 23.
I20260709 12:13:18.097607 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:18.097170 13679 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 25.
W20260709 12:13:18.103050 22214 log.cc:927] Time spent T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:13:18.103621 22047 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:18.103983 21742 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:18.105260 22034 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:18.107538 22223 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:18.108373 22223 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:18.082158 22215 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:18.111001 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:18.112107 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:18.112993 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:18.116330 21328 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:18.117599 22222 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:18.119011 13679 raft_consensus.cc:2468] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 17.
I20260709 12:13:18.120405 22222 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:18.121426 22213 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:18.121454 22217 log.cc:927] Time spent T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 12:13:18.122066 22213 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:18.115306 14379 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
W20260709 12:13:18.129902 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 160400us
I20260709 12:13:18.136898 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:18.140178 13687 raft_consensus.cc:1275] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260709 12:13:18.145948 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:18.146956 21328 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:18.150645 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:18.150511 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:18.154994 13832 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 27.
I20260709 12:13:18.132987 22162 raft_consensus.cc:2804] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:18.159900 21328 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:18.159922 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:18.157601 14380 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:18.153949 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:18.129261 22015 raft_consensus.cc:2749] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:18.162351 13833 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:18.160462 13683 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:18.055524 21956 consensus_queue.cc:237] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:18.176587 13727 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:18.176973 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:18.166515 22162 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:18.180444 13684 raft_consensus.cc:1275] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:13:18.164422 22149 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:18.181908 21328 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:18.179452 13830 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 28.
I20260709 12:13:18.177822 13687 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:18.103082 13577 catalog_manager.cc:5697] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 13 to 22, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 22 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:18.188024 22227 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:18.193527 22213 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:18.183059 22162 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:18.190375 22034 raft_consensus.cc:2804] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:18.176010 21833 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:18.158183 22222 consensus_queue.cc:1059] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.021s
I20260709 12:13:18.216042 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:18.217911 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:18.219260 13727 leader_election.cc:304] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
W20260709 12:13:18.222402 13800 connection.cc:256] RPC call timeout handler was delayed by -1.0090174990002652s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2594s for a response
I20260709 12:13:18.223114 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:18.223650 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:18.224303 13830 raft_consensus.cc:1275] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 12:13:18.227118 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:18.228571 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:18.229923 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:18.197126 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:18.236608 21328 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:18.237633 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:18.238544 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:18.240983 13836 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:18.244448 13760 raft_consensus.cc:2368] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for earlier term 27. Current term is 28.
I20260709 12:13:18.242280 13762 raft_consensus.cc:2410] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for term 25 because replica has last-logged OpId of term: 23 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 15.
I20260709 12:13:18.239775 13763 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 24.
I20260709 12:13:18.242105 21932 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:18.251247 22028 raft_consensus.cc:2804] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:18.254886 22028 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:18.255354 22028 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:18.213352 22035 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:18.257903 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:18.238497 22034 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:18.263974 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:18.249140 22101 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:18.272034 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:18.271232 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:18.272747 13679 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 23.
I20260709 12:13:18.268430 22223 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:18.277418 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:18.273269 13831 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 25.
W20260709 12:13:18.285307 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 160894us
I20260709 12:13:18.285113 13727 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:18.250985 21833 raft_consensus.cc:697] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 27 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:18.237891 22149 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:18.317384 21926 consensus_queue.cc:1048] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:13:18.314532 22098 raft_consensus.cc:2804] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:18.318646 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:18.288952 22035 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:18.320192 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 24 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:18.320873 13682 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 24.
I20260709 12:13:18.293360 13761 raft_consensus.cc:1240] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 30. Current term is 31. Ops: []
I20260709 12:13:18.323925 21833 consensus_queue.cc:237] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 17, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:18.325453 13679 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 25.
I20260709 12:13:18.326834 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:18.327461 13679 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:18.329465 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:18.330482 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:18.332124 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:18.321594 22035 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:18.332934 21893 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:18.333189 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:18.281991 22101 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:18.334457 22164 raft_consensus.cc:3055] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:18.334937 22164 raft_consensus.cc:740] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 21 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:18.335610 13758 raft_consensus.cc:1275] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 12:13:18.336014 22101 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:18.336082 22164 consensus_queue.cc:260] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:18.336776 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:18.341172 21957 leader_election.cc:290] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:18.343793 13800 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:18.262084 21932 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:18.295034 13683 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 23.
I20260709 12:13:18.297309 22220 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:18.349335 13679 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 24.
I20260709 12:13:18.349232 22220 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:18.350670 22191 log.cc:927] Time spent T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.726s	user 0.009s	sys 0.007s
I20260709 12:13:18.350989 13679 raft_consensus.cc:1275] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 12:13:18.352560 22220 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:18.353566 13688 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 22.
I20260709 12:13:18.297479 21986 raft_consensus.cc:3055] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 30 LEADER]: Stepping down as leader of term 30
I20260709 12:13:18.354400 21986 raft_consensus.cc:740] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 30 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:18.354332 13577 catalog_manager.cc:5697] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 9 to 16, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 16 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:18.355726 21986 consensus_queue.cc:260] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 30.19, Last appended by leader: 19, Current term: 30, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:18.334860 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:18.298031 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:18.357892 13682 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 28.
I20260709 12:13:18.282608 21452 consensus_queue.cc:1048] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.016s
I20260709 12:13:18.354424 13836 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 24.
I20260709 12:13:18.298936 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:18.299887 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:18.360694 13681 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 22.
I20260709 12:13:18.361042 14408 raft_consensus.cc:2410] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 24 because replica has last-logged OpId of term: 22 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 17.
I20260709 12:13:18.303344 22028 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:18.303891 22215 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:18.363991 13680 raft_consensus.cc:1240] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:18.305181 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:18.365042 13685 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:18.365314 13761 raft_consensus.cc:2393] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 29: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:18.307716 22188 consensus_queue.cc:1048] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:13:18.297029 22225 log.cc:927] Time spent T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 12:13:18.367476 22028 leader_election.cc:290] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 29 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:18.311936 13755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48114 (request call id 3670) took 1023 ms. Trace:
I20260709 12:13:18.369964 13755 rpcz_store.cc:276] 0709 12:13:17.288743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:17.289585 (+   842us) service_pool.cc:224] Handling call
0709 12:13:18.311662 (+1022077us) spinlock_profiling.cc:243] Waited 597 ms on lock 0x7b5400332cd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:18.311850 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1373867392}
I20260709 12:13:18.370577 13756 raft_consensus.cc:1240] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 24. Current term is 25. Ops: [24.18-24.18]
I20260709 12:13:18.371165 22215 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:18.318874 22098 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:18.371932 22098 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:18.373335 22213 raft_consensus.cc:3055] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:18.357003 21986 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:18.316344 22149 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:18.373757 22213 raft_consensus.cc:740] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:18.374850 13831 raft_consensus.cc:1275] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
W20260709 12:13:18.381414 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 197947us
I20260709 12:13:18.341462 13687 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 24.
I20260709 12:13:18.375836 13685 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 27.
I20260709 12:13:18.267875 22034 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:18.316748 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:13:18.397425 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 78381.3us
I20260709 12:13:18.400332 13833 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 28.
I20260709 12:13:18.403949 14407 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 22.
I20260709 12:13:18.239022 22227 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:18.403332 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:18.412904 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:18.413607 13834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 1623) took 1410 ms. Trace:
I20260709 12:13:18.416335 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:13:18.419588 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 75920.4us
I20260709 12:13:18.421279 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:18.420064 13801 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:18.425941 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:18.418360 13834 rpcz_store.cc:276] 0709 12:13:16.991806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:17.007432 (+ 15626us) service_pool.cc:224] Handling call
0709 12:13:17.021902 (+ 14470us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:17.122230 (+100328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:17.122299 (+    69us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:17.175938 (+ 53639us) log.cc:844] Serialized 26 byte log entry
0709 12:13:17.376589 (+200651us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:13:17.376729 (+   140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:17.376915 (+   186us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:18.350260 (+973345us) spinlock_profiling.cc:243] Waited 51.7 ms on lock 0x7b2400261ed8. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924d269c4 00007fa924d24acb 00007fa924edfdc9 00007fa924edfa55 00007fa924edf09d 00007fa927b1110e 00007fa927b2888c 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221
0709 12:13:18.383530 (+ 33270us) raft_consensus.cc:1685] finished
0709 12:13:18.383557 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:18.402252 (+ 18695us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":327358,"raft.run_cpu_time_us":973,"raft.run_wall_time_us":95917,"spinlock_wait_cycles":118993792,"thread_start_us":144790,"threads_started":1,"wal-append.queue_time_us":309003}
I20260709 12:13:18.356971 13577 catalog_manager.cc:5697] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 10 to 19, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 19 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:13:18.407373 22164 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:18.434707 13651 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:18.441635 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:18.446517 22236 consensus_queue.cc:1059] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.006s
I20260709 12:13:18.447642 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:18.452384 22074 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:18.457963 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:18.459158 13829 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:18.464761 13727 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:18.466625 13755 raft_consensus.cc:2393] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 24: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:18.478305 21452 raft_consensus.cc:2804] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader election won for term 24
W20260709 12:13:18.478820 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:18.478991 21452 raft_consensus.cc:697] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:18.480437 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:18.480279 21452 consensus_queue.cc:237] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:18.480057 22213 consensus_queue.cc:260] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:18.482141 22213 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:18.482762 13652 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:13:18.486637 22198 log.cc:927] Time spent T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.826s	user 0.002s	sys 0.002s
I20260709 12:13:18.477697 22028 consensus_queue.cc:1048] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:13:18.454092 21957 consensus_queue.cc:1059] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:13:18.429633 22240 raft_consensus.cc:2804] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:18.438068 22149 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:18.492512 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 57990.1us
I20260709 12:13:18.503826 13727 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:13:18.486776 22238 consensus_queue.cc:1175] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" responder_term: 23 status { last_received { term: 19 index: 13 } last_committed_idx: 13 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 22. Current term is 23. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:13:18.510421 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:18.515774 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:18.516618 13687 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:18.523762 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:18.524726 13763 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 23.
I20260709 12:13:18.520395 13651 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:18.529666 13681 raft_consensus.cc:1275] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 12:13:18.530458 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:18.496933 22240 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:18.533258 13762 raft_consensus.cc:1275] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:13:18.539984 13727 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:18.541533 13652 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:18.499152 22047 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:18.543359 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:18.544407 13652 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:18.545243 14410 raft_consensus.cc:1275] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 12:13:18.531360 13685 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 21.
I20260709 12:13:18.557184 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:18.587527 14379 leader_election.cc:400] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 election: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for earlier term 27. Current term is 28.
W20260709 12:13:18.589699 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 50749.4us
I20260709 12:13:18.600816 14379 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:18.597237 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:18.602097 13758 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 22.
I20260709 12:13:18.611845 13687 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 29.
I20260709 12:13:18.613922 13651 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:18.502832 22149 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:18.630079 14379 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:18.585947 22223 raft_consensus.cc:2804] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:18.540181 22240 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:18.585685 22015 raft_consensus.cc:2749] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:13:18.651696 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 107404us
I20260709 12:13:18.519304 21935 consensus_queue.cc:1048] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.106s
I20260709 12:13:18.636766 14379 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:13:18.633519 22198 log.cc:927] Time spent T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:13:18.543035 21742 consensus_queue.cc:1048] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.089s
W20260709 12:13:18.681221 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 44544.7us
W20260709 12:13:18.689918 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 269929us
I20260709 12:13:18.627117 22035 raft_consensus.cc:2749] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:18.603123 22047 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:18.700089 13755 raft_consensus.cc:1275] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 12:13:18.636812 22236 raft_consensus.cc:2749] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:18.640030 21893 raft_consensus.cc:2749] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:18.649276 22223 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:18.658399 21833 raft_consensus.cc:2749] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:18.693032 22209 raft_consensus.cc:2749] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:18.663384 21957 consensus_queue.cc:1059] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 25.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.050s
W20260709 12:13:18.723517 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 211148us
I20260709 12:13:18.731679 13726 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 31 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:18.726526 22223 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:18.658671 13577 catalog_manager.cc:5697] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 19 to 22. New cstate: current_term: 22 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:18.772182 22227 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:18.830641 22237 log.cc:927] Time spent T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:13:18.939085 22188 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:13:18.939971 21986 consensus_meta.cc:287] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.564s	user 0.013s	sys 0.000s
I20260709 12:13:18.940385 22074 raft_consensus.cc:3055] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:13:18.723392 22235 consensus_queue.cc:1059] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.073s
I20260709 12:13:18.765690 13726 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:18.994320 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:18.771912 22232 consensus_queue.cc:1048] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.222s
I20260709 12:13:18.950364 13757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 3669) took 1472 ms. Trace:
W20260709 12:13:18.723891 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 259474us
W20260709 12:13:18.970880 13837 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.013s	sys 0.013s
W20260709 12:13:18.999496 13837 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.014s	sys 0.013s
W20260709 12:13:18.999330 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 233709us
W20260709 12:13:18.982985 22034 consensus_meta.cc:287] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.559s	user 0.005s	sys 0.009s
I20260709 12:13:18.980173 14410 raft_consensus.cc:1240] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 21. Current term is 22. Ops: []
W20260709 12:13:18.992506 13829 consensus_meta.cc:287] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.515s	user 0.013s	sys 0.003s
I20260709 12:13:18.997690 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:18.994308 22074 raft_consensus.cc:740] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
W20260709 12:13:18.990314 22162 consensus_meta.cc:287] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.731s	user 0.015s	sys 0.006s
I20260709 12:13:19.001550 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:19.014808 13829 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 29.
I20260709 12:13:18.980386 22253 raft_consensus.cc:2804] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:18.963737 22035 raft_consensus.cc:2749] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Leader election lost for term 31. Reason: could not achieve majority
I20260709 12:13:18.939126 22149 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:13:18.978016 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 438099us
W20260709 12:13:18.998636 22213 consensus_meta.cc:287] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.516s	user 0.010s	sys 0.005s
W20260709 12:13:18.990094 22098 consensus_meta.cc:287] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.616s	user 0.015s	sys 0.003s
I20260709 12:13:19.028888 13727 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:18.998626 13757 rpcz_store.cc:276] 0709 12:13:17.288356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:17.309762 (+ 21406us) service_pool.cc:224] Handling call
0709 12:13:17.310185 (+   423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:17.310688 (+   503us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:17.310719 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:17.311310 (+   591us) log.cc:844] Serialized 26 byte log entry
0709 12:13:17.421800 (+110490us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:13:17.443475 (+ 21675us) log.cc:844] Serialized 14 byte log entry
0709 12:13:17.443897 (+   422us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:17.443988 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:18.380837 (+936849us) spinlock_profiling.cc:243] Waited 1.65 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:13:18.729721 (+348884us) raft_consensus.cc:1685] finished
0709 12:13:18.736121 (+  6400us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:18.760812 (+ 24691us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":28746,"prepare.run_cpu_time_us":110,"prepare.run_wall_time_us":44,"raft.queue_time_us":2168,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":154,"spinlock_wait_cycles":3800960,"thread_start_us":110004,"threads_started":1,"wal-append.queue_time_us":303623}
W20260709 12:13:19.012223 22164 consensus_meta.cc:287] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.550s	user 0.013s	sys 0.003s
I20260709 12:13:19.033360 13756 raft_consensus.cc:1275] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 12:13:19.004367 21986 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:19.004386 22199 raft_consensus.cc:2804] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:19.048820 13727 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:19.070880 13685 raft_consensus.cc:1275] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 14. (term mismatch)
I20260709 12:13:19.074041 13685 pending_rounds.cc:85] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 13
I20260709 12:13:19.074510 13685 pending_rounds.cc:107] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 20.14
I20260709 12:13:19.074870 13685 raft_consensus.cc:2889] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:19.075505 13685 pending_rounds.cc:107] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 22.15
I20260709 12:13:19.075830 13685 raft_consensus.cc:2889] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:19.003991 22188 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:19.067884 14409 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 22.
W20260709 12:13:19.085515 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 71783.4us
I20260709 12:13:19.088668 13726 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:19.010949 22034 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:19.015950 22162 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:19.042976 22098 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:19.035542 21935 consensus_queue.cc:1048] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.063s
I20260709 12:13:19.047426 22235 raft_consensus.cc:3055] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:19.114492 13726 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:19.067122 21742 raft_consensus.cc:2749] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:19.037251 22074 consensus_queue.cc:260] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:19.081307 22199 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:19.210214 22199 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:19.211303 22223 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:19.132449 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 93839.9us
I20260709 12:13:19.084460 22253 raft_consensus.cc:697] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 22 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:19.214735 22253 consensus_queue.cc:237] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:19.216817 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 189087us
I20260709 12:13:19.217761 13800 leader_election.cc:304] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:13:19.219201 22240 consensus_meta.cc:287] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.520s	user 0.014s	sys 0.000s
I20260709 12:13:19.219643 22240 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:19.222589 21932 raft_consensus.cc:2804] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:19.223448 21932 raft_consensus.cc:697] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:19.224457 21932 consensus_queue.cc:237] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:19.106585 22034 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:19.178431 22248 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:19.100061 22047 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:19.132388 21893 raft_consensus.cc:2749] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:13:19.187057 13754 raft_consensus.cc:1240] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:19.080250 21986 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:19.194398 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 103798us
I20260709 12:13:19.247174 13726 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:19.196120 22162 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:19.197413 22188 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:19.209214 22149 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:19.178485 22261 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:19.243486 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:13:19.248535 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 199804us
I20260709 12:13:19.249696 13829 raft_consensus.cc:1240] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 27. Current term is 28. Ops: []
I20260709 12:13:19.256300 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:19.257030 14407 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 23.
I20260709 12:13:19.234853 21452 raft_consensus.cc:2804] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:19.271407 13727 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:19.273331 13727 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:19.187590 22235 raft_consensus.cc:740] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 24 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:19.277863 13727 leader_election.cc:304] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:19.289264 13828 raft_consensus.cc:1275] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 12:13:19.291247 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:19.249213 21926 raft_consensus.cc:2764] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Leader election decision vote started in defunct term 28: won
I20260709 12:13:19.294888 13800 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:19.252388 22240 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:19.299266 13801 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:19.276206 22047 consensus_queue.cc:1048] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.026s
I20260709 12:13:19.301326 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:19.302353 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:19.256486 22248 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:19.263590 22149 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:19.401700 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:19.545161 13835 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:19.545514 14407 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 21.
I20260709 12:13:19.226854 13577 catalog_manager.cc:5697] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 18 to 20, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 20 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:19.271189 21742 raft_consensus.cc:2804] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:19.276106 22034 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:19.358995 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 93812.6us
I20260709 12:13:19.411139 14379 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:19.284358 21956 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:13:19.284600 22254 raft_consensus.cc:2749] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:13:19.409088 22269 log.cc:927] Time spent T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
W20260709 12:13:19.448390 22191 log.cc:927] Time spent T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:13:19.275326 21452 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:19.297428 22101 consensus_queue.cc:1059] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.287s
I20260709 12:13:19.599712 14409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41700 (request call id 1240) took 1091 ms. Trace:
I20260709 12:13:19.359144 22252 raft_consensus.cc:2749] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:19.483691 22028 raft_consensus.cc:2804] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:13:19.600126 14409 rpcz_store.cc:276] 0709 12:13:18.507938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:18.519868 (+ 11930us) service_pool.cc:224] Handling call
0709 12:13:19.599538 (+1079670us) spinlock_profiling.cc:243] Waited 524 ms on lock 0x7b54004b41d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:19.599657 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1204370816}
I20260709 12:13:19.426208 22099 raft_consensus.cc:3055] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 20 LEADER]: Stepping down as leader of term 20
W20260709 12:13:19.582589 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 171591us
I20260709 12:13:19.585676 22034 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:19.649900 22149 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:19.652017 22034 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:19.648494 22099 raft_consensus.cc:740] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:19.654191 22271 consensus_queue.cc:1048] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:13:19.646399 13684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 3778) took 1323 ms. Trace:
I20260709 12:13:19.419404 21986 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:19.589989 22233 raft_consensus.cc:2749] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:13:19.590987 22015 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:19.599251 21742 raft_consensus.cc:697] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:19.378340 22223 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:19.573941 22068 raft_consensus.cc:2749] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:13:19.642418 22215 raft_consensus.cc:2749] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:19.359622 22249 raft_consensus.cc:2804] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 12:13:19.600926 13652 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 1.639s (SENT) [suppressed 27 similar messages]
I20260709 12:13:19.622869 22228 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:19.606670 21452 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:19.580569 21893 consensus_queue.cc:1048] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.067s
I20260709 12:13:19.276831 22261 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:19.614603 21956 raft_consensus.cc:697] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:19.392210 22236 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:19.644531 22213 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:19.668561 22162 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:19.678923 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:19.666239 22028 raft_consensus.cc:697] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:19.655462 13684 rpcz_store.cc:276] 0709 12:13:18.318014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:18.322115 (+  4101us) service_pool.cc:224] Handling call
0709 12:13:18.322486 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:18.322893 (+   407us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:18.322921 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:18.323491 (+   570us) log.cc:844] Serialized 26 byte log entry
0709 12:13:18.590321 (+266830us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:13:19.002294 (+411973us) log.cc:844] Serialized 14 byte log entry
0709 12:13:19.641219 (+638925us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:19.641313 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:19.641361 (+    48us) raft_consensus.cc:1685] finished
0709 12:13:19.641372 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:19.641518 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":674704,"prepare.queue_time_us":104401,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":3529,"raft.queue_time_us":642342,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":76,"thread_start_us":577874,"threads_started":2,"wal-append.queue_time_us":436111}
I20260709 12:13:19.657539 22188 consensus_queue.cc:1048] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.028s
I20260709 12:13:19.670113 21986 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:19.673961 22249 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:19.687928 13754 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 20.
I20260709 12:13:19.697301 13836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 3925) took 1279 ms. Trace:
I20260709 12:13:19.591398 13577 catalog_manager.cc:5697] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 15 to 18, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 18 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
W20260709 12:13:19.699496 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 1.08573e+06us
I20260709 12:13:19.693434 13686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 3764) took 1581 ms. Trace:
I20260709 12:13:19.682199 22098 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:19.688151 22220 raft_consensus.cc:2749] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:19.702579 13836 rpcz_store.cc:276] 0709 12:13:18.418399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:18.441055 (+ 22656us) service_pool.cc:224] Handling call
0709 12:13:18.446780 (+  5725us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:18.935660 (+488880us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:18.935708 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:18.936459 (+   751us) log.cc:844] Serialized 26 byte log entry
0709 12:13:19.016359 (+ 79900us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:13:19.016413 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:19.016495 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:19.697066 (+680571us) raft_consensus.cc:1685] finished
0709 12:13:19.697089 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:19.697238 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2850,"raft.queue_time_us":487359,"raft.run_cpu_time_us":65,"raft.run_wall_time_us":65,"thread_start_us":564942,"threads_started":2,"wal-append.queue_time_us":176735}
W20260709 12:13:19.712970 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 69194.7us
I20260709 12:13:19.669224 22015 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:19.712850 22234 log.cc:927] Time spent T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:13:19.716970 22259 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:19.717813 22259 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:19.718822 22015 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:19.720918 22259 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:19.721380 22248 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:13:19.721747 22257 log.cc:927] Time spent T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.415s	user 0.002s	sys 0.000s
I20260709 12:13:19.722654 22273 raft_consensus.cc:2804] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:19.722941 22261 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:19.723320 22273 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:19.723512 22235 consensus_queue.cc:260] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:19.724704 22267 log.cc:927] Time spent T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.318s	user 0.000s	sys 0.001s
W20260709 12:13:19.726176 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:19.723874 22273 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:19.733886 13835 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 26.
W20260709 12:13:19.735123 22264 log.cc:927] Time spent T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:13:19.715353 14379 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:19.696941 22213 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:19.737058 22096 raft_consensus.cc:2804] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:19.737574 22096 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:19.738008 22096 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:19.738737 22213 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:19.738824 22273 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:19.705689 22249 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:19.746814 13577 catalog_manager.cc:5697] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 16 to 18, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 18 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:13:19.697849 22162 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:19.750012 22096 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:19.752308 21742 consensus_queue.cc:237] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.16, Last appended by leader: 16, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:19.680539 22228 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:19.756230 22228 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:19.758051 22212 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:19.758882 22212 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:19.761919 21956 consensus_queue.cc:237] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 17, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:19.771894 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 65946.2us
I20260709 12:13:19.703900 13686 rpcz_store.cc:276] 0709 12:13:18.112059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:18.114027 (+  1968us) service_pool.cc:224] Handling call
0709 12:13:18.151008 (+ 36981us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:18.168699 (+ 17691us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:18.168740 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:18.210863 (+ 42123us) log.cc:844] Serialized 26 byte log entry
0709 12:13:18.541697 (+330834us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:13:18.603659 (+ 61962us) log.cc:844] Serialized 14 byte log entry
0709 12:13:19.487134 (+883475us) spinlock_profiling.cc:243] Waited 7.61 ms on lock 0x7b180046dc80. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e1ac0a 00007fa92e55a219 00007fa924ea2a40 00007fa924e9d4e4 00007fa924e9d455 00007fa927f85060 00007fa927f97716 00007fa927fa8287 00007fa927fa8208
0709 12:13:19.683914 (+196780us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:19.684233 (+   319us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:19.684303 (+    70us) raft_consensus.cc:1685] finished
0709 12:13:19.693080 (+  8777us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:19.693300 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":93889,"prepare.queue_time_us":76399,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":58,"raft.queue_time_us":993230,"raft.run_cpu_time_us":404,"raft.run_wall_time_us":35258,"spinlock_wait_cycles":17509632,"thread_start_us":513716,"threads_started":2,"wal-append.queue_time_us":485734}
I20260709 12:13:19.773062 13651 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:19.692834 22236 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:19.703341 21986 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:19.781028 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:19.781869 13836 raft_consensus.cc:1275] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260709 12:13:19.783099 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:19.784112 13832 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 20.
I20260709 12:13:19.781819 13831 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 26.
W20260709 12:13:19.791394 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:19.796415 13829 raft_consensus.cc:1275] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:13:19.810271 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:19.806222 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:19.811846 13756 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 27.
I20260709 12:13:19.813136 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:19.778053 22015 raft_consensus.cc:2804] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:19.776631 22212 leader_election.cc:290] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:19.823207 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:19.773931 22213 consensus_queue.cc:1048] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 12:13:19.815706 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:19.814670 13831 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 23.
I20260709 12:13:19.833746 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:19.815364 13800 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:19.822464 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:19.776355 22256 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:19.834672 13683 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:19.835054 13756 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 20.
I20260709 12:13:19.839524 13832 raft_consensus.cc:2393] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 26: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:19.835399 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:19.840757 13681 raft_consensus.cc:1275] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
W20260709 12:13:19.843011 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 56187.9us
W20260709 12:13:19.826395 22251 log.cc:927] Time spent T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.180s	user 0.001s	sys 0.001s
I20260709 12:13:19.846558 13687 raft_consensus.cc:2393] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 21: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:19.817677 22233 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:19.818941 22015 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:19.838375 22068 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:19.855027 13683 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 26.
I20260709 12:13:19.855072 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:19.858408 13688 raft_consensus.cc:1275] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 12:13:19.850170 13651 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:19.860743 22284 raft_consensus.cc:2804] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:19.860960 13651 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:19.861377 22284 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:19.858448 13682 raft_consensus.cc:1275] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 12:13:19.861924 22157 raft_consensus.cc:2804] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:19.861969 22284 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:19.862529 22157 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:19.862978 22157 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:19.816732 22028 consensus_queue.cc:237] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:19.842350 22232 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:19.808884 21452 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:19.817025 21935 consensus_queue.cc:1048] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 12:13:19.846665 22248 raft_consensus.cc:2764] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election decision vote started in defunct term 24: won
I20260709 12:13:19.872252 13800 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:19.875494 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:19.878090 21986 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:19.858286 22015 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:19.855327 22098 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:19.897032 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 296112us
I20260709 12:13:19.898124 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:19.899633 13652 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:13:19.899236 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 81228us
I20260709 12:13:19.902361 13727 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:19.909641 13829 raft_consensus.cc:2393] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 18: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:19.911283 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:19.908669 13727 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:19.917934 13757 raft_consensus.cc:1240] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 LEADER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 27. Current term is 28. Ops: []
I20260709 12:13:19.921049 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:19.889377 22227 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:19.921021 13680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 1670) took 1509 ms. Trace:
I20260709 12:13:19.924662 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:19.925463 13688 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:19.853154 22256 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:19.912737 22212 raft_consensus.cc:2749] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:13:19.880309 22232 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:19.916465 22213 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:19.859504 22233 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:19.889281 21986 consensus_queue.cc:1048] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 12:13:19.912319 22188 raft_consensus.cc:2804] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:19.923532 13680 rpcz_store.cc:276] 0709 12:13:18.411184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:18.420871 (+  9687us) service_pool.cc:224] Handling call
0709 12:13:18.437380 (+ 16509us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:18.477664 (+ 40284us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:18.477713 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:18.478379 (+   666us) log.cc:844] Serialized 26 byte log entry
0709 12:13:18.691749 (+213370us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:13:18.691800 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:18.691883 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:19.920784 (+1228901us) raft_consensus.cc:1685] finished
0709 12:13:19.920805 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:19.920959 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17692,"raft.queue_time_us":23864,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":22736,"thread_start_us":200826,"threads_started":1,"wal-append.queue_time_us":973270}
I20260709 12:13:19.903132 22068 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:19.993180 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:13:19.992956 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 103984us
I20260709 12:13:19.981000 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:19.993985 13800 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:20.003053 14415 raft_consensus.cc:2393] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 22: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:13:19.920408 22098 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:19.925393 22280 consensus_queue.cc:1048] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.202s
I20260709 12:13:19.943362 22222 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:19.923002 21956 consensus_queue.cc:1048] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.039s
W20260709 12:13:20.007437 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 45895.2us
I20260709 12:13:20.009688 22281 raft_consensus.cc:2804] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:20.011085 22280 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:20.012023 22236 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:19.998857 22212 consensus_queue.cc:1059] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.051s
I20260709 12:13:20.009300 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:20.035436 13726 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:20.049729 22280 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:19.994820 22188 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:20.049103 22074 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:20.046043 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:19.998281 22028 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:19.927887 22227 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:20.002904 22228 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:19.945358 22213 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:20.075305 13800 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:19.943854 22282 consensus_queue.cc:1059] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.250s
I20260709 12:13:20.035264 22223 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:20.095440 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:20.058784 22188 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:20.062680 22222 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:20.098206 22291 raft_consensus.cc:2804] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:20.100476 22218 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:20.101285 22218 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:20.102339 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:20.102216 22292 consensus_queue.cc:1048] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.050s
I20260709 12:13:20.103144 13684 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 23.
I20260709 12:13:20.104010 22218 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:20.104251 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:13:20.104733 22296 log.cc:927] Time spent T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.057s	user 0.002s	sys 0.000s
I20260709 12:13:20.100622 22222 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:20.107812 22273 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 24 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:20.062319 21935 raft_consensus.cc:2804] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:20.050704 22212 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:20.116104 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:20.096422 14415 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 22.
I20260709 12:13:20.076524 22259 raft_consensus.cc:2804] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:13:20.120546 13762 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:20.116209 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:13:20.123410 22199 consensus_meta.cc:287] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.912s	user 0.012s	sys 0.003s
I20260709 12:13:20.117766 22290 raft_consensus.cc:3055] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:20.113322 21935 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:20.232968 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:20.245990 13684 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 25.
W20260709 12:13:20.250057 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 163281us
I20260709 12:13:20.094985 22223 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:20.094560 22228 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:20.277143 13688 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 26.
W20260709 12:13:20.284094 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 230317us
I20260709 12:13:20.285307 13800 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:20.112730 22028 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:20.246454 22149 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:20.209693 22259 raft_consensus.cc:697] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 29 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:20.328681 22226 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:20.130949 22212 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:20.329337 22226 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:20.331941 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 46781.9us
I20260709 12:13:20.250527 21935 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:20.233212 22290 raft_consensus.cc:740] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:20.316586 22233 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:20.233212 13652 leader_election.cc:336] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 1.501s (SENT)
I20260709 12:13:20.299925 22261 raft_consensus.cc:2749] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:20.319103 22213 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:20.320596 22157 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:20.387693 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 154481us
I20260709 12:13:20.322165 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:20.326967 22149 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:20.260509 21452 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:20.356089 13762 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 24.
W20260709 12:13:20.244629 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 336082us
I20260709 12:13:20.369216 22280 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:20.369920 22256 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:20.370738 22232 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:20.372715 22228 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:20.373649 22068 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:20.374936 22261 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:20.405929 22261 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:20.407912 22249 consensus_meta.cc:287] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.665s	user 0.007s	sys 0.003s
I20260709 12:13:20.247041 21742 consensus_queue.cc:1048] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.098s
I20260709 12:13:20.409152 22261 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:20.380851 13800 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:13:20.410482 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 65500.4us
I20260709 12:13:20.411326 13800 leader_election.cc:400] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 22. Current term is 23.
I20260709 12:13:20.411600 13800 leader_election.cc:403] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:13:20.389142 13652 leader_election.cc:336] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 1.681s (SENT)
I20260709 12:13:20.414124 13652 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:20.391592 13727 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:20.232079 22199 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:20.402086 22266 log.cc:927] Time spent T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:13:20.403535 22149 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:20.396803 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:20.416641 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:13:20.421968 22287 log.cc:927] Time spent T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.397s	user 0.001s	sys 0.000s
I20260709 12:13:20.329056 22259 consensus_queue.cc:237] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 27.16, Last appended by leader: 16, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:20.418553 13680 raft_consensus.cc:2393] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 22: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:20.447154 22212 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:20.447430 13800 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:13:20.448004 22015 consensus_meta.cc:287] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.536s	user 0.011s	sys 0.000s
I20260709 12:13:20.446759 22290 consensus_queue.cc:260] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:20.408383 22249 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:20.451229 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 29 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:13:20.451861 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 62795.4us
W20260709 12:13:20.468927 13652 leader_election.cc:336] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 1.792s (SENT)
W20260709 12:13:20.453862 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 362498us
I20260709 12:13:20.397207 22281 raft_consensus.cc:697] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:13:20.458540 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 67034.8us
W20260709 12:13:20.454059 22307 log.cc:927] Time spent T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
W20260709 12:13:20.472194 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 56053.1us
I20260709 12:13:20.473642 13801 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:20.468313 22015 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:20.477121 22028 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:20.478816 13760 raft_consensus.cc:2393] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 25: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:20.460624 22068 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:20.481891 13652 leader_election.cc:304] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:20.464547 22035 raft_consensus.cc:2804] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:20.491214 13828 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:20.461712 22261 raft_consensus.cc:2749] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:20.466634 22098 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:20.480604 13727 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:20.498638 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:20.499214 22227 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:20.499358 22281 consensus_queue.cc:237] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:20.498638 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:20.493132 22319 consensus_queue.cc:1048] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.015s
I20260709 12:13:20.493346 22248 raft_consensus.cc:2749] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:20.503217 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:20.498869 22280 raft_consensus.cc:2749] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:20.494738 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:20.495106 22320 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 22. Current term is 23.
I20260709 12:13:20.509632 13688 raft_consensus.cc:1275] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:13:20.502266 22028 consensus_queue.cc:1048] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.008s
I20260709 12:13:20.505029 14415 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 31.
I20260709 12:13:20.482601 22015 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:20.520195 13688 raft_consensus.cc:1275] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
W20260709 12:13:20.530947 22288 log.cc:927] Time spent T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.198s	user 0.004s	sys 0.000s
I20260709 12:13:20.531071 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:20.534016 22098 consensus_queue.cc:1048] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:13:20.535944 22098 raft_consensus.cc:2804] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:20.536437 22098 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:20.536861 22098 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:20.538378 22249 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:20.539491 22249 raft_consensus.cc:2749] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:20.540422 22319 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:20.540548 22249 raft_consensus.cc:2804] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:20.541157 22249 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:20.494004 22035 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:20.520165 22199 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:20.529670 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 48934.9us
I20260709 12:13:20.546305 22035 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:20.555687 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:13:20.568216 22299 log.cc:927] Time spent T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.246s	user 0.000s	sys 0.002s
I20260709 12:13:20.568948 22313 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:20.569592 22313 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:20.573818 22300 log.cc:927] Time spent T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.247s	user 0.001s	sys 0.001s
I20260709 12:13:20.574762 13686 raft_consensus.cc:1240] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 20. Current term is 21. Ops: []
W20260709 12:13:20.576141 22074 consensus_meta.cc:287] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.514s	user 0.011s	sys 0.000s
I20260709 12:13:20.576833 13684 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 18.
I20260709 12:13:20.574677 22157 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:13:20.562706 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:20.558456 13727 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:20.541069 22319 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:20.588858 13828 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 24.
I20260709 12:13:20.594357 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:20.586886 14379 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:20.521190 22290 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:20.541754 22249 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:20.607370 13759 raft_consensus.cc:1240] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 24. Current term is 25. Ops: [24.18-24.18]
W20260709 12:13:20.587750 22284 consensus_meta.cc:287] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.725s	user 0.014s	sys 0.000s
I20260709 12:13:20.636520 22284 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:20.637890 13682 raft_consensus.cc:2393] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 28: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:20.639072 22284 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:20.640220 22156 raft_consensus.cc:2804] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Leader election won for term 24
W20260709 12:13:20.641763 22305 log.cc:927] Time spent T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.313s	user 0.001s	sys 0.001s
I20260709 12:13:20.647591 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 24 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:20.648744 13683 raft_consensus.cc:2393] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 25: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:20.626116 22047 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:20.628211 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:20.606602 22318 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:20.626914 13652 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:20.651002 22047 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:20.651647 22318 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:20.653749 22319 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:20.654152 22318 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:20.654670 22074 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:20.655324 22074 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:20.654973 21957 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:13:20.656603 21957 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:20.657002 21957 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:20.578131 22313 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:20.558411 22199 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:13:20.660580 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 187005us
I20260709 12:13:20.594916 21956 raft_consensus.cc:2749] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:13:20.660876 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 30 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:20.660441 14415 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 23.
I20260709 12:13:20.660465 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:20.680464 13688 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 29.
I20260709 12:13:20.683670 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:20.685272 22238 raft_consensus.cc:3055] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:13:20.685659 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:20.686089 22238 raft_consensus.cc:740] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:20.681639 13683 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 25.
I20260709 12:13:20.668397 22222 raft_consensus.cc:3055] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:13:20.691920 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 30 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:20.604020 22280 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:20.696417 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:20.697849 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:20.698899 22280 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:20.699604 13837 raft_consensus.cc:2393] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 23: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
W20260709 12:13:20.676020 22188 consensus_meta.cc:287] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.541s	user 0.010s	sys 0.000s
I20260709 12:13:20.657678 22074 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:20.702201 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:13:20.702996 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 255692us
I20260709 12:13:20.706686 13829 raft_consensus.cc:2393] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 26: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:20.706875 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:20.707141 13832 raft_consensus.cc:1275] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
W20260709 12:13:20.705633 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 77364.8us
I20260709 12:13:20.690706 22222 raft_consensus.cc:740] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:20.709437 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:20.709362 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:20.597198 21935 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:20.669699 22047 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:20.718547 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:20.673060 22068 raft_consensus.cc:2749] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:20.760012 13829 raft_consensus.cc:2410] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 26 because replica has last-logged OpId of term: 23 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 13.
I20260709 12:13:20.761526 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:20.765972 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:20.766136 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:20.767292 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 24 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:13:20.767151 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 73395us
I20260709 12:13:20.770285 14411 raft_consensus.cc:2393] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 22: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:13:20.687445 22238 consensus_queue.cc:260] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:20.772243 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 54428.8us
I20260709 12:13:20.785526 13683 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:20.787698 13837 raft_consensus.cc:1275] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 29 index: 16. (index mismatch)
I20260709 12:13:20.789683 13833 raft_consensus.cc:3055] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:20.790179 13833 raft_consensus.cc:740] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:20.792466 13832 raft_consensus.cc:3055] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:20.792977 13832 raft_consensus.cc:740] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:20.793967 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:20.794742 13688 raft_consensus.cc:2393] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 23: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:20.759268 22074 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:20.711603 22188 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:20.799786 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:20.707868 22199 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:20.792080 22130 raft_consensus.cc:3055] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:13:20.812304 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:20.818075 13683 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 24.
I20260709 12:13:20.804828 22074 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:20.821308 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:20.859820 13829 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 25.
I20260709 12:13:20.821372 13833 consensus_queue.cc:260] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:20.825263 21957 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 31 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:20.826400 22028 consensus_queue.cc:1048] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:13:20.872153 22074 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:20.873023 22028 consensus_queue.cc:1243] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer 96701a74fdee481fb5f54aac841e17dd log is divergent from this leader: its last log entry 20.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:13:20.830936 22223 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:20.831627 22276 consensus_queue.cc:1048] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:20.847393 22280 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:20.847640 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:20.848150 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:20.848278 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:20.849162 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:20.850912 22096 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:20.853067 22235 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:20.858243 13726 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:20.862159 13727 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:20.894430 13829 raft_consensus.cc:1275] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 28 index: 18. (index mismatch)
I20260709 12:13:20.864459 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:20.856668 21328 consensus_queue.cc:1048] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:13:20.897002 21328 consensus_queue.cc:1243] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer b98d2519bb504dc6905ed2ede4571835 log is divergent from this leader: its last log entry 21.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:13:20.868108 13679 raft_consensus.cc:1275] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 29 index: 16. (index mismatch)
I20260709 12:13:20.855458 22130 raft_consensus.cc:740] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 27 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:20.859613 22156 raft_consensus.cc:697] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 24 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
W20260709 12:13:20.870322 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 156013us
I20260709 12:13:20.872138 21957 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 31 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:20.872438 13833 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:20.882258 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:20.910099 13758 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 25.
W20260709 12:13:20.885346 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:20.884789 13763 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 22.
I20260709 12:13:20.886859 13754 raft_consensus.cc:2393] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 31: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:20.899755 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:20.903542 13800 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:20.769906 22222 consensus_queue.cc:260] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.15, Last appended by leader: 15, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:20.879092 22238 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:20.913802 22156 consensus_queue.cc:237] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:20.915520 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 57372.7us
I20260709 12:13:20.915272 21328 raft_consensus.cc:2749] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:13:20.918991 13800 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:20.880343 22226 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:20.925040 13726 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:20.930400 22130 consensus_queue.cc:260] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 27.18, Last appended by leader: 18, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:20.931903 22130 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:20.867928 21956 consensus_queue.cc:1048] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 12:13:20.944537 13726 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:20.949330 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:20.950027 13755 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:20.951248 21328 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:20.953527 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:20.952095 21328 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:20.961948 13726 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:20.967973 21328 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:20.970281 22162 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:20.971731 13755 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 23.
I20260709 12:13:20.973760 22149 raft_consensus.cc:2804] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:20.974444 22149 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:20.974925 22149 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:20.954363 22313 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:20.936342 22261 raft_consensus.cc:2804] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:13:20.988672 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 69796.1us
I20260709 12:13:20.989569 13800 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:20.984851 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:21.003964 13833 raft_consensus.cc:1275] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:13:21.007687 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:21.008483 13755 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Advancing to term 22
W20260709 12:13:21.009260 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 47475.7us
I20260709 12:13:21.010682 13726 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:20.922871 22310 consensus_queue.cc:1048] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.066s
I20260709 12:13:20.997234 22035 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:21.014235 13683 raft_consensus.cc:1275] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
I20260709 12:13:21.016037 22047 raft_consensus.cc:2749] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:13:21.017117 22326 log.cc:927] Time spent T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.302s	user 0.001s	sys 0.000s
I20260709 12:13:21.020539 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:13:21.027637 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:21.028402 14412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41700 (request call id 1245) took 1718 ms. Trace:
I20260709 12:13:21.046160 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:21.029850 13755 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 22.
I20260709 12:13:21.013912 22276 raft_consensus.cc:2804] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:13:21.036824 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:21.003770 22323 raft_consensus.cc:2749] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:13:21.048719 14412 rpcz_store.cc:276] 0709 12:13:19.309418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:19.409323 (+ 99905us) service_pool.cc:224] Handling call
0709 12:13:19.409719 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:19.811102 (+401383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:19.811135 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:19.811178 (+    43us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:13:19.811223 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:21.027906 (+1216683us) spinlock_profiling.cc:243] Waited 401 ms on lock 0x7b540059e554. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:21.027981 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:21.028181 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":922586368}
I20260709 12:13:21.002409 22261 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:21.056115 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:21.012256 22281 raft_consensus.cc:2804] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:21.064513 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:21.066372 13755 raft_consensus.cc:2393] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 28: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:21.055578 22276 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:21.057139 21935 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:21.060457 22324 raft_consensus.cc:2749] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:21.063266 22261 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:21.094884 13686 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 26.
I20260709 12:13:21.096649 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 30 candidate_status { last_received { term: 29 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:21.082666 22276 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Advancing to term 30
W20260709 12:13:21.099125 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 109629us
W20260709 12:13:21.104280 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 141037us
W20260709 12:13:21.101867 22327 log.cc:927] Time spent T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.402s	user 0.003s	sys 0.002s
I20260709 12:13:21.115984 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:21.121121 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 32 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:21.096215 22188 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:21.121960 14409 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 31.
I20260709 12:13:21.135659 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:21.135872 22291 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:21.136646 13837 pending_rounds.cc:85] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 13
I20260709 12:13:21.137049 13837 pending_rounds.cc:107] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 20.14
I20260709 12:13:21.137318 13837 raft_consensus.cc:2889] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:21.138075 13685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 1689) took 1006 ms. Trace:
I20260709 12:13:21.138509 13685 rpcz_store.cc:276] 0709 12:13:20.131914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:20.587926 (+456012us) service_pool.cc:224] Handling call
0709 12:13:20.607838 (+ 19912us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:20.632798 (+ 24960us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:20.632849 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:20.633470 (+   621us) log.cc:844] Serialized 26 byte log entry
0709 12:13:20.946107 (+312637us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:13:20.946154 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:20.946227 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:21.137851 (+191624us) raft_consensus.cc:1685] finished
0709 12:13:21.137874 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:21.138007 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24536,"raft.queue_time_us":27940,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":100,"thread_start_us":254759,"threads_started":1,"wal-append.queue_time_us":471003}
I20260709 12:13:21.140321 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:21.141098 13754 raft_consensus.cc:2393] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 22: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:21.142280 13727 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:21.143918 22256 raft_consensus.cc:2749] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:21.143968 13727 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:21.145428 22310 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:21.146042 22281 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:21.146616 22281 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:21.136386 22291 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:21.154968 13800 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:21.155658 22256 consensus_queue.cc:1048] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:13:21.155973 13832 consensus_queue.cc:260] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.16, Last appended by leader: 16, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:21.156965 13832 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:21.160985 22199 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:21.189850 13800 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:21.210217 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:13:21.212052 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:21.222687 13680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48212 (request call id 1683) took 1274 ms. Trace:
I20260709 12:13:21.223428 13680 rpcz_store.cc:276] 0709 12:13:19.947852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:20.006332 (+ 58480us) service_pool.cc:224] Handling call
0709 12:13:21.222325 (+1215993us) spinlock_profiling.cc:243] Waited 358 ms on lock 0x7b54002c4054. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:21.222575 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":822344064}
I20260709 12:13:21.229759 13759 raft_consensus.cc:2393] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 31: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
W20260709 12:13:21.194175 22304 log.cc:927] Time spent T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.868s	user 0.002s	sys 0.001s
I20260709 12:13:21.234176 22035 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:21.234964 13760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48114 (request call id 3693) took 1409 ms. Trace:
I20260709 12:13:21.236564 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 32 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:21.259562 13684 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 31.
I20260709 12:13:21.237268 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:13:21.238240 22275 log.cc:927] Time spent T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 1.596s	user 0.013s	sys 0.025s
W20260709 12:13:21.244701 22249 consensus_meta.cc:287] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.547s	user 0.002s	sys 0.007s
I20260709 12:13:21.257102 22281 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:21.247653 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:21.162827 22248 raft_consensus.cc:2749] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:13:21.252492 13832 raft_consensus.cc:1275] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 26 index: 16. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
W20260709 12:13:21.254142 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 96469.8us
W20260709 12:13:21.263407 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 73298.2us
I20260709 12:13:21.258247 13760 rpcz_store.cc:276] 0709 12:13:19.807083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:19.807236 (+   153us) service_pool.cc:224] Handling call
0709 12:13:21.216141 (+1408905us) spinlock_profiling.cc:243] Waited 641 ms on lock 0x7b54003a07d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:21.216372 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1477071104}
W20260709 12:13:21.213754 22337 log.cc:927] Time spent T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:13:21.129360 22322 consensus_queue.cc:1059] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.102s
I20260709 12:13:21.232944 22259 raft_consensus.cc:2749] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:13:21.322922 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:21.357131 22098 consensus_meta.cc:287] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.820s	user 0.016s	sys 0.003s
I20260709 12:13:21.400983 13756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 3700) took 1491 ms. Trace:
I20260709 12:13:21.299777 22249 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:21.359067 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 58451.2us
I20260709 12:13:21.375229 22254 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:21.401686 13756 rpcz_store.cc:276] 0709 12:13:19.909165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:19.909310 (+   145us) service_pool.cc:224] Handling call
0709 12:13:19.909662 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:19.910005 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:19.910033 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:19.910467 (+   434us) log.cc:844] Serialized 26 byte log entry
0709 12:13:20.006520 (+ 96053us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:13:20.006653 (+   133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:20.006843 (+   190us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:21.162452 (+1155609us) spinlock_profiling.cc:243] Waited 6.08 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:13:21.386801 (+224349us) raft_consensus.cc:1685] finished
0709 12:13:21.386837 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:21.400863 (+ 14026us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33264,"raft.queue_time_us":24942,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":41812,"spinlock_wait_cycles":13974272,"thread_start_us":61808,"threads_started":1,"wal-append.queue_time_us":204733}
I20260709 12:13:21.426489 13800 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:21.437492 22281 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:21.444213 13828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35422 (request call id 1657) took 1029 ms. Trace:
I20260709 12:13:21.444662 13828 rpcz_store.cc:276] 0709 12:13:20.415230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:20.415406 (+   176us) service_pool.cc:224] Handling call
0709 12:13:21.444007 (+1028601us) spinlock_profiling.cc:243] Waited 31.7 ms on lock 0x7b54000da554. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:21.444130 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":73011968}
I20260709 12:13:21.454624 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:21.455302 13828 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Advancing to term 28
I20260709 12:13:21.456112 22149 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:21.459797 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:21.460491 14409 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 22.
I20260709 12:13:21.429522 22047 consensus_queue.cc:1048] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.036s
I20260709 12:13:21.429204 21935 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:21.463495 21935 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:21.428926 22285 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:21.466259 22285 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:21.468334 22285 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:21.469367 13828 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 28.
W20260709 12:13:21.471926 22339 log.cc:927] Time spent T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 12:13:21.465562 21935 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:13:21.497745 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 71343.9us
I20260709 12:13:21.397620 22098 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:21.485649 22320 raft_consensus.cc:2764] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader election decision vote started in defunct term 25: won
I20260709 12:13:21.421545 22254 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:21.488703 22313 raft_consensus.cc:2749] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:21.512751 13800 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:21.515869 13762 raft_consensus.cc:1240] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:21.520462 13757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 1439) took 1852 ms. Trace:
I20260709 12:13:21.522953 13757 rpcz_store.cc:276] 0709 12:13:19.668152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:19.668304 (+   152us) service_pool.cc:224] Handling call
0709 12:13:19.668638 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:19.924546 (+255908us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:21.520103 (+1595557us) spinlock_profiling.cc:243] Waited 246 ms on lock 0x7b540009fe54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:21.520399 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":566667520}
I20260709 12:13:21.523766 22322 raft_consensus.cc:2749] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:13:21.535269 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:21.498708 22261 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:21.542806 13832 raft_consensus.cc:1275] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 26 index: 13. (index mismatch)
W20260709 12:13:21.540572 22130 consensus_meta.cc:287] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.608s	user 0.011s	sys 0.002s
I20260709 12:13:21.513410 22276 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:21.554994 14407 raft_consensus.cc:1275] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 27 index: 18. Preceding OpId from leader: term: 28 index: 18. (term mismatch)
I20260709 12:13:21.555454 14407 pending_rounds.cc:85] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f: Aborting all ops after (but not including) 17
I20260709 12:13:21.555719 14407 pending_rounds.cc:107] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f: Aborting uncommitted NO_OP operation due to leader change: 27.18
I20260709 12:13:21.556000 14407 raft_consensus.cc:2889] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:21.554277 13800 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:21.543424 22291 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:21.566040 22099 consensus_queue.cc:260] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:21.567703 22099 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:13:21.567996 22342 log.cc:927] Time spent T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 12:13:21.569304 22291 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:21.560004 22320 raft_consensus.cc:2749] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:13:21.569758 22343 log.cc:927] Time spent T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 12:13:21.578840 22149 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:21.582037 22249 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:21.600756 13800 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:21.602077 22249 raft_consensus.cc:2749] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:21.603354 13800 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:21.605756 22320 raft_consensus.cc:2749] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:21.605867 13800 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:21.592617 22254 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:21.611016 22322 raft_consensus.cc:2749] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:21.611189 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:21.612041 13800 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:13:21.622582 22352 log.cc:927] Time spent T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:13:21.594746 22098 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:21.632651 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
W20260709 12:13:21.635088 22235 consensus_meta.cc:287] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.730s	user 0.009s	sys 0.004s
I20260709 12:13:21.635834 22164 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:21.636404 22164 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:21.646369 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:21.646654 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:21.647396 13757 raft_consensus.cc:2393] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 22: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:21.648468 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 32 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:21.649353 13761 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 31.
I20260709 12:13:21.649910 22322 raft_consensus.cc:2749] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:13:21.654664 22223 consensus_queue.cc:1048] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 12:13:21.654347 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:21.656672 22235 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:21.659771 22235 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:21.663913 14379 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:21.665817 22235 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:21.665915 13829 raft_consensus.cc:1240] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 17. Current term is 18. Ops: []
I20260709 12:13:21.666515 21986 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:21.667200 22276 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 30 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:21.667572 14379 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:21.667793 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:21.669148 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:21.671125 14413 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 22.
I20260709 12:13:21.671041 13830 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 24.
I20260709 12:13:21.673211 13801 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:21.627652 22261 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:21.675406 14380 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:21.679114 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:21.679894 13682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 3800) took 1791 ms. Trace:
I20260709 12:13:21.680295 13682 rpcz_store.cc:276] 0709 12:13:19.888432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:19.961316 (+ 72884us) service_pool.cc:224] Handling call
0709 12:13:21.679682 (+1718366us) spinlock_profiling.cc:243] Waited 587 ms on lock 0x7b540021f554. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:21.679835 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1349694336}
I20260709 12:13:21.670410 22164 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:21.674356 22249 raft_consensus.cc:2804] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:21.685199 13761 raft_consensus.cc:1240] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 21. Current term is 22. Ops: []
W20260709 12:13:21.686146 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:21.682830 21986 raft_consensus.cc:2749] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:13:21.681540 22271 raft_consensus.cc:2804] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:21.687897 22271 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:21.688340 22271 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:13:21.689006 22302 log.cc:927] Time spent T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 1.235s	user 0.000s	sys 0.004s
I20260709 12:13:21.698736 13835 raft_consensus.cc:1275] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 24 index: 19. (index mismatch)
I20260709 12:13:21.684499 14379 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:21.709520 13726 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:21.709395 22276 consensus_queue.cc:1048] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:21.712746 22319 raft_consensus.cc:2804] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:21.713323 22319 raft_consensus.cc:697] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:21.710091 22249 raft_consensus.cc:697] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 22 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:21.683214 22239 consensus_queue.cc:1059] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.028s
I20260709 12:13:21.714283 22319 consensus_queue.cc:237] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:21.714756 22239 raft_consensus.cc:3055] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:13:21.714686 22249 consensus_queue.cc:237] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:21.715338 22239 raft_consensus.cc:740] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:21.715615 14415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41692 (request call id 1261) took 1022 ms. Trace:
I20260709 12:13:21.718930 13726 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:21.716032 14415 rpcz_store.cc:276] 0709 12:13:20.693493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:20.701469 (+  7976us) service_pool.cc:224] Handling call
0709 12:13:21.715382 (+1013913us) spinlock_profiling.cc:243] Waited 735 ms on lock 0x7b54006b0154. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:21.715525 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1690679552}
I20260709 12:13:21.720345 22239 consensus_queue.cc:260] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:21.711680 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:21.721815 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:21.722666 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:21.721736 22239 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:21.729094 22222 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:21.722554 22035 consensus_queue.cc:1048] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:13:21.733464 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:21.734459 13682 raft_consensus.cc:2410] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 22 because replica has last-logged OpId of term: 21 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 16.
I20260709 12:13:21.737332 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: true dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:21.738209 13687 raft_consensus.cc:2368] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 25. Current term is 26.
I20260709 12:13:21.737401 13651 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:13:21.742810 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 59041.2us
I20260709 12:13:21.745944 13651 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:21.747112 22096 consensus_queue.cc:1048] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
W20260709 12:13:21.741979 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 88424.5us
I20260709 12:13:21.749145 14379 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
W20260709 12:13:21.719722 22356 log.cc:927] Time spent T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 12:13:21.753073 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:21.755283 14379 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:21.756768 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:21.758008 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:21.758136 13651 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:21.747992 22068 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:21.763810 22164 raft_consensus.cc:2804] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:21.764832 22164 raft_consensus.cc:697] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 26 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:21.766031 22164 consensus_queue.cc:237] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:21.770411 14379 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:21.774308 22330 raft_consensus.cc:2804] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:21.774523 22162 raft_consensus.cc:2804] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:13:21.774921 22330 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:21.775072 22162 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:21.775604 22162 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:21.775501 22330 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:21.751662 22130 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:13:21.779862 22130 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 31 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:21.780265 22130 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:13:21.757453 13681 raft_consensus.cc:2376] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 29. Re-sending same reply.
I20260709 12:13:21.770736 13575 maintenance_manager.cc:419] P 17d79eae88f84be7a847d0cf544674cd: Scheduling FlushDeltaMemStoresOp(00000000000000000000000000000000): perf score=0.033367
I20260709 12:13:21.788810 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:21.790623 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:21.791324 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:21.790719 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:21.789511 13834 raft_consensus.cc:2376] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 25. Re-sending same reply.
I20260709 12:13:21.777669 13651 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:21.782723 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:21.783267 13829 raft_consensus.cc:1240] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 22 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:21.751592 22035 raft_consensus.cc:2804] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:21.782128 22222 raft_consensus.cc:2804] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:21.780836 22248 raft_consensus.cc:3055] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:21.751560 22238 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:21.794086 13828 raft_consensus.cc:2368] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 25. Current term is 26.
I20260709 12:13:21.798302 22035 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:21.799746 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:21.811976 13651 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:21.803637 22248 raft_consensus.cc:740] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:21.840270 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:21.842186 13651 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:21.799551 22222 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:21.847604 13829 raft_consensus.cc:1240] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:21.850138 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:21.855377 13762 raft_consensus.cc:1275] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 16. (term mismatch)
I20260709 12:13:21.855801 13762 pending_rounds.cc:85] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting all ops after (but not including) 15
I20260709 12:13:21.856020 13762 pending_rounds.cc:107] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting uncommitted NO_OP operation due to leader change: 23.16
I20260709 12:13:21.856307 13762 raft_consensus.cc:2889] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:21.858454 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:21.808645 22035 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:21.864346 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:21.866667 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:21.868202 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:21.868772 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 29 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:21.870352 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:21.871099 13756 raft_consensus.cc:2368] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 23. Current term is 24.
I20260709 12:13:21.872607 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:21.843848 22068 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:21.845161 22212 raft_consensus.cc:2804] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:21.873371 13756 raft_consensus.cc:2368] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 22. Current term is 23.
I20260709 12:13:21.846719 22359 raft_consensus.cc:2749] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:21.882474 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:21.883324 13757 raft_consensus.cc:2393] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 22: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:21.875541 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:21.876546 13763 raft_consensus.cc:2393] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 26: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:21.876781 13680 raft_consensus.cc:2368] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 27. Current term is 28.
I20260709 12:13:21.880321 13761 raft_consensus.cc:1240] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 29. Current term is 30. Ops: []
I20260709 12:13:21.853606 22222 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:21.858276 22238 raft_consensus.cc:2804] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:21.886554 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:21.893404 13754 raft_consensus.cc:2368] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 23. Current term is 24.
I20260709 12:13:21.885977 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:21.895073 13829 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 22.
I20260709 12:13:21.878756 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:13:21.889010 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 98798.3us
I20260709 12:13:21.891265 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:21.896935 13762 raft_consensus.cc:2393] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 22: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
W20260709 12:13:21.904490 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:21.904429 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:21.905381 13832 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:21.911505 13829 raft_consensus.cc:1240] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:21.914178 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:21.914940 13763 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 25.
I20260709 12:13:21.916777 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:21.917683 13833 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:21.919802 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:21.920713 13836 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:21.929817 13756 raft_consensus.cc:1240] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:21.943246 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:21.944330 13831 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 21.
I20260709 12:13:21.886072 22212 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:21.951108 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:21.955246 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:21.946992 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:21.946424 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:21.949512 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:21.959617 13832 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 26.
I20260709 12:13:21.948066 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:21.963804 13834 raft_consensus.cc:2410] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 26 because replica has last-logged OpId of term: 24 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 17.
I20260709 12:13:21.952906 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:21.969147 13831 raft_consensus.cc:2393] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 28: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:21.970022 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:21.973001 14412 raft_consensus.cc:2368] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 21. Current term is 22.
I20260709 12:13:21.881134 22068 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:21.989122 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:21.995654 13837 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:21.853081 22248 consensus_queue.cc:260] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:22.003204 22248 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:22.005375 13831 raft_consensus.cc:1240] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 25. Current term is 26. Ops: []
W20260709 12:13:22.014237 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 50916.2us
I20260709 12:13:22.015331 13727 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:22.016440 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 30 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:21.964464 22212 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:13:22.023944 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:22.037238 13833 raft_consensus.cc:2410] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 26 because replica has last-logged OpId of term: 23 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 13.
I20260709 12:13:22.043833 13836 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 21.
I20260709 12:13:22.046690 13727 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:22.060599 13829 raft_consensus.cc:1240] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:22.071414 14408 raft_consensus.cc:1240] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 26 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:22.075438 22261 consensus_queue.cc:1059] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 25.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 12:13:22.076328 22261 consensus_queue.cc:1243] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer ca9fbbc2c0a94897897d502d42f3951f log is divergent from this leader: its last log entry 26.19 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 18
I20260709 12:13:22.076848 22261 raft_consensus.cc:3055] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:13:22.077181 22261 raft_consensus.cc:740] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:22.078210 22261 consensus_queue.cc:260] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:22.079552 22068 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:22.080283 22068 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:22.082391 22034 raft_consensus.cc:2749] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:22.082789 13727 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:22.083581 22199 raft_consensus.cc:2749] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:13:22.084515 14379 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:22.084777 13727 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:22.085621 22274 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:13:22.085774 22367 raft_consensus.cc:2749] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:22.086179 22274 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:22.086644 22274 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Advancing to term 32
W20260709 12:13:22.088275 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:22.094784 22363 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:22.095461 22363 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:22.097931 13727 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
W20260709 12:13:22.099419 22335 log.cc:927] Time spent T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:13:22.058931 22285 raft_consensus.cc:2749] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:22.080928 22068 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:22.109297 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:22.113235 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:22.079595 22261 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:22.118764 13727 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:22.124408 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:22.125265 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:22.134668 13836 raft_consensus.cc:2410] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 26 because replica has last-logged OpId of term: 23 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 13.
I20260709 12:13:22.097254 22330 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:22.123279 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:22.146822 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:22.115134 21935 raft_consensus.cc:2804] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:22.170976 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:22.101207 22274 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 32 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:22.110353 22238 raft_consensus.cc:697] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 23 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:22.179338 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:22.179113 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:13:22.199220 13800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:22.200352 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 55226.3us
I20260709 12:13:22.201208 22321 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:22.201910 22321 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:22.182188 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:22.187913 13837 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 24.
I20260709 12:13:22.189615 13756 raft_consensus.cc:1275] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 24 index: 19. (index mismatch)
I20260709 12:13:22.193938 13763 raft_consensus.cc:1240] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 22. Current term is 24. Ops: []
I20260709 12:13:22.206790 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:22.207551 13834 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:22.145385 22319 raft_consensus.cc:2804] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:13:22.117650 22276 consensus_queue.cc:1048] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.057s
I20260709 12:13:22.180117 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:22.170418 21935 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:22.215128 13829 raft_consensus.cc:2393] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 28: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:22.195115 22359 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:22.221300 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 30 candidate_status { last_received { term: 29 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:22.229442 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:13:22.231513 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:22.214975 21935 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:22.242340 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:22.249637 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:22.214855 22239 consensus_queue.cc:1048] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 15, Time since last communication: 0.029s
I20260709 12:13:22.255638 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:22.256528 13832 raft_consensus.cc:2393] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 18: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:22.230233 22319 raft_consensus.cc:697] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:22.255115 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:22.262018 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:22.257951 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:22.234277 22330 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:22.243125 22370 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:22.281996 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 23 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:22.284206 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:22.267649 13831 raft_consensus.cc:2393] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 28: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:22.243587 22363 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:22.303069 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:22.303660 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:13:22.304381 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:22.260182 22239 consensus_queue.cc:1243] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer 3f37c9cc9dda46b4be21dd675ba78fb7 log is divergent from this leader: its last log entry 21.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 12:13:22.317001 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:22.235078 22359 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:22.247763 22222 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:22.330644 13829 raft_consensus.cc:2393] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 24: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:22.306773 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:13:22.356909 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 113658us
I20260709 12:13:22.327368 22378 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:22.364620 22374 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:22.365362 22374 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:22.366460 22373 log.cc:927] Time spent T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 12:13:22.351217 22366 log.cc:927] Time spent T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
I20260709 12:13:22.299826 22238 consensus_queue.cc:237] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:22.371994 22371 log.cc:927] Time spent T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:13:22.304472 22370 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:22.379877 13651 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.008s	sys 0.014s
W20260709 12:13:22.380429 13651 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.008s	sys 0.014s
W20260709 12:13:22.380832 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 538694us
I20260709 12:13:22.381754 13651 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:22.367825 22374 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:22.360424 22375 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:22.390929 22375 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:22.384835 13681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d"
dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
mode: GRACEFUL
new_leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
 from {username='slave'} at 127.0.0.1:55008
W20260709 12:13:22.394899 22379 log.cc:927] Time spent T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 12:13:22.395354 13681 raft_consensus.cc:606] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 23 LEADER]: Received request to transfer leadership to TS 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:13:22.410892 13836 raft_consensus.cc:2410] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 26 because replica has last-logged OpId of term: 25 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 17.
I20260709 12:13:22.411152 13681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9"
dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
mode: GRACEFUL
new_leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
 from {username='slave'} at 127.0.0.1:55008
I20260709 12:13:22.411768 13681 raft_consensus.cc:606] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Received request to transfer leadership to TS 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:13:22.412180 13681 raft_consensus.cc:614] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:13:22.413494 22130 consensus_meta.cc:287] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.633s	user 0.008s	sys 0.004s
I20260709 12:13:22.414036 22130 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 32 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:22.415441 14415 raft_consensus.cc:2368] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 32 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 31. Current term is 32.
I20260709 12:13:22.422968 22359 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:22.421475 22162 consensus_meta.cc:287] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.645s	user 0.008s	sys 0.002s
W20260709 12:13:22.443971 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:22.407308 22375 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:22.453708 13834 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 23.
I20260709 12:13:22.375011 22380 consensus_queue.cc:1048] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.073s
I20260709 12:13:22.371066 22378 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:22.409343 22274 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 32 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:13:22.457947 22271 consensus_meta.cc:287] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.769s	user 0.006s	sys 0.007s
I20260709 12:13:22.459905 22212 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:22.471927 22370 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:22.472290 14408 raft_consensus.cc:1275] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 12:13:22.472939 22130 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 32 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:22.475871 22156 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:22.503271 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:22.445912 22374 raft_consensus.cc:2804] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:22.538477 22374 raft_consensus.cc:697] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 22 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:22.539433 22374 consensus_queue.cc:237] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:22.540962 21935 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:22.405890 22319 consensus_queue.cc:237] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.14, Last appended by leader: 14, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:22.448428 22162 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:22.543274 22370 consensus_queue.cc:1059] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 12:13:22.544107 22035 consensus_meta.cc:287] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.664s	user 0.012s	sys 0.000s
I20260709 12:13:22.521099 22271 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:22.546406 22212 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:22.546918 13680 raft_consensus.cc:1240] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:22.519588 22369 consensus_queue.cc:1059] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 23.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.029s
I20260709 12:13:22.548648 13681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612"
dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
mode: GRACEFUL
new_leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
 from {username='slave'} at 127.0.0.1:55008
I20260709 12:13:22.566396 13681 raft_consensus.cc:606] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Received request to transfer leadership to TS 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:13:22.566859 13681 raft_consensus.cc:614] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:13:22.568629 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 200901us
I20260709 12:13:22.577396 13727 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
W20260709 12:13:22.585502 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 74198.8us
I20260709 12:13:22.580683 13727 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:22.587782 13681 raft_consensus.cc:1217] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Deduplicated request from leader. Original: 18.11->[20.12-24.14]   Dedup: 20.12->[22.13-24.14]
I20260709 12:13:22.588574 14407 raft_consensus.cc:2393] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 26: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:13:22.561527 22359 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:22.584998 22383 raft_consensus.cc:2804] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:22.589859 13727 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:22.588318 13681 pending_rounds.cc:85] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 12
I20260709 12:13:22.594301 13681 pending_rounds.cc:107] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 21.13
I20260709 12:13:22.594604 13681 raft_consensus.cc:2889] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:22.569372 22375 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:22.569167 22378 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:22.597818 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:22.598471 13682 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:22.598294 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 32 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:22.598161 13727 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:22.599416 13687 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 31.
I20260709 12:13:22.588938 22212 raft_consensus.cc:3055] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:22.590224 22274 raft_consensus.cc:2804] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:22.560541 22156 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:22.599357 22222 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:22.611346 22271 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:22.604045 22212 raft_consensus.cc:740] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:22.615087 21935 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:22.566691 22035 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:22.589335 22238 raft_consensus.cc:3055] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:22.619184 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:22.591919 22383 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:22.595098 22320 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:22.623931 13727 leader_election.cc:400] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 21. Current term is 22.
I20260709 12:13:22.599586 22276 raft_consensus.cc:2804] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:22.633338 13682 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 22.
I20260709 12:13:22.648041 13831 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:22.617225 22380 raft_consensus.cc:2804] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:22.655339 13727 leader_election.cc:403] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:22.656296 13686 raft_consensus.cc:1275] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 26 index: 13. (index mismatch)
W20260709 12:13:22.658759 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:22.660174 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:22.663429 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:22.664309 14412 raft_consensus.cc:1240] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:22.595283 22359 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:22.668991 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 45250.4us
I20260709 12:13:22.673142 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:22.656001 22383 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:22.674659 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:22.675344 14409 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:22.654927 22271 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:22.678436 22271 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:22.635994 22261 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:22.684537 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:22.669762 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 32 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:22.674110 13684 raft_consensus.cc:2393] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 28: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:22.652559 22274 raft_consensus.cc:697] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:22.602510 22375 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:22.646148 22238 raft_consensus.cc:740] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:22.688423 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:22.683547 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:22.657998 22389 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:22.695199 13682 raft_consensus.cc:2393] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 26: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:22.714190 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:22.680501 22276 raft_consensus.cc:697] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:22.688112 22380 raft_consensus.cc:697] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:22.688167 22387 raft_consensus.cc:2749] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 21. Current term is 22.
I20260709 12:13:22.735442 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 30 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:22.737787 13682 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:22.661497 22320 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:22.753805 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:22.778364 13682 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 30.
I20260709 12:13:22.695119 22261 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:22.802498 14409 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 23.
I20260709 12:13:22.726698 22292 consensus_queue.cc:1059] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 25.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.054s
I20260709 12:13:22.713351 22212 consensus_queue.cc:260] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:22.713181 22389 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:22.765019 22382 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:22.862653 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:13:22.873756 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 66453.4us
I20260709 12:13:22.875195 13727 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:22.795275 22271 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:22.888860 22382 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:22.789840 22238 consensus_queue.cc:260] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:22.935343 22238 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:22.790470 22274 consensus_queue.cc:237] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:22.938300 22156 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:22.883481 22276 consensus_queue.cc:237] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:22.940798 22162 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:22.935621 22320 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:22.943059 22320 consensus_queue.cc:1048] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:13:22.885982 22149 raft_consensus.cc:2804] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:22.905305 22212 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:22.962150 22035 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:22.930336 22380 consensus_queue.cc:237] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:23.082743 13831 raft_consensus.cc:1275] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 12:13:23.085333 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:23.086997 13830 raft_consensus.cc:2393] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 26: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:23.085355 22149 raft_consensus.cc:697] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:23.095023 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:23.095827 14409 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 21.
I20260709 12:13:23.096822 14412 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b"
dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
mode: GRACEFUL
new_leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
 from {username='slave'} at 127.0.0.1:46814
I20260709 12:13:23.097533 14412 raft_consensus.cc:606] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 22 LEADER]: Received request to transfer leadership to TS 3f37c9cc9dda46b4be21dd675ba78fb7
W20260709 12:13:23.089956 22395 log.cc:927] Time spent T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.263s	user 0.004s	sys 0.004s
I20260709 12:13:23.105686 22261 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:23.107623 22359 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:23.101586 22199 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:23.112990 22407 log.cc:927] Time spent T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 12:13:23.112895 22199 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:23.117307 22199 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:23.118351 22409 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:23.121040 22409 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:23.123446 22409 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:23.124055 22409 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:23.124604 22409 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:23.132340 22383 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:23.135133 22409 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:13:23.139178 22392 log.cc:927] Time spent T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.476s	user 0.002s	sys 0.000s
W20260709 12:13:23.142175 22393 log.cc:927] Time spent T 00000000000000000000000000000000 P 17d79eae88f84be7a847d0cf544674cd: Append to log took a long time: real 0.496s	user 0.000s	sys 0.002s
W20260709 12:13:23.142897 13574 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.557s	user 0.000s	sys 0.000s
I20260709 12:13:23.148873 22387 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:23.149650 22387 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:23.152235 22387 leader_election.cc:290] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:23.154295 22375 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:23.158088 14407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41700 (request call id 1258) took 1255 ms. Trace:
W20260709 12:13:23.158453 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 277923us
I20260709 12:13:23.158636 14407 rpcz_store.cc:276] 0709 12:13:21.902727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:21.902934 (+   207us) service_pool.cc:224] Handling call
0709 12:13:23.157812 (+1254878us) spinlock_profiling.cc:243] Waited 627 ms on lock 0x7b540068ced4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:23.158008 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1443011840}
I20260709 12:13:23.159353 13800 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:13:23.161036 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:23.161926 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:23.164317 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:23.164956 13835 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Advancing to term 26
I20260709 12:13:23.161017 13800 leader_election.cc:400] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 election: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 23. Current term is 24.
I20260709 12:13:23.166867 13800 leader_election.cc:403] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 election: Cancelling election due to peer responding with higher term
I20260709 12:13:23.168170 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:23.175065 13687 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 24.
I20260709 12:13:23.178979 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:23.179276 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:23.180570 14408 raft_consensus.cc:2410] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 19 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 12:13:23.183883 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:23.187201 13829 raft_consensus.cc:2393] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 18: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:23.193980 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 29 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:23.194990 13837 raft_consensus.cc:2410] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for term 29 because replica has last-logged OpId of term: 28 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 26 index: 17.
I20260709 12:13:23.196990 13800 leader_election.cc:400] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 election: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 22. Current term is 23.
I20260709 12:13:23.198194 14416 raft_consensus.cc:1275] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 12:13:23.197492 13800 leader_election.cc:403] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 12:13:23.176267 22261 consensus_queue.cc:1048] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.029s
I20260709 12:13:23.207093 22261 raft_consensus.cc:2749] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader election lost for term 23. Reason: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 23. Current term is 24.
I20260709 12:13:23.204487 13574 maintenance_manager.cc:643] P 17d79eae88f84be7a847d0cf544674cd: FlushDeltaMemStoresOp(00000000000000000000000000000000) complete. Timing: real 1.406s	user 0.046s	sys 0.000s Metrics: {"bytes_written":4815,"delete_count":0,"lbm_write_time_us":19611,"lbm_writes_1-10_ms":1,"lbm_writes_10-100_ms":1,"lbm_writes_lt_1ms":3,"reinsert_count":0,"update_count":192}
I20260709 12:13:23.215988 13575 maintenance_manager.cc:419] P 17d79eae88f84be7a847d0cf544674cd: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.249509
I20260709 12:13:23.224057 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:23.224435 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:23.224246 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:23.225371 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:23.226367 13755 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 26.
W20260709 12:13:23.227710 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:23.233086 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:23.237835 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 24 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:23.175313 22409 consensus_queue.cc:1059] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 12:13:23.247766 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:23.248842 13755 raft_consensus.cc:2393] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 26: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
W20260709 12:13:23.244505 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:23.244815 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:23.243973 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:23.250344 13760 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 20.
I20260709 12:13:23.202069 22384 raft_consensus.cc:2749] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:23.256377 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:23.237383 22212 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:23.258457 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:23.268761 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:23.270761 13755 raft_consensus.cc:1275] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 12:13:23.246141 22394 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:23.273488 13835 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 26.
I20260709 12:13:23.274289 13755 raft_consensus.cc:1275] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 12:13:23.277721 13651 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:23.282749 13755 raft_consensus.cc:1240] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:23.281888 13651 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:23.299127 22238 raft_consensus.cc:2804] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:23.299597 22238 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:23.299988 22238 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:23.300720 13680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 1695) took 1400 ms. Trace:
I20260709 12:13:23.302982 13836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54830 (request call id 3557) took 1124 ms. Trace:
I20260709 12:13:23.303448 13836 rpcz_store.cc:276] 0709 12:13:22.178956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:22.179082 (+   126us) service_pool.cc:224] Handling call
0709 12:13:23.302732 (+1123650us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b54003babd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:23.302897 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":492961664}
I20260709 12:13:23.303845 22383 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:23.304535 22409 raft_consensus.cc:3055] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:23.304970 22409 raft_consensus.cc:740] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:23.305876 22409 consensus_queue.cc:260] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:23.307772 22409 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:23.280659 22394 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:23.244310 22149 consensus_queue.cc:237] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:23.310989 22396 raft_consensus.cc:993] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835: : Instructing follower 3f37c9cc9dda46b4be21dd675ba78fb7 to start an election
I20260709 12:13:23.311700 22396 raft_consensus.cc:1081] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 23 LEADER]: Signalling peer 3f37c9cc9dda46b4be21dd675ba78fb7 to start an election
I20260709 12:13:23.314469 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:23.314780 22394 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:23.315198 13836 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:13:23.320824 22388 log.cc:927] Time spent T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.790s	user 0.001s	sys 0.001s
I20260709 12:13:23.322525 22394 consensus_queue.cc:1048] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:13:23.324786 22374 consensus_queue.cc:1048] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:13:23.332005 13836 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 22.
I20260709 12:13:23.301195 13680 rpcz_store.cc:276] 0709 12:13:21.900214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:21.900424 (+   210us) service_pool.cc:224] Handling call
0709 12:13:21.949369 (+ 48945us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:22.564109 (+614740us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:23.300462 (+736353us) spinlock_profiling.cc:243] Waited 597 ms on lock 0x7b5400272754. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:23.300658 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1373784832}
I20260709 12:13:23.273303 22212 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:23.336508 22238 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:23.339931 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 143133us
I20260709 12:13:23.280851 22384 raft_consensus.cc:2749] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 22. Current term is 23.
I20260709 12:13:23.284520 22359 raft_consensus.cc:2804] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:23.354602 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:23.355332 13727 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:23.356586 13800 leader_election.cc:400] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 23. Current term is 24.
I20260709 12:13:23.363790 13763 raft_consensus.cc:1240] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 25. Current term is 26. Ops: []
W20260709 12:13:23.367022 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 167025us
I20260709 12:13:23.352550 22359 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:23.368144 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:23.372813 13755 raft_consensus.cc:1240] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:23.373361 13680 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:23.363360 21986 consensus_queue.cc:1059] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.012s
I20260709 12:13:23.362820 22384 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:23.376509 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:23.353581 22320 consensus_queue.cc:1059] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.019s
I20260709 12:13:23.363641 22098 raft_consensus.cc:2804] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:23.380733 13836 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 26.
I20260709 12:13:23.386312 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:23.356864 22383 consensus_queue.cc:1048] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 12:13:23.375856 22359 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:23.389132 13800 leader_election.cc:400] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 election: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 25. Current term is 26.
I20260709 12:13:23.407378 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:23.374737 22389 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:23.403951 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:23.412061 13834 raft_consensus.cc:1275] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 12:13:23.409696 13759 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 26.
W20260709 12:13:23.408314 22416 log.cc:927] Time spent T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.131s	user 0.001s	sys 0.001s
I20260709 12:13:23.423198 13762 raft_consensus.cc:1240] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 20. Current term is 21. Ops: []
W20260709 12:13:23.406652 22313 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.254s	user 0.009s	sys 0.021s
I20260709 12:13:23.418757 22320 raft_consensus.cc:3055] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 29 LEADER]: Stepping down as leader of term 29
I20260709 12:13:23.385965 22384 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:23.415762 22098 raft_consensus.cc:697] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:13:23.442682 22313 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.291s	user 0.009s	sys 0.021s
I20260709 12:13:23.480406 13755 raft_consensus.cc:1240] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:23.403530 22223 consensus_queue.cc:1059] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
W20260709 12:13:23.484921 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 68594.5us
I20260709 12:13:23.486757 14380 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:23.474421 22422 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:23.489796 13834 raft_consensus.cc:1275] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
W20260709 12:13:23.489651 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 100677us
I20260709 12:13:23.453342 22320 raft_consensus.cc:740] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 29 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:23.480643 22389 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:23.507767 13800 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:23.430294 22423 consensus_queue.cc:1048] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.071s
I20260709 12:13:23.505133 21986 raft_consensus.cc:2804] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:23.511737 22271 consensus_queue.cc:1048] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.011s
I20260709 12:13:23.522593 22068 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:23.523249 22068 raft_consensus.cc:3055] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:23.523618 22068 raft_consensus.cc:740] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:23.524550 22068 consensus_queue.cc:260] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:23.488014 22421 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:23.526525 22421 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:23.527045 22375 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:23.527696 22375 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:23.529222 22421 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:23.530956 22384 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:13:23.532033 22368 log.cc:927] Time spent T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 1.327s	user 0.000s	sys 0.003s
W20260709 12:13:23.532330 22419 log.cc:927] Time spent T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
W20260709 12:13:23.534004 22420 log.cc:927] Time spent T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:13:23.488315 22238 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:13:23.540729 22424 log.cc:927] Time spent T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:13:23.541467 14412 raft_consensus.cc:1240] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 22. Current term is 23. Ops: [22.17-22.17]
I20260709 12:13:23.488642 22418 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:23.580114 13680 raft_consensus.cc:2468] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 18.
I20260709 12:13:23.551658 21986 raft_consensus.cc:697] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 26 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:23.567417 22311 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:23.569476 22384 raft_consensus.cc:2749] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:23.549736 22375 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:23.574749 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:13:23.589249 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 259916us
I20260709 12:13:23.508001 22389 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:23.548758 13726 connection.cc:256] RPC call timeout handler was delayed by -1.033110059999899s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1622s for a response
W20260709 12:13:23.601807 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:23.602488 13726 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:23.503376 22422 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:23.613430 22383 raft_consensus.cc:2749] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:13:23.615969 22426 log.cc:927] Time spent T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 12:13:23.616339 13726 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:23.619463 22383 raft_consensus.cc:2804] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:23.620052 22383 raft_consensus.cc:697] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:23.620990 22383 consensus_queue.cc:237] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:23.624528 13835 raft_consensus.cc:1275] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 12:13:23.638581 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:23.595681 22421 consensus_queue.cc:1059] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.040s
I20260709 12:13:23.591025 22311 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:23.642299 13688 raft_consensus.cc:2368] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 25. Current term is 26.
I20260709 12:13:23.586848 22320 consensus_queue.cc:260] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 29.17, Last appended by leader: 17, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:23.593902 22098 consensus_queue.cc:237] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:23.604072 22418 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:23.711489 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 81834.5us
I20260709 12:13:23.742877 13726 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:23.745252 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:23.641629 21986 consensus_queue.cc:237] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.18, Last appended by leader: 18, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:23.748616 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:23.755848 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:23.756589 14412 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 21.
I20260709 12:13:23.757764 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:23.758610 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:13:23.759809 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:23.767532 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:23.770339 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:13:23.769658 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 269615us
I20260709 12:13:23.771552 13800 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:23.768074 13726 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:23.772476 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:23.772794 22422 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:23.773151 14407 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 18.
W20260709 12:13:23.773934 22391 log.cc:927] Time spent T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 1.108s	user 0.004s	sys 0.006s
W20260709 12:13:23.776201 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:23.776772 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:23.777194 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:23.749519 22320 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:23.780195 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:23.784840 14410 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:13:23.785181 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:23.781301 13688 raft_consensus.cc:1217] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Deduplicated request from leader. Original: 21.12->[23.13-23.13]   Dedup: 23.13->[]
I20260709 12:13:23.785869 13688 raft_consensus.cc:1240] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 23. Current term is 24. Ops: [23.13-23.13]
I20260709 12:13:23.787660 13688 raft_consensus.cc:1240] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:23.775610 13726 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:23.764892 22034 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:23.794754 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:23.796617 14414 raft_consensus.cc:1275] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 12:13:23.818393 13683 raft_consensus.cc:1240] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:23.782886 22276 raft_consensus.cc:2749] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:13:23.770516 22256 consensus_queue.cc:1048] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 12:13:23.810411 22422 raft_consensus.cc:2749] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:23.798281 22149 raft_consensus.cc:2804] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Leader election won for term 30
I20260709 12:13:23.859429 22438 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
W20260709 12:13:23.860313 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:23.860239 22438 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:23.849161 22421 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:23.862272 22421 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:23.864482 22432 log.cc:927] Time spent T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.212s	user 0.000s	sys 0.000s
I20260709 12:13:23.864791 22421 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:23.871029 22438 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:23.872560 21833 raft_consensus.cc:3055] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:23.873248 21833 raft_consensus.cc:740] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 22 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
W20260709 12:13:23.895818 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 132859us
I20260709 12:13:23.826781 13800 leader_election.cc:400] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 27. Current term is 28.
I20260709 12:13:23.900504 13800 leader_election.cc:403] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:13:23.897565 13652 leader_election.cc:336] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 1.639s (SENT)
W20260709 12:13:23.906601 13652 connection.cc:256] RPC call timeout handler was delayed by -1.566645718000018s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1703s for a response
W20260709 12:13:23.907130 13652 leader_election.cc:336] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 1.712s (SENT)
I20260709 12:13:23.907636 13652 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:13:23.908527 13652 connection.cc:256] RPC call timeout handler was delayed by -1.5548032949998287s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1915s for a response
W20260709 12:13:23.908993 13652 leader_election.cc:336] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 1.568s (SENT)
I20260709 12:13:23.909338 13652 leader_election.cc:304] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:13:23.911999 13652 connection.cc:256] RPC call timeout handler was delayed by -1.5250331059999098s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1526s for a response
W20260709 12:13:23.913398 13652 leader_election.cc:336] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 1.610s (SENT)
W20260709 12:13:23.915340 13652 leader_election.cc:336] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Timed out: RequestConsensusVote RPC to 127.12.56.195:36603 timed out after 1.820s (SENT)
I20260709 12:13:23.916993 13652 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:23.917506 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:23.919270 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 32 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:23.919112 21833 consensus_queue.cc:260] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:23.922279 21833 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:13:23.926101 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 99591.2us
I20260709 12:13:23.927033 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 23 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:23.927953 13687 raft_consensus.cc:2410] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for term 23 because replica has last-logged OpId of term: 21 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
I20260709 12:13:23.929123 13687 raft_consensus.cc:1240] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 25. Current term is 26. Ops: [25.18-25.18]
I20260709 12:13:23.927013 13800 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:23.930851 22446 raft_consensus.cc:2749] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:13:23.931581 13683 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:13:23.931784 22068 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:23.933010 13687 raft_consensus.cc:1275] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 17. (term mismatch)
I20260709 12:13:23.933698 13687 pending_rounds.cc:85] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 16
I20260709 12:13:23.934010 13687 pending_rounds.cc:107] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 21.17
I20260709 12:13:23.934294 13687 raft_consensus.cc:2889] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:13:23.921079 13652 connection.cc:256] RPC call timeout handler was delayed by -1.3941269209999518s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1898s for a response
I20260709 12:13:23.934737 13680 raft_consensus.cc:1240] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 22. Current term is 24. Ops: []
I20260709 12:13:23.911994 22438 raft_consensus.cc:2749] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader pre-election lost for term 27. Reason: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 27. Current term is 28.
I20260709 12:13:23.935628 22238 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:23.935705 13687 raft_consensus.cc:1240] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 29. Current term is 30. Ops: []
I20260709 12:13:23.936192 22238 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:23.938655 22238 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:23.939267 13652 connection.cc:256] RPC call timeout handler was delayed by -1.2694603369998276s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.219s for a response
I20260709 12:13:23.940519 22238 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:23.911805 22374 raft_consensus.cc:2749] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:13:23.941381 13652 connection.cc:256] RPC call timeout handler was delayed by -1.1998054849998425s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1938s for a response
W20260709 12:13:23.941794 13652 connection.cc:256] RPC call timeout handler was delayed by -1.0994855169999482s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19810000000000003s for a response
W20260709 12:13:23.942927 13652 connection.cc:256] RPC call timeout handler was delayed by -1.0958855169999424s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1985s for a response
W20260709 12:13:23.943691 13652 connection.cc:256] RPC call timeout handler was delayed by -1.0779974269999002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22410000000000002s for a response
W20260709 12:13:23.944365 13652 connection.cc:256] RPC call timeout handler was delayed by -1.0535032949999277s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2472s for a response
I20260709 12:13:23.896324 22149 raft_consensus.cc:697] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:23.988826 13683 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 32.
I20260709 12:13:23.992331 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:23.997448 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:23.998755 13683 raft_consensus.cc:2393] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 22: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:23.996222 13832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 3993) took 1389 ms. Trace:
I20260709 12:13:23.942924 22389 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:24.000727 13832 rpcz_store.cc:276] 0709 12:13:22.606382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:22.609383 (+  3001us) service_pool.cc:224] Handling call
0709 12:13:23.770368 (+1160985us) spinlock_profiling.cc:243] Waited 1.74 ms on lock 0x7b5800034898. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924e68b71 00007fa924e68a22 00007fa92dd818d9 00007fa92cedbee0 00007fa92cfa50ab 00007fa92cfa5131 00007fa92cf66fc0 00007fa92cf51929 00007fa92cf513d2 00007fa9264c8bd4
0709 12:13:23.770559 (+   191us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:23.770902 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 12:13:23.807134 (+ 36232us) log.cc:844] Serialized 14 byte log entry
0709 12:13:23.992820 (+185686us) log.cc:844] Serialized 14 byte log entry
0709 12:13:23.995748 (+  2928us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:23.995821 (+    73us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:13:23.995889 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:23.995993 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:23.996142 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2531,"prepare.queue_time_us":35514,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":63,"raft.queue_time_us":3618,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":109,"spinlock_wait_cycles":4011904,"thread_start_us":216274,"threads_started":3}
I20260709 12:13:23.996649 22383 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:23.982631 22374 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:23.941062 22238 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:24.001428 22311 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:24.011572 22436 raft_consensus.cc:2749] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 12:13:24.046506 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 101202us
W20260709 12:13:24.055889 13800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:24.061537 13832 raft_consensus.cc:1240] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 23. Current term is 24. Ops: [23.16-23.16]
I20260709 12:13:24.064209 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:24.064692 13680 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 18.
I20260709 12:13:24.064937 13832 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 18.
I20260709 12:13:24.066800 13832 raft_consensus.cc:1240] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:24.067163 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:24.045670 22311 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:24.026839 22383 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:24.032368 22374 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:24.084381 22311 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:24.127784 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:24.128181 14410 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 22.
I20260709 12:13:24.129053 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:24.247465 13684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 3846) took 1145 ms. Trace:
I20260709 12:13:24.247654 13828 raft_consensus.cc:2410] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 25 because replica has last-logged OpId of term: 24 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 12.
I20260709 12:13:24.079015 22149 consensus_queue.cc:237] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:24.129671 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:13:24.214847 22448 log.cc:927] Time spent T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.191s	user 0.008s	sys 0.000s
I20260709 12:13:24.216837 22374 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:24.217324 13680 raft_consensus.cc:1275] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 12:13:24.250523 22439 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:24.261852 22313 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:24.262281 22439 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:24.219607 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:24.262629 22313 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:24.270978 22418 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:24.271283 22468 consensus_queue.cc:1059] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:13:24.271804 22320 consensus_queue.cc:1059] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 24.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:13:24.266597 13800 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:24.272517 22468 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:24.273300 22438 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:24.273121 22320 raft_consensus.cc:3055] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:24.274361 22320 raft_consensus.cc:740] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:24.274518 22238 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:24.275139 22238 raft_consensus.cc:3055] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:13:24.275527 22238 raft_consensus.cc:740] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:24.275329 22320 consensus_queue.cc:260] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 24.10, Last appended by leader: 10, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:24.276037 13800 leader_election.cc:336] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 2.125s (SENT)
I20260709 12:13:24.276804 22320 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:24.276440 22238 consensus_queue.cc:260] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:24.278143 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:24.273097 22468 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:24.288890 22468 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:24.290966 22311 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:24.293020 13682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 3844) took 1380 ms. Trace:
I20260709 12:13:24.132589 13831 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 26.
I20260709 12:13:24.242504 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:24.241739 13685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 3848) took 1031 ms. Trace:
I20260709 12:13:24.244158 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:24.245378 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:24.247880 13684 rpcz_store.cc:276] 0709 12:13:23.101973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:23.102135 (+   162us) service_pool.cc:224] Handling call
0709 12:13:23.104131 (+  1996us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:23.104363 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:13:23.783643 (+679280us) log.cc:844] Serialized 14 byte log entry
0709 12:13:24.231789 (+448146us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:24.246526 (+ 14737us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:13:24.246917 (+   391us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:24.247194 (+   277us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:24.247410 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":485515,"prepare.queue_time_us":660180,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"thread_start_us":631208,"threads_started":3}
W20260709 12:13:24.246843 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 176535us
I20260709 12:13:24.249928 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:24.293476 13682 rpcz_store.cc:276] 0709 12:13:22.912185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:22.912334 (+   149us) service_pool.cc:224] Handling call
0709 12:13:22.912800 (+   466us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:22.932121 (+ 19321us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 12:13:23.763944 (+831823us) log.cc:844] Serialized 14 byte log entry
0709 12:13:24.036110 (+272166us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:24.037358 (+  1248us) log.cc:844] Serialized 52 byte log entry
0709 12:13:24.037507 (+   149us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:13:24.037543 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:24.037638 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:24.292766 (+255128us) raft_consensus.cc:1685] finished
0709 12:13:24.292789 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:24.292953 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":630528,"prepare.queue_time_us":705852,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":274161,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":9935,"thread_start_us":410704,"threads_started":3,"wal-append.queue_time_us":270310}
I20260709 12:13:24.293864 13685 rpcz_store.cc:276] 0709 12:13:23.210206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:23.214020 (+  3814us) service_pool.cc:224] Handling call
0709 12:13:23.214376 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:23.214578 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:13:23.999789 (+785211us) log.cc:844] Serialized 14 byte log entry
0709 12:13:24.220255 (+220466us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:24.240762 (+ 20507us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:13:24.241191 (+   429us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:24.241518 (+   327us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:24.241673 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":390656,"prepare.queue_time_us":556450,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":7154,"raft.queue_time_us":52055,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"thread_start_us":591705,"threads_started":2}
I20260709 12:13:24.300472 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:24.298377 13834 raft_consensus.cc:2410] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 26 because replica has last-logged OpId of term: 23 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 13.
I20260709 12:13:24.302431 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:24.303251 13680 raft_consensus.cc:2468] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 18.
I20260709 12:13:24.277729 22238 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:24.252781 22034 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:24.253806 22383 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:24.254029 22435 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:24.254225 22458 log.cc:927] Time spent T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
W20260709 12:13:24.237675 22359 consensus_meta.cc:287] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.803s	user 0.000s	sys 0.020s
I20260709 12:13:24.218163 21742 raft_consensus.cc:3055] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:13:24.259032 14410 raft_consensus.cc:1240] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 22. Current term is 23. Ops: [22.17-22.17]
I20260709 12:13:24.217451 13681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 3823) took 1630 ms. Trace:
I20260709 12:13:24.280247 13828 raft_consensus.cc:2468] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 18.
I20260709 12:13:24.250633 22375 raft_consensus.cc:2749] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:13:24.281718 22421 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:24.283069 22313 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:13:24.283424 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:24.285559 22439 leader_election.cc:290] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:24.279321 21893 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:24.279501 22321 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:13:24.238719 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:24.241346 14379 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:24.294126 13688 raft_consensus.cc:1217] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Deduplicated request from leader. Original: 24.15->[26.16-26.16]   Dedup: 26.16->[]
W20260709 12:13:24.252159 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:24.316655 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:24.329345 22098 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:13:24.360948 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 119699us
I20260709 12:13:24.334860 13652 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:24.341912 13681 rpcz_store.cc:276] 0709 12:13:22.586972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:22.587218 (+   246us) service_pool.cc:224] Handling call
0709 12:13:22.587567 (+   349us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:13:22.616477 (+ 28910us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:13:23.573516 (+957039us) spinlock_profiling.cc:243] Waited 1.09 ms on lock 0x7b180001e460. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e1ac0a 00007fa92e55a219 00007fa924ea2a40 00007fa924e9d4e4 00007fa924e9d455 00007fa92b9853c7 00007fa927f979a7 00007fa927fa70bf 00007fa927fa7038
0709 12:13:23.778840 (+205324us) log.cc:844] Serialized 14 byte log entry
0709 12:13:24.045967 (+267127us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:24.057675 (+ 11708us) log.cc:844] Serialized 52 byte log entry
0709 12:13:24.058189 (+   514us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:13:24.058249 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:24.058372 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:24.217103 (+158731us) raft_consensus.cc:1685] finished
0709 12:13:24.217204 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:24.217374 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30087,"prepare.queue_time_us":1007859,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":196029,"raft.run_cpu_time_us":1674,"raft.run_wall_time_us":62588,"spinlock_wait_cycles":2500992,"thread_start_us":405196,"threads_started":3,"wal-append.queue_time_us":353524}
I20260709 12:13:24.362996 21893 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:24.363996 22439 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:24.365206 22439 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:24.365952 13688 raft_consensus.cc:1240] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 26. Current term is 27. Ops: [26.16-26.16]
I20260709 12:13:24.341512 22359 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:24.366945 13686 raft_consensus.cc:2368] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 26. Current term is 27.
I20260709 12:13:24.368117 22359 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:24.364641 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:24.370945 13679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 3843) took 1565 ms. Trace:
I20260709 12:13:24.371408 13679 rpcz_store.cc:276] 0709 12:13:22.806241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:22.873677 (+ 67436us) service_pool.cc:224] Handling call
0709 12:13:22.874058 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:22.874409 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:22.874436 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:22.887914 (+ 13478us) log.cc:844] Serialized 26 byte log entry
0709 12:13:23.928411 (+1040497us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b18001a2840. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e82e07 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9fc02 00007fa927b2720b 00007fa927b2cd23 00007fa927b2d0d1 00007fa927f48a0f
0709 12:13:23.999429 (+ 71018us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:13:23.999522 (+    93us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:23.999591 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:24.370603 (+371012us) raft_consensus.cc:1685] finished
0709 12:13:24.370623 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:24.370875 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3534,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":2832,"spinlock_wait_cycles":25270528,"thread_start_us":70827,"threads_started":1,"wal-append.queue_time_us":1162122}
I20260709 12:13:24.360857 22421 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:24.373670 21893 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:24.375691 22421 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:24.343398 22034 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:24.378690 22034 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:24.375428 14379 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 32 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:24.379669 22162 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 32 FOLLOWER]: Leader election won for term 32
I20260709 12:13:24.380316 22162 raft_consensus.cc:697] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 32 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:24.381160 14379 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
W20260709 12:13:24.383095 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 48351.6us
I20260709 12:13:24.341185 21742 raft_consensus.cc:740] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:13:24.384845 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:24.389464 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 32 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:24.385404 13652 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:24.338940 22068 consensus_queue.cc:1059] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.044s
I20260709 12:13:24.397848 13681 raft_consensus.cc:2393] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 32 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 32: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:13:24.386936 14379 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:24.400645 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:24.401268 13652 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:24.403604 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:24.384526 22311 raft_consensus.cc:2804] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:13:24.407101 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 24 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:24.407912 13682 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 25.
I20260709 12:13:24.409111 13684 raft_consensus.cc:2368] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 21. Current term is 22.
I20260709 12:13:24.383688 22421 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:24.409713 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:24.411125 13652 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:24.411198 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:24.381407 22162 consensus_queue.cc:237] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 30.19, Last appended by leader: 19, Current term: 32, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:24.419469 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:24.387933 22359 raft_consensus.cc:2749] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:24.427692 13652 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:24.383038 22098 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:24.405376 21986 raft_consensus.cc:2804] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:24.388232 21833 consensus_queue.cc:1048] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.027s
I20260709 12:13:24.405541 22447 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:24.402379 22471 raft_consensus.cc:2749] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:24.437630 13652 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:24.440124 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:24.442245 13652 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:24.415180 22374 raft_consensus.cc:2749] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 12:13:24.446108 13685 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 26.
I20260709 12:13:24.428573 22068 raft_consensus.cc:2749] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:13:24.451211 22359 raft_consensus.cc:2749] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:24.435706 21986 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:24.340224 22435 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:24.419008 22421 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:24.434106 21742 consensus_queue.cc:260] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:24.652808 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:24.653662 13833 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 23.
I20260709 12:13:24.439198 22468 raft_consensus.cc:2749] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:24.456372 13652 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:13:24.648877 13800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:24.648097 13681 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 22.
I20260709 12:13:24.619678 13828 raft_consensus.cc:1275] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 26 index: 14. Preceding OpId from leader: term: 28 index: 15. (index mismatch)
I20260709 12:13:24.568876 13834 raft_consensus.cc:3055] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:24.690285 13834 raft_consensus.cc:740] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:24.510885 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:24.693655 13679 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 23.
I20260709 12:13:24.547508 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:24.696578 13837 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 23.
W20260709 12:13:24.710233 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 253983us
I20260709 12:13:24.711261 13652 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:24.712585 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:24.714135 13680 raft_consensus.cc:1275] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
W20260709 12:13:24.538988 22411 log.cc:927] Time spent T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 1.443s	user 0.005s	sys 0.012s
W20260709 12:13:24.514847 22474 log.cc:927] Time spent T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 12:13:24.655656 21986 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:24.504408 22311 raft_consensus.cc:697] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 18 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:24.461009 22466 raft_consensus.cc:2749] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:24.589665 22212 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:24.447238 22447 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:24.723548 13652 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:24.715471 22370 raft_consensus.cc:2749] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:13:24.691490 13834 consensus_queue.cc:260] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:24.687723 22261 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:24.534068 21833 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:24.745280 13834 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:24.585233 22313 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:24.746654 13652 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:24.727597 22468 raft_consensus.cc:2749] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:24.750864 13652 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:24.752104 22359 raft_consensus.cc:2749] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:24.754688 13652 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:24.755555 22359 raft_consensus.cc:2749] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:24.758981 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:24.737746 22320 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:24.736611 22098 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:13:24.800323 13727 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.56.196:46341 timed out after 2.557s (SENT) [suppressed 22 similar messages]
W20260709 12:13:24.804538 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:24.867215 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:24.763124 13652 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:13:24.890396 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:24.898321 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 137855us
I20260709 12:13:24.899835 13652 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:24.747411 22436 raft_consensus.cc:2749] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:24.757064 22068 raft_consensus.cc:2749] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:24.917389 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:24.917833 13835 raft_consensus.cc:1275] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:13:24.911216 13652 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:13:24.923028 14415 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 1409) took 3006 ms (client timeout 1981 ms). Trace:
W20260709 12:13:24.923673 14415 rpcz_store.cc:269] 0709 12:13:21.897555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:21.898259 (+   704us) service_pool.cc:224] Handling call
0709 12:13:24.903808 (+3005549us) spinlock_profiling.cc:243] Waited 463 ms on lock 0x7b54005e0e54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:24.903957 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1065651456}
I20260709 12:13:24.763827 22472 raft_consensus.cc:3055] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:13:24.965253 13834 raft_consensus.cc:1275] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 17. (term mismatch)
I20260709 12:13:24.971977 13834 pending_rounds.cc:85] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 16
I20260709 12:13:24.972313 13834 pending_rounds.cc:107] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 22.17
I20260709 12:13:24.972550 13834 raft_consensus.cc:2889] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:24.809887 22291 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:24.976075 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 175776us
W20260709 12:13:24.981369 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 70258.6us
I20260709 12:13:24.982425 13681 raft_consensus.cc:1275] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:13:24.905524 22321 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:24.757021 21833 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:24.758520 22313 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:24.992660 13652 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:24.911617 22471 raft_consensus.cc:2749] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:24.994285 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:24.927342 22468 raft_consensus.cc:2749] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:25.002028 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:24.760627 22261 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:25.000754 13652 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:24.901021 22320 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:25.015933 22480 log.cc:927] Time spent T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.300s	user 0.001s	sys 0.000s
I20260709 12:13:25.016362 22320 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:25.016952 22320 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:24.997262 22321 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:25.019856 22321 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:25.021636 13834 raft_consensus.cc:1275] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 12:13:24.971889 22472 raft_consensus.cc:740] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:24.993095 22466 raft_consensus.cc:2804] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:25.025866 13652 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:25.034299 13652 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:25.010413 22374 raft_consensus.cc:2749] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:25.033111 22466 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:25.017547 22320 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:24.991350 22291 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:25.062621 13652 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:25.060322 22466 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:25.035642 22471 raft_consensus.cc:2749] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:25.066972 13682 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 25.
I20260709 12:13:25.064543 22359 raft_consensus.cc:2749] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:25.071895 22370 raft_consensus.cc:2749] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
W20260709 12:13:25.073886 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:25.068588 22068 raft_consensus.cc:2749] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:25.080508 22435 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:25.083946 22447 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:25.087316 22291 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:25.000406 22311 consensus_queue.cc:237] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:25.085629 13686 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 2619) took 1833 ms (client timeout 1547 ms). Trace:
W20260709 12:13:25.089843 13686 rpcz_store.cc:269] 0709 12:13:23.274736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:23.334062 (+ 59326us) service_pool.cc:224] Handling call
0709 12:13:25.085367 (+1751305us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54003f0cd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:25.085527 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2325623168}
I20260709 12:13:25.091202 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:25.092233 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:25.073486 22421 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:25.103675 22498 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:25.104614 22498 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:25.107566 22498 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:25.120282 22498 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:25.123214 22498 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:25.124293 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 30 candidate_status { last_received { term: 29 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:25.125015 13679 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 29.
I20260709 12:13:25.125906 22498 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:25.121909 22285 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:25.120676 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 30 candidate_status { last_received { term: 29 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:25.135708 22285 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:25.136291 13686 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 29.
I20260709 12:13:25.137512 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:25.129578 22320 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:25.154456 22447 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:25.155131 22447 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:25.155912 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:25.156571 13679 raft_consensus.cc:2376] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 18. Re-sending same reply.
I20260709 12:13:25.157516 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:25.159011 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:25.160176 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:25.161306 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:25.131305 13726 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:25.134620 21833 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:25.126932 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:25.138731 22285 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:25.139700 22238 consensus_meta.cc:287] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.802s	user 0.010s	sys 0.002s
I20260709 12:13:25.070242 22472 consensus_queue.cc:260] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:25.173518 22472 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:25.157573 22447 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:25.178617 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:25.178960 13685 raft_consensus.cc:1275] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 12:13:25.094888 22370 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:25.179397 13684 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 24.
I20260709 12:13:25.179800 22370 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:25.180646 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:25.128276 22261 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:25.095122 13687 raft_consensus.cc:2368] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 26. Current term is 27.
I20260709 12:13:25.183655 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:25.184407 13687 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 21.
I20260709 12:13:25.186149 22466 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:25.189289 22466 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:25.141505 22313 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:25.194509 22370 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:25.165035 13726 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 32 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:25.163929 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:25.172434 22285 raft_consensus.cc:2804] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260709 12:13:25.201090 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:25.185453 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:13:25.172536 13574 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.256s	user 0.008s	sys 0.005s
I20260709 12:13:25.207047 13687 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 23.
I20260709 12:13:25.204715 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:13:25.204095 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:25.217032 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:25.217969 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:25.218492 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:25.219321 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 54389.5us
I20260709 12:13:25.216609 13684 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 27.
I20260709 12:13:25.217191 13686 raft_consensus.cc:2410] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 24 because replica has last-logged OpId of term: 23 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 14.
I20260709 12:13:25.220477 13726 leader_election.cc:400] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 21. Current term is 22.
I20260709 12:13:25.220877 13726 leader_election.cc:403] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:25.221633 22261 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:25.223459 13831 raft_consensus.cc:1275] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:13:25.225034 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:25.242394 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:25.243521 14408 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 24.
I20260709 12:13:25.245954 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:25.246943 13687 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 26.
I20260709 12:13:25.249074 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:25.249825 13679 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 26.
I20260709 12:13:25.215936 22285 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:25.252724 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:25.257522 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:25.235390 22313 raft_consensus.cc:2749] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 32 FOLLOWER]: Leader election lost for term 32. Reason: could not achieve majority
W20260709 12:13:25.260478 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 179265us
I20260709 12:13:25.263728 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:25.222258 22261 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:25.266548 13652 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:25.267334 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:25.272639 13829 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 23.
I20260709 12:13:25.268643 13679 raft_consensus.cc:2393] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 19: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:25.269834 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:25.271018 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:25.255775 22285 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:25.287185 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:25.288519 13833 raft_consensus.cc:1275] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 12:13:25.289031 13652 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:25.300581 13652 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:13:25.301604 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 137448us
W20260709 12:13:25.303280 13800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:25.314707 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:25.315846 13829 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 22.
I20260709 12:13:25.318677 13801 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:25.321158 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:25.322744 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:25.325419 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:25.326437 13833 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:25.310770 13652 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:25.323542 13831 raft_consensus.cc:2376] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 23. Re-sending same reply.
I20260709 12:13:25.327703 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:25.331956 13837 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 26.
I20260709 12:13:25.329087 13684 raft_consensus.cc:1275] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 26 index: 14. Preceding OpId from leader: term: 28 index: 15. (index mismatch)
I20260709 12:13:25.330945 13831 raft_consensus.cc:1240] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 12:13:25.336544 13687 raft_consensus.cc:1275] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 12:13:25.340229 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:25.264998 22382 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:25.341565 22261 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:25.341925 22382 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Advancing to term 22
I20260709 12:13:25.335655 14380 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:25.326613 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:25.302415 22370 raft_consensus.cc:2749] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 12:13:25.349260 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:25.307947 22466 raft_consensus.cc:2749] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:13:25.328599 21986 consensus_meta.cc:287] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.582s	user 0.006s	sys 0.005s
I20260709 12:13:25.329246 22396 raft_consensus.cc:2749] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:25.354606 22096 raft_consensus.cc:2804] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:25.328456 22321 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:25.343781 22068 raft_consensus.cc:2804] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:25.372040 13684 raft_consensus.cc:1275] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:13:25.370329 22096 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:25.344247 22493 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:13:25.376963 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 156628us
I20260709 12:13:25.343586 22495 raft_consensus.cc:2804] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:25.378777 13726 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:25.377044 13833 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 27.
I20260709 12:13:25.337415 22238 consensus_queue.cc:1048] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.032s
I20260709 12:13:25.344276 22477 consensus_queue.cc:1048] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.033s
I20260709 12:13:25.375784 22096 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:25.375952 22491 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:25.384676 22495 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:25.436432 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 30 candidate_status { last_received { term: 29 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:25.414987 13800 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:25.438011 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:25.437979 13800 leader_election.cc:304] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:13:25.428449 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 49791us
I20260709 12:13:25.388885 22068 raft_consensus.cc:697] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 22 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:25.369508 21986 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:25.438939 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:25.381330 22321 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:25.391424 22320 consensus_queue.cc:1048] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.043s
I20260709 12:13:25.433182 21893 raft_consensus.cc:2804] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:25.457798 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:25.458012 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:25.459815 13762 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 23.
I20260709 12:13:25.456735 13726 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:25.463883 22414 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:25.463766 13800 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:25.464447 22414 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:25.461403 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:25.467501 13755 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 23.
I20260709 12:13:25.469434 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:25.471293 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 30 candidate_status { last_received { term: 29 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:25.391481 22493 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:25.438140 22370 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:25.478519 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:25.475786 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:25.437142 22495 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:25.481900 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:25.482030 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:25.461011 22311 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:25.486217 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:25.458616 22320 consensus_queue.cc:1243] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer b98d2519bb504dc6905ed2ede4571835 log is divergent from this leader: its last log entry 19.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 12:13:25.462704 22261 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:13:25.505007 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:25.511019 14410 raft_consensus.cc:1240] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 25. Current term is 26. Ops: []
W20260709 12:13:25.512313 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 48886.7us
I20260709 12:13:25.512853 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:25.513149 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:25.513497 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:25.515821 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:25.523315 22493 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:25.523993 22493 raft_consensus.cc:2804] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:13:25.524482 22493 raft_consensus.cc:697] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 18 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:25.530972 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:25.530579 22068 consensus_queue.cc:237] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:25.531731 14416 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 22.
I20260709 12:13:25.532531 21986 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:25.533236 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:25.535204 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:25.474363 21893 raft_consensus.cc:697] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:25.537113 21893 consensus_queue.cc:237] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:25.537987 13760 raft_consensus.cc:1217] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Deduplicated request from leader. Original: 17.15->[18.16-24.19]   Dedup: 18.16->[20.17-24.19]
I20260709 12:13:25.538544 13760 pending_rounds.cc:85] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting all ops after (but not including) 16
I20260709 12:13:25.538821 13760 pending_rounds.cc:107] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting uncommitted NO_OP operation due to leader change: 21.17
I20260709 12:13:25.539057 13760 raft_consensus.cc:2889] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:25.540679 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:25.541241 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 32 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:25.511482 22261 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:25.485266 13800 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:25.475243 22421 raft_consensus.cc:2804] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:13:25.509449 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:25.436491 22491 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:25.547096 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 61946.7us
W20260709 12:13:25.595163 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 79071.2us
I20260709 12:13:25.542143 13759 raft_consensus.cc:2393] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 32 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 32: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
W20260709 12:13:25.578550 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:25.597092 13800 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:25.543138 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:25.503544 21935 raft_consensus.cc:2804] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:25.599299 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:13:25.546362 22502 log.cc:927] Time spent T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
W20260709 12:13:25.543035 22500 log.cc:927] Time spent T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 12:13:25.547437 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:13:25.545747 22497 log.cc:927] Time spent T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.197s	user 0.000s	sys 0.001s
I20260709 12:13:25.542268 22261 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:25.486716 22370 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:25.612692 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:25.542178 22414 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:25.593344 22320 raft_consensus.cc:2749] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:25.614843 13763 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:25.593833 22422 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:25.601485 21935 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:25.593500 22421 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:25.525354 22493 consensus_queue.cc:237] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:25.614969 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:25.505154 22311 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:25.629235 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:25.639955 14415 raft_consensus.cc:2368] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 21. Current term is 22.
I20260709 12:13:25.642755 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 29 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:25.648590 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:13:25.648352 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 191724us
I20260709 12:13:25.668329 22382 raft_consensus.cc:2749] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 21. Current term is 22.
I20260709 12:13:25.632710 22421 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:25.632952 21935 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:13:25.652175 13571 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d2f365337b324999a073edacbe6c6e09 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER failed with leader ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica ca9fbbc2c0a94897897d502d42f3951f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 23 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
W20260709 12:13:25.717056 13571 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 64932.5us
I20260709 12:13:25.656792 13685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 3859) took 1195 ms. Trace:
I20260709 12:13:25.702368 14415 raft_consensus.cc:1275] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:13:25.717767 13685 rpcz_store.cc:276] 0709 12:13:24.461564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:24.466771 (+  5207us) service_pool.cc:224] Handling call
0709 12:13:24.467857 (+  1086us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:25.179361 (+711504us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:25.656514 (+477153us) spinlock_profiling.cc:243] Waited 711 ms on lock 0x7b540021e154. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:25.656722 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1634459392}
I20260709 12:13:25.631362 22414 raft_consensus.cc:2804] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:25.667500 22370 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:25.632614 22422 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:25.693586 22156 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:25.709761 13763 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 26.
I20260709 12:13:25.675977 13727 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:25.711455 13688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 2617) took 2460 ms. Trace:
I20260709 12:13:25.711966 13726 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:13:25.724951 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 72989.9us
I20260709 12:13:25.726835 13727 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:25.729615 22422 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:25.731132 22156 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:25.724805 13688 rpcz_store.cc:276] 0709 12:13:23.251303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:23.792887 (+541584us) service_pool.cc:224] Handling call
0709 12:13:24.293982 (+501095us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:24.366323 (+ 72341us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:25.711237 (+1344914us) spinlock_profiling.cc:243] Waited 499 ms on lock 0x7b54002c2c50. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:25.711390 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1146564864}
I20260709 12:13:25.734779 13688 raft_consensus.cc:1275] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 30 index: 16. (index mismatch)
I20260709 12:13:25.734608 13727 leader_election.cc:304] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:25.739105 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:13:25.739374 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 143114us
I20260709 12:13:25.740592 13759 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 22.
I20260709 12:13:25.740587 13800 leader_election.cc:400] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 election: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 26. Current term is 27.
I20260709 12:13:25.743484 13727 leader_election.cc:400] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 21. Current term is 22.
I20260709 12:13:25.742796 13800 leader_election.cc:403] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 election: Cancelling election due to peer responding with higher term
I20260709 12:13:25.746610 13727 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:25.721491 22414 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:25.746793 13800 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:25.752027 13800 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:25.737739 22504 raft_consensus.cc:2804] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:25.752979 13800 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:25.740105 22380 raft_consensus.cc:2749] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:25.764380 13726 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:25.739547 22422 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:25.772338 13832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 4025) took 1151 ms. Trace:
I20260709 12:13:25.772904 13832 rpcz_store.cc:276] 0709 12:13:24.620943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:24.621103 (+   160us) service_pool.cc:224] Handling call
0709 12:13:24.621514 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:24.725200 (+103686us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:24.725256 (+    56us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:24.725335 (+    79us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:13:24.725387 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:25.771943 (+1046556us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b540002d354. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:25.772012 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:25.772245 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":237797248}
I20260709 12:13:25.745023 22199 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:13:25.780078 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:25.746248 22387 raft_consensus.cc:2749] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:25.752278 22414 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:13:25.794780 22413 log.cc:927] Time spent T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
W20260709 12:13:25.795806 22512 log.cc:927] Time spent T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:13:25.796015 13757 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
 from {username='slave'} at 127.0.0.1:48114
I20260709 12:13:25.796864 13757 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:25.797317 13757 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:25.797195 22387 consensus_queue.cc:1048] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:13:25.799417 22513 raft_consensus.cc:2804] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:25.799887 22513 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:25.800239 22513 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:25.803531 22311 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:25.751482 22508 raft_consensus.cc:2749] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader election lost for term 26. Reason: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 26. Current term is 27.
I20260709 12:13:25.804620 22508 raft_consensus.cc:2804] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:25.805016 22508 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:25.805433 22508 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:25.807871 22491 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:25.808820 22439 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:25.809298 13755 raft_consensus.cc:1275] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 12:13:25.762699 22320 raft_consensus.cc:2804] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:25.814946 22320 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:25.815078 13683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 1711) took 1797 ms. Trace:
I20260709 12:13:25.815532 22320 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:25.767477 22504 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:25.817350 22096 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:25.818189 22504 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:25.819751 22096 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 23 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:25.820400 22096 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:25.766965 22506 raft_consensus.cc:2804] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:25.821998 14411 raft_consensus.cc:1240] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:25.822121 22506 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:25.760063 22291 consensus_queue.cc:1048] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.068s
I20260709 12:13:25.822743 22506 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:25.786443 22422 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:25.826388 22156 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:25.826476 13679 raft_consensus.cc:1240] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:25.788156 22507 raft_consensus.cc:2749] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:25.828811 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:25.829457 13687 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:25.830142 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:25.815548 13683 rpcz_store.cc:276] 0709 12:13:24.017989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:24.018139 (+   150us) service_pool.cc:224] Handling call
0709 12:13:24.018480 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:24.215634 (+197154us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:24.215668 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:24.215717 (+    49us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:13:24.215759 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:25.814830 (+1599071us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b54002841d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:25.814879 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:25.815016 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":452712832}
W20260709 12:13:25.833369 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:25.778578 22313 consensus_queue.cc:1048] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.044s
W20260709 12:13:25.794898 22511 log.cc:927] Time spent T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:13:25.843418 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:25.844265 13683 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 23.
I20260709 12:13:25.790731 22494 consensus_queue.cc:1048] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.056s
I20260709 12:13:25.848147 21742 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:25.848623 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:25.851225 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:25.845248 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:25.853703 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:25.856874 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:13:25.832988 22409 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 23 current term: 23 is higher.
I20260709 12:13:25.859431 13829 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 23.
I20260709 12:13:25.860114 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:25.864408 22436 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:25.871899 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:25.858527 13687 raft_consensus.cc:2468] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 19.
I20260709 12:13:25.870523 13685 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a"
dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:55008
I20260709 12:13:25.874321 13685 raft_consensus.cc:606] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:25.874732 13685 raft_consensus.cc:614] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:25.882747 14413 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41692 (request call id 1282) took 1986 ms. Trace:
I20260709 12:13:25.868005 13757 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:25.887400 13756 raft_consensus.cc:1240] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:25.883455 14413 rpcz_store.cc:276] 0709 12:13:23.896218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:23.896571 (+   353us) service_pool.cc:224] Handling call
0709 12:13:23.912216 (+ 15645us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:23.912454 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 12:13:23.947028 (+ 34574us) log.cc:844] Serialized 14 byte log entry
0709 12:13:24.332221 (+385193us) spinlock_profiling.cc:243] Waited 20.5 ms on lock 0x7b180013dbc0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924ea03f3 00007fa924ea27c1 00007fa924ea2779 00007fa924ea2709 00007fa924ea26d1 00007fa924ea19cd 0000000000388634 0000000000388479 00007fa924e8383a
0709 12:13:25.709651 (+1377430us) spinlock_profiling.cc:243] Waited 22.9 ms on lock 0x7b180013dbc0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e1ac0a 00007fa92e55a219 00007fa924ea2a40 00007fa924e9d4e4 00007fa924e9d455 00007fa92b9853c7 00007fa927f979a7 00007fa927fa70bf 00007fa927fa7038
0709 12:13:25.718011 (+  8360us) log.cc:844] Serialized 14 byte log entry
0709 12:13:25.881811 (+163800us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:25.881881 (+    70us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:13:25.881940 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:25.882261 (+   321us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:25.882400 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1391216,"prepare.queue_time_us":1811180,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":92,"raft.queue_time_us":12154,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":14930,"spinlock_wait_cycles":99853440,"thread_start_us":160777,"threads_started":1}
W20260709 12:13:25.880755 22472 consensus_meta.cc:287] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.707s	user 0.013s	sys 0.000s
I20260709 12:13:25.866888 22491 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:25.897827 13757 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:25.899682 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:25.905172 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:25.906576 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:25.909861 13684 raft_consensus.cc:1275] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:13:25.913683 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:25.914427 22504 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:25.915730 13763 raft_consensus.cc:2393] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 23: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:25.917539 22504 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:25.918150 22491 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:25.920354 22491 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:13:25.923506 22285 consensus_meta.cc:287] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.609s	user 0.005s	sys 0.008s
I20260709 12:13:25.923980 22285 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:25.926680 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:25.927405 21935 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:25.927959 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:25.929029 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:25.884925 22365 raft_consensus.cc:2749] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:25.820894 22096 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:25.933797 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:25.938567 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:25.940563 13680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 3851) took 1551 ms. Trace:
I20260709 12:13:25.942530 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:25.942556 13680 rpcz_store.cc:276] 0709 12:13:24.389166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:24.389347 (+   181us) service_pool.cc:224] Handling call
0709 12:13:24.391034 (+  1687us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:24.714588 (+323554us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:25.940240 (+1225652us) spinlock_profiling.cc:243] Waited 323 ms on lock 0x7b5400312ed4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:25.940489 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":742246656}
I20260709 12:13:25.945621 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:25.947945 13684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 3870) took 1210 ms. Trace:
W20260709 12:13:25.941855 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 43985.1us
I20260709 12:13:25.948356 13684 rpcz_store.cc:276] 0709 12:13:24.737891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:25.372886 (+634995us) service_pool.cc:224] Handling call
0709 12:13:25.386631 (+ 13745us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:25.910334 (+523703us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:25.947683 (+ 37349us) spinlock_profiling.cc:243] Waited 516 ms on lock 0x7b5400245ed4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:25.947888 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1186569984}
I20260709 12:13:25.929585 21935 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:25.957831 13685 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a"
dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:55008
I20260709 12:13:25.960753 13685 raft_consensus.cc:606] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
W20260709 12:13:25.960804 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 166615us
I20260709 12:13:25.961294 13685 raft_consensus.cc:614] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:25.952471 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:13:25.950721 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 58598us
I20260709 12:13:25.955276 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:25.909914 22321 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:25.944121 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:25.880292 22436 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:25.975445 13754 raft_consensus.cc:1275] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 32 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 30 index: 19. Preceding OpId from leader: term: 32 index: 20. (index mismatch)
I20260709 12:13:25.973613 14380 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:13:25.976954 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 224032us
I20260709 12:13:25.977950 13800 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:25.980254 13800 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:25.980947 13832 raft_consensus.cc:1275] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:13:25.987807 13800 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:13:25.988734 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 222526us
I20260709 12:13:25.955276 22472 consensus_queue.cc:1059] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 23.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.029s
I20260709 12:13:25.994867 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:25.995555 14413 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 28.
I20260709 12:13:25.997591 13800 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:25.956561 22495 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:25.990640 14379 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:25.950233 22261 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:26.010754 13761 raft_consensus.cc:1240] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 22. Current term is 23. Ops: [22.18-22.18]
I20260709 12:13:25.957489 22320 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:26.000363 14379 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:26.015357 13801 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:25.984437 22321 raft_consensus.cc:2749] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:26.000234 13727 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:25.973024 22164 consensus_queue.cc:1059] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.026s
I20260709 12:13:26.017824 13681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 3866) took 1364 ms. Trace:
I20260709 12:13:25.989667 22285 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:25.987948 22477 raft_consensus.cc:2804] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:26.018091 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:13:26.032013 13681 rpcz_store.cc:276] 0709 12:13:24.653728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:24.719458 (+ 65730us) service_pool.cc:224] Handling call
0709 12:13:24.719831 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:24.982941 (+263110us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:26.017524 (+1034583us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b54002472d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:26.017734 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":479393536}
I20260709 12:13:25.997349 22491 raft_consensus.cc:2804] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:26.017644 22101 raft_consensus.cc:2804] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 12:13:26.042505 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:26.004967 22422 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:26.047591 22210 consensus_queue.cc:1048] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 12:13:26.051422 22096 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:26.051738 22506 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:26.053949 22409 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:26.054559 22409 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:26.055090 22409 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:26.046756 21935 consensus_queue.cc:1048] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 12:13:26.036664 22477 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:26.057508 22513 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:26.047851 22101 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:26.058157 22477 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:13:26.059022 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:26.059293 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 59001.4us
I20260709 12:13:26.061342 13757 raft_consensus.cc:2393] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 27: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:26.060653 22101 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:26.037537 22472 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:26.017560 22518 raft_consensus.cc:2804] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:26.064985 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:26.066835 14411 raft_consensus.cc:2393] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 26: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:13:26.061167 22164 raft_consensus.cc:2804] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:13:26.032954 22509 consensus_queue.cc:1048] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.037s
I20260709 12:13:26.070127 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:26.070298 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:26.070585 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:26.068362 22034 consensus_queue.cc:1048] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.010s
I20260709 12:13:26.082093 22472 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:26.106123 22261 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 30 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:26.107596 22472 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:26.067857 22518 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:26.108321 22518 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:26.047909 22285 raft_consensus.cc:2804] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:26.095397 22513 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:26.109998 22510 consensus_queue.cc:1048] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:13:26.110368 22509 consensus_queue.cc:1048] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:13:26.094250 22495 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:26.096930 13760 raft_consensus.cc:1275] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 12:13:26.040012 22491 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:26.095450 22436 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:26.112121 22491 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:26.103153 22320 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:26.079229 22501 consensus_queue.cc:1048] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:26.109376 22387 consensus_queue.cc:1048] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 12:13:26.115195 22414 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:26.103899 22506 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:26.048090 22493 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:26.107267 22520 consensus_queue.cc:1048] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:26.122997 22421 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:26.119596 22414 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:26.018013 13574 maintenance_manager.cc:643] P 17d79eae88f84be7a847d0cf544674cd: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 2.801s	user 0.138s	sys 0.054s Metrics: {"cfile_cache_miss":8,"cfile_cache_miss_bytes":25991,"cfile_init":4,"delete_count":0,"delta_blocks_compacted":2,"delta_iterators_relevant":2,"dirs.queue_time_us":380229,"dirs.run_cpu_time_us":654,"dirs.run_wall_time_us":18991,"lbm_read_time_us":21382,"lbm_reads_1-10_ms":2,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":21,"lbm_write_time_us":47301,"lbm_writes_10-100_ms":2,"lbm_writes_lt_1ms":9,"peak_mem_usage":273892,"reinsert_count":0,"thread_start_us":425567,"threads_started":3,"update_count":209,"wal-append.queue_time_us":209373}
I20260709 12:13:26.096251 13651 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:26.131721 13575 maintenance_manager.cc:419] P 17d79eae88f84be7a847d0cf544674cd: Scheduling MinorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.002000
I20260709 12:13:26.132419 22436 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:26.135736 22436 consensus_queue.cc:1048] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:13:26.142879 22409 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:26.148128 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:26.195849 22396 raft_consensus.cc:3055] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:26.196486 22396 raft_consensus.cc:740] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:26.153008 13574 maintenance_manager.cc:643] P 17d79eae88f84be7a847d0cf544674cd: MinorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {}
I20260709 12:13:26.204037 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:26.153932 22472 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:26.160401 22508 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:26.163411 22414 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:26.163782 22421 leader_election.cc:290] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 30 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:26.163045 13762 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 26.
I20260709 12:13:26.168174 13727 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:26.177614 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:26.180822 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:26.185285 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:26.172652 22164 raft_consensus.cc:697] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 19 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:26.186705 22285 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:26.188037 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:26.188277 22493 raft_consensus.cc:2749] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:26.189965 22518 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:26.215992 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: true dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:26.218035 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:13:26.249486 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 234255us
I20260709 12:13:26.219923 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:26.221170 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 24 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:26.250622 13686 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:26.250646 13688 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:26.239114 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:26.252571 13680 raft_consensus.cc:2393] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 27: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
W20260709 12:13:26.257434 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:26.260775 13726 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:26.261703 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:26.263118 13832 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 23.
I20260709 12:13:26.264313 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:26.264947 14416 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:26.224427 22212 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:26.275856 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:26.280472 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:26.281891 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:26.286365 22509 raft_consensus.cc:2749] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:26.236949 22223 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:26.249696 22285 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:26.294576 14413 raft_consensus.cc:1275] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
W20260709 12:13:26.293669 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 297038us
I20260709 12:13:26.254671 21893 raft_consensus.cc:2749] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 12:13:26.245715 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 77670us
I20260709 12:13:26.197559 22396 consensus_queue.cc:260] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:26.298307 22212 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:26.322096 22518 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:26.322885 22212 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:26.324689 22101 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:26.311959 13727 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:26.313242 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:26.237816 22472 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:26.304770 13800 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:26.224292 22477 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:26.331516 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:26.240588 22414 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:26.342530 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:26.334069 13652 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:26.338712 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:26.339524 13688 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 26.
I20260709 12:13:26.296525 22493 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:26.347353 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:26.374264 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:13:26.380189 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 68315.2us
I20260709 12:13:26.395201 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:26.396894 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:26.395288 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:13:26.396786 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 140649us
I20260709 12:13:26.398000 13761 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 26.
I20260709 12:13:26.401955 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:26.404189 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 24 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:26.405092 13760 raft_consensus.cc:2393] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 26: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
W20260709 12:13:26.406280 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 72345.1us
I20260709 12:13:26.309814 22223 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:26.407274 13652 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:26.411120 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 30 candidate_status { last_received { term: 29 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:26.408489 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:26.368539 22526 raft_consensus.cc:2804] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:26.409245 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:26.413755 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:26.414429 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:26.415534 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:26.418362 22212 raft_consensus.cc:2749] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 12:13:26.421584 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:26.376732 22493 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:26.396725 21742 consensus_queue.cc:1048] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.069s
I20260709 12:13:26.512533 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 30 candidate_status { last_received { term: 29 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:13:26.513855 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:26.430606 13761 raft_consensus.cc:2393] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 24: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
W20260709 12:13:26.515425 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:26.392258 22505 raft_consensus.cc:2749] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:26.514376 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:26.399796 21893 consensus_queue.cc:1048] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.081s
I20260709 12:13:26.373610 22164 consensus_queue.cc:237] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:26.523600 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 110191us
I20260709 12:13:26.570590 13727 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:26.520857 22526 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:26.584329 13727 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:26.586535 22409 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:13:26.591949 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 246577us
I20260709 12:13:26.581810 22508 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:26.595759 22101 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 24 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:26.600289 22493 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:26.602104 22472 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:26.602725 22472 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:26.602825 22414 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:26.603277 22472 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:26.590781 22539 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:26.581025 22212 consensus_queue.cc:1059] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 20.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.025s
I20260709 12:13:26.544010 22520 consensus_queue.cc:1048] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 12:13:26.580755 22494 raft_consensus.cc:2749] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:26.594471 13727 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:26.586228 22526 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:13:26.623144 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 224345us
I20260709 12:13:26.626510 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 31 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:26.641511 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:26.643796 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:26.605638 22472 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:26.653052 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:26.664079 14413 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:26.659718 13686 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 24.
I20260709 12:13:26.677942 22285 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:26.680541 22285 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:26.610353 21935 raft_consensus.cc:2749] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:26.683615 13761 raft_consensus.cc:1240] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:26.688535 14411 raft_consensus.cc:1240] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 23. Current term is 24. Ops: [23.17-23.17]
I20260709 12:13:26.692096 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:26.696388 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: true dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:26.697283 13837 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:26.701236 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:26.702282 13833 raft_consensus.cc:2393] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 24: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:26.700210 14413 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 29.
I20260709 12:13:26.613952 22510 raft_consensus.cc:2764] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election decision vote started in defunct term 23: won
I20260709 12:13:26.703022 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 24 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:13:26.716629 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:26.717350 13830 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:26.722352 13833 raft_consensus.cc:1275] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 29 index: 17. Preceding OpId from leader: term: 30 index: 16. (term mismatch)
I20260709 12:13:26.723316 13833 pending_rounds.cc:85] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 15
I20260709 12:13:26.723839 13833 pending_rounds.cc:107] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 27.16
I20260709 12:13:26.724215 13833 raft_consensus.cc:2889] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:26.724701 13833 pending_rounds.cc:107] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 29.17
I20260709 12:13:26.725078 13833 raft_consensus.cc:2889] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:26.742683 14416 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 25.
I20260709 12:13:26.748041 14414 raft_consensus.cc:1240] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:26.744309 13801 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:26.750927 14408 raft_consensus.cc:1240] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 19 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:26.753585 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:26.754298 13829 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:26.754388 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:13:26.755378 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 348164us
I20260709 12:13:26.756237 13652 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:26.748447 13833 raft_consensus.cc:1240] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 29. Current term is 30. Ops: []
I20260709 12:13:26.758030 13801 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:13:26.821614 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 63661.2us
I20260709 12:13:26.688364 22472 raft_consensus.cc:3055] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:26.765065 13835 raft_consensus.cc:2393] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 27: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:26.834218 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:26.839515 22507 consensus_queue.cc:1059] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:13:26.840704 22494 consensus_queue.cc:1059] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:13:26.758699 13837 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 24.
I20260709 12:13:26.846859 22509 consensus_queue.cc:1048] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 12:13:26.760679 22491 consensus_meta.cc:287] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.644s	user 0.011s	sys 0.000s
I20260709 12:13:26.836946 22422 raft_consensus.cc:2804] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:26.919205 13830 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 26.
I20260709 12:13:26.764882 22421 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Leader election won for term 29
W20260709 12:13:26.831487 22530 log.cc:927] Time spent T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.295s	user 0.000s	sys 0.001s
I20260709 12:13:26.802023 22223 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:26.935530 13837 raft_consensus.cc:1240] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 29. Current term is 30. Ops: []
I20260709 12:13:26.815572 22477 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 24 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:26.946209 13800 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.017s	sys 0.012s
W20260709 12:13:26.965067 13800 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.017s	sys 0.013s
I20260709 12:13:26.918121 13829 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 24.
I20260709 12:13:26.749748 22506 consensus_queue.cc:1048] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.184s
I20260709 12:13:26.832293 22472 raft_consensus.cc:740] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
W20260709 12:13:26.970716 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 565006us
I20260709 12:13:27.019049 22311 raft_consensus.cc:3055] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:13:26.953184 22409 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:27.061762 22508 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:27.062636 22508 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:27.034412 22223 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:26.949167 22491 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:26.962553 22414 consensus_queue.cc:1059] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.104s
I20260709 12:13:27.036316 22422 raft_consensus.cc:697] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 25 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:27.059664 22311 raft_consensus.cc:740] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
W20260709 12:13:27.113514 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 399491us
I20260709 12:13:27.103379 22414 consensus_queue.cc:1243] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer ca9fbbc2c0a94897897d502d42f3951f log is divergent from this leader: its last log entry 19.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 12:13:27.069056 22409 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:27.125913 22558 log.cc:927] Time spent T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
W20260709 12:13:27.135519 22554 log.cc:927] Time spent T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.311s	user 0.001s	sys 0.000s
I20260709 12:13:27.137171 22409 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:27.138375 22508 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:27.090363 22526 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:27.142539 13834 raft_consensus.cc:1240] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:27.085354 22472 consensus_queue.cc:260] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.18, Last appended by leader: 18, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:27.143716 22472 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:13:27.145212 22539 consensus_meta.cc:287] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.539s	user 0.010s	sys 0.000s
W20260709 12:13:27.131206 22541 log.cc:927] Time spent T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:13:27.130960 22422 consensus_queue.cc:237] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:27.132052 22547 log.cc:927] Time spent T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
W20260709 12:13:27.132972 22553 log.cc:927] Time spent T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
W20260709 12:13:27.133913 22549 log.cc:927] Time spent T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
W20260709 12:13:27.134840 22555 log.cc:927] Time spent T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:13:27.146166 22311 consensus_queue.cc:260] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:27.160812 22311 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:13:27.162387 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 47363.3us
W20260709 12:13:27.154268 22557 log.cc:927] Time spent T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.342s	user 0.000s	sys 0.001s
I20260709 12:13:27.152338 22539 raft_consensus.cc:2749] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:27.150872 22526 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:27.163987 14379 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:27.161578 22421 raft_consensus.cc:697] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 29 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:27.187016 22491 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:27.169476 22477 consensus_queue.cc:1048] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 16, Time since last communication: 0.026s
W20260709 12:13:27.210270 22551 log.cc:927] Time spent T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.395s	user 0.000s	sys 0.003s
I20260709 12:13:27.210505 22421 consensus_queue.cc:237] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 28.18, Last appended by leader: 18, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:27.252666 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:27.253757 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 497365us
I20260709 12:13:27.255082 13688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 3900) took 1031 ms. Trace:
I20260709 12:13:27.258049 13683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 3896) took 1035 ms. Trace:
I20260709 12:13:27.256932 13688 rpcz_store.cc:276] 0709 12:13:26.229292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:26.348682 (+119390us) service_pool.cc:224] Handling call
0709 12:13:26.349048 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:26.543589 (+194541us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:26.543619 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:26.544191 (+   572us) log.cc:844] Serialized 26 byte log entry
0709 12:13:26.930987 (+386796us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:13:26.931048 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:26.931147 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:27.254201 (+323054us) raft_consensus.cc:1685] finished
0709 12:13:27.254304 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:27.254728 (+   424us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4048,"raft.queue_time_us":220901,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":17095,"thread_start_us":578942,"threads_started":2,"wal-append.queue_time_us":410021}
I20260709 12:13:27.258603 13683 rpcz_store.cc:276] 0709 12:13:26.222149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:26.271720 (+ 49571us) service_pool.cc:224] Handling call
0709 12:13:26.305127 (+ 33407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:26.415762 (+110635us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:26.415797 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:26.512502 (+ 96705us) log.cc:844] Serialized 26 byte log entry
0709 12:13:26.691571 (+179069us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:13:26.691608 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:26.691685 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:27.257488 (+565803us) raft_consensus.cc:1685] finished
0709 12:13:27.257529 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:27.257855 (+   326us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":112507,"raft.run_cpu_time_us":51,"raft.run_wall_time_us":51,"thread_start_us":288838,"threads_started":2,"wal-append.queue_time_us":318811}
I20260709 12:13:27.024766 13684 raft_consensus.cc:1275] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 32 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 30 index: 19. Preceding OpId from leader: term: 32 index: 20. (index mismatch)
I20260709 12:13:27.266271 13686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 3904) took 1014 ms. Trace:
W20260709 12:13:27.255230 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:27.268129 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:27.268635 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:27.253964 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:27.274394 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 426374us
W20260709 12:13:27.274813 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:27.266886 13686 rpcz_store.cc:276] 0709 12:13:26.252111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:27.017295 (+765184us) service_pool.cc:224] Handling call
0709 12:13:27.017701 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:27.017953 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:27.017992 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:27.018053 (+    61us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:13:27.018102 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:27.018167 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:27.266055 (+247888us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:27.256299 13679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 3895) took 1034 ms. Trace:
W20260709 12:13:27.283792 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 119807us
I20260709 12:13:27.268504 13687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 3901) took 1038 ms. Trace:
I20260709 12:13:27.284220 13679 rpcz_store.cc:276] 0709 12:13:26.221891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:26.269571 (+ 47680us) service_pool.cc:224] Handling call
0709 12:13:26.270006 (+   435us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:26.513359 (+243353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:26.513406 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:26.513973 (+   567us) log.cc:844] Serialized 26 byte log entry
0709 12:13:26.622436 (+108463us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:13:26.622488 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:26.622555 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:27.209597 (+587042us) spinlock_profiling.cc:243] Waited 8.54 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:13:27.255499 (+ 45902us) raft_consensus.cc:1685] finished
0709 12:13:27.255540 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:27.256107 (+   567us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":147250,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"spinlock_wait_cycles":19650304,"thread_start_us":265678,"threads_started":2,"wal-append.queue_time_us":181728}
I20260709 12:13:27.286058 13687 rpcz_store.cc:276] 0709 12:13:26.229633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:26.571459 (+341826us) service_pool.cc:224] Handling call
0709 12:13:26.571809 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:26.572113 (+   304us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:26.572137 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:26.572649 (+   512us) log.cc:844] Serialized 26 byte log entry
0709 12:13:26.822528 (+249879us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:13:26.932907 (+110379us) log.cc:844] Serialized 14 byte log entry
0709 12:13:27.267835 (+334928us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:27.267994 (+   159us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:27.268096 (+   102us) raft_consensus.cc:1685] finished
0709 12:13:27.268111 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:27.268331 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":702264,"prepare.queue_time_us":109589,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":204837,"raft.run_cpu_time_us":344,"raft.run_wall_time_us":675711,"thread_start_us":579548,"threads_started":2,"wal-append.queue_time_us":455374}
I20260709 12:13:27.302031 13835 raft_consensus.cc:1240] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 25 LEADER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:27.298589 13684 raft_consensus.cc:1240] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 18. Current term is 19. Ops: [18.15-18.15]
I20260709 12:13:27.298642 22162 raft_consensus.cc:2749] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:27.296620 13800 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:27.285332 14379 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:27.283891 13652 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 31 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:13:27.335137 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:27.339066 22162 raft_consensus.cc:2749] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:27.339335 22422 raft_consensus.cc:2749] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:27.344012 22533 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:13:27.345201 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 61617.3us
I20260709 12:13:27.346275 22542 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:27.346737 13652 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:27.348278 22573 consensus_queue.cc:1059] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 29.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:13:27.351578 22493 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:27.352662 22493 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:27.353462 22472 raft_consensus.cc:2749] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 32 FOLLOWER]: Leader election lost for term 31. Reason: could not achieve majority
I20260709 12:13:27.371474 13831 raft_consensus.cc:1240] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 18. Current term is 19. Ops: [15.13-18.15]
I20260709 12:13:27.345386 22533 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:27.380527 13728 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.001s	sys 0.018s
I20260709 12:13:27.383329 22436 raft_consensus.cc:2749] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:13:27.384063 22545 log.cc:927] Time spent T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.583s	user 0.003s	sys 0.000s
I20260709 12:13:27.386253 22533 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:27.347481 22542 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:27.387883 22548 log.cc:927] Time spent T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.338s	user 0.000s	sys 0.001s
I20260709 12:13:27.350483 22573 raft_consensus.cc:3055] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 LEADER]: Stepping down as leader of term 29
I20260709 12:13:27.385424 13652 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:27.401062 13680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 3899) took 1177 ms. Trace:
I20260709 12:13:27.403249 13682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 3898) took 1180 ms. Trace:
I20260709 12:13:27.396289 13726 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:27.404107 22542 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:13:27.404383 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 108137us
I20260709 12:13:27.405346 13680 rpcz_store.cc:276] 0709 12:13:26.222916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:26.307298 (+ 84382us) service_pool.cc:224] Handling call
0709 12:13:26.329302 (+ 22004us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:26.329753 (+   451us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:26.329832 (+    79us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:26.341080 (+ 11248us) log.cc:844] Serialized 26 byte log entry
0709 12:13:26.589970 (+248890us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:13:26.590008 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:26.590073 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:27.382449 (+792376us) spinlock_profiling.cc:243] Waited 2.41 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:13:27.396881 (+ 14432us) raft_consensus.cc:1685] finished
0709 12:13:27.396912 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:27.400720 (+  3808us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":88486,"raft.run_cpu_time_us":69,"raft.run_wall_time_us":68,"spinlock_wait_cycles":5539584,"thread_start_us":188735,"threads_started":1,"wal-append.queue_time_us":359972}
I20260709 12:13:27.412364 13800 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:27.405407 13682 rpcz_store.cc:276] 0709 12:13:26.222674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:26.299534 (+ 76860us) service_pool.cc:224] Handling call
0709 12:13:26.300018 (+   484us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:26.518442 (+218424us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:26.518472 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:26.518988 (+   516us) log.cc:844] Serialized 26 byte log entry
0709 12:13:26.644217 (+125229us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:13:26.644274 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:26.644362 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:27.386650 (+742288us) spinlock_profiling.cc:243] Waited 3.68 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:13:27.402554 (+ 15904us) raft_consensus.cc:1685] finished
0709 12:13:27.402584 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:27.403035 (+   451us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":117432,"raft.run_cpu_time_us":60,"raft.run_wall_time_us":61,"spinlock_wait_cycles":8454912,"thread_start_us":342729,"threads_started":2,"wal-append.queue_time_us":420585}
I20260709 12:13:27.415238 22422 raft_consensus.cc:2764] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election decision vote started in defunct term 23: won
I20260709 12:13:27.416814 22568 raft_consensus.cc:2749] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:13:27.424181 21893 raft_consensus.cc:3055] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:27.429749 21893 raft_consensus.cc:740] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:27.439010 21893 consensus_queue.cc:260] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:27.425735 13800 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:27.435027 22518 raft_consensus.cc:3055] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:13:27.442330 22518 raft_consensus.cc:740] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:27.444169 22518 consensus_queue.cc:260] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:27.446362 22518 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:27.447543 13726 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:27.404961 22573 raft_consensus.cc:740] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:27.451395 22573 consensus_queue.cc:260] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 29.16, Last appended by leader: 16, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:27.453253 22573 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:27.454399 22422 raft_consensus.cc:2749] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 12:13:27.456673 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 171665us
I20260709 12:13:27.458859 22285 raft_consensus.cc:2749] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:13:27.459383 13800 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:27.462376 22422 raft_consensus.cc:2749] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:27.470017 22285 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:27.470969 22285 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:27.473888 22285 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:27.474056 21742 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:27.474992 21742 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:27.501011 13800 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:27.503722 21742 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:27.488123 22579 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:27.520627 22579 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:27.523572 22579 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:27.489176 13681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 3902) took 1259 ms. Trace:
I20260709 12:13:27.493381 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:13:27.494792 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 57737.3us
I20260709 12:13:27.434335 13727 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:27.507609 22162 consensus_queue.cc:1048] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 12:13:27.508821 14379 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:27.510739 22542 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:27.540232 22542 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:27.525086 22421 raft_consensus.cc:2749] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:27.524510 13681 rpcz_store.cc:276] 0709 12:13:26.229945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:26.754350 (+524405us) service_pool.cc:224] Handling call
0709 12:13:26.754681 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:26.782564 (+ 27883us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:26.784053 (+  1489us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:26.796380 (+ 12327us) log.cc:844] Serialized 26 byte log entry
0709 12:13:27.463965 (+667585us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:13:27.464074 (+   109us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:27.464179 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:27.488763 (+ 24584us) raft_consensus.cc:1685] finished
0709 12:13:27.488782 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:27.488976 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":182764,"raft.queue_time_us":203343,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":231064,"thread_start_us":384449,"threads_started":1,"wal-append.queue_time_us":632223}
I20260709 12:13:27.531543 22509 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:27.542747 13800 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:27.543304 22509 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:27.544037 22421 raft_consensus.cc:2804] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:27.544524 22421 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:27.544966 22421 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:27.548262 22542 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:27.523947 13680 raft_consensus.cc:1275] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 12:13:27.541016 21893 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:27.549356 22509 leader_election.cc:290] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:27.550217 22436 raft_consensus.cc:2749] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:13:27.553169 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 44562.5us
I20260709 12:13:27.554015 22365 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:27.555956 22493 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:27.541519 22396 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:13:27.563091 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 80106.5us
W20260709 12:13:27.539232 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 133610us
I20260709 12:13:27.567512 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:27.569414 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:27.570205 13687 pending_rounds.cc:85] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 15
I20260709 12:13:27.570848 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:27.571640 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 24 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:27.565968 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:13:27.581557 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 166528us
I20260709 12:13:27.586374 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:27.593992 21742 raft_consensus.cc:2804] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:27.607375 13684 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 24.
I20260709 12:13:27.614037 13727 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:27.616156 13727 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:27.616513 13652 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:13:27.618300 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:27.618328 22436 raft_consensus.cc:2804] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:27.620596 22436 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:27.620985 13652 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:27.622376 13686 raft_consensus.cc:2393] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 26: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:27.622416 22533 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:27.622813 22579 raft_consensus.cc:2804] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:27.623700 22579 raft_consensus.cc:697] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:27.624147 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:27.626149 22519 consensus_queue.cc:1059] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 29.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:27.628660 13652 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:27.639240 22519 raft_consensus.cc:3055] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 LEADER]: Stepping down as leader of term 29
I20260709 12:13:27.639464 14379 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:27.639813 22519 raft_consensus.cc:740] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:27.640043 13652 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:13:27.631626 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 30 candidate_status { last_received { term: 29 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:27.642163 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 30 candidate_status { last_received { term: 29 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:27.621024 22436 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:27.643815 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:27.607292 13687 pending_rounds.cc:107] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 19.16
I20260709 12:13:27.644567 13687 raft_consensus.cc:2889] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:27.637368 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:27.645622 22509 raft_consensus.cc:2804] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:27.646160 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:27.633611 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:27.625219 22579 consensus_queue.cc:237] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 24.10, Last appended by leader: 10, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:27.646286 22509 raft_consensus.cc:697] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:27.635653 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:27.643873 22156 raft_consensus.cc:2749] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:13:27.646763 13681 raft_consensus.cc:1240] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 18. Current term is 19. Ops: []
W20260709 12:13:27.654721 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:27.656203 22533 raft_consensus.cc:2804] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader election won for term 27
W20260709 12:13:27.660781 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 85200.7us
I20260709 12:13:27.653435 21742 raft_consensus.cc:697] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:27.656040 22542 raft_consensus.cc:2749] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:27.665933 22533 raft_consensus.cc:697] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 27 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:27.641196 22519 consensus_queue.cc:260] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 29.14, Last appended by leader: 14, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:27.670022 13682 raft_consensus.cc:2393] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 24: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:27.661883 22573 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:27.675683 22212 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:27.689849 13726 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
W20260709 12:13:27.690083 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 50210.5us
I20260709 12:13:27.685978 22212 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:27.694468 22212 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:27.695338 22542 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:27.695644 14415 raft_consensus.cc:1275] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 12:13:27.696071 22542 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:27.697655 22493 consensus_queue.cc:1048] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
W20260709 12:13:27.689023 22507 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.703s	user 0.017s	sys 0.024s
I20260709 12:13:27.668267 21742 consensus_queue.cc:237] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:27.702966 22507 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.018s	sys 0.025s
I20260709 12:13:27.711393 22212 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:27.712131 22212 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:27.698756 22573 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:27.704479 22509 consensus_queue.cc:237] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:27.700593 22421 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:27.725133 22519 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:27.705608 22533 consensus_queue.cc:237] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.15, Last appended by leader: 15, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:27.737897 22510 raft_consensus.cc:2804] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:27.739660 22510 raft_consensus.cc:697] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:27.739874 13685 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 24.
I20260709 12:13:27.740749 22472 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:27.740865 22510 consensus_queue.cc:237] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:27.741415 22472 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:27.742985 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:27.758386 22096 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:27.759152 22096 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:27.767650 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:27.768848 13681 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:27.776212 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:27.778966 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 29 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:27.779479 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:27.780220 13761 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Advancing to term 24
I20260709 12:13:27.781116 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:27.782907 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:27.784350 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:27.785223 13755 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 22.
I20260709 12:13:27.786500 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:27.787427 13758 raft_consensus.cc:2376] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 26. Re-sending same reply.
I20260709 12:13:27.788793 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:27.789613 13759 raft_consensus.cc:2376] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 26. Re-sending same reply.
I20260709 12:13:27.790172 22493 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:27.790383 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:27.790827 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 32 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:27.790839 22493 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:27.791743 13760 raft_consensus.cc:2393] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 32 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 32: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:27.792889 13833 raft_consensus.cc:1240] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:27.795193 22493 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:27.795521 13688 raft_consensus.cc:1275] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
W20260709 12:13:27.795277 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 115209us
I20260709 12:13:27.796073 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:27.796734 13834 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 26.
I20260709 12:13:27.810659 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:27.776695 22542 leader_election.cc:290] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:27.812989 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:27.823058 22573 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:27.752803 22396 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:27.824635 13756 raft_consensus.cc:2410] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for term 24 because replica has last-logged OpId of term: 23 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 16.
I20260709 12:13:27.828589 13830 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 19.
I20260709 12:13:27.831023 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 31 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:27.832945 13834 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 30.
I20260709 12:13:27.819592 22542 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:27.843454 22542 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:27.846117 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:27.849989 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:27.845606 22212 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:27.865422 22212 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:27.866129 22212 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:27.866554 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:27.867606 13832 raft_consensus.cc:2393] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 25: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:27.861591 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:27.870085 22421 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:27.870411 13831 raft_consensus.cc:2393] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 26: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:27.873056 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:27.873950 22396 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:27.874488 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:27.875170 13835 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 18.
I20260709 12:13:27.848915 13833 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 28.
W20260709 12:13:27.884548 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:27.886075 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:27.817137 13580 catalog_manager.cc:5697] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 8 to 11, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 11 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:13:27.903200 13681 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 24.
I20260709 12:13:27.878250 22542 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:27.923367 13761 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 24.
I20260709 12:13:27.920308 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:27.928465 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:27.929822 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:27.929919 22542 consensus_queue.cc:1059] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 23.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:13:27.850221 22436 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:27.930992 22542 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:27.931778 13686 raft_consensus.cc:2393] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 27: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:27.931638 22542 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:27.932029 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 44571.4us
I20260709 12:13:27.933730 21893 consensus_queue.cc:1059] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:13:27.934199 22505 raft_consensus.cc:3055] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:27.934742 21893 consensus_queue.cc:1243] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer 96701a74fdee481fb5f54aac841e17dd log is divergent from this leader: its last log entry 25.18 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 17
I20260709 12:13:27.935626 21893 consensus_queue.cc:1059] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 25.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:13:27.937495 21742 raft_consensus.cc:3055] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:27.938000 21742 raft_consensus.cc:740] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:27.938112 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:27.939428 21742 consensus_queue.cc:260] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:27.943387 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 30 candidate_status { last_received { term: 29 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:27.943742 14415 raft_consensus.cc:1240] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 28. Current term is 29. Ops: []
I20260709 12:13:27.944162 13756 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 30.
W20260709 12:13:27.944937 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:27.945117 22542 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:27.934698 22505 raft_consensus.cc:740] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:27.946851 22505 consensus_queue.cc:260] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:27.930814 13688 raft_consensus.cc:2368] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 23. Current term is 24.
I20260709 12:13:27.925480 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:13:27.988699 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 105342us
I20260709 12:13:27.941491 21742 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:27.992107 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:27.945765 22542 raft_consensus.cc:3055] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:27.997174 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:28.002763 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:28.003710 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:28.008011 13830 raft_consensus.cc:1240] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:27.991644 22396 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:28.013368 13834 raft_consensus.cc:1240] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:27.999068 22505 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:28.015153 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:28.012413 13681 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 20.
I20260709 12:13:28.019474 13682 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:28.025843 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:28.000203 22542 raft_consensus.cc:740] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:28.026556 13688 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 24.
I20260709 12:13:28.021771 13686 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 26.
I20260709 12:13:28.036978 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:28.035703 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:28.046761 22508 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:28.047235 13834 raft_consensus.cc:1240] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:28.047441 22508 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:28.049911 22598 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:28.050588 22598 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:28.052579 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:28.053220 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:28.054529 22595 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:28.055177 22595 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:28.058656 22591 log.cc:927] Time spent T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:13:28.060017 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:28.061604 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:28.064105 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:28.084801 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:13:28.071579 13685 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 3878) took 1904 ms (client timeout 1524 ms). Trace:
I20260709 12:13:28.080847 22568 consensus_queue.cc:1059] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 28.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.010s
I20260709 12:13:28.094451 22568 raft_consensus.cc:3055] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 LEADER]: Stepping down as leader of term 28
I20260709 12:13:28.064014 22096 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:28.087926 13685 rpcz_store.cc:269] 0709 12:13:26.167554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:26.167688 (+   134us) service_pool.cc:224] Handling call
0709 12:13:28.071284 (+1903596us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b54001b03d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:28.071471 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3438862080}
I20260709 12:13:28.092932 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:28.080298 22396 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:28.106356 13832 raft_consensus.cc:1240] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 29. Current term is 30. Ops: []
I20260709 12:13:28.116067 13834 raft_consensus.cc:1240] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 27. Current term is 28. Ops: []
I20260709 12:13:28.116793 13829 raft_consensus.cc:1240] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 29 LEADER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 28. Current term is 29. Ops: []
I20260709 12:13:28.117635 13834 raft_consensus.cc:1240] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:28.117924 22396 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:28.099025 22365 raft_consensus.cc:2749] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:28.098098 22568 raft_consensus.cc:740] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:28.151175 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:28.154268 14408 raft_consensus.cc:1275] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 28 index: 18. Preceding OpId from leader: term: 29 index: 19. (index mismatch)
I20260709 12:13:28.155699 22542 consensus_queue.cc:260] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:28.156946 22542 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:28.158659 22510 raft_consensus.cc:3055] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:13:28.158354 22568 consensus_queue.cc:260] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 28.18, Last appended by leader: 18, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:28.159147 22510 raft_consensus.cc:740] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:28.159813 22568 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:28.160283 22510 consensus_queue.cc:260] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:28.169538 22510 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:28.104441 22508 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:28.172453 13651 leader_election.cc:304] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:13:28.178756 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 154415us
I20260709 12:13:28.182421 14379 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:13:28.182962 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 129477us
W20260709 12:13:28.200618 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:28.200773 22593 log.cc:927] Time spent T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:13:28.201465 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:28.202028 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:28.203549 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:28.207515 13726 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:28.209128 13726 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:28.192022 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:28.235975 22589 raft_consensus.cc:2804] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:13:28.236603 22589 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:28.237026 22589 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:28.237083 22510 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:28.237936 22613 consensus_queue.cc:1059] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 26.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.048s
W20260709 12:13:28.239732 22604 log.cc:927] Time spent T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
W20260709 12:13:28.242543 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 68090.5us
W20260709 12:13:28.243193 22608 log.cc:927] Time spent T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:13:28.252209 14408 raft_consensus.cc:2368] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 23. Current term is 24.
W20260709 12:13:28.255942 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:28.250669 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:28.264196 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:28.266215 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:28.288647 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:28.290031 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:28.293124 22579 raft_consensus.cc:2749] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:28.276886 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 31 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:28.259889 22162 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:28.315001 13688 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:28.315613 13679 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 23.
I20260709 12:13:28.315001 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:28.327185 13685 raft_consensus.cc:2410] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 31 because replica has last-logged OpId of term: 30 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 26 index: 15.
I20260709 12:13:28.302692 22598 leader_election.cc:290] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:13:28.351109 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:28.328820 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 62215us
I20260709 12:13:28.351783 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:28.299449 22518 consensus_queue.cc:1048] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.049s
I20260709 12:13:28.362336 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:28.370946 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 31 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:28.371404 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:28.378718 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:13:28.404803 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 82330.3us
I20260709 12:13:28.405881 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:28.425726 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 28 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:28.373750 22579 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:28.449681 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:13:28.481077 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 60999.4us
W20260709 12:13:28.479718 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 53580.2us
I20260709 12:13:28.494640 13756 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:28.495797 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:28.511598 22607 consensus_queue.cc:1048] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:28.512084 14379 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:28.531749 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:13:28.532552 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:28.482950 22573 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:28.428107 22567 consensus_queue.cc:1048] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.304s
I20260709 12:13:28.558547 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 28 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:28.557621 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:13:28.566277 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:28.491089 22311 consensus_queue.cc:1048] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.250s
I20260709 12:13:28.540102 22610 raft_consensus.cc:3055] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:28.568682 22096 raft_consensus.cc:2804] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:28.513175 22579 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:28.553524 22518 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:28.581301 13755 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 27.
I20260709 12:13:28.565861 22573 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:28.575901 21935 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:28.578311 22610 raft_consensus.cc:740] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 26 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
W20260709 12:13:28.589619 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 110319us
I20260709 12:13:28.589589 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:28.581167 22096 raft_consensus.cc:697] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 24 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
W20260709 12:13:28.589047 22614 log.cc:927] Time spent T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.266s	user 0.000s	sys 0.001s
W20260709 12:13:28.619644 22578 log.cc:927] Time spent T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:13:28.620438 22584 consensus_queue.cc:1059] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.031s
I20260709 12:13:28.622205 22610 consensus_queue.cc:260] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 26.19, Last appended by leader: 19, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:28.623632 22610 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:28.626356 13688 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 27.
I20260709 12:13:28.634794 13756 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 27.
I20260709 12:13:28.588212 22518 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:28.597169 22421 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:28.588155 22622 consensus_queue.cc:1059] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.084s
W20260709 12:13:28.662865 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:28.596436 21893 consensus_queue.cc:1059] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 27.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.051s
W20260709 12:13:28.664647 13682 consensus_meta.cc:287] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.624s	user 0.005s	sys 0.009s
W20260709 12:13:28.664505 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 46513.2us
I20260709 12:13:28.666733 13682 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 28.
I20260709 12:13:28.674919 22579 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:28.676636 13800 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:28.678751 22573 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:28.656630 22421 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:28.683869 13801 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:28.690603 21893 raft_consensus.cc:3055] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:13:28.694092 13758 raft_consensus.cc:1240] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 23. Current term is 24. Ops: []
W20260709 12:13:28.696529 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 487456us
I20260709 12:13:28.699087 22639 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:28.699728 22639 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:28.697232 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 185264us
I20260709 12:13:28.683142 21742 raft_consensus.cc:3055] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:28.683945 22533 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:28.664094 21935 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:28.694965 21893 raft_consensus.cc:740] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:28.720731 13800 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:28.719538 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:28.705325 21742 raft_consensus.cc:740] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:28.727726 21742 consensus_queue.cc:260] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.15, Last appended by leader: 15, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:28.720244 22508 raft_consensus.cc:2749] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:13:28.728236 22642 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:28.734802 22518 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:28.745960 13800 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:28.748107 21893 consensus_queue.cc:260] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 27.17, Last appended by leader: 17, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:28.748769 13833 raft_consensus.cc:1275] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 24 index: 10. Preceding OpId from leader: term: 26 index: 11. (index mismatch)
I20260709 12:13:28.750047 21893 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:28.750247 13832 raft_consensus.cc:1275] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 12:13:28.742810 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:28.703663 22096 consensus_queue.cc:237] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:28.718482 22533 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:28.754225 13830 raft_consensus.cc:1275] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:13:28.755156 22639 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:28.755813 22639 consensus_queue.cc:1048] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 12:13:28.760304 22505 consensus_meta.cc:287] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.739s	user 0.008s	sys 0.002s
I20260709 12:13:28.761107 13757 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 23.
I20260709 12:13:28.762153 13726 leader_election.cc:400] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 23. Current term is 24.
I20260709 12:13:28.762511 13726 leader_election.cc:403] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:28.763285 13726 leader_election.cc:304] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:28.764133 22519 raft_consensus.cc:2749] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 23. Current term is 24.
I20260709 12:13:28.764245 22620 consensus_queue.cc:1059] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 24.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.117s
I20260709 12:13:28.764876 22519 raft_consensus.cc:2804] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:28.765367 22519 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:13:28.771409 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:28.765599 22620 raft_consensus.cc:3055] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 LEADER]: Stepping down as leader of term 24
W20260709 12:13:28.764145 22612 log.cc:927] Time spent T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 12:13:28.780548 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:13:28.779567 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:28.783555 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 85685.3us
I20260709 12:13:28.784195 22643 raft_consensus.cc:2804] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:28.773451 22519 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:28.781876 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 30 candidate_status { last_received { term: 29 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:28.811241 13832 raft_consensus.cc:2393] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 30: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:28.812551 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:28.786679 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:28.788417 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:28.788932 13800 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:28.818610 13834 raft_consensus.cc:2410] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 20 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 12:13:28.819501 13800 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:28.820781 22628 raft_consensus.cc:2804] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:28.821226 22628 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:28.789337 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:28.821630 22628 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:28.754289 22533 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:28.822950 22533 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:28.823617 22533 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:28.790165 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:28.791357 21935 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:28.774425 22518 raft_consensus.cc:2804] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader pre-election won for term 28
W20260709 12:13:28.784355 22616 log.cc:927] Time spent T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.279s	user 0.000s	sys 0.001s
I20260709 12:13:28.826942 13800 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:28.827719 22649 raft_consensus.cc:2749] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:28.827000 22518 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:28.828331 22518 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:28.808619 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:28.829420 13688 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 24.
I20260709 12:13:28.830372 13834 raft_consensus.cc:1275] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 15. (term mismatch)
W20260709 12:13:28.832441 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 118532us
I20260709 12:13:28.832636 13834 pending_rounds.cc:85] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 14
I20260709 12:13:28.848616 13832 raft_consensus.cc:1240] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:28.849345 13834 pending_rounds.cc:107] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 18.15
I20260709 12:13:28.850330 14379 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:28.849706 13834 raft_consensus.cc:2889] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:13:28.852038 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:28.783511 22620 raft_consensus.cc:740] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:28.855477 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:28.793798 22633 consensus_queue.cc:1048] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 12:13:28.794003 22641 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:28.853072 22642 raft_consensus.cc:2749] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:28.853636 22607 raft_consensus.cc:2749] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:28.897104 13800 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:28.899179 14408 raft_consensus.cc:2393] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 24: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:13:28.896656 22520 consensus_queue.cc:1048] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.041s
I20260709 12:13:28.860680 22643 raft_consensus.cc:697] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 27 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:28.871436 22584 consensus_queue.cc:1048] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.049s
W20260709 12:13:28.946945 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 148372us
W20260709 12:13:28.953351 22542 consensus_meta.cc:287] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.796s	user 0.010s	sys 0.004s
I20260709 12:13:28.898892 22610 consensus_queue.cc:1048] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.048s
I20260709 12:13:28.963217 22509 raft_consensus.cc:3055] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:28.963739 22509 raft_consensus.cc:740] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:28.964748 22509 consensus_queue.cc:260] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:28.919186 22533 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:28.981559 13759 consensus_meta.cc:287] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.576s	user 0.012s	sys 0.002s
I20260709 12:13:28.983201 13759 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 26.
I20260709 12:13:28.926187 22508 raft_consensus.cc:2749] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:28.982164 22584 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:28.989897 22584 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:28.987241 14379 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:28.982261 22212 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:29.010854 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 31 candidate_status { last_received { term: 29 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:29.011698 13828 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 30.
I20260709 12:13:28.878237 22641 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:29.020332 14379 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:29.020789 22641 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:13:29.022092 22647 log.cc:927] Time spent T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
I20260709 12:13:29.023422 22643 consensus_queue.cc:237] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.14, Last appended by leader: 14, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:29.026712 22652 log.cc:927] Time spent T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:13:29.031083 22519 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:29.033625 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:29.042728 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 145718us
I20260709 12:13:29.043604 14379 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:29.046866 13727 leader_election.cc:400] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 23. Current term is 24.
W20260709 12:13:29.047951 22589 consensus_meta.cc:287] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.810s	user 0.015s	sys 0.000s
I20260709 12:13:29.048445 22589 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:28.947178 22620 consensus_queue.cc:260] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.12, Last appended by leader: 12, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:29.017669 22568 consensus_meta.cc:287] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.857s	user 0.012s	sys 0.003s
I20260709 12:13:29.002487 22584 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:29.060096 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:29.075013 13800 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 30 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:29.076983 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:29.040078 22212 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:13:29.081498 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:29.057013 22607 raft_consensus.cc:2764] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 12:13:29.094813 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 31 candidate_status { last_received { term: 29 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:29.099366 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:13:29.110585 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 53112.7us
I20260709 12:13:29.082015 22096 raft_consensus.cc:2804] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:29.116210 22649 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:29.116237 22645 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:29.119122 22649 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:29.119681 22645 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:29.121877 22649 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:13:29.128428 22627 log.cc:927] Time spent T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.575s	user 0.000s	sys 0.001s
I20260709 12:13:29.120338 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:29.130869 22589 leader_election.cc:290] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 30 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:29.131714 22589 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:29.132432 22589 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:29.112592 22620 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:29.138617 22533 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:29.139407 22533 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:29.140527 22628 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:29.142724 22533 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:29.144881 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:29.145723 13680 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 26.
I20260709 12:13:29.146991 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:29.148224 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:29.149163 22644 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:29.149791 22644 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:29.106654 22660 raft_consensus.cc:2749] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Leader election lost for term 30. Reason: could not achieve majority
I20260709 12:13:29.160095 22096 raft_consensus.cc:697] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 26 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:29.161665 22096 consensus_queue.cc:237] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:29.107234 22610 raft_consensus.cc:2749] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:13:29.164501 13800 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:29.166700 13800 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:29.168560 13800 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:29.169735 22649 raft_consensus.cc:2749] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:13:29.170626 22660 raft_consensus.cc:2749] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:29.170832 22649 raft_consensus.cc:2749] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:13:29.096689 22212 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:29.172960 13688 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 29.
I20260709 12:13:29.174626 22212 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:29.180896 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:29.181953 22212 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:29.182986 22212 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:29.184839 22644 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:29.186834 22212 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:29.190179 22589 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:29.183576 22645 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:29.198588 13685 raft_consensus.cc:1275] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 24 index: 10. Preceding OpId from leader: term: 26 index: 11. (index mismatch)
I20260709 12:13:29.213901 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 24 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:29.227918 13726 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:13:29.239759 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 46736.9us
I20260709 12:13:29.250479 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:29.250730 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:29.254920 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:29.259568 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:29.262151 13800 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:29.260330 13835 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 19.
I20260709 12:13:29.266475 13756 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 23.
I20260709 12:13:29.271432 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 30 candidate_status { last_received { term: 29 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:29.278690 13680 raft_consensus.cc:1275] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:13:29.283291 13683 raft_consensus.cc:1275] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 12:13:29.286520 13763 raft_consensus.cc:1275] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 12:13:29.288178 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:29.290125 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 30 candidate_status { last_received { term: 29 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:29.290738 22519 leader_election.cc:290] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:29.291059 13761 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 30.
W20260709 12:13:29.292542 13577 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45618 (request call id 237) took 53981 ms (client timeout 15000 ms). Trace:
I20260709 12:13:29.281807 13652 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:13:29.298601 13759 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 30.
I20260709 12:13:29.303120 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:29.269035 22637 raft_consensus.cc:2749] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:13:29.313623 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 65706.4us
W20260709 12:13:29.309140 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 273896us
W20260709 12:13:29.330453 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:29.294217 22671 log.cc:927] Time spent T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:13:29.261731 22518 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:29.293264 22630 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:29.334753 13651 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:29.331861 22436 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:29.349475 13726 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:29.372074 22510 raft_consensus.cc:2804] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:29.359676 22654 consensus_queue.cc:1048] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.013s
I20260709 12:13:29.372826 22510 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:29.373466 22510 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:29.359360 22630 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:29.347945 22639 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:29.366004 13800 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:29.374008 22653 raft_consensus.cc:2804] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:29.347033 22589 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:29.357921 22542 raft_consensus.cc:2804] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 12:13:29.293035 13577 rpcz_store.cc:269] 0709 12:12:35.311724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.314059 (+  2335us) service_pool.cc:224] Handling call
0709 12:13:29.292254 (+53978195us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:20.530728 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:20.531547 (+   819us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:20.531611 (+    64us) write_op.cc:435] Acquired schema lock
0709 12:13:20.531628 (+    17us) tablet.cc:662] Decoding operations
0709 12:13:20.533688 (+  2060us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:20.585020 (+ 51332us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:20.587469 (+  2449us) tablet.cc:685] Acquiring locks for 18 operations
0709 12:13:20.677476 (+ 90007us) tablet.cc:701] Row locks acquired
0709 12:13:20.677538 (+    62us) write_op.cc:260] PREPARE: finished
0709 12:13:20.677719 (+   181us) write_op.cc:270] Start()
0709 12:13:20.678133 (+   414us) write_op.cc:276] Timestamp: P: 1783599200677646 usec, L: 0
0709 12:13:20.678186 (+    53us) op_driver.cc:348] REPLICATION: starting
0709 12:13:20.682698 (+  4512us) log.cc:844] Serialized 7124 byte log entry
0709 12:13:21.469243 (+786545us) op_driver.cc:464] REPLICATION: finished
0709 12:13:21.580318 (+111075us) write_op.cc:301] APPLY: starting
0709 12:13:21.583885 (+  3567us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:21.762073 (+178188us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:21.772766 (+ 10693us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:22.479122 (+706356us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:22.479576 (+   454us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=36,key_file_lookups=36,delta_file_lookups=49,mrs_lookups=0
0709 12:13:22.479643 (+    67us) write_op.cc:312] APPLY: finished
0709 12:13:22.480096 (+   453us) log.cc:844] Serialized 164 byte log entry
0709 12:13:22.595818 (+115722us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:22.621624 (+ 25806us) write_op.cc:454] Released schema lock
0709 12:13:22.653991 (+ 32367us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:22.715180 (+ 61189us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:22.720956 (+  5776us) write_op.cc:454] Released schema lock
0709 12:13:23.141549 (+420593us) spinlock_profiling.cc:243] Waited 6.58 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
Metrics: {"mutex_wait_us":61906,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":109043,"apply.run_cpu_time_us":65207,"apply.run_wall_time_us":1107751,"cfile_cache_hit":74,"cfile_cache_hit_bytes":79367,"num_ops":18,"prepare.queue_time_us":397383,"prepare.run_cpu_time_us":22223,"prepare.run_wall_time_us":265014,"raft.queue_time_us":397337,"raft.run_cpu_time_us":28461,"raft.run_wall_time_us":167551,"replication_time_us":740810,"spinlock_wait_cycles":15132032,"thread_start_us":768484,"threads_started":5,"wal-append.queue_time_us":381708,"wal-append.run_cpu_time_us":33372,"wal-append.run_wall_time_us":2883524}]]}
I20260709 12:13:29.354801 13651 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:29.383280 22630 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:29.398238 22637 raft_consensus.cc:2749] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:13:29.423921 22630 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:29.425259 22628 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:29.396605 22542 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:29.426303 22542 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:29.409214 22639 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:29.395713 22520 consensus_queue.cc:1048] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.035s
W20260709 12:13:29.432415 22673 log.cc:927] Time spent T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:13:29.432914 22639 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:29.435431 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:29.396966 13651 leader_election.cc:304] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:13:29.437958 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:29.438202 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 168392us
W20260709 12:13:29.436950 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 47719.7us
I20260709 12:13:29.454854 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:29.455657 13756 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 23.
I20260709 12:13:29.448371 22639 raft_consensus.cc:2804] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Leader election won for term 30
I20260709 12:13:29.411849 22212 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:13:29.458250 13651 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:13:29.465191 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 105050us
I20260709 12:13:29.467304 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:29.394580 22584 consensus_queue.cc:1048] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 12:13:29.480587 13652 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:13:29.453503 22598 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:29.485067 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:29.499776 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:29.410274 22589 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:29.469431 22212 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:29.507272 13800 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:13:29.471357 22533 raft_consensus.cc:2804] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:29.511732 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:29.454255 22644 consensus_queue.cc:1048] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.041s
I20260709 12:13:29.512869 14415 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 23.
I20260709 12:13:29.473878 22639 raft_consensus.cc:697] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 30 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
W20260709 12:13:29.516395 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 46048.4us
I20260709 12:13:29.527078 13652 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:29.501946 22654 raft_consensus.cc:2804] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:13:29.532832 13652 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:29.512812 22212 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:29.535308 13760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 1498) took 1673 ms. Trace:
I20260709 12:13:29.537122 22653 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:29.538558 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:29.535881 13760 rpcz_store.cc:276] 0709 12:13:27.859519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:27.859663 (+   144us) service_pool.cc:224] Handling call
0709 12:13:27.864152 (+  4489us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:27.864838 (+   686us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 12:13:27.993546 (+128708us) log.cc:844] Serialized 14 byte log entry
0709 12:13:28.026706 (+ 33160us) spinlock_profiling.cc:243] Waited 2.04 ms on lock 0x7b18001f70e0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924ea03f3 00007fa924ea27c1 00007fa924ea2779 00007fa924ea2709 00007fa924ea26d1 00007fa924ea19cd 0000000000388634 0000000000388479 00007fa924e8383a
0709 12:13:28.960520 (+933814us) spinlock_profiling.cc:243] Waited 3.5 ms on lock 0x7b18001f70e0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa927b354bc 00007fa924e8348b 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9fc02 00007fa927b2720b 00007fa927b2cd23 00007fa927b2d23a
0709 12:13:28.960931 (+   411us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:28.961567 (+   636us) log.cc:844] Serialized 52 byte log entry
0709 12:13:28.961753 (+   186us) raft_consensus.cc:1645] Marking committed up to 19
0709 12:13:29.402365 (+440612us) spinlock_profiling.cc:243] Waited 4.23 ms on lock 0x7b18001f70e0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e82e07 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9d455 00007fa92b9853c7 00007fa927f979a7 00007fa927fa70bf 00007fa927fa7038
0709 12:13:29.502863 (+100498us) log.cc:844] Serialized 14 byte log entry
0709 12:13:29.524206 (+ 21343us) log.cc:844] Serialized 14 byte log entry
0709 12:13:29.532823 (+  8617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:29.532901 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:29.532939 (+    38us) raft_consensus.cc:1685] finished
0709 12:13:29.532949 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:29.533077 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40215,"prepare.queue_time_us":518509,"prepare.run_cpu_time_us":2321,"prepare.run_wall_time_us":19091,"raft.queue_time_us":43515,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":5405,"spinlock_wait_cycles":22469120,"thread_start_us":251039,"threads_started":3,"wal-append.queue_time_us":121319}
W20260709 12:13:29.539721 22675 log.cc:927] Time spent T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
W20260709 12:13:29.540534 22621 log.cc:927] Time spent T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 1.002s	user 0.001s	sys 0.003s
I20260709 12:13:29.529325 22637 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:29.545140 13757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48120 (request call id 2827) took 1194 ms. Trace:
I20260709 12:13:29.581904 13760 raft_consensus.cc:1240] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 20. Current term is 21. Ops: []
W20260709 12:13:29.582276 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 75136us
I20260709 12:13:29.583244 13800 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:13:29.562328 22639 consensus_queue.cc:237] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 29.16, Last appended by leader: 16, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:29.566236 22656 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:29.530925 22654 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:13:29.568701 13577 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45620 (request call id 253) took 21929 ms (client timeout 15000 ms). Trace:
W20260709 12:13:29.590728 13577 rpcz_store.cc:269] 0709 12:13:07.602430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:29.514614 (+21912184us) service_pool.cc:211] Skipping call since client already timed out
0709 12:13:29.531217 (+ 16603us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:13:29.515558 22533 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:29.595316 22533 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:29.533892 22568 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:29.585538 14379 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:29.581494 13757 rpcz_store.cc:276] 0709 12:13:28.350972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:28.405276 (+ 54304us) service_pool.cc:224] Handling call
0709 12:13:29.544922 (+1139646us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b540035f2d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:29.545048 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":359287680}
I20260709 12:13:29.587553 13756 raft_consensus.cc:1275] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 12:13:29.588656 13800 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:29.576169 22653 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:29.519726 22598 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:29.598217 22654 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:29.590180 22518 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:29.600561 22493 raft_consensus.cc:2804] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:29.614948 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:29.622651 22595 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:29.624984 13758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 3772) took 1274 ms. Trace:
I20260709 12:13:29.625397 13758 rpcz_store.cc:276] 0709 12:13:28.350378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:28.358571 (+  8193us) service_pool.cc:224] Handling call
0709 12:13:28.375474 (+ 16903us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:28.697330 (+321856us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:29.624707 (+927377us) spinlock_profiling.cc:243] Waited 316 ms on lock 0x7b54000889d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:29.624917 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":726948608}
I20260709 12:13:29.604943 22568 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:29.607487 22156 raft_consensus.cc:2749] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:29.632117 22510 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:29.633981 22650 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:29.635025 21742 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:29.636080 22651 raft_consensus.cc:2804] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:29.636631 22651 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:29.637104 22651 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:29.638253 22436 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:13:29.644187 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 55646.3us
I20260709 12:13:29.646294 13800 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:29.579447 22637 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:29.648818 13726 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:29.653260 21893 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:13:29.644858 13683 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 19.
I20260709 12:13:29.653846 21893 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:29.654198 21893 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:29.640931 22493 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:29.657872 22493 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:29.634689 22650 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:29.650326 22635 raft_consensus.cc:2749] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:29.686896 21893 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:29.690711 21893 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 31 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:29.663688 22518 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:13:29.693485 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 47263.8us
I20260709 12:13:29.679469 22643 raft_consensus.cc:2749] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:29.709648 13800 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:13:29.712256 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 179493us
I20260709 12:13:29.714136 13652 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:13:29.716635 22628 raft_consensus.cc:2749] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:13:29.705993 22518 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:29.728431 22620 consensus_meta.cc:287] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.594s	user 0.011s	sys 0.003s
I20260709 12:13:29.722601 22589 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:13:29.762766 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 69841.6us
I20260709 12:13:29.734361 22510 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:29.764379 14379 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:29.750753 22623 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:29.774087 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 60076.1us
I20260709 12:13:29.780572 13652 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:13:29.781877 13800 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:13:29.766913 22595 raft_consensus.cc:2804] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:29.758761 22472 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:29.771759 22162 raft_consensus.cc:2804] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:29.785799 22595 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:29.783732 22623 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:29.829972 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:29.833117 22598 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:29.844129 22162 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:29.861827 22162 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:29.841679 22654 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:29.863991 22654 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 31 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:29.864645 22691 raft_consensus.cc:2804] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:29.865121 22691 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:29.865475 22691 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:29.833693 22637 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:29.851307 22595 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:13:29.853232 22686 log.cc:927] Time spent T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 12:13:29.851912 22650 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:29.869958 13681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 1745) took 1156 ms. Trace:
W20260709 12:13:29.870713 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 89014.3us
I20260709 12:13:29.843086 22436 raft_consensus.cc:2749] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:29.874025 22628 raft_consensus.cc:2804] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:13:29.874235 22635 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:29.823513 22421 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:29.874822 22635 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:29.845700 22518 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:29.878042 13757 raft_consensus.cc:1275] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 12:13:29.877988 22635 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:29.879281 13760 raft_consensus.cc:1275] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 28 index: 18. Preceding OpId from leader: term: 29 index: 19. (index mismatch)
I20260709 12:13:29.831156 22212 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:29.866163 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 85745.2us
I20260709 12:13:29.855243 22623 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:29.882561 22212 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 30 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:29.882978 13652 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:29.870409 13681 rpcz_store.cc:276] 0709 12:13:28.714112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:28.714253 (+   141us) service_pool.cc:224] Handling call
0709 12:13:28.714612 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:28.859242 (+144630us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:28.859297 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:28.867080 (+  7783us) log.cc:844] Serialized 26 byte log entry
0709 12:13:29.559163 (+692083us) spinlock_profiling.cc:243] Waited 3.25 ms on lock 0x7b18004a7820. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e82e07 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9fc02 00007fa927b2720b 00007fa927b2cd23 00007fa927b2d0d1 00007fa927f48a0f
0709 12:13:29.650412 (+ 91249us) raft_consensus.cc:1645] Marking committed up to 19
0709 12:13:29.650454 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:29.650537 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:29.869558 (+219021us) raft_consensus.cc:1685] finished
0709 12:13:29.869589 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:29.869882 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15356,"raft.queue_time_us":161847,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":38015,"spinlock_wait_cycles":7486208,"thread_start_us":203523,"threads_started":2,"wal-append.queue_time_us":792669}
I20260709 12:13:29.889626 22472 raft_consensus.cc:2749] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:29.878307 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:29.892043 13756 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 24.
I20260709 12:13:29.874692 22628 raft_consensus.cc:697] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 28 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:29.894837 22212 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:29.895800 22212 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:29.895484 22628 consensus_queue.cc:237] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 27.17, Last appended by leader: 17, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:29.900539 22212 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:29.905270 22691 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:29.910223 22691 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:29.892992 13652 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:29.915405 22691 raft_consensus.cc:2749] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:29.915827 13652 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:29.923491 13652 leader_election.cc:304] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:29.821729 22542 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:29.924968 22212 raft_consensus.cc:2749] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:29.925748 22212 raft_consensus.cc:2749] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:29.927086 22542 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:29.902766 22653 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:29.935947 22653 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:29.945926 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 168388us
I20260709 12:13:29.953102 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 28 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:29.958119 13652 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:29.959844 13652 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:29.963163 22693 consensus_queue.cc:1059] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:29.964761 22610 raft_consensus.cc:3055] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:13:29.964570 22693 consensus_queue.cc:1048] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:13:29.965268 22610 raft_consensus.cc:740] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:29.967276 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:29.968160 13800 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:29.968302 22396 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:29.968677 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:29.968441 22533 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:29.969954 13682 raft_consensus.cc:1240] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:29.970656 22635 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:13:29.971228 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:29.972096 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 29 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:29.971565 22518 raft_consensus.cc:2804] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:29.976750 22396 raft_consensus.cc:2749] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:29.978461 22518 raft_consensus.cc:697] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 26 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:29.980335 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:29.987128 13652 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:29.973270 22653 raft_consensus.cc:2749] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:29.988942 13800 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:29.990803 13652 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:29.992617 22162 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:29.999101 22639 raft_consensus.cc:2749] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:29.983798 22645 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:29.971258 22635 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:29.994673 22518 consensus_queue.cc:237] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:30.017602 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:29.995718 22610 consensus_queue.cc:260] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:30.018062 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 30 candidate_status { last_received { term: 29 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:29.998519 13652 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:29.957945 22493 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:29.994041 22396 raft_consensus.cc:2749] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:30.002480 22643 raft_consensus.cc:2804] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:30.028751 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:30.001889 13800 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:30.033586 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 29 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:30.003363 22568 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:30.035038 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 31 candidate_status { last_received { term: 29 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:30.035779 13686 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:30.006147 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 30 candidate_status { last_received { term: 29 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:30.006759 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 31 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:30.037580 13757 raft_consensus.cc:2368] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 30. Current term is 31.
I20260709 12:13:30.038012 22649 raft_consensus.cc:2804] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:30.038596 22649 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:30.039019 22649 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:30.039259 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:30.040304 13830 raft_consensus.cc:2393] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 27: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:30.041277 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 31 candidate_status { last_received { term: 29 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:30.043768 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:30.007036 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:30.044828 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:30.045485 22635 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:30.007514 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:30.046151 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:30.008088 22421 consensus_queue.cc:1048] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 12:13:30.046558 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:30.047866 13837 raft_consensus.cc:1240] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:30.045511 14408 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 24.
I20260709 12:13:30.017122 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:30.049383 13684 raft_consensus.cc:2393] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 27: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:30.050246 13830 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:30.050853 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:30.051208 22610 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:30.051551 13832 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 22.
I20260709 12:13:30.045940 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:30.045833 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:30.054165 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:30.055462 22162 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:30.050408 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:30.008679 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:30.022724 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:30.059876 13828 raft_consensus.cc:1240] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 27. Current term is 28. Ops: []
I20260709 12:13:30.060930 13754 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:30.024488 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:30.027343 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 28 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:30.027971 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:30.028837 22643 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:30.008672 22650 consensus_queue.cc:1048] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.039s
I20260709 12:13:30.019982 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:30.003875 22533 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:13:30.067533 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 63141us
I20260709 12:13:29.968189 22651 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:30.062330 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:30.070381 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:30.075166 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:30.075405 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 30 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:30.061167 22653 raft_consensus.cc:2749] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:30.076046 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:30.108976 13835 raft_consensus.cc:2376] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 19. Re-sending same reply.
I20260709 12:13:30.076467 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:30.085210 13754 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 24.
I20260709 12:13:30.050323 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:30.077965 21935 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:30.078074 22568 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:30.086750 13679 raft_consensus.cc:1275] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
I20260709 12:13:30.088901 13829 raft_consensus.cc:2410] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 25 because replica has last-logged OpId of term: 24 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 16.
I20260709 12:13:30.089500 13681 raft_consensus.cc:1240] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 28. Current term is 29. Ops: []
I20260709 12:13:30.090740 22509 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:30.066344 22645 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:30.098150 13652 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:13:30.147004 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 48974.2us
I20260709 12:13:30.148262 13652 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:13:30.098546 22493 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:30.100728 13682 raft_consensus.cc:1240] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 26. Current term is 27. Ops: [26.15-26.15]
I20260709 12:13:30.076786 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:30.022087 22656 raft_consensus.cc:2749] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:30.115851 13684 raft_consensus.cc:2410] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 25 because replica has last-logged OpId of term: 23 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 11.
I20260709 12:13:30.116883 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:30.159790 13828 raft_consensus.cc:2393] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 27: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:30.118667 13686 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 31.
W20260709 12:13:30.121685 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:30.059850 22162 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:30.123961 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 24 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:30.127909 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:30.162837 13683 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:30.070973 22643 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:30.144763 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 31 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:30.154007 13652 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:30.158419 13679 raft_consensus.cc:1240] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:30.127523 22507 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:30.184686 13830 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 31.
I20260709 12:13:30.187224 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 30 candidate_status { last_received { term: 29 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:30.187363 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:30.188292 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 30 candidate_status { last_received { term: 29 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:30.189224 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:30.189668 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:30.190343 13837 raft_consensus.cc:2468] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 17.
I20260709 12:13:30.174571 22162 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:30.194731 22649 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:30.198477 13833 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 24.
I20260709 12:13:30.199496 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 30 candidate_status { last_received { term: 29 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:30.200326 13835 raft_consensus.cc:2393] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 30: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:30.201318 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:30.127274 21935 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:30.202775 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:30.146970 22568 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:30.204062 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:30.205250 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:30.207219 22507 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:30.188324 13828 raft_consensus.cc:2368] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 31 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 30. Current term is 31.
I20260709 12:13:30.210062 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:30.214823 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:30.216208 14408 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 27.
I20260709 12:13:30.220469 13828 raft_consensus.cc:1240] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:30.221062 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:30.222982 13835 raft_consensus.cc:2468] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 20.
I20260709 12:13:30.225508 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:30.226401 13834 raft_consensus.cc:2393] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 22: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
W20260709 12:13:30.226527 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 72604.3us
I20260709 12:13:30.227376 13652 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:30.229321 22639 raft_consensus.cc:2804] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:13:30.229938 22639 raft_consensus.cc:697] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 19 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:30.230911 22639 consensus_queue.cc:237] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:30.233956 22691 raft_consensus.cc:2749] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:30.234395 22651 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:30.235682 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:30.236814 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:30.237356 13686 raft_consensus.cc:1275] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 12:13:30.239204 22645 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:30.240077 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:30.193569 22162 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:30.174299 22396 consensus_queue.cc:1059] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.067s
I20260709 12:13:30.242024 22396 raft_consensus.cc:3055] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:13:30.242406 22396 raft_consensus.cc:740] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:30.243244 22396 consensus_queue.cc:260] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 27.16, Last appended by leader: 16, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:30.244436 22396 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:30.158828 22533 raft_consensus.cc:2749] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
W20260709 12:13:30.245102 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 65068.3us
I20260709 12:13:30.234659 13683 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 27.
I20260709 12:13:30.249624 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:30.253363 13837 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:30.201347 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:30.259594 13833 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 24.
I20260709 12:13:30.259797 13652 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:30.112114 22595 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:30.171036 22653 raft_consensus.cc:2804] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:30.264725 22643 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:30.272086 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:30.270769 13652 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:30.276077 13652 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:30.279808 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:30.280547 13754 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 29.
W20260709 12:13:30.266294 22696 log.cc:927] Time spent T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.116s	user 0.004s	sys 0.000s
W20260709 12:13:30.270162 22698 log.cc:927] Time spent T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.085s	user 0.000s	sys 0.003s
I20260709 12:13:30.197753 22649 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:30.284294 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:30.278688 13652 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:30.290663 13688 raft_consensus.cc:2393] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 19: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:30.290977 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:30.305313 13727 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:30.314059 13652 leader_election.cc:400] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 30 election: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 31 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 30. Current term is 31.
I20260709 12:13:30.314494 13652 leader_election.cc:403] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 30 election: Cancelling election due to peer responding with higher term
I20260709 12:13:30.315372 13727 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:30.269522 22653 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:30.279489 22212 raft_consensus.cc:2804] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:13:30.327939 13652 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:30.331172 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:30.329182 13727 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:30.331010 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:30.334959 14412 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:30.348625 13679 raft_consensus.cc:1275] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 12:13:30.348104 13727 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:30.348023 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:30.355038 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:30.319368 22691 raft_consensus.cc:2749] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:30.357230 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:30.357591 13727 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:30.358430 13800 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:30.320240 22653 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:30.324440 22654 raft_consensus.cc:2749] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 31 FOLLOWER]: Leader election lost for term 30. Reason: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 31 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 30. Current term is 31.
I20260709 12:13:30.363847 21742 raft_consensus.cc:2749] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:30.323872 22212 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:30.378727 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:30.383503 13727 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:30.356416 22630 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Leader election won for term 31
I20260709 12:13:30.394548 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:30.395231 13686 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 28.
I20260709 12:13:30.390985 13760 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 26.
I20260709 12:13:30.355916 22656 raft_consensus.cc:2749] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:30.425109 13727 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:30.362887 22598 raft_consensus.cc:2749] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:30.367461 22644 raft_consensus.cc:2749] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:13:30.368993 22651 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:13:30.432916 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:30.437919 13757 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 23.
I20260709 12:13:30.393666 22620 raft_consensus.cc:2749] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:30.437755 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:30.393841 22212 raft_consensus.cc:3060] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:30.389981 22650 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:30.448243 13727 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:30.451393 13651 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 31 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:30.429833 22533 raft_consensus.cc:2749] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:30.476277 13756 raft_consensus.cc:1275] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
W20260709 12:13:30.476845 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 154468us
I20260709 12:13:30.478272 13652 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:30.473453 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:30.430205 22421 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:30.484764 13835 raft_consensus.cc:1240] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:30.443746 22651 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:30.481340 13651 leader_election.cc:400] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 30 election: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 30. Current term is 31.
I20260709 12:13:30.488955 21742 raft_consensus.cc:2749] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:30.496991 13651 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:30.447218 22630 raft_consensus.cc:697] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:30.500741 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:30.469252 22633 raft_consensus.cc:2804] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:30.505367 13652 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:13:30.507176 13651 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:30.508666 13651 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:30.509857 13800 leader_election.cc:304] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 30 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:30.516548 13652 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:30.483541 22598 raft_consensus.cc:2749] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 31 FOLLOWER]: Leader election lost for term 31. Reason: could not achieve majority
I20260709 12:13:30.482838 22635 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:30.499248 22651 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:30.531078 13800 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:30.498786 22542 raft_consensus.cc:2804] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:13:30.529191 22702 log.cc:927] Time spent T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:13:30.465363 22650 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:30.522733 22654 raft_consensus.cc:2804] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 12:13:30.530444 22703 log.cc:927] Time spent T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:13:30.501343 22643 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:30.539836 14414 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 21.
I20260709 12:13:30.513092 22691 raft_consensus.cc:2749] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:13:30.512915 22472 raft_consensus.cc:2749] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
W20260709 12:13:30.526834 22681 log.cc:927] Time spent T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 12:13:30.522248 22639 raft_consensus.cc:2804] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:30.512406 22633 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:30.550155 22518 raft_consensus.cc:2749] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Leader election lost for term 30. Reason: could not achieve majority
I20260709 12:13:30.560528 22568 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:30.525604 22595 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:30.490089 22421 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:30.567912 22650 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:30.570257 22507 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:30.576367 21935 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:30.580930 13755 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 24.
I20260709 12:13:30.584594 13837 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 20.
I20260709 12:13:30.585932 14416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41700 (request call id 1295) took 1509 ms. Trace:
W20260709 12:13:30.586730 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 55754.4us
I20260709 12:13:30.630545 13800 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:13:30.587707 22706 log.cc:927] Time spent T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 12:13:30.525302 22649 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:30.596338 14412 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 24.
I20260709 12:13:30.548454 22628 raft_consensus.cc:2749] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:30.534627 22542 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:30.550635 22573 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:30.551493 22654 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:30.548019 22598 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:30.631217 13836 raft_consensus.cc:1275] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 29 index: 16. Preceding OpId from leader: term: 30 index: 17. (index mismatch)
I20260709 12:13:30.629725 14416 rpcz_store.cc:276] 0709 12:13:29.076264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:29.076674 (+   410us) service_pool.cc:224] Handling call
0709 12:13:30.585619 (+1508945us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b540059e554. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:30.585836 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2752213248}
I20260709 12:13:30.620100 22639 raft_consensus.cc:697] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 24 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:30.605216 22633 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:30.603551 13757 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:13:30.538503 22635 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:30.635586 22709 log.cc:927] Time spent T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 12:13:30.633816 13800 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:30.658886 21893 raft_consensus.cc:2749] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:13:30.633154 22285 raft_consensus.cc:2804] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:30.628096 22691 raft_consensus.cc:2749] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:30.635788 22493 raft_consensus.cc:2749] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:30.641803 22542 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:30.657099 13757 raft_consensus.cc:606] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 LEADER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:30.649840 22654 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:30.638602 22649 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:30.728273 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 94575.6us
I20260709 12:13:30.729348 13800 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:30.621996 22630 consensus_queue.cc:237] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 29.14, Last appended by leader: 14, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:30.655439 22573 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:30.743224 13800 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:30.727406 22643 raft_consensus.cc:2749] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:13:30.661216 22598 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:30.761909 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 245418us
I20260709 12:13:30.763231 13652 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:30.764029 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:30.774290 13652 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:30.745137 22628 raft_consensus.cc:2749] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 12:13:30.777004 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:30.783084 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:30.759956 22507 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:30.788848 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:30.789127 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:30.790072 14411 raft_consensus.cc:2393] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 24: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
W20260709 12:13:30.791868 22712 log.cc:927] Time spent T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 12:13:30.801105 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:30.801939 22635 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:30.805548 22626 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:30.775962 22472 raft_consensus.cc:2749] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:30.780035 22595 raft_consensus.cc:2749] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:30.813664 22649 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:30.806246 22626 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:30.801136 22509 consensus_meta.cc:287] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.645s	user 0.004s	sys 0.004s
I20260709 12:13:30.826152 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
W20260709 12:13:30.828998 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 85885.1us
I20260709 12:13:30.831827 14410 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765"
dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:46814
I20260709 12:13:30.835430 14411 raft_consensus.cc:2393] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 23: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:13:30.832796 14410 raft_consensus.cc:606] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 29 LEADER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
W20260709 12:13:30.840834 22713 log.cc:927] Time spent T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.236s	user 0.002s	sys 0.000s
I20260709 12:13:30.819052 22507 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:30.858562 13759 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 22.
I20260709 12:13:30.874086 14410 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25896261d1204b3d858fb5b478a89034"
dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:46814
I20260709 12:13:30.833627 13800 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:30.877573 14410 raft_consensus.cc:606] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:30.878233 14410 raft_consensus.cc:614] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:30.806205 22651 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:30.881109 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 47608.6us
I20260709 12:13:30.770946 22639 consensus_queue.cc:237] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.18, Last appended by leader: 18, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:30.833884 22649 raft_consensus.cc:2749] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:30.850028 22421 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:30.892437 13800 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:30.884330 22635 raft_consensus.cc:2749] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:30.860371 22693 consensus_queue.cc:1059] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 24.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.032s
I20260709 12:13:30.906535 22654 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:30.908432 22396 consensus_meta.cc:287] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.664s	user 0.013s	sys 0.000s
I20260709 12:13:30.910514 22654 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:30.908197 22653 consensus_meta.cc:287] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.511s	user 0.012s	sys 0.000s
I20260709 12:13:30.911537 22653 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:30.912807 13684 raft_consensus.cc:1240] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:30.916383 13800 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:30.917042 22653 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:30.918200 22635 raft_consensus.cc:2749] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:13:30.919624 13800 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:30.920535 22635 raft_consensus.cc:2749] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:30.923290 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:30.924222 13683 raft_consensus.cc:2393] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 27: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
W20260709 12:13:30.926558 13651 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.56.194:39545 timed out after 1.574s (SENT) [suppressed 20 similar messages]
I20260709 12:13:30.929914 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:30.937528 22720 consensus_queue.cc:1048] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:13:30.938894 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:30.930151 22635 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:30.939646 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:30.939819 22635 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:30.940874 22714 log.cc:927] Time spent T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.340s	user 0.003s	sys 0.000s
I20260709 12:13:30.941247 13836 raft_consensus.cc:1240] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:30.899505 22649 raft_consensus.cc:2749] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:30.946725 14410 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602"
dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
mode: GRACEFUL
new_leader_uuid: "b98d2519bb504dc6905ed2ede4571835"
 from {username='slave'} at 127.0.0.1:46814
I20260709 12:13:30.947440 14410 raft_consensus.cc:606] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 23 LEADER]: Received request to transfer leadership to TS b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:30.948956 13835 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:30.919756 22507 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:30.895617 22643 consensus_queue.cc:1048] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.036s
I20260709 12:13:30.950168 22720 consensus_queue.cc:1059] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 12:13:30.954795 22720 raft_consensus.cc:3055] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:13:30.955152 22720 raft_consensus.cc:740] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:30.956161 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:30.956552 22720 consensus_queue.cc:260] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:30.963178 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 80643.1us
I20260709 12:13:30.931653 22633 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:30.975250 14380 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:30.976059 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:30.962157 22507 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:30.980664 13683 raft_consensus.cc:2393] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 29: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:30.973608 22635 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:31.018051 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:30.962183 22542 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:31.019109 22725 log.cc:927] Time spent T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:13:31.019256 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:31.019937 22598 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:31.024799 14410 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3"
dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:46814
I20260709 12:13:31.034396 14410 raft_consensus.cc:606] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:31.034802 14410 raft_consensus.cc:614] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:30.977754 22732 raft_consensus.cc:993] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f: : Instructing follower 96701a74fdee481fb5f54aac841e17dd to start an election
I20260709 12:13:31.027326 13831 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 23.
I20260709 12:13:31.030736 22421 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:31.042755 13686 raft_consensus.cc:1240] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:31.031724 13688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 2681) took 1010 ms. Trace:
I20260709 12:13:31.043612 13688 rpcz_store.cc:276] 0709 12:13:30.021389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:30.021543 (+   154us) service_pool.cc:224] Handling call
0709 12:13:31.031481 (+1009938us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b5400040bd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:31.031629 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":591060224}
I20260709 12:13:31.032341 13680 raft_consensus.cc:1240] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:31.045656 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:13:31.036608 22212 consensus_meta.cc:287] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.569s	user 0.007s	sys 0.005s
I20260709 12:13:31.033876 22285 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:31.069734 13800 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:31.071717 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:31.073319 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:31.073573 22693 raft_consensus.cc:2804] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:13:31.012816 22507 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:30.983047 22649 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:31.075555 13688 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 25.
I20260709 12:13:31.067032 13801 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:31.090021 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:31.083077 13688 raft_consensus.cc:1275] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
W20260709 12:13:31.085884 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:31.130010 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 63605.8us
I20260709 12:13:31.134490 13679 raft_consensus.cc:1240] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 31 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 30. Current term is 31. Ops: []
W20260709 12:13:31.084529 13759 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48114 (request call id 3781) took 1782 ms (client timeout 1574 ms). Trace:
I20260709 12:13:31.079504 13800 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:31.067380 22285 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:31.202582 13684 raft_consensus.cc:1275] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 27 index: 17. Preceding OpId from leader: term: 28 index: 18. (index mismatch)
I20260709 12:13:31.058511 22651 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 30 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:31.059405 22626 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:31.224051 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 92978.8us
W20260709 12:13:31.191334 13759 rpcz_store.cc:269] 0709 12:13:29.302417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:29.302712 (+   295us) service_pool.cc:224] Handling call
0709 12:13:31.084342 (+1781630us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b540004fe54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:31.084461 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3565771520}
I20260709 12:13:31.196194 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:13:31.230821 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 151396us
I20260709 12:13:31.232254 13800 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:31.237250 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:31.238483 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:31.239391 13685 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 26.
I20260709 12:13:31.240203 13800 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:31.240886 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:31.243223 22628 raft_consensus.cc:2749] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:13:31.244396 22628 consensus_queue.cc:1048] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:13:31.245942 22735 raft_consensus.cc:2804] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:31.246585 22735 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:31.246992 22735 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:31.252456 22635 raft_consensus.cc:2804] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:31.253149 22635 raft_consensus.cc:697] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 24 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:31.254285 22635 consensus_queue.cc:237] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:31.078786 22493 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:31.055924 22421 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:31.259629 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 130247us
I20260709 12:13:31.268240 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:31.265523 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:13:31.099408 22693 raft_consensus.cc:697] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 20 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:31.138083 22533 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:31.221355 22096 raft_consensus.cc:1081] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 29 LEADER]: Signalling peer 96701a74fdee481fb5f54aac841e17dd to start an election
I20260709 12:13:31.069509 22212 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:31.222819 22650 raft_consensus.cc:2749] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:13:31.228456 22505 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:31.273674 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 74932.4us
I20260709 12:13:31.291640 21742 consensus_queue.cc:1059] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 28.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:13:31.277585 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:31.277842 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:31.279745 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:31.280162 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:31.283371 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:31.287618 13761 raft_consensus.cc:1275] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 27 index: 17. Preceding OpId from leader: term: 28 index: 18. (index mismatch)
I20260709 12:13:31.288159 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:31.294821 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:31.280547 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:31.300941 21893 consensus_queue.cc:1059] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 26.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:13:31.111708 22649 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:31.311980 13759 raft_consensus.cc:1275] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 29 index: 16. Preceding OpId from leader: term: 30 index: 17. (index mismatch)
I20260709 12:13:31.273381 14380 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:31.327430 13829 raft_consensus.cc:1240] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:31.282954 22509 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:31.317085 13762 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 22.
I20260709 12:13:31.302040 14414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41700 (request call id 1298) took 1259 ms. Trace:
I20260709 12:13:31.336920 13682 raft_consensus.cc:1240] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 17. Current term is 18. Ops: []
I20260709 12:13:31.336576 14414 rpcz_store.cc:276] 0709 12:13:30.042281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:30.043459 (+  1178us) service_pool.cc:224] Handling call
0709 12:13:31.301336 (+1257877us) spinlock_profiling.cc:243] Waited 290 ms on lock 0x7b54006301d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:31.301878 (+   542us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":667218176}
I20260709 12:13:31.343896 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:31.345371 13833 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 27.
I20260709 12:13:31.324033 22720 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:31.369381 13761 raft_consensus.cc:1275] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 12:13:31.300563 22533 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:31.386453 22633 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:31.395886 13680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 3951) took 1370 ms. Trace:
I20260709 12:13:31.396484 13680 rpcz_store.cc:276] 0709 12:13:30.025330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:30.094635 (+ 69305us) service_pool.cc:224] Handling call
0709 12:13:31.032114 (+937479us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:31.044933 (+ 12819us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:31.395587 (+350654us) spinlock_profiling.cc:243] Waited 937 ms on lock 0x7b5400040bd0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:31.395789 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2155111808}
I20260709 12:13:31.412142 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:13:31.419370 22734 log.cc:927] Time spent T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 12:13:31.427336 22738 raft_consensus.cc:2804] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:31.427945 22738 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:31.428299 22738 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:31.430683 22162 raft_consensus.cc:3055] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:31.431182 22162 raft_consensus.cc:740] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 24 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:31.432098 22162 consensus_queue.cc:260] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:31.433884 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:31.436053 13651 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:31.437197 22598 consensus_queue.cc:1048] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:13:31.438506 22649 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:31.438761 22598 raft_consensus.cc:2749] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:13:31.437315 13651 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:31.440819 13651 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:31.441529 22653 raft_consensus.cc:2749] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:13:31.442451 22507 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:31.442133 22598 raft_consensus.cc:2804] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:31.443109 22598 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:31.443478 22598 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:31.443660 13760 raft_consensus.cc:1275] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 12:13:31.445478 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:31.448078 22421 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:31.448639 22639 consensus_queue.cc:1048] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:13:31.452116 22573 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:31.453933 22542 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:31.459256 22542 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:31.459830 22542 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:31.464219 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:31.465368 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:31.467361 22533 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:31.474166 22542 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:31.326845 22505 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:31.477144 22505 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:31.411567 22693 consensus_queue.cc:237] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:31.347153 22509 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:31.488085 22509 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:31.481719 22738 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:31.482214 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:31.489935 13758 raft_consensus.cc:2410] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 25 because replica has last-logged OpId of term: 24 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 16.
I20260709 12:13:31.490273 22738 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 24 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:31.483083 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:13:31.506139 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 193259us
W20260709 12:13:31.500741 13835 consensus_meta.cc:287] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.551s	user 0.010s	sys 0.001s
I20260709 12:13:31.507943 13835 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 25.
I20260709 12:13:31.498714 13761 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 25.
I20260709 12:13:31.493520 22746 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:31.517208 13757 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 23.
I20260709 12:13:31.465266 22735 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:31.529300 13828 raft_consensus.cc:1240] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 24. Current term is 25. Ops: []
W20260709 12:13:31.530876 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 219650us
W20260709 12:13:31.533205 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 291660us
W20260709 12:13:31.539706 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 266395us
W20260709 12:13:31.535583 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 212982us
I20260709 12:13:31.542241 13800 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:31.523283 22746 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:31.545508 14379 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:31.530257 22285 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:31.589452 13800 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:13:31.591482 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 46076.1us
I20260709 12:13:31.533174 22630 consensus_queue.cc:1059] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 24.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.016s
I20260709 12:13:31.543011 22493 raft_consensus.cc:2749] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:31.597555 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:31.597926 13800 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:31.601645 14414 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 27.
I20260709 12:13:31.553182 22649 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:31.596719 22628 raft_consensus.cc:2749] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:13:31.587404 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 47096.1us
I20260709 12:13:31.548391 13835 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765"
dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:35422
I20260709 12:13:31.606964 13835 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:31.607390 13835 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:31.609958 13800 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:31.588336 22533 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:13:31.611996 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 67937us
I20260709 12:13:31.614652 22743 raft_consensus.cc:3055] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:31.615075 22729 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:31.615899 22493 raft_consensus.cc:2804] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:31.621395 22626 consensus_queue.cc:1048] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.002s
I20260709 12:13:31.639246 13835 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 31 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:31.612068 22643 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:31.590034 22598 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:31.598426 22650 consensus_queue.cc:1048] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.038s
I20260709 12:13:31.611780 22162 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:31.666851 13832 raft_consensus.cc:1240] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:31.667459 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:31.725059 13830 raft_consensus.cc:2393] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 27: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:31.667637 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:31.670043 13835 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 31 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:31.670485 22633 consensus_queue.cc:1059] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:13:31.672890 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:31.673924 22634 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 32 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:13:31.674913 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 68361.6us
I20260709 12:13:31.675503 13836 raft_consensus.cc:1240] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:31.675767 13727 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:31.676340 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:31.730093 13837 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 27.
I20260709 12:13:31.679509 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:13:31.730463 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 110697us
I20260709 12:13:31.731099 13828 raft_consensus.cc:2393] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 26: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:31.680496 22736 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:31.732290 13831 raft_consensus.cc:2393] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 28: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:31.682562 22735 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:31.640969 22533 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:31.630988 22212 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:31.628918 22749 raft_consensus.cc:2804] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:31.651902 22729 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:31.692160 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 73350.5us
I20260709 12:13:31.659184 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:31.746696 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:31.749342 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:31.750439 13761 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 27.
I20260709 12:13:31.630292 22743 raft_consensus.cc:740] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:31.630021 22693 consensus_queue.cc:1059] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 23.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.061s
I20260709 12:13:31.738516 22639 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:31.604233 22721 consensus_queue.cc:1048] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.047s
I20260709 12:13:31.753648 22639 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:31.657997 22493 raft_consensus.cc:697] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 23 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:31.755860 22639 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:31.756425 22738 raft_consensus.cc:3055] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:31.757089 22738 raft_consensus.cc:740] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 23 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:31.737967 22710 raft_consensus.cc:3055] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 LEADER]: Stepping down as leader of term 28
I20260709 12:13:31.758206 22710 raft_consensus.cc:740] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:31.758530 13833 raft_consensus.cc:1275] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 31 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 29 index: 14. Preceding OpId from leader: term: 31 index: 15. (index mismatch)
I20260709 12:13:31.758260 22738 consensus_queue.cc:260] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:31.759127 22710 consensus_queue.cc:260] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 28.17, Last appended by leader: 17, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:31.759760 22738 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:31.760826 22710 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:31.762024 22653 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:31.762480 22285 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:31.762632 22653 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:31.764976 22653 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:31.766269 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 90584.6us
I20260709 12:13:31.767135 13727 leader_election.cc:304] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:31.768436 22649 raft_consensus.cc:2749] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:31.721649 13801 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 30 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:31.769299 13834 raft_consensus.cc:1240] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 26. Current term is 27. Ops: []
W20260709 12:13:31.769887 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 48329.6us
I20260709 12:13:31.770627 13801 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:31.772261 13801 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:31.728556 22595 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:31.774156 22733 consensus_queue.cc:1059] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:31.774590 22626 consensus_queue.cc:1059] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 17.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:13:31.775344 22735 raft_consensus.cc:2749] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:31.775532 22733 raft_consensus.cc:3055] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:13:31.776117 22733 raft_consensus.cc:740] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:31.777273 22735 raft_consensus.cc:2804] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:31.737890 22736 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:31.757102 22745 raft_consensus.cc:3055] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:31.778348 22745 raft_consensus.cc:740] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:31.779243 22745 consensus_queue.cc:260] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 24.13, Last appended by leader: 13, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:31.777161 22733 consensus_queue.cc:260] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:31.780581 22745 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:31.781368 22733 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:31.755461 22493 consensus_queue.cc:237] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:31.786152 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:31.736967 13837 raft_consensus.cc:1240] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 31 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 29. Current term is 31. Ops: []
I20260709 12:13:31.788084 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 31 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: true dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:31.788707 13758 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Advancing to term 31
I20260709 12:13:31.774094 22595 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:31.789887 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:31.790822 22595 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:31.789908 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:31.785660 13686 raft_consensus.cc:1240] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:31.791676 14416 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:31.738713 22542 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:31.738551 22634 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:31.792419 22542 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:31.793969 22634 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:31.794564 22542 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:31.794696 22633 raft_consensus.cc:2804] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:31.795220 22542 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:31.795359 22633 raft_consensus.cc:697] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:31.795745 22542 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:31.796700 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:31.796355 22633 consensus_queue.cc:237] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:31.797278 13727 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:31.738339 22720 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:13:31.794029 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 64613.2us
I20260709 12:13:31.798151 22720 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:31.730623 22518 consensus_queue.cc:1048] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.010s
I20260709 12:13:31.799113 13726 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:31.799700 22715 consensus_queue.cc:1059] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:13:31.800314 22720 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:31.800808 13726 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:31.800961 22651 consensus_queue.cc:1048] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:31.801594 22721 raft_consensus.cc:2749] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 31 FOLLOWER]: Leader election lost for term 30. Reason: could not achieve majority
I20260709 12:13:31.794198 22573 raft_consensus.cc:2749] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:31.799317 22505 raft_consensus.cc:993] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7: : Instructing follower 96701a74fdee481fb5f54aac841e17dd to start an election
I20260709 12:13:31.794060 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:31.804538 13754 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:31.807925 21742 raft_consensus.cc:2804] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:31.809039 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:31.810938 13726 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:31.814443 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:31.815434 13759 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 27.
I20260709 12:13:31.822811 13758 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 31.
I20260709 12:13:31.804979 22735 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:31.848131 21893 consensus_queue.cc:1048] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:31.775709 22626 raft_consensus.cc:3055] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:13:31.827097 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:31.858740 22626 raft_consensus.cc:740] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:31.860278 22626 consensus_queue.cc:260] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 17.16, Last appended by leader: 16, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:31.799116 22519 raft_consensus.cc:2804] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:31.863011 22519 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:31.867558 22519 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:31.919319 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:31.756119 22533 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:31.870970 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:31.871899 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 31 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: true dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:31.921767 14410 raft_consensus.cc:3055] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 29 LEADER]: Stepping down as leader of term 29
I20260709 12:13:31.872167 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:31.922863 13687 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:31.875242 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:31.877800 14409 raft_consensus.cc:1240] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 20 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:31.883411 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:31.925489 13683 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 21.
I20260709 12:13:31.890182 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:31.887805 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:31.929112 22630 raft_consensus.cc:1081] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 LEADER]: Signalling peer 96701a74fdee481fb5f54aac841e17dd to start an election
I20260709 12:13:31.938537 22685 raft_consensus.cc:3055] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:31.939270 22685 raft_consensus.cc:740] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:31.803836 22749 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:31.922267 14410 raft_consensus.cc:740] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 29 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:31.848747 22735 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:31.779901 22736 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:31.948400 14408 raft_consensus.cc:1275] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 24 index: 19. (index mismatch)
I20260709 12:13:31.876281 22285 raft_consensus.cc:3055] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:13:31.961424 14379 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:31.872046 22634 raft_consensus.cc:2804] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:31.919809 22573 raft_consensus.cc:2749] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:31.976604 13754 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 26.
W20260709 12:13:31.978636 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 181041us
I20260709 12:13:31.983134 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:13:31.983997 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 236255us
I20260709 12:13:31.984797 13652 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:13:31.985101 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:31.962551 22542 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:31.952032 14410 consensus_queue.cc:260] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 29.18, Last appended by leader: 18, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:31.951217 22533 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:31.948190 22749 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:31.992875 13651 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:31.996321 22643 raft_consensus.cc:2749] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:32.000185 22746 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:31.980983 22736 raft_consensus.cc:2749] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:31.972303 22639 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:31.973738 22285 raft_consensus.cc:740] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:31.978685 22634 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:32.003136 14410 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Advancing to term 31
I20260709 12:13:31.982969 22626 raft_consensus.cc:3060] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:31.989979 22653 raft_consensus.cc:2804] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:32.021468 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:32.030783 13754 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:32.026948 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:32.028568 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:31.940359 22685 consensus_queue.cc:260] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:32.028729 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:32.029474 22493 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:32.076244 13754 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 24.
W20260709 12:13:32.071995 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 261028us
W20260709 12:13:32.072690 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 273729us
I20260709 12:13:32.030094 22634 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:32.093402 13830 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9"
dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:54820
I20260709 12:13:32.094225 13830 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:32.094678 13830 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:32.002193 22533 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:32.110903 14416 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 25.
W20260709 12:13:32.115257 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:32.062350 22518 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:13:32.132586 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 140625us
I20260709 12:13:32.163277 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:32.031986 22639 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:32.177793 21742 raft_consensus.cc:697] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:32.186386 13754 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 22.
I20260709 12:13:32.101186 22760 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:13:32.182339 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 103146us
I20260709 12:13:32.195026 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:32.161053 22759 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:32.223850 21742 consensus_queue.cc:237] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:32.170502 22598 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:32.284435 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:13:32.285043 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 78534.3us
I20260709 12:13:32.192889 13830 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:32.092856 22493 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:32.322975 13830 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:32.181270 22542 raft_consensus.cc:2804] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:32.174412 22518 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:31.997958 22737 consensus_queue.cc:1175] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "96701a74fdee481fb5f54aac841e17dd" responder_term: 31 status { last_received { term: 29 index: 18 } last_committed_idx: 18 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 29. Current term is 31. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:13:32.238389 22760 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:32.206679 22285 consensus_queue.cc:260] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:32.327440 22759 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:32.697196 13652 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.024s	sys 0.029s
W20260709 12:13:32.711660 22653 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.016s	sys 0.045s
W20260709 12:13:32.865412 13651 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.000s	sys 0.012s
W20260709 12:13:33.029596 13651 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.001s	sys 0.012s
W20260709 12:13:32.866413 13654 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.001s	sys 0.010s
W20260709 12:13:33.030706 13654 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.845s	user 0.002s	sys 0.011s
I20260709 12:13:32.973896 22493 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:13:32.869491 13680 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.003s	sys 0.008s
W20260709 12:13:33.038288 13680 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.861s	user 0.005s	sys 0.008s
W20260709 12:13:32.864684 14379 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.873s	user 0.005s	sys 0.018s
W20260709 12:13:33.039218 14379 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.048s	user 0.007s	sys 0.019s
I20260709 12:13:32.197682 22762 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 32 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:32.322975 22757 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:13:32.749356 13686 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.005s	sys 0.011s
I20260709 12:13:32.180629 22763 consensus_queue.cc:1059] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 26.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.212s
I20260709 12:13:32.204685 22507 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:13:33.007671 14410 consensus_meta.cc:287] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.987s	user 0.018s	sys 0.000s
W20260709 12:13:33.010535 13687 consensus_meta.cc:287] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 1.087s	user 0.009s	sys 0.012s
W20260709 12:13:33.002657 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 712013us
I20260709 12:13:33.046125 22773 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:33.051857 13726 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:33.051752 22773 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:33.053297 13726 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:33.057999 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:33.005367 22542 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:32.996338 22598 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:13:33.029240 22653 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.955s	user 0.017s	sys 0.045s
I20260709 12:13:33.045208 13760 raft_consensus.cc:1240] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 LEADER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 26. Current term is 27. Ops: []
W20260709 12:13:33.039665 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 1.04868e+06us
W20260709 12:13:33.017614 13652 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.841s	user 0.025s	sys 0.029s
W20260709 12:13:33.049541 13686 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.959s	user 0.006s	sys 0.015s
I20260709 12:13:33.011737 22505 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:33.028307 13829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35422 (request call id 1784) took 1356 ms. Trace:
I20260709 12:13:33.057042 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:33.050315 13687 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 26.
W20260709 12:13:33.018973 22738 consensus_meta.cc:287] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 1.259s	user 0.021s	sys 0.004s
I20260709 12:13:33.050076 14410 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 31.
W20260709 12:13:33.011130 22162 consensus_meta.cc:287] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 1.280s	user 0.025s	sys 0.007s
I20260709 12:13:33.086390 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:33.087561 13687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 2699) took 1292 ms. Trace:
I20260709 12:13:33.106530 13831 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 28.
I20260709 12:13:33.106427 13687 rpcz_store.cc:276] 0709 12:13:31.795234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:31.805645 (+ 10411us) service_pool.cc:224] Handling call
0709 12:13:33.087478 (+1281833us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:33.088086 14410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41692 (request call id 1333) took 1275 ms. Trace:
I20260709 12:13:33.088598 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:33.108006 13834 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:33.086103 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:33.072495 22542 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:33.109252 13833 raft_consensus.cc:3060] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:33.086324 13829 rpcz_store.cc:276] 0709 12:13:31.656572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:31.656815 (+   243us) service_pool.cc:224] Handling call
0709 12:13:33.002474 (+1345659us) spinlock_profiling.cc:243] Waited 261 ms on lock 0x7b54000afad4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:33.012345 (+  9871us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":601158528}
I20260709 12:13:33.069111 22285 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:33.057245 22493 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:33.088591 13652 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:33.088907 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:13:33.099701 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 46514.5us
I20260709 12:13:33.095718 22773 leader_election.cc:290] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:33.070192 22754 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:33.135568 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:33.066749 22507 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:33.087498 13832 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 23.
I20260709 12:13:33.107714 14410 rpcz_store.cc:276] 0709 12:13:31.812906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:31.813099 (+   193us) service_pool.cc:224] Handling call
0709 12:13:33.088016 (+1274917us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:33.075873 22653 raft_consensus.cc:697] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 25 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:33.146896 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:33.145592 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:33.073905 13835 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 23.
I20260709 12:13:33.101209 22741 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:33.111065 22421 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:33.067118 22757 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:33.108806 22771 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:33.087534 22598 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:33.167253 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:33.093036 22505 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:33.167243 22635 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:33.176033 22797 consensus_queue.cc:1059] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:13:33.177464 22774 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:33.179519 22760 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:33.184964 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:33.136525 22768 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:33.203264 13833 raft_consensus.cc:2468] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 18.
I20260709 12:13:33.151369 22773 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:33.108569 22738 consensus_queue.cc:1059] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.060s
I20260709 12:13:33.148351 22782 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:33.242280 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:33.252483 13687 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 23.
I20260709 12:13:33.141053 22493 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:33.157567 22729 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:33.246955 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 105488us
I20260709 12:13:33.097721 22762 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:33.258647 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:33.237262 22737 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:33.263533 14410 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 23.
I20260709 12:13:33.195519 22421 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:33.253336 22715 raft_consensus.cc:2804] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election won for term 27
W20260709 12:13:33.269470 22745 consensus_meta.cc:287] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 1.488s	user 0.015s	sys 0.011s
I20260709 12:13:33.328186 13686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 2697) took 1533 ms. Trace:
W20260709 12:13:33.322094 22634 consensus_meta.cc:287] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 1.214s	user 0.017s	sys 0.001s
I20260709 12:13:33.278642 22729 raft_consensus.cc:3055] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:33.331297 13686 rpcz_store.cc:276] 0709 12:13:31.794576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:31.802386 (+  7810us) service_pool.cc:224] Handling call
0709 12:13:31.802779 (+   393us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:31.992367 (+189588us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:31.992426 (+    59us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:32.015970 (+ 23544us) log.cc:844] Serialized 52 byte log entry
0709 12:13:33.075072 (+1059102us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:13:33.075124 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:33.075217 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:33.327875 (+252658us) raft_consensus.cc:1685] finished
0709 12:13:33.327906 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:33.328103 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6084,"raft.queue_time_us":66540,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":49509,"thread_start_us":1172927,"threads_started":2,"wal-append.queue_time_us":973533}
I20260709 12:13:33.248312 22769 consensus_queue.cc:1059] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 30.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.069s
I20260709 12:13:33.151855 22754 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:33.201663 22771 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:33.322682 22626 consensus_meta.cc:287] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 1.290s	user 0.012s	sys 0.017s
I20260709 12:13:33.193488 22741 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:33.323310 22735 consensus_meta.cc:287] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 1.351s	user 0.012s	sys 0.009s
I20260709 12:13:33.235116 22635 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:33.409395 22778 log.cc:927] Time spent T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 12:13:33.251612 22773 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:33.409693 22505 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:33.334353 22795 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:33.327329 22733 consensus_meta.cc:287] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 1.545s	user 0.015s	sys 0.010s
W20260709 12:13:33.327082 22710 consensus_meta.cc:287] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 1.562s	user 0.021s	sys 0.004s
W20260709 12:13:33.458454 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 369931us
W20260709 12:13:33.330943 22749 consensus_meta.cc:287] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 1.318s	user 0.002s	sys 0.019s
I20260709 12:13:33.273329 22793 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:33.325584 22715 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:33.340128 22519 consensus_meta.cc:287] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 1.389s	user 0.017s	sys 0.016s
I20260709 12:13:33.248394 22768 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:33.486805 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: true dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:33.274430 22653 consensus_queue.cc:237] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:33.526391 13758 raft_consensus.cc:3055] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:33.526814 13758 raft_consensus.cc:740] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:33.487948 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:33.488737 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:33.483609 13834 raft_consensus.cc:2468] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 21.
I20260709 12:13:33.374428 22761 raft_consensus.cc:2749] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:33.241860 22774 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:33.410382 22421 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:33.376243 22518 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:33.375464 22787 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:33.374950 22729 raft_consensus.cc:740] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 26 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:33.506850 13828 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 25.
I20260709 12:13:33.518594 22792 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:33.507557 22735 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:33.273658 22737 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:33.455930 22788 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:33.511727 13800 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:13:33.608006 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 96426.9us
I20260709 12:13:33.607766 22788 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:33.608814 22804 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:33.609418 22804 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:33.609794 13800 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:33.611303 13800 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:33.611845 22804 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:33.259063 22782 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:33.612437 22804 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:33.612978 22804 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:33.524024 22749 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:33.588186 22787 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:33.615031 22809 raft_consensus.cc:2804] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:33.615571 22809 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:13:33.499909 22775 log.cc:927] Time spent T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.467s	user 0.000s	sys 0.001s
I20260709 12:13:33.616068 22809 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:33.616710 22783 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:13:33.374078 22634 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:33.618171 14414 raft_consensus.cc:2368] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 27. Current term is 28.
I20260709 12:13:33.618064 13757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 2864) took 1872 ms. Trace:
W20260709 12:13:33.500756 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 245592us
I20260709 12:13:33.570003 22786 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:33.620275 14379 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:13:33.512579 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 59115.8us
I20260709 12:13:33.618858 13757 rpcz_store.cc:276] 0709 12:13:31.745423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:31.747917 (+  2494us) service_pool.cc:224] Handling call
0709 12:13:31.748426 (+   509us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:31.871807 (+123381us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:13:31.947973 (+ 76166us) log.cc:844] Serialized 14 byte log entry
0709 12:13:32.179351 (+231378us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:32.202267 (+ 22916us) log.cc:844] Serialized 52 byte log entry
0709 12:13:32.202429 (+   162us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:13:32.202466 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:32.202544 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:33.617735 (+1415191us) raft_consensus.cc:1685] finished
0709 12:13:33.617763 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:33.617992 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":173317,"prepare.queue_time_us":76735,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":45,"raft.queue_time_us":254410,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":4058,"thread_start_us":118742,"threads_started":1,"wal-append.queue_time_us":349413}
I20260709 12:13:33.628880 13651 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:33.558946 13758 consensus_queue.cc:260] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.12, Last appended by leader: 12, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:33.525954 22793 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:33.646798 22634 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 29 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:33.523543 22715 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:33.530941 22519 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:33.518283 22795 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:33.524932 22760 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:33.597259 13680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 1773) took 1790 ms. Trace:
I20260709 12:13:33.592236 22803 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:33.519119 13652 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:33.616812 22729 consensus_queue.cc:260] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.18, Last appended by leader: 18, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:33.535053 22759 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:33.646265 13754 raft_consensus.cc:1240] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 28. Current term is 29. Ops: [28.18-28.18]
I20260709 12:13:33.573768 22745 raft_consensus.cc:3055] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 LEADER]: Stepping down as leader of term 30
W20260709 12:13:33.616338 22758 log.cc:927] Time spent T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.359s	user 0.000s	sys 0.001s
I20260709 12:13:33.594030 22773 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:33.590624 22784 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:33.534003 22710 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:33.654443 22421 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 31 FOLLOWER]: Leader election won for term 31
I20260709 12:13:33.654561 22786 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:33.597934 22792 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:33.683036 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:13:33.684880 13728 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.000s	sys 0.009s
W20260709 12:13:33.702294 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 183274us
I20260709 12:13:33.705744 13652 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:33.707413 13652 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:33.681547 22519 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:33.648177 22507 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:33.727761 22790 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:33.728890 22653 raft_consensus.cc:2749] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:33.728600 22790 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:33.729754 22653 raft_consensus.cc:2749] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:33.730090 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:33.730216 22777 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:33.730852 22777 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:33.731313 22790 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:33.733137 22786 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:33.701491 22781 raft_consensus.cc:2804] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:33.734320 22781 raft_consensus.cc:697] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 22 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:33.735424 22781 consensus_queue.cc:237] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:33.677919 22693 raft_consensus.cc:2804] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:33.738402 22693 raft_consensus.cc:697] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 24 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:33.739588 22774 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:33.739710 22693 consensus_queue.cc:237] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:33.728627 22793 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:33.673893 22745 raft_consensus.cc:740] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:13:33.742604 22542 consensus_meta.cc:287] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.602s	user 0.010s	sys 0.000s
I20260709 12:13:33.743095 22542 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:33.743294 22745 consensus_queue.cc:260] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 30.16, Last appended by leader: 16, Current term: 30, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:33.744695 22745 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:33.746165 22788 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:33.702840 13686 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 20.
I20260709 12:13:33.751206 22518 raft_consensus.cc:2804] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:33.751833 22518 raft_consensus.cc:697] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 26 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:33.678130 22803 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:33.725260 22759 raft_consensus.cc:2749] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:33.756582 22803 leader_election.cc:290] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:33.758651 22795 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:33.700120 22784 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:33.701833 22783 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:33.760581 22783 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:33.763384 22783 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:33.678469 22598 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:33.731074 13687 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 24.
I20260709 12:13:33.768805 22794 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:33.769502 22794 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:33.699930 22710 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:33.774740 22710 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:33.753007 22518 consensus_queue.cc:237] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.12, Last appended by leader: 12, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:33.791105 14409 raft_consensus.cc:2468] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 18.
W20260709 12:13:33.703855 13728 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.000s	sys 0.009s
W20260709 12:13:33.799420 22285 consensus_meta.cc:287] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.664s	user 0.011s	sys 0.001s
I20260709 12:13:33.890149 22803 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:33.801906 22794 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:33.902360 22803 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:33.886747 13578 catalog_manager.cc:5697] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 21 to 23, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 23 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:13:33.903602 22810 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:33.700727 22760 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:33.745376 22542 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:33.906296 13837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 4148) took 1798 ms. Trace:
I20260709 12:13:33.674748 13680 rpcz_store.cc:276] 0709 12:13:31.806973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:31.807146 (+   173us) service_pool.cc:224] Handling call
0709 12:13:31.872020 (+ 64874us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:31.872422 (+   402us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:31.872460 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:31.924582 (+ 52122us) log.cc:844] Serialized 26 byte log entry
0709 12:13:32.098075 (+173493us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:13:32.176900 (+ 78825us) log.cc:844] Serialized 14 byte log entry
0709 12:13:33.038738 (+861838us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:33.038827 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:33.596970 (+558143us) raft_consensus.cc:1685] finished
0709 12:13:33.597012 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:33.597182 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":83534,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":1091447,"raft.run_cpu_time_us":414,"raft.run_wall_time_us":8606,"thread_start_us":976463,"threads_started":2,"wal-append.queue_time_us":1548085}
I20260709 12:13:33.904404 22810 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:33.905154 22803 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:33.794607 22784 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:33.873942 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 46767.5us
W20260709 12:13:33.804826 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 97507.6us
I20260709 12:13:33.899593 14412 raft_consensus.cc:2468] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 21.
I20260709 12:13:33.906744 13837 rpcz_store.cc:276] 0709 12:13:32.108150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:32.108321 (+   171us) service_pool.cc:224] Handling call
0709 12:13:32.173253 (+ 64932us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:33.018485 (+845232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:33.018527 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:33.018571 (+    44us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:13:33.018608 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:33.905993 (+887385us) spinlock_profiling.cc:243] Waited 845 ms on lock 0x7b54002a6054. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:33.906046 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:33.906196 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1943190272}
I20260709 12:13:33.923161 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:33.924396 14410 raft_consensus.cc:2393] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 21: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:33.785418 22809 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:33.930594 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 318433us
W20260709 12:13:33.934803 13802 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.939s	user 0.009s	sys 0.012s
W20260709 12:13:33.997023 13802 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.021s	user 0.010s	sys 0.012s
I20260709 12:13:33.918895 22764 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:34.001502 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:33.913493 22519 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:34.004643 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:34.005385 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:33.928426 22507 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
W20260709 12:13:34.006834 22633 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.939s	user 0.015s	sys 0.008s
I20260709 12:13:33.844290 22715 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:34.017849 22781 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:34.024128 22781 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:34.024865 22809 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:34.010082 22764 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:34.026336 22781 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:34.015177 13652 connection.cc:256] RPC call timeout handler was delayed by -1.0296765790001245s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15500000000000003s for a response
I20260709 12:13:34.028821 13652 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:34.029758 22781 raft_consensus.cc:2749] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:34.030102 13652 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:13:34.019704 22507 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:34.031483 13652 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:13:34.032924 22773 raft_consensus.cc:2804] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:34.033320 22773 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:33.932420 22784 consensus_queue.cc:1048] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.082s
I20260709 12:13:34.033699 22773 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:34.013747 22519 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:34.036243 22519 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:34.029912 22805 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:34.041898 22781 raft_consensus.cc:2804] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:34.041401 22805 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:34.043453 13652 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:34.044270 22784 raft_consensus.cc:2749] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:34.044273 22805 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:34.046308 13652 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:34.047113 22784 raft_consensus.cc:2749] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:34.048019 22810 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:34.048309 13652 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:34.050043 22790 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:34.050391 22784 raft_consensus.cc:2749] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:34.050807 22790 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:34.051852 13652 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:34.049556 22773 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:34.042395 22781 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:34.053593 22781 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:34.053980 22784 raft_consensus.cc:2804] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:13:34.012812 22794 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:34.004608 22760 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:34.054646 22794 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:34.057008 22794 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:34.057732 22784 raft_consensus.cc:697] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 18 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:34.021096 22814 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:34.058754 22814 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:34.058952 22784 consensus_queue.cc:237] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 17.16, Last appended by leader: 16, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:34.066888 22743 consensus_queue.cc:260] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:34.007869 22542 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:34.071296 22542 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:34.072109 22782 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:34.021646 22633 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.964s	user 0.016s	sys 0.008s
I20260709 12:13:34.075050 22542 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:34.077405 22777 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:34.000679 22421 raft_consensus.cc:697] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 31 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
W20260709 12:13:34.086973 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:34.087492 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:34.083685 22768 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:34.086468 22421 consensus_queue.cc:237] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 29.18, Last appended by leader: 18, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:34.063185 13652 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:34.085273 22790 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:34.081699 22735 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:34.092662 13834 raft_consensus.cc:1240] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:34.102059 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:34.093883 13833 raft_consensus.cc:1240] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:34.102783 13763 raft_consensus.cc:1240] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 26. Current term is 27. Ops: [26.15-26.15]
I20260709 12:13:34.097376 22773 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:34.098718 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:34.099433 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 30 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:34.099293 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:34.100469 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:34.110270 14415 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 29.
I20260709 12:13:34.101400 13760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 1520) took 2287 ms. Trace:
I20260709 12:13:34.111267 13760 rpcz_store.cc:276] 0709 12:13:31.802677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:31.804903 (+  2226us) service_pool.cc:224] Handling call
0709 12:13:31.871832 (+ 66929us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:33.073356 (+1201524us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:34.089674 (+1016318us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b540038ccd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:34.089878 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2697902848}
I20260709 12:13:34.108636 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:34.112555 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:34.113035 13832 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:34.110082 14407 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 22.
I20260709 12:13:34.110751 14413 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 24.
I20260709 12:13:34.113864 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:34.064375 22507 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:34.116015 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:34.116887 13833 raft_consensus.cc:2393] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 22: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:34.113296 14411 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 25.
I20260709 12:13:34.121061 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:34.124518 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:34.125488 13837 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 29.
I20260709 12:13:34.127210 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:34.127889 13833 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:34.129297 13760 raft_consensus.cc:1240] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:34.107030 22720 raft_consensus.cc:2804] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:34.101300 22741 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:34.120136 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:34.106563 22768 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:34.134703 13834 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 24.
I20260709 12:13:34.130483 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 32 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:34.134914 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:34.137266 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:34.136338 13831 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 30.
I20260709 12:13:34.144024 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:34.144378 13727 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:34.143961 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:34.144927 13831 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 27.
I20260709 12:13:34.147078 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:34.147315 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:34.148361 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 32 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:34.148370 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:34.149981 14415 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 24.
I20260709 12:13:34.150406 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:34.150532 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:34.151109 13837 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 22.
I20260709 12:13:34.153231 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:34.154003 13757 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:34.154914 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:34.165966 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:34.154094 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 31 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:34.131712 22810 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:34.143421 22805 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:34.149272 22741 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:34.204254 22822 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:34.204602 22741 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:34.204941 22822 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:34.207243 22741 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:34.207355 22822 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:34.204312 22805 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:34.210590 22805 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:34.212033 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:34.193593 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 32 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:34.194002 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:34.213742 14415 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 31.
I20260709 12:13:34.215000 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:34.215701 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:34.217392 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 25 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:34.219065 22757 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:34.219492 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 32 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:34.220440 13755 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 31.
W20260709 12:13:34.192698 14380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:34.195444 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:34.189007 13837 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 23.
I20260709 12:13:34.192634 22509 raft_consensus.cc:2804] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:34.149567 22745 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:34.150098 22720 raft_consensus.cc:697] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 21 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:34.152709 22507 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:34.200047 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:34.191735 13727 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:34.202270 13832 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 29.
I20260709 12:13:34.189534 22790 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:34.212363 22715 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:34.238212 13727 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:34.239146 22630 raft_consensus.cc:2804] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:34.239248 13727 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:34.239725 22630 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:34.240176 22746 raft_consensus.cc:2804] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:34.240360 13727 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:34.240684 22746 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:34.224828 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:34.225373 13687 raft_consensus.cc:1275] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:13:34.194510 13833 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 28.
I20260709 12:13:34.220898 22754 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:34.227124 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:34.230247 22803 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:13:34.251510 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:34.231300 22720 consensus_queue.cc:237] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:34.232352 22507 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:34.233223 13761 raft_consensus.cc:2393] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 28: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:34.149389 22768 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:34.233583 22509 raft_consensus.cc:697] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:34.233438 13578 catalog_manager.cc:5697] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 19 to 21, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 21 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:34.236318 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:34.276711 13834 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:34.240299 22630 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:34.228754 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:34.277985 13832 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 20.
I20260709 12:13:34.225445 13757 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 28.
I20260709 12:13:34.247484 13727 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:34.248587 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:34.230505 22790 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:34.252610 13762 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 29.
I20260709 12:13:34.241616 22715 raft_consensus.cc:2804] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:34.283041 13837 raft_consensus.cc:2468] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 19.
I20260709 12:13:34.252938 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:34.255402 13831 raft_consensus.cc:2393] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 25: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:34.193198 22814 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:34.258684 13688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 1778) took 1015 ms. Trace:
I20260709 12:13:34.259461 22803 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:34.250695 22746 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:34.263974 22739 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:34.270233 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:34.271332 22754 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:34.241992 22745 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:34.303983 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:34.304382 22745 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:34.305022 13755 raft_consensus.cc:2393] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 28: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:34.305544 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:34.306150 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 25 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:34.285746 22715 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:34.307842 22715 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:34.309108 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:13:34.309895 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:34.310788 14412 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 1443) took 2484 ms (client timeout 1748 ms). Trace:
W20260709 12:13:34.311299 14412 rpcz_store.cc:269] 0709 12:13:31.826342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:31.827634 (+  1292us) service_pool.cc:224] Handling call
0709 12:13:34.310551 (+2482917us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b540013ecd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:34.310671 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3673758464}
I20260709 12:13:34.287328 22803 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:34.319578 22729 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:34.322294 22764 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:34.322678 22533 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:34.323042 22743 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:13:34.323374 14409 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 1446) took 2365 ms (client timeout 1550 ms). Trace:
I20260709 12:13:34.323626 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:13:34.323784 14409 rpcz_store.cc:269] 0709 12:13:31.958084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:31.967437 (+  9353us) service_pool.cc:224] Handling call
0709 12:13:34.323202 (+2355765us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b54006b0dd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:34.323305 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3472679680}
I20260709 12:13:34.324455 13682 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 22.
I20260709 12:13:34.324652 22509 consensus_queue.cc:237] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:34.331542 22792 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:34.332858 22804 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:34.334401 22787 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:34.336458 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:34.337175 13686 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 27.
I20260709 12:13:34.338390 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:34.339267 13680 raft_consensus.cc:2393] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 26: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:34.340317 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:34.341137 13682 raft_consensus.cc:2368] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 28. Current term is 29.
I20260709 12:13:34.295898 22739 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:34.343032 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:34.343675 14416 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 25.
I20260709 12:13:34.344169 22739 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:34.345253 22651 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:34.345849 22651 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:34.346791 22768 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:34.347369 22768 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:34.347945 22651 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:34.347802 22768 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:34.348474 22651 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:34.348903 22651 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:34.351219 22816 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:34.352146 13758 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:34.352051 22816 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:34.353214 22822 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:34.353397 13679 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:34.354104 22649 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:34.222051 22810 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:34.354693 22809 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:13:34.355631 22776 log.cc:927] Time spent T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.762s	user 0.001s	sys 0.014s
I20260709 12:13:34.355316 22809 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:34.356629 22810 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:34.357883 13760 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 24.
I20260709 12:13:34.358958 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:34.287650 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:34.289204 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:34.293467 14415 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 22.
I20260709 12:13:34.294039 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:13:34.270850 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 171285us
I20260709 12:13:34.285256 13688 rpcz_store.cc:276] 0709 12:13:33.243318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:33.243493 (+   175us) service_pool.cc:224] Handling call
0709 12:13:33.260265 (+ 16772us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:33.324938 (+ 64673us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:33.324984 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:33.325050 (+    66us) raft_consensus.cc:1645] Marking committed up to 20
0709 12:13:33.325099 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:34.258415 (+933316us) spinlock_profiling.cc:243] Waited 64.4 ms on lock 0x7b5400246dd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:34.258466 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:34.258618 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":148026624}
I20260709 12:13:34.300904 22507 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:34.301441 22754 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:34.302022 22829 raft_consensus.cc:2804] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:34.353823 22822 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:34.404460 13801 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:34.381969 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 32 candidate_status { last_received { term: 29 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:34.385970 13682 raft_consensus.cc:1275] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 31 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 29 index: 14. Preceding OpId from leader: term: 31 index: 15. (index mismatch)
I20260709 12:13:34.400882 13832 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 24.
I20260709 12:13:34.408315 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 31 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:34.350842 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:34.344692 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:34.373714 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:34.365134 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:34.409835 13758 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 25.
I20260709 12:13:34.410806 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:34.411185 13686 raft_consensus.cc:1275] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 27 index: 18. (index mismatch)
I20260709 12:13:34.389629 13829 raft_consensus.cc:2393] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 27: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:34.382092 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:34.350701 22768 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:34.400594 13834 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 24.
I20260709 12:13:34.388458 13800 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:34.416220 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 29 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:34.401583 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 31 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:34.401860 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:34.401819 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 30 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:34.393642 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:34.406461 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:34.411895 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 26 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:34.282589 13727 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:13:34.381876 22797 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.125s	user 0.014s	sys 0.030s
W20260709 12:13:34.422266 22797 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.170s	user 0.015s	sys 0.031s
I20260709 12:13:34.422605 22777 raft_consensus.cc:2804] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:13:34.399144 22769 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:34.423197 22777 raft_consensus.cc:697] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 28 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:34.423343 22769 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:34.415735 22741 raft_consensus.cc:2804] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:34.424577 22741 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:34.424510 22777 consensus_queue.cc:237] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 26.19, Last appended by leader: 19, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:34.419101 13687 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:34.426970 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:34.428530 13756 raft_consensus.cc:1240] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:34.425172 22741 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:34.432456 22715 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:34.357662 22809 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:34.435489 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:34.436215 13682 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 24.
I20260709 12:13:34.436652 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:13:34.437115 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:34.407110 22829 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:34.438289 22829 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:34.439016 22769 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:34.354693 22649 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:34.442333 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:34.443114 13837 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 23.
I20260709 12:13:34.444109 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:34.413583 22821 consensus_queue.cc:1059] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.041s
I20260709 12:13:34.445333 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:34.418920 13761 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 31.
I20260709 12:13:34.445638 22821 raft_consensus.cc:3055] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:34.423099 14416 raft_consensus.cc:1240] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 24 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:34.450593 13687 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 29.
W20260709 12:13:34.446261 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 163754us
I20260709 12:13:34.413481 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:34.447991 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:34.455842 13688 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:34.448015 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:34.449719 13837 raft_consensus.cc:2468] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 18.
I20260709 12:13:34.449245 13800 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:34.466384 13762 raft_consensus.cc:1275] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 12:13:34.478179 14407 raft_consensus.cc:1240] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:34.479319 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 32 candidate_status { last_received { term: 29 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:34.480834 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:34.482704 13837 raft_consensus.cc:2393] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 25: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:34.469908 13652 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:34.485316 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:34.485687 13652 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:34.490208 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:34.490499 13652 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:34.492687 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:34.462874 22769 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:13:34.496259 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:34.496817 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:34.351717 22781 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:34.502980 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:34.493201 13652 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:34.497037 22773 raft_consensus.cc:2804] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:34.483448 22735 raft_consensus.cc:2804] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:34.499115 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:34.504570 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:34.504580 13652 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:34.510296 13679 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:34.505618 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:34.512318 13682 raft_consensus.cc:2393] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 24: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:34.505082 22773 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:34.513231 22773 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:34.513484 22595 raft_consensus.cc:2804] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:34.514003 22595 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:34.514489 22595 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:34.515375 22746 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:34.516294 22784 raft_consensus.cc:2804] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:34.516806 22784 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:34.517202 22784 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:34.491168 22814 raft_consensus.cc:2804] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:13:34.511023 13652 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:34.522982 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:34.534685 13681 raft_consensus.cc:1240] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:34.502558 22769 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:34.524701 14380 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:34.530287 22762 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:34.530674 22771 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:34.533742 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:34.548542 13652 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:34.530894 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 29 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:34.532864 22781 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:34.499454 22785 raft_consensus.cc:2804] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:13:34.533394 22767 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:34.533375 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:13:34.538858 14414 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41700 (request call id 1308) took 2873 ms (client timeout 2110 ms). Trace:
I20260709 12:13:34.489388 22816 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:34.542215 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:34.605633 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:34.542409 14408 raft_consensus.cc:1275] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 27 index: 18. (term mismatch)
I20260709 12:13:34.606690 14408 pending_rounds.cc:85] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f: Aborting all ops after (but not including) 17
I20260709 12:13:34.607012 14408 pending_rounds.cc:107] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f: Aborting uncommitted NO_OP operation due to leader change: 26.18
I20260709 12:13:34.607376 14408 raft_consensus.cc:2889] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:34.542479 13763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 2870) took 1058 ms. Trace:
I20260709 12:13:34.471097 22768 consensus_queue.cc:1059] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 27.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.033s
I20260709 12:13:34.585134 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:34.585400 13679 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 27.
I20260709 12:13:34.610989 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:13:34.611501 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 63052.2us
I20260709 12:13:34.548237 13754 raft_consensus.cc:1240] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:34.586330 13726 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:34.534474 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:34.551823 22814 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:34.539254 13828 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54830 (request call id 3646) took 1481 ms (client timeout 1859 ms). Trace:
I20260709 12:13:34.594578 13758 raft_consensus.cc:2393] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 29: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
W20260709 12:13:34.593964 14414 rpcz_store.cc:269] 0709 12:13:31.665190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:31.667351 (+  2161us) service_pool.cc:224] Handling call
0709 12:13:34.538617 (+2871266us) spinlock_profiling.cc:243] Waited 1.89 s on lock 0x7b540068ced4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:34.538765 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4350184704}
I20260709 12:13:34.616150 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:13:34.596483 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 71831.1us
I20260709 12:13:34.618059 13726 leader_election.cc:400] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 28. Current term is 29.
I20260709 12:13:34.617937 14380 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:34.618611 13726 leader_election.cc:403] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:34.513419 22737 leader_election.cc:290] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:34.572384 14379 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:13:34.468916 22821 raft_consensus.cc:740] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:34.506637 22735 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:34.627162 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:13:34.627552 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 55279.3us
I20260709 12:13:34.629323 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:34.628372 13835 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 19.
I20260709 12:13:34.602550 22808 raft_consensus.cc:2749] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:34.611829 13680 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 24.
I20260709 12:13:34.591169 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:34.635540 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:34.613595 13651 leader_election.cc:304] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:34.637727 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:34.622193 22814 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:34.614151 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:34.621891 22542 raft_consensus.cc:2804] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:13:34.664855 13686 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 19.
I20260709 12:13:34.602507 13688 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 28.
I20260709 12:13:34.545768 22493 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:34.599810 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:34.621601 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:34.583964 22804 raft_consensus.cc:2804] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:34.622104 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:13:34.615778 13828 rpcz_store.cc:269] 0709 12:13:33.058098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:33.058225 (+   127us) service_pool.cc:224] Handling call
0709 12:13:34.539084 (+1480859us) spinlock_profiling.cc:243] Waited 376 ms on lock 0x7b54000d9b54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:34.539198 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":863898368}
I20260709 12:13:34.544232 22770 raft_consensus.cc:3055] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:34.592166 22769 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:13:34.593830 22785 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 31 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:34.706472 22785 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:13:34.706254 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:34.708138 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:34.623296 22741 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:34.702558 22770 raft_consensus.cc:740] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:34.679605 22804 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:34.701507 22542 raft_consensus.cc:697] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 29 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:34.697248 22509 consensus_queue.cc:1048] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.039s
I20260709 12:13:34.710073 22765 raft_consensus.cc:2804] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:34.747486 22765 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:34.748013 22765 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:34.709720 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: true dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:34.750998 13679 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:34.625094 14380 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:34.719847 22785 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 32 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:34.752785 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 133040us
I20260709 12:13:34.754426 22790 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:34.754877 22785 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 32 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:34.601495 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:34.755620 22790 raft_consensus.cc:2749] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:34.757064 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:34.598191 22746 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:34.758315 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 26 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:34.726415 22754 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:34.724267 22630 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:34.759449 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:34.726982 22741 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:34.760682 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:34.728065 22770 consensus_queue.cc:260] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 26.13, Last appended by leader: 13, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:34.761091 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:34.720209 22773 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:34.762147 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:34.725607 13830 raft_consensus.cc:2393] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 26: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:34.734154 22804 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:34.638522 22212 raft_consensus.cc:2749] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:34.758899 13832 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 26.
I20260709 12:13:34.764753 21893 raft_consensus.cc:3055] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:34.765208 22773 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:34.610064 22767 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:34.734858 22803 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:34.719966 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:34.771659 13834 raft_consensus.cc:1275] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:13:34.661501 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:34.621127 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:34.643648 14379 leader_election.cc:304] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:13:34.773041 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 129476us
I20260709 12:13:34.773484 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:34.773833 14379 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:34.774386 13760 raft_consensus.cc:2393] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 25: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:34.775013 22822 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:34.775233 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:34.775453 14379 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:34.624693 22744 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Advancing to term 29
I20260709 12:13:34.721743 22715 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:34.776141 22710 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:34.732580 22649 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:34.629695 22096 raft_consensus.cc:2804] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:34.776815 22710 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:34.777601 22096 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:34.778142 22096 raft_consensus.cc:3060] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:34.778268 13759 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 25.
I20260709 12:13:34.778390 22808 raft_consensus.cc:2804] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:34.677317 13800 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:34.630108 22507 raft_consensus.cc:2749] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:13:34.793380 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 116171us
I20260709 12:13:34.682830 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:34.676097 13726 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:34.631135 22735 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:34.674959 13836 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 25.
I20260709 12:13:34.633800 22816 raft_consensus.cc:3055] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 28 LEADER]: Stepping down as leader of term 28
I20260709 12:13:34.699162 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 26 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:34.715929 22651 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:34.624238 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:34.761464 22630 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:34.608503 13763 rpcz_store.cc:276] 0709 12:13:33.484457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:33.484676 (+   219us) service_pool.cc:224] Handling call
0709 12:13:33.485131 (+   455us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:34.106391 (+621260us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:34.541545 (+435154us) spinlock_profiling.cc:243] Waited 617 ms on lock 0x7b54000efe54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:34.541757 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1419598208}
I20260709 12:13:34.652341 13835 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 24.
I20260709 12:13:34.779999 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:34.765247 21893 raft_consensus.cc:740] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:34.718200 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:34.788733 13834 raft_consensus.cc:1240] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:34.814522 13835 raft_consensus.cc:1240] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:34.788564 14379 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:34.789937 13831 raft_consensus.cc:1275] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:13:34.612334 13652 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:34.736205 22542 consensus_queue.cc:237] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 27.16, Last appended by leader: 16, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:34.806617 22639 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:34.825518 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 236790us
W20260709 12:13:34.826669 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:34.779965 22736 raft_consensus.cc:2749] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:34.816365 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:34.816656 21893 consensus_queue.cc:260] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:34.780212 22808 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:34.832795 22808 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:34.779961 22635 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:34.820787 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:34.833988 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:34.834713 13685 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 19.
I20260709 12:13:34.834750 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:34.835548 13759 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 19.
I20260709 12:13:34.836563 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:34.837191 13759 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 22.
I20260709 12:13:34.821004 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:34.801442 13800 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:13:34.826475 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 214257us
I20260709 12:13:34.839640 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:34.840335 13683 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 22.
I20260709 12:13:34.812130 22816 raft_consensus.cc:740] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 28 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:34.812670 22746 raft_consensus.cc:2749] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:34.838701 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:34.812798 22803 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 30 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:34.844175 13800 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:34.804443 22628 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:34.846800 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:34.847182 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 31 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:34.831441 14379 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:34.849035 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 32 candidate_status { last_received { term: 29 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:34.864660 13687 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 31.
I20260709 12:13:34.856528 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:34.791450 22595 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:34.858686 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:34.741958 22784 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:34.827164 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:34.830338 22773 raft_consensus.cc:2804] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:34.871459 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 32 candidate_status { last_received { term: 29 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:34.849515 13652 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:34.873623 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:34.874459 13679 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 25.
I20260709 12:13:34.876080 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:34.868386 14379 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:34.850715 22635 raft_consensus.cc:2804] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:34.837427 22769 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 32 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:34.865743 13759 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 25.
W20260709 12:13:34.850389 22831 log.cc:927] Time spent T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.350s	user 0.000s	sys 0.001s
I20260709 12:13:34.868357 13800 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:34.779992 22821 consensus_queue.cc:260] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.18, Last appended by leader: 18, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:34.810881 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 134901us
I20260709 12:13:34.882586 13652 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:13:34.868412 13680 raft_consensus.cc:2368] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 32 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 31. Current term is 32.
I20260709 12:13:34.891268 13682 raft_consensus.cc:2368] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 23. Current term is 24.
I20260709 12:13:34.890380 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:34.891393 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:34.885965 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:34.837996 22739 consensus_queue.cc:1048] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.035s
I20260709 12:13:34.892875 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:34.892922 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:34.928432 13759 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 25.
I20260709 12:13:34.894366 13800 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:34.931066 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 32 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:34.879417 22649 raft_consensus.cc:2749] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:34.932017 13763 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:13:34.870976 22773 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:34.933558 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 51082.3us
I20260709 12:13:34.933748 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:34.984650 13683 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Advancing to term 26
I20260709 12:13:34.984721 13652 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:34.934355 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:34.851389 22829 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:34.981798 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 26 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:34.936873 13726 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:34.885418 22635 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:34.888919 22639 raft_consensus.cc:2804] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:34.878453 22736 raft_consensus.cc:2804] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 12:13:35.020941 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 84196.2us
I20260709 12:13:35.021891 13680 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 24.
I20260709 12:13:35.023108 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:35.024044 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 30 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:35.023176 13759 raft_consensus.cc:1275] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 25 index: 13. (term mismatch)
I20260709 12:13:35.031004 13759 pending_rounds.cc:85] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting all ops after (but not including) 12
I20260709 12:13:35.031297 13759 pending_rounds.cc:107] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting uncommitted NO_OP operation due to leader change: 24.13
I20260709 12:13:35.031594 13759 raft_consensus.cc:2889] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:35.027460 13726 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:34.890028 22737 raft_consensus.cc:2804] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:34.986522 22822 raft_consensus.cc:2804] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:35.050220 13726 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:34.888037 22790 raft_consensus.cc:2804] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:35.073428 13680 raft_consensus.cc:1240] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:35.078293 13757 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 24.
I20260709 12:13:35.079072 13726 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:34.930325 22739 consensus_queue.cc:1243] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer b98d2519bb504dc6905ed2ede4571835 log is divergent from this leader: its last log entry 19.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 12:13:35.079185 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:34.988330 22773 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:35.076124 13727 leader_election.cc:304] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:34.981699 22781 raft_consensus.cc:2804] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:35.076635 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:34.932112 22628 raft_consensus.cc:2749] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:35.026523 22507 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:35.084697 22765 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:35.038206 22736 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:34.935346 22767 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:35.109923 13683 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 26.
I20260709 12:13:35.136368 13679 raft_consensus.cc:1240] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:35.053251 13759 raft_consensus.cc:1240] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 29. Current term is 30. Ops: []
I20260709 12:13:35.077628 22790 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:35.037990 22639 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:35.076661 22509 consensus_queue.cc:1059] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.063s
I20260709 12:13:35.139587 22651 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:35.077461 22573 raft_consensus.cc:2804] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:13:35.074839 22822 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:35.178136 22822 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:35.178795 22784 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:35.179776 22685 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:35.086325 22810 raft_consensus.cc:2749] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:35.158648 13683 raft_consensus.cc:1240] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 28. Current term is 29. Ops: [28.18-28.18]
I20260709 12:13:35.184367 22749 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 28 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:35.185909 22573 raft_consensus.cc:697] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:35.187057 22573 consensus_queue.cc:237] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 27.17, Last appended by leader: 17, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:35.194204 13680 raft_consensus.cc:1240] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 22. Current term is 24. Ops: []
I20260709 12:13:35.201658 22595 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:35.206813 22744 raft_consensus.cc:2749] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Leader pre-election lost for term 28. Reason: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 28. Current term is 29.
I20260709 12:13:35.208649 22737 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:35.209383 22737 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:35.209733 14414 raft_consensus.cc:1240] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:35.210281 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:35.157240 22651 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:35.211874 14407 raft_consensus.cc:1275] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 12:13:35.162647 22639 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:35.072485 22821 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:35.039769 22635 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:34.986137 22803 consensus_queue.cc:1048] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.148s
W20260709 12:13:35.167742 22836 log.cc:927] Time spent T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.289s	user 0.000s	sys 0.000s
I20260709 12:13:35.134220 22212 raft_consensus.cc:2804] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:35.159690 22790 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:35.169131 22509 raft_consensus.cc:3055] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 LEADER]: Stepping down as leader of term 21
W20260709 12:13:35.170229 22835 log.cc:927] Time spent T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.323s	user 0.000s	sys 0.001s
I20260709 12:13:35.170740 22829 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:35.172609 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 30 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:35.322726 14416 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:35.176563 22765 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 24 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:35.153549 22736 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:35.086997 22634 raft_consensus.cc:2749] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:13:34.932536 22814 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:35.152431 13759 raft_consensus.cc:1240] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 32 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 31. Current term is 32. Ops: []
I20260709 12:13:35.220737 13800 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:13:35.338584 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 117971us
I20260709 12:13:35.339360 13800 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:35.260700 13679 raft_consensus.cc:1240] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 26. Current term is 27. Ops: [26.15-26.15]
I20260709 12:13:35.262187 13763 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 32.
I20260709 12:13:35.092192 22781 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:13:35.256433 22518 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.079s	sys 0.116s
I20260709 12:13:35.342308 22781 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:13:35.342480 22518 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.079s	sys 0.116s
I20260709 12:13:35.278396 13756 raft_consensus.cc:1240] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:35.346091 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:35.346930 13756 raft_consensus.cc:1240] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:35.348923 13756 raft_consensus.cc:1275] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:13:35.285681 13758 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 29.
I20260709 12:13:35.299983 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:35.350497 13683 raft_consensus.cc:2393] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 24: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:34.931624 22816 consensus_queue.cc:260] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 28.18, Last appended by leader: 18, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:35.352603 22816 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:35.319270 22212 raft_consensus.cc:697] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 24 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:35.354694 22212 consensus_queue.cc:237] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:35.357935 22741 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:13:35.358501 22741 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 31 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:35.359058 22741 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:13:35.275844 22509 raft_consensus.cc:740] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:13:35.365410 22808 consensus_meta.cc:287] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.532s	user 0.001s	sys 0.013s
I20260709 12:13:35.366006 22808 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:35.321947 22787 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:35.371819 22787 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:35.332844 22710 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:35.375514 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:35.376703 13800 leader_election.cc:400] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 31 pre-election: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 32 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 31. Current term is 32.
I20260709 12:13:35.377417 13800 leader_election.cc:403] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 31 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:35.391794 13800 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:35.380509 22628 raft_consensus.cc:2804] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:35.403326 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:35.404922 14415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 1451) took 1272 ms. Trace:
W20260709 12:13:35.408219 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 423566us
I20260709 12:13:35.362993 22509 consensus_queue.cc:260] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:35.408591 14415 rpcz_store.cc:276] 0709 12:13:34.132837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:34.214649 (+ 81812us) service_pool.cc:224] Handling call
0709 12:13:35.404658 (+1190009us) spinlock_profiling.cc:243] Waited 77.7 ms on lock 0x7b54005e01d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:35.404831 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":178684288}
I20260709 12:13:35.389081 22693 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:35.407124 13800 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:35.398331 22421 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Advancing to term 32
I20260709 12:13:35.416934 13652 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:35.418015 13800 leader_election.cc:400] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 23. Current term is 24.
I20260709 12:13:35.421028 13800 leader_election.cc:403] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:35.399838 22649 raft_consensus.cc:2804] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:35.423868 13652 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:35.428424 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:35.429211 13683 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:35.435850 13652 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:35.413998 22729 raft_consensus.cc:2749] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:35.416551 22628 raft_consensus.cc:697] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 25 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:35.457676 14416 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 30.
I20260709 12:13:35.458617 13754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 2886) took 1078 ms. Trace:
I20260709 12:13:35.447645 13684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 3990) took 1094 ms. Trace:
I20260709 12:13:35.459692 13683 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 25.
I20260709 12:13:35.422761 22518 raft_consensus.cc:2804] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:35.407353 22822 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:35.460461 13754 rpcz_store.cc:276] 0709 12:13:34.380450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:34.380631 (+   181us) service_pool.cc:224] Handling call
0709 12:13:34.381036 (+   405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:34.612364 (+231328us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:35.458381 (+846017us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b540032e954. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:35.458558 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":384050944}
I20260709 12:13:35.461350 13684 rpcz_store.cc:276] 0709 12:13:34.353135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:34.361149 (+  8014us) service_pool.cc:224] Handling call
0709 12:13:34.361422 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:34.361670 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:13:34.792433 (+430763us) log.cc:844] Serialized 14 byte log entry
0709 12:13:35.441032 (+648599us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:35.441111 (+    79us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:13:35.447251 (+  6140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:35.447368 (+   117us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:35.447567 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":68422,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":113755,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":8012,"thread_start_us":1077797,"threads_started":3,"wal-append.queue_time_us":533203}
I20260709 12:13:35.463825 14408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41700 (request call id 1322) took 1325 ms. Trace:
I20260709 12:13:35.437213 22784 raft_consensus.cc:2749] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:35.435150 22649 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:35.465535 14408 rpcz_store.cc:276] 0709 12:13:34.132813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:34.237701 (+104888us) service_pool.cc:224] Handling call
0709 12:13:34.238065 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:34.608030 (+369965us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:35.457875 (+849845us) spinlock_profiling.cc:243] Waited 304 ms on lock 0x7b540059e554. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:35.458104 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":698923904}
I20260709 12:13:35.472565 13652 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:35.473546 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:35.469578 22509 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:13:35.483436 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 396117us
I20260709 12:13:35.458321 22816 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Advancing to term 24
W20260709 12:13:35.496923 13762 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.006s	sys 0.037s
I20260709 12:13:35.502197 13726 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:13:35.538005 13762 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.007s	sys 0.037s
I20260709 12:13:35.493281 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:35.460525 22785 raft_consensus.cc:2804] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader pre-election won for term 27
W20260709 12:13:35.503147 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 427098us
I20260709 12:13:35.539116 14408 raft_consensus.cc:2376] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 21. Re-sending same reply.
W20260709 12:13:35.506876 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:35.511266 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:35.489946 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 26 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:35.443634 22808 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:35.544510 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:35.539548 21893 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:35.545226 13762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 3823) took 1014 ms. Trace:
I20260709 12:13:35.538631 13726 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:35.422310 22693 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:35.441224 22720 consensus_queue.cc:1048] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 12:13:35.471123 22649 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:35.549481 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:35.550983 13727 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:35.552505 14407 raft_consensus.cc:1275] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:13:35.546339 14379 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:35.545631 13762 rpcz_store.cc:276] 0709 12:13:34.530671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:34.550633 (+ 19962us) service_pool.cc:224] Handling call
0709 12:13:34.561055 (+ 10422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:34.561272 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 12:13:34.843520 (+282248us) log.cc:844] Serialized 14 byte log entry
0709 12:13:35.544888 (+701368us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:35.544946 (+    58us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:13:35.544992 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:35.545071 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:35.545175 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":519326,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":7485,"thread_start_us":934509,"threads_started":2}
W20260709 12:13:35.559094 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:35.545014 22804 consensus_meta.cc:287] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.782s	user 0.013s	sys 0.000s
I20260709 12:13:35.542507 22784 raft_consensus.cc:2804] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:35.566107 13761 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 27.
I20260709 12:13:35.571717 22744 raft_consensus.cc:2804] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:35.572415 22744 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:35.572911 22744 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:35.574043 22796 consensus_queue.cc:1059] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 23.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:13:35.575611 22796 raft_consensus.cc:3055] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:35.576071 22796 raft_consensus.cc:740] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:13:35.584529 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 112075us
I20260709 12:13:35.550086 22767 raft_consensus.cc:2749] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:13:35.556553 22803 raft_consensus.cc:2804] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader election won for term 27
W20260709 12:13:35.590833 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 94325.3us
I20260709 12:13:35.541054 22773 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:35.563753 22507 raft_consensus.cc:2804] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:13:35.564085 22740 raft_consensus.cc:2804] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:35.599413 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:35.600131 13762 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:35.568950 22800 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:35.581808 22784 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:35.604285 13727 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:35.610849 13763 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:35.611195 22518 raft_consensus.cc:697] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 26 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:35.612555 22518 consensus_queue.cc:237] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:35.615720 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:35.600698 22762 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.038s	sys 0.038s
I20260709 12:13:35.639314 13681 raft_consensus.cc:1240] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 20. Current term is 21. Ops: [18.15-20.16]
I20260709 12:13:35.622876 22822 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:35.596940 22853 raft_consensus.cc:2804] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:35.600438 22814 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 30 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:35.602159 22803 raft_consensus.cc:697] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:13:35.623795 22846 log.cc:927] Time spent T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
W20260709 12:13:35.624152 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:35.619025 22735 consensus_meta.cc:287] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.789s	user 0.013s	sys 0.000s
W20260709 12:13:35.626942 22843 log.cc:927] Time spent T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 12:13:35.628916 22834 log.cc:927] Time spent T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.544s	user 0.000s	sys 0.003s
I20260709 12:13:35.608896 22628 consensus_queue.cc:237] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:35.582299 22804 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:35.609956 22212 consensus_queue.cc:1048] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.054s
I20260709 12:13:35.632170 22651 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:35.633594 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 28 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:35.577117 22796 consensus_queue.cc:260] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:35.615507 22784 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:35.637398 13761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48114 (request call id 3829) took 1099 ms. Trace:
I20260709 12:13:35.697839 13761 rpcz_store.cc:276] 0709 12:13:34.537494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:34.661190 (+123696us) service_pool.cc:224] Handling call
0709 12:13:35.637160 (+975970us) spinlock_profiling.cc:243] Waited 793 ms on lock 0x7b54003930d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:35.637315 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1824973696}
I20260709 12:13:35.648427 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 28 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:13:35.654127 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 209695us
W20260709 12:13:35.638286 22847 log.cc:927] Time spent T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.222s	user 0.000s	sys 0.001s
I20260709 12:13:35.625672 22693 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:35.657673 21893 raft_consensus.cc:2804] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:35.736469 21893 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:35.736805 22773 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:13:35.639117 22762 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.038s	sys 0.038s
I20260709 12:13:35.659075 13763 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 24.
I20260709 12:13:35.615130 22740 raft_consensus.cc:697] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 25 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
W20260709 12:13:35.654165 22856 log.cc:927] Time spent T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:13:35.607265 22800 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:35.652473 22853 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:35.678500 22635 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:35.749488 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 145313us
I20260709 12:13:35.651347 22507 raft_consensus.cc:697] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:35.699587 13687 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 27.
I20260709 12:13:35.701392 22796 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:13:35.702898 22861 log.cc:927] Time spent T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:13:35.704089 22741 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 32 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:35.692212 22737 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:35.710546 22784 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:35.713442 22804 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:35.714226 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:35.714365 22421 raft_consensus.cc:2749] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 32 FOLLOWER]: Leader pre-election lost for term 31. Reason: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 32 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 31. Current term is 32.
I20260709 12:13:35.673714 22803 consensus_queue.cc:237] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:35.724973 22736 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:35.736891 21893 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:13:35.661193 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 69286.1us
I20260709 12:13:35.738636 13830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35422 (request call id 1798) took 1336 ms. Trace:
I20260709 12:13:35.741060 13762 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 30.
I20260709 12:13:35.747399 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:35.754726 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:35.774096 13761 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 25.
I20260709 12:13:35.769691 13830 rpcz_store.cc:276] 0709 12:13:34.402490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:34.447693 (+ 45203us) service_pool.cc:224] Handling call
0709 12:13:35.738423 (+1290730us) spinlock_profiling.cc:243] Waited 263 ms on lock 0x7b540002dd54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:35.738569 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":604875008}
I20260709 12:13:35.667342 22735 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:35.749286 22853 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:35.709587 22781 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:35.762887 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:35.765112 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:35.765941 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:35.767097 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:35.767251 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:35.766659 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 32 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:35.776703 13682 raft_consensus.cc:1240] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:35.759696 14379 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:35.780612 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:35.781209 13828 raft_consensus.cc:1275] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 12:13:35.782029 13836 raft_consensus.cc:1275] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:13:35.782384 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:35.760752 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:35.811303 14409 raft_consensus.cc:1240] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:35.782263 21893 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:35.773221 13727 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:35.784047 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:35.787391 13832 raft_consensus.cc:1240] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:35.757383 22651 consensus_queue.cc:1059] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 25.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.027s
I20260709 12:13:35.834167 13837 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:35.798205 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 32 candidate_status { last_received { term: 31 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:35.788352 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:35.793412 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:35.837932 13833 raft_consensus.cc:2393] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 28: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:35.813187 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:35.843514 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 32 candidate_status { last_received { term: 31 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:13:35.852300 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 92685us
I20260709 12:13:35.868710 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:35.874457 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:35.888490 13836 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:35.868139 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:35.884104 13800 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:35.868170 14412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 1452) took 1722 ms. Trace:
I20260709 12:13:35.858445 13681 raft_consensus.cc:2368] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 24. Current term is 25.
I20260709 12:13:35.869020 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:35.844131 13830 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:35.848982 21893 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:35.894136 13651 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:35.890945 14412 rpcz_store.cc:276] 0709 12:13:34.146029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:34.312500 (+166471us) service_pool.cc:224] Handling call
0709 12:13:34.312954 (+   454us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:34.313395 (+   441us) raft_consensus.cc:1534] Early marking committed up to index 18
0709 12:13:34.792013 (+478618us) log.cc:844] Serialized 14 byte log entry
0709 12:13:35.029093 (+237080us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:35.077293 (+ 48200us) log.cc:844] Serialized 26 byte log entry
0709 12:13:35.085617 (+  8324us) raft_consensus.cc:1645] Marking committed up to 19
0709 12:13:35.085944 (+   327us) log.cc:844] Serialized 14 byte log entry
0709 12:13:35.187623 (+101679us) spinlock_profiling.cc:243] Waited 4.71 ms on lock 0x7b18004e0a00. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e82e07 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9d455 00007fa927f85060 00007fa927f97716 00007fa927fa8287 00007fa927fa8208
0709 12:13:35.410324 (+222701us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:35.410408 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:35.867921 (+457513us) raft_consensus.cc:1685] finished
0709 12:13:35.867947 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:35.868106 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4155,"prepare.queue_time_us":622394,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":100,"raft.queue_time_us":144189,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":8085,"spinlock_wait_cycles":106137600,"thread_start_us":899771,"threads_started":3,"wal-append.queue_time_us":521340}
W20260709 12:13:35.844125 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 70971.5us
I20260709 12:13:35.897308 13651 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:35.897469 13727 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:35.873661 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:35.897593 13800 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:35.899186 13686 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 24.
I20260709 12:13:35.901711 13651 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:35.902596 13683 raft_consensus.cc:1240] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:35.903082 13835 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 32.
I20260709 12:13:35.904946 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:35.905095 13800 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:35.906687 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:35.907120 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: true dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:35.908324 13651 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:35.905683 13835 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:35.910806 13761 raft_consensus.cc:2376] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 25. Re-sending same reply.
W20260709 12:13:35.872519 22844 log.cc:927] Time spent T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.456s	user 0.001s	sys 0.000s
I20260709 12:13:35.915174 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:35.789179 22784 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:35.796063 22741 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 32 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:35.794566 22737 leader_election.cc:290] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:35.868549 22808 raft_consensus.cc:2804] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:35.785696 22735 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:35.923089 13727 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:35.868466 22822 raft_consensus.cc:3055] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:35.797766 22635 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:35.860317 22505 raft_consensus.cc:2749] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:35.926465 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:35.925500 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:35.928479 13835 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 28.
I20260709 12:13:35.900265 22850 raft_consensus.cc:2749] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:13:35.781848 22519 consensus_queue.cc:1059] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.146s
I20260709 12:13:35.938921 13651 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:35.852794 22720 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:35.810745 22736 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 23 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:35.871747 22769 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 32 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:35.941917 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:13:35.951205 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 1.19351e+06us
I20260709 12:13:35.938633 22851 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:35.900141 22773 consensus_queue.cc:1048] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.066s
I20260709 12:13:35.795855 22790 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:35.792917 22744 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:35.870349 22804 consensus_queue.cc:1048] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.076s
I20260709 12:13:35.936921 13837 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 25.
I20260709 12:13:35.989698 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:13:35.958858 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:35.990677 13685 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:35.953315 13727 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:35.993597 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:35.993258 22822 raft_consensus.cc:740] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
W20260709 12:13:35.993680 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 54856.1us
I20260709 12:13:35.901515 22777 raft_consensus.cc:2749] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:35.927006 22630 raft_consensus.cc:2749] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:35.882059 22710 consensus_queue.cc:1059] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 24.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.071s
I20260709 12:13:35.906164 22866 raft_consensus.cc:2749] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:35.922158 22814 raft_consensus.cc:2749] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 12:13:36.034297 13757 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38932 (request call id 1537) took 1646 ms (client timeout 2014 ms). Trace:
W20260709 12:13:36.034765 13757 rpcz_store.cc:269] 0709 12:13:34.387868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:34.413034 (+ 25166us) service_pool.cc:224] Handling call
0709 12:13:36.034124 (+1621090us) spinlock_profiling.cc:243] Waited 623 ms on lock 0x7b54002ef754. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:36.034236 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1431864064}
I20260709 12:13:35.923852 22764 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:35.958093 13830 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 30.
I20260709 12:13:36.001415 13801 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:35.935002 13800 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:13:35.953569 22639 consensus_meta.cc:287] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.729s	user 0.016s	sys 0.001s
I20260709 12:13:35.937889 22651 raft_consensus.cc:2749] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:35.790045 22740 consensus_queue.cc:237] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:36.049752 22790 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:35.942597 22808 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:35.941084 22765 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
W20260709 12:13:36.058712 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 105483us
I20260709 12:13:36.059656 13727 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:35.953270 22849 raft_consensus.cc:2749] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:13:35.971165 22821 consensus_meta.cc:287] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.714s	user 0.010s	sys 0.003s
I20260709 12:13:35.968564 22634 raft_consensus.cc:2749] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:36.013198 13651 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:36.015220 13828 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:36.015820 13754 raft_consensus.cc:2393] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 20: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:36.016680 22744 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:36.019762 22781 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:36.020277 13833 raft_consensus.cc:1275] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 18 index: 17. (index mismatch)
W20260709 12:13:36.054042 22096 consensus_meta.cc:287] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 1.275s	user 0.001s	sys 0.021s
I20260709 12:13:36.024591 14414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41700 (request call id 1327) took 1145 ms. Trace:
I20260709 12:13:36.069044 14414 rpcz_store.cc:276] 0709 12:13:34.879189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:34.879395 (+   206us) service_pool.cc:224] Handling call
0709 12:13:34.889834 (+ 10439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:35.210207 (+320373us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:36.024338 (+814131us) spinlock_profiling.cc:243] Waited 320 ms on lock 0x7b54005f1ed4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:36.024527 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":735275776}
I20260709 12:13:35.999270 22212 raft_consensus.cc:2749] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:35.922719 22507 consensus_queue.cc:237] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.15, Last appended by leader: 15, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:36.045487 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 44206.5us
I20260709 12:13:35.941388 22421 consensus_queue.cc:1059] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.069s
I20260709 12:13:36.053260 13836 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 21.
W20260709 12:13:36.077694 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 64549.9us
I20260709 12:13:35.998868 22720 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:35.925480 22865 raft_consensus.cc:2749] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 12:13:36.061302 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 126605us
I20260709 12:13:36.023731 13685 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 20.
I20260709 12:13:36.081560 13800 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:36.010200 22851 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:36.079099 13651 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:36.084854 13651 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 32 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:36.077538 13801 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:13:36.079963 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:36.055650 22866 raft_consensus.cc:2749] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:36.063809 22808 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:36.066223 22651 raft_consensus.cc:2749] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 12:13:36.082116 22816 consensus_meta.cc:287] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.536s	user 0.011s	sys 0.000s
I20260709 12:13:36.071853 22800 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:36.107003 13727 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:36.066361 22715 raft_consensus.cc:2749] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:13:36.068238 22741 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:36.054008 22639 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:36.088255 22773 consensus_queue.cc:1048] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 12:13:36.080309 22849 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:13:36.081401 22519 raft_consensus.cc:3055] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:36.090435 22212 raft_consensus.cc:2749] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:13:36.082425 22096 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:36.115746 22816 raft_consensus.cc:2749] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 23. Current term is 24.
I20260709 12:13:36.123658 22519 raft_consensus.cc:740] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:36.111753 13801 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:36.056296 22764 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:36.105976 22822 consensus_queue.cc:260] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.15, Last appended by leader: 15, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:36.119812 22800 raft_consensus.cc:2749] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:13:36.117436 13800 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:36.118453 13727 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:36.108116 22781 raft_consensus.cc:2804] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 32 FOLLOWER]: Leader election won for term 32
I20260709 12:13:36.108057 22767 raft_consensus.cc:2749] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:13:36.064527 22765 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:36.137245 13679 raft_consensus.cc:1240] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:36.114056 22762 consensus_queue.cc:1059] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 24.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.047s
I20260709 12:13:36.164345 14416 raft_consensus.cc:2368] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 18. Current term is 19.
I20260709 12:13:36.177851 13828 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 25.
I20260709 12:13:36.121048 22518 raft_consensus.cc:2749] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:36.165427 13835 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 24.
I20260709 12:13:36.166004 22777 raft_consensus.cc:2749] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 12:13:36.166363 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 54682.1us
I20260709 12:13:36.181356 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:13:36.166738 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 49369.8us
I20260709 12:13:36.184258 13800 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:36.120401 22866 raft_consensus.cc:2749] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:36.167088 22735 raft_consensus.cc:2749] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:36.168603 22507 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Leader election won for term 30
W20260709 12:13:36.163475 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 45103.2us
W20260709 12:13:36.189389 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 82477.6us
W20260709 12:13:36.146636 22869 log.cc:927] Time spent T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:13:36.114728 22821 consensus_queue.cc:1059] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.046s
I20260709 12:13:36.120008 22741 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:36.187377 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:36.201143 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:36.202286 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:36.186065 13800 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:36.123189 22634 consensus_queue.cc:1048] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.066s
I20260709 12:13:36.189949 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 26 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:36.191659 13651 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:36.157135 22787 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:36.192049 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:36.228087 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:36.228574 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:36.230764 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:36.232035 14412 raft_consensus.cc:2393] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 26: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:13:36.205914 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:36.198225 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:13:36.234504 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 48491.1us
I20260709 12:13:36.118216 22865 consensus_queue.cc:1048] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
I20260709 12:13:36.174950 22781 raft_consensus.cc:697] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 32 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:36.225809 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:36.208516 14411 raft_consensus.cc:1275] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 31 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 29 index: 18. Preceding OpId from leader: term: 31 index: 19. (index mismatch)
I20260709 12:13:36.242292 13830 raft_consensus.cc:2410] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for term 26 because replica has last-logged OpId of term: 24 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 16.
I20260709 12:13:36.243405 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:36.244068 13833 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:36.206595 22821 consensus_queue.cc:1243] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer ca9fbbc2c0a94897897d502d42f3951f log is divergent from this leader: its last log entry 24.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 16
I20260709 12:13:36.264402 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:36.229485 13837 raft_consensus.cc:2393] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 20: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:36.191357 22822 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:36.266283 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 32 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:36.267140 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:36.189116 22651 raft_consensus.cc:2804] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:36.236227 13651 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:36.227077 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:36.225757 22777 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:36.244994 22765 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:36.193213 22800 consensus_queue.cc:1048] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.071s
I20260709 12:13:36.273275 13680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 4009) took 1754 ms. Trace:
I20260709 12:13:36.274015 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:36.273753 13680 rpcz_store.cc:276] 0709 12:13:34.518385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:35.081057 (+562672us) service_pool.cc:224] Handling call
0709 12:13:35.193924 (+112867us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:35.194895 (+   971us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:36.273070 (+1078175us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b54003124d0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:36.273214 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":249566080}
W20260709 12:13:36.247829 22873 log.cc:927] Time spent T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
W20260709 12:13:36.248595 22874 log.cc:927] Time spent T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 12:13:36.250543 22851 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:36.240069 22735 raft_consensus.cc:2749] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:36.258932 22096 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:36.259033 22764 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:36.209362 22507 raft_consensus.cc:697] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:36.260278 13578 catalog_manager.cc:5697] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:13:36.209092 22710 consensus_queue.cc:1059] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.052s
I20260709 12:13:36.261955 22639 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:36.269690 22651 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
W20260709 12:13:36.263562 22649 consensus_meta.cc:287] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.696s	user 0.010s	sys 0.000s
I20260709 12:13:36.267968 13837 raft_consensus.cc:2393] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 28: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:36.236856 22533 raft_consensus.cc:2804] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Leader election won for term 30
I20260709 12:13:36.246193 14411 raft_consensus.cc:1240] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 30 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 29. Current term is 30. Ops: []
I20260709 12:13:36.135582 22519 consensus_queue.cc:260] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:36.230237 22785 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:36.247413 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 32 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:36.291246 14414 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:13:36.274787 13833 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 26.
I20260709 12:13:36.235350 13800 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:36.275003 14415 raft_consensus.cc:1240] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:36.276296 13651 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:13:36.262511 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:36.286738 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:36.278940 22762 raft_consensus.cc:2804] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:36.288473 22651 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:13:36.286789 22796 consensus_meta.cc:287] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.526s	user 0.011s	sys 0.000s
I20260709 12:13:36.311524 13759 raft_consensus.cc:1275] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 27 index: 16. Preceding OpId from leader: term: 29 index: 17. (index mismatch)
W20260709 12:13:36.311184 13758 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48114 (request call id 3828) took 1775 ms (client timeout 1574 ms). Trace:
W20260709 12:13:36.297303 22882 log.cc:927] Time spent T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:13:36.297672 22762 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:36.298391 22507 consensus_queue.cc:237] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 29.19, Last appended by leader: 19, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:36.312239 13829 raft_consensus.cc:1240] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 32 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 31. Current term is 32. Ops: []
I20260709 12:13:36.308938 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:36.277576 22777 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:36.306936 13726 leader_election.cc:400] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 election: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 24. Current term is 25.
I20260709 12:13:36.310727 13763 raft_consensus.cc:1240] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 25. Current term is 26. Ops: [25.13-25.13]
I20260709 12:13:36.292567 14380 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:36.278940 22853 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:36.364583 14409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41692 (request call id 1335) took 2038 ms. Trace:
W20260709 12:13:36.313104 13758 rpcz_store.cc:269] 0709 12:13:34.536245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:34.628959 (+ 92714us) service_pool.cc:224] Handling call
0709 12:13:36.310965 (+1682006us) spinlock_profiling.cc:243] Waited 578 ms on lock 0x7b540038d1d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:36.311103 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1328355584}
W20260709 12:13:36.313962 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:36.373989 13836 raft_consensus.cc:3055] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:36.428484 13836 raft_consensus.cc:740] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:36.426833 14409 rpcz_store.cc:276] 0709 12:13:34.325939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:34.327688 (+  1749us) service_pool.cc:224] Handling call
0709 12:13:35.405752 (+1078064us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:35.833392 (+427640us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:36.363636 (+530244us) spinlock_profiling.cc:243] Waited 405 ms on lock 0x7b54005e01d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:36.364367 (+   731us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54005e01d0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:36.364519 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3410474112}
I20260709 12:13:36.430127 13836 consensus_queue.cc:260] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:36.356105 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:36.432921 13756 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 22.
I20260709 12:13:36.432833 13836 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:36.428704 13726 leader_election.cc:403] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 election: Cancelling election due to peer responding with higher term
W20260709 12:13:36.434738 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 142258us
I20260709 12:13:36.435921 14380 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:36.363224 13832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 1795) took 2000 ms. Trace:
I20260709 12:13:36.296088 22533 raft_consensus.cc:697] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 30 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
W20260709 12:13:36.314754 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 79496us
I20260709 12:13:36.437562 13685 raft_consensus.cc:1240] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:36.293920 22785 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:36.436620 13832 rpcz_store.cc:276] 0709 12:13:34.362558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:34.769886 (+407328us) service_pool.cc:224] Handling call
0709 12:13:34.770173 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:35.833839 (+1063666us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:36.362953 (+529114us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54000da554. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:36.363153 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2338915200}
W20260709 12:13:36.440141 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 133380us
I20260709 12:13:36.419018 14414 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 32.
I20260709 12:13:36.445303 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:36.445910 13836 raft_consensus.cc:1275] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 17. (term mismatch)
I20260709 12:13:36.446100 13685 raft_consensus.cc:2393] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 20: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:36.446707 13836 pending_rounds.cc:85] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 16
I20260709 12:13:36.446621 13727 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:36.447223 13836 pending_rounds.cc:107] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 23.17
I20260709 12:13:36.447686 13836 raft_consensus.cc:2889] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:36.449990 13756 raft_consensus.cc:1275] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 12:13:36.451769 13757 raft_consensus.cc:1240] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:36.451786 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:36.362022 22773 raft_consensus.cc:3055] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:36.453960 13686 raft_consensus.cc:2393] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 28: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:36.454100 22773 raft_consensus.cc:740] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:36.454455 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:36.455149 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:36.356474 22808 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:36.456302 14410 raft_consensus.cc:1240] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 27. Current term is 28. Ops: [27.18-27.18]
I20260709 12:13:36.457401 22808 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 28 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:36.458134 22739 raft_consensus.cc:2749] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 12:13:36.460546 13832 raft_consensus.cc:1240] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:36.461802 22770 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:36.323276 22720 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:36.316371 22872 log.cc:927] Time spent T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
I20260709 12:13:36.455179 22773 consensus_queue.cc:260] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 24.19, Last appended by leader: 19, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:36.463591 22866 consensus_queue.cc:1059] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 29.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260709 12:13:36.456198 13679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 1803) took 1043 ms. Trace:
I20260709 12:13:36.465654 22832 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:36.466372 13726 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:13:36.516453 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 50160.4us
I20260709 12:13:36.466737 22635 consensus_queue.cc:1059] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:13:36.467842 13833 raft_consensus.cc:1240] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:36.519677 13833 raft_consensus.cc:1240] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:36.469017 13683 raft_consensus.cc:1275] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
I20260709 12:13:36.469283 13801 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:36.471444 13681 raft_consensus.cc:1240] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:36.471963 13828 raft_consensus.cc:1240] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 22. Current term is 24. Ops: []
I20260709 12:13:36.471920 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:36.292069 22649 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:36.439143 22854 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:13:36.474196 22518 consensus_queue.cc:1059] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 25.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 12:13:36.377234 22096 consensus_queue.cc:1048] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.098s
I20260709 12:13:36.310482 22639 raft_consensus.cc:2804] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:36.432717 22762 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:36.475430 22628 consensus_queue.cc:1059] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:13:36.439420 22212 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:36.380483 22741 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:36.474654 22533 consensus_queue.cc:237] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 28.17, Last appended by leader: 17, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:36.482622 22651 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:36.545147 13834 raft_consensus.cc:2393] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 26: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:36.486677 13727 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:36.489224 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:36.490913 13651 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:36.491966 22865 consensus_queue.cc:1059] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 23.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:13:36.489944 22421 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 24 current term: 24 is higher.
I20260709 12:13:36.527367 22797 raft_consensus.cc:2804] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:36.494061 13684 raft_consensus.cc:1275] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 27 index: 17. Preceding OpId from leader: term: 29 index: 18. (index mismatch)
W20260709 12:13:36.494167 22877 log.cc:927] Time spent T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.382s	user 0.004s	sys 0.000s
I20260709 12:13:36.495048 21893 raft_consensus.cc:3055] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:36.500603 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:36.505882 13837 raft_consensus.cc:1275] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 25 index: 18. (term mismatch)
I20260709 12:13:36.497455 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 32 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:36.346143 22519 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:36.406025 22821 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:36.344569 22735 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:36.514510 13679 rpcz_store.cc:276] 0709 12:13:35.412609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:35.412745 (+   136us) service_pool.cc:224] Handling call
0709 12:13:35.434106 (+ 21361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:36.171961 (+737855us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:36.455985 (+284024us) spinlock_profiling.cc:243] Waited 703 ms on lock 0x7b54003115d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:36.456142 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1616436096}
I20260709 12:13:36.302879 22764 consensus_queue.cc:1048] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 12, Time since last communication: 0.195s
I20260709 12:13:36.527873 13835 raft_consensus.cc:1275] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 28 index: 18. Preceding OpId from leader: term: 29 index: 18. (term mismatch)
I20260709 12:13:36.512048 22739 consensus_queue.cc:1059] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 24.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.021s
I20260709 12:13:36.508574 22773 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:36.547338 13832 raft_consensus.cc:3060] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:36.557767 21893 raft_consensus.cc:740] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:13:36.548641 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 62081.4us
I20260709 12:13:36.569710 13835 pending_rounds.cc:85] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 17
I20260709 12:13:36.571195 13835 pending_rounds.cc:107] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 28.18
I20260709 12:13:36.571473 13835 raft_consensus.cc:2889] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:13:36.551169 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:36.573691 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:36.372479 22781 consensus_queue.cc:237] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 30.16, Last appended by leader: 16, Current term: 32, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:36.493403 22880 log.cc:927] Time spent T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
W20260709 12:13:36.554998 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 64177us
I20260709 12:13:36.576253 21893 consensus_queue.cc:260] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:36.566058 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 96842.1us
I20260709 12:13:36.557456 22797 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:36.588877 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 199061us
I20260709 12:13:36.564004 22542 raft_consensus.cc:2804] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:36.540172 22639 raft_consensus.cc:697] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 24 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
W20260709 12:13:36.573081 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 99292.4us
I20260709 12:13:36.487509 22853 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:36.554394 22741 raft_consensus.cc:3055] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 29 LEADER]: Stepping down as leader of term 29
I20260709 12:13:36.554894 22866 raft_consensus.cc:3055] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 31 LEADER]: Stepping down as leader of term 31
I20260709 12:13:36.558089 13837 pending_rounds.cc:85] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 17
W20260709 12:13:36.582028 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 64370.4us
I20260709 12:13:36.584678 13801 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:36.560747 13830 raft_consensus.cc:1240] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:36.563004 22505 raft_consensus.cc:2804] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:36.565927 22821 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:36.575747 22634 consensus_queue.cc:1059] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 31.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.065s
I20260709 12:13:36.573084 22735 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:36.641237 22868 consensus_queue.cc:1059] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:13:36.569307 22804 raft_consensus.cc:3055] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:13:36.600273 22739 consensus_queue.cc:1059] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:36.602833 22865 consensus_queue.cc:1048] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:36.648698 22634 raft_consensus.cc:3055] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 LEADER]: Stepping down as leader of term 31
I20260709 12:13:36.649150 22634 raft_consensus.cc:740] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:36.629585 22797 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:36.608767 21893 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:36.622604 22421 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:36.623118 22651 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:36.624195 22720 consensus_queue.cc:1048] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:13:36.624591 22816 consensus_queue.cc:1048] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 12:13:36.557575 22635 raft_consensus.cc:2749] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:36.633039 13800 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:36.633860 13578 catalog_manager.cc:5697] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 21 to 26, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 26 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:36.543363 22212 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:36.636713 13832 raft_consensus.cc:2468] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 19.
I20260709 12:13:36.637545 13837 pending_rounds.cc:107] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 24.18
I20260709 12:13:36.671350 13837 raft_consensus.cc:2889] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:13:36.640093 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 55508.5us
I20260709 12:13:36.634744 22741 raft_consensus.cc:740] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 29 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:36.648721 22739 consensus_queue.cc:1243] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer b98d2519bb504dc6905ed2ede4571835 log is divergent from this leader: its last log entry 19.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 12:13:36.673952 22651 raft_consensus.cc:2749] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:36.639460 13726 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:36.637320 22866 raft_consensus.cc:740] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 31 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:36.599141 14379 leader_election.cc:304] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:36.631982 22746 raft_consensus.cc:2749] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:36.683070 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:36.683825 13758 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 24.
I20260709 12:13:36.647262 22735 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:36.646885 22639 consensus_queue.cc:237] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:36.647137 22715 consensus_queue.cc:1059] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:36.634941 22773 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:36.691159 22773 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:36.693324 22773 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:36.647833 22505 raft_consensus.cc:697] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:13:36.694242 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 54882.9us
I20260709 12:13:36.695281 13726 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:36.696112 22720 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:36.696712 22720 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:36.697149 22796 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:36.700114 22212 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:36.700961 22744 raft_consensus.cc:2749] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:36.702980 22710 raft_consensus.cc:3055] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:36.703435 22710 raft_consensus.cc:740] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:36.704272 22710 consensus_queue.cc:260] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:36.705200 22720 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:36.648211 22821 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:36.706323 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:36.633219 22542 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:36.707056 22542 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:36.708022 22649 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:36.709156 13833 raft_consensus.cc:1275] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 27 index: 15. (term mismatch)
I20260709 12:13:36.709574 13833 pending_rounds.cc:85] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 14
I20260709 12:13:36.709861 13833 pending_rounds.cc:107] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 26.15
I20260709 12:13:36.710130 13833 raft_consensus.cc:2889] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:13:36.656929 13651 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.56.194:39545 timed out after 2.081s (SENT) [suppressed 8 similar messages]
I20260709 12:13:36.663318 22421 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:36.714753 22777 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:36.715503 22421 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:36.662964 21893 consensus_queue.cc:1059] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.006s
I20260709 12:13:36.672796 13652 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:36.705596 22710 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:36.719913 22851 raft_consensus.cc:3055] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:36.720484 22851 raft_consensus.cc:740] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:36.721623 22851 consensus_queue.cc:260] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:36.722790 22851 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:36.682572 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:36.675901 22741 consensus_queue.cc:260] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 29.19, Last appended by leader: 19, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:36.724970 22741 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:36.697191 13726 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:36.685654 22866 consensus_queue.cc:260] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 31.19, Last appended by leader: 19, Current term: 31, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:36.728777 22866 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:13:36.655087 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:36.730407 22785 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:36.688159 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:36.681159 22832 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader election lost for term 24. Reason: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 24. Current term is 25.
W20260709 12:13:36.689090 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 90019.4us
I20260709 12:13:36.734236 13578 catalog_manager.cc:5697] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 21 to 25. New cstate: current_term: 25 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:13:36.690008 22739 raft_consensus.cc:2749] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:13:36.676229 22634 consensus_queue.cc:260] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 31.15, Last appended by leader: 15, Current term: 31, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:36.736207 13578 catalog_manager.cc:5697] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 15 to 20, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 20 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:13:36.644685 22804 raft_consensus.cc:740] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
W20260709 12:13:36.737425 22651 consensus_queue.cc:1175] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ca9fbbc2c0a94897897d502d42f3951f" responder_term: 30 status { last_received { term: 29 index: 19 } last_committed_idx: 19 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 29. Current term is 30. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:13:36.738345 22804 consensus_queue.cc:260] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 25.13, Last appended by leader: 13, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:36.739740 22804 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:13:36.719853 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 47148.3us
I20260709 12:13:36.742987 22509 raft_consensus.cc:3055] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:36.743630 22509 raft_consensus.cc:740] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:36.720525 22853 raft_consensus.cc:2749] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:36.744867 22509 consensus_queue.cc:260] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:36.735023 14379 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:36.683913 22769 consensus_queue.cc:1048] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.006s
I20260709 12:13:36.747715 22096 raft_consensus.cc:3055] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:13:36.748217 22096 raft_consensus.cc:740] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:36.750005 22749 raft_consensus.cc:2749] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:13:36.750156 13686 raft_consensus.cc:1240] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:36.751372 22749 consensus_queue.cc:1059] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:13:36.752470 22808 raft_consensus.cc:3055] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:13:36.752910 22808 raft_consensus.cc:740] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:36.753250 22757 raft_consensus.cc:3055] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:13:36.753721 22757 raft_consensus.cc:740] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:36.753901 22808 consensus_queue.cc:260] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:36.685964 22635 raft_consensus.cc:2749] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:13:36.755672 22808 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:36.754695 22757 consensus_queue.cc:260] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:36.758365 22757 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:36.760994 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:36.761962 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 32 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:36.762423 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:36.762809 13759 raft_consensus.cc:2393] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 32 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 32: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:36.763222 13684 raft_consensus.cc:2393] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 26: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:36.761060 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:36.764381 13760 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 27.
I20260709 12:13:36.764788 13757 raft_consensus.cc:2393] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 23: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:36.694561 22505 consensus_queue.cc:237] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.12, Last appended by leader: 13, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:36.749276 22096 consensus_queue.cc:260] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:36.773885 22634 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Advancing to term 32
W20260709 12:13:36.776234 13760 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48114 (request call id 3834) took 2232 ms (client timeout 2081 ms). Trace:
W20260709 12:13:36.776780 13760 rpcz_store.cc:269] 0709 12:13:34.543710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:34.774973 (+231263us) service_pool.cc:224] Handling call
0709 12:13:36.776018 (+2001045us) spinlock_profiling.cc:243] Waited 1.99 s on lock 0x7b54000893d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:36.776151 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4572824960}
I20260709 12:13:36.680622 13801 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:13:36.787534 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 106995us
I20260709 12:13:36.744889 13652 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:36.790822 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 28 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:13:36.792881 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 63949.9us
I20260709 12:13:36.795298 22651 raft_consensus.cc:2749] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:13:36.795732 22800 consensus_queue.cc:1048] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:13:36.796322 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 28 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:36.797994 22715 raft_consensus.cc:2749] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:13:36.733264 22785 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:36.803146 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 146222us
I20260709 12:13:36.802883 13578 catalog_manager.cc:5697] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 16 to 22. New cstate: current_term: 22 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:36.796463 22509 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:36.812924 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
W20260709 12:13:36.819809 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 75017.2us
I20260709 12:13:36.820851 13652 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:36.822976 14380 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:36.829932 13681 raft_consensus.cc:1275] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 28 index: 16. (index mismatch)
I20260709 12:13:36.830053 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:36.830888 14414 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 26.
I20260709 12:13:36.832026 14410 raft_consensus.cc:2393] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 23: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:13:36.833451 14380 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:36.833757 13833 raft_consensus.cc:1240] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:36.835603 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:36.837250 13759 raft_consensus.cc:1275] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 12:13:36.838310 21893 consensus_queue.cc:1059] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 24.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:13:36.839495 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:36.840365 13685 raft_consensus.cc:2393] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 24: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:36.840992 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:36.842496 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:13:36.838317 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 153110us
I20260709 12:13:36.846342 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:36.849691 13652 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:13:36.852210 21893 raft_consensus.cc:3055] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:36.852690 21893 raft_consensus.cc:740] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:36.854292 21893 consensus_queue.cc:260] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:36.856338 21893 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:36.868409 13652 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:13:36.831722 22720 raft_consensus.cc:2749] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:36.883672 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:36.847172 22765 raft_consensus.cc:2749] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:36.881665 13652 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:36.894519 13727 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:36.855219 22785 raft_consensus.cc:2749] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:13:36.808378 22868 consensus_queue.cc:1048] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.067s
I20260709 12:13:36.818863 22651 consensus_queue.cc:1059] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.065s
I20260709 12:13:36.924468 13800 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 32 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:36.926303 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 26 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:36.836709 22790 consensus_queue.cc:1048] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.075s
I20260709 12:13:36.927882 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:36.983985 13755 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 27.
I20260709 12:13:36.878722 22853 raft_consensus.cc:2804] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:13:36.928182 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:36.834322 22762 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:36.878252 22212 raft_consensus.cc:2804] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader election won for term 25
W20260709 12:13:36.929659 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:36.872810 22767 consensus_queue.cc:1048] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.061s
I20260709 12:13:36.871495 22744 consensus_queue.cc:1059] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 26.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 12:13:36.924431 22518 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:13:36.943406 22891 log.cc:927] Time spent T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 12:13:36.991400 22542 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:37.009217 21893 raft_consensus.cc:2749] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
W20260709 12:13:36.993065 22895 log.cc:927] Time spent T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 12:13:36.994191 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:36.912385 22865 consensus_queue.cc:1048] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.032s
W20260709 12:13:36.997152 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 72820.9us
W20260709 12:13:36.998847 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 173599us
I20260709 12:13:36.919756 22770 consensus_queue.cc:1048] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.064s
W20260709 12:13:37.011721 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 130225us
W20260709 12:13:37.012876 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 118469us
I20260709 12:13:36.983877 22765 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:13:37.045006 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 211638us
I20260709 12:13:37.067755 13800 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:13:37.068344 13727 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 32 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:37.069159 13652 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:13:37.000052 22777 raft_consensus.cc:2749] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 32 FOLLOWER]: Leader election lost for term 32. Reason: could not achieve majority
I20260709 12:13:37.000504 22853 raft_consensus.cc:697] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 28 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:37.073369 14380 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:37.032706 22507 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.165227 22507 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:37.166652 22887 raft_consensus.cc:3055] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:37.167161 22887 raft_consensus.cc:740] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:37.168154 22542 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:37.168084 22887 consensus_queue.cc:260] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:37.169050 22542 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.115790 13832 raft_consensus.cc:1275] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 28 index: 16. (index mismatch)
I20260709 12:13:37.047330 22630 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.033294 22518 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:37.121592 22892 consensus_queue.cc:1059] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:13:37.122951 22628 raft_consensus.cc:2804] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:13:37.190500 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:37.123545 13757 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:13:37.191445 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 30 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:37.125237 22784 raft_consensus.cc:2804] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:37.136423 22800 consensus_queue.cc:1059] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 25.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:13:37.138438 22505 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 32 FOLLOWER]: Leader election won for term 32
W20260709 12:13:37.139446 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 66228.5us
I20260709 12:13:37.202598 14380 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:37.139981 22764 raft_consensus.cc:2749] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 32 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:13:37.141208 22796 raft_consensus.cc:2749] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:37.046444 22746 consensus_queue.cc:1048] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.061s
W20260709 12:13:37.154371 22519 consensus_meta.cc:287] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.589s	user 0.003s	sys 0.007s
I20260709 12:13:37.157579 22740 raft_consensus.cc:3055] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:37.158430 22757 raft_consensus.cc:3055] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:37.159878 13756 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 24.
I20260709 12:13:37.068923 22797 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:37.047171 22785 raft_consensus.cc:2804] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:37.173458 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:37.223223 14408 raft_consensus.cc:1240] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:37.175341 13833 raft_consensus.cc:1275] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 12:13:37.176752 13832 raft_consensus.cc:1275] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 29 index: 17. (index mismatch)
I20260709 12:13:37.227192 13687 raft_consensus.cc:1240] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:37.180154 13578 catalog_manager.cc:5697] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:13:37.181020 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:37.182178 13835 raft_consensus.cc:1240] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 25. Current term is 26. Ops: [23.12-25.13]
I20260709 12:13:37.188956 14379 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:37.191458 13757 raft_consensus.cc:606] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:37.129539 13759 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 23.
I20260709 12:13:37.198662 13763 raft_consensus.cc:1240] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 22. Current term is 23. Ops: []
W20260709 12:13:37.180490 22880 log.cc:927] Time spent T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 12:13:37.197225 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:37.200680 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:37.265353 13834 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:13:37.261155 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:37.169539 22542 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:37.208209 13800 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:37.214609 14411 raft_consensus.cc:1275] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 12:13:37.215056 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:37.187752 22905 consensus_queue.cc:1048] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.015s
I20260709 12:13:37.219170 22898 raft_consensus.cc:2804] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:13:37.188522 22630 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:37.221158 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 223919us
I20260709 12:13:37.224547 22740 raft_consensus.cc:740] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 24 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:37.233299 13836 raft_consensus.cc:2393] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 22: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:37.278256 13835 raft_consensus.cc:1240] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 20. Current term is 21. Ops: [15.13-20.16]
I20260709 12:13:37.309682 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 26 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:13:37.304800 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 115923us
I20260709 12:13:37.222369 22628 raft_consensus.cc:697] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 20 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:37.222930 22505 raft_consensus.cc:697] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 32 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:37.233852 14414 raft_consensus.cc:1240] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 32 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 31. Current term is 32. Ops: [31.19-31.19]
I20260709 12:13:37.289181 13757 raft_consensus.cc:614] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:37.231048 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:37.225047 22757 raft_consensus.cc:740] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:37.300505 22785 raft_consensus.cc:697] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 21 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:37.208480 22784 raft_consensus.cc:697] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 25 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
W20260709 12:13:37.302596 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 94505.2us
I20260709 12:13:37.315721 22892 raft_consensus.cc:2804] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:37.305609 13754 raft_consensus.cc:2393] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 26: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:37.273061 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:37.223210 22854 consensus_queue.cc:1059] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 24.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.083s
I20260709 12:13:37.337167 13758 raft_consensus.cc:1275] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 24 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 12:13:37.298710 22796 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.271654 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:37.343926 13800 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:37.304410 13651 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:37.315928 22898 raft_consensus.cc:697] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 19 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:37.317164 22720 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:37.316107 22212 raft_consensus.cc:697] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 25 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
W20260709 12:13:37.347951 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 43639.1us
I20260709 12:13:37.351177 13831 raft_consensus.cc:2393] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 23: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:37.351264 13800 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:37.381031 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:37.386137 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:37.391050 14411 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025"
dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:46814
I20260709 12:13:37.392105 14411 raft_consensus.cc:606] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:37.392529 14411 raft_consensus.cc:614] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:37.392714 22096 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:37.394855 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:37.395627 13687 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:37.396306 22784 consensus_queue.cc:237] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:37.398267 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 30 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:37.399040 22518 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:37.399690 22518 raft_consensus.cc:2749] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:13:37.399789 22505 consensus_queue.cc:237] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 29.18, Last appended by leader: 18, Current term: 32, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:37.400496 13683 raft_consensus.cc:1275] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 12:13:37.401050 22518 consensus_queue.cc:1059] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:13:37.371881 22635 raft_consensus.cc:2749] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:37.402107 13686 raft_consensus.cc:1275] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 24 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 12:13:37.344568 22762 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:37.338078 22787 raft_consensus.cc:2749] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:13:37.395040 22542 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:37.353626 13834 raft_consensus.cc:2468] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 20.
I20260709 12:13:37.386272 22630 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:37.407611 13686 raft_consensus.cc:1240] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:37.407428 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:37.345482 22892 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:37.411520 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 318904us
W20260709 12:13:37.419113 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:37.415730 14415 raft_consensus.cc:2468] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 20.
I20260709 12:13:37.304262 22853 consensus_queue.cc:237] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:37.436812 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:37.425711 13687 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 26.
I20260709 12:13:37.428785 13762 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 22.
I20260709 12:13:37.478933 22765 raft_consensus.cc:2749] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:13:37.476758 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 70284.3us
I20260709 12:13:37.411265 22507 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:37.421482 22892 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:37.412313 22907 raft_consensus.cc:2804] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:37.372008 22796 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:37.476153 22634 consensus_meta.cc:287] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.701s	user 0.011s	sys 0.003s
W20260709 12:13:37.486701 22903 log.cc:927] Time spent T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 12:13:37.434010 22757 consensus_queue.cc:260] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:37.472259 22785 consensus_queue.cc:237] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:37.420872 22866 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.493752 13651 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:13:37.503090 22509 consensus_meta.cc:287] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.667s	user 0.013s	sys 0.001s
I20260709 12:13:37.379947 22720 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:37.506817 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:37.484011 13652 leader_election.cc:400] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 election: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 18. Current term is 19.
W20260709 12:13:37.544227 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 60400.6us
W20260709 12:13:37.509810 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:37.496011 14411 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34a12e91341d4472be7460f1061495db"
dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
mode: GRACEFUL
new_leader_uuid: "b98d2519bb504dc6905ed2ede4571835"
 from {username='slave'} at 127.0.0.1:46814
W20260709 12:13:37.535552 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 220491us
I20260709 12:13:37.497303 22851 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.547168 13831 raft_consensus.cc:1275] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 29 index: 19. Preceding OpId from leader: term: 30 index: 20. (index mismatch)
I20260709 12:13:37.547825 14379 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:37.503600 22907 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:37.552182 14408 raft_consensus.cc:1275] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 30 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 29 index: 19. Preceding OpId from leader: term: 30 index: 20. (index mismatch)
I20260709 12:13:37.554046 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:37.546002 14411 raft_consensus.cc:606] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 22 LEADER]: Received request to transfer leadership to TS b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:37.566039 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 33 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:37.566715 13834 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 32.
I20260709 12:13:37.556105 22739 raft_consensus.cc:2749] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 12:13:37.559358 22509 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 32 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:37.550181 22635 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:37.532373 22212 consensus_queue.cc:237] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:37.492445 22628 consensus_queue.cc:237] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:37.560140 22907 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:37.541632 22866 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:37.568782 22797 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:37.559569 22851 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:37.577077 22533 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:37.569466 22744 consensus_queue.cc:1059] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.032s
I20260709 12:13:37.588524 22749 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.592640 22899 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:37.583117 22635 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:37.593513 22901 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:37.617532 22901 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:37.618830 22635 leader_election.cc:290] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:37.620105 22773 consensus_queue.cc:1059] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:13:37.618916 22749 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:37.509833 22898 consensus_queue.cc:237] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 17.16, Last appended by leader: 16, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:37.634943 22796 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:37.594815 22914 raft_consensus.cc:2804] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:37.641202 22914 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:37.641767 22914 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:37.642052 22769 raft_consensus.cc:3055] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:37.642784 22769 raft_consensus.cc:740] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:37.664170 22908 raft_consensus.cc:3055] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:13:37.665803 22908 raft_consensus.cc:740] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:37.666956 22908 consensus_queue.cc:260] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.17, Last appended by leader: 17, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:37.666584 22907 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:37.706019 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 142535us
W20260709 12:13:37.715134 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 323678us
W20260709 12:13:37.716619 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:37.735297 22886 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.736889 14408 raft_consensus.cc:1240] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:37.736560 22886 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:37.587034 22509 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:37.739737 22635 consensus_queue.cc:1048] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:13:37.616314 22533 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:37.747859 22720 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:37.734390 22519 consensus_queue.cc:1048] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.002s
I20260709 12:13:37.749365 22743 raft_consensus.cc:3055] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:13:37.750134 22743 raft_consensus.cc:740] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:37.617035 22899 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:37.775396 22907 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:37.815063 22509 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:37.816787 22797 raft_consensus.cc:3055] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:37.817453 22797 raft_consensus.cc:740] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:37.819322 22797 consensus_queue.cc:260] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:37.822892 22886 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:13:37.824579 13800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:37.809381 22866 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:37.830974 13830 raft_consensus.cc:1240] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 18. Current term is 19. Ops: [18.17-18.17]
I20260709 12:13:37.833144 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:37.835139 13834 raft_consensus.cc:2393] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 22: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:37.834970 13578 catalog_manager.cc:5697] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:13:37.824992 22797 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:13:37.833293 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:37.847502 13837 raft_consensus.cc:1275] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 12:13:37.837512 13578 catalog_manager.cc:5697] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 19 to 21, leader changed from ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 21 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:37.885156 13800 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:37.885481 22749 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:37.886691 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:37.888180 13834 raft_consensus.cc:2368] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 25. Current term is 26.
I20260709 12:13:37.888885 22635 raft_consensus.cc:2749] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:13:37.890092 22635 consensus_queue.cc:1048] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:13:37.892392 22635 consensus_queue.cc:1048] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:13:37.894459 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 400582us
I20260709 12:13:37.895831 22887 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:37.896023 13651 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:37.896890 13578 catalog_manager.cc:5697] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 10 to 22, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 22 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:13:37.899412 13578 catalog_manager.cc:5697] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 19 to 20, leader changed from ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 20 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:37.902688 22757 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:13:37.904165 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 342652us
I20260709 12:13:37.905395 13652 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:37.902614 13578 catalog_manager.cc:5697] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 16 to 20, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 20 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
W20260709 12:13:37.921916 22912 log.cc:927] Time spent T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.351s	user 0.004s	sys 0.000s
I20260709 12:13:37.922717 22762 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:37.922959 22781 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.908828 22740 consensus_queue.cc:260] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 24.19, Last appended by leader: 19, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:37.923797 22762 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:37.925696 22740 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:37.925923 22851 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:37.926887 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:37.928339 22804 raft_consensus.cc:2804] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:37.929244 22804 raft_consensus.cc:697] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 22 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:37.930881 22804 consensus_queue.cc:237] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:37.932195 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 31 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:37.933224 13837 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 30.
I20260709 12:13:37.934512 22785 raft_consensus.cc:2804] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:37.934999 22785 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:37.935393 22785 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:37.929567 22901 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:37.923902 22781 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:37.942384 14380 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:37.942919 22781 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:37.945127 22865 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.946012 22865 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:37.949234 22865 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:37.949941 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:37.950259 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 31 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:37.952491 22744 consensus_queue.cc:1059] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 26.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:13:37.955618 22914 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:37.957697 22744 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.958647 22744 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:37.961148 22762 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:37.963943 13580 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45610 (request call id 257) took 108374 ms (client timeout 15000 ms). Trace:
I20260709 12:13:37.964767 14415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 1464) took 1152 ms. Trace:
I20260709 12:13:37.966526 13829 raft_consensus.cc:1240] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:37.967550 22914 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:37.970741 22851 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.969980 22744 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:37.972222 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 258111us
I20260709 12:13:37.933930 13578 catalog_manager.cc:5697] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 13 to 19, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 19 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:13:37.982911 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 28 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:37.991868 14411 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b"
dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
mode: GRACEFUL
new_leader_uuid: "b98d2519bb504dc6905ed2ede4571835"
 from {username='slave'} at 127.0.0.1:46814
I20260709 12:13:37.992342 13684 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 27.
I20260709 12:13:37.992882 14411 raft_consensus.cc:606] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 24 LEADER]: Received request to transfer leadership to TS b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:37.977576 14415 rpcz_store.cc:276] 0709 12:13:36.812161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:36.812278 (+   117us) service_pool.cc:224] Handling call
0709 12:13:37.964353 (+1152075us) spinlock_profiling.cc:243] Waited 373 ms on lock 0x7b54006df454. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:37.964534 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":857978624}
I20260709 12:13:37.986886 22901 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:13:37.995968 22901 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:37.996552 22901 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:37.997054 14415 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09"
dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:46814
I20260709 12:13:37.997790 14415 raft_consensus.cc:606] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:37.998195 14415 raft_consensus.cc:614] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:37.999945 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:13:38.000553 22762 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:38.001314 22762 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:38.004266 22762 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:38.007148 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:38.005695 13652 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:38.011103 22639 consensus_queue.cc:1048] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:38.012362 13578 catalog_manager.cc:5697] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:13:38.014015 22762 raft_consensus.cc:2749] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:13:38.014647 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:38.015923 13652 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:38.016095 13679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 4036) took 1201 ms. Trace:
I20260709 12:13:38.017127 22853 raft_consensus.cc:2749] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:13:38.016680 13679 rpcz_store.cc:276] 0709 12:13:36.814398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:36.814524 (+   126us) service_pool.cc:224] Handling call
0709 12:13:38.014874 (+1200350us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b5800002798. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924e68b71 00007fa924e68a22 00007fa92dd818d9 00007fa92cedbee0 00007fa92cfa50ab 00007fa92cfa5131 00007fa92cf66fc0 00007fa92cf51929 00007fa92cf513d2 00007fa9264c8bd4
0709 12:13:38.015242 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:38.015536 (+   294us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:38.015564 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:38.015611 (+    47us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:13:38.015680 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:38.015734 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:38.015890 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":35913472}
I20260709 12:13:38.019901 22519 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:38.005739 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:38.020768 22519 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:38.022934 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:38.023861 22519 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:38.027447 13830 raft_consensus.cc:1240] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:38.029161 22421 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:38.030077 22421 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:38.034116 22421 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:38.034443 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 33 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:37.982753 22851 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:38.042758 13831 raft_consensus.cc:1275] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 12:13:38.045075 13837 raft_consensus.cc:2393] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 27: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
W20260709 12:13:38.046631 13756 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48120 (request call id 2914) took 1364 ms (client timeout 1631 ms). Trace:
W20260709 12:13:38.047335 13756 rpcz_store.cc:269] 0709 12:13:36.682106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:36.682252 (+   146us) service_pool.cc:224] Handling call
0709 12:13:38.046225 (+1363973us) spinlock_profiling.cc:243] Waited 435 ms on lock 0x7b54002b07d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:38.046424 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1001364224}
I20260709 12:13:38.048326 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 29 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:38.049229 13684 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 28.
I20260709 12:13:38.053680 22908 raft_consensus.cc:3060] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:38.067245 13800 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
W20260709 12:13:38.070081 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 60340us
I20260709 12:13:38.044713 13578 catalog_manager.cc:5697] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:38.074918 22851 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:13:38.088177 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 66378.7us
W20260709 12:13:38.078177 22937 log.cc:927] Time spent T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.310s	user 0.003s	sys 0.000s
I20260709 12:13:38.097260 22628 raft_consensus.cc:2804] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:38.097391 22518 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:38.098539 13652 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:38.098414 13578 catalog_manager.cc:5697] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 10 to 17, leader changed from ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 17 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:13:38.102360 22914 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:38.103554 22868 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:38.104225 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:38.104957 22899 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:38.071126 22421 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:38.112301 13757 raft_consensus.cc:1275] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 12:13:38.112805 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:38.114179 22518 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:38.114759 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:38.115640 22628 raft_consensus.cc:697] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 26 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:38.074175 22519 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:38.054838 22781 consensus_queue.cc:1048] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 12:13:38.126286 22421 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:38.128139 13578 catalog_manager.cc:5697] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 22 to 26. New cstate: current_term: 26 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:13:38.133826 13834 raft_consensus.cc:1275] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 32 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 30 index: 16. Preceding OpId from leader: term: 32 index: 17. (index mismatch)
I20260709 12:13:38.143045 22421 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:38.144745 13680 raft_consensus.cc:1275] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 25 index: 13. Preceding OpId from leader: term: 26 index: 13. (term mismatch)
I20260709 12:13:38.145624 13680 pending_rounds.cc:85] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 12
I20260709 12:13:38.144714 22868 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:38.145949 13680 pending_rounds.cc:107] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 25.13
I20260709 12:13:38.146337 13680 raft_consensus.cc:2889] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:38.149024 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:38.148568 22743 consensus_queue.cc:260] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 27.18, Last appended by leader: 18, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:38.156839 22773 raft_consensus.cc:2749] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
W20260709 12:13:38.157047 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 58613.2us
I20260709 12:13:38.165918 13652 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:38.150012 13687 raft_consensus.cc:2393] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 26: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:38.151719 22628 consensus_queue.cc:237] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:38.171722 22518 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:38.157554 22868 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:38.158519 22743 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:38.174113 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:38.160523 13829 raft_consensus.cc:1275] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 28 index: 17. Preceding OpId from leader: term: 30 index: 18. (index mismatch)
I20260709 12:13:38.152263 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 33 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:38.124444 22914 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:38.115770 22769 consensus_queue.cc:260] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 26.11, Last appended by leader: 11, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:38.191007 13762 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 27.
I20260709 12:13:38.159101 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:38.198231 13681 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 25.
I20260709 12:13:38.204540 22533 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:38.206059 13578 catalog_manager.cc:5697] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 19 to 23, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 23 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:38.201807 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 138256us
I20260709 12:13:38.208341 13578 catalog_manager.cc:5697] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 19 to 25, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 25 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:13:38.196004 22212 raft_consensus.cc:2749] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:38.225279 13578 catalog_manager.cc:5697] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 18 to 22. New cstate: current_term: 22 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:13:38.228242 13687 raft_consensus.cc:1275] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 12:13:38.229413 13578 catalog_manager.cc:5697] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:13:38.230415 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:38.230937 22769 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:38.231053 13578 catalog_manager.cc:5697] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 17 to 21, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 21 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:38.233078 13578 catalog_manager.cc:5697] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:13:38.235379 22914 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:38.235388 13578 catalog_manager.cc:5697] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:38.237696 13755 raft_consensus.cc:1275] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 12:13:38.240082 14379 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:38.241160 22507 consensus_queue.cc:1048] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 12:13:38.244467 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 28 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:38.244839 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 31 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:38.246093 22899 raft_consensus.cc:993] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f: : Instructing follower b98d2519bb504dc6905ed2ede4571835 to start an election
I20260709 12:13:38.246630 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 29 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:38.246764 22899 raft_consensus.cc:1081] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 22 LEADER]: Signalling peer b98d2519bb504dc6905ed2ede4571835 to start an election
W20260709 12:13:38.249666 22892 consensus_meta.cc:287] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.751s	user 0.009s	sys 0.015s
I20260709 12:13:38.250123 14379 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:38.250412 22892 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:38.251380 22739 raft_consensus.cc:2804] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:38.251959 22739 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:38.252538 22739 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:38.252935 22892 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:38.224201 22533 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:37.977519 13580 rpcz_store.cc:269] 0709 12:11:49.590079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:49.590381 (+   302us) service_pool.cc:224] Handling call
0709 12:13:37.963617 (+108373236us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:29.510874 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:29.562028 (+ 51154us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:29.562103 (+    75us) write_op.cc:435] Acquired schema lock
0709 12:13:29.562131 (+    28us) tablet.cc:662] Decoding operations
0709 12:13:29.562712 (+   581us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:29.562826 (+   114us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:29.562874 (+    48us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:13:29.563252 (+   378us) tablet.cc:701] Row locks acquired
0709 12:13:29.563313 (+    61us) write_op.cc:260] PREPARE: finished
0709 12:13:29.563553 (+   240us) write_op.cc:270] Start()
0709 12:13:29.563766 (+   213us) write_op.cc:276] Timestamp: P: 1783599209563460 usec, L: 0
0709 12:13:29.563818 (+    52us) op_driver.cc:348] REPLICATION: starting
0709 12:13:29.610710 (+ 46892us) log.cc:844] Serialized 541 byte log entry
0709 12:13:29.934860 (+324150us) op_driver.cc:464] REPLICATION: finished
0709 12:13:29.950277 (+ 15417us) write_op.cc:301] APPLY: starting
0709 12:13:29.950387 (+   110us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:29.953409 (+  3022us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:29.953550 (+   141us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:30.088913 (+135363us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:30.231199 (+142286us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 12:13:30.231270 (+    71us) write_op.cc:312] APPLY: finished
0709 12:13:30.231560 (+   290us) log.cc:844] Serialized 25 byte log entry
0709 12:13:30.231763 (+   203us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:30.231848 (+    85us) write_op.cc:454] Released schema lock
0709 12:13:30.231915 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:30.232379 (+   464us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:30.232409 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1741759,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":15090,"apply.run_cpu_time_us":6834,"apply.run_wall_time_us":282079,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8307,"cfile_init":1,"lbm_read_time_us":543,"lbm_reads_lt_1ms":4,"num_ops":1,"prepare.queue_time_us":175180,"prepare.run_cpu_time_us":28148,"prepare.run_wall_time_us":253629,"raft.queue_time_us":102301,"raft.run_cpu_time_us":2619,"raft.run_wall_time_us":19463,"replication_time_us":370860,"thread_start_us":398069,"threads_started":4,"wal-append.queue_time_us":138005,"wal-append.run_cpu_time_us":7836,"wal-append.run_wall_time_us":1539263}]]}
W20260709 12:13:38.253140 22096 consensus_meta.cc:287] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.860s	user 0.014s	sys 0.010s
I20260709 12:13:38.220950 13652 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:38.253952 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:13:38.258481 22944 log.cc:927] Time spent T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
W20260709 12:13:38.284825 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 115059us
I20260709 12:13:38.253750 22892 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:38.216765 22519 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:38.296469 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:38.302521 13680 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "34a12e91341d4472be7460f1061495db"
dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
 from {username='slave'} at 127.0.0.1:48212
I20260709 12:13:38.257150 22533 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:38.303421 13680 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:38.305907 13680 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:38.257939 22749 consensus_queue.cc:1048] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.036s
I20260709 12:13:38.310508 22764 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:38.311240 22764 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:38.312520 22868 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:38.313251 22868 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:38.315824 22868 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:38.300511 22212 raft_consensus.cc:2804] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:13:38.325800 22628 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:38.333078 22628 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:38.329028 22518 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:38.342058 22822 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:38.341809 22518 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:38.342612 22822 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:38.343291 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:38.344436 22518 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:38.344679 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:38.308633 22507 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:38.345439 22743 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:38.345943 22507 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:38.346143 22743 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:38.347735 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:38.348815 13688 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 25.
I20260709 12:13:38.344899 22822 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:38.350116 22854 raft_consensus.cc:2749] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:38.351125 22743 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:38.352751 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:38.350226 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:38.350189 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 31 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:38.353837 13727 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:38.325412 22892 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:38.367344 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 58365.4us
I20260709 12:13:38.368464 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 31 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:38.354830 22212 raft_consensus.cc:697] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 20 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:38.378257 22519 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:38.357990 22785 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:38.371287 22743 raft_consensus.cc:2804] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260709 12:13:38.390766 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:38.432397 22212 consensus_queue.cc:237] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:38.425233 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 55189us
I20260709 12:13:38.391580 22743 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 32 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:38.437892 22743 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:13:38.439152 22892 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:38.436404 13684 raft_consensus.cc:1240] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 26. Current term is 27. Ops: [26.19-26.19]
I20260709 12:13:38.437345 13756 raft_consensus.cc:2393] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 25: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:38.445511 13800 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:38.457217 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:38.383978 22518 consensus_queue.cc:1048] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.060s
I20260709 12:13:38.468461 22914 consensus_queue.cc:1048] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:13:38.468802 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:38.479352 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:38.481618 13726 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:38.482689 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:38.468519 22651 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:38.483656 13757 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 24.
I20260709 12:13:38.484054 22651 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:38.484925 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:38.485723 13756 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 25.
I20260709 12:13:38.486536 22743 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 33 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:38.487473 14408 raft_consensus.cc:1275] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 32 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 29 index: 18. Preceding OpId from leader: term: 32 index: 19. (index mismatch)
I20260709 12:13:38.489243 22743 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 33 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:38.449064 22628 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:38.499894 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:38.500748 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:38.501554 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:38.502262 22785 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:38.505594 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:38.506415 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 31 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:38.512841 13830 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 30.
I20260709 12:13:38.502291 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:38.507443 13683 raft_consensus.cc:1275] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 12:13:38.509227 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 33 candidate_status { last_received { term: 31 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:38.511926 13832 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 24.
I20260709 12:13:38.519145 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:38.520289 13762 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 25.
I20260709 12:13:38.522698 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:38.524412 13757 raft_consensus.cc:1275] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 28 index: 17. Preceding OpId from leader: term: 30 index: 18. (index mismatch)
I20260709 12:13:38.522616 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:38.526929 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:38.531848 13679 raft_consensus.cc:2393] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 25: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:38.534606 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:38.535148 13829 raft_consensus.cc:1275] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 26 index: 13. (index mismatch)
I20260709 12:13:38.535645 22892 raft_consensus.cc:2804] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:38.536100 22892 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:38.536484 22892 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:38.536760 13682 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 31.
I20260709 12:13:38.536957 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:38.537757 14410 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 22.
I20260709 12:13:38.540123 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:13:38.540433 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 145154us
W20260709 12:13:38.542135 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 117819us
I20260709 12:13:38.542922 22743 consensus_queue.cc:1048] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:13:38.544121 13726 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:38.545918 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:38.546213 13754 raft_consensus.cc:1275] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:13:38.547266 22767 raft_consensus.cc:2749] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:13:38.549891 22951 log.cc:927] Time spent T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.242s	user 0.001s	sys 0.000s
I20260709 12:13:38.531502 14415 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 23.
I20260709 12:13:38.534711 13831 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 25.
I20260709 12:13:38.535516 13836 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 24.
I20260709 12:13:38.557451 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:38.557978 22743 raft_consensus.cc:2804] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:38.561405 14411 raft_consensus.cc:1240] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 27. Current term is 28. Ops: [27.18-27.18]
I20260709 12:13:38.561959 13652 leader_election.cc:400] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 election: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 25. Current term is 26.
I20260709 12:13:38.561444 22743 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:38.562731 22743 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:38.565323 22740 raft_consensus.cc:993] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f: : Instructing follower b98d2519bb504dc6905ed2ede4571835 to start an election
I20260709 12:13:38.570756 13755 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 20.
I20260709 12:13:38.558566 13651 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:38.562283 13652 leader_election.cc:403] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 election: Cancelling election due to peer responding with higher term
I20260709 12:13:38.565748 22926 consensus_queue.cc:1048] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 12:13:38.566423 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:38.575014 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:38.582259 13756 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 25.
I20260709 12:13:38.577140 13759 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 23.
I20260709 12:13:38.581650 13829 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 23.
W20260709 12:13:38.586738 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 97427.5us
I20260709 12:13:38.570426 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:38.572405 22743 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:38.597584 13680 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:38.597425 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 33 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:38.604535 13688 raft_consensus.cc:1240] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:38.555708 22533 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:38.606961 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 30 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:38.607525 13760 raft_consensus.cc:1275] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 12:13:38.607874 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:38.608119 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:38.609478 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 33 candidate_status { last_received { term: 31 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:38.618150 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:38.628262 13756 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 24.
I20260709 12:13:38.631933 13762 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 22.
I20260709 12:13:38.604647 22804 raft_consensus.cc:2749] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader election lost for term 25. Reason: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 25. Current term is 26.
I20260709 12:13:38.638183 13761 raft_consensus.cc:2368] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 25. Current term is 26.
I20260709 12:13:38.638918 13680 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:38.640960 13829 raft_consensus.cc:1275] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 32 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 31 index: 19. Preceding OpId from leader: term: 32 index: 19. (term mismatch)
I20260709 12:13:38.610355 22914 raft_consensus.cc:2804] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:38.639912 13727 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:13:38.643869 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 91039.9us
I20260709 12:13:38.600732 22739 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:38.641500 13829 pending_rounds.cc:85] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 18
I20260709 12:13:38.653903 13829 pending_rounds.cc:107] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 31.19
I20260709 12:13:38.654276 13829 raft_consensus.cc:2889] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 32 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:38.601390 22781 consensus_queue.cc:1048] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.036s
I20260709 12:13:38.648831 13830 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 32.
I20260709 12:13:38.644007 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:38.663707 13760 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 27.
I20260709 12:13:38.630534 22964 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:38.676353 13727 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:38.681584 13800 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:38.637355 22651 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:13:38.669950 22901 consensus_meta.cc:287] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.673s	user 0.011s	sys 0.003s
I20260709 12:13:38.650806 22628 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:38.689464 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:38.689638 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 89812.8us
I20260709 12:13:38.658241 22866 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:38.691901 13652 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:38.695204 13727 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:38.692739 13800 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:38.685150 22519 raft_consensus.cc:2749] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:13:38.671365 22914 raft_consensus.cc:697] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 27 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:38.705233 13800 leader_election.cc:304] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:38.717731 13727 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:38.710299 22518 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:38.689487 22899 raft_consensus.cc:1081] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 24 LEADER]: Signalling peer b98d2519bb504dc6905ed2ede4571835 to start an election
I20260709 12:13:38.702996 22651 raft_consensus.cc:2804] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:38.725580 22715 raft_consensus.cc:2804] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 12:13:38.725710 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 48402.9us
I20260709 12:13:38.726028 22651 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:38.726240 22715 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:38.726523 22651 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:38.726734 22715 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:38.728781 22963 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:38.729403 22963 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:38.724709 22628 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:38.724200 13727 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:38.725431 22754 raft_consensus.cc:2804] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:38.714250 22767 raft_consensus.cc:2804] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:38.713944 22804 raft_consensus.cc:2749] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:38.710572 22744 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:38.684958 22964 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:38.723361 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 113445us
I20260709 12:13:38.703097 22901 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 31 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:38.702392 22866 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:38.758805 13726 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:38.736936 22767 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:38.767422 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 33 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:38.735944 22754 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:38.769702 13829 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 32 FOLLOWER]: Advancing to term 33
W20260709 12:13:38.771112 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 65989.7us
W20260709 12:13:38.791673 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 67281.4us
I20260709 12:13:38.742274 22926 consensus_queue.cc:1048] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.053s
I20260709 12:13:38.780393 22754 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:38.774801 22519 raft_consensus.cc:2749] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:13:38.741937 22785 consensus_queue.cc:1059] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.050s
I20260709 12:13:38.764416 22421 raft_consensus.cc:2749] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:13:38.763988 22770 consensus_queue.cc:1048] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.256s
I20260709 12:13:38.876716 22743 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:38.757853 22963 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:38.741719 22781 consensus_queue.cc:1048] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.039s
I20260709 12:13:38.775436 22767 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:38.752626 22908 consensus_queue.cc:1048] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.124s
I20260709 12:13:38.780355 22744 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:38.915270 21893 raft_consensus.cc:2749] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:38.941556 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 30 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:38.914059 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:38.773384 22804 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:38.801054 22628 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:38.908174 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:38.897651 13727 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:38.927631 13686 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b"
dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
 from {username='slave'} at 127.0.0.1:48212
I20260709 12:13:38.948917 13686 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 12:13:38.949136 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 51603.7us
I20260709 12:13:38.768443 22518 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:38.935240 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:38.949308 13686 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:38.893517 22769 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260709 12:13:38.945264 13679 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 24.
I20260709 12:13:38.951334 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:13:38.958546 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 137856us
I20260709 12:13:38.963271 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:13:38.959903 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 180545us
I20260709 12:13:38.965034 13800 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:38.967252 21893 raft_consensus.cc:2804] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:13:38.967700 21893 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:38.968027 21893 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Advancing to term 31
W20260709 12:13:38.993387 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 238006us
I20260709 12:13:38.993952 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 33 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:38.964066 13651 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:38.969116 13727 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:38.903484 22710 consensus_queue.cc:1048] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.258s
I20260709 12:13:38.945732 22739 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:13:38.958957 22915 log.cc:927] Time spent T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.264s	user 0.000s	sys 0.001s
I20260709 12:13:38.956477 22769 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 32 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:38.901615 22914 consensus_queue.cc:237] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 26.13, Last appended by leader: 13, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:39.026592 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:39.027410 13685 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:39.020340 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:39.032624 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:13:39.051512 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 101327us
I20260709 12:13:38.946236 22804 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:39.027139 22769 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 32 FOLLOWER]: Advancing to term 33
W20260709 12:13:39.080993 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 116024us
I20260709 12:13:39.086863 13727 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:39.062896 22770 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.092162 22519 raft_consensus.cc:2804] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 12:13:39.082360 22892 consensus_meta.cc:287] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.545s	user 0.012s	sys 0.001s
W20260709 12:13:39.120375 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 156224us
I20260709 12:13:39.122346 13651 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:39.074930 22739 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.111037 22519 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:39.203693 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 149560us
I20260709 12:13:39.119966 22901 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 31 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:39.212796 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:13:39.213081 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 196559us
I20260709 12:13:39.225354 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:39.214506 14408 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 24.
I20260709 12:13:39.231417 13652 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:39.185200 22743 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.206599 22899 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.205178 22519 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:39.148175 22892 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:39.170907 22421 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.197708 22964 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:39.249568 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:39.249405 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:39.264421 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:39.260246 13830 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 23.
W20260709 12:13:39.225574 13762 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.012s	sys 0.019s
I20260709 12:13:39.261053 14408 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 25.
I20260709 12:13:39.198099 22710 consensus_queue.cc:1048] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.064s
I20260709 12:13:39.235020 22866 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:39.271181 14411 raft_consensus.cc:1275] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 16. (term mismatch)
I20260709 12:13:39.275417 14411 pending_rounds.cc:85] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f: Aborting all ops after (but not including) 15
I20260709 12:13:39.275760 14411 pending_rounds.cc:107] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f: Aborting uncommitted NO_OP operation due to leader change: 20.16
I20260709 12:13:39.276036 14411 raft_consensus.cc:2889] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:39.186134 22770 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:39.271057 13762 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.013s	sys 0.019s
I20260709 12:13:39.299607 13835 raft_consensus.cc:1275] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 12:13:39.299913 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 31 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:13:39.300998 22980 log.cc:927] Time spent T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:13:39.290410 22743 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:39.304865 22743 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:39.285758 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 203725us
I20260709 12:13:39.274744 22994 raft_consensus.cc:2804] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:39.318581 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:39.315619 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:39.312990 22991 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.331159 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:39.255785 22899 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:39.331849 22997 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:39.283149 23001 raft_consensus.cc:2749] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:39.269629 22739 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:39.352139 13830 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 21.
W20260709 12:13:39.331213 22969 log.cc:927] Time spent T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 12:13:39.355366 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:39.350641 22866 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.363338 22866 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:39.414134 22986 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:39.364892 14413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: true dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:39.366756 23000 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.368870 22996 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.373615 14380 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:39.305748 22743 raft_consensus.cc:2804] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260709 12:13:39.422475 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 48952.3us
I20260709 12:13:39.375466 22977 consensus_queue.cc:1048] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:13:39.377807 22972 raft_consensus.cc:2749] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:39.383234 22770 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:39.383494 22651 consensus_meta.cc:287] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.656s	user 0.011s	sys 0.004s
I20260709 12:13:39.388805 13685 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 26.
I20260709 12:13:39.311836 22764 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:39.395503 22899 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:39.396055 14411 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 25.
I20260709 12:13:39.397157 22804 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:39.342350 22518 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:39.398525 22983 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.399856 22995 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:39.416616 22970 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:39.402565 22976 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.402827 22964 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.404832 13687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 1832) took 1135 ms. Trace:
I20260709 12:13:39.321520 22994 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:39.295070 22421 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:39.416039 22892 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:39.320976 22926 consensus_queue.cc:1048] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.095s
I20260709 12:13:39.416484 13680 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 25.
I20260709 12:13:39.459146 22785 raft_consensus.cc:2804] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:39.459990 22984 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.312667 13800 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:39.331561 22991 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:39.419577 14413 raft_consensus.cc:3055] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 22 LEADER]: Stepping down as leader of term 22
W20260709 12:13:39.463317 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 273314us
I20260709 12:13:39.335026 22781 consensus_queue.cc:1048] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.076s
I20260709 12:13:39.423934 21893 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:39.425864 13801 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:39.403455 22923 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:39.436909 22651 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:39.434099 13829 consensus_meta.cc:287] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.638s	user 0.005s	sys 0.007s
I20260709 12:13:39.472635 13829 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 33.
I20260709 12:13:39.438030 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:39.474426 13836 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 25.
I20260709 12:13:39.439155 22982 raft_consensus.cc:2804] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:39.444890 13652 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:39.454494 22994 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:39.446573 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:39.407123 22997 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:39.342555 22744 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:39.419269 13681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 4051) took 1112 ms. Trace:
W20260709 12:13:39.462718 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 150131us
I20260709 12:13:39.419054 13686 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:39.418115 22986 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:39.451131 13687 rpcz_store.cc:276] 0709 12:13:38.269903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:38.270073 (+   170us) service_pool.cc:224] Handling call
0709 12:13:38.285025 (+ 14952us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:38.539783 (+254758us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 12:13:38.539822 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:38.539867 (+    45us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:13:38.539916 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:39.404565 (+864649us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b5400284bd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:39.404627 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:39.404769 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6425,"raft.queue_time_us":26582,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":8164,"spinlock_wait_cycles":474281728}
I20260709 12:13:39.464838 14413 raft_consensus.cc:740] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 22 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:39.424772 22743 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:39.433660 23000 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:39.475412 13651 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:39.439666 22996 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:39.481200 21893 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 31 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:39.489914 13837 raft_consensus.cc:1240] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 27. Current term is 28. Ops: []
I20260709 12:13:39.456125 22964 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:39.482259 13681 rpcz_store.cc:276] 0709 12:13:38.307158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:38.323337 (+ 16179us) service_pool.cc:224] Handling call
0709 12:13:38.339093 (+ 15756us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:38.380762 (+ 41669us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:38.380822 (+    60us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:38.428119 (+ 47297us) log.cc:844] Serialized 26 byte log entry
0709 12:13:38.630569 (+202450us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:13:38.630673 (+   104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:38.630809 (+   136us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:39.419050 (+788241us) raft_consensus.cc:1685] finished
0709 12:13:39.419069 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:39.419202 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4315,"raft.queue_time_us":13831,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":6348,"thread_start_us":190453,"threads_started":1,"wal-append.queue_time_us":851725}
I20260709 12:13:39.476423 22982 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:39.497100 13686 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:39.495239 13800 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:39.501421 23003 raft_consensus.cc:2804] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:39.501984 23003 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:39.502345 23003 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:39.482065 22926 raft_consensus.cc:2804] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:39.450258 22983 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:39.500538 13800 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:39.505191 13651 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:39.461943 22970 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:39.511605 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: true dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:39.512938 22997 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:39.480382 22923 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:39.489274 22743 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:39.516040 14414 raft_consensus.cc:3055] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:39.495434 22739 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:39.507586 22715 consensus_meta.cc:287] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.780s	user 0.013s	sys 0.001s
I20260709 12:13:39.518918 14414 raft_consensus.cc:740] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 24 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:39.470082 22976 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:39.503341 22982 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:39.514720 22926 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:39.472255 22995 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:39.526149 14412 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 25.
I20260709 12:13:39.536934 13726 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:39.542497 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:39.480794 22984 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:39.545190 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:39.563105 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:13:39.549872 22974 log.cc:927] Time spent T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
I20260709 12:13:39.550259 22990 raft_consensus.cc:2749] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:39.550860 22991 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:39.550730 23007 raft_consensus.cc:2804] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:39.552413 22970 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:39.552650 22976 leader_election.cc:290] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:39.553859 23006 raft_consensus.cc:2804] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:39.574944 23006 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:39.575498 23006 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:13:39.579588 14416 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41692 (request call id 1362) took 2366 ms (client timeout 1732 ms). Trace:
W20260709 12:13:39.580283 14416 rpcz_store.cc:269] 0709 12:13:37.213407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:37.214781 (+  1374us) service_pool.cc:224] Handling call
0709 12:13:39.579045 (+2364264us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54006b0dd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:39.579308 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2942736128}
I20260709 12:13:39.583271 22986 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:39.554560 14414 consensus_queue.cc:260] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:39.586262 14414 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:39.554509 22996 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:39.556775 23000 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:39.548028 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 31 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:39.548055 23008 raft_consensus.cc:2804] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:39.549103 22923 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:39.524022 22781 raft_consensus.cc:2804] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:39.594297 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:39.595283 13680 raft_consensus.cc:2393] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 24: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:39.595494 14379 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:13:39.553865 23005 log.cc:927] Time spent T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 12:13:39.558988 22952 log.cc:927] Time spent T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 1.229s	user 0.008s	sys 0.005s
I20260709 12:13:39.558885 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:39.560904 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:39.498553 22518 consensus_queue.cc:1048] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 12:13:39.561666 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:39.545455 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:39.638938 13685 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 24.
I20260709 12:13:39.523469 14413 consensus_queue.cc:260] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:39.640266 14413 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:13:39.562369 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 136647us
I20260709 12:13:39.556828 22995 leader_election.cc:290] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:39.545573 13834 raft_consensus.cc:2393] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 23: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:39.495009 22914 consensus_queue.cc:1048] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.032s
I20260709 12:13:39.543723 22866 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:39.571556 13679 raft_consensus.cc:1275] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 12:13:39.574241 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:39.543347 22926 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:39.590400 23008 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:39.592577 22651 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:39.660684 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:39.613463 21893 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:39.598249 14379 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:39.606894 13836 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 23.
I20260709 12:13:39.571265 23007 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:39.643226 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 556507us
I20260709 12:13:39.526911 22715 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:39.644927 13835 raft_consensus.cc:1240] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 24. Current term is 25. Ops: [24.13-24.13]
I20260709 12:13:39.650533 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:39.652351 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:39.579664 22983 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:39.688755 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:39.650327 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:39.650411 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:39.659260 14380 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:39.663352 13830 raft_consensus.cc:1275] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:13:39.593088 22981 raft_consensus.cc:2804] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader election won for term 26
W20260709 12:13:39.664812 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 66639.5us
I20260709 12:13:39.639535 23000 raft_consensus.cc:2804] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:39.685544 21893 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:39.686103 13727 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:39.689813 14408 raft_consensus.cc:2468] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 20.
I20260709 12:13:39.734627 13683 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 23.
W20260709 12:13:39.736479 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 50452.3us
I20260709 12:13:39.744047 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:13:39.746418 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 87207.8us
I20260709 12:13:39.654915 22914 consensus_queue.cc:1243] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer ca9fbbc2c0a94897897d502d42f3951f log is divergent from this leader: its last log entry 18.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 12:13:39.749943 21893 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:39.747340 13687 raft_consensus.cc:1240] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:39.751008 14416 raft_consensus.cc:2393] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 22: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:13:39.663257 23008 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:13:39.753480 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:39.755645 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:39.690359 22976 raft_consensus.cc:2804] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:39.744918 13833 raft_consensus.cc:2468] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 20.
W20260709 12:13:39.746280 22767 consensus_meta.cc:287] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.788s	user 0.009s	sys 0.005s
I20260709 12:13:39.760722 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:39.735496 23000 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:39.691080 23007 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:39.761566 13679 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 23.
I20260709 12:13:39.763787 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 33 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:39.741807 22985 raft_consensus.cc:2749] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:39.783730 23003 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:39.747784 22981 raft_consensus.cc:697] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:39.770303 23000 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:39.787313 22715 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:39.788141 23011 consensus_queue.cc:1048] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:13:39.789741 22976 raft_consensus.cc:697] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 25 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:39.790089 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:39.791131 14409 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 23.
I20260709 12:13:39.790946 22976 consensus_queue.cc:237] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 24.19, Last appended by leader: 19, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:39.779850 22964 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:39.769358 13836 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 32.
I20260709 12:13:39.761116 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:39.807047 14408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:13:39.810606 22961 log.cc:927] Time spent T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 1.076s	user 0.003s	sys 0.000s
I20260709 12:13:39.754668 22421 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:39.748240 22781 raft_consensus.cc:697] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 23 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:39.756431 22970 raft_consensus.cc:2804] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:39.817463 22970 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:39.805074 13761 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48120 (request call id 2931) took 1252 ms (client timeout 1594 ms). Trace:
I20260709 12:13:39.807798 13684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 2749) took 1757 ms. Trace:
I20260709 12:13:39.811733 13835 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 26.
I20260709 12:13:39.818732 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:39.819751 13836 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 24.
W20260709 12:13:39.818887 13761 rpcz_store.cc:269] 0709 12:13:38.552361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:38.552488 (+   127us) service_pool.cc:224] Handling call
0709 12:13:39.804775 (+1252287us) spinlock_profiling.cc:243] Waited 38.5 ms on lock 0x7b54001d2c54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:39.804985 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":88576256}
I20260709 12:13:39.814450 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:39.815052 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:39.815385 13727 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 33 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:39.805346 22984 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:39.821352 13687 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 21.
W20260709 12:13:39.793103 22769 consensus_meta.cc:287] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.683s	user 0.012s	sys 0.002s
I20260709 12:13:39.823020 21893 raft_consensus.cc:2804] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 33 FOLLOWER]: Leader election won for term 33
I20260709 12:13:39.819154 13684 rpcz_store.cc:276] 0709 12:13:38.050612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:38.058918 (+  8306us) service_pool.cc:224] Handling call
0709 12:13:38.073808 (+ 14890us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:38.445273 (+371465us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:39.807519 (+1362246us) spinlock_profiling.cc:243] Waited 362 ms on lock 0x7b5400271d54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:39.807736 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":833234816}
I20260709 12:13:39.835789 21893 raft_consensus.cc:697] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 33 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:39.827764 22981 consensus_queue.cc:237] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:39.834690 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:13:39.814364 22754 consensus_meta.cc:287] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.884s	user 0.013s	sys 0.000s
I20260709 12:13:39.844143 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:39.818048 22970 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:39.853535 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:39.856333 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:39.857836 22781 consensus_queue.cc:237] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:39.862674 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:39.866614 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 31 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:39.864378 13833 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 26.
I20260709 12:13:39.871696 13835 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Advancing to term 26
I20260709 12:13:39.871699 13836 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:39.768366 22767 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:39.875790 14413 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 23.
I20260709 12:13:39.881217 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:39.882182 13833 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:39.885308 21893 consensus_queue.cc:237] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 30.16, Last appended by leader: 16, Current term: 33, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:39.890518 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 29 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:39.841090 22769 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 33 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:39.895293 22769 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 33 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:39.896584 22785 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:39.897200 22785 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:39.908943 14379 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:39.836838 22743 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:39.913882 13686 raft_consensus.cc:2410] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for term 29 because replica has last-logged OpId of term: 27 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 17.
I20260709 12:13:39.876474 22988 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:39.919342 14379 leader_election.cc:304] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:39.887737 23003 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:39.843557 22754 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:39.890419 22984 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.934782 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:39.940470 14414 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 25.
I20260709 12:13:39.956284 13828 raft_consensus.cc:2393] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 25: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:39.926837 22991 raft_consensus.cc:2804] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 12:13:39.965080 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 102232us
I20260709 12:13:39.936362 22710 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.966881 22991 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:39.982628 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:39.983824 13758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 1563) took 1530 ms. Trace:
I20260709 12:13:39.983917 22765 raft_consensus.cc:2804] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 12:13:39.986059 23014 log.cc:927] Time spent T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
W20260709 12:13:39.986522 23012 log.cc:927] Time spent T 00000000000000000000000000000000 P 17d79eae88f84be7a847d0cf544674cd: Append to log took a long time: real 0.102s	user 0.002s	sys 0.000s
I20260709 12:13:39.996670 23007 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:39.974551 22715 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.998961 22507 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:40.004794 13828 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 24.
I20260709 12:13:40.011198 13833 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 24.
I20260709 12:13:40.013116 13835 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 26.
I20260709 12:13:39.955706 22988 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:40.008057 22991 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:40.005090 13758 rpcz_store.cc:276] 0709 12:13:38.355911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:38.356111 (+   200us) service_pool.cc:224] Handling call
0709 12:13:38.359697 (+  3586us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:38.382544 (+ 22847us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:38.382577 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:38.391186 (+  8609us) log.cc:844] Serialized 26 byte log entry
0709 12:13:38.602000 (+210814us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:13:38.602059 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:38.602159 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:39.809805 (+1207646us) spinlock_profiling.cc:243] Waited 2.38 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:13:39.875637 (+ 65832us) raft_consensus.cc:1685] finished
0709 12:13:39.875658 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:39.886024 (+ 10366us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3922,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":81,"spinlock_wait_cycles":5473152,"thread_start_us":173056,"threads_started":1,"wal-append.queue_time_us":230759}
I20260709 12:13:40.020783 13762 raft_consensus.cc:1275] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 12:13:39.966554 22984 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:40.022082 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:13:40.004518 22994 consensus_meta.cc:287] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.505s	user 0.011s	sys 0.000s
I20260709 12:13:40.007608 22765 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:40.033071 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:40.033869 13759 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 24.
I20260709 12:13:40.034173 13760 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 26.
I20260709 12:13:40.035614 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:40.036845 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:40.037824 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:40.036379 13761 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 28.
I20260709 12:13:40.040359 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:40.041059 13754 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 24.
I20260709 12:13:40.041256 13755 raft_consensus.cc:2393] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 25: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:40.015759 23025 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.030654 22982 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:40.019222 22744 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:40.052459 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 33 candidate_status { last_received { term: 31 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:40.053093 13828 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:13:39.979817 22710 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:40.047813 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:40.031406 22507 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:40.035645 22765 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:40.057415 13760 raft_consensus.cc:2393] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 23: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:40.017948 22715 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:40.059880 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 33 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:40.039420 22994 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:40.033164 23022 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:40.068156 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:13:40.070106 23019 log.cc:927] Time spent T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
W20260709 12:13:40.071009 23020 log.cc:927] Time spent T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:13:40.062536 22507 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:40.077889 13759 raft_consensus.cc:2393] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 26: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:40.065454 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 31 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:40.079149 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: true dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:40.080005 13755 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:40.081517 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 29 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:40.084584 14379 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:40.086055 22715 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:40.087319 22963 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:40.084527 22982 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:40.091991 22754 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:40.093538 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:40.094105 22710 leader_election.cc:290] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:40.094275 13759 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 22.
I20260709 12:13:40.095357 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:40.095729 22988 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:40.096990 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:40.096886 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:40.097666 13763 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 22.
I20260709 12:13:40.099112 13763 raft_consensus.cc:1240] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 33 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 32. Current term is 33. Ops: [32.17-32.17]
I20260709 12:13:40.099745 13757 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 24.
I20260709 12:13:40.100596 22926 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:40.101483 14379 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 31 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:40.101922 14407 raft_consensus.cc:1240] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 21. Current term is 22. Ops: [19.15-21.16]
I20260709 12:13:40.103467 22982 raft_consensus.cc:2749] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 31 FOLLOWER]: Leader election lost for term 31. Reason: could not achieve majority
I20260709 12:13:40.108814 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: true dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:13:40.110041 22519 consensus_meta.cc:287] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.836s	user 0.006s	sys 0.008s
I20260709 12:13:40.110677 22908 raft_consensus.cc:3055] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:40.110517 22519 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:40.064397 22767 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:40.112578 13836 raft_consensus.cc:2468] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 31.
I20260709 12:13:40.113588 13755 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 23.
I20260709 12:13:40.109478 13759 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:40.112197 13828 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 33.
I20260709 12:13:40.067981 22744 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:40.111250 22908 raft_consensus.cc:740] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:40.120299 13828 raft_consensus.cc:1240] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 33 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 32. Current term is 33. Ops: [32.17-32.17]
I20260709 12:13:40.049999 23025 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:40.118204 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:40.082002 22743 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:40.122104 13682 raft_consensus.cc:1240] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:40.122917 13834 raft_consensus.cc:1240] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 24. Current term is 25. Ops: [24.13-24.13]
I20260709 12:13:40.124276 13836 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 28.
I20260709 12:13:40.128681 13834 raft_consensus.cc:1240] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 31 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 30. Current term is 31. Ops: [30.18-30.18]
I20260709 12:13:40.111841 22988 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:40.131767 13763 raft_consensus.cc:1240] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 24. Current term is 25. Ops: [24.13-24.13]
I20260709 12:13:40.136416 13836 raft_consensus.cc:1275] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 28 index: 16. (index mismatch)
I20260709 12:13:40.139972 13834 raft_consensus.cc:1275] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 12:13:40.140829 13836 raft_consensus.cc:1275] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:13:40.130599 22785 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:40.145185 13760 raft_consensus.cc:2410] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for term 29 because replica has last-logged OpId of term: 27 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 17.
I20260709 12:13:40.145385 22785 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:40.146471 23025 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:40.141710 22988 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:40.150561 22984 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:40.152393 22988 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:40.152207 23008 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:40.082093 23022 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:40.153875 13755 raft_consensus.cc:1275] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 28 index: 16. (index mismatch)
I20260709 12:13:40.155314 13755 raft_consensus.cc:1240] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:40.155831 23022 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:13:40.139500 23006 consensus_meta.cc:287] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.563s	user 0.014s	sys 0.000s
I20260709 12:13:40.156558 13755 raft_consensus.cc:1240] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:40.156836 23006 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:40.158969 13832 raft_consensus.cc:1240] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:40.159216 23006 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:40.160463 23007 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:40.163252 13759 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 25.
I20260709 12:13:40.080379 23000 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:40.168517 13755 raft_consensus.cc:1240] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 30. Current term is 31. Ops: [30.18-30.18]
I20260709 12:13:40.126313 22507 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:40.171718 13828 raft_consensus.cc:1240] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 25. Current term is 26. Ops: [25.17-25.17]
I20260709 12:13:40.186271 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:40.190904 22908 consensus_queue.cc:260] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:40.192536 22908 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:40.194540 22994 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:40.197541 22976 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:40.198590 14411 raft_consensus.cc:1240] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 31 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 30. Current term is 31. Ops: [30.20-30.20]
I20260709 12:13:40.198241 22976 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:40.199177 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:40.199997 14414 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:40.200647 22976 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:40.198385 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:40.186291 13681 pending_rounds.cc:85] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 16
I20260709 12:13:40.207302 13681 pending_rounds.cc:107] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 18.17
I20260709 12:13:40.207656 13681 raft_consensus.cc:2889] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:40.219835 13837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 4231) took 1450 ms. Trace:
I20260709 12:13:40.220351 13837 rpcz_store.cc:276] 0709 12:13:38.751285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:38.751407 (+   122us) service_pool.cc:224] Handling call
0709 12:13:38.768606 (+ 17199us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:39.498340 (+729734us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:40.201510 (+703170us) spinlock_profiling.cc:243] Waited 720 ms on lock 0x7b5400362c54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:40.201688 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1656620416}
I20260709 12:13:40.219619 22987 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:40.229831 22988 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:40.230476 22988 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:40.229575 22987 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:40.231891 22970 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:40.233001 22988 leader_election.cc:290] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:40.233078 22987 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:40.233348 14412 raft_consensus.cc:2368] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 25. Current term is 26.
I20260709 12:13:40.238505 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:40.226915 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:40.242921 14407 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 25.
I20260709 12:13:40.250345 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:40.252470 14414 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 24.
I20260709 12:13:40.227203 23025 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:40.260311 13837 raft_consensus.cc:1240] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 28. Current term is 29. Ops: []
I20260709 12:13:40.267730 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:40.268584 13755 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Advancing to term 26
I20260709 12:13:40.273036 23008 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:40.267899 23025 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:40.322244 22991 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:40.325764 22991 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 24 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:40.325947 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:40.326732 13682 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:40.328230 13688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 1834) took 1969 ms. Trace:
I20260709 12:13:40.328663 13688 rpcz_store.cc:276] 0709 12:13:38.358931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:38.367512 (+  8581us) service_pool.cc:224] Handling call
0709 12:13:38.373638 (+  6126us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:38.614317 (+240679us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:40.328002 (+1713685us) spinlock_profiling.cc:243] Waited 231 ms on lock 0x7b540031e7d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:40.328166 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":530405120}
I20260709 12:13:40.329870 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:40.330693 13685 raft_consensus.cc:2393] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 25: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:40.331496 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:40.331820 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:40.332114 13757 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:40.333024 13829 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 23.
I20260709 12:13:40.310287 22970 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:40.313625 23000 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:40.318118 22519 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:40.336550 23032 log.cc:927] Time spent T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:13:40.342483 13755 raft_consensus.cc:2468] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 26.
I20260709 12:13:40.309252 22765 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:40.346781 14379 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:40.348330 22744 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:40.340014 22963 raft_consensus.cc:2749] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:40.353971 13757 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 25.
I20260709 12:13:40.349910 22926 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:40.354677 23000 raft_consensus.cc:2804] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Leader election won for term 26
W20260709 12:13:40.364220 22962 log.cc:927] Time spent T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 1.033s	user 0.003s	sys 0.000s
I20260709 12:13:40.360482 23025 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:40.359262 23000 raft_consensus.cc:697] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 26 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:40.370023 23000 consensus_queue.cc:237] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 24.19, Last appended by leader: 19, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:40.371433 22765 leader_election.cc:290] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 23 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:40.373739 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:40.373993 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:40.374693 13680 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Advancing to term 23
I20260709 12:13:40.374780 13757 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:40.383038 13757 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 23.
I20260709 12:13:40.384487 14379 leader_election.cc:304] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:40.385669 22765 raft_consensus.cc:2804] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:40.386662 22765 raft_consensus.cc:697] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 23 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:40.389468 13682 raft_consensus.cc:2468] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 24.
I20260709 12:13:40.388618 22765 consensus_queue.cc:237] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:40.511636 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:40.523094 13761 raft_consensus.cc:2376] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 26. Re-sending same reply.
I20260709 12:13:40.517242 22985 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.523758 22518 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:40.523864 22985 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:40.524452 22518 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:40.526211 22990 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:40.526319 22985 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:40.526834 22990 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:40.528124 22518 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:13:40.519670 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 736624us
W20260709 12:13:40.501889 22868 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.999s	user 0.009s	sys 0.003s
W20260709 12:13:40.534322 22868 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.032s	user 0.010s	sys 0.003s
W20260709 12:13:40.507020 14380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:40.535974 13800 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:40.535966 22990 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:40.537374 22628 raft_consensus.cc:2749] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:13:40.537763 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:40.538028 13801 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:40.516180 13754 raft_consensus.cc:1240] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:40.538699 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:40.539448 13837 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:40.539443 13800 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:40.536213 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:40.541234 13760 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:40.543107 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 26 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:40.543870 13763 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 27.
I20260709 12:13:40.545360 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:40.546468 13756 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:13:40.546589 13788 heartbeater.cc:646] Failed to heartbeat to 127.12.56.254:40645 (7 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.12.56.254:40645 timed out after 15.000s (SENT)
W20260709 12:13:40.547482 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:40.550776 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:40.551497 22628 raft_consensus.cc:2804] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:40.551621 13757 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:40.552341 22628 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:40.552840 22628 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:40.558347 22518 raft_consensus.cc:2749] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:13:40.561746 13800 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:40.564102 22518 raft_consensus.cc:2749] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:40.560446 13801 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:40.576117 22518 raft_consensus.cc:2804] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:40.577737 22518 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:40.579202 22518 raft_consensus.cc:3060] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:40.539469 13680 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 23.
I20260709 12:13:40.588510 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:40.600515 22989 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:40.598582 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 82973.2us
I20260709 12:13:40.634886 13652 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:40.575279 13801 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:13:40.638139 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 63056.4us
I20260709 12:13:40.638237 23006 raft_consensus.cc:2804] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:40.639189 13801 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:40.640129 22887 raft_consensus.cc:2804] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:40.640553 22887 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:40.640945 22887 raft_consensus.cc:3060] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:40.540673 22983 consensus_queue.cc:1048] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 12:13:40.641371 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:40.641713 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:40.561916 13726 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:13:40.642877 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 81539.7us
I20260709 12:13:40.643074 22985 raft_consensus.cc:2804] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:40.594650 13727 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:40.643628 22985 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:40.644088 22985 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:40.627385 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:40.645427 14416 raft_consensus.cc:2393] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 25: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:13:40.628115 22972 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:40.646613 22972 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:40.637385 13757 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 26.
I20260709 12:13:40.648303 22519 raft_consensus.cc:2804] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:40.648823 22519 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:40.649168 22519 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Advancing to term 27
W20260709 12:13:40.645962 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 52206us
I20260709 12:13:40.653036 13837 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 22.
I20260709 12:13:40.650867 23006 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:40.657838 23006 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:40.657405 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:40.659104 13757 raft_consensus.cc:2393] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 25: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
W20260709 12:13:40.660734 22770 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.851s	user 0.008s	sys 0.008s
W20260709 12:13:40.662362 22770 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.853s	user 0.008s	sys 0.008s
I20260709 12:13:40.662971 22990 consensus_queue.cc:1048] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.013s
I20260709 12:13:40.652699 13727 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:40.670011 23025 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.670307 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:40.671833 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:40.673312 13837 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Advancing to term 25
I20260709 12:13:40.668568 13652 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:40.679436 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:40.679876 13686 raft_consensus.cc:1240] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:40.631688 22989 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:40.683890 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:40.680389 13727 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:40.670616 22892 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:40.686143 14380 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:40.689076 14380 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:13:40.692235 14380 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:13:40.686913 22509 raft_consensus.cc:2804] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Leader election won for term 31
I20260709 12:13:40.675390 22908 raft_consensus.cc:2804] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:40.697595 14379 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:40.686918 22971 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:40.702239 22509 raft_consensus.cc:697] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:40.702543 13727 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 33 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:40.702484 22971 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:40.685556 22868 raft_consensus.cc:2804] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:40.703680 13727 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:40.694317 22096 raft_consensus.cc:2804] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:40.719475 14380 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:40.679738 23025 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:40.723551 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 89478us
I20260709 12:13:40.725099 22096 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:40.725584 22096 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:40.725651 23025 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:40.691256 22892 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:40.726649 22972 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:40.727389 22972 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:40.727939 22972 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:40.730312 22887 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:40.732905 22887 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:40.734551 13831 raft_consensus.cc:2393] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 26: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:40.734349 22990 consensus_queue.cc:1059] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 25.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:13:40.735473 22990 raft_consensus.cc:3055] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:13:40.735888 22990 raft_consensus.cc:740] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:40.736843 22990 consensus_queue.cc:260] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.13, Last appended by leader: 13, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:40.692495 22628 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:40.737531 13837 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 25.
I20260709 12:13:40.751482 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:40.752249 13756 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 26.
I20260709 12:13:40.693701 22781 raft_consensus.cc:2804] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:40.698675 22970 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260709 12:13:40.698534 22976 raft_consensus.cc:2804] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:40.752270 13763 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 23.
I20260709 12:13:40.753594 13757 raft_consensus.cc:1240] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:40.762259 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:40.764145 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:40.769857 13756 raft_consensus.cc:2393] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 25: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:40.765090 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 26 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:40.771063 13754 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 27.
I20260709 12:13:40.721355 22988 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 33 FOLLOWER]: Leader election won for term 33
I20260709 12:13:40.772778 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:40.703338 22509 consensus_queue.cc:237] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 28.17, Last appended by leader: 17, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:40.769131 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:40.723582 22982 raft_consensus.cc:2804] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:40.753562 22926 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 31 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:40.698468 22994 consensus_queue.cc:1059] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.070s
I20260709 12:13:40.753810 22868 raft_consensus.cc:697] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:40.733600 22887 consensus_queue.cc:1059] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 24.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.040s
I20260709 12:13:40.773406 22765 raft_consensus.cc:2749] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:40.759694 22507 raft_consensus.cc:2804] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:40.821317 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 29 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:40.773593 22781 raft_consensus.cc:697] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 25 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:40.816692 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 29 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:40.768277 22970 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 32 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:13:40.774458 13800 connection.cc:256] RPC call timeout handler was delayed by -1.0642817670000113s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15940000000000001s for a response
I20260709 12:13:40.774803 22976 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:40.818753 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:40.821734 22518 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:40.763702 23022 consensus_queue.cc:1059] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 27.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.052s
I20260709 12:13:40.812537 13760 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 21.
I20260709 12:13:40.789664 22964 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
W20260709 12:13:40.827533 13800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:40.774324 22743 consensus_queue.cc:1059] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 28.16, Next index: 17, Last known committed idx: 14, Time since last communication: 0.050s
I20260709 12:13:40.817658 22982 raft_consensus.cc:697] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 24 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:40.832348 13755 raft_consensus.cc:1240] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 20. Current term is 21. Ops: [20.10-20.10]
I20260709 12:13:40.796416 22990 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:40.823167 22507 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:40.791486 22988 raft_consensus.cc:697] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 33 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:40.817597 22892 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:40.844825 13800 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:40.830528 22994 consensus_queue.cc:1243] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer ca9fbbc2c0a94897897d502d42f3951f log is divergent from this leader: its last log entry 18.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 12:13:40.829509 22970 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:13:40.831574 22976 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:40.847755 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:40.816521 22868 consensus_queue.cc:237] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:40.843789 23025 raft_consensus.cc:3055] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:13:40.855358 13800 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
W20260709 12:13:40.861498 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 141153us
I20260709 12:13:40.855218 13830 raft_consensus.cc:2393] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 24: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:40.855747 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:40.818287 22926 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:40.847012 22744 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.811637 22971 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:40.857815 23008 raft_consensus.cc:2749] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:13:40.867388 22628 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:40.867311 22744 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:40.868320 22988 consensus_queue.cc:237] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 31.15, Last appended by leader: 15, Current term: 33, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:40.844018 22964 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:40.850966 22983 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:40.847708 22507 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:40.877616 13800 leader_election.cc:400] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 25. Current term is 26.
I20260709 12:13:40.889501 13800 leader_election.cc:403] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:40.892284 13800 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:40.878976 22989 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:40.880419 14379 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:40.904469 13800 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:40.905993 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:40.861740 23025 raft_consensus.cc:740] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:40.880352 22892 raft_consensus.cc:2804] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:40.880200 22994 raft_consensus.cc:3055] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:40.913159 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 26 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:40.913944 13682 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 27.
I20260709 12:13:40.914299 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 33 candidate_status { last_received { term: 31 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:40.914925 13681 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 31 FOLLOWER]: Advancing to term 33
I20260709 12:13:40.914104 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:40.915392 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:40.916137 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:40.916426 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:40.916508 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:40.918440 13800 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:40.919251 13800 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:40.917117 13684 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 23.
I20260709 12:13:40.907332 22421 raft_consensus.cc:2749] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election lost for term 25. Reason: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 25. Current term is 26.
I20260709 12:13:40.921959 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:40.877050 23000 consensus_queue.cc:1059] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.034s
I20260709 12:13:40.925534 13685 raft_consensus.cc:2393] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 23: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:13:40.911127 22754 raft_consensus.cc:2804] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:40.911010 23008 raft_consensus.cc:2804] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:40.911652 22892 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:40.895213 22983 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:40.940021 22983 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:40.946926 22964 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:40.906668 22887 consensus_queue.cc:1048] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.020s
I20260709 12:13:40.944307 13681 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 33.
I20260709 12:13:40.922711 22628 raft_consensus.cc:2804] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:40.937510 23003 raft_consensus.cc:2804] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:40.938140 22989 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:40.913257 22994 raft_consensus.cc:740] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:40.922310 22765 raft_consensus.cc:2749] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:41.001344 22518 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:40.934966 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 29 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:40.976249 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:41.006733 13681 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 26.
I20260709 12:13:40.930812 22754 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:41.007882 22754 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:40.906533 22781 consensus_queue.cc:237] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:41.014546 23047 log.cc:927] Time spent T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 12:13:41.014989 22994 consensus_queue.cc:260] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:41.016057 22744 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:41.016561 22994 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:41.018906 22926 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:41.019126 23022 raft_consensus.cc:3055] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 LEADER]: Stepping down as leader of term 28
I20260709 12:13:41.019773 23022 raft_consensus.cc:740] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:40.974202 23008 raft_consensus.cc:697] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 24 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:41.022730 23008 consensus_queue.cc:237] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:41.025211 23001 raft_consensus.cc:3055] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:41.025831 23001 raft_consensus.cc:740] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
W20260709 12:13:41.026232 23044 log.cc:927] Time spent T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260709 12:13:41.026012 22989 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:41.028462 22989 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:13:40.979532 23045 log.cc:927] Time spent T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 12:13:41.030179 13834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 4242) took 1182 ms. Trace:
I20260709 12:13:41.030552 13834 rpcz_store.cc:276] 0709 12:13:39.848220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:40.180792 (+332572us) service_pool.cc:224] Handling call
0709 12:13:40.181551 (+   759us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:40.526476 (+344925us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:40.526506 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:40.527270 (+   764us) log.cc:844] Serialized 26 byte log entry
0709 12:13:40.617442 (+ 90172us) raft_consensus.cc:1645] Marking committed up to 18
0709 12:13:40.617521 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:40.617677 (+   156us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:41.029948 (+412271us) raft_consensus.cc:1685] finished
0709 12:13:41.029968 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:41.030115 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":344043,"raft.queue_time_us":345933,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":86,"spinlock_wait_cycles":58112,"thread_start_us":89592,"threads_started":1,"wal-append.queue_time_us":318159}
I20260709 12:13:41.000103 23003 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:41.032778 23003 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:41.027005 23001 consensus_queue.cc:260] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 26.19, Last appended by leader: 19, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:40.925206 22982 consensus_queue.cc:237] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:40.998116 22985 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:41.039057 23001 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:41.040478 22985 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:41.031330 22970 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 33 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:40.927484 22096 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:41.037889 23006 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:41.043692 22096 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 21 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:41.043804 23006 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:40.933581 22519 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:41.020823 23022 consensus_queue.cc:260] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 28.16, Last appended by leader: 16, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:41.046370 13684 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 27.
I20260709 12:13:41.001163 23025 consensus_queue.cc:260] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 27.15, Last appended by leader: 15, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:40.935642 22892 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:40.953577 22972 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:40.997576 22628 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:41.009057 22976 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:41.082952 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 31 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:13:41.094362 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 375035us
I20260709 12:13:41.096022 14380 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:41.097726 14380 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:41.106884 14380 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:41.112414 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:41.060288 22970 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 33 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:41.117704 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:13:41.117211 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 194290us
I20260709 12:13:41.127106 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:41.128350 13836 raft_consensus.cc:1275] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 24 index: 19. Preceding OpId from leader: term: 26 index: 20. (index mismatch)
I20260709 12:13:41.131757 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:41.135401 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:41.135916 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:41.136718 13836 raft_consensus.cc:2393] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 21: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:41.137748 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:41.088778 22628 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:41.084144 22519 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:41.143972 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:41.094069 22908 raft_consensus.cc:697] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 23 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:41.146060 14412 raft_consensus.cc:2393] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 21: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:13:41.146366 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:41.147975 13685 raft_consensus.cc:2393] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 26: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:41.150593 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:13:41.148258 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 229048us
I20260709 12:13:41.152240 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:41.152781 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 33 candidate_status { last_received { term: 32 index: 19 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:41.117978 22765 raft_consensus.cc:2749] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:41.126528 22096 raft_consensus.cc:2804] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:41.118078 22972 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:41.155807 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:41.155993 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 33 candidate_status { last_received { term: 32 index: 19 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:41.133159 22991 raft_consensus.cc:2804] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:41.159030 13679 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 26.
I20260709 12:13:41.136445 23025 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:41.158484 13687 raft_consensus.cc:2393] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 27: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:41.162580 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 26 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:41.163369 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:41.163499 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:41.164669 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:41.165444 13833 raft_consensus.cc:2393] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 25: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:13:41.166358 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:41.166442 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:41.167232 13758 raft_consensus.cc:2393] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 26: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:13:41.169227 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:41.170109 13762 raft_consensus.cc:2393] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 26: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:41.171263 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:41.172201 13759 raft_consensus.cc:2393] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 27: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:41.177166 13832 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 26.
I20260709 12:13:41.131880 22507 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:41.184579 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 325446us
I20260709 12:13:41.187000 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:41.187175 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:41.188364 14416 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:41.158849 22992 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:41.159087 22990 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:41.190733 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:41.192616 13832 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 24.
I20260709 12:13:41.200894 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:41.202534 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 32 candidate_status { last_received { term: 31 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:41.202695 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:41.204612 13685 raft_consensus.cc:3055] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 32 LEADER]: Stepping down as leader of term 32
I20260709 12:13:41.205106 13685 raft_consensus.cc:740] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 32 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:41.207156 13831 raft_consensus.cc:2368] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 33 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 32. Current term is 33.
I20260709 12:13:41.209534 22992 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:41.158279 22970 consensus_queue.cc:1059] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.032s
I20260709 12:13:41.178303 22822 consensus_queue.cc:1059] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 12:13:41.178864 22972 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:41.215706 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:13:41.228816 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 49870.6us
W20260709 12:13:41.214416 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 458026us
I20260709 12:13:41.232457 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:41.233606 13688 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 21.
W20260709 12:13:41.239005 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:41.204792 23052 consensus_queue.cc:1048] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.036s
I20260709 12:13:41.263437 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:41.264813 13828 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:13:41.240099 23050 log.cc:927] Time spent T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:13:41.260246 13652 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:41.219468 13685 consensus_queue.cc:260] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 32.17, Last appended by leader: 17, Current term: 32, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:41.201294 22990 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:41.266351 14416 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 27.
I20260709 12:13:41.266543 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 26 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:41.374255 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:41.372486 22887 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:41.455125 13801 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:41.380265 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:41.375622 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:41.456468 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:13:41.381343 23056 log.cc:927] Time spent T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
I20260709 12:13:41.388845 23022 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:41.391582 22963 raft_consensus.cc:3055] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:13:41.210539 22908 consensus_queue.cc:237] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:41.399880 22754 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:41.401083 13800 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:41.403386 22507 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 29 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:41.404737 22992 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:41.407953 22976 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:41.408027 23003 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:41.410538 22972 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:41.411865 23055 log.cc:927] Time spent T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
I20260709 12:13:41.258816 13651 leader_election.cc:304] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:13:41.450412 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 190224us
I20260709 12:13:41.462510 13828 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 26.
I20260709 12:13:41.265978 23060 raft_consensus.cc:3055] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:13:41.480549 13685 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:13:41.556195 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:41.511071 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:13:41.549120 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 148179us
I20260709 12:13:41.557966 13829 raft_consensus.cc:2393] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 23: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:41.550557 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:41.256703 22892 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:41.378933 23006 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:41.453497 22926 raft_consensus.cc:2804] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:41.267581 22989 consensus_queue.cc:1059] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 23.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.225s
I20260709 12:13:41.479089 22518 raft_consensus.cc:2804] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader election won for term 27
W20260709 12:13:41.565030 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 306160us
I20260709 12:13:41.560995 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:13:41.573120 23067 log.cc:927] Time spent T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.204s	user 0.000s	sys 0.000s
I20260709 12:13:41.560408 23060 raft_consensus.cc:740] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:41.577186 14416 raft_consensus.cc:1240] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:41.566215 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:41.473196 22963 raft_consensus.cc:740] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 25 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:41.478328 22096 raft_consensus.cc:697] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 22 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
W20260709 12:13:41.572275 23061 log.cc:927] Time spent T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:13:41.582429 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:41.585827 13828 raft_consensus.cc:2393] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 25: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:41.583709 13754 raft_consensus.cc:1275] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:13:41.586225 13836 raft_consensus.cc:1240] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 27. Current term is 28. Ops: []
I20260709 12:13:41.583241 13685 raft_consensus.cc:1275] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 33 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 32 index: 17. Preceding OpId from leader: term: 33 index: 17. (term mismatch)
I20260709 12:13:41.586601 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:41.586836 13685 pending_rounds.cc:85] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 16
I20260709 12:13:41.587229 13685 pending_rounds.cc:107] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 32.17
I20260709 12:13:41.587427 13829 raft_consensus.cc:2393] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 25: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:41.587518 13685 raft_consensus.cc:2889] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 33 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:41.585361 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 31 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:41.588651 13830 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 30.
I20260709 12:13:41.560375 22983 raft_consensus.cc:2749] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:13:41.592453 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:41.600365 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:41.564694 22926 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:41.593407 14379 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:41.574009 23053 consensus_queue.cc:1059] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 28.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.006s
I20260709 12:13:41.472690 22887 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:41.568544 23057 raft_consensus.cc:2764] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 12:13:41.604079 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:41.606006 13762 raft_consensus.cc:2368] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for earlier term 26. Current term is 27.
I20260709 12:13:41.606567 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 29 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:41.607249 14407 raft_consensus.cc:2393] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 28: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:13:41.618430 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:41.627933 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:41.630056 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:41.570205 22972 consensus_queue.cc:1059] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 12:13:41.640609 13830 raft_consensus.cc:2393] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 26: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
W20260709 12:13:41.644296 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 51010.6us
I20260709 12:13:41.645354 14379 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 33 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:41.610572 22926 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:41.579691 23006 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:41.585717 23049 consensus_queue.cc:1048] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.053s
I20260709 12:13:41.656790 14379 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:41.654312 13829 raft_consensus.cc:1275] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 12:13:41.589849 22781 consensus_queue.cc:1048] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.052s
I20260709 12:13:41.670250 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:41.670740 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:41.674036 22898 raft_consensus.cc:2749] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 33 FOLLOWER]: Leader election lost for term 33. Reason: could not achieve majority
I20260709 12:13:41.674557 22754 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:41.574314 23060 consensus_queue.cc:260] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:41.676083 22963 consensus_queue.cc:260] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 25.20, Last appended by leader: 20, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:41.676874 22892 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:13:41.677423 22994 consensus_meta.cc:287] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.660s	user 0.014s	sys 0.000s
I20260709 12:13:41.678859 22990 leader_election.cc:290] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:41.657732 23064 raft_consensus.cc:2749] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 12:13:41.656749 23001 consensus_meta.cc:287] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.615s	user 0.012s	sys 0.000s
I20260709 12:13:41.628392 22991 raft_consensus.cc:697] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 25 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:41.680137 13685 raft_consensus.cc:1275] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:13:41.681996 22997 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:41.682204 22887 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:41.684386 22096 consensus_queue.cc:237] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:41.670143 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:41.694577 14412 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 23.
I20260709 12:13:41.695091 14416 raft_consensus.cc:2393] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 27: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:41.707801 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:41.709197 13834 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 27.
I20260709 12:13:41.696142 23052 raft_consensus.cc:2749] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 12:13:41.717152 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 150446us
I20260709 12:13:41.717579 14409 raft_consensus.cc:1240] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 22. Current term is 23. Ops: []
W20260709 12:13:41.710877 13726 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.546s (SENT) [suppressed 7 similar messages]
I20260709 12:13:41.756165 13727 leader_election.cc:400] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 25. Current term is 26.
I20260709 12:13:41.756779 13727 leader_election.cc:403] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:13:41.797441 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 79345.2us
I20260709 12:13:41.811568 13835 raft_consensus.cc:1275] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 33 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 30 index: 16. Preceding OpId from leader: term: 33 index: 17. (index mismatch)
W20260709 12:13:41.812109 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 56163.3us
I20260709 12:13:41.841602 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:13:41.866381 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 290602us
I20260709 12:13:41.826388 23003 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:41.841487 22988 raft_consensus.cc:2749] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election lost for term 25. Reason: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 25. Current term is 26.
I20260709 12:13:41.810307 22773 raft_consensus.cc:476] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 23 LEADER]: Not starting pre-election -- already a leader
I20260709 12:13:41.714401 22994 consensus_queue.cc:1048] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.150s
I20260709 12:13:41.710407 23051 consensus_queue.cc:1059] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 29.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.155s
I20260709 12:13:41.868266 23001 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:41.882246 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:41.715703 22997 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:41.887975 14407 raft_consensus.cc:1275] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
W20260709 12:13:41.881106 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 170268us
I20260709 12:13:41.873248 22887 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:41.894634 22887 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:41.897181 22887 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:41.898852 13727 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:41.899394 22997 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:41.900091 23006 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:41.900014 22926 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:41.900557 13727 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:41.911476 13727 leader_election.cc:304] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:41.888139 23077 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:41.908851 22628 consensus_meta.cc:287] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.725s	user 0.011s	sys 0.001s
W20260709 12:13:41.920665 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:41.890930 22518 raft_consensus.cc:697] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 27 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:41.900009 22997 raft_consensus.cc:2804] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:41.918514 22988 raft_consensus.cc:2749] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 12:13:41.921141 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 96522.8us
I20260709 12:13:41.917550 13727 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:41.931874 23025 raft_consensus.cc:2804] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:41.925570 13687 raft_consensus.cc:2393] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 25: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:41.923394 23051 raft_consensus.cc:2804] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:13:41.890236 23079 consensus_queue.cc:1059] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.040s
I20260709 12:13:41.910148 22972 consensus_queue.cc:1059] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 24.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.022s
I20260709 12:13:41.901451 23001 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:41.934295 13652 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:13:41.939883 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 53881.3us
I20260709 12:13:41.927323 23077 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:41.952521 23001 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:41.952684 23077 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:13:41.954268 23075 log.cc:927] Time spent T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 12:13:41.955226 22770 consensus_queue.cc:1048] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:13:41.946704 23087 consensus_queue.cc:1059] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.013s
I20260709 12:13:41.934872 23025 raft_consensus.cc:697] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:41.936825 23051 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:42.086349 23051 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:42.110601 13686 raft_consensus.cc:1275] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
W20260709 12:13:42.038177 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 108229us
I20260709 12:13:41.947046 23053 consensus_queue.cc:1059] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.170s
I20260709 12:13:42.115767 13652 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:13:42.062691 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 120633us
I20260709 12:13:42.066498 23064 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.068969 22994 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:13:42.069375 22518 consensus_queue.cc:237] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:42.109208 22887 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:41.908068 22991 consensus_queue.cc:237] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 25, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:41.938402 22997 raft_consensus.cc:697] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:41.933984 23086 consensus_queue.cc:1048] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.146s
I20260709 12:13:42.077406 23079 raft_consensus.cc:3055] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 22 LEADER]: Stepping down as leader of term 22
W20260709 12:13:42.080080 23022 consensus_meta.cc:287] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.601s	user 0.011s	sys 0.000s
W20260709 12:13:42.082679 23082 log.cc:927] Time spent T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
I20260709 12:13:41.929593 22628 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:42.121920 13834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35422 (request call id 1849) took 1011 ms. Trace:
I20260709 12:13:42.147099 13834 rpcz_store.cc:276] 0709 12:13:41.111056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:41.126808 (+ 15752us) service_pool.cc:224] Handling call
0709 12:13:42.121675 (+994867us) spinlock_profiling.cc:243] Waited 581 ms on lock 0x7b540002dd54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:42.121838 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1336692480}
I20260709 12:13:42.072305 23087 consensus_queue.cc:1059] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 28.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:13:42.129503 13651 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:42.136996 22887 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:42.152493 22926 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:42.156684 22892 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.160463 22926 consensus_queue.cc:1059] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:13:42.160763 22892 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:42.163045 22926 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:42.165437 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:42.167958 23071 consensus_queue.cc:1048] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:13:42.138258 23053 raft_consensus.cc:2804] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:42.128515 23089 raft_consensus.cc:3055] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 25 LEADER]: Stepping down as leader of term 25
W20260709 12:13:42.169180 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 235385us
I20260709 12:13:42.163172 22892 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:42.176519 13837 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 27.
I20260709 12:13:42.141042 23079 raft_consensus.cc:740] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:42.126706 23064 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:42.176168 23089 raft_consensus.cc:740] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:42.158231 23025 consensus_queue.cc:237] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:42.207677 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 92346us
I20260709 12:13:42.208688 13652 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:42.210068 23053 raft_consensus.cc:697] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 26 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:42.229717 23087 raft_consensus.cc:2804] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:42.217531 23063 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:42.223184 23079 consensus_queue.cc:260] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:42.210062 22997 consensus_queue.cc:237] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:42.241168 14380 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:42.259848 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:42.245059 23064 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:42.247095 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:42.268781 13832 raft_consensus.cc:1275] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 12:13:42.247448 13652 leader_election.cc:400] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 32 pre-election: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 33 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 32. Current term is 33.
I20260709 12:13:42.251269 22628 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:42.246981 23087 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:42.252023 23063 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:42.248224 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 118826us
I20260709 12:13:42.253551 23049 raft_consensus.cc:3055] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:42.281342 13651 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:42.284380 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:42.271847 13652 leader_election.cc:403] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 32 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:13:42.283675 22989 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.010s	sys 0.032s
I20260709 12:13:42.288398 13836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 3736) took 1128 ms. Trace:
I20260709 12:13:42.288870 13836 rpcz_store.cc:276] 0709 12:13:41.161588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:41.162651 (+  1063us) service_pool.cc:224] Handling call
0709 12:13:41.162934 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:41.586620 (+423686us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:42.288199 (+701579us) spinlock_profiling.cc:243] Waited 423 ms on lock 0x7b54001671d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:42.288344 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":973034880}
I20260709 12:13:42.214282 23089 consensus_queue.cc:260] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.14, Last appended by leader: 14, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:42.297910 23053 consensus_queue.cc:237] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 25.13, Last appended by leader: 13, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:42.299600 23079 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:42.281765 23071 raft_consensus.cc:2804] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:42.282784 23087 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:42.284402 23049 raft_consensus.cc:740] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
W20260709 12:13:42.305954 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 77182.6us
W20260709 12:13:42.292555 22989 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.010s	sys 0.033s
I20260709 12:13:42.314085 23094 raft_consensus.cc:2804] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:42.293453 23089 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:42.320025 13651 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:42.319680 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:42.294268 22964 consensus_queue.cc:1048] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.027s
I20260709 12:13:42.303939 23071 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:42.326223 23049 consensus_queue.cc:260] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.13, Last appended by leader: 13, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:42.314157 22994 raft_consensus.cc:2749] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 33 FOLLOWER]: Leader pre-election lost for term 32. Reason: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 33 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 32. Current term is 33.
I20260709 12:13:42.338686 14412 raft_consensus.cc:1275] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 12:13:42.333262 14414 raft_consensus.cc:1275] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:13:42.294230 23051 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:42.319180 23094 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:42.316011 23063 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:42.342609 13651 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:42.347368 23094 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:42.349166 23095 consensus_queue.cc:1059] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.013s
I20260709 12:13:42.355973 23095 raft_consensus.cc:3055] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:13:42.356490 23095 raft_consensus.cc:740] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:42.349033 23092 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.333088 23071 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:42.323000 22991 consensus_queue.cc:1048] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.027s
I20260709 12:13:42.345567 22773 raft_consensus.cc:2804] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:42.358829 22964 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.360355 23093 raft_consensus.cc:2804] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:42.366142 23049 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:42.367401 22868 raft_consensus.cc:3055] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 LEADER]: Stepping down as leader of term 30
I20260709 12:13:42.349123 22994 consensus_queue.cc:1048] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.024s
I20260709 12:13:42.381920 23093 raft_consensus.cc:697] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 21 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
W20260709 12:13:42.389377 13571 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d2f365337b324999a073edacbe6c6e09 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER failed with leader ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:13:42.389967 23051 leader_election.cc:290] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 31 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:42.389623 23093 consensus_queue.cc:237] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:42.380322 22964 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:42.374540 23095 consensus_queue.cc:260] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:42.392388 23095 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:42.393342 22964 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:42.394999 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:42.418190 13832 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 24.
I20260709 12:13:42.396368 13837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54830 (request call id 3737) took 1234 ms. Trace:
I20260709 12:13:42.371227 22773 raft_consensus.cc:697] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 26 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:42.419226 13837 rpcz_store.cc:276] 0709 12:13:41.162186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:41.162314 (+   128us) service_pool.cc:224] Handling call
0709 12:13:42.396148 (+1233834us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54001667d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:42.396271 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2330282880}
I20260709 12:13:42.420065 22773 consensus_queue.cc:237] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 24.19, Last appended by leader: 19, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:42.422712 22963 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:42.397945 23080 raft_consensus.cc:3055] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:42.366523 23092 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:42.400115 22887 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:42.403007 23094 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:42.384234 22868 raft_consensus.cc:740] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:13:42.406193 23068 log.cc:927] Time spent T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.742s	user 0.010s	sys 0.000s
I20260709 12:13:42.412165 23071 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:42.414659 23085 raft_consensus.cc:3055] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:13:42.416374 23057 raft_consensus.cc:3055] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:42.430677 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 31 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:42.430632 14380 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:42.451188 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:42.451737 14414 raft_consensus.cc:2393] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 31 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 31: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:13:42.451982 13681 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:42.452041 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:42.452872 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:42.453666 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 29 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:42.453799 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:42.454708 13680 raft_consensus.cc:2410] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 25 because replica has last-logged OpId of term: 24 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 12.
I20260709 12:13:42.439760 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 26 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:42.438874 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:42.451668 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:42.453042 13684 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 23.
I20260709 12:13:42.462589 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:42.463325 13686 raft_consensus.cc:2468] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 25.
I20260709 12:13:42.464725 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:42.467325 13679 raft_consensus.cc:2368] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 27. Current term is 28.
I20260709 12:13:42.437312 23080 raft_consensus.cc:740] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:42.470816 23052 raft_consensus.cc:2804] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:42.458300 23057 raft_consensus.cc:740] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:42.474603 22868 consensus_queue.cc:260] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 30.20, Last appended by leader: 20, Current term: 30, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:42.446210 22994 consensus_queue.cc:1059] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 12:13:42.477171 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 31 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:42.477329 22781 raft_consensus.cc:3055] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 30 LEADER]: Stepping down as leader of term 30
I20260709 12:13:42.445969 22887 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.477957 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:42.480844 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 29 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:42.529600 13834 raft_consensus.cc:1275] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 33 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 31 index: 15. Preceding OpId from leader: term: 33 index: 16. (index mismatch)
I20260709 12:13:42.443797 23086 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:42.529620 13683 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 26.
I20260709 12:13:42.481398 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:42.481842 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:42.450906 23049 consensus_queue.cc:1048] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.034s
I20260709 12:13:42.485210 23080 consensus_queue.cc:260] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:42.497753 23057 consensus_queue.cc:260] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:42.501150 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:42.504037 13681 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 28.
I20260709 12:13:42.506283 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:42.510545 13837 raft_consensus.cc:1275] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 12:13:42.510833 13832 raft_consensus.cc:1275] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 31 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 28 index: 17. Preceding OpId from leader: term: 31 index: 18. (index mismatch)
I20260709 12:13:42.446959 23085 raft_consensus.cc:740] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:42.519754 22982 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.524027 14379 leader_election.cc:400] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 election: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for earlier term 26. Current term is 27.
I20260709 12:13:42.550352 14379 leader_election.cc:403] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 election: Cancelling election due to peer responding with higher term
I20260709 12:13:42.522351 23051 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:42.550729 13726 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:42.520731 23008 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:42.527941 22781 raft_consensus.cc:740] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 30 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:42.526279 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:42.531663 13684 raft_consensus.cc:2410] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 26 because replica has last-logged OpId of term: 25 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 13.
I20260709 12:13:42.531803 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:42.534937 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 34 candidate_status { last_received { term: 31 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:42.563699 13686 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 33.
I20260709 12:13:42.526048 22898 consensus_queue.cc:1048] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.016s
I20260709 12:13:42.546056 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 26 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:42.548291 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 34 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:42.574661 13683 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 33.
I20260709 12:13:42.480631 23052 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:42.580448 13687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 4103) took 1315 ms. Trace:
I20260709 12:13:42.555542 13836 raft_consensus.cc:2393] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 29: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:42.533943 23053 raft_consensus.cc:3055] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:13:42.500335 23087 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:42.624531 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:42.540748 23086 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:42.540159 22868 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:42.568729 13726 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:42.565124 13831 raft_consensus.cc:2393] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 26: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:42.576709 13681 raft_consensus.cc:2368] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 27. Current term is 28.
W20260709 12:13:42.577112 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 132477us
I20260709 12:13:42.554152 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:42.568043 23091 raft_consensus.cc:2804] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:42.598582 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:42.544338 22887 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:42.600719 13687 rpcz_store.cc:276] 0709 12:13:41.258413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:41.258556 (+   143us) service_pool.cc:224] Handling call
0709 12:13:42.573383 (+1314827us) spinlock_profiling.cc:243] Waited 468 ms on lock 0x7b5400272254. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:42.573520 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1077208832}
I20260709 12:13:42.607517 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 31 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:42.619608 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:42.626071 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:42.564096 23080 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:13:42.522298 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:42.635931 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:42.644767 13683 raft_consensus.cc:2393] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 27: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
W20260709 12:13:42.653335 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 84709us
I20260709 12:13:42.654035 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:42.553742 22096 raft_consensus.cc:2749] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Leader election lost for term 26. Reason: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for earlier term 26. Current term is 27.
I20260709 12:13:42.597972 23052 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:42.655717 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:42.657547 13832 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:42.619439 22421 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.662356 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:42.664075 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:42.728242 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:42.659811 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:42.729135 13831 raft_consensus.cc:2393] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 29: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:42.729753 13836 raft_consensus.cc:2410] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 27 because replica has last-logged OpId of term: 26 index: 19, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 18.
I20260709 12:13:42.620501 23053 raft_consensus.cc:740] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:42.571866 23051 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:42.620527 23022 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:13:42.651688 23068 log.cc:927] Time spent T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:13:42.743206 13831 raft_consensus.cc:1240] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:42.711921 23083 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.559759 22982 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:42.661214 13726 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:42.568550 23008 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:42.720335 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:42.756865 13833 raft_consensus.cc:2368] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 23. Current term is 24.
I20260709 12:13:42.652087 23025 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.724843 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:42.723479 23092 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:42.730611 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:42.656376 22992 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:42.731926 13836 raft_consensus.cc:1240] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260709 12:13:42.657277 23091 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
W20260709 12:13:42.711031 23103 log.cc:927] Time spent T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260709 12:13:42.761185 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:13:42.740418 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:42.762015 13834 raft_consensus.cc:2393] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 25: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
W20260709 12:13:42.742147 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:42.742817 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:42.709722 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:42.709610 23094 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:42.736778 22421 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:42.718081 23071 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:42.779112 13832 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 31.
I20260709 12:13:42.781031 13835 raft_consensus.cc:1240] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 31 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 30. Current term is 31. Ops: []
I20260709 12:13:42.781208 13680 raft_consensus.cc:1240] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:42.765408 23025 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:42.657506 22519 raft_consensus.cc:2749] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 12:13:42.759676 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 98560.3us
W20260709 12:13:42.761009 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:42.763943 13831 raft_consensus.cc:1240] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 25. Current term is 26. Ops: [25.14-25.14]
I20260709 12:13:42.765931 23115 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:42.766801 13833 raft_consensus.cc:1240] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 24. Current term is 25. Ops: [24.13-24.13]
I20260709 12:13:42.787726 23092 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:42.770325 23053 consensus_queue.cc:260] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 27.14, Last appended by leader: 14, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:42.793203 23107 log.cc:927] Time spent T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 12:13:42.769196 13681 raft_consensus.cc:1275] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 33 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 31 index: 15. Preceding OpId from leader: term: 33 index: 16. (index mismatch)
I20260709 12:13:42.793421 23092 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:42.794610 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:42.795512 13681 raft_consensus.cc:2410] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 25 because replica has last-logged OpId of term: 24 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 12.
I20260709 12:13:42.795725 23092 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:42.761507 23091 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:42.799146 22519 raft_consensus.cc:2804] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:42.799620 22519 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:42.799970 22519 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:13:42.801481 13800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:42.625645 23085 consensus_queue.cc:260] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:42.745877 13837 raft_consensus.cc:1240] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 28. Current term is 29. Ops: [28.16-28.16]
I20260709 12:13:42.778164 22992 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:42.806496 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:42.809249 13652 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:42.802328 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:42.826763 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:42.786664 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:42.830255 13833 raft_consensus.cc:1240] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 25. Current term is 26. Ops: [25.17-25.17]
I20260709 12:13:42.833930 13652 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:42.756575 23022 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:42.841938 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 53266.4us
I20260709 12:13:42.844413 23123 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.845186 23123 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:42.847890 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:42.801623 23006 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.836771 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 26 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:42.852725 13831 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:42.802898 23008 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:42.861150 13836 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 27.
I20260709 12:13:42.804076 23025 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:42.864069 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:42.870223 13680 raft_consensus.cc:2410] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 26 because replica has last-logged OpId of term: 25 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 13.
I20260709 12:13:42.871842 23025 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.873883 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:42.854038 23085 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:42.897503 13685 raft_consensus.cc:2410] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 21 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 15.
I20260709 12:13:42.726903 22781 consensus_queue.cc:260] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 30.18, Last appended by leader: 18, Current term: 30, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:42.757577 23083 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:42.876914 13652 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:13:42.878661 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 114196us
I20260709 12:13:42.880909 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:42.912326 13759 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 28.
I20260709 12:13:42.882098 23008 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:42.887570 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:42.874944 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:42.854894 22908 raft_consensus.cc:2749] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:42.893987 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:42.895450 13758 raft_consensus.cc:1275] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 12:13:42.896245 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:42.875155 13761 raft_consensus.cc:1275] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 26 index: 13. Preceding OpId from leader: term: 27 index: 14. (index mismatch)
I20260709 12:13:42.895221 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 32 candidate_status { last_received { term: 31 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:42.899730 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:42.826246 23115 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:42.877511 22994 raft_consensus.cc:2749] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:42.894501 14380 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:42.896224 22997 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.909132 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:42.930706 13757 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 29.
I20260709 12:13:42.901512 23128 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.867220 23006 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:42.936324 23113 log.cc:927] Time spent T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 12:13:42.903697 13760 raft_consensus.cc:1240] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 28. Current term is 29. Ops: [28.16-28.16]
I20260709 12:13:42.937754 23006 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:42.938261 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:42.938922 23054 raft_consensus.cc:2804] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:42.940448 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:42.940851 13829 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 26.
I20260709 12:13:42.941344 13761 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:42.943186 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:42.939688 23054 raft_consensus.cc:697] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 27 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:42.949546 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 31 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:42.923722 23087 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:42.934778 13652 leader_election.cc:400] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 election: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 23. Current term is 24.
I20260709 12:13:42.895143 23025 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:42.961721 13762 raft_consensus.cc:2393] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 31: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:42.927654 23095 raft_consensus.cc:2749] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:13:42.965346 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 26 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:42.948661 13758 raft_consensus.cc:2393] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 29: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:42.967059 13652 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:42.971261 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:13:42.950011 23111 log.cc:927] Time spent T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 12:13:42.924598 13755 raft_consensus.cc:2393] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 25: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:42.974100 13680 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 23.
I20260709 12:13:42.903824 23125 consensus_queue.cc:1048] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.066s
I20260709 12:13:42.984547 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 31 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:42.978528 13681 raft_consensus.cc:2393] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 28: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:42.984920 13758 raft_consensus.cc:1240] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 24. Current term is 25. Ops: []
W20260709 12:13:42.949615 23112 log.cc:927] Time spent T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 12:13:42.964140 23086 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:42.987807 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 93325.9us
I20260709 12:13:42.993185 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 31 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:42.994405 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:42.998574 13754 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:42.977178 22994 raft_consensus.cc:2749] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:42.925719 23008 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:43.001915 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 34 candidate_status { last_received { term: 30 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:42.940937 22997 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:43.014525 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:43.015345 13681 raft_consensus.cc:1275] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 12:13:43.018178 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:43.020570 13760 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 24.
I20260709 12:13:43.009243 22421 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:42.946336 22773 consensus_queue.cc:1059] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.044s
I20260709 12:13:42.946944 23128 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:43.031203 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:43.033725 13681 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 23.
I20260709 12:13:43.031682 22773 raft_consensus.cc:3055] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:43.034376 22992 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:43.034376 22773 raft_consensus.cc:740] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:43.036351 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 32 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:43.042222 13727 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:43.044019 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:42.999554 22982 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:43.047676 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 33 candidate_status { last_received { term: 31 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:43.050606 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 31 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:43.051831 13681 raft_consensus.cc:2376] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 33 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 33. Re-sending same reply.
W20260709 12:13:43.055799 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:43.059278 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 29 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:43.060266 13681 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 27.
I20260709 12:13:43.100543 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:43.100842 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:43.102900 13761 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 28.
I20260709 12:13:43.104815 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 26 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:43.106235 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 34 candidate_status { last_received { term: 31 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:43.110641 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:43.111780 13681 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 25.
I20260709 12:13:43.115465 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:43.120433 13761 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 27.
I20260709 12:13:43.137691 13762 raft_consensus.cc:1275] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 24 index: 19. Preceding OpId from leader: term: 26 index: 20. (index mismatch)
I20260709 12:13:43.105880 23000 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
W20260709 12:13:43.160861 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:43.015911 23054 consensus_queue.cc:237] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 26.19, Last appended by leader: 19, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:43.162583 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:13:43.168414 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:43.227968 13681 raft_consensus.cc:1275] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 12:13:43.158954 23123 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:43.111701 23135 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:43.234549 14414 raft_consensus.cc:1275] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
I20260709 12:13:43.241644 13688 raft_consensus.cc:2410] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 26 because replica has last-logged OpId of term: 25 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 16.
I20260709 12:13:43.237984 22964 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:43.246336 22964 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:43.251619 22868 consensus_meta.cc:287] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.595s	user 0.009s	sys 0.002s
I20260709 12:13:43.252607 13755 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 31.
I20260709 12:13:43.254779 23128 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:43.163625 23000 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:43.237205 23136 raft_consensus.cc:2749] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:13:43.259856 22963 consensus_meta.cc:287] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.837s	user 0.006s	sys 0.007s
I20260709 12:13:43.262476 13681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09"
dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:51328
I20260709 12:13:43.263105 23083 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:43.263136 13681 raft_consensus.cc:606] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Received request to transfer leadership
I20260709 12:13:43.264119 13681 raft_consensus.cc:614] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:43.265270 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:43.265607 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:43.162526 22887 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:43.266130 13762 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 25.
I20260709 12:13:43.266261 13759 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 23.
I20260709 12:13:43.269399 13831 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 28.
I20260709 12:13:43.273553 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:43.294252 23025 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:43.295644 23091 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:43.293193 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:43.298751 13763 raft_consensus.cc:2393] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 27: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:43.299707 23091 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:43.301252 23008 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:43.299592 13651 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:43.304559 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 26 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:43.304904 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:43.305594 13759 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:43.307546 13754 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 24.
I20260709 12:13:43.309957 13762 raft_consensus.cc:1240] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 30. Current term is 31. Ops: []
I20260709 12:13:43.311192 13651 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:43.319243 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:43.321365 13760 raft_consensus.cc:1275] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 24 index: 19. Preceding OpId from leader: term: 26 index: 20. (index mismatch)
I20260709 12:13:43.323984 13761 raft_consensus.cc:1275] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 25 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 12:13:43.325119 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:43.327993 13758 raft_consensus.cc:1275] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 12:13:43.329052 13651 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:13:43.334559 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 292392us
I20260709 12:13:43.338203 13761 raft_consensus.cc:1275] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
I20260709 12:13:43.340209 13759 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 28.
I20260709 12:13:43.315526 23095 raft_consensus.cc:2804] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:43.344298 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:43.315325 23087 raft_consensus.cc:2749] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:43.350548 13727 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:43.238566 23135 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:43.352758 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:43.365908 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:13:43.354897 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:43.366681 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:43.367558 13831 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 29.
I20260709 12:13:43.370692 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:43.371414 13832 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:43.329471 22908 consensus_queue.cc:1048] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.038s
I20260709 12:13:43.367846 13754 raft_consensus.cc:2410] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 26 because replica has last-logged OpId of term: 24 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 12.
I20260709 12:13:43.329339 23092 consensus_queue.cc:1059] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 26.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.025s
I20260709 12:13:43.325603 23085 consensus_queue.cc:1048] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.028s
I20260709 12:13:43.373270 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:43.346503 22989 raft_consensus.cc:2749] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:13:43.349395 23095 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:13:43.354708 23080 consensus_meta.cc:287] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.691s	user 0.005s	sys 0.007s
I20260709 12:13:43.371565 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:43.375196 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:43.380119 13832 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 25.
I20260709 12:13:43.384478 13762 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 25.
I20260709 12:13:43.387415 13831 raft_consensus.cc:1275] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 25 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 12:13:43.387988 23083 consensus_queue.cc:1048] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:13:43.389228 23136 consensus_queue.cc:1048] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:13:43.390586 22868 consensus_queue.cc:1048] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 12:13:43.391124 22519 consensus_meta.cc:287] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.591s	user 0.012s	sys 0.000s
I20260709 12:13:43.350232 22509 consensus_queue.cc:1048] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.035s
I20260709 12:13:43.393028 13727 leader_election.cc:304] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:43.393666 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 32 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:43.399761 23135 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:43.422348 22519 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:43.424245 23135 raft_consensus.cc:2804] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Leader election won for term 31
I20260709 12:13:43.424984 23135 raft_consensus.cc:697] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:43.367241 23141 raft_consensus.cc:2749] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:13:43.350401 22770 consensus_queue.cc:1048] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.036s
I20260709 12:13:43.439630 14415 raft_consensus.cc:1275] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 12:13:43.410872 13834 raft_consensus.cc:1240] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 23. Current term is 24. Ops: [23.15-23.15]
I20260709 12:13:43.411100 13652 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:43.403967 13679 raft_consensus.cc:2410] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 23 because replica has last-logged OpId of term: 22 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 14.
I20260709 12:13:43.401734 23095 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Advancing to term 28
W20260709 12:13:43.414889 23052 consensus_meta.cc:287] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.679s	user 0.008s	sys 0.004s
I20260709 12:13:43.442236 13652 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:43.442006 23052 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:43.443737 13652 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:43.416239 13762 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "232d133451004a83941860574adec712"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:13:43.445472 14412 raft_consensus.cc:1240] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 24. Current term is 25. Ops: [24.17-24.17]
W20260709 12:13:43.418257 13800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:43.418999 22887 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:43.425462 22519 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:43.430233 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:43.452561 13800 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:43.430217 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:43.426076 23135 consensus_queue.cc:237] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 30.17, Last appended by leader: 17, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:43.436288 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:13:43.454728 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:43.437899 14407 raft_consensus.cc:1240] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 33 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 32. Current term is 33. Ops: []
I20260709 12:13:43.440908 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:43.402555 22926 consensus_queue.cc:1059] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 26.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.020s
W20260709 12:13:43.451390 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 93141.5us
I20260709 12:13:43.429178 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:43.454725 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:43.458415 13832 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 25.
I20260709 12:13:43.458676 13800 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:43.458709 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:43.459441 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:43.444913 23052 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:43.456063 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 29 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:43.461727 13837 raft_consensus.cc:1275] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 12:13:43.461076 13834 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 28.
I20260709 12:13:43.445122 23085 raft_consensus.cc:2804] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:13:43.463382 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 30 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:43.463950 13832 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 29.
I20260709 12:13:43.466280 13837 raft_consensus.cc:1240] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:43.453886 23092 raft_consensus.cc:2804] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:13:43.452471 23115 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:43.462966 22628 raft_consensus.cc:2804] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:43.454093 22887 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:43.457207 22868 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.491621 13727 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:43.463234 23128 raft_consensus.cc:2749] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:43.481536 23092 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:43.501839 13727 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:43.508724 23136 raft_consensus.cc:2804] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:43.509431 23136 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:43.509929 23136 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:43.482942 23123 consensus_queue.cc:1048] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.028s
I20260709 12:13:43.512138 23094 consensus_queue.cc:1048] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:13:43.512190 23147 consensus_queue.cc:1059] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 30.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.002s
I20260709 12:13:43.507315 23141 consensus_queue.cc:1048] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.007s
I20260709 12:13:43.515257 22989 raft_consensus.cc:3055] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 30 LEADER]: Stepping down as leader of term 30
I20260709 12:13:43.515504 23145 raft_consensus.cc:2804] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:43.515678 22989 raft_consensus.cc:740] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 30 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:43.506315 23115 raft_consensus.cc:2749] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:43.516288 23145 raft_consensus.cc:697] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 25 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:43.500147 22868 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:43.519250 22868 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:43.507542 23092 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:43.520591 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:43.516757 22989 consensus_queue.cc:260] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 30.17, Last appended by leader: 17, Current term: 30, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:43.483259 22628 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:43.482551 22519 consensus_queue.cc:1059] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 32.19, Next index: 20, Last known committed idx: 18, Time since last communication: 0.040s
I20260709 12:13:43.522075 22628 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:43.523381 22773 consensus_queue.cc:260] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:43.524267 22887 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:43.524425 22773 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:43.528529 23051 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:43.532979 23057 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:43.536863 22964 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:43.538180 13727 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:43.539341 23091 raft_consensus.cc:2804] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:13:43.539759 23091 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:43.540120 23091 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:43.542579 23130 consensus_queue.cc:1059] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 24.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:43.543686 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:43.543937 23051 raft_consensus.cc:3055] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:43.544435 23051 raft_consensus.cc:740] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:43.545346 23051 consensus_queue.cc:260] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:43.546684 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 32 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:43.550308 23095 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:43.553609 23095 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:43.545486 13759 raft_consensus.cc:1275] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 12:13:43.542519 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:43.562438 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:43.563612 14412 raft_consensus.cc:2410] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 27 because replica has last-logged OpId of term: 25 index: 20, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 19.
I20260709 12:13:43.570946 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:13:43.575354 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 96551.9us
I20260709 12:13:43.576213 13800 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:43.577167 22887 raft_consensus.cc:2804] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:13:43.577927 22887 raft_consensus.cc:697] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 28 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:43.578879 13800 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:43.580432 13833 raft_consensus.cc:2393] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 23: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:43.582257 13686 raft_consensus.cc:1275] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 12:13:43.580442 22964 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.585170 14379 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:43.586208 14379 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:43.586694 13800 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:43.567350 23120 consensus_queue.cc:1059] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.006s
I20260709 12:13:43.595324 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:43.600101 13687 raft_consensus.cc:1240] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 21 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 20. Current term is 21. Ops: [20.10-20.10]
I20260709 12:13:43.517297 23145 consensus_queue.cc:237] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:43.617007 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 155897us
I20260709 12:13:43.623396 23060 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:13:43.625556 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:43.629519 23053 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Advancing to term 28
W20260709 12:13:43.655989 13634 auto_rebalancer.cc:893] Removing replace marker failed: Replica b98d2519bb504dc6905ed2ede4571835 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 25 committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
W20260709 12:13:43.656598 13634 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 12:13:43.656941 13634 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 12:13:43.663267 22096 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.663883 22096 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:43.590092 23084 raft_consensus.cc:2764] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader election decision vote started in defunct term 27: won
I20260709 12:13:43.668375 22096 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:43.578977 22887 consensus_queue.cc:237] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 26.13, Last appended by leader: 13, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:43.679155 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:43.610950 23124 raft_consensus.cc:2804] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:43.688668 13755 raft_consensus.cc:1240] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 23. Current term is 24. Ops: [23.15-23.15]
I20260709 12:13:43.682883 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:43.681658 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:43.690066 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:43.690632 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:43.690546 13755 raft_consensus.cc:1275] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:13:43.691247 13681 raft_consensus.cc:2376] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 28. Re-sending same reply.
I20260709 12:13:43.612170 23051 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:43.692129 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:43.694067 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 29 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:43.618340 22992 raft_consensus.cc:2804] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:43.694969 13686 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 28.
W20260709 12:13:43.697952 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 80536.6us
I20260709 12:13:43.699636 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:43.700244 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:43.700304 13686 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 23.
I20260709 12:13:43.701990 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:43.703182 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:43.703227 23085 raft_consensus.cc:697] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 28 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:43.703948 13686 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 26.
I20260709 12:13:43.593323 23116 consensus_queue.cc:1048] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.092s
I20260709 12:13:43.583158 22964 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 33 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:43.705374 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 32 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:43.707469 13800 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:43.701122 13682 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 25.
I20260709 12:13:43.671110 22898 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.710348 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:43.720610 13756 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 28.
I20260709 12:13:43.729951 23127 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:13:43.730633 23127 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:43.731138 23127 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:43.735885 23000 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:43.695238 23148 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.688997 23124 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:43.676062 23128 consensus_queue.cc:1059] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.047s
I20260709 12:13:43.777503 23128 raft_consensus.cc:3055] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:43.779593 22628 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:43.688776 23079 consensus_queue.cc:1048] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.051s
I20260709 12:13:43.675592 23093 consensus_queue.cc:1048] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 12:13:43.782325 13680 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 25.
I20260709 12:13:43.782135 13726 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:43.712545 22926 consensus_queue.cc:1048] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.068s
I20260709 12:13:43.776523 23124 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:13:43.783674 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:43.784482 13651 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:43.818244 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 29 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:43.694691 23150 consensus_queue.cc:1048] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.094s
I20260709 12:13:43.806151 22628 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:43.814393 13726 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:43.787673 23155 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.819227 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:43.820289 13686 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 28.
I20260709 12:13:43.834265 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:43.744853 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:43.838047 13759 raft_consensus.cc:1240] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 21. Current term is 22. Ops: []
W20260709 12:13:43.840018 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:43.837186 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:43.842722 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:13:43.841495 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 169699us
I20260709 12:13:43.724614 22898 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:43.848542 13685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 2768) took 1409 ms. Trace:
W20260709 12:13:43.849481 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:43.722296 23152 consensus_queue.cc:1048] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.116s
I20260709 12:13:43.851442 13682 raft_consensus.cc:2393] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 25: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:43.802243 23128 raft_consensus.cc:740] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:43.863899 13681 raft_consensus.cc:2410] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 24 because replica has last-logged OpId of term: 23 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 14.
W20260709 12:13:43.860005 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 45723.5us
I20260709 12:13:43.865100 13726 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:43.824431 23141 raft_consensus.cc:2749] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
I20260709 12:13:43.780930 23148 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:43.868140 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:43.857713 13685 rpcz_store.cc:276] 0709 12:13:42.438720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:42.438879 (+   159us) service_pool.cc:224] Handling call
0709 12:13:43.848239 (+1409360us) spinlock_profiling.cc:243] Waited 444 ms on lock 0x7b54003115d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:43.848458 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1020126592}
I20260709 12:13:43.825064 22963 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:13:43.876405 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 226992us
W20260709 12:13:43.877175 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 290992us
I20260709 12:13:43.833387 23095 raft_consensus.cc:2804] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader election won for term 28
W20260709 12:13:43.873039 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 165596us
I20260709 12:13:43.881281 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 30 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:43.880493 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:43.882164 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 22 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:43.882342 13686 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 28.
I20260709 12:13:43.883464 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:43.886140 14412 raft_consensus.cc:1240] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 24. Current term is 25. Ops: [24.17-24.17]
I20260709 12:13:43.884141 13800 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:43.889111 14379 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:43.899896 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:43.911127 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:43.900424 13800 leader_election.cc:304] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:43.900766 13833 raft_consensus.cc:1275] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:13:43.876490 22744 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:43.870779 23025 raft_consensus.cc:2749] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:43.918354 13757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48114 (request call id 3916) took 1032 ms. Trace:
I20260709 12:13:43.923429 13800 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:13:43.917425 14379 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:43.926199 13762 raft_consensus.cc:606] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 LEADER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:43.847546 23136 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:43.985261 13830 raft_consensus.cc:2410] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 22 because replica has last-logged OpId of term: 20 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 9.
I20260709 12:13:43.991185 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:43.929046 13757 rpcz_store.cc:276] 0709 12:13:42.885943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:42.886221 (+   278us) service_pool.cc:224] Handling call
0709 12:13:43.918155 (+1031934us) spinlock_profiling.cc:243] Waited 7.1 ms on lock 0x7b5400333bd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:43.918280 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16340352}
I20260709 12:13:43.998605 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:43.902354 23095 raft_consensus.cc:697] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 28 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:43.900367 22992 raft_consensus.cc:697] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 24 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:43.920576 22628 raft_consensus.cc:2749] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:13:43.916326 23063 raft_consensus.cc:2749] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:43.851011 23155 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:43.981596 23123 consensus_queue.cc:1059] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.028s
I20260709 12:13:43.867677 23085 consensus_queue.cc:237] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 26.11, Last appended by leader: 11, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:44.175127 23174 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.181224 23008 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.045531 22926 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:13:44.045984 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 122624us
I20260709 12:13:44.202970 13800 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:43.912362 23141 consensus_queue.cc:1048] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.105s
I20260709 12:13:44.205227 13800 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:43.997471 23128 consensus_queue.cc:260] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:44.124568 23159 log.cc:927] Time spent T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:13:44.046479 13828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 4270) took 1536 ms. Trace:
I20260709 12:13:44.126816 22898 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:44.103863 23057 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:44.134478 23092 consensus_meta.cc:287] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.614s	user 0.013s	sys 0.000s
I20260709 12:13:44.136937 22744 raft_consensus.cc:2749] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:44.044181 22972 consensus_queue.cc:1059] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.077s
I20260709 12:13:44.162868 23148 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:44.119954 23093 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:44.167632 23091 consensus_meta.cc:287] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.627s	user 0.012s	sys 0.001s
I20260709 12:13:44.212906 22628 raft_consensus.cc:2749] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:13:43.900241 23084 consensus_queue.cc:1048] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.122s
I20260709 12:13:43.883786 22963 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:44.184185 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:44.184032 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 266661us
W20260709 12:13:44.120527 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 243006us
I20260709 12:13:44.233300 13726 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:44.234448 22744 raft_consensus.cc:2749] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:13:44.207106 13800 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:13:44.184970 22773 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:44.208509 13682 raft_consensus.cc:1275] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 26 index: 14. (term mismatch)
I20260709 12:13:44.186837 23177 raft_consensus.cc:2749] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:13:44.193022 22964 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:44.199848 23052 raft_consensus.cc:2804] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:44.212548 13828 rpcz_store.cc:276] 0709 12:13:42.510506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:42.510659 (+   153us) service_pool.cc:224] Handling call
0709 12:13:42.511046 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:42.511331 (+   285us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:13:42.530533 (+ 19202us) log.cc:844] Serialized 14 byte log entry
0709 12:13:43.253081 (+722548us) spinlock_profiling.cc:243] Waited 6.36 ms on lock 0x7b18002913a0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924ea03f3 00007fa924ea27c1 00007fa924ea2779 00007fa924ea2709 00007fa924ea26d1 00007fa924ea19cd 0000000000388634 0000000000388479 00007fa924e8383a
0709 12:13:43.518421 (+265340us) spinlock_profiling.cc:243] Waited 3.29 ms on lock 0x7b18002913a0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e82e07 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9d455 00007fa92b9853c7 00007fa927f979a7 00007fa927fa70bf 00007fa927fa7038
0709 12:13:43.697127 (+178706us) log.cc:844] Serialized 14 byte log entry
0709 12:13:44.045936 (+348809us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:44.046025 (+    89us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:13:44.046115 (+    90us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:44.046217 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:44.046394 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8213,"prepare.queue_time_us":29777,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":3684,"raft.queue_time_us":29841,"raft.run_cpu_time_us":336,"raft.run_wall_time_us":10527,"spinlock_wait_cycles":22196480,"thread_start_us":710680,"threads_started":3,"wal-append.queue_time_us":223000}
I20260709 12:13:43.925843 23131 raft_consensus.cc:2749] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 31 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
W20260709 12:13:44.223209 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 50212us
I20260709 12:13:44.213217 23164 raft_consensus.cc:2749] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:44.062752 23060 raft_consensus.cc:2804] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election won for term 27
W20260709 12:13:44.236557 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:44.239059 13726 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:44.205566 23174 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:44.224334 23053 consensus_meta.cc:287] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.594s	user 0.011s	sys 0.003s
I20260709 12:13:44.208242 23008 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:44.243978 13800 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
W20260709 12:13:44.241044 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 122924us
I20260709 12:13:44.222683 23128 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:44.212020 22926 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:44.250976 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:44.243407 13682 pending_rounds.cc:85] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 13
I20260709 12:13:44.260418 13682 pending_rounds.cc:107] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 25.14
I20260709 12:13:44.217974 23092 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:44.219529 23057 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:44.258071 13800 leader_election.cc:400] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 election: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 27. Current term is 28.
I20260709 12:13:44.260854 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:44.260864 13682 raft_consensus.cc:2889] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:44.282353 22964 consensus_queue.cc:1048] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:13:44.285262 22926 leader_election.cc:290] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:44.250207 22773 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:44.287627 23092 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 30 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:44.294842 23136 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 29 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:44.295861 13688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 2775) took 1855 ms. Trace:
I20260709 12:13:44.228325 23093 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:44.230692 23095 consensus_queue.cc:237] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 27.18, Last appended by leader: 18, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:44.300463 23174 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:44.303553 22997 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:44.304812 23131 raft_consensus.cc:2804] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 33 FOLLOWER]: Leader pre-election won for term 34
I20260709 12:13:44.305284 23155 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:44.228426 23127 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 31 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:44.224732 23091 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:44.306447 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 67506.8us
I20260709 12:13:44.252693 23060 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:44.334360 23176 raft_consensus.cc:2749] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:13:44.409392 23060 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:44.410166 13726 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:44.411288 23091 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 30 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:44.219319 22992 consensus_queue.cc:237] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:44.412930 13726 leader_election.cc:304] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:44.244475 23063 consensus_queue.cc:1048] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.034s
I20260709 12:13:44.305612 13683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 2781) took 1863 ms. Trace:
I20260709 12:13:44.248673 23006 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 33 FOLLOWER]: Leader pre-election won for term 34
I20260709 12:13:44.344702 13688 rpcz_store.cc:276] 0709 12:13:42.440778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:42.573261 (+132483us) service_pool.cc:224] Handling call
0709 12:13:44.295500 (+1722239us) spinlock_profiling.cc:243] Waited 584 ms on lock 0x7b5400271854. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:44.295757 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1342186880}
I20260709 12:13:44.415037 23006 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 33 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:44.415518 23006 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 33 FOLLOWER]: Advancing to term 34
W20260709 12:13:44.336993 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 79152.7us
I20260709 12:13:44.384214 14416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 1490) took 1689 ms. Trace:
I20260709 12:13:44.417873 13688 raft_consensus.cc:1240] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 29. Current term is 30. Ops: []
I20260709 12:13:44.418395 13800 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:44.419337 13726 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:44.419787 13800 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:44.420143 23176 raft_consensus.cc:2749] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:44.420940 23176 raft_consensus.cc:2749] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:44.357055 14412 raft_consensus.cc:2393] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 28: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
W20260709 12:13:44.367861 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:44.421614 23176 raft_consensus.cc:2749] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:44.403988 23057 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:44.414007 13683 rpcz_store.cc:276] 0709 12:13:42.441720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:42.718310 (+276590us) service_pool.cc:224] Handling call
0709 12:13:42.718917 (+   607us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:42.719451 (+   534us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:42.719510 (+    59us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:42.726300 (+  6790us) log.cc:844] Serialized 26 byte log entry
0709 12:13:43.648200 (+921900us) spinlock_profiling.cc:243] Waited 2.06 ms on lock 0x7b1800088f60. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e82e07 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9fc02 00007fa927b2720b 00007fa927b2cd23 00007fa927b2d0d1 00007fa927f48a0f
0709 12:13:43.787709 (+139509us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:13:43.787763 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:43.787854 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:44.259060 (+471206us) raft_consensus.cc:1685] finished
0709 12:13:44.259082 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:44.305544 (+ 46462us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3878,"raft.queue_time_us":904,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":10060,"spinlock_wait_cycles":4734208,"thread_start_us":139273,"threads_started":1,"wal-append.queue_time_us":1174245}
I20260709 12:13:44.423313 22773 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:44.418043 14416 rpcz_store.cc:276] 0709 12:13:42.654110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:42.654266 (+   156us) service_pool.cc:224] Handling call
0709 12:13:42.654605 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:42.709462 (+ 54857us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:42.709495 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:44.014797 (+1305302us) spinlock_profiling.cc:243] Waited 3.08 ms on lock 0x7b2c000472a8. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa926886a11 00007fa926896372 00007fa927fc8a01 00007fa927f8d43a 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2
0709 12:13:44.015355 (+   558us) log.cc:844] Serialized 26 byte log entry
0709 12:13:44.192199 (+176844us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:13:44.192238 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:44.192321 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:44.308356 (+116035us) raft_consensus.cc:1685] finished
0709 12:13:44.308384 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:44.343545 (+ 35161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57814,"raft.queue_time_us":66626,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":10288,"spinlock_wait_cycles":7080832,"thread_start_us":176391,"threads_started":1,"wal-append.queue_time_us":221172}
I20260709 12:13:44.426026 13726 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:44.396653 13763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48114 (request call id 3910) took 1522 ms. Trace:
I20260709 12:13:44.398089 13754 raft_consensus.cc:1240] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:44.427238 23166 raft_consensus.cc:2749] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:13:44.430395 23063 consensus_queue.cc:1048] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:44.430837 23083 raft_consensus.cc:2804] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:44.431443 23083 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:44.431855 23083 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:44.426044 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 29 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:44.389583 14380 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:44.428526 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:44.433533 13833 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:44.386494 22926 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.433971 13726 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:44.428315 13763 rpcz_store.cc:276] 0709 12:13:42.873819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:42.874605 (+   786us) service_pool.cc:224] Handling call
0709 12:13:44.396394 (+1521789us) spinlock_profiling.cc:243] Waited 383 ms on lock 0x7b54003c9954. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:44.396582 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":880130944}
W20260709 12:13:44.441071 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 51640.5us
W20260709 12:13:44.441862 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:44.444890 13800 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:44.445801 13651 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:44.440301 14379 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:44.445828 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:44.442739 22964 raft_consensus.cc:2749] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:44.426697 23131 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 33 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:44.454766 13726 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:44.408353 23093 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:44.449756 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 34 candidate_status { last_received { term: 32 index: 19 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:44.456327 13726 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:44.461632 13832 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 32.
I20260709 12:13:44.455597 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 30 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:44.464257 13829 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:44.432737 23164 raft_consensus.cc:2749] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
I20260709 12:13:44.459041 13800 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:13:44.439193 23127 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 31 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:44.448107 23057 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.451854 22926 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:44.433164 23091 consensus_queue.cc:1048] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.027s
I20260709 12:13:44.473711 13800 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:44.460953 23094 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:44.460376 23131 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:13:44.460541 23123 raft_consensus.cc:2804] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:44.534335 13833 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 29.
I20260709 12:13:44.460754 23025 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:44.468113 22421 raft_consensus.cc:2749] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:13:44.524065 23186 log.cc:927] Time spent T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
W20260709 12:13:44.542191 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 68583.1us
I20260709 12:13:44.515407 22997 raft_consensus.cc:2804] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:44.502815 22994 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:44.546720 13727 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:44.548629 13833 raft_consensus.cc:1275] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 12:13:44.544559 22887 raft_consensus.cc:2764] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Leader election decision vote started in defunct term 28: won
I20260709 12:13:44.543198 23123 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:44.544692 23166 raft_consensus.cc:2749] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:44.526276 23052 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:44.657446 23052 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:44.521616 22989 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:44.552563 23188 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:44.517264 23160 raft_consensus.cc:2749] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:44.501874 22773 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:44.538005 23057 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:44.557256 22926 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:44.559553 23182 log.cc:927] Time spent T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
W20260709 12:13:44.560009 23124 consensus_meta.cc:287] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.727s	user 0.010s	sys 0.003s
I20260709 12:13:44.561767 22507 raft_consensus.cc:3055] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 32 LEADER]: Stepping down as leader of term 32
I20260709 12:13:44.567116 13800 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:13:44.677367 22507 raft_consensus.cc:740] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 32 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:13:44.678196 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 111162us
I20260709 12:13:44.678516 23124 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:44.678977 13800 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:44.678555 22507 consensus_queue.cc:260] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 32.19, Last appended by leader: 19, Current term: 32, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:44.680099 13800 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:13:44.680745 23124 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:44.475857 13726 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
W20260709 12:13:44.681700 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 206000us
I20260709 12:13:44.573949 13679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 2776) took 2133 ms. Trace:
I20260709 12:13:44.682531 13679 rpcz_store.cc:276] 0709 12:13:42.440945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:42.598223 (+157278us) service_pool.cc:224] Handling call
0709 12:13:44.570955 (+1972732us) spinlock_profiling.cc:243] Waited 751 ms on lock 0x7b5400245ed4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:44.573850 (+  2895us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1726399360}
I20260709 12:13:44.683738 23176 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:44.687162 23057 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:44.669086 22773 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:44.692126 22773 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:44.695142 13800 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:13:44.633469 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:44.578728 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 108451us
I20260709 12:13:44.572345 22997 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:44.646803 23141 raft_consensus.cc:2804] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:13:44.617306 23123 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:44.640722 13829 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 30.
I20260709 12:13:44.744343 13727 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:44.632261 23095 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.631889 23025 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:44.647169 23087 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:44.649818 23051 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:44.572371 23094 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:44.682063 14409 raft_consensus.cc:1240] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:44.699759 13726 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:44.700964 13800 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
W20260709 12:13:44.701495 23140 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.013s	sys 0.040s
I20260709 12:13:44.698076 23166 raft_consensus.cc:2749] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:13:44.701753 22421 raft_consensus.cc:2804] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:44.646718 22994 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:44.778898 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:44.701889 23127 raft_consensus.cc:2749] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:44.702171 23129 consensus_queue.cc:1048] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:13:44.706084 23176 raft_consensus.cc:2749] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:44.707254 23022 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:13:44.716212 13830 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54820 (request call id 4264) took 3096 ms (client timeout 1635 ms). Trace:
I20260709 12:13:44.716547 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 27 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:44.701601 22992 raft_consensus.cc:2804] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:44.717623 22926 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:44.718312 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 27 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:13:44.719776 23162 log.cc:927] Time spent T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.792s	user 0.003s	sys 0.000s
I20260709 12:13:44.721581 23130 raft_consensus.cc:3055] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 LEADER]: Stepping down as leader of term 24
W20260709 12:13:44.732925 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:44.734589 13756 raft_consensus.cc:1240] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 28. Current term is 29. Ops: [28.16-28.16]
W20260709 12:13:44.803632 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:44.716249 13683 raft_consensus.cc:1275] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 16. (term mismatch)
I20260709 12:13:44.733682 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:44.766683 14415 raft_consensus.cc:1275] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 25 index: 20. Preceding OpId from leader: term: 26 index: 20. (term mismatch)
I20260709 12:13:44.804982 13683 pending_rounds.cc:85] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 15
I20260709 12:13:44.805219 14415 pending_rounds.cc:85] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f: Aborting all ops after (but not including) 19
I20260709 12:13:44.771835 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:44.806083 14412 raft_consensus.cc:2468] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 21.
I20260709 12:13:44.776407 22421 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:44.806777 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:44.807017 22421 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:44.808019 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 29 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:44.776382 23025 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:44.811964 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:44.812702 13760 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 26.
I20260709 12:13:44.814378 13754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 2988) took 1466 ms. Trace:
I20260709 12:13:44.805728 14415 pending_rounds.cc:107] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f: Aborting uncommitted NO_OP operation due to leader change: 25.20
I20260709 12:13:44.815132 22994 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:44.814806 13754 rpcz_store.cc:276] 0709 12:13:43.348238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:43.404314 (+ 56076us) service_pool.cc:224] Handling call
0709 12:13:44.397900 (+993586us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:44.428782 (+ 30882us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:44.814170 (+385388us) spinlock_profiling.cc:243] Waited 993 ms on lock 0x7b54003c9950. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:44.814309 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2284261120}
I20260709 12:13:44.724617 22908 raft_consensus.cc:3055] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 28 LEADER]: Stepping down as leader of term 28
W20260709 12:13:44.774887 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 75209.6us
I20260709 12:13:44.815935 22908 raft_consensus.cc:740] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 28 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:44.816466 13726 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:44.817000 22908 consensus_queue.cc:260] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 28.16, Last appended by leader: 16, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:44.813573 23025 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:44.817740 13726 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:44.818264 22908 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:44.819151 13726 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:44.819922 23176 raft_consensus.cc:2749] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:13:44.820588 23176 raft_consensus.cc:2749] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:44.821887 13726 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:44.822640 23022 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:44.823820 13726 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:44.815049 14415 raft_consensus.cc:2889] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:44.826078 13726 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:44.825973 22926 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:44.827072 22509 raft_consensus.cc:2749] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:44.827358 13726 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:44.776475 22519 raft_consensus.cc:2749] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:13:44.780853 23141 raft_consensus.cc:697] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:44.766000 22997 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:44.764631 23124 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:44.791064 13830 rpcz_store.cc:269] 0709 12:13:41.614317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:41.670450 (+ 56133us) service_pool.cc:224] Handling call
0709 12:13:44.710096 (+3039646us) spinlock_profiling.cc:243] Waited 2.21 s on lock 0x7b54000db454. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:44.710273 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5081589504}
I20260709 12:13:44.769637 23175 raft_consensus.cc:2804] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Leader election won for term 30
I20260709 12:13:44.797505 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:44.776674 23136 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.835963 22509 raft_consensus.cc:2749] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:44.773939 23083 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:44.666838 23060 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:44.824615 23176 raft_consensus.cc:2749] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:13:44.785364 22628 raft_consensus.cc:2804] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election won for term 27
W20260709 12:13:44.774369 23140 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.014s	sys 0.040s
I20260709 12:13:44.788568 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:13:44.772652 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 71754.3us
I20260709 12:13:44.864450 13800 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:44.805280 13683 pending_rounds.cc:107] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 21.16
W20260709 12:13:44.831887 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:44.791330 13829 raft_consensus.cc:1275] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 26 index: 19. Preceding OpId from leader: term: 27 index: 20. (index mismatch)
I20260709 12:13:44.834429 13652 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:44.835232 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:44.795509 22992 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:44.773975 23095 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:44.780393 23087 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:44.781141 23051 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:44.802368 23130 raft_consensus.cc:740] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:44.865846 13683 raft_consensus.cc:2889] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:13:44.886179 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:44.885883 23130 consensus_queue.cc:260] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:44.887112 23130 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:44.867377 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:44.888015 13761 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 23.
I20260709 12:13:44.889083 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:13:44.897557 23192 log.cc:927] Time spent T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
W20260709 12:13:44.907889 23198 log.cc:927] Time spent T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:13:44.916379 22926 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:44.917234 23095 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:44.918191 23094 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:44.918809 23087 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:44.919991 23083 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:44.855386 23175 raft_consensus.cc:697] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:44.921519 23175 consensus_queue.cc:237] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 28.16, Last appended by leader: 16, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:44.924958 13682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 4132) took 1106 ms. Trace:
I20260709 12:13:44.925658 23060 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:44.856163 23136 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:44.928959 23178 log.cc:927] Time spent T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.750s	user 0.000s	sys 0.003s
I20260709 12:13:44.929754 23141 consensus_queue.cc:237] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 27.15, Last appended by leader: 15, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:44.934010 23176 consensus_queue.cc:1059] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 29.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:13:44.935748 22509 raft_consensus.cc:3055] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 LEADER]: Stepping down as leader of term 29
I20260709 12:13:44.936282 22509 raft_consensus.cc:740] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:44.858083 22628 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:44.937980 22628 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:44.844871 23124 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:44.872228 23173 raft_consensus.cc:2804] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:44.941159 23173 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:44.941551 23173 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:44.874426 22992 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:44.943109 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:44.943804 13758 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 25.
I20260709 12:13:44.944796 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:44.884881 23051 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:44.937358 22509 consensus_queue.cc:260] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 29.18, Last appended by leader: 18, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:44.947655 14379 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:44.866834 13800 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:13:44.955504 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 88800.6us
I20260709 12:13:44.956547 13800 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:44.925413 13682 rpcz_store.cc:276] 0709 12:13:43.818678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:43.915510 (+ 96832us) service_pool.cc:224] Handling call
0709 12:13:43.916803 (+  1293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:44.337110 (+420307us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:44.924716 (+587606us) spinlock_profiling.cc:243] Waited 288 ms on lock 0x7b5400312ed4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:44.924893 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":662254976}
I20260709 12:13:44.962695 13686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 4131) took 1144 ms. Trace:
I20260709 12:13:44.879161 22994 consensus_queue.cc:1048] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.081s
I20260709 12:13:44.963217 13686 rpcz_store.cc:276] 0709 12:13:43.818441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:43.887027 (+ 68586us) service_pool.cc:224] Handling call
0709 12:13:43.887414 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:43.887841 (+   427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:43.887869 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:43.888510 (+   641us) log.cc:844] Serialized 26 byte log entry
0709 12:13:44.120752 (+232242us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:13:44.120876 (+   124us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:44.121062 (+   186us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:44.928359 (+807297us) spinlock_profiling.cc:243] Waited 2.57 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:13:44.959253 (+ 30894us) raft_consensus.cc:1685] finished
0709 12:13:44.959287 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:44.962620 (+  3333us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":32325,"spinlock_wait_cycles":125999232,"thread_start_us":140630,"threads_started":1,"wal-append.queue_time_us":267622}
I20260709 12:13:44.840863 23131 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 34 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:44.961364 22887 raft_consensus.cc:2749] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:44.978320 23008 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:44.978456 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:44.875512 23164 raft_consensus.cc:2804] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:44.969750 13800 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:44.982503 23087 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.987140 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:44.994935 23087 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:44.998107 23087 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:45.012061 13800 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:13:45.022581 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:45.029856 22887 raft_consensus.cc:2749] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:13:45.030515 23188 raft_consensus.cc:2749] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:45.030965 23114 raft_consensus.cc:2749] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:45.031646 23136 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:13:45.029291 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 246755us
I20260709 12:13:45.034237 13652 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:45.035944 14410 raft_consensus.cc:1240] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 33 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 32. Current term is 33. Ops: []
I20260709 12:13:44.987188 23060 raft_consensus.cc:2749] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:13:45.037858 13687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41702 (request call id 2780) took 2591 ms. Trace:
I20260709 12:13:45.039228 13687 rpcz_store.cc:276] 0709 12:13:42.441572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:42.711778 (+270206us) service_pool.cc:224] Handling call
0709 12:13:42.738022 (+ 26244us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:43.610357 (+872335us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:45.032712 (+1422355us) spinlock_profiling.cc:243] Waited 862 ms on lock 0x7b5400040bd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:45.032932 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1981941632}
I20260709 12:13:45.059413 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:45.060505 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:45.062458 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 32 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:45.063278 14407 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 31.
W20260709 12:13:45.071851 13681 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 2804) took 1391 ms (client timeout 1579 ms). Trace:
W20260709 12:13:45.072360 13681 rpcz_store.cc:269] 0709 12:13:43.680464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:43.691844 (+ 11380us) service_pool.cc:224] Handling call
0709 12:13:45.060816 (+1368972us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b54002472d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:45.071766 (+ 10950us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":391702784}
I20260709 12:13:44.999933 23164 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:45.020319 23006 consensus_meta.cc:287] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.604s	user 0.006s	sys 0.006s
I20260709 12:13:45.077122 13652 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:13:45.019151 23152 raft_consensus.cc:2749] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:13:45.081868 13727 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:45.057982 23087 raft_consensus.cc:2749] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:45.004421 22421 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:45.097332 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 255537us
I20260709 12:13:45.083218 23094 raft_consensus.cc:2804] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:45.081351 23164 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:45.107249 13833 raft_consensus.cc:1240] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 28. Current term is 29. Ops: [28.16-28.16]
I20260709 12:13:45.110559 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:45.111303 13833 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:45.084637 23052 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:45.084941 23006 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 34 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:45.101712 23152 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.104175 23060 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.114027 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:45.100565 23094 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.102609 23124 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:45.113276 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:45.150456 23060 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:45.151360 23157 log.cc:927] Time spent T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 1.289s	user 0.000s	sys 0.006s
I20260709 12:13:45.153079 23060 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:45.153906 23052 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 24 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:45.155689 23006 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 34 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:45.156023 13828 raft_consensus.cc:1240] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 34 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 33. Current term is 34. Ops: []
I20260709 12:13:45.158522 23131 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 34 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:45.158617 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:45.159449 13828 raft_consensus.cc:2468] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 21.
I20260709 12:13:45.160421 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:45.160544 14414 raft_consensus.cc:1240] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:45.161165 22509 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:45.161844 23094 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Advancing to term 27
W20260709 12:13:45.166005 13680 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41688 (request call id 4121) took 2113 ms (client timeout 2176 ms). Trace:
W20260709 12:13:45.166499 13680 rpcz_store.cc:269] 0709 12:13:43.052168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:43.052286 (+   118us) service_pool.cc:224] Handling call
0709 12:13:45.165745 (+2113459us) spinlock_profiling.cc:243] Waited 680 ms on lock 0x7b5400311ad4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:45.165900 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1564563840}
I20260709 12:13:45.167850 13837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 4290) took 1711 ms. Trace:
W20260709 12:13:45.134521 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 52766.1us
I20260709 12:13:45.169981 13761 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 25.
I20260709 12:13:45.136180 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:45.171453 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:45.172181 13830 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 23.
I20260709 12:13:45.172338 13652 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:45.138450 23207 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:13:45.130396 23152 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:45.123814 22744 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.030737 23184 consensus_queue.cc:1048] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.150s
I20260709 12:13:45.161614 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:45.168366 13837 rpcz_store.cc:276] 0709 12:13:43.456497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:43.468312 (+ 11815us) service_pool.cc:224] Handling call
0709 12:13:43.468697 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:43.469867 (+  1170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:43.469910 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:43.470890 (+   980us) log.cc:844] Serialized 26 byte log entry
0709 12:13:43.712012 (+241122us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:13:43.712076 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:43.712175 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:45.150655 (+1438480us) spinlock_profiling.cc:243] Waited 5.64 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:13:45.167506 (+ 16851us) raft_consensus.cc:1685] finished
0709 12:13:45.167531 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:45.167782 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13377,"raft.queue_time_us":2361,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92,"spinlock_wait_cycles":12965248,"thread_start_us":170415,"threads_started":1,"wal-append.queue_time_us":292688}
I20260709 12:13:45.178675 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:45.138124 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:45.179520 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:45.171615 13833 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 30.
I20260709 12:13:45.180179 13837 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 25.
I20260709 12:13:45.175957 13652 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:45.143651 22421 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:45.178790 13828 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 26.
I20260709 12:13:45.181798 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:45.181962 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:45.182134 13652 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:45.180869 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:45.185102 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:45.185165 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:13:45.173880 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 137720us
I20260709 12:13:45.117306 22628 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:45.186209 13756 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 23.
I20260709 12:13:45.187719 13833 raft_consensus.cc:1275] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 12:13:45.188937 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:45.189245 13828 raft_consensus.cc:1275] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 26 index: 11. Preceding OpId from leader: term: 28 index: 12. (index mismatch)
I20260709 12:13:45.191972 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:45.175971 23207 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.191672 13652 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:45.177984 22989 raft_consensus.cc:2749] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:45.199697 23152 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:45.196237 13652 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:45.195366 23205 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.201498 13652 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:45.201315 23205 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:45.202168 14414 raft_consensus.cc:1275] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 28 index: 19. (index mismatch)
I20260709 12:13:45.202816 23188 raft_consensus.cc:2804] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Leader election won for term 30
I20260709 12:13:45.184038 22744 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:45.203397 23188 raft_consensus.cc:697] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 30 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:45.204005 23205 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:45.196610 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:45.204358 23188 consensus_queue.cc:237] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 29.18, Last appended by leader: 18, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:45.204991 22744 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:45.205977 23087 raft_consensus.cc:2804] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:45.206055 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:45.206518 23087 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.206980 23087 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:45.207492 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:13:45.197278 13800 leader_election.cc:336] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.579s (SENT)
I20260709 12:13:45.210438 13652 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:45.210843 14380 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:45.211254 13756 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 24.
I20260709 12:13:45.199239 13830 raft_consensus.cc:1240] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:45.178069 23175 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.195624 22994 raft_consensus.cc:2749] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:45.184141 23184 consensus_queue.cc:1243] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer b98d2519bb504dc6905ed2ede4571835 log is divergent from this leader: its last log entry 19.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 12:13:45.188330 23079 raft_consensus.cc:2749] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:45.213490 22770 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 32 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:45.214062 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:45.216168 23179 raft_consensus.cc:2749] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:13:45.197367 22908 raft_consensus.cc:2804] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:45.219955 14380 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:45.215998 22989 raft_consensus.cc:2804] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:45.223335 23057 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.157648 23123 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:45.226498 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:45.221325 23175 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:45.233121 13756 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:45.206981 22628 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:45.211560 23207 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:13:45.227836 23025 raft_consensus.cc:2749] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:45.227857 22908 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.231817 22989 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.237748 22096 consensus_queue.cc:1048] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:45.235409 23057 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:45.234126 22770 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:45.234652 22994 consensus_queue.cc:1048] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.021s
I20260709 12:13:45.246039 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:45.256840 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:45.246289 22908 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:45.259819 22994 consensus_queue.cc:1048] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:13:45.212489 22997 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:45.246485 22989 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:45.262967 23148 raft_consensus.cc:3055] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:45.263487 23148 raft_consensus.cc:740] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:45.264823 22997 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:45.243250 23000 consensus_queue.cc:1059] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.023s
I20260709 12:13:45.267060 23000 raft_consensus.cc:3055] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:45.267506 23000 raft_consensus.cc:740] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 24 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:45.250263 23057 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:45.268522 23000 consensus_queue.cc:260] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:45.251643 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 31 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:45.264437 23148 consensus_queue.cc:260] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 21.10, Last appended by leader: 10, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:45.279313 23148 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:45.269656 23000 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:45.256273 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:45.284480 13652 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:45.285697 14414 raft_consensus.cc:2393] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 31 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 31: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:13:45.258129 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:45.273085 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:45.273195 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:45.276798 13758 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 30.
I20260709 12:13:45.307391 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:45.312661 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:13:45.316933 13726 leader_election.cc:336] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 2.176s (SENT)
I20260709 12:13:45.250398 22963 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:45.317724 13726 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:45.323961 13834 raft_consensus.cc:2410] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 28 because replica has last-logged OpId of term: 26 index: 19, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 18.
I20260709 12:13:45.238957 23215 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 33 FOLLOWER]: Leader pre-election won for term 34
I20260709 12:13:45.251247 22770 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:45.300550 23086 raft_consensus.cc:2749] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:45.325673 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:45.242471 23124 consensus_queue.cc:1048] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.084s
W20260709 12:13:45.322460 23214 log.cc:927] Time spent T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:13:45.332628 13756 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 25.
I20260709 12:13:45.337528 13759 raft_consensus.cc:2393] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 22: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:45.324883 22509 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:45.341048 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:45.274612 23173 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:45.344247 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 34 candidate_status { last_received { term: 33 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:45.345522 13652 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:45.348897 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 29 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:45.335377 22994 consensus_queue.cc:1048] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.015s
W20260709 12:13:45.362339 23161 log.cc:927] Time spent T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 1.357s	user 0.004s	sys 0.000s
I20260709 12:13:45.363916 13835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 4292) took 1875 ms. Trace:
I20260709 12:13:45.364444 13835 rpcz_store.cc:276] 0709 12:13:43.488509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:43.521648 (+ 33139us) service_pool.cc:224] Handling call
0709 12:13:43.531088 (+  9440us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:43.531497 (+   409us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:43.531526 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:43.557399 (+ 25873us) log.cc:844] Serialized 26 byte log entry
0709 12:13:43.789827 (+232428us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:13:43.789939 (+   112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:43.790053 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:45.325927 (+1535874us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:13:45.363446 (+ 37519us) raft_consensus.cc:1685] finished
0709 12:13:45.363489 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:45.363826 (+   337us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7582,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"spinlock_wait_cycles":25747328,"thread_start_us":200324,"threads_started":1,"wal-append.queue_time_us":294547}
I20260709 12:13:45.331072 23215 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 33 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.374730 23215 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:13:45.330689 23120 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:45.382205 23123 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 29 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:45.384217 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 29 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:45.384891 14410 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:45.388396 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 34 candidate_status { last_received { term: 33 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:45.389151 13836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 4293) took 1900 ms. Trace:
I20260709 12:13:45.389654 13836 rpcz_store.cc:276] 0709 12:13:43.488938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:43.527076 (+ 38138us) service_pool.cc:224] Handling call
0709 12:13:43.581446 (+ 54370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:43.583732 (+  2286us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:43.583780 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:43.590652 (+  6872us) log.cc:844] Serialized 26 byte log entry
0709 12:13:43.789924 (+199272us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:13:43.789967 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:43.790038 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:44.288953 (+498915us) spinlock_profiling.cc:243] Waited 21.1 ms on lock 0x7b48001bd758. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92ceb6aa1 00007fa92ceadb37 00007fa92cead9ca 00007fa92cfa526f 00007fa92cfa4f37 00007fa92cfb955c 00007fa92cfb9508 00007fa92cfb9488 00007fa92cfb9443 00007fa92cfb86ec 00007fa92bee2a96
0709 12:13:44.718791 (+429838us) spinlock_profiling.cc:243] Waited 37.4 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:13:44.926476 (+207685us) raft_consensus.cc:1685] finished
0709 12:13:44.926513 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:45.388947 (+462434us) spinlock_profiling.cc:243] Waited 54 ms on lock 0x7b54000daf50. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:45.389084 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1861,"raft.queue_time_us":2561,"raft.run_cpu_time_us":3507,"raft.run_wall_time_us":704565,"spinlock_wait_cycles":258782720,"thread_start_us":102343,"threads_started":1,"wal-append.queue_time_us":179726}
I20260709 12:13:45.330725 23057 consensus_queue.cc:1059] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 23.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.061s
I20260709 12:13:45.392778 22994 raft_consensus.cc:3055] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:45.393267 22994 raft_consensus.cc:740] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:45.393646 22507 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:13:45.394142 22994 consensus_queue.cc:260] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:45.394881 23173 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:45.395556 22994 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:13:45.402630 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 57207.8us
I20260709 12:13:45.346928 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 34 candidate_status { last_received { term: 32 index: 19 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:45.369052 23087 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:45.433874 13759 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 33.
I20260709 12:13:45.421684 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:45.407825 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 31 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:45.442005 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:45.442849 13761 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 27.
I20260709 12:13:45.443969 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 29 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:45.407030 22509 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:45.444068 23087 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:45.444933 13761 raft_consensus.cc:2393] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 29: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:45.448115 13761 raft_consensus.cc:1240] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:45.446789 23087 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.450227 13762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:39554 (request call id 100) took 2098 ms. Trace:
I20260709 12:13:45.450773 23087 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:45.426892 22908 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:45.454445 23087 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:45.455766 22908 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:45.457139 13760 raft_consensus.cc:1240] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 25. Current term is 26. Ops: [25.16-25.16]
I20260709 12:13:45.457374 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:13:45.408367 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:45.446614 22509 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:45.469759 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:45.437994 23049 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:45.477272 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:45.477264 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:45.485028 23215 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 34 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:45.549443 13688 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 23.
I20260709 12:13:45.437510 23207 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 32 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:45.495020 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:45.431847 22992 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:45.496474 23094 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:45.506861 13687 pending_rounds.cc:85] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 14
I20260709 12:13:45.555887 13687 pending_rounds.cc:107] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 19.15
I20260709 12:13:45.556416 13687 raft_consensus.cc:2889] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:45.432693 23175 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:13:45.517282 23187 log.cc:927] Time spent T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 1.051s	user 0.000s	sys 0.003s
W20260709 12:13:45.524401 23209 log.cc:927] Time spent T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.507s	user 0.001s	sys 0.001s
I20260709 12:13:45.527429 22781 raft_consensus.cc:3060] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:45.484690 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:45.532670 13763 raft_consensus.cc:1275] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 26 index: 13. Preceding OpId from leader: term: 28 index: 14. (index mismatch)
I20260709 12:13:45.539601 13836 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:13:45.540364 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:45.545307 14414 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 27.
I20260709 12:13:45.566401 14409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 1491) took 1325 ms. Trace:
I20260709 12:13:45.450785 13762 rpcz_store.cc:276] 0709 12:13:43.367919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:43.396300 (+ 28381us) service_pool.cc:224] Handling call
0709 12:13:45.450036 (+2053736us) spinlock_profiling.cc:243] Waited 481 ms on lock 0x7b540038b8d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f87853 00007fa92cf5560a 00007fa9264db7d4 00007fa9264db762 00007fa9264db691 00007fa9264db60c 00007fa9264da8c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:45.450129 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1105440000}
W20260709 12:13:45.547957 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:45.456100 23206 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:45.420017 23173 raft_consensus.cc:2749] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:45.587512 13756 raft_consensus.cc:2368] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 32 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 31. Current term is 32.
I20260709 12:13:45.582480 13727 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:45.550429 13760 raft_consensus.cc:1275] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 12:13:45.534529 22770 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:45.567896 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:45.589397 13828 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:13:45.568415 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:45.569826 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:45.566888 14409 rpcz_store.cc:276] 0709 12:13:44.240771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:44.241001 (+   230us) service_pool.cc:224] Handling call
0709 12:13:44.251629 (+ 10628us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:44.771406 (+519777us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:45.566157 (+794751us) spinlock_profiling.cc:243] Waited 430 ms on lock 0x7b540016b7d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:45.566336 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":989215104}
I20260709 12:13:45.591070 13835 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:45.586807 14410 raft_consensus.cc:2468] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 29.
I20260709 12:13:45.595655 13800 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:45.555015 23087 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.406795 23164 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:45.602779 14379 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:45.592748 13727 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:45.606523 14379 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:45.612411 14379 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:45.610221 22628 raft_consensus.cc:2804] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:45.598186 23206 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:45.625095 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:45.606848 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:13:45.610798 23186 log.cc:927] Time spent T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:13:45.637357 13829 raft_consensus.cc:1240] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 25. Current term is 26. Ops: [25.16-25.16]
I20260709 12:13:45.556239 23049 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:45.633476 13836 raft_consensus.cc:2468] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 22.
I20260709 12:13:45.647377 13828 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 24.
I20260709 12:13:45.654616 13835 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 26.
I20260709 12:13:45.648157 13755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 3937) took 1726 ms. Trace:
I20260709 12:13:45.632093 23125 raft_consensus.cc:2804] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:13:45.604936 23119 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:45.613976 23124 raft_consensus.cc:2749] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:13:45.647573 13834 raft_consensus.cc:2393] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 24: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:45.635480 23193 raft_consensus.cc:2804] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:45.632217 22628 raft_consensus.cc:697] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 25 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:45.658202 13755 rpcz_store.cc:276] 0709 12:13:43.921516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:43.921733 (+   217us) service_pool.cc:224] Handling call
0709 12:13:43.922230 (+   497us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:44.224691 (+302461us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:13:44.224747 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:44.225688 (+   941us) log.cc:844] Serialized 26 byte log entry
0709 12:13:44.307606 (+ 81918us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:13:44.307647 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:44.307722 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:45.516837 (+1209115us) spinlock_profiling.cc:243] Waited 3.53 ms on lock 0x7b24002bbf68. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924d269c4 00007fa924d24acb 00007fa924edfdc9 00007fa924edfa55 00007fa924edf09d 00007fa927b1110e 00007fa927b2888c 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221
0709 12:13:45.635139 (+118302us) raft_consensus.cc:1685] finished
0709 12:13:45.635159 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:45.648077 (+ 12918us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":55541,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":14481,"spinlock_wait_cycles":8118016,"thread_start_us":383273,"threads_started":2,"wal-append.queue_time_us":210571}
I20260709 12:13:45.611035 23087 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:45.666858 23193 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:45.672322 23193 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:45.679176 22628 consensus_queue.cc:237] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:45.684865 23125 raft_consensus.cc:697] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:45.685252 13755 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:39554
I20260709 12:13:45.686304 13755 raft_consensus.cc:606] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:45.686774 13755 raft_consensus.cc:614] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:45.599903 23008 consensus_queue.cc:1059] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 26.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.056s
I20260709 12:13:45.646963 23169 raft_consensus.cc:2749] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:45.599319 22770 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:45.689500 22963 consensus_queue.cc:1059] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:45.685889 23119 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:45.702966 23215 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 34 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:45.704140 23221 log.cc:927] Time spent T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 12:13:45.612629 23148 consensus_queue.cc:1059] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 25.18, Next index: 19, Last known committed idx: 17, Time since last communication: 0.082s
I20260709 12:13:45.648677 23084 consensus_queue.cc:1048] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.048s
I20260709 12:13:45.693919 23087 leader_election.cc:290] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:45.704553 23119 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:45.716972 14410 raft_consensus.cc:1240] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 28. Current term is 29. Ops: [27.18-28.19]
I20260709 12:13:45.718710 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 34 candidate_status { last_received { term: 32 index: 19 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:45.719393 13755 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:13:45.669397 22989 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:45.727468 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:45.723984 14410 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087"
dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
mode: GRACEFUL
new_leader_uuid: "b98d2519bb504dc6905ed2ede4571835"
 from {username='slave'} at 127.0.0.1:46814
W20260709 12:13:45.724663 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:45.727797 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:45.728482 14410 raft_consensus.cc:606] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 32 LEADER]: Received request to transfer leadership to TS b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:45.728878 13835 raft_consensus.cc:2368] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 23. Current term is 24.
I20260709 12:13:45.729801 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:45.730533 14409 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:45.733609 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:45.741307 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:45.739066 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 32 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:45.746644 13835 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 31.
I20260709 12:13:45.739073 23125 consensus_queue.cc:237] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 27.18, Last appended by leader: 18, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:45.765841 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:45.769179 13834 raft_consensus.cc:1240] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 29. Current term is 30. Ops: []
I20260709 12:13:45.772949 13755 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 34 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 34.
I20260709 12:13:45.733399 23123 consensus_queue.cc:1059] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 33.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.025s
I20260709 12:13:45.779404 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:45.748097 22992 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:45.780920 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:45.774519 14379 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 34 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:45.786375 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 32 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:45.787346 14414 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:13:45.802299 14414 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 32.
I20260709 12:13:45.807598 13679 raft_consensus.cc:1275] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 27 index: 20. (index mismatch)
I20260709 12:13:45.763594 23094 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:45.812677 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 29 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:45.815001 13680 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 24.
I20260709 12:13:45.818789 14409 raft_consensus.cc:2468] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 22.
I20260709 12:13:45.821786 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:45.785077 23207 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 32 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:45.832141 13828 raft_consensus.cc:1275] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 27 index: 15. Preceding OpId from leader: term: 29 index: 16. (index mismatch)
I20260709 12:13:45.819033 23129 raft_consensus.cc:3055] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 33 LEADER]: Stepping down as leader of term 33
I20260709 12:13:45.837061 23049 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:45.819732 23054 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 34 FOLLOWER]: Leader election won for term 34
I20260709 12:13:45.840492 13834 raft_consensus.cc:1240] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:45.841246 13828 raft_consensus.cc:1240] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 28. Current term is 29. Ops: []
I20260709 12:13:45.843180 13836 raft_consensus.cc:1275] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 31 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 30 index: 17. Preceding OpId from leader: term: 31 index: 18. (index mismatch)
I20260709 12:13:45.825747 23025 raft_consensus.cc:2804] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:45.843725 13837 raft_consensus.cc:1275] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 28 index: 16. Preceding OpId from leader: term: 30 index: 17. (index mismatch)
I20260709 12:13:45.845156 13684 raft_consensus.cc:1275] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 31 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 30 index: 18. Preceding OpId from leader: term: 31 index: 18. (term mismatch)
I20260709 12:13:45.910040 13684 pending_rounds.cc:85] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 17
I20260709 12:13:45.855631 23206 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:45.911058 13684 pending_rounds.cc:107] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 30.18
I20260709 12:13:45.883247 23054 raft_consensus.cc:697] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 34 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:45.911501 13684 raft_consensus.cc:2889] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 31 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:45.912375 23054 consensus_queue.cc:237] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 32.19, Last appended by leader: 19, Current term: 34, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:45.861585 13831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 3769) took 2463 ms. Trace:
I20260709 12:13:45.914085 13831 rpcz_store.cc:276] 0709 12:13:43.397714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:43.401838 (+  4124us) service_pool.cc:224] Handling call
0709 12:13:44.710769 (+1308931us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:44.711104 (+   335us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:13:44.711132 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:44.711172 (+    40us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:13:44.711201 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:44.711279 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:45.569164 (+857885us) spinlock_profiling.cc:243] Waited 14.5 ms on lock 0x7b1800193d80. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e6e2a6 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4
0709 12:13:45.861343 (+292179us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b54000db450. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8c8ad 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:45.861479 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":135,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":44525,"spinlock_wait_cycles":3019917568}
I20260709 12:13:45.880729 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 32 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:45.916181 13835 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:13:45.870869 23120 raft_consensus.cc:2749] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:45.861459 22989 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:45.840552 23129 raft_consensus.cc:740] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 33 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:45.906694 23131 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.919099 23131 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:45.856478 22770 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:45.922250 23129 consensus_queue.cc:260] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 33.16, Last appended by leader: 16, Current term: 33, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:45.927556 23131 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:45.928637 13755 raft_consensus.cc:1240] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 25. Current term is 26. Ops: [25.16-25.16]
I20260709 12:13:45.941555 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:45.942678 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:45.943171 13763 raft_consensus.cc:1275] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 26 index: 11. Preceding OpId from leader: term: 28 index: 12. (index mismatch)
I20260709 12:13:45.943421 13762 raft_consensus.cc:1240] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 21. Current term is 22. Ops: [21.10-21.10]
I20260709 12:13:45.943809 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:45.943373 13759 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 28.
I20260709 12:13:45.944722 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:45.950883 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:45.951798 13759 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:45.932933 23129 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:13:45.957527 13761 raft_consensus.cc:1275] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
W20260709 12:13:45.965683 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 330061us
I20260709 12:13:45.974323 13800 leader_election.cc:400] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 31 election: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 32 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 31. Current term is 32.
I20260709 12:13:45.974834 13800 leader_election.cc:403] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 31 election: Cancelling election due to peer responding with higher term
I20260709 12:13:45.933898 23080 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.987529 23152 raft_consensus.cc:3055] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:45.988076 23152 raft_consensus.cc:740] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:46.001598 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:45.939800 23063 consensus_queue.cc:1059] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.046s
W20260709 12:13:46.012449 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:46.004477 13759 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 26.
I20260709 12:13:46.004992 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:46.017316 13763 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 25.
I20260709 12:13:46.018414 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:46.005944 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:46.019973 13756 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 23.
I20260709 12:13:45.959640 23120 consensus_queue.cc:1048] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 12:13:46.030992 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 34 candidate_status { last_received { term: 32 index: 19 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:46.020885 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:46.007409 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 32 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:46.019017 13763 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 25.
I20260709 12:13:46.021919 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:46.036103 13760 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:46.036182 13651 leader_election.cc:304] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:13:46.023119 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:46.026229 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:45.983695 23131 consensus_queue.cc:1048] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.038s
I20260709 12:13:46.024029 13800 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:46.056275 14380 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:46.037539 13758 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:46.047086 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:46.092226 13761 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:46.037598 13651 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:46.003633 22989 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.989873 23080 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:46.061618 23225 log.cc:927] Time spent T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.216s	user 0.000s	sys 0.001s
I20260709 12:13:46.027679 23087 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.011854 22781 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
W20260709 12:13:46.059624 23222 log.cc:927] Time spent T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
I20260709 12:13:46.115166 13754 raft_consensus.cc:1240] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 28. Current term is 29. Ops: []
I20260709 12:13:46.096516 13835 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 32.
I20260709 12:13:46.147874 13758 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 24.
I20260709 12:13:46.150792 13760 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 27.
I20260709 12:13:46.054755 22908 raft_consensus.cc:2804] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:46.154165 22908 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:46.154883 22908 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:46.020174 23173 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:46.158155 23173 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:46.160992 23173 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:46.100281 23119 raft_consensus.cc:2749] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 12:13:46.176831 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 139334us
I20260709 12:13:46.178011 13651 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:46.178372 13761 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 24.
W20260709 12:13:46.179234 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 155315us
I20260709 12:13:46.008798 23152 consensus_queue.cc:260] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:46.183387 13651 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:46.161752 23173 raft_consensus.cc:2749] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:46.163790 23006 raft_consensus.cc:2804] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:46.164150 23060 raft_consensus.cc:2749] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 32 FOLLOWER]: Leader election lost for term 31. Reason: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 32 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 31. Current term is 32.
I20260709 12:13:46.187669 13800 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:46.114158 22989 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:46.189394 13651 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:46.163307 22781 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:46.186880 23094 raft_consensus.cc:2804] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:46.146149 23087 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:46.207456 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:46.191740 23006 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:46.223846 13729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:46.200110 23000 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:13:46.208920 23193 consensus_meta.cc:287] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.536s	user 0.014s	sys 0.000s
I20260709 12:13:46.216672 23173 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:46.217408 23049 raft_consensus.cc:2804] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:46.210866 23094 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:46.225394 23006 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:46.249209 23094 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:46.249378 23125 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.234225 23008 raft_consensus.cc:2804] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:46.258091 13684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 4104) took 3708 ms. Trace:
W20260709 12:13:46.256572 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 57829.3us
I20260709 12:13:46.260691 13684 rpcz_store.cc:276] 0709 12:13:42.550160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:42.764887 (+214727us) service_pool.cc:224] Handling call
0709 12:13:42.765194 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:45.912147 (+3146953us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:46.253805 (+341658us) spinlock_profiling.cc:243] Waited 3.08 s on lock 0x7b54002bf2d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:46.258001 (+  4196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7079492480}
I20260709 12:13:46.262969 13651 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:46.264442 13651 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:46.264639 23148 raft_consensus.cc:2804] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:46.265065 23148 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:46.265429 23148 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:46.266196 13651 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:46.266774 22989 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:46.267177 23149 raft_consensus.cc:2749] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:46.268102 22989 raft_consensus.cc:2749] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:46.268029 23149 consensus_queue.cc:1048] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:46.269078 22989 consensus_queue.cc:1048] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:13:46.267933 13651 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:46.237304 23193 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:46.234359 23000 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:46.271095 13651 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:46.271922 13651 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:46.272847 14410 raft_consensus.cc:1240] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 27. Current term is 28. Ops: [27.19-27.19]
I20260709 12:13:46.247609 23131 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.275785 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:46.246311 23049 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:46.272914 13651 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:46.283437 13651 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:46.272861 23000 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:46.289285 23149 raft_consensus.cc:2804] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:46.320604 23149 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:46.321077 23149 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:46.287814 23049 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:13:46.326359 23232 log.cc:927] Time spent T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 12:13:46.327276 13761 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379"
dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:39554
W20260709 12:13:46.327857 23226 log.cc:927] Time spent T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 12:13:46.327970 13761 raft_consensus.cc:606] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 LEADER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:46.328274 22781 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:46.318177 22994 raft_consensus.cc:2804] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:46.319902 23245 raft_consensus.cc:2804] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader election won for term 27
W20260709 12:13:46.329660 23233 log.cc:927] Time spent T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 12:13:46.281131 23240 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:46.330026 22994 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:46.261845 23125 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:46.315888 23243 raft_consensus.cc:2804] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:46.294210 23131 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:46.390556 13755 raft_consensus.cc:1240] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 25. Current term is 26. Ops: [25.16-25.16]
W20260709 12:13:46.343587 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 80254.8us
I20260709 12:13:46.354501 23087 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:46.342402 22994 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:46.360265 23242 consensus_queue.cc:1059] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 25.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:13:46.406211 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:46.363806 23093 raft_consensus.cc:3055] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:13:46.340443 23245 raft_consensus.cc:697] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 27 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:46.371474 23006 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:46.374333 23243 raft_consensus.cc:697] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 26 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:46.375049 23094 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:46.375991 13727 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:46.376089 23173 raft_consensus.cc:2749] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:46.376654 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:46.377277 14410 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c95811190f014949bb25448e8db1040e"
dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
mode: GRACEFUL
new_leader_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:46814
I20260709 12:13:46.379134 13835 raft_consensus.cc:1240] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 34 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 33. Current term is 34. Ops: []
I20260709 12:13:46.379930 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 29 candidate_status { last_received { term: 26 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:46.380872 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:46.381815 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:46.382023 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:46.430260 14410 raft_consensus.cc:606] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 17 LEADER]: Received request to transfer leadership to TS 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:46.359789 23125 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:46.404628 13830 raft_consensus.cc:1240] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:46.354629 23080 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:46.404021 23052 consensus_queue.cc:1059] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.027s
I20260709 12:13:46.442045 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:13:46.443367 23193 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 28 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:46.450302 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:13:46.455457 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 79565.7us
I20260709 12:13:46.466042 23129 raft_consensus.cc:2749] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:46.466315 23080 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:46.467315 23080 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:46.480567 13727 leader_election.cc:400] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 election: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 23. Current term is 24.
I20260709 12:13:46.481215 13727 leader_election.cc:403] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 election: Cancelling election due to peer responding with higher term
W20260709 12:13:46.483125 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:46.399924 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 116552us
I20260709 12:13:46.486941 13651 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:46.408635 23093 raft_consensus.cc:740] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
W20260709 12:13:46.461650 23230 log.cc:927] Time spent T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.252s	user 0.001s	sys 0.001s
I20260709 12:13:46.495466 13652 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:46.489821 23025 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:46.498504 13727 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:46.503361 13829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35422 (request call id 1897) took 1251 ms. Trace:
I20260709 12:13:46.504451 13727 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:46.506863 14414 raft_consensus.cc:1275] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 12:13:46.503911 13829 rpcz_store.cc:276] 0709 12:13:45.251881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:45.252028 (+   147us) service_pool.cc:224] Handling call
0709 12:13:45.252377 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:45.645742 (+393365us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:46.503124 (+857382us) spinlock_profiling.cc:243] Waited 385 ms on lock 0x7b54000aebd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:46.503302 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":884646656}
I20260709 12:13:46.511019 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:46.478652 23094 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:46.477211 23131 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:46.471650 23080 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:46.511365 14379 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:13:46.507828 23176 raft_consensus.cc:2749] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:46.519842 23243 consensus_queue.cc:237] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.13, Last appended by leader: 13, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:46.494163 23169 raft_consensus.cc:3055] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:13:46.521158 23245 consensus_queue.cc:237] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.17, Last appended by leader: 17, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:46.522070 23057 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:46.501343 22989 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 33 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:46.531699 23120 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:13:46.522859 22781 raft_consensus.cc:2804] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:46.522737 23149 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:46.508096 23240 raft_consensus.cc:2804] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:46.469734 23049 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:46.525833 23006 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:46.493227 23129 raft_consensus.cc:2749] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader election lost for term 23. Reason: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 23. Current term is 24.
I20260709 12:13:46.506456 23025 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:46.543932 14379 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:13:46.548014 23086 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:46.531373 23008 raft_consensus.cc:697] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 24 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:46.548861 23193 raft_consensus.cc:2804] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:46.556085 23148 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:46.562019 23057 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:46.597012 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 53191us
I20260709 12:13:46.526604 23084 consensus_queue.cc:1048] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.041s
I20260709 12:13:46.547020 23169 raft_consensus.cc:740] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 25 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:46.526360 23093 consensus_queue.cc:260] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:46.601873 13688 raft_consensus.cc:1240] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:46.549711 23000 consensus_queue.cc:1048] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 18, Time since last communication: 0.044s
I20260709 12:13:46.550881 22994 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:46.598804 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 54571us
I20260709 12:13:46.578356 22781 raft_consensus.cc:697] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 22 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:46.574182 22989 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:46.605726 23063 raft_consensus.cc:2804] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:46.576884 22908 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:46.599218 23193 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:13:46.632707 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 137166us
I20260709 12:13:46.600263 23086 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:46.603261 23125 consensus_queue.cc:1048] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.024s
I20260709 12:13:46.643193 13727 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 32 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:46.652114 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 30 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:46.628090 23093 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:46.659579 13758 raft_consensus.cc:1275] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 12:13:46.630308 23193 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:46.662604 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 29 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:46.663357 13684 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:46.663364 13679 raft_consensus.cc:1240] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 26. Current term is 27. Ops: [26.18-26.18]
I20260709 12:13:46.665030 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:46.665048 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:46.668608 13681 raft_consensus.cc:2368] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 23. Current term is 24.
I20260709 12:13:46.669878 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:46.662770 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 30 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:46.673465 13680 raft_consensus.cc:3060] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:46.683254 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:46.684212 13682 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:13:46.687644 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 154967us
I20260709 12:13:46.689617 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:46.690523 13755 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:46.623023 23120 consensus_queue.cc:1059] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 26.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.033s
I20260709 12:13:46.694656 13832 raft_consensus.cc:1275] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 29 index: 18. Preceding OpId from leader: term: 30 index: 19. (index mismatch)
I20260709 12:13:46.695794 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:46.696069 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:46.696136 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:46.696558 13835 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 25.
I20260709 12:13:46.696873 13832 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:46.697067 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:46.698976 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:46.699622 13679 raft_consensus.cc:2393] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 25: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:46.704162 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:46.705490 13836 raft_consensus.cc:2393] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 29: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:46.706775 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 32 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:46.707226 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:46.623232 23123 consensus_queue.cc:1048] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.033s
I20260709 12:13:46.714076 13687 raft_consensus.cc:1275] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 31 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 30 index: 17. Preceding OpId from leader: term: 31 index: 18. (index mismatch)
I20260709 12:13:46.718152 23240 raft_consensus.cc:697] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 24 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
W20260709 12:13:46.718734 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 70883.7us
I20260709 12:13:46.721683 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 29 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:46.730257 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:46.731096 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 32 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:46.658320 23206 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 32 FOLLOWER]: Leader election won for term 32
I20260709 12:13:46.727910 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:46.766450 13687 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 26.
I20260709 12:13:46.650346 22770 consensus_queue.cc:1048] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.078s
W20260709 12:13:46.750730 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 93368.2us
I20260709 12:13:46.680106 23175 consensus_queue.cc:1059] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 26.18, Next index: 19, Last known committed idx: 17, Time since last communication: 0.081s
I20260709 12:13:46.752079 13830 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 31.
I20260709 12:13:46.752833 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:46.691095 23094 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.792932 23094 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:46.751874 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:46.760766 23250 raft_consensus.cc:3055] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:13:46.795476 13831 raft_consensus.cc:2393] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 26: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:46.751606 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:46.751098 13679 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 26.
I20260709 12:13:46.739974 13680 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 30.
I20260709 12:13:46.648343 23176 consensus_queue.cc:1059] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 28.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.074s
I20260709 12:13:46.797425 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:46.727239 22992 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:46.722692 23229 consensus_queue.cc:1059] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 33.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.103s
I20260709 12:13:46.753640 23253 consensus_queue.cc:1059] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 25.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.087s
I20260709 12:13:46.695201 23008 consensus_queue.cc:237] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:46.719830 22781 consensus_queue.cc:237] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:46.760120 13682 raft_consensus.cc:2410] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 26 because replica has last-logged OpId of term: 25 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 15.
I20260709 12:13:46.799490 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:46.919358 13680 raft_consensus.cc:2393] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 27: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:46.795570 23131 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:46.931629 22992 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:46.784027 23206 raft_consensus.cc:697] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 32 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:46.745671 13755 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 26.
I20260709 12:13:46.934140 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:13:46.835389 23257 log.cc:927] Time spent T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:13:46.920642 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:46.837294 23125 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.836141 23148 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:46.799788 23250 raft_consensus.cc:740] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:46.924618 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:46.924499 13800 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:13:46.927232 13679 raft_consensus.cc:2410] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 26 because replica has last-logged OpId of term: 25 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 15.
W20260709 12:13:46.982365 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 58007.6us
I20260709 12:13:46.922415 23049 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:46.781584 23129 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.782505 23120 raft_consensus.cc:3055] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:46.691468 23169 consensus_queue.cc:260] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.16, Last appended by leader: 16, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:46.798926 13832 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 27.
I20260709 12:13:46.990619 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 26 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:13:46.956380 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:46.946280 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 186932us
I20260709 12:13:46.855154 23119 raft_consensus.cc:993] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f: : Instructing follower b98d2519bb504dc6905ed2ede4571835 to start an election
I20260709 12:13:46.962893 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:13:46.979172 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:46.980106 13684 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 29.
I20260709 12:13:46.982669 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 29 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:46.802065 13834 raft_consensus.cc:2393] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 27: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
W20260709 12:13:46.983170 13800 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.721s (SENT) [suppressed 27 similar messages]
I20260709 12:13:46.789497 23063 raft_consensus.cc:697] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 24 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:46.942375 23057 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:46.996711 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:46.997270 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:46.997810 13679 raft_consensus.cc:2368] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 29. Current term is 30.
I20260709 12:13:46.986913 23242 raft_consensus.cc:2764] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election decision vote started in defunct term 25: won
I20260709 12:13:47.004052 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:46.978703 22770 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:47.005614 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:47.006506 13684 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 25.
I20260709 12:13:46.991676 22994 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:46.933583 23131 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:47.010946 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:13:47.012734 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 256134us
I20260709 12:13:46.998657 23229 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:47.012790 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 34 candidate_status { last_received { term: 33 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:13:47.027302 13800 leader_election.cc:336] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.903s (SENT)
W20260709 12:13:47.008229 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 325759us
I20260709 12:13:46.992697 23176 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:47.032600 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:47.032932 13836 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 32 FOLLOWER]: Advancing to term 34
I20260709 12:13:47.033335 13684 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 27.
I20260709 12:13:47.034940 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 34 candidate_status { last_received { term: 33 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:47.035712 13684 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 33 FOLLOWER]: Advancing to term 34
W20260709 12:13:47.035765 13800 leader_election.cc:336] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.918s (SENT)
I20260709 12:13:47.002111 23263 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.999330 23094 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:46.786194 23240 consensus_queue.cc:237] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:47.030315 14414 raft_consensus.cc:1240] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:47.030283 14379 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:47.031116 13726 leader_election.cc:400] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 election: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 23. Current term is 24.
I20260709 12:13:46.983106 23125 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:46.990717 23120 raft_consensus.cc:740] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:47.047734 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 29 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:47.049541 13726 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:47.036512 13800 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:47.039319 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:47.040104 13652 leader_election.cc:304] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:13:47.004917 23279 raft_consensus.cc:3055] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 28 LEADER]: Stepping down as leader of term 28
I20260709 12:13:47.005124 22989 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:46.990463 23129 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:47.056283 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 30 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:47.056982 13679 raft_consensus.cc:2393] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 24: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:47.057615 13685 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 29.
W20260709 12:13:47.070412 13800 leader_election.cc:336] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.924s (SENT)
I20260709 12:13:47.071115 13800 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:47.031935 23124 raft_consensus.cc:1081] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 32 LEADER]: Signalling peer b98d2519bb504dc6905ed2ede4571835 to start an election
I20260709 12:13:47.074738 13652 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:13:47.092124 13800 leader_election.cc:336] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.948s (SENT)
I20260709 12:13:47.011761 22770 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:47.097061 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 68318.9us
I20260709 12:13:47.159483 13727 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:47.161939 13800 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:47.108865 13684 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 34 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 34.
W20260709 12:13:47.163087 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:47.160343 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 130131us
I20260709 12:13:47.166296 14379 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:13:47.090269 23247 log.cc:927] Time spent T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:13:47.057229 23279 raft_consensus.cc:740] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 28 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:47.045949 23164 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:13:47.157328 23276 log.cc:927] Time spent T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 12:13:47.038370 23057 consensus_queue.cc:1048] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.093s
I20260709 12:13:47.174562 13836 raft_consensus.cc:1275] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 34 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 32 index: 19. Preceding OpId from leader: term: 34 index: 20. (index mismatch)
I20260709 12:13:47.057394 23086 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:47.176994 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 29 candidate_status { last_received { term: 26 index: 11 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:47.041757 23176 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:47.158469 23261 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.177220 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 29 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:47.097615 22989 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:13:47.177489 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 85360.8us
I20260709 12:13:47.090258 23008 raft_consensus.cc:2749] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
I20260709 12:13:47.181377 14414 raft_consensus.cc:1240] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 27. Current term is 28. Ops: [27.19-27.19]
W20260709 12:13:47.181502 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 106820us
I20260709 12:13:47.040750 23283 consensus_queue.cc:1059] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.146s
I20260709 12:13:47.179593 23049 raft_consensus.cc:2749] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:47.091466 23242 raft_consensus.cc:2749] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:47.043577 22997 consensus_queue.cc:1048] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.129s
I20260709 12:13:47.021838 23206 consensus_queue.cc:237] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 30.20, Last appended by leader: 20, Current term: 32, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:47.222471 22992 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:47.195868 13684 raft_consensus.cc:2393] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 29: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:47.224685 13684 raft_consensus.cc:1275] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 28 index: 16. Preceding OpId from leader: term: 30 index: 17. (index mismatch)
W20260709 12:13:47.225348 23193 consensus_meta.cc:287] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.511s	user 0.010s	sys 0.000s
I20260709 12:13:47.099746 22994 raft_consensus.cc:2804] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:13:47.226083 22994 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 31 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:47.226656 22994 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:13:47.226776 23131 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:47.038564 23250 consensus_queue.cc:260] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 27.19, Last appended by leader: 19, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:47.228019 23250 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:47.163781 23119 raft_consensus.cc:2749] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:13:47.231069 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:47.208618 22989 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:47.198292 23252 raft_consensus.cc:2749] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:13:47.184903 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:47.233376 13652 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:47.048889 23263 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:47.242800 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 30 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:47.243489 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:47.243595 13828 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 29.
I20260709 12:13:47.244191 13832 raft_consensus.cc:2393] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 29: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:47.218348 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:47.244887 13831 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:47.219372 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:13:47.236928 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 145738us
I20260709 12:13:47.236478 13684 raft_consensus.cc:1240] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 34 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 33. Current term is 34. Ops: []
W20260709 12:13:47.238276 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 72105.5us
I20260709 12:13:47.239207 13685 raft_consensus.cc:1275] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 27 index: 15. Preceding OpId from leader: term: 29 index: 16. (index mismatch)
I20260709 12:13:47.237644 13754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 3960) took 1291 ms. Trace:
I20260709 12:13:47.247989 13754 rpcz_store.cc:276] 0709 12:13:45.946121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:45.948247 (+  2126us) service_pool.cc:224] Handling call
0709 12:13:45.948575 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:46.163455 (+214880us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:47.237378 (+1073923us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b540038ccd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:47.237580 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":382440192}
I20260709 12:13:47.042218 23229 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:47.250638 13829 raft_consensus.cc:2393] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 27: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:47.212157 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:47.128422 23063 consensus_queue.cc:237] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:47.210688 23114 raft_consensus.cc:2749] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 12:13:47.210310 23086 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:47.270758 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:47.174332 23282 consensus_queue.cc:1059] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.067s
W20260709 12:13:47.238334 23093 consensus_meta.cc:287] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.552s	user 0.011s	sys 0.000s
I20260709 12:13:47.276803 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 34 candidate_status { last_received { term: 33 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:47.272785 13800 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:47.204736 23261 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:47.277964 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:47.280515 13682 raft_consensus.cc:2410] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 22 because replica has last-logged OpId of term: 21 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 10.
I20260709 12:13:47.274318 13726 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:47.279688 13834 raft_consensus.cc:2393] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 34 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 34: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:47.281999 13726 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:47.282895 23129 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:47.250558 22997 raft_consensus.cc:2749] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:47.298098 13726 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:47.283004 23086 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:47.242252 23193 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:47.300685 23129 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:47.283571 23176 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:47.302367 23176 raft_consensus.cc:2749] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:13:47.303156 23176 consensus_queue.cc:1048] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:13:47.304944 23176 raft_consensus.cc:2804] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:47.305367 23176 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:47.242587 22989 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:47.266502 23279 consensus_queue.cc:260] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 28.19, Last appended by leader: 19, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:47.310927 23279 raft_consensus.cc:3060] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:47.194381 23120 consensus_queue.cc:260] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 26.13, Last appended by leader: 13, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:47.287269 13652 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:47.250211 23049 raft_consensus.cc:2749] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:13:47.295058 23252 raft_consensus.cc:2804] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:47.311782 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:47.280416 23273 raft_consensus.cc:2749] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:47.275995 13831 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 26.
I20260709 12:13:47.330704 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:13:47.337141 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 177837us
I20260709 12:13:47.346714 23086 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:47.306370 23283 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.305755 23176 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:47.377974 14416 raft_consensus.cc:1240] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 28. Current term is 29. Ops: [27.18-28.19]
I20260709 12:13:47.334358 23057 raft_consensus.cc:2804] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:13:47.334690 23252 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:47.379276 23298 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 34 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.390362 13652 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:47.384415 23057 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:47.386530 23291 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.387414 23252 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:47.400384 23298 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 34 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:47.408885 23263 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:47.404374 23291 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:47.412072 23291 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:47.413479 23294 log.cc:927] Time spent T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:13:47.382692 23283 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:47.416612 23129 raft_consensus.cc:2749] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:47.420735 22908 leader_election.cc:290] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:47.422133 23283 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:47.428948 22770 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:47.394385 23193 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 24 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:47.396093 23125 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:47.430569 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:47.431627 13687 raft_consensus.cc:1240] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 23. Current term is 24. Ops: []
W20260709 12:13:47.434752 23025 consensus_meta.cc:287] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.835s	user 0.007s	sys 0.006s
I20260709 12:13:47.435840 23261 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:47.436270 13686 raft_consensus.cc:1240] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:47.436743 23229 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:47.437716 23300 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:47.438254 13688 raft_consensus.cc:1240] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 26. Current term is 27. Ops: []
W20260709 12:13:47.438563 23296 log.cc:927] Time spent T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 12:13:47.439249 23298 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:47.444646 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:47.492839 13756 raft_consensus.cc:2393] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 26: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:47.447400 23252 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:47.449302 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:47.504331 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:47.505386 13755 raft_consensus.cc:2393] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 26: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:47.450600 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 32 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:47.451083 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:47.507347 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:47.451669 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:47.452514 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:47.509364 13835 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 24.
I20260709 12:13:47.510987 13835 raft_consensus.cc:1240] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:47.453487 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:47.512090 13833 raft_consensus.cc:2410] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 23 because replica has last-logged OpId of term: 20 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 9.
I20260709 12:13:47.456328 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:47.456581 23000 consensus_queue.cc:1059] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 25.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:13:47.456946 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:47.457333 23149 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:47.488574 23025 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:47.522663 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:47.461838 13837 raft_consensus.cc:1240] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 28. Current term is 29. Ops: []
I20260709 12:13:47.524832 23025 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:47.463552 23169 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:47.465353 13684 raft_consensus.cc:1275] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 28 index: 19. Preceding OpId from leader: term: 29 index: 19. (term mismatch)
I20260709 12:13:47.525559 13684 pending_rounds.cc:85] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 18
I20260709 12:13:47.461160 22507 raft_consensus.cc:3055] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:47.525871 13684 pending_rounds.cc:107] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 28.19
I20260709 12:13:47.525969 22507 raft_consensus.cc:740] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:47.526247 13684 raft_consensus.cc:2889] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:47.400154 23057 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:47.527127 13727 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:47.526933 22507 consensus_queue.cc:260] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.18, Last appended by leader: 18, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:47.528153 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:47.528018 23176 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:47.528785 13757 raft_consensus.cc:1240] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 27. Current term is 28. Ops: []
I20260709 12:13:47.403920 23086 raft_consensus.cc:2749] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:47.530289 23000 raft_consensus.cc:3055] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:13:47.530289 23086 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.531410 23086 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:47.461992 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:47.514885 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:47.491302 13836 raft_consensus.cc:1240] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 34 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 33. Current term is 34. Ops: []
I20260709 12:13:47.533293 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:13:47.496273 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:47.481468 22994 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 32 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:47.534545 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 35 candidate_status { last_received { term: 33 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:47.535672 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:47.520182 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 30 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:47.536255 22994 leader_election.cc:290] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 32 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:47.536397 13763 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 29.
I20260709 12:13:47.537400 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:47.538232 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:47.538861 14410 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 25.
I20260709 12:13:47.538928 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 35 candidate_status { last_received { term: 33 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:47.539580 13829 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 34 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 34.
I20260709 12:13:47.540148 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:47.540338 14415 raft_consensus.cc:1240] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:47.541085 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:47.541739 14414 raft_consensus.cc:1275] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 29 index: 19. (index mismatch)
I20260709 12:13:47.519209 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:47.542538 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:47.543008 13762 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 25.
I20260709 12:13:47.543375 14411 raft_consensus.cc:2393] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 28: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:13:47.543310 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:47.543877 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:47.502743 23300 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:47.459753 13681 raft_consensus.cc:1240] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 28. Current term is 29. Ops: []
I20260709 12:13:47.490882 23193 consensus_queue.cc:1059] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 23.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.035s
I20260709 12:13:47.524042 13755 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:47.528286 22507 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:47.530809 23000 raft_consensus.cc:740] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 25 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:47.577324 23000 consensus_queue.cc:260] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:47.579205 23000 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:47.517966 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 34 candidate_status { last_received { term: 33 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:47.516881 23252 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:47.535820 23277 raft_consensus.cc:993] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f: : Instructing follower 96701a74fdee481fb5f54aac841e17dd to start an election
I20260709 12:13:47.583307 23277 raft_consensus.cc:1081] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 17 LEADER]: Signalling peer 96701a74fdee481fb5f54aac841e17dd to start an election
I20260709 12:13:47.583777 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:47.521656 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:47.519040 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 29 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:47.585048 13683 raft_consensus.cc:2376] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 29. Re-sending same reply.
I20260709 12:13:47.585255 13759 raft_consensus.cc:2393] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 24: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:47.470949 13687 raft_consensus.cc:1240] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:47.544427 13762 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:47.585740 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:47.586165 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 23 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:47.533309 13756 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 29.
I20260709 12:13:47.593356 13756 raft_consensus.cc:1275] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 34 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 32 index: 19. Preceding OpId from leader: term: 34 index: 20. (index mismatch)
I20260709 12:13:47.536430 13685 raft_consensus.cc:2393] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 24: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:13:47.547814 13837 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 28.
W20260709 12:13:47.525331 23287 log.cc:927] Time spent T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:13:47.571915 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:47.575485 13726 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:47.603993 13681 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087"
dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
 from {username='slave'} at 127.0.0.1:48212
I20260709 12:13:47.604651 13681 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 32 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:47.605019 13681 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:13:47.597282 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 31 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:47.596359 13756 raft_consensus.cc:1275] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 29 index: 18. Preceding OpId from leader: term: 30 index: 19. (index mismatch)
I20260709 12:13:47.610844 13762 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 26.
I20260709 12:13:47.611629 13759 raft_consensus.cc:1240] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:47.614041 13762 raft_consensus.cc:1275] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 27 index: 18. (index mismatch)
I20260709 12:13:47.616653 13755 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 26.
I20260709 12:13:47.619252 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:47.620023 13756 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 22.
I20260709 12:13:47.620425 23300 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:47.624094 23086 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:47.600309 22994 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.625298 22994 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:47.627161 23176 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:47.598264 23125 raft_consensus.cc:2804] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:47.631318 23125 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:47.631789 23125 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:47.635776 13651 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:47.637106 13651 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:47.638336 13651 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:47.639098 23260 raft_consensus.cc:2749] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:47.639631 23240 raft_consensus.cc:2749] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:47.639784 23260 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:47.642558 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:47.642860 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:47.643512 23175 raft_consensus.cc:3055] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 33 LEADER]: Stepping down as leader of term 33
I20260709 12:13:47.643945 23175 raft_consensus.cc:740] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 33 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:47.645491 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:47.647495 13651 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:47.647782 14411 raft_consensus.cc:1275] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 12:13:47.635322 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:47.649375 13762 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 26.
I20260709 12:13:47.650465 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:47.651557 14409 raft_consensus.cc:2410] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 26 because replica has last-logged OpId of term: 25 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 15.
I20260709 12:13:47.651998 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:47.652707 13762 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 25.
I20260709 12:13:47.655395 13651 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:47.653626 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 32 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:47.661230 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:47.661155 14379 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:47.663018 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:47.662180 13755 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 27.
I20260709 12:13:47.664898 13651 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:47.663183 14379 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:47.664649 13685 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 26.
I20260709 12:13:47.668361 13651 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:13:47.730533 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 62246.6us
W20260709 12:13:47.665953 23087 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.033s	user 0.021s	sys 0.016s
I20260709 12:13:47.742112 13651 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:47.666211 23240 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:47.666599 23086 raft_consensus.cc:2749] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:13:47.701241 23263 raft_consensus.cc:2749] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:13:47.667311 22964 raft_consensus.cc:2749] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:13:47.644768 23175 consensus_queue.cc:260] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 33.17, Last appended by leader: 17, Current term: 33, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:47.744131 23087 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.116s	user 0.021s	sys 0.018s
I20260709 12:13:47.701463 23283 raft_consensus.cc:2804] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:47.660027 23179 consensus_queue.cc:1048] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.087s
I20260709 12:13:47.705987 13681 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 33 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:47.744588 23173 raft_consensus.cc:2749] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:47.747349 23049 raft_consensus.cc:2749] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
I20260709 12:13:47.673501 23251 consensus_queue.cc:1048] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.086s
I20260709 12:13:47.757217 13651 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:47.759198 23283 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:47.765141 13688 raft_consensus.cc:1240] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 33 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 32. Current term is 33. Ops: []
I20260709 12:13:47.776270 23152 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:47.767843 23283 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:47.767315 23175 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:13:47.775391 22989 raft_consensus.cc:2804] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:47.794623 13683 raft_consensus.cc:1240] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 32 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 31. Current term is 32. Ops: [31.18-31.18]
I20260709 12:13:47.755241 22781 consensus_queue.cc:1048] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.014s
I20260709 12:13:47.805424 13652 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:47.811395 13800 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:13:47.813542 13682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41702 (request call id 2816) took 1058 ms. Trace:
I20260709 12:13:47.813978 13682 rpcz_store.cc:276] 0709 12:13:46.755451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:46.996443 (+240992us) service_pool.cc:224] Handling call
0709 12:13:47.808291 (+811848us) spinlock_profiling.cc:243] Waited 277 ms on lock 0x7b5400040bd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:47.813458 (+  5167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":637154176}
I20260709 12:13:47.816534 13651 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:47.812572 23241 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 34 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.819303 23057 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:47.858700 23311 log.cc:927] Time spent T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 12:13:47.831007 23263 raft_consensus.cc:2749] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 34 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
I20260709 12:13:47.861616 23049 raft_consensus.cc:2804] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:47.863013 13651 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:47.864287 23241 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 34 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:47.820318 23252 raft_consensus.cc:2804] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:13:47.864954 23283 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:47.821910 23278 consensus_queue.cc:1048] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.008s
I20260709 12:13:47.822980 23084 consensus_queue.cc:1059] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.044s
I20260709 12:13:47.825160 23008 consensus_queue.cc:1059] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.030s
I20260709 12:13:47.867487 23054 raft_consensus.cc:3055] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:47.869901 23250 consensus_queue.cc:1048] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:13:47.871598 23125 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:47.826692 22989 raft_consensus.cc:697] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 26 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
W20260709 12:13:47.872350 23271 log.cc:927] Time spent T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.831s	user 0.001s	sys 0.001s
I20260709 12:13:47.876163 13684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41688 (request call id 4166) took 1152 ms. Trace:
W20260709 12:13:47.878283 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 50356.1us
I20260709 12:13:47.884523 23252 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:47.883077 23049 raft_consensus.cc:697] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 26 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:47.910611 13684 rpcz_store.cc:276] 0709 12:13:46.723624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:47.247188 (+523564us) service_pool.cc:224] Handling call
0709 12:13:47.247563 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:47.526750 (+279187us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:47.875735 (+348985us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x7b54003129d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:47.876064 (+   329us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":499649920}
W20260709 12:13:47.912719 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 92349.1us
I20260709 12:13:47.919821 23120 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:47.921883 23057 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 30 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:47.893512 23084 consensus_queue.cc:1243] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer b98d2519bb504dc6905ed2ede4571835 log is divergent from this leader: its last log entry 27.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:13:47.893025 23008 consensus_queue.cc:1243] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer b98d2519bb504dc6905ed2ede4571835 log is divergent from this leader: its last log entry 23.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 12:13:47.891153 23054 raft_consensus.cc:740] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 23 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:47.935278 23125 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:47.935197 23123 raft_consensus.cc:3055] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 LEADER]: Stepping down as leader of term 28
I20260709 12:13:47.936306 23123 raft_consensus.cc:740] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:47.937322 23123 consensus_queue.cc:260] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 28.15, Last appended by leader: 15, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:47.938186 23275 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.938928 23275 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:47.940070 23240 raft_consensus.cc:2749] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:47.928843 23084 raft_consensus.cc:3055] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:47.942276 23084 raft_consensus.cc:740] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:47.941300 23049 consensus_queue.cc:237] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:47.914294 23252 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:47.941535 22994 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:47.952984 23054 consensus_queue.cc:260] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:47.952533 23084 consensus_queue.cc:260] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:47.954293 23054 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:47.955101 13757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 3018) took 1314 ms. Trace:
I20260709 12:13:47.955557 13757 rpcz_store.cc:276] 0709 12:13:46.640612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:46.640808 (+   196us) service_pool.cc:224] Handling call
0709 12:13:46.645189 (+  4381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:47.529211 (+884022us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:47.954801 (+425590us) spinlock_profiling.cc:243] Waited 883 ms on lock 0x7b54000ef954. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:47.955024 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2031595264}
I20260709 12:13:47.958362 23241 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:47.958154 22989 consensus_queue.cc:237] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:47.950268 23260 raft_consensus.cc:2749] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 12:13:47.965161 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:47.968870 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:47.971892 23060 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.972606 23060 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:47.973543 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:47.973278 23275 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:47.976027 23060 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:47.976233 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 28 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:47.976853 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:47.977684 14409 raft_consensus.cc:2393] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 25: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:13:47.977306 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 35 candidate_status { last_received { term: 32 index: 19 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:47.979202 23283 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:47.982951 22963 consensus_queue.cc:1048] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260709 12:13:47.998710 23152 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:48.004961 23152 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:47.998283 23283 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:48.006744 23283 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:48.007716 23152 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:48.010033 13830 raft_consensus.cc:1240] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 27. Current term is 28. Ops: []
I20260709 12:13:48.018910 23084 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:48.030730 23006 raft_consensus.cc:3055] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 28 LEADER]: Stepping down as leader of term 28
I20260709 12:13:48.031256 23006 raft_consensus.cc:740] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 28 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:48.032187 23006 consensus_queue.cc:260] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 28.14, Last appended by leader: 14, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:48.033385 23006 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:48.040138 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: true dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:48.042522 14412 raft_consensus.cc:3055] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 32 LEADER]: Stepping down as leader of term 32
I20260709 12:13:48.042996 14412 raft_consensus.cc:740] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 32 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:48.044852 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 31 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:48.043834 14412 consensus_queue.cc:260] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 32.20, Last appended by leader: 20, Current term: 32, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:48.047911 14412 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:13:48.048933 13830 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c95811190f014949bb25448e8db1040e"
dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
 from {username='slave'} at 127.0.0.1:35422
I20260709 12:13:48.049577 13830 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:48.009104 23152 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:48.033445 13801 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:47.016045 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:48.049986 13830 raft_consensus.cc:3060] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:13:48.139093 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:48.060532 23314 log.cc:927] Time spent T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.253s	user 0.004s	sys 0.000s
I20260709 12:13:48.136322 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:13:48.131888 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 98418us
I20260709 12:13:48.115651 13680 raft_consensus.cc:1240] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 23. Current term is 24. Ops: []
W20260709 12:13:48.130419 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 214245us
I20260709 12:13:48.116061 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:13:48.150975 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:48.112317 13763 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 27.
I20260709 12:13:48.152628 23322 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:13:48.156345 13800 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:48.051353 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:48.059369 23252 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:48.167296 13582 catalog_manager.cc:5697] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:48.168612 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 593037us
W20260709 12:13:48.170517 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 596218us
W20260709 12:13:48.174353 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:48.059469 23152 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:48.177765 23282 raft_consensus.cc:2749] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:48.065990 23283 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:48.179980 23270 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:48.181147 23270 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:48.182302 22997 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.183285 22997 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:48.184613 23270 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:48.185745 23152 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:48.123373 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:48.188894 22770 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 34 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.189471 13684 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 26.
I20260709 12:13:48.190485 23120 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:48.191416 13829 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 26.
I20260709 12:13:48.119406 13681 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 33 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:48.205461 22770 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 34 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:48.209446 13679 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:48.203928 13727 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
W20260709 12:13:48.217423 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:48.217685 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 61829.4us
I20260709 12:13:48.220920 23008 raft_consensus.cc:2804] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:48.191448 23120 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:48.231449 23252 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 30 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:48.223232 23008 raft_consensus.cc:697] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 26 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:48.233112 23120 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:48.213402 23320 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.212922 23152 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
W20260709 12:13:48.236613 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 62961.8us
I20260709 12:13:48.236335 23008 consensus_queue.cc:237] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:48.238979 22770 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:48.239979 22507 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 34 FOLLOWER]: Leader pre-election won for term 35
I20260709 12:13:48.241901 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:48.243794 13830 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:48.234980 13688 raft_consensus.cc:1275] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 12:13:48.245036 13726 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:48.246534 23025 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:48.249760 22507 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 34 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:48.247481 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:48.253849 22507 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:13:48.253613 23320 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:48.257237 23320 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:48.257445 23025 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:48.250042 22997 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:48.264715 13830 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:48.267858 23025 leader_election.cc:290] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:48.275332 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:48.276213 13727 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:48.276752 13757 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 26.
I20260709 12:13:48.274544 22770 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:48.277814 23025 raft_consensus.cc:2804] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:13:48.278775 23025 raft_consensus.cc:697] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:48.280405 23025 consensus_queue.cc:237] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 27.19, Last appended by leader: 19, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:48.285087 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:48.285516 23283 consensus_queue.cc:1059] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 27.20, Next index: 21, Last known committed idx: 20, Time since last communication: 0.001s
I20260709 12:13:48.287009 23283 raft_consensus.cc:3055] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:13:48.287551 23283 raft_consensus.cc:740] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 27 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:48.289436 23283 consensus_queue.cc:260] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 27.20, Last appended by leader: 20, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:48.291497 13582 catalog_manager.cc:5697] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 17 to 23. New cstate: current_term: 23 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:48.292975 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 433868us
I20260709 12:13:48.293951 23152 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:48.294837 13651 leader_election.cc:304] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:48.298864 23173 raft_consensus.cc:2804] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:48.299643 23173 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:48.300370 23173 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:48.291770 13687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 1938) took 1037 ms. Trace:
I20260709 12:13:48.302666 13687 rpcz_store.cc:276] 0709 12:13:47.254547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:47.586791 (+332244us) service_pool.cc:224] Handling call
0709 12:13:47.587126 (+   335us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:47.587518 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:47.587548 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:47.588122 (+   574us) log.cc:844] Serialized 52 byte log entry
0709 12:13:47.764828 (+176706us) raft_consensus.cc:1645] Marking committed up to 20
0709 12:13:47.891145 (+126317us) log.cc:844] Serialized 14 byte log entry
0709 12:13:48.290774 (+399629us) log.cc:844] Serialized 14 byte log entry
0709 12:13:48.291125 (+   351us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:48.291260 (+   135us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:48.291364 (+   104us) raft_consensus.cc:1685] finished
0709 12:13:48.291376 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:48.291598 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":398555,"prepare.queue_time_us":54854,"prepare.run_cpu_time_us":178,"prepare.run_wall_time_us":2569,"raft.queue_time_us":403281,"raft.run_cpu_time_us":340,"raft.run_wall_time_us":344,"thread_start_us":253740,"threads_started":2,"wal-append.queue_time_us":228042}
W20260709 12:13:48.299481 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 55858.9us
I20260709 12:13:48.309942 23080 raft_consensus.cc:2749] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:13:48.310295 23270 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:48.311297 23270 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:48.275626 23123 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:48.314896 23270 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:48.316013 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:13:48.316470 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 105902us
I20260709 12:13:48.318269 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:48.275590 13800 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:48.319398 13757 raft_consensus.cc:3060] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Advancing to term 27
W20260709 12:13:48.320525 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 45063.9us
I20260709 12:13:48.321794 23252 raft_consensus.cc:2804] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:48.322379 23252 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:48.323244 23252 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:48.325922 23006 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:48.326882 13759 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:48.326727 23006 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:48.327742 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:48.329440 23006 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:48.330432 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 33 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:48.291401 23283 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:48.311740 13651 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:48.334551 23251 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 33 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:48.334897 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: true dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
W20260709 12:13:48.335968 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 57242.1us
I20260709 12:13:48.338442 13582 catalog_manager.cc:5697] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 19 to 26, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 26 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:48.348536 13679 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 27.
I20260709 12:13:48.352507 14407 raft_consensus.cc:3055] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:13:48.346611 14411 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 32.
I20260709 12:13:48.353070 14407 raft_consensus.cc:740] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:48.354383 14407 consensus_queue.cc:260] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:48.356004 14407 raft_consensus.cc:3060] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:48.356235 14412 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 33.
I20260709 12:13:48.358412 23175 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.359320 23175 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:48.362404 23275 consensus_queue.cc:1048] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
W20260709 12:13:48.365929 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 54406.8us
I20260709 12:13:48.344058 23120 consensus_queue.cc:1048] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.029s
I20260709 12:13:48.367661 23152 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:13:48.389968 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:48.390916 23080 raft_consensus.cc:2804] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:48.391575 23080 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:48.401027 14407 raft_consensus.cc:2468] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 18.
I20260709 12:13:48.411369 23300 consensus_queue.cc:1048] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.003s
I20260709 12:13:48.411403 13800 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:48.414443 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:48.414680 23320 raft_consensus.cc:2804] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Leader pre-election won for term 30
W20260709 12:13:48.415156 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 46041.2us
I20260709 12:13:48.415315 23320 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:48.417070 14380 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:48.418306 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:48.415903 23320 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:48.415346 13828 raft_consensus.cc:2468] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 21.
W20260709 12:13:48.426846 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 50544.4us
I20260709 12:13:48.431427 13582 catalog_manager.cc:5697] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 16 to 19. New cstate: current_term: 19 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:48.402720 23080 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:48.402459 23251 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:48.436800 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:48.445906 13683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:51344 (request call id 1) took 1011 ms. Trace:
I20260709 12:13:48.450078 22770 raft_consensus.cc:2749] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 12:13:48.456913 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 54626.1us
I20260709 12:13:48.461100 13726 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:48.462255 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:48.395397 23175 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:48.461467 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:48.468720 13683 rpcz_store.cc:276] 0709 12:13:47.360965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:47.799781 (+438816us) service_pool.cc:224] Handling call
0709 12:13:48.344007 (+544226us) spinlock_profiling.cc:243] Waited 531 ms on lock 0x7b54002bf2d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f93735 00007fa92cf53d29 00007fa9264d21d4 00007fa9264d2162 00007fa9264d2091 00007fa9264d200c 00007fa9264d12c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:48.372160 (+ 28153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1220884352}
I20260709 12:13:48.475612 14409 raft_consensus.cc:2368] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 26. Current term is 27.
I20260709 12:13:48.478402 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:13:48.480922 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 63994.1us
I20260709 12:13:48.482123 23265 raft_consensus.cc:2804] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:48.482590 23251 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:48.482998 14380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:48.483376 23251 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.482667 23265 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:48.483501 14380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:48.487520 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:48.491111 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:48.497339 13801 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:48.503451 13801 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:48.502324 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:48.472496 23120 raft_consensus.cc:2749] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:48.484073 23251 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:48.508490 13759 raft_consensus.cc:1275] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 12:13:48.509115 13757 raft_consensus.cc:2468] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 27.
I20260709 12:13:48.513517 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:48.508139 23006 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260709 12:13:48.515487 13832 raft_consensus.cc:1275] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 12:13:48.516815 13651 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
W20260709 12:13:48.519949 13634 auto_rebalancer.cc:629] Failed to schedule move for tablet b57529c42e834d3f85dd24588a5d5773: Illegal state: Replica b98d2519bb504dc6905ed2ede4571835 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 31 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:13:48.522575 14407 raft_consensus.cc:1275] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 32 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 29 index: 19. Preceding OpId from leader: term: 32 index: 21. (index mismatch)
I20260709 12:13:48.524938 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 35 candidate_status { last_received { term: 32 index: 19 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:48.532289 13652 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 33 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:48.533108 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:48.491402 23265 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:48.543267 22507 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 35 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:48.569766 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 62781.7us
I20260709 12:13:48.553253 13835 raft_consensus.cc:1240] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 29. Current term is 30. Ops: []
I20260709 12:13:48.555824 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:13:48.563678 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 60325.1us
I20260709 12:13:48.547435 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:13:48.569825 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 108814us
I20260709 12:13:48.470672 23252 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:48.578907 14409 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:48.580509 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:48.576586 13837 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 27.
I20260709 12:13:48.569126 23006 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 32 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:48.576256 13763 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 25.
W20260709 12:13:48.589475 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 57404.1us
I20260709 12:13:48.594919 13835 raft_consensus.cc:1275] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 27 index: 18. (index mismatch)
I20260709 12:13:48.596835 13830 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:48.589602 23006 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:13:48.599391 14414 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 24.
I20260709 12:13:48.605626 14380 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:48.608079 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:48.609385 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:48.609872 13582 catalog_manager.cc:5697] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:48.615451 23057 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 33 FOLLOWER]: Leader election won for term 33
I20260709 12:13:48.616240 23241 raft_consensus.cc:2804] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:13:48.616465 22770 consensus_queue.cc:1059] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 23.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:13:48.616927 23241 raft_consensus.cc:697] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 18 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
W20260709 12:13:48.618610 13578 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45610 (request call id 260) took 50523 ms (client timeout 15000 ms). Trace:
I20260709 12:13:48.618251 23241 consensus_queue.cc:237] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:48.620391 23282 consensus_queue.cc:1048] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.001s
W20260709 12:13:48.621902 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 105293us
I20260709 12:13:48.624821 23283 raft_consensus.cc:2804] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:48.624867 13727 leader_election.cc:400] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 26. Current term is 27.
I20260709 12:13:48.625600 13727 leader_election.cc:403] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:48.625514 23283 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:48.633991 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:48.635500 23057 raft_consensus.cc:697] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 33 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:48.634049 23283 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:48.657459 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 35 candidate_status { last_received { term: 32 index: 19 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:48.658185 23123 raft_consensus.cc:2749] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader pre-election lost for term 26. Reason: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 26. Current term is 27.
I20260709 12:13:48.687186 23080 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:48.688808 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 86656.2us
I20260709 12:13:48.690083 13837 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 21.
I20260709 12:13:48.637075 23057 consensus_queue.cc:237] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 32.20, Last appended by leader: 20, Current term: 33, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:48.641305 23278 raft_consensus.cc:2804] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:48.692164 13830 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 26.
I20260709 12:13:48.627769 13582 catalog_manager.cc:5697] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 16 to 20, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 20 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:48.690639 13829 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 27.
I20260709 12:13:48.693244 14409 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 26.
I20260709 12:13:48.699038 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 32 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:48.700451 23149 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:48.696455 23282 consensus_queue.cc:1048] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 19, Time since last communication: 0.018s
I20260709 12:13:48.718917 13833 raft_consensus.cc:1275] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 12:13:48.718247 13582 catalog_manager.cc:5697] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 21 to 22, leader changed from ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 22 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:13:48.720293 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 34 candidate_status { last_received { term: 33 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:48.721278 13833 raft_consensus.cc:2393] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 34 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 34: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:48.722855 13726 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:48.723438 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 30 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:48.723981 23123 raft_consensus.cc:2749] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:48.724182 13837 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:48.724931 13726 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:48.725936 23123 raft_consensus.cc:2749] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:48.726331 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:48.726977 13835 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 26.
I20260709 12:13:48.727977 23080 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:48.728369 13835 raft_consensus.cc:1275] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:13:48.701195 23149 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:48.732007 23149 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:48.702049 23278 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:48.733656 23278 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:48.741463 23149 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:48.742743 23149 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:48.751302 13834 raft_consensus.cc:1275] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 12:13:48.751184 23251 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:48.762779 22507 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 35 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:48.765089 23173 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:48.770926 23175 raft_consensus.cc:3055] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:48.771449 23175 raft_consensus.cc:740] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:48.772656 23175 consensus_queue.cc:260] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 23.18, Last appended by leader: 18, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:48.774438 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 49631.2us
I20260709 12:13:48.775436 13726 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:48.777184 13726 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:48.778368 23282 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:48.689534 23265 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:48.757408 14379 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:48.803959 13837 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 30.
W20260709 12:13:48.619099 13578 rpcz_store.cc:269] 0709 12:12:58.153554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:05.813177 (+7659623us) service_pool.cc:224] Handling call
0709 12:13:48.618341 (+42805164us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:38.781251 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:39.102737 (+321486us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:39.102801 (+    64us) write_op.cc:435] Acquired schema lock
0709 12:13:39.102832 (+    31us) tablet.cc:662] Decoding operations
0709 12:13:39.255485 (+152653us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:39.280098 (+ 24613us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:39.283898 (+  3800us) tablet.cc:685] Acquiring locks for 25 operations
0709 12:13:39.417948 (+134050us) tablet.cc:701] Row locks acquired
0709 12:13:39.418002 (+    54us) write_op.cc:260] PREPARE: finished
0709 12:13:39.418186 (+   184us) write_op.cc:270] Start()
0709 12:13:39.418366 (+   180us) write_op.cc:276] Timestamp: P: 1783599219418121 usec, L: 0
0709 12:13:39.418407 (+    41us) op_driver.cc:348] REPLICATION: starting
0709 12:13:39.470068 (+ 51661us) log.cc:844] Serialized 9868 byte log entry
0709 12:13:40.279219 (+809151us) op_driver.cc:464] REPLICATION: finished
0709 12:13:40.382000 (+102781us) write_op.cc:301] APPLY: starting
0709 12:13:40.382121 (+   121us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:40.509898 (+127777us) spinlock_profiling.cc:243] Waited 3.84 ms on lock 0x7b5400373cd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8a32a 00007fa927f0ff14 00007fa927f0fec3 00007fa927f0fe38 00007fa927f0fdf3 00007fa927f0f0dc 00007fa927f38e16 00007fa927f20cbb 00007fa927f0b39d 00007fa927f0ed75
0709 12:13:40.731646 (+221748us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:40.731701 (+    55us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:41.954461 (+1222760us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b5c0007658c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92e17f331 00007fa92e17f221 00007fa92e179f6c 00007fa92b8da30b 00007fa92b8d9fd3 00007fa92b9d8e34 00007fa92b9c497c 00007fa92b9c8d61 00007fa92b9c8d19 00007fa92b9c8ca9 00007fa92b9c8c71
0709 12:13:42.254746 (+300285us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:42.255280 (+   534us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=50,key_file_lookups=50,delta_file_lookups=0,mrs_lookups=0
0709 12:13:42.255353 (+    73us) write_op.cc:312] APPLY: finished
0709 12:13:42.255986 (+   633us) log.cc:844] Serialized 220 byte log entry
0709 12:13:42.274989 (+ 19003us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:42.275237 (+   248us) write_op.cc:454] Released schema lock
0709 12:13:42.275331 (+    94us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:42.275944 (+   613us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:42.275999 (+    55us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6003929,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":76054,"apply.run_cpu_time_us":73538,"apply.run_wall_time_us":1893937,"cfile_cache_hit":102,"cfile_cache_hit_bytes":108627,"num_ops":25,"prepare.queue_time_us":311341,"prepare.run_cpu_time_us":61977,"prepare.run_wall_time_us":994151,"raft.queue_time_us":166992,"raft.run_cpu_time_us":17783,"raft.run_wall_time_us":244073,"replication_time_us":860603,"spinlock_wait_cycles":38624000,"thread_start_us":469589,"threads_started":5,"wal-append.queue_time_us":341715,"wal-append.run_cpu_time_us":26085,"wal-append.run_wall_time_us":2397008}]]}
I20260709 12:13:48.784828 23149 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:48.812860 22770 raft_consensus.cc:2749] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:13:48.819828 23173 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:48.792330 23320 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:48.835475 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 58434.8us
I20260709 12:13:48.837678 22982 raft_consensus.cc:2749] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 12:13:48.839277 13578 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53318 (request call id 150) took 22692 ms (client timeout 15000 ms). Trace:
W20260709 12:13:48.839362 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 82048.6us
W20260709 12:13:48.844127 13578 rpcz_store.cc:269] 0709 12:13:26.146733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:48.839010 (+22692277us) service_pool.cc:211] Skipping call since client already timed out
0709 12:13:48.839187 (+   177us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:13:48.849159 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:48.850683 23252 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:48.858739 14411 raft_consensus.cc:2368] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 25. Current term is 26.
I20260709 12:13:48.869973 13836 raft_consensus.cc:1240] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 29. Current term is 30. Ops: []
I20260709 12:13:48.835230 23006 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 33 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:48.877346 13801 leader_election.cc:400] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 election: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 25. Current term is 26.
I20260709 12:13:48.877982 13801 leader_election.cc:403] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 election: Cancelling election due to peer responding with higher term
W20260709 12:13:48.887280 13578 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45620 (request call id 254) took 20825 ms (client timeout 15000 ms). Trace:
W20260709 12:13:48.888069 13578 rpcz_store.cc:269] 0709 12:13:28.054066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:48.873887 (+20819821us) service_pool.cc:211] Skipping call since client already timed out
0709 12:13:48.879211 (+  5324us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:13:48.896687 13829 raft_consensus.cc:1240] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 33 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 32. Current term is 33. Ops: []
I20260709 12:13:48.885375 23149 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:48.903246 23149 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:48.910799 23149 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:48.914193 23333 log.cc:927] Time spent T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.328s	user 0.001s	sys 0.004s
I20260709 12:13:48.865468 22770 consensus_queue.cc:1059] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 30.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.032s
I20260709 12:13:48.894711 23252 raft_consensus.cc:2749] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader election lost for term 25. Reason: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 25. Current term is 26.
I20260709 12:13:48.938872 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:48.948784 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:13:48.954676 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:48.965917 23175 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:48.981261 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:48.986482 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:48.987807 13687 raft_consensus.cc:2368] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 22. Current term is 23.
I20260709 12:13:48.925537 23284 consensus_queue.cc:1048] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.081s
I20260709 12:13:48.973347 23283 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:48.988672 13683 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 24.
I20260709 12:13:49.000412 13652 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:48.992560 23320 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 30 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:48.976516 23123 consensus_queue.cc:1059] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 29.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.028s
I20260709 12:13:49.021252 22976 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:49.021842 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:49.022189 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:49.022980 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:49.023729 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:49.028411 13830 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Advancing to term 23
I20260709 12:13:49.029175 13836 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Advancing to term 28
W20260709 12:13:49.028105 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 156279us
I20260709 12:13:49.034327 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 34 candidate_status { last_received { term: 33 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:49.034847 13683 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:13:49.033176 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:49.008391 23278 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:49.040846 13685 raft_consensus.cc:2393] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 27: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:49.038358 13832 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 26.
I20260709 12:13:49.045086 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 28 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:49.047624 22997 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:49.048139 23332 log.cc:927] Time spent T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.448s	user 0.001s	sys 0.001s
I20260709 12:13:49.035662 23057 raft_consensus.cc:2749] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 12:13:49.049409 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 68080.6us
W20260709 12:13:49.050314 23340 log.cc:927] Time spent T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:13:49.050125 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 29 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:49.051458 13652 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:49.041755 23006 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 33 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:49.033659 23123 raft_consensus.cc:3055] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 LEADER]: Stepping down as leader of term 29
I20260709 12:13:49.054563 23123 raft_consensus.cc:740] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:49.054958 13757 raft_consensus.cc:1275] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:13:49.055617 23123 consensus_queue.cc:260] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 29.16, Last appended by leader: 16, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:49.057097 23123 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:49.057934 23149 consensus_queue.cc:1048] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:13:49.058957 23349 consensus_queue.cc:1048] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:13:49.059801 23149 consensus_queue.cc:1048] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:13:49.062973 23283 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:49.064071 23278 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:49.064940 13679 raft_consensus.cc:2393] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 27: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:49.073856 13652 leader_election.cc:304] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 32 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:49.074890 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:49.079133 14379 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:49.061568 23149 raft_consensus.cc:2749] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:13:49.082729 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 35 candidate_status { last_received { term: 32 index: 19 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:49.085281 13759 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 27.
I20260709 12:13:49.089183 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:49.090147 13829 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:49.090973 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 33 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:13:49.091135 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 54879.9us
I20260709 12:13:49.091931 13830 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 23.
I20260709 12:13:49.092092 14379 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:49.091195 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:13:49.094408 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 122533us
I20260709 12:13:49.096388 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 33 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:49.097206 14414 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:13:49.099520 23349 raft_consensus.cc:2804] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:49.101404 13836 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 28.
I20260709 12:13:49.095515 13727 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:49.102130 23349 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:49.048348 22997 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:49.110026 22989 raft_consensus.cc:2749] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 32 FOLLOWER]: Leader election lost for term 32. Reason: could not achieve majority
I20260709 12:13:49.110710 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 33 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:49.106202 23283 raft_consensus.cc:2804] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:49.119367 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 34 candidate_status { last_received { term: 33 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:49.039144 22976 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:49.121662 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:49.123250 13684 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:49.128767 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: true dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:49.129701 13757 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:13:49.132077 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:13:49.132921 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 79258.5us
I20260709 12:13:49.134116 13829 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 27.
I20260709 12:13:49.116127 23349 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:49.114215 23149 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:49.136986 13759 raft_consensus.cc:1240] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:49.137497 13687 raft_consensus.cc:2376] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 34 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 34. Re-sending same reply.
I20260709 12:13:49.146904 23320 consensus_queue.cc:1048] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:13:49.148412 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 30 candidate_status { last_received { term: 29 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:49.150275 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:49.151453 22997 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:49.152112 22997 raft_consensus.cc:2804] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:49.152482 22997 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:49.152832 22997 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:49.154091 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:49.154965 13688 raft_consensus.cc:2393] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 28: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:49.156437 13680 raft_consensus.cc:1240] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 28. Current term is 29. Ops: [28.14-28.14]
I20260709 12:13:49.156801 13763 raft_consensus.cc:2368] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 25. Current term is 26.
I20260709 12:13:49.159560 22976 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:49.162083 23282 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.163162 23282 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:49.139611 23057 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:49.166507 23057 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:49.167603 23149 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:49.171352 13685 raft_consensus.cc:1275] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:13:49.174988 23298 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:49.175683 23298 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:49.179502 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:49.190482 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 29 candidate_status { last_received { term: 28 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:49.191366 13760 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 28.
W20260709 12:13:49.193310 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 46722.5us
I20260709 12:13:49.119171 23284 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:49.181556 13684 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 27.
I20260709 12:13:49.208132 13681 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 29.
I20260709 12:13:49.211539 23080 consensus_queue.cc:1048] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:49.214877 13652 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:49.221874 13800 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:49.165678 23282 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:49.228421 13800 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:49.237653 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:49.239511 13760 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 24.
I20260709 12:13:49.238072 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:49.220901 23262 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.264199 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:49.265064 13760 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:49.270092 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 30 candidate_status { last_received { term: 29 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:49.270926 13684 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:49.272046 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:49.274257 23175 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:49.274736 23025 raft_consensus.cc:3055] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 LEADER]: Stepping down as leader of term 31
I20260709 12:13:49.275231 23025 raft_consensus.cc:740] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:49.276016 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:49.276204 23025 consensus_queue.cc:260] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 31.18, Last appended by leader: 18, Current term: 31, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:49.277453 23025 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:13:49.274915 23175 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:49.284796 23175 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:49.285939 23251 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:49.286655 23251 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:49.289388 23251 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:49.233042 22989 raft_consensus.cc:2764] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader pre-election decision vote started in defunct term 26: won
I20260709 12:13:49.261490 23298 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:49.278851 13686 raft_consensus.cc:3060] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:49.285365 23175 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.277841 13680 raft_consensus.cc:1275] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 12:13:49.298079 23298 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:49.299044 23175 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:49.233258 23241 raft_consensus.cc:2764] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader pre-election decision vote started in defunct term 27: won
W20260709 12:13:49.301086 23347 log.cc:927] Time spent T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:13:49.298928 23298 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:49.235213 23149 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:49.302440 23262 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:49.303503 23298 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:49.305922 23175 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:49.223416 23284 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:49.307964 23284 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:49.308938 13757 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 33.
W20260709 12:13:49.309532 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 81171.8us
I20260709 12:13:49.312453 13800 leader_election.cc:400] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 election: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 25. Current term is 26.
I20260709 12:13:49.336956 13683 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 34 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 34.
I20260709 12:13:49.343663 13684 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 30.
I20260709 12:13:49.337873 13800 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:49.354305 23060 raft_consensus.cc:2804] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:49.355517 14411 raft_consensus.cc:1275] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 12:13:49.361814 13686 raft_consensus.cc:1275] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 12:13:49.355007 23060 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:49.257875 23282 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:49.350129 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: true dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:49.247004 23322 raft_consensus.cc:2749] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 34 FOLLOWER]: Leader pre-election lost for term 35. Reason: could not achieve majority
W20260709 12:13:49.344677 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 83412.3us
W20260709 12:13:49.370800 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 245792us
I20260709 12:13:49.369678 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 29 candidate_status { last_received { term: 28 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:49.373404 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:49.379065 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:49.379976 13684 raft_consensus.cc:2368] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 26. Current term is 27.
I20260709 12:13:49.389803 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 30 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:49.394466 14414 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 33.
I20260709 12:13:49.397609 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:49.399029 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:49.399259 13727 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:49.399904 14415 raft_consensus.cc:2393] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 24: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:13:49.400480 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:49.401854 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:13:49.403170 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 188241us
I20260709 12:13:49.404166 13686 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:49.405442 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:49.373972 23060 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:49.346773 23006 consensus_queue.cc:1059] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 26.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.048s
I20260709 12:13:49.408135 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 35 candidate_status { last_received { term: 33 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:49.408486 13688 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 24.
I20260709 12:13:49.410673 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:49.411815 14379 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:49.410133 13800 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:49.415983 13801 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 33 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:13:49.416297 13683 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:13:49.390173 23262 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:49.417873 13681 raft_consensus.cc:2468] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 18.
I20260709 12:13:49.422636 13687 raft_consensus.cc:2393] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 24: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:49.424297 13685 raft_consensus.cc:1240] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 29. Current term is 30. Ops: [29.16-29.16]
I20260709 12:13:49.424768 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:13:49.428920 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:49.429678 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:49.398547 23282 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:49.430500 13727 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:49.436908 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:49.414799 23283 raft_consensus.cc:697] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 27 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:49.441808 14415 raft_consensus.cc:1240] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 33 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 32. Current term is 33. Ops: [30.20-32.21]
W20260709 12:13:49.475809 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 59903.8us
W20260709 12:13:49.477638 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 47241.4us
I20260709 12:13:49.430598 23278 consensus_queue.cc:1048] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 12:13:49.478888 13727 leader_election.cc:304] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:13:49.478915 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 67200us
I20260709 12:13:49.432159 23262 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:49.463887 23241 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 33 FOLLOWER]: Leader election won for term 33
I20260709 12:13:49.482411 13652 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:49.491739 13760 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 27.
I20260709 12:13:49.422262 22989 consensus_queue.cc:1048] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.053s
I20260709 12:13:49.424362 23175 consensus_queue.cc:1059] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.053s
I20260709 12:13:49.494129 14416 raft_consensus.cc:1275] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 28 index: 20. (index mismatch)
I20260709 12:13:49.495333 23282 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:49.496147 23282 raft_consensus.cc:2804] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:49.496623 23282 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:49.497123 23282 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:49.502599 23241 raft_consensus.cc:697] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 33 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:49.503216 23283 consensus_queue.cc:237] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.18, Last appended by leader: 18, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:49.504180 23241 consensus_queue.cc:237] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 30.20, Last appended by leader: 20, Current term: 33, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:49.523216 13683 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 35 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 35.
I20260709 12:13:49.545249 13686 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 27.
W20260709 12:13:49.549795 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 73715.4us
I20260709 12:13:49.480212 23322 raft_consensus.cc:2749] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:49.482977 23298 raft_consensus.cc:2749] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 34 FOLLOWER]: Leader pre-election lost for term 35. Reason: could not achieve majority
W20260709 12:13:49.558074 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:49.490846 23361 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.577605 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:49.578495 13686 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 27.
W20260709 12:13:49.564790 23357 log.cc:927] Time spent T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.163s	user 0.000s	sys 0.002s
I20260709 12:13:49.598220 13652 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:49.577445 23149 raft_consensus.cc:2804] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Leader election won for term 30
W20260709 12:13:49.608435 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 129675us
I20260709 12:13:49.616499 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 35 candidate_status { last_received { term: 33 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:49.618204 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:49.626258 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:49.629395 13836 raft_consensus.cc:3060] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:13:49.599808 23006 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.555171 23262 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:49.619215 13832 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 27.
I20260709 12:13:49.602768 23362 raft_consensus.cc:2804] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:49.645103 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:49.645502 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:13:49.626044 23123 consensus_meta.cc:287] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.560s	user 0.008s	sys 0.004s
I20260709 12:13:49.653469 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:49.659767 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:49.660732 13834 raft_consensus.cc:2393] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 30: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:49.661403 23366 raft_consensus.cc:2749] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:13:49.662662 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:49.652908 23149 raft_consensus.cc:697] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 30 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:49.664403 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:49.665318 23149 consensus_queue.cc:237] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 28.16, Last appended by leader: 16, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:49.666342 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:49.659798 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:13:49.669842 23363 log.cc:927] Time spent T 00000000000000000000000000000000 P 17d79eae88f84be7a847d0cf544674cd: Append to log took a long time: real 0.154s	user 0.002s	sys 0.000s
I20260709 12:13:49.658042 23175 consensus_queue.cc:1048] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 18, Time since last communication: 0.013s
W20260709 12:13:49.670907 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 264967us
I20260709 12:13:49.669070 13754 raft_consensus.cc:1275] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 12:13:49.589874 23361 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:49.658725 13833 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 26.
I20260709 12:13:49.672056 13800 leader_election.cc:400] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 22. Current term is 23.
I20260709 12:13:49.672135 23374 raft_consensus.cc:2804] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:49.687407 13800 leader_election.cc:403] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:49.620764 23251 consensus_queue.cc:1059] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 29.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.062s
I20260709 12:13:49.695611 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:49.695967 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:49.696604 13831 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 24.
I20260709 12:13:49.672083 23362 raft_consensus.cc:697] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:49.730885 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 30 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:49.728663 13754 raft_consensus.cc:1275] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
W20260709 12:13:49.725600 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 123597us
I20260709 12:13:49.741164 23175 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.741426 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:49.653959 23298 consensus_queue.cc:1059] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 29.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.059s
I20260709 12:13:49.741601 23371 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:49.753077 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 54936.3us
I20260709 12:13:49.753032 13652 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:49.647217 23006 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:49.690083 23374 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:49.761754 13726 leader_election.cc:400] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 26. Current term is 27.
I20260709 12:13:49.768203 13652 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:49.772584 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:49.727707 23265 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:49.776685 23175 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:49.779456 23175 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:49.780480 22989 raft_consensus.cc:2804] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:13:49.781224 22989 raft_consensus.cc:697] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 28 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:49.730154 23376 raft_consensus.cc:2749] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199) with higher term. Message: Invalid argument: T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 22. Current term is 23.
I20260709 12:13:49.767357 23374 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:49.782577 22989 consensus_queue.cc:237] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.15, Last appended by leader: 15, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:49.787283 13754 raft_consensus.cc:1275] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 12:13:49.792544 13833 raft_consensus.cc:1275] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 27 index: 19. Preceding OpId from leader: term: 28 index: 20. (index mismatch)
W20260709 12:13:49.767175 23349 consensus_meta.cc:287] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.559s	user 0.012s	sys 0.001s
I20260709 12:13:49.793668 13759 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:49.796765 13727 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
W20260709 12:13:49.800930 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 129093us
I20260709 12:13:49.807653 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:49.793944 23251 raft_consensus.cc:2804] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:49.816366 23006 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:49.803815 23376 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.817569 23362 consensus_queue.cc:237] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:49.807974 13727 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
W20260709 12:13:49.820881 22997 consensus_meta.cc:287] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.668s	user 0.006s	sys 0.005s
W20260709 12:13:49.807631 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 46042.7us
I20260709 12:13:49.827226 13836 raft_consensus.cc:2468] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 35 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 35.
I20260709 12:13:49.771888 23060 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:49.832981 13727 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:49.771023 23371 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:49.832067 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 63975.9us
I20260709 12:13:49.837954 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:49.839237 13726 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:49.840179 14409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41700 (request call id 1403) took 1135 ms. Trace:
I20260709 12:13:49.841043 13726 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:49.842067 13727 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:49.840647 14409 rpcz_store.cc:276] 0709 12:13:48.707525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:48.761907 (+ 54382us) service_pool.cc:224] Handling call
0709 12:13:48.762395 (+   488us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:48.763221 (+   826us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:48.763256 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:48.764035 (+   779us) log.cc:844] Serialized 52 byte log entry
0709 12:13:48.890727 (+126692us) raft_consensus.cc:1645] Marking committed up to 18
0709 12:13:48.930291 (+ 39564us) log.cc:844] Serialized 14 byte log entry
0709 12:13:49.215025 (+284734us) spinlock_profiling.cc:243] Waited 2.34 ms on lock 0x7b1800391240. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924ea0522 00007fa924ea27c1 00007fa924ea2779 00007fa924ea2709 00007fa924ea26d1 00007fa924ea19cd 0000000000388634 0000000000388479 00007fa924e8383a
0709 12:13:49.815380 (+600355us) spinlock_profiling.cc:243] Waited 7.49 ms on lock 0x7b1800391240. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e82e07 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9d455 00007fa927f85060 00007fa927f97716 00007fa927fa8287 00007fa927fa8208
0709 12:13:49.839765 (+ 24385us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:49.839865 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:49.839913 (+    48us) raft_consensus.cc:1685] finished
0709 12:13:49.839930 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:49.840098 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":36642,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":57,"raft.queue_time_us":90316,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":232,"spinlock_wait_cycles":22605824,"thread_start_us":133568,"threads_started":2,"wal-append.queue_time_us":179849}
I20260709 12:13:49.845016 14410 raft_consensus.cc:1240] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:49.827080 23262 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:49.799542 23349 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:49.852532 13761 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 30.
I20260709 12:13:49.854103 13800 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:13:49.830005 23251 raft_consensus.cc:697] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 23 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:49.853844 13727 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 35 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:49.858736 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:49.835809 23298 raft_consensus.cc:2804] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:49.846985 23175 raft_consensus.cc:2804] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:49.862672 13759 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 30.
I20260709 12:13:49.851747 22507 raft_consensus.cc:2749] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:49.867467 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:49.865623 23361 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:49.870486 14415 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 28.
I20260709 12:13:49.870968 14407 raft_consensus.cc:1240] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:49.856518 23123 raft_consensus.cc:2804] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:49.837294 22997 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:49.874872 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 30 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:49.875792 13836 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 29.
I20260709 12:13:49.862744 23298 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:49.866163 23175 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:49.833994 23376 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:49.883498 13727 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:49.885434 13760 raft_consensus.cc:1240] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 27. Current term is 28. Ops: [27.18-27.18]
I20260709 12:13:49.873907 23241 raft_consensus.cc:2804] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:49.887537 13680 raft_consensus.cc:1240] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:49.874251 23123 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:49.891111 23372 raft_consensus.cc:2749] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:49.892464 23060 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:49.895138 23386 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 31 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:49.895320 23282 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:49.895776 23386 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:49.889434 23241 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:49.898267 23241 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:49.899135 23349 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:49.901131 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:49.880615 23298 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:49.903179 23251 consensus_queue.cc:237] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 21.10, Last appended by leader: 10, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:49.904193 23389 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.904922 23389 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:49.886044 23175 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:13:49.910161 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 63361.9us
I20260709 12:13:49.889813 23123 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:49.911260 13800 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:49.912771 13800 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:49.879878 23361 raft_consensus.cc:2804] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 35 FOLLOWER]: Leader election won for term 35
I20260709 12:13:49.907917 22997 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:49.915463 23376 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:49.917860 23252 raft_consensus.cc:3055] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:49.918363 23252 raft_consensus.cc:740] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:49.916662 23060 raft_consensus.cc:2749] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:13:49.915834 23386 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:49.923203 23371 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:49.917011 23376 raft_consensus.cc:2749] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 12:13:49.933413 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:49.934207 13836 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:49.936408 23359 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.930680 23386 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 34 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.934487 23282 leader_election.cc:290] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:49.942651 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:49.889361 23373 raft_consensus.cc:2804] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:49.945314 23373 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:49.945039 23006 consensus_queue.cc:1059] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 25.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:13:49.940881 23386 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 34 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:49.956272 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:13:49.993294 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 80609.1us
I20260709 12:13:49.994421 13836 raft_consensus.cc:2468] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 28.
I20260709 12:13:49.997210 14407 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 24.
W20260709 12:13:49.997707 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 142233us
I20260709 12:13:49.998932 13727 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:50.002321 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 29 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:50.003944 13681 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 27.
W20260709 12:13:49.948975 23388 log.cc:927] Time spent T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.068s	user 0.002s	sys 0.002s
W20260709 12:13:49.953198 23382 log.cc:927] Time spent T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.084s	user 0.000s	sys 0.002s
I20260709 12:13:50.015354 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 29 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:50.015873 13800 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 34 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:13:49.925603 23057 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:49.946174 23376 raft_consensus.cc:3055] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:13:49.937273 23359 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:50.034200 14379 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:50.042596 14379 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:50.035670 13651 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:49.945755 23373 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:50.002118 22989 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.919407 23252 consensus_queue.cc:260] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 26.13, Last appended by leader: 13, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:50.099750 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:50.061033 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 34 candidate_status { last_received { term: 33 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:50.044386 13832 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 28.
W20260709 12:13:50.131274 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 132448us
W20260709 12:13:50.130712 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 96123.3us
I20260709 12:13:50.005911 23361 raft_consensus.cc:697] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 35 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:50.042289 23282 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.051086 23366 raft_consensus.cc:2804] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:50.036806 23376 raft_consensus.cc:740] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:50.062124 23365 raft_consensus.cc:3055] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 32 LEADER]: Stepping down as leader of term 32
I20260709 12:13:50.130239 22770 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:50.174628 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 139089us
I20260709 12:13:50.051661 23381 raft_consensus.cc:2804] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:50.171947 13726 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:50.050777 23389 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:50.164896 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 300966us
I20260709 12:13:50.160823 23372 raft_consensus.cc:2804] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:13:50.129417 23368 raft_consensus.cc:2804] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 34 FOLLOWER]: Leader election won for term 34
I20260709 12:13:50.130353 23386 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:50.154049 23349 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.175881 23381 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:50.046576 23123 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:50.173148 23252 raft_consensus.cc:3060] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:50.194144 13652 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:50.129838 22989 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:50.176589 23365 raft_consensus.cc:740] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 32 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:50.181843 23366 raft_consensus.cc:697] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 27 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:50.180765 23394 raft_consensus.cc:2804] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:13:50.167835 23241 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:50.208376 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 192597us
I20260709 12:13:50.212558 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:50.213406 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:50.216203 13727 leader_election.cc:304] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:50.196628 23381 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:50.225917 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:50.225968 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:50.190531 23298 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:50.177852 23282 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:50.200642 23368 raft_consensus.cc:697] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 34 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:50.203136 23175 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:50.180848 23374 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:50.214227 23394 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:50.232203 13758 raft_consensus.cc:1275] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 12:13:50.196951 22770 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:50.196436 23349 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 33 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:50.223644 23120 raft_consensus.cc:2804] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:50.248400 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:50.245864 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 30 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:50.328274 13759 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 24.
I20260709 12:13:50.234783 13836 raft_consensus.cc:1240] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:50.231846 13760 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 28.
I20260709 12:13:50.203703 23389 consensus_queue.cc:1048] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 12:13:50.198083 23251 consensus_queue.cc:1059] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.031s
I20260709 12:13:50.299293 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:50.300844 13832 raft_consensus.cc:1240] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 33 LEADER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 32. Current term is 33. Ops: [32.21-32.21]
I20260709 12:13:50.208144 23080 consensus_queue.cc:1048] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.025s
I20260709 12:13:50.298324 13758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 3038) took 1143 ms. Trace:
I20260709 12:13:50.321951 13763 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 26.
I20260709 12:13:50.323510 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:13:50.337268 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 126494us
I20260709 12:13:50.232880 23399 raft_consensus.cc:2804] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:50.340217 13758 rpcz_store.cc:276] 0709 12:13:49.102762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:49.134232 (+ 31470us) service_pool.cc:224] Handling call
0709 12:13:50.063298 (+929066us) spinlock_profiling.cc:243] Waited 44 ms on lock 0x7b58001e3f98. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924e68b71 00007fa924e68a22 00007fa92dd818d9 00007fa92cedbee0 00007fa92cfa50ab 00007fa92cfa5131 00007fa92cf66fc0 00007fa92cf51929 00007fa92cf513d2 00007fa9264c8bd4
0709 12:13:50.130526 (+ 67228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:50.238340 (+107814us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:50.246534 (+  8194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":101140864}
I20260709 12:13:50.232704 23405 raft_consensus.cc:2804] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader pre-election won for term 28
W20260709 12:13:50.325920 23382 log.cc:927] Time spent T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:13:50.351111 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:50.354043 13760 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:50.248425 23394 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:50.357445 13754 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:50.235189 23057 consensus_queue.cc:1048] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.110s
I20260709 12:13:50.358909 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:50.363215 13800 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:50.346215 23120 raft_consensus.cc:697] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:50.227614 23376 consensus_queue.cc:260] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:50.349067 23399 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:13:50.393035 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 50420.8us
I20260709 12:13:50.356163 23407 raft_consensus.cc:2804] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:50.353403 23405 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:50.404351 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:13:50.410171 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 238322us
I20260709 12:13:50.412797 13726 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:50.427663 13726 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:50.429567 13726 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:50.434283 13726 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:50.436785 13757 raft_consensus.cc:1240] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:50.401029 23356 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.342741 23361 consensus_queue.cc:237] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 33.16, Last appended by leader: 16, Current term: 35, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:50.444137 13760 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 28.
I20260709 12:13:50.403224 23399 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:50.359452 23149 consensus_queue.cc:1048] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.066s
I20260709 12:13:50.385147 23060 consensus_queue.cc:1048] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.051s
I20260709 12:13:50.431289 23407 raft_consensus.cc:697] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:50.405439 23405 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:50.452075 23376 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:50.459913 23284 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:50.449836 23123 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:50.298363 23365 consensus_queue.cc:260] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 32.21, Last appended by leader: 21, Current term: 32, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:50.453627 23006 raft_consensus.cc:2749] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:13:50.463024 23395 log.cc:927] Time spent T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 12:13:50.463260 23298 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:50.503450 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:50.464095 23397 log.cc:927] Time spent T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 12:13:50.464897 13763 raft_consensus.cc:1275] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 33 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 32 index: 20. Preceding OpId from leader: term: 33 index: 21. (index mismatch)
W20260709 12:13:50.466614 23401 log.cc:927] Time spent T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 12:13:50.413765 23366 consensus_queue.cc:237] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.16, Last appended by leader: 16, Current term: 27, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:50.469215 23402 raft_consensus.cc:2749] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:50.470057 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:13:50.470382 23403 log.cc:927] Time spent T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 12:13:50.470669 23120 consensus_queue.cc:237] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 26.13, Last appended by leader: 13, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:50.472144 23241 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:50.474964 13759 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 27.
I20260709 12:13:50.529731 13760 raft_consensus.cc:2410] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 26 because replica has last-logged OpId of term: 24 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 15.
I20260709 12:13:50.475903 23025 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.529433 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:50.455035 23356 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:50.480193 23175 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:50.480422 23373 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:50.450888 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 35 candidate_status { last_received { term: 33 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:50.482120 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 32 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:13:50.462365 23400 log.cc:927] Time spent T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 12:13:50.449616 23408 raft_consensus.cc:3055] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:50.449424 23362 raft_consensus.cc:2749] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:50.449486 23368 consensus_queue.cc:237] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 33.17, Last appended by leader: 17, Current term: 34, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:50.450031 23359 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:50.481719 23406 raft_consensus.cc:2749] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:50.470425 22770 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:50.501331 23282 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:13:50.515367 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 308180us
W20260709 12:13:50.518121 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 154987us
I20260709 12:13:50.602286 13800 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:13:50.602851 23282 consensus_queue.cc:1048] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 12:13:50.603468 22770 consensus_queue.cc:1059] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 24.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:50.603904 13800 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:50.604756 23298 raft_consensus.cc:3055] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:50.605134 23360 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:50.605641 13800 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:50.606025 23006 raft_consensus.cc:2804] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:13:50.605947 23360 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:50.606886 23320 raft_consensus.cc:2749] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:50.607616 23320 raft_consensus.cc:2749] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:50.608546 23360 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:50.529402 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:50.609264 23412 consensus_queue.cc:1048] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:50.533244 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 30 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:50.549002 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:50.610376 23006 raft_consensus.cc:697] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 29 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:50.610567 13759 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 24.
I20260709 12:13:50.611586 23006 consensus_queue.cc:237] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 28.15, Last appended by leader: 15, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:50.612411 13759 raft_consensus.cc:1240] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 26. Current term is 27. Ops: [24.13-26.14]
I20260709 12:13:50.516916 22507 consensus_queue.cc:1059] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 30.20, Next index: 21, Last known committed idx: 20, Time since last communication: 0.030s
I20260709 12:13:50.614074 22507 consensus_queue.cc:1243] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Peer 96701a74fdee481fb5f54aac841e17dd log is divergent from this leader: its last log entry 33.21 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 20
I20260709 12:13:50.536885 23374 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:50.551584 23356 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:50.553966 13757 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 34 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 34.
I20260709 12:13:50.615029 22989 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:50.554678 23241 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:50.616415 13800 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 34 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:13:50.616364 23241 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:50.616792 23381 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:50.618655 13759 raft_consensus.cc:1275] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
I20260709 12:13:50.618734 23412 raft_consensus.cc:2764] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 35 FOLLOWER]: Leader election decision vote started in defunct term 34: won
I20260709 12:13:50.621728 23241 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:13:50.618714 13761 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48120 (request call id 3033) took 1571 ms (client timeout 1868 ms). Trace:
W20260709 12:13:50.623060 13761 rpcz_store.cc:269] 0709 12:13:49.047089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:49.096191 (+ 49102us) service_pool.cc:224] Handling call
0709 12:13:50.618532 (+1522341us) spinlock_profiling.cc:243] Waited 508 ms on lock 0x7b54000efe54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:50.618654 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1168710016}
W20260709 12:13:50.524031 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 89916.8us
I20260709 12:13:50.557293 13755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 1658) took 1330 ms. Trace:
I20260709 12:13:50.523006 23372 raft_consensus.cc:697] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:50.567113 13758 raft_consensus.cc:1275] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 28 index: 16. (index mismatch)
I20260709 12:13:50.624476 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:50.625126 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:50.625425 13836 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:50.625696 23372 consensus_queue.cc:237] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:50.624951 13755 rpcz_store.cc:276] 0709 12:13:49.226762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:49.824158 (+597396us) service_pool.cc:224] Handling call
0709 12:13:49.824596 (+   438us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:49.825053 (+   457us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:49.825113 (+    60us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:49.838764 (+ 13651us) log.cc:844] Serialized 26 byte log entry
0709 12:13:50.007714 (+168950us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:13:50.007770 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:50.007835 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:50.556921 (+549086us) raft_consensus.cc:1685] finished
0709 12:13:50.556946 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:50.557111 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1768,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":5944,"thread_start_us":131470,"threads_started":1,"wal-append.queue_time_us":347605}
I20260709 12:13:50.546059 23408 raft_consensus.cc:740] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:50.536985 23349 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:50.569008 23407 consensus_queue.cc:237] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:50.584829 23380 raft_consensus.cc:3055] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 29 LEADER]: Stepping down as leader of term 29
I20260709 12:13:50.631310 23380 raft_consensus.cc:740] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 29 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
W20260709 12:13:50.586561 13756 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48114 (request call id 4003) took 1475 ms (client timeout 1943 ms). Trace:
I20260709 12:13:50.555830 23373 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:50.605206 23298 raft_consensus.cc:740] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:50.609594 14414 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 26.
W20260709 12:13:50.640668 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 75748.8us
I20260709 12:13:50.532405 14415 raft_consensus.cc:1275] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 12:13:50.536275 23025 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:50.638098 13754 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 23.
I20260709 12:13:50.591622 23284 raft_consensus.cc:2749] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 12:13:50.633361 13756 rpcz_store.cc:269] 0709 12:13:49.111067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:49.166678 (+ 55611us) service_pool.cc:224] Handling call
0709 12:13:50.060827 (+894149us) spinlock_profiling.cc:243] Waited 36.2 ms on lock 0x7b58001e3f98. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924e68b71 00007fa924e68a22 00007fa92dd818d9 00007fa92cedbee0 00007fa92cfa50ab 00007fa92cfa5131 00007fa92cf530a0 00007fa92cf52984 00007fa9264cd6d4 00007fa9264cd662
0709 12:13:50.586275 (+525448us) spinlock_profiling.cc:243] Waited 398 ms on lock 0x7b54003c8a54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:50.586448 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":998607872}
W20260709 12:13:50.663650 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 147165us
I20260709 12:13:50.663862 14416 raft_consensus.cc:1275] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 12:13:50.666919 13651 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:50.665858 13836 raft_consensus.cc:2468] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 27.
I20260709 12:13:50.673533 13828 raft_consensus.cc:1275] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 12:13:50.674575 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:50.675359 13832 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:50.678109 13727 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:50.678390 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 34 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:50.680572 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:50.680835 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 29 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:50.681349 13831 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 26.
I20260709 12:13:50.681828 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:50.681732 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:50.683590 13835 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:50.682641 13833 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 25.
I20260709 12:13:50.632337 23380 consensus_queue.cc:260] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 29.17, Last appended by leader: 17, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:50.692106 13763 raft_consensus.cc:2410] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 30 because replica has last-logged OpId of term: 28 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 27 index: 14.
I20260709 12:13:50.624475 23405 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:50.694202 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:50.694659 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:50.694900 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:50.651296 23283 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:50.696483 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 113187us
I20260709 12:13:50.682149 23241 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.702898 14379 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:50.708124 13651 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:50.711779 23149 raft_consensus.cc:2804] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:50.712337 23149 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:50.712800 23149 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:50.712942 23025 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:50.716883 23252 consensus_meta.cc:287] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.515s	user 0.011s	sys 0.000s
I20260709 12:13:50.693660 23362 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:50.717967 23362 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:50.720453 23362 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:50.720687 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 30 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:50.701370 23373 raft_consensus.cc:2804] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:50.721664 23373 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:50.722095 23373 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:50.725119 23241 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:50.727844 23241 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:50.702003 23365 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:13:50.704066 23283 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:50.732657 23149 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:50.735385 13837 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 29.
I20260709 12:13:50.735667 23149 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:50.735559 23399 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:50.736559 23149 raft_consensus.cc:2749] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:50.737107 13651 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:50.738837 23381 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:50.739460 13688 raft_consensus.cc:1240] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:50.740603 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:50.741433 13830 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 26.
W20260709 12:13:50.708503 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 92168.2us
I20260709 12:13:50.743225 13800 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:50.744874 13835 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 28.
W20260709 12:13:50.751835 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 49113.9us
I20260709 12:13:50.758286 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:50.756747 14379 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:50.700970 23412 consensus_queue.cc:1048] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.054s
I20260709 12:13:50.752539 23391 raft_consensus.cc:2749] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:13:50.751811 23251 raft_consensus.cc:2749] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:13:50.767616 14379 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:50.764400 13651 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:50.769857 23381 raft_consensus.cc:2749] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:50.769986 23422 consensus_queue.cc:1048] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.004s
I20260709 12:13:50.770663 22989 raft_consensus.cc:2804] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:50.771275 22989 raft_consensus.cc:697] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 27 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:50.756547 23320 raft_consensus.cc:2804] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Leader election won for term 30
I20260709 12:13:50.772032 23422 consensus_queue.cc:1059] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:13:50.772249 23320 raft_consensus.cc:697] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 30 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:50.772331 22989 consensus_queue.cc:237] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 26.13, Last appended by leader: 13, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:50.773339 23417 raft_consensus.cc:3055] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:50.773926 23417 raft_consensus.cc:740] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:50.773568 23320 consensus_queue.cc:237] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 29.16, Last appended by leader: 16, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:50.775053 23417 consensus_queue.cc:260] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 26.14, Last appended by leader: 14, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:50.778098 14411 raft_consensus.cc:2393] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 26: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:13:50.778285 13651 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:50.700675 23414 consensus_queue.cc:1059] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 25.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.072s
I20260709 12:13:50.753202 23149 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.780683 13800 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:50.706871 23298 consensus_queue.cc:260] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:50.798040 23366 raft_consensus.cc:2804] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:50.781905 23241 consensus_queue.cc:1048] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.020s
I20260709 12:13:50.802829 23405 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:50.804797 23414 raft_consensus.cc:3055] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:13:50.805281 23414 raft_consensus.cc:740] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:50.779882 23394 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:50.784657 23284 consensus_queue.cc:1048] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.022s
I20260709 12:13:50.806378 23414 consensus_queue.cc:260] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 27.18, Last appended by leader: 18, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:50.792747 23379 raft_consensus.cc:2804] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 34 FOLLOWER]: Leader pre-election won for term 35
I20260709 12:13:50.809077 23379 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 34 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:50.809535 23379 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:13:50.808502 23394 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 30 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:50.811965 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 30 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:50.796489 14379 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:50.807979 23414 raft_consensus.cc:3060] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:50.819717 14379 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:50.798521 23298 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:50.766353 23278 consensus_queue.cc:1059] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.055s
I20260709 12:13:50.778903 23399 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:50.798730 23366 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:50.822891 13832 raft_consensus.cc:2468] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 25.
I20260709 12:13:50.828263 13651 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:50.825570 23391 raft_consensus.cc:2804] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:50.834666 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 34 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:50.835495 13760 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 33.
I20260709 12:13:50.861220 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 29 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:50.827937 23381 raft_consensus.cc:2804] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:50.862867 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:50.822542 23365 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:50.865302 13684 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:50.869971 13762 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 24.
I20260709 12:13:50.824049 23006 raft_consensus.cc:2749] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:13:50.834702 23391 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:50.838014 23366 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:50.879863 13756 raft_consensus.cc:1275] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 30 index: 17. (index mismatch)
I20260709 12:13:50.879288 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 30 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:50.881070 13686 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 29.
I20260709 12:13:50.881768 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:50.882174 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:50.882510 13685 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:50.868887 23405 raft_consensus.cc:2749] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 35 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
I20260709 12:13:50.941367 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:50.981626 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:50.982513 13679 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 25.
I20260709 12:13:50.942094 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
W20260709 12:13:50.943523 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:50.883626 23391 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:50.942462 23373 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:50.882751 23278 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:50.992170 23278 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:50.994742 23278 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:50.996095 23373 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:50.935515 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:50.828783 22976 consensus_queue.cc:1048] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.047s
I20260709 12:13:50.998198 13681 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 26.
I20260709 12:13:50.966425 23399 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.966307 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:50.967371 13758 raft_consensus.cc:1275] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 23 index: 11. (index mismatch)
I20260709 12:13:50.999883 23399 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:50.941653 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 173212us
I20260709 12:13:50.934257 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:50.940872 23393 consensus_queue.cc:1048] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.113s
I20260709 12:13:50.978017 23283 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:50.945197 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:50.869525 23381 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:51.010147 23381 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:51.010932 23399 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:13:50.942947 23428 log.cc:927] Time spent T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 12:13:50.975209 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:51.016185 13759 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 24.
I20260709 12:13:50.996886 13755 raft_consensus.cc:1240] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 26. Current term is 27. Ops: [26.16-26.16]
I20260709 12:13:51.018823 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:51.021216 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:51.022086 13681 raft_consensus.cc:3060] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:51.022913 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:51.024447 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 30 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:51.025159 13679 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 29.
I20260709 12:13:51.026260 13684 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 29.
I20260709 12:13:51.032934 23379 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 35 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:51.036052 23379 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 35 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:51.039850 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:51.040234 13681 raft_consensus.cc:2468] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 28.
I20260709 12:13:51.044094 13681 raft_consensus.cc:1240] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 26. Current term is 27. Ops: []
W20260709 12:13:51.046906 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:51.047806 13800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:51.049826 13728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:50.830873 23149 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:51.058734 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 30 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:51.059443 13681 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:51.054324 23060 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.067665 13800 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 30 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:50.878454 23365 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:51.053021 23376 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:51.070231 13683 raft_consensus.cc:2393] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 24: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:51.073503 13681 raft_consensus.cc:2468] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 30.
W20260709 12:13:51.077097 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:51.081391 13837 raft_consensus.cc:1275] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 35 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 33 index: 16. Preceding OpId from leader: term: 35 index: 17. (index mismatch)
I20260709 12:13:51.083019 13685 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 25.
I20260709 12:13:51.085685 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 23 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:51.085302 13726 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:51.088223 13726 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:51.089690 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:51.092386 13726 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:51.091859 23120 raft_consensus.cc:2804] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:51.094275 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 30 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:51.094655 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 29 candidate_status { last_received { term: 28 index: 12 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:51.097311 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:51.097344 13679 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 29.
I20260709 12:13:51.099103 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:51.094626 13726 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:51.100934 13685 raft_consensus.cc:1240] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 24. Current term is 25. Ops: [24.14-24.14]
I20260709 12:13:51.104609 13726 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:51.105944 23366 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:51.108991 23282 consensus_queue.cc:1059] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 26.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:51.111264 13726 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:51.096524 23415 raft_consensus.cc:2804] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:51.097191 23373 raft_consensus.cc:2804] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:13:51.117400 13681 raft_consensus.cc:1275] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 35 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 33 index: 16. Preceding OpId from leader: term: 35 index: 17. (index mismatch)
I20260709 12:13:51.073582 23060 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:51.099291 23120 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:51.095329 23399 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:51.115747 23415 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:51.083278 23376 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:51.112278 23320 raft_consensus.cc:2749] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Leader election lost for term 30. Reason: could not achieve majority
I20260709 12:13:51.134997 23415 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:51.114521 23373 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:51.142554 23417 raft_consensus.cc:3060] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:51.143096 23376 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:51.143179 23372 consensus_queue.cc:1048] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:13:51.143718 23421 raft_consensus.cc:2804] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader election won for term 28
W20260709 12:13:51.144717 23435 log.cc:927] Time spent T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:13:51.133050 22770 raft_consensus.cc:2804] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:51.180804 22770 raft_consensus.cc:697] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:51.182139 22770 consensus_queue.cc:237] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:51.185120 23421 raft_consensus.cc:697] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:51.186800 23421 consensus_queue.cc:237] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.18, Last appended by leader: 18, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:51.187522 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 29 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:51.168685 23394 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.190528 23394 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:51.173290 23373 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:51.178087 23278 consensus_queue.cc:1048] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 12:13:51.170904 23379 consensus_queue.cc:1048] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.029s
I20260709 12:13:51.201898 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 35 candidate_status { last_received { term: 33 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:51.202872 13759 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:13:51.150946 23365 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:51.151692 23060 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:51.151906 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:51.133919 23120 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:51.155386 23399 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:51.103926 23391 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:51.156024 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:51.217028 13759 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 35 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 35.
I20260709 12:13:51.157866 13831 raft_consensus.cc:1275] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 26 index: 13. Preceding OpId from leader: term: 27 index: 14. (index mismatch)
I20260709 12:13:51.164145 13651 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:13:51.169273 13634 auto_rebalancer.cc:629] Failed to schedule move for tablet 637cf9d05e2348118404a474b84d67d7: Illegal state: Replica 3f37c9cc9dda46b4be21dd675ba78fb7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 26 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
W20260709 12:13:51.218875 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 54819.8us
I20260709 12:13:51.217245 13833 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 30.
I20260709 12:13:51.170270 13687 raft_consensus.cc:2410] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 28 because replica has last-logged OpId of term: 27 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 17.
I20260709 12:13:51.126653 23298 raft_consensus.cc:2804] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Leader election won for term 30
I20260709 12:13:51.177429 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:51.209503 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:51.171248 23407 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.218125 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:51.223382 13760 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 27.
I20260709 12:13:51.210422 23394 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:51.225270 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:51.229358 13651 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 35 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:13:51.231488 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 163861us
I20260709 12:13:51.223371 23405 raft_consensus.cc:2804] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:51.236380 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 30 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:51.236788 13800 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:51.239738 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:51.240639 13832 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 22.
I20260709 12:13:51.227910 23298 raft_consensus.cc:697] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:51.244525 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 29 candidate_status { last_received { term: 28 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:51.245941 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:51.248317 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:51.249207 13837 raft_consensus.cc:2393] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 27: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:51.249491 13759 raft_consensus.cc:2468] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 25.
I20260709 12:13:51.250524 13831 raft_consensus.cc:1240] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 26. Current term is 27. Ops: [24.13-26.14]
I20260709 12:13:51.250882 13759 raft_consensus.cc:1240] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 24. Current term is 25. Ops: [24.16-24.16]
I20260709 12:13:51.250469 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:51.243942 23381 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:51.252724 13835 raft_consensus.cc:2393] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 28: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:51.254506 23381 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:51.256808 13833 raft_consensus.cc:1240] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 27. Current term is 28. Ops: [25.17-27.18]
I20260709 12:13:51.237998 23060 consensus_queue.cc:1048] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.021s
I20260709 12:13:51.241353 23393 raft_consensus.cc:2804] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 35 FOLLOWER]: Leader election won for term 35
I20260709 12:13:51.270759 13832 raft_consensus.cc:1240] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 29. Current term is 30. Ops: []
I20260709 12:13:51.271627 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 32 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:51.272226 13832 raft_consensus.cc:1240] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 28. Current term is 29. Ops: []
I20260709 12:13:51.273192 23391 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:51.273811 23366 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:51.243115 23405 raft_consensus.cc:697] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 24 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:51.274986 23399 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:51.275172 23405 consensus_queue.cc:237] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 23.18, Last appended by leader: 18, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:51.276738 23380 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:51.279253 23298 consensus_queue.cc:237] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 28.15, Last appended by leader: 15, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:51.280871 23393 raft_consensus.cc:697] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 35 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:51.231791 23407 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:51.282025 23393 consensus_queue.cc:237] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 33.17, Last appended by leader: 17, Current term: 35, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:51.284065 23407 leader_election.cc:290] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:51.286803 13757 raft_consensus.cc:1240] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:51.288445 13757 raft_consensus.cc:1275] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 33 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 32 index: 21. Preceding OpId from leader: term: 33 index: 21. (term mismatch)
I20260709 12:13:51.288817 13757 pending_rounds.cc:85] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting all ops after (but not including) 20
I20260709 12:13:51.282151 23408 consensus_queue.cc:260] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:51.304252 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 33 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:51.317658 13759 raft_consensus.cc:1240] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 24. Current term is 25. Ops: [24.14-24.14]
I20260709 12:13:51.321003 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:51.289088 13757 pending_rounds.cc:107] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7: Aborting uncommitted NO_OP operation due to leader change: 32.21
I20260709 12:13:51.321760 13679 raft_consensus.cc:1275] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 26 index: 13. Preceding OpId from leader: term: 27 index: 14. (index mismatch)
I20260709 12:13:51.321827 13757 raft_consensus.cc:2889] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 33 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:51.322615 13835 raft_consensus.cc:2410] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 26 because replica has last-logged OpId of term: 24 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 15.
I20260709 12:13:51.325320 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:51.319761 13687 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 32.
I20260709 12:13:51.326325 13829 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 26.
I20260709 12:13:51.329425 13837 raft_consensus.cc:1240] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 24. Current term is 25. Ops: [22.15-24.16]
I20260709 12:13:51.326156 23408 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:51.337673 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 35 candidate_status { last_received { term: 33 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:51.339705 13757 raft_consensus.cc:1240] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 35 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 34. Current term is 35. Ops: []
I20260709 12:13:51.341915 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:51.341991 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 33 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:51.345228 13837 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 31.
I20260709 12:13:51.352177 23373 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:51.356657 13829 raft_consensus.cc:1275] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 28 index: 16. (index mismatch)
I20260709 12:13:51.356807 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 30 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:13:51.349936 23438 log.cc:927] Time spent T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 12:13:51.360152 13837 raft_consensus.cc:2410] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 30 because replica has last-logged OpId of term: 28 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 27 index: 14.
I20260709 12:13:51.362655 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:51.360365 13835 raft_consensus.cc:1275] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 30 index: 17. (index mismatch)
I20260709 12:13:51.361971 13832 raft_consensus.cc:1275] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 23 index: 11. (index mismatch)
I20260709 12:13:51.380651 13760 raft_consensus.cc:2393] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 30: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:51.385537 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:51.385571 13833 raft_consensus.cc:2393] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 28: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
W20260709 12:13:51.388514 23448 log.cc:927] Time spent T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:13:51.388701 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 35 candidate_status { last_received { term: 33 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:51.390036 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 31 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:51.399580 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:51.400709 13832 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 27.
I20260709 12:13:51.404017 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:51.404400 13800 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:51.391687 23320 raft_consensus.cc:2749] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:51.410094 13800 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:51.411751 23368 consensus_queue.cc:1059] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:13:51.412694 23368 raft_consensus.cc:3055] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:51.413096 23368 raft_consensus.cc:740] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:51.413254 13685 raft_consensus.cc:1275] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 12:13:51.413637 13652 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:51.414117 23368 consensus_queue.cc:260] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:51.415642 23368 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:51.416278 13832 raft_consensus.cc:1275] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 28 index: 18. (index mismatch)
I20260709 12:13:51.414625 23399 raft_consensus.cc:2804] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:51.417330 23399 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:51.417822 23399 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:13:51.418917 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:51.045260 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:51.421906 23284 raft_consensus.cc:3055] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:51.422327 23284 raft_consensus.cc:740] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:51.423218 23284 consensus_queue.cc:260] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.14, Last appended by leader: 14, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:51.424564 23284 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:51.424957 23149 leader_election.cc:290] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:51.430831 13726 leader_election.cc:304] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:51.433454 23175 consensus_queue.cc:1048] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:13:51.437176 23251 raft_consensus.cc:3055] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:51.437716 23399 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:51.440130 23399 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:51.440442 13683 raft_consensus.cc:1275] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 27 index: 18. Preceding OpId from leader: term: 28 index: 18. (term mismatch)
I20260709 12:13:51.440865 13683 pending_rounds.cc:85] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 17
I20260709 12:13:51.441097 13683 pending_rounds.cc:107] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 27.18
I20260709 12:13:51.441331 13683 raft_consensus.cc:2889] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:51.433492 22507 raft_consensus.cc:2804] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260709 12:13:51.437712 23251 raft_consensus.cc:740] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:51.442374 22507 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 32 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:51.442818 22507 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:13:51.443212 23251 consensus_queue.cc:260] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:51.444375 23251 raft_consensus.cc:3060] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:51.444646 13727 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:51.445637 23421 raft_consensus.cc:2804] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:51.445487 23355 consensus_queue.cc:1048] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:13:51.446133 23421 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:51.446604 23421 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:51.449023 23006 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:51.449615 23006 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:51.451400 22507 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 33 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:51.452680 23006 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:51.453636 13727 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:51.453801 22507 leader_election.cc:290] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 33 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:51.458673 13652 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:51.459316 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 33 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:51.460055 13685 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:13:51.468345 23006 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.468487 23422 consensus_queue.cc:1059] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 28.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:13:51.469096 23006 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:51.469831 23405 raft_consensus.cc:2749] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:13:51.471267 23006 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:51.478713 13800 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:51.454530 22507 raft_consensus.cc:2804] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:51.487098 22507 raft_consensus.cc:697] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:51.487818 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:51.492506 13800 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:51.493098 13763 raft_consensus.cc:1240] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 29. Current term is 30. Ops: []
I20260709 12:13:51.494184 13800 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:51.497045 14411 raft_consensus.cc:1240] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 26. Current term is 27. Ops: [26.16-26.16]
I20260709 12:13:51.489892 13727 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:51.472908 23241 raft_consensus.cc:2804] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:13:51.502380 14416 raft_consensus.cc:1240] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:51.504000 14407 raft_consensus.cc:1275] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 33 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 32 index: 20. Preceding OpId from leader: term: 33 index: 21. (index mismatch)
I20260709 12:13:51.518555 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:51.504036 13727 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:51.526348 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:51.526535 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:51.527141 13763 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 23.
I20260709 12:13:51.528399 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 31 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:51.529587 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:51.531170 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:51.480062 23422 raft_consensus.cc:3055] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 28 LEADER]: Stepping down as leader of term 28
W20260709 12:13:51.537328 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 56510.2us
I20260709 12:13:51.480324 23443 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:51.542984 13763 raft_consensus.cc:1275] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 29 index: 16. Preceding OpId from leader: term: 30 index: 17. (index mismatch)
I20260709 12:13:51.542454 13652 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:51.543272 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:51.500396 23060 raft_consensus.cc:2749] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:51.490020 23424 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:51.498732 23365 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 34 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:51.568602 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:51.498594 23252 raft_consensus.cc:2749] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
I20260709 12:13:51.502092 23006 raft_consensus.cc:2804] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:51.526086 23175 raft_consensus.cc:2804] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:51.535223 23241 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:51.569463 14407 raft_consensus.cc:2368] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 24. Current term is 25.
I20260709 12:13:51.482344 23389 consensus_queue.cc:1059] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 25.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.065s
I20260709 12:13:51.542943 23362 raft_consensus.cc:2804] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:51.648180 14414 raft_consensus.cc:1275] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 12:13:51.490355 23298 consensus_queue.cc:1048] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.064s
I20260709 12:13:51.572955 13685 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 33.
W20260709 12:13:51.574491 13802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:51.488442 23355 consensus_queue.cc:1048] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.067s
I20260709 12:13:51.573035 23282 consensus_queue.cc:1048] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.067s
I20260709 12:13:51.576680 13687 raft_consensus.cc:1240] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 35 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 34. Current term is 35. Ops: []
I20260709 12:13:51.606967 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:51.553521 23381 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.613334 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 29 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:51.522271 23415 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:51.610294 22770 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.647727 22507 consensus_queue.cc:237] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:51.662519 22770 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:51.663882 23415 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:51.664652 13757 raft_consensus.cc:1240] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 26. Current term is 27. Ops: [24.16-26.17]
W20260709 12:13:51.618781 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 90549.3us
W20260709 12:13:51.608950 23448 log.cc:927] Time spent T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:13:51.574131 23424 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:51.666126 13727 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
W20260709 12:13:51.667199 23446 log.cc:927] Time spent T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
I20260709 12:13:51.664705 22770 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:51.644004 23241 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:51.645910 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:51.539111 23422 raft_consensus.cc:740] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 28 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:51.655421 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:51.657814 13828 raft_consensus.cc:3060] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:51.563838 23443 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:51.566583 23120 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:51.646090 23373 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 30 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:51.637679 23175 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:51.645903 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:51.682499 14415 raft_consensus.cc:2368] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 28. Current term is 29.
I20260709 12:13:51.582864 23365 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 34 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:51.688213 14412 raft_consensus.cc:2393] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 27: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:13:51.691102 23422 consensus_queue.cc:260] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 28.12, Last appended by leader: 12, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:51.692651 23422 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:51.694610 23365 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:51.670351 23362 raft_consensus.cc:697] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:13:51.700804 23447 log.cc:927] Time spent T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.299s	user 0.000s	sys 0.001s
I20260709 12:13:51.688891 23175 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:51.674664 23381 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 33 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:51.681807 22770 raft_consensus.cc:2804] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:13:51.708931 22770 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:51.709376 22770 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:51.711081 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:51.717072 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 35 candidate_status { last_received { term: 34 index: 20 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:51.719204 23120 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:51.704663 23394 consensus_queue.cc:1048] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.017s
I20260709 12:13:51.723687 23381 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:51.688524 23407 consensus_queue.cc:1048] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 12:13:51.700868 23362 consensus_queue.cc:237] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:51.733179 23457 log.cc:927] Time spent T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
W20260709 12:13:51.737884 23451 log.cc:927] Time spent T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:13:51.734078 13828 raft_consensus.cc:2468] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 29.
W20260709 12:13:51.736907 23417 consensus_meta.cc:287] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.558s	user 0.007s	sys 0.004s
I20260709 12:13:51.729267 14379 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:51.725761 22770 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:51.741626 13686 raft_consensus.cc:2410] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 27 because replica has last-logged OpId of term: 26 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 12.
W20260709 12:13:51.749591 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 254083us
I20260709 12:13:51.736882 23443 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:51.755482 23407 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:51.753901 23463 consensus_queue.cc:1059] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 24.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.019s
I20260709 12:13:51.750535 23349 raft_consensus.cc:2804] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Leader election won for term 29
W20260709 12:13:51.763123 13634 auto_rebalancer.cc:629] Failed to schedule move for tablet 0a8c7c772cf44d36bc44b25edc405d1d: Illegal state: Replica 3f37c9cc9dda46b4be21dd675ba78fb7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 25 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:13:51.769863 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:51.801694 13759 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:51.773895 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:51.799610 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 34 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:51.764194 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:51.771363 13727 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:51.758180 23416 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.810181 23416 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 33 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:51.814209 23376 raft_consensus.cc:2749] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:51.762418 23407 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:51.759392 23415 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:51.817895 23407 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:51.818035 23415 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:51.779207 23456 log.cc:927] Time spent T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.128s	user 0.002s	sys 0.000s
I20260709 12:13:51.822779 23376 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.823309 23376 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:51.768589 23120 consensus_queue.cc:1048] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.055s
I20260709 12:13:51.824939 22982 raft_consensus.cc:3055] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:51.759065 23464 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:51.825435 22982 raft_consensus.cc:740] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 24 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:51.825907 23464 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:51.827329 22982 consensus_queue.cc:260] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:51.828617 22982 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:51.826329 13762 raft_consensus.cc:1275] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
I20260709 12:13:51.830437 23464 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:51.831760 13757 raft_consensus.cc:2410] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 33 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for term 34 because replica has last-logged OpId of term: 30 index: 20, which is greater than that of the candidate, which has last-logged OpId of term: 29 index: 19.
I20260709 12:13:51.833374 14411 raft_consensus.cc:1240] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 28. Current term is 29. Ops: []
I20260709 12:13:51.770656 23349 raft_consensus.cc:697] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 29 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:51.834558 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:51.835412 13763 raft_consensus.cc:2393] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 27: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
W20260709 12:13:51.839504 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 297155us
I20260709 12:13:51.840395 13652 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:13:51.760396 23453 log.cc:927] Time spent T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 12:13:51.841982 22989 raft_consensus.cc:2804] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:51.842458 22989 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:51.842860 22989 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:51.779515 23421 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:51.845587 13754 raft_consensus.cc:1240] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:51.846004 23379 raft_consensus.cc:2749] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:51.843811 23424 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:51.850136 23389 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.850935 23389 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:51.813364 23416 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:51.852267 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:51.853307 13688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:51.853997 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:51.855399 13652 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:51.825580 23376 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:51.860831 13759 raft_consensus.cc:2468] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 25.
W20260709 12:13:51.869143 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 97875.2us
I20260709 12:13:51.863358 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:51.873847 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 34 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:51.874753 14411 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 33.
I20260709 12:13:51.879680 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:51.882392 13727 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:51.821252 23415 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:51.757334 22770 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 31 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:51.888020 13726 leader_election.cc:304] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 33 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:51.895570 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:13:51.896607 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 142314us
I20260709 12:13:51.888486 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:51.899143 13800 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:51.900563 14412 raft_consensus.cc:1275] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 33 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 29 index: 19. Preceding OpId from leader: term: 33 index: 21. (index mismatch)
I20260709 12:13:51.887293 23374 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.909421 13727 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:51.914830 13652 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:51.795940 23175 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:51.921422 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:51.925707 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 30 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:51.926995 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:51.776664 23241 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:51.896184 23417 raft_consensus.cc:2749] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:13:51.928979 13681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:51.901436 23408 raft_consensus.cc:3055] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:51.948949 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 33 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:51.949857 13830 raft_consensus.cc:3060] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 31 FOLLOWER]: Advancing to term 33
I20260709 12:13:51.950220 14379 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
W20260709 12:13:51.951164 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 52114us
I20260709 12:13:51.927700 13837 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:51.940229 13652 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:51.940641 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:51.960331 13652 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:51.962260 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 31 candidate_status { last_received { term: 29 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:51.920361 23415 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:13:51.962519 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:13:51.965870 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 56517.3us
I20260709 12:13:51.964279 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 35 candidate_status { last_received { term: 34 index: 20 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:51.934173 23365 raft_consensus.cc:2804] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 33 FOLLOWER]: Leader election won for term 33
I20260709 12:13:51.992336 13828 raft_consensus.cc:2393] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 30: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:51.909276 23278 consensus_queue.cc:1048] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.054s
I20260709 12:13:51.938407 23380 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:51.933538 23421 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:51.997725 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 47700.6us
I20260709 12:13:51.938849 23252 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 34 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:51.908725 23443 consensus_queue.cc:1048] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.055s
I20260709 12:13:51.963845 23399 raft_consensus.cc:2749] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 12:13:52.022105 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:52.023131 13651 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:52.000505 14379 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:51.948990 23408 raft_consensus.cc:740] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:51.965247 23060 raft_consensus.cc:2804] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:51.931937 23374 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:52.056005 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 60590.5us
I20260709 12:13:52.010588 23476 consensus_queue.cc:1048] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:13:52.013329 23422 raft_consensus.cc:2749] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:52.013566 23376 consensus_queue.cc:1059] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 28.20, Next index: 21, Last known committed idx: 20, Time since last communication: 0.001s
I20260709 12:13:52.058969 13830 raft_consensus.cc:2468] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 33.
I20260709 12:13:52.013962 23252 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 34 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:52.013376 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 77732.5us
I20260709 12:13:52.064402 13801 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:51.933991 23405 consensus_queue.cc:1048] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 12:13:51.935264 23412 consensus_queue.cc:1059] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.062s
I20260709 12:13:51.963758 23006 raft_consensus.cc:697] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 25 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:51.933712 23149 consensus_queue.cc:1048] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.064s
I20260709 12:13:52.024315 13837 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 26.
I20260709 12:13:52.035526 14379 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:51.994335 23298 raft_consensus.cc:2749] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:51.996021 23417 raft_consensus.cc:2804] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:51.996052 23424 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 33 FOLLOWER]: Leader pre-election won for term 34
I20260709 12:13:52.060523 13800 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:52.060689 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:51.998188 23464 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 33 FOLLOWER]: Leader pre-election won for term 34
I20260709 12:13:51.953296 23467 consensus_queue.cc:1059] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.124s
I20260709 12:13:52.070782 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 34 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:52.031520 23060 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:52.024780 22976 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.064807 23391 consensus_queue.cc:1048] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.019s
I20260709 12:13:52.032053 23365 raft_consensus.cc:697] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 33 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:52.407655 23365 consensus_queue.cc:237] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 31.18, Last appended by leader: 18, Current term: 33, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:52.410041 13634 auto_rebalancer.cc:629] Failed to schedule move for tablet 0e3f87a61fef4f1ca0b961e7c64d63f8: Illegal state: Replica b98d2519bb504dc6905ed2ede4571835 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 35 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:13:52.411547 23252 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:13:52.411976 22989 consensus_meta.cc:287] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.569s	user 0.009s	sys 0.003s
I20260709 12:13:52.412484 22989 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:52.412976 23252 raft_consensus.cc:2749] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:13:52.354612 22770 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:52.122812 23060 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:52.414901 22770 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:52.347048 23278 consensus_queue.cc:1048] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.069s
W20260709 12:13:52.188992 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 165958us
I20260709 12:13:52.298635 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:52.422134 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:52.422773 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 30 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:52.423467 13687 raft_consensus.cc:3060] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:52.022349 23380 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:52.319973 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:51.963083 23349 consensus_queue.cc:237] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 27.20, Last appended by leader: 20, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:52.222054 13833 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 34 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 34.
I20260709 12:13:52.337221 13836 raft_consensus.cc:1275] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 28 index: 19. (index mismatch)
I20260709 12:13:52.343438 14379 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:52.081032 23366 raft_consensus.cc:2804] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:52.070870 23405 consensus_queue.cc:1243] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer 96701a74fdee481fb5f54aac841e17dd log is divergent from this leader: its last log entry 20.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:13:52.066865 23368 consensus_queue.cc:1059] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.100s
I20260709 12:13:52.333622 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:52.083875 23464 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 33 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:52.124934 23452 log.cc:927] Time spent T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:13:52.082291 23386 raft_consensus.cc:2749] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:13:52.227434 23408 consensus_queue.cc:260] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.16, Last appended by leader: 16, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:52.271947 23354 raft_consensus.cc:2804] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:52.081394 23424 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 33 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:52.214834 23006 consensus_queue.cc:237] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:52.313527 23381 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:13:52.358805 23471 log.cc:927] Time spent T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.359s	user 0.000s	sys 0.002s
W20260709 12:13:52.364801 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 300469us
I20260709 12:13:52.320632 23414 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:52.318233 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:13:52.303804 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 92293.1us
I20260709 12:13:52.495891 13652 leader_election.cc:400] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 election: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 24. Current term is 25.
I20260709 12:13:52.496663 13801 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:52.497087 13652 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:52.081670 23417 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:52.333425 13830 raft_consensus.cc:1275] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 14. (term mismatch)
I20260709 12:13:52.499289 13830 pending_rounds.cc:85] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 13
I20260709 12:13:52.499681 13830 pending_rounds.cc:107] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 24.14
I20260709 12:13:52.500052 13830 raft_consensus.cc:2889] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:13:52.396026 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 308720us
W20260709 12:13:52.401042 22982 consensus_meta.cc:287] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.572s	user 0.008s	sys 0.006s
I20260709 12:13:52.364087 23120 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.404939 22976 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:52.362171 23389 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:52.476419 23252 raft_consensus.cc:3055] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 34 LEADER]: Stepping down as leader of term 34
W20260709 12:13:52.439617 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 96288.5us
I20260709 12:13:52.520925 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:52.439670 13681 raft_consensus.cc:1240] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:52.441844 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 31 candidate_status { last_received { term: 29 index: 16 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:52.445674 23391 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:13:52.449213 13686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:52.522747 13683 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 30.
I20260709 12:13:52.373164 23422 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:52.451581 13679 raft_consensus.cc:1275] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 28 index: 19. (index mismatch)
I20260709 12:13:52.466066 13761 raft_consensus.cc:1275] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 26 index: 13. Preceding OpId from leader: term: 27 index: 14. (index mismatch)
I20260709 12:13:52.425889 23481 consensus_queue.cc:1059] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 26.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.038s
I20260709 12:13:52.454655 23464 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:13:52.472098 23487 raft_consensus.cc:3055] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:52.472839 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:52.502692 13759 raft_consensus.cc:1275] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 35 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 33 index: 17. Preceding OpId from leader: term: 35 index: 18. (index mismatch)
I20260709 12:13:52.506435 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 31 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:52.455238 23366 raft_consensus.cc:697] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 25 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:52.512102 23414 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:52.528375 23320 consensus_queue.cc:1059] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.081s
I20260709 12:13:52.604475 23487 raft_consensus.cc:740] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:52.610035 23414 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:52.524927 23175 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:52.506918 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 31 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:52.611266 23487 consensus_queue.cc:260] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 17, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:52.613268 23487 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Advancing to term 27
W20260709 12:13:52.605453 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 90820.9us
W20260709 12:13:52.607772 23490 log.cc:927] Time spent T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:13:52.618441 23360 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:52.607807 23482 log.cc:927] Time spent T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:13:52.619202 23360 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:52.607826 23366 consensus_queue.cc:237] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 23.18, Last appended by leader: 18, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:52.606813 13762 raft_consensus.cc:2410] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 31 because replica has last-logged OpId of term: 29 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 27 index: 15.
I20260709 12:13:52.473685 23424 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:13:52.437518 23241 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 30 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:52.511729 23252 raft_consensus.cc:740] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 34 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:52.465919 23354 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:52.510879 13652 leader_election.cc:400] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 election: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 28. Current term is 29.
I20260709 12:13:52.658787 13652 leader_election.cc:403] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 election: Cancelling election due to peer responding with higher term
I20260709 12:13:52.528203 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:52.529938 14380 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:52.505569 23417 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:52.504526 23381 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:52.509858 23251 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.604717 13682 raft_consensus.cc:3060] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:52.604621 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:52.509403 13754 raft_consensus.cc:1240] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:52.608803 22976 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:52.608151 23422 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:52.634239 23414 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:52.635107 23481 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
W20260709 12:13:52.635324 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:52.654804 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:52.528640 23386 raft_consensus.cc:2749] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:13:52.559454 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:13:52.670662 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 140904us
W20260709 12:13:52.659678 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 148985us
I20260709 12:13:52.706889 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 35 candidate_status { last_received { term: 34 index: 20 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:52.688532 13760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 4044) took 1202 ms. Trace:
I20260709 12:13:52.708740 13652 leader_election.cc:304] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:52.698963 13687 raft_consensus.cc:2468] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 30.
I20260709 12:13:52.607666 23491 raft_consensus.cc:2749] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:52.707772 13760 rpcz_store.cc:276] 0709 12:13:51.485764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.503252 (+ 17488us) service_pool.cc:224] Handling call
0709 12:13:51.548200 (+ 44948us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:51.553504 (+  5304us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:51.553534 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:51.554134 (+   600us) log.cc:844] Serialized 52 byte log entry
0709 12:13:51.797901 (+243767us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:13:51.797944 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:51.798015 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:52.688153 (+890138us) raft_consensus.cc:1685] finished
0709 12:13:52.688190 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:52.688431 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4792,"raft.queue_time_us":6770,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":6478,"thread_start_us":232772,"threads_started":1,"wal-append.queue_time_us":341378}
I20260709 12:13:52.658028 23405 raft_consensus.cc:3055] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:52.510098 23120 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:52.668025 23354 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:52.653288 23464 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 34 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:52.690701 23376 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.038s	sys 0.034s
I20260709 12:13:52.674527 23320 consensus_queue.cc:1243] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer b98d2519bb504dc6905ed2ede4571835 log is divergent from this leader: its last log entry 35.18 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 16
I20260709 12:13:52.731526 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:52.740998 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:52.816349 13833 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:52.818666 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 35 candidate_status { last_received { term: 34 index: 20 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:52.660627 23060 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:52.686964 23476 raft_consensus.cc:2749] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:52.690985 23360 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:52.631116 23488 consensus_queue.cc:1048] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 19, Time since last communication: 0.088s
I20260709 12:13:52.792186 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 30 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:52.700037 22976 raft_consensus.cc:2749] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
W20260709 12:13:52.790798 23376 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.039s	sys 0.034s
I20260709 12:13:52.825938 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:52.828070 13755 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 30.
I20260709 12:13:52.834982 23495 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.836328 23422 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:52.836822 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:52.837543 23491 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:52.838012 23380 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:52.842368 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 30 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:52.863368 13760 raft_consensus.cc:2393] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 30: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
W20260709 12:13:52.791421 23468 log.cc:927] Time spent T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:13:52.736876 23405 raft_consensus.cc:740] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:52.846263 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:52.698109 23251 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:52.849941 13761 raft_consensus.cc:1240] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 34 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 33. Current term is 34. Ops: [33.21-33.21]
I20260709 12:13:52.790793 22989 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:52.856879 13683 raft_consensus.cc:2393] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 30: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:52.705230 23414 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:52.882560 13834 raft_consensus.cc:2468] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 22.
I20260709 12:13:52.859879 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:52.892338 13687 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 27.
I20260709 12:13:52.711359 23481 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:52.829370 23320 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:52.883553 13679 raft_consensus.cc:1275] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 12:13:52.855162 23368 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:52.919778 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 34 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:52.932376 13687 raft_consensus.cc:1275] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 28 index: 15. Preceding OpId from leader: term: 30 index: 16. (index mismatch)
I20260709 12:13:52.934728 13679 raft_consensus.cc:1275] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 27 index: 15. Preceding OpId from leader: term: 30 index: 17. (index mismatch)
I20260709 12:13:52.892623 23120 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:52.954766 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 111974us
I20260709 12:13:52.893611 23241 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.969125 13683 raft_consensus.cc:1240] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 29. Current term is 30. Ops: []
I20260709 12:13:52.900183 23376 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:52.896344 23489 raft_consensus.cc:2749] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:52.901285 23487 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.982563 13834 raft_consensus.cc:1275] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
W20260709 12:13:52.479951 23483 consensus_queue.cc:1175] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ca9fbbc2c0a94897897d502d42f3951f" responder_term: 27 status { last_received { term: 25 index: 15 } last_committed_idx: 15 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 26. Current term is 27. Ops: [26.16-26.16]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:13:52.994798 13687 raft_consensus.cc:1275] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 26 index: 14. Preceding OpId from leader: term: 27 index: 13. (term mismatch)
I20260709 12:13:52.996265 13687 pending_rounds.cc:85] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 12
I20260709 12:13:52.997162 13687 pending_rounds.cc:107] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 24.13
I20260709 12:13:52.950575 23494 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:52.998056 13687 raft_consensus.cc:2889] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:52.862591 23495 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:53.004947 13687 pending_rounds.cc:107] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 26.14
I20260709 12:13:52.866531 23491 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:53.010228 13687 raft_consensus.cc:2889] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:52.963666 23492 raft_consensus.cc:2749] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Leader election lost for term 28. Reason: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 28. Current term is 29.
I20260709 12:13:52.947973 23368 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:52.938297 23320 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:53.012404 13683 raft_consensus.cc:1275] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 16. (term mismatch)
I20260709 12:13:53.024995 13683 pending_rounds.cc:85] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835: Aborting all ops after (but not including) 15
I20260709 12:13:53.026283 13683 pending_rounds.cc:107] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835: Aborting uncommitted NO_OP operation due to leader change: 24.16
I20260709 12:13:53.026535 13683 raft_consensus.cc:2889] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:13:53.044644 13756 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.003s	sys 0.007s
W20260709 12:13:53.045337 13756 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.003s	sys 0.007s
I20260709 12:13:53.011245 22989 consensus_queue.cc:1048] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.016s
I20260709 12:13:53.022403 23492 consensus_queue.cc:1059] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:13:52.986428 23241 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:53.021392 13687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:52.988092 23376 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:52.999488 23487 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:53.024991 23467 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.053891 13687 raft_consensus.cc:2468] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 22.
W20260709 12:13:53.059988 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 212837us
I20260709 12:13:53.014430 23380 consensus_queue.cc:1048] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.036s
I20260709 12:13:53.010766 23494 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:52.978891 23405 consensus_queue.cc:260] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.14, Last appended by leader: 14, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:53.062139 13800 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:53.064633 14379 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:53.068053 14380 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:53.077093 14380 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:53.080528 14380 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:53.083082 23359 raft_consensus.cc:2749] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:53.083922 23359 raft_consensus.cc:2804] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:53.084295 23359 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:53.084656 23359 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:53.086088 23283 raft_consensus.cc:2749] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 33 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
I20260709 12:13:53.087483 23368 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:53.093541 13682 raft_consensus.cc:2468] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 26.
W20260709 12:13:53.121177 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:53.134680 13801 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:13:53.146358 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 64345.5us
I20260709 12:13:53.078358 23464 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 34 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:53.097545 23502 raft_consensus.cc:2804] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:53.096786 23389 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 35 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:53.119004 23405 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:53.123023 23481 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:53.062952 23467 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:53.188809 23488 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:53.189147 23491 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:53.189591 23488 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:53.190682 13833 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 23.
I20260709 12:13:53.191220 23491 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:53.157073 22989 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:53.158648 23251 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:53.196959 13829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 4410) took 1270 ms. Trace:
I20260709 12:13:53.157596 23060 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:13:53.206197 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 71675.8us
I20260709 12:13:53.162801 23389 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 35 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:53.157507 23283 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:53.206203 22989 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:53.207605 23283 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:53.208863 23493 log.cc:927] Time spent T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
I20260709 12:13:53.158429 23502 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:53.158067 23492 raft_consensus.cc:3055] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 24 LEADER]: Stepping down as leader of term 24
W20260709 12:13:53.189342 23501 log.cc:927] Time spent T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 12:13:53.243258 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:53.249564 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:53.205084 13829 rpcz_store.cc:276] 0709 12:13:51.926927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.928068 (+  1141us) service_pool.cc:224] Handling call
0709 12:13:51.956233 (+ 28165us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:51.994217 (+ 37984us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:51.994265 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:52.676940 (+682675us) spinlock_profiling.cc:243] Waited 6.95 ms on lock 0x7b2c0000bb28. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa926886a11 00007fa926896372 00007fa927fc8a01 00007fa927f8d43a 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2
0709 12:13:52.691319 (+ 14379us) log.cc:844] Serialized 52 byte log entry
0709 12:13:52.984716 (+293397us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:13:53.007128 (+ 22412us) log.cc:844] Serialized 14 byte log entry
0709 12:13:53.007443 (+   315us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:53.007525 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:53.192795 (+185270us) raft_consensus.cc:1685] finished
0709 12:13:53.196661 (+  3866us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:53.196856 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21816,"prepare.queue_time_us":17690,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":202051,"raft.run_cpu_time_us":332,"raft.run_wall_time_us":3643,"spinlock_wait_cycles":15983360,"thread_start_us":192871,"threads_started":1,"wal-append.queue_time_us":415606}
I20260709 12:13:53.303165 13836 raft_consensus.cc:2393] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 27: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:53.163686 23414 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:53.300774 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:53.210256 13831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 4403) took 1285 ms. Trace:
I20260709 12:13:53.153389 23515 consensus_queue.cc:1048] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.079s
W20260709 12:13:53.210780 23497 log.cc:927] Time spent T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.222s	user 0.000s	sys 0.001s
I20260709 12:13:53.304610 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:53.309262 13833 raft_consensus.cc:2468] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 21.
W20260709 12:13:53.222926 23496 log.cc:927] Time spent T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.300s	user 0.000s	sys 0.001s
W20260709 12:13:53.222673 23524 log.cc:927] Time spent T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:13:53.313719 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:53.230775 23465 raft_consensus.cc:3055] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 28 LEADER]: Stepping down as leader of term 28
I20260709 12:13:53.209667 22989 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:53.299680 23502 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:53.305177 13831 rpcz_store.cc:276] 0709 12:13:51.924584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.924744 (+   160us) service_pool.cc:224] Handling call
0709 12:13:51.948592 (+ 23848us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:51.956235 (+  7643us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 12:13:51.956265 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:51.956738 (+   473us) log.cc:844] Serialized 26 byte log entry
0709 12:13:52.332320 (+375582us) spinlock_profiling.cc:243] Waited 1.75 ms on lock 0x7b180013dec0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e82e07 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9fc02 00007fa927b2720b 00007fa927b2cd23 00007fa927b2d0d1 00007fa927f48a0f
0709 12:13:52.675384 (+343064us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:13:52.675445 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:52.675542 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:53.209962 (+534420us) raft_consensus.cc:1685] finished
0709 12:13:53.209983 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:53.210197 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31943,"raft.queue_time_us":39756,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":4499,"spinlock_wait_cycles":4020096,"thread_start_us":342789,"threads_started":1,"wal-append.queue_time_us":882225}
I20260709 12:13:53.224053 23522 raft_consensus.cc:2749] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 34 FOLLOWER]: Leader pre-election lost for term 35. Reason: could not achieve majority
I20260709 12:13:53.192296 23488 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:53.192435 23491 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:53.300841 23492 raft_consensus.cc:740] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:53.210888 23283 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:53.326290 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:53.217414 23359 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:53.331369 13829 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 26.
I20260709 12:13:53.331764 13833 raft_consensus.cc:1240] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:53.318894 23465 raft_consensus.cc:740] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 28 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:53.229095 23354 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:53.222919 23252 consensus_queue.cc:260] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 34.18, Last appended by leader: 18, Current term: 34, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:53.324626 23320 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:53.338300 13835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 4412) took 1388 ms. Trace:
I20260709 12:13:53.339330 13835 rpcz_store.cc:276] 0709 12:13:51.950091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.953837 (+  3746us) service_pool.cc:224] Handling call
0709 12:13:51.954314 (+   477us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:52.055601 (+101287us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:52.055636 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:52.402969 (+347333us) spinlock_profiling.cc:243] Waited 2.78 ms on lock 0x7b2c0000bb28. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa926886a11 00007fa926896372 00007fa927fc8a01 00007fa927f8d43a 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2
0709 12:13:52.403438 (+   469us) log.cc:844] Serialized 26 byte log entry
0709 12:13:52.418408 (+ 14970us) spinlock_profiling.cc:243] Waited 2.98 ms on lock 0x7b1800373720. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924ea03f3 00007fa924ea27c1 00007fa924ea2779 00007fa924ea2709 00007fa924ea26d1 00007fa924ea19cd 0000000000388634 0000000000388479 00007fa924e8383a
0709 12:13:52.526554 (+108146us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:13:52.526605 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:52.526672 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:53.336398 (+809726us) raft_consensus.cc:1685] finished
0709 12:13:53.336414 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:53.338224 (+  1810us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":100763,"raft.queue_time_us":104610,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":96,"spinlock_wait_cycles":13239936,"thread_start_us":101021,"threads_started":1,"wal-append.queue_time_us":409482}
I20260709 12:13:53.341409 23523 raft_consensus.cc:2749] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:53.337821 23241 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:53.346195 23376 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:53.349241 23487 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:53.360127 23389 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:53.362221 23374 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:53.358994 23252 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:13:53.366721 14416 raft_consensus.cc:1240] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:53.358474 23492 consensus_queue.cc:260] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.19, Last appended by leader: 19, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:53.369161 23492 raft_consensus.cc:3060] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:53.373327 23466 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:53.364925 23491 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:53.374063 23466 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:53.378336 23467 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:53.379796 13679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:53.380139 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835"
I20260709 12:13:53.381556 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
W20260709 12:13:53.381940 23475 log.cc:927] Time spent T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 1.250s	user 0.010s	sys 0.000s
I20260709 12:13:53.382145 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:53.382988 13683 raft_consensus.cc:2393] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 27: Already voted for candidate b98d2519bb504dc6905ed2ede4571835 in this term.
I20260709 12:13:53.382897 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:53.355225 23494 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:53.387353 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:53.386564 13679 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 27.
I20260709 12:13:53.388896 13684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:53.390950 13800 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:53.391247 13680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 31 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:53.391559 13682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:53.367268 23523 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.377526 23466 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:53.394145 23494 raft_consensus.cc:2749] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:53.394369 13685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:53.395072 13685 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 25.
I20260709 12:13:53.395689 23494 consensus_queue.cc:1048] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:13:53.399257 23359 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 23 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:53.400133 23523 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:53.400760 13800 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:53.402962 23477 raft_consensus.cc:2749] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:53.403975 13800 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:53.405525 13683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "b98d2519bb504dc6905ed2ede4571835" is_pre_election: true
I20260709 12:13:53.404033 13681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 1997) took 1005 ms. Trace:
I20260709 12:13:53.386183 23467 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.406222 13683 raft_consensus.cc:2468] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 22.
I20260709 12:13:53.406471 13681 rpcz_store.cc:276] 0709 12:13:52.398628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:52.398830 (+   202us) service_pool.cc:224] Handling call
0709 12:13:52.399352 (+   522us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:52.522113 (+122761us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:53.403795 (+881682us) spinlock_profiling.cc:243] Waited 33.9 ms on lock 0x7b5400311fd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:53.403970 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":77881728}
W20260709 12:13:53.408215 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:53.410071 13578 catalog_manager.cc:5697] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
W20260709 12:13:53.407239 23424 consensus_meta.cc:287] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.747s	user 0.009s	sys 0.004s
I20260709 12:13:53.421561 23477 raft_consensus.cc:2749] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:53.422310 23424 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 34 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:461: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 2
I20260709 12:13:53.424266 12515 tablet_server.cc:179] TabletServer@127.12.56.193:0 shutting down...
W20260709 12:13:53.428352 23417 consensus_meta.cc:287] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.743s	user 0.013s	sys 0.001s
I20260709 12:13:53.409739 13800 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:53.432340 13800 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:53.429092 23417 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:53.431809 23412 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.300s	user 0.027s	sys 0.023s
I20260709 12:13:53.433094 23495 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:53.439527 13688 raft_consensus.cc:1240] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 27. Current term is 28. Ops: []
I20260709 12:13:53.435491 23241 raft_consensus.cc:2804] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:53.435235 23477 raft_consensus.cc:2804] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260709 12:13:53.439404 23412 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.317s	user 0.028s	sys 0.023s
I20260709 12:13:53.447748 23412 consensus_queue.cc:1243] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer 3f37c9cc9dda46b4be21dd675ba78fb7 log is divergent from this leader: its last log entry 30.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 12:13:53.448989 23466 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.443487 23522 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:53.454866 22770 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:53.449739 23466 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:53.455665 23417 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:13:53.445230 23533 log.cc:927] Time spent T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:13:53.443759 23241 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
W20260709 12:13:53.443744 13800 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 8 similar messages]
I20260709 12:13:53.430810 23467 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:53.464545 23175 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.465152 23354 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:53.454409 23494 consensus_queue.cc:1059] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.011s
I20260709 12:13:53.454457 23522 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:53.464679 23467 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:53.446007 23477 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:53.473474 23477 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:53.466574 23241 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:13:53.469666 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 654133us
I20260709 12:13:53.465241 23175 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:53.452656 23523 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:53.482602 13727 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:53.488219 13758 raft_consensus.cc:1240] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:53.484416 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:53.485874 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:53.475287 13756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 4051) took 1006 ms. Trace:
I20260709 12:13:53.490651 13756 rpcz_store.cc:276] 0709 12:13:52.468489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:52.468810 (+   321us) service_pool.cc:224] Handling call
0709 12:13:52.472845 (+  4035us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:52.473088 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 21
0709 12:13:52.473479 (+   391us) log.cc:844] Serialized 14 byte log entry
0709 12:13:53.472840 (+999361us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:53.473147 (+   307us) raft_consensus.cc:1645] Marking committed up to 21
0709 12:13:53.474666 (+  1519us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:53.474943 (+   277us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:53.475157 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":424103,"prepare.queue_time_us":1049,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":3074,"raft.queue_time_us":424984,"thread_start_us":574586,"threads_started":1,"wal-append.queue_time_us":596166}
I20260709 12:13:53.494107 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:53.494756 23523 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:53.495636 23523 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:53.494956 23175 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:53.498750 23175 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:53.498826 23523 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:53.499671 23175 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:53.495066 13762 raft_consensus.cc:2393] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 27: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:53.505173 13763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48114 (request call id 4057) took 1014 ms. Trace:
I20260709 12:13:53.468258 23424 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 34 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:53.502801 23175 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:53.535696 13688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48212 (request call id 1996) took 1309 ms. Trace:
I20260709 12:13:53.536190 13688 rpcz_store.cc:276] 0709 12:13:52.250982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:52.293639 (+ 42657us) service_pool.cc:224] Handling call
0709 12:13:52.294108 (+   469us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:53.442035 (+1147927us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:53.535334 (+ 93299us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b540021e654. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:53.535542 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2633707392}
I20260709 12:13:53.538256 13762 raft_consensus.cc:1240] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 30. Current term is 31. Ops: []
I20260709 12:13:53.528439 23522 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:53.512962 23508 raft_consensus.cc:2749] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:13:53.502864 23415 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:53.507165 13763 rpcz_store.cc:276] 0709 12:13:52.490310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:52.493141 (+  2831us) service_pool.cc:224] Handling call
0709 12:13:52.493496 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:52.493723 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 12:13:52.866823 (+373100us) log.cc:844] Serialized 14 byte log entry
0709 12:13:53.478859 (+612036us) log.cc:844] Serialized 14 byte log entry
0709 12:13:53.504630 (+ 25771us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:53.504712 (+    82us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:13:53.504802 (+    90us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:53.504903 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:53.505080 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":450505,"prepare.queue_time_us":65500,"prepare.run_cpu_time_us":118,"prepare.run_wall_time_us":24264,"raft.queue_time_us":424797,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":21631,"thread_start_us":544420,"threads_started":2,"wal-append.queue_time_us":215121}
I20260709 12:13:53.540766 13727 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:53.542788 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:53.546056 23522 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.546599 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:53.545686 23415 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:53.548331 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:53.548666 23415 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:53.546729 23522 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:53.555934 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:53.553606 23359 consensus_queue.cc:1059] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: INVALID_TERM, Last received: 26.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.005s
I20260709 12:13:53.558828 23354 consensus_queue.cc:1059] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:53.559451 23359 raft_consensus.cc:3055] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:53.559839 23360 raft_consensus.cc:3055] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:13:53.560292 23360 raft_consensus.cc:740] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 27 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:53.559985 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:53.561090 13833 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:53.561580 13726 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:53.564677 13830 raft_consensus.cc:1275] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 27 index: 20. Preceding OpId from leader: term: 29 index: 21. (index mismatch)
I20260709 12:13:53.565819 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:53.565267 14380 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:53.561385 23360 consensus_queue.cc:260] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 27.17, Last appended by leader: 17, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:53.568064 23175 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:53.562263 23278 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.568662 23175 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:53.569000 23360 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:53.569409 23278 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:53.570508 23424 raft_consensus.cc:2804] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:53.570951 23424 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:53.571290 23424 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:53.571668 23278 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:53.574223 23522 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:53.559894 23359 raft_consensus.cc:740] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 26 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:53.575598 23359 consensus_queue.cc:260] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 26.19, Last appended by leader: 19, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:53.577061 23359 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:53.554071 23423 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.556478 23523 consensus_queue.cc:1059] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.022s
I20260709 12:13:53.578143 23423 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:53.578933 23523 raft_consensus.cc:3055] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:53.579313 23523 raft_consensus.cc:740] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:53.579851 23424 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:53.580385 23423 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:53.580215 23523 consensus_queue.cc:260] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:53.581445 23523 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:53.584388 23175 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:53.594475 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 53799.3us
W20260709 12:13:53.601115 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 157378us
W20260709 12:13:53.619204 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:53.623769 13833 raft_consensus.cc:2468] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 23.
I20260709 12:13:53.630883 23502 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:53.564378 23540 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.632071 23540 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:53.634969 14407 raft_consensus.cc:2368] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 22. Current term is 23.
I20260709 12:13:53.635619 13727 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:53.634274 23540 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:53.637741 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:13:53.639993 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 54525.3us
I20260709 12:13:53.640842 13726 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 31 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:53.627054 23365 raft_consensus.cc:2804] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:53.625641 23284 raft_consensus.cc:2804] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:13:53.648074 13800 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 30 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:53.633692 23502 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 23 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:53.646014 13726 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:53.662248 13727 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:53.619529 23354 consensus_queue.cc:1059] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.026s
I20260709 12:13:53.667671 13726 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:53.577003 23241 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:53.638593 23415 consensus_queue.cc:1048] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.020s
I20260709 12:13:53.640296 23362 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:53.639212 23494 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.644397 23412 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:53.644711 23366 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:53.650741 23540 raft_consensus.cc:2749] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:53.657874 23467 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.683269 13833 raft_consensus.cc:3060] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:53.658461 23284 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:53.678064 23416 raft_consensus.cc:2804] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Leader election won for term 30
I20260709 12:13:53.693740 23284 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:53.694289 23416 raft_consensus.cc:697] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:53.668080 23522 consensus_queue.cc:1059] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 30.20, Next index: 21, Last known committed idx: 20, Time since last communication: 0.027s
I20260709 12:13:53.695607 23522 raft_consensus.cc:3055] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 33 LEADER]: Stepping down as leader of term 33
I20260709 12:13:53.695380 23416 consensus_queue.cc:237] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 28.14, Last appended by leader: 14, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:53.696061 23522 raft_consensus.cc:740] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 33 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:53.668916 23394 raft_consensus.cc:2749] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:13:53.679579 23494 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:53.657938 23252 raft_consensus.cc:2749] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Leader election lost for term 30. Reason: could not achieve majority
I20260709 12:13:53.660892 23365 raft_consensus.cc:697] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:53.658372 23175 raft_consensus.cc:2749] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Leader election lost for term 31. Reason: could not achieve majority
I20260709 12:13:53.688895 23467 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:53.674829 23362 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:53.692319 23506 log.cc:927] Time spent T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.640s	user 0.003s	sys 0.002s
I20260709 12:13:53.692708 23366 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:53.697922 23491 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:53.761703 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 88434.4us
W20260709 12:13:53.766183 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 98568.5us
I20260709 12:13:53.766752 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:53.718510 23424 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:53.687832 14379 consensus_peers.cc:597] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:53.668320 23464 consensus_queue.cc:1048] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 12:13:53.671381 23372 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 34 FOLLOWER]: Leader pre-election won for term 35
W20260709 12:13:53.709352 13800 consensus_peers.cc:597] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:53.768182 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 58926.2us
I20260709 12:13:53.696990 23522 consensus_queue.cc:260] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 33.21, Last appended by leader: 21, Current term: 33, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:53.773257 13800 leader_election.cc:336] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:53.731129 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:53.774528 13760 raft_consensus.cc:2393] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 25: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:53.733180 23443 raft_consensus.cc:3055] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 29 LEADER]: Stepping down as leader of term 29
I20260709 12:13:53.706220 23539 consensus_queue.cc:1048] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.053s
I20260709 12:13:53.734395 23365 consensus_queue.cc:237] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:53.767225 13726 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:53.783000 13726 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:53.767418 13837 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Advancing to term 27
W20260709 12:13:53.769387 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:53.683825 23412 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:53.777278 13800 leader_election.cc:336] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:53.779224 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 91517.8us
I20260709 12:13:53.784440 13726 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:53.781617 13755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48114 (request call id 4056) took 1291 ms. Trace:
W20260709 12:13:53.785633 14379 consensus_peers.cc:597] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:53.787252 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 31 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:13:53.785648 13800 consensus_peers.cc:597] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:53.833034 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:53.924824 23423 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.775665 23443 raft_consensus.cc:740] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 29 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
W20260709 12:13:53.944176 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 158571us
I20260709 12:13:53.824401 23494 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:53.822167 22770 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.787055 13755 rpcz_store.cc:276] 0709 12:13:52.490010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:52.490196 (+   186us) service_pool.cc:224] Handling call
0709 12:13:53.781446 (+1291250us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x7b540038d1d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:53.781561 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":498418432}
I20260709 12:13:53.799440 13833 raft_consensus.cc:2468] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 23.
I20260709 12:13:53.814165 13828 raft_consensus.cc:1275] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 12:13:53.859031 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:53.815289 23366 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:53.871731 23464 raft_consensus.cc:2804] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:53.942783 23381 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:53.863986 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:53.775662 23492 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:53.925356 23278 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 31 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:53.804023 23412 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:53.832417 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:53.819267 23477 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:53.801035 23241 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:53.809662 23362 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:53.818140 23502 raft_consensus.cc:3055] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:53.822284 23284 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:53.829566 13832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 4415) took 1771 ms. Trace:
W20260709 12:13:53.799314 14379 leader_election.cc:336] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:53.874899 13754 raft_consensus.cc:1240] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 35 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 34. Current term is 35. Ops: [34.18-34.18]
W20260709 12:13:53.987927 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 199983us
I20260709 12:13:53.811540 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:13:53.988782 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:53.988965 14379 consensus_peers.cc:597] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:53.989639 14379 leader_election.cc:336] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:53.800088 13829 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 30.
I20260709 12:13:53.793720 23394 raft_consensus.cc:2749] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:13:53.990546 14379 consensus_peers.cc:597] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:53.810904 23522 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 33 FOLLOWER]: Advancing to term 34
W20260709 12:13:53.913043 14382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:53.985903 13832 rpcz_store.cc:276] 0709 12:13:52.058202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:52.058351 (+   149us) service_pool.cc:224] Handling call
0709 12:13:52.077381 (+ 19030us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:52.470138 (+392757us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 12:13:52.511634 (+ 41496us) log.cc:844] Serialized 14 byte log entry
0709 12:13:53.106003 (+594369us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:53.106717 (+   714us) log.cc:844] Serialized 26 byte log entry
0709 12:13:53.106901 (+   184us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:13:53.107220 (+   319us) log.cc:844] Serialized 14 byte log entry
0709 12:13:53.124285 (+ 17065us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:53.124409 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:53.691529 (+567120us) spinlock_profiling.cc:243] Waited 2.18 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:13:53.829227 (+137698us) raft_consensus.cc:1685] finished
0709 12:13:53.829264 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:53.829473 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50710,"prepare.queue_time_us":130358,"prepare.run_cpu_time_us":114,"prepare.run_wall_time_us":119,"raft.queue_time_us":600362,"raft.run_cpu_time_us":453,"raft.run_wall_time_us":2586,"spinlock_wait_cycles":5003136,"thread_start_us":815339,"threads_started":3,"wal-append.queue_time_us":440604}
I20260709 12:13:53.793138 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:53.813076 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:53.799898 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 34 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:53.992523 13835 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 27.
I20260709 12:13:53.771351 23372 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 34 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:53.847046 23487 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:53.800902 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:53.904070 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:53.802232 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 34 candidate_status { last_received { term: 30 index: 20 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:13:53.846992 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 62627.4us
I20260709 12:13:53.813104 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:53.903148 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:53.824607 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 36 candidate_status { last_received { term: 35 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:53.833310 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:53.799319 23415 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:53.942641 13837 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 27.
I20260709 12:13:53.947113 13756 raft_consensus.cc:2393] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 27: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:53.948202 23423 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:53.949630 13800 leader_election.cc:336] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:53.765740 23491 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:54.018065 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:54.019958 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:53.958344 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:54.020984 13755 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 26.
I20260709 12:13:54.022069 23508 consensus_queue.cc:1048] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:13:54.022382 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:54.024135 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:53.944854 23320 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:53.960722 23278 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:53.952553 22770 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:53.954006 23464 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:53.971519 13758 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 26.
I20260709 12:13:54.044504 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:53.999264 23372 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:13:53.992563 14415 raft_consensus.cc:2368] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 26. Current term is 27.
I20260709 12:13:53.997586 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:53.997916 23381 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:13:54.008211 14379 consensus_peers.cc:597] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:53.966888 23492 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:54.005956 14416 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 25.
I20260709 12:13:53.990483 23443 consensus_queue.cc:260] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 29.16, Last appended by leader: 16, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:54.017447 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:54.044842 23415 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 33 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:54.104327 13832 raft_consensus.cc:1275] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 33 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 31 index: 18. Preceding OpId from leader: term: 33 index: 19. (index mismatch)
I20260709 12:13:54.020121 23491 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:53.956676 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:54.026883 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:54.032275 23484 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:54.028820 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 31 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:54.117091 13759 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 30.
I20260709 12:13:54.117869 14380 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:54.118032 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 31 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:54.029913 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:13:54.015762 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 66183.3us
I20260709 12:13:54.037235 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 30 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:13:54.120106 13800 leader_election.cc:336] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:53.985013 23502 raft_consensus.cc:740] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 22 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:54.040043 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 28 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:54.045399 13758 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:54.024158 23508 consensus_queue.cc:1048] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.023s
I20260709 12:13:54.046944 23464 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:54.047709 23495 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.050443 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:54.042696 23320 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:53.999042 23487 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:54.033581 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 34 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:54.052981 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:54.145043 13833 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 26.
I20260709 12:13:54.057056 23417 consensus_queue.cc:1059] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 30.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 12:13:54.075011 23467 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:54.077586 13830 raft_consensus.cc:1275] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 27 index: 13. (index mismatch)
I20260709 12:13:54.079816 22770 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:54.081367 23477 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:54.089476 23278 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:54.089844 23408 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Advancing to term 27
W20260709 12:13:54.092832 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 84762.3us
I20260709 12:13:54.091885 13757 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 27.
I20260709 12:13:54.103756 23415 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 33 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:54.126521 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 31 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:54.126641 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 28 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:54.025352 23546 consensus_queue.cc:1048] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.087s
I20260709 12:13:54.121223 13800 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:13:54.197549 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 76437.4us
I20260709 12:13:54.130769 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:54.137629 14415 raft_consensus.cc:1240] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 28. Current term is 29. Ops: []
I20260709 12:13:54.132725 23407 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:54.039918 23547 consensus_queue.cc:1048] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.102s
I20260709 12:13:54.213394 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:54.146701 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 28 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:54.146780 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:54.149220 23362 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.149748 23495 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:54.134259 23275 consensus_queue.cc:1048] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.020s
I20260709 12:13:54.152110 13727 leader_election.cc:400] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 election: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 26. Current term is 27.
I20260709 12:13:54.224656 13727 leader_election.cc:403] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 election: Cancelling election due to peer responding with higher term
I20260709 12:13:54.224789 13756 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:13:54.152501 23423 leader_election.cc:290] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:54.150516 23502 consensus_queue.cc:260] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:54.166570 13837 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 25.
I20260709 12:13:54.168431 23487 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:54.172207 23320 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:54.179013 23492 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:54.181125 23284 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 31 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:54.185611 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:54.183612 13578 catalog_manager.cc:5697] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 18 to 22, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 22 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:54.192361 13760 raft_consensus.cc:1240] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 30. Current term is 31. Ops: []
I20260709 12:13:54.246359 13760 raft_consensus.cc:1275] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 23 index: 18. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
I20260709 12:13:54.247370 23415 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:54.187162 23465 consensus_queue.cc:260] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 28.20, Last appended by leader: 20, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:54.192953 14379 leader_election.cc:336] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:54.249300 23465 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Advancing to term 29
W20260709 12:13:54.249477 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 60984.9us
W20260709 12:13:54.250605 14379 leader_election.cc:336] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 34 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:54.251492 14379 leader_election.cc:336] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:54.252277 14379 leader_election.cc:336] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:54.252724 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:54.134589 23463 raft_consensus.cc:2804] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:54.254349 23463 raft_consensus.cc:697] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 23 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:54.255752 23463 consensus_queue.cc:237] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:54.203259 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 29 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:54.259327 23502 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:54.206028 23443 raft_consensus.cc:3060] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:54.206171 23467 raft_consensus.cc:2804] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election won for term 27
W20260709 12:13:54.263543 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 111587us
I20260709 12:13:54.214644 14414 raft_consensus.cc:2368] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 22. Current term is 23.
I20260709 12:13:54.217922 14412 raft_consensus.cc:2410] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for term 28 because replica has last-logged OpId of term: 27 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 15.
I20260709 12:13:54.222842 14416 raft_consensus.cc:2393] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 27: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:13:54.227353 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:54.266896 14415 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 28.
I20260709 12:13:54.128542 23484 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:54.270815 23484 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:54.103055 23381 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:54.234992 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:54.179077 23466 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:54.236927 13801 leader_election.cc:400] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 pre-election: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 22. Current term is 23.
I20260709 12:13:54.239732 14380 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:54.264470 13727 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:54.268246 13759 raft_consensus.cc:1240] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 LEADER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 29. Current term is 30. Ops: [29.16-29.16]
W20260709 12:13:54.326428 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 62075us
I20260709 12:13:54.327320 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:54.278992 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 30 candidate_status { last_received { term: 28 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:54.328517 13757 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 28.
I20260709 12:13:54.329689 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:54.280699 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:13:54.238938 23359 consensus_meta.cc:287] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.661s	user 0.013s	sys 0.000s
W20260709 12:13:54.303617 13634 auto_rebalancer.cc:288] Could not retrieve cluster info: Not found: tserver ca9fbbc2c0a94897897d502d42f3951f not available for placement
I20260709 12:13:54.333639 13758 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 27.
I20260709 12:13:54.210906 23407 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:54.281719 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:13:54.287974 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 50510.1us
I20260709 12:13:54.231066 23362 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:54.330741 13755 raft_consensus.cc:1275] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 12:13:54.332290 13837 raft_consensus.cc:1240] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 25. Current term is 26. Ops: [25.14-25.14]
W20260709 12:13:54.320760 13800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:54.347932 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 31 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:54.336625 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:54.360114 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 31 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:13:54.360677 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:54.378901 14379 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:54.380271 14379 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:54.381614 23353 raft_consensus.cc:2749] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:54.382404 23275 raft_consensus.cc:2749] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:13:54.383533 23407 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:54.362394 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:54.369516 23284 raft_consensus.cc:2749] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader election lost for term 26. Reason: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 26. Current term is 27.
I20260709 12:13:54.362761 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:54.384589 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 34 candidate_status { last_received { term: 33 index: 21 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:54.384620 13830 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 25.
I20260709 12:13:54.385519 14415 raft_consensus.cc:2393] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 34 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 34: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:13:54.386747 14379 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:54.267501 23467 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:54.390228 23495 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:54.390291 23467 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:54.395747 14379 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:54.363785 13578 catalog_manager.cc:5697] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:13:54.388358 23362 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:54.399430 13578 catalog_manager.cc:5697] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 22 to 28. New cstate: current_term: 28 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:13:54.373296 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:54.401078 14416 raft_consensus.cc:2393] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 25: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:13:54.402436 23366 raft_consensus.cc:2749] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 12:13:54.368198 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 128553us
I20260709 12:13:54.396224 23466 raft_consensus.cc:2749] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:54.389166 13727 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:54.405894 23362 raft_consensus.cc:2804] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:13:54.406378 23362 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:54.406796 23362 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:54.410401 13727 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:54.411564 23175 raft_consensus.cc:2804] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:54.412107 23175 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:54.412043 23550 consensus_queue.cc:1048] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:13:54.413033 23175 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:54.394487 13829 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 26.
I20260709 12:13:54.414897 13727 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:54.415804 23550 raft_consensus.cc:2804] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:54.416280 23550 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:54.416751 23550 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:54.426322 14380 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:54.427254 23381 leader_election.cc:290] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:54.428027 23547 consensus_queue.cc:1048] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:54.401149 13578 catalog_manager.cc:5697] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 11 to 26. New cstate: current_term: 26 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:13:54.347510 22770 raft_consensus.cc:2804] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:54.433039 22770 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:54.432473 13578 catalog_manager.cc:5697] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 23 to 29. New cstate: current_term: 29 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:13:54.433516 22770 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:54.434963 23175 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:54.380616 23359 raft_consensus.cc:2804] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:54.437471 23359 raft_consensus.cc:697] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 27 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:54.438690 23359 consensus_queue.cc:237] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:54.442301 23381 raft_consensus.cc:2804] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:54.443339 23381 raft_consensus.cc:697] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 23 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:54.444805 23381 consensus_queue.cc:237] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:54.452795 23366 consensus_queue.cc:1048] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
W20260709 12:13:54.458599 13800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:54.459116 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:54.462213 13801 leader_election.cc:400] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 election: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 22. Current term is 23.
I20260709 12:13:54.462867 13801 leader_election.cc:403] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 12:13:54.464349 14379 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:13:54.465368 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 50547.1us
I20260709 12:13:54.468061 13756 raft_consensus.cc:2410] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 34 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for term 34 because replica has last-logged OpId of term: 33 index: 21, which is greater than that of the candidate, which has last-logged OpId of term: 32 index: 20.
I20260709 12:13:54.466754 13727 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:54.499583 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:54.434562 13578 catalog_manager.cc:5697] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 21 to 24, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 24 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:13:54.503657 23275 raft_consensus.cc:2749] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:54.504071 14416 raft_consensus.cc:1240] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 25 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:54.437507 23175 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:54.501590 23284 consensus_queue.cc:1048] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 12:13:54.509701 13754 raft_consensus.cc:1240] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 34 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 33. Current term is 34. Ops: []
W20260709 12:13:54.511296 13800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:54.513243 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:54.516029 14415 raft_consensus.cc:1240] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 34 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 33. Current term is 34. Ops: [33.21-33.21]
I20260709 12:13:54.518678 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:54.515513 13578 catalog_manager.cc:5697] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 23 to 27, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 27 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:54.523005 13578 catalog_manager.cc:5697] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 15 to 26. New cstate: current_term: 26 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:13:54.530594 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:54.537499 13800 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:13:54.539110 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 77118.4us
I20260709 12:13:54.541093 13578 catalog_manager.cc:5697] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 9 to 25. New cstate: current_term: 25 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
W20260709 12:13:54.544138 13726 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.019s	sys 0.022s
I20260709 12:13:54.540866 13801 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:54.543396 13578 catalog_manager.cc:5697] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 16 to 23, leader changed from ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 23 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:54.551931 13800 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:54.552299 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 30 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:54.552426 13578 catalog_manager.cc:5697] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 26 to 31, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 31 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:13:54.554098 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:54.523094 23547 raft_consensus.cc:2804] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260709 12:13:54.555388 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 442086us
W20260709 12:13:54.544883 13726 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.019s	sys 0.022s
I20260709 12:13:54.555349 14414 raft_consensus.cc:2410] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 28 because replica has last-logged OpId of term: 27 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 16.
W20260709 12:13:54.555996 13582 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45618 (request call id 238) took 51892 ms (client timeout 15000 ms). Trace:
W20260709 12:13:54.568706 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 563508us
I20260709 12:13:54.521679 23487 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 31 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:54.529032 23477 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.558552 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:54.509034 23467 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:54.561043 13727 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:54.526537 23491 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 35 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.580952 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:54.580988 13727 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:54.550673 23494 raft_consensus.cc:2749] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 22. Current term is 23.
I20260709 12:13:54.555696 23320 raft_consensus.cc:2749] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:54.536319 23421 consensus_queue.cc:1059] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 12:13:54.599905 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 29 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:54.601667 22770 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:54.603183 13759 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 25.
I20260709 12:13:54.593560 14407 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 27.
I20260709 12:13:54.578329 13652 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:54.572754 13651 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:54.559195 23547 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:54.618554 23547 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:54.600618 13830 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 28.
I20260709 12:13:54.621881 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:54.622642 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:54.622767 14409 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 27.
I20260709 12:13:54.623384 13830 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:54.608970 23495 raft_consensus.cc:2804] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:54.624292 23495 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:54.624782 23495 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:54.630314 23394 raft_consensus.cc:3055] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:13:54.630880 23394 raft_consensus.cc:740] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:54.631853 23394 consensus_queue.cc:260] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.14, Last appended by leader: 14, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:54.632300 13727 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:54.633306 23394 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:54.565524 13578 catalog_manager.cc:5697] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 25 to 30, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 30 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:54.581981 23477 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:54.579592 23487 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:54.612952 23467 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:54.588629 23491 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 35 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:54.615878 23464 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:54.617965 23408 raft_consensus.cc:2804] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:13:54.640645 23487 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:54.635267 23539 raft_consensus.cc:2804] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:54.656507 23539 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:54.646139 23408 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:54.657372 23539 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:54.657742 23408 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:54.635188 22770 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:54.660012 23535 raft_consensus.cc:2804] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:54.660614 23535 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:54.661037 23535 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Advancing to term 27
W20260709 12:13:54.646376 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:54.649914 23484 consensus_queue.cc:1059] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 33.21, Next index: 22, Last known committed idx: 21, Time since last communication: 0.013s
I20260709 12:13:54.645867 23464 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:54.663710 23386 raft_consensus.cc:3055] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 33 LEADER]: Stepping down as leader of term 33
I20260709 12:13:54.664098 23386 raft_consensus.cc:740] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 33 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:54.665086 23386 consensus_queue.cc:260] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 33.21, Last appended by leader: 21, Current term: 33, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:54.666491 23386 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 33 FOLLOWER]: Advancing to term 34
W20260709 12:13:54.669368 23522 consensus_meta.cc:287] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.670s	user 0.007s	sys 0.001s
I20260709 12:13:54.651836 23492 raft_consensus.cc:2804] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:54.647953 13578 catalog_manager.cc:5697] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 20 to 24, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 24 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:54.672154 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 34 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:54.609212 23120 raft_consensus.cc:2804] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:54.655699 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 32 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:54.673278 13755 raft_consensus.cc:1240] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 27. Current term is 28. Ops: []
I20260709 12:13:54.639006 23477 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:54.643062 23491 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:54.651600 13830 raft_consensus.cc:2468] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 28.
W20260709 12:13:54.675077 23372 consensus_meta.cc:287] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.573s	user 0.011s	sys 0.001s
I20260709 12:13:54.669257 23408 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:54.700842 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:54.675958 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:54.677011 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 31 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:54.678102 23362 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:54.568868 13582 rpcz_store.cc:269] 0709 12:13:02.663873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:17.408196 (+14744323us) service_pool.cc:224] Handling call
0709 12:13:54.555877 (+37147681us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:49.021144 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:49.022019 (+   875us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:49.022174 (+   155us) write_op.cc:435] Acquired schema lock
0709 12:13:49.022193 (+    19us) tablet.cc:662] Decoding operations
0709 12:13:49.023322 (+  1129us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:49.023433 (+   111us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:49.023468 (+    35us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:13:49.024295 (+   827us) tablet.cc:701] Row locks acquired
0709 12:13:49.024341 (+    46us) write_op.cc:260] PREPARE: finished
0709 12:13:49.024570 (+   229us) write_op.cc:270] Start()
0709 12:13:49.024749 (+   179us) write_op.cc:276] Timestamp: P: 1783599229024482 usec, L: 0
0709 12:13:49.024787 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 12:13:49.073962 (+ 49175us) log.cc:844] Serialized 2860 byte log entry
0709 12:13:49.877700 (+803738us) op_driver.cc:464] REPLICATION: finished
0709 12:13:50.192737 (+315037us) write_op.cc:301] APPLY: starting
0709 12:13:50.199488 (+  6751us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:50.469003 (+269515us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:50.469304 (+   301us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:50.800361 (+331057us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:50.800717 (+   356us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=0,mrs_lookups=0
0709 12:13:50.800821 (+   104us) write_op.cc:312] APPLY: finished
0709 12:13:50.801247 (+   426us) log.cc:844] Serialized 73 byte log entry
0709 12:13:50.801498 (+   251us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:50.801681 (+   183us) write_op.cc:454] Released schema lock
0709 12:13:50.801765 (+    84us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:50.863911 (+ 62146us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:50.869798 (+  5887us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1672582,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":250688,"apply.run_cpu_time_us":16912,"apply.run_wall_time_us":659145,"cfile_cache_hit":30,"cfile_cache_hit_bytes":33387,"num_ops":7,"prepare.queue_time_us":273926,"prepare.run_cpu_time_us":14310,"prepare.run_wall_time_us":365903,"raft.queue_time_us":175187,"raft.run_cpu_time_us":12461,"raft.run_wall_time_us":145495,"replication_time_us":839630,"thread_start_us":421368,"threads_started":4,"wal-append.queue_time_us":309694,"wal-append.run_cpu_time_us":38308,"wal-append.run_wall_time_us":2402241}]]}
W20260709 12:13:54.652179 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 73990.8us
I20260709 12:13:54.633720 23547 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:54.682360 13651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:54.581171 23415 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.682837 13727 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:54.695327 13578 catalog_manager.cc:5697] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 22 to 27, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 27 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:13:54.590667 23175 raft_consensus.cc:2804] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:54.699342 13836 raft_consensus.cc:2410] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 34 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 34 because replica has last-logged OpId of term: 33 index: 21, which is greater than that of the candidate, which has last-logged OpId of term: 30 index: 20.
I20260709 12:13:54.701996 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
W20260709 12:13:54.785951 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:54.743680 23417 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.039s	sys 0.064s
W20260709 12:13:54.804857 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 122130us
I20260709 12:13:54.814664 13578 catalog_manager.cc:5697] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 22 to 28, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 28 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:54.816839 13578 catalog_manager.cc:5697] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
W20260709 12:13:54.745453 23399 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.011s	sys 0.022s
I20260709 12:13:54.706156 23492 raft_consensus.cc:697] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 23 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
W20260709 12:13:54.769797 14411 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.012s	sys 0.023s
I20260709 12:13:54.827615 13836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54820 (request call id 4429) took 1028 ms. Trace:
I20260709 12:13:54.698179 23120 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:54.713824 23539 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:54.837880 23539 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 29 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:54.838593 23547 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:54.706913 23372 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 35 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:54.842113 13578 catalog_manager.cc:5697] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 26 to 30, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 30 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:54.843622 23372 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 35 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:54.844178 13763 raft_consensus.cc:1240] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 35 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 34. Current term is 35. Ops: []
I20260709 12:13:54.843935 13578 catalog_manager.cc:5697] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 23 to 32. New cstate: current_term: 32 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:13:54.706351 23550 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:54.827956 14411 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.014s	sys 0.023s
I20260709 12:13:54.830904 23559 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.846292 23559 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:54.847705 23550 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:54.817886 23464 raft_consensus.cc:2804] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:54.848547 23464 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:54.848634 23559 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:54.848973 23464 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:54.849217 23559 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.832175 13727 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:54.834796 23362 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 31 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:54.850306 23362 raft_consensus.cc:2804] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:13:54.853912 23362 raft_consensus.cc:697] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:54.814254 23175 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:54.855213 23175 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:13:54.820127 23417 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.039s	sys 0.068s
I20260709 12:13:54.849676 23559 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:54.854952 23362 consensus_queue.cc:237] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 27.14, Last appended by leader: 14, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:54.834371 23492 consensus_queue.cc:237] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:54.828095 13836 rpcz_store.cc:276] 0709 12:13:53.799743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:53.801972 (+  2229us) service_pool.cc:224] Handling call
0709 12:13:54.822618 (+1020646us) spinlock_profiling.cc:243] Waited 697 ms on lock 0x7b54000da054. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:54.827526 (+  4908us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1602243456}
I20260709 12:13:54.858486 13759 raft_consensus.cc:1240] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:54.860805 14409 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 25.
W20260709 12:13:54.858043 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:54.857800 23489 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:54.863049 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 35 candidate_status { last_received { term: 34 index: 20 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
W20260709 12:13:54.872792 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:54.838631 23120 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Advancing to term 28
W20260709 12:13:54.830230 23399 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.012s	sys 0.022s
I20260709 12:13:54.820500 23551 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.903195 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 31 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:54.904143 13836 raft_consensus.cc:3060] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Advancing to term 31
W20260709 12:13:54.827869 23443 consensus_meta.cc:287] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.566s	user 0.015s	sys 0.003s
I20260709 12:13:54.864601 23559 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:54.915038 13831 raft_consensus.cc:1275] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 29 index: 16. Preceding OpId from leader: term: 30 index: 16. (term mismatch)
I20260709 12:13:54.915633 13831 pending_rounds.cc:85] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 15
I20260709 12:13:54.915915 13831 pending_rounds.cc:107] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 29.16
I20260709 12:13:54.916201 13831 raft_consensus.cc:2889] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:54.861892 23417 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:54.823020 23415 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:54.919783 23559 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.928274 13727 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 34 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:54.937562 23558 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:54.928761 23417 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:54.940547 23558 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:54.941161 13831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 4428) took 1142 ms. Trace:
I20260709 12:13:54.941591 13831 rpcz_store.cc:276] 0709 12:13:53.799302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:53.801402 (+  2100us) service_pool.cc:224] Handling call
0709 12:13:53.801736 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:54.916726 (+1114990us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:54.940908 (+ 24182us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54003c1c54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:54.941101 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2559203584}
I20260709 12:13:54.942164 23417 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:54.942659 23558 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:54.943104 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 29 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:54.943722 13831 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:54.934713 23559 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:54.902997 23489 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:54.951777 13833 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.007s	sys 0.020s
W20260709 12:13:54.952261 13833 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.007s	sys 0.021s
I20260709 12:13:54.951043 13727 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:54.948724 23547 raft_consensus.cc:2749] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 34 FOLLOWER]: Leader election lost for term 34. Reason: could not achieve majority
I20260709 12:13:54.845340 13578 catalog_manager.cc:5697] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 18 to 22, leader changed from ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 22 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:54.915263 23551 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:54.962728 23394 raft_consensus.cc:2804] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:54.972072 23495 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:54.972658 23394 raft_consensus.cc:697] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:54.933420 13836 raft_consensus.cc:2468] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 31.
I20260709 12:13:54.973631 23394 consensus_queue.cc:237] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:54.975754 23489 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:54.974500 23495 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:54.964856 13578 catalog_manager.cc:5697] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 13 to 23, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 23 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:54.977988 13834 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.017s	sys 0.017s
I20260709 12:13:54.953070 23550 consensus_queue.cc:1048] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.020s
I20260709 12:13:54.970847 23408 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 31 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:54.979092 23463 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.017s	sys 0.031s
I20260709 12:13:54.982213 13727 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
W20260709 12:13:54.987948 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 436083us
W20260709 12:13:54.981796 13834 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.017s	sys 0.017s
I20260709 12:13:54.995801 13800 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:54.997047 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:54.997910 13834 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:54.981235 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 35 candidate_status { last_received { term: 34 index: 20 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:54.985502 13578 catalog_manager.cc:5697] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:13:55.006839 13578 catalog_manager.cc:5697] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 20 to 25. New cstate: current_term: 25 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:55.010385 13800 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:55.012130 13727 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 35 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:13:54.981608 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 440830us
W20260709 12:13:54.981202 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 414888us
I20260709 12:13:55.016577 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:55.021996 13800 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:13:54.993463 23463 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.017s	sys 0.031s
I20260709 12:13:54.983294 23278 raft_consensus.cc:3055] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 30 LEADER]: Stepping down as leader of term 30
I20260709 12:13:54.977006 23464 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:55.025436 13801 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:55.024717 23465 raft_consensus.cc:2749] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:13:55.015439 23372 raft_consensus.cc:2804] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Leader election won for term 31
I20260709 12:13:55.029202 22770 raft_consensus.cc:2749] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 35 FOLLOWER]: Leader election lost for term 35. Reason: could not achieve majority
I20260709 12:13:55.038403 23559 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:55.026294 23278 raft_consensus.cc:740] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 30 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:55.024341 13578 catalog_manager.cc:5697] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 19 to 24, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 24 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:55.042133 23372 raft_consensus.cc:697] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:55.029708 23495 raft_consensus.cc:2749] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:55.043519 23372 consensus_queue.cc:237] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 29.17, Last appended by leader: 17, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:55.044394 23465 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:55.046630 13832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 4436) took 1237 ms. Trace:
I20260709 12:13:55.047039 13832 rpcz_store.cc:276] 0709 12:13:53.808869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:54.113718 (+304849us) service_pool.cc:224] Handling call
0709 12:13:54.140786 (+ 27068us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:54.141294 (+   508us) raft_consensus.cc:1534] Early marking committed up to index 18
0709 12:13:54.205066 (+ 63772us) log.cc:844] Serialized 14 byte log entry
0709 12:13:54.983541 (+778475us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:54.984108 (+   567us) log.cc:844] Serialized 26 byte log entry
0709 12:13:54.984335 (+   227us) raft_consensus.cc:1645] Marking committed up to 18
0709 12:13:54.984379 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:54.984471 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:55.046421 (+ 61950us) raft_consensus.cc:1685] finished
0709 12:13:55.046444 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:55.046574 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15082,"prepare.queue_time_us":69652,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":74,"raft.queue_time_us":111600,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":13220,"thread_start_us":776881,"threads_started":2,"wal-append.queue_time_us":721030}
I20260709 12:13:55.022187 23556 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.049356 13831 raft_consensus.cc:2468] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 29.
I20260709 12:13:55.028043 13800 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:55.053951 13800 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:13:55.054196 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:55.040918 23278 consensus_queue.cc:260] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 30.19, Last appended by leader: 19, Current term: 30, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:54.980847 23120 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:55.048074 13578 catalog_manager.cc:5697] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 18 to 21, leader changed from ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 21 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:55.048982 23547 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:55.054643 23495 raft_consensus.cc:2764] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader pre-election decision vote started in defunct term 26: won
I20260709 12:13:55.065610 13727 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:55.057099 23491 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:55.074436 13831 raft_consensus.cc:1275] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 28 index: 14. Preceding OpId from leader: term: 30 index: 15. (index mismatch)
I20260709 12:13:55.057281 23494 raft_consensus.cc:2749] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:55.063637 13578 catalog_manager.cc:5697] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 17 to 25, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 25 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:55.107913 13578 catalog_manager.cc:5697] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:13:55.055624 13800 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:55.075479 23278 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:55.052284 23535 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:55.111881 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 56326.9us
I20260709 12:13:55.075294 23416 raft_consensus.cc:2804] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:13:55.095260 23175 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:55.057121 23556 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:55.103500 14412 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.012s	sys 0.018s
I20260709 12:13:55.106233 13831 raft_consensus.cc:1240] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 28. Current term is 29. Ops: []
W20260709 12:13:55.120522 14412 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.012s	sys 0.018s
I20260709 12:13:55.070511 14379 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 34 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:13:55.112474 13828 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.003s	sys 0.029s
W20260709 12:13:55.123687 13828 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.003s	sys 0.029s
I20260709 12:13:55.127436 13836 raft_consensus.cc:2393] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 27: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:55.072758 23547 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:55.113550 13762 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.008s	sys 0.024s
W20260709 12:13:55.131153 13762 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.009s	sys 0.024s
W20260709 12:13:55.114816 14380 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.017s	sys 0.012s
I20260709 12:13:55.083048 23551 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:13:55.124563 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 54191.2us
I20260709 12:13:55.132887 14379 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:55.114002 13800 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:55.135016 13800 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:13:55.135921 14380 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.017s	sys 0.012s
W20260709 12:13:55.136390 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 601811us
I20260709 12:13:55.110025 13578 catalog_manager.cc:5697] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 15 to 27, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 27 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:13:55.085291 23546 consensus_queue.cc:1048] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.036s
I20260709 12:13:55.115016 23494 raft_consensus.cc:2764] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 31 FOLLOWER]: Leader pre-election decision vote started in defunct term 30: won
I20260709 12:13:55.083514 23491 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:55.156190 13762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 1685) took 1252 ms. Trace:
I20260709 12:13:55.156782 13762 rpcz_store.cc:276] 0709 12:13:53.903792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:54.143913 (+240121us) service_pool.cc:224] Handling call
0709 12:13:54.144307 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:54.144563 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 19
0709 12:13:54.559242 (+414679us) log.cc:844] Serialized 14 byte log entry
0709 12:13:55.155819 (+596577us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:55.155917 (+    98us) raft_consensus.cc:1645] Marking committed up to 19
0709 12:13:55.155957 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:55.156020 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:55.156136 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23721,"prepare.queue_time_us":49724,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":53,"thread_start_us":939798,"threads_started":2}
I20260709 12:13:55.159379 23522 raft_consensus.cc:2749] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:13:55.161010 13800 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:55.162015 23522 raft_consensus.cc:2804] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:55.162456 23522 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:55.162853 23522 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:55.163848 23415 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:55.165586 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:55.130191 23463 raft_consensus.cc:2749] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 34 FOLLOWER]: Leader election lost for term 34. Reason: could not achieve majority
I20260709 12:13:55.124712 23416 raft_consensus.cc:697] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:13:55.169531 13835 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.003s	sys 0.032s
I20260709 12:13:55.172840 23494 consensus_queue.cc:1059] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 30.17, Next index: 18, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 12:13:55.176923 13835 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.003s	sys 0.032s
W20260709 12:13:55.177260 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 146140us
I20260709 12:13:55.179724 13834 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 26.
I20260709 12:13:55.143558 13578 catalog_manager.cc:5697] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 17 to 20, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 20 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:13:55.183987 23477 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 35 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:55.185120 23467 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:55.185035 23477 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 35 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:55.186005 23467 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:55.187942 23477 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:55.188766 23467 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:55.150624 23353 raft_consensus.cc:2804] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:55.195775 13834 raft_consensus.cc:1275] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 12:13:55.197538 13800 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:55.146333 23421 consensus_queue.cc:1059] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 28.20, Next index: 21, Last known committed idx: 20, Time since last communication: 0.044s
I20260709 12:13:55.165619 23360 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.166786 23464 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:55.190764 13578 catalog_manager.cc:5697] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 26 to 32, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 32 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:55.150599 23502 consensus_queue.cc:1059] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 34.20, Next index: 21, Last known committed idx: 20, Time since last communication: 0.047s
W20260709 12:13:55.200780 23359 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.016s	sys 0.018s
I20260709 12:13:55.212777 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 31 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:55.210934 13578 catalog_manager.cc:5697] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 23 to 29. New cstate: current_term: 29 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:55.193709 23547 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:55.197849 23353 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:55.223199 23120 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:55.247846 23535 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:55.250005 23491 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:55.250556 23465 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:55.252610 23353 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:13:55.253147 23381 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.802s	user 0.009s	sys 0.027s
I20260709 12:13:55.204843 23463 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.212385 23494 consensus_queue.cc:1048] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.041s
I20260709 12:13:55.212169 23360 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:55.275143 13836 raft_consensus.cc:1240] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:55.276981 13836 raft_consensus.cc:1240] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 28. Current term is 29. Ops: [28.16-28.16]
I20260709 12:13:55.255863 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:55.206977 23467 raft_consensus.cc:2804] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:13:55.279500 23467 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:55.238173 13578 catalog_manager.cc:5697] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 22 to 27, leader changed from ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 27 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:13:55.236016 13727 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
W20260709 12:13:55.280489 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 44591.1us
W20260709 12:13:55.218637 23359 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.016s	sys 0.018s
I20260709 12:13:55.261574 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:55.285292 13834 raft_consensus.cc:2393] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 24: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:55.282425 13578 catalog_manager.cc:5697] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 15 to 20, leader changed from ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 20 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:55.271817 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:55.249646 23320 raft_consensus.cc:3055] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 30 LEADER]: Stepping down as leader of term 30
I20260709 12:13:55.293241 23320 raft_consensus.cc:740] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 30 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:55.286083 14409 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:55.296422 23320 consensus_queue.cc:260] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 30.17, Last appended by leader: 17, Current term: 30, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:55.298975 23320 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:55.257592 23464 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:55.310468 13836 raft_consensus.cc:1240] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 27. Current term is 28. Ops: []
W20260709 12:13:55.273070 23381 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.822s	user 0.009s	sys 0.027s
I20260709 12:13:55.280015 23467 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:55.324491 13836 raft_consensus.cc:1275] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 35 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 34 index: 18. Preceding OpId from leader: term: 35 index: 18. (term mismatch)
I20260709 12:13:55.314009 23298 raft_consensus.cc:3055] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 LEADER]: Stepping down as leader of term 28
I20260709 12:13:55.312362 23546 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.350777 13836 pending_rounds.cc:85] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 17
I20260709 12:13:55.354560 13836 pending_rounds.cc:107] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 34.18
I20260709 12:13:55.354908 13836 raft_consensus.cc:2889] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 35 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:13:55.325455 13652 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.012s	sys 0.029s
I20260709 12:13:55.306460 23120 raft_consensus.cc:2804] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:55.342686 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:13:55.358019 13652 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.012s	sys 0.029s
I20260709 12:13:55.361177 14409 raft_consensus.cc:2468] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 28.
I20260709 12:13:55.320257 23495 raft_consensus.cc:2749] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:55.371963 23551 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:55.364413 13578 catalog_manager.cc:5697] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 20 to 26, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 26 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:13:55.366484 13727 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:13:55.367713 13634 auto_rebalancer.cc:288] Could not retrieve cluster info: Not found: tserver ca9fbbc2c0a94897897d502d42f3951f not available for placement
I20260709 12:13:55.409716 13578 catalog_manager.cc:5697] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 14 to 21, leader changed from ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 21 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:55.407141 13834 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 25.
I20260709 12:13:55.412187 13652 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:55.376694 23559 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.353922 23298 raft_consensus.cc:740] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:55.315412 23547 consensus_queue.cc:1048] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.058s
W20260709 12:13:55.428611 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 62242us
I20260709 12:13:55.332929 23535 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.284471 23463 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:55.424804 13652 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:55.400467 23408 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:55.308511 23416 consensus_queue.cc:237] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 28.16, Last appended by leader: 16, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:55.373140 23489 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:55.322163 23464 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:55.401156 23175 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:55.378132 23581 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:55.408169 23558 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.409162 23120 raft_consensus.cc:697] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
W20260709 12:13:55.449311 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:55.451700 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:55.370277 23546 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:55.447216 13652 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:55.423028 23399 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:55.413560 23556 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:55.372852 23551 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:55.426277 23386 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
W20260709 12:13:55.458041 13833 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.006s	sys 0.006s
W20260709 12:13:55.523677 13833 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.007s	sys 0.006s
I20260709 12:13:55.503212 14409 raft_consensus.cc:2393] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 25: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:13:55.517386 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:55.519709 23492 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:55.520735 13759 raft_consensus.cc:1275] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
I20260709 12:13:55.444325 23421 raft_consensus.cc:2804] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:13:55.468434 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 31 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:55.538239 13834 raft_consensus.cc:2393] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 31 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 31: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:55.526679 13833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 4439) took 1195 ms. Trace:
W20260709 12:13:55.440385 23423 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.006s	sys 0.013s
W20260709 12:13:55.548448 23423 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.006s	sys 0.014s
W20260709 12:13:55.638999 14412 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.002s	sys 0.014s
W20260709 12:13:55.663399 14412 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.002s	sys 0.014s
W20260709 12:13:55.640313 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 121892us
I20260709 12:13:55.532837 23443 raft_consensus.cc:2749] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:55.554116 23556 raft_consensus.cc:2804] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:55.546094 14416 raft_consensus.cc:1240] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 23 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:55.647725 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:55.648428 14411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41692 (request call id 1452) took 1447 ms. Trace:
I20260709 12:13:55.683568 13834 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Advancing to term 27
W20260709 12:13:55.665367 14379 consensus_peers.cc:597] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:55.451105 23417 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.447485 23535 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:55.653579 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:55.448429 23408 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:55.666412 14412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41700 (request call id 1438) took 1301 ms. Trace:
I20260709 12:13:55.430933 23559 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:55.687325 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
W20260709 12:13:55.676045 23578 log.cc:927] Time spent T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.307s	user 0.001s	sys 0.000s
I20260709 12:13:55.688786 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:55.451530 23489 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:55.663972 23362 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.111s	sys 0.116s
I20260709 12:13:55.683439 14411 rpcz_store.cc:276] 0709 12:13:54.201439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:54.201620 (+   181us) service_pool.cc:224] Handling call
0709 12:13:54.202089 (+   469us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:54.202430 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 21
0709 12:13:54.855405 (+652975us) log.cc:844] Serialized 14 byte log entry
0709 12:13:55.562092 (+706687us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:55.648037 (+ 85945us) raft_consensus.cc:1645] Marking committed up to 21
0709 12:13:55.648106 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:55.648198 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:55.648361 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25340,"prepare.queue_time_us":790854,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":3743,"raft.queue_time_us":164886,"spinlock_wait_cycles":5233024,"thread_start_us":1317907,"threads_started":3,"wal-append.queue_time_us":590399}
I20260709 12:13:55.663638 23554 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.525213 23399 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:55.705587 14412 rpcz_store.cc:276] 0709 12:13:54.364954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:54.365162 (+   208us) service_pool.cc:224] Handling call
0709 12:13:54.365498 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:54.366531 (+  1033us) raft_consensus.cc:1534] Early marking committed up to index 18
0709 12:13:55.121368 (+754837us) log.cc:844] Serialized 14 byte log entry
0709 12:13:55.665848 (+544480us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:55.665932 (+    84us) raft_consensus.cc:1645] Marking committed up to 18
0709 12:13:55.666003 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:55.666144 (+   141us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:55.666329 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":663240,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":11915,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":13049,"spinlock_wait_cycles":1742592,"thread_start_us":1276730,"threads_started":2}
I20260709 12:13:55.508436 23558 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:55.705042 23417 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:55.698266 23556 raft_consensus.cc:697] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 27 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
W20260709 12:13:55.727363 23362 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.111s	sys 0.117s
I20260709 12:13:55.539116 13833 rpcz_store.cc:276] 0709 12:13:54.331597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:54.332683 (+  1086us) service_pool.cc:224] Handling call
0709 12:13:54.373544 (+ 40861us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:54.373775 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 18
0709 12:13:54.956094 (+582319us) log.cc:844] Serialized 14 byte log entry
0709 12:13:55.526158 (+570064us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:55.526248 (+    90us) raft_consensus.cc:1645] Marking committed up to 18
0709 12:13:55.526322 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:55.526430 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:55.526597 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14604,"prepare.queue_time_us":15311,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":1602,"thread_start_us":1132055,"threads_started":2}
I20260709 12:13:55.728247 23502 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.745168 23417 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:55.746601 23408 leader_election.cc:290] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:55.748086 23559 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:13:55.748188 23568 log.cc:927] Time spent T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.314s	user 0.000s	sys 0.001s
I20260709 12:13:55.848006 13837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 4449) took 1246 ms. Trace:
I20260709 12:13:55.749975 23120 consensus_queue.cc:237] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:55.744462 23359 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
W20260709 12:13:55.791554 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:55.848479 13837 rpcz_store.cc:276] 0709 12:13:54.602054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:54.714084 (+112030us) service_pool.cc:224] Handling call
0709 12:13:54.714514 (+   430us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:54.828780 (+114266us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:54.828812 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:54.829529 (+   717us) log.cc:844] Serialized 52 byte log entry
0709 12:13:55.365768 (+536239us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:13:55.423227 (+ 57459us) log.cc:844] Serialized 14 byte log entry
0709 12:13:55.423461 (+   234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:55.423557 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:55.777074 (+353517us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b18004e2620. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924ea03f3 00007fa924ea27c1 00007fa924ea2779 00007fa924ea2709 00007fa924ea26d1 00007fa924ea19cd 0000000000388634 0000000000388479 00007fa924e8383a
0709 12:13:55.847608 (+ 70534us) raft_consensus.cc:1685] finished
0709 12:13:55.847740 (+   132us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:55.847930 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":105209,"prepare.queue_time_us":61518,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":116157,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":213,"spinlock_wait_cycles":37378432,"thread_start_us":440337,"threads_started":1,"wal-append.queue_time_us":804553}
I20260709 12:13:55.864557 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:55.865713 13837 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 27.
I20260709 12:13:55.869138 13828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 4444) took 1504 ms. Trace:
W20260709 12:13:55.756839 23577 log.cc:927] Time spent T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.382s	user 0.000s	sys 0.001s
W20260709 12:13:55.778265 23582 log.cc:927] Time spent T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.245s	user 0.000s	sys 0.001s
W20260709 12:13:55.774533 23588 log.cc:927] Time spent T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:13:55.765019 23399 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:55.880605 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:13:55.775246 23594 log.cc:927] Time spent T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 12:13:55.779062 23585 log.cc:927] Time spent T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 12:13:55.761123 23569 log.cc:927] Time spent T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.348s	user 0.001s	sys 0.002s
I20260709 12:13:55.771489 23571 raft_consensus.cc:3055] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 34 LEADER]: Stepping down as leader of term 34
I20260709 12:13:55.749625 23489 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:55.740775 23360 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:55.880306 13835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 4447) took 1279 ms. Trace:
I20260709 12:13:55.895341 13727 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:56.012926 13835 rpcz_store.cc:276] 0709 12:13:54.601304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:54.603115 (+  1811us) service_pool.cc:224] Handling call
0709 12:13:54.603582 (+   467us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:54.603989 (+   407us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:54.604029 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:54.604587 (+   558us) log.cc:844] Serialized 26 byte log entry
0709 12:13:55.191736 (+587149us) raft_consensus.cc:1645] Marking committed up to 18
0709 12:13:55.191798 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:55.191896 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:55.879995 (+688099us) raft_consensus.cc:1685] finished
0709 12:13:55.880019 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:55.880208 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28359,"raft.queue_time_us":82264,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":9235,"thread_start_us":586730,"threads_started":1,"wal-append.queue_time_us":715212}
I20260709 12:13:55.744923 23464 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:55.777103 23535 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:55.744462 23463 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:55.917636 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 36 candidate_status { last_received { term: 35 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:55.783308 23546 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:55.784444 23547 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.977499 13834 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 27.
I20260709 12:13:55.836622 23502 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:55.774027 23362 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:56.036132 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:13:56.008647 13652 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.008s	sys 0.012s
I20260709 12:13:56.017170 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:13:56.062486 13652 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.009s	sys 0.012s
W20260709 12:13:56.062916 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 615815us
I20260709 12:13:56.063445 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:13:56.063669 23579 log.cc:927] Time spent T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.381s	user 0.001s	sys 0.001s
I20260709 12:13:56.064472 13833 raft_consensus.cc:2410] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 28 because replica has last-logged OpId of term: 27 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 16.
I20260709 12:13:55.884362 23421 raft_consensus.cc:697] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:55.766840 23558 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:56.032397 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:56.065459 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 31 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:56.031068 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:55.873150 23359 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:55.860123 23600 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 33 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
W20260709 12:13:56.078392 23583 log.cc:927] Time spent T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.195s	user 0.000s	sys 0.002s
I20260709 12:13:56.079020 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:55.754940 23556 consensus_queue.cc:237] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 26.19, Last appended by leader: 19, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:56.042245 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 32 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:56.083743 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 34 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:56.084307 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 30 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:13:56.084844 23278 consensus_meta.cc:287] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.971s	user 0.010s	sys 0.001s
I20260709 12:13:56.085163 13757 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 28.
I20260709 12:13:56.085640 23551 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:56.050334 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 36 candidate_status { last_received { term: 35 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:56.086045 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 31 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:56.053143 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:56.087366 13758 raft_consensus.cc:2393] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 27: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:56.036634 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:56.088699 13829 raft_consensus.cc:1240] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 23. Current term is 24. Ops: [21.10-23.11]
I20260709 12:13:56.090170 13831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 4463) took 1055 ms. Trace:
W20260709 12:13:56.090519 23353 consensus_meta.cc:287] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.806s	user 0.013s	sys 0.000s
I20260709 12:13:56.010131 23571 raft_consensus.cc:740] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 34 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:56.072329 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 32 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:13:56.070604 13652 connection.cc:256] RPC call timeout handler was delayed by -1.3423213460000625s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22050000000000003s for a response
W20260709 12:13:56.092113 13652 connection.cc:256] RPC call timeout handler was delayed by -1.3207213460000276s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22290000000000001s for a response
W20260709 12:13:56.037438 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 142198us
I20260709 12:13:56.092796 23502 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:56.051543 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:56.045636 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:56.094260 13756 raft_consensus.cc:2393] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 31: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:56.090858 13831 rpcz_store.cc:276] 0709 12:13:55.034627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:55.122381 (+ 87754us) service_pool.cc:224] Handling call
0709 12:13:55.122774 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:55.125235 (+  2461us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:55.125279 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:55.125891 (+   612us) log.cc:844] Serialized 26 byte log entry
0709 12:13:55.426451 (+300560us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:13:55.426513 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:55.426590 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:56.089877 (+663287us) raft_consensus.cc:1685] finished
0709 12:13:56.089911 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:56.090087 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":774,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":18735,"thread_start_us":300036,"threads_started":1,"wal-append.queue_time_us":953735}
I20260709 12:13:56.035668 23547 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:56.090939 13837 raft_consensus.cc:1240] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:56.097508 23547 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:56.098706 13759 raft_consensus.cc:2393] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 27: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:56.094115 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 36 candidate_status { last_received { term: 34 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:13:56.106879 23590 log.cc:927] Time spent T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 12:13:56.110922 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:56.111955 13835 raft_consensus.cc:2468] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 27.
I20260709 12:13:56.065706 23550 raft_consensus.cc:2804] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader election won for term 25
W20260709 12:13:56.114329 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 424594us
I20260709 12:13:56.078651 23600 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 33 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:55.502525 23581 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:55.879838 23465 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:55.784668 23554 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:56.066551 23535 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:56.137763 13830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 4451) took 1535 ms. Trace:
I20260709 12:13:56.118664 23443 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.138387 13830 rpcz_store.cc:276] 0709 12:13:54.602665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:54.715087 (+112422us) service_pool.cc:224] Handling call
0709 12:13:54.715420 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:54.828915 (+113495us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:54.828968 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:54.829509 (+   541us) log.cc:844] Serialized 26 byte log entry
0709 12:13:55.316211 (+486702us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:13:55.316250 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:55.316322 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:56.137458 (+821136us) raft_consensus.cc:1685] finished
0709 12:13:56.137491 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:56.137678 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":113068,"raft.queue_time_us":115229,"raft.run_cpu_time_us":54,"raft.run_wall_time_us":54,"thread_start_us":404028,"threads_started":1,"wal-append.queue_time_us":643467}
W20260709 12:13:56.120549 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 433907us
I20260709 12:13:56.153689 13762 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 27.
I20260709 12:13:56.097651 23571 consensus_queue.cc:260] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 34.20, Last appended by leader: 20, Current term: 34, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:56.067073 23362 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:56.121433 23477 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 34 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:56.155227 23443 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:56.162468 23591 log.cc:927] Time spent T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.312s	user 0.000s	sys 0.001s
I20260709 12:13:56.160952 23550 raft_consensus.cc:697] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:56.091054 23353 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:56.159987 23175 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:56.136317 23465 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:56.209481 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 116894us
I20260709 12:13:56.209762 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 30 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:56.210431 13763 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 28.
I20260709 12:13:56.142642 23535 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:56.215909 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:56.217869 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:56.218809 13763 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 27.
W20260709 12:13:56.225715 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:56.227034 14379 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:56.229924 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:56.231207 13835 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 28.
I20260709 12:13:56.231341 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:56.231684 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 30 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:56.233903 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:56.235404 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:56.230492 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:56.236028 14412 raft_consensus.cc:2468] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 24.
I20260709 12:13:56.236835 14407 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 28.
I20260709 12:13:56.239215 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:56.239419 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 32 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:56.240041 13833 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 30.
I20260709 12:13:56.241967 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:56.208725 23546 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.244344 14409 raft_consensus.cc:2393] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 26: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:13:56.214783 23547 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:56.186705 23477 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 34 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:56.252067 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:56.224532 23464 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:56.193158 23175 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:56.226503 23597 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:56.264580 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:56.258035 14409 raft_consensus.cc:2393] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 28: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:56.255264 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 34 candidate_status { last_received { term: 33 index: 21 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:56.258216 13652 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:56.258738 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:56.267817 13834 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 27.
W20260709 12:13:56.254130 14379 consensus_peers.cc:597] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:56.183478 23421 consensus_queue.cc:237] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:56.269894 13763 raft_consensus.cc:2393] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 34 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 34: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:56.277489 13836 raft_consensus.cc:1240] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 28. Current term is 29. Ops: []
I20260709 12:13:56.278647 23581 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:56.279525 13834 raft_consensus.cc:1275] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 26 index: 13. Preceding OpId from leader: term: 28 index: 15. (index mismatch)
W20260709 12:13:56.275152 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:56.261469 23600 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:56.262022 23386 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.253222 23546 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:56.224175 23608 consensus_queue.cc:1048] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.065s
I20260709 12:13:56.334412 23175 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:56.297420 23359 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:56.262814 23547 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:56.276549 23278 raft_consensus.cc:2749] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:13:56.315361 13652 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:13:56.296811 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 141360us
W20260709 12:13:56.298468 23467 consensus_meta.cc:287] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.944s	user 0.007s	sys 0.007s
I20260709 12:13:56.271095 23464 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:56.396404 23617 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 34 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.313311 23423 consensus_queue.cc:1059] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 26.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.066s
I20260709 12:13:56.331040 23580 consensus_queue.cc:1059] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 26.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.077s
I20260709 12:13:56.375396 22770 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 35 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
W20260709 12:13:56.379583 23613 log.cc:927] Time spent T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:13:56.327785 23298 consensus_queue.cc:260] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 28.20, Last appended by leader: 20, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:56.387298 23546 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:56.331728 23362 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:13:56.388949 23320 consensus_meta.cc:287] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 1.089s	user 0.009s	sys 0.005s
I20260709 12:13:56.389621 23556 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 34 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.391119 23465 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:56.330567 23443 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:56.323117 23535 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:13:56.392390 23522 consensus_meta.cc:287] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 1.229s	user 0.014s	sys 0.001s
I20260709 12:13:56.333988 23558 consensus_queue.cc:1048] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.060s
I20260709 12:13:56.337210 23554 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:56.335309 23477 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:56.276633 23550 consensus_queue.cc:237] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:56.272081 23597 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:56.395445 23547 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:56.313446 23386 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:56.332450 23353 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:56.397065 23617 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 34 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:56.428390 13634 auto_rebalancer.cc:288] Could not retrieve cluster info: Not found: tserver ca9fbbc2c0a94897897d502d42f3951f not available for placement
I20260709 12:13:56.320842 23551 consensus_queue.cc:1059] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.095s
W20260709 12:13:56.408233 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 92987.3us
I20260709 12:13:56.400341 23464 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:55.869822 13828 rpcz_store.cc:276] 0709 12:13:54.367081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:54.367356 (+   275us) service_pool.cc:224] Handling call
0709 12:13:54.367839 (+   483us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:54.368101 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 18
0709 12:13:55.125364 (+757263us) log.cc:844] Serialized 14 byte log entry
0709 12:13:55.868356 (+742992us) log.cc:844] Serialized 14 byte log entry
0709 12:13:55.868656 (+   300us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:55.868731 (+    75us) raft_consensus.cc:1645] Marking committed up to 18
0709 12:13:55.868800 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:55.868896 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:55.869053 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6882,"prepare.queue_time_us":81612,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":55,"raft.queue_time_us":5862,"raft.run_cpu_time_us":314,"raft.run_wall_time_us":17335,"spinlock_wait_cycles":16908032,"thread_start_us":1471392,"threads_started":3,"wal-append.queue_time_us":494046}
I20260709 12:13:56.414868 23278 raft_consensus.cc:2749] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:56.401589 23467 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:56.480778 13652 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:56.467485 23298 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:56.434676 23581 raft_consensus.cc:3055] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 28 LEADER]: Stepping down as leader of term 28
I20260709 12:13:56.495071 13652 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:56.467803 23546 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.429529 22770 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 35 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:56.556113 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 30 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:13:56.549492 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 45089us
I20260709 12:13:56.556947 14411 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 29.
I20260709 12:13:56.557374 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 35 candidate_status { last_received { term: 34 index: 20 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:56.560798 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:56.561347 14411 raft_consensus.cc:1240] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:56.560837 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:56.566057 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:56.567333 13837 raft_consensus.cc:2410] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for term 28 because replica has last-logged OpId of term: 26 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 15.
I20260709 12:13:56.561484 14416 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 26.
I20260709 12:13:56.432238 23556 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 34 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:56.571486 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:56.572140 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:56.467375 23522 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:56.574530 13727 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:56.492787 23423 raft_consensus.cc:3055] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:13:56.580054 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:56.577252 13727 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:56.580812 14409 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 23.
I20260709 12:13:56.548188 23551 raft_consensus.cc:2749] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:13:56.588923 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:56.589300 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:56.589996 13833 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 27.
I20260709 12:13:56.590847 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 31 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:56.543116 23581 raft_consensus.cc:740] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 28 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
W20260709 12:13:56.596609 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:56.604192 13832 raft_consensus.cc:3060] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:56.580356 23423 raft_consensus.cc:740] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:56.585418 23372 raft_consensus.cc:2804] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:56.601397 23558 raft_consensus.cc:3060] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:56.564107 23546 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:56.617657 23567 log.cc:927] Time spent T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 1.244s	user 0.004s	sys 0.000s
I20260709 12:13:56.613422 23464 raft_consensus.cc:2804] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Leader pre-election won for term 32
W20260709 12:13:56.642611 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 263764us
I20260709 12:13:56.622676 23372 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:56.651789 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:13:56.652104 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:56.655234 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 349988us
I20260709 12:13:56.641083 23464 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:56.668144 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 30 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:56.669173 13835 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 29.
W20260709 12:13:56.664141 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 81650us
I20260709 12:13:56.674057 13727 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:56.664892 13832 raft_consensus.cc:2468] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 28.
I20260709 12:13:56.665223 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:56.676168 13831 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 28.
I20260709 12:13:56.664942 13833 raft_consensus.cc:1275] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
W20260709 12:13:56.681113 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 323203us
I20260709 12:13:56.654748 23372 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:56.684823 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:56.689932 13801 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:56.689954 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 34 candidate_status { last_received { term: 33 index: 21 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:56.691182 13831 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 34 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 34.
I20260709 12:13:56.672719 23464 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Advancing to term 32
W20260709 12:13:56.692885 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 408038us
I20260709 12:13:56.697813 13800 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:56.699715 13801 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:56.682819 23547 raft_consensus.cc:2804] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:56.693555 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:56.709317 13836 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 23.
W20260709 12:13:56.711871 14379 consensus_peers.cc:597] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:56.724907 14379 leader_election.cc:336] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:56.730615 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 30 candidate_status { last_received { term: 28 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:56.731475 14380 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:56.741961 23554 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:56.742832 23554 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:56.711139 13727 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:56.748025 13833 raft_consensus.cc:2393] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 30: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
W20260709 12:13:56.751428 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 256480us
I20260709 12:13:56.751930 23630 raft_consensus.cc:2804] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:13:56.752481 23630 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:56.752954 23630 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:56.753603 23359 consensus_queue.cc:1048] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:13:56.754755 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:56.755828 23580 consensus_queue.cc:1059] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:13:56.756291 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:56.752748 14380 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:56.763016 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:56.731834 14379 leader_election.cc:304] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:56.765686 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 35 candidate_status { last_received { term: 34 index: 20 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:56.766600 13759 raft_consensus.cc:2393] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 35 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 35: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:56.763691 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:56.748656 23477 raft_consensus.cc:2804] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:56.766083 14380 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:56.770233 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:56.659893 23423 consensus_queue.cc:260] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 27.14, Last appended by leader: 14, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:56.708039 23547 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:56.771286 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 46423.6us
I20260709 12:13:56.776473 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 30 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:13:56.777858 14379 consensus_peers.cc:597] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:56.659322 23581 consensus_queue.cc:260] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 28.16, Last appended by leader: 16, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:56.773018 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 35 candidate_status { last_received { term: 33 index: 21 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:13:56.763718 23615 log.cc:927] Time spent T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.282s	user 0.002s	sys 0.000s
I20260709 12:13:56.710632 23386 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:56.782225 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 31 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:56.733160 23465 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.774248 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:56.829176 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:56.843827 13833 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 27.
I20260709 12:13:56.770002 23580 consensus_queue.cc:1243] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer 96701a74fdee481fb5f54aac841e17dd log is divergent from this leader: its last log entry 20.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:13:56.834436 13762 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 34 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 34.
W20260709 12:13:56.834908 14379 consensus_peers.cc:597] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:56.775844 23608 raft_consensus.cc:2749] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:56.730044 23625 raft_consensus.cc:2804] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:13:56.799647 23554 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:56.781661 23359 raft_consensus.cc:2804] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:56.771325 23477 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:56.771309 23599 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 33 FOLLOWER]: Leader pre-election won for term 34
I20260709 12:13:56.842095 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 35 candidate_status { last_received { term: 33 index: 21 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:56.845360 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:56.881067 13833 raft_consensus.cc:2410] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 29 because replica has last-logged OpId of term: 28 index: 19, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 17.
I20260709 12:13:56.830075 23617 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:56.775298 23602 raft_consensus.cc:2804] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:56.837287 13652 leader_election.cc:304] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:56.845990 23639 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:56.859319 23595 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 34 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.786063 23547 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:56.773274 23637 raft_consensus.cc:2804] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:56.729144 23624 consensus_queue.cc:1048] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.134s
I20260709 12:13:56.779942 22770 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:56.849125 23621 log.cc:927] Time spent T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.254s	user 0.000s	sys 0.001s
I20260709 12:13:56.767957 23278 consensus_queue.cc:1059] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 25.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.083s
I20260709 12:13:56.836525 23489 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.827689 23597 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:56.847575 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:56.842756 23570 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:56.897282 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 60053.9us
W20260709 12:13:56.898591 13832 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54820 (request call id 4469) took 1652 ms (client timeout 1995 ms). Trace:
I20260709 12:13:56.846458 23467 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 30 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:56.859092 23623 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:13:56.853452 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 74735.4us
I20260709 12:13:56.855646 23423 raft_consensus.cc:3060] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:56.860213 23581 raft_consensus.cc:3060] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:56.865509 23625 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:56.886442 23605 raft_consensus.cc:3055] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:56.868259 23556 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:56.880613 23359 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:56.880343 23477 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:56.931264 13727 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:56.888718 23599 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 33 FOLLOWER]: Starting leader election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:56.896143 23602 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:56.854025 23465 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:56.936244 23622 consensus_queue.cc:1059] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.028s
I20260709 12:13:56.994690 23622 raft_consensus.cc:3055] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:13:56.995107 23622 raft_consensus.cc:740] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:56.995972 23622 consensus_queue.cc:260] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.19, Last appended by leader: 19, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:56.997172 23622 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:13:56.945999 13832 rpcz_store.cc:269] 0709 12:13:55.233270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:55.255584 (+ 22314us) service_pool.cc:224] Handling call
0709 12:13:56.885208 (+1629624us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b540002e754. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:56.885393 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3048698112}
I20260709 12:13:56.998528 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:56.999140 13832 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 26.
I20260709 12:13:56.944819 23489 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:57.000001 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 36 candidate_status { last_received { term: 35 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:57.000612 13832 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 35 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 35.
I20260709 12:13:56.925148 23637 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:56.974280 23605 raft_consensus.cc:740] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:57.002007 23637 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:57.002964 23605 consensus_queue.cc:260] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.14, Last appended by leader: 14, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:57.004278 23605 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:56.965806 23625 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:56.903453 23641 raft_consensus.cc:2804] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:57.006381 13835 raft_consensus.cc:1275] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 29 index: 17. (index mismatch)
I20260709 12:13:57.006750 23641 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:57.007301 23641 raft_consensus.cc:3060] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:56.932207 23546 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:56.953361 13836 raft_consensus.cc:1275] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 12:13:56.952129 23570 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:56.957208 14379 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:13:57.011283 23642 log.cc:927] Time spent T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 12:13:57.011629 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 54482.4us
I20260709 12:13:56.981416 23599 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 33 FOLLOWER]: Advancing to term 34
I20260709 12:13:57.012586 23570 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:56.983880 23465 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:57.013342 23570 raft_consensus.cc:2804] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Leader pre-election won for term 29
W20260709 12:13:56.978489 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:56.860169 23386 consensus_queue.cc:1059] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.065s
I20260709 12:13:57.026610 23386 consensus_queue.cc:1243] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer ca9fbbc2c0a94897897d502d42f3951f log is divergent from this leader: its last log entry 23.18 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 17
I20260709 12:13:56.973551 23467 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:56.979842 23602 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Advancing to term 28
W20260709 12:13:56.990007 23634 log.cc:927] Time spent T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 12:13:56.929318 23595 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 34 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:57.016383 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:56.930509 23639 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:57.001402 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 29 candidate_status { last_received { term: 28 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:57.020901 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:57.033314 23546 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 35 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.037894 13832 raft_consensus.cc:2368] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 29. Current term is 30.
I20260709 12:13:56.974664 23359 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:57.014477 23539 raft_consensus.cc:2804] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:57.055874 13754 raft_consensus.cc:2468] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 29.
I20260709 12:13:57.054605 13759 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 26.
I20260709 12:13:57.001474 23489 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:57.027307 23386 raft_consensus.cc:3055] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:57.020363 23570 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:57.027526 23608 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.052103 23546 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 35 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:57.134948 23647 log.cc:927] Time spent T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 12:13:57.136051 23546 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:57.139115 23595 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:57.140564 23464 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 32 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:57.146793 23648 log.cc:927] Time spent T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 12:13:57.064935 23645 log.cc:927] Time spent T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 12:13:57.098366 23580 raft_consensus.cc:3055] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:13:56.960692 23623 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:57.063305 23386 raft_consensus.cc:740] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:57.102051 23551 raft_consensus.cc:3055] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:57.102957 23571 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:13:57.129195 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 30 candidate_status { last_received { term: 28 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:57.129948 13652 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:57.130026 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:57.132022 13754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48120 (request call id 3098) took 1087 ms. Trace:
I20260709 12:13:57.168114 13763 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Advancing to term 30
W20260709 12:13:57.090384 14381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:57.057600 23539 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:57.064615 23570 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:57.101133 23522 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:13:57.156351 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:57.048847 23467 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:57.177206 13759 raft_consensus.cc:1240] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Rejecting Update request from peer 96701a74fdee481fb5f54aac841e17dd for earlier term 27. Current term is 28. Ops: []
I20260709 12:13:57.171428 13760 raft_consensus.cc:2368] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 27. Current term is 28.
I20260709 12:13:57.171298 13754 rpcz_store.cc:276] 0709 12:13:56.044191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:56.045284 (+  1093us) service_pool.cc:224] Handling call
0709 12:13:57.131831 (+1086547us) spinlock_profiling.cc:243] Waited 894 ms on lock 0x7b54000ef954. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:57.131952 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2057218944}
I20260709 12:13:57.181114 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 36 candidate_status { last_received { term: 34 index: 20 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:57.180574 13652 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:57.182782 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 32 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:57.189309 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 36 candidate_status { last_received { term: 34 index: 20 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:57.184250 13760 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 31.
I20260709 12:13:57.192950 13835 raft_consensus.cc:1275] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 12:13:57.154929 23580 raft_consensus.cc:740] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:57.167399 23551 raft_consensus.cc:740] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:57.207592 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 30 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:57.166369 23489 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.199822 13652 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:57.174012 23539 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:57.218716 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 35 candidate_status { last_received { term: 33 index: 21 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:57.214527 23463 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:57.259094 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 59409us
I20260709 12:13:57.224411 14416 raft_consensus.cc:1275] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 26 index: 19. Preceding OpId from leader: term: 27 index: 20. (index mismatch)
I20260709 12:13:57.260006 13652 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:13:57.209185 13727 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:57.255147 14379 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:13:57.261080 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 55658.2us
I20260709 12:13:57.261181 23640 raft_consensus.cc:2749] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:13:57.261917 13727 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:57.262140 23640 raft_consensus.cc:2804] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:57.262687 23640 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:57.262722 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:57.263079 23640 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:57.263911 13727 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:57.234599 13760 raft_consensus.cc:1240] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 LEADER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 28. Current term is 29. Ops: []
I20260709 12:13:57.237891 13761 raft_consensus.cc:2410] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for term 26 because replica has last-logged OpId of term: 25 index: 19, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 18.
W20260709 12:13:57.231649 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 269341us
I20260709 12:13:57.241544 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:57.242611 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:57.247629 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 35 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:57.266741 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:57.267338 13759 raft_consensus.cc:2410] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 34 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for term 35 because replica has last-logged OpId of term: 33 index: 21, which is greater than that of the candidate, which has last-logged OpId of term: 32 index: 20.
I20260709 12:13:57.267908 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:57.268121 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:57.268707 13761 raft_consensus.cc:2393] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 28: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
W20260709 12:13:57.248723 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:57.250157 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 30 candidate_status { last_received { term: 28 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:57.239406 23467 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:57.161405 23625 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:57.254576 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 31 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:57.173869 23556 raft_consensus.cc:2749] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:57.214815 23607 raft_consensus.cc:493] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:57.204252 23278 raft_consensus.cc:2749] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:57.223661 13763 raft_consensus.cc:2468] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 30.
I20260709 12:13:57.230643 13800 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:57.264072 23546 raft_consensus.cc:2804] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:13:57.265547 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:57.087253 23608 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:57.250588 23551 consensus_queue.cc:260] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.11, Last appended by leader: 11, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:57.271128 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:57.313943 13834 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 27.
I20260709 12:13:57.259024 14411 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 34 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 34.
I20260709 12:13:57.276623 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:13:57.279346 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:57.316404 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:57.317154 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:57.290259 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:13:57.290138 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 59611.5us
I20260709 12:13:57.318785 13800 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:57.319028 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:13:57.284816 23630 consensus_meta.cc:287] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.531s	user 0.003s	sys 0.010s
I20260709 12:13:57.312805 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:57.321653 13727 leader_election.cc:400] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 29 pre-election: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 29. Current term is 30.
I20260709 12:13:57.322880 13727 leader_election.cc:403] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 29 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:57.320292 13763 raft_consensus.cc:2410] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 26 because replica has last-logged OpId of term: 25 index: 19, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 18.
I20260709 12:13:57.284332 23612 raft_consensus.cc:2804] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 35 FOLLOWER]: Leader pre-election won for term 36
I20260709 12:13:57.284225 23595 raft_consensus.cc:2804] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:57.326295 13800 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:57.285135 23554 raft_consensus.cc:2804] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election won for term 27
W20260709 12:13:57.332751 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 60210.3us
I20260709 12:13:57.337076 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:57.337914 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 30 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:57.339759 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 35 candidate_status { last_received { term: 33 index: 21 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:57.340489 13761 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 34 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 34.
I20260709 12:13:57.306952 23467 raft_consensus.cc:2749] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:57.337580 23443 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 34 FOLLOWER]: Leader pre-election won for term 35
I20260709 12:13:57.349516 23443 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 34 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:57.350076 23443 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:13:57.355877 13727 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:57.359081 23629 consensus_queue.cc:1048] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:13:57.360999 23629 raft_consensus.cc:2749] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 35 FOLLOWER]: Leader pre-election lost for term 36. Reason: could not achieve majority
I20260709 12:13:57.314898 23580 consensus_queue.cc:260] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:57.332643 23522 raft_consensus.cc:2749] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 12:13:57.363346 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:57.364073 23320 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.284402 23489 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:57.364589 23320 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:57.347167 23551 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:57.366214 23489 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:57.366801 23320 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:57.370595 23639 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:13:57.372088 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:57.284176 23386 consensus_queue.cc:260] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:57.373744 23443 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 35 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:57.374612 23386 raft_consensus.cc:3060] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:57.376121 23443 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 35 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:57.378695 23623 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:57.386551 13800 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:57.388132 13800 leader_election.cc:400] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 election: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 27. Current term is 28.
I20260709 12:13:57.388475 13800 leader_election.cc:403] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 election: Cancelling election due to peer responding with higher term
W20260709 12:13:57.343627 14379 leader_election.cc:336] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:57.392019 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 48418.8us
W20260709 12:13:57.392953 14379 leader_election.cc:336] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:57.390848 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 70000.7us
I20260709 12:13:57.286756 23463 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:57.404927 23372 consensus_meta.cc:287] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.712s	user 0.011s	sys 0.000s
I20260709 12:13:57.390538 13800 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:57.393818 23639 consensus_queue.cc:1059] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 27.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.005s
I20260709 12:13:57.411738 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 32 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:57.335217 23595 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:13:57.337110 23554 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:57.401557 23547 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:57.405602 23464 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 32 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:57.410086 13800 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:57.338085 23546 raft_consensus.cc:697] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:57.331812 23298 consensus_queue.cc:1048] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.080s
W20260709 12:13:57.397832 14379 leader_election.cc:336] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:57.425225 14379 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:57.322490 23416 consensus_queue.cc:1048] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.074s
I20260709 12:13:57.408298 14380 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:57.289976 23477 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:57.346393 23120 raft_consensus.cc:2749] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Leader pre-election lost for term 29. Reason: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 29. Current term is 30.
I20260709 12:13:57.345007 23612 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 35 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
W20260709 12:13:57.454336 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 46120.8us
I20260709 12:13:57.334676 23630 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 30 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:57.457439 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:57.460609 14411 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 25.
I20260709 12:13:57.407569 23623 raft_consensus.cc:2804] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:13:57.407068 23522 raft_consensus.cc:2749] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader election lost for term 27. Reason: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 27. Current term is 28.
I20260709 12:13:57.421671 23554 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:57.309070 23607 raft_consensus.cc:515] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:57.423527 23595 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:57.469121 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:57.416308 23650 raft_consensus.cc:2804] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:13:57.427979 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:57.483403 13759 raft_consensus.cc:2393] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 28: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
W20260709 12:13:57.478469 13634 auto_rebalancer.cc:288] Could not retrieve cluster info: Not found: tserver ca9fbbc2c0a94897897d502d42f3951f not available for placement
I20260709 12:13:57.484752 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 35 candidate_status { last_received { term: 33 index: 21 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:57.488895 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 31 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:57.490499 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:57.493443 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:13:57.494954 14379 leader_election.cc:336] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:57.495474 14379 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:57.494745 13801 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:57.508833 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:57.450078 23360 raft_consensus.cc:2749] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:57.509588 13836 raft_consensus.cc:2376] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 27. Re-sending same reply.
I20260709 12:13:57.457994 23320 raft_consensus.cc:2804] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Leader election won for term 30
I20260709 12:13:57.457921 23612 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 35 FOLLOWER]: Advancing to term 36
I20260709 12:13:57.356563 23640 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:57.423007 23489 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.540861 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 31 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:57.514321 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:57.523690 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:57.524572 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:57.516808 23658 raft_consensus.cc:2749] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:13:57.524572 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 35 candidate_status { last_received { term: 33 index: 21 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:57.557029 13760 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:13:57.422416 23372 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:57.563355 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 303451us
I20260709 12:13:57.531786 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 30 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:57.565289 13759 raft_consensus.cc:3060] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Advancing to term 30
I20260709 12:13:57.458834 23641 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:57.532562 23639 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.532799 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 36 candidate_status { last_received { term: 35 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:57.470091 23609 raft_consensus.cc:2804] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:57.491928 23650 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 31 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:57.548878 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:13:57.469416 23581 consensus_meta.cc:287] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.511s	user 0.010s	sys 0.000s
I20260709 12:13:57.550099 13829 raft_consensus.cc:2368] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 27. Current term is 28.
I20260709 12:13:57.576987 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:57.497336 23623 raft_consensus.cc:697] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 29 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
W20260709 12:13:57.507469 14379 leader_election.cc:336] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:57.561743 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:57.531335 23547 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:57.581756 13828 raft_consensus.cc:3060] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:57.583019 13760 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 35 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 35.
I20260709 12:13:57.577807 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:57.583081 13829 raft_consensus.cc:2393] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 26: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
W20260709 12:13:57.572965 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:57.584290 13652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:57.546604 23320 raft_consensus.cc:697] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 30 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
W20260709 12:13:57.581099 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 73671.9us
I20260709 12:13:57.591903 13651 leader_election.cc:304] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:57.594894 13829 raft_consensus.cc:1240] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:57.574331 23609 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:57.610849 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:57.611783 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:57.610584 13829 raft_consensus.cc:1275] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 26 index: 19. Preceding OpId from leader: term: 27 index: 20. (index mismatch)
I20260709 12:13:57.612046 13651 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:57.612666 13835 raft_consensus.cc:2410] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for term 28 because replica has last-logged OpId of term: 27 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 16.
I20260709 12:13:57.613543 13651 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:57.566871 23625 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 30 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:57.615638 13652 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:57.628216 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:13:57.621279 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:57.630736 13829 raft_consensus.cc:1240] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 28. Current term is 29. Ops: [28.16-28.16]
I20260709 12:13:57.636683 14412 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 35 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 35.
I20260709 12:13:57.636893 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:13:57.633351 13800 leader_election.cc:336] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:57.642144 13800 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:13:57.644402 13800 leader_election.cc:336] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:57.645058 13800 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:57.579947 23650 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 31 FOLLOWER]: Advancing to term 32
W20260709 12:13:57.598644 23558 consensus_meta.cc:287] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.963s	user 0.006s	sys 0.008s
I20260709 12:13:57.556140 23489 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:57.556561 23546 consensus_queue.cc:237] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.14, Last appended by leader: 14, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:57.627728 23556 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.661619 23463 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:57.653928 13759 raft_consensus.cc:2468] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 30.
I20260709 12:13:57.710335 23558 raft_consensus.cc:2749] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:13:57.672932 23637 consensus_meta.cc:287] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.670s	user 0.012s	sys 0.000s
W20260709 12:13:57.646629 23615 log.cc:927] Time spent T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:13:57.667879 23551 raft_consensus.cc:2749] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:13:57.672032 23535 raft_consensus.cc:3055] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:13:57.659632 23423 raft_consensus.cc:2749] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:13:57.714843 23372 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:57.647225 23443 raft_consensus.cc:2749] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:57.736689 23477 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:57.628427 23608 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:57.629832 23609 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Advancing to term 28
W20260709 12:13:57.749914 13832 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.043s	sys 0.029s
W20260709 12:13:57.752070 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:57.794847 13832 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.044s	sys 0.029s
I20260709 12:13:57.664912 14412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41692 (request call id 1462) took 1108 ms. Trace:
I20260709 12:13:57.635955 23278 consensus_queue.cc:1048] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.149s
I20260709 12:13:57.756613 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 29 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:57.758210 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 30 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:57.580181 23639 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:57.778529 23625 raft_consensus.cc:2749] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:57.783077 23465 raft_consensus.cc:2804] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260709 12:13:57.668033 23661 log.cc:927] Time spent T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 12:13:57.649838 23581 raft_consensus.cc:2749] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 33 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
I20260709 12:13:57.789050 23535 raft_consensus.cc:740] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:57.798005 23558 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:57.843236 23558 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:57.661360 23599 consensus_meta.cc:287] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.649s	user 0.003s	sys 0.008s
I20260709 12:13:57.735416 23640 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:57.660296 23630 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 30 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:57.692076 23607 leader_election.cc:290] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:57.683516 23641 leader_election.cc:290] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:57.785285 23637 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:57.795975 14412 rpcz_store.cc:276] 0709 12:13:56.556639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:56.556765 (+   126us) service_pool.cc:224] Handling call
0709 12:13:57.664633 (+1107868us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54007c01d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:57.664795 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2479238016}
I20260709 12:13:57.755612 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 30 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:57.804442 13835 raft_consensus.cc:2393] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 30: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:57.803792 23477 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:57.845746 23558 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:57.866528 23580 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:57.850436 13837 raft_consensus.cc:1240] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:57.851828 13760 raft_consensus.cc:2393] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 30: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:57.872391 13833 raft_consensus.cc:1240] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:57.872824 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:13:57.689338 23605 consensus_meta.cc:287] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.685s	user 0.013s	sys 0.000s
I20260709 12:13:57.639861 23655 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 35 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:57.794294 23570 consensus_meta.cc:287] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 0.543s	user 0.006s	sys 0.003s
I20260709 12:13:57.806859 23663 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 34 FOLLOWER]: Leader pre-election won for term 35
I20260709 12:13:57.808832 23443 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 33 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:57.819031 23489 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:57.824980 13830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 4473) took 1621 ms. Trace:
I20260709 12:13:57.684657 23623 consensus_queue.cc:237] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 28.20, Last appended by leader: 20, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:57.684218 23320 consensus_queue.cc:237] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 28.12, Last appended by leader: 12, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:57.835973 14414 raft_consensus.cc:1275] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 12:13:57.837435 14416 raft_consensus.cc:1275] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 28 index: 16. (index mismatch)
I20260709 12:13:57.770138 13828 raft_consensus.cc:2468] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 28.
W20260709 12:13:57.886224 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:57.888120 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:57.904655 23663 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 34 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:57.896651 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d10bdf51504a12a70a50e9a48f7ede" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:57.898980 13837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 3906) took 1170 ms. Trace:
I20260709 12:13:57.902396 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
W20260709 12:13:57.865612 23539 consensus_meta.cc:287] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.577s	user 0.008s	sys 0.002s
I20260709 12:13:57.907527 13830 rpcz_store.cc:276] 0709 12:13:56.203403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:56.203609 (+   206us) service_pool.cc:224] Handling call
0709 12:13:56.208898 (+  5289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:57.127178 (+918280us) spinlock_profiling.cc:243] Waited 1.72 ms on lock 0x7b18002cd1c0. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa927b354bc 00007fa924e8348b 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9d455 00007fa927f85060 00007fa927f85bfb 00007fa927f9064b
0709 12:13:57.127327 (+   149us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:57.127354 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:57.127879 (+   525us) log.cc:844] Serialized 26 byte log entry
0709 12:13:57.410816 (+282937us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:13:57.410873 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:57.410969 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:57.824515 (+413546us) raft_consensus.cc:1685] finished
0709 12:13:57.824550 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:57.824885 (+   335us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":746,"raft.queue_time_us":207533,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":35300,"spinlock_wait_cycles":3956608,"thread_start_us":491711,"threads_started":2,"wal-append.queue_time_us":405021}
I20260709 12:13:57.911307 23535 consensus_queue.cc:260] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 27.15, Last appended by leader: 15, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:57.851490 23465 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:57.783901 23556 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:57.810276 23602 consensus_meta.cc:287] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.758s	user 0.012s	sys 0.000s
I20260709 12:13:57.951809 23602 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:57.863579 23639 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:57.924448 13837 rpcz_store.cc:276] 0709 12:13:56.728656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:56.845255 (+116599us) service_pool.cc:224] Handling call
0709 12:13:56.845658 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:57.870769 (+1025111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:57.898596 (+ 27827us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54002a6554. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:57.898879 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2310311680}
I20260709 12:13:57.954245 23609 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:57.852017 23637 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:57.962074 23278 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.962894 23278 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:57.932847 23663 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 34 FOLLOWER]: Advancing to term 35
W20260709 12:13:57.937626 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:57.921162 23467 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.022s	sys 0.048s
W20260709 12:13:57.942652 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:57.976799 13835 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 28.
W20260709 12:13:57.977205 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:57.924851 23353 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:13:57.933916 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 318353us
I20260709 12:13:57.936488 13727 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:57.904321 23655 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 35 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:57.908159 23570 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:57.953642 13762 raft_consensus.cc:1240] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Rejecting Update request from peer ca9fbbc2c0a94897897d502d42f3951f for earlier term 27. Current term is 28. Ops: [27.19-27.19]
I20260709 12:13:57.862556 23477 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:57.943127 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 329672us
I20260709 12:13:57.945091 23465 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:13:57.979737 23467 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.023s	sys 0.049s
I20260709 12:13:58.005883 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:58.008502 13651 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:57.846168 23599 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 34 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:58.005329 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:57.913806 23443 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:58.005997 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 69632.4us
I20260709 12:13:58.008013 23353 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:58.028929 23353 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:58.017910 23535 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:58.015545 23175 raft_consensus.cc:2804] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:13:58.032680 23175 raft_consensus.cc:697] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:58.033794 23175 consensus_queue.cc:237] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.14, Last appended by leader: 14, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:58.035547 23599 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 34 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:58.036168 14379 leader_election.cc:336] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:58.037751 23443 leader_election.cc:290] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:58.056447 23570 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:58.070221 23489 raft_consensus.cc:2749] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:57.965603 23278 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:57.941074 23539 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:58.090246 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 66331.3us
I20260709 12:13:58.023526 14411 raft_consensus.cc:1240] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 27. Current term is 28. Ops: [27.20-27.20]
I20260709 12:13:58.095485 14380 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:58.104758 13758 raft_consensus.cc:1240] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:58.022703 23666 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:58.107580 13651 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:58.092064 14409 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 34 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 34.
I20260709 12:13:58.104913 14412 raft_consensus.cc:2368] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 28. Current term is 29.
W20260709 12:13:58.105381 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 79355.4us
I20260709 12:13:58.095635 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1bace76cb204a6d92c38685645dd9db" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 30 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
W20260709 12:13:58.113924 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:58.112166 13801 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
W20260709 12:13:58.110381 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 465975us
W20260709 12:13:58.117062 13800 leader_election.cc:336] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:58.119652 13727 leader_election.cc:304] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:58.121757 14416 raft_consensus.cc:2393] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 30: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:13:58.126173 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:58.131170 14380 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 30 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:58.131704 13651 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:13:58.122521 23359 consensus_meta.cc:287] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 1.054s	user 0.014s	sys 0.001s
I20260709 12:13:58.135573 13652 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:58.146493 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:58.149130 13760 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:58.150882 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:58.152340 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 25 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:58.113286 23600 raft_consensus.cc:2749] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:58.153585 13651 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:58.154539 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 34 candidate_status { last_received { term: 33 index: 19 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:13:58.121763 23629 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.013s	sys 0.037s
W20260709 12:13:58.155941 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:58.133770 23522 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 34 FOLLOWER]: Leader pre-election won for term 35
W20260709 12:13:58.187803 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 52350.4us
I20260709 12:13:58.134308 22770 raft_consensus.cc:2749] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:58.155710 23675 raft_consensus.cc:2749] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:58.180523 23539 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:58.122340 23666 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:58.153689 23359 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:58.186237 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:58.179571 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 34 candidate_status { last_received { term: 33 index: 21 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:58.205209 13833 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:58.205978 13831 raft_consensus.cc:2368] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 35 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for earlier term 34. Current term is 35.
I20260709 12:13:58.192746 13651 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 31 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:58.197036 13760 raft_consensus.cc:2468] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 28.
I20260709 12:13:58.193995 13652 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:58.207412 13651 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:58.152489 23602 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:58.121065 23362 consensus_queue.cc:1048] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.056s
W20260709 12:13:58.178239 23554 consensus_meta.cc:287] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.660s	user 0.009s	sys 0.006s
I20260709 12:13:58.148001 23381 raft_consensus.cc:2749] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 30 FOLLOWER]: Leader election lost for term 30. Reason: could not achieve majority
I20260709 12:13:58.120805 23464 consensus_queue.cc:1048] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.062s
I20260709 12:13:58.199821 23489 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Advancing to term 28
W20260709 12:13:58.175552 23629 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.769s	user 0.013s	sys 0.038s
I20260709 12:13:58.212344 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 30 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:58.123677 23650 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 32 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:58.208304 23386 raft_consensus.cc:2749] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:13:58.195050 23656 log.cc:927] Time spent T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:13:58.223029 13800 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 35 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:58.225438 13651 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:58.260521 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:58.261516 13831 raft_consensus.cc:2393] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 28: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:58.229101 23675 raft_consensus.cc:2749] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:58.187134 23522 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 34 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:58.159682 23673 raft_consensus.cc:3060] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:58.208586 13652 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:58.229704 14416 raft_consensus.cc:2393] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 24: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:13:58.230448 14380 leader_election.cc:400] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 34 election: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 35 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for earlier term 34. Current term is 35.
I20260709 12:13:58.196367 23278 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:58.229735 23554 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:58.243605 23672 log.cc:927] Time spent T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.143s	user 0.002s	sys 0.000s
W20260709 12:13:58.222899 23612 consensus_meta.cc:287] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7: Time spent flushing consensus metadata: real 0.676s	user 0.005s	sys 0.008s
I20260709 12:13:58.245679 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:13:58.253129 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:58.209113 23674 raft_consensus.cc:2749] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 31 FOLLOWER]: Leader election lost for term 31. Reason: could not achieve majority
I20260709 12:13:58.199383 23605 raft_consensus.cc:2749] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:13:58.273240 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 50526.8us
I20260709 12:13:58.285320 13833 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 29.
I20260709 12:13:58.285934 14380 leader_election.cc:403] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 34 election: Cancelling election due to peer responding with higher term
I20260709 12:13:58.296262 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:58.303634 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 31 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:13:58.303797 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 73522.2us
I20260709 12:13:58.290728 23522 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:13:58.290076 23677 raft_consensus.cc:2804] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 35 FOLLOWER]: Leader election won for term 35
I20260709 12:13:58.291567 23558 raft_consensus.cc:2749] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:58.306310 23381 raft_consensus.cc:3060] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:13:58.320852 23677 raft_consensus.cc:697] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 35 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:58.329152 23650 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 32 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:58.302155 23612 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 36 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:58.329512 23677 consensus_queue.cc:237] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 33.21, Last appended by leader: 21, Current term: 35, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:58.341468 23666 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:58.343816 23612 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 36 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:58.353914 23673 raft_consensus.cc:2749] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:13:58.261906 13651 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:13:58.386719 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 124822us
I20260709 12:13:58.391752 13651 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:13:58.396741 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 188146us
W20260709 12:13:58.412981 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:58.415524 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 128953us
I20260709 12:13:58.418969 13652 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:58.293622 23278 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:58.439587 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:58.442934 13763 raft_consensus.cc:2368] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 26. Current term is 27.
W20260709 12:13:58.441741 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 50361.5us
W20260709 12:13:58.445650 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:58.429710 13652 leader_election.cc:400] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 27. Current term is 28.
I20260709 12:13:58.490542 13652 leader_election.cc:403] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:58.451226 13836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54830 (request call id 3921) took 1021 ms. Trace:
I20260709 12:13:58.470571 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:58.502070 23580 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:58.503381 23580 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:58.508183 23580 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:58.303666 13800 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:58.510866 23558 raft_consensus.cc:2749] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:58.334786 23556 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:58.513597 23675 raft_consensus.cc:2749] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:58.455077 23359 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 24 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:58.472826 23278 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:58.469254 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
W20260709 12:13:58.443769 13726 leader_election.cc:336] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.542s (SENT)
I20260709 12:13:58.520787 23674 raft_consensus.cc:2749] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 35 FOLLOWER]: Leader pre-election lost for term 36. Reason: could not achieve majority
I20260709 12:13:58.522161 23666 raft_consensus.cc:2749] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:58.494303 13836 rpcz_store.cc:276] 0709 12:13:57.429135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:57.590776 (+161641us) service_pool.cc:224] Handling call
0709 12:13:57.639063 (+ 48287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:57.639611 (+   548us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 12:13:57.661664 (+ 22053us) log.cc:844] Serialized 14 byte log entry
0709 12:13:58.073598 (+411934us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:58.090759 (+ 17161us) log.cc:844] Serialized 26 byte log entry
0709 12:13:58.090988 (+   229us) raft_consensus.cc:1645] Marking committed up to 18
0709 12:13:58.091313 (+   325us) log.cc:844] Serialized 14 byte log entry
0709 12:13:58.101473 (+ 10160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:58.101599 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:58.450570 (+348971us) raft_consensus.cc:1685] finished
0709 12:13:58.450615 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:58.450978 (+   363us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59852,"prepare.queue_time_us":24331,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":84,"raft.queue_time_us":26796,"raft.run_cpu_time_us":531,"raft.run_wall_time_us":65095,"thread_start_us":409764,"threads_started":1,"wal-append.queue_time_us":586409}
I20260709 12:13:58.525741 23554 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:58.531153 23595 consensus_meta.cc:287] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f: Time spent flushing consensus metadata: real 1.013s	user 0.015s	sys 0.000s
I20260709 12:13:58.531947 23595 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:58.521987 23605 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:58.534013 23605 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:58.534603 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 497015us
W20260709 12:13:58.536183 14379 leader_election.cc:336] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 35 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:58.536417 13634 auto_rebalancer.cc:288] Could not retrieve cluster info: Not found: tserver ca9fbbc2c0a94897897d502d42f3951f not available for placement
I20260709 12:13:58.542040 23595 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:58.513640 23650 raft_consensus.cc:2804] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Leader election won for term 30
I20260709 12:13:58.544158 23609 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 28 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:58.536836 23605 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:58.536794 14379 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:13:58.538647 14409 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41692 (request call id 1464) took 1697 ms (client timeout 1547 ms). Trace:
I20260709 12:13:58.521965 13754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48114 (request call id 4087) took 1280 ms. Trace:
W20260709 12:13:58.539062 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 95595.4us
I20260709 12:13:58.550812 14407 raft_consensus.cc:2393] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in current term 27: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:13:58.549132 13754 rpcz_store.cc:276] 0709 12:13:57.241155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:57.241302 (+   147us) service_pool.cc:224] Handling call
0709 12:13:58.521246 (+1279944us) spinlock_profiling.cc:243] Waited 935 ms on lock 0x7b54000898d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:58.521621 (+   375us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2151528704}
W20260709 12:13:58.549042 14409 rpcz_store.cc:269] 0709 12:13:56.841505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:56.841696 (+   191us) service_pool.cc:224] Handling call
0709 12:13:58.538083 (+1696387us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b5400530054. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:58.538341 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2741811072}
I20260709 12:13:58.569650 13651 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:58.571336 23675 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:58.572904 13651 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:58.555459 23674 raft_consensus.cc:3060] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Advancing to term 28
W20260709 12:13:58.580219 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:58.582604 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 36 candidate_status { last_received { term: 35 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:13:58.585985 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 156986us
I20260709 12:13:58.586658 13763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48114 (request call id 4103) took 1250 ms. Trace:
I20260709 12:13:58.587244 13763 rpcz_store.cc:276] 0709 12:13:57.336658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:57.336793 (+   135us) service_pool.cc:224] Handling call
0709 12:13:58.586399 (+1249606us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b540004fe54. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f912fa 00007fa92cf52b17 00007fa9264cd6d4 00007fa9264cd662 00007fa9264cd591 00007fa9264cd50c 00007fa9264cc7c2 00007fa9262c848c 00007fa9262c78c6 00007fa9262c726f
0709 12:13:58.586590 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2539131776}
I20260709 12:13:58.587752 13652 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:13:58.589564 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 53495us
I20260709 12:13:58.590062 23609 raft_consensus.cc:2749] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 34 FOLLOWER]: Leader pre-election lost for term 35. Reason: could not achieve majority
I20260709 12:13:58.575515 23650 raft_consensus.cc:697] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 30 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
W20260709 12:13:58.591871 14379 leader_election.cc:336] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:58.592706 14379 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:58.592206 23650 consensus_queue.cc:237] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 28.20, Last appended by leader: 20, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:58.593488 13762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38932 (request call id 1707) took 1577 ms. Trace:
I20260709 12:13:58.594084 13762 rpcz_store.cc:276] 0709 12:13:57.015953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:57.016073 (+   120us) service_pool.cc:224] Handling call
0709 12:13:57.016551 (+   478us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:58.003304 (+986753us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:58.592679 (+589375us) spinlock_profiling.cc:243] Waited 937 ms on lock 0x7b540035f2d4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef6571 00007fa927f8de01 00007fa927f8c83e 00007fa92cf51419 00007fa9264c8bd4 00007fa9264c8b62 00007fa9264c8a91 00007fa9264c8a0c 00007fa9264c7cc2 00007fa9262c848c 00007fa9262c78c6
0709 12:13:58.593194 (+   515us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2154257280}
W20260709 12:13:58.597872 23663 consensus_meta.cc:287] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.543s	user 0.013s	sys 0.000s
I20260709 12:13:58.598526 23663 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 35 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:58.599552 13651 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:58.600603 23605 raft_consensus.cc:3060] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:58.600678 23278 raft_consensus.cc:2749] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:13:58.601189 23663 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 35 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:13:58.604998 23687 log.cc:927] Time spent T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.102s	user 0.000s	sys 0.003s
I20260709 12:13:58.610002 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:58.611354 13835 raft_consensus.cc:2393] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 24: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:13:58.614181 23278 raft_consensus.cc:2749] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:58.615960 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:58.617697 23278 consensus_queue.cc:1048] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 12:13:58.617738 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 35 candidate_status { last_received { term: 33 index: 21 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:13:58.626578 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:58.631191 13831 raft_consensus.cc:1275] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 26 index: 14. Preceding OpId from leader: term: 28 index: 15. (index mismatch)
W20260709 12:13:58.641930 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 256884us
I20260709 12:13:58.644551 13800 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:58.646057 23443 raft_consensus.cc:2804] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:13:58.646509 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:58.646832 23443 raft_consensus.cc:697] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 28 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:58.647629 13830 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:58.648729 23443 consensus_queue.cc:237] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.17, Last appended by leader: 17, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:58.650913 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:58.585371 23477 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:58.651957 13835 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Advancing to term 27
W20260709 12:13:58.659235 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 59878.9us
W20260709 12:13:58.662786 23682 log.cc:927] Time spent T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.406s	user 0.000s	sys 0.002s
W20260709 12:13:58.662968 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 71222.8us
W20260709 12:13:58.669363 13726 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.740s (SENT) [suppressed 127 similar messages]
I20260709 12:13:58.638031 13652 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:13:58.673585 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 64062us
W20260709 12:13:58.713454 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:58.720175 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:58.717737 13834 raft_consensus.cc:1275] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 26 index: 14. Preceding OpId from leader: term: 28 index: 15. (index mismatch)
I20260709 12:13:58.725549 23690 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:58.727061 23595 consensus_queue.cc:1059] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 25.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:13:58.728194 23595 raft_consensus.cc:3055] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:13:58.728653 23595 raft_consensus.cc:740] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 27 LEADER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:58.736644 23655 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:58.741632 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 36 candidate_status { last_received { term: 34 index: 20 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:58.743952 13835 raft_consensus.cc:2468] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 27.
I20260709 12:13:58.745955 13651 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:58.746337 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:58.747488 13762 raft_consensus.cc:2393] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 29: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
W20260709 12:13:58.747701 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 50739.8us
I20260709 12:13:58.749029 13651 leader_election.cc:400] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 26. Current term is 27.
I20260709 12:13:58.749413 13651 leader_election.cc:403] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:58.750248 23556 raft_consensus.cc:2749] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 12:13:58.750355 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 126189us
I20260709 12:13:58.753216 13727 leader_election.cc:400] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 election: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 28. Current term is 29.
I20260709 12:13:58.756755 13727 leader_election.cc:403] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 election: Cancelling election due to peer responding with higher term
I20260709 12:13:58.757869 14407 raft_consensus.cc:3060] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Advancing to term 29
W20260709 12:13:58.758388 13726 leader_election.cc:336] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 31 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.719s (SENT)
I20260709 12:13:58.766203 13726 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 31 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:58.766499 23605 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 12:13:58.767944 13726 leader_election.cc:336] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.722s (SENT)
I20260709 12:13:58.768313 23624 raft_consensus.cc:2749] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Leader election lost for term 31. Reason: could not achieve majority
I20260709 12:13:58.709622 23666 consensus_queue.cc:1059] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 26.20, Next index: 21, Last known committed idx: 20, Time since last communication: 0.047s
W20260709 12:13:58.773423 23465 consensus_meta.cc:287] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.749s	user 0.016s	sys 0.013s
I20260709 12:13:58.773890 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 34 candidate_status { last_received { term: 33 index: 21 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:58.774966 13762 raft_consensus.cc:2368] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 35 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for earlier term 34. Current term is 35.
I20260709 12:13:58.774405 23465 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:58.776087 13828 raft_consensus.cc:1240] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Rejecting Update request from peer 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 25. Current term is 26. Ops: []
W20260709 12:13:58.772114 23691 log.cc:927] Time spent T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 12:13:58.779856 23465 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:58.780095 23580 consensus_queue.cc:1059] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:13:58.782491 23673 raft_consensus.cc:3055] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:58.783030 23673 raft_consensus.cc:740] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:58.784297 23673 consensus_queue.cc:260] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:58.795616 23556 raft_consensus.cc:3060] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Advancing to term 27
W20260709 12:13:58.798300 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 49596us
I20260709 12:13:58.743396 23663 raft_consensus.cc:2749] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:58.806139 13830 raft_consensus.cc:2468] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 28.
I20260709 12:13:58.758496 23522 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 35 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:58.819551 14407 raft_consensus.cc:1275] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 28 index: 20. Preceding OpId from leader: term: 29 index: 21. (index mismatch)
I20260709 12:13:58.774066 23666 raft_consensus.cc:3055] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:58.828580 13800 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:58.830001 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:58.830554 14416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
W20260709 12:13:58.835114 13726 leader_election.cc:336] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.510s (SENT)
I20260709 12:13:58.835753 13831 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 35 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 35.
W20260709 12:13:58.836979 13726 leader_election.cc:336] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 34 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.758s (SENT)
W20260709 12:13:58.838992 23662 log.cc:927] Time spent T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.744s	user 0.004s	sys 0.000s
I20260709 12:13:58.841379 23580 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:58.842226 23580 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:58.844561 23465 raft_consensus.cc:2749] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:58.845438 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:58.846457 13836 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 27.
I20260709 12:13:58.847373 23675 raft_consensus.cc:2749] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:13:58.848594 23697 log.cc:927] Time spent T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.155s	user 0.004s	sys 0.000s
W20260709 12:13:58.849710 23535 consensus_meta.cc:287] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd: Time spent flushing consensus metadata: real 0.820s	user 0.008s	sys 0.013s
I20260709 12:13:58.850239 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:58.853510 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:58.822276 23278 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:58.858160 23278 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:58.859090 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 121881us
I20260709 12:13:58.859941 23558 consensus_queue.cc:1059] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 26.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 12:13:58.854542 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 36 candidate_status { last_received { term: 34 index: 20 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:58.861651 13760 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 35 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 35.
I20260709 12:13:58.862675 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:58.863170 13759 raft_consensus.cc:1275] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 28 index: 12. Preceding OpId from leader: term: 30 index: 13. (index mismatch)
I20260709 12:13:58.854815 13832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54820 (request call id 4504) took 1821 ms. Trace:
I20260709 12:13:58.863380 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 32 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:58.854862 23522 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 35 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:58.828933 23666 raft_consensus.cc:740] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:58.864380 13754 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:13:58.865552 23278 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:58.866020 14379 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:58.866561 23673 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:13:58.867444 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 61283.4us
I20260709 12:13:58.867599 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:58.868414 14379 leader_election.cc:400] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 34 election: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 35 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for earlier term 34. Current term is 35.
I20260709 12:13:58.868513 13763 raft_consensus.cc:2393] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 27: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:58.860131 13727 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:58.863023 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 35 candidate_status { last_received { term: 34 index: 20 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:58.860270 23416 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:58.844587 23580 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:58.831050 13830 raft_consensus.cc:2393] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 29: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:13:58.870273 13756 raft_consensus.cc:2393] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 35 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 35: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:58.853816 23605 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:58.751569 23595 consensus_queue.cc:260] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 27.19, Last appended by leader: 19, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:58.871294 23605 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:58.857409 13836 raft_consensus.cc:1240] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 27. Current term is 28. Ops: [27.20-27.20]
I20260709 12:13:58.837553 13726 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:58.856148 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:58.878597 13762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:58.865909 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 31 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:58.882603 23690 raft_consensus.cc:2749] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:58.883405 23605 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:58.886175 13831 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 24.
I20260709 12:13:58.887472 23674 raft_consensus.cc:2749] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader pre-election lost for term 27. Reason: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 27. Current term is 28.
I20260709 12:13:58.871977 23120 raft_consensus.cc:2749] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 12:13:58.882683 13833 raft_consensus.cc:2368] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 32 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 31. Current term is 32.
I20260709 12:13:58.890888 23666 consensus_queue.cc:260] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 26.20, Last appended by leader: 20, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:58.875221 23627 consensus_queue.cc:1048] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.018s
W20260709 12:13:58.906737 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 50129.6us
I20260709 12:13:58.904655 14379 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:58.863718 13832 rpcz_store.cc:276] 0709 12:13:57.033338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:57.050480 (+ 17142us) service_pool.cc:224] Handling call
0709 12:13:57.050881 (+   401us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:57.051247 (+   366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:57.051274 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:57.051837 (+   563us) log.cc:844] Serialized 52 byte log entry
0709 12:13:57.795894 (+744057us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:13:57.795959 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:57.796069 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:58.837951 (+1041882us) spinlock_profiling.cc:243] Waited 6.9 ms on lock 0x7b4400022b4c. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924dc6c85 00007fa924dc76a2 00007fa927b391db 00007fa927b34aaf 00007fa927b2886e 00007fa927b27bb6 00007fa927b277d8 00007fa927b31221 00007fa927b311d9 00007fa927b31169
0709 12:13:58.854278 (+ 16327us) raft_consensus.cc:1685] finished
0709 12:13:58.854312 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:58.854608 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":767,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":13537,"spinlock_wait_cycles":15869184,"thread_start_us":647898,"threads_started":1,"wal-append.queue_time_us":915134}
I20260709 12:13:58.915899 13760 raft_consensus.cc:1275] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 35 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 30 index: 20. Preceding OpId from leader: term: 33 index: 21. (index mismatch)
I20260709 12:13:58.918147 23120 raft_consensus.cc:2749] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 34 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
W20260709 12:13:58.926155 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 89250.3us
I20260709 12:13:58.922995 23535 consensus_queue.cc:1048] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 12:13:58.929989 23571 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 35 FOLLOWER]: Leader pre-election won for term 36
I20260709 12:13:58.921846 13652 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:13:58.939929 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:58.943017 23278 raft_consensus.cc:3055] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:13:58.943523 23278 raft_consensus.cc:740] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:58.944644 23278 consensus_queue.cc:260] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 27.20, Last appended by leader: 20, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:58.925065 23489 consensus_meta.cc:287] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835: Time spent flushing consensus metadata: real 0.596s	user 0.000s	sys 0.024s
I20260709 12:13:58.950294 23489 raft_consensus.cc:2749] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:58.937655 23571 raft_consensus.cc:493] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 35 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:58.954250 23571 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 35 FOLLOWER]: Advancing to term 36
I20260709 12:13:58.941075 23595 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Advancing to term 28
W20260709 12:13:58.966668 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:58.970887 14380 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:58.971015 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 35 candidate_status { last_received { term: 34 index: 20 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:58.972505 23570 raft_consensus.cc:2804] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:13:58.973765 23570 raft_consensus.cc:697] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 28 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:58.972587 23381 raft_consensus.cc:2749] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 35 FOLLOWER]: Leader election lost for term 34. Reason: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 35 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for earlier term 34. Current term is 35.
I20260709 12:13:58.976017 14414 raft_consensus.cc:2468] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 35 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 35.
I20260709 12:13:58.976812 23570 consensus_queue.cc:237] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 26.19, Last appended by leader: 19, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:58.982225 23666 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:58.982232 23278 raft_consensus.cc:3060] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:58.985183 23535 consensus_queue.cc:1048] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.001s
I20260709 12:13:58.985805 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:58.987489 13801 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:58.988480 23535 raft_consensus.cc:2749] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:13:58.993353 13754 raft_consensus.cc:2468] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 32.
I20260709 12:13:58.993947 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:13:58.994156 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 72432.6us
W20260709 12:13:58.994817 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 57318us
I20260709 12:13:58.989235 23571 raft_consensus.cc:515] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 36 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:59.001454 13727 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
W20260709 12:13:59.004670 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 90620.6us
I20260709 12:13:58.998324 23489 raft_consensus.cc:2804] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:59.014137 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:58.996623 23556 raft_consensus.cc:2749] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader pre-election lost for term 26. Reason: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 26. Current term is 27.
I20260709 12:13:59.002291 23394 consensus_queue.cc:1048] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.008s
I20260709 12:13:59.014334 23489 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:59.017889 14411 raft_consensus.cc:2368] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 36 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 35. Current term is 36.
I20260709 12:13:59.017836 23489 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:59.024092 23421 consensus_queue.cc:1059] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: INVALID_TERM, Last received: 25.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:13:59.030747 13652 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:13:59.031405 13726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:59.032387 23703 raft_consensus.cc:2804] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:59.032954 23703 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:59.033391 23703 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:59.041563 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:59.044567 13652 leader_election.cc:400] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 31 pre-election: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 32 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 31. Current term is 32.
I20260709 12:13:59.044965 13652 leader_election.cc:403] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 31 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:59.014694 23175 raft_consensus.cc:2804] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:59.051520 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:59.052203 14412 raft_consensus.cc:1275] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 30 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 28 index: 20. Preceding OpId from leader: term: 30 index: 21. (index mismatch)
I20260709 12:13:59.055647 14407 raft_consensus.cc:2393] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 29: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:13:59.060233 23416 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Leader election lost for term 28. Reason: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f37c9cc9dda46b4be21dd675ba78fb7 for earlier term 28. Current term is 29.
I20260709 12:13:59.067063 23629 raft_consensus.cc:3055] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:13:59.073843 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 31 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:59.076711 23175 raft_consensus.cc:697] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:59.067615 23629 raft_consensus.cc:740] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:59.084652 14414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 35 candidate_status { last_received { term: 33 index: 21 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:59.091317 13801 leader_election.cc:400] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 35 election: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 36 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 35. Current term is 36.
I20260709 12:13:59.091908 13801 leader_election.cc:403] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 35 election: Cancelling election due to peer responding with higher term
W20260709 12:13:59.095739 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:59.096697 23629 consensus_queue.cc:260] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:59.098621 23629 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:59.101914 14414 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 34 FOLLOWER]: Advancing to term 35
I20260709 12:13:59.101886 23120 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.103597 23120 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:59.104307 23175 consensus_queue.cc:237] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.14, Last appended by leader: 14, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:59.108286 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 30 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:59.084653 23677 consensus_queue.cc:1048] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.024s
I20260709 12:13:59.109910 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:59.111429 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:13:59.111624 13726 leader_election.cc:336] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.578s (SENT)
I20260709 12:13:59.112155 13726 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:59.113044 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:13:59.114259 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:59.114323 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:59.069718 23673 raft_consensus.cc:3060] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Advancing to term 32
I20260709 12:13:59.056835 23703 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:59.133750 13756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 35 candidate_status { last_received { term: 33 index: 21 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:59.113749 23381 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.136749 13652 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:59.137995 13762 raft_consensus.cc:2468] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 29.
I20260709 12:13:59.139219 13652 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:13:59.135550 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 44477.9us
I20260709 12:13:59.122243 23556 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:13:59.122948 23675 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:13:59.124019 23421 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:59.128729 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:59.117230 23320 consensus_queue.cc:1048] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 20, Time since last communication: 0.001s
I20260709 12:13:59.129701 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:59.110028 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:59.132755 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:59.113194 13800 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 32 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:59.121646 13758 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 27.
I20260709 12:13:59.145905 14414 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 35 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 35.
I20260709 12:13:59.150949 23571 leader_election.cc:290] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 36 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:59.151476 14407 raft_consensus.cc:1275] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 35 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 33 index: 21. Preceding OpId from leader: term: 35 index: 22. (index mismatch)
I20260709 12:13:59.154551 13756 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 34 FOLLOWER]: Advancing to term 35
W20260709 12:13:59.167102 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 55517.5us
I20260709 12:13:59.169376 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 31 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:13:59.183959 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 70862.4us
I20260709 12:13:59.192154 13759 raft_consensus.cc:2368] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 32 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 31. Current term is 32.
W20260709 12:13:59.188593 14379 leader_election.cc:336] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:59.158215 23558 raft_consensus.cc:2749] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:59.197907 13761 raft_consensus.cc:1240] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 36 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 35. Current term is 36. Ops: []
I20260709 12:13:59.197856 13755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:59.212142 13758 raft_consensus.cc:1240] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Rejecting Update request from peer b98d2519bb504dc6905ed2ede4571835 for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:59.208359 23489 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:59.189226 23663 raft_consensus.cc:3060] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Advancing to term 29
W20260709 12:13:59.216630 13653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:59.217810 12515 thread.cc:527] Waited for 1000ms trying to join with heartbeat (tid 13713)
W20260709 12:13:59.217610 13726 leader_election.cc:336] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.805s (SENT)
I20260709 12:13:59.220439 23120 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:59.224042 23623 raft_consensus.cc:2804] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 32 FOLLOWER]: Leader election won for term 32
I20260709 12:13:59.224936 23623 raft_consensus.cc:697] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 32 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:13:59.194204 23675 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:59.227603 23675 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:59.209251 23674 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.233301 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:59.234355 13836 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:59.190603 23381 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:13:59.219774 14379 leader_election.cc:336] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:59.196080 23556 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:59.237442 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:59.215260 23703 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:59.237134 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 36 candidate_status { last_received { term: 34 index: 20 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:13:59.239773 13830 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:59.243389 23678 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 35 FOLLOWER]: Advancing to term 36
I20260709 12:13:59.244971 23556 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:59.251044 23673 raft_consensus.cc:2749] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 32 FOLLOWER]: Leader pre-election lost for term 31. Reason: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 32 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 31. Current term is 32.
W20260709 12:13:59.251173 13726 leader_election.cc:336] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:59.252245 23623 consensus_queue.cc:237] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 30.17, Last appended by leader: 17, Current term: 32, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:59.253805 13726 leader_election.cc:336] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 31 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:59.256314 14379 leader_election.cc:336] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:59.256873 14379 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
W20260709 12:13:59.255913 13726 leader_election.cc:336] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:59.240342 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:59.266067 13756 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 35 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 35.
I20260709 12:13:59.211885 23443 consensus_queue.cc:1048] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.026s
I20260709 12:13:59.234928 23489 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:13:59.278416 13726 leader_election.cc:336] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:59.279858 13726 leader_election.cc:336] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:59.281296 13726 leader_election.cc:336] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:59.282099 13726 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:59.283215 23547 raft_consensus.cc:2749] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:59.286931 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:59.287773 14415 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 26.
I20260709 12:13:59.292789 23663 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 12:13:59.308245 13726 leader_election.cc:336] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:59.308755 23713 log.cc:927] Time spent T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.111s	user 0.001s	sys 0.001s
W20260709 12:13:59.310220 13726 leader_election.cc:336] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:59.311730 23673 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.312623 23673 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:59.316309 23489 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 31 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:59.317301 23489 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:59.323966 13830 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 28.
I20260709 12:13:59.338167 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
W20260709 12:13:59.339126 13726 leader_election.cc:336] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:59.270411 23674 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:59.327780 23489 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:59.354732 13651 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:59.356554 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:59.357182 13754 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:59.363404 23674 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:13:59.368193 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 111902us
W20260709 12:13:59.369089 14379 leader_election.cc:336] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:59.369601 14379 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:59.370640 23595 raft_consensus.cc:2749] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:13:59.371033 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 32 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:59.371374 23595 raft_consensus.cc:2749] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:13:59.356328 23381 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:59.378293 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31cd7111f2470d8d34b5898dce5765" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 36 candidate_status { last_received { term: 34 index: 20 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:13:59.378371 13652 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 35 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:59.379256 13759 raft_consensus.cc:3060] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 35 FOLLOWER]: Advancing to term 36
I20260709 12:13:59.379751 13652 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:59.381067 13727 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:59.382795 23673 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:59.382980 23416 raft_consensus.cc:2804] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:59.383582 23416 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:59.384014 23416 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:59.389824 23558 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 35 FOLLOWER]: Leader election won for term 35
I20260709 12:13:59.390604 23558 raft_consensus.cc:697] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 35 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:59.391759 23558 consensus_queue.cc:237] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 33.21, Last appended by leader: 21, Current term: 35, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:59.392360 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 32 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:59.394008 23580 raft_consensus.cc:2749] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:59.397610 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:59.398450 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:59.399372 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 30 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:59.400990 13761 raft_consensus.cc:1275] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 28 index: 18. (index mismatch)
I20260709 12:13:59.401544 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:59.403586 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:13:59.403853 13801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:59.392151 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 61956.7us
I20260709 12:13:59.410815 23674 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.411514 23674 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:59.398185 13800 leader_election.cc:336] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.764s (SENT)
W20260709 12:13:59.415535 13726 leader_election.cc:336] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:59.437834 13726 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:59.425557 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 30 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:13:59.415503 13800 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:59.421048 13652 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 
W20260709 12:13:59.447006 13803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:59.451485 13759 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 36 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 36.
I20260709 12:13:59.430649 14379 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:59.455861 13754 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 28.
I20260709 12:13:59.461737 13836 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 25.
I20260709 12:13:59.422874 23623 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:59.467654 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 69554.7us
I20260709 12:13:59.464059 23666 raft_consensus.cc:2804] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:13:59.474292 23666 raft_consensus.cc:697] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 28 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:59.475405 23416 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:59.475533 23666 consensus_queue.cc:237] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.14, Last appended by leader: 14, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:59.476992 13758 raft_consensus.cc:2393] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 27: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
W20260709 12:13:59.473596 13800 leader_election.cc:336] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Timed out: RequestConsensusVote RPC to 127.12.56.193:33199 timed out after 1.797s (SENT)
I20260709 12:13:59.477942 23673 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.478396 13800 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:59.478636 23673 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:59.479056 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 48640.9us
I20260709 12:13:59.481011 23673 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:59.481050 23465 raft_consensus.cc:2749] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:59.481618 23595 raft_consensus.cc:2804] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:13:59.490922 23595 raft_consensus.cc:697] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 29 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:59.492115 23595 consensus_queue.cc:237] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 27.17, Last appended by leader: 17, Current term: 29, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:59.482285 23489 raft_consensus.cc:2749] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:59.457712 23120 raft_consensus.cc:2749] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
W20260709 12:13:59.484436 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 132307us
I20260709 12:13:59.486408 23443 consensus_queue.cc:1048] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:59.460187 23535 raft_consensus.cc:2749] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:13:59.478431 23674 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:59.489866 23623 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:59.499393 13651 leader_election.cc:304] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:13:59.514092 13800 leader_election.cc:336] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:59.515493 13800 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:13:59.517735 13800 leader_election.cc:336] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:59.518738 23465 raft_consensus.cc:2749] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:13:59.525029 23623 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:13:59.529022 13651 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:59.530584 13651 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:13:59.530887 13800 leader_election.cc:336] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:59.531137 23674 raft_consensus.cc:2749] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:13:59.531699 23673 raft_consensus.cc:2749] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 12:13:59.531725 23558 raft_consensus.cc:2749] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:13:59.532173 13651 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:59.538856 23673 raft_consensus.cc:2749] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:13:59.541529 13651 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:59.536541 13800 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:59.546272 23465 raft_consensus.cc:2749] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:13:59.547317 23673 raft_consensus.cc:2749] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:59.549906 13651 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:59.551256 23673 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:59.553049 13651 leader_election.cc:400] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 31 pre-election: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 32 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 for earlier term 31. Current term is 32.
I20260709 12:13:59.554692 23673 consensus_queue.cc:1059] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: INVALID_TERM, Last received: 35.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:13:59.556556 23558 raft_consensus.cc:3055] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 35 LEADER]: Stepping down as leader of term 35
I20260709 12:13:59.557044 23558 raft_consensus.cc:740] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 35 LEADER]: Becoming Follower/Learner. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:13:59.558696 23558 consensus_queue.cc:260] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 35.18, Last appended by leader: 18, Current term: 35, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:59.561214 23558 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 35 FOLLOWER]: Advancing to term 36
W20260709 12:13:59.566150 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 154955us
W20260709 12:13:59.567209 13726 leader_election.cc:336] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:59.568418 13726 leader_election.cc:336] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:59.569176 13651 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:13:59.570324 23715 log.cc:927] Time spent T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
W20260709 12:13:59.575471 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 63232.8us
W20260709 12:13:59.570757 13800 consensus_peers.cc:597] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:59.574087 23416 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:59.568851 13726 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:59.581306 14379 leader_election.cc:304] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 36 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:59.579818 23678 raft_consensus.cc:2749] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 36 FOLLOWER]: Leader election lost for term 35. Reason: Vote denied by peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341) with higher term. Message: Invalid argument: T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 36 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 35. Current term is 36.
I20260709 12:13:59.577316 23674 raft_consensus.cc:2749] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:59.587072 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 31 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:59.589155 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 32 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:59.590906 13754 raft_consensus.cc:2393] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 32 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 32: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:13:59.591152 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:59.585014 23609 raft_consensus.cc:2804] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 36 FOLLOWER]: Leader election won for term 36
I20260709 12:13:59.599165 23609 raft_consensus.cc:697] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 36 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:13:59.600617 23609 consensus_queue.cc:237] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 34.20, Last appended by leader: 20, Current term: 36, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:59.585976 23629 raft_consensus.cc:2749] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
W20260709 12:13:59.591907 14379 leader_election.cc:336] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:59.605195 13727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:59.603554 14379 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:59.607057 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:13:59.607753 14410 raft_consensus.cc:3060] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:59.614389 13832 raft_consensus.cc:1275] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 26 index: 19. Preceding OpId from leader: term: 28 index: 20. (index mismatch)
I20260709 12:13:59.592784 23421 raft_consensus.cc:2749] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:59.625562 13829 raft_consensus.cc:2468] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 36 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 36.
I20260709 12:13:59.629925 23690 consensus_queue.cc:1048] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.002s
W20260709 12:13:59.641215 13800 leader_election.cc:336] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:59.641829 13800 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:59.642704 23535 raft_consensus.cc:2749] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
W20260709 12:13:59.644872 13800 leader_election.cc:336] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:59.646298 13800 leader_election.cc:336] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:59.646860 13800 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:59.648095 13763 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 24.
I20260709 12:13:59.655937 13652 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:59.659017 13577 catalog_manager.cc:5697] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 8 to 24, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 24 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
W20260709 12:13:59.660589 13634 auto_rebalancer.cc:288] Could not retrieve cluster info: Not found: tserver ca9fbbc2c0a94897897d502d42f3951f not available for placement
I20260709 12:13:59.661454 23674 raft_consensus.cc:2749] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:13:59.663002 23720 log.cc:927] Time spent T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.083s	user 0.002s	sys 0.000s
I20260709 12:13:59.678148 13577 catalog_manager.cc:5697] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
W20260709 12:13:59.678156 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 109779us
W20260709 12:13:59.690935 13726 leader_election.cc:336] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:59.692709 13726 consensus_peers.cc:597] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:59.693584 13726 consensus_peers.cc:597] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:59.693288 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 47077.4us
W20260709 12:13:59.694468 13726 consensus_peers.cc:597] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:59.694913 13800 leader_election.cc:336] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 36 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:59.696487 13800 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:59.695689 14410 raft_consensus.cc:2468] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 27.
W20260709 12:13:59.700716 13726 consensus_peers.cc:597] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:59.703378 14379 consensus_peers.cc:597] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:59.701253 13727 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:13:59.695853 23678 raft_consensus.cc:2749] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:13:59.700063 23381 raft_consensus.cc:2749] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:59.712231 23175 raft_consensus.cc:2804] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:59.712841 23175 raft_consensus.cc:697] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:13:59.713765 23175 consensus_queue.cc:237] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.19, Last appended by leader: 19, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:59.729449 23678 raft_consensus.cc:2749] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 35 FOLLOWER]: Leader pre-election lost for term 36. Reason: could not achieve majority
W20260709 12:13:59.723091 13726 consensus_peers.cc:597] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:59.737098 13726 consensus_peers.cc:597] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:59.755241 13577 catalog_manager.cc:5697] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 20 to 22, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 22 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
W20260709 12:13:59.778255 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 83410.4us
W20260709 12:13:59.779510 13800 leader_election.cc:336] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 36 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:59.780192 13800 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:59.781286 23678 raft_consensus.cc:2749] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 35 FOLLOWER]: Leader pre-election lost for term 36. Reason: could not achieve majority
W20260709 12:13:59.783244 13800 leader_election.cc:336] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:59.790069 13726 consensus_peers.cc:597] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:59.791877 13726 consensus_peers.cc:597] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:59.792856 13726 consensus_peers.cc:597] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:59.793745 13726 consensus_peers.cc:597] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:59.794675 13726 consensus_peers.cc:597] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:59.797402 13577 catalog_manager.cc:5697] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 15 to 25. New cstate: current_term: 25 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:59.806088 13800 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:59.807204 23678 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Advancing to term 31
W20260709 12:13:59.809005 13800 leader_election.cc:336] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:59.810325 13726 consensus_peers.cc:597] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:59.812372 13800 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:59.811015 13577 catalog_manager.cc:5697] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 17 to 20, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 20 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
W20260709 12:13:59.812520 13726 consensus_peers.cc:597] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:59.827175 13726 consensus_peers.cc:597] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:59.827914 13726 leader_election.cc:336] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:59.829097 13726 leader_election.cc:336] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:59.829427 23558 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.830569 23558 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:13:59.840278 23678 raft_consensus.cc:2749] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 31 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:13:59.840729 23558 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:13:59.829533 13726 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:59.846953 23175 raft_consensus.cc:2749] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:59.843253 23443 raft_consensus.cc:2749] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:13:59.850647 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:13:59.856701 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 47775.2us
W20260709 12:13:59.857599 13800 leader_election.cc:336] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:59.858045 13800 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:59.858906 23465 raft_consensus.cc:2749] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:13:59.859565 13800 leader_election.cc:336] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:59.877236 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 48209.1us
W20260709 12:13:59.885365 13800 leader_election.cc:336] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 30 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:59.886853 13800 leader_election.cc:336] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:59.888207 13800 leader_election.cc:336] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:59.891813 13652 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:13:59.893321 13652 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:59.893554 13760 raft_consensus.cc:1275] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 28 index: 20. Preceding OpId from leader: term: 30 index: 21. (index mismatch)
I20260709 12:13:59.895154 23558 raft_consensus.cc:2749] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:13:59.896052 23558 raft_consensus.cc:2749] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:59.898161 13652 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:59.898249 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 29 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:59.899870 23674 raft_consensus.cc:2749] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:13:59.900336 13763 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 28.
I20260709 12:13:59.900978 23674 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:59.901659 23674 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:59.904285 23674 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:59.906183 13652 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:13:59.908073 23674 raft_consensus.cc:2804] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader election won for term 25
W20260709 12:13:59.910746 13578 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45610 (request call id 262) took 17675 ms (client timeout 15000 ms). Trace:
I20260709 12:13:59.911813 23674 raft_consensus.cc:697] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 25 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
W20260709 12:13:59.913079 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:59.914693 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 31 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:13:59.916894 14379 consensus_peers.cc:597] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:59.918546 23674 consensus_queue.cc:237] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.11, Last appended by leader: 11, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:13:59.926608 13726 consensus_peers.cc:597] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:59.928972 13726 leader_election.cc:336] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:59.930464 13726 leader_election.cc:336] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:59.931789 13726 consensus_peers.cc:597] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:59.932848 13726 consensus_peers.cc:597] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:59.939682 13760 raft_consensus.cc:1275] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 27 index: 17. Preceding OpId from leader: term: 29 index: 18. (index mismatch)
W20260709 12:13:59.911218 13578 rpcz_store.cc:269] 0709 12:13:42.235573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:48.927650 (+6692077us) service_pool.cc:224] Handling call
0709 12:13:49.898274 (+970624us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x7b5400373cd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef7090 00007fa927f95f3a 00007fa92dd4be9c 00007fa92de4a04e 00007fa92c30b2a4 00007fa92c30b232 00007fa92c30b161 00007fa92c30b0dc 00007fa92c30a392 00007fa9262c848c 00007fa9262c78c6
0709 12:13:59.910429 (+10012155us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:56.380277 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:56.380908 (+   631us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:56.380949 (+    41us) write_op.cc:435] Acquired schema lock
0709 12:13:56.380970 (+    21us) tablet.cc:662] Decoding operations
0709 12:13:56.384147 (+  3177us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:56.384217 (+    70us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:56.384250 (+    33us) tablet.cc:685] Acquiring locks for 35 operations
0709 12:13:56.708744 (+324494us) tablet.cc:701] Row locks acquired
0709 12:13:56.711116 (+  2372us) write_op.cc:260] PREPARE: finished
0709 12:13:56.769477 (+ 58361us) write_op.cc:270] Start()
0709 12:13:56.776013 (+  6536us) write_op.cc:276] Timestamp: P: 1783599236765213 usec, L: 0
0709 12:13:56.783497 (+  7484us) op_driver.cc:348] REPLICATION: starting
0709 12:13:56.933743 (+150246us) log.cc:844] Serialized 13660 byte log entry
0709 12:13:57.838252 (+904509us) op_driver.cc:464] REPLICATION: finished
0709 12:13:58.179678 (+341426us) write_op.cc:301] APPLY: starting
0709 12:13:58.179769 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:58.352620 (+172851us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:58.352730 (+   110us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:59.074026 (+721296us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:59.074519 (+   493us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=70,key_file_lookups=70,delta_file_lookups=0,mrs_lookups=0
0709 12:13:59.074595 (+    76us) write_op.cc:312] APPLY: finished
0709 12:13:59.075318 (+   723us) log.cc:844] Serialized 300 byte log entry
0709 12:13:59.198431 (+123113us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:59.226524 (+ 28093us) write_op.cc:454] Released schema lock
0709 12:13:59.226626 (+   102us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:59.227282 (+   656us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:59.227320 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2454586,"reported_tablets":50,"spinlock_wait_cycles":503762304,"child_traces":[["op",{"apply.queue_time_us":341054,"apply.run_cpu_time_us":80933,"apply.run_wall_time_us":1047583,"cfile_cache_hit":142,"cfile_cache_hit_bytes":150427,"num_ops":35,"prepare.queue_time_us":594924,"prepare.run_cpu_time_us":35327,"prepare.run_wall_time_us":855733,"raft.queue_time_us":484693,"raft.run_cpu_time_us":30133,"raft.run_wall_time_us":282831,"replication_time_us":1008614,"thread_start_us":1396285,"threads_started":5,"wal-append.queue_time_us":553963,"wal-append.run_cpu_time_us":29458,"wal-append.run_wall_time_us":1364089}]]}
I20260709 12:13:59.943431 23381 consensus_queue.cc:1048] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 12:13:59.953953 13726 leader_election.cc:336] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:59.955523 13757 raft_consensus.cc:1275] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 32 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 30 index: 17. Preceding OpId from leader: term: 32 index: 18. (index mismatch)
W20260709 12:13:59.956235 13726 leader_election.cc:336] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:59.956781 13726 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:13:59.957716 23175 raft_consensus.cc:2749] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:59.964740 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 32 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:13:59.964892 13726 leader_election.cc:336] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:59.965555 13726 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:59.965601 13830 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 31.
I20260709 12:13:59.966694 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 31 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:59.966943 23175 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:13:59.968564 13726 leader_election.cc:336] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:59.968853 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:13:59.969833 13726 leader_election.cc:336] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:59.970058 14379 consensus_peers.cc:597] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:59.970396 13726 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
W20260709 12:13:59.971004 14379 consensus_peers.cc:597] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:59.971231 23175 raft_consensus.cc:2749] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
W20260709 12:13:59.971793 14379 consensus_peers.cc:597] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:59.972625 13726 leader_election.cc:336] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:59.974040 13726 leader_election.cc:336] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:13:59.974255 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:59.974563 13726 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:13:59.975596 23558 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:13:59.976233 23558 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:59.982301 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 31 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:13:59.985287 13832 raft_consensus.cc:1275] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 26 index: 14. Preceding OpId from leader: term: 28 index: 15. (index mismatch)
I20260709 12:13:59.985616 13830 raft_consensus.cc:1275] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 27 index: 17. Preceding OpId from leader: term: 29 index: 18. (index mismatch)
I20260709 12:13:59.988346 13800 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:13:59.992422 23320 raft_consensus.cc:2804] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:59.994122 23673 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.998050 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:13:59.997056 23623 consensus_queue.cc:1048] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 15, Time since last communication: 0.002s
I20260709 12:13:59.993170 23320 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:59.999778 23673 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:13:59.991344 23535 consensus_queue.cc:1048] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.015s
I20260709 12:14:00.001921 23320 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:14:00.015288 23558 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:14:00.019274 23673 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:13:59.991611 23595 consensus_queue.cc:1048] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 15, Time since last communication: 0.031s
I20260709 12:14:00.022349 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 31 candidate_status { last_received { term: 28 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:14:00.023423 13763 raft_consensus.cc:1275] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 35 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 33 index: 21. Preceding OpId from leader: term: 35 index: 22. (index mismatch)
I20260709 12:14:00.029052 23558 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:14:00.028856 23666 consensus_queue.cc:1048] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.001s
I20260709 12:14:00.031147 14407 raft_consensus.cc:1275] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 35 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 32 index: 20. Preceding OpId from leader: term: 35 index: 22. (index mismatch)
I20260709 12:14:00.031692 23558 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:00.034299 23558 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:14:00.034999 23666 consensus_queue.cc:1048] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 20, Time since last communication: 0.001s
I20260709 12:14:00.036124 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:14:00.042971 23673 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:00.071581 23464 raft_consensus.cc:2749] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:00.084656 23678 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:14:00.085372 23678 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:00.089000 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:14:00.089891 14407 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 28.
W20260709 12:14:00.090027 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 116012us
W20260709 12:14:00.090837 13726 leader_election.cc:336] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 36 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:00.091370 13801 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:14:00.073657 23674 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:14:00.090298 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 97415.1us
I20260709 12:14:00.073937 23673 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:00.090358 23678 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:14:00.094128 23535 raft_consensus.cc:2804] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader pre-election won for term 28
W20260709 12:14:00.127436 13726 leader_election.cc:336] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:00.111979 23666 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:14:00.143174 13800 leader_election.cc:336] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:00.123652 23535 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting leader election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:14:00.149189 13800 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:00.125684 23558 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:00.104261 23674 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:00.139611 23666 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:00.156585 23674 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:14:00.162086 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:14:00.166811 13754 raft_consensus.cc:2393] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 28: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:14:00.156770 23666 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:14:00.174548 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:14:00.176496 23666 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 35 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:00.177310 23666 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 35 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:14:00.178328 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 50920.7us
I20260709 12:14:00.179221 23738 raft_consensus.cc:2749] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:14:00.182569 13763 raft_consensus.cc:1275] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 26 index: 14. Preceding OpId from leader: term: 28 index: 15. (index mismatch)
I20260709 12:14:00.153959 23535 raft_consensus.cc:3060] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:14:00.169761 23558 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:00.161689 23320 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:00.197242 23320 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:14:00.201279 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 30 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:14:00.203047 13754 raft_consensus.cc:1275] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 36 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 34 index: 20. Preceding OpId from leader: term: 36 index: 21. (index mismatch)
I20260709 12:14:00.203619 23673 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:14:00.218291 12515 thread.cc:527] Waited for 2000ms trying to join with heartbeat (tid 13713)
W20260709 12:14:00.221045 14379 consensus_peers.cc:597] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:00.222081 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 82038.1us
I20260709 12:14:00.224736 13652 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
W20260709 12:14:00.225997 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 82839.8us
W20260709 12:14:00.226871 13800 leader_election.cc:336] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:00.226764 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 30 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:14:00.227480 13800 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:14:00.228303 23735 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:14:00.228478 23690 consensus_queue.cc:1048] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.001s
I20260709 12:14:00.229025 23735 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:00.230888 23320 raft_consensus.cc:2749] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:14:00.227528 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:14:00.231714 23735 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:14:00.232210 14409 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 24.
W20260709 12:14:00.228988 13800 leader_election.cc:336] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:00.233188 13800 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:14:00.234032 13652 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:14:00.238487 13652 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:14:00.245030 13800 leader_election.cc:336] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:00.241186 23320 raft_consensus.cc:2749] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:14:00.268438 23741 raft_consensus.cc:2804] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:14:00.269083 23741 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 31 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:00.269524 23741 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:00.273929 23558 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:14:00.274695 23558 raft_consensus.cc:2749] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:14:00.275461 23558 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:00.275981 23558 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:00.279821 23674 raft_consensus.cc:2749] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:14:00.281718 23666 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:14:00.293668 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 48663.9us
W20260709 12:14:00.295727 13800 leader_election.cc:336] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:00.296471 13800 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:14:00.290381 14379 consensus_peers.cc:597] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:00.331208 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 159953us
W20260709 12:14:00.333899 13654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:00.287914 23655 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:00.339107 13836 raft_consensus.cc:1275] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 36 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 34 index: 20. Preceding OpId from leader: term: 36 index: 21. (index mismatch)
W20260709 12:14:00.346783 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 108428us
I20260709 12:14:00.319831 23623 raft_consensus.cc:2749] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
W20260709 12:14:00.357930 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 62277.3us
W20260709 12:14:00.358817 13800 leader_election.cc:336] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:00.359398 13800 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:00.361449 13830 raft_consensus.cc:1275] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
I20260709 12:14:00.362648 13652 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:14:00.341820 23674 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:14:00.367985 23743 raft_consensus.cc:2749] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:14:00.368505 13652 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:14:00.369403 23743 raft_consensus.cc:2749] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:14:00.370476 23743 consensus_queue.cc:1048] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:14:00.372054 13652 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:14:00.373754 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:14:00.374050 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:14:00.379864 23535 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:00.344383 23655 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:00.382757 23381 consensus_queue.cc:1048] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.016s
I20260709 12:14:00.384865 23753 raft_consensus.cc:2804] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:14:00.385025 23674 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:00.387437 23674 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:14:00.385576 23753 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:00.387537 13651 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:14:00.388170 23753 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:14:00.388106 23674 consensus_queue.cc:1048] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:14:00.366928 23558 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:14:00.389720 13726 consensus_peers.cc:597] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:00.392233 13726 consensus_peers.cc:597] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:00.392892 13726 consensus_peers.cc:597] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:00.393528 13726 leader_election.cc:336] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 32 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:00.394047 13726 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 32 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:00.390806 23558 raft_consensus.cc:2749] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:14:00.396569 13829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:00.384851 23655 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:14:00.397585 13829 raft_consensus.cc:2393] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f in current term 26: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
W20260709 12:14:00.405901 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 47154.2us
I20260709 12:14:00.410324 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
W20260709 12:14:00.407186 13800 leader_election.cc:336] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 34 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:00.441360 13800 leader_election.cc:304] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:00.409343 23535 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:14:00.411649 23753 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:14:00.412628 13726 leader_election.cc:336] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:00.447211 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:14:00.449100 13726 leader_election.cc:336] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:00.450419 23465 raft_consensus.cc:2749] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 33 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
I20260709 12:14:00.413156 23416 raft_consensus.cc:2749] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 32 FOLLOWER]: Leader election lost for term 32. Reason: could not achieve majority
I20260709 12:14:00.406476 23464 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:00.451809 23464 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:00.415409 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 32 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:14:00.453908 23741 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 32 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:00.418352 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:14:00.456360 23464 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:14:00.423339 23745 log.cc:927] Time spent T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 12:14:00.424072 23739 log.cc:927] Time spent T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260709 12:14:00.421475 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 36 candidate_status { last_received { term: 35 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:14:00.427923 14412 raft_consensus.cc:1275] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 27 index: 20. (index mismatch)
I20260709 12:14:00.429867 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:14:00.462993 13726 leader_election.cc:336] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:00.430495 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:14:00.463588 13726 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:14:00.432382 23623 raft_consensus.cc:2749] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:14:00.467684 13651 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:14:00.468209 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:14:00.468832 23753 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:14:00.468941 13759 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 26.
I20260709 12:14:00.469336 13651 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:14:00.470001 23464 raft_consensus.cc:2749] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:14:00.470517 23735 raft_consensus.cc:2749] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:14:00.471269 13726 leader_election.cc:336] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 36 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:00.471702 13726 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 36 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:00.472019 13651 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:14:00.473289 23735 raft_consensus.cc:2749] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:14:00.475677 14410 raft_consensus.cc:2468] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 28.
I20260709 12:14:00.469637 23753 raft_consensus.cc:2749] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:00.477027 13758 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:14:00.478011 23464 raft_consensus.cc:2749] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 36 FOLLOWER]: Leader election lost for term 36. Reason: could not achieve majority
W20260709 12:14:00.479103 13726 consensus_peers.cc:597] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:00.481845 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 74675.2us
I20260709 12:14:00.484066 13801 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:14:00.490839 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:00.498346 13828 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 26.
W20260709 12:14:00.499675 13800 leader_election.cc:336] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 32 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:00.492527 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:14:00.506242 14412 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 25.
I20260709 12:14:00.511080 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:14:00.511809 14410 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:14:00.494550 13726 consensus_peers.cc:597] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:00.513533 13800 consensus_peers.cc:597] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:00.523525 13726 leader_election.cc:336] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:00.517424 13800 consensus_peers.cc:597] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:00.535712 13726 leader_election.cc:336] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:00.536937 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 31 candidate_status { last_received { term: 28 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:00.541468 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:00.551417 14410 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 25.
I20260709 12:14:00.519333 23623 raft_consensus.cc:2804] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:14:00.519239 23753 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:00.563836 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:14:00.569172 13726 leader_election.cc:336] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:00.563341 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:14:00.571589 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 73873.2us
I20260709 12:14:00.540390 23735 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:00.573372 14379 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd
I20260709 12:14:00.573050 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:00.576709 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 32 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:00.575361 13727 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:14:00.575675 13834 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 24.
I20260709 12:14:00.578877 23735 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:00.570562 23753 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:00.584110 23753 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:14:00.588119 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:14:00.588303 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 34 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:14:00.588768 13759 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 27.
I20260709 12:14:00.589881 13651 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:14:00.537847 23416 consensus_queue.cc:1048] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 18, Time since last communication: 0.038s
I20260709 12:14:00.540961 23464 consensus_queue.cc:1048] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 12:14:00.598049 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 36 candidate_status { last_received { term: 35 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:00.574292 23623 raft_consensus.cc:697] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 28 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:14:00.586766 23735 leader_election.cc:290] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:14:00.609884 23381 raft_consensus.cc:2804] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:14:00.610452 23381 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:00.610888 23381 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:14:00.596958 23743 raft_consensus.cc:2804] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:14:00.594017 23421 raft_consensus.cc:2804] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:14:00.617753 23421 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:00.618351 23421 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Advancing to term 27
W20260709 12:14:00.627430 13726 consensus_peers.cc:597] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:00.616991 23743 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:00.628123 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 57386.8us
I20260709 12:14:00.628585 23743 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:14:00.635991 23623 consensus_queue.cc:237] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 27.19, Last appended by leader: 19, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:00.668047 13758 raft_consensus.cc:1275] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 23 index: 11. Preceding OpId from leader: term: 25 index: 12. (index mismatch)
W20260709 12:14:00.668313 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 95776.8us
I20260709 12:14:00.678404 13652 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:14:00.710420 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:14:00.711159 13834 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:14:00.716966 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 32 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:14:00.718741 13763 raft_consensus.cc:2393] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 32 FOLLOWER]: Leader election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 32: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:14:00.725204 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:14:00.676383 23735 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:00.725116 14379 consensus_peers.cc:597] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:00.716271 23752 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:00.733050 23381 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:00.715494 23674 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 36 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:00.742920 23421 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:00.745895 13833 raft_consensus.cc:1275] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 25 index: 12. (index mismatch)
I20260709 12:14:00.764492 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:14:00.765695 13754 raft_consensus.cc:2393] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 28: Already voted for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in this term.
I20260709 12:14:00.766865 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 34 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:00.746500 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 32 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:14:00.752019 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 29 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:14:00.774286 13832 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:14:00.752463 13652 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:14:00.721312 23558 raft_consensus.cc:2804] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:14:00.774313 13759 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:14:00.729127 14412 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 27.
I20260709 12:14:00.720614 23741 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 32 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:14:00.721992 23666 consensus_queue.cc:1048] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 12:14:00.816461 23773 raft_consensus.cc:2749] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:14:00.760381 23735 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:00.821439 23558 raft_consensus.cc:697] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 25 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
W20260709 12:14:00.822324 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 69974.7us
I20260709 12:14:00.765834 23674 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 36 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:00.823901 13652 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:14:00.761595 23752 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:00.827441 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:14:00.828145 13837 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:14:00.835568 23735 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:14:00.843700 23752 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:14:00.844480 23752 raft_consensus.cc:2749] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:14:00.814970 23753 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:00.848018 13759 raft_consensus.cc:2468] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 29.
I20260709 12:14:00.849098 13652 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:14:00.851702 13837 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 27.
I20260709 12:14:00.854355 13834 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 25.
I20260709 12:14:00.851756 23381 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:14:00.847681 23767 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:00.862630 13652 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:14:00.865803 23767 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:00.906492 13652 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:14:00.909123 13652 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:14:00.916963 13634 auto_rebalancer.cc:288] Could not retrieve cluster info: Not found: tserver 96701a74fdee481fb5f54aac841e17dd not available for placement
I20260709 12:14:00.922789 13832 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 32.
I20260709 12:14:00.859907 23421 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 election: Requested vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:14:00.924556 13652 leader_election.cc:304] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:14:00.917577 23558 consensus_queue.cc:237] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:00.852908 23753 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:00.914162 23666 raft_consensus.cc:2749] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:00.934536 13652 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 32 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:14:00.922293 23771 raft_consensus.cc:2749] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 35 FOLLOWER]: Leader pre-election lost for term 36. Reason: could not achieve majority
W20260709 12:14:00.951133 13800 leader_election.cc:336] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:00.952978 13800 consensus_peers.cc:597] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:00.954407 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:14:00.955228 13759 raft_consensus.cc:2368] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for earlier term 26. Current term is 27.
W20260709 12:14:00.918067 14379 consensus_peers.cc:597] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:00.925233 23770 raft_consensus.cc:2749] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:14:00.927083 23766 raft_consensus.cc:2749] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:14:00.934326 23773 raft_consensus.cc:2749] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 33 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
I20260709 12:14:00.921584 23673 consensus_queue.cc:1048] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 12:14:00.965843 23673 consensus_queue.cc:1243] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Peer 96701a74fdee481fb5f54aac841e17dd log is divergent from this leader: its last log entry 20.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:14:00.981380 23674 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:14:00.983098 23767 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:14:00.951417 23752 raft_consensus.cc:2804] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 32 FOLLOWER]: Leader election won for term 32
I20260709 12:14:00.984091 23752 raft_consensus.cc:697] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 32 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:14:00.984674 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:14:00.985445 14407 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:14:00.985180 23752 consensus_queue.cc:237] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 30.19, Last appended by leader: 19, Current term: 32, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:00.988685 23743 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:14:00.959968 14379 consensus_peers.cc:597] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:00.992560 14379 consensus_peers.cc:597] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:00.997568 13760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:14:00.998167 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:14:00.996155 13800 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:14:01.000017 23535 raft_consensus.cc:2804] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:14:01.000568 23535 raft_consensus.cc:697] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 29 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:14:01.006642 14407 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 27.
I20260709 12:14:01.005493 13727 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:14:01.009696 23535 consensus_queue.cc:237] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 27.15, Last appended by leader: 15, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:14:01.011504 23776 log.cc:927] Time spent T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.052s	user 0.002s	sys 0.000s
I20260709 12:14:01.013710 23629 raft_consensus.cc:2804] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:14:01.014441 23629 raft_consensus.cc:697] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:14:01.015360 23767 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.015463 23629 consensus_queue.cc:237] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:01.016050 23767 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:01.018430 23767 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:14:01.029871 23767 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.030572 23767 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:01.031944 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 37 candidate_status { last_received { term: 35 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:14:01.032706 13754 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 36 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 36.
W20260709 12:14:01.035332 13800 leader_election.cc:336] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:01.035476 13651 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:14:01.036346 23770 raft_consensus.cc:2804] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 36 FOLLOWER]: Leader pre-election won for term 37
I20260709 12:14:01.036774 23770 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 36 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:01.037104 23770 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 36 FOLLOWER]: Advancing to term 37
I20260709 12:14:01.039211 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:14:01.048321 13726 consensus_peers.cc:597] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:01.061394 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:14:01.062366 13754 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:14:01.063227 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:14:01.064692 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:14:01.065586 13828 raft_consensus.cc:2368] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for earlier term 26. Current term is 27.
I20260709 12:14:01.081804 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:14:01.075681 13834 pending_rounds.cc:85] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd: Aborting all ops after (but not including) 9
I20260709 12:14:01.086429 14380 leader_election.cc:400] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 election: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for earlier term 26. Current term is 27.
I20260709 12:14:01.086928 14380 leader_election.cc:403] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 election: Cancelling election due to peer responding with higher term
I20260709 12:14:01.087878 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:01.088234 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:01.090554 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:01.091370 13830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:01.092265 23673 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.085530 13834 pending_rounds.cc:107] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd: Aborting uncommitted NO_OP operation due to leader change: 20.10
I20260709 12:14:01.099418 23777 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.099587 13834 raft_consensus.cc:2889] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:01.100042 23777 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:01.094583 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 37 candidate_status { last_received { term: 35 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:01.110447 13652 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:14:01.113130 14379 leader_election.cc:400] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 election: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for earlier term 26. Current term is 27.
I20260709 12:14:01.127985 13652 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:14:01.128140 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:14:01.129201 23741 raft_consensus.cc:2749] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:14:01.086476 23674 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.146425 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
W20260709 12:14:01.146843 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 58315.7us
W20260709 12:14:01.177985 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 50133.8us
I20260709 12:14:01.178373 14407 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:14:01.178959 13652 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:14:01.111951 23743 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:14:01.157621 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 47314.6us
I20260709 12:14:01.094710 23773 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.181195 23773 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:01.183651 13759 raft_consensus.cc:2393] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b98d2519bb504dc6905ed2ede4571835 in current term 29: Already voted for candidate 96701a74fdee481fb5f54aac841e17dd in this term.
I20260709 12:14:01.126055 23767 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:14:01.118396 23655 raft_consensus.cc:2749] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Leader election lost for term 26. Reason: Vote denied by peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603) with higher term. Message: Invalid argument: T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate ca9fbbc2c0a94897897d502d42f3951f for earlier term 26. Current term is 27.
I20260709 12:14:01.175902 13754 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 28.
I20260709 12:14:01.192931 13652 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:14:01.190013 23766 raft_consensus.cc:2749] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:01.198165 23773 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:14:01.193096 13651 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:14:01.202981 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:01.205410 13652 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:14:01.206319 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 30 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:01.211817 14407 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 28.
W20260709 12:14:01.219086 12515 thread.cc:527] Waited for 3000ms trying to join with heartbeat (tid 13713)
I20260709 12:14:01.099486 23673 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:01.231199 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:14:01.196436 23783 log.cc:927] Time spent T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 12:14:01.236155 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 30 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:14:01.238117 23766 raft_consensus.cc:2804] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:14:01.238809 23766 raft_consensus.cc:697] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 28 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:14:01.238696 23767 raft_consensus.cc:2749] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:14:01.193627 23771 raft_consensus.cc:2749] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:01.170011 23770 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 37 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:01.201938 23773 raft_consensus.cc:2749] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:14:01.313383 13651 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:14:01.190815 23674 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:01.243616 23777 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:14:01.339162 23673 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:14:01.324674 23773 raft_consensus.cc:2749] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:14:01.328325 23753 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:14:01.240248 23766 consensus_queue.cc:237] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 26.20, Last appended by leader: 20, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:01.363854 23770 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 37 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:14:01.367802 13754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 37 candidate_status { last_received { term: 35 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:14:01.368742 13754 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 36 FOLLOWER]: Advancing to term 37
W20260709 12:14:01.419689 23782 log.cc:927] Time spent T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:14:01.421613 23674 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:14:01.422302 23674 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.422827 23674 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:01.425125 23674 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:14:01.425374 23735 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:14:01.426283 23735 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:01.429157 23735 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:14:01.430559 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:14:01.431910 13758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:14:01.441391 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8f8986661dd4d049ab4a79338d33a1a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:01.445545 13759 raft_consensus.cc:1275] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 28 index: 20. (index mismatch)
I20260709 12:14:01.455750 13754 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 37 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b98d2519bb504dc6905ed2ede4571835 in term 37.
I20260709 12:14:01.449841 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:14:01.443642 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:14:01.461094 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:01.461474 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:01.465523 13835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 37 candidate_status { last_received { term: 35 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:14:01.467643 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:14:01.470172 13651 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 37 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835; no voters: 
I20260709 12:14:01.463716 13578 catalog_manager.cc:5697] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 19 to 25, leader changed from ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 25 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:14:01.471256 13652 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:14:01.486542 23767 raft_consensus.cc:2749] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:14:01.488838 23738 consensus_queue.cc:1048] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:14:01.494392 14407 raft_consensus.cc:1275] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 27 index: 19. Preceding OpId from leader: term: 28 index: 20. (index mismatch)
I20260709 12:14:01.497303 13837 raft_consensus.cc:1275] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 32 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 30 index: 19. Preceding OpId from leader: term: 32 index: 20. (index mismatch)
I20260709 12:14:01.499370 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:14:01.504966 13652 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:14:01.510106 13836 raft_consensus.cc:1275] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 27 index: 18. (index mismatch)
W20260709 12:14:01.506182 14379 consensus_peers.cc:597] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:01.513015 13652 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:14:01.521414 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:01.510993 23674 consensus_queue.cc:1048] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.019s
I20260709 12:14:01.538611 13652 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:14:01.511106 23738 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 35 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:14:01.513758 23770 raft_consensus.cc:2804] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 37 FOLLOWER]: Leader election won for term 37
I20260709 12:14:01.510458 23777 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.515700 23773 raft_consensus.cc:2749] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:14:01.554306 23666 raft_consensus.cc:3060] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:14:01.554745 14407 raft_consensus.cc:1275] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 12:14:01.552613 13652 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:14:01.537843 23674 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:14:01.569710 13652 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:14:01.573603 13578 catalog_manager.cc:5697] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 25 to 34. New cstate: current_term: 34 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:01.511722 23732 consensus_queue.cc:1048] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.052s
I20260709 12:14:01.580255 13578 catalog_manager.cc:5697] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 23 to 24, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 24 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:01.579320 23749 consensus_queue.cc:1048] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.009s
I20260709 12:14:01.588951 23773 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:14:01.571341 23741 raft_consensus.cc:2749] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:14:01.568284 23770 raft_consensus.cc:697] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 37 LEADER]: Becoming Leader. State: Replica: b98d2519bb504dc6905ed2ede4571835, State: Running, Role: LEADER
I20260709 12:14:01.592072 23770 consensus_queue.cc:237] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 35.18, Last appended by leader: 18, Current term: 37, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:01.594383 14409 raft_consensus.cc:1275] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 27 index: 18. (index mismatch)
I20260709 12:14:01.597752 13763 raft_consensus.cc:1275] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 27 index: 15. Preceding OpId from leader: term: 29 index: 16. (index mismatch)
I20260709 12:14:01.556097 23738 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 35 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:01.603369 23767 consensus_queue.cc:1048] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:14:01.565961 23777 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:14:01.614347 13577 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45610 (request call id 261) took 43907 ms (client timeout 15000 ms). Trace:
I20260709 12:14:01.616560 23777 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:14:01.619534 13578 catalog_manager.cc:5697] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 19 to 25, leader changed from ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 25 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:14:01.631124 13831 raft_consensus.cc:1275] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
W20260709 12:14:01.624650 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 50378.3us
I20260709 12:14:01.636747 23547 consensus_queue.cc:1048] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:14:01.636400 13578 catalog_manager.cc:5697] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 20 to 26, leader changed from ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 26 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:14:01.639739 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:01.640017 23792 consensus_queue.cc:1048] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:14:01.651144 23738 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:14:01.653903 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:14:01.659755 23666 raft_consensus.cc:2749] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 12:14:01.662393 13800 leader_election.cc:336] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 36 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:01.663179 13800 consensus_peers.cc:597] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:01.638473 13578 catalog_manager.cc:5697] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 18 to 24, leader changed from ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 24 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:14:01.664777 23666 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.665490 23666 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:01.667975 23666 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:14:01.670816 23777 consensus_queue.cc:1048] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:14:01.674844 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:01.677155 13578 catalog_manager.cc:5697] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 15 to 26, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 26 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:14:01.615688 13577 rpcz_store.cc:269] 0709 12:13:17.713549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:29.591782 (+11878233us) service_pool.cc:224] Handling call
0709 12:13:30.115584 (+523802us) spinlock_profiling.cc:243] Waited 78 ms on lock 0x7b5400373cd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef7090 00007fa927f95f3a 00007fa92dd4be9c 00007fa92de4a04e 00007fa92c30b2a4 00007fa92c30b232 00007fa92c30b161 00007fa92c30b0dc 00007fa92c30a392 00007fa9262c848c 00007fa9262c78c6
0709 12:13:30.295561 (+179977us) spinlock_profiling.cc:243] Waited 3.95 ms on lock 0x7b54002eff90. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924e69640 00007fa92dd40846 00007fa92de4a90e 00007fa92c30b2a4 00007fa92c30b232 00007fa92c30b161 00007fa92c30b0dc 00007fa92c30a392 00007fa9262c848c 00007fa9262c78c6
0709 12:14:01.614238 (+31318677us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:00.038153 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:00.039148 (+   995us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:00.039213 (+    65us) write_op.cc:435] Acquired schema lock
0709 12:14:00.039236 (+    23us) tablet.cc:662] Decoding operations
0709 12:14:00.040208 (+   972us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:00.040504 (+   296us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:00.040540 (+    36us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:14:00.041233 (+   693us) tablet.cc:701] Row locks acquired
0709 12:14:00.041295 (+    62us) write_op.cc:260] PREPARE: finished
0709 12:14:00.041522 (+   227us) write_op.cc:270] Start()
0709 12:14:00.041681 (+   159us) write_op.cc:276] Timestamp: P: 1783599240041430 usec, L: 0
0709 12:14:00.041705 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:14:00.068404 (+ 26699us) log.cc:844] Serialized 2080 byte log entry
0709 12:14:00.208841 (+140437us) op_driver.cc:464] REPLICATION: finished
0709 12:14:00.441234 (+232393us) write_op.cc:301] APPLY: starting
0709 12:14:00.441382 (+   148us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:00.445691 (+  4309us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:00.506853 (+ 61162us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:00.642288 (+135435us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:00.642571 (+   283us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=0,mrs_lookups=0
0709 12:14:00.642639 (+    68us) write_op.cc:312] APPLY: finished
0709 12:14:00.642963 (+   324us) log.cc:844] Serialized 57 byte log entry
0709 12:14:00.643196 (+   233us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:00.643339 (+   143us) write_op.cc:454] Released schema lock
0709 12:14:00.643401 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:00.721972 (+ 78571us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:00.727468 (+  5496us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":491627,"reported_tablets":50,"spinlock_wait_cycles":188567552,"child_traces":[["op",{"apply.queue_time_us":231991,"apply.run_cpu_time_us":11971,"apply.run_wall_time_us":240624,"cfile_cache_hit":22,"cfile_cache_hit_bytes":25027,"num_ops":5,"prepare.queue_time_us":173974,"prepare.run_cpu_time_us":5122,"prepare.run_wall_time_us":30761,"replication_time_us":166934,"thread_start_us":230272,"threads_started":2}]]}
I20260709 12:14:01.703713 13651 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:14:01.721464 13578 catalog_manager.cc:5697] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 21 to 27, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 27 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:01.724363 13758 raft_consensus.cc:1275] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 32 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 30 index: 19. Preceding OpId from leader: term: 32 index: 20. (index mismatch)
I20260709 12:14:01.731376 13578 catalog_manager.cc:5697] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 16 to 24. New cstate: current_term: 24 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:01.740626 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 36 candidate_status { last_received { term: 35 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:14:01.741413 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:14:01.750612 13757 raft_consensus.cc:2368] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 37 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 36. Current term is 37.
I20260709 12:14:01.748554 13578 catalog_manager.cc:5697] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 21 to 22, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 22 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:01.757326 13800 leader_election.cc:400] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 36 pre-election: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 37 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 36. Current term is 37.
I20260709 12:14:01.757750 13800 leader_election.cc:403] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 36 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:14:01.760012 13651 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:14:01.758503 23770 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.761891 23773 consensus_queue.cc:1048] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.003s
I20260709 12:14:01.762591 23674 raft_consensus.cc:2749] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:14:01.740410 23666 raft_consensus.cc:2749] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:14:01.761876 23770 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:01.776116 23770 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:14:01.788959 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 30 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:14:01.789873 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 30 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:01.767868 13578 catalog_manager.cc:5697] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 20 to 28. New cstate: current_term: 28 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:14:01.819185 13652 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:14:01.791954 23792 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 35 FOLLOWER]: Advancing to term 37
I20260709 12:14:01.824965 23770 raft_consensus.cc:2749] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:14:01.820330 23735 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:14:01.840543 23735 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:01.844573 14409 raft_consensus.cc:1275] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 26 index: 20. Preceding OpId from leader: term: 28 index: 21. (index mismatch)
I20260709 12:14:01.868598 13837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:01.843528 23735 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:14:01.890899 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:14:01.860589 23766 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.899420 13652 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:14:01.902959 23767 raft_consensus.cc:2749] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:14:01.898608 23741 consensus_queue.cc:1048] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.011s
I20260709 12:14:01.898766 23766 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:01.937459 23766 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:14:01.964711 23792 raft_consensus.cc:2749] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 37 FOLLOWER]: Leader pre-election lost for term 36. Reason: Vote denied by peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545) with higher term. Message: Invalid argument: T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 37 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd for earlier term 36. Current term is 37.
W20260709 12:14:01.982499 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 64412.3us
I20260709 12:14:01.986145 23666 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.986763 23666 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:01.990166 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:01.991560 23666 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:14:01.997732 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 79959.5us
I20260709 12:14:01.999717 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:14:02.007371 13757 raft_consensus.cc:1275] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 26 index: 20. Preceding OpId from leader: term: 28 index: 21. (index mismatch)
I20260709 12:14:02.008653 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:14:02.016783 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34a12e91341d4472be7460f1061495db" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:14:02.025499 13651 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:14:02.030498 23666 raft_consensus.cc:2749] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:02.033983 23767 consensus_queue.cc:1048] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260709 12:14:02.031642 13652 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:14:02.030498 23735 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:02.046847 23735 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:02.049293 23735 leader_election.cc:290] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:14:02.041798 23666 raft_consensus.cc:2749] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:14:02.060271 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:14:02.064035 13834 raft_consensus.cc:1275] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 37 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 35 index: 18. Preceding OpId from leader: term: 37 index: 19. (index mismatch)
I20260709 12:14:02.068730 23666 consensus_queue.cc:1048] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 12:14:02.079401 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:14:02.116333 13651 leader_election.cc:304] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:14:02.117208 23766 raft_consensus.cc:2749] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:14:02.120219 13761 raft_consensus.cc:1275] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 37 FOLLOWER]: Refusing update from remote peer b98d2519bb504dc6905ed2ede4571835: Log matching property violated. Preceding OpId in replica: term: 35 index: 18. Preceding OpId from leader: term: 37 index: 19. (index mismatch)
I20260709 12:14:02.134152 23741 consensus_queue.cc:1048] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.003s
I20260709 12:14:02.205735 23766 raft_consensus.cc:493] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:02.208243 23766 raft_consensus.cc:515] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:02.212872 23766 leader_election.cc:290] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:14:02.215553 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 30 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:14:02.216953 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 30 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:14:02.219748 12515 thread.cc:527] Waited for 4000ms trying to join with heartbeat (tid 13713)
I20260709 12:14:02.217994 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f365337b324999a073edacbe6c6e09" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 30 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:02.227814 13651 leader_election.cc:304] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:14:02.236544 23766 raft_consensus.cc:2749] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:14:02.264731 13834 consensus_queue.cc:237] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 29.16, Last appended by leader: 15, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:14:02.295164 23741 raft_consensus.cc:493] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:02.295852 23741 raft_consensus.cc:515] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:14:02.301143 13801 consensus_peers.cc:597] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd -> Peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Couldn't send request to peer ca9fbbc2c0a94897897d502d42f3951f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d8f8986661dd4d049ab4a79338d33a1a. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:02.305189 13578 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53318 (request call id 151) took 13848 ms (client timeout 15000 ms). Trace:
I20260709 12:14:02.308677 13761 raft_consensus.cc:1275] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 29 index: 16. Preceding OpId from leader: term: 29 index: 17. (index mismatch)
W20260709 12:14:02.305814 13578 rpcz_store.cc:269] 0709 12:13:48.456551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:59.961174 (+11504623us) service_pool.cc:224] Handling call
0709 12:14:02.305079 (+2343905us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:02.014109 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:02.014732 (+   623us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:02.014778 (+    46us) write_op.cc:435] Acquired schema lock
0709 12:14:02.014797 (+    19us) tablet.cc:662] Decoding operations
0709 12:14:02.016108 (+  1311us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:02.016203 (+    95us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:02.016234 (+    31us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:14:02.017204 (+   970us) tablet.cc:701] Row locks acquired
0709 12:14:02.017225 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:14:02.017378 (+   153us) write_op.cc:270] Start()
0709 12:14:02.017499 (+   121us) write_op.cc:276] Timestamp: P: 1783599242017332 usec, L: 0
0709 12:14:02.017519 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:14:02.022588 (+  5069us) log.cc:844] Serialized 4367 byte log entry
0709 12:14:02.053594 (+ 31006us) spinlock_profiling.cc:243] Waited 995 us on lock 0x7b5400374220. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef7090 00007fa927f046b8 00007fa927f042fa 00007fa927f88965 00007fa927f88e09 00007fa92b9c3581 00007fa92b9c2d58 00007fa92b9c79f1 00007fa92b9c79a9 00007fa92b9c7939 00007fa92b9c7901
0709 12:14:02.056237 (+  2643us) spinlock_profiling.cc:243] Waited 1.7 ms on lock 0x7b1800496000. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa92dd68ab1 00007fa92dd75281 00007fa924e82e07 00007fa92dcdd9a9 00007fa924e9f69b 00007fa924e9d93f 00007fa924e9d455 00007fa927f0a190 00007fa927f03ae7 00007fa927f02dd9 00007fa927f0d930
0709 12:14:02.132885 (+ 76648us) op_driver.cc:464] REPLICATION: finished
0709 12:14:02.182954 (+ 50069us) write_op.cc:301] APPLY: starting
0709 12:14:02.183048 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:02.239002 (+ 55954us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:02.239029 (+    27us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:02.244505 (+  5476us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:02.244976 (+   471us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=0,mrs_lookups=0
0709 12:14:02.245042 (+    66us) write_op.cc:312] APPLY: finished
0709 12:14:02.245463 (+   421us) log.cc:844] Serialized 105 byte log entry
0709 12:14:02.245825 (+   362us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:02.246026 (+   201us) write_op.cc:454] Released schema lock
0709 12:14:02.246091 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:02.248855 (+  2764us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:02.248896 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":823332,"reported_tablets":29,"child_traces":[["op",{"apply.queue_time_us":48419,"apply.run_cpu_time_us":14768,"apply.run_wall_time_us":65762,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50107,"num_ops":11,"prepare.queue_time_us":120411,"prepare.run_cpu_time_us":7648,"prepare.run_wall_time_us":39730,"raft.queue_time_us":102395,"raft.run_cpu_time_us":8297,"raft.run_wall_time_us":47117,"replication_time_us":115192,"spinlock_wait_cycles":6192256,"thread_start_us":207048,"threads_started":4,"wal-append.queue_time_us":1153}]]}
I20260709 12:14:02.322679 13579 catalog_manager.cc:5697] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 17 to 18, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 18 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:02.365454 23741 leader_election.cc:290] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:14:02.365327 23320 consensus_queue.cc:1048] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:14:02.367805 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:14:02.373937 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89d2a3019c74941a4f8dffc9aa5cf40" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:14:02.380474 13652 leader_election.cc:304] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:14:02.381757 23735 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:02.382324 23735 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:02.384842 23735 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:14:02.385439 23735 raft_consensus.cc:2749] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:14:02.389375 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:02.390671 23320 raft_consensus.cc:2955] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 29 LEADER]: Committing config change with OpId 29.17: config changed from index -1 to 17, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:14:02.393594 13757 raft_consensus.cc:2955] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Committing config change with OpId 29.17: config changed from index -1 to 17, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:14:02.397562 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956300599d004370953188dd3ae3a256" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:14:02.420140 13634 auto_rebalancer.cc:629] Failed to schedule move for tablet 107415ab6e76484890fa8115e8832a21: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:02.436229 13652 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:14:02.437988 23741 raft_consensus.cc:2749] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 12:14:02.438517 14379 consensus_peers.cc:597] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:02.474494 13726 consensus_peers.cc:597] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:02.501277 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 57994.7us
W20260709 12:14:02.505846 14379 consensus_peers.cc:597] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:02.538025 13634 auto_rebalancer.cc:629] Failed to schedule move for tablet d43dfb2e8dc04299ad696b99238cf41a: Illegal state: Replica 3f37c9cc9dda46b4be21dd675ba78fb7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 25 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
W20260709 12:14:02.538949 14379 consensus_peers.cc:597] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:02.550172 13634 auto_rebalancer.cc:629] Failed to schedule move for tablet 243ef5a036904f43835a7e29d96599de: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:02.558352 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 49672.1us
W20260709 12:14:02.564041 14379 consensus_peers.cc:597] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:02.568801 13579 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45620 (request call id 252) took 77300 ms (client timeout 15000 ms). Trace:
W20260709 12:14:02.588388 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 90277.2us
W20260709 12:14:02.569391 13579 rpcz_store.cc:269] 0709 12:12:45.268062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:56.236046 (+10967984us) service_pool.cc:224] Handling call
0709 12:14:02.568703 (+66332657us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:02.331539 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:02.333003 (+  1464us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:02.333043 (+    40us) write_op.cc:435] Acquired schema lock
0709 12:14:02.333062 (+    19us) tablet.cc:662] Decoding operations
0709 12:14:02.333476 (+   414us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:02.333535 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:02.333573 (+    38us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:14:02.333766 (+   193us) tablet.cc:701] Row locks acquired
0709 12:14:02.333807 (+    41us) write_op.cc:260] PREPARE: finished
0709 12:14:02.337170 (+  3363us) write_op.cc:270] Start()
0709 12:14:02.337324 (+   154us) write_op.cc:276] Timestamp: P: 1783599242337077 usec, L: 0
0709 12:14:02.337346 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:14:02.338171 (+   825us) log.cc:844] Serialized 541 byte log entry
0709 12:14:02.360894 (+ 22723us) op_driver.cc:464] REPLICATION: finished
0709 12:14:02.443634 (+ 82740us) write_op.cc:301] APPLY: starting
0709 12:14:02.443718 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:02.444924 (+  1206us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:02.445019 (+    95us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:02.445726 (+   707us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:02.445902 (+   176us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 12:14:02.445947 (+    45us) write_op.cc:312] APPLY: finished
0709 12:14:02.446126 (+   179us) log.cc:844] Serialized 25 byte log entry
0709 12:14:02.450732 (+  4606us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:02.450833 (+   101us) write_op.cc:454] Released schema lock
0709 12:14:02.450874 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:02.498195 (+ 47321us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:02.498879 (+   684us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":50,"spinlock_wait_cycles":3456,"child_traces":[["op",{"apply.queue_time_us":82487,"apply.run_cpu_time_us":2824,"apply.run_wall_time_us":7593,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4180,"num_ops":1,"prepare.queue_time_us":196,"prepare.run_cpu_time_us":3099,"prepare.run_wall_time_us":29079,"replication_time_us":23380}]]}
W20260709 12:14:02.589895 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 88573.1us
I20260709 12:14:02.592752 13580 catalog_manager.cc:5697] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 17 to 21, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 21 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:02.608291 13580 catalog_manager.cc:5697] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 18 to 24, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 24 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:02.611104 14379 consensus_peers.cc:597] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:02.639585 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 72156.9us
W20260709 12:14:02.656615 14379 consensus_peers.cc:597] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:02.656049 13800 consensus_peers.cc:597] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:02.656647 13580 catalog_manager.cc:5697] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 19 to 23. New cstate: current_term: 23 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:02.675944 13726 consensus_peers.cc:597] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:02.676921 13726 consensus_peers.cc:597] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:02.678063 23766 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:02.679226 23766 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:02.684283 23766 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:14:02.686396 13580 catalog_manager.cc:5697] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 26 to 28, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 28 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:02.700637 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 31 candidate_status { last_received { term: 28 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:02.708757 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 31 candidate_status { last_received { term: 28 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:14:02.688911 13580 catalog_manager.cc:5697] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 21 to 23, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 23 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:02.719154 13580 catalog_manager.cc:5697] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 20 to 24. New cstate: current_term: 24 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
W20260709 12:14:02.744009 13800 consensus_peers.cc:597] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:02.744665 13651 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:14:02.745615 23766 raft_consensus.cc:2749] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:14:02.764201 13580 catalog_manager.cc:5697] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 21 to 24. New cstate: current_term: 24 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:02.765915 23766 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:02.770175 23766 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:02.772600 23766 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:14:02.773825 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:02.778560 13580 catalog_manager.cc:5697] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 20 to 24. New cstate: current_term: 24 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:02.787190 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 43911.6us
I20260709 12:14:02.791563 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dfb6cae84194e19bf3a75e14c3d2263" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:14:02.811043 13651 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:14:02.812211 23767 raft_consensus.cc:2749] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:14:02.819615 23766 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
W20260709 12:14:02.819808 13726 consensus_peers.cc:597] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:02.820297 23766 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:02.824924 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:14:02.825021 13726 consensus_peers.cc:597] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:02.832624 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c95811190f014949bb25448e8db1040e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:14:02.834848 13726 consensus_peers.cc:597] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:02.836187 13726 consensus_peers.cc:597] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:02.836747 13652 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:14:02.838107 23767 raft_consensus.cc:2749] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:14:02.831490 23766 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:14:02.840927 23767 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:02.854955 23767 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:14:02.858963 13726 consensus_peers.cc:597] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:02.859884 23767 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:14:02.860562 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:02.865574 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c029efbe5e410cb15f323fd19bf316" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:14:02.867358 13651 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:14:02.868175 23767 raft_consensus.cc:2749] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:14:02.891263 23767 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:14:02.891851 23767 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:02.903954 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:14:02.905759 14379 consensus_peers.cc:597] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:02.908893 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:14:02.907604 23767 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:14:02.925609 13651 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:14:02.927552 23767 raft_consensus.cc:2749] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:02.931977 13579 catalog_manager.cc:5697] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 32 to 35, leader changed from ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 35 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:14:02.933657 13579 catalog_manager.cc:5697] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 25 to 28. New cstate: current_term: 28 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:14:02.935037 13579 catalog_manager.cc:5697] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 23 to 29, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 29 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:02.937065 13579 catalog_manager.cc:5697] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 24 to 29, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 29 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:14:02.946550 13579 catalog_manager.cc:5697] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 26 to 28. New cstate: current_term: 28 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:02.949043 13579 catalog_manager.cc:5697] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 34 to 36. New cstate: current_term: 36 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:02.967833 23767 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 31 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:02.968953 23767 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:02.972777 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 32 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:14:02.974220 14379 consensus_peers.cc:597] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:02.974892 23767 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:14:02.983773 23766 raft_consensus.cc:493] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:14:02.984376 23766 raft_consensus.cc:515] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:02.986605 23766 leader_election.cc:290] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:14:02.989447 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:14:02.991278 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f29dda715314a93a03981264972c4c3" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:02.999002 13652 leader_election.cc:304] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:14:03.000962 23735 raft_consensus.cc:2749] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:14:03.010443 23741 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:03.010993 23741 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:03.013290 23741 leader_election.cc:290] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:14:03.018190 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 34 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:03.023464 23830 ts_tablet_manager.cc:933] T d8f8986661dd4d049ab4a79338d33a1a P ca9fbbc2c0a94897897d502d42f3951f: Initiating tablet copy from peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:14:03.025189 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b57529c42e834d3f85dd24588a5d5773" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 32 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:14:03.027844 13726 consensus_peers.cc:597] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:03.030470 13579 catalog_manager.cc:5697] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 21 to 23, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 23 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:03.043143 13579 catalog_manager.cc:5697] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 22 to 27. New cstate: current_term: 27 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:03.045647 13579 catalog_manager.cc:5697] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 20 to 24, leader changed from ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 24 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:14:03.049252 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 34 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:14:03.051626 13579 catalog_manager.cc:5697] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 24 to 27, leader changed from ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 27 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:14:03.053176 13579 catalog_manager.cc:5697] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 22 to 26, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 26 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:14:03.062337 13579 catalog_manager.cc:5697] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 25 to 28, leader changed from ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 28 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:14:03.063939 13579 catalog_manager.cc:5697] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 26 to 28. New cstate: current_term: 28 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:14:03.072660 13579 catalog_manager.cc:5697] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 28 to 35, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 35 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:14:03.074600 13579 catalog_manager.cc:5697] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 24 to 27, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 27 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:14:03.076341 13579 catalog_manager.cc:5697] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 27 to 29. New cstate: current_term: 29 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:14:03.108294 13579 catalog_manager.cc:5697] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 20 to 23, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 23 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:03.110070 13579 catalog_manager.cc:5697] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 27 to 29. New cstate: current_term: 29 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:03.111588 13579 catalog_manager.cc:5697] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 17 to 18, leader changed from ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 18 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:14:03.113505 13579 catalog_manager.cc:5697] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 22 to 25, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 25 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:03.115576 13579 catalog_manager.cc:5697] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 22 to 25, leader changed from ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 25 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:14:03.117440 13579 catalog_manager.cc:5697] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 28 to 30. New cstate: current_term: 30 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:14:03.127257 23830 tablet_copy_client.cc:323] T d8f8986661dd4d049ab4a79338d33a1a P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Beginning tablet copy session from remote peer at address 127.12.56.195:36603
I20260709 12:14:03.130013 13847 tablet_copy_service.cc:140] P 96701a74fdee481fb5f54aac841e17dd: Received BeginTabletCopySession request for tablet d8f8986661dd4d049ab4a79338d33a1a from peer ca9fbbc2c0a94897897d502d42f3951f ({username='slave'} at 127.0.0.1:35422)
I20260709 12:14:03.130718 13847 tablet_copy_service.cc:161] P 96701a74fdee481fb5f54aac841e17dd: Beginning new tablet copy session on tablet d8f8986661dd4d049ab4a79338d33a1a from peer ca9fbbc2c0a94897897d502d42f3951f at {username='slave'} at 127.0.0.1:35422: session id = ca9fbbc2c0a94897897d502d42f3951f-d8f8986661dd4d049ab4a79338d33a1a
I20260709 12:14:03.146289 13847 tablet_copy_source_session.cc:215] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:14:03.166108 23830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8f8986661dd4d049ab4a79338d33a1a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:14:03.193671 13726 consensus_peers.cc:597] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:03.193878 23767 raft_consensus.cc:493] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:03.194464 13726 consensus_peers.cc:597] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:03.194406 23767 raft_consensus.cc:515] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:03.196578 23766 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:03.197155 23766 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:03.199222 23766 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:14:03.203291 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:03.210574 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad007c01ddb46db81e7206ec8b58024" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:14:03.216818 23767 leader_election.cc:290] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:14:03.220472 12515 thread.cc:527] Waited for 5000ms trying to join with heartbeat (tid 13713)
I20260709 12:14:03.222486 13652 leader_election.cc:304] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:14:03.224988 23767 raft_consensus.cc:2749] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:14:03.231010 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:14:03.231841 14379 consensus_peers.cc:597] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:03.248788 13651 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:14:03.249840 23766 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:14:03.252277 14379 consensus_peers.cc:597] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:03.274129 23766 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:03.277113 23766 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:14:03.278854 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:03.291779 13651 leader_election.cc:304] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
W20260709 12:14:03.299588 13580 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45618 (request call id 239) took 37818 ms (client timeout 15000 ms). Trace:
I20260709 12:14:03.298238 23735 raft_consensus.cc:2749] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 33 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
I20260709 12:14:03.314153 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:14:03.300045 13580 rpcz_store.cc:269] 0709 12:13:25.494473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:38.360243 (+12865770us) service_pool.cc:224] Handling call
0709 12:14:03.299514 (+24939271us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:02.828146 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:02.828724 (+   578us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:02.828786 (+    62us) write_op.cc:435] Acquired schema lock
0709 12:14:02.828805 (+    19us) tablet.cc:662] Decoding operations
0709 12:14:02.829690 (+   885us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:02.829753 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:02.829809 (+    56us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:14:02.830566 (+   757us) tablet.cc:701] Row locks acquired
0709 12:14:02.830589 (+    23us) write_op.cc:260] PREPARE: finished
0709 12:14:02.830750 (+   161us) write_op.cc:270] Start()
0709 12:14:02.830879 (+   129us) write_op.cc:276] Timestamp: P: 1783599242830699 usec, L: 0
0709 12:14:02.830904 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:14:02.834209 (+  3305us) log.cc:844] Serialized 3306 byte log entry
0709 12:14:02.844074 (+  9865us) op_driver.cc:464] REPLICATION: finished
0709 12:14:02.844417 (+   343us) write_op.cc:301] APPLY: starting
0709 12:14:02.844494 (+    77us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:02.862036 (+ 17542us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:02.862157 (+   121us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:02.866857 (+  4700us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:02.867087 (+   230us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=0,mrs_lookups=0
0709 12:14:02.867138 (+    51us) write_op.cc:312] APPLY: finished
0709 12:14:02.867461 (+   323us) log.cc:844] Serialized 81 byte log entry
0709 12:14:02.872006 (+  4545us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:02.872146 (+   140us) write_op.cc:454] Released schema lock
0709 12:14:02.872198 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:02.891974 (+ 19776us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:02.892013 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1538,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":109,"apply.run_cpu_time_us":11340,"apply.run_wall_time_us":47487,"cfile_cache_hit":32,"cfile_cache_hit_bytes":33440,"num_ops":8,"prepare.queue_time_us":115,"prepare.run_cpu_time_us":3988,"prepare.run_wall_time_us":6365,"replication_time_us":13013}]]}
I20260709 12:14:03.293949 23766 raft_consensus.cc:2749] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:14:03.340812 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:14:03.343376 13800 consensus_peers.cc:597] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:03.343514 23766 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:03.344081 13800 consensus_peers.cc:597] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:03.344041 23766 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:03.346623 23766 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:14:03.366281 23767 raft_consensus.cc:493] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:03.366912 23767 raft_consensus.cc:515] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:03.368104 23830 tablet_copy_client.cc:806] T d8f8986661dd4d049ab4a79338d33a1a P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 0 data blocks...
I20260709 12:14:03.368916 23830 tablet_copy_client.cc:670] T d8f8986661dd4d049ab4a79338d33a1a P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:14:03.374290 23767 leader_election.cc:290] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:14:03.377888 23830 tablet_copy_client.cc:538] T d8f8986661dd4d049ab4a79338d33a1a P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:14:03.379909 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:14:03.380960 13726 consensus_peers.cc:597] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:03.382977 23766 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:03.383610 23766 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:03.384815 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:03.386790 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 33 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:03.390183 23766 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:14:03.386674 13726 consensus_peers.cc:597] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:03.394847 13726 consensus_peers.cc:597] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:03.395906 13726 consensus_peers.cc:597] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:03.397459 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:14:03.398280 13726 consensus_peers.cc:597] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:03.401947 13726 consensus_peers.cc:597] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:03.402887 13726 consensus_peers.cc:597] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:03.405565 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614cf111d8b41fca205e6eff5934612" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 33 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:14:03.406827 23830 tablet_bootstrap.cc:492] T d8f8986661dd4d049ab4a79338d33a1a P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap starting.
I20260709 12:14:03.415570 23767 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:03.418715 23767 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:03.421052 23767 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:14:03.423156 13651 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:14:03.423357 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 30 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:14:03.424561 13651 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:14:03.432250 23735 raft_consensus.cc:2749] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:14:03.434640 23735 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:03.435214 23735 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:03.417699 23766 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:03.438951 23766 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:03.426358 23741 raft_consensus.cc:2749] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:03.441613 23766 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:14:03.470903 14379 consensus_peers.cc:597] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:03.456125 23735 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:14:03.481439 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 56957.3us
I20260709 12:14:03.484618 13651 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:14:03.487737 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:03.488405 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 30 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:03.495644 23735 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:14:03.495776 23833 raft_consensus.cc:2749] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:14:03.496440 23735 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:03.498732 13651 leader_election.cc:304] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:14:03.514057 23741 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:03.526110 23741 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:03.528577 23741 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:14:03.494755 23767 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:03.531195 13577 catalog_manager.cc:5697] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 30 to 31, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 31 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:14:03.542354 13577 catalog_manager.cc:5697] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 29 to 30, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 30 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:14:03.544942 13577 catalog_manager.cc:5697] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 23 to 26, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 26 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:03.547932 13577 catalog_manager.cc:5697] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 30 to 31, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 31 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:14:03.552014 23766 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:03.552889 13579 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53318 (request call id 152) took 1168 ms. Trace:
I20260709 12:14:03.552651 23766 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:03.555162 23766 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:14:03.539505 23834 raft_consensus.cc:2749] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:14:03.553308 13579 rpcz_store.cc:276] 0709 12:14:02.384008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:02.596818 (+212810us) service_pool.cc:224] Handling call
0709 12:14:03.552794 (+955976us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:03.300889 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:03.301443 (+   554us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:03.301479 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:14:03.301492 (+    13us) tablet.cc:662] Decoding operations
0709 12:14:03.306741 (+  5249us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:03.306804 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:03.306839 (+    35us) tablet.cc:685] Acquiring locks for 22 operations
0709 12:14:03.308649 (+  1810us) tablet.cc:701] Row locks acquired
0709 12:14:03.308669 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:14:03.308854 (+   185us) write_op.cc:270] Start()
0709 12:14:03.308989 (+   135us) write_op.cc:276] Timestamp: P: 1783599243308799 usec, L: 0
0709 12:14:03.309016 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 12:14:03.317897 (+  8881us) log.cc:844] Serialized 8643 byte log entry
0709 12:14:03.320835 (+  2938us) op_driver.cc:464] REPLICATION: finished
0709 12:14:03.321286 (+   451us) write_op.cc:301] APPLY: starting
0709 12:14:03.321382 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:03.343798 (+ 22416us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:03.343919 (+   121us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:03.432613 (+ 88694us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:03.433025 (+   412us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=44,key_file_lookups=44,delta_file_lookups=0,mrs_lookups=0
0709 12:14:03.433087 (+    62us) write_op.cc:312] APPLY: finished
0709 12:14:03.433646 (+   559us) log.cc:844] Serialized 196 byte log entry
0709 12:14:03.437518 (+  3872us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:03.438624 (+  1106us) write_op.cc:454] Released schema lock
0709 12:14:03.438713 (+    89us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:03.467208 (+ 28495us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:03.468919 (+  1711us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":100359,"reported_tablets":27,"child_traces":[["op",{"apply.queue_time_us":222,"apply.run_cpu_time_us":30347,"apply.run_wall_time_us":137448,"cfile_cache_hit":88,"cfile_cache_hit_bytes":91960,"num_ops":22,"prepare.queue_time_us":2012,"prepare.run_cpu_time_us":6045,"prepare.run_wall_time_us":17339,"replication_time_us":11670}]]}
I20260709 12:14:03.538280 23741 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:03.563686 23741 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:03.550071 23767 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:03.570086 23741 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:14:03.570680 23735 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:14:03.572578 23767 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:14:03.587734 13651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 89099.6us
W20260709 12:14:03.586583 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 44155.4us
I20260709 12:14:03.586666 13577 catalog_manager.cc:5697] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 25 to 26, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 26 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:14:03.598444 13577 catalog_manager.cc:5697] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 24 to 26, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 26 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
W20260709 12:14:03.604259 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 90661.4us
W20260709 12:14:03.610951 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 69912.8us
I20260709 12:14:03.613334 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66aa0310b814479591b9f665634674f1" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:14:03.614353 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d20ad9ea2849238148cd46eb3be62c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 30 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:14:03.615334 13757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:14:03.616048 13577 catalog_manager.cc:5697] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 24 to 25, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 25 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:14:03.624483 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d28ac895464968890083dea150a58d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 30 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:14:03.624162 13577 catalog_manager.cc:5697] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 21 to 24, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 24 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:03.627811 13577 catalog_manager.cc:5697] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 24 to 28, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 28 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:14:03.630365 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:14:03.633992 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 56940.1us
W20260709 12:14:03.634913 13800 consensus_peers.cc:597] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:03.635519 13800 consensus_peers.cc:597] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:03.645264 23841 raft_consensus.cc:493] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:03.645895 23841 raft_consensus.cc:515] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:03.634565 13577 catalog_manager.cc:5697] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 25 to 30, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 30 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
W20260709 12:14:03.648366 13726 consensus_peers.cc:597] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:03.649417 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97f901403f34a8ca78bfeb8472bfa6e" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:14:03.650214 13726 consensus_peers.cc:597] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:03.632309 23735 raft_consensus.cc:493] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:14:03.652012 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:14:03.650839 13726 consensus_peers.cc:597] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:03.652794 13726 consensus_peers.cc:597] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:03.650949 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 31 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:03.653366 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 31 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:14:03.661516 23735 raft_consensus.cc:515] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:03.664846 23735 leader_election.cc:290] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:14:03.672170 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:14:03.671131 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 74598.8us
W20260709 12:14:03.676764 13726 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 308 similar messages]
I20260709 12:14:03.682096 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:14:03.680264 23735 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 35 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:14:03.685318 13726 consensus_peers.cc:597] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:03.701207 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58c7d3b9588c414ba528311a1818a44b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:14:03.676712 23833 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
W20260709 12:14:03.708839 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 96572.2us
I20260709 12:14:03.691514 23735 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 35 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:03.717504 23735 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:14:03.719437 23841 leader_election.cc:290] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:14:03.717617 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:14:03.720449 23833 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:03.722800 23833 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:14:03.728032 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca45e62639f49b4a8367d6868dabc07" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:14:03.728436 14415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34b21ec197b4241a780a8ae562e4602" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:14:03.728058 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:14:03.736755 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 36 candidate_status { last_received { term: 35 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:14:03.733517 13652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 46315.6us
I20260709 12:14:03.745669 23851 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:03.746410 23851 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:14:03.748042 14379 consensus_peers.cc:597] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:03.748968 23851 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:14:03.753194 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3f87a61fef4f1ca0b961e7c64d63f8" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 36 candidate_status { last_received { term: 35 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:03.753194 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:14:03.736537 13651 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:14:03.761890 13651 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:14:03.769907 23851 raft_consensus.cc:2749] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:14:03.769717 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:03.770651 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:03.772684 13651 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:14:03.773954 23845 raft_consensus.cc:2749] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:14:03.773669 23741 raft_consensus.cc:2749] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:14:03.776152 13651 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:14:03.779706 23851 raft_consensus.cc:2749] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:14:03.786250 13652 leader_election.cc:304] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:14:03.778982 13651 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:14:03.787720 23833 raft_consensus.cc:2749] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:14:03.788628 23833 raft_consensus.cc:2749] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:03.790562 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7fcff4988b4d928d7bb79c969a2025" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:14:03.790807 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:14:03.793988 13651 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:14:03.797176 13652 leader_election.cc:304] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:14:03.797969 23833 raft_consensus.cc:2749] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:14:03.798955 13651 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:14:03.807861 23833 raft_consensus.cc:2749] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:14:03.810374 23833 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:14:03.811910 13651 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:14:03.818467 23833 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:03.823422 23833 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:03.825997 23833 leader_election.cc:290] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:14:03.827493 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:14:03.830772 23851 raft_consensus.cc:2749] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:14:03.833725 13651 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:14:03.844604 23851 raft_consensus.cc:2749] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:14:03.859043 13651 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:14:03.862691 23851 raft_consensus.cc:2749] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 35 FOLLOWER]: Leader pre-election lost for term 36. Reason: could not achieve majority
I20260709 12:14:03.876713 13651 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:14:03.883562 23851 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:14:03.892642 13577 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45620 (request call id 255) took 13342 ms (client timeout 15000 ms). Trace:
W20260709 12:14:03.893193 13577 rpcz_store.cc:269] 0709 12:13:50.550155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:01.766000 (+11215845us) service_pool.cc:224] Handling call
0709 12:14:03.892569 (+2126569us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:03.763876 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:03.764487 (+   611us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:03.764527 (+    40us) write_op.cc:435] Acquired schema lock
0709 12:14:03.764547 (+    20us) tablet.cc:662] Decoding operations
0709 12:14:03.765614 (+  1067us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:03.765688 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:03.765725 (+    37us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:14:03.766694 (+   969us) tablet.cc:701] Row locks acquired
0709 12:14:03.766717 (+    23us) write_op.cc:260] PREPARE: finished
0709 12:14:03.766895 (+   178us) write_op.cc:270] Start()
0709 12:14:03.767050 (+   155us) write_op.cc:276] Timestamp: P: 1783599243766838 usec, L: 0
0709 12:14:03.767076 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:14:03.767784 (+   708us) log.cc:844] Serialized 4034 byte log entry
0709 12:14:03.770066 (+  2282us) op_driver.cc:464] REPLICATION: finished
0709 12:14:03.770503 (+   437us) write_op.cc:301] APPLY: starting
0709 12:14:03.770583 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:03.775495 (+  4912us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:03.775585 (+    90us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:03.795667 (+ 20082us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:03.795913 (+   246us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=0,mrs_lookups=0
0709 12:14:03.795962 (+    49us) write_op.cc:312] APPLY: finished
0709 12:14:03.796300 (+   338us) log.cc:844] Serialized 97 byte log entry
0709 12:14:03.797148 (+   848us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:03.797306 (+   158us) write_op.cc:454] Released schema lock
0709 12:14:03.797366 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:03.818883 (+ 21517us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:03.818916 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":247,"apply.run_cpu_time_us":12880,"apply.run_wall_time_us":48334,"cfile_cache_hit":40,"cfile_cache_hit_bytes":41800,"num_ops":10,"prepare.queue_time_us":135,"prepare.run_cpu_time_us":4249,"prepare.run_wall_time_us":4249,"replication_time_us":2836}]]}
I20260709 12:14:03.943892 23851 raft_consensus.cc:493] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:03.944590 23851 raft_consensus.cc:515] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:03.948348 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:03.951013 23851 leader_election.cc:290] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:14:03.979295 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:14:03.984481 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8195765ed074b74be387475c214120b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:14:04.004361 13584 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45618 (request call id 235) took 135055 ms (client timeout 15000 ms). Trace:
W20260709 12:14:04.017927 13584 rpcz_store.cc:269] 0709 12:11:48.949237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:48.949443 (+   206us) service_pool.cc:224] Handling call
0709 12:14:04.004104 (+135054661us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8214,"reported_tablets":50}
I20260709 12:14:04.019747 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "026a826aa72f4cbea032d49e318401ae" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:14:04.028441 23851 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:04.029162 23851 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:04.035995 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:04.037791 23851 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:14:04.074714 23851 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:04.074878 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ef5a036904f43835a7e29d96599de" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:14:04.075459 23851 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:04.078783 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:04.083176 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:14:04.083678 23851 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:14:04.086514 13652 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:14:04.088302 23741 raft_consensus.cc:2749] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:14:04.103933 23851 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:04.104936 23851 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:04.110702 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 31 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:04.116637 23851 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:14:04.145946 13651 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:14:04.147661 13651 leader_election.cc:304] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:14:04.148161 13583 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45618 (request call id 236) took 114617 ms (client timeout 15000 ms). Trace:
W20260709 12:14:04.148782 13583 rpcz_store.cc:269] 0709 12:12:09.531182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:09.531488 (+   306us) service_pool.cc:224] Handling call
0709 12:12:09.956346 (+424858us) spinlock_profiling.cc:243] Waited 3.29 ms on lock 0x7b54002eff90. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa924d28db1 00007fa924e68b71 00007fa924e690b2 00007fa92dde2759 00007fa92dd7aa76 00007fa92dd4bd58 00007fa92de4a04e 00007fa92c30b2a4 00007fa92c30b232 00007fa92c30b161 00007fa92c30b0dc
0709 12:14:04.147945 (+114191599us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1311345,"reported_tablets":50,"spinlock_wait_cycles":7569280}
I20260709 12:14:04.152078 13651 leader_election.cc:304] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:14:04.152927 23766 raft_consensus.cc:2749] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:14:04.154295 13651 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:14:04.155153 23766 raft_consensus.cc:2749] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:04.145524 23741 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:04.166074 23741 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:04.151070 23841 raft_consensus.cc:2749] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:14:04.169855 23741 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:14:04.171260 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 32 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:04.150288 23851 raft_consensus.cc:2749] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:14:04.174121 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7af43351ec498cb9e13128a20c3c89" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 31 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:14:04.180195 13726 consensus_peers.cc:597] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:04.188109 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107415ab6e76484890fa8115e8832a21" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 32 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:14:04.199043 23830 tablet_bootstrap.cc:492] T d8f8986661dd4d049ab4a79338d33a1a P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap replayed 1/1 log segments. Stats: ops{read=17 overwritten=0 applied=17 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:04.210989 23830 tablet_bootstrap.cc:492] T d8f8986661dd4d049ab4a79338d33a1a P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap complete.
I20260709 12:14:04.212024 23830 ts_tablet_manager.cc:1403] T d8f8986661dd4d049ab4a79338d33a1a P ca9fbbc2c0a94897897d502d42f3951f: Time spent bootstrapping tablet: real 0.805s	user 0.075s	sys 0.000s
I20260709 12:14:04.214648 13651 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:14:04.217377 23741 raft_consensus.cc:2749] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:14:04.219404 13651 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:14:04.220966 23741 raft_consensus.cc:2749] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
W20260709 12:14:04.225965 12515 thread.cc:527] Waited for 6000ms trying to join with heartbeat (tid 13713)
I20260709 12:14:04.257681 23830 raft_consensus.cc:359] T d8f8986661dd4d049ab4a79338d33a1a P ca9fbbc2c0a94897897d502d42f3951f [term 29 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:14:04.258858 23830 raft_consensus.cc:740] T d8f8986661dd4d049ab4a79338d33a1a P ca9fbbc2c0a94897897d502d42f3951f [term 29 LEARNER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Initialized, Role: LEARNER
I20260709 12:14:04.259676 23830 consensus_queue.cc:260] T d8f8986661dd4d049ab4a79338d33a1a P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 17, Last appended: 29.17, Last appended by leader: 17, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
W20260709 12:14:04.260390 13586 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45610 (request call id 259) took 85890 ms (client timeout 15000 ms). Trace:
W20260709 12:14:04.271984 13586 rpcz_store.cc:269] 0709 12:12:38.369689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:38.381615 (+ 11926us) service_pool.cc:224] Handling call
0709 12:14:04.260161 (+85878546us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34881,"reported_tablets":50}
I20260709 12:14:04.287901 23830 ts_tablet_manager.cc:1434] T d8f8986661dd4d049ab4a79338d33a1a P ca9fbbc2c0a94897897d502d42f3951f: Time spent starting tablet: real 0.075s	user 0.004s	sys 0.004s
I20260709 12:14:04.289934 13847 tablet_copy_service.cc:342] P 96701a74fdee481fb5f54aac841e17dd: Request end of tablet copy session ca9fbbc2c0a94897897d502d42f3951f-d8f8986661dd4d049ab4a79338d33a1a received from {username='slave'} at 127.0.0.1:35422
I20260709 12:14:04.290515 13847 tablet_copy_service.cc:434] P 96701a74fdee481fb5f54aac841e17dd: ending tablet copy session ca9fbbc2c0a94897897d502d42f3951f-d8f8986661dd4d049ab4a79338d33a1a on tablet d8f8986661dd4d049ab4a79338d33a1a with peer ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:14:04.299108 13583 catalog_manager.cc:5697] T d8f8986661dd4d049ab4a79338d33a1a P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: config changed from index -1 to 17, term changed from 27 to 29, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to <none>, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New cstate: current_term: 29 committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
W20260709 12:14:04.345008 13585 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45620 (request call id 249) took 151231 ms (client timeout 15000 ms). Trace:
W20260709 12:14:04.352094 13585 rpcz_store.cc:269] 0709 12:11:33.113829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.114047 (+   218us) service_pool.cc:224] Handling call
0709 12:14:04.344774 (+151230727us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44893,"reported_tablets":50}
I20260709 12:14:04.421311 14407 raft_consensus.cc:1217] T d8f8986661dd4d049ab4a79338d33a1a P ca9fbbc2c0a94897897d502d42f3951f [term 29 LEARNER]: Deduplicated request from leader. Original: 29.16->[29.17-29.17]   Dedup: 29.17->[]
I20260709 12:14:04.443668 23741 raft_consensus.cc:493] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:14:04.444415 23741 raft_consensus.cc:515] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:04.447746 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:14:04.449918 23741 leader_election.cc:290] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:14:04.451447 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "625e9b5c2aa14658af58496a21f9ee8b" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:14:04.453572 13651 leader_election.cc:304] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:14:04.459605 23851 raft_consensus.cc:2749] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:04.487799 13578 catalog_manager.cc:5697] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 31 to 35. New cstate: current_term: 35 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:14:04.490168 13578 catalog_manager.cc:5697] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 28 to 30. New cstate: current_term: 30 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:04.495223 13578 catalog_manager.cc:5697] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 25 to 28, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 28 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:14:04.502312 13578 catalog_manager.cc:5697] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 26 to 28. New cstate: current_term: 28 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:04.505048 13581 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45620 (request call id 251) took 100198 ms (client timeout 15000 ms). Trace:
W20260709 12:14:04.507947 13581 rpcz_store.cc:269] 0709 12:12:24.330195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:24.330474 (+   279us) service_pool.cc:224] Handling call
0709 12:12:24.598808 (+268334us) spinlock_profiling.cc:243] Waited 92.2 ms on lock 0x7b5400373cd4. stack: 00007fa924e6e343 00007fa924e6e240 00007fa9247fd1d4 00007fa92e53b304 00007fa92e53b299 00007fa927ef7090 00007fa927f95f3a 00007fa92dd4be9c 00007fa92de4a04e 00007fa92c30b2a4 00007fa92c30b232 00007fa92c30b161 00007fa92c30b0dc 00007fa92c30a392 00007fa9262c848c 00007fa9262c78c6
0709 12:14:04.504845 (+99906037us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":50,"spinlock_wait_cycles":212120320}
I20260709 12:14:04.506767 13578 catalog_manager.cc:5697] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 reported cstate change: term changed from 26 to 27, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 27 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:14:04.566519 13583 catalog_manager.cc:5697] T d8f8986661dd4d049ab4a79338d33a1a P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: leader changed from <none> to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 29 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:14:04.630038 23741 raft_consensus.cc:493] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:14:04.630653 23741 raft_consensus.cc:515] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:04.632912 23741 leader_election.cc:290] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:14:04.634821 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:04.637451 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7564a63b8041ff80f64a7f8d533acb" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:14:04.638423 13582 catalog_manager.cc:5697] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 27 to 28, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 28 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:14:04.639292 13652 leader_election.cc:304] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:14:04.640707 23741 raft_consensus.cc:2749] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:14:04.643648 13578 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45610 (request call id 263) took 4688 ms. Trace:
I20260709 12:14:04.654896 13578 rpcz_store.cc:276] 0709 12:13:59.955041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:02.349215 (+2394174us) service_pool.cc:224] Handling call
0709 12:14:04.643586 (+2294371us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:04.526187 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:04.526953 (+   766us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:04.526989 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:14:04.527006 (+    17us) tablet.cc:662] Decoding operations
0709 12:14:04.528956 (+  1950us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:04.529027 (+    71us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:04.529060 (+    33us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:14:04.529632 (+   572us) tablet.cc:701] Row locks acquired
0709 12:14:04.529652 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:14:04.529928 (+   276us) write_op.cc:270] Start()
0709 12:14:04.530055 (+   127us) write_op.cc:276] Timestamp: P: 1783599244529876 usec, L: 0
0709 12:14:04.530083 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 12:14:04.530725 (+   642us) log.cc:844] Serialized 2094 byte log entry
0709 12:14:04.533131 (+  2406us) op_driver.cc:464] REPLICATION: finished
0709 12:14:04.534015 (+   884us) write_op.cc:301] APPLY: starting
0709 12:14:04.534087 (+    72us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:04.536559 (+  2472us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:04.536668 (+   109us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:04.542925 (+  6257us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:04.543096 (+   171us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=0,mrs_lookups=0
0709 12:14:04.543137 (+    41us) write_op.cc:312] APPLY: finished
0709 12:14:04.543370 (+   233us) log.cc:844] Serialized 57 byte log entry
0709 12:14:04.543547 (+   177us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:04.543656 (+   109us) write_op.cc:454] Released schema lock
0709 12:14:04.543696 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:04.544079 (+   383us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:04.544124 (+    45us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":45231,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":640,"apply.run_cpu_time_us":6776,"apply.run_wall_time_us":10016,"cfile_cache_hit":20,"cfile_cache_hit_bytes":20900,"num_ops":5,"prepare.queue_time_us":3460,"prepare.run_cpu_time_us":3546,"prepare.run_wall_time_us":6809,"replication_time_us":2940}]]}
I20260709 12:14:04.645471 13582 catalog_manager.cc:5697] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 24 to 26. New cstate: current_term: 26 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:04.671288 13582 catalog_manager.cc:5697] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 32 to 33, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 33 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:04.678850 12515 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:04.684080 12515 tablet_replica.cc:333] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835: stopping tablet replica
I20260709 12:14:04.682770 13582 catalog_manager.cc:5697] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 27 to 29. New cstate: current_term: 29 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:04.685987 12515 raft_consensus.cc:2243] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 25 LEADER]: Raft consensus shutting down.
I20260709 12:14:04.687314 12515 raft_consensus.cc:2272] T e880992fc1b041b1a1717bb18203a22f P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:04.690737 12515 tablet_replica.cc:333] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835: stopping tablet replica
I20260709 12:14:04.692078 12515 raft_consensus.cc:2243] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:04.692715 12515 raft_consensus.cc:2272] T 0a8c7c772cf44d36bc44b25edc405d1d P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:04.731971 14379 consensus_peers.cc:597] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:04.750209 12515 tablet_replica.cc:333] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835: stopping tablet replica
I20260709 12:14:04.751583 23741 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:04.755728 23741 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:04.756731 12515 raft_consensus.cc:2243] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:04.759100 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:14:04.760461 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca94d8f3109143599733e3a684149726" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:04.762518 23741 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:14:04.763144 12515 raft_consensus.cc:2272] T d8f8986661dd4d049ab4a79338d33a1a P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:04.768699 13651 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:14:04.775442 23841 raft_consensus.cc:2749] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:04.782998 13579 catalog_manager.cc:5697] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 22 to 25, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 25 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:04.784933 13579 catalog_manager.cc:5697] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 30 to 32. New cstate: current_term: 32 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:14:04.788550 12515 tablet_replica.cc:333] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835: stopping tablet replica
I20260709 12:14:04.796264 12515 raft_consensus.cc:2243] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:04.786695 13579 catalog_manager.cc:5697] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 18 to 25, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 25 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:14:04.806510 12515 raft_consensus.cc:2272] T 7a7564a63b8041ff80f64a7f8d533acb P b98d2519bb504dc6905ed2ede4571835 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:04.807186 13579 catalog_manager.cc:5697] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 31 to 33. New cstate: current_term: 33 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:04.814284 13579 catalog_manager.cc:5697] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 24 to 27, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 27 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:04.816984 12515 tablet_replica.cc:333] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835: stopping tablet replica
I20260709 12:14:04.816072 13579 catalog_manager.cc:5697] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 24 to 25, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 25 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:14:04.831583 12515 raft_consensus.cc:2243] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 28 LEADER]: Raft consensus shutting down.
I20260709 12:14:04.834933 12515 raft_consensus.cc:2272] T e39d323dce0c45249bf1cf9b6062ab9a P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:04.830073 13579 catalog_manager.cc:5697] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 28 to 30, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 30 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:04.837919 13579 catalog_manager.cc:5697] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 24 to 27, leader changed from 96701a74fdee481fb5f54aac841e17dd (127.12.56.195) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 27 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:04.858153 23846 raft_consensus.cc:1064] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd: attempting to promote NON_VOTER ca9fbbc2c0a94897897d502d42f3951f to VOTER
I20260709 12:14:04.861624 23846 consensus_queue.cc:237] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 29.17, Last appended by leader: 15, Current term: 29, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:14:04.836426 13582 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45618 (request call id 240) took 16386 ms (client timeout 15000 ms). Trace:
I20260709 12:14:04.913575 13579 catalog_manager.cc:5697] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 23 to 26, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 26 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
W20260709 12:14:04.909724 13726 consensus_peers.cc:597] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:04.912392 13582 rpcz_store.cc:269] 0709 12:13:48.450055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:54.912961 (+6462906us) service_pool.cc:224] Handling call
0709 12:14:04.721898 (+9808937us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:04.721926 (+    28us) write_op.cc:454] Released schema lock
0709 12:14:04.836174 (+114248us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:04.702240 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:04.702771 (+   531us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:04.702803 (+    32us) write_op.cc:435] Acquired schema lock
0709 12:14:04.702820 (+    17us) tablet.cc:662] Decoding operations
0709 12:14:04.703428 (+   608us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:04.703486 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:04.703514 (+    28us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:14:04.703914 (+   400us) tablet.cc:701] Row locks acquired
0709 12:14:04.703928 (+    14us) write_op.cc:260] PREPARE: finished
0709 12:14:04.704066 (+   138us) write_op.cc:270] Start()
0709 12:14:04.704175 (+   109us) write_op.cc:276] Timestamp: P: 1783599244704020 usec, L: 0
0709 12:14:04.704200 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:14:04.704842 (+   642us) log.cc:844] Serialized 1706 byte log entry
0709 12:14:04.707188 (+  2346us) op_driver.cc:464] REPLICATION: finished
0709 12:14:04.707634 (+   446us) write_op.cc:301] APPLY: starting
0709 12:14:04.707721 (+    87us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:04.710226 (+  2505us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:04.710334 (+   108us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:04.715419 (+  5085us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:04.715585 (+   166us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=0,mrs_lookups=0
0709 12:14:04.715632 (+    47us) write_op.cc:312] APPLY: finished
0709 12:14:04.720484 (+  4852us) log.cc:844] Serialized 49 byte log entry
0709 12:14:04.721323 (+   839us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:04.721434 (+   111us) write_op.cc:454] Released schema lock
0709 12:14:04.721482 (+    48us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":24994,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":260,"apply.run_cpu_time_us":6543,"apply.run_wall_time_us":14107,"cfile_cache_hit":16,"cfile_cache_hit_bytes":16720,"num_ops":4,"prepare.queue_time_us":112,"prepare.run_cpu_time_us":2919,"prepare.run_wall_time_us":2919,"replication_time_us":2859,"spinlock_wait_cycles":7552}]]}
I20260709 12:14:04.938676 13579 catalog_manager.cc:5697] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 26 to 28. New cstate: current_term: 28 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:04.936528 12515 tablet_replica.cc:333] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835: stopping tablet replica
I20260709 12:14:04.942000 12515 raft_consensus.cc:2243] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:04.940745 13579 catalog_manager.cc:5697] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 26 to 28. New cstate: current_term: 28 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:04.944240 13579 catalog_manager.cc:5697] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 26 to 28. New cstate: current_term: 28 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:04.945848 13579 catalog_manager.cc:5697] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 28 to 30. New cstate: current_term: 30 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:04.947428 13579 catalog_manager.cc:5697] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 26 to 28. New cstate: current_term: 28 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:14:04.950048 12515 pending_rounds.cc:70] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835: Trying to abort 1 pending ops.
I20260709 12:14:04.948848 13579 catalog_manager.cc:5697] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 29 to 31, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 31 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:04.950584 12515 pending_rounds.cc:77] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835: Aborting op as it isn't in flight: id { term: 23 index: 15 } timestamp: 7305622405428097024 op_type: NO_OP noop_request { }
I20260709 12:14:04.951076 12515 raft_consensus.cc:2889] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:14:04.951501 12515 raft_consensus.cc:2272] T 956300599d004370953188dd3ae3a256 P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:04.951304 13579 catalog_manager.cc:5697] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 33 to 37, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to b98d2519bb504dc6905ed2ede4571835 (127.12.56.193). New cstate: current_term: 37 leader_uuid: "b98d2519bb504dc6905ed2ede4571835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:14:04.956594 12515 tablet_replica.cc:333] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835: stopping tablet replica
I20260709 12:14:04.955909 13579 catalog_manager.cc:5697] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 29 to 32, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 32 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:14:04.960486 13759 raft_consensus.cc:1275] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 29 index: 17. Preceding OpId from leader: term: 29 index: 18. (index mismatch)
I20260709 12:14:04.960520 14407 raft_consensus.cc:1275] T d8f8986661dd4d049ab4a79338d33a1a P ca9fbbc2c0a94897897d502d42f3951f [term 29 LEARNER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 29 index: 17. Preceding OpId from leader: term: 29 index: 18. (index mismatch)
W20260709 12:14:04.963148 13800 consensus_peers.cc:597] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:04.982648 13579 catalog_manager.cc:5697] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 28 to 30, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 30 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } }
I20260709 12:14:04.984895 13579 catalog_manager.cc:5697] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 24 to 28, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 28 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:04.986593 12515 raft_consensus.cc:2243] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:04.987414 12515 raft_consensus.cc:2272] T 625e9b5c2aa14658af58496a21f9ee8b P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:04.986793 13579 catalog_manager.cc:5697] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 25 to 26, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 26 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:04.987692 23678 consensus_queue.cc:1048] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:14:04.990952 23859 consensus_queue.cc:1048] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:14:04.989055 13579 catalog_manager.cc:5697] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 24 to 29. New cstate: current_term: 29 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:05.004280 12515 tablet_replica.cc:333] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835: stopping tablet replica
I20260709 12:14:05.005793 12515 raft_consensus.cc:2243] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:05.006572 12515 raft_consensus.cc:2272] T 34a12e91341d4472be7460f1061495db P b98d2519bb504dc6905ed2ede4571835 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:05.083622 12515 tablet_replica.cc:333] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835: stopping tablet replica
W20260709 12:14:05.112452 14379 consensus_peers.cc:597] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:05.124900 14379 consensus_peers.cc:597] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:05.145666 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 61157.7us
I20260709 12:14:05.140326 23741 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:05.194985 12515 raft_consensus.cc:2243] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:05.196894 12515 raft_consensus.cc:2272] T a2541d5a960c4a8ba1d642e9a29fd19c P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:05.179489 23741 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:05.200376 12515 tablet_replica.cc:333] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835: stopping tablet replica
I20260709 12:14:05.201467 12515 raft_consensus.cc:2243] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:05.209836 23741 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:14:05.210287 12515 raft_consensus.cc:2272] T 243ef5a036904f43835a7e29d96599de P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:05.215304 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:14:05.224846 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5274c30729744338992e7c7710e5266" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:05.232041 23741 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:05.232697 23741 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:14:05.237751 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 102154us
I20260709 12:14:05.238967 23741 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:14:05.244884 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 31 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:05.250576 13652 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:14:05.257900 23741 raft_consensus.cc:2749] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:05.241823 12515 tablet_replica.cc:333] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835: stopping tablet replica
I20260709 12:14:05.271672 23846 raft_consensus.cc:2955] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 29 LEADER]: Committing config change with OpId 29.18: config changed from index 17 to 18, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:14:05.278208 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7639868c5cbf467e82d51f50ad8d6379" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 31 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:14:05.279690 14379 consensus_peers.cc:597] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:05.300261 14379 consensus_peers.cc:597] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:14:05.305908 13651 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:14:05.306885 23741 raft_consensus.cc:2749] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:14:05.308493 14409 raft_consensus.cc:2955] T d8f8986661dd4d049ab4a79338d33a1a P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Committing config change with OpId 29.18: config changed from index 17 to 18, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:14:05.309948 12515 raft_consensus.cc:2243] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:05.310801 12515 raft_consensus.cc:2272] T 9dfb6cae84194e19bf3a75e14c3d2263 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:05.315176 23741 raft_consensus.cc:493] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:05.315815 23741 raft_consensus.cc:515] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:05.326838 23741 leader_election.cc:290] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:14:05.330484 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 30 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:05.335644 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277b655b7311432a95ed2ad291df0b8d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 30 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:14:05.337260 13652 leader_election.cc:304] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:14:05.338510 23741 raft_consensus.cc:2749] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 12:14:05.346577 14379 consensus_peers.cc:597] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:14:05.352672 12515 tablet_replica.cc:333] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835: stopping tablet replica
I20260709 12:14:05.353991 12515 raft_consensus.cc:2243] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:05.359163 12515 pending_rounds.cc:70] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835: Trying to abort 1 pending ops.
I20260709 12:14:05.360584 12515 pending_rounds.cc:77] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835: Aborting op as it isn't in flight: id { term: 24 index: 19 } timestamp: 7305622451313524736 op_type: NO_OP noop_request { }
I20260709 12:14:05.361171 12515 raft_consensus.cc:2889] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:14:05.361572 12515 raft_consensus.cc:2272] T c89d2a3019c74941a4f8dffc9aa5cf40 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:05.364832 12515 tablet_replica.cc:333] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835: stopping tablet replica
W20260709 12:14:05.374966 13726 consensus_peers.cc:597] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:05.377718 13726 consensus_peers.cc:597] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:05.378418 13726 consensus_peers.cc:597] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:05.381997 13726 consensus_peers.cc:597] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:05.389683 13761 raft_consensus.cc:2955] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Committing config change with OpId 29.18: config changed from index 17 to 18, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:14:05.400190 23741 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:05.400868 23741 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:05.396312 13579 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45618 (request call id 241) took 1618 ms. Trace:
I20260709 12:14:05.405247 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 34 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:05.404031 13579 rpcz_store.cc:276] 0709 12:14:03.777687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.777912 (+   225us) service_pool.cc:224] Handling call
0709 12:14:05.396215 (+1618303us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:05.029869 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:05.030737 (+   868us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:05.030817 (+    80us) write_op.cc:435] Acquired schema lock
0709 12:14:05.030839 (+    22us) tablet.cc:662] Decoding operations
0709 12:14:05.033412 (+  2573us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:05.033473 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:05.033502 (+    29us) tablet.cc:685] Acquiring locks for 21 operations
0709 12:14:05.035683 (+  2181us) tablet.cc:701] Row locks acquired
0709 12:14:05.035758 (+    75us) write_op.cc:260] PREPARE: finished
0709 12:14:05.035976 (+   218us) write_op.cc:270] Start()
0709 12:14:05.036135 (+   159us) write_op.cc:276] Timestamp: P: 1783599245035911 usec, L: 0
0709 12:14:05.036166 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 12:14:05.074329 (+ 38163us) log.cc:844] Serialized 8298 byte log entry
0709 12:14:05.117833 (+ 43504us) op_driver.cc:464] REPLICATION: finished
0709 12:14:05.118261 (+   428us) write_op.cc:301] APPLY: starting
0709 12:14:05.118353 (+    92us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:05.142327 (+ 23974us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:05.150462 (+  8135us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:05.230145 (+ 79683us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:05.230441 (+   296us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=42,key_file_lookups=42,delta_file_lookups=0,mrs_lookups=0
0709 12:14:05.230488 (+    47us) write_op.cc:312] APPLY: finished
0709 12:14:05.230895 (+   407us) log.cc:844] Serialized 188 byte log entry
0709 12:14:05.252319 (+ 21424us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:05.252558 (+   239us) write_op.cc:454] Released schema lock
0709 12:14:05.252643 (+    85us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:05.253040 (+   397us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:05.253068 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6854,"reported_tablets":50,"spinlock_wait_cycles":2432,"child_traces":[["op",{"apply.queue_time_us":167,"apply.run_cpu_time_us":31473,"apply.run_wall_time_us":134750,"cfile_cache_hit":84,"cfile_cache_hit_bytes":87780,"num_ops":21,"prepare.queue_time_us":206,"prepare.run_cpu_time_us":7192,"prepare.run_wall_time_us":44926,"replication_time_us":81470}]]}
W20260709 12:14:05.427412 14379 consensus_peers.cc:597] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:14:05.431466 13584 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45620 (request call id 256) took 1379 ms. Trace:
I20260709 12:14:05.432101 13584 rpcz_store.cc:276] 0709 12:14:04.052147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:04.052283 (+   136us) service_pool.cc:224] Handling call
0709 12:14:05.431311 (+1379028us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29386,"reported_tablets":42}
I20260709 12:14:05.403822 23741 leader_election.cc:290] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:14:05.462090 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232d133451004a83941860574adec712" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 34 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:14:05.463896 13579 catalog_manager.cc:5697] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd reported cstate change: config changed from index 17 to 18, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New cstate: current_term: 29 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:14:05.466164 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 82672.5us
I20260709 12:14:05.382807 12515 raft_consensus.cc:2243] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 35 LEADER]: Raft consensus shutting down.
I20260709 12:14:05.474056 13651 leader_election.cc:304] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:14:05.493505 23841 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:14:05.498389 23867 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:05.501405 23867 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:05.502485 23741 raft_consensus.cc:2749] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 33 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
I20260709 12:14:05.503778 23867 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:14:05.505015 23841 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:05.507752 23841 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:14:05.499121 12515 raft_consensus.cc:2272] T 64b889ec5fe4445d81fe94e0ae9fb087 P b98d2519bb504dc6905ed2ede4571835 [term 35 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:05.509419 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:05.528018 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:14:05.548870 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407aabb01908409185c74e2349da4c3d" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:14:05.551477 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:14:05.566272 13726 consensus_peers.cc:597] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:05.568642 13651 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:14:05.570007 23841 raft_consensus.cc:2749] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:14:05.572144 12515 tablet_replica.cc:333] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835: stopping tablet replica
I20260709 12:14:05.573324 12515 raft_consensus.cc:2243] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Raft consensus shutting down.
W20260709 12:14:05.585258 13726 consensus_peers.cc:597] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:05.589936 13726 consensus_peers.cc:597] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:05.590974 13726 consensus_peers.cc:597] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:05.587028 12515 raft_consensus.cc:2272] T c6d20ad9ea2849238148cd46eb3be62c P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:05.592473 13726 consensus_peers.cc:597] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:05.593894 13726 consensus_peers.cc:597] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:05.595046 12515 tablet_replica.cc:333] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835: stopping tablet replica
I20260709 12:14:05.596095 12515 raft_consensus.cc:2243] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 31 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:05.596679 12515 raft_consensus.cc:2272] T 107415ab6e76484890fa8115e8832a21 P b98d2519bb504dc6905ed2ede4571835 [term 31 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:05.598104 13652 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:14:05.598414 13726 consensus_peers.cc:597] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:05.599450 23841 raft_consensus.cc:2749] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:14:05.600181 13726 consensus_peers.cc:597] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:05.608144 13726 consensus_peers.cc:597] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:05.612432 13726 consensus_peers.cc:597] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:05.615765 13726 consensus_peers.cc:597] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:05.643157 12515 tablet_replica.cc:333] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835: stopping tablet replica
I20260709 12:14:05.644140 12515 raft_consensus.cc:2243] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:05.644850 12515 pending_rounds.cc:70] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835: Trying to abort 2 pending ops.
I20260709 12:14:05.645123 12515 pending_rounds.cc:77] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835: Aborting op as it isn't in flight: id { term: 26 index: 17 } timestamp: 7305622439203708928 op_type: NO_OP noop_request { }
I20260709 12:14:05.645484 12515 raft_consensus.cc:2889] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:14:05.649174 12515 pending_rounds.cc:77] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835: Aborting op as it isn't in flight: id { term: 24 index: 16 } timestamp: 7305622409319591936 op_type: NO_OP noop_request { }
I20260709 12:14:05.649547 12515 raft_consensus.cc:2889] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:14:05.649905 12515 raft_consensus.cc:2272] T 026a826aa72f4cbea032d49e318401ae P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:05.653131 12515 tablet_replica.cc:333] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835: stopping tablet replica
I20260709 12:14:05.654069 12515 raft_consensus.cc:2243] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:05.654801 12515 pending_rounds.cc:70] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835: Trying to abort 1 pending ops.
W20260709 12:14:05.638898 14379 consensus_peers.cc:597] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:14:05.655267 12515 pending_rounds.cc:77] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835: Aborting op as it isn't in flight: id { term: 27 index: 14 } timestamp: 7305622448375099392 op_type: NO_OP noop_request { }
I20260709 12:14:05.675340 12515 raft_consensus.cc:2889] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:14:05.675864 12515 raft_consensus.cc:2272] T e5274c30729744338992e7c7710e5266 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:05.695009 12515 tablet_replica.cc:333] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835: stopping tablet replica
I20260709 12:14:05.694932 23861 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:14:05.696189 12515 raft_consensus.cc:2243] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:05.695858 23861 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:05.696874 12515 raft_consensus.cc:2272] T ca94d8f3109143599733e3a684149726 P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:05.698833 23861 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:14:05.700345 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:14:05.709540 13726 leader_election.cc:336] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:05.710356 13726 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:05.711149 23861 raft_consensus.cc:2749] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:14:05.715430 13726 consensus_peers.cc:597] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:05.724328 13726 consensus_peers.cc:597] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:05.726050 13726 consensus_peers.cc:597] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:05.706307 12515 tablet_replica.cc:333] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835: stopping tablet replica
W20260709 12:14:05.729827 13800 consensus_peers.cc:597] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:05.730683 12515 raft_consensus.cc:2243] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 32 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:05.734438 12515 raft_consensus.cc:2272] T 2614cf111d8b41fca205e6eff5934612 P b98d2519bb504dc6905ed2ede4571835 [term 32 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:05.737599 12515 tablet_replica.cc:333] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835: stopping tablet replica
I20260709 12:14:05.745365 12515 raft_consensus.cc:2243] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 28 LEADER]: Raft consensus shutting down.
I20260709 12:14:05.747922 12515 raft_consensus.cc:2272] T 1d3056e0d375412a9db3769da3ef2eb9 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:05.752868 14379 consensus_peers.cc:597] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:05.769753 13800 consensus_peers.cc:597] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:05.791747 13726 consensus_peers.cc:597] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:05.795998 13831 consensus_queue.cc:237] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 29.18, Last appended by leader: 15, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:05.798045 12515 tablet_replica.cc:333] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835: stopping tablet replica
I20260709 12:14:05.800391 12515 raft_consensus.cc:2243] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:05.804935 12515 raft_consensus.cc:2272] T 277b655b7311432a95ed2ad291df0b8d P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:05.825707 12515 tablet_replica.cc:333] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835: stopping tablet replica
I20260709 12:14:05.834460 12515 raft_consensus.cc:2243] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:05.830984 14409 raft_consensus.cc:1275] T d8f8986661dd4d049ab4a79338d33a1a P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 29 index: 18. Preceding OpId from leader: term: 29 index: 19. (index mismatch)
I20260709 12:14:05.836473 23859 consensus_queue.cc:1048] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
W20260709 12:14:05.827863 13800 consensus_peers.cc:597] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:05.844062 14379 consensus_peers.cc:597] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:14:05.847379 13761 raft_consensus.cc:1275] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 29 index: 18. Preceding OpId from leader: term: 29 index: 19. (index mismatch)
I20260709 12:14:05.848101 12515 raft_consensus.cc:2272] T 7639868c5cbf467e82d51f50ad8d6379 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:05.847885 23678 raft_consensus.cc:2955] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 29 LEADER]: Committing config change with OpId 29.19: config changed from index 18 to 19, VOTER b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) evicted. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:14:05.851841 12515 tablet_replica.cc:333] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835: stopping tablet replica
I20260709 12:14:05.852823 12515 raft_consensus.cc:2243] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:05.853698 12515 raft_consensus.cc:2272] T 66aa0310b814479591b9f665634674f1 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:05.856037 23846 consensus_queue.cc:1048] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 12:14:05.856951 12515 tablet_replica.cc:333] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835: stopping tablet replica
I20260709 12:14:05.861025 13761 raft_consensus.cc:2955] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Committing config change with OpId 29.19: config changed from index 18 to 19, VOTER b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) evicted. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:14:05.865585 13571 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d8f8986661dd4d049ab4a79338d33a1a with cas_config_opid_index 18: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:14:05.861099 14409 raft_consensus.cc:2955] T d8f8986661dd4d049ab4a79338d33a1a P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Committing config change with OpId 29.19: config changed from index 18 to 19, VOTER b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) evicted. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:14:05.877179 13579 catalog_manager.cc:5697] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd reported cstate change: config changed from index 18 to 19, VOTER b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) evicted. New cstate: current_term: 29 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:05.884446 12515 raft_consensus.cc:2243] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:05.885344 12515 pending_rounds.cc:70] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835: Trying to abort 1 pending ops.
I20260709 12:14:05.886044 12515 pending_rounds.cc:77] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835: Aborting op as it isn't in flight: id { term: 28 index: 18 } timestamp: 7305622448655151104 op_type: NO_OP noop_request { }
I20260709 12:14:05.886484 12515 raft_consensus.cc:2889] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:14:05.886906 12515 raft_consensus.cc:2272] T 58c7d3b9588c414ba528311a1818a44b P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:05.889827 12515 tablet_replica.cc:333] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835: stopping tablet replica
I20260709 12:14:05.890731 12515 raft_consensus.cc:2243] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 31 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:05.893417 23841 raft_consensus.cc:493] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:05.897662 23841 raft_consensus.cc:515] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:05.899978 23841 leader_election.cc:290] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:14:05.906140 12515 raft_consensus.cc:2272] T b57529c42e834d3f85dd24588a5d5773 P b98d2519bb504dc6905ed2ede4571835 [term 31 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:05.908358 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:14:05.910458 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8e96840ffec4e38a0f975263031c226" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:05.912024 13652 leader_election.cc:304] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:14:05.913213 23841 raft_consensus.cc:2749] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:14:05.927176 13726 consensus_peers.cc:597] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:05.928124 12515 tablet_replica.cc:333] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835: stopping tablet replica
I20260709 12:14:05.929097 12515 raft_consensus.cc:2243] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:05.932089 12515 pending_rounds.cc:70] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835: Trying to abort 1 pending ops.
I20260709 12:14:05.932480 12515 pending_rounds.cc:77] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835: Aborting op as it isn't in flight: id { term: 26 index: 16 } timestamp: 7305622437728591872 op_type: NO_OP noop_request { }
I20260709 12:14:05.932933 12515 raft_consensus.cc:2889] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:14:05.933382 12515 raft_consensus.cc:2272] T a34b21ec197b4241a780a8ae562e4602 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:05.953040 12515 tablet_replica.cc:333] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835: stopping tablet replica
I20260709 12:14:05.964007 23859 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:14:05.964629 23859 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:05.966286 12515 raft_consensus.cc:2243] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Raft consensus shutting down.
W20260709 12:14:05.970387 13570 catalog_manager.cc:4755] TS b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet d8f8986661dd4d049ab4a79338d33a1a: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
W20260709 12:14:05.986315 13800 leader_election.cc:336] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:05.976956 12515 pending_rounds.cc:70] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835: Trying to abort 1 pending ops.
I20260709 12:14:05.995869 12515 pending_rounds.cc:77] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835: Aborting op as it isn't in flight: id { term: 25 index: 16 } timestamp: 7305622414323101696 op_type: NO_OP noop_request { }
I20260709 12:14:05.997469 12515 raft_consensus.cc:2889] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:14:05.998024 12515 raft_consensus.cc:2272] T d2f365337b324999a073edacbe6c6e09 P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:06.006081 12515 tablet_replica.cc:333] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835: stopping tablet replica
I20260709 12:14:06.011489 12515 raft_consensus.cc:2243] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:06.022451 12515 raft_consensus.cc:2272] T 658b56fb08f0467fa5a9d602dd275f81 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:06.029874 12515 tablet_replica.cc:333] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835: stopping tablet replica
I20260709 12:14:06.034158 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:14:06.026432 14379 consensus_peers.cc:597] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:14:06.032375 23859 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:14:06.035003 13761 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 25.
I20260709 12:14:06.037348 13800 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:06.034648 12515 raft_consensus.cc:2243] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:06.038524 23859 raft_consensus.cc:2804] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:14:06.038926 23859 raft_consensus.cc:493] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:14:06.039289 23859 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:14:06.039867 12515 pending_rounds.cc:70] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835: Trying to abort 1 pending ops.
I20260709 12:14:06.040244 12515 pending_rounds.cc:77] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835: Aborting op as it isn't in flight: id { term: 27 index: 20 } timestamp: 7305622470991638528 op_type: NO_OP noop_request { }
I20260709 12:14:06.042425 23861 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:14:06.043141 23861 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:06.046298 23861 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:14:06.042815 12515 raft_consensus.cc:2889] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:14:06.047183 12515 raft_consensus.cc:2272] T cad007c01ddb46db81e7206ec8b58024 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:06.051707 12515 tablet_replica.cc:333] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835: stopping tablet replica
I20260709 12:14:06.053424 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 29 candidate_status { last_received { term: 28 index: 21 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:14:06.056939 12515 raft_consensus.cc:2243] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:06.059331 12515 raft_consensus.cc:2272] T c95811190f014949bb25448e8db1040e P b98d2519bb504dc6905ed2ede4571835 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:06.059127 23859 raft_consensus.cc:515] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:06.061726 23859 leader_election.cc:290] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:14:06.063833 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e880992fc1b041b1a1717bb18203a22f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:14:06.064534 13761 raft_consensus.cc:3060] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:14:06.083693 13726 consensus_peers.cc:597] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:06.091440 12515 tablet_replica.cc:333] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835: stopping tablet replica
I20260709 12:14:06.092577 12515 raft_consensus.cc:2243] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:06.093236 12515 raft_consensus.cc:2272] T b2210d5649f048c68ae57986b065cb28 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:06.093806 13800 leader_election.cc:336] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:06.097286 13761 raft_consensus.cc:2468] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 26.
I20260709 12:14:06.098754 13800 leader_election.cc:304] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:06.100018 23859 raft_consensus.cc:2804] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:14:06.100561 23859 raft_consensus.cc:697] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 26 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:14:06.101944 12515 tablet_replica.cc:333] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835: stopping tablet replica
I20260709 12:14:06.101487 23859 consensus_queue.cc:237] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 25.12, Last appended by leader: 12, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:14:06.104993 13726 leader_election.cc:336] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:06.105561 13726 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:14:06.106428 23842 raft_consensus.cc:2749] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:14:06.135042 13579 catalog_manager.cc:5697] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 25 to 26, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 26 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:06.137986 12515 raft_consensus.cc:2243] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:06.179884 23868 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:14:06.180696 23868 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:06.185860 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 29 candidate_status { last_received { term: 28 index: 21 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:14:06.186625 13759 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 28.
I20260709 12:14:06.187958 14379 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:14:06.189671 23868 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:14:06.191903 14379 leader_election.cc:336] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:06.193138 23868 raft_consensus.cc:2804] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:14:06.202675 23868 raft_consensus.cc:493] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:14:06.204017 23868 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Advancing to term 29
W20260709 12:14:06.207998 13800 consensus_peers.cc:597] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:06.160089 12515 raft_consensus.cc:2272] T dca45e62639f49b4a8367d6868dabc07 P b98d2519bb504dc6905ed2ede4571835 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:06.215893 13726 consensus_peers.cc:597] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:06.219180 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 45353us
I20260709 12:14:06.235931 12515 tablet_replica.cc:333] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835: stopping tablet replica
I20260709 12:14:06.241833 12515 raft_consensus.cc:2243] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:06.251827 12515 pending_rounds.cc:70] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835: Trying to abort 1 pending ops.
I20260709 12:14:06.252110 12515 pending_rounds.cc:77] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835: Aborting op as it isn't in flight: id { term: 24 index: 18 } timestamp: 7305622448671617024 op_type: NO_OP noop_request { }
I20260709 12:14:06.252466 12515 raft_consensus.cc:2889] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:14:06.252849 12515 raft_consensus.cc:2272] T c8195765ed074b74be387475c214120b P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:06.256310 23868 raft_consensus.cc:515] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:14:06.264832 13800 consensus_peers.cc:597] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:06.264871 14379 leader_election.cc:336] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:06.274214 12515 tablet_replica.cc:333] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835: stopping tablet replica
I20260709 12:14:06.275126 12515 raft_consensus.cc:2243] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 30 LEADER]: Raft consensus shutting down.
I20260709 12:14:06.276271 12515 raft_consensus.cc:2272] T dabf40829555486da9d6b588472147ec P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:06.405563 23872 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.406288 23872 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:06.408768 23872 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:14:06.423628 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:06.406785 12515 tablet_replica.cc:333] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835: stopping tablet replica
I20260709 12:14:06.430392 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d323dce0c45249bf1cf9b6062ab9a" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 29 candidate_status { last_received { term: 28 index: 21 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:14:06.431107 13759 raft_consensus.cc:3060] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:14:06.432915 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637cf9d05e2348118404a474b84d67d7" candidate_uuid: "b98d2519bb504dc6905ed2ede4571835" candidate_term: 29 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:14:06.435019 12515 raft_consensus.cc:2243] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:06.448807 13759 raft_consensus.cc:2468] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 29.
I20260709 12:14:06.452742 14379 leader_election.cc:304] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:06.453738 23875 raft_consensus.cc:2804] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:14:06.454201 12515 raft_consensus.cc:2272] T 407aabb01908409185c74e2349da4c3d P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:06.454725 23875 raft_consensus.cc:697] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 29 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:14:06.455792 23875 consensus_queue.cc:237] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 28.21, Last appended by leader: 21, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:06.459095 13651 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b98d2519bb504dc6905ed2ede4571835; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:14:06.459997 23841 raft_consensus.cc:2749] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:14:06.423437 23868 leader_election.cc:290] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:14:06.485181 13579 catalog_manager.cc:5697] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 28 to 29, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 29 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:06.486716 12515 tablet_replica.cc:333] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835: stopping tablet replica
I20260709 12:14:06.487591 12515 raft_consensus.cc:2243] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 32 LEADER]: Raft consensus shutting down.
I20260709 12:14:06.488647 12515 raft_consensus.cc:2272] T 14d7a26ca33940fbba5fa30c5212e5ac P b98d2519bb504dc6905ed2ede4571835 [term 32 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:06.487761 14379 consensus_peers.cc:597] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:06.515967 13726 consensus_peers.cc:597] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:06.529305 12515 tablet_replica.cc:333] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835: stopping tablet replica
I20260709 12:14:06.542732 12515 raft_consensus.cc:2243] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:06.543576 12515 pending_rounds.cc:70] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835: Trying to abort 1 pending ops.
I20260709 12:14:06.550711 12515 pending_rounds.cc:77] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835: Aborting op as it isn't in flight: id { term: 27 index: 14 } timestamp: 7305622402641842176 op_type: NO_OP noop_request { }
I20260709 12:14:06.551403 12515 raft_consensus.cc:2889] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:14:06.554252 12515 raft_consensus.cc:2272] T ab7af43351ec498cb9e13128a20c3c89 P b98d2519bb504dc6905ed2ede4571835 [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:06.557710 12515 tablet_replica.cc:333] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835: stopping tablet replica
I20260709 12:14:06.565069 12515 raft_consensus.cc:2243] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:06.571512 12515 raft_consensus.cc:2272] T d43dfb2e8dc04299ad696b99238cf41a P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:06.586531 12515 tablet_replica.cc:333] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835: stopping tablet replica
I20260709 12:14:06.593282 12515 raft_consensus.cc:2243] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:06.595752 12515 raft_consensus.cc:2272] T 637cf9d05e2348118404a474b84d67d7 P b98d2519bb504dc6905ed2ede4571835 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:06.611907 12515 tablet_replica.cc:333] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835: stopping tablet replica
W20260709 12:14:06.614353 13800 consensus_peers.cc:597] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:06.621611 12515 raft_consensus.cc:2243] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:06.624678 12515 raft_consensus.cc:2272] T e229ea1f19c74be5884179acde106305 P b98d2519bb504dc6905ed2ede4571835 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:06.642410 12515 tablet_replica.cc:333] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835: stopping tablet replica
I20260709 12:14:06.643523 12515 raft_consensus.cc:2243] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:06.644610 12515 pending_rounds.cc:70] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835: Trying to abort 1 pending ops.
I20260709 12:14:06.644971 12515 pending_rounds.cc:77] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835: Aborting op as it isn't in flight: id { term: 22 index: 15 } timestamp: 7305622396783648768 op_type: NO_OP noop_request { }
I20260709 12:14:06.649963 12515 raft_consensus.cc:2889] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:14:06.650938 12515 raft_consensus.cc:2272] T d9c029efbe5e410cb15f323fd19bf316 P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:06.665719 12515 tablet_replica.cc:333] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835: stopping tablet replica
I20260709 12:14:06.668133 12515 raft_consensus.cc:2243] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:06.668871 12515 raft_consensus.cc:2272] T c97f901403f34a8ca78bfeb8472bfa6e P b98d2519bb504dc6905ed2ede4571835 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:06.672736 23842 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:14:06.675212 23842 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:06.677767 23842 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:14:06.680114 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 29 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:14:06.681903 13726 leader_election.cc:336] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:06.682422 13726 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:06.683254 23842 raft_consensus.cc:2749] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:14:06.684268 12515 tablet_replica.cc:333] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835: stopping tablet replica
I20260709 12:14:06.702656 12515 raft_consensus.cc:2243] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 33 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:06.702750 13759 raft_consensus.cc:1275] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 25 index: 12. Preceding OpId from leader: term: 26 index: 13. (index mismatch)
I20260709 12:14:06.711084 12515 raft_consensus.cc:2272] T 232d133451004a83941860574adec712 P b98d2519bb504dc6905ed2ede4571835 [term 33 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:06.712250 23846 consensus_queue.cc:1048] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:14:06.729277 12515 tablet_replica.cc:333] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835: stopping tablet replica
I20260709 12:14:06.730388 12515 raft_consensus.cc:2243] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 35 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:06.741925 12515 raft_consensus.cc:2272] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P b98d2519bb504dc6905ed2ede4571835 [term 35 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:06.753574 12515 tablet_replica.cc:333] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835: stopping tablet replica
I20260709 12:14:06.754796 12515 raft_consensus.cc:2243] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:06.761198 12515 raft_consensus.cc:2272] T 56d28ac895464968890083dea150a58d P b98d2519bb504dc6905ed2ede4571835 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:06.766419 12515 tablet_replica.cc:333] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835: stopping tablet replica
I20260709 12:14:06.767434 12515 raft_consensus.cc:2243] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:06.768556 12515 raft_consensus.cc:2272] T 3f29dda715314a93a03981264972c4c3 P b98d2519bb504dc6905ed2ede4571835 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:06.772573 12515 tablet_replica.cc:333] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835: stopping tablet replica
I20260709 12:14:06.773698 12515 raft_consensus.cc:2243] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:06.781737 12515 raft_consensus.cc:2272] T 2e7fcff4988b4d928d7bb79c969a2025 P b98d2519bb504dc6905ed2ede4571835 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:06.790019 23868 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 35 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:14:06.790858 23868 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 35 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:06.793001 23868 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:14:06.795204 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 36 candidate_status { last_received { term: 35 index: 22 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
W20260709 12:14:06.797114 14379 leader_election.cc:336] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 36 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:06.797607 14379 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:06.799597 23875 raft_consensus.cc:2749] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 35 FOLLOWER]: Leader pre-election lost for term 36. Reason: could not achieve majority
I20260709 12:14:06.813753 12515 tablet_replica.cc:333] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835: stopping tablet replica
I20260709 12:14:06.818858 12515 raft_consensus.cc:2243] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:06.819734 12515 raft_consensus.cc:2272] T e8e96840ffec4e38a0f975263031c226 P b98d2519bb504dc6905ed2ede4571835 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:06.832420 12515 tablet_replica.cc:333] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835: stopping tablet replica
I20260709 12:14:06.833441 12515 raft_consensus.cc:2243] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 25 LEADER]: Raft consensus shutting down.
I20260709 12:14:06.835336 12515 raft_consensus.cc:2272] T a3c0f10b06fa4aa48a99239da6d81a1f P b98d2519bb504dc6905ed2ede4571835 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:06.839099 12515 tablet_replica.cc:333] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835: stopping tablet replica
I20260709 12:14:06.842554 12515 raft_consensus.cc:2243] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 37 LEADER]: Raft consensus shutting down.
I20260709 12:14:06.850641 12515 raft_consensus.cc:2272] T f1494f6353074242857c7901c21da06d P b98d2519bb504dc6905ed2ede4571835 [term 37 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:06.953681 23846 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:14:06.954270 23846 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:06.956808 23846 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:14:06.958931 13759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 29 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:14:06.959681 13759 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 28.
I20260709 12:14:06.961215 23842 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 35 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:14:06.961843 23842 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 35 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:06.964273 23842 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:14:06.965312 13800 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:14:06.965324 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 36 candidate_status { last_received { term: 35 index: 22 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:14:06.966276 14409 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 35 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 35.
I20260709 12:14:06.968300 13727 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
W20260709 12:14:06.969655 13800 leader_election.cc:336] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:06.969952 23861 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 35 FOLLOWER]: Leader pre-election won for term 36
I20260709 12:14:06.973251 23861 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 35 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:14:06.973721 23861 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 35 FOLLOWER]: Advancing to term 36
W20260709 12:14:06.976738 13726 leader_election.cc:336] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 36 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:06.970860 23846 raft_consensus.cc:2804] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:14:06.984530 23846 raft_consensus.cc:493] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:14:06.990060 23846 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Advancing to term 29
W20260709 12:14:07.002662 14379 consensus_peers.cc:597] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:07.019289 14379 consensus_peers.cc:597] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:14:07.042037 13759 raft_consensus.cc:1275] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 28 index: 21. Preceding OpId from leader: term: 29 index: 22. (index mismatch)
I20260709 12:14:07.047778 23868 consensus_queue.cc:1048] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.001s
I20260709 12:14:07.025274 23861 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 36 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:07.064066 23861 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 36 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:14:07.066745 13726 leader_election.cc:336] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 36 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:07.068611 23846 raft_consensus.cc:515] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:07.082777 14409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b889ec5fe4445d81fe94e0ae9fb087" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 36 candidate_status { last_received { term: 35 index: 22 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:14:07.083539 14409 raft_consensus.cc:3060] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 35 FOLLOWER]: Advancing to term 36
I20260709 12:14:07.100524 23846 leader_election.cc:290] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:14:07.103266 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3056e0d375412a9db3769da3ef2eb9" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 29 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:14:07.104054 13763 raft_consensus.cc:3060] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Advancing to term 29
W20260709 12:14:07.105997 13800 leader_election.cc:336] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:07.128584 14409 raft_consensus.cc:2468] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 36 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 36.
I20260709 12:14:07.163401 13763 raft_consensus.cc:2468] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 29.
W20260709 12:14:07.174816 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 80177.1us
I20260709 12:14:07.194238 13800 leader_election.cc:304] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:07.195417 23846 raft_consensus.cc:2804] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:14:07.196039 23846 raft_consensus.cc:697] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 29 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:14:07.192241 13727 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 36 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:07.199695 23878 raft_consensus.cc:2804] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 36 FOLLOWER]: Leader election won for term 36
I20260709 12:14:07.200227 23878 raft_consensus.cc:697] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 36 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:14:07.197120 23846 consensus_queue.cc:237] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 28.15, Last appended by leader: 15, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:07.201108 23878 consensus_queue.cc:237] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 35.22, Last appended by leader: 22, Current term: 36, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:07.251183 13831 consensus_queue.cc:237] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:14:07.248926 13579 catalog_manager.cc:5697] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 28 to 29, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 29 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:07.285540 13582 catalog_manager.cc:5697] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 35 to 36, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 36 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:07.330673 13801 consensus_peers.cc:597] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd -> Peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Couldn't send request to peer ca9fbbc2c0a94897897d502d42f3951f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d43dfb2e8dc04299ad696b99238cf41a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:07.340364 13761 raft_consensus.cc:1275] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 12:14:07.347988 23846 consensus_queue.cc:1048] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 12:14:07.350584 13570 catalog_manager.cc:4755] TS b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet d8f8986661dd4d049ab4a79338d33a1a: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
W20260709 12:14:07.350988 13800 consensus_peers.cc:597] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:07.384672 23846 raft_consensus.cc:2955] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 25 LEADER]: Committing config change with OpId 25.16: config changed from index -1 to 16, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:14:07.393666 13763 raft_consensus.cc:2955] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Committing config change with OpId 25.16: config changed from index -1 to 16, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:14:07.416823 13582 catalog_manager.cc:5697] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd reported cstate change: config changed from index -1 to 16, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New cstate: current_term: 25 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:07.422695 13726 consensus_peers.cc:597] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:07.468773 13634 auto_rebalancer.cc:629] Failed to schedule move for tablet 14d7a26ca33940fbba5fa30c5212e5ac: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
I20260709 12:14:07.476441 13763 consensus_queue.cc:237] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:14:07.503782 13831 raft_consensus.cc:1275] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
W20260709 12:14:07.506103 13727 consensus_peers.cc:597] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Couldn't send request to peer ca9fbbc2c0a94897897d502d42f3951f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0a8c7c772cf44d36bc44b25edc405d1d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:07.507076 23842 consensus_queue.cc:1048] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
W20260709 12:14:07.522852 14379 consensus_peers.cc:597] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:07.573184 13726 consensus_peers.cc:597] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:07.617709 13726 consensus_peers.cc:597] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:14:07.618889 23842 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:14:07.620149 23842 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:07.622093 23842 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:14:07.623613 23878 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 32 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:14:07.624300 23878 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:07.626673 23878 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:14:07.636272 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 31 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:14:07.644374 13726 leader_election.cc:336] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
W20260709 12:14:07.645066 13726 leader_election.cc:336] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 33 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
W20260709 12:14:07.662082 14379 consensus_peers.cc:597] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:07.678072 13800 consensus_peers.cc:597] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:07.678881 23876 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:14:07.679589 23876 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:07.682397 23876 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:14:07.684432 13727 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:07.685410 23902 raft_consensus.cc:2955] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 LEADER]: Committing config change with OpId 26.18: config changed from index -1 to 18, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:14:07.686748 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:07.685431 23878 raft_consensus.cc:2749] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:14:07.700912 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 31 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:14:07.701848 13763 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 30.
I20260709 12:14:07.706435 13800 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:14:07.707561 23876 raft_consensus.cc:2804] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:14:07.689670 13831 raft_consensus.cc:2955] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Committing config change with OpId 26.18: config changed from index -1 to 18, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:14:07.708031 23876 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:14:07.708523 23876 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Advancing to term 31
W20260709 12:14:07.713737 13800 leader_election.cc:336] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
I20260709 12:14:07.720209 13763 consensus_queue.cc:237] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 30.17, Last appended by leader: 16, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:14:07.729526 13582 catalog_manager.cc:5697] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: config changed from index -1 to 18, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New cstate: current_term: 26 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:07.732824 13727 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:07.736321 23878 raft_consensus.cc:2749] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
W20260709 12:14:07.752805 13726 consensus_peers.cc:597] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:07.754690 23876 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:07.763526 14407 raft_consensus.cc:1275] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 36 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 35 index: 22. Preceding OpId from leader: term: 36 index: 23. (index mismatch)
I20260709 12:14:07.757685 23876 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 31 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:14:07.776418 13761 raft_consensus.cc:1275] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 28 index: 15. Preceding OpId from leader: term: 29 index: 16. (index mismatch)
I20260709 12:14:07.780766 13763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 31 candidate_status { last_received { term: 30 index: 17 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:14:07.781492 13763 raft_consensus.cc:3060] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:14:07.784471 23859 consensus_queue.cc:1048] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 12:14:07.787703 13800 leader_election.cc:336] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 31 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
W20260709 12:14:07.791520 13726 consensus_peers.cc:597] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:07.797025 14379 consensus_peers.cc:597] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:14:07.807996 23843 consensus_queue.cc:1048] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.001s
I20260709 12:14:07.815204 13831 raft_consensus.cc:1275] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 30 index: 17. Preceding OpId from leader: term: 30 index: 18. (index mismatch)
I20260709 12:14:07.822522 23843 consensus_queue.cc:1048] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
W20260709 12:14:07.826125 13727 consensus_peers.cc:597] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341): Couldn't send request to peer ca9fbbc2c0a94897897d502d42f3951f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a2541d5a960c4a8ba1d642e9a29fd19c. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:07.835266 13726 consensus_peers.cc:597] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:07.843552 13726 consensus_peers.cc:597] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:14:07.843796 13763 raft_consensus.cc:2468] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 31.
I20260709 12:14:07.847695 13800 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:07.849574 23859 raft_consensus.cc:2804] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 31 FOLLOWER]: Leader election won for term 31
I20260709 12:14:07.850452 23859 raft_consensus.cc:697] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 31 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:14:07.853031 13836 raft_consensus.cc:2955] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Committing config change with OpId 30.18: config changed from index -1 to 18, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:14:07.850584 23843 raft_consensus.cc:2955] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 LEADER]: Committing config change with OpId 30.18: config changed from index -1 to 18, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } } }
I20260709 12:14:07.856555 23859 consensus_queue.cc:237] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 30.17, Last appended by leader: 17, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:07.883514 23912 ts_tablet_manager.cc:933] T d43dfb2e8dc04299ad696b99238cf41a P ca9fbbc2c0a94897897d502d42f3951f: Initiating tablet copy from peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:14:07.886574 23912 tablet_copy_client.cc:323] T d43dfb2e8dc04299ad696b99238cf41a P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Beginning tablet copy session from remote peer at address 127.12.56.195:36603
I20260709 12:14:07.902056 13847 tablet_copy_service.cc:140] P 96701a74fdee481fb5f54aac841e17dd: Received BeginTabletCopySession request for tablet d43dfb2e8dc04299ad696b99238cf41a from peer ca9fbbc2c0a94897897d502d42f3951f ({username='slave'} at 127.0.0.1:35422)
I20260709 12:14:07.902997 13847 tablet_copy_service.cc:161] P 96701a74fdee481fb5f54aac841e17dd: Beginning new tablet copy session on tablet d43dfb2e8dc04299ad696b99238cf41a from peer ca9fbbc2c0a94897897d502d42f3951f at {username='slave'} at 127.0.0.1:35422: session id = ca9fbbc2c0a94897897d502d42f3951f-d43dfb2e8dc04299ad696b99238cf41a
W20260709 12:14:07.910287 14379 consensus_peers.cc:597] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:14:07.936220 23908 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:14:07.937429 23908 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:07.942474 23908 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:14:07.944062 13836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:07.942039 23876 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 32 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
W20260709 12:14:07.944772 13726 consensus_peers.cc:597] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:07.949982 13726 consensus_peers.cc:597] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:14:07.954375 23876 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:07.956670 23876 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:14:07.960019 13847 tablet_copy_source_session.cc:215] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:14:07.972513 23912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d43dfb2e8dc04299ad696b99238cf41a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:14:07.976418 14379 leader_election.cc:336] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
I20260709 12:14:07.930089 23859 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:14:07.982523 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:14:07.983337 13761 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 32.
I20260709 12:14:07.986811 13800 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:14:07.991240 23846 raft_consensus.cc:2804] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260709 12:14:07.991837 23846 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 32 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:14:07.992297 23846 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 32 FOLLOWER]: Advancing to term 33
W20260709 12:14:08.004442 14379 consensus_peers.cc:597] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:14:08.005407 23846 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 33 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:08.007704 23846 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 33 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:14:08.012866 13582 catalog_manager.cc:5697] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 30 to 31, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 31 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:07.985765 23859 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:08.025454 13836 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 25.
I20260709 12:14:08.029348 14380 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:08.031678 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 33 candidate_status { last_received { term: 32 index: 20 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7"
I20260709 12:14:08.032546 13761 raft_consensus.cc:3060] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 32 FOLLOWER]: Advancing to term 33
I20260709 12:14:08.050812 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:14:08.051991 23859 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:14:08.042210 23868 raft_consensus.cc:2804] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:14:08.058882 23868 raft_consensus.cc:493] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:14:08.059337 23868 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:14:08.051765 13761 raft_consensus.cc:2468] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 33.
I20260709 12:14:08.080935 13579 catalog_manager.cc:5697] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: config changed from index -1 to 18, NON_VOTER ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) added. New cstate: current_term: 30 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:08.082199 13726 consensus_peers.cc:597] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:08.091602 14379 consensus_peers.cc:597] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:14:08.097301 23912 tablet_copy_client.cc:806] T d43dfb2e8dc04299ad696b99238cf41a P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 0 data blocks...
I20260709 12:14:08.099617 23912 tablet_copy_client.cc:670] T d43dfb2e8dc04299ad696b99238cf41a P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:14:08.102058 23918 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 37 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:14:08.102691 23918 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 37 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:08.105177 23918 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 38 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:14:08.098563 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 55903.9us
I20260709 12:14:08.110842 13800 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 33 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:14:08.116751 23912 tablet_copy_client.cc:538] T d43dfb2e8dc04299ad696b99238cf41a P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:14:08.120852 13800 consensus_peers.cc:597] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:08.121658 13800 leader_election.cc:336] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 33 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
W20260709 12:14:08.125818 13800 leader_election.cc:336] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 33 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
W20260709 12:14:08.127136 13800 leader_election.cc:336] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
W20260709 12:14:08.128445 13726 consensus_peers.cc:597] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:14:08.120857 23919 raft_consensus.cc:2804] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 33 FOLLOWER]: Leader election won for term 33
W20260709 12:14:08.137847 13726 consensus_peers.cc:597] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:14:08.138396 13761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 38 candidate_status { last_received { term: 37 index: 19 } } ignore_live_leader: false dest_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" is_pre_election: true
I20260709 12:14:08.156824 23924 ts_tablet_manager.cc:933] T 0a8c7c772cf44d36bc44b25edc405d1d P ca9fbbc2c0a94897897d502d42f3951f: Initiating tablet copy from peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:14:08.157135 12515 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 13709)
I20260709 12:14:08.133947 23919 raft_consensus.cc:697] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 33 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:14:08.159237 23919 consensus_queue.cc:237] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 32.20, Last appended by leader: 20, Current term: 33, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:14:08.163939 13726 consensus_peers.cc:597] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:08.167712 13800 leader_election.cc:336] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 38 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
I20260709 12:14:08.169140 13800 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 38 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:08.190416 23868 raft_consensus.cc:515] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:14:08.212581 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 44915.1us
W20260709 12:14:08.221583 13726 consensus_peers.cc:597] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:14:08.223655 14410 raft_consensus.cc:2393] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96701a74fdee481fb5f54aac841e17dd in current term 26: Already voted for candidate ca9fbbc2c0a94897897d502d42f3951f in this term.
I20260709 12:14:08.224067 23923 raft_consensus.cc:2749] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 37 FOLLOWER]: Leader pre-election lost for term 38. Reason: could not achieve majority
I20260709 12:14:08.225880 13801 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:14:08.226850 23918 raft_consensus.cc:3060] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:14:08.259176 13726 consensus_peers.cc:597] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:08.260033 13726 consensus_peers.cc:597] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:14:08.262915 23924 tablet_copy_client.cc:323] T 0a8c7c772cf44d36bc44b25edc405d1d P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Beginning tablet copy session from remote peer at address 127.12.56.194:39545
I20260709 12:14:08.267486 13773 tablet_copy_service.cc:140] P 3f37c9cc9dda46b4be21dd675ba78fb7: Received BeginTabletCopySession request for tablet 0a8c7c772cf44d36bc44b25edc405d1d from peer ca9fbbc2c0a94897897d502d42f3951f ({username='slave'} at 127.0.0.1:38932)
I20260709 12:14:08.268595 13773 tablet_copy_service.cc:161] P 3f37c9cc9dda46b4be21dd675ba78fb7: Beginning new tablet copy session on tablet 0a8c7c772cf44d36bc44b25edc405d1d from peer ca9fbbc2c0a94897897d502d42f3951f at {username='slave'} at 127.0.0.1:38932: session id = ca9fbbc2c0a94897897d502d42f3951f-0a8c7c772cf44d36bc44b25edc405d1d
I20260709 12:14:08.279007 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c0f10b06fa4aa48a99239da6d81a1f" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:14:08.284837 23868 leader_election.cc:290] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:14:08.297079 14379 leader_election.cc:336] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
I20260709 12:14:08.311090 13773 tablet_copy_source_session.cc:215] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:14:08.324273 13726 consensus_peers.cc:597] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:08.327755 13800 consensus_peers.cc:597] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:14:08.330462 13582 catalog_manager.cc:5697] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 32 to 33, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 33 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:08.322098 23902 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 37 FOLLOWER]: Starting pre-election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:14:08.334697 23902 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 37 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:08.340806 23924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a8c7c772cf44d36bc44b25edc405d1d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:14:08.325625 13726 consensus_peers.cc:597] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:08.336894 13800 consensus_peers.cc:597] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:08.346299 13726 consensus_peers.cc:597] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:08.354837 13726 consensus_peers.cc:597] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:14:08.375662 23912 tablet_bootstrap.cc:492] T d43dfb2e8dc04299ad696b99238cf41a P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap starting.
W20260709 12:14:08.396304 14379 consensus_peers.cc:597] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:08.398615 13726 consensus_peers.cc:597] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:14:08.403911 13763 raft_consensus.cc:1275] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 30 index: 17. Preceding OpId from leader: term: 31 index: 18. (index mismatch)
I20260709 12:14:08.380451 23918 raft_consensus.cc:2749] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:14:08.422271 23921 consensus_queue.cc:1048] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.004s
I20260709 12:14:08.425828 23902 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 38 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:14:08.431318 13726 consensus_peers.cc:597] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:14:08.435238 23928 ts_tablet_manager.cc:933] T a2541d5a960c4a8ba1d642e9a29fd19c P ca9fbbc2c0a94897897d502d42f3951f: Initiating tablet copy from peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:14:08.437846 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 38 candidate_status { last_received { term: 37 index: 19 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:08.438567 13828 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 37 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 37.
I20260709 12:14:08.446924 13727 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 38 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: 
I20260709 12:14:08.448736 23902 raft_consensus.cc:2804] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 37 FOLLOWER]: Leader pre-election won for term 38
I20260709 12:14:08.449286 23902 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 37 FOLLOWER]: Starting leader election (detected failure of leader b98d2519bb504dc6905ed2ede4571835)
I20260709 12:14:08.449748 23902 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 37 FOLLOWER]: Advancing to term 38
I20260709 12:14:08.461083 13831 raft_consensus.cc:2468] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 26.
W20260709 12:14:08.455345 13726 leader_election.cc:336] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 38 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
I20260709 12:14:08.468283 14380 leader_election.cc:304] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:08.474351 23926 raft_consensus.cc:2804] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:14:08.475179 23926 raft_consensus.cc:697] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 26 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:14:08.476606 23926 consensus_queue.cc:237] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:08.517472 23928 tablet_copy_client.cc:323] T a2541d5a960c4a8ba1d642e9a29fd19c P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Beginning tablet copy session from remote peer at address 127.12.56.194:39545
I20260709 12:14:08.525928 13773 tablet_copy_service.cc:140] P 3f37c9cc9dda46b4be21dd675ba78fb7: Received BeginTabletCopySession request for tablet a2541d5a960c4a8ba1d642e9a29fd19c from peer ca9fbbc2c0a94897897d502d42f3951f ({username='slave'} at 127.0.0.1:38932)
I20260709 12:14:08.532171 13773 tablet_copy_service.cc:161] P 3f37c9cc9dda46b4be21dd675ba78fb7: Beginning new tablet copy session on tablet a2541d5a960c4a8ba1d642e9a29fd19c from peer ca9fbbc2c0a94897897d502d42f3951f at {username='slave'} at 127.0.0.1:38932: session id = ca9fbbc2c0a94897897d502d42f3951f-a2541d5a960c4a8ba1d642e9a29fd19c
I20260709 12:14:08.532310 23902 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 38 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:14:08.547075 13726 consensus_peers.cc:597] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:14:08.564514 23902 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 38 election: Requested vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:14:08.569288 13831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1494f6353074242857c7901c21da06d" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 38 candidate_status { last_received { term: 37 index: 19 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
I20260709 12:14:08.570303 13831 raft_consensus.cc:3060] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 37 FOLLOWER]: Advancing to term 38
I20260709 12:14:08.591934 13773 tablet_copy_source_session.cc:215] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:14:08.597731 13726 leader_election.cc:336] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 38 election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
W20260709 12:14:08.599865 13570 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 63222.7us
W20260709 12:14:08.620103 13800 consensus_peers.cc:597] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:08.641415 13579 catalog_manager.cc:5697] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 25 to 26, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 26 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:08.645164 13831 raft_consensus.cc:2468] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 38 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f37c9cc9dda46b4be21dd675ba78fb7 in term 38.
I20260709 12:14:08.666689 23924 tablet_copy_client.cc:806] T 0a8c7c772cf44d36bc44b25edc405d1d P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 0 data blocks...
I20260709 12:14:08.668593 23928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2541d5a960c4a8ba1d642e9a29fd19c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:08.680209 13727 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 38 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835
W20260709 12:14:08.680220 13800 consensus_peers.cc:597] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:14:08.691991 23861 raft_consensus.cc:2804] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 38 FOLLOWER]: Leader election won for term 38
I20260709 12:14:08.692659 23861 raft_consensus.cc:697] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 38 LEADER]: Becoming Leader. State: Replica: 3f37c9cc9dda46b4be21dd675ba78fb7, State: Running, Role: LEADER
I20260709 12:14:08.693940 23861 consensus_queue.cc:237] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 37.19, Last appended by leader: 19, Current term: 38, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:14:08.698201 14379 consensus_peers.cc:597] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:08.679425 13726 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111) [suppressed 456 similar messages]
I20260709 12:14:08.702487 23924 tablet_copy_client.cc:670] T 0a8c7c772cf44d36bc44b25edc405d1d P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 1 WAL segments...
I20260709 12:14:08.857038 23924 tablet_copy_client.cc:538] T 0a8c7c772cf44d36bc44b25edc405d1d P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:14:08.868170 13570 catalog_manager.cc:4755] TS b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet d8f8986661dd4d049ab4a79338d33a1a: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
I20260709 12:14:08.894243 13759 raft_consensus.cc:1275] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 33 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 32 index: 20. Preceding OpId from leader: term: 33 index: 21. (index mismatch)
W20260709 12:14:08.931622 13726 consensus_peers.cc:597] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:08.917625 14379 consensus_peers.cc:597] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:08.920768 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 51572us
I20260709 12:14:08.947736 23919 consensus_queue.cc:1048] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.001s
W20260709 12:14:08.940903 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 59374.6us
W20260709 12:14:08.982249 14379 consensus_peers.cc:597] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:08.983757 14379 consensus_peers.cc:597] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:08.990578 13800 consensus_peers.cc:597] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:08.990980 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 102933us
I20260709 12:14:09.007328 23924 tablet_bootstrap.cc:492] T 0a8c7c772cf44d36bc44b25edc405d1d P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap starting.
I20260709 12:14:09.079200 13579 catalog_manager.cc:5697] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: term changed from 37 to 38, leader changed from b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) to 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194). New cstate: current_term: 38 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:09.083912 23928 tablet_copy_client.cc:806] T a2541d5a960c4a8ba1d642e9a29fd19c P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 0 data blocks...
I20260709 12:14:09.087666 23928 tablet_copy_client.cc:670] T a2541d5a960c4a8ba1d642e9a29fd19c P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Starting download of 1 WAL segments...
W20260709 12:14:09.123524 14379 consensus_peers.cc:597] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:09.148762 13828 raft_consensus.cc:1275] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
W20260709 12:14:09.158157 12515 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 13709)
I20260709 12:14:09.164072 23936 consensus_queue.cc:1048] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:14:09.181185 23912 tablet_bootstrap.cc:492] T d43dfb2e8dc04299ad696b99238cf41a P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap replayed 1/1 log segments. Stats: ops{read=17 overwritten=1 applied=16 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:09.211341 23928 tablet_copy_client.cc:538] T a2541d5a960c4a8ba1d642e9a29fd19c P ca9fbbc2c0a94897897d502d42f3951f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:14:09.241572 13726 consensus_peers.cc:597] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:14:09.349431 23912 tablet_bootstrap.cc:492] T d43dfb2e8dc04299ad696b99238cf41a P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap complete.
I20260709 12:14:09.398559 13828 raft_consensus.cc:1275] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 38 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 37 index: 19. Preceding OpId from leader: term: 38 index: 20. (index mismatch)
W20260709 12:14:09.428473 13800 consensus_peers.cc:597] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:09.448366 23912 ts_tablet_manager.cc:1403] T d43dfb2e8dc04299ad696b99238cf41a P ca9fbbc2c0a94897897d502d42f3951f: Time spent bootstrapping tablet: real 1.115s	user 0.065s	sys 0.027s
I20260709 12:14:09.487795 23948 consensus_queue.cc:1048] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 12:14:09.491402 23928 tablet_bootstrap.cc:492] T a2541d5a960c4a8ba1d642e9a29fd19c P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap starting.
W20260709 12:14:09.507784 13726 consensus_peers.cc:597] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:09.550628 23912 raft_consensus.cc:359] T d43dfb2e8dc04299ad696b99238cf41a P ca9fbbc2c0a94897897d502d42f3951f [term 25 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:14:09.551828 23912 raft_consensus.cc:740] T d43dfb2e8dc04299ad696b99238cf41a P ca9fbbc2c0a94897897d502d42f3951f [term 25 LEARNER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Initialized, Role: LEARNER
I20260709 12:14:09.553546 23912 consensus_queue.cc:260] T d43dfb2e8dc04299ad696b99238cf41a P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:14:09.573758 23912 ts_tablet_manager.cc:1434] T d43dfb2e8dc04299ad696b99238cf41a P ca9fbbc2c0a94897897d502d42f3951f: Time spent starting tablet: real 0.125s	user 0.006s	sys 0.003s
I20260709 12:14:09.590703 13847 tablet_copy_service.cc:342] P 96701a74fdee481fb5f54aac841e17dd: Request end of tablet copy session ca9fbbc2c0a94897897d502d42f3951f-d43dfb2e8dc04299ad696b99238cf41a received from {username='slave'} at 127.0.0.1:35422
I20260709 12:14:09.592003 13847 tablet_copy_service.cc:434] P 96701a74fdee481fb5f54aac841e17dd: ending tablet copy session ca9fbbc2c0a94897897d502d42f3951f-d43dfb2e8dc04299ad696b99238cf41a on tablet d43dfb2e8dc04299ad696b99238cf41a with peer ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:14:09.705380 14379 consensus_peers.cc:597] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:09.810698 14379 consensus_peers.cc:597] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:09.900100 13726 consensus_peers.cc:597] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:14:09.923892 14407 raft_consensus.cc:1217] T d43dfb2e8dc04299ad696b99238cf41a P ca9fbbc2c0a94897897d502d42f3951f [term 25 LEARNER]: Deduplicated request from leader. Original: 25.15->[25.16-25.16]   Dedup: 25.16->[]
I20260709 12:14:10.075421 23924 tablet_bootstrap.cc:492] T 0a8c7c772cf44d36bc44b25edc405d1d P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap replayed 1/1 log segments. Stats: ops{read=20 overwritten=2 applied=18 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:10.090483 23924 tablet_bootstrap.cc:492] T 0a8c7c772cf44d36bc44b25edc405d1d P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap complete.
I20260709 12:14:10.095994 23924 ts_tablet_manager.cc:1403] T 0a8c7c772cf44d36bc44b25edc405d1d P ca9fbbc2c0a94897897d502d42f3951f: Time spent bootstrapping tablet: real 1.089s	user 0.063s	sys 0.026s
W20260709 12:14:10.098665 13800 consensus_peers.cc:597] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:10.119859 23924 raft_consensus.cc:359] T 0a8c7c772cf44d36bc44b25edc405d1d P ca9fbbc2c0a94897897d502d42f3951f [term 26 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:14:10.123435 23924 raft_consensus.cc:740] T 0a8c7c772cf44d36bc44b25edc405d1d P ca9fbbc2c0a94897897d502d42f3951f [term 26 LEARNER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Initialized, Role: LEARNER
I20260709 12:14:10.124626 23924 consensus_queue.cc:260] T 0a8c7c772cf44d36bc44b25edc405d1d P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 18, Last appended: 26.18, Last appended by leader: 18, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:14:10.127513 23928 tablet_bootstrap.cc:492] T a2541d5a960c4a8ba1d642e9a29fd19c P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap replayed 1/1 log segments. Stats: ops{read=19 overwritten=1 applied=18 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:10.135596 23928 tablet_bootstrap.cc:492] T a2541d5a960c4a8ba1d642e9a29fd19c P ca9fbbc2c0a94897897d502d42f3951f: Bootstrap complete.
I20260709 12:14:10.136487 23928 ts_tablet_manager.cc:1403] T a2541d5a960c4a8ba1d642e9a29fd19c P ca9fbbc2c0a94897897d502d42f3951f: Time spent bootstrapping tablet: real 0.645s	user 0.064s	sys 0.020s
I20260709 12:14:10.136919 23924 ts_tablet_manager.cc:1434] T 0a8c7c772cf44d36bc44b25edc405d1d P ca9fbbc2c0a94897897d502d42f3951f: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.001s
W20260709 12:14:10.148180 13726 consensus_peers.cc:597] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:10.150218 13773 tablet_copy_service.cc:342] P 3f37c9cc9dda46b4be21dd675ba78fb7: Request end of tablet copy session ca9fbbc2c0a94897897d502d42f3951f-0a8c7c772cf44d36bc44b25edc405d1d received from {username='slave'} at 127.0.0.1:38932
I20260709 12:14:10.150756 23928 raft_consensus.cc:359] T a2541d5a960c4a8ba1d642e9a29fd19c P ca9fbbc2c0a94897897d502d42f3951f [term 30 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
I20260709 12:14:10.153293 23928 raft_consensus.cc:740] T a2541d5a960c4a8ba1d642e9a29fd19c P ca9fbbc2c0a94897897d502d42f3951f [term 30 LEARNER]: Becoming Follower/Learner. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Initialized, Role: LEARNER
I20260709 12:14:10.151079 13773 tablet_copy_service.cc:434] P 3f37c9cc9dda46b4be21dd675ba78fb7: ending tablet copy session ca9fbbc2c0a94897897d502d42f3951f-0a8c7c772cf44d36bc44b25edc405d1d on tablet 0a8c7c772cf44d36bc44b25edc405d1d with peer ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:14:10.155381 13726 consensus_peers.cc:597] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:10.159090 12515 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 13709)
I20260709 12:14:10.166098 23928 consensus_queue.cc:260] T a2541d5a960c4a8ba1d642e9a29fd19c P ca9fbbc2c0a94897897d502d42f3951f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 18, Last appended: 30.18, Last appended by leader: 18, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: NON_VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: true } }
W20260709 12:14:10.181659 13726 consensus_peers.cc:597] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:14:10.194689 23928 ts_tablet_manager.cc:1434] T a2541d5a960c4a8ba1d642e9a29fd19c P ca9fbbc2c0a94897897d502d42f3951f: Time spent starting tablet: real 0.058s	user 0.007s	sys 0.002s
I20260709 12:14:10.196727 13773 tablet_copy_service.cc:342] P 3f37c9cc9dda46b4be21dd675ba78fb7: Request end of tablet copy session ca9fbbc2c0a94897897d502d42f3951f-a2541d5a960c4a8ba1d642e9a29fd19c received from {username='slave'} at 127.0.0.1:38932
I20260709 12:14:10.197297 13773 tablet_copy_service.cc:434] P 3f37c9cc9dda46b4be21dd675ba78fb7: ending tablet copy session ca9fbbc2c0a94897897d502d42f3951f-a2541d5a960c4a8ba1d642e9a29fd19c on tablet a2541d5a960c4a8ba1d642e9a29fd19c with peer ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:14:10.227843 14407 raft_consensus.cc:1217] T 0a8c7c772cf44d36bc44b25edc405d1d P ca9fbbc2c0a94897897d502d42f3951f [term 26 LEARNER]: Deduplicated request from leader. Original: 26.17->[26.18-26.18]   Dedup: 26.18->[]
W20260709 12:14:10.239964 13726 consensus_peers.cc:597] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:10.280576 14379 consensus_peers.cc:597] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:10.294819 13726 consensus_peers.cc:597] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:14:10.321671 14407 raft_consensus.cc:1217] T a2541d5a960c4a8ba1d642e9a29fd19c P ca9fbbc2c0a94897897d502d42f3951f [term 30 LEARNER]: Deduplicated request from leader. Original: 30.17->[30.18-30.18]   Dedup: 30.18->[]
W20260709 12:14:10.370043 13800 consensus_peers.cc:597] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:10.433504 14379 consensus_peers.cc:597] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:10.438901 14379 consensus_peers.cc:597] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:10.479101 14379 consensus_peers.cc:597] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:10.484050 13726 consensus_peers.cc:597] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:10.520216 14379 consensus_peers.cc:597] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:10.570204 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 50056.5us
I20260709 12:14:10.626240 23921 raft_consensus.cc:1064] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd: attempting to promote NON_VOTER ca9fbbc2c0a94897897d502d42f3951f to VOTER
I20260709 12:14:10.643923 23921 consensus_queue.cc:237] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 14, Current term: 25, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:14:10.679277 13726 consensus_peers.cc:597] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:14:10.713143 14409 raft_consensus.cc:1275] T d43dfb2e8dc04299ad696b99238cf41a P ca9fbbc2c0a94897897d502d42f3951f [term 25 LEARNER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 12:14:10.715755 23921 consensus_queue.cc:1048] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 12:14:10.763438 13726 consensus_peers.cc:597] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:10.779218 13726 consensus_peers.cc:597] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:10.804858 13726 consensus_peers.cc:597] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:10.809027 13726 consensus_peers.cc:597] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:14:10.811247 13763 raft_consensus.cc:1275] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
W20260709 12:14:10.828385 13726 consensus_peers.cc:597] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:10.829923 13726 consensus_peers.cc:597] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:10.852658 13726 consensus_peers.cc:597] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:10.858652 13726 consensus_peers.cc:597] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:10.879230 13726 consensus_peers.cc:597] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:10.897930 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 143382us
W20260709 12:14:10.905084 14379 consensus_peers.cc:597] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:10.920849 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 64564.6us
I20260709 12:14:10.926481 23859 consensus_queue.cc:1048] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 12:14:10.949911 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 79425.7us
W20260709 12:14:10.962790 13726 consensus_peers.cc:597] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:10.953795 13800 consensus_peers.cc:597] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:10.968278 14379 consensus_peers.cc:597] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:10.978083 13726 consensus_peers.cc:597] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:11.008347 13800 consensus_peers.cc:597] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:11.021333 23961 raft_consensus.cc:1064] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7: attempting to promote NON_VOTER ca9fbbc2c0a94897897d502d42f3951f to VOTER
I20260709 12:14:11.028688 23903 raft_consensus.cc:1064] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7: attempting to promote NON_VOTER ca9fbbc2c0a94897897d502d42f3951f to VOTER
I20260709 12:14:11.024994 23961 consensus_queue.cc:237] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 30.18, Last appended by leader: 16, Current term: 30, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:11.033203 23903 consensus_queue.cc:237] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.18, Last appended by leader: 16, Current term: 26, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:14:11.045881 13800 consensus_peers.cc:597] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:11.046597 13800 consensus_peers.cc:597] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:11.056311 23859 raft_consensus.cc:2955] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 25 LEADER]: Committing config change with OpId 25.17: config changed from index 16 to 17, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:14:11.089921 14409 raft_consensus.cc:1275] T 0a8c7c772cf44d36bc44b25edc405d1d P ca9fbbc2c0a94897897d502d42f3951f [term 26 LEARNER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
W20260709 12:14:11.101756 13726 consensus_peers.cc:597] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:11.113142 13830 raft_consensus.cc:1275] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 12:14:11.113924 23940 consensus_queue.cc:1048] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
W20260709 12:14:11.133885 13570 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 125666us
W20260709 12:14:11.135247 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 56265.1us
W20260709 12:14:11.138561 13570 catalog_manager.cc:4755] TS b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet d8f8986661dd4d049ab4a79338d33a1a: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
I20260709 12:14:11.138357 14407 raft_consensus.cc:2955] T d43dfb2e8dc04299ad696b99238cf41a P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Committing config change with OpId 25.17: config changed from index 16 to 17, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:14:11.141052 13761 raft_consensus.cc:2955] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Committing config change with OpId 25.17: config changed from index 16 to 17, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
W20260709 12:14:11.159664 12515 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 13709)
I20260709 12:14:11.165766 13582 catalog_manager.cc:5697] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd reported cstate change: config changed from index 16 to 17, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New cstate: current_term: 25 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:11.186492 23961 consensus_queue.cc:1048] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:14:11.188120 14410 raft_consensus.cc:1275] T a2541d5a960c4a8ba1d642e9a29fd19c P ca9fbbc2c0a94897897d502d42f3951f [term 30 LEARNER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 30 index: 18. Preceding OpId from leader: term: 30 index: 19. (index mismatch)
I20260709 12:14:11.191402 13830 raft_consensus.cc:1275] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 30 index: 18. Preceding OpId from leader: term: 30 index: 19. (index mismatch)
W20260709 12:14:11.224905 13726 consensus_peers.cc:597] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:11.242398 13726 consensus_peers.cc:597] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:14:11.255048 23940 consensus_queue.cc:1048] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:14:11.258818 23842 consensus_queue.cc:1048] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
W20260709 12:14:11.284271 13726 consensus_peers.cc:597] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:11.284950 13726 consensus_peers.cc:597] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:11.305998 14379 consensus_peers.cc:597] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:11.317972 14379 consensus_peers.cc:597] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:11.318382 13800 consensus_peers.cc:597] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:11.349949 14379 consensus_peers.cc:597] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:11.389333 13800 consensus_peers.cc:597] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:11.402675 13726 consensus_peers.cc:597] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:11.403301 13726 consensus_peers.cc:597] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:14:11.402666 23947 raft_consensus.cc:2955] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 LEADER]: Committing config change with OpId 26.19: config changed from index 18 to 19, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:14:11.418094 23842 raft_consensus.cc:2955] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 LEADER]: Committing config change with OpId 30.19: config changed from index 18 to 19, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:14:11.443617 13830 raft_consensus.cc:2955] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Committing config change with OpId 26.19: config changed from index 18 to 19, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:14:11.447866 14409 raft_consensus.cc:2955] T a2541d5a960c4a8ba1d642e9a29fd19c P ca9fbbc2c0a94897897d502d42f3951f [term 30 FOLLOWER]: Committing config change with OpId 30.19: config changed from index 18 to 19, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:14:11.448096 14407 raft_consensus.cc:2955] T 0a8c7c772cf44d36bc44b25edc405d1d P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Committing config change with OpId 26.19: config changed from index 18 to 19, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:14:11.472354 13584 catalog_manager.cc:5697] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: config changed from index 18 to 19, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New cstate: current_term: 26 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:11.497318 13579 catalog_manager.cc:5697] T a2541d5a960c4a8ba1d642e9a29fd19c P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: config changed from index 18 to 19, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New cstate: current_term: 30 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
W20260709 12:14:11.515074 14379 consensus_peers.cc:597] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:11.528576 14379 consensus_peers.cc:597] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:11.620368 13831 raft_consensus.cc:2955] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Committing config change with OpId 30.19: config changed from index 18 to 19, ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196) changed from NON_VOTER to VOTER. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
W20260709 12:14:11.652779 13800 consensus_peers.cc:597] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:11.723853 13761 consensus_queue.cc:237] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 26.19, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:14:11.758208 13726 consensus_peers.cc:597] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:14:11.765077 14410 raft_consensus.cc:1275] T 0a8c7c772cf44d36bc44b25edc405d1d P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 26 index: 19. Preceding OpId from leader: term: 26 index: 20. (index mismatch)
I20260709 12:14:11.767318 13831 raft_consensus.cc:1275] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Refusing update from remote peer 3f37c9cc9dda46b4be21dd675ba78fb7: Log matching property violated. Preceding OpId in replica: term: 26 index: 19. Preceding OpId from leader: term: 26 index: 20. (index mismatch)
W20260709 12:14:11.775338 13800 consensus_peers.cc:597] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:11.808429 23947 consensus_queue.cc:1048] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 12:14:11.847996 23961 consensus_queue.cc:1048] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 12:14:11.883140 23903 raft_consensus.cc:2955] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 LEADER]: Committing config change with OpId 26.20: config changed from index 19 to 20, VOTER b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) evicted. New config: { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:14:11.908514 13579 catalog_manager.cc:5697] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 reported cstate change: config changed from index 19 to 20, VOTER b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) evicted. New cstate: current_term: 26 leader_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" committed_config { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:11.969314 13830 raft_consensus.cc:2955] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Committing config change with OpId 26.20: config changed from index 19 to 20, VOTER b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) evicted. New config: { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
W20260709 12:14:11.977823 13570 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 52491.6us
I20260709 12:14:11.981194 13570 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0a8c7c772cf44d36bc44b25edc405d1d with cas_config_opid_index 19: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:14:11.990140 14410 raft_consensus.cc:2955] T 0a8c7c772cf44d36bc44b25edc405d1d P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Committing config change with OpId 26.20: config changed from index 19 to 20, VOTER b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) evicted. New config: { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
W20260709 12:14:12.142222 13570 catalog_manager.cc:4755] TS b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 0a8c7c772cf44d36bc44b25edc405d1d: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
W20260709 12:14:12.165244 12515 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 13709)
W20260709 12:14:12.236807 13726 consensus_peers.cc:597] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:12.321834 14379 consensus_peers.cc:597] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:12.520104 13726 consensus_peers.cc:597] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:12.531782 14379 consensus_peers.cc:597] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:12.717065 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 82224.9us
W20260709 12:14:12.726209 13726 consensus_peers.cc:597] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:12.794855 14379 consensus_peers.cc:597] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:12.817683 13726 consensus_peers.cc:597] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:12.840816 13726 consensus_peers.cc:597] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:12.907663 14379 consensus_peers.cc:597] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:12.934787 13800 consensus_peers.cc:597] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:12.936744 13726 consensus_peers.cc:597] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:12.961803 14379 consensus_peers.cc:597] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:12.973937 14379 consensus_peers.cc:597] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:13.017069 14379 consensus_peers.cc:597] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:13.047624 13726 consensus_peers.cc:597] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:13.070781 13800 consensus_peers.cc:597] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:13.087025 13726 consensus_peers.cc:597] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:13.136907 13726 consensus_peers.cc:597] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:13.153103 13726 consensus_peers.cc:597] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:13.153455 14379 consensus_peers.cc:597] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:13.167392 12515 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 13709)
W20260709 12:14:13.175336 13726 consensus_peers.cc:597] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:13.212774 13570 catalog_manager.cc:4755] TS b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 0a8c7c772cf44d36bc44b25edc405d1d: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
W20260709 12:14:13.283458 13800 consensus_peers.cc:597] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:13.526624 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 125582us
W20260709 12:14:13.545359 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 283761us
W20260709 12:14:13.638615 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 359070us
W20260709 12:14:13.701368 13800 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111) [suppressed 438 similar messages]
W20260709 12:14:13.760664 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 59382.6us
W20260709 12:14:13.800959 14379 consensus_peers.cc:597] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:13.823530 13726 consensus_peers.cc:597] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:13.849720 14379 consensus_peers.cc:597] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:13.887892 13800 consensus_peers.cc:597] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:13.888787 13800 consensus_peers.cc:597] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:13.913318 14379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 47085.9us
W20260709 12:14:13.948050 13726 consensus_peers.cc:597] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:13.970482 13726 consensus_peers.cc:597] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:13.981910 13726 consensus_peers.cc:597] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:13.982046 13800 consensus_peers.cc:597] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:13.991706 13726 consensus_peers.cc:597] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:13.993094 13726 consensus_peers.cc:597] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:13.993700 13726 consensus_peers.cc:597] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:13.994390 13726 consensus_peers.cc:597] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:13.995024 13726 consensus_peers.cc:597] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:14.167917 12515 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 13709)
W20260709 12:14:14.230228 13800 consensus_peers.cc:597] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:14.254827 14379 consensus_peers.cc:597] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:14.255522 14379 consensus_peers.cc:597] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:14.267079 13726 consensus_peers.cc:597] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:14.279651 13726 consensus_peers.cc:597] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:14.306595 13726 consensus_peers.cc:597] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:14.319252 13800 consensus_peers.cc:597] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:14.327200 13800 consensus_peers.cc:597] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:14.516326 13617 debug-util.cc:398] Leaking SignalData structure 0x7b0800244160 after lost signal to thread 12518
W20260709 12:14:14.518002 13617 debug-util.cc:398] Leaking SignalData structure 0x7b0800338c40 after lost signal to thread 13620
W20260709 12:14:14.519811 13617 debug-util.cc:398] Leaking SignalData structure 0x7b08001945c0 after lost signal to thread 13787
W20260709 12:14:14.521384 13617 debug-util.cc:398] Leaking SignalData structure 0x7b0800325240 after lost signal to thread 13861
W20260709 12:14:14.552865 13617 debug-util.cc:398] Leaking SignalData structure 0x7b0800044c20 after lost signal to thread 14440
W20260709 12:14:14.554355 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 140182us
W20260709 12:14:14.651347 13726 consensus_peers.cc:597] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:14.748821 14379 consensus_peers.cc:597] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:14.777460 14379 consensus_peers.cc:597] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:14.846176 13570 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 170328us
W20260709 12:14:14.863718 13570 catalog_manager.cc:4755] TS b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 0a8c7c772cf44d36bc44b25edc405d1d: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
W20260709 12:14:14.923571 13726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 57889.2us
W20260709 12:14:15.135056 13726 consensus_peers.cc:597] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:15.136176 14379 consensus_peers.cc:597] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:15.168437 12515 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 13709)
I20260709 12:14:15.210268 14415 consensus_queue.cc:237] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 29.18, Last appended by leader: 17, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:15.252924 13831 raft_consensus.cc:1275] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 29 index: 18. Preceding OpId from leader: term: 29 index: 19. (index mismatch)
I20260709 12:14:15.258718 23985 consensus_queue.cc:1048] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:14:15.272713 13763 raft_consensus.cc:1275] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 29 index: 18. Preceding OpId from leader: term: 29 index: 19. (index mismatch)
W20260709 12:14:15.280892 13726 consensus_peers.cc:597] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:15.281584 13726 consensus_peers.cc:597] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:15.282222 13726 consensus_peers.cc:597] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:14:15.314877 23985 raft_consensus.cc:2955] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 29 LEADER]: Committing config change with OpId 29.19: config changed from index 10 to 19, VOTER b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) evicted. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:14:15.319521 13832 raft_consensus.cc:2955] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Committing config change with OpId 29.19: config changed from index 10 to 19, VOTER b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) evicted. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
I20260709 12:14:15.358511 23999 consensus_queue.cc:1048] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:14:15.414258 13571 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d2f365337b324999a073edacbe6c6e09 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 13)
W20260709 12:14:15.419129 13784 debug-util.cc:398] Leaking SignalData structure 0x7b08002703e0 after lost signal to thread 12518
W20260709 12:14:15.420378 13784 debug-util.cc:398] Leaking SignalData structure 0x7b080003fee0 after lost signal to thread 13620
W20260709 12:14:15.421840 24004 log.cc:927] Time spent T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f: Append to log took a long time: real 0.050s	user 0.014s	sys 0.006s
W20260709 12:14:15.421973 13784 debug-util.cc:398] Leaking SignalData structure 0x7b0800387ea0 after lost signal to thread 13787
I20260709 12:14:15.421406 13579 catalog_manager.cc:5697] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: config changed from index 10 to 19, VOTER b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) evicted. New cstate: current_term: 29 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:14:15.423405 13784 debug-util.cc:398] Leaking SignalData structure 0x7b08003dda20 after lost signal to thread 13861
W20260709 12:14:15.425148 13784 debug-util.cc:398] Leaking SignalData structure 0x7b0800141480 after lost signal to thread 14440
W20260709 12:14:15.486406 14379 consensus_peers.cc:597] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:14:15.506271 13758 raft_consensus.cc:2955] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Committing config change with OpId 29.19: config changed from index 10 to 19, VOTER b98d2519bb504dc6905ed2ede4571835 (127.12.56.193) evicted. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } } }
W20260709 12:14:15.516757 13800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39545, user_credentials={real_user=slave}} blocked reactor thread for 77770.8us
W20260709 12:14:15.662099 14379 consensus_peers.cc:597] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:15.687225 13800 consensus_peers.cc:597] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:15.727408 13726 consensus_peers.cc:597] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:15.730998 13726 consensus_peers.cc:597] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:15.751863 13726 consensus_peers.cc:597] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:15.782459 13726 consensus_peers.cc:597] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:15.784925 14379 consensus_peers.cc:597] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:15.856124 14379 consensus_peers.cc:597] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:15.905025 13800 consensus_peers.cc:597] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:15.910313 13726 consensus_peers.cc:597] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:15.916917 14379 consensus_peers.cc:597] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:15.917852 13726 consensus_peers.cc:597] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:15.957726 13570 catalog_manager.cc:4755] TS b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet d2f365337b324999a073edacbe6c6e09: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
W20260709 12:14:15.975769 14379 consensus_peers.cc:597] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:16.033018 13800 consensus_peers.cc:597] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:16.146893 14379 consensus_peers.cc:597] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:16.169067 12515 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 13709)
W20260709 12:14:16.175149 13800 consensus_peers.cc:597] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:16.196475 14379 consensus_peers.cc:597] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:16.208619 13800 consensus_peers.cc:597] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:16.437752 14379 consensus_peers.cc:597] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:16.504629 13726 consensus_peers.cc:597] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:16.511271 13726 consensus_peers.cc:597] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:16.531005 13726 consensus_peers.cc:597] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:16.534035 13726 consensus_peers.cc:597] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:16.559767 13726 consensus_peers.cc:597] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:16.571883 13726 consensus_peers.cc:597] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:16.635001 13800 consensus_peers.cc:597] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:16.641113 13726 consensus_peers.cc:597] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:16.669332 13726 consensus_peers.cc:597] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:16.707267 14379 consensus_peers.cc:597] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:16.740983 13800 consensus_peers.cc:597] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:16.751216 13726 consensus_peers.cc:597] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:16.802927 14379 consensus_peers.cc:597] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:16.829605 13800 consensus_peers.cc:597] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:16.847759 13726 consensus_peers.cc:597] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:16.862286 14379 consensus_peers.cc:597] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:16.880101 13800 consensus_peers.cc:597] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:16.939426 13726 consensus_peers.cc:597] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:16.968711 13726 consensus_peers.cc:597] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:16.990478 13726 consensus_peers.cc:597] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:17.079524 13726 consensus_peers.cc:597] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:17.169754 12515 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 13709)
W20260709 12:14:17.197387 13726 consensus_peers.cc:597] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:17.367511 13801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 67775.1us
W20260709 12:14:17.396279 14379 consensus_peers.cc:597] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:17.501175 13726 consensus_peers.cc:597] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:17.583720 13726 consensus_peers.cc:597] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:17.598078 13726 consensus_peers.cc:597] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:17.759997 13726 consensus_peers.cc:597] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:17.906514 14379 consensus_peers.cc:597] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:17.969664 13570 catalog_manager.cc:4755] TS b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet d2f365337b324999a073edacbe6c6e09: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
W20260709 12:14:18.049605 13726 consensus_peers.cc:597] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:18.056339 14379 consensus_peers.cc:597] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:18.170284 12515 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 13709)
W20260709 12:14:18.171957 13800 consensus_peers.cc:597] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:18.232753 13726 consensus_peers.cc:597] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:18.242973 14379 consensus_peers.cc:597] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:14:18.243764 14379 consensus_peers.cc:597] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:14:18.275887 13726 consensus_peers.cc:597] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:18.276805 14379 consensus_peers.cc:597] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:14:18.306345 13726 consensus_peers.cc:597] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:18.384652 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 43559.7us
W20260709 12:14:18.432677 13800 consensus_peers.cc:597] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:18.510515 13800 consensus_peers.cc:597] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:18.543782 13726 consensus_peers.cc:597] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:18.587100 13726 consensus_peers.cc:597] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:14:18.600080 12515 tablet_server.cc:196] TabletServer@127.12.56.193:0 shutdown complete.
W20260709 12:14:18.610746 13726 consensus_peers.cc:597] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:18.650267 14379 consensus_peers.cc:597] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:14:18.653746 13800 consensus_peers.cc:597] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:18.679181 14379 consensus_peers.cc:597] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:14:18.712345 13726 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111) [suppressed 483 similar messages]
W20260709 12:14:18.715520 13726 consensus_peers.cc:597] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:18.777990 13726 consensus_peers.cc:597] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:18.836629 14379 consensus_peers.cc:597] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:14:18.853183 14379 consensus_peers.cc:597] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:14:18.859972 13800 consensus_peers.cc:597] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:19.062762 14380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 51397.1us
W20260709 12:14:19.210937 13800 consensus_peers.cc:597] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:19.243436 13726 consensus_peers.cc:597] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:19.244122 13726 consensus_peers.cc:597] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:19.244787 13726 consensus_peers.cc:597] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:19.274966 13726 consensus_peers.cc:597] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:19.279740 13726 consensus_peers.cc:597] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:19.312564 13726 consensus_peers.cc:597] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:19.339666 14379 consensus_peers.cc:597] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:14:19.358747 13726 consensus_peers.cc:597] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:19.365880 13800 consensus_peers.cc:597] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:19.383554 14379 consensus_peers.cc:597] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:14:19.400640 13800 consensus_peers.cc:597] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:19.408685 13726 consensus_peers.cc:597] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:19.409963 13800 consensus_peers.cc:597] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:14:19.413072 12515 tablet_server.cc:179] TabletServer@127.12.56.194:0 shutting down...
W20260709 12:14:19.433650 13726 consensus_peers.cc:597] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:19.454073 14379 consensus_peers.cc:597] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:14:19.456091 14379 consensus_peers.cc:597] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f -> Peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Couldn't send request to peer 3f37c9cc9dda46b4be21dd675ba78fb7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:19.476872 13800 consensus_peers.cc:597] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd -> Peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Couldn't send request to peer 3f37c9cc9dda46b4be21dd675ba78fb7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:19.472741 14379 consensus_peers.cc:597] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f -> Peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Couldn't send request to peer 3f37c9cc9dda46b4be21dd675ba78fb7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:19.483160 13800 consensus_peers.cc:597] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd -> Peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Couldn't send request to peer 3f37c9cc9dda46b4be21dd675ba78fb7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:19.512796 14379 consensus_peers.cc:597] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f -> Peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Couldn't send request to peer 3f37c9cc9dda46b4be21dd675ba78fb7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:19.577097 13726 consensus_peers.cc:597] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:19.581216 14379 consensus_peers.cc:597] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f -> Peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Couldn't send request to peer 3f37c9cc9dda46b4be21dd675ba78fb7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:19.611881 13800 consensus_peers.cc:597] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd -> Peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Couldn't send request to peer 3f37c9cc9dda46b4be21dd675ba78fb7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:19.640061 13800 consensus_peers.cc:597] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd -> Peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Couldn't send request to peer 3f37c9cc9dda46b4be21dd675ba78fb7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:19.669135 14379 consensus_peers.cc:597] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f -> Peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Couldn't send request to peer 3f37c9cc9dda46b4be21dd675ba78fb7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:19.696367 12515 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:19.700196 12515 tablet_replica.cc:333] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7: stopping tablet replica
W20260709 12:14:19.702922 13800 consensus_peers.cc:597] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd -> Peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Couldn't send request to peer 3f37c9cc9dda46b4be21dd675ba78fb7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:19.709497 12515 raft_consensus.cc:2243] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 36 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:19.713248 12515 raft_consensus.cc:2272] T 1e31cd7111f2470d8d34b5898dce5765 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 36 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:19.725601 12515 tablet_replica.cc:333] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7: stopping tablet replica
I20260709 12:14:19.730145 12515 raft_consensus.cc:2243] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 LEADER]: Raft consensus shutting down.
I20260709 12:14:19.731607 12515 raft_consensus.cc:2272] T 0a8c7c772cf44d36bc44b25edc405d1d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:19.738880 13726 consensus_peers.cc:597] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:19.759323 14379 consensus_peers.cc:597] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f -> Peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Couldn't send request to peer 3f37c9cc9dda46b4be21dd675ba78fb7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:19.759598 12515 tablet_replica.cc:333] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7: stopping tablet replica
I20260709 12:14:19.762434 12515 raft_consensus.cc:2243] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 LEADER]: Raft consensus shutting down.
W20260709 12:14:19.774449 13800 consensus_peers.cc:597] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd -> Peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Couldn't send request to peer 3f37c9cc9dda46b4be21dd675ba78fb7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:19.777460 12515 raft_consensus.cc:2272] T 34a12e91341d4472be7460f1061495db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:19.783862 12515 tablet_replica.cc:333] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7: stopping tablet replica
I20260709 12:14:19.787536 12515 raft_consensus.cc:2243] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Raft consensus shutting down.
W20260709 12:14:19.785225 14379 consensus_peers.cc:597] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f -> Peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Couldn't send request to peer 3f37c9cc9dda46b4be21dd675ba78fb7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:19.788816 12515 raft_consensus.cc:2272] T e880992fc1b041b1a1717bb18203a22f P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:19.810850 12515 tablet_replica.cc:333] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7: stopping tablet replica
W20260709 12:14:19.811982 13800 consensus_peers.cc:597] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd -> Peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Couldn't send request to peer 3f37c9cc9dda46b4be21dd675ba78fb7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:19.812100 12515 raft_consensus.cc:2243] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Raft consensus shutting down.
W20260709 12:14:19.815672 13726 consensus_peers.cc:597] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:14:19.815881 12515 raft_consensus.cc:2272] T d8f8986661dd4d049ab4a79338d33a1a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:19.844601 12515 tablet_replica.cc:333] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7: stopping tablet replica
I20260709 12:14:19.845697 12515 raft_consensus.cc:2243] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 LEADER]: Raft consensus shutting down.
I20260709 12:14:19.847106 12515 raft_consensus.cc:2272] T 956300599d004370953188dd3ae3a256 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:19.855073 13800 consensus_peers.cc:597] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd -> Peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Couldn't send request to peer 3f37c9cc9dda46b4be21dd675ba78fb7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:19.856374 13800 consensus_peers.cc:597] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd -> Peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Couldn't send request to peer 3f37c9cc9dda46b4be21dd675ba78fb7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:19.863389 12515 tablet_replica.cc:333] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7: stopping tablet replica
I20260709 12:14:19.864462 12515 raft_consensus.cc:2243] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:19.865159 12515 raft_consensus.cc:2272] T e39d323dce0c45249bf1cf9b6062ab9a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:19.869247 12515 tablet_replica.cc:333] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7: stopping tablet replica
W20260709 12:14:19.877046 13800 consensus_peers.cc:597] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd -> Peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Couldn't send request to peer 3f37c9cc9dda46b4be21dd675ba78fb7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:19.886322 12515 raft_consensus.cc:2243] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 LEADER]: Raft consensus shutting down.
I20260709 12:14:19.922346 12515 raft_consensus.cc:2272] T a2541d5a960c4a8ba1d642e9a29fd19c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:19.928983 12515 tablet_replica.cc:333] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7: stopping tablet replica
I20260709 12:14:19.930083 12515 raft_consensus.cc:2243] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:19.940284 12515 raft_consensus.cc:2272] T 625e9b5c2aa14658af58496a21f9ee8b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:19.959579 12515 tablet_replica.cc:333] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7: stopping tablet replica
I20260709 12:14:19.962204 12515 raft_consensus.cc:2243] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 LEADER]: Raft consensus shutting down.
I20260709 12:14:19.963852 12515 raft_consensus.cc:2272] T aa310cca462541d39d36ebe94a27446e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:19.992728 12515 tablet_replica.cc:333] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7: stopping tablet replica
I20260709 12:14:19.993939 12515 raft_consensus.cc:2243] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:19.994907 12515 raft_consensus.cc:2272] T c89d2a3019c74941a4f8dffc9aa5cf40 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:19.995594 13800 consensus_peers.cc:597] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd -> Peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Couldn't send request to peer 3f37c9cc9dda46b4be21dd675ba78fb7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:20.012740 13800 consensus_peers.cc:597] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd -> Peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Couldn't send request to peer 3f37c9cc9dda46b4be21dd675ba78fb7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:19.995548 14379 consensus_peers.cc:597] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f -> Peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Couldn't send request to peer 3f37c9cc9dda46b4be21dd675ba78fb7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:20.017179 13726 consensus_peers.cc:597] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:20.026564 14379 consensus_peers.cc:597] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:14:20.032393 13800 consensus_peers.cc:597] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd -> Peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Couldn't send request to peer 3f37c9cc9dda46b4be21dd675ba78fb7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:20.056964 12515 tablet_replica.cc:333] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7: stopping tablet replica
I20260709 12:14:20.058260 12515 raft_consensus.cc:2243] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 36 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.060088 12515 raft_consensus.cc:2272] T 64b889ec5fe4445d81fe94e0ae9fb087 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 36 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.114805 12515 tablet_replica.cc:333] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7: stopping tablet replica
I20260709 12:14:20.116401 12515 raft_consensus.cc:2243] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.137035 12515 raft_consensus.cc:2272] T e5274c30729744338992e7c7710e5266 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:20.152217 13726 consensus_peers.cc:597] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:14:20.158955 12515 tablet_replica.cc:333] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7: stopping tablet replica
I20260709 12:14:20.170469 12515 raft_consensus.cc:2243] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.172540 12515 raft_consensus.cc:2272] T 51d10bdf51504a12a70a50e9a48f7ede P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.176517 12515 tablet_replica.cc:333] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7: stopping tablet replica
W20260709 12:14:20.185478 13726 consensus_peers.cc:597] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:14:20.194440 12515 raft_consensus.cc:2243] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.197135 12515 raft_consensus.cc:2272] T ca94d8f3109143599733e3a684149726 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.233033 12515 tablet_replica.cc:333] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7: stopping tablet replica
W20260709 12:14:20.233610 13570 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 139084us
W20260709 12:14:20.248425 13570 catalog_manager.cc:4755] TS b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet d2f365337b324999a073edacbe6c6e09: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
I20260709 12:14:20.253854 12515 raft_consensus.cc:2243] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.275686 12515 raft_consensus.cc:2272] T 107415ab6e76484890fa8115e8832a21 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.286751 12515 tablet_replica.cc:333] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7: stopping tablet replica
I20260709 12:14:20.303478 12515 raft_consensus.cc:2243] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.326224 12515 raft_consensus.cc:2272] T 026a826aa72f4cbea032d49e318401ae P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.329519 12515 tablet_replica.cc:333] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7: stopping tablet replica
I20260709 12:14:20.336743 12515 raft_consensus.cc:2243] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.338531 12515 raft_consensus.cc:2272] T c6d20ad9ea2849238148cd46eb3be62c P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.341990 24027 raft_consensus.cc:493] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:14:20.343062 24027 raft_consensus.cc:515] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:14:20.347405 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 44426.2us
I20260709 12:14:20.364284 24027 leader_election.cc:290] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:14:20.370002 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e229ea1f19c74be5884179acde106305" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:14:20.376443 13726 leader_election.cc:336] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
I20260709 12:14:20.377060 13726 leader_election.cc:304] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:14:20.383203 24027 raft_consensus.cc:2749] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:14:20.385075 14379 consensus_peers.cc:597] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:14:20.341499 12515 tablet_replica.cc:333] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7: stopping tablet replica
I20260709 12:14:20.406044 12515 raft_consensus.cc:2243] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 32 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.419281 12515 raft_consensus.cc:2272] T 2614cf111d8b41fca205e6eff5934612 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 32 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.449805 12515 tablet_replica.cc:333] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7: stopping tablet replica
I20260709 12:14:20.465971 12515 raft_consensus.cc:2243] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.473112 12515 raft_consensus.cc:2272] T 1d3056e0d375412a9db3769da3ef2eb9 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.483767 12515 tablet_replica.cc:333] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7: stopping tablet replica
I20260709 12:14:20.518977 12515 raft_consensus.cc:2243] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.566814 12515 raft_consensus.cc:2272] T 25896261d1204b3d858fb5b478a89034 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.542724 24025 raft_consensus.cc:493] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:14:20.572060 24025 raft_consensus.cc:515] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:20.576222 24025 leader_election.cc:290] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:14:20.569644 24027 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:14:20.578058 24027 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:20.579618 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabf40829555486da9d6b588472147ec" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 32 candidate_status { last_received { term: 31 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:14:20.583343 13726 leader_election.cc:336] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
I20260709 12:14:20.584052 13727 leader_election.cc:304] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:20.585485 24025 raft_consensus.cc:2749] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:14:20.587872 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:20.592470 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c06f5564ed4c259ca5c238c3faf2a3" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:14:20.595009 13727 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:14:20.596676 24025 raft_consensus.cc:2749] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:14:20.597599 24027 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:14:20.619665 24028 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 35 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:14:20.620388 24028 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 35 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:20.623335 24028 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:14:20.642314 13834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 36 candidate_status { last_received { term: 35 index: 22 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:20.643226 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9139e027a704f14bb60e60e22390d08" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 36 candidate_status { last_received { term: 35 index: 22 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:14:20.647930 13727 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:14:20.673032 24026 raft_consensus.cc:2749] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 35 FOLLOWER]: Leader pre-election lost for term 36. Reason: could not achieve majority
W20260709 12:14:20.696512 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46341, user_credentials={real_user=slave}} blocked reactor thread for 48645.4us
W20260709 12:14:20.698927 13800 consensus_peers.cc:597] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:14:20.719991 12515 tablet_replica.cc:333] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7: stopping tablet replica
I20260709 12:14:20.727629 12515 raft_consensus.cc:2243] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.708865 24025 raft_consensus.cc:493] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ca9fbbc2c0a94897897d502d42f3951f)
I20260709 12:14:20.728730 24025 raft_consensus.cc:515] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:20.725172 24027 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:14:20.731101 24027 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:14:20.743567 14379 consensus_peers.cc:597] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:14:20.751365 24025 leader_election.cc:290] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:14:20.752609 12515 raft_consensus.cc:2272] T d2f365337b324999a073edacbe6c6e09 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.756561 12515 tablet_replica.cc:333] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7: stopping tablet replica
I20260709 12:14:20.757576 12515 raft_consensus.cc:2243] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.758672 12515 raft_consensus.cc:2272] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:20.766319 13726 leader_election.cc:336] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
W20260709 12:14:20.772559 13727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:36603, user_credentials={real_user=slave}} blocked reactor thread for 68624.8us
I20260709 12:14:20.771840 24027 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:14:20.771085 14379 consensus_peers.cc:597] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:14:20.772862 13726 consensus_peers.cc:597] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:14:20.779814 24027 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
W20260709 12:14:20.780490 13726 leader_election.cc:336] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
W20260709 12:14:20.781181 13726 consensus_peers.cc:597] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:14:20.785342 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:20.780833 24027 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:20.788796 24027 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:14:20.791101 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658b56fb08f0467fa5a9d602dd275f81" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:14:20.788431 12515 tablet_replica.cc:333] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7: stopping tablet replica
I20260709 12:14:20.795617 12515 raft_consensus.cc:2243] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.798290 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d43dfb2e8dc04299ad696b99238cf41a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:14:20.800547 24036 raft_consensus.cc:493] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:14:20.801087 24036 raft_consensus.cc:515] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:20.803218 24036 leader_election.cc:290] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:14:20.796994 12515 raft_consensus.cc:2272] T 7639868c5cbf467e82d51f50ad8d6379 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.806427 13727 leader_election.cc:304] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
W20260709 12:14:20.807147 13727 raft_consensus.cc:2686] T 658b56fb08f0467fa5a9d602dd275f81 P 3f37c9cc9dda46b4be21dd675ba78fb7: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:14:20.808805 13727 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:14:20.809685 24037 raft_consensus.cc:2749] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:14:20.810192 13726 leader_election.cc:336] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
W20260709 12:14:20.810619 14379 consensus_peers.cc:597] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:14:20.808897 12515 tablet_replica.cc:333] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7: stopping tablet replica
I20260709 12:14:20.817297 12515 raft_consensus.cc:2243] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.818845 12515 raft_consensus.cc:2272] T 66aa0310b814479591b9f665634674f1 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:20.824100 13800 consensus_peers.cc:597] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:14:20.827636 12515 tablet_replica.cc:333] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7: stopping tablet replica
I20260709 12:14:20.828316 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 30 candidate_status { last_received { term: 29 index: 21 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:20.828740 12515 raft_consensus.cc:2243] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.831694 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2210d5649f048c68ae57986b065cb28" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 31 candidate_status { last_received { term: 30 index: 13 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:20.830673 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15347ea1eb2348e7b262bd0d59ce6f3a" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 30 candidate_status { last_received { term: 29 index: 21 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:14:20.835345 12515 raft_consensus.cc:2272] T 243ef5a036904f43835a7e29d96599de P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.845561 13727 leader_election.cc:304] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:20.849323 24037 raft_consensus.cc:2749] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:14:20.851676 13727 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:14:20.852644 24037 raft_consensus.cc:2749] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:14:20.854079 12515 tablet_replica.cc:333] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7: stopping tablet replica
I20260709 12:14:20.855119 12515 raft_consensus.cc:2243] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.856765 12515 raft_consensus.cc:2272] T 9dfb6cae84194e19bf3a75e14c3d2263 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.876284 12515 tablet_replica.cc:333] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7: stopping tablet replica
I20260709 12:14:20.885352 12515 raft_consensus.cc:2243] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.886310 12515 raft_consensus.cc:2272] T f1bace76cb204a6d92c38685645dd9db P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.890801 12515 tablet_replica.cc:333] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7: stopping tablet replica
I20260709 12:14:20.891737 12515 raft_consensus.cc:2243] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.893091 12515 raft_consensus.cc:2272] T 58c7d3b9588c414ba528311a1818a44b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.899765 24037 raft_consensus.cc:493] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 33 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:14:20.900750 12515 tablet_replica.cc:333] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7: stopping tablet replica
I20260709 12:14:20.900389 24037 raft_consensus.cc:515] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
W20260709 12:14:20.900875 13726 consensus_peers.cc:597] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:14:20.904378 12515 raft_consensus.cc:2243] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.904717 24037 leader_election.cc:290] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:14:20.907733 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14d7a26ca33940fbba5fa30c5212e5ac" candidate_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" candidate_term: 34 candidate_status { last_received { term: 33 index: 21 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:20.909472 12515 raft_consensus.cc:2272] T a34b21ec197b4241a780a8ae562e4602 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:20.913719 13726 leader_election.cc:336] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 34 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
I20260709 12:14:20.914368 13726 leader_election.cc:304] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f37c9cc9dda46b4be21dd675ba78fb7; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:20.915706 24037 raft_consensus.cc:2749] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 33 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
I20260709 12:14:20.928967 12515 tablet_replica.cc:333] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7: stopping tablet replica
I20260709 12:14:20.930195 12515 raft_consensus.cc:2243] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.932117 12515 raft_consensus.cc:2272] T 407aabb01908409185c74e2349da4c3d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.936637 12515 tablet_replica.cc:333] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7: stopping tablet replica
I20260709 12:14:20.937664 12515 raft_consensus.cc:2243] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 33 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.938664 12515 raft_consensus.cc:2272] T 14d7a26ca33940fbba5fa30c5212e5ac P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 33 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:20.953246 14379 consensus_peers.cc:597] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:14:20.954073 24029 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:20.954713 12515 tablet_replica.cc:333] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7: stopping tablet replica
I20260709 12:14:20.954903 24029 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:20.965466 12515 raft_consensus.cc:2243] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.968315 12515 raft_consensus.cc:2272] T b57529c42e834d3f85dd24588a5d5773 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.968400 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
W20260709 12:14:20.968614 13800 leader_election.cc:336] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
I20260709 12:14:20.976606 13801 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: b98d2519bb504dc6905ed2ede4571835, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:14:20.977972 24031 raft_consensus.cc:2749] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
W20260709 12:14:20.982060 13800 leader_election.cc:336] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:20.971951 12515 tablet_replica.cc:333] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7: stopping tablet replica
I20260709 12:14:20.985042 12515 raft_consensus.cc:2243] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.983850 24029 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:14:20.990473 13726 consensus_peers.cc:597] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:14:20.990595 12515 raft_consensus.cc:2272] T 637cf9d05e2348118404a474b84d67d7 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.994918 12515 tablet_replica.cc:333] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7: stopping tablet replica
I20260709 12:14:20.996086 12515 raft_consensus.cc:2243] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.997807 12515 raft_consensus.cc:2272] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.001698 12515 tablet_replica.cc:333] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7: stopping tablet replica
I20260709 12:14:21.002820 12515 raft_consensus.cc:2243] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:21.003770 12515 raft_consensus.cc:2272] T 15347ea1eb2348e7b262bd0d59ce6f3a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.016799 12515 tablet_replica.cc:333] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7: stopping tablet replica
I20260709 12:14:21.017838 12515 raft_consensus.cc:2243] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:14:21.019474 12515 raft_consensus.cc:2272] T c8195765ed074b74be387475c214120b P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:21.020432 13800 consensus_peers.cc:597] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:14:21.035077 12515 tablet_replica.cc:333] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7: stopping tablet replica
I20260709 12:14:21.036084 12515 raft_consensus.cc:2243] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:21.037050 12515 raft_consensus.cc:2272] T c3c06f5564ed4c259ca5c238c3faf2a3 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.040512 12515 tablet_replica.cc:333] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7: stopping tablet replica
I20260709 12:14:21.041554 12515 raft_consensus.cc:2243] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:21.042438 12515 raft_consensus.cc:2272] T dabf40829555486da9d6b588472147ec P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 31 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.049994 12515 tablet_replica.cc:333] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7: stopping tablet replica
I20260709 12:14:21.050948 12515 raft_consensus.cc:2243] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 LEADER]: Raft consensus shutting down.
I20260709 12:14:21.052104 12515 raft_consensus.cc:2272] T ab7af43351ec498cb9e13128a20c3c89 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:21.054629 13726 consensus_peers.cc:597] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:14:21.055305 12515 tablet_replica.cc:333] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7: stopping tablet replica
I20260709 12:14:21.056380 12515 raft_consensus.cc:2243] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:21.057828 12515 raft_consensus.cc:2272] T d43dfb2e8dc04299ad696b99238cf41a P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.061136 12515 tablet_replica.cc:333] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7: stopping tablet replica
I20260709 12:14:21.062166 12515 raft_consensus.cc:2243] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 LEADER]: Raft consensus shutting down.
I20260709 12:14:21.063804 12515 raft_consensus.cc:2272] T d9c029efbe5e410cb15f323fd19bf316 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.067365 12515 tablet_replica.cc:333] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7: stopping tablet replica
I20260709 12:14:21.068996 12515 raft_consensus.cc:2243] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 LEADER]: Raft consensus shutting down.
I20260709 12:14:21.070950 12515 raft_consensus.cc:2272] T c97f901403f34a8ca78bfeb8472bfa6e P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.075018 12515 tablet_replica.cc:333] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7: stopping tablet replica
I20260709 12:14:21.076511 12515 raft_consensus.cc:2243] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 33 LEADER]: Raft consensus shutting down.
I20260709 12:14:21.079341 12515 raft_consensus.cc:2272] T 232d133451004a83941860574adec712 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 33 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.080268 24031 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:21.082289 24031 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:21.084237 12515 tablet_replica.cc:333] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7: stopping tablet replica
I20260709 12:14:21.084497 24031 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:14:21.085180 12515 raft_consensus.cc:2243] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 35 LEADER]: Raft consensus shutting down.
I20260709 12:14:21.086474 12515 raft_consensus.cc:2272] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 35 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.087184 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:14:21.089857 24030 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:21.090509 24030 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:21.092847 24030 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:14:21.089447 12515 tablet_replica.cc:333] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7: stopping tablet replica
I20260709 12:14:21.094676 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:21.095305 13828 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 26.
I20260709 12:14:21.096493 12515 raft_consensus.cc:2243] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:21.096692 14380 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:14:21.097231 12515 raft_consensus.cc:2272] T b2210d5649f048c68ae57986b065cb28 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.098057 24030 raft_consensus.cc:2804] T 0a8c7c772cf44d36bc44b25edc405d1d P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:14:21.101219 24030 raft_consensus.cc:493] T 0a8c7c772cf44d36bc44b25edc405d1d P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:21.110539 24030 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:14:21.113235 12515 tablet_replica.cc:333] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7: stopping tablet replica
I20260709 12:14:21.114250 12515 raft_consensus.cc:2243] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 LEADER]: Raft consensus shutting down.
I20260709 12:14:21.116061 12515 raft_consensus.cc:2272] T 56d28ac895464968890083dea150a58d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.119096 12515 tablet_replica.cc:333] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7: stopping tablet replica
I20260709 12:14:21.119915 12515 raft_consensus.cc:2243] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Raft consensus shutting down.
W20260709 12:14:21.120222 14379 leader_election.cc:336] T 0a8c7c772cf44d36bc44b25edc405d1d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:21.120698 12515 raft_consensus.cc:2272] T e229ea1f19c74be5884179acde106305 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.123847 12515 tablet_replica.cc:333] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7: stopping tablet replica
I20260709 12:14:21.124645 12515 raft_consensus.cc:2243] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 38 LEADER]: Raft consensus shutting down.
I20260709 12:14:21.125989 12515 raft_consensus.cc:2272] T f1494f6353074242857c7901c21da06d P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 38 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:21.128135 13800 leader_election.cc:336] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:21.128708 13800 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:14:21.130030 12515 tablet_replica.cc:333] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7: stopping tablet replica
I20260709 12:14:21.130800 12515 raft_consensus.cc:2243] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 35 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:21.131680 12515 raft_consensus.cc:2272] T f9139e027a704f14bb60e60e22390d08 P 3f37c9cc9dda46b4be21dd675ba78fb7 [term 35 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.132647 24029 raft_consensus.cc:2749] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:14:21.140101 24006 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P ca9fbbc2c0a94897897d502d42f3951f [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:21.140784 24006 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P ca9fbbc2c0a94897897d502d42f3951f [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:21.146543 24006 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:14:21.149711 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:14:21.149505 14379 leader_election.cc:336] T a2541d5a960c4a8ba1d642e9a29fd19c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
I20260709 12:14:21.150350 13828 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 30.
I20260709 12:14:21.175246 24006 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:21.175875 24006 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:21.179514 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
W20260709 12:14:21.179703 14379 consensus_peers.cc:597] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:14:21.156994 24030 raft_consensus.cc:515] T 0a8c7c772cf44d36bc44b25edc405d1d P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Starting leader election with config: opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:21.185076 24006 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:14:21.187870 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a8c7c772cf44d36bc44b25edc405d1d" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:14:21.188482 14379 leader_election.cc:336] T a2541d5a960c4a8ba1d642e9a29fd19c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:21.188550 13828 raft_consensus.cc:3060] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:14:21.189072 14379 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:21.190583 24006 raft_consensus.cc:2749] T a2541d5a960c4a8ba1d642e9a29fd19c P ca9fbbc2c0a94897897d502d42f3951f [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:14:21.192552 24030 leader_election.cc:290] T 0a8c7c772cf44d36bc44b25edc405d1d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:14:21.196831 13570 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.12.56.193:33199, user_credentials={real_user=slave}} blocked reactor thread for 67091.4us
I20260709 12:14:21.203591 13828 raft_consensus.cc:2468] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 27.
I20260709 12:14:21.205415 14380 leader_election.cc:304] T 0a8c7c772cf44d36bc44b25edc405d1d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:14:21.206372 24030 raft_consensus.cc:2804] T 0a8c7c772cf44d36bc44b25edc405d1d P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:14:21.206935 24030 raft_consensus.cc:697] T 0a8c7c772cf44d36bc44b25edc405d1d P ca9fbbc2c0a94897897d502d42f3951f [term 27 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
W20260709 12:14:21.211047 14379 leader_election.cc:336] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:21.211613 14379 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:14:21.208055 24030 consensus_queue.cc:237] T 0a8c7c772cf44d36bc44b25edc405d1d P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 26.20, Last appended by leader: 20, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:21.216418 24006 raft_consensus.cc:2749] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 12:14:21.218084 14379 leader_election.cc:336] T 0a8c7c772cf44d36bc44b25edc405d1d P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:21.219451 24006 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:21.220058 24006 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:21.222932 24029 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:21.224515 24006 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:14:21.223544 24029 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:21.237339 24029 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:14:21.246165 13584 catalog_manager.cc:5697] T 0a8c7c772cf44d36bc44b25edc405d1d P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 26 to 27, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 27 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:14:21.249465 13800 leader_election.cc:336] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
W20260709 12:14:21.254257 14379 leader_election.cc:336] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:21.260459 23999 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 36 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:21.261098 23999 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 36 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:21.263111 23999 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:14:21.263797 24029 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:21.264407 24029 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:21.266767 24029 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:14:21.273216 13800 leader_election.cc:336] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:21.273988 13800 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:21.274869 24029 raft_consensus.cc:2749] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 12:14:21.280372 13800 leader_election.cc:336] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:21.284098 13800 leader_election.cc:336] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
W20260709 12:14:21.281467 14379 leader_election.cc:336] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
I20260709 12:14:21.287081 14379 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:21.285473 13800 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:21.289599 24030 raft_consensus.cc:2749] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:21.291622 24029 raft_consensus.cc:2749] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:14:21.306164 24029 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:21.307097 24029 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:21.310166 24029 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:14:21.325639 13800 leader_election.cc:336] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
W20260709 12:14:21.327340 13800 leader_election.cc:336] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:21.303411 14379 leader_election.cc:336] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 37 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
I20260709 12:14:21.328899 13800 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:21.338075 24029 raft_consensus.cc:2749] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 12:14:21.344637 13800 consensus_peers.cc:597] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:21.351156 14379 leader_election.cc:336] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 37 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:21.351887 14379 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:21.355327 24030 raft_consensus.cc:2749] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 36 FOLLOWER]: Leader pre-election lost for term 37. Reason: could not achieve majority
I20260709 12:14:21.383646 24029 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:21.384351 24029 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:14:21.399641 13800 leader_election.cc:336] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:21.404291 24029 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:14:21.405478 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:14:21.412083 14407 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 26.
I20260709 12:14:21.412531 24031 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 31 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:21.413151 24031 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:21.415580 24031 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:14:21.413429 13801 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:14:21.417027 24031 raft_consensus.cc:2804] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:14:21.417553 24031 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:21.418208 24031 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:14:21.436370 24041 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
W20260709 12:14:21.437951 13800 leader_election.cc:336] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
W20260709 12:14:21.438964 13800 leader_election.cc:336] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:21.439335 13800 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:21.429752 24031 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:21.440138 24041 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:21.442605 24041 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:14:21.449076 14379 leader_election.cc:336] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
I20260709 12:14:21.448726 24029 raft_consensus.cc:2749] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
W20260709 12:14:21.457851 14379 consensus_peers.cc:597] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:14:21.465934 14379 leader_election.cc:336] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:21.466578 14379 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:14:21.472705 13800 leader_election.cc:336] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:21.474130 24041 raft_consensus.cc:2749] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:14:21.476235 24031 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:14:21.476327 13729 connection.cc:466] server connection from 127.0.0.1:48120 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 3708) could send its response
W20260709 12:14:21.477497 13729 connection.cc:466] server connection from 127.0.0.1:48120 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 3709) could send its response
W20260709 12:14:21.478533 13729 connection.cc:466] server connection from 127.0.0.1:48120 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48120 (request call id 3710) could send its response
I20260709 12:14:21.480181 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa310cca462541d39d36ebe94a27446e" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:14:21.480827 14407 raft_consensus.cc:3060] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Advancing to term 27
W20260709 12:14:21.495298 14379 connection.cc:769] client connection to 127.12.56.194:39545 send error: Network error: sendmsg error: Connection reset by peer (error 104)
I20260709 12:14:21.513324 14407 raft_consensus.cc:2468] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 27.
I20260709 12:14:21.515008 13801 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:14:21.516412 24029 raft_consensus.cc:2804] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:14:21.516980 24029 raft_consensus.cc:697] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 27 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:14:21.519338 24029 consensus_queue.cc:237] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.18, Last appended by leader: 18, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:14:21.521574 13800 consensus_peers.cc:597] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:14:21.555712 13584 catalog_manager.cc:5697] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 26 to 27, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 27 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:21.608805 14379 consensus_peers.cc:597] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:14:21.651460 13828 raft_consensus.cc:1275] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 26 index: 20. Preceding OpId from leader: term: 27 index: 21. (index mismatch)
I20260709 12:14:21.653699 24041 consensus_queue.cc:1048] T 0a8c7c772cf44d36bc44b25edc405d1d P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.001s
W20260709 12:14:21.672546 14379 consensus_peers.cc:597] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:14:21.680397 14379 consensus_peers.cc:597] T 0a8c7c772cf44d36bc44b25edc405d1d P ca9fbbc2c0a94897897d502d42f3951f -> Peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Couldn't send request to peer 3f37c9cc9dda46b4be21dd675ba78fb7. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:21.683856 13800 consensus_peers.cc:597] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:21.687729 13800 consensus_peers.cc:597] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:14:21.769807 14379 consensus_peers.cc:597] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f -> Peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Couldn't send request to peer 3f37c9cc9dda46b4be21dd675ba78fb7. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:21.788282 14379 consensus_peers.cc:597] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:14:21.794425 24030 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:21.795107 24030 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:14:21.803077 14379 leader_election.cc:336] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111)
I20260709 12:14:21.805603 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:21.807757 14380 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:14:21.809900 24041 raft_consensus.cc:2749] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:21.819998 24030 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:14:21.821954 13800 consensus_peers.cc:597] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:21.887990 14379 consensus_peers.cc:597] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:14:21.888358 13800 consensus_peers.cc:597] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:14:21.900609 13800 consensus_peers.cc:597] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd -> Peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Couldn't send request to peer 3f37c9cc9dda46b4be21dd675ba78fb7. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:21.939359 13800 consensus_peers.cc:597] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd -> Peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Couldn't send request to peer 3f37c9cc9dda46b4be21dd675ba78fb7. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:21.984162 14379 consensus_peers.cc:597] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f -> Peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Couldn't send request to peer 3f37c9cc9dda46b4be21dd675ba78fb7. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:22.001013 24031 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:22.001754 24031 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:22.005807 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:14:22.006515 14410 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 27.
W20260709 12:14:22.006742 14379 consensus_peers.cc:597] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f -> Peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Couldn't send request to peer 3f37c9cc9dda46b4be21dd675ba78fb7. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:22.009924 14410 raft_consensus.cc:1275] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
I20260709 12:14:22.010797 13801 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:14:22.012261 24032 raft_consensus.cc:2804] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:14:22.012719 24032 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:22.013099 24032 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:14:22.016310 24029 consensus_queue.cc:1048] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:14:22.018986 24031 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:14:22.022330 24032 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:14:22.026772 13800 consensus_peers.cc:597] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd -> Peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Couldn't send request to peer 3f37c9cc9dda46b4be21dd675ba78fb7. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:22.034237 14407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25896261d1204b3d858fb5b478a89034" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f"
I20260709 12:14:22.034986 14407 raft_consensus.cc:3060] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Advancing to term 28
W20260709 12:14:22.034236 13800 leader_election.cc:336] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111)
I20260709 12:14:22.042994 14407 raft_consensus.cc:2468] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96701a74fdee481fb5f54aac841e17dd in term 28.
I20260709 12:14:22.045115 13801 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:14:22.046037 24031 raft_consensus.cc:2804] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:14:22.046666 24031 raft_consensus.cc:697] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 28 LEADER]: Becoming Leader. State: Replica: 96701a74fdee481fb5f54aac841e17dd, State: Running, Role: LEADER
I20260709 12:14:22.047114 24032 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
I20260709 12:14:22.047827 24031 consensus_queue.cc:237] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 27.18, Last appended by leader: 18, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:14:22.053988 13800 leader_election.cc:336] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111)
W20260709 12:14:22.082728 13800 consensus_peers.cc:597] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd -> Peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Couldn't send request to peer 3f37c9cc9dda46b4be21dd675ba78fb7. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:22.099067 14379 consensus_peers.cc:597] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:14:22.119891 24054 raft_consensus.cc:493] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:22.127254 24054 raft_consensus.cc:515] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:22.124704 13579 catalog_manager.cc:5697] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd reported cstate change: term changed from 27 to 28, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to 96701a74fdee481fb5f54aac841e17dd (127.12.56.195). New cstate: current_term: 28 leader_uuid: "96701a74fdee481fb5f54aac841e17dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:22.125262 14379 consensus_peers.cc:597] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f -> Peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Couldn't send request to peer 3f37c9cc9dda46b4be21dd675ba78fb7. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:22.126894 24032 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:22.135231 24032 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:22.137930 24032 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196:46341)
W20260709 12:14:22.138257 14379 consensus_peers.cc:597] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f -> Peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Couldn't send request to peer 3f37c9cc9dda46b4be21dd675ba78fb7. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:22.140340 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "96701a74fdee481fb5f54aac841e17dd" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "ca9fbbc2c0a94897897d502d42f3951f" is_pre_election: true
I20260709 12:14:22.140893 24029 raft_consensus.cc:493] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:22.133386 24054 leader_election.cc:290] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:14:22.143769 24029 raft_consensus.cc:515] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:22.151631 24029 leader_election.cc:290] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:14:22.169636 13800 leader_election.cc:336] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
W20260709 12:14:22.171592 13800 leader_election.cc:336] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111)
I20260709 12:14:22.172272 13800 leader_election.cc:304] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:22.181270 24029 raft_consensus.cc:2749] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 12:14:22.182667 13800 leader_election.cc:336] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111)
I20260709 12:14:22.183175 13800 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, ca9fbbc2c0a94897897d502d42f3951f
I20260709 12:14:22.184034 24029 raft_consensus.cc:2749] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:14:22.185282 13800 consensus_peers.cc:597] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd -> Peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Couldn't send request to peer 3f37c9cc9dda46b4be21dd675ba78fb7. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:22.192082 13800 leader_election.cc:336] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
W20260709 12:14:22.198709 13800 leader_election.cc:336] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111)
I20260709 12:14:22.199291 13800 leader_election.cc:304] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:22.200359 24029 raft_consensus.cc:2749] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:14:22.201812 24029 raft_consensus.cc:493] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:22.202319 24029 raft_consensus.cc:515] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:22.204417 24029 leader_election.cc:290] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:14:22.205380 13800 consensus_peers.cc:597] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd -> Peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Couldn't send request to peer 3f37c9cc9dda46b4be21dd675ba78fb7. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:22.207623 24030 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:22.208294 24030 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:22.210680 24030 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:14:22.212591 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:22.213373 13828 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 25.
I20260709 12:14:22.215615 14380 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 
I20260709 12:14:22.217312 24006 raft_consensus.cc:2804] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:14:22.217715 24006 raft_consensus.cc:493] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting leader election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:22.218259 24006 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:14:22.220368 14379 leader_election.cc:336] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111)
I20260709 12:14:22.230055 24006 raft_consensus.cc:515] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:14:22.234452 13800 consensus_peers.cc:597] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd -> Peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Couldn't send request to peer 3f37c9cc9dda46b4be21dd675ba78fb7. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:22.235455 24006 leader_election.cc:290] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 election: Requested vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:14:22.236726 13828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566e3cc2115c4b6dbd3070c4f4f4f11b" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd"
W20260709 12:14:22.243105 14379 leader_election.cc:336] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111)
I20260709 12:14:22.250926 13828 raft_consensus.cc:3060] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:14:22.255996 13800 leader_election.cc:336] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111)
W20260709 12:14:22.257035 13800 leader_election.cc:336] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
I20260709 12:14:22.257686 13800 leader_election.cc:304] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:22.258530 24029 raft_consensus.cc:2749] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:14:22.260072 13828 raft_consensus.cc:2468] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 26.
I20260709 12:14:22.261569 14380 leader_election.cc:304] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7
I20260709 12:14:22.263002 24006 raft_consensus.cc:2804] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:14:22.263558 24006 raft_consensus.cc:697] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 26 LEADER]: Becoming Leader. State: Replica: ca9fbbc2c0a94897897d502d42f3951f, State: Running, Role: LEADER
I20260709 12:14:22.264678 24006 consensus_queue.cc:237] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:14:22.276803 14379 consensus_peers.cc:597] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f -> Peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Couldn't send request to peer 3f37c9cc9dda46b4be21dd675ba78fb7. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:22.279628 24029 raft_consensus.cc:493] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:22.280305 24029 raft_consensus.cc:515] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:22.280633 24056 raft_consensus.cc:493] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 31 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:22.281213 24056 raft_consensus.cc:515] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:22.282693 24029 leader_election.cc:290] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:14:22.283402 24056 leader_election.cc:290] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:14:22.286785 24030 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:22.287457 24030 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:22.289812 24056 raft_consensus.cc:493] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:22.290513 24056 raft_consensus.cc:515] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:22.291595 13579 catalog_manager.cc:5697] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f reported cstate change: term changed from 25 to 26, leader changed from 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194) to ca9fbbc2c0a94897897d502d42f3951f (127.12.56.196). New cstate: current_term: 26 leader_uuid: "ca9fbbc2c0a94897897d502d42f3951f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:22.293138 24056 leader_election.cc:290] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:14:22.293846 24056 raft_consensus.cc:493] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:22.294369 24056 raft_consensus.cc:515] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:22.300940 24054 raft_consensus.cc:493] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:22.301000 24032 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 33 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:22.301678 24032 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:22.304170 24032 leader_election.cc:290] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:14:22.304731 24032 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:22.305186 24032 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:22.301924 24031 raft_consensus.cc:493] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:22.306412 24031 raft_consensus.cc:515] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:22.301599 24054 raft_consensus.cc:515] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:22.308426 24031 leader_election.cc:290] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:14:22.310372 24054 leader_election.cc:290] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:14:22.310567 24032 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:14:22.311512 24056 leader_election.cc:290] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:14:22.314085 13800 leader_election.cc:336] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
W20260709 12:14:22.314742 13800 leader_election.cc:336] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
I20260709 12:14:22.289793 24030 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:14:22.319152 14379 leader_election.cc:336] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111)
W20260709 12:14:22.323082 13800 leader_election.cc:336] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111)
I20260709 12:14:22.323695 13800 leader_election.cc:304] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
W20260709 12:14:22.324908 13800 leader_election.cc:336] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111)
I20260709 12:14:22.325116 24029 raft_consensus.cc:2749] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:14:22.325403 13800 leader_election.cc:304] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:22.326207 24029 raft_consensus.cc:2749] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
W20260709 12:14:22.326318 14379 leader_election.cc:336] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
I20260709 12:14:22.328272 14379 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:22.331502 24030 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 12:14:22.331795 13800 leader_election.cc:336] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
W20260709 12:14:22.342967 13800 leader_election.cc:336] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
W20260709 12:14:22.344206 14379 consensus_peers.cc:597] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f -> Peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Couldn't send request to peer 3f37c9cc9dda46b4be21dd675ba78fb7. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:22.344841 13800 leader_election.cc:336] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111)
I20260709 12:14:22.345855 13800 leader_election.cc:304] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:22.347085 24029 raft_consensus.cc:2749] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:14:22.353011 24029 raft_consensus.cc:493] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 38 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:22.353585 24029 raft_consensus.cc:515] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 38 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:22.355692 24029 leader_election.cc:290] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 39 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:14:22.357055 13800 leader_election.cc:336] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 34 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
W20260709 12:14:22.361799 13800 leader_election.cc:336] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
W20260709 12:14:22.362454 13800 leader_election.cc:336] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
W20260709 12:14:22.363005 13800 leader_election.cc:336] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
W20260709 12:14:22.363667 13800 leader_election.cc:336] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 34 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111)
I20260709 12:14:22.370474 13800 leader_election.cc:304] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:22.371415 24029 raft_consensus.cc:2749] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 33 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
W20260709 12:14:22.373934 13800 leader_election.cc:336] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111)
I20260709 12:14:22.374459 13800 leader_election.cc:304] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:22.375218 24029 raft_consensus.cc:2749] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 12:14:22.376334 13800 leader_election.cc:336] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111)
I20260709 12:14:22.376791 13800 leader_election.cc:304] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:22.377648 24029 raft_consensus.cc:2749] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 12:14:22.378772 13800 leader_election.cc:336] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111)
I20260709 12:14:22.379235 13800 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:22.379963 24029 raft_consensus.cc:2749] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 12:14:22.381286 13800 leader_election.cc:336] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111)
I20260709 12:14:22.381929 13800 leader_election.cc:304] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:22.388360 24029 raft_consensus.cc:2749] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:14:22.398669 24029 raft_consensus.cc:493] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 35 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:22.399236 24029 raft_consensus.cc:515] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 35 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:22.401458 24029 leader_election.cc:290] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:14:22.402638 13800 leader_election.cc:336] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 39 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111)
W20260709 12:14:22.404603 13800 consensus_peers.cc:597] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd -> Peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Couldn't send request to peer 3f37c9cc9dda46b4be21dd675ba78fb7. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:22.406217 13800 leader_election.cc:336] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 39 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
I20260709 12:14:22.410049 13800 leader_election.cc:304] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 39 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:22.410907 24029 raft_consensus.cc:2749] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 38 FOLLOWER]: Leader pre-election lost for term 39. Reason: could not achieve majority
W20260709 12:14:22.414729 13800 consensus_peers.cc:597] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd -> Peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Couldn't send request to peer 3f37c9cc9dda46b4be21dd675ba78fb7. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:22.425189 13800 leader_election.cc:336] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 36 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111)
W20260709 12:14:22.426005 13800 leader_election.cc:336] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 36 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
I20260709 12:14:22.426492 13800 leader_election.cc:304] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:22.427392 24029 raft_consensus.cc:2749] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 35 FOLLOWER]: Leader pre-election lost for term 36. Reason: could not achieve majority
I20260709 12:14:22.438057 24060 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:22.438720 24060 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:22.441123 24060 leader_election.cc:290] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:14:22.452647 13800 consensus_peers.cc:597] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd -> Peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Couldn't send request to peer 3f37c9cc9dda46b4be21dd675ba78fb7. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:22.454187 14379 leader_election.cc:336] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
W20260709 12:14:22.455037 14379 leader_election.cc:336] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111)
I20260709 12:14:22.455513 14379 leader_election.cc:304] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:22.457437 24060 raft_consensus.cc:2749] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:14:22.486009 13800 consensus_peers.cc:597] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd -> Peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Couldn't send request to peer 3f37c9cc9dda46b4be21dd675ba78fb7. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:22.503058 13800 consensus_peers.cc:597] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd -> Peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Couldn't send request to peer 3f37c9cc9dda46b4be21dd675ba78fb7. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:22.510986 14379 consensus_peers.cc:597] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f -> Peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Couldn't send request to peer 3f37c9cc9dda46b4be21dd675ba78fb7. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:22.519439 14410 raft_consensus.cc:1275] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Refusing update from remote peer 96701a74fdee481fb5f54aac841e17dd: Log matching property violated. Preceding OpId in replica: term: 27 index: 18. Preceding OpId from leader: term: 28 index: 19. (index mismatch)
I20260709 12:14:22.521374 24056 consensus_queue.cc:1048] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:14:22.535184 24056 raft_consensus.cc:493] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:22.535796 24056 raft_consensus.cc:515] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:22.537959 24056 leader_election.cc:290] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:14:22.545981 13800 leader_election.cc:336] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
W20260709 12:14:22.547979 13800 leader_election.cc:336] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111)
I20260709 12:14:22.548435 13800 leader_election.cc:304] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:22.549723 24056 raft_consensus.cc:2749] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:14:22.551693 24029 raft_consensus.cc:493] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:22.552213 24029 raft_consensus.cc:515] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:22.554440 24029 leader_election.cc:290] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:14:22.556670 13800 consensus_peers.cc:597] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd -> Peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Couldn't send request to peer 3f37c9cc9dda46b4be21dd675ba78fb7. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:22.557240 13800 consensus_peers.cc:597] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd -> Peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Couldn't send request to peer 3f37c9cc9dda46b4be21dd675ba78fb7. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:22.561486 14379 consensus_peers.cc:597] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:14:22.590301 13800 leader_election.cc:336] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
W20260709 12:14:22.593719 13800 leader_election.cc:336] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111)
I20260709 12:14:22.594344 13800 leader_election.cc:304] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:22.599521 24032 raft_consensus.cc:2749] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
W20260709 12:14:22.728629 13800 consensus_peers.cc:597] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd -> Peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Couldn't send request to peer 3f37c9cc9dda46b4be21dd675ba78fb7. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:22.729719 24060 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P ca9fbbc2c0a94897897d502d42f3951f [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:22.730453 24060 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P ca9fbbc2c0a94897897d502d42f3951f [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:22.734928 13832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2541d5a960c4a8ba1d642e9a29fd19c" candidate_uuid: "ca9fbbc2c0a94897897d502d42f3951f" candidate_term: 31 candidate_status { last_received { term: 30 index: 19 } } ignore_live_leader: false dest_uuid: "96701a74fdee481fb5f54aac841e17dd" is_pre_election: true
I20260709 12:14:22.735730 13832 raft_consensus.cc:2468] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca9fbbc2c0a94897897d502d42f3951f in term 30.
I20260709 12:14:22.742080 24060 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:14:22.753074 14379 leader_election.cc:336] T a2541d5a960c4a8ba1d642e9a29fd19c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111)
W20260709 12:14:22.754010 14379 leader_election.cc:336] T a2541d5a960c4a8ba1d642e9a29fd19c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
I20260709 12:14:22.754562 14379 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd, ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:22.755368 24060 raft_consensus.cc:2749] T a2541d5a960c4a8ba1d642e9a29fd19c P ca9fbbc2c0a94897897d502d42f3951f [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:14:22.777626 24032 raft_consensus.cc:493] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:22.778260 24032 raft_consensus.cc:515] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:22.780465 24032 leader_election.cc:290] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:14:22.786321 13832 raft_consensus.cc:1275] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Refusing update from remote peer ca9fbbc2c0a94897897d502d42f3951f: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 12:14:22.789211 24006 consensus_queue.cc:1048] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [LEADER]: Connected to new peer: Peer: permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
W20260709 12:14:22.792200 13800 leader_election.cc:336] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
W20260709 12:14:22.793102 13800 leader_election.cc:336] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111)
I20260709 12:14:22.793680 13800 leader_election.cc:304] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:22.795125 24032 raft_consensus.cc:2749] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 12:14:22.837004 14379 consensus_peers.cc:597] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f -> Peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Couldn't send request to peer 3f37c9cc9dda46b4be21dd675ba78fb7. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:22.871119 14379 consensus_peers.cc:597] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:14:22.902370 13800 consensus_peers.cc:597] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:14:22.977161 14379 consensus_peers.cc:597] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:14:22.990857 24032 raft_consensus.cc:493] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:22.991475 24032 raft_consensus.cc:515] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:22.993574 24032 leader_election.cc:290] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:14:23.001324 13800 leader_election.cc:336] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
W20260709 12:14:23.002133 13800 leader_election.cc:336] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111)
I20260709 12:14:23.002564 13800 leader_election.cc:304] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:23.003912 24029 raft_consensus.cc:2749] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:14:23.172127 24029 raft_consensus.cc:493] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 31 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:23.172631 24029 raft_consensus.cc:515] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:23.174634 24029 leader_election.cc:290] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:14:23.180114 24030 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 36 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:23.180716 24030 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 36 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
W20260709 12:14:23.182631 13800 leader_election.cc:336] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
I20260709 12:14:23.182865 24030 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:14:23.184398 13800 leader_election.cc:336] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111)
I20260709 12:14:23.184979 13800 leader_election.cc:304] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:23.185732 24029 raft_consensus.cc:2749] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
W20260709 12:14:23.192539 14379 leader_election.cc:336] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 37 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111)
W20260709 12:14:23.197507 14379 leader_election.cc:336] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 37 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
I20260709 12:14:23.198210 14379 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:23.199414 24030 raft_consensus.cc:2749] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 36 FOLLOWER]: Leader pre-election lost for term 37. Reason: could not achieve majority
W20260709 12:14:23.364990 14379 consensus_peers.cc:597] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:14:23.400842 24056 raft_consensus.cc:493] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:23.401458 24056 raft_consensus.cc:515] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:23.403646 24056 leader_election.cc:290] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:14:23.411422 13800 leader_election.cc:336] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
W20260709 12:14:23.413640 13800 leader_election.cc:336] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111)
I20260709 12:14:23.414179 13800 leader_election.cc:304] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:23.414976 24056 raft_consensus.cc:2749] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 12:14:23.426452 14379 consensus_peers.cc:597] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:14:23.437208 14379 consensus_peers.cc:597] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:14:23.447048 13800 consensus_peers.cc:597] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:14:23.495059 24006 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:23.495641 24006 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:23.504577 24006 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:14:23.510051 14379 leader_election.cc:336] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
I20260709 12:14:23.511039 24006 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:23.511600 24006 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:23.513372 24006 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:14:23.511006 12515 tablet_server.cc:196] TabletServer@127.12.56.194:0 shutdown complete.
W20260709 12:14:23.523195 14379 leader_election.cc:336] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111)
I20260709 12:14:23.528205 14379 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:23.529942 24006 raft_consensus.cc:2749] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 12:14:23.544425 14379 leader_election.cc:336] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111)
W20260709 12:14:23.551077 14379 leader_election.cc:336] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
W20260709 12:14:23.553470 13800 consensus_peers.cc:597] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:14:23.555333 14379 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:23.556174 24006 raft_consensus.cc:2749] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 12:14:23.564990 13570 catalog_manager.cc:4755] TS b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet d8f8986661dd4d049ab4a79338d33a1a: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
I20260709 12:14:23.707382 12515 tablet_server.cc:179] TabletServer@127.12.56.195:0 shutting down...
W20260709 12:14:23.727995 14379 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111) [suppressed 590 similar messages]
W20260709 12:14:23.734807 14379 consensus_peers.cc:597] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:14:23.759541 14380 consensus_peers.cc:597] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f -> Peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Couldn't send request to peer 96701a74fdee481fb5f54aac841e17dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:23.763154 14380 consensus_peers.cc:597] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f -> Peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Couldn't send request to peer 96701a74fdee481fb5f54aac841e17dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:23.766844 14380 consensus_peers.cc:597] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f -> Peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Couldn't send request to peer 96701a74fdee481fb5f54aac841e17dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:23.817865 12515 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:23.821164 12515 tablet_replica.cc:333] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd: stopping tablet replica
I20260709 12:14:23.822412 12515 raft_consensus.cc:2243] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:23.824205 12515 raft_consensus.cc:2272] T 0a8c7c772cf44d36bc44b25edc405d1d P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:23.828437 12515 tablet_replica.cc:333] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd: stopping tablet replica
I20260709 12:14:23.829413 12515 raft_consensus.cc:2243] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 26 LEADER]: Raft consensus shutting down.
I20260709 12:14:23.831073 12515 raft_consensus.cc:2272] T e880992fc1b041b1a1717bb18203a22f P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:23.831570 14380 consensus_peers.cc:597] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f -> Peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Couldn't send request to peer 96701a74fdee481fb5f54aac841e17dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:23.834219 12515 tablet_replica.cc:333] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd: stopping tablet replica
I20260709 12:14:23.835312 12515 raft_consensus.cc:2243] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 29 LEADER]: Raft consensus shutting down.
I20260709 12:14:23.836762 12515 raft_consensus.cc:2272] T d8f8986661dd4d049ab4a79338d33a1a P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:23.839998 12515 tablet_replica.cc:333] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd: stopping tablet replica
I20260709 12:14:23.841100 12515 raft_consensus.cc:2243] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:23.842455 12515 raft_consensus.cc:2272] T 7a7564a63b8041ff80f64a7f8d533acb P 96701a74fdee481fb5f54aac841e17dd [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:23.852679 12515 tablet_replica.cc:333] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd: stopping tablet replica
I20260709 12:14:23.853672 12515 raft_consensus.cc:2243] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:23.854478 12515 raft_consensus.cc:2272] T 956300599d004370953188dd3ae3a256 P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:23.857219 12515 tablet_replica.cc:333] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd: stopping tablet replica
I20260709 12:14:23.858088 12515 raft_consensus.cc:2243] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 27 LEADER]: Raft consensus shutting down.
I20260709 12:14:23.859287 12515 raft_consensus.cc:2272] T aa310cca462541d39d36ebe94a27446e P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:23.865198 12515 tablet_replica.cc:333] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd: stopping tablet replica
W20260709 12:14:23.868239 14379 consensus_peers.cc:597] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:14:23.869228 12515 raft_consensus.cc:2243] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 36 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:23.870533 12515 raft_consensus.cc:2272] T 1e31cd7111f2470d8d34b5898dce5765 P 96701a74fdee481fb5f54aac841e17dd [term 36 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:23.873894 12515 tablet_replica.cc:333] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd: stopping tablet replica
W20260709 12:14:23.881625 14379 consensus_peers.cc:597] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:14:23.883826 12515 raft_consensus.cc:2243] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 32 LEADER]: Raft consensus shutting down.
W20260709 12:14:23.885461 14380 consensus_peers.cc:597] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f -> Peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Couldn't send request to peer 96701a74fdee481fb5f54aac841e17dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:23.885998 12515 raft_consensus.cc:2272] T 2614cf111d8b41fca205e6eff5934612 P 96701a74fdee481fb5f54aac841e17dd [term 32 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:23.891533 12515 tablet_replica.cc:333] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd: stopping tablet replica
I20260709 12:14:23.892616 12515 raft_consensus.cc:2243] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 29 LEADER]: Raft consensus shutting down.
I20260709 12:14:23.894222 12515 raft_consensus.cc:2272] T 1d3056e0d375412a9db3769da3ef2eb9 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:23.897534 12515 tablet_replica.cc:333] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd: stopping tablet replica
I20260709 12:14:23.898617 12515 raft_consensus.cc:2243] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 28 LEADER]: Raft consensus shutting down.
I20260709 12:14:23.899935 12515 raft_consensus.cc:2272] T 25896261d1204b3d858fb5b478a89034 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:23.903280 12515 tablet_replica.cc:333] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd: stopping tablet replica
W20260709 12:14:23.908339 14380 consensus_peers.cc:597] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f -> Peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Couldn't send request to peer 96701a74fdee481fb5f54aac841e17dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:23.911769 12515 raft_consensus.cc:2243] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 31 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:23.914399 12515 raft_consensus.cc:2272] T 107415ab6e76484890fa8115e8832a21 P 96701a74fdee481fb5f54aac841e17dd [term 31 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:23.918275 12515 tablet_replica.cc:333] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd: stopping tablet replica
I20260709 12:14:23.919299 12515 raft_consensus.cc:2243] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 28 LEADER]: Raft consensus shutting down.
W20260709 12:14:23.925804 14380 consensus_peers.cc:597] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f -> Peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Couldn't send request to peer 96701a74fdee481fb5f54aac841e17dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:23.931329 12515 raft_consensus.cc:2272] T 026a826aa72f4cbea032d49e318401ae P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:23.936650 12515 tablet_replica.cc:333] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd: stopping tablet replica
I20260709 12:14:23.939128 12515 raft_consensus.cc:2243] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Raft consensus shutting down.
W20260709 12:14:23.941327 14380 consensus_peers.cc:597] T 0a8c7c772cf44d36bc44b25edc405d1d P ca9fbbc2c0a94897897d502d42f3951f -> Peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Couldn't send request to peer 96701a74fdee481fb5f54aac841e17dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:23.942505 12515 raft_consensus.cc:2272] T e5274c30729744338992e7c7710e5266 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:23.945861 12515 tablet_replica.cc:333] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd: stopping tablet replica
I20260709 12:14:23.946928 12515 raft_consensus.cc:2243] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:23.949057 12515 raft_consensus.cc:2272] T 51d10bdf51504a12a70a50e9a48f7ede P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:23.953321 12515 tablet_replica.cc:333] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd: stopping tablet replica
I20260709 12:14:23.957257 12515 raft_consensus.cc:2243] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:23.958572 12515 raft_consensus.cc:2272] T ca94d8f3109143599733e3a684149726 P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:23.962366 12515 tablet_replica.cc:333] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd: stopping tablet replica
I20260709 12:14:23.971798 12515 raft_consensus.cc:2243] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:23.977625 12515 raft_consensus.cc:2272] T 277b655b7311432a95ed2ad291df0b8d P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:23.976591 14380 consensus_peers.cc:597] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f -> Peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Couldn't send request to peer 96701a74fdee481fb5f54aac841e17dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:23.989194 12515 tablet_replica.cc:333] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd: stopping tablet replica
I20260709 12:14:23.990307 12515 raft_consensus.cc:2243] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:23.991719 12515 raft_consensus.cc:2272] T 7639868c5cbf467e82d51f50ad8d6379 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:23.995338 12515 tablet_replica.cc:333] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd: stopping tablet replica
I20260709 12:14:23.996359 12515 raft_consensus.cc:2243] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:23.997673 12515 raft_consensus.cc:2272] T 66aa0310b814479591b9f665634674f1 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.001389 12515 tablet_replica.cc:333] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd: stopping tablet replica
I20260709 12:14:24.002391 12515 raft_consensus.cc:2243] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.003202 12515 raft_consensus.cc:2272] T 243ef5a036904f43835a7e29d96599de P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.006438 12515 tablet_replica.cc:333] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd: stopping tablet replica
I20260709 12:14:24.007433 12515 raft_consensus.cc:2243] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.008510 12515 raft_consensus.cc:2272] T 9dfb6cae84194e19bf3a75e14c3d2263 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.011783 12515 tablet_replica.cc:333] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd: stopping tablet replica
I20260709 12:14:24.013290 12515 raft_consensus.cc:2243] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 30 LEADER]: Raft consensus shutting down.
I20260709 12:14:24.015805 12515 raft_consensus.cc:2272] T f1bace76cb204a6d92c38685645dd9db P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.020406 12515 tablet_replica.cc:333] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd: stopping tablet replica
I20260709 12:14:24.021485 12515 raft_consensus.cc:2243] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.022486 12515 raft_consensus.cc:2272] T 58c7d3b9588c414ba528311a1818a44b P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.029083 24056 raft_consensus.cc:493] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 33 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:24.029615 12515 tablet_replica.cc:333] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd: stopping tablet replica
I20260709 12:14:24.029754 24056 raft_consensus.cc:515] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:24.030721 12515 raft_consensus.cc:2243] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 29 LEADER]: Raft consensus shutting down.
I20260709 12:14:24.031971 12515 raft_consensus.cc:2272] T 15347ea1eb2348e7b262bd0d59ce6f3a P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.032341 24056 leader_election.cc:290] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:14:24.035192 12515 tablet_replica.cc:333] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd: stopping tablet replica
I20260709 12:14:24.036245 12515 raft_consensus.cc:2243] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.037187 12515 raft_consensus.cc:2272] T cad007c01ddb46db81e7206ec8b58024 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.040520 12515 tablet_replica.cc:333] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd: stopping tablet replica
W20260709 12:14:24.042745 13800 leader_election.cc:336] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 34 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111)
W20260709 12:14:24.043612 13800 leader_election.cc:336] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 34 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
I20260709 12:14:24.044116 13800 leader_election.cc:304] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:24.046481 24032 raft_consensus.cc:2749] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 33 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
I20260709 12:14:24.049316 12515 raft_consensus.cc:2243] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 31 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.051143 12515 raft_consensus.cc:2272] T b57529c42e834d3f85dd24588a5d5773 P 96701a74fdee481fb5f54aac841e17dd [term 31 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.054324 12515 tablet_replica.cc:333] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd: stopping tablet replica
I20260709 12:14:24.055244 12515 raft_consensus.cc:2243] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.056389 12515 raft_consensus.cc:2272] T d2f365337b324999a073edacbe6c6e09 P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.059607 12515 tablet_replica.cc:333] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd: stopping tablet replica
I20260709 12:14:24.060675 12515 raft_consensus.cc:2243] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.061408 12515 raft_consensus.cc:2272] T 407aabb01908409185c74e2349da4c3d P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.064535 12515 tablet_replica.cc:333] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd: stopping tablet replica
W20260709 12:14:24.065950 13800 consensus_peers.cc:597] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:14:24.065537 12515 raft_consensus.cc:2243] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 33 LEADER]: Raft consensus shutting down.
I20260709 12:14:24.070540 12515 raft_consensus.cc:2272] T 14d7a26ca33940fbba5fa30c5212e5ac P 96701a74fdee481fb5f54aac841e17dd [term 33 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.074025 12515 tablet_replica.cc:333] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd: stopping tablet replica
I20260709 12:14:24.075021 12515 raft_consensus.cc:2243] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:14:24.076381 12515 raft_consensus.cc:2272] T c95811190f014949bb25448e8db1040e P 96701a74fdee481fb5f54aac841e17dd [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.081732 12515 tablet_replica.cc:333] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd: stopping tablet replica
I20260709 12:14:24.084233 12515 raft_consensus.cc:2243] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 30 LEADER]: Raft consensus shutting down.
I20260709 12:14:24.086027 12515 raft_consensus.cc:2272] T b2210d5649f048c68ae57986b065cb28 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.089083 12515 tablet_replica.cc:333] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd: stopping tablet replica
I20260709 12:14:24.089994 12515 raft_consensus.cc:2243] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.090811 12515 raft_consensus.cc:2272] T dca45e62639f49b4a8367d6868dabc07 P 96701a74fdee481fb5f54aac841e17dd [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:24.098376 14380 consensus_peers.cc:597] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f -> Peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Couldn't send request to peer 96701a74fdee481fb5f54aac841e17dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:24.099596 12515 tablet_replica.cc:333] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd: stopping tablet replica
I20260709 12:14:24.100672 12515 raft_consensus.cc:2243] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.101523 12515 raft_consensus.cc:2272] T e8e96840ffec4e38a0f975263031c226 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.107187 12515 tablet_replica.cc:333] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd: stopping tablet replica
W20260709 12:14:24.107714 14379 consensus_peers.cc:597] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:14:24.109261 12515 raft_consensus.cc:2243] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.110525 12515 raft_consensus.cc:2272] T ab7af43351ec498cb9e13128a20c3c89 P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.113814 12515 tablet_replica.cc:333] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd: stopping tablet replica
I20260709 12:14:24.114833 12515 raft_consensus.cc:2243] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 25 LEADER]: Raft consensus shutting down.
W20260709 12:14:24.122315 14379 consensus_peers.cc:597] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:14:24.124348 24032 raft_consensus.cc:493] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:24.125044 12515 raft_consensus.cc:2272] T d43dfb2e8dc04299ad696b99238cf41a P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.125041 24032 raft_consensus.cc:515] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } }
I20260709 12:14:24.127780 24032 leader_election.cc:290] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
I20260709 12:14:24.128834 12515 tablet_replica.cc:333] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd: stopping tablet replica
I20260709 12:14:24.131376 12515 raft_consensus.cc:2243] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.132541 12515 raft_consensus.cc:2272] T 2e7fcff4988b4d928d7bb79c969a2025 P 96701a74fdee481fb5f54aac841e17dd [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:24.135108 13800 leader_election.cc:336] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
W20260709 12:14:24.136157 13800 leader_election.cc:336] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111)
I20260709 12:14:24.136619 13800 leader_election.cc:304] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96701a74fdee481fb5f54aac841e17dd; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:24.137373 24032 raft_consensus.cc:2749] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 12:14:24.138942 14379 consensus_peers.cc:597] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f -> Peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Couldn't send request to peer 3f37c9cc9dda46b4be21dd675ba78fb7. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:24.141302 12515 tablet_replica.cc:333] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd: stopping tablet replica
I20260709 12:14:24.142485 12515 raft_consensus.cc:2243] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.143436 12515 raft_consensus.cc:2272] T d9c029efbe5e410cb15f323fd19bf316 P 96701a74fdee481fb5f54aac841e17dd [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.146450 12515 tablet_replica.cc:333] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd: stopping tablet replica
I20260709 12:14:24.147326 12515 raft_consensus.cc:2243] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.148080 12515 raft_consensus.cc:2272] T c97f901403f34a8ca78bfeb8472bfa6e P 96701a74fdee481fb5f54aac841e17dd [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.150955 12515 tablet_replica.cc:333] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd: stopping tablet replica
I20260709 12:14:24.151818 12515 raft_consensus.cc:2243] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 33 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.155820 12515 raft_consensus.cc:2272] T 232d133451004a83941860574adec712 P 96701a74fdee481fb5f54aac841e17dd [term 33 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.161432 12515 tablet_replica.cc:333] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd: stopping tablet replica
I20260709 12:14:24.162599 12515 raft_consensus.cc:2243] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 35 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.164003 12515 raft_consensus.cc:2272] T 0e3f87a61fef4f1ca0b961e7c64d63f8 P 96701a74fdee481fb5f54aac841e17dd [term 35 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.167121 12515 tablet_replica.cc:333] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd: stopping tablet replica
I20260709 12:14:24.168004 12515 raft_consensus.cc:2243] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Raft consensus shutting down.
W20260709 12:14:24.168390 14380 consensus_peers.cc:597] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f -> Peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Couldn't send request to peer 96701a74fdee481fb5f54aac841e17dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:24.168785 12515 raft_consensus.cc:2272] T 56d28ac895464968890083dea150a58d P 96701a74fdee481fb5f54aac841e17dd [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.171878 12515 tablet_replica.cc:333] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd: stopping tablet replica
I20260709 12:14:24.172794 12515 raft_consensus.cc:2243] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.173561 12515 raft_consensus.cc:2272] T 3f29dda715314a93a03981264972c4c3 P 96701a74fdee481fb5f54aac841e17dd [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.176573 12515 tablet_replica.cc:333] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd: stopping tablet replica
I20260709 12:14:24.177520 12515 raft_consensus.cc:2243] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.181145 24030 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:24.181749 24030 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:24.183947 24030 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:14:24.191504 14379 leader_election.cc:336] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
W20260709 12:14:24.193466 14379 leader_election.cc:336] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111)
I20260709 12:14:24.194082 14379 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:24.194307 24030 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:24.194965 24030 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:24.195425 12515 raft_consensus.cc:2272] T 637cf9d05e2348118404a474b84d67d7 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.197361 24067 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 12:14:24.199817 14380 consensus_peers.cc:597] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f -> Peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Couldn't send request to peer 96701a74fdee481fb5f54aac841e17dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:24.201364 12515 tablet_replica.cc:333] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd: stopping tablet replica
I20260709 12:14:24.206714 12515 raft_consensus.cc:2243] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 28 LEADER]: Raft consensus shutting down.
I20260709 12:14:24.208065 12515 raft_consensus.cc:2272] T c3c06f5564ed4c259ca5c238c3faf2a3 P 96701a74fdee481fb5f54aac841e17dd [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.211094 12515 tablet_replica.cc:333] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd: stopping tablet replica
I20260709 12:14:24.211971 12515 raft_consensus.cc:2243] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.213018 12515 raft_consensus.cc:2272] T a2541d5a960c4a8ba1d642e9a29fd19c P 96701a74fdee481fb5f54aac841e17dd [term 30 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:24.215469 14380 consensus_peers.cc:597] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f -> Peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Couldn't send request to peer 96701a74fdee481fb5f54aac841e17dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:24.205595 14379 leader_election.cc:336] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
I20260709 12:14:24.216151 12515 tablet_replica.cc:333] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd: stopping tablet replica
I20260709 12:14:24.201435 24030 leader_election.cc:290] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:14:24.222443 14379 leader_election.cc:336] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111)
I20260709 12:14:24.222958 14379 leader_election.cc:304] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:24.224706 12515 raft_consensus.cc:2243] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 31 LEADER]: Raft consensus shutting down.
I20260709 12:14:24.225972 24030 raft_consensus.cc:2749] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:14:24.226854 12515 raft_consensus.cc:2272] T dabf40829555486da9d6b588472147ec P 96701a74fdee481fb5f54aac841e17dd [term 31 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.230197 12515 tablet_replica.cc:333] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd: stopping tablet replica
I20260709 12:14:24.231065 12515 raft_consensus.cc:2243] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.241526 12515 raft_consensus.cc:2272] T a3c0f10b06fa4aa48a99239da6d81a1f P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.244889 12515 tablet_replica.cc:333] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd: stopping tablet replica
I20260709 12:14:24.245837 12515 raft_consensus.cc:2243] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 38 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.247071 12515 raft_consensus.cc:2272] T f1494f6353074242857c7901c21da06d P 96701a74fdee481fb5f54aac841e17dd [term 38 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.250080 12515 tablet_replica.cc:333] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd: stopping tablet replica
I20260709 12:14:24.251037 12515 raft_consensus.cc:2243] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 35 LEADER]: Raft consensus shutting down.
I20260709 12:14:24.252318 12515 raft_consensus.cc:2272] T f9139e027a704f14bb60e60e22390d08 P 96701a74fdee481fb5f54aac841e17dd [term 35 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:24.255579 12515 tablet_replica.cc:333] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd: stopping tablet replica
I20260709 12:14:24.256410 12515 raft_consensus.cc:2243] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:24.257246 12515 raft_consensus.cc:2272] T 566e3cc2115c4b6dbd3070c4f4f4f11b P 96701a74fdee481fb5f54aac841e17dd [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:24.305742 14379 consensus_peers.cc:597] T 0a8c7c772cf44d36bc44b25edc405d1d P ca9fbbc2c0a94897897d502d42f3951f -> Peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Couldn't send request to peer 3f37c9cc9dda46b4be21dd675ba78fb7. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:24.415222 14379 consensus_peers.cc:597] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f -> Peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Couldn't send request to peer 3f37c9cc9dda46b4be21dd675ba78fb7. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:24.415879 14379 consensus_peers.cc:597] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f -> Peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Couldn't send request to peer 3f37c9cc9dda46b4be21dd675ba78fb7. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:24.441103 14379 consensus_peers.cc:597] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:14:24.502897 14379 consensus_peers.cc:597] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:14:24.639870 14379 consensus_peers.cc:597] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f -> Peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Couldn't send request to peer 3f37c9cc9dda46b4be21dd675ba78fb7. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:24.687860 14379 consensus_peers.cc:597] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f -> Peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Couldn't send request to peer 3f37c9cc9dda46b4be21dd675ba78fb7. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:24.728829 14379 consensus_peers.cc:597] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f -> Peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Couldn't send request to peer 3f37c9cc9dda46b4be21dd675ba78fb7. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:24.799753 14379 consensus_peers.cc:597] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f -> Peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Couldn't send request to peer 3f37c9cc9dda46b4be21dd675ba78fb7. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:24.842659 14379 consensus_peers.cc:597] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:14:24.892354 24030 raft_consensus.cc:493] T a2541d5a960c4a8ba1d642e9a29fd19c P ca9fbbc2c0a94897897d502d42f3951f [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:24.892938 24030 raft_consensus.cc:515] T a2541d5a960c4a8ba1d642e9a29fd19c P ca9fbbc2c0a94897897d502d42f3951f [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } attrs { replace: true } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:24.895857 24030 leader_election.cc:290] T a2541d5a960c4a8ba1d642e9a29fd19c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:14:24.905328 24006 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:14:24.908166 24006 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:24.910712 24006 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:14:24.914526 14380 leader_election.cc:336] T a2541d5a960c4a8ba1d642e9a29fd19c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Network error: Client connection negotiation failed: client connection to 127.12.56.195:36603: connect: Connection refused (error 111)
W20260709 12:14:24.917446 14379 leader_election.cc:336] T a2541d5a960c4a8ba1d642e9a29fd19c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
I20260709 12:14:24.920418 14379 leader_election.cc:304] T a2541d5a960c4a8ba1d642e9a29fd19c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
W20260709 12:14:24.922433 14379 leader_election.cc:336] T a2541d5a960c4a8ba1d642e9a29fd19c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111)
I20260709 12:14:24.923035 24006 raft_consensus.cc:2749] T a2541d5a960c4a8ba1d642e9a29fd19c P ca9fbbc2c0a94897897d502d42f3951f [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
W20260709 12:14:24.919673 14380 leader_election.cc:336] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Network error: Client connection negotiation failed: client connection to 127.12.56.195:36603: connect: Connection refused (error 111)
W20260709 12:14:24.939224 14379 leader_election.cc:336] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111)
I20260709 12:14:24.939843 14379 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:14:24.940659 24006 raft_consensus.cc:2749] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:14:24.969199 24006 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:14:24.971686 24006 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:24.973955 24006 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
I20260709 12:14:24.979611 24006 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:14:24.980299 24006 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:24.983003 24006 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:14:24.988570 14380 leader_election.cc:336] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Network error: Client connection negotiation failed: client connection to 127.12.56.195:36603: connect: Connection refused (error 111)
W20260709 12:14:24.993666 14380 leader_election.cc:336] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Network error: Client connection negotiation failed: client connection to 127.12.56.195:36603: connect: Connection refused (error 111)
I20260709 12:14:25.002182 24006 raft_consensus.cc:493] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 36 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:25.002912 24006 raft_consensus.cc:515] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 36 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:25.005498 24006 leader_election.cc:290] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 37 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:14:25.039081 14379 leader_election.cc:336] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111)
I20260709 12:14:25.039755 14379 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:14:25.040634 24006 raft_consensus.cc:2749] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:14:25.041637 24006 raft_consensus.cc:493] T d8f8986661dd4d049ab4a79338d33a1a P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:14:25.042223 24006 raft_consensus.cc:515] T d8f8986661dd4d049ab4a79338d33a1a P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:25.044395 24006 leader_election.cc:290] T d8f8986661dd4d049ab4a79338d33a1a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:14:25.059010 14380 leader_election.cc:336] T d8f8986661dd4d049ab4a79338d33a1a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Network error: Client connection negotiation failed: client connection to 127.12.56.195:36603: connect: Connection refused (error 111)
W20260709 12:14:25.063061 14379 leader_election.cc:336] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111)
I20260709 12:14:25.066833 14379 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:14:25.067830 24006 raft_consensus.cc:2749] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 12:14:25.095629 14379 leader_election.cc:336] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 37 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
W20260709 12:14:25.099047 14379 leader_election.cc:336] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 37 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111)
I20260709 12:14:25.101255 14379 leader_election.cc:304] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 37 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:25.103930 24006 raft_consensus.cc:2749] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 36 FOLLOWER]: Leader pre-election lost for term 37. Reason: could not achieve majority
W20260709 12:14:25.112360 14379 leader_election.cc:336] T d8f8986661dd4d049ab4a79338d33a1a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111)
I20260709 12:14:25.113902 14379 leader_election.cc:304] T d8f8986661dd4d049ab4a79338d33a1a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:14:25.114876 24006 raft_consensus.cc:2749] T d8f8986661dd4d049ab4a79338d33a1a P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:14:25.171717 24006 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:14:25.172338 24006 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:25.174674 24006 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:14:25.180070 14380 leader_election.cc:336] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Network error: Client connection negotiation failed: client connection to 127.12.56.195:36603: connect: Connection refused (error 111)
W20260709 12:14:25.186373 14379 consensus_peers.cc:597] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f -> Peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Couldn't send request to peer 3f37c9cc9dda46b4be21dd675ba78fb7. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:25.189033 14379 leader_election.cc:336] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
I20260709 12:14:25.189646 14379 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:25.190568 24006 raft_consensus.cc:2749] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:14:25.272411 14379 consensus_peers.cc:597] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:14:25.295480 24006 raft_consensus.cc:493] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:25.296185 24006 raft_consensus.cc:515] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:25.301631 24006 leader_election.cc:290] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:14:25.315414 14379 leader_election.cc:336] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
W20260709 12:14:25.316440 14379 leader_election.cc:336] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111)
I20260709 12:14:25.317081 14379 leader_election.cc:304] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:25.318159 24006 raft_consensus.cc:2749] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 12:14:25.428424 12515 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 13858)
I20260709 12:14:25.453917 24006 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:14:25.454675 24006 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:25.463897 24006 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:14:25.465994 14380 leader_election.cc:336] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Network error: Client connection negotiation failed: client connection to 127.12.56.195:36603: connect: Connection refused (error 111)
W20260709 12:14:25.482144 14379 leader_election.cc:336] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111)
I20260709 12:14:25.482832 14379 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:14:25.483807 24006 raft_consensus.cc:2749] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:14:25.516942 24006 raft_consensus.cc:493] T d43dfb2e8dc04299ad696b99238cf41a P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:14:25.517549 24006 raft_consensus.cc:515] T d43dfb2e8dc04299ad696b99238cf41a P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } attrs { replace: true } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:25.522059 24006 leader_election.cc:290] T d43dfb2e8dc04299ad696b99238cf41a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:14:25.526482 14380 leader_election.cc:336] T d43dfb2e8dc04299ad696b99238cf41a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Network error: Client connection negotiation failed: client connection to 127.12.56.195:36603: connect: Connection refused (error 111)
W20260709 12:14:25.542493 14379 leader_election.cc:336] T d43dfb2e8dc04299ad696b99238cf41a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
I20260709 12:14:25.543154 14379 leader_election.cc:304] T d43dfb2e8dc04299ad696b99238cf41a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:25.544294 24006 raft_consensus.cc:2749] T d43dfb2e8dc04299ad696b99238cf41a P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:14:25.546878 24006 raft_consensus.cc:493] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 35 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:14:25.547381 24006 raft_consensus.cc:515] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 35 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:25.549481 24006 leader_election.cc:290] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 36 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:14:25.554595 14380 leader_election.cc:336] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 36 pre-election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Network error: Client connection negotiation failed: client connection to 127.12.56.195:36603: connect: Connection refused (error 111)
W20260709 12:14:25.555577 14379 leader_election.cc:336] T d43dfb2e8dc04299ad696b99238cf41a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111)
W20260709 12:14:25.562003 14379 leader_election.cc:336] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 36 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111)
I20260709 12:14:25.566038 14379 leader_election.cc:304] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 36 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:14:25.566908 24006 raft_consensus.cc:2749] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 35 FOLLOWER]: Leader pre-election lost for term 36. Reason: could not achieve majority
I20260709 12:14:25.569231 24006 raft_consensus.cc:493] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:14:25.569692 24006 raft_consensus.cc:515] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:25.571623 24006 leader_election.cc:290] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:14:25.577109 14380 leader_election.cc:336] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Network error: Client connection negotiation failed: client connection to 127.12.56.195:36603: connect: Connection refused (error 111)
W20260709 12:14:25.582355 14379 leader_election.cc:336] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111)
I20260709 12:14:25.582815 14379 leader_election.cc:304] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:14:25.583556 24006 raft_consensus.cc:2749] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 12:14:25.669075 14379 consensus_peers.cc:597] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:25.764375 14379 consensus_peers.cc:597] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f -> Peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Couldn't send request to peer 3f37c9cc9dda46b4be21dd675ba78fb7. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:25.817718 14379 consensus_peers.cc:597] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:14:25.840420 14379 consensus_peers.cc:597] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:14:25.979871 14379 consensus_peers.cc:597] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:14:26.074916 14379 consensus_peers.cc:597] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:14:26.250607 24071 raft_consensus.cc:493] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:26.251302 24071 raft_consensus.cc:515] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:26.254060 24071 leader_election.cc:290] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:14:26.275241 14379 leader_election.cc:336] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111)
W20260709 12:14:26.276044 14379 leader_election.cc:336] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
I20260709 12:14:26.276526 14379 leader_election.cc:304] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:26.277552 24071 raft_consensus.cc:2749] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 12:14:26.358393 14379 consensus_peers.cc:597] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:14:26.396871 14379 consensus_peers.cc:597] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:14:26.502287 24030 raft_consensus.cc:493] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:14:26.502892 24030 raft_consensus.cc:515] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:26.505699 24030 leader_election.cc:290] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:14:26.511737 14379 leader_election.cc:336] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111)
I20260709 12:14:26.647899 24030 raft_consensus.cc:493] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:14:26.648454 24030 raft_consensus.cc:515] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:26.650677 24030 leader_election.cc:290] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:14:26.655385 14379 consensus_peers.cc:597] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:14:26.656796 14379 consensus_peers.cc:597] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f -> Peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Couldn't send request to peer 3f37c9cc9dda46b4be21dd675ba78fb7. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:26.660212 14379 leader_election.cc:336] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111)
W20260709 12:14:26.793931 14379 consensus_peers.cc:597] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:14:26.801947 14379 consensus_peers.cc:597] T 0a8c7c772cf44d36bc44b25edc405d1d P ca9fbbc2c0a94897897d502d42f3951f -> Peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Couldn't send request to peer 3f37c9cc9dda46b4be21dd675ba78fb7. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:14:26.839416 14379 consensus_peers.cc:597] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f -> Peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Couldn't send request to peer 3f37c9cc9dda46b4be21dd675ba78fb7. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:14:26.840324 14379 consensus_peers.cc:597] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:14:26.867014 12515 tablet_server.cc:196] TabletServer@127.12.56.195:0 shutdown complete.
I20260709 12:14:26.914217 24074 raft_consensus.cc:493] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:26.914930 24074 raft_consensus.cc:515] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:26.917543 24074 leader_election.cc:290] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:14:26.929469 14379 leader_election.cc:336] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
W20260709 12:14:26.930511 14379 leader_election.cc:336] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111)
I20260709 12:14:26.931123 14379 leader_election.cc:304] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:26.932065 24074 raft_consensus.cc:2749] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 12:14:26.967579 14380 consensus_peers.cc:597] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f -> Peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Couldn't send request to peer 96701a74fdee481fb5f54aac841e17dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.195:36603: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:26.968590 14380 consensus_peers.cc:597] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f -> Peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Couldn't send request to peer 96701a74fdee481fb5f54aac841e17dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.195:36603: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:26.970052 14380 consensus_peers.cc:597] T 0a8c7c772cf44d36bc44b25edc405d1d P ca9fbbc2c0a94897897d502d42f3951f -> Peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Couldn't send request to peer 96701a74fdee481fb5f54aac841e17dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.195:36603: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:26.975376 14380 consensus_peers.cc:597] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f -> Peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Couldn't send request to peer 96701a74fdee481fb5f54aac841e17dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.195:36603: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:26.976183 14380 leader_election.cc:336] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Network error: Client connection negotiation failed: client connection to 127.12.56.195:36603: connect: Connection refused (error 111)
I20260709 12:14:26.976745 14380 leader_election.cc:304] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:14:26.977710 24074 raft_consensus.cc:2749] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 12:14:26.979228 14380 leader_election.cc:336] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Network error: Client connection negotiation failed: client connection to 127.12.56.195:36603: connect: Connection refused (error 111)
I20260709 12:14:26.979773 14380 leader_election.cc:304] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:14:26.980741 24074 raft_consensus.cc:2749] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 12:14:26.985343 14380 consensus_peers.cc:597] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f -> Peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Couldn't send request to peer 96701a74fdee481fb5f54aac841e17dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.195:36603: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:27.009990 24074 raft_consensus.cc:493] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 3f37c9cc9dda46b4be21dd675ba78fb7)
I20260709 12:14:27.010718 24074 raft_consensus.cc:515] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:27.011569 12515 tablet_server.cc:179] TabletServer@127.12.56.196:0 shutting down...
I20260709 12:14:27.014086 24074 leader_election.cc:290] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545)
W20260709 12:14:27.024796 14379 leader_election.cc:336] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
W20260709 12:14:27.026055 14379 leader_election.cc:336] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111)
I20260709 12:14:27.026669 14379 leader_election.cc:304] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:27.030256 24030 raft_consensus.cc:2749] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:14:27.035941 24074 raft_consensus.cc:493] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:14:27.036721 24074 raft_consensus.cc:515] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:27.041006 24074 leader_election.cc:290] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:14:27.046777 14379 leader_election.cc:336] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111)
W20260709 12:14:27.048642 14380 consensus_peers.cc:597] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f -> Peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Couldn't send request to peer 96701a74fdee481fb5f54aac841e17dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.195:36603: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:27.058871 24074 raft_consensus.cc:493] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:14:27.059476 24074 raft_consensus.cc:515] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b98d2519bb504dc6905ed2ede4571835" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33199 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:27.062302 24074 leader_election.cc:290] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:14:27.063057 14379 consensus_peers.cc:597] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:14:27.065194 14380 leader_election.cc:336] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Network error: Client connection negotiation failed: client connection to 127.12.56.195:36603: connect: Connection refused (error 111)
W20260709 12:14:27.065831 14379 leader_election.cc:336] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
I20260709 12:14:27.068698 14380 leader_election.cc:304] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:14:27.069667 24074 raft_consensus.cc:2749] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 12:14:27.075001 14380 leader_election.cc:336] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Network error: Client connection negotiation failed: client connection to 127.12.56.195:36603: connect: Connection refused (error 111)
I20260709 12:14:27.075628 14380 leader_election.cc:304] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 96701a74fdee481fb5f54aac841e17dd, b98d2519bb504dc6905ed2ede4571835
I20260709 12:14:27.076459 24074 raft_consensus.cc:2749] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:14:27.088580 14379 consensus_peers.cc:597] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f -> Peer b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): Couldn't send request to peer b98d2519bb504dc6905ed2ede4571835. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:14:27.099478 14380 consensus_peers.cc:597] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f -> Peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Couldn't send request to peer 96701a74fdee481fb5f54aac841e17dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.195:36603: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:27.105958 14380 consensus_peers.cc:597] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f -> Peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Couldn't send request to peer 96701a74fdee481fb5f54aac841e17dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.195:36603: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:27.117766 12515 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:27.118983 12515 tablet_replica.cc:333] T d43dfb2e8dc04299ad696b99238cf41a P ca9fbbc2c0a94897897d502d42f3951f: stopping tablet replica
I20260709 12:14:27.120221 12515 raft_consensus.cc:2243] T d43dfb2e8dc04299ad696b99238cf41a P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:27.121236 12515 raft_consensus.cc:2272] T d43dfb2e8dc04299ad696b99238cf41a P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:27.125444 12515 tablet_replica.cc:333] T d8f8986661dd4d049ab4a79338d33a1a P ca9fbbc2c0a94897897d502d42f3951f: stopping tablet replica
I20260709 12:14:27.126461 12515 raft_consensus.cc:2243] T d8f8986661dd4d049ab4a79338d33a1a P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:27.127372 12515 raft_consensus.cc:2272] T d8f8986661dd4d049ab4a79338d33a1a P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:27.130954 24074 raft_consensus.cc:493] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 96701a74fdee481fb5f54aac841e17dd)
I20260709 12:14:27.131264 12515 tablet_replica.cc:333] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f: stopping tablet replica
I20260709 12:14:27.131597 24074 raft_consensus.cc:515] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3f37c9cc9dda46b4be21dd675ba78fb7" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39545 } } peers { permanent_uuid: "96701a74fdee481fb5f54aac841e17dd" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36603 } } peers { permanent_uuid: "ca9fbbc2c0a94897897d502d42f3951f" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46341 } attrs { promote: false } }
I20260709 12:14:27.132367 12515 raft_consensus.cc:2243] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 25 LEADER]: Raft consensus shutting down.
I20260709 12:14:27.133765 12515 raft_consensus.cc:2272] T c89d2a3019c74941a4f8dffc9aa5cf40 P ca9fbbc2c0a94897897d502d42f3951f [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:27.138473 24074 leader_election.cc:290] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545), 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603)
W20260709 12:14:27.140290 14379 leader_election.cc:336] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 3f37c9cc9dda46b4be21dd675ba78fb7 (127.12.56.194:39545): Network error: Client connection negotiation failed: client connection to 127.12.56.194:39545: connect: Connection refused (error 111)
W20260709 12:14:27.143996 14380 consensus_peers.cc:597] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f -> Peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Couldn't send request to peer 96701a74fdee481fb5f54aac841e17dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.195:36603: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:27.145193 12515 tablet_replica.cc:333] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f: stopping tablet replica
W20260709 12:14:27.145169 14380 leader_election.cc:336] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Network error: Client connection negotiation failed: client connection to 127.12.56.195:36603: connect: Connection refused (error 111)
I20260709 12:14:27.145965 14380 leader_election.cc:304] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca9fbbc2c0a94897897d502d42f3951f; no voters: 3f37c9cc9dda46b4be21dd675ba78fb7, 96701a74fdee481fb5f54aac841e17dd
I20260709 12:14:27.146813 24030 raft_consensus.cc:2749] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 12:14:27.147673 12515 raft_consensus.cc:2243] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:27.148487 12515 raft_consensus.cc:2272] T a34b21ec197b4241a780a8ae562e4602 P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:27.152477 12515 tablet_replica.cc:333] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f: stopping tablet replica
W20260709 12:14:27.152814 14380 consensus_peers.cc:597] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f -> Peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Couldn't send request to peer 96701a74fdee481fb5f54aac841e17dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.195:36603: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:27.153674 12515 raft_consensus.cc:2243] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 36 LEADER]: Raft consensus shutting down.
I20260709 12:14:27.155014 12515 raft_consensus.cc:2272] T 1e31cd7111f2470d8d34b5898dce5765 P ca9fbbc2c0a94897897d502d42f3951f [term 36 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:27.158421 12515 tablet_replica.cc:333] T 0a8c7c772cf44d36bc44b25edc405d1d P ca9fbbc2c0a94897897d502d42f3951f: stopping tablet replica
I20260709 12:14:27.159435 12515 raft_consensus.cc:2243] T 0a8c7c772cf44d36bc44b25edc405d1d P ca9fbbc2c0a94897897d502d42f3951f [term 27 LEADER]: Raft consensus shutting down.
I20260709 12:14:27.160852 12515 raft_consensus.cc:2272] T 0a8c7c772cf44d36bc44b25edc405d1d P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:27.164340 12515 tablet_replica.cc:333] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f: stopping tablet replica
I20260709 12:14:27.165334 12515 raft_consensus.cc:2243] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 27 LEADER]: Raft consensus shutting down.
I20260709 12:14:27.166615 12515 raft_consensus.cc:2272] T 625e9b5c2aa14658af58496a21f9ee8b P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:27.169955 12515 tablet_replica.cc:333] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f: stopping tablet replica
I20260709 12:14:27.171134 12515 raft_consensus.cc:2243] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 26 LEADER]: Raft consensus shutting down.
I20260709 12:14:27.172431 12515 raft_consensus.cc:2272] T 566e3cc2115c4b6dbd3070c4f4f4f11b P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:27.175609 12515 tablet_replica.cc:333] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f: stopping tablet replica
I20260709 12:14:27.176529 12515 raft_consensus.cc:2243] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 29 LEADER]: Raft consensus shutting down.
I20260709 12:14:27.177987 12515 raft_consensus.cc:2272] T e39d323dce0c45249bf1cf9b6062ab9a P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:27.181280 12515 tablet_replica.cc:333] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f: stopping tablet replica
I20260709 12:14:27.182272 12515 raft_consensus.cc:2243] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 29 LEADER]: Raft consensus shutting down.
I20260709 12:14:27.183481 12515 raft_consensus.cc:2272] T d2f365337b324999a073edacbe6c6e09 P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:27.184883 14380 consensus_peers.cc:597] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f -> Peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Couldn't send request to peer 96701a74fdee481fb5f54aac841e17dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.195:36603: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:27.186988 12515 tablet_replica.cc:333] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f: stopping tablet replica
I20260709 12:14:27.187970 12515 raft_consensus.cc:2243] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:27.188691 12515 raft_consensus.cc:2272] T c3c06f5564ed4c259ca5c238c3faf2a3 P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:27.191802 12515 tablet_replica.cc:333] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f: stopping tablet replica
I20260709 12:14:27.192696 12515 raft_consensus.cc:2243] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:14:27.193802 12515 raft_consensus.cc:2272] T 658b56fb08f0467fa5a9d602dd275f81 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:27.197104 12515 tablet_replica.cc:333] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f: stopping tablet replica
I20260709 12:14:27.198109 12515 raft_consensus.cc:2243] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 26 LEADER]: Raft consensus shutting down.
I20260709 12:14:27.199523 12515 raft_consensus.cc:2272] T a3c0f10b06fa4aa48a99239da6d81a1f P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:27.202797 12515 tablet_replica.cc:333] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f: stopping tablet replica
I20260709 12:14:27.203779 12515 raft_consensus.cc:2243] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 29 LEADER]: Raft consensus shutting down.
I20260709 12:14:27.205161 12515 raft_consensus.cc:2272] T 277b655b7311432a95ed2ad291df0b8d P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:27.206877 14380 consensus_peers.cc:597] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f -> Peer 96701a74fdee481fb5f54aac841e17dd (127.12.56.195:36603): Couldn't send request to peer 96701a74fdee481fb5f54aac841e17dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.195:36603: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:27.208580 12515 tablet_replica.cc:333] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f: stopping tablet replica
I20260709 12:14:27.209573 12515 raft_consensus.cc:2243] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:14:27.210990 12515 raft_consensus.cc:2272] T e8e96840ffec4e38a0f975263031c226 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:27.214346 12515 tablet_replica.cc:333] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f: stopping tablet replica
I20260709 12:14:27.215250 12515 raft_consensus.cc:2243] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 30 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:27.216010 12515 raft_consensus.cc:2272] T f1bace76cb204a6d92c38685645dd9db P ca9fbbc2c0a94897897d502d42f3951f [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:27.219274 12515 tablet_replica.cc:333] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f: stopping tablet replica
I20260709 12:14:27.220268 12515 raft_consensus.cc:2243] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:27.220904 12515 raft_consensus.cc:2272] T c95811190f014949bb25448e8db1040e P ca9fbbc2c0a94897897d502d42f3951f [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:27.224455 12515 tablet_replica.cc:333] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f: stopping tablet replica
I20260709 12:14:27.225466 12515 raft_consensus.cc:2243] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:14:27.226769 12515 raft_consensus.cc:2272] T dca45e62639f49b4a8367d6868dabc07 P ca9fbbc2c0a94897897d502d42f3951f [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:27.230216 12515 tablet_replica.cc:333] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f: stopping tablet replica
I20260709 12:14:27.231209 12515 raft_consensus.cc:2243] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:27.231961 12515 raft_consensus.cc:2272] T 34a12e91341d4472be7460f1061495db P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:27.235113 12515 tablet_replica.cc:333] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f: stopping tablet replica
I20260709 12:14:27.236076 12515 raft_consensus.cc:2243] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:27.236740 12515 raft_consensus.cc:2272] T c8195765ed074b74be387475c214120b P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:27.240254 12515 tablet_replica.cc:333] T a2541d5a960c4a8ba1d642e9a29fd19c P ca9fbbc2c0a94897897d502d42f3951f: stopping tablet replica
I20260709 12:14:27.241313 12515 raft_consensus.cc:2243] T a2541d5a960c4a8ba1d642e9a29fd19c P ca9fbbc2c0a94897897d502d42f3951f [term 30 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:27.242268 12515 raft_consensus.cc:2272] T a2541d5a960c4a8ba1d642e9a29fd19c P ca9fbbc2c0a94897897d502d42f3951f [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:27.245980 12515 tablet_replica.cc:333] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f: stopping tablet replica
I20260709 12:14:27.246851 12515 raft_consensus.cc:2243] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:14:27.248194 12515 raft_consensus.cc:2272] T e229ea1f19c74be5884179acde106305 P ca9fbbc2c0a94897897d502d42f3951f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:27.251783 12515 tablet_replica.cc:333] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f: stopping tablet replica
I20260709 12:14:27.252665 12515 raft_consensus.cc:2243] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 36 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:27.253333 12515 raft_consensus.cc:2272] T 64b889ec5fe4445d81fe94e0ae9fb087 P ca9fbbc2c0a94897897d502d42f3951f [term 36 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:27.256368 12515 tablet_replica.cc:333] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f: stopping tablet replica
I20260709 12:14:27.257313 12515 raft_consensus.cc:2243] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:27.257999 12515 raft_consensus.cc:2272] T aa310cca462541d39d36ebe94a27446e P ca9fbbc2c0a94897897d502d42f3951f [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:27.261057 12515 tablet_replica.cc:333] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f: stopping tablet replica
I20260709 12:14:27.262454 12515 raft_consensus.cc:2243] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:14:27.264228 12515 raft_consensus.cc:2272] T 3f29dda715314a93a03981264972c4c3 P ca9fbbc2c0a94897897d502d42f3951f [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:27.267894 12515 tablet_replica.cc:333] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f: stopping tablet replica
I20260709 12:14:27.268826 12515 raft_consensus.cc:2243] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 26 LEADER]: Raft consensus shutting down.
I20260709 12:14:27.270202 12515 raft_consensus.cc:2272] T 51d10bdf51504a12a70a50e9a48f7ede P ca9fbbc2c0a94897897d502d42f3951f [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:27.273407 12515 tablet_replica.cc:333] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f: stopping tablet replica
I20260709 12:14:27.274369 12515 raft_consensus.cc:2243] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:27.275010 12515 raft_consensus.cc:2272] T 25896261d1204b3d858fb5b478a89034 P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:27.277927 12515 tablet_replica.cc:333] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f: stopping tablet replica
I20260709 12:14:27.278748 12515 raft_consensus.cc:2243] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:14:27.279946 12515 raft_consensus.cc:2272] T 7a7564a63b8041ff80f64a7f8d533acb P ca9fbbc2c0a94897897d502d42f3951f [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:27.283016 12515 tablet_replica.cc:333] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f: stopping tablet replica
I20260709 12:14:27.283862 12515 raft_consensus.cc:2243] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:27.284649 12515 raft_consensus.cc:2272] T c6d20ad9ea2849238148cd46eb3be62c P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:27.287750 12515 tablet_replica.cc:333] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f: stopping tablet replica
I20260709 12:14:27.288820 12515 raft_consensus.cc:2243] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 35 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:27.289893 12515 raft_consensus.cc:2272] T f9139e027a704f14bb60e60e22390d08 P ca9fbbc2c0a94897897d502d42f3951f [term 35 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:27.293114 12515 tablet_replica.cc:333] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f: stopping tablet replica
I20260709 12:14:27.294044 12515 raft_consensus.cc:2243] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:14:27.295334 12515 raft_consensus.cc:2272] T 2e7fcff4988b4d928d7bb79c969a2025 P ca9fbbc2c0a94897897d502d42f3951f [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:27.298664 12515 tablet_replica.cc:333] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f: stopping tablet replica
I20260709 12:14:27.299791 12515 raft_consensus.cc:2243] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 28 LEADER]: Raft consensus shutting down.
I20260709 12:14:27.301219 12515 raft_consensus.cc:2272] T cad007c01ddb46db81e7206ec8b58024 P ca9fbbc2c0a94897897d502d42f3951f [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:27.304901 12515 tablet_replica.cc:333] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f: stopping tablet replica
I20260709 12:14:27.305886 12515 raft_consensus.cc:2243] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:27.306777 12515 raft_consensus.cc:2272] T 15347ea1eb2348e7b262bd0d59ce6f3a P ca9fbbc2c0a94897897d502d42f3951f [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:28.167954 12515 tablet_server.cc:196] TabletServer@127.12.56.196:0 shutdown complete.
I20260709 12:14:28.244827 12515 master.cc:562] Master@127.12.56.254:40645 shutting down...
W20260709 12:14:28.294196 13634 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 12:14:28.294584 13634 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:14:28.294806 13634 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:14:29.433399 13570 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111) [suppressed 299 similar messages]
W20260709 12:14:29.438169 13570 catalog_manager.cc:4755] TS b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 0a8c7c772cf44d36bc44b25edc405d1d: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
W20260709 12:14:32.662429 13570 catalog_manager.cc:4755] TS b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet d2f365337b324999a073edacbe6c6e09: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
W20260709 12:14:39.965227 13570 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260709 12:14:39.969606 13570 catalog_manager.cc:4755] TS b98d2519bb504dc6905ed2ede4571835 (127.12.56.193:33199): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet d8f8986661dd4d049ab4a79338d33a1a: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33199: connect: Connection refused (error 111)
I20260709 12:14:41.913486 12515 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 17d79eae88f84be7a847d0cf544674cd [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:41.914799 12515 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 17d79eae88f84be7a847d0cf544674cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:41.915233 12515 tablet_replica.cc:333] T 00000000000000000000000000000000 P 17d79eae88f84be7a847d0cf544674cd: stopping tablet replica
I20260709 12:14:42.079010 12515 master.cc:584] Master@127.12.56.254:40645 shutdown complete.
I20260709 12:14:42.138080 12515 test_util.cc:182] -----------------------------------------------
I20260709 12:14:42.138314 12515 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894707649-12515-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (326614 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 12:14:42.142096 12515 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.12.56.254:39861
I20260709 12:14:42.143311 12515 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:42.150242 24083 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:42.150257 24084 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:42.151041 24086 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:42.153066 12515 server_base.cc:1061] running on GCE node
I20260709 12:14:42.157343 12515 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:42.157588 12515 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:42.157759 12515 hybrid_clock.cc:648] HybridClock initialized: now 1783599282157699 us; error 0 us; skew 500 ppm
I20260709 12:14:42.158598 12515 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:42.161358 12515 webserver.cc:533] Webserver started at http://127.12.56.254:33705/ using document root <none> and password file <none>
I20260709 12:14:42.161929 12515 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:42.162104 12515 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:42.162336 12515 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:42.163643 12515 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894707649-12515-0/minicluster-data/master-0-root/instance:
uuid: "0a5582756e6b400ba8fd562c370ea634"
format_stamp: "Formatted at 2026-07-09 12:14:42 on dist-test-slave-705g"
I20260709 12:14:42.168668 12515 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:14:42.172752 24091 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:42.173547 12515 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:14:42.174082 12515 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894707649-12515-0/minicluster-data/master-0-root
uuid: "0a5582756e6b400ba8fd562c370ea634"
format_stamp: "Formatted at 2026-07-09 12:14:42 on dist-test-slave-705g"
I20260709 12:14:42.174417 12515 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894707649-12515-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894707649-12515-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894707649-12515-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:42.193207 12515 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:42.194635 12515 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:42.238843 12515 rpc_server.cc:307] RPC server started. Bound to: 127.12.56.254:39861
I20260709 12:14:42.238986 24142 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.56.254:39861 every 8 connection(s)
I20260709 12:14:42.243269 24143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:42.256175 24143 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0a5582756e6b400ba8fd562c370ea634: Bootstrap starting.
I20260709 12:14:42.261330 24143 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0a5582756e6b400ba8fd562c370ea634: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:42.266150 24143 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0a5582756e6b400ba8fd562c370ea634: No bootstrap required, opened a new log
I20260709 12:14:42.268711 24143 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0a5582756e6b400ba8fd562c370ea634 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a5582756e6b400ba8fd562c370ea634" member_type: VOTER }
I20260709 12:14:42.269351 24143 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0a5582756e6b400ba8fd562c370ea634 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:42.269541 24143 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0a5582756e6b400ba8fd562c370ea634 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a5582756e6b400ba8fd562c370ea634, State: Initialized, Role: FOLLOWER
I20260709 12:14:42.270139 24143 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0a5582756e6b400ba8fd562c370ea634 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a5582756e6b400ba8fd562c370ea634" member_type: VOTER }
I20260709 12:14:42.270601 24143 raft_consensus.cc:399] T 00000000000000000000000000000000 P 0a5582756e6b400ba8fd562c370ea634 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:14:42.270818 24143 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0a5582756e6b400ba8fd562c370ea634 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:14:42.271049 24143 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0a5582756e6b400ba8fd562c370ea634 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:42.276062 24143 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0a5582756e6b400ba8fd562c370ea634 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a5582756e6b400ba8fd562c370ea634" member_type: VOTER }
I20260709 12:14:42.276659 24143 leader_election.cc:304] T 00000000000000000000000000000000 P 0a5582756e6b400ba8fd562c370ea634 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0a5582756e6b400ba8fd562c370ea634; no voters: 
I20260709 12:14:42.278018 24143 leader_election.cc:290] T 00000000000000000000000000000000 P 0a5582756e6b400ba8fd562c370ea634 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:14:42.278563 24146 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0a5582756e6b400ba8fd562c370ea634 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:42.280208 24146 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0a5582756e6b400ba8fd562c370ea634 [term 1 LEADER]: Becoming Leader. State: Replica: 0a5582756e6b400ba8fd562c370ea634, State: Running, Role: LEADER
I20260709 12:14:42.281185 24143 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0a5582756e6b400ba8fd562c370ea634 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:14:42.281203 24146 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0a5582756e6b400ba8fd562c370ea634 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a5582756e6b400ba8fd562c370ea634" member_type: VOTER }
I20260709 12:14:42.290086 24148 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0a5582756e6b400ba8fd562c370ea634 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0a5582756e6b400ba8fd562c370ea634. Latest consensus state: current_term: 1 leader_uuid: "0a5582756e6b400ba8fd562c370ea634" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a5582756e6b400ba8fd562c370ea634" member_type: VOTER } }
I20260709 12:14:42.290755 24148 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0a5582756e6b400ba8fd562c370ea634 [sys.catalog]: This master's current role is: LEADER
I20260709 12:14:42.290459 24147 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0a5582756e6b400ba8fd562c370ea634 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0a5582756e6b400ba8fd562c370ea634" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a5582756e6b400ba8fd562c370ea634" member_type: VOTER } }
I20260709 12:14:42.291332 24147 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0a5582756e6b400ba8fd562c370ea634 [sys.catalog]: This master's current role is: LEADER
I20260709 12:14:42.298497 24156 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:14:42.299922 12515 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:14:42.304026 24156 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:14:42.314390 24156 catalog_manager.cc:1383] Generated new cluster ID: edca6b7bc4554df893f4b4d59a69f72d
I20260709 12:14:42.314747 24156 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:14:42.330713 24156 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:14:42.332132 24156 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:14:42.345528 24156 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 0a5582756e6b400ba8fd562c370ea634: Generated new TSK 0
I20260709 12:14:42.346227 24156 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:14:42.367107 12515 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:42.374562 24164 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:42.375628 24165 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:42.379534 12515 server_base.cc:1061] running on GCE node
W20260709 12:14:42.379940 24167 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:42.382544 12515 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:42.382876 12515 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:42.383071 12515 hybrid_clock.cc:648] HybridClock initialized: now 1783599282383045 us; error 0 us; skew 500 ppm
I20260709 12:14:42.383721 12515 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:42.386734 12515 webserver.cc:533] Webserver started at http://127.12.56.193:43503/ using document root <none> and password file <none>
I20260709 12:14:42.387181 12515 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:42.387346 12515 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:42.387564 12515 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:42.388836 12515 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894707649-12515-0/minicluster-data/ts-0-root/instance:
uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
format_stamp: "Formatted at 2026-07-09 12:14:42 on dist-test-slave-705g"
I20260709 12:14:42.394060 12515 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:14:42.397758 24172 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:42.398828 12515 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:14:42.399196 12515 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894707649-12515-0/minicluster-data/ts-0-root
uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
format_stamp: "Formatted at 2026-07-09 12:14:42 on dist-test-slave-705g"
I20260709 12:14:42.399567 12515 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894707649-12515-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894707649-12515-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894707649-12515-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:42.424371 12515 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:42.425683 12515 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:42.427269 12515 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:42.429858 12515 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:42.430086 12515 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:42.430357 12515 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:42.430553 12515 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:42.476321 12515 rpc_server.cc:307] RPC server started. Bound to: 127.12.56.193:38787
I20260709 12:14:42.476488 24234 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.56.193:38787 every 8 connection(s)
I20260709 12:14:42.482239 12515 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:42.490520 24239 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:42.492676 24240 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:42.494343 24242 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:42.495954 12515 server_base.cc:1061] running on GCE node
I20260709 12:14:42.499336 12515 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:14:42.499508 24235 heartbeater.cc:344] Connected to a master server at 127.12.56.254:39861
W20260709 12:14:42.499708 12515 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:42.499935 12515 hybrid_clock.cc:648] HybridClock initialized: now 1783599282499916 us; error 0 us; skew 500 ppm
I20260709 12:14:42.499977 24235 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:42.500878 12515 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:42.501103 24235 heartbeater.cc:507] Master 127.12.56.254:39861 requested a full tablet report, sending...
I20260709 12:14:42.503840 24108 ts_manager.cc:194] Registered new tserver with Master: 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:42.504086 12515 webserver.cc:533] Webserver started at http://127.12.56.194:38393/ using document root <none> and password file <none>
I20260709 12:14:42.504704 12515 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:42.504908 12515 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:42.505196 12515 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:42.505978 24108 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41470
I20260709 12:14:42.506613 12515 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894707649-12515-0/minicluster-data/ts-1-root/instance:
uuid: "cf2d8294ae68482ca4ffa8be051ad054"
format_stamp: "Formatted at 2026-07-09 12:14:42 on dist-test-slave-705g"
I20260709 12:14:42.512243 12515 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:14:42.516211 24247 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:42.517022 12515 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:14:42.517350 12515 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894707649-12515-0/minicluster-data/ts-1-root
uuid: "cf2d8294ae68482ca4ffa8be051ad054"
format_stamp: "Formatted at 2026-07-09 12:14:42 on dist-test-slave-705g"
I20260709 12:14:42.517619 12515 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894707649-12515-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894707649-12515-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894707649-12515-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:42.527868 12515 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:42.529320 12515 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:42.531016 12515 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:42.533641 12515 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:42.533999 12515 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:14:42.534265 12515 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:42.534462 12515 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:42.584956 12515 rpc_server.cc:307] RPC server started. Bound to: 127.12.56.194:34565
I20260709 12:14:42.585068 24309 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.56.194:34565 every 8 connection(s)
I20260709 12:14:42.590682 12515 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:42.599619 24313 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:42.599996 24314 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:42.604823 24316 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:42.605515 24310 heartbeater.cc:344] Connected to a master server at 127.12.56.254:39861
I20260709 12:14:42.605571 12515 server_base.cc:1061] running on GCE node
I20260709 12:14:42.606204 24310 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:42.606989 12515 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:42.607354 12515 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:42.607245 24310 heartbeater.cc:507] Master 127.12.56.254:39861 requested a full tablet report, sending...
I20260709 12:14:42.607659 12515 hybrid_clock.cc:648] HybridClock initialized: now 1783599282607638 us; error 0 us; skew 500 ppm
I20260709 12:14:42.608485 12515 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:42.609685 24108 ts_manager.cc:194] Registered new tserver with Master: cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:14:42.611822 24108 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41474
I20260709 12:14:42.612085 12515 webserver.cc:533] Webserver started at http://127.12.56.195:42819/ using document root <none> and password file <none>
I20260709 12:14:42.612787 12515 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:42.612979 12515 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:42.613184 12515 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:42.614648 12515 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894707649-12515-0/minicluster-data/ts-2-root/instance:
uuid: "aa14caefbdaa47b09abf91881635ba96"
format_stamp: "Formatted at 2026-07-09 12:14:42 on dist-test-slave-705g"
I20260709 12:14:42.619643 12515 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:14:42.623642 24321 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:42.624513 12515 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 12:14:42.624845 12515 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894707649-12515-0/minicluster-data/ts-2-root
uuid: "aa14caefbdaa47b09abf91881635ba96"
format_stamp: "Formatted at 2026-07-09 12:14:42 on dist-test-slave-705g"
I20260709 12:14:42.625160 12515 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894707649-12515-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894707649-12515-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894707649-12515-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:42.644701 12515 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:42.646088 12515 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:42.647673 12515 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:42.650082 12515 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:42.650342 12515 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:42.650591 12515 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:42.650774 12515 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:42.698912 12515 rpc_server.cc:307] RPC server started. Bound to: 127.12.56.195:46845
I20260709 12:14:42.698969 24383 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.56.195:46845 every 8 connection(s)
I20260709 12:14:42.704623 12515 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:42.713055 24387 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:42.715219 24388 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:42.717428 24390 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:42.718375 12515 server_base.cc:1061] running on GCE node
I20260709 12:14:42.719517 12515 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:42.719805 12515 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:42.719900 24384 heartbeater.cc:344] Connected to a master server at 127.12.56.254:39861
I20260709 12:14:42.720065 12515 hybrid_clock.cc:648] HybridClock initialized: now 1783599282720047 us; error 0 us; skew 500 ppm
I20260709 12:14:42.720476 24384 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:42.720872 12515 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:42.721381 24384 heartbeater.cc:507] Master 127.12.56.254:39861 requested a full tablet report, sending...
I20260709 12:14:42.723788 24108 ts_manager.cc:194] Registered new tserver with Master: aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:14:42.724035 12515 webserver.cc:533] Webserver started at http://127.12.56.196:35239/ using document root <none> and password file <none>
I20260709 12:14:42.724778 12515 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:42.725036 12515 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:42.725368 12515 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:42.725764 24108 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41476
I20260709 12:14:42.726985 12515 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894707649-12515-0/minicluster-data/ts-3-root/instance:
uuid: "ad362df39b114ec3a3a419128097b362"
format_stamp: "Formatted at 2026-07-09 12:14:42 on dist-test-slave-705g"
I20260709 12:14:42.732256 12515 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:14:42.736212 24395 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:42.737238 12515 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:14:42.737592 12515 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894707649-12515-0/minicluster-data/ts-3-root
uuid: "ad362df39b114ec3a3a419128097b362"
format_stamp: "Formatted at 2026-07-09 12:14:42 on dist-test-slave-705g"
I20260709 12:14:42.738004 12515 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894707649-12515-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894707649-12515-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894707649-12515-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:42.754542 12515 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:42.755898 12515 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:42.757506 12515 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:42.760015 12515 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:42.760275 12515 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:42.760529 12515 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:42.760715 12515 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:42.807024 12515 rpc_server.cc:307] RPC server started. Bound to: 127.12.56.196:46467
I20260709 12:14:42.807123 24457 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.56.196:46467 every 8 connection(s)
I20260709 12:14:42.822232 24458 heartbeater.cc:344] Connected to a master server at 127.12.56.254:39861
I20260709 12:14:42.822616 24458 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:42.823387 24458 heartbeater.cc:507] Master 127.12.56.254:39861 requested a full tablet report, sending...
I20260709 12:14:42.825349 24108 ts_manager.cc:194] Registered new tserver with Master: ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:14:42.825855 12515 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.015501368s
I20260709 12:14:42.826889 24108 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41482
I20260709 12:14:42.856961 24108 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41496:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 12:14:43.139067 24275 tablet_service.cc:1511] Processing CreateTablet for tablet e24b175869274d33ade73761b6f23ca4 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:14:43.140745 24275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e24b175869274d33ade73761b6f23ca4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.142620 24271 tablet_service.cc:1511] Processing CreateTablet for tablet 95d3180f4ab5472d9de6e220219e7898 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:14:43.143034 24274 tablet_service.cc:1511] Processing CreateTablet for tablet 133e492e820f4152ad30562c343b617d (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:14:43.144295 24271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95d3180f4ab5472d9de6e220219e7898. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.145592 24272 tablet_service.cc:1511] Processing CreateTablet for tablet 7943c68d21d449dba2d1dca6ddde5820 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:14:43.147114 24272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7943c68d21d449dba2d1dca6ddde5820. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.148779 24270 tablet_service.cc:1511] Processing CreateTablet for tablet 1b9a17cccc4f4ca79468bb6b4e904ec8 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:14:43.150403 24270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b9a17cccc4f4ca79468bb6b4e904ec8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.151113 24273 tablet_service.cc:1511] Processing CreateTablet for tablet 0d31cf2c4a7849d9a798bf886e7fc997 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:14:43.152849 24273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d31cf2c4a7849d9a798bf886e7fc997. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.155478 24269 tablet_service.cc:1511] Processing CreateTablet for tablet 99329004ca1c4c76a3a2dd4567ef15dd (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:14:43.157194 24269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99329004ca1c4c76a3a2dd4567ef15dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.158000 24274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 133e492e820f4152ad30562c343b617d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.158809 24200 tablet_service.cc:1511] Processing CreateTablet for tablet 133e492e820f4152ad30562c343b617d (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:14:43.160595 24200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 133e492e820f4152ad30562c343b617d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.163378 24199 tablet_service.cc:1511] Processing CreateTablet for tablet 0d31cf2c4a7849d9a798bf886e7fc997 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:14:43.166472 24198 tablet_service.cc:1511] Processing CreateTablet for tablet ba38e800dd034ff8b7fda6701973510b (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:14:43.169623 24197 tablet_service.cc:1511] Processing CreateTablet for tablet 7943c68d21d449dba2d1dca6ddde5820 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:14:43.172855 24196 tablet_service.cc:1511] Processing CreateTablet for tablet 95d3180f4ab5472d9de6e220219e7898 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:14:43.175482 24195 tablet_service.cc:1511] Processing CreateTablet for tablet 477aafe049fa4b1182fb0afe55fe5e55 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:14:43.178957 24194 tablet_service.cc:1511] Processing CreateTablet for tablet 99329004ca1c4c76a3a2dd4567ef15dd (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:14:43.183319 24349 tablet_service.cc:1511] Processing CreateTablet for tablet e24b175869274d33ade73761b6f23ca4 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:14:43.185341 24349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e24b175869274d33ade73761b6f23ca4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.187337 24348 tablet_service.cc:1511] Processing CreateTablet for tablet 133e492e820f4152ad30562c343b617d (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:14:43.189145 24348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 133e492e820f4152ad30562c343b617d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.191341 24347 tablet_service.cc:1511] Processing CreateTablet for tablet ba38e800dd034ff8b7fda6701973510b (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:14:43.192052 24197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7943c68d21d449dba2d1dca6ddde5820. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.193053 24347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba38e800dd034ff8b7fda6701973510b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.195050 24346 tablet_service.cc:1511] Processing CreateTablet for tablet 7943c68d21d449dba2d1dca6ddde5820 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:14:43.195670 24198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba38e800dd034ff8b7fda6701973510b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.198115 24345 tablet_service.cc:1511] Processing CreateTablet for tablet 477aafe049fa4b1182fb0afe55fe5e55 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:14:43.202267 24196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95d3180f4ab5472d9de6e220219e7898. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.207756 24344 tablet_service.cc:1511] Processing CreateTablet for tablet 1b9a17cccc4f4ca79468bb6b4e904ec8 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:14:43.210218 24195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 477aafe049fa4b1182fb0afe55fe5e55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.209574 24344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b9a17cccc4f4ca79468bb6b4e904ec8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.215301 24346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7943c68d21d449dba2d1dca6ddde5820. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.219802 24199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d31cf2c4a7849d9a798bf886e7fc997. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.222268 24194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99329004ca1c4c76a3a2dd4567ef15dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.219888 24345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 477aafe049fa4b1182fb0afe55fe5e55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.237795 24422 tablet_service.cc:1511] Processing CreateTablet for tablet 0d31cf2c4a7849d9a798bf886e7fc997 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:14:43.238801 24423 tablet_service.cc:1511] Processing CreateTablet for tablet e24b175869274d33ade73761b6f23ca4 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:14:43.241750 24421 tablet_service.cc:1511] Processing CreateTablet for tablet ba38e800dd034ff8b7fda6701973510b (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:14:43.246902 24422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d31cf2c4a7849d9a798bf886e7fc997. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.248159 24423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e24b175869274d33ade73761b6f23ca4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.277197 24421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba38e800dd034ff8b7fda6701973510b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.359539 24420 tablet_service.cc:1511] Processing CreateTablet for tablet 95d3180f4ab5472d9de6e220219e7898 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:14:43.363396 24420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95d3180f4ab5472d9de6e220219e7898. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:14:43.371935 24155 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:43.377907 24478 tablet_bootstrap.cc:492] T 95d3180f4ab5472d9de6e220219e7898 P cf2d8294ae68482ca4ffa8be051ad054: Bootstrap starting.
I20260709 12:14:43.378995 24343 tablet_service.cc:1511] Processing CreateTablet for tablet 99329004ca1c4c76a3a2dd4567ef15dd (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:14:43.380519 24343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99329004ca1c4c76a3a2dd4567ef15dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.385138 24193 tablet_service.cc:1511] Processing CreateTablet for tablet c75afe0e0e00446aa6d220941d288eab (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:14:43.386688 24193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c75afe0e0e00446aa6d220941d288eab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.389830 24342 tablet_service.cc:1511] Processing CreateTablet for tablet 4b1c850a65b748c093c5c88aa94fed71 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:14:43.391353 24342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b1c850a65b748c093c5c88aa94fed71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.397317 24192 tablet_service.cc:1511] Processing CreateTablet for tablet 4b1c850a65b748c093c5c88aa94fed71 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
W20260709 12:14:43.397922 24095 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.12.56.194:34565, user_credentials={real_user=slave}} blocked reactor thread for 73761.6us
I20260709 12:14:43.399127 24192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b1c850a65b748c093c5c88aa94fed71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.401747 24419 tablet_service.cc:1511] Processing CreateTablet for tablet 477aafe049fa4b1182fb0afe55fe5e55 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:14:43.402679 24269 tablet_service.cc:1511] Processing CreateTablet for tablet c75afe0e0e00446aa6d220941d288eab (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:14:43.403564 24419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 477aafe049fa4b1182fb0afe55fe5e55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.404150 24269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c75afe0e0e00446aa6d220941d288eab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.406991 24270 tablet_service.cc:1511] Processing CreateTablet for tablet e15e9b81515343958a00ba6f2f291860 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:14:43.408846 24270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e15e9b81515343958a00ba6f2f291860. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.410274 24418 tablet_service.cc:1511] Processing CreateTablet for tablet 1b9a17cccc4f4ca79468bb6b4e904ec8 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:14:43.412197 24341 tablet_service.cc:1511] Processing CreateTablet for tablet e15e9b81515343958a00ba6f2f291860 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:14:43.414119 24341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e15e9b81515343958a00ba6f2f291860. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.412263 24418 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b9a17cccc4f4ca79468bb6b4e904ec8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.415781 24417 tablet_service.cc:1511] Processing CreateTablet for tablet c75afe0e0e00446aa6d220941d288eab (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:14:43.417662 24417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c75afe0e0e00446aa6d220941d288eab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.427776 24416 tablet_service.cc:1511] Processing CreateTablet for tablet 4b1c850a65b748c093c5c88aa94fed71 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:14:43.428855 24478 tablet_bootstrap.cc:654] T 95d3180f4ab5472d9de6e220219e7898 P cf2d8294ae68482ca4ffa8be051ad054: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:43.429322 24416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b1c850a65b748c093c5c88aa94fed71. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:14:43.457971 24095 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.12.56.194:34565, user_credentials={real_user=slave}} blocked reactor thread for 58480.7us
I20260709 12:14:43.463441 24191 tablet_service.cc:1511] Processing CreateTablet for tablet ab8dff607862460ea0fcd88422c31ac2 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:14:43.465009 24191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab8dff607862460ea0fcd88422c31ac2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.485623 24415 tablet_service.cc:1511] Processing CreateTablet for tablet e15e9b81515343958a00ba6f2f291860 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:14:43.487241 24415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e15e9b81515343958a00ba6f2f291860. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.487285 24271 tablet_service.cc:1511] Processing CreateTablet for tablet b727e95d8f5843a3bb0d7cbddce61bdb (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:14:43.488845 24271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b727e95d8f5843a3bb0d7cbddce61bdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.499022 24199 tablet_service.cc:1511] Processing CreateTablet for tablet b727e95d8f5843a3bb0d7cbddce61bdb (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:14:43.500499 24199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b727e95d8f5843a3bb0d7cbddce61bdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.513048 24479 tablet_bootstrap.cc:492] T e24b175869274d33ade73761b6f23ca4 P ad362df39b114ec3a3a419128097b362: Bootstrap starting.
I20260709 12:14:43.517756 24235 heartbeater.cc:499] Master 127.12.56.254:39861 was elected leader, sending a full tablet report...
I20260709 12:14:43.527359 24482 tablet_bootstrap.cc:492] T 99329004ca1c4c76a3a2dd4567ef15dd P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:14:43.534649 24346 tablet_service.cc:1511] Processing CreateTablet for tablet e05eec364f764114bdb814096b9bf0ce (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:14:43.536171 24346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e05eec364f764114bdb814096b9bf0ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.546684 24348 tablet_service.cc:1511] Processing CreateTablet for tablet ab8dff607862460ea0fcd88422c31ac2 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:14:43.548525 24348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab8dff607862460ea0fcd88422c31ac2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.557312 24481 tablet_bootstrap.cc:492] T ba38e800dd034ff8b7fda6701973510b P aa14caefbdaa47b09abf91881635ba96: Bootstrap starting.
I20260709 12:14:43.562300 24274 tablet_service.cc:1511] Processing CreateTablet for tablet ab8dff607862460ea0fcd88422c31ac2 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:14:43.564014 24274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab8dff607862460ea0fcd88422c31ac2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.564622 24478 tablet_bootstrap.cc:492] T 95d3180f4ab5472d9de6e220219e7898 P cf2d8294ae68482ca4ffa8be051ad054: No bootstrap required, opened a new log
I20260709 12:14:43.565277 24478 ts_tablet_manager.cc:1403] T 95d3180f4ab5472d9de6e220219e7898 P cf2d8294ae68482ca4ffa8be051ad054: Time spent bootstrapping tablet: real 0.188s	user 0.019s	sys 0.008s
I20260709 12:14:43.566092 24479 tablet_bootstrap.cc:654] T e24b175869274d33ade73761b6f23ca4 P ad362df39b114ec3a3a419128097b362: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:43.516749 24420 tablet_service.cc:1511] Processing CreateTablet for tablet b727e95d8f5843a3bb0d7cbddce61bdb (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:14:43.572088 24420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b727e95d8f5843a3bb0d7cbddce61bdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.577899 24482 tablet_bootstrap.cc:654] T 99329004ca1c4c76a3a2dd4567ef15dd P 9bf3da5b54ef4a1ea1cee60f02ea2883: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:43.589116 24423 tablet_service.cc:1511] Processing CreateTablet for tablet e05eec364f764114bdb814096b9bf0ce (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:14:43.591974 24423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e05eec364f764114bdb814096b9bf0ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.592917 24269 tablet_service.cc:1511] Processing CreateTablet for tablet 9c40e590be9d4c3eac0ddd7f96278894 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:14:43.597895 24269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c40e590be9d4c3eac0ddd7f96278894. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.612493 24345 tablet_service.cc:1511] Processing CreateTablet for tablet 9c40e590be9d4c3eac0ddd7f96278894 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:14:43.614154 24345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c40e590be9d4c3eac0ddd7f96278894. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.614579 24481 tablet_bootstrap.cc:654] T ba38e800dd034ff8b7fda6701973510b P aa14caefbdaa47b09abf91881635ba96: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:43.614873 24310 heartbeater.cc:499] Master 127.12.56.254:39861 was elected leader, sending a full tablet report...
I20260709 12:14:43.619117 24273 tablet_service.cc:1511] Processing CreateTablet for tablet a18e73ef976b49f0878423c0b3e6e6f2 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:14:43.620791 24273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a18e73ef976b49f0878423c0b3e6e6f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.621325 24478 raft_consensus.cc:359] T 95d3180f4ab5472d9de6e220219e7898 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:43.622282 24478 raft_consensus.cc:385] T 95d3180f4ab5472d9de6e220219e7898 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:43.622709 24478 raft_consensus.cc:740] T 95d3180f4ab5472d9de6e220219e7898 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Initialized, Role: FOLLOWER
I20260709 12:14:43.623728 24478 consensus_queue.cc:260] T 95d3180f4ab5472d9de6e220219e7898 P cf2d8294ae68482ca4ffa8be051ad054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:43.634104 24416 tablet_service.cc:1511] Processing CreateTablet for tablet 9c40e590be9d4c3eac0ddd7f96278894 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:14:43.657974 24416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c40e590be9d4c3eac0ddd7f96278894. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.667837 24195 tablet_service.cc:1511] Processing CreateTablet for tablet e05eec364f764114bdb814096b9bf0ce (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:14:43.669366 24195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e05eec364f764114bdb814096b9bf0ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.670866 24192 tablet_service.cc:1511] Processing CreateTablet for tablet a18e73ef976b49f0878423c0b3e6e6f2 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:14:43.674252 24341 tablet_service.cc:1511] Processing CreateTablet for tablet a18e73ef976b49f0878423c0b3e6e6f2 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:14:43.675834 24341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a18e73ef976b49f0878423c0b3e6e6f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.707677 24422 tablet_service.cc:1511] Processing CreateTablet for tablet 6af96d3f7393445f8b7edb30a26a6f65 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:14:43.709338 24422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6af96d3f7393445f8b7edb30a26a6f65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.718561 24192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a18e73ef976b49f0878423c0b3e6e6f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.728838 24384 heartbeater.cc:499] Master 127.12.56.254:39861 was elected leader, sending a full tablet report...
I20260709 12:14:43.736166 24479 tablet_bootstrap.cc:492] T e24b175869274d33ade73761b6f23ca4 P ad362df39b114ec3a3a419128097b362: No bootstrap required, opened a new log
I20260709 12:14:43.736250 24482 tablet_bootstrap.cc:492] T 99329004ca1c4c76a3a2dd4567ef15dd P 9bf3da5b54ef4a1ea1cee60f02ea2883: No bootstrap required, opened a new log
I20260709 12:14:43.737478 24482 ts_tablet_manager.cc:1403] T 99329004ca1c4c76a3a2dd4567ef15dd P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.211s	user 0.048s	sys 0.031s
I20260709 12:14:43.741125 24482 raft_consensus.cc:359] T 99329004ca1c4c76a3a2dd4567ef15dd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:43.742064 24482 raft_consensus.cc:385] T 99329004ca1c4c76a3a2dd4567ef15dd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:43.742450 24482 raft_consensus.cc:740] T 99329004ca1c4c76a3a2dd4567ef15dd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:14:43.742947 24348 tablet_service.cc:1511] Processing CreateTablet for tablet 7cbef09353144c0b9a9ebf7731fd019f (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:14:43.743402 24482 consensus_queue.cc:260] T 99329004ca1c4c76a3a2dd4567ef15dd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:43.744501 24348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cbef09353144c0b9a9ebf7731fd019f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.736961 24479 ts_tablet_manager.cc:1403] T e24b175869274d33ade73761b6f23ca4 P ad362df39b114ec3a3a419128097b362: Time spent bootstrapping tablet: real 0.224s	user 0.012s	sys 0.024s
I20260709 12:14:43.747596 24479 raft_consensus.cc:359] T e24b175869274d33ade73761b6f23ca4 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:43.748325 24479 raft_consensus.cc:385] T e24b175869274d33ade73761b6f23ca4 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:43.748731 24479 raft_consensus.cc:740] T e24b175869274d33ade73761b6f23ca4 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad362df39b114ec3a3a419128097b362, State: Initialized, Role: FOLLOWER
I20260709 12:14:43.751579 24478 ts_tablet_manager.cc:1434] T 95d3180f4ab5472d9de6e220219e7898 P cf2d8294ae68482ca4ffa8be051ad054: Time spent starting tablet: real 0.186s	user 0.018s	sys 0.000s
I20260709 12:14:43.753295 24478 tablet_bootstrap.cc:492] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P cf2d8294ae68482ca4ffa8be051ad054: Bootstrap starting.
I20260709 12:14:43.756225 24481 tablet_bootstrap.cc:492] T ba38e800dd034ff8b7fda6701973510b P aa14caefbdaa47b09abf91881635ba96: No bootstrap required, opened a new log
I20260709 12:14:43.757166 24481 ts_tablet_manager.cc:1403] T ba38e800dd034ff8b7fda6701973510b P aa14caefbdaa47b09abf91881635ba96: Time spent bootstrapping tablet: real 0.200s	user 0.017s	sys 0.011s
I20260709 12:14:43.758278 24479 consensus_queue.cc:260] T e24b175869274d33ade73761b6f23ca4 P ad362df39b114ec3a3a419128097b362 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:43.761950 24197 tablet_service.cc:1511] Processing CreateTablet for tablet 6af96d3f7393445f8b7edb30a26a6f65 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:14:43.764125 24197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6af96d3f7393445f8b7edb30a26a6f65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.768206 24273 tablet_service.cc:1511] Processing CreateTablet for tablet 6af96d3f7393445f8b7edb30a26a6f65 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:14:43.787757 24273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6af96d3f7393445f8b7edb30a26a6f65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.788347 24415 tablet_service.cc:1511] Processing CreateTablet for tablet 7cbef09353144c0b9a9ebf7731fd019f (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:14:43.789812 24415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cbef09353144c0b9a9ebf7731fd019f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.790678 24458 heartbeater.cc:499] Master 127.12.56.254:39861 was elected leader, sending a full tablet report...
I20260709 12:14:43.792022 24479 ts_tablet_manager.cc:1434] T e24b175869274d33ade73761b6f23ca4 P ad362df39b114ec3a3a419128097b362: Time spent starting tablet: real 0.047s	user 0.008s	sys 0.000s
I20260709 12:14:43.793463 24479 tablet_bootstrap.cc:492] T ba38e800dd034ff8b7fda6701973510b P ad362df39b114ec3a3a419128097b362: Bootstrap starting.
I20260709 12:14:43.798270 24482 ts_tablet_manager.cc:1434] T 99329004ca1c4c76a3a2dd4567ef15dd P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.060s	user 0.021s	sys 0.024s
I20260709 12:14:43.799682 24482 tablet_bootstrap.cc:492] T 0d31cf2c4a7849d9a798bf886e7fc997 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:14:43.801285 24481 raft_consensus.cc:359] T ba38e800dd034ff8b7fda6701973510b P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:43.802234 24481 raft_consensus.cc:385] T ba38e800dd034ff8b7fda6701973510b P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:43.802606 24481 raft_consensus.cc:740] T ba38e800dd034ff8b7fda6701973510b P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Initialized, Role: FOLLOWER
I20260709 12:14:43.806234 24478 tablet_bootstrap.cc:654] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P cf2d8294ae68482ca4ffa8be051ad054: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:43.809458 24482 tablet_bootstrap.cc:654] T 0d31cf2c4a7849d9a798bf886e7fc997 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Neither blocks nor log segments found. Creating new log.
W20260709 12:14:43.811883 24459 tablet.cc:2406] T e24b175869274d33ade73761b6f23ca4 P ad362df39b114ec3a3a419128097b362: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:14:43.814177 24481 consensus_queue.cc:260] T ba38e800dd034ff8b7fda6701973510b P aa14caefbdaa47b09abf91881635ba96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:43.819387 24479 tablet_bootstrap.cc:654] T ba38e800dd034ff8b7fda6701973510b P ad362df39b114ec3a3a419128097b362: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:43.822233 24269 tablet_service.cc:1511] Processing CreateTablet for tablet 20629783689c4296afb55366d9ad5f6c (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:14:43.823678 24269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20629783689c4296afb55366d9ad5f6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.829404 24348 tablet_service.cc:1511] Processing CreateTablet for tablet 20629783689c4296afb55366d9ad5f6c (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:14:43.830823 24192 tablet_service.cc:1511] Processing CreateTablet for tablet 7cbef09353144c0b9a9ebf7731fd019f (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:14:43.835704 24481 ts_tablet_manager.cc:1434] T ba38e800dd034ff8b7fda6701973510b P aa14caefbdaa47b09abf91881635ba96: Time spent starting tablet: real 0.078s	user 0.004s	sys 0.008s
I20260709 12:14:43.835791 24199 tablet_service.cc:1511] Processing CreateTablet for tablet 27de4156b2e24143a2f301fbefc7cb23 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:14:43.837157 24481 tablet_bootstrap.cc:492] T 133e492e820f4152ad30562c343b617d P aa14caefbdaa47b09abf91881635ba96: Bootstrap starting.
I20260709 12:14:43.837312 24199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27de4156b2e24143a2f301fbefc7cb23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.830861 24348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20629783689c4296afb55366d9ad5f6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.834249 24490 raft_consensus.cc:493] T ba38e800dd034ff8b7fda6701973510b P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:43.846408 24490 raft_consensus.cc:515] T ba38e800dd034ff8b7fda6701973510b P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:43.848068 24478 tablet_bootstrap.cc:492] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P cf2d8294ae68482ca4ffa8be051ad054: No bootstrap required, opened a new log
I20260709 12:14:43.848884 24478 ts_tablet_manager.cc:1403] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P cf2d8294ae68482ca4ffa8be051ad054: Time spent bootstrapping tablet: real 0.096s	user 0.010s	sys 0.005s
I20260709 12:14:43.849233 24490 leader_election.cc:290] T ba38e800dd034ff8b7fda6701973510b P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:14:43.850858 24415 tablet_service.cc:1511] Processing CreateTablet for tablet 20629783689c4296afb55366d9ad5f6c (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:14:43.855026 24274 tablet_service.cc:1511] Processing CreateTablet for tablet 27de4156b2e24143a2f301fbefc7cb23 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:14:43.871727 24192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cbef09353144c0b9a9ebf7731fd019f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.862764 24422 tablet_service.cc:1511] Processing CreateTablet for tablet 085a04f8ed724f82bc12490bbb1ceea7 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:14:43.867084 24195 tablet_service.cc:1511] Processing CreateTablet for tablet 085a04f8ed724f82bc12490bbb1ceea7 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:14:43.873209 24195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 085a04f8ed724f82bc12490bbb1ceea7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.873337 24422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 085a04f8ed724f82bc12490bbb1ceea7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.876246 24488 raft_consensus.cc:493] T e24b175869274d33ade73761b6f23ca4 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:43.876969 24488 raft_consensus.cc:515] T e24b175869274d33ade73761b6f23ca4 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:43.880093 24415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20629783689c4296afb55366d9ad5f6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.871995 24274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27de4156b2e24143a2f301fbefc7cb23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.888432 24488 leader_election.cc:290] T e24b175869274d33ade73761b6f23ca4 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:14:43.890692 24271 tablet_service.cc:1511] Processing CreateTablet for tablet 085a04f8ed724f82bc12490bbb1ceea7 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:14:43.892257 24271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 085a04f8ed724f82bc12490bbb1ceea7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.907146 24341 tablet_service.cc:1511] Processing CreateTablet for tablet 27de4156b2e24143a2f301fbefc7cb23 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:14:43.908897 24341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27de4156b2e24143a2f301fbefc7cb23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.915692 24346 tablet_service.cc:1511] Processing CreateTablet for tablet ed15c59b19ff49d3a39bf5b5abf8b69a (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:14:43.917410 24346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed15c59b19ff49d3a39bf5b5abf8b69a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.923833 24423 tablet_service.cc:1511] Processing CreateTablet for tablet ed15c59b19ff49d3a39bf5b5abf8b69a (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:14:43.925681 24423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed15c59b19ff49d3a39bf5b5abf8b69a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.930275 24482 tablet_bootstrap.cc:492] T 0d31cf2c4a7849d9a798bf886e7fc997 P 9bf3da5b54ef4a1ea1cee60f02ea2883: No bootstrap required, opened a new log
I20260709 12:14:43.930948 24482 ts_tablet_manager.cc:1403] T 0d31cf2c4a7849d9a798bf886e7fc997 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.132s	user 0.018s	sys 0.018s
I20260709 12:14:43.935057 24482 raft_consensus.cc:359] T 0d31cf2c4a7849d9a798bf886e7fc997 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:43.935973 24482 raft_consensus.cc:385] T 0d31cf2c4a7849d9a798bf886e7fc997 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:43.936337 24482 raft_consensus.cc:740] T 0d31cf2c4a7849d9a798bf886e7fc997 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:14:43.937232 24482 consensus_queue.cc:260] T 0d31cf2c4a7849d9a798bf886e7fc997 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:43.938130 24479 tablet_bootstrap.cc:492] T ba38e800dd034ff8b7fda6701973510b P ad362df39b114ec3a3a419128097b362: No bootstrap required, opened a new log
I20260709 12:14:43.940308 24482 ts_tablet_manager.cc:1434] T 0d31cf2c4a7849d9a798bf886e7fc997 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 12:14:43.941524 24482 tablet_bootstrap.cc:492] T 133e492e820f4152ad30562c343b617d P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:14:43.943559 24478 raft_consensus.cc:359] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:43.944538 24478 raft_consensus.cc:385] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:43.941489 24479 ts_tablet_manager.cc:1403] T ba38e800dd034ff8b7fda6701973510b P ad362df39b114ec3a3a419128097b362: Time spent bootstrapping tablet: real 0.148s	user 0.013s	sys 0.003s
I20260709 12:14:43.949959 24485 raft_consensus.cc:493] T 95d3180f4ab5472d9de6e220219e7898 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:43.953258 24485 raft_consensus.cc:515] T 95d3180f4ab5472d9de6e220219e7898 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:43.959949 24193 tablet_service.cc:1511] Processing CreateTablet for tablet ed15c59b19ff49d3a39bf5b5abf8b69a (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:14:43.961575 24193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed15c59b19ff49d3a39bf5b5abf8b69a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.962710 24275 tablet_service.cc:1511] Processing CreateTablet for tablet 3e977ea0483d4c029394b273e7c4e90f (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:14:43.964728 24485 leader_election.cc:290] T 95d3180f4ab5472d9de6e220219e7898 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:43.967814 24344 tablet_service.cc:1511] Processing CreateTablet for tablet 3e977ea0483d4c029394b273e7c4e90f (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:14:43.969492 24344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e977ea0483d4c029394b273e7c4e90f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.981014 24479 raft_consensus.cc:359] T ba38e800dd034ff8b7fda6701973510b P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:43.986574 24479 raft_consensus.cc:385] T ba38e800dd034ff8b7fda6701973510b P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:43.987084 24479 raft_consensus.cc:740] T ba38e800dd034ff8b7fda6701973510b P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad362df39b114ec3a3a419128097b362, State: Initialized, Role: FOLLOWER
I20260709 12:14:43.988322 24479 consensus_queue.cc:260] T ba38e800dd034ff8b7fda6701973510b P ad362df39b114ec3a3a419128097b362 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:43.991569 24479 ts_tablet_manager.cc:1434] T ba38e800dd034ff8b7fda6701973510b P ad362df39b114ec3a3a419128097b362: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 12:14:43.993055 24416 tablet_service.cc:1511] Processing CreateTablet for tablet 3e977ea0483d4c029394b273e7c4e90f (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:14:43.994491 24198 tablet_service.cc:1511] Processing CreateTablet for tablet 628105dfc534451285d72f9e17f5d4f3 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:14:43.995164 24416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e977ea0483d4c029394b273e7c4e90f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.995890 24198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 628105dfc534451285d72f9e17f5d4f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:43.953261 24478 raft_consensus.cc:740] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Initialized, Role: FOLLOWER
I20260709 12:14:43.999971 24478 consensus_queue.cc:260] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P cf2d8294ae68482ca4ffa8be051ad054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:44.002873 24478 ts_tablet_manager.cc:1434] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P cf2d8294ae68482ca4ffa8be051ad054: Time spent starting tablet: real 0.135s	user 0.007s	sys 0.001s
I20260709 12:14:44.006366 24487 raft_consensus.cc:493] T 99329004ca1c4c76a3a2dd4567ef15dd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.007028 24487 raft_consensus.cc:515] T 99329004ca1c4c76a3a2dd4567ef15dd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:44.009716 24359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b175869274d33ade73761b6f23ca4" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:44.010296 24487 leader_election.cc:290] T 99329004ca1c4c76a3a2dd4567ef15dd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
W20260709 12:14:44.011962 24398 leader_election.cc:343] T e24b175869274d33ade73761b6f23ca4 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:44.013890 24275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e977ea0483d4c029394b273e7c4e90f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:44.020700 24433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba38e800dd034ff8b7fda6701973510b" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:44.021632 24433 raft_consensus.cc:2468] T ba38e800dd034ff8b7fda6701973510b P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa14caefbdaa47b09abf91881635ba96 in term 0.
I20260709 12:14:44.023561 24323 leader_election.cc:304] T ba38e800dd034ff8b7fda6701973510b P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, ad362df39b114ec3a3a419128097b362; no voters: 
I20260709 12:14:44.024598 24490 raft_consensus.cc:2804] T ba38e800dd034ff8b7fda6701973510b P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:44.025041 24490 raft_consensus.cc:493] T ba38e800dd034ff8b7fda6701973510b P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:44.025450 24490 raft_consensus.cc:3060] T ba38e800dd034ff8b7fda6701973510b P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:44.026469 24285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b175869274d33ade73761b6f23ca4" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:43.951337 24481 tablet_bootstrap.cc:654] T 133e492e820f4152ad30562c343b617d P aa14caefbdaa47b09abf91881635ba96: Neither blocks nor log segments found. Creating new log.
W20260709 12:14:44.032541 24399 leader_election.cc:343] T e24b175869274d33ade73761b6f23ca4 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:43.950896 24482 tablet_bootstrap.cc:654] T 133e492e820f4152ad30562c343b617d P 9bf3da5b54ef4a1ea1cee60f02ea2883: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:44.037030 24273 tablet_service.cc:1511] Processing CreateTablet for tablet 628105dfc534451285d72f9e17f5d4f3 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:14:44.037416 24490 raft_consensus.cc:515] T ba38e800dd034ff8b7fda6701973510b P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:44.038713 24273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 628105dfc534451285d72f9e17f5d4f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:44.041124 24433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba38e800dd034ff8b7fda6701973510b" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362"
I20260709 12:14:44.041214 24210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba38e800dd034ff8b7fda6701973510b" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
I20260709 12:14:44.042038 24433 raft_consensus.cc:3060] T ba38e800dd034ff8b7fda6701973510b P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:44.043411 24478 tablet_bootstrap.cc:492] T 99329004ca1c4c76a3a2dd4567ef15dd P cf2d8294ae68482ca4ffa8be051ad054: Bootstrap starting.
I20260709 12:14:44.044227 24210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba38e800dd034ff8b7fda6701973510b" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
W20260709 12:14:44.046069 24322 leader_election.cc:343] T ba38e800dd034ff8b7fda6701973510b P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:44.047201 24322 leader_election.cc:343] T ba38e800dd034ff8b7fda6701973510b P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:43.992776 24479 tablet_bootstrap.cc:492] T 95d3180f4ab5472d9de6e220219e7898 P ad362df39b114ec3a3a419128097b362: Bootstrap starting.
I20260709 12:14:44.068521 24359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99329004ca1c4c76a3a2dd4567ef15dd" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
W20260709 12:14:44.070665 24175 leader_election.cc:343] T 99329004ca1c4c76a3a2dd4567ef15dd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:44.071916 24433 raft_consensus.cc:2468] T ba38e800dd034ff8b7fda6701973510b P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa14caefbdaa47b09abf91881635ba96 in term 1.
I20260709 12:14:44.033166 24399 leader_election.cc:304] T e24b175869274d33ade73761b6f23ca4 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad362df39b114ec3a3a419128097b362; no voters: aa14caefbdaa47b09abf91881635ba96, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:14:44.075035 24488 raft_consensus.cc:2749] T e24b175869274d33ade73761b6f23ca4 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:14:44.077155 24399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:34565, user_credentials={real_user=slave}} blocked reactor thread for 44834.4us
I20260709 12:14:44.078394 24348 tablet_service.cc:1511] Processing CreateTablet for tablet 628105dfc534451285d72f9e17f5d4f3 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:14:44.079623 24481 tablet_bootstrap.cc:492] T 133e492e820f4152ad30562c343b617d P aa14caefbdaa47b09abf91881635ba96: No bootstrap required, opened a new log
I20260709 12:14:44.080058 24323 leader_election.cc:304] T ba38e800dd034ff8b7fda6701973510b P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, ad362df39b114ec3a3a419128097b362; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883
I20260709 12:14:44.079825 24348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 628105dfc534451285d72f9e17f5d4f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:44.080045 24487 raft_consensus.cc:493] T 0d31cf2c4a7849d9a798bf886e7fc997 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.083247 24487 raft_consensus.cc:515] T 0d31cf2c4a7849d9a798bf886e7fc997 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:44.081065 24481 ts_tablet_manager.cc:1403] T 133e492e820f4152ad30562c343b617d P aa14caefbdaa47b09abf91881635ba96: Time spent bootstrapping tablet: real 0.244s	user 0.015s	sys 0.001s
I20260709 12:14:44.088701 24418 tablet_service.cc:1511] Processing CreateTablet for tablet 318c217e16874865bd6dff6bd4d8cd4f (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:14:44.092159 24487 leader_election.cc:290] T 0d31cf2c4a7849d9a798bf886e7fc997 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:14:44.074112 24490 leader_election.cc:290] T ba38e800dd034ff8b7fda6701973510b P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 election: Requested vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:14:44.104813 24482 tablet_bootstrap.cc:492] T 133e492e820f4152ad30562c343b617d P 9bf3da5b54ef4a1ea1cee60f02ea2883: No bootstrap required, opened a new log
I20260709 12:14:44.108779 24482 ts_tablet_manager.cc:1403] T 133e492e820f4152ad30562c343b617d P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.168s	user 0.013s	sys 0.008s
I20260709 12:14:44.105648 24418 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 318c217e16874865bd6dff6bd4d8cd4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:44.105464 24479 tablet_bootstrap.cc:654] T 95d3180f4ab5472d9de6e220219e7898 P ad362df39b114ec3a3a419128097b362: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:44.112730 24482 raft_consensus.cc:359] T 133e492e820f4152ad30562c343b617d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:44.114308 24482 raft_consensus.cc:385] T 133e492e820f4152ad30562c343b617d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:44.114876 24482 raft_consensus.cc:740] T 133e492e820f4152ad30562c343b617d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:14:44.116014 24482 consensus_queue.cc:260] T 133e492e820f4152ad30562c343b617d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:44.112840 24433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d3180f4ab5472d9de6e220219e7898" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
W20260709 12:14:44.118736 24249 leader_election.cc:343] T 95d3180f4ab5472d9de6e220219e7898 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:44.119930 24432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31cf2c4a7849d9a798bf886e7fc997" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:44.122725 24482 ts_tablet_manager.cc:1434] T 133e492e820f4152ad30562c343b617d P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 12:14:44.124203 24482 tablet_bootstrap.cc:492] T 4b1c850a65b748c093c5c88aa94fed71 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:14:44.130985 24210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d3180f4ab5472d9de6e220219e7898" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
W20260709 12:14:44.132933 24248 leader_election.cc:343] T 95d3180f4ab5472d9de6e220219e7898 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:44.133513 24248 leader_election.cc:304] T 95d3180f4ab5472d9de6e220219e7898 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf2d8294ae68482ca4ffa8be051ad054; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, ad362df39b114ec3a3a419128097b362
I20260709 12:14:44.134141 24482 tablet_bootstrap.cc:654] T 4b1c850a65b748c093c5c88aa94fed71 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:44.134753 24485 raft_consensus.cc:2749] T 95d3180f4ab5472d9de6e220219e7898 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:14:44.135846 24174 leader_election.cc:343] T 0d31cf2c4a7849d9a798bf886e7fc997 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:44.128563 24490 raft_consensus.cc:2804] T ba38e800dd034ff8b7fda6701973510b P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:44.139647 24490 raft_consensus.cc:697] T ba38e800dd034ff8b7fda6701973510b P aa14caefbdaa47b09abf91881635ba96 [term 1 LEADER]: Becoming Leader. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Running, Role: LEADER
I20260709 12:14:44.140995 24479 tablet_bootstrap.cc:492] T 95d3180f4ab5472d9de6e220219e7898 P ad362df39b114ec3a3a419128097b362: No bootstrap required, opened a new log
I20260709 12:14:44.141610 24479 ts_tablet_manager.cc:1403] T 95d3180f4ab5472d9de6e220219e7898 P ad362df39b114ec3a3a419128097b362: Time spent bootstrapping tablet: real 0.149s	user 0.014s	sys 0.011s
I20260709 12:14:44.142308 24490 consensus_queue.cc:237] T ba38e800dd034ff8b7fda6701973510b P aa14caefbdaa47b09abf91881635ba96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:44.145324 24479 raft_consensus.cc:359] T 95d3180f4ab5472d9de6e220219e7898 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:44.146327 24479 raft_consensus.cc:385] T 95d3180f4ab5472d9de6e220219e7898 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:44.146687 24479 raft_consensus.cc:740] T 95d3180f4ab5472d9de6e220219e7898 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad362df39b114ec3a3a419128097b362, State: Initialized, Role: FOLLOWER
I20260709 12:14:44.147703 24479 consensus_queue.cc:260] T 95d3180f4ab5472d9de6e220219e7898 P ad362df39b114ec3a3a419128097b362 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:44.154477 24284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31cf2c4a7849d9a798bf886e7fc997" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:44.157083 24285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99329004ca1c4c76a3a2dd4567ef15dd" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
W20260709 12:14:44.159233 24176 leader_election.cc:343] T 0d31cf2c4a7849d9a798bf886e7fc997 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:44.159776 24176 leader_election.cc:304] T 0d31cf2c4a7849d9a798bf886e7fc997 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883; no voters: ad362df39b114ec3a3a419128097b362, cf2d8294ae68482ca4ffa8be051ad054
W20260709 12:14:44.161161 24176 leader_election.cc:343] T 99329004ca1c4c76a3a2dd4567ef15dd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:44.161669 24176 leader_election.cc:304] T 99329004ca1c4c76a3a2dd4567ef15dd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883; no voters: aa14caefbdaa47b09abf91881635ba96, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:14:44.162848 24487 raft_consensus.cc:2749] T 0d31cf2c4a7849d9a798bf886e7fc997 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:44.164343 24487 raft_consensus.cc:2749] T 99329004ca1c4c76a3a2dd4567ef15dd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:44.166859 24479 ts_tablet_manager.cc:1434] T 95d3180f4ab5472d9de6e220219e7898 P ad362df39b114ec3a3a419128097b362: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.003s
I20260709 12:14:44.169250 24478 tablet_bootstrap.cc:654] T 99329004ca1c4c76a3a2dd4567ef15dd P cf2d8294ae68482ca4ffa8be051ad054: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:44.175294 24479 tablet_bootstrap.cc:492] T 4b1c850a65b748c093c5c88aa94fed71 P ad362df39b114ec3a3a419128097b362: Bootstrap starting.
I20260709 12:14:44.178417 24195 tablet_service.cc:1511] Processing CreateTablet for tablet 318c217e16874865bd6dff6bd4d8cd4f (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:14:44.180065 24195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 318c217e16874865bd6dff6bd4d8cd4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:44.180135 24482 tablet_bootstrap.cc:492] T 4b1c850a65b748c093c5c88aa94fed71 P 9bf3da5b54ef4a1ea1cee60f02ea2883: No bootstrap required, opened a new log
I20260709 12:14:44.180963 24482 ts_tablet_manager.cc:1403] T 4b1c850a65b748c093c5c88aa94fed71 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.057s	user 0.024s	sys 0.003s
I20260709 12:14:44.189534 24341 tablet_service.cc:1511] Processing CreateTablet for tablet fd6e20f3c92f4498a8c272b807797efa (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:14:44.191246 24341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd6e20f3c92f4498a8c272b807797efa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:44.194823 24488 raft_consensus.cc:493] T 95d3180f4ab5472d9de6e220219e7898 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.194973 24482 raft_consensus.cc:359] T 4b1c850a65b748c093c5c88aa94fed71 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:44.195515 24488 raft_consensus.cc:515] T 95d3180f4ab5472d9de6e220219e7898 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:44.196036 24482 raft_consensus.cc:385] T 4b1c850a65b748c093c5c88aa94fed71 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:44.196480 24482 raft_consensus.cc:740] T 4b1c850a65b748c093c5c88aa94fed71 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:14:44.199926 24479 tablet_bootstrap.cc:654] T 4b1c850a65b748c093c5c88aa94fed71 P ad362df39b114ec3a3a419128097b362: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:44.197450 24482 consensus_queue.cc:260] T 4b1c850a65b748c093c5c88aa94fed71 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:44.209488 24478 tablet_bootstrap.cc:492] T 99329004ca1c4c76a3a2dd4567ef15dd P cf2d8294ae68482ca4ffa8be051ad054: No bootstrap required, opened a new log
I20260709 12:14:44.210423 24478 ts_tablet_manager.cc:1403] T 99329004ca1c4c76a3a2dd4567ef15dd P cf2d8294ae68482ca4ffa8be051ad054: Time spent bootstrapping tablet: real 0.167s	user 0.000s	sys 0.023s
I20260709 12:14:44.177395 24481 raft_consensus.cc:359] T 133e492e820f4152ad30562c343b617d P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:44.211745 24482 ts_tablet_manager.cc:1434] T 4b1c850a65b748c093c5c88aa94fed71 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.005s
I20260709 12:14:44.212833 24488 leader_election.cc:290] T 95d3180f4ab5472d9de6e220219e7898 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:14:44.214097 24285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d3180f4ab5472d9de6e220219e7898" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:44.214308 24513 raft_consensus.cc:493] T 133e492e820f4152ad30562c343b617d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.214919 24285 raft_consensus.cc:2468] T 95d3180f4ab5472d9de6e220219e7898 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 0.
I20260709 12:14:44.215176 24513 raft_consensus.cc:515] T 133e492e820f4152ad30562c343b617d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:44.216367 24399 leader_election.cc:304] T 95d3180f4ab5472d9de6e220219e7898 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad362df39b114ec3a3a419128097b362, cf2d8294ae68482ca4ffa8be051ad054; no voters: 
I20260709 12:14:44.220001 24210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d3180f4ab5472d9de6e220219e7898" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
I20260709 12:14:44.221589 24285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133e492e820f4152ad30562c343b617d" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:44.221803 24513 leader_election.cc:290] T 133e492e820f4152ad30562c343b617d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:14:44.222703 24488 raft_consensus.cc:2804] T 95d3180f4ab5472d9de6e220219e7898 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:44.221650 24359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133e492e820f4152ad30562c343b617d" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
W20260709 12:14:44.223215 24176 leader_election.cc:343] T 133e492e820f4152ad30562c343b617d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:44.223773 24482 tablet_bootstrap.cc:492] T ab8dff607862460ea0fcd88422c31ac2 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:14:44.223189 24488 raft_consensus.cc:493] T 95d3180f4ab5472d9de6e220219e7898 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:44.222010 24396 leader_election.cc:343] T 95d3180f4ab5472d9de6e220219e7898 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:44.225399 24488 raft_consensus.cc:3060] T 95d3180f4ab5472d9de6e220219e7898 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:44.228299 24273 tablet_service.cc:1511] Processing CreateTablet for tablet 318c217e16874865bd6dff6bd4d8cd4f (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:14:44.231290 24481 raft_consensus.cc:385] T 133e492e820f4152ad30562c343b617d P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:44.237391 24481 raft_consensus.cc:740] T 133e492e820f4152ad30562c343b617d P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Initialized, Role: FOLLOWER
I20260709 12:14:44.235261 24273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 318c217e16874865bd6dff6bd4d8cd4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:44.248282 24275 tablet_service.cc:1511] Processing CreateTablet for tablet 00b51df5a8ee448884a9f145559a5ea3 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:14:44.243832 24198 tablet_service.cc:1511] Processing CreateTablet for tablet fd6e20f3c92f4498a8c272b807797efa (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:14:44.250320 24275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00b51df5a8ee448884a9f145559a5ea3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:44.253672 24418 tablet_service.cc:1511] Processing CreateTablet for tablet fd6e20f3c92f4498a8c272b807797efa (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:14:44.255297 24418 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd6e20f3c92f4498a8c272b807797efa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:44.255884 24344 tablet_service.cc:1511] Processing CreateTablet for tablet 00b51df5a8ee448884a9f145559a5ea3 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:14:44.253021 24198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd6e20f3c92f4498a8c272b807797efa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:44.257357 24344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00b51df5a8ee448884a9f145559a5ea3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:44.238993 24481 consensus_queue.cc:260] T 133e492e820f4152ad30562c343b617d P aa14caefbdaa47b09abf91881635ba96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:44.259645 24359 raft_consensus.cc:2468] T 133e492e820f4152ad30562c343b617d P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 0.
I20260709 12:14:44.261672 24481 ts_tablet_manager.cc:1434] T 133e492e820f4152ad30562c343b617d P aa14caefbdaa47b09abf91881635ba96: Time spent starting tablet: real 0.174s	user 0.006s	sys 0.003s
I20260709 12:14:44.262974 24481 tablet_bootstrap.cc:492] T e24b175869274d33ade73761b6f23ca4 P aa14caefbdaa47b09abf91881635ba96: Bootstrap starting.
I20260709 12:14:44.263957 24175 leader_election.cc:304] T 133e492e820f4152ad30562c343b617d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, aa14caefbdaa47b09abf91881635ba96; no voters: cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:14:44.265022 24513 raft_consensus.cc:2804] T 133e492e820f4152ad30562c343b617d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:44.265467 24513 raft_consensus.cc:493] T 133e492e820f4152ad30562c343b617d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:44.265900 24513 raft_consensus.cc:3060] T 133e492e820f4152ad30562c343b617d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:44.266508 24482 tablet_bootstrap.cc:654] T ab8dff607862460ea0fcd88422c31ac2 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:44.259919 24105 catalog_manager.cc:5697] T ba38e800dd034ff8b7fda6701973510b P aa14caefbdaa47b09abf91881635ba96 reported cstate change: term changed from 0 to 1, leader changed from <none> to aa14caefbdaa47b09abf91881635ba96 (127.12.56.195). New cstate: current_term: 1 leader_uuid: "aa14caefbdaa47b09abf91881635ba96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:44.273581 24422 tablet_service.cc:1511] Processing CreateTablet for tablet 00b51df5a8ee448884a9f145559a5ea3 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:14:44.275259 24422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00b51df5a8ee448884a9f145559a5ea3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:44.257140 24478 raft_consensus.cc:359] T 99329004ca1c4c76a3a2dd4567ef15dd P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:44.278442 24478 raft_consensus.cc:385] T 99329004ca1c4c76a3a2dd4567ef15dd P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:44.278861 24478 raft_consensus.cc:740] T 99329004ca1c4c76a3a2dd4567ef15dd P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Initialized, Role: FOLLOWER
I20260709 12:14:44.279845 24478 consensus_queue.cc:260] T 99329004ca1c4c76a3a2dd4567ef15dd P cf2d8294ae68482ca4ffa8be051ad054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:44.277976 24479 tablet_bootstrap.cc:492] T 4b1c850a65b748c093c5c88aa94fed71 P ad362df39b114ec3a3a419128097b362: No bootstrap required, opened a new log
I20260709 12:14:44.283133 24513 raft_consensus.cc:515] T 133e492e820f4152ad30562c343b617d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:44.283728 24193 tablet_service.cc:1511] Processing CreateTablet for tablet 5310371490a542269db28e29d7adfffa (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:14:44.285358 24193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5310371490a542269db28e29d7adfffa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:44.286732 24285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133e492e820f4152ad30562c343b617d" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054"
W20260709 12:14:44.288592 24176 leader_election.cc:343] T 133e492e820f4152ad30562c343b617d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:44.282927 24479 ts_tablet_manager.cc:1403] T 4b1c850a65b748c093c5c88aa94fed71 P ad362df39b114ec3a3a419128097b362: Time spent bootstrapping tablet: real 0.108s	user 0.030s	sys 0.004s
I20260709 12:14:44.300979 24482 tablet_bootstrap.cc:492] T ab8dff607862460ea0fcd88422c31ac2 P 9bf3da5b54ef4a1ea1cee60f02ea2883: No bootstrap required, opened a new log
I20260709 12:14:44.301759 24482 ts_tablet_manager.cc:1403] T ab8dff607862460ea0fcd88422c31ac2 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.078s	user 0.012s	sys 0.003s
I20260709 12:14:44.301451 24359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133e492e820f4152ad30562c343b617d" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
I20260709 12:14:44.302386 24359 raft_consensus.cc:3060] T 133e492e820f4152ad30562c343b617d P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:44.304914 24488 raft_consensus.cc:515] T 95d3180f4ab5472d9de6e220219e7898 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:44.308786 24210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d3180f4ab5472d9de6e220219e7898" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
W20260709 12:14:44.310698 24396 leader_election.cc:343] T 95d3180f4ab5472d9de6e220219e7898 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:44.312579 24485 raft_consensus.cc:493] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.293620 24479 raft_consensus.cc:359] T 4b1c850a65b748c093c5c88aa94fed71 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:44.313221 24485 raft_consensus.cc:515] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:44.314149 24479 raft_consensus.cc:385] T 4b1c850a65b748c093c5c88aa94fed71 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:44.314555 24479 raft_consensus.cc:740] T 4b1c850a65b748c093c5c88aa94fed71 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad362df39b114ec3a3a419128097b362, State: Initialized, Role: FOLLOWER
I20260709 12:14:44.315083 24274 tablet_service.cc:1511] Processing CreateTablet for tablet 5310371490a542269db28e29d7adfffa (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:14:44.315498 24479 consensus_queue.cc:260] T 4b1c850a65b748c093c5c88aa94fed71 P ad362df39b114ec3a3a419128097b362 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:44.316675 24274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5310371490a542269db28e29d7adfffa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:44.316771 24485 leader_election.cc:290] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:14:44.319294 24432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a17cccc4f4ca79468bb6b4e904ec8" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:44.321918 24478 ts_tablet_manager.cc:1434] T 99329004ca1c4c76a3a2dd4567ef15dd P cf2d8294ae68482ca4ffa8be051ad054: Time spent starting tablet: real 0.109s	user 0.003s	sys 0.006s
I20260709 12:14:44.323247 24478 tablet_bootstrap.cc:492] T 133e492e820f4152ad30562c343b617d P cf2d8294ae68482ca4ffa8be051ad054: Bootstrap starting.
I20260709 12:14:44.324101 24513 leader_election.cc:290] T 133e492e820f4152ad30562c343b617d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 election: Requested vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:14:44.324717 24359 raft_consensus.cc:2468] T 133e492e820f4152ad30562c343b617d P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 1.
I20260709 12:14:44.326467 24175 leader_election.cc:304] T 133e492e820f4152ad30562c343b617d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, aa14caefbdaa47b09abf91881635ba96; no voters: cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:14:44.328336 24485 raft_consensus.cc:493] T 99329004ca1c4c76a3a2dd4567ef15dd P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.328902 24485 raft_consensus.cc:515] T 99329004ca1c4c76a3a2dd4567ef15dd P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:44.327782 24513 raft_consensus.cc:2804] T 133e492e820f4152ad30562c343b617d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:14:44.331380 24249 leader_election.cc:343] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:44.333140 24210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99329004ca1c4c76a3a2dd4567ef15dd" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
I20260709 12:14:44.333602 24513 raft_consensus.cc:697] T 133e492e820f4152ad30562c343b617d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 LEADER]: Becoming Leader. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Running, Role: LEADER
I20260709 12:14:44.334043 24210 raft_consensus.cc:2468] T 99329004ca1c4c76a3a2dd4567ef15dd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 0.
I20260709 12:14:44.313483 24482 raft_consensus.cc:359] T ab8dff607862460ea0fcd88422c31ac2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:44.335434 24248 leader_election.cc:304] T 99329004ca1c4c76a3a2dd4567ef15dd P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054; no voters: 
I20260709 12:14:44.335985 24482 raft_consensus.cc:385] T ab8dff607862460ea0fcd88422c31ac2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:44.301131 24481 tablet_bootstrap.cc:654] T e24b175869274d33ade73761b6f23ca4 P aa14caefbdaa47b09abf91881635ba96: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:44.331557 24485 leader_election.cc:290] T 99329004ca1c4c76a3a2dd4567ef15dd P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:14:44.344628 24485 raft_consensus.cc:2804] T 99329004ca1c4c76a3a2dd4567ef15dd P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:44.345150 24485 raft_consensus.cc:493] T 99329004ca1c4c76a3a2dd4567ef15dd P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:44.345662 24485 raft_consensus.cc:3060] T 99329004ca1c4c76a3a2dd4567ef15dd P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:44.336400 24482 raft_consensus.cc:740] T ab8dff607862460ea0fcd88422c31ac2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:14:44.349184 24348 tablet_service.cc:1511] Processing CreateTablet for tablet 5310371490a542269db28e29d7adfffa (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:14:44.354727 24482 consensus_queue.cc:260] T ab8dff607862460ea0fcd88422c31ac2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:44.334796 24513 consensus_queue.cc:237] T 133e492e820f4152ad30562c343b617d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:44.355716 24488 leader_election.cc:290] T 95d3180f4ab5472d9de6e220219e7898 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 election: Requested vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:14:44.364230 24285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d3180f4ab5472d9de6e220219e7898" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054"
I20260709 12:14:44.364632 24348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5310371490a542269db28e29d7adfffa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:44.365077 24285 raft_consensus.cc:3060] T 95d3180f4ab5472d9de6e220219e7898 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:44.371997 24482 ts_tablet_manager.cc:1434] T ab8dff607862460ea0fcd88422c31ac2 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.062s	user 0.005s	sys 0.004s
I20260709 12:14:44.372622 24418 tablet_service.cc:1511] Processing CreateTablet for tablet 9cb931cb82d74add922e65a2ea3de34d (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:14:44.373416 24482 tablet_bootstrap.cc:492] T 477aafe049fa4b1182fb0afe55fe5e55 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:14:44.374270 24418 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cb931cb82d74add922e65a2ea3de34d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:14:44.375195 24155 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:44.381651 24195 tablet_service.cc:1511] Processing CreateTablet for tablet 9cb931cb82d74add922e65a2ea3de34d (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:14:44.383436 24195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cb931cb82d74add922e65a2ea3de34d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:44.384680 24482 tablet_bootstrap.cc:654] T 477aafe049fa4b1182fb0afe55fe5e55 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:44.402215 24271 tablet_service.cc:1511] Processing CreateTablet for tablet 9cb931cb82d74add922e65a2ea3de34d (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:14:44.404488 24271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cb931cb82d74add922e65a2ea3de34d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:44.418427 24478 tablet_bootstrap.cc:654] T 133e492e820f4152ad30562c343b617d P cf2d8294ae68482ca4ffa8be051ad054: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:44.419778 24359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a17cccc4f4ca79468bb6b4e904ec8" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:44.420437 24487 raft_consensus.cc:493] T 4b1c850a65b748c093c5c88aa94fed71 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.420698 24285 raft_consensus.cc:2468] T 95d3180f4ab5472d9de6e220219e7898 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 1.
I20260709 12:14:44.421100 24487 raft_consensus.cc:515] T 4b1c850a65b748c093c5c88aa94fed71 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:44.426433 24399 leader_election.cc:304] T 95d3180f4ab5472d9de6e220219e7898 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad362df39b114ec3a3a419128097b362, cf2d8294ae68482ca4ffa8be051ad054; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883
I20260709 12:14:44.421588 24358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99329004ca1c4c76a3a2dd4567ef15dd" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:44.427862 24487 leader_election.cc:290] T 4b1c850a65b748c093c5c88aa94fed71 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:14:44.424458 24479 ts_tablet_manager.cc:1434] T 4b1c850a65b748c093c5c88aa94fed71 P ad362df39b114ec3a3a419128097b362: Time spent starting tablet: real 0.134s	user 0.009s	sys 0.031s
I20260709 12:14:44.438990 24358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b1c850a65b748c093c5c88aa94fed71" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:44.436496 24341 tablet_service.cc:1511] Processing CreateTablet for tablet 4f756e6bcc20458b8748cd090cd3fce2 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:14:44.433540 24432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b1c850a65b748c093c5c88aa94fed71" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
W20260709 12:14:44.447912 24175 leader_election.cc:343] T 4b1c850a65b748c093c5c88aa94fed71 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:44.448189 24432 raft_consensus.cc:2468] T 4b1c850a65b748c093c5c88aa94fed71 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 0.
I20260709 12:14:44.449631 24174 leader_election.cc:304] T 4b1c850a65b748c093c5c88aa94fed71 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, ad362df39b114ec3a3a419128097b362; no voters: aa14caefbdaa47b09abf91881635ba96
I20260709 12:14:44.450009 24422 tablet_service.cc:1511] Processing CreateTablet for tablet 4f756e6bcc20458b8748cd090cd3fce2 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:14:44.450573 24479 tablet_bootstrap.cc:492] T c75afe0e0e00446aa6d220941d288eab P ad362df39b114ec3a3a419128097b362: Bootstrap starting.
I20260709 12:14:44.451216 24487 raft_consensus.cc:2804] T 4b1c850a65b748c093c5c88aa94fed71 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:44.451661 24422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f756e6bcc20458b8748cd090cd3fce2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:44.451761 24487 raft_consensus.cc:493] T 4b1c850a65b748c093c5c88aa94fed71 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:44.452371 24487 raft_consensus.cc:3060] T 4b1c850a65b748c093c5c88aa94fed71 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:44.456053 24485 raft_consensus.cc:515] T 99329004ca1c4c76a3a2dd4567ef15dd P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:44.456467 24108 catalog_manager.cc:5697] T 133e492e820f4152ad30562c343b617d P 9bf3da5b54ef4a1ea1cee60f02ea2883 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193). New cstate: current_term: 1 leader_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:44.427902 24250 leader_election.cc:343] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:44.463083 24250 leader_election.cc:304] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf2d8294ae68482ca4ffa8be051ad054; no voters: aa14caefbdaa47b09abf91881635ba96, ad362df39b114ec3a3a419128097b362
I20260709 12:14:44.441720 24341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f756e6bcc20458b8748cd090cd3fce2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:44.442144 24521 raft_consensus.cc:2804] T 95d3180f4ab5472d9de6e220219e7898 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:44.467782 24520 raft_consensus.cc:2749] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:14:44.468591 24250 leader_election.cc:343] T 99329004ca1c4c76a3a2dd4567ef15dd P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:44.471800 24487 raft_consensus.cc:515] T 4b1c850a65b748c093c5c88aa94fed71 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:44.476212 24485 leader_election.cc:290] T 99329004ca1c4c76a3a2dd4567ef15dd P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 election: Requested vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:14:44.476902 24210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99329004ca1c4c76a3a2dd4567ef15dd" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
I20260709 12:14:44.477620 24210 raft_consensus.cc:3060] T 99329004ca1c4c76a3a2dd4567ef15dd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:44.486271 24358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99329004ca1c4c76a3a2dd4567ef15dd" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
I20260709 12:14:44.486569 24198 tablet_service.cc:1511] Processing CreateTablet for tablet 4f756e6bcc20458b8748cd090cd3fce2 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:14:44.487674 24274 tablet_service.cc:1511] Processing CreateTablet for tablet 7c84013312e3409d851214e9954dad8b (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:14:44.488052 24346 tablet_service.cc:1511] Processing CreateTablet for tablet 7c84013312e3409d851214e9954dad8b (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:14:44.481391 24479 tablet_bootstrap.cc:654] T c75afe0e0e00446aa6d220941d288eab P ad362df39b114ec3a3a419128097b362: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:44.491719 24423 tablet_service.cc:1511] Processing CreateTablet for tablet 7c84013312e3409d851214e9954dad8b (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:14:44.493172 24423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c84013312e3409d851214e9954dad8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:44.493065 24193 tablet_service.cc:1511] Processing CreateTablet for tablet 3fe3be6bb3264475ba597fec30a06f6c (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:14:44.489502 24346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c84013312e3409d851214e9954dad8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:44.488114 24198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f756e6bcc20458b8748cd090cd3fce2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:14:44.497176 24250 leader_election.cc:343] T 99329004ca1c4c76a3a2dd4567ef15dd P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:44.499045 24482 tablet_bootstrap.cc:492] T 477aafe049fa4b1182fb0afe55fe5e55 P 9bf3da5b54ef4a1ea1cee60f02ea2883: No bootstrap required, opened a new log
I20260709 12:14:44.499660 24482 ts_tablet_manager.cc:1403] T 477aafe049fa4b1182fb0afe55fe5e55 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.127s	user 0.016s	sys 0.014s
I20260709 12:14:44.499377 24273 tablet_service.cc:1511] Processing CreateTablet for tablet 3fe3be6bb3264475ba597fec30a06f6c (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:14:44.500802 24273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fe3be6bb3264475ba597fec30a06f6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:44.503844 24193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fe3be6bb3264475ba597fec30a06f6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:44.505615 24481 tablet_bootstrap.cc:492] T e24b175869274d33ade73761b6f23ca4 P aa14caefbdaa47b09abf91881635ba96: No bootstrap required, opened a new log
I20260709 12:14:44.506285 24481 ts_tablet_manager.cc:1403] T e24b175869274d33ade73761b6f23ca4 P aa14caefbdaa47b09abf91881635ba96: Time spent bootstrapping tablet: real 0.244s	user 0.017s	sys 0.001s
I20260709 12:14:44.511111 24482 raft_consensus.cc:359] T 477aafe049fa4b1182fb0afe55fe5e55 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:44.512018 24482 raft_consensus.cc:385] T 477aafe049fa4b1182fb0afe55fe5e55 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:44.512398 24482 raft_consensus.cc:740] T 477aafe049fa4b1182fb0afe55fe5e55 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:14:44.514979 24487 leader_election.cc:290] T 4b1c850a65b748c093c5c88aa94fed71 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 election: Requested vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:14:44.481215 24521 raft_consensus.cc:697] T 95d3180f4ab5472d9de6e220219e7898 P ad362df39b114ec3a3a419128097b362 [term 1 LEADER]: Becoming Leader. State: Replica: ad362df39b114ec3a3a419128097b362, State: Running, Role: LEADER
I20260709 12:14:44.515812 24210 raft_consensus.cc:2468] T 99329004ca1c4c76a3a2dd4567ef15dd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 1.
I20260709 12:14:44.516223 24432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b1c850a65b748c093c5c88aa94fed71" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362"
I20260709 12:14:44.518975 24274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c84013312e3409d851214e9954dad8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:44.519135 24248 leader_election.cc:304] T 99329004ca1c4c76a3a2dd4567ef15dd P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054; no voters: aa14caefbdaa47b09abf91881635ba96
I20260709 12:14:44.519654 24358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b1c850a65b748c093c5c88aa94fed71" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
I20260709 12:14:44.516898 24432 raft_consensus.cc:3060] T 4b1c850a65b748c093c5c88aa94fed71 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:44.520385 24485 raft_consensus.cc:2804] T 99329004ca1c4c76a3a2dd4567ef15dd P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:14:44.521534 24175 leader_election.cc:343] T 4b1c850a65b748c093c5c88aa94fed71 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:44.513278 24482 consensus_queue.cc:260] T 477aafe049fa4b1182fb0afe55fe5e55 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:44.522998 24485 raft_consensus.cc:697] T 99329004ca1c4c76a3a2dd4567ef15dd P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Becoming Leader. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Running, Role: LEADER
I20260709 12:14:44.523936 24485 consensus_queue.cc:237] T 99329004ca1c4c76a3a2dd4567ef15dd P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:44.509610 24481 raft_consensus.cc:359] T e24b175869274d33ade73761b6f23ca4 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:44.529671 24481 raft_consensus.cc:385] T e24b175869274d33ade73761b6f23ca4 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:44.528648 24482 ts_tablet_manager.cc:1434] T 477aafe049fa4b1182fb0afe55fe5e55 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.002s
I20260709 12:14:44.528524 24344 tablet_service.cc:1511] Processing CreateTablet for tablet 3fe3be6bb3264475ba597fec30a06f6c (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:14:44.530654 24481 raft_consensus.cc:740] T e24b175869274d33ade73761b6f23ca4 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Initialized, Role: FOLLOWER
I20260709 12:14:44.535655 24481 consensus_queue.cc:260] T e24b175869274d33ade73761b6f23ca4 P aa14caefbdaa47b09abf91881635ba96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:44.537885 24432 raft_consensus.cc:2468] T 4b1c850a65b748c093c5c88aa94fed71 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 1.
I20260709 12:14:44.554670 24174 leader_election.cc:304] T 4b1c850a65b748c093c5c88aa94fed71 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, ad362df39b114ec3a3a419128097b362; no voters: aa14caefbdaa47b09abf91881635ba96
I20260709 12:14:44.516826 24521 consensus_queue.cc:237] T 95d3180f4ab5472d9de6e220219e7898 P ad362df39b114ec3a3a419128097b362 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:44.556141 24487 raft_consensus.cc:2804] T 4b1c850a65b748c093c5c88aa94fed71 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:44.556761 24487 raft_consensus.cc:697] T 4b1c850a65b748c093c5c88aa94fed71 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 LEADER]: Becoming Leader. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Running, Role: LEADER
I20260709 12:14:44.557737 24487 consensus_queue.cc:237] T 4b1c850a65b748c093c5c88aa94fed71 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:44.556864 24415 tablet_service.cc:1511] Processing CreateTablet for tablet d10519ad64d948b09186e335ed06257d (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:14:44.563766 24478 tablet_bootstrap.cc:492] T 133e492e820f4152ad30562c343b617d P cf2d8294ae68482ca4ffa8be051ad054: No bootstrap required, opened a new log
I20260709 12:14:44.571089 24415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d10519ad64d948b09186e335ed06257d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:44.572515 24192 tablet_service.cc:1511] Processing CreateTablet for tablet d10519ad64d948b09186e335ed06257d (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:14:44.568282 24344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fe3be6bb3264475ba597fec30a06f6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:44.568300 24482 tablet_bootstrap.cc:492] T ba38e800dd034ff8b7fda6701973510b P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:14:44.577395 24192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d10519ad64d948b09186e335ed06257d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:44.575947 24478 ts_tablet_manager.cc:1403] T 133e492e820f4152ad30562c343b617d P cf2d8294ae68482ca4ffa8be051ad054: Time spent bootstrapping tablet: real 0.253s	user 0.013s	sys 0.016s
I20260709 12:14:44.587531 24275 tablet_service.cc:1511] Processing CreateTablet for tablet d10519ad64d948b09186e335ed06257d (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:14:44.598555 24481 ts_tablet_manager.cc:1434] T e24b175869274d33ade73761b6f23ca4 P aa14caefbdaa47b09abf91881635ba96: Time spent starting tablet: real 0.092s	user 0.008s	sys 0.000s
I20260709 12:14:44.600172 24481 tablet_bootstrap.cc:492] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96: Bootstrap starting.
I20260709 12:14:44.601722 24418 tablet_service.cc:1511] Processing CreateTablet for tablet 464c7ebd16cd488086ccaec23defbb33 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:14:44.602097 24346 tablet_service.cc:1511] Processing CreateTablet for tablet 464c7ebd16cd488086ccaec23defbb33 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:14:44.603283 24418 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 464c7ebd16cd488086ccaec23defbb33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:44.603446 24346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 464c7ebd16cd488086ccaec23defbb33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:44.608302 24275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d10519ad64d948b09186e335ed06257d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:44.599489 24478 raft_consensus.cc:359] T 133e492e820f4152ad30562c343b617d P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:44.610137 24478 raft_consensus.cc:385] T 133e492e820f4152ad30562c343b617d P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:44.610558 24478 raft_consensus.cc:740] T 133e492e820f4152ad30562c343b617d P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Initialized, Role: FOLLOWER
I20260709 12:14:44.611531 24478 consensus_queue.cc:260] T 133e492e820f4152ad30562c343b617d P cf2d8294ae68482ca4ffa8be051ad054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:44.613960 24478 ts_tablet_manager.cc:1434] T 133e492e820f4152ad30562c343b617d P cf2d8294ae68482ca4ffa8be051ad054: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:14:44.607003 24105 catalog_manager.cc:5697] T 99329004ca1c4c76a3a2dd4567ef15dd P cf2d8294ae68482ca4ffa8be051ad054 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194). New cstate: current_term: 1 leader_uuid: "cf2d8294ae68482ca4ffa8be051ad054" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:44.635705 24195 tablet_service.cc:1511] Processing CreateTablet for tablet 464c7ebd16cd488086ccaec23defbb33 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:14:44.637214 24195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 464c7ebd16cd488086ccaec23defbb33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:44.638778 24479 tablet_bootstrap.cc:492] T c75afe0e0e00446aa6d220941d288eab P ad362df39b114ec3a3a419128097b362: No bootstrap required, opened a new log
I20260709 12:14:44.639407 24479 ts_tablet_manager.cc:1403] T c75afe0e0e00446aa6d220941d288eab P ad362df39b114ec3a3a419128097b362: Time spent bootstrapping tablet: real 0.189s	user 0.022s	sys 0.001s
I20260709 12:14:44.642902 24108 catalog_manager.cc:5697] T 95d3180f4ab5472d9de6e220219e7898 P ad362df39b114ec3a3a419128097b362 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad362df39b114ec3a3a419128097b362 (127.12.56.196). New cstate: current_term: 1 leader_uuid: "ad362df39b114ec3a3a419128097b362" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:44.642489 24482 tablet_bootstrap.cc:654] T ba38e800dd034ff8b7fda6701973510b P 9bf3da5b54ef4a1ea1cee60f02ea2883: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:44.642215 24478 tablet_bootstrap.cc:492] T 7943c68d21d449dba2d1dca6ddde5820 P cf2d8294ae68482ca4ffa8be051ad054: Bootstrap starting.
I20260709 12:14:44.649581 24271 tablet_service.cc:1511] Processing CreateTablet for tablet 93ece38976574ad7a5e93a69c33c074d (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:14:44.651038 24416 tablet_service.cc:1511] Processing CreateTablet for tablet 93ece38976574ad7a5e93a69c33c074d (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:14:44.652668 24416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93ece38976574ad7a5e93a69c33c074d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:14:44.666075 24322 consensus_peers.cc:597] T ba38e800dd034ff8b7fda6701973510b P aa14caefbdaa47b09abf91881635ba96 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:44.667089 24199 tablet_service.cc:1511] Processing CreateTablet for tablet 356b14abd90d418cab44e524aef8154c (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:14:44.668951 24481 tablet_bootstrap.cc:654] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:44.669124 24199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 356b14abd90d418cab44e524aef8154c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:44.681253 24271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93ece38976574ad7a5e93a69c33c074d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:44.653062 24107 catalog_manager.cc:5697] T 4b1c850a65b748c093c5c88aa94fed71 P 9bf3da5b54ef4a1ea1cee60f02ea2883 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193). New cstate: current_term: 1 leader_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:44.662282 24348 tablet_service.cc:1511] Processing CreateTablet for tablet 93ece38976574ad7a5e93a69c33c074d (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:14:44.692507 24348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93ece38976574ad7a5e93a69c33c074d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:44.720491 24485 raft_consensus.cc:493] T 133e492e820f4152ad30562c343b617d P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.721102 24485 raft_consensus.cc:515] T 133e492e820f4152ad30562c343b617d P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:44.724730 24358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133e492e820f4152ad30562c343b617d" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:44.725939 24485 leader_election.cc:290] T 133e492e820f4152ad30562c343b617d P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:14:44.730784 24358 raft_consensus.cc:2393] T 133e492e820f4152ad30562c343b617d P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cf2d8294ae68482ca4ffa8be051ad054 in current term 1: Already voted for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in this term.
I20260709 12:14:44.732908 24210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133e492e820f4152ad30562c343b617d" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
I20260709 12:14:44.735258 24487 raft_consensus.cc:493] T ab8dff607862460ea0fcd88422c31ac2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.735684 24248 leader_election.cc:304] T 133e492e820f4152ad30562c343b617d P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf2d8294ae68482ca4ffa8be051ad054; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, aa14caefbdaa47b09abf91881635ba96
I20260709 12:14:44.736107 24487 raft_consensus.cc:515] T ab8dff607862460ea0fcd88422c31ac2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:44.737085 24485 raft_consensus.cc:3060] T 133e492e820f4152ad30562c343b617d P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:44.740414 24487 leader_election.cc:290] T ab8dff607862460ea0fcd88422c31ac2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:14:44.741621 24358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab8dff607862460ea0fcd88422c31ac2" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
W20260709 12:14:44.749986 24175 leader_election.cc:343] T ab8dff607862460ea0fcd88422c31ac2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:44.746268 24285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab8dff607862460ea0fcd88422c31ac2" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
W20260709 12:14:44.752892 24176 leader_election.cc:343] T ab8dff607862460ea0fcd88422c31ac2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:44.746984 24485 raft_consensus.cc:2749] T 133e492e820f4152ad30562c343b617d P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:44.753647 24176 leader_election.cc:304] T ab8dff607862460ea0fcd88422c31ac2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883; no voters: aa14caefbdaa47b09abf91881635ba96, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:14:44.756644 24487 raft_consensus.cc:2749] T ab8dff607862460ea0fcd88422c31ac2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:44.757253 24481 tablet_bootstrap.cc:492] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96: No bootstrap required, opened a new log
I20260709 12:14:44.757920 24481 ts_tablet_manager.cc:1403] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96: Time spent bootstrapping tablet: real 0.158s	user 0.021s	sys 0.006s
I20260709 12:14:44.758773 24482 tablet_bootstrap.cc:492] T ba38e800dd034ff8b7fda6701973510b P 9bf3da5b54ef4a1ea1cee60f02ea2883: No bootstrap required, opened a new log
I20260709 12:14:44.759459 24482 ts_tablet_manager.cc:1403] T ba38e800dd034ff8b7fda6701973510b P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.209s	user 0.025s	sys 0.018s
I20260709 12:14:44.761219 24481 raft_consensus.cc:359] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:44.762033 24481 raft_consensus.cc:385] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:44.762353 24481 raft_consensus.cc:740] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Initialized, Role: FOLLOWER
I20260709 12:14:44.763185 24482 raft_consensus.cc:359] T ba38e800dd034ff8b7fda6701973510b P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:44.763450 24481 consensus_queue.cc:260] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:44.764111 24482 raft_consensus.cc:385] T ba38e800dd034ff8b7fda6701973510b P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:44.771050 24478 tablet_bootstrap.cc:654] T 7943c68d21d449dba2d1dca6ddde5820 P cf2d8294ae68482ca4ffa8be051ad054: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:44.770567 24479 raft_consensus.cc:359] T c75afe0e0e00446aa6d220941d288eab P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:44.774333 24479 raft_consensus.cc:385] T c75afe0e0e00446aa6d220941d288eab P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:44.774741 24479 raft_consensus.cc:740] T c75afe0e0e00446aa6d220941d288eab P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad362df39b114ec3a3a419128097b362, State: Initialized, Role: FOLLOWER
I20260709 12:14:44.774964 24481 ts_tablet_manager.cc:1434] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:14:44.776279 24481 tablet_bootstrap.cc:492] T 7943c68d21d449dba2d1dca6ddde5820 P aa14caefbdaa47b09abf91881635ba96: Bootstrap starting.
I20260709 12:14:44.775956 24479 consensus_queue.cc:260] T c75afe0e0e00446aa6d220941d288eab P ad362df39b114ec3a3a419128097b362 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:44.778625 24479 ts_tablet_manager.cc:1434] T c75afe0e0e00446aa6d220941d288eab P ad362df39b114ec3a3a419128097b362: Time spent starting tablet: real 0.139s	user 0.008s	sys 0.002s
I20260709 12:14:44.778497 24490 consensus_queue.cc:1048] T ba38e800dd034ff8b7fda6701973510b P aa14caefbdaa47b09abf91881635ba96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:44.780160 24479 tablet_bootstrap.cc:492] T 477aafe049fa4b1182fb0afe55fe5e55 P ad362df39b114ec3a3a419128097b362: Bootstrap starting.
I20260709 12:14:44.784994 24481 tablet_bootstrap.cc:654] T 7943c68d21d449dba2d1dca6ddde5820 P aa14caefbdaa47b09abf91881635ba96: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:44.784571 24275 tablet_service.cc:1511] Processing CreateTablet for tablet 356b14abd90d418cab44e524aef8154c (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:14:44.788131 24275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 356b14abd90d418cab44e524aef8154c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:44.790043 24344 tablet_service.cc:1511] Processing CreateTablet for tablet 356b14abd90d418cab44e524aef8154c (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:14:44.766113 24482 raft_consensus.cc:740] T ba38e800dd034ff8b7fda6701973510b P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:14:44.791529 24344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 356b14abd90d418cab44e524aef8154c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:44.791739 24487 consensus_queue.cc:1048] T 133e492e820f4152ad30562c343b617d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:44.797926 24482 consensus_queue.cc:260] T ba38e800dd034ff8b7fda6701973510b P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:44.808203 24482 ts_tablet_manager.cc:1434] T ba38e800dd034ff8b7fda6701973510b P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.048s	user 0.003s	sys 0.005s
I20260709 12:14:44.812628 24482 tablet_bootstrap.cc:492] T 95d3180f4ab5472d9de6e220219e7898 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:14:44.820395 24415 tablet_service.cc:1511] Processing CreateTablet for tablet 67c0216443004287861015dd30ae5144 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:14:44.822037 24415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67c0216443004287861015dd30ae5144. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:44.823345 24478 tablet_bootstrap.cc:492] T 7943c68d21d449dba2d1dca6ddde5820 P cf2d8294ae68482ca4ffa8be051ad054: No bootstrap required, opened a new log
I20260709 12:14:44.824071 24478 ts_tablet_manager.cc:1403] T 7943c68d21d449dba2d1dca6ddde5820 P cf2d8294ae68482ca4ffa8be051ad054: Time spent bootstrapping tablet: real 0.195s	user 0.014s	sys 0.006s
I20260709 12:14:44.813560 24479 tablet_bootstrap.cc:654] T 477aafe049fa4b1182fb0afe55fe5e55 P ad362df39b114ec3a3a419128097b362: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:44.833353 24482 tablet_bootstrap.cc:654] T 95d3180f4ab5472d9de6e220219e7898 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:44.834321 24478 raft_consensus.cc:359] T 7943c68d21d449dba2d1dca6ddde5820 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:44.847457 24478 raft_consensus.cc:385] T 7943c68d21d449dba2d1dca6ddde5820 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:44.847906 24478 raft_consensus.cc:740] T 7943c68d21d449dba2d1dca6ddde5820 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Initialized, Role: FOLLOWER
I20260709 12:14:44.848721 24478 consensus_queue.cc:260] T 7943c68d21d449dba2d1dca6ddde5820 P cf2d8294ae68482ca4ffa8be051ad054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:44.839531 24513 consensus_queue.cc:1048] T 133e492e820f4152ad30562c343b617d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:44.849669 24195 tablet_service.cc:1511] Processing CreateTablet for tablet 67c0216443004287861015dd30ae5144 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:14:44.841707 24481 tablet_bootstrap.cc:492] T 7943c68d21d449dba2d1dca6ddde5820 P aa14caefbdaa47b09abf91881635ba96: No bootstrap required, opened a new log
I20260709 12:14:44.850809 24481 ts_tablet_manager.cc:1403] T 7943c68d21d449dba2d1dca6ddde5820 P aa14caefbdaa47b09abf91881635ba96: Time spent bootstrapping tablet: real 0.075s	user 0.013s	sys 0.030s
I20260709 12:14:44.851143 24195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67c0216443004287861015dd30ae5144. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:44.852685 24478 ts_tablet_manager.cc:1434] T 7943c68d21d449dba2d1dca6ddde5820 P cf2d8294ae68482ca4ffa8be051ad054: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 12:14:44.853979 24478 tablet_bootstrap.cc:492] T 0d31cf2c4a7849d9a798bf886e7fc997 P cf2d8294ae68482ca4ffa8be051ad054: Bootstrap starting.
I20260709 12:14:44.858700 24481 raft_consensus.cc:359] T 7943c68d21d449dba2d1dca6ddde5820 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:44.859802 24481 raft_consensus.cc:385] T 7943c68d21d449dba2d1dca6ddde5820 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:44.860512 24481 raft_consensus.cc:740] T 7943c68d21d449dba2d1dca6ddde5820 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Initialized, Role: FOLLOWER
I20260709 12:14:44.862329 24481 consensus_queue.cc:260] T 7943c68d21d449dba2d1dca6ddde5820 P aa14caefbdaa47b09abf91881635ba96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:44.867565 24481 ts_tablet_manager.cc:1434] T 7943c68d21d449dba2d1dca6ddde5820 P aa14caefbdaa47b09abf91881635ba96: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.002s
I20260709 12:14:44.873463 24482 tablet_bootstrap.cc:492] T 95d3180f4ab5472d9de6e220219e7898 P 9bf3da5b54ef4a1ea1cee60f02ea2883: No bootstrap required, opened a new log
I20260709 12:14:44.874202 24482 ts_tablet_manager.cc:1403] T 95d3180f4ab5472d9de6e220219e7898 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.062s	user 0.008s	sys 0.007s
I20260709 12:14:44.874814 24344 tablet_service.cc:1511] Processing CreateTablet for tablet fa882381d669422a95ec60c9aefa8105 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:14:44.878446 24275 tablet_service.cc:1511] Processing CreateTablet for tablet 67c0216443004287861015dd30ae5144 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:14:44.876775 24344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa882381d669422a95ec60c9aefa8105. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:44.880108 24275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67c0216443004287861015dd30ae5144. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:44.868690 24478 tablet_bootstrap.cc:654] T 0d31cf2c4a7849d9a798bf886e7fc997 P cf2d8294ae68482ca4ffa8be051ad054: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:44.882644 24192 tablet_service.cc:1511] Processing CreateTablet for tablet fa882381d669422a95ec60c9aefa8105 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:14:44.884064 24192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa882381d669422a95ec60c9aefa8105. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:44.871873 24479 tablet_bootstrap.cc:492] T 477aafe049fa4b1182fb0afe55fe5e55 P ad362df39b114ec3a3a419128097b362: No bootstrap required, opened a new log
I20260709 12:14:44.884508 24415 tablet_service.cc:1511] Processing CreateTablet for tablet fa882381d669422a95ec60c9aefa8105 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:14:44.887898 24416 tablet_service.cc:1511] Processing CreateTablet for tablet dbace6d282ab498283858033606494ae (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:14:44.888648 24271 tablet_service.cc:1511] Processing CreateTablet for tablet dbace6d282ab498283858033606494ae (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:14:44.891117 24271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbace6d282ab498283858033606494ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:44.888437 24415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa882381d669422a95ec60c9aefa8105. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:44.891670 24348 tablet_service.cc:1511] Processing CreateTablet for tablet dbace6d282ab498283858033606494ae (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:14:44.892731 24416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbace6d282ab498283858033606494ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:44.893049 24348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbace6d282ab498283858033606494ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:44.873471 24481 tablet_bootstrap.cc:492] T 99329004ca1c4c76a3a2dd4567ef15dd P aa14caefbdaa47b09abf91881635ba96: Bootstrap starting.
I20260709 12:14:44.904407 24199 tablet_service.cc:1511] Processing CreateTablet for tablet b98a35cf96ba4562b4933543b1e4efb9 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:14:44.905970 24199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b98a35cf96ba4562b4933543b1e4efb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:44.887868 24479 ts_tablet_manager.cc:1403] T 477aafe049fa4b1182fb0afe55fe5e55 P ad362df39b114ec3a3a419128097b362: Time spent bootstrapping tablet: real 0.108s	user 0.013s	sys 0.002s
I20260709 12:14:44.913057 24479 raft_consensus.cc:359] T 477aafe049fa4b1182fb0afe55fe5e55 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:44.913894 24479 raft_consensus.cc:385] T 477aafe049fa4b1182fb0afe55fe5e55 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:44.914222 24479 raft_consensus.cc:740] T 477aafe049fa4b1182fb0afe55fe5e55 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad362df39b114ec3a3a419128097b362, State: Initialized, Role: FOLLOWER
I20260709 12:14:44.914992 24479 consensus_queue.cc:260] T 477aafe049fa4b1182fb0afe55fe5e55 P ad362df39b114ec3a3a419128097b362 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:44.903755 24482 raft_consensus.cc:359] T 95d3180f4ab5472d9de6e220219e7898 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:44.916041 24482 raft_consensus.cc:385] T 95d3180f4ab5472d9de6e220219e7898 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:44.916345 24482 raft_consensus.cc:740] T 95d3180f4ab5472d9de6e220219e7898 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:14:44.917068 24482 consensus_queue.cc:260] T 95d3180f4ab5472d9de6e220219e7898 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:44.919418 24482 ts_tablet_manager.cc:1434] T 95d3180f4ab5472d9de6e220219e7898 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.045s	user 0.004s	sys 0.003s
I20260709 12:14:44.920876 24482 tablet_bootstrap.cc:492] T 7943c68d21d449dba2d1dca6ddde5820 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:14:44.927129 24482 tablet_bootstrap.cc:654] T 7943c68d21d449dba2d1dca6ddde5820 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:44.936803 24273 tablet_service.cc:1511] Processing CreateTablet for tablet b98a35cf96ba4562b4933543b1e4efb9 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:14:44.937889 24481 tablet_bootstrap.cc:654] T 99329004ca1c4c76a3a2dd4567ef15dd P aa14caefbdaa47b09abf91881635ba96: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:44.937566 24346 tablet_service.cc:1511] Processing CreateTablet for tablet b98a35cf96ba4562b4933543b1e4efb9 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:14:44.939105 24346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b98a35cf96ba4562b4933543b1e4efb9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:14:44.942492 24541 log.cc:927] Time spent T 133e492e820f4152ad30562c343b617d P aa14caefbdaa47b09abf91881635ba96: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:14:44.943311 24479 ts_tablet_manager.cc:1434] T 477aafe049fa4b1182fb0afe55fe5e55 P ad362df39b114ec3a3a419128097b362: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 12:14:44.943789 24478 tablet_bootstrap.cc:492] T 0d31cf2c4a7849d9a798bf886e7fc997 P cf2d8294ae68482ca4ffa8be051ad054: No bootstrap required, opened a new log
I20260709 12:14:44.944355 24478 ts_tablet_manager.cc:1403] T 0d31cf2c4a7849d9a798bf886e7fc997 P cf2d8294ae68482ca4ffa8be051ad054: Time spent bootstrapping tablet: real 0.091s	user 0.010s	sys 0.010s
I20260709 12:14:44.944607 24479 tablet_bootstrap.cc:492] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P ad362df39b114ec3a3a419128097b362: Bootstrap starting.
I20260709 12:14:44.948305 24487 raft_consensus.cc:493] T 477aafe049fa4b1182fb0afe55fe5e55 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.948918 24487 raft_consensus.cc:515] T 477aafe049fa4b1182fb0afe55fe5e55 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:44.949479 24478 raft_consensus.cc:359] T 0d31cf2c4a7849d9a798bf886e7fc997 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:44.950397 24478 raft_consensus.cc:385] T 0d31cf2c4a7849d9a798bf886e7fc997 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:44.950733 24478 raft_consensus.cc:740] T 0d31cf2c4a7849d9a798bf886e7fc997 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Initialized, Role: FOLLOWER
I20260709 12:14:44.951246 24487 leader_election.cc:290] T 477aafe049fa4b1182fb0afe55fe5e55 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:14:44.951012 24418 tablet_service.cc:1511] Processing CreateTablet for tablet 06d0284e94354a2686c577372cceb2bc (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:14:44.951635 24478 consensus_queue.cc:260] T 0d31cf2c4a7849d9a798bf886e7fc997 P cf2d8294ae68482ca4ffa8be051ad054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:44.953935 24521 raft_consensus.cc:493] T c75afe0e0e00446aa6d220941d288eab P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.954145 24359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477aafe049fa4b1182fb0afe55fe5e55" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:44.954515 24521 raft_consensus.cc:515] T c75afe0e0e00446aa6d220941d288eab P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:44.954859 24359 raft_consensus.cc:2468] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 0.
I20260709 12:14:44.955420 24432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477aafe049fa4b1182fb0afe55fe5e55" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:44.956434 24432 raft_consensus.cc:2468] T 477aafe049fa4b1182fb0afe55fe5e55 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 0.
I20260709 12:14:44.956734 24521 leader_election.cc:290] T c75afe0e0e00446aa6d220941d288eab P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:14:44.957338 24175 leader_election.cc:304] T 477aafe049fa4b1182fb0afe55fe5e55 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, aa14caefbdaa47b09abf91881635ba96; no voters: 
I20260709 12:14:44.958273 24273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b98a35cf96ba4562b4933543b1e4efb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:44.959586 24285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75afe0e0e00446aa6d220941d288eab" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:44.961234 24210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75afe0e0e00446aa6d220941d288eab" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
I20260709 12:14:44.962323 24487 raft_consensus.cc:2804] T 477aafe049fa4b1182fb0afe55fe5e55 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:44.962824 24487 raft_consensus.cc:493] T 477aafe049fa4b1182fb0afe55fe5e55 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:44.963193 24487 raft_consensus.cc:3060] T 477aafe049fa4b1182fb0afe55fe5e55 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:14:44.963896 24399 leader_election.cc:343] T c75afe0e0e00446aa6d220941d288eab P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:44.954692 24418 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06d0284e94354a2686c577372cceb2bc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:14:44.965410 24396 leader_election.cc:343] T c75afe0e0e00446aa6d220941d288eab P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:44.970057 24396 leader_election.cc:304] T c75afe0e0e00446aa6d220941d288eab P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad362df39b114ec3a3a419128097b362; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:14:44.971625 24513 raft_consensus.cc:493] T ba38e800dd034ff8b7fda6701973510b P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.972299 24513 raft_consensus.cc:515] T ba38e800dd034ff8b7fda6701973510b P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:44.973134 24195 tablet_service.cc:1511] Processing CreateTablet for tablet 06d0284e94354a2686c577372cceb2bc (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:14:44.974797 24513 leader_election.cc:290] T ba38e800dd034ff8b7fda6701973510b P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:14:44.976853 24359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba38e800dd034ff8b7fda6701973510b" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:44.959556 24478 ts_tablet_manager.cc:1434] T 0d31cf2c4a7849d9a798bf886e7fc997 P cf2d8294ae68482ca4ffa8be051ad054: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.003s
I20260709 12:14:44.984385 24482 tablet_bootstrap.cc:492] T 7943c68d21d449dba2d1dca6ddde5820 P 9bf3da5b54ef4a1ea1cee60f02ea2883: No bootstrap required, opened a new log
I20260709 12:14:44.984905 24482 ts_tablet_manager.cc:1403] T 7943c68d21d449dba2d1dca6ddde5820 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.064s	user 0.010s	sys 0.004s
I20260709 12:14:44.974810 24195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06d0284e94354a2686c577372cceb2bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:44.987983 24432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba38e800dd034ff8b7fda6701973510b" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:44.981288 24521 raft_consensus.cc:2749] T c75afe0e0e00446aa6d220941d288eab P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:45.003788 24422 tablet_service.cc:1511] Processing CreateTablet for tablet cf280984dcfc44039a942819e8df951c (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:14:45.004470 24481 tablet_bootstrap.cc:492] T 99329004ca1c4c76a3a2dd4567ef15dd P aa14caefbdaa47b09abf91881635ba96: No bootstrap required, opened a new log
I20260709 12:14:45.004242 24269 tablet_service.cc:1511] Processing CreateTablet for tablet d84ed08271a24f7fa134ae81a858c314 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:14:45.005098 24481 ts_tablet_manager.cc:1403] T 99329004ca1c4c76a3a2dd4567ef15dd P aa14caefbdaa47b09abf91881635ba96: Time spent bootstrapping tablet: real 0.132s	user 0.012s	sys 0.005s
I20260709 12:14:45.005568 24422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf280984dcfc44039a942819e8df951c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:44.993758 24274 tablet_service.cc:1511] Processing CreateTablet for tablet 06d0284e94354a2686c577372cceb2bc (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:14:45.005721 24269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d84ed08271a24f7fa134ae81a858c314. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:45.008224 24192 tablet_service.cc:1511] Processing CreateTablet for tablet cf280984dcfc44039a942819e8df951c (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:14:45.023545 24192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf280984dcfc44039a942819e8df951c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:45.013001 24348 tablet_service.cc:1511] Processing CreateTablet for tablet cf280984dcfc44039a942819e8df951c (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:14:45.025139 24348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf280984dcfc44039a942819e8df951c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:45.024901 24423 tablet_service.cc:1511] Processing CreateTablet for tablet d84ed08271a24f7fa134ae81a858c314 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:14:45.026465 24423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d84ed08271a24f7fa134ae81a858c314. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:45.029251 24274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06d0284e94354a2686c577372cceb2bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:45.029752 24341 tablet_service.cc:1511] Processing CreateTablet for tablet d84ed08271a24f7fa134ae81a858c314 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:14:45.042249 24478 tablet_bootstrap.cc:492] T c75afe0e0e00446aa6d220941d288eab P cf2d8294ae68482ca4ffa8be051ad054: Bootstrap starting.
I20260709 12:14:45.052774 24485 raft_consensus.cc:493] T 0d31cf2c4a7849d9a798bf886e7fc997 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.053408 24485 raft_consensus.cc:515] T 0d31cf2c4a7849d9a798bf886e7fc997 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:45.054230 24482 raft_consensus.cc:359] T 7943c68d21d449dba2d1dca6ddde5820 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:45.055244 24482 raft_consensus.cc:385] T 7943c68d21d449dba2d1dca6ddde5820 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:45.055609 24482 raft_consensus.cc:740] T 7943c68d21d449dba2d1dca6ddde5820 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:14:45.055775 24485 leader_election.cc:290] T 0d31cf2c4a7849d9a798bf886e7fc997 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:14:45.056572 24482 consensus_queue.cc:260] T 7943c68d21d449dba2d1dca6ddde5820 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:45.059340 24432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31cf2c4a7849d9a798bf886e7fc997" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:45.059966 24193 tablet_service.cc:1511] Processing CreateTablet for tablet b1e1c3b597fd49b2831e5f523149b2dc (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:14:45.062170 24481 raft_consensus.cc:359] T 99329004ca1c4c76a3a2dd4567ef15dd P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:45.064154 24481 raft_consensus.cc:385] T 99329004ca1c4c76a3a2dd4567ef15dd P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:45.065935 24481 raft_consensus.cc:740] T 99329004ca1c4c76a3a2dd4567ef15dd P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Initialized, Role: FOLLOWER
I20260709 12:14:45.066036 24193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1e1c3b597fd49b2831e5f523149b2dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:45.047439 24490 raft_consensus.cc:493] T e24b175869274d33ade73761b6f23ca4 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.071587 24490 raft_consensus.cc:515] T e24b175869274d33ade73761b6f23ca4 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:45.074669 24482 ts_tablet_manager.cc:1434] T 7943c68d21d449dba2d1dca6ddde5820 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.089s	user 0.009s	sys 0.000s
I20260709 12:14:45.070292 24481 consensus_queue.cc:260] T 99329004ca1c4c76a3a2dd4567ef15dd P aa14caefbdaa47b09abf91881635ba96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:45.070756 24341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d84ed08271a24f7fa134ae81a858c314. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:45.084553 24482 tablet_bootstrap.cc:492] T c75afe0e0e00446aa6d220941d288eab P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:14:45.090683 24548 raft_consensus.cc:493] T 7943c68d21d449dba2d1dca6ddde5820 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.091280 24548 raft_consensus.cc:515] T 7943c68d21d449dba2d1dca6ddde5820 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:45.092075 24198 tablet_service.cc:1511] Processing CreateTablet for tablet bbab1a4afac94c1eaeb3ed35bc54408a (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:14:45.074117 24174 leader_election.cc:304] T ba38e800dd034ff8b7fda6701973510b P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883; no voters: aa14caefbdaa47b09abf91881635ba96, ad362df39b114ec3a3a419128097b362
W20260709 12:14:45.094372 24174 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46467, user_credentials={real_user=slave}} blocked reactor thread for 48249us
I20260709 12:14:45.094756 24415 tablet_service.cc:1511] Processing CreateTablet for tablet bbab1a4afac94c1eaeb3ed35bc54408a (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:14:45.096117 24415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbab1a4afac94c1eaeb3ed35bc54408a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:45.096432 24198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbab1a4afac94c1eaeb3ed35bc54408a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:45.098912 24345 tablet_service.cc:1511] Processing CreateTablet for tablet b1e1c3b597fd49b2831e5f523149b2dc (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:14:45.099643 24478 tablet_bootstrap.cc:654] T c75afe0e0e00446aa6d220941d288eab P cf2d8294ae68482ca4ffa8be051ad054: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:45.100340 24345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1e1c3b597fd49b2831e5f523149b2dc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:14:45.085884 24249 leader_election.cc:343] T 0d31cf2c4a7849d9a798bf886e7fc997 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:45.118551 24487 raft_consensus.cc:515] T 477aafe049fa4b1182fb0afe55fe5e55 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:45.104341 24548 leader_election.cc:290] T 7943c68d21d449dba2d1dca6ddde5820 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:14:45.130241 24479 tablet_bootstrap.cc:654] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P ad362df39b114ec3a3a419128097b362: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:45.143842 24513 raft_consensus.cc:2749] T ba38e800dd034ff8b7fda6701973510b P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:45.144654 24513 raft_consensus.cc:493] T 95d3180f4ab5472d9de6e220219e7898 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.151014 24513 raft_consensus.cc:515] T 95d3180f4ab5472d9de6e220219e7898 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:45.153530 24358 raft_consensus.cc:3060] T 99329004ca1c4c76a3a2dd4567ef15dd P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:45.174989 24487 leader_election.cc:290] T 477aafe049fa4b1182fb0afe55fe5e55 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 election: Requested vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:14:45.159293 24490 leader_election.cc:290] T e24b175869274d33ade73761b6f23ca4 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:14:45.181699 24348 tablet_service.cc:1511] Processing CreateTablet for tablet d92a635ff6404268bd5e51d3b9681551 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:14:45.183090 24348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d92a635ff6404268bd5e51d3b9681551. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:45.186252 24433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b175869274d33ade73761b6f23ca4" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:45.186993 24433 raft_consensus.cc:2468] T e24b175869274d33ade73761b6f23ca4 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa14caefbdaa47b09abf91881635ba96 in term 0.
I20260709 12:14:45.188623 24323 leader_election.cc:304] T e24b175869274d33ade73761b6f23ca4 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, ad362df39b114ec3a3a419128097b362; no voters: 
I20260709 12:14:45.189620 24548 raft_consensus.cc:2804] T e24b175869274d33ade73761b6f23ca4 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:45.160885 24513 leader_election.cc:290] T 95d3180f4ab5472d9de6e220219e7898 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:14:45.213876 24416 tablet_service.cc:1511] Processing CreateTablet for tablet d92a635ff6404268bd5e51d3b9681551 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:14:45.215865 24416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d92a635ff6404268bd5e51d3b9681551. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:45.219120 24433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d3180f4ab5472d9de6e220219e7898" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:45.200084 24548 raft_consensus.cc:493] T e24b175869274d33ade73761b6f23ca4 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:45.229302 24555 raft_consensus.cc:493] T 7943c68d21d449dba2d1dca6ddde5820 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.227697 24548 raft_consensus.cc:3060] T e24b175869274d33ade73761b6f23ca4 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:45.231400 24555 raft_consensus.cc:515] T 7943c68d21d449dba2d1dca6ddde5820 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:45.232447 24481 ts_tablet_manager.cc:1434] T 99329004ca1c4c76a3a2dd4567ef15dd P aa14caefbdaa47b09abf91881635ba96: Time spent starting tablet: real 0.227s	user 0.009s	sys 0.004s
I20260709 12:14:45.234632 24555 leader_election.cc:290] T 7943c68d21d449dba2d1dca6ddde5820 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:14:45.238986 24482 tablet_bootstrap.cc:654] T c75afe0e0e00446aa6d220941d288eab P 9bf3da5b54ef4a1ea1cee60f02ea2883: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:45.244495 24521 consensus_queue.cc:1048] T 95d3180f4ab5472d9de6e220219e7898 P ad362df39b114ec3a3a419128097b362 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:45.223384 24552 raft_consensus.cc:493] T 7943c68d21d449dba2d1dca6ddde5820 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.248238 24552 raft_consensus.cc:515] T 7943c68d21d449dba2d1dca6ddde5820 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:45.252054 24552 leader_election.cc:290] T 7943c68d21d449dba2d1dca6ddde5820 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:14:45.269292 24210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7943c68d21d449dba2d1dca6ddde5820" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
I20260709 12:14:45.270200 24210 raft_consensus.cc:2468] T 7943c68d21d449dba2d1dca6ddde5820 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa14caefbdaa47b09abf91881635ba96 in term 0.
I20260709 12:14:45.269397 24433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477aafe049fa4b1182fb0afe55fe5e55" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362"
I20260709 12:14:45.271209 24433 raft_consensus.cc:3060] T 477aafe049fa4b1182fb0afe55fe5e55 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:45.273645 24208 raft_consensus.cc:3060] T 95d3180f4ab5472d9de6e220219e7898 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:45.274324 24209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31cf2c4a7849d9a798bf886e7fc997" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
I20260709 12:14:45.275107 24209 raft_consensus.cc:2468] T 0d31cf2c4a7849d9a798bf886e7fc997 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 0.
I20260709 12:14:45.275696 24269 tablet_service.cc:1511] Processing CreateTablet for tablet bbab1a4afac94c1eaeb3ed35bc54408a (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:14:45.276681 24284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95d3180f4ab5472d9de6e220219e7898" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:45.277297 24283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7943c68d21d449dba2d1dca6ddde5820" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:45.282141 24283 raft_consensus.cc:2468] T 7943c68d21d449dba2d1dca6ddde5820 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 0.
I20260709 12:14:45.277992 24271 tablet_service.cc:1511] Processing CreateTablet for tablet 7d67db0aeb6e4afb953c96511f9863d1 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:14:45.282868 24348 tablet_service.cc:1511] Processing CreateTablet for tablet 7d67db0aeb6e4afb953c96511f9863d1 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:14:45.286772 24273 tablet_service.cc:1511] Processing CreateTablet for tablet b1e1c3b597fd49b2831e5f523149b2dc (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:14:45.285095 24548 raft_consensus.cc:515] T e24b175869274d33ade73761b6f23ca4 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:45.292861 24432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b175869274d33ade73761b6f23ca4" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362"
I20260709 12:14:45.293887 24432 raft_consensus.cc:3060] T e24b175869274d33ade73761b6f23ca4 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:45.299361 24210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7943c68d21d449dba2d1dca6ddde5820" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
I20260709 12:14:45.300249 24210 raft_consensus.cc:2468] T 7943c68d21d449dba2d1dca6ddde5820 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 0.
I20260709 12:14:45.300024 24192 tablet_service.cc:1511] Processing CreateTablet for tablet d92a635ff6404268bd5e51d3b9681551 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:14:45.302685 24478 tablet_bootstrap.cc:492] T c75afe0e0e00446aa6d220941d288eab P cf2d8294ae68482ca4ffa8be051ad054: No bootstrap required, opened a new log
I20260709 12:14:45.303009 24556 consensus_queue.cc:1048] T 4b1c850a65b748c093c5c88aa94fed71 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:45.303584 24322 leader_election.cc:304] T 7943c68d21d449dba2d1dca6ddde5820 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, aa14caefbdaa47b09abf91881635ba96; no voters: 
I20260709 12:14:45.301651 24192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d92a635ff6404268bd5e51d3b9681551. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:45.305862 24478 ts_tablet_manager.cc:1403] T c75afe0e0e00446aa6d220941d288eab P cf2d8294ae68482ca4ffa8be051ad054: Time spent bootstrapping tablet: real 0.313s	user 0.022s	sys 0.041s
I20260709 12:14:45.308687 24550 raft_consensus.cc:2804] T 7943c68d21d449dba2d1dca6ddde5820 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:45.309311 24550 raft_consensus.cc:493] T 7943c68d21d449dba2d1dca6ddde5820 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:45.309743 24550 raft_consensus.cc:3060] T 7943c68d21d449dba2d1dca6ddde5820 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:45.278997 24269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbab1a4afac94c1eaeb3ed35bc54408a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:45.317739 24176 leader_election.cc:304] T 95d3180f4ab5472d9de6e220219e7898 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883; no voters: ad362df39b114ec3a3a419128097b362, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:14:45.320151 24176 leader_election.cc:304] T 7943c68d21d449dba2d1dca6ddde5820 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054; no voters: 
I20260709 12:14:45.321344 24555 raft_consensus.cc:2804] T 7943c68d21d449dba2d1dca6ddde5820 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:45.321841 24555 raft_consensus.cc:493] T 7943c68d21d449dba2d1dca6ddde5820 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:45.324944 24555 raft_consensus.cc:3060] T 7943c68d21d449dba2d1dca6ddde5820 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:45.325598 24248 leader_election.cc:304] T 0d31cf2c4a7849d9a798bf886e7fc997 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054; no voters: ad362df39b114ec3a3a419128097b362
I20260709 12:14:45.329694 24552 raft_consensus.cc:2804] T 0d31cf2c4a7849d9a798bf886e7fc997 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:45.339531 24552 raft_consensus.cc:493] T 0d31cf2c4a7849d9a798bf886e7fc997 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:45.339934 24552 raft_consensus.cc:3060] T 0d31cf2c4a7849d9a798bf886e7fc997 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:45.340059 24479 tablet_bootstrap.cc:492] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P ad362df39b114ec3a3a419128097b362: No bootstrap required, opened a new log
I20260709 12:14:45.340929 24479 ts_tablet_manager.cc:1403] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P ad362df39b114ec3a3a419128097b362: Time spent bootstrapping tablet: real 0.397s	user 0.018s	sys 0.005s
I20260709 12:14:45.344574 24479 raft_consensus.cc:359] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:45.338806 24485 consensus_queue.cc:1048] T 99329004ca1c4c76a3a2dd4567ef15dd P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:45.346262 24548 leader_election.cc:290] T e24b175869274d33ade73761b6f23ca4 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 election: Requested vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:14:45.348178 24359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7943c68d21d449dba2d1dca6ddde5820" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:45.348060 24423 tablet_service.cc:1511] Processing CreateTablet for tablet 7d67db0aeb6e4afb953c96511f9863d1 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:14:45.349054 24356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477aafe049fa4b1182fb0afe55fe5e55" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
I20260709 12:14:45.349843 24356 raft_consensus.cc:3060] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:45.350348 24423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d67db0aeb6e4afb953c96511f9863d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:45.350512 24248 leader_election.cc:304] T 7943c68d21d449dba2d1dca6ddde5820 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054; no voters: 
I20260709 12:14:45.353142 24210 raft_consensus.cc:3060] T ba38e800dd034ff8b7fda6701973510b P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:45.348903 24355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7943c68d21d449dba2d1dca6ddde5820" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:45.337062 24432 raft_consensus.cc:2468] T e24b175869274d33ade73761b6f23ca4 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa14caefbdaa47b09abf91881635ba96 in term 1.
I20260709 12:14:45.357968 24485 consensus_queue.cc:1048] T 99329004ca1c4c76a3a2dd4567ef15dd P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:45.359221 24323 leader_election.cc:304] T e24b175869274d33ade73761b6f23ca4 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, ad362df39b114ec3a3a419128097b362; no voters: 
I20260709 12:14:45.359532 24485 raft_consensus.cc:2804] T 7943c68d21d449dba2d1dca6ddde5820 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:45.345503 24479 raft_consensus.cc:385] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:45.349874 24348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d67db0aeb6e4afb953c96511f9863d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:45.359742 24283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7943c68d21d449dba2d1dca6ddde5820" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:45.364558 24271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d67db0aeb6e4afb953c96511f9863d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:45.373534 24284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b175869274d33ade73761b6f23ca4" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:45.345054 24555 raft_consensus.cc:515] T 7943c68d21d449dba2d1dca6ddde5820 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:45.369724 24548 raft_consensus.cc:2804] T e24b175869274d33ade73761b6f23ca4 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:45.383047 24548 raft_consensus.cc:697] T e24b175869274d33ade73761b6f23ca4 P aa14caefbdaa47b09abf91881635ba96 [term 1 LEADER]: Becoming Leader. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Running, Role: LEADER
I20260709 12:14:45.384104 24555 leader_election.cc:290] T 7943c68d21d449dba2d1dca6ddde5820 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 election: Requested vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:14:45.384465 24548 consensus_queue.cc:237] T e24b175869274d33ade73761b6f23ca4 P aa14caefbdaa47b09abf91881635ba96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
W20260709 12:14:45.385262 24325 leader_election.cc:343] T e24b175869274d33ade73761b6f23ca4 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:45.375321 24481 tablet_bootstrap.cc:492] T 4b1c850a65b748c093c5c88aa94fed71 P aa14caefbdaa47b09abf91881635ba96: Bootstrap starting.
I20260709 12:14:45.375191 24282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b175869274d33ade73761b6f23ca4" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054"
W20260709 12:14:45.386742 24175 consensus_peers.cc:597] T 4b1c850a65b748c093c5c88aa94fed71 P 9bf3da5b54ef4a1ea1cee60f02ea2883 -> Peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Couldn't send request to peer aa14caefbdaa47b09abf91881635ba96. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:45.380782 24556 raft_consensus.cc:2749] T 95d3180f4ab5472d9de6e220219e7898 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:45.380659 24478 raft_consensus.cc:359] T c75afe0e0e00446aa6d220941d288eab P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:45.363613 24485 raft_consensus.cc:493] T 7943c68d21d449dba2d1dca6ddde5820 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:45.382120 24155 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:45.390590 24356 raft_consensus.cc:2468] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 1.
W20260709 12:14:45.390504 24325 leader_election.cc:343] T e24b175869274d33ade73761b6f23ca4 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:45.391170 24485 raft_consensus.cc:3060] T 7943c68d21d449dba2d1dca6ddde5820 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:45.391703 24521 consensus_queue.cc:1048] T 95d3180f4ab5472d9de6e220219e7898 P ad362df39b114ec3a3a419128097b362 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:45.391870 24355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7943c68d21d449dba2d1dca6ddde5820" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
I20260709 12:14:45.395713 24478 raft_consensus.cc:385] T c75afe0e0e00446aa6d220941d288eab P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:45.396140 24478 raft_consensus.cc:740] T c75afe0e0e00446aa6d220941d288eab P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Initialized, Role: FOLLOWER
I20260709 12:14:45.385231 24552 raft_consensus.cc:515] T 0d31cf2c4a7849d9a798bf886e7fc997 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:45.397806 24175 leader_election.cc:304] T 477aafe049fa4b1182fb0afe55fe5e55 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, aa14caefbdaa47b09abf91881635ba96; no voters: 
I20260709 12:14:45.397835 24479 raft_consensus.cc:740] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad362df39b114ec3a3a419128097b362, State: Initialized, Role: FOLLOWER
I20260709 12:14:45.400472 24432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31cf2c4a7849d9a798bf886e7fc997" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362"
I20260709 12:14:45.400193 24198 tablet_service.cc:1511] Processing CreateTablet for tablet bfba40ac52f842ca99dd4293619360af (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
W20260709 12:14:45.401944 24249 leader_election.cc:343] T 0d31cf2c4a7849d9a798bf886e7fc997 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:45.402863 24198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfba40ac52f842ca99dd4293619360af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:45.402837 24478 consensus_queue.cc:260] T c75afe0e0e00446aa6d220941d288eab P cf2d8294ae68482ca4ffa8be051ad054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:45.404230 24346 tablet_service.cc:1511] Processing CreateTablet for tablet bfba40ac52f842ca99dd4293619360af (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:14:45.399906 24479 consensus_queue.cc:260] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P ad362df39b114ec3a3a419128097b362 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:45.415414 24346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfba40ac52f842ca99dd4293619360af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:45.407039 24418 tablet_service.cc:1511] Processing CreateTablet for tablet 49b141610080476a8e5f0415c370e8cd (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:14:45.417333 24479 ts_tablet_manager.cc:1434] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P ad362df39b114ec3a3a419128097b362: Time spent starting tablet: real 0.076s	user 0.004s	sys 0.004s
I20260709 12:14:45.418387 24418 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49b141610080476a8e5f0415c370e8cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:45.412983 24481 tablet_bootstrap.cc:654] T 4b1c850a65b748c093c5c88aa94fed71 P aa14caefbdaa47b09abf91881635ba96: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:45.368821 24433 raft_consensus.cc:2468] T 477aafe049fa4b1182fb0afe55fe5e55 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 1.
I20260709 12:14:45.420588 24552 leader_election.cc:290] T 0d31cf2c4a7849d9a798bf886e7fc997 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 election: Requested vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:14:45.434546 24273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1e1c3b597fd49b2831e5f523149b2dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:45.447302 24550 raft_consensus.cc:515] T 7943c68d21d449dba2d1dca6ddde5820 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:45.450306 24359 raft_consensus.cc:2393] T 7943c68d21d449dba2d1dca6ddde5820 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cf2d8294ae68482ca4ffa8be051ad054 in current term 1: Already voted for candidate aa14caefbdaa47b09abf91881635ba96 in this term.
I20260709 12:14:45.429505 24555 raft_consensus.cc:2804] T 477aafe049fa4b1182fb0afe55fe5e55 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:45.450973 24555 raft_consensus.cc:697] T 477aafe049fa4b1182fb0afe55fe5e55 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 LEADER]: Becoming Leader. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Running, Role: LEADER
I20260709 12:14:45.452077 24482 tablet_bootstrap.cc:492] T c75afe0e0e00446aa6d220941d288eab P 9bf3da5b54ef4a1ea1cee60f02ea2883: No bootstrap required, opened a new log
I20260709 12:14:45.456302 24482 ts_tablet_manager.cc:1403] T c75afe0e0e00446aa6d220941d288eab P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.373s	user 0.020s	sys 0.039s
I20260709 12:14:45.422210 24485 raft_consensus.cc:515] T 7943c68d21d449dba2d1dca6ddde5820 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:45.445250 24479 tablet_bootstrap.cc:492] T 0d31cf2c4a7849d9a798bf886e7fc997 P ad362df39b114ec3a3a419128097b362: Bootstrap starting.
W20260709 12:14:45.425313 24248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:38787, user_credentials={real_user=slave}} blocked reactor thread for 74889.7us
I20260709 12:14:45.462232 24274 tablet_service.cc:1511] Processing CreateTablet for tablet bfba40ac52f842ca99dd4293619360af (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:14:45.462549 24275 tablet_service.cc:1511] Processing CreateTablet for tablet 49b141610080476a8e5f0415c370e8cd (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:14:45.463929 24274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfba40ac52f842ca99dd4293619360af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:45.464720 24275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49b141610080476a8e5f0415c370e8cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:45.465291 24207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31cf2c4a7849d9a798bf886e7fc997" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
I20260709 12:14:45.466082 24207 raft_consensus.cc:3060] T 0d31cf2c4a7849d9a798bf886e7fc997 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:45.490015 24478 ts_tablet_manager.cc:1434] T c75afe0e0e00446aa6d220941d288eab P cf2d8294ae68482ca4ffa8be051ad054: Time spent starting tablet: real 0.183s	user 0.010s	sys 0.000s
I20260709 12:14:45.490425 24283 raft_consensus.cc:2393] T 7943c68d21d449dba2d1dca6ddde5820 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aa14caefbdaa47b09abf91881635ba96 in current term 1: Already voted for candidate cf2d8294ae68482ca4ffa8be051ad054 in this term.
I20260709 12:14:45.492075 24355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7943c68d21d449dba2d1dca6ddde5820" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
I20260709 12:14:45.493467 24355 raft_consensus.cc:2393] T 7943c68d21d449dba2d1dca6ddde5820 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cf2d8294ae68482ca4ffa8be051ad054 in current term 1: Already voted for candidate aa14caefbdaa47b09abf91881635ba96 in this term.
I20260709 12:14:45.495030 24284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7943c68d21d449dba2d1dca6ddde5820" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054"
I20260709 12:14:45.494807 24193 tablet_service.cc:1511] Processing CreateTablet for tablet 49b141610080476a8e5f0415c370e8cd (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:14:45.490036 24485 leader_election.cc:290] T 7943c68d21d449dba2d1dca6ddde5820 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 election: Requested vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:14:45.496526 24193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49b141610080476a8e5f0415c370e8cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:45.499027 24348 tablet_service.cc:1511] Processing CreateTablet for tablet 8996365fa46548d49f3b3bafe14e9c83 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:14:45.500844 24348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8996365fa46548d49f3b3bafe14e9c83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:45.522807 24550 leader_election.cc:290] T 7943c68d21d449dba2d1dca6ddde5820 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 election: Requested vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:14:45.527228 24482 raft_consensus.cc:359] T c75afe0e0e00446aa6d220941d288eab P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:45.533463 24482 raft_consensus.cc:385] T c75afe0e0e00446aa6d220941d288eab P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:45.533962 24482 raft_consensus.cc:740] T c75afe0e0e00446aa6d220941d288eab P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:14:45.536384 24482 consensus_queue.cc:260] T c75afe0e0e00446aa6d220941d288eab P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:45.560992 24195 tablet_service.cc:1511] Processing CreateTablet for tablet 8996365fa46548d49f3b3bafe14e9c83 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:14:45.550585 24284 raft_consensus.cc:2393] T 7943c68d21d449dba2d1dca6ddde5820 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in current term 1: Already voted for candidate cf2d8294ae68482ca4ffa8be051ad054 in this term.
I20260709 12:14:45.562521 24195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8996365fa46548d49f3b3bafe14e9c83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:45.562705 24482 ts_tablet_manager.cc:1434] T c75afe0e0e00446aa6d220941d288eab P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.106s	user 0.009s	sys 0.001s
I20260709 12:14:45.575377 24482 tablet_bootstrap.cc:492] T b727e95d8f5843a3bb0d7cbddce61bdb P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:14:45.584600 24283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7943c68d21d449dba2d1dca6ddde5820" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054"
I20260709 12:14:45.585626 24283 raft_consensus.cc:2393] T 7943c68d21d449dba2d1dca6ddde5820 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate aa14caefbdaa47b09abf91881635ba96 in current term 1: Already voted for candidate cf2d8294ae68482ca4ffa8be051ad054 in this term.
I20260709 12:14:45.602864 24345 tablet_service.cc:1511] Processing CreateTablet for tablet 6d6c85f42e284b06b8d1e7cee59f3dbc (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:14:45.604339 24345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d6c85f42e284b06b8d1e7cee59f3dbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:45.605993 24479 tablet_bootstrap.cc:654] T 0d31cf2c4a7849d9a798bf886e7fc997 P ad362df39b114ec3a3a419128097b362: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:45.614229 24206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7943c68d21d449dba2d1dca6ddde5820" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
I20260709 12:14:45.615593 24206 raft_consensus.cc:2393] T 7943c68d21d449dba2d1dca6ddde5820 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate aa14caefbdaa47b09abf91881635ba96 in current term 1: Already voted for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in this term.
I20260709 12:14:45.577836 24478 tablet_bootstrap.cc:492] T e15e9b81515343958a00ba6f2f291860 P cf2d8294ae68482ca4ffa8be051ad054: Bootstrap starting.
I20260709 12:14:45.565594 24555 consensus_queue.cc:237] T 477aafe049fa4b1182fb0afe55fe5e55 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:45.649120 24206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7943c68d21d449dba2d1dca6ddde5820" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
I20260709 12:14:45.648991 24270 tablet_service.cc:1511] Processing CreateTablet for tablet 6d6c85f42e284b06b8d1e7cee59f3dbc (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:14:45.650120 24206 raft_consensus.cc:2393] T 7943c68d21d449dba2d1dca6ddde5820 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cf2d8294ae68482ca4ffa8be051ad054 in current term 1: Already voted for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in this term.
I20260709 12:14:45.650636 24270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d6c85f42e284b06b8d1e7cee59f3dbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:45.654798 24415 tablet_service.cc:1511] Processing CreateTablet for tablet 8996365fa46548d49f3b3bafe14e9c83 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:14:45.656320 24415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8996365fa46548d49f3b3bafe14e9c83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:45.658934 24207 raft_consensus.cc:2468] T 0d31cf2c4a7849d9a798bf886e7fc997 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 1.
I20260709 12:14:45.659598 24322 leader_election.cc:304] T 7943c68d21d449dba2d1dca6ddde5820 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:14:45.666574 24348 tablet_service.cc:1511] Processing CreateTablet for tablet f841b9f0e82748d399b5eef243c442fc (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:14:45.669745 24348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f841b9f0e82748d399b5eef243c442fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:45.673827 24195 tablet_service.cc:1511] Processing CreateTablet for tablet f841b9f0e82748d399b5eef243c442fc (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:14:45.675189 24195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f841b9f0e82748d399b5eef243c442fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:45.683244 24560 raft_consensus.cc:2749] T 7943c68d21d449dba2d1dca6ddde5820 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:14:45.667707 24513 raft_consensus.cc:493] T c75afe0e0e00446aa6d220941d288eab P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.699064 24482 tablet_bootstrap.cc:654] T b727e95d8f5843a3bb0d7cbddce61bdb P 9bf3da5b54ef4a1ea1cee60f02ea2883: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:45.699122 24513 raft_consensus.cc:515] T c75afe0e0e00446aa6d220941d288eab P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:45.704116 24481 tablet_bootstrap.cc:492] T 4b1c850a65b748c093c5c88aa94fed71 P aa14caefbdaa47b09abf91881635ba96: No bootstrap required, opened a new log
I20260709 12:14:45.704691 24481 ts_tablet_manager.cc:1403] T 4b1c850a65b748c093c5c88aa94fed71 P aa14caefbdaa47b09abf91881635ba96: Time spent bootstrapping tablet: real 0.330s	user 0.040s	sys 0.031s
I20260709 12:14:45.706993 24433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75afe0e0e00446aa6d220941d288eab" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:45.707734 24433 raft_consensus.cc:2468] T c75afe0e0e00446aa6d220941d288eab P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 0.
I20260709 12:14:45.708680 24422 tablet_service.cc:1511] Processing CreateTablet for tablet 6d6c85f42e284b06b8d1e7cee59f3dbc (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:14:45.710201 24422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d6c85f42e284b06b8d1e7cee59f3dbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:45.710577 24174 leader_election.cc:304] T c75afe0e0e00446aa6d220941d288eab P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, ad362df39b114ec3a3a419128097b362; no voters: 
I20260709 12:14:45.710645 24248 leader_election.cc:304] T 7943c68d21d449dba2d1dca6ddde5820 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf2d8294ae68482ca4ffa8be051ad054; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, aa14caefbdaa47b09abf91881635ba96
I20260709 12:14:45.706820 24272 tablet_service.cc:1511] Processing CreateTablet for tablet f841b9f0e82748d399b5eef243c442fc (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:14:45.695629 24485 raft_consensus.cc:493] T c75afe0e0e00446aa6d220941d288eab P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.713510 24552 raft_consensus.cc:2749] T 7943c68d21d449dba2d1dca6ddde5820 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:14:45.677879 24176 leader_election.cc:304] T 7943c68d21d449dba2d1dca6ddde5820 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883; no voters: aa14caefbdaa47b09abf91881635ba96, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:14:45.714238 24555 raft_consensus.cc:2804] T c75afe0e0e00446aa6d220941d288eab P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:45.735214 24248 leader_election.cc:304] T 0d31cf2c4a7849d9a798bf886e7fc997 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054; no voters: ad362df39b114ec3a3a419128097b362
I20260709 12:14:45.735860 24555 raft_consensus.cc:493] T c75afe0e0e00446aa6d220941d288eab P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:45.746811 24416 tablet_service.cc:1511] Processing CreateTablet for tablet f9094185a2ad43d0b3a5174b165dab65 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:14:45.747582 24272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f841b9f0e82748d399b5eef243c442fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:45.718607 24485 raft_consensus.cc:515] T c75afe0e0e00446aa6d220941d288eab P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:45.751842 24268 tablet_service.cc:1511] Processing CreateTablet for tablet f9094185a2ad43d0b3a5174b165dab65 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:14:45.752784 24485 leader_election.cc:290] T c75afe0e0e00446aa6d220941d288eab P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:45.738325 24556 raft_consensus.cc:2749] T 7943c68d21d449dba2d1dca6ddde5820 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:14:45.754832 24433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75afe0e0e00446aa6d220941d288eab" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:45.755192 24341 tablet_service.cc:1511] Processing CreateTablet for tablet 2c00f77150f7475c94c4fd29c90805cd (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:14:45.755640 24433 raft_consensus.cc:2468] T c75afe0e0e00446aa6d220941d288eab P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 0.
I20260709 12:14:45.756659 24341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c00f77150f7475c94c4fd29c90805cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:45.757347 24210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75afe0e0e00446aa6d220941d288eab" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
I20260709 12:14:45.759485 24416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9094185a2ad43d0b3a5174b165dab65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:45.759312 24249 leader_election.cc:304] T c75afe0e0e00446aa6d220941d288eab P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad362df39b114ec3a3a419128097b362, cf2d8294ae68482ca4ffa8be051ad054; no voters: 
I20260709 12:14:45.750619 24555 raft_consensus.cc:3060] T c75afe0e0e00446aa6d220941d288eab P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:45.759747 24268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9094185a2ad43d0b3a5174b165dab65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:45.771311 24565 raft_consensus.cc:2804] T c75afe0e0e00446aa6d220941d288eab P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:45.771843 24565 raft_consensus.cc:493] T c75afe0e0e00446aa6d220941d288eab P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:45.772249 24565 raft_consensus.cc:3060] T c75afe0e0e00446aa6d220941d288eab P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:45.748710 24552 raft_consensus.cc:2804] T 0d31cf2c4a7849d9a798bf886e7fc997 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:45.772918 24269 tablet_service.cc:1511] Processing CreateTablet for tablet 0f0c432146014cf099d66c95cde2ea1d (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:14:45.762385 24564 raft_consensus.cc:493] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.774049 24564 raft_consensus.cc:515] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:45.774423 24192 tablet_service.cc:1511] Processing CreateTablet for tablet f9094185a2ad43d0b3a5174b165dab65 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:14:45.763691 24423 tablet_service.cc:1511] Processing CreateTablet for tablet 2c00f77150f7475c94c4fd29c90805cd (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:14:45.739871 24513 leader_election.cc:290] T c75afe0e0e00446aa6d220941d288eab P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:14:45.775897 24192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9094185a2ad43d0b3a5174b165dab65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:45.776847 24423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c00f77150f7475c94c4fd29c90805cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:45.785406 24479 tablet_bootstrap.cc:492] T 0d31cf2c4a7849d9a798bf886e7fc997 P ad362df39b114ec3a3a419128097b362: No bootstrap required, opened a new log
I20260709 12:14:45.786007 24479 ts_tablet_manager.cc:1403] T 0d31cf2c4a7849d9a798bf886e7fc997 P ad362df39b114ec3a3a419128097b362: Time spent bootstrapping tablet: real 0.359s	user 0.026s	sys 0.026s
W20260709 12:14:45.745695 24176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:34565, user_credentials={real_user=slave}} blocked reactor thread for 79844.4us
I20260709 12:14:45.788807 24478 tablet_bootstrap.cc:654] T e15e9b81515343958a00ba6f2f291860 P cf2d8294ae68482ca4ffa8be051ad054: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:45.795246 24285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75afe0e0e00446aa6d220941d288eab" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:45.795821 24344 tablet_service.cc:1511] Processing CreateTablet for tablet 0f0c432146014cf099d66c95cde2ea1d (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:14:45.797329 24344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f0c432146014cf099d66c95cde2ea1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:45.803437 24481 raft_consensus.cc:359] T 4b1c850a65b748c093c5c88aa94fed71 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:45.804308 24481 raft_consensus.cc:385] T 4b1c850a65b748c093c5c88aa94fed71 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:45.804726 24481 raft_consensus.cc:740] T 4b1c850a65b748c093c5c88aa94fed71 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Initialized, Role: FOLLOWER
I20260709 12:14:45.805541 24481 consensus_queue.cc:260] T 4b1c850a65b748c093c5c88aa94fed71 P aa14caefbdaa47b09abf91881635ba96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:45.807036 24564 leader_election.cc:290] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:14:45.807548 24479 raft_consensus.cc:359] T 0d31cf2c4a7849d9a798bf886e7fc997 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:45.808269 24479 raft_consensus.cc:385] T 0d31cf2c4a7849d9a798bf886e7fc997 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:45.808560 24479 raft_consensus.cc:740] T 0d31cf2c4a7849d9a798bf886e7fc997 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad362df39b114ec3a3a419128097b362, State: Initialized, Role: FOLLOWER
I20260709 12:14:45.808776 24284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a17cccc4f4ca79468bb6b4e904ec8" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:45.774444 24269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f0c432146014cf099d66c95cde2ea1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:45.809473 24418 tablet_service.cc:1511] Processing CreateTablet for tablet 0f0c432146014cf099d66c95cde2ea1d (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:14:45.809597 24284 raft_consensus.cc:2468] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 0.
I20260709 12:14:45.815385 24399 leader_election.cc:304] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad362df39b114ec3a3a419128097b362, cf2d8294ae68482ca4ffa8be051ad054; no voters: 
I20260709 12:14:45.816206 24481 ts_tablet_manager.cc:1434] T 4b1c850a65b748c093c5c88aa94fed71 P aa14caefbdaa47b09abf91881635ba96: Time spent starting tablet: real 0.111s	user 0.011s	sys 0.002s
I20260709 12:14:45.816697 24418 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f0c432146014cf099d66c95cde2ea1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:45.817504 24481 tablet_bootstrap.cc:492] T e15e9b81515343958a00ba6f2f291860 P aa14caefbdaa47b09abf91881635ba96: Bootstrap starting.
I20260709 12:14:45.817957 24359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a17cccc4f4ca79468bb6b4e904ec8" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:45.822111 24198 tablet_service.cc:1511] Processing CreateTablet for tablet 558ced611e584b32ab838cceeb7cb410 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:14:45.831884 24198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 558ced611e584b32ab838cceeb7cb410. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:45.818986 24195 tablet_service.cc:1511] Processing CreateTablet for tablet 2c00f77150f7475c94c4fd29c90805cd (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:14:45.824265 24564 raft_consensus.cc:2804] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:45.851270 24564 raft_consensus.cc:493] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:45.809388 24479 consensus_queue.cc:260] T 0d31cf2c4a7849d9a798bf886e7fc997 P ad362df39b114ec3a3a419128097b362 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:45.883690 24195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c00f77150f7475c94c4fd29c90805cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:45.882359 24564 raft_consensus.cc:3060] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:45.890488 24479 ts_tablet_manager.cc:1434] T 0d31cf2c4a7849d9a798bf886e7fc997 P ad362df39b114ec3a3a419128097b362: Time spent starting tablet: real 0.104s	user 0.010s	sys 0.002s
I20260709 12:14:45.893069 24479 tablet_bootstrap.cc:492] T b727e95d8f5843a3bb0d7cbddce61bdb P ad362df39b114ec3a3a419128097b362: Bootstrap starting.
W20260709 12:14:45.879226 24398 leader_election.cc:343] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:45.900290 24398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:46845, user_credentials={real_user=slave}} blocked reactor thread for 66213.2us
I20260709 12:14:45.900525 24565 raft_consensus.cc:515] T c75afe0e0e00446aa6d220941d288eab P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:45.907265 24560 consensus_queue.cc:1048] T e24b175869274d33ade73761b6f23ca4 P aa14caefbdaa47b09abf91881635ba96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:45.919747 24482 tablet_bootstrap.cc:492] T b727e95d8f5843a3bb0d7cbddce61bdb P 9bf3da5b54ef4a1ea1cee60f02ea2883: No bootstrap required, opened a new log
I20260709 12:14:45.920341 24482 ts_tablet_manager.cc:1403] T b727e95d8f5843a3bb0d7cbddce61bdb P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.353s	user 0.018s	sys 0.005s
I20260709 12:14:45.886597 24555 raft_consensus.cc:515] T c75afe0e0e00446aa6d220941d288eab P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:45.921757 24285 raft_consensus.cc:2393] T c75afe0e0e00446aa6d220941d288eab P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in current term 1: Already voted for candidate cf2d8294ae68482ca4ffa8be051ad054 in this term.
I20260709 12:14:45.945326 24210 raft_consensus.cc:2393] T c75afe0e0e00446aa6d220941d288eab P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cf2d8294ae68482ca4ffa8be051ad054 in current term 1: Already voted for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in this term.
I20260709 12:14:45.951279 24481 tablet_bootstrap.cc:654] T e15e9b81515343958a00ba6f2f291860 P aa14caefbdaa47b09abf91881635ba96: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:45.928279 24209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75afe0e0e00446aa6d220941d288eab" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
I20260709 12:14:45.928848 24565 leader_election.cc:290] T c75afe0e0e00446aa6d220941d288eab P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 election: Requested vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:45.931010 24275 tablet_service.cc:1511] Processing CreateTablet for tablet 558ced611e584b32ab838cceeb7cb410 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:14:45.957449 24209 raft_consensus.cc:2393] T c75afe0e0e00446aa6d220941d288eab P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cf2d8294ae68482ca4ffa8be051ad054 in current term 1: Already voted for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in this term.
I20260709 12:14:45.958050 24275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 558ced611e584b32ab838cceeb7cb410. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:45.934384 24433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75afe0e0e00446aa6d220941d288eab" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362"
I20260709 12:14:45.937108 24107 catalog_manager.cc:5697] T e24b175869274d33ade73761b6f23ca4 P aa14caefbdaa47b09abf91881635ba96 reported cstate change: term changed from 0 to 1, leader changed from <none> to aa14caefbdaa47b09abf91881635ba96 (127.12.56.195). New cstate: current_term: 1 leader_uuid: "aa14caefbdaa47b09abf91881635ba96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:45.962103 24433 raft_consensus.cc:3060] T c75afe0e0e00446aa6d220941d288eab P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:45.963032 24285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75afe0e0e00446aa6d220941d288eab" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054"
I20260709 12:14:45.963867 24285 raft_consensus.cc:2393] T c75afe0e0e00446aa6d220941d288eab P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in current term 1: Already voted for candidate cf2d8294ae68482ca4ffa8be051ad054 in this term.
I20260709 12:14:45.941097 24478 tablet_bootstrap.cc:492] T e15e9b81515343958a00ba6f2f291860 P cf2d8294ae68482ca4ffa8be051ad054: No bootstrap required, opened a new log
I20260709 12:14:45.964635 24478 ts_tablet_manager.cc:1403] T e15e9b81515343958a00ba6f2f291860 P cf2d8294ae68482ca4ffa8be051ad054: Time spent bootstrapping tablet: real 0.408s	user 0.016s	sys 0.007s
I20260709 12:14:45.955902 24555 leader_election.cc:290] T c75afe0e0e00446aa6d220941d288eab P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 election: Requested vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:14:45.924072 24482 raft_consensus.cc:359] T b727e95d8f5843a3bb0d7cbddce61bdb P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:45.966477 24482 raft_consensus.cc:385] T b727e95d8f5843a3bb0d7cbddce61bdb P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:45.966909 24482 raft_consensus.cc:740] T b727e95d8f5843a3bb0d7cbddce61bdb P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:14:45.967918 24482 consensus_queue.cc:260] T b727e95d8f5843a3bb0d7cbddce61bdb P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:45.970660 24482 ts_tablet_manager.cc:1434] T b727e95d8f5843a3bb0d7cbddce61bdb P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.001s
I20260709 12:14:45.971683 24482 tablet_bootstrap.cc:492] T a18e73ef976b49f0878423c0b3e6e6f2 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:14:45.893626 24552 raft_consensus.cc:697] T 0d31cf2c4a7849d9a798bf886e7fc997 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Becoming Leader. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Running, Role: LEADER
I20260709 12:14:45.953382 24432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75afe0e0e00446aa6d220941d288eab" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362"
I20260709 12:14:45.973785 24348 tablet_service.cc:1511] Processing CreateTablet for tablet 558ced611e584b32ab838cceeb7cb410 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:14:45.976020 24348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 558ced611e584b32ab838cceeb7cb410. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:45.977672 24478 raft_consensus.cc:359] T e15e9b81515343958a00ba6f2f291860 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:45.978500 24478 raft_consensus.cc:385] T e15e9b81515343958a00ba6f2f291860 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:45.978791 24478 raft_consensus.cc:740] T e15e9b81515343958a00ba6f2f291860 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Initialized, Role: FOLLOWER
I20260709 12:14:45.979524 24478 consensus_queue.cc:260] T e15e9b81515343958a00ba6f2f291860 P cf2d8294ae68482ca4ffa8be051ad054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:45.982703 24552 consensus_queue.cc:237] T 0d31cf2c4a7849d9a798bf886e7fc997 P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:45.987790 24174 leader_election.cc:304] T c75afe0e0e00446aa6d220941d288eab P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883; no voters: ad362df39b114ec3a3a419128097b362, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:14:45.989178 24555 raft_consensus.cc:2749] T c75afe0e0e00446aa6d220941d288eab P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:14:45.981621 24478 ts_tablet_manager.cc:1434] T e15e9b81515343958a00ba6f2f291860 P cf2d8294ae68482ca4ffa8be051ad054: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.000s
I20260709 12:14:46.004928 24478 tablet_bootstrap.cc:492] T a18e73ef976b49f0878423c0b3e6e6f2 P cf2d8294ae68482ca4ffa8be051ad054: Bootstrap starting.
I20260709 12:14:46.024442 24481 tablet_bootstrap.cc:492] T e15e9b81515343958a00ba6f2f291860 P aa14caefbdaa47b09abf91881635ba96: No bootstrap required, opened a new log
I20260709 12:14:46.025068 24481 ts_tablet_manager.cc:1403] T e15e9b81515343958a00ba6f2f291860 P aa14caefbdaa47b09abf91881635ba96: Time spent bootstrapping tablet: real 0.208s	user 0.016s	sys 0.010s
I20260709 12:14:46.029623 24482 tablet_bootstrap.cc:654] T a18e73ef976b49f0878423c0b3e6e6f2 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:46.018049 24433 raft_consensus.cc:2468] T c75afe0e0e00446aa6d220941d288eab P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 1.
I20260709 12:14:46.046003 24565 raft_consensus.cc:493] T e15e9b81515343958a00ba6f2f291860 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:46.049221 24481 raft_consensus.cc:359] T e15e9b81515343958a00ba6f2f291860 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:46.050405 24481 raft_consensus.cc:385] T e15e9b81515343958a00ba6f2f291860 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:46.049939 24565 raft_consensus.cc:515] T e15e9b81515343958a00ba6f2f291860 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:46.053395 24249 leader_election.cc:304] T c75afe0e0e00446aa6d220941d288eab P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad362df39b114ec3a3a419128097b362, cf2d8294ae68482ca4ffa8be051ad054; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883
W20260709 12:14:46.057591 24325 consensus_peers.cc:597] T e24b175869274d33ade73761b6f23ca4 P aa14caefbdaa47b09abf91881635ba96 -> Peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Couldn't send request to peer cf2d8294ae68482ca4ffa8be051ad054. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:46.059661 24479 tablet_bootstrap.cc:654] T b727e95d8f5843a3bb0d7cbddce61bdb P ad362df39b114ec3a3a419128097b362: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:46.065688 24565 leader_election.cc:290] T e15e9b81515343958a00ba6f2f291860 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:14:46.066429 24565 raft_consensus.cc:2804] T c75afe0e0e00446aa6d220941d288eab P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:46.061249 24422 tablet_service.cc:1511] Processing CreateTablet for tablet 7d2a60078de84a53aedeb20cdcd211a4 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:14:46.066907 24478 tablet_bootstrap.cc:654] T a18e73ef976b49f0878423c0b3e6e6f2 P cf2d8294ae68482ca4ffa8be051ad054: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:46.066587 24358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e15e9b81515343958a00ba6f2f291860" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:46.064006 24564 raft_consensus.cc:515] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:46.072474 24192 tablet_service.cc:1511] Processing CreateTablet for tablet 7d2a60078de84a53aedeb20cdcd211a4 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:14:46.074028 24192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d2a60078de84a53aedeb20cdcd211a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:46.077394 24269 tablet_service.cc:1511] Processing CreateTablet for tablet 7d2a60078de84a53aedeb20cdcd211a4 (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:14:46.078555 24285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a17cccc4f4ca79468bb6b4e904ec8" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054"
I20260709 12:14:46.079269 24285 raft_consensus.cc:3060] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:46.083674 24344 tablet_service.cc:1511] Processing CreateTablet for tablet 9219abaaa2c34b08a24191512ff742bc (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:14:46.085323 24344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9219abaaa2c34b08a24191512ff742bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:46.086357 24269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d2a60078de84a53aedeb20cdcd211a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:46.086567 24418 tablet_service.cc:1511] Processing CreateTablet for tablet 9219abaaa2c34b08a24191512ff742bc (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:14:46.091159 24285 raft_consensus.cc:2468] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 1.
I20260709 12:14:46.092602 24399 leader_election.cc:304] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad362df39b114ec3a3a419128097b362, cf2d8294ae68482ca4ffa8be051ad054; no voters: 
I20260709 12:14:46.093564 24563 raft_consensus.cc:2804] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:46.094147 24563 raft_consensus.cc:697] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P ad362df39b114ec3a3a419128097b362 [term 1 LEADER]: Becoming Leader. State: Replica: ad362df39b114ec3a3a419128097b362, State: Running, Role: LEADER
I20260709 12:14:46.095077 24563 consensus_queue.cc:237] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P ad362df39b114ec3a3a419128097b362 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:46.068367 24422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d2a60078de84a53aedeb20cdcd211a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:46.095956 24564 leader_election.cc:290] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 election: Requested vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:14:46.097607 24418 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9219abaaa2c34b08a24191512ff742bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:46.071106 24565 raft_consensus.cc:697] T c75afe0e0e00446aa6d220941d288eab P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Becoming Leader. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Running, Role: LEADER
I20260709 12:14:46.095400 24359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a17cccc4f4ca79468bb6b4e904ec8" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
I20260709 12:14:46.098610 24565 consensus_queue.cc:237] T c75afe0e0e00446aa6d220941d288eab P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:46.100594 24548 raft_consensus.cc:493] T 4b1c850a65b748c093c5c88aa94fed71 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:46.101156 24548 raft_consensus.cc:515] T 4b1c850a65b748c093c5c88aa94fed71 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:46.069597 24432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e15e9b81515343958a00ba6f2f291860" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
W20260709 12:14:46.099298 24398 leader_election.cc:343] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:46.103384 24548 leader_election.cc:290] T 4b1c850a65b748c093c5c88aa94fed71 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
W20260709 12:14:46.103806 24249 leader_election.cc:343] T e15e9b81515343958a00ba6f2f291860 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:46.105249 24209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b1c850a65b748c093c5c88aa94fed71" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
I20260709 12:14:46.108490 24432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b1c850a65b748c093c5c88aa94fed71" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:46.110394 24323 leader_election.cc:304] T 4b1c850a65b748c093c5c88aa94fed71 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, ad362df39b114ec3a3a419128097b362
I20260709 12:14:46.111686 24548 raft_consensus.cc:2749] T 4b1c850a65b748c093c5c88aa94fed71 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:46.116469 24555 raft_consensus.cc:493] T b727e95d8f5843a3bb0d7cbddce61bdb P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:46.116940 24555 raft_consensus.cc:515] T b727e95d8f5843a3bb0d7cbddce61bdb P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:46.116914 24198 tablet_service.cc:1511] Processing CreateTablet for tablet 9219abaaa2c34b08a24191512ff742bc (DEFAULT_TABLE table=test-workload [id=70db4dd4dd084273b8afd2e2f744e77b]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:14:46.118402 24198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9219abaaa2c34b08a24191512ff742bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:46.067801 24481 raft_consensus.cc:740] T e15e9b81515343958a00ba6f2f291860 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Initialized, Role: FOLLOWER
I20260709 12:14:46.120543 24432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727e95d8f5843a3bb0d7cbddce61bdb" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:46.121310 24285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727e95d8f5843a3bb0d7cbddce61bdb" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:46.123212 24555 leader_election.cc:290] T b727e95d8f5843a3bb0d7cbddce61bdb P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
W20260709 12:14:46.123751 24176 leader_election.cc:343] T b727e95d8f5843a3bb0d7cbddce61bdb P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:46.124073 24479 tablet_bootstrap.cc:492] T b727e95d8f5843a3bb0d7cbddce61bdb P ad362df39b114ec3a3a419128097b362: No bootstrap required, opened a new log
W20260709 12:14:46.124409 24174 leader_election.cc:343] T b727e95d8f5843a3bb0d7cbddce61bdb P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:46.124591 24479 ts_tablet_manager.cc:1403] T b727e95d8f5843a3bb0d7cbddce61bdb P ad362df39b114ec3a3a419128097b362: Time spent bootstrapping tablet: real 0.232s	user 0.014s	sys 0.000s
I20260709 12:14:46.124867 24174 leader_election.cc:304] T b727e95d8f5843a3bb0d7cbddce61bdb P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883; no voters: ad362df39b114ec3a3a419128097b362, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:14:46.126456 24556 raft_consensus.cc:2749] T b727e95d8f5843a3bb0d7cbddce61bdb P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:46.126672 24555 consensus_queue.cc:1048] T 477aafe049fa4b1182fb0afe55fe5e55 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:46.127705 24479 raft_consensus.cc:359] T b727e95d8f5843a3bb0d7cbddce61bdb P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:46.127702 24481 consensus_queue.cc:260] T e15e9b81515343958a00ba6f2f291860 P aa14caefbdaa47b09abf91881635ba96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:46.128681 24479 raft_consensus.cc:385] T b727e95d8f5843a3bb0d7cbddce61bdb P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:46.128988 24358 raft_consensus.cc:2468] T e15e9b81515343958a00ba6f2f291860 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 0.
I20260709 12:14:46.131269 24250 leader_election.cc:304] T e15e9b81515343958a00ba6f2f291860 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, cf2d8294ae68482ca4ffa8be051ad054; no voters: ad362df39b114ec3a3a419128097b362
I20260709 12:14:46.131781 24478 tablet_bootstrap.cc:492] T a18e73ef976b49f0878423c0b3e6e6f2 P cf2d8294ae68482ca4ffa8be051ad054: No bootstrap required, opened a new log
I20260709 12:14:46.132189 24565 raft_consensus.cc:2804] T e15e9b81515343958a00ba6f2f291860 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:46.132344 24478 ts_tablet_manager.cc:1403] T a18e73ef976b49f0878423c0b3e6e6f2 P cf2d8294ae68482ca4ffa8be051ad054: Time spent bootstrapping tablet: real 0.128s	user 0.005s	sys 0.010s
I20260709 12:14:46.132759 24565 raft_consensus.cc:493] T e15e9b81515343958a00ba6f2f291860 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:46.133205 24565 raft_consensus.cc:3060] T e15e9b81515343958a00ba6f2f291860 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:46.129038 24479 raft_consensus.cc:740] T b727e95d8f5843a3bb0d7cbddce61bdb P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad362df39b114ec3a3a419128097b362, State: Initialized, Role: FOLLOWER
I20260709 12:14:46.136023 24479 consensus_queue.cc:260] T b727e95d8f5843a3bb0d7cbddce61bdb P ad362df39b114ec3a3a419128097b362 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:46.136986 24478 raft_consensus.cc:359] T a18e73ef976b49f0878423c0b3e6e6f2 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:46.132376 24482 tablet_bootstrap.cc:492] T a18e73ef976b49f0878423c0b3e6e6f2 P 9bf3da5b54ef4a1ea1cee60f02ea2883: No bootstrap required, opened a new log
I20260709 12:14:46.139817 24478 raft_consensus.cc:385] T a18e73ef976b49f0878423c0b3e6e6f2 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:46.140411 24482 ts_tablet_manager.cc:1403] T a18e73ef976b49f0878423c0b3e6e6f2 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.169s	user 0.018s	sys 0.003s
I20260709 12:14:46.140468 24478 raft_consensus.cc:740] T a18e73ef976b49f0878423c0b3e6e6f2 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Initialized, Role: FOLLOWER
I20260709 12:14:46.141816 24478 consensus_queue.cc:260] T a18e73ef976b49f0878423c0b3e6e6f2 P cf2d8294ae68482ca4ffa8be051ad054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:46.144855 24478 ts_tablet_manager.cc:1434] T a18e73ef976b49f0878423c0b3e6e6f2 P cf2d8294ae68482ca4ffa8be051ad054: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:14:46.145648 24482 raft_consensus.cc:359] T a18e73ef976b49f0878423c0b3e6e6f2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:46.149745 24482 raft_consensus.cc:385] T a18e73ef976b49f0878423c0b3e6e6f2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:46.150283 24482 raft_consensus.cc:740] T a18e73ef976b49f0878423c0b3e6e6f2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:14:46.146518 24479 ts_tablet_manager.cc:1434] T b727e95d8f5843a3bb0d7cbddce61bdb P ad362df39b114ec3a3a419128097b362: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.002s
I20260709 12:14:46.152436 24479 tablet_bootstrap.cc:492] T 9c40e590be9d4c3eac0ddd7f96278894 P ad362df39b114ec3a3a419128097b362: Bootstrap starting.
I20260709 12:14:46.154065 24482 consensus_queue.cc:260] T a18e73ef976b49f0878423c0b3e6e6f2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:46.147578 24481 ts_tablet_manager.cc:1434] T e15e9b81515343958a00ba6f2f291860 P aa14caefbdaa47b09abf91881635ba96: Time spent starting tablet: real 0.122s	user 0.008s	sys 0.003s
I20260709 12:14:46.156670 24481 tablet_bootstrap.cc:492] T 9c40e590be9d4c3eac0ddd7f96278894 P aa14caefbdaa47b09abf91881635ba96: Bootstrap starting.
I20260709 12:14:46.151038 24478 tablet_bootstrap.cc:492] T e24b175869274d33ade73761b6f23ca4 P cf2d8294ae68482ca4ffa8be051ad054: Bootstrap starting.
I20260709 12:14:46.166147 24478 tablet_bootstrap.cc:654] T e24b175869274d33ade73761b6f23ca4 P cf2d8294ae68482ca4ffa8be051ad054: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:46.169206 24555 consensus_queue.cc:1048] T 477aafe049fa4b1182fb0afe55fe5e55 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:46.171026 24481 tablet_bootstrap.cc:654] T 9c40e590be9d4c3eac0ddd7f96278894 P aa14caefbdaa47b09abf91881635ba96: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:46.172652 24482 ts_tablet_manager.cc:1434] T a18e73ef976b49f0878423c0b3e6e6f2 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.031s	user 0.009s	sys 0.001s
I20260709 12:14:46.173959 24482 tablet_bootstrap.cc:492] T e05eec364f764114bdb814096b9bf0ce P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:14:46.179306 24478 tablet_bootstrap.cc:492] T e24b175869274d33ade73761b6f23ca4 P cf2d8294ae68482ca4ffa8be051ad054: No bootstrap required, opened a new log
I20260709 12:14:46.179912 24478 ts_tablet_manager.cc:1403] T e24b175869274d33ade73761b6f23ca4 P cf2d8294ae68482ca4ffa8be051ad054: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.007s
I20260709 12:14:46.181262 24479 tablet_bootstrap.cc:654] T 9c40e590be9d4c3eac0ddd7f96278894 P ad362df39b114ec3a3a419128097b362: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:46.181658 24481 tablet_bootstrap.cc:492] T 9c40e590be9d4c3eac0ddd7f96278894 P aa14caefbdaa47b09abf91881635ba96: No bootstrap required, opened a new log
I20260709 12:14:46.182224 24481 ts_tablet_manager.cc:1403] T 9c40e590be9d4c3eac0ddd7f96278894 P aa14caefbdaa47b09abf91881635ba96: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.007s
I20260709 12:14:46.183060 24478 raft_consensus.cc:359] T e24b175869274d33ade73761b6f23ca4 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:46.183212 24565 raft_consensus.cc:515] T e15e9b81515343958a00ba6f2f291860 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:46.183852 24478 raft_consensus.cc:385] T e24b175869274d33ade73761b6f23ca4 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:46.184202 24478 raft_consensus.cc:740] T e24b175869274d33ade73761b6f23ca4 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Initialized, Role: FOLLOWER
I20260709 12:14:46.184916 24478 consensus_queue.cc:260] T e24b175869274d33ade73761b6f23ca4 P cf2d8294ae68482ca4ffa8be051ad054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:46.185118 24481 raft_consensus.cc:359] T 9c40e590be9d4c3eac0ddd7f96278894 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:46.185796 24481 raft_consensus.cc:385] T 9c40e590be9d4c3eac0ddd7f96278894 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:46.186093 24481 raft_consensus.cc:740] T 9c40e590be9d4c3eac0ddd7f96278894 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Initialized, Role: FOLLOWER
I20260709 12:14:46.187000 24481 consensus_queue.cc:260] T 9c40e590be9d4c3eac0ddd7f96278894 P aa14caefbdaa47b09abf91881635ba96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:46.187471 24478 ts_tablet_manager.cc:1434] T e24b175869274d33ade73761b6f23ca4 P cf2d8294ae68482ca4ffa8be051ad054: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:14:46.187383 24359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e15e9b81515343958a00ba6f2f291860" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
I20260709 12:14:46.188210 24359 raft_consensus.cc:3060] T e15e9b81515343958a00ba6f2f291860 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:46.188633 24478 tablet_bootstrap.cc:492] T b727e95d8f5843a3bb0d7cbddce61bdb P cf2d8294ae68482ca4ffa8be051ad054: Bootstrap starting.
I20260709 12:14:46.189527 24481 ts_tablet_manager.cc:1434] T 9c40e590be9d4c3eac0ddd7f96278894 P aa14caefbdaa47b09abf91881635ba96: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:14:46.190321 24432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e15e9b81515343958a00ba6f2f291860" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362"
I20260709 12:14:46.190639 24481 tablet_bootstrap.cc:492] T ab8dff607862460ea0fcd88422c31ac2 P aa14caefbdaa47b09abf91881635ba96: Bootstrap starting.
W20260709 12:14:46.192118 24249 leader_election.cc:343] T e15e9b81515343958a00ba6f2f291860 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:46.195634 24478 tablet_bootstrap.cc:654] T b727e95d8f5843a3bb0d7cbddce61bdb P cf2d8294ae68482ca4ffa8be051ad054: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:46.197705 24481 tablet_bootstrap.cc:654] T ab8dff607862460ea0fcd88422c31ac2 P aa14caefbdaa47b09abf91881635ba96: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:46.201345 24359 raft_consensus.cc:2468] T e15e9b81515343958a00ba6f2f291860 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 1.
I20260709 12:14:46.205902 24565 leader_election.cc:290] T e15e9b81515343958a00ba6f2f291860 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 election: Requested vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:14:46.206830 24250 leader_election.cc:304] T e15e9b81515343958a00ba6f2f291860 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, cf2d8294ae68482ca4ffa8be051ad054; no voters: ad362df39b114ec3a3a419128097b362
I20260709 12:14:46.208647 24552 raft_consensus.cc:2804] T e15e9b81515343958a00ba6f2f291860 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:46.209185 24552 raft_consensus.cc:697] T e15e9b81515343958a00ba6f2f291860 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Becoming Leader. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Running, Role: LEADER
I20260709 12:14:46.210069 24552 consensus_queue.cc:237] T e15e9b81515343958a00ba6f2f291860 P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:46.215139 24105 catalog_manager.cc:5697] T 477aafe049fa4b1182fb0afe55fe5e55 P 9bf3da5b54ef4a1ea1cee60f02ea2883 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193). New cstate: current_term: 1 leader_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:46.205470 24482 tablet_bootstrap.cc:654] T e05eec364f764114bdb814096b9bf0ce P 9bf3da5b54ef4a1ea1cee60f02ea2883: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:46.232178 24479 tablet_bootstrap.cc:492] T 9c40e590be9d4c3eac0ddd7f96278894 P ad362df39b114ec3a3a419128097b362: No bootstrap required, opened a new log
I20260709 12:14:46.232661 24479 ts_tablet_manager.cc:1403] T 9c40e590be9d4c3eac0ddd7f96278894 P ad362df39b114ec3a3a419128097b362: Time spent bootstrapping tablet: real 0.081s	user 0.008s	sys 0.005s
I20260709 12:14:46.235414 24479 raft_consensus.cc:359] T 9c40e590be9d4c3eac0ddd7f96278894 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:46.236116 24479 raft_consensus.cc:385] T 9c40e590be9d4c3eac0ddd7f96278894 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:46.236397 24479 raft_consensus.cc:740] T 9c40e590be9d4c3eac0ddd7f96278894 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad362df39b114ec3a3a419128097b362, State: Initialized, Role: FOLLOWER
I20260709 12:14:46.236814 24482 tablet_bootstrap.cc:492] T e05eec364f764114bdb814096b9bf0ce P 9bf3da5b54ef4a1ea1cee60f02ea2883: No bootstrap required, opened a new log
I20260709 12:14:46.237126 24479 consensus_queue.cc:260] T 9c40e590be9d4c3eac0ddd7f96278894 P ad362df39b114ec3a3a419128097b362 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:46.237706 24482 ts_tablet_manager.cc:1403] T e05eec364f764114bdb814096b9bf0ce P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.064s	user 0.008s	sys 0.004s
I20260709 12:14:46.240131 24479 ts_tablet_manager.cc:1434] T 9c40e590be9d4c3eac0ddd7f96278894 P ad362df39b114ec3a3a419128097b362: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:14:46.240871 24482 raft_consensus.cc:359] T e05eec364f764114bdb814096b9bf0ce P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:46.241325 24479 tablet_bootstrap.cc:492] T e15e9b81515343958a00ba6f2f291860 P ad362df39b114ec3a3a419128097b362: Bootstrap starting.
I20260709 12:14:46.241745 24482 raft_consensus.cc:385] T e05eec364f764114bdb814096b9bf0ce P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:46.242126 24482 raft_consensus.cc:740] T e05eec364f764114bdb814096b9bf0ce P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:14:46.242928 24482 consensus_queue.cc:260] T e05eec364f764114bdb814096b9bf0ce P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:46.245460 24482 ts_tablet_manager.cc:1434] T e05eec364f764114bdb814096b9bf0ce P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 12:14:46.246640 24482 tablet_bootstrap.cc:492] T 6af96d3f7393445f8b7edb30a26a6f65 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:14:46.249053 24479 tablet_bootstrap.cc:654] T e15e9b81515343958a00ba6f2f291860 P ad362df39b114ec3a3a419128097b362: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:46.253646 24482 tablet_bootstrap.cc:654] T 6af96d3f7393445f8b7edb30a26a6f65 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:46.254344 24553 raft_consensus.cc:493] T e05eec364f764114bdb814096b9bf0ce P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:46.252350 24106 catalog_manager.cc:5697] T c75afe0e0e00446aa6d220941d288eab P cf2d8294ae68482ca4ffa8be051ad054 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194). New cstate: current_term: 1 leader_uuid: "cf2d8294ae68482ca4ffa8be051ad054" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:46.254974 24553 raft_consensus.cc:515] T e05eec364f764114bdb814096b9bf0ce P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:46.260627 24432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05eec364f764114bdb814096b9bf0ce" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:46.256498 24106 catalog_manager.cc:5697] T 0d31cf2c4a7849d9a798bf886e7fc997 P cf2d8294ae68482ca4ffa8be051ad054 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194). New cstate: current_term: 1 leader_uuid: "cf2d8294ae68482ca4ffa8be051ad054" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:46.262603 24359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05eec364f764114bdb814096b9bf0ce" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
W20260709 12:14:46.265763 24174 leader_election.cc:343] T e05eec364f764114bdb814096b9bf0ce P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:46.267047 24175 leader_election.cc:343] T e05eec364f764114bdb814096b9bf0ce P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:46.267738 24175 leader_election.cc:304] T e05eec364f764114bdb814096b9bf0ce P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883; no voters: aa14caefbdaa47b09abf91881635ba96, ad362df39b114ec3a3a419128097b362
I20260709 12:14:46.268913 24555 raft_consensus.cc:2749] T e05eec364f764114bdb814096b9bf0ce P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:46.270051 24481 tablet_bootstrap.cc:492] T ab8dff607862460ea0fcd88422c31ac2 P aa14caefbdaa47b09abf91881635ba96: No bootstrap required, opened a new log
I20260709 12:14:46.270107 24553 leader_election.cc:290] T e05eec364f764114bdb814096b9bf0ce P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:14:46.271126 24481 ts_tablet_manager.cc:1403] T ab8dff607862460ea0fcd88422c31ac2 P aa14caefbdaa47b09abf91881635ba96: Time spent bootstrapping tablet: real 0.081s	user 0.007s	sys 0.009s
I20260709 12:14:46.276012 24481 raft_consensus.cc:359] T ab8dff607862460ea0fcd88422c31ac2 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:46.277235 24563 raft_consensus.cc:493] T 0d31cf2c4a7849d9a798bf886e7fc997 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:46.279084 24563 raft_consensus.cc:515] T 0d31cf2c4a7849d9a798bf886e7fc997 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:46.285965 24209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31cf2c4a7849d9a798bf886e7fc997" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
I20260709 12:14:46.286810 24563 leader_election.cc:290] T 0d31cf2c4a7849d9a798bf886e7fc997 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:14:46.287503 24209 raft_consensus.cc:2393] T 0d31cf2c4a7849d9a798bf886e7fc997 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad362df39b114ec3a3a419128097b362 in current term 1: Already voted for candidate cf2d8294ae68482ca4ffa8be051ad054 in this term.
I20260709 12:14:46.277259 24481 raft_consensus.cc:385] T ab8dff607862460ea0fcd88422c31ac2 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:46.288249 24481 raft_consensus.cc:740] T ab8dff607862460ea0fcd88422c31ac2 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Initialized, Role: FOLLOWER
I20260709 12:14:46.289171 24481 consensus_queue.cc:260] T ab8dff607862460ea0fcd88422c31ac2 P aa14caefbdaa47b09abf91881635ba96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:46.291710 24481 ts_tablet_manager.cc:1434] T ab8dff607862460ea0fcd88422c31ac2 P aa14caefbdaa47b09abf91881635ba96: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:14:46.291568 24285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31cf2c4a7849d9a798bf886e7fc997" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:46.292879 24481 tablet_bootstrap.cc:492] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P aa14caefbdaa47b09abf91881635ba96: Bootstrap starting.
I20260709 12:14:46.293727 24399 leader_election.cc:304] T 0d31cf2c4a7849d9a798bf886e7fc997 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad362df39b114ec3a3a419128097b362; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:14:46.295038 24104 catalog_manager.cc:5697] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P ad362df39b114ec3a3a419128097b362 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad362df39b114ec3a3a419128097b362 (127.12.56.196). New cstate: current_term: 1 leader_uuid: "ad362df39b114ec3a3a419128097b362" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:46.297324 24585 raft_consensus.cc:3060] T 0d31cf2c4a7849d9a798bf886e7fc997 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:46.302387 24563 raft_consensus.cc:493] T b727e95d8f5843a3bb0d7cbddce61bdb P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:46.303244 24563 raft_consensus.cc:515] T b727e95d8f5843a3bb0d7cbddce61bdb P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:46.305817 24478 tablet_bootstrap.cc:492] T b727e95d8f5843a3bb0d7cbddce61bdb P cf2d8294ae68482ca4ffa8be051ad054: No bootstrap required, opened a new log
I20260709 12:14:46.307910 24479 tablet_bootstrap.cc:492] T e15e9b81515343958a00ba6f2f291860 P ad362df39b114ec3a3a419128097b362: No bootstrap required, opened a new log
I20260709 12:14:46.308171 24481 tablet_bootstrap.cc:654] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P aa14caefbdaa47b09abf91881635ba96: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:46.318173 24479 ts_tablet_manager.cc:1403] T e15e9b81515343958a00ba6f2f291860 P ad362df39b114ec3a3a419128097b362: Time spent bootstrapping tablet: real 0.077s	user 0.015s	sys 0.008s
I20260709 12:14:46.318011 24209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727e95d8f5843a3bb0d7cbddce61bdb" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
I20260709 12:14:46.318837 24209 raft_consensus.cc:2468] T b727e95d8f5843a3bb0d7cbddce61bdb P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 0.
I20260709 12:14:46.320363 24396 leader_election.cc:304] T b727e95d8f5843a3bb0d7cbddce61bdb P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, ad362df39b114ec3a3a419128097b362; no voters: 
I20260709 12:14:46.309536 24482 tablet_bootstrap.cc:492] T 6af96d3f7393445f8b7edb30a26a6f65 P 9bf3da5b54ef4a1ea1cee60f02ea2883: No bootstrap required, opened a new log
I20260709 12:14:46.322292 24564 raft_consensus.cc:2804] T b727e95d8f5843a3bb0d7cbddce61bdb P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:46.322829 24564 raft_consensus.cc:493] T b727e95d8f5843a3bb0d7cbddce61bdb P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:46.323273 24564 raft_consensus.cc:3060] T b727e95d8f5843a3bb0d7cbddce61bdb P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:46.323997 24479 raft_consensus.cc:359] T e15e9b81515343958a00ba6f2f291860 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:46.324721 24479 raft_consensus.cc:385] T e15e9b81515343958a00ba6f2f291860 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:46.324985 24479 raft_consensus.cc:740] T e15e9b81515343958a00ba6f2f291860 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad362df39b114ec3a3a419128097b362, State: Initialized, Role: FOLLOWER
I20260709 12:14:46.325649 24479 consensus_queue.cc:260] T e15e9b81515343958a00ba6f2f291860 P ad362df39b114ec3a3a419128097b362 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:46.327836 24479 ts_tablet_manager.cc:1434] T e15e9b81515343958a00ba6f2f291860 P ad362df39b114ec3a3a419128097b362: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:14:46.328811 24479 tablet_bootstrap.cc:492] T 6af96d3f7393445f8b7edb30a26a6f65 P ad362df39b114ec3a3a419128097b362: Bootstrap starting.
I20260709 12:14:46.323356 24482 ts_tablet_manager.cc:1403] T 6af96d3f7393445f8b7edb30a26a6f65 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.077s	user 0.035s	sys 0.028s
I20260709 12:14:46.339179 24479 tablet_bootstrap.cc:654] T 6af96d3f7393445f8b7edb30a26a6f65 P ad362df39b114ec3a3a419128097b362: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:46.342733 24482 raft_consensus.cc:359] T 6af96d3f7393445f8b7edb30a26a6f65 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:46.343673 24482 raft_consensus.cc:385] T 6af96d3f7393445f8b7edb30a26a6f65 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:46.343998 24482 raft_consensus.cc:740] T 6af96d3f7393445f8b7edb30a26a6f65 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:14:46.344802 24482 consensus_queue.cc:260] T 6af96d3f7393445f8b7edb30a26a6f65 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:46.346696 24482 ts_tablet_manager.cc:1434] T 6af96d3f7393445f8b7edb30a26a6f65 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 12:14:46.346824 24563 leader_election.cc:290] T b727e95d8f5843a3bb0d7cbddce61bdb P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:14:46.347838 24482 tablet_bootstrap.cc:492] T 27de4156b2e24143a2f301fbefc7cb23 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:14:46.348544 24478 ts_tablet_manager.cc:1403] T b727e95d8f5843a3bb0d7cbddce61bdb P cf2d8294ae68482ca4ffa8be051ad054: Time spent bootstrapping tablet: real 0.160s	user 0.024s	sys 0.047s
I20260709 12:14:46.348655 24285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727e95d8f5843a3bb0d7cbddce61bdb" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:46.364347 24585 raft_consensus.cc:2749] T 0d31cf2c4a7849d9a798bf886e7fc997 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:46.377512 24479 tablet_bootstrap.cc:492] T 6af96d3f7393445f8b7edb30a26a6f65 P ad362df39b114ec3a3a419128097b362: No bootstrap required, opened a new log
I20260709 12:14:46.378227 24479 ts_tablet_manager.cc:1403] T 6af96d3f7393445f8b7edb30a26a6f65 P ad362df39b114ec3a3a419128097b362: Time spent bootstrapping tablet: real 0.050s	user 0.015s	sys 0.000s
I20260709 12:14:46.378999 24478 raft_consensus.cc:359] T b727e95d8f5843a3bb0d7cbddce61bdb P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:46.379314 24481 tablet_bootstrap.cc:492] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P aa14caefbdaa47b09abf91881635ba96: No bootstrap required, opened a new log
I20260709 12:14:46.379781 24478 raft_consensus.cc:385] T b727e95d8f5843a3bb0d7cbddce61bdb P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:14:46.379911 24399 leader_election.cc:343] T b727e95d8f5843a3bb0d7cbddce61bdb P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:46.380091 24481 ts_tablet_manager.cc:1403] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P aa14caefbdaa47b09abf91881635ba96: Time spent bootstrapping tablet: real 0.087s	user 0.028s	sys 0.041s
I20260709 12:14:46.380124 24478 raft_consensus.cc:740] T b727e95d8f5843a3bb0d7cbddce61bdb P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Initialized, Role: FOLLOWER
I20260709 12:14:46.381309 24479 raft_consensus.cc:359] T 6af96d3f7393445f8b7edb30a26a6f65 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:46.382164 24479 raft_consensus.cc:385] T 6af96d3f7393445f8b7edb30a26a6f65 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:46.382447 24478 consensus_queue.cc:260] T b727e95d8f5843a3bb0d7cbddce61bdb P cf2d8294ae68482ca4ffa8be051ad054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:46.383737 24482 tablet_bootstrap.cc:654] T 27de4156b2e24143a2f301fbefc7cb23 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:46.384228 24481 raft_consensus.cc:359] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:46.384748 24478 ts_tablet_manager.cc:1434] T b727e95d8f5843a3bb0d7cbddce61bdb P cf2d8294ae68482ca4ffa8be051ad054: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.001s
I20260709 12:14:46.385138 24481 raft_consensus.cc:385] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:46.385488 24481 raft_consensus.cc:740] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Initialized, Role: FOLLOWER
I20260709 12:14:46.385812 24564 raft_consensus.cc:515] T b727e95d8f5843a3bb0d7cbddce61bdb P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:46.382481 24479 raft_consensus.cc:740] T 6af96d3f7393445f8b7edb30a26a6f65 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad362df39b114ec3a3a419128097b362, State: Initialized, Role: FOLLOWER
I20260709 12:14:46.387766 24479 consensus_queue.cc:260] T 6af96d3f7393445f8b7edb30a26a6f65 P ad362df39b114ec3a3a419128097b362 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:46.386336 24481 consensus_queue.cc:260] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P aa14caefbdaa47b09abf91881635ba96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:46.389205 24209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727e95d8f5843a3bb0d7cbddce61bdb" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
I20260709 12:14:46.389909 24209 raft_consensus.cc:3060] T b727e95d8f5843a3bb0d7cbddce61bdb P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:46.390584 24479 ts_tablet_manager.cc:1434] T 6af96d3f7393445f8b7edb30a26a6f65 P ad362df39b114ec3a3a419128097b362: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:14:46.390589 24481 ts_tablet_manager.cc:1434] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P aa14caefbdaa47b09abf91881635ba96: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 12:14:46.392033 24479 tablet_bootstrap.cc:492] T e05eec364f764114bdb814096b9bf0ce P ad362df39b114ec3a3a419128097b362: Bootstrap starting.
I20260709 12:14:46.392033 24481 tablet_bootstrap.cc:492] T e05eec364f764114bdb814096b9bf0ce P aa14caefbdaa47b09abf91881635ba96: Bootstrap starting.
I20260709 12:14:46.399574 24359 raft_consensus.cc:3060] T 4b1c850a65b748c093c5c88aa94fed71 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:46.400903 24481 tablet_bootstrap.cc:654] T e05eec364f764114bdb814096b9bf0ce P aa14caefbdaa47b09abf91881635ba96: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:46.400252 24107 catalog_manager.cc:5697] T e15e9b81515343958a00ba6f2f291860 P cf2d8294ae68482ca4ffa8be051ad054 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194). New cstate: current_term: 1 leader_uuid: "cf2d8294ae68482ca4ffa8be051ad054" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:46.405632 24478 tablet_bootstrap.cc:492] T ab8dff607862460ea0fcd88422c31ac2 P cf2d8294ae68482ca4ffa8be051ad054: Bootstrap starting.
I20260709 12:14:46.406308 24479 tablet_bootstrap.cc:654] T e05eec364f764114bdb814096b9bf0ce P ad362df39b114ec3a3a419128097b362: Neither blocks nor log segments found. Creating new log.
W20260709 12:14:46.417613 24155 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:46.426257 24553 raft_consensus.cc:493] T ab8dff607862460ea0fcd88422c31ac2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:46.427456 24552 raft_consensus.cc:493] T e24b175869274d33ade73761b6f23ca4 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:46.427174 24553 raft_consensus.cc:515] T ab8dff607862460ea0fcd88422c31ac2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:46.428097 24552 raft_consensus.cc:515] T e24b175869274d33ade73761b6f23ca4 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:46.433152 24358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b175869274d33ade73761b6f23ca4" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:46.433962 24552 leader_election.cc:290] T e24b175869274d33ade73761b6f23ca4 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:14:46.433152 24432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24b175869274d33ade73761b6f23ca4" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:46.436715 24555 raft_consensus.cc:493] T a18e73ef976b49f0878423c0b3e6e6f2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:46.436990 24249 leader_election.cc:304] T e24b175869274d33ade73761b6f23ca4 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf2d8294ae68482ca4ffa8be051ad054; no voters: aa14caefbdaa47b09abf91881635ba96, ad362df39b114ec3a3a419128097b362
I20260709 12:14:46.437374 24555 raft_consensus.cc:515] T a18e73ef976b49f0878423c0b3e6e6f2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:46.438405 24552 raft_consensus.cc:2749] T e24b175869274d33ade73761b6f23ca4 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:46.440160 24555 leader_election.cc:290] T a18e73ef976b49f0878423c0b3e6e6f2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:14:46.449160 24553 leader_election.cc:290] T ab8dff607862460ea0fcd88422c31ac2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:14:46.450614 24284 raft_consensus.cc:3060] T e24b175869274d33ade73761b6f23ca4 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:46.452322 24283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab8dff607862460ea0fcd88422c31ac2" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
W20260709 12:14:46.454259 24176 leader_election.cc:343] T ab8dff607862460ea0fcd88422c31ac2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:46.454324 24285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18e73ef976b49f0878423c0b3e6e6f2" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:46.455475 24285 raft_consensus.cc:2468] T a18e73ef976b49f0878423c0b3e6e6f2 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 0.
I20260709 12:14:46.450804 24548 raft_consensus.cc:493] T 9c40e590be9d4c3eac0ddd7f96278894 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:46.457304 24176 leader_election.cc:304] T a18e73ef976b49f0878423c0b3e6e6f2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054; no voters: 
I20260709 12:14:46.458379 24548 raft_consensus.cc:515] T 9c40e590be9d4c3eac0ddd7f96278894 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:46.459074 24585 raft_consensus.cc:493] T 6af96d3f7393445f8b7edb30a26a6f65 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:46.459484 24356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab8dff607862460ea0fcd88422c31ac2" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:46.459695 24585 raft_consensus.cc:515] T 6af96d3f7393445f8b7edb30a26a6f65 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:46.460250 24356 raft_consensus.cc:2468] T ab8dff607862460ea0fcd88422c31ac2 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 0.
I20260709 12:14:46.462572 24175 leader_election.cc:304] T ab8dff607862460ea0fcd88422c31ac2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, aa14caefbdaa47b09abf91881635ba96; no voters: cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:14:46.463039 24210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6af96d3f7393445f8b7edb30a26a6f65" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
I20260709 12:14:46.463621 24513 raft_consensus.cc:2804] T a18e73ef976b49f0878423c0b3e6e6f2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:46.463797 24210 raft_consensus.cc:2468] T 6af96d3f7393445f8b7edb30a26a6f65 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 0.
I20260709 12:14:46.464109 24513 raft_consensus.cc:493] T a18e73ef976b49f0878423c0b3e6e6f2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:46.464622 24513 raft_consensus.cc:3060] T a18e73ef976b49f0878423c0b3e6e6f2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:46.464932 24585 leader_election.cc:290] T 6af96d3f7393445f8b7edb30a26a6f65 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:14:46.465111 24283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c40e590be9d4c3eac0ddd7f96278894" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:46.465520 24548 leader_election.cc:290] T 9c40e590be9d4c3eac0ddd7f96278894 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:14:46.461537 24358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18e73ef976b49f0878423c0b3e6e6f2" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:46.466650 24285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6af96d3f7393445f8b7edb30a26a6f65" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:46.467796 24432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c40e590be9d4c3eac0ddd7f96278894" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:46.468128 24585 raft_consensus.cc:493] T e15e9b81515343958a00ba6f2f291860 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:46.468081 24396 leader_election.cc:304] T 6af96d3f7393445f8b7edb30a26a6f65 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, ad362df39b114ec3a3a419128097b362; no voters: 
I20260709 12:14:46.468981 24585 raft_consensus.cc:515] T e15e9b81515343958a00ba6f2f291860 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
W20260709 12:14:46.470013 24399 leader_election.cc:343] T 6af96d3f7393445f8b7edb30a26a6f65 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:46.470235 24325 leader_election.cc:343] T 9c40e590be9d4c3eac0ddd7f96278894 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:46.475760 24478 tablet_bootstrap.cc:654] T ab8dff607862460ea0fcd88422c31ac2 P cf2d8294ae68482ca4ffa8be051ad054: Neither blocks nor log segments found. Creating new log.
W20260709 12:14:46.468990 24175 leader_election.cc:343] T a18e73ef976b49f0878423c0b3e6e6f2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:46.470587 24563 raft_consensus.cc:2804] T 6af96d3f7393445f8b7edb30a26a6f65 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:46.480957 24563 raft_consensus.cc:493] T 6af96d3f7393445f8b7edb30a26a6f65 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:46.481581 24563 raft_consensus.cc:3060] T 6af96d3f7393445f8b7edb30a26a6f65 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:46.486784 24552 consensus_queue.cc:1048] T 0d31cf2c4a7849d9a798bf886e7fc997 P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:46.476281 24585 leader_election.cc:290] T e15e9b81515343958a00ba6f2f291860 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:14:46.490413 24358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e15e9b81515343958a00ba6f2f291860" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:46.477521 24285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e15e9b81515343958a00ba6f2f291860" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:46.492759 24358 raft_consensus.cc:2393] T e15e9b81515343958a00ba6f2f291860 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad362df39b114ec3a3a419128097b362 in current term 1: Already voted for candidate cf2d8294ae68482ca4ffa8be051ad054 in this term.
I20260709 12:14:46.497740 24209 raft_consensus.cc:2468] T b727e95d8f5843a3bb0d7cbddce61bdb P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 1.
I20260709 12:14:46.523779 24396 leader_election.cc:304] T b727e95d8f5843a3bb0d7cbddce61bdb P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, ad362df39b114ec3a3a419128097b362; no voters: 
I20260709 12:14:46.468439 24553 raft_consensus.cc:2804] T ab8dff607862460ea0fcd88422c31ac2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:46.524138 24479 tablet_bootstrap.cc:492] T e05eec364f764114bdb814096b9bf0ce P ad362df39b114ec3a3a419128097b362: No bootstrap required, opened a new log
I20260709 12:14:46.524652 24553 raft_consensus.cc:493] T ab8dff607862460ea0fcd88422c31ac2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:46.525563 24553 raft_consensus.cc:3060] T ab8dff607862460ea0fcd88422c31ac2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:46.525640 24479 ts_tablet_manager.cc:1403] T e05eec364f764114bdb814096b9bf0ce P ad362df39b114ec3a3a419128097b362: Time spent bootstrapping tablet: real 0.134s	user 0.030s	sys 0.047s
I20260709 12:14:46.499004 24585 consensus_queue.cc:1048] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P ad362df39b114ec3a3a419128097b362 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.028s
I20260709 12:14:46.527695 24513 raft_consensus.cc:515] T a18e73ef976b49f0878423c0b3e6e6f2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:46.503991 24432 raft_consensus.cc:2468] T 9c40e590be9d4c3eac0ddd7f96278894 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa14caefbdaa47b09abf91881635ba96 in term 0.
I20260709 12:14:46.528896 24479 raft_consensus.cc:359] T e05eec364f764114bdb814096b9bf0ce P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:46.529594 24479 raft_consensus.cc:385] T e05eec364f764114bdb814096b9bf0ce P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:46.505352 24563 raft_consensus.cc:515] T 6af96d3f7393445f8b7edb30a26a6f65 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:46.530079 24479 raft_consensus.cc:740] T e05eec364f764114bdb814096b9bf0ce P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad362df39b114ec3a3a419128097b362, State: Initialized, Role: FOLLOWER
I20260709 12:14:46.524950 24586 raft_consensus.cc:2804] T b727e95d8f5843a3bb0d7cbddce61bdb P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:46.530162 24323 leader_election.cc:304] T 9c40e590be9d4c3eac0ddd7f96278894 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, ad362df39b114ec3a3a419128097b362; no voters: cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:14:46.530769 24586 raft_consensus.cc:697] T b727e95d8f5843a3bb0d7cbddce61bdb P ad362df39b114ec3a3a419128097b362 [term 1 LEADER]: Becoming Leader. State: Replica: ad362df39b114ec3a3a419128097b362, State: Running, Role: LEADER
I20260709 12:14:46.478930 24482 tablet_bootstrap.cc:492] T 27de4156b2e24143a2f301fbefc7cb23 P 9bf3da5b54ef4a1ea1cee60f02ea2883: No bootstrap required, opened a new log
I20260709 12:14:46.531093 24550 raft_consensus.cc:2804] T 9c40e590be9d4c3eac0ddd7f96278894 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:46.530897 24479 consensus_queue.cc:260] T e05eec364f764114bdb814096b9bf0ce P ad362df39b114ec3a3a419128097b362 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:46.533926 24285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18e73ef976b49f0878423c0b3e6e6f2" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054"
I20260709 12:14:46.505158 24398 leader_election.cc:304] T e15e9b81515343958a00ba6f2f291860 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad362df39b114ec3a3a419128097b362; no voters: aa14caefbdaa47b09abf91881635ba96, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:14:46.535341 24479 ts_tablet_manager.cc:1434] T e05eec364f764114bdb814096b9bf0ce P ad362df39b114ec3a3a419128097b362: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:14:46.530174 24513 leader_election.cc:290] T a18e73ef976b49f0878423c0b3e6e6f2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 election: Requested vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:14:46.534286 24550 raft_consensus.cc:493] T 9c40e590be9d4c3eac0ddd7f96278894 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:46.536989 24565 raft_consensus.cc:493] T b727e95d8f5843a3bb0d7cbddce61bdb P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:46.537290 24479 tablet_bootstrap.cc:492] T 7cbef09353144c0b9a9ebf7731fd019f P ad362df39b114ec3a3a419128097b362: Bootstrap starting.
I20260709 12:14:46.537657 24565 raft_consensus.cc:515] T b727e95d8f5843a3bb0d7cbddce61bdb P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:46.532712 24482 ts_tablet_manager.cc:1403] T 27de4156b2e24143a2f301fbefc7cb23 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.185s	user 0.011s	sys 0.019s
I20260709 12:14:46.535948 24585 raft_consensus.cc:3060] T e15e9b81515343958a00ba6f2f291860 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:46.540629 24565 leader_election.cc:290] T b727e95d8f5843a3bb0d7cbddce61bdb P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:46.541971 24210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6af96d3f7393445f8b7edb30a26a6f65" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
I20260709 12:14:46.542912 24210 raft_consensus.cc:3060] T 6af96d3f7393445f8b7edb30a26a6f65 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:46.542953 24482 raft_consensus.cc:359] T 27de4156b2e24143a2f301fbefc7cb23 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:46.543927 24482 raft_consensus.cc:385] T 27de4156b2e24143a2f301fbefc7cb23 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:46.544229 24482 raft_consensus.cc:740] T 27de4156b2e24143a2f301fbefc7cb23 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:14:46.534680 24285 raft_consensus.cc:3060] T a18e73ef976b49f0878423c0b3e6e6f2 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:46.595976 24482 consensus_queue.cc:260] T 27de4156b2e24143a2f301fbefc7cb23 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:46.639005 24482 ts_tablet_manager.cc:1434] T 27de4156b2e24143a2f301fbefc7cb23 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.099s	user 0.006s	sys 0.003s
I20260709 12:14:46.520648 24564 leader_election.cc:290] T b727e95d8f5843a3bb0d7cbddce61bdb P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 election: Requested vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:14:46.537302 24550 raft_consensus.cc:3060] T 9c40e590be9d4c3eac0ddd7f96278894 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:46.497995 24548 raft_consensus.cc:493] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:46.533418 24358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18e73ef976b49f0878423c0b3e6e6f2" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
I20260709 12:14:46.532037 24563 leader_election.cc:290] T 6af96d3f7393445f8b7edb30a26a6f65 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 election: Requested vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:14:46.643375 24432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727e95d8f5843a3bb0d7cbddce61bdb" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:46.660544 24482 tablet_bootstrap.cc:492] T 7cbef09353144c0b9a9ebf7731fd019f P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
W20260709 12:14:46.665593 24398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:46845, user_credentials={real_user=slave}} blocked reactor thread for 160584us
I20260709 12:14:46.671262 24481 tablet_bootstrap.cc:492] T e05eec364f764114bdb814096b9bf0ce P aa14caefbdaa47b09abf91881635ba96: No bootstrap required, opened a new log
I20260709 12:14:46.671922 24481 ts_tablet_manager.cc:1403] T e05eec364f764114bdb814096b9bf0ce P aa14caefbdaa47b09abf91881635ba96: Time spent bootstrapping tablet: real 0.280s	user 0.042s	sys 0.046s
I20260709 12:14:46.674149 24283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727e95d8f5843a3bb0d7cbddce61bdb" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054"
I20260709 12:14:46.674971 24283 raft_consensus.cc:3060] T b727e95d8f5843a3bb0d7cbddce61bdb P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:46.531821 24586 consensus_queue.cc:237] T b727e95d8f5843a3bb0d7cbddce61bdb P ad362df39b114ec3a3a419128097b362 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:46.695008 24552 consensus_queue.cc:1048] T c75afe0e0e00446aa6d220941d288eab P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:46.689038 24563 raft_consensus.cc:493] T e05eec364f764114bdb814096b9bf0ce P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:46.650490 24548 raft_consensus.cc:515] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:46.714257 24208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b727e95d8f5843a3bb0d7cbddce61bdb" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
I20260709 12:14:46.718233 24478 tablet_bootstrap.cc:492] T ab8dff607862460ea0fcd88422c31ac2 P cf2d8294ae68482ca4ffa8be051ad054: No bootstrap required, opened a new log
I20260709 12:14:46.719072 24478 ts_tablet_manager.cc:1403] T ab8dff607862460ea0fcd88422c31ac2 P cf2d8294ae68482ca4ffa8be051ad054: Time spent bootstrapping tablet: real 0.314s	user 0.046s	sys 0.031s
I20260709 12:14:46.723954 24481 raft_consensus.cc:359] T e05eec364f764114bdb814096b9bf0ce P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:46.725075 24481 raft_consensus.cc:385] T e05eec364f764114bdb814096b9bf0ce P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:46.725455 24481 raft_consensus.cc:740] T e05eec364f764114bdb814096b9bf0ce P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Initialized, Role: FOLLOWER
I20260709 12:14:46.726384 24481 consensus_queue.cc:260] T e05eec364f764114bdb814096b9bf0ce P aa14caefbdaa47b09abf91881635ba96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:46.733173 24481 ts_tablet_manager.cc:1434] T e05eec364f764114bdb814096b9bf0ce P aa14caefbdaa47b09abf91881635ba96: Time spent starting tablet: real 0.061s	user 0.007s	sys 0.004s
I20260709 12:14:46.735430 24481 tablet_bootstrap.cc:492] T 7cbef09353144c0b9a9ebf7731fd019f P aa14caefbdaa47b09abf91881635ba96: Bootstrap starting.
W20260709 12:14:46.721036 24175 leader_election.cc:343] T a18e73ef976b49f0878423c0b3e6e6f2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:46.742774 24208 raft_consensus.cc:2393] T b727e95d8f5843a3bb0d7cbddce61bdb P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cf2d8294ae68482ca4ffa8be051ad054 in current term 1: Already voted for candidate ad362df39b114ec3a3a419128097b362 in this term.
I20260709 12:14:46.748040 24553 raft_consensus.cc:515] T ab8dff607862460ea0fcd88422c31ac2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:46.750533 24553 leader_election.cc:290] T ab8dff607862460ea0fcd88422c31ac2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 election: Requested vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:14:46.751477 24479 tablet_bootstrap.cc:654] T 7cbef09353144c0b9a9ebf7731fd019f P ad362df39b114ec3a3a419128097b362: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:46.737370 24358 raft_consensus.cc:3060] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:46.740643 24281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6af96d3f7393445f8b7edb30a26a6f65" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054"
I20260709 12:14:46.716936 24563 raft_consensus.cc:515] T e05eec364f764114bdb814096b9bf0ce P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
W20260709 12:14:46.764338 24175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:46845, user_credentials={real_user=slave}} blocked reactor thread for 47413.8us
I20260709 12:14:46.774317 24356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05eec364f764114bdb814096b9bf0ce" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:46.775117 24356 raft_consensus.cc:2468] T e05eec364f764114bdb814096b9bf0ce P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 0.
I20260709 12:14:46.775939 24560 raft_consensus.cc:493] T e05eec364f764114bdb814096b9bf0ce P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:46.776427 24560 raft_consensus.cc:515] T e05eec364f764114bdb814096b9bf0ce P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:46.776886 24207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05eec364f764114bdb814096b9bf0ce" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
I20260709 12:14:46.777582 24207 raft_consensus.cc:2468] T e05eec364f764114bdb814096b9bf0ce P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 0.
I20260709 12:14:46.778709 24560 leader_election.cc:290] T e05eec364f764114bdb814096b9bf0ce P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:46.779081 24396 leader_election.cc:304] T e05eec364f764114bdb814096b9bf0ce P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, ad362df39b114ec3a3a419128097b362; no voters: 
I20260709 12:14:46.780100 24564 raft_consensus.cc:2804] T e05eec364f764114bdb814096b9bf0ce P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:46.780701 24564 raft_consensus.cc:493] T e05eec364f764114bdb814096b9bf0ce P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:46.781092 24564 raft_consensus.cc:3060] T e05eec364f764114bdb814096b9bf0ce P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:14:46.765596 24399 leader_election.cc:343] T 6af96d3f7393445f8b7edb30a26a6f65 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:46.766480 24563 leader_election.cc:290] T e05eec364f764114bdb814096b9bf0ce P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:46.764213 24565 consensus_queue.cc:1048] T 0d31cf2c4a7849d9a798bf886e7fc997 P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 12:14:46.787339 24281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab8dff607862460ea0fcd88422c31ac2" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054"
I20260709 12:14:46.787729 24248 leader_election.cc:304] T b727e95d8f5843a3bb0d7cbddce61bdb P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf2d8294ae68482ca4ffa8be051ad054; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, ad362df39b114ec3a3a419128097b362
I20260709 12:14:46.790783 24285 raft_consensus.cc:2468] T a18e73ef976b49f0878423c0b3e6e6f2 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 1.
I20260709 12:14:46.790869 24208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05eec364f764114bdb814096b9bf0ce" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
I20260709 12:14:46.791750 24208 raft_consensus.cc:2468] T e05eec364f764114bdb814096b9bf0ce P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa14caefbdaa47b09abf91881635ba96 in term 0.
I20260709 12:14:46.792821 24176 leader_election.cc:304] T a18e73ef976b49f0878423c0b3e6e6f2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054; no voters: aa14caefbdaa47b09abf91881635ba96
I20260709 12:14:46.793236 24356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab8dff607862460ea0fcd88422c31ac2" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
I20260709 12:14:46.794137 24322 leader_election.cc:304] T e05eec364f764114bdb814096b9bf0ce P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, aa14caefbdaa47b09abf91881635ba96; no voters: 
I20260709 12:14:46.794875 24553 raft_consensus.cc:2804] T a18e73ef976b49f0878423c0b3e6e6f2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:46.795305 24356 raft_consensus.cc:3060] T ab8dff607862460ea0fcd88422c31ac2 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:46.795454 24553 raft_consensus.cc:697] T a18e73ef976b49f0878423c0b3e6e6f2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 LEADER]: Becoming Leader. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Running, Role: LEADER
I20260709 12:14:46.796480 24553 consensus_queue.cc:237] T a18e73ef976b49f0878423c0b3e6e6f2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:46.757681 24585 raft_consensus.cc:2749] T e15e9b81515343958a00ba6f2f291860 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:46.798574 24478 raft_consensus.cc:359] T ab8dff607862460ea0fcd88422c31ac2 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:46.806344 24478 raft_consensus.cc:385] T ab8dff607862460ea0fcd88422c31ac2 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:46.806795 24478 raft_consensus.cc:740] T ab8dff607862460ea0fcd88422c31ac2 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Initialized, Role: FOLLOWER
I20260709 12:14:46.809646 24482 tablet_bootstrap.cc:654] T 7cbef09353144c0b9a9ebf7731fd019f P 9bf3da5b54ef4a1ea1cee60f02ea2883: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:46.809689 24478 consensus_queue.cc:260] T ab8dff607862460ea0fcd88422c31ac2 P cf2d8294ae68482ca4ffa8be051ad054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:46.760095 24283 raft_consensus.cc:2468] T b727e95d8f5843a3bb0d7cbddce61bdb P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 1.
I20260709 12:14:46.813313 24565 consensus_queue.cc:1048] T c75afe0e0e00446aa6d220941d288eab P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:14:46.830943 24478 ts_tablet_manager.cc:1434] T ab8dff607862460ea0fcd88422c31ac2 P cf2d8294ae68482ca4ffa8be051ad054: Time spent starting tablet: real 0.111s	user 0.007s	sys 0.001s
I20260709 12:14:46.842365 24478 tablet_bootstrap.cc:492] T 9c40e590be9d4c3eac0ddd7f96278894 P cf2d8294ae68482ca4ffa8be051ad054: Bootstrap starting.
I20260709 12:14:46.826025 24210 raft_consensus.cc:2468] T 6af96d3f7393445f8b7edb30a26a6f65 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 1.
I20260709 12:14:46.832787 24431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05eec364f764114bdb814096b9bf0ce" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:46.820211 24552 raft_consensus.cc:2749] T b727e95d8f5843a3bb0d7cbddce61bdb P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:46.818598 24281 raft_consensus.cc:3060] T ab8dff607862460ea0fcd88422c31ac2 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:46.838706 24582 consensus_queue.cc:1048] T e15e9b81515343958a00ba6f2f291860 P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:46.874287 24620 raft_consensus.cc:2804] T e05eec364f764114bdb814096b9bf0ce P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:46.880327 24620 raft_consensus.cc:493] T e05eec364f764114bdb814096b9bf0ce P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:46.880906 24620 raft_consensus.cc:3060] T e05eec364f764114bdb814096b9bf0ce P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:46.870014 24548 leader_election.cc:290] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:14:46.951713 24481 tablet_bootstrap.cc:654] T 7cbef09353144c0b9a9ebf7731fd019f P aa14caefbdaa47b09abf91881635ba96: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:46.953075 24478 tablet_bootstrap.cc:654] T 9c40e590be9d4c3eac0ddd7f96278894 P cf2d8294ae68482ca4ffa8be051ad054: Neither blocks nor log segments found. Creating new log.
W20260709 12:14:46.868526 24323 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46467, user_credentials={real_user=slave}} blocked reactor thread for 44922.5us
I20260709 12:14:46.960072 24479 tablet_bootstrap.cc:492] T 7cbef09353144c0b9a9ebf7731fd019f P ad362df39b114ec3a3a419128097b362: No bootstrap required, opened a new log
I20260709 12:14:46.961856 24479 ts_tablet_manager.cc:1403] T 7cbef09353144c0b9a9ebf7731fd019f P ad362df39b114ec3a3a419128097b362: Time spent bootstrapping tablet: real 0.425s	user 0.021s	sys 0.046s
W20260709 12:14:46.951084 24176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:34565, user_credentials={real_user=slave}} blocked reactor thread for 74354.5us
W20260709 12:14:46.950835 24249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46467, user_credentials={real_user=slave}} blocked reactor thread for 71945.1us
I20260709 12:14:46.958896 24582 consensus_queue.cc:1048] T e15e9b81515343958a00ba6f2f291860 P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 12:14:46.950909 24396 leader_election.cc:304] T 6af96d3f7393445f8b7edb30a26a6f65 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, ad362df39b114ec3a3a419128097b362; no voters: cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:14:46.977896 24284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a17cccc4f4ca79468bb6b4e904ec8" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:46.983907 24550 raft_consensus.cc:515] T 9c40e590be9d4c3eac0ddd7f96278894 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:46.984792 24564 raft_consensus.cc:515] T e05eec364f764114bdb814096b9bf0ce P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:46.999279 24586 raft_consensus.cc:2804] T 6af96d3f7393445f8b7edb30a26a6f65 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:14:47.009465 24625 log.cc:927] Time spent T c75afe0e0e00446aa6d220941d288eab P ad362df39b114ec3a3a419128097b362: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 12:14:47.011018 24429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9a17cccc4f4ca79468bb6b4e904ec8" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:47.012208 24564 leader_election.cc:290] T e05eec364f764114bdb814096b9bf0ce P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 election: Requested vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:47.019424 24586 raft_consensus.cc:697] T 6af96d3f7393445f8b7edb30a26a6f65 P ad362df39b114ec3a3a419128097b362 [term 1 LEADER]: Becoming Leader. State: Replica: ad362df39b114ec3a3a419128097b362, State: Running, Role: LEADER
I20260709 12:14:47.019953 24356 raft_consensus.cc:2468] T ab8dff607862460ea0fcd88422c31ac2 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 1.
W20260709 12:14:47.020519 24626 log.cc:927] Time spent T b727e95d8f5843a3bb0d7cbddce61bdb P ad362df39b114ec3a3a419128097b362: Append to log took a long time: real 0.086s	user 0.002s	sys 0.006s
I20260709 12:14:47.024259 24281 raft_consensus.cc:2468] T ab8dff607862460ea0fcd88422c31ac2 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 1.
I20260709 12:14:47.038651 24282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c40e590be9d4c3eac0ddd7f96278894" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054"
I20260709 12:14:47.026834 24513 raft_consensus.cc:493] T 27de4156b2e24143a2f301fbefc7cb23 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.029264 24431 raft_consensus.cc:2393] T e05eec364f764114bdb814096b9bf0ce P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aa14caefbdaa47b09abf91881635ba96 in current term 1: Already voted for candidate ad362df39b114ec3a3a419128097b362 in this term.
I20260709 12:14:47.029399 24359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05eec364f764114bdb814096b9bf0ce" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
W20260709 12:14:47.003981 24396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:38787, user_credentials={real_user=slave}} blocked reactor thread for 126081us
I20260709 12:14:47.046043 24430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c40e590be9d4c3eac0ddd7f96278894" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362"
I20260709 12:14:47.046861 24430 raft_consensus.cc:3060] T 9c40e590be9d4c3eac0ddd7f96278894 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:47.048022 24209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05eec364f764114bdb814096b9bf0ce" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
I20260709 12:14:47.028400 24550 leader_election.cc:290] T 9c40e590be9d4c3eac0ddd7f96278894 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 election: Requested vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:14:47.018373 24620 raft_consensus.cc:515] T e05eec364f764114bdb814096b9bf0ce P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:47.039659 24513 raft_consensus.cc:515] T 27de4156b2e24143a2f301fbefc7cb23 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:47.049389 24209 raft_consensus.cc:3060] T e05eec364f764114bdb814096b9bf0ce P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:47.071712 24513 leader_election.cc:290] T 27de4156b2e24143a2f301fbefc7cb23 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
W20260709 12:14:47.072682 24633 log.cc:927] Time spent T a18e73ef976b49f0878423c0b3e6e6f2 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:14:47.075408 24479 raft_consensus.cc:359] T 7cbef09353144c0b9a9ebf7731fd019f P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:47.076380 24479 raft_consensus.cc:385] T 7cbef09353144c0b9a9ebf7731fd019f P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:47.076438 24482 tablet_bootstrap.cc:492] T 7cbef09353144c0b9a9ebf7731fd019f P 9bf3da5b54ef4a1ea1cee60f02ea2883: No bootstrap required, opened a new log
I20260709 12:14:47.076864 24479 raft_consensus.cc:740] T 7cbef09353144c0b9a9ebf7731fd019f P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad362df39b114ec3a3a419128097b362, State: Initialized, Role: FOLLOWER
I20260709 12:14:47.077005 24282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27de4156b2e24143a2f301fbefc7cb23" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:47.077281 24482 ts_tablet_manager.cc:1403] T 7cbef09353144c0b9a9ebf7731fd019f P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.417s	user 0.025s	sys 0.025s
I20260709 12:14:47.064867 24586 consensus_queue.cc:237] T 6af96d3f7393445f8b7edb30a26a6f65 P ad362df39b114ec3a3a419128097b362 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:47.067557 24620 leader_election.cc:290] T e05eec364f764114bdb814096b9bf0ce P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 election: Requested vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:47.068531 24359 raft_consensus.cc:2393] T e05eec364f764114bdb814096b9bf0ce P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ad362df39b114ec3a3a419128097b362 in current term 1: Already voted for candidate aa14caefbdaa47b09abf91881635ba96 in this term.
I20260709 12:14:47.078069 24479 consensus_queue.cc:260] T 7cbef09353144c0b9a9ebf7731fd019f P ad362df39b114ec3a3a419128097b362 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
W20260709 12:14:47.078814 24176 leader_election.cc:343] T 27de4156b2e24143a2f301fbefc7cb23 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:47.088955 24479 ts_tablet_manager.cc:1434] T 7cbef09353144c0b9a9ebf7731fd019f P ad362df39b114ec3a3a419128097b362: Time spent starting tablet: real 0.123s	user 0.007s	sys 0.002s
I20260709 12:14:47.090006 24479 tablet_bootstrap.cc:492] T 3e977ea0483d4c029394b273e7c4e90f P ad362df39b114ec3a3a419128097b362: Bootstrap starting.
I20260709 12:14:47.154525 24482 raft_consensus.cc:359] T 7cbef09353144c0b9a9ebf7731fd019f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:47.155906 24482 raft_consensus.cc:385] T 7cbef09353144c0b9a9ebf7731fd019f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:47.156311 24482 raft_consensus.cc:740] T 7cbef09353144c0b9a9ebf7731fd019f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:14:47.159184 24482 consensus_queue.cc:260] T 7cbef09353144c0b9a9ebf7731fd019f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:47.163818 24482 ts_tablet_manager.cc:1434] T 7cbef09353144c0b9a9ebf7731fd019f P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.086s	user 0.006s	sys 0.003s
I20260709 12:14:47.164958 24482 tablet_bootstrap.cc:492] T 085a04f8ed724f82bc12490bbb1ceea7 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:14:47.165946 24431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05eec364f764114bdb814096b9bf0ce" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362"
I20260709 12:14:47.167090 24431 raft_consensus.cc:2393] T e05eec364f764114bdb814096b9bf0ce P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate aa14caefbdaa47b09abf91881635ba96 in current term 1: Already voted for candidate ad362df39b114ec3a3a419128097b362 in this term.
I20260709 12:14:47.171030 24209 raft_consensus.cc:2468] T e05eec364f764114bdb814096b9bf0ce P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 1.
I20260709 12:14:47.186529 24482 tablet_bootstrap.cc:654] T 085a04f8ed724f82bc12490bbb1ceea7 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:47.182186 24396 leader_election.cc:304] T e05eec364f764114bdb814096b9bf0ce P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, ad362df39b114ec3a3a419128097b362; no voters: 
I20260709 12:14:47.188541 24564 raft_consensus.cc:2804] T e05eec364f764114bdb814096b9bf0ce P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:47.189217 24564 raft_consensus.cc:697] T e05eec364f764114bdb814096b9bf0ce P ad362df39b114ec3a3a419128097b362 [term 1 LEADER]: Becoming Leader. State: Replica: ad362df39b114ec3a3a419128097b362, State: Running, Role: LEADER
I20260709 12:14:47.190249 24564 consensus_queue.cc:237] T e05eec364f764114bdb814096b9bf0ce P ad362df39b114ec3a3a419128097b362 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:47.191226 24478 tablet_bootstrap.cc:492] T 9c40e590be9d4c3eac0ddd7f96278894 P cf2d8294ae68482ca4ffa8be051ad054: No bootstrap required, opened a new log
I20260709 12:14:47.191789 24478 ts_tablet_manager.cc:1403] T 9c40e590be9d4c3eac0ddd7f96278894 P cf2d8294ae68482ca4ffa8be051ad054: Time spent bootstrapping tablet: real 0.350s	user 0.018s	sys 0.013s
I20260709 12:14:47.195057 24478 raft_consensus.cc:359] T 9c40e590be9d4c3eac0ddd7f96278894 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:47.195878 24478 raft_consensus.cc:385] T 9c40e590be9d4c3eac0ddd7f96278894 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:47.196180 24478 raft_consensus.cc:740] T 9c40e590be9d4c3eac0ddd7f96278894 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Initialized, Role: FOLLOWER
I20260709 12:14:47.188395 24430 raft_consensus.cc:2468] T 9c40e590be9d4c3eac0ddd7f96278894 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa14caefbdaa47b09abf91881635ba96 in term 1.
I20260709 12:14:47.198864 24481 tablet_bootstrap.cc:492] T 7cbef09353144c0b9a9ebf7731fd019f P aa14caefbdaa47b09abf91881635ba96: No bootstrap required, opened a new log
I20260709 12:14:47.199707 24481 ts_tablet_manager.cc:1403] T 7cbef09353144c0b9a9ebf7731fd019f P aa14caefbdaa47b09abf91881635ba96: Time spent bootstrapping tablet: real 0.465s	user 0.043s	sys 0.043s
I20260709 12:14:47.202425 24478 consensus_queue.cc:260] T 9c40e590be9d4c3eac0ddd7f96278894 P cf2d8294ae68482ca4ffa8be051ad054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:47.242836 24478 ts_tablet_manager.cc:1434] T 9c40e590be9d4c3eac0ddd7f96278894 P cf2d8294ae68482ca4ffa8be051ad054: Time spent starting tablet: real 0.051s	user 0.005s	sys 0.005s
I20260709 12:14:47.243714 24478 tablet_bootstrap.cc:492] T 20629783689c4296afb55366d9ad5f6c P cf2d8294ae68482ca4ffa8be051ad054: Bootstrap starting.
I20260709 12:14:47.247433 24175 leader_election.cc:304] T ab8dff607862460ea0fcd88422c31ac2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, aa14caefbdaa47b09abf91881635ba96; no voters: 
I20260709 12:14:47.248834 24513 raft_consensus.cc:2804] T ab8dff607862460ea0fcd88422c31ac2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:47.247723 24481 raft_consensus.cc:359] T 7cbef09353144c0b9a9ebf7731fd019f P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:47.250530 24481 raft_consensus.cc:385] T 7cbef09353144c0b9a9ebf7731fd019f P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:47.250795 24481 raft_consensus.cc:740] T 7cbef09353144c0b9a9ebf7731fd019f P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Initialized, Role: FOLLOWER
I20260709 12:14:47.255390 24479 tablet_bootstrap.cc:654] T 3e977ea0483d4c029394b273e7c4e90f P ad362df39b114ec3a3a419128097b362: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:47.253116 24209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e05eec364f764114bdb814096b9bf0ce" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
I20260709 12:14:47.258874 24209 raft_consensus.cc:2393] T e05eec364f764114bdb814096b9bf0ce P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate aa14caefbdaa47b09abf91881635ba96 in current term 1: Already voted for candidate ad362df39b114ec3a3a419128097b362 in this term.
I20260709 12:14:47.249527 24513 raft_consensus.cc:697] T ab8dff607862460ea0fcd88422c31ac2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 LEADER]: Becoming Leader. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Running, Role: LEADER
I20260709 12:14:47.260968 24513 consensus_queue.cc:237] T ab8dff607862460ea0fcd88422c31ac2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:47.251427 24481 consensus_queue.cc:260] T 7cbef09353144c0b9a9ebf7731fd019f P aa14caefbdaa47b09abf91881635ba96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:47.244216 24323 leader_election.cc:304] T 9c40e590be9d4c3eac0ddd7f96278894 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, ad362df39b114ec3a3a419128097b362; no voters: 
I20260709 12:14:47.273118 24620 raft_consensus.cc:2804] T 9c40e590be9d4c3eac0ddd7f96278894 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:47.273914 24620 raft_consensus.cc:697] T 9c40e590be9d4c3eac0ddd7f96278894 P aa14caefbdaa47b09abf91881635ba96 [term 1 LEADER]: Becoming Leader. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Running, Role: LEADER
I20260709 12:14:47.274994 24620 consensus_queue.cc:237] T 9c40e590be9d4c3eac0ddd7f96278894 P aa14caefbdaa47b09abf91881635ba96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:47.301906 24322 leader_election.cc:304] T e05eec364f764114bdb814096b9bf0ce P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, ad362df39b114ec3a3a419128097b362
I20260709 12:14:47.304409 24106 catalog_manager.cc:5697] T b727e95d8f5843a3bb0d7cbddce61bdb P ad362df39b114ec3a3a419128097b362 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad362df39b114ec3a3a419128097b362 (127.12.56.196). New cstate: current_term: 1 leader_uuid: "ad362df39b114ec3a3a419128097b362" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:47.305238 24635 raft_consensus.cc:2749] T e05eec364f764114bdb814096b9bf0ce P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:14:47.306180 24356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27de4156b2e24143a2f301fbefc7cb23" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
W20260709 12:14:47.308200 24175 consensus_peers.cc:597] T a18e73ef976b49f0878423c0b3e6e6f2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 -> Peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Couldn't send request to peer aa14caefbdaa47b09abf91881635ba96. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:47.252043 24564 raft_consensus.cc:493] T 7cbef09353144c0b9a9ebf7731fd019f P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.312734 24481 ts_tablet_manager.cc:1434] T 7cbef09353144c0b9a9ebf7731fd019f P aa14caefbdaa47b09abf91881635ba96: Time spent starting tablet: real 0.113s	user 0.009s	sys 0.002s
I20260709 12:14:47.315346 24481 tablet_bootstrap.cc:492] T a18e73ef976b49f0878423c0b3e6e6f2 P aa14caefbdaa47b09abf91881635ba96: Bootstrap starting.
I20260709 12:14:47.323153 24513 raft_consensus.cc:493] T 7cbef09353144c0b9a9ebf7731fd019f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.324076 24513 raft_consensus.cc:515] T 7cbef09353144c0b9a9ebf7731fd019f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:47.323230 24637 raft_consensus.cc:493] T 7cbef09353144c0b9a9ebf7731fd019f P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.326202 24637 raft_consensus.cc:515] T 7cbef09353144c0b9a9ebf7731fd019f P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:47.328833 24513 leader_election.cc:290] T 7cbef09353144c0b9a9ebf7731fd019f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:14:47.332072 24478 tablet_bootstrap.cc:654] T 20629783689c4296afb55366d9ad5f6c P cf2d8294ae68482ca4ffa8be051ad054: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:47.333369 24429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbef09353144c0b9a9ebf7731fd019f" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:47.335510 24433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbef09353144c0b9a9ebf7731fd019f" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:47.336536 24479 tablet_bootstrap.cc:492] T 3e977ea0483d4c029394b273e7c4e90f P ad362df39b114ec3a3a419128097b362: No bootstrap required, opened a new log
I20260709 12:14:47.337107 24479 ts_tablet_manager.cc:1403] T 3e977ea0483d4c029394b273e7c4e90f P ad362df39b114ec3a3a419128097b362: Time spent bootstrapping tablet: real 0.247s	user 0.026s	sys 0.016s
W20260709 12:14:47.323544 24175 leader_election.cc:343] T 27de4156b2e24143a2f301fbefc7cb23 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:47.337903 24586 consensus_queue.cc:1048] T b727e95d8f5843a3bb0d7cbddce61bdb P ad362df39b114ec3a3a419128097b362 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:47.340458 24479 raft_consensus.cc:359] T 3e977ea0483d4c029394b273e7c4e90f P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:47.341459 24479 raft_consensus.cc:385] T 3e977ea0483d4c029394b273e7c4e90f P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:47.341814 24479 raft_consensus.cc:740] T 3e977ea0483d4c029394b273e7c4e90f P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad362df39b114ec3a3a419128097b362, State: Initialized, Role: FOLLOWER
I20260709 12:14:47.342968 24479 consensus_queue.cc:260] T 3e977ea0483d4c029394b273e7c4e90f P ad362df39b114ec3a3a419128097b362 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:47.338330 24175 leader_election.cc:304] T 27de4156b2e24143a2f301fbefc7cb23 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883; no voters: aa14caefbdaa47b09abf91881635ba96, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:14:47.316699 24564 raft_consensus.cc:515] T 7cbef09353144c0b9a9ebf7731fd019f P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:47.346801 24429 raft_consensus.cc:2468] T 7cbef09353144c0b9a9ebf7731fd019f P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 0.
I20260709 12:14:47.348006 24564 leader_election.cc:290] T 7cbef09353144c0b9a9ebf7731fd019f P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:47.328895 24637 leader_election.cc:290] T 7cbef09353144c0b9a9ebf7731fd019f P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:47.354208 24482 tablet_bootstrap.cc:492] T 085a04f8ed724f82bc12490bbb1ceea7 P 9bf3da5b54ef4a1ea1cee60f02ea2883: No bootstrap required, opened a new log
I20260709 12:14:47.355082 24482 ts_tablet_manager.cc:1403] T 085a04f8ed724f82bc12490bbb1ceea7 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.190s	user 0.020s	sys 0.028s
I20260709 12:14:47.345872 24586 consensus_queue.cc:1048] T b727e95d8f5843a3bb0d7cbddce61bdb P ad362df39b114ec3a3a419128097b362 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:14:47.364494 24481 tablet_bootstrap.cc:654] T a18e73ef976b49f0878423c0b3e6e6f2 P aa14caefbdaa47b09abf91881635ba96: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:47.357160 24479 ts_tablet_manager.cc:1434] T 3e977ea0483d4c029394b273e7c4e90f P ad362df39b114ec3a3a419128097b362: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.001s
I20260709 12:14:47.354624 24209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbef09353144c0b9a9ebf7731fd019f" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
I20260709 12:14:47.368099 24209 raft_consensus.cc:2468] T 7cbef09353144c0b9a9ebf7731fd019f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 0.
I20260709 12:14:47.355489 24513 raft_consensus.cc:2749] T 27de4156b2e24143a2f301fbefc7cb23 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:47.367653 24174 leader_election.cc:304] T 7cbef09353144c0b9a9ebf7731fd019f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, ad362df39b114ec3a3a419128097b362; no voters: 
I20260709 12:14:47.373405 24396 leader_election.cc:304] T 7cbef09353144c0b9a9ebf7731fd019f P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, ad362df39b114ec3a3a419128097b362; no voters: 
I20260709 12:14:47.366775 24479 tablet_bootstrap.cc:492] T 20629783689c4296afb55366d9ad5f6c P ad362df39b114ec3a3a419128097b362: Bootstrap starting.
I20260709 12:14:47.375548 24586 raft_consensus.cc:2804] T 7cbef09353144c0b9a9ebf7731fd019f P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:47.375695 24209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbef09353144c0b9a9ebf7731fd019f" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
I20260709 12:14:47.376009 24586 raft_consensus.cc:493] T 7cbef09353144c0b9a9ebf7731fd019f P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:47.376387 24586 raft_consensus.cc:3060] T 7cbef09353144c0b9a9ebf7731fd019f P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:47.376430 24209 raft_consensus.cc:2468] T 7cbef09353144c0b9a9ebf7731fd019f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa14caefbdaa47b09abf91881635ba96 in term 0.
I20260709 12:14:47.378374 24565 raft_consensus.cc:493] T 9c40e590be9d4c3eac0ddd7f96278894 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.379128 24565 raft_consensus.cc:515] T 9c40e590be9d4c3eac0ddd7f96278894 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
W20260709 12:14:47.367444 24175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:46845, user_credentials={real_user=slave}} blocked reactor thread for 43958us
I20260709 12:14:47.388167 24479 tablet_bootstrap.cc:654] T 20629783689c4296afb55366d9ad5f6c P ad362df39b114ec3a3a419128097b362: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:47.411984 24478 tablet_bootstrap.cc:492] T 20629783689c4296afb55366d9ad5f6c P cf2d8294ae68482ca4ffa8be051ad054: No bootstrap required, opened a new log
I20260709 12:14:47.423563 24478 ts_tablet_manager.cc:1403] T 20629783689c4296afb55366d9ad5f6c P cf2d8294ae68482ca4ffa8be051ad054: Time spent bootstrapping tablet: real 0.180s	user 0.029s	sys 0.016s
I20260709 12:14:47.380376 24325 leader_election.cc:304] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96; no voters: ad362df39b114ec3a3a419128097b362, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:14:47.386977 24565 leader_election.cc:290] T 9c40e590be9d4c3eac0ddd7f96278894 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:14:47.386866 24429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c40e590be9d4c3eac0ddd7f96278894" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:47.381541 24513 raft_consensus.cc:2804] T 7cbef09353144c0b9a9ebf7731fd019f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:47.437026 24482 raft_consensus.cc:359] T 085a04f8ed724f82bc12490bbb1ceea7 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:47.384502 24357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c40e590be9d4c3eac0ddd7f96278894" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:47.445868 24482 raft_consensus.cc:385] T 085a04f8ed724f82bc12490bbb1ceea7 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:47.446406 24482 raft_consensus.cc:740] T 085a04f8ed724f82bc12490bbb1ceea7 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:14:47.381332 24322 leader_election.cc:304] T 7cbef09353144c0b9a9ebf7731fd019f P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, aa14caefbdaa47b09abf91881635ba96; no voters: ad362df39b114ec3a3a419128097b362
I20260709 12:14:47.445724 24513 raft_consensus.cc:493] T 7cbef09353144c0b9a9ebf7731fd019f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:47.457837 24429 raft_consensus.cc:2393] T 9c40e590be9d4c3eac0ddd7f96278894 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cf2d8294ae68482ca4ffa8be051ad054 in current term 1: Already voted for candidate aa14caefbdaa47b09abf91881635ba96 in this term.
I20260709 12:14:47.456090 24560 raft_consensus.cc:2749] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:47.459220 24482 consensus_queue.cc:260] T 085a04f8ed724f82bc12490bbb1ceea7 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
W20260709 12:14:47.462908 24325 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:34565, user_credentials={real_user=slave}} blocked reactor thread for 417232us
W20260709 12:14:47.469112 24325 leader_election.cc:343] T 9c40e590be9d4c3eac0ddd7f96278894 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:47.470950 24358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbef09353144c0b9a9ebf7731fd019f" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:47.471700 24358 raft_consensus.cc:2468] T 7cbef09353144c0b9a9ebf7731fd019f P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 0.
I20260709 12:14:47.471925 24250 leader_election.cc:304] T 9c40e590be9d4c3eac0ddd7f96278894 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf2d8294ae68482ca4ffa8be051ad054; no voters: aa14caefbdaa47b09abf91881635ba96, ad362df39b114ec3a3a419128097b362
I20260709 12:14:47.458827 24513 raft_consensus.cc:3060] T 7cbef09353144c0b9a9ebf7731fd019f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:47.489009 24564 consensus_queue.cc:1048] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P ad362df39b114ec3a3a419128097b362 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:14:47.489518 24322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:38787, user_credentials={real_user=slave}} blocked reactor thread for 109288us
I20260709 12:14:47.490995 24555 consensus_queue.cc:1048] T a18e73ef976b49f0878423c0b3e6e6f2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:47.487594 24637 raft_consensus.cc:2804] T 7cbef09353144c0b9a9ebf7731fd019f P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:47.492957 24637 raft_consensus.cc:493] T 7cbef09353144c0b9a9ebf7731fd019f P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:47.493500 24637 raft_consensus.cc:3060] T 7cbef09353144c0b9a9ebf7731fd019f P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:47.498679 24478 raft_consensus.cc:359] T 20629783689c4296afb55366d9ad5f6c P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:47.499563 24478 raft_consensus.cc:385] T 20629783689c4296afb55366d9ad5f6c P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:47.499894 24478 raft_consensus.cc:740] T 20629783689c4296afb55366d9ad5f6c P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Initialized, Role: FOLLOWER
I20260709 12:14:47.492383 24357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbef09353144c0b9a9ebf7731fd019f" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:47.500651 24478 consensus_queue.cc:260] T 20629783689c4296afb55366d9ad5f6c P cf2d8294ae68482ca4ffa8be051ad054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:47.486343 24552 raft_consensus.cc:3060] T 9c40e590be9d4c3eac0ddd7f96278894 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:47.506750 24481 tablet_bootstrap.cc:492] T a18e73ef976b49f0878423c0b3e6e6f2 P aa14caefbdaa47b09abf91881635ba96: No bootstrap required, opened a new log
I20260709 12:14:47.507302 24636 raft_consensus.cc:493] T 7943c68d21d449dba2d1dca6ddde5820 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.507956 24636 raft_consensus.cc:515] T 7943c68d21d449dba2d1dca6ddde5820 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:47.508296 24586 raft_consensus.cc:515] T 7cbef09353144c0b9a9ebf7731fd019f P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:47.507413 24481 ts_tablet_manager.cc:1403] T a18e73ef976b49f0878423c0b3e6e6f2 P aa14caefbdaa47b09abf91881635ba96: Time spent bootstrapping tablet: real 0.192s	user 0.016s	sys 0.005s
W20260709 12:14:47.489594 24155 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:47.510936 24636 leader_election.cc:290] T 7943c68d21d449dba2d1dca6ddde5820 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:14:47.488814 24513 raft_consensus.cc:515] T 7cbef09353144c0b9a9ebf7731fd019f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:47.511973 24284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7943c68d21d449dba2d1dca6ddde5820" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:47.517347 24284 raft_consensus.cc:2468] T 7943c68d21d449dba2d1dca6ddde5820 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 1.
I20260709 12:14:47.515162 24481 raft_consensus.cc:359] T a18e73ef976b49f0878423c0b3e6e6f2 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:47.515967 24358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7943c68d21d449dba2d1dca6ddde5820" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:47.518389 24481 raft_consensus.cc:385] T a18e73ef976b49f0878423c0b3e6e6f2 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:47.518718 24481 raft_consensus.cc:740] T a18e73ef976b49f0878423c0b3e6e6f2 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Initialized, Role: FOLLOWER
I20260709 12:14:47.518591 24358 raft_consensus.cc:2468] T 7943c68d21d449dba2d1dca6ddde5820 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 1.
I20260709 12:14:47.519218 24176 leader_election.cc:304] T 7943c68d21d449dba2d1dca6ddde5820 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054; no voters: 
I20260709 12:14:47.519881 24356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbef09353144c0b9a9ebf7731fd019f" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
I20260709 12:14:47.520123 24636 raft_consensus.cc:2804] T 7943c68d21d449dba2d1dca6ddde5820 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:47.520509 24636 raft_consensus.cc:493] T 7943c68d21d449dba2d1dca6ddde5820 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:47.520831 24636 raft_consensus.cc:3060] T 7943c68d21d449dba2d1dca6ddde5820 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:47.525411 24586 leader_election.cc:290] T 7cbef09353144c0b9a9ebf7731fd019f P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 election: Requested vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:47.525758 24482 ts_tablet_manager.cc:1434] T 085a04f8ed724f82bc12490bbb1ceea7 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.170s	user 0.011s	sys 0.003s
I20260709 12:14:47.526505 24208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbef09353144c0b9a9ebf7731fd019f" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
I20260709 12:14:47.526919 24482 tablet_bootstrap.cc:492] T ed15c59b19ff49d3a39bf5b5abf8b69a P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:14:47.519501 24481 consensus_queue.cc:260] T a18e73ef976b49f0878423c0b3e6e6f2 P aa14caefbdaa47b09abf91881635ba96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:47.533876 24513 leader_election.cc:290] T 7cbef09353144c0b9a9ebf7731fd019f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 election: Requested vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:14:47.534118 24358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbef09353144c0b9a9ebf7731fd019f" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
I20260709 12:14:47.536022 24429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbef09353144c0b9a9ebf7731fd019f" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362"
I20260709 12:14:47.538532 24429 raft_consensus.cc:2393] T 7cbef09353144c0b9a9ebf7731fd019f P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in current term 1: Already voted for candidate ad362df39b114ec3a3a419128097b362 in this term.
I20260709 12:14:47.536996 24208 raft_consensus.cc:2393] T 7cbef09353144c0b9a9ebf7731fd019f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ad362df39b114ec3a3a419128097b362 in current term 1: Already voted for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in this term.
I20260709 12:14:47.543255 24478 ts_tablet_manager.cc:1434] T 20629783689c4296afb55366d9ad5f6c P cf2d8294ae68482ca4ffa8be051ad054: Time spent starting tablet: real 0.119s	user 0.007s	sys 0.002s
I20260709 12:14:47.536881 24552 raft_consensus.cc:2749] T 9c40e590be9d4c3eac0ddd7f96278894 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:47.547699 24481 ts_tablet_manager.cc:1434] T a18e73ef976b49f0878423c0b3e6e6f2 P aa14caefbdaa47b09abf91881635ba96: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.000s
I20260709 12:14:47.548717 24481 tablet_bootstrap.cc:492] T 20629783689c4296afb55366d9ad5f6c P aa14caefbdaa47b09abf91881635ba96: Bootstrap starting.
I20260709 12:14:47.537518 24636 raft_consensus.cc:515] T 7943c68d21d449dba2d1dca6ddde5820 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:47.549384 24174 leader_election.cc:304] T 7cbef09353144c0b9a9ebf7731fd019f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883; no voters: aa14caefbdaa47b09abf91881635ba96, ad362df39b114ec3a3a419128097b362
I20260709 12:14:47.551414 24396 leader_election.cc:304] T 7cbef09353144c0b9a9ebf7731fd019f P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad362df39b114ec3a3a419128097b362; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, aa14caefbdaa47b09abf91881635ba96
I20260709 12:14:47.558301 24618 raft_consensus.cc:2749] T 7cbef09353144c0b9a9ebf7731fd019f P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:14:47.559304 24513 raft_consensus.cc:2749] T 7cbef09353144c0b9a9ebf7731fd019f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:14:47.559347 24618 consensus_queue.cc:1048] T 6af96d3f7393445f8b7edb30a26a6f65 P ad362df39b114ec3a3a419128097b362 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:47.561115 24478 tablet_bootstrap.cc:492] T 6af96d3f7393445f8b7edb30a26a6f65 P cf2d8294ae68482ca4ffa8be051ad054: Bootstrap starting.
I20260709 12:14:47.562187 24637 raft_consensus.cc:515] T 7cbef09353144c0b9a9ebf7731fd019f P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:47.563673 24357 raft_consensus.cc:2393] T 7cbef09353144c0b9a9ebf7731fd019f P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in current term 1: Already voted for candidate aa14caefbdaa47b09abf91881635ba96 in this term.
I20260709 12:14:47.565815 24429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbef09353144c0b9a9ebf7731fd019f" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362"
I20260709 12:14:47.565992 24208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbef09353144c0b9a9ebf7731fd019f" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
I20260709 12:14:47.566876 24429 raft_consensus.cc:2393] T 7cbef09353144c0b9a9ebf7731fd019f P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate aa14caefbdaa47b09abf91881635ba96 in current term 1: Already voted for candidate ad362df39b114ec3a3a419128097b362 in this term.
I20260709 12:14:47.566887 24208 raft_consensus.cc:2393] T 7cbef09353144c0b9a9ebf7731fd019f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate aa14caefbdaa47b09abf91881635ba96 in current term 1: Already voted for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in this term.
I20260709 12:14:47.568877 24637 leader_election.cc:290] T 7cbef09353144c0b9a9ebf7731fd019f P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 election: Requested vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:47.569042 24323 leader_election.cc:304] T 7cbef09353144c0b9a9ebf7731fd019f P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, ad362df39b114ec3a3a419128097b362
I20260709 12:14:47.571264 24481 tablet_bootstrap.cc:654] T 20629783689c4296afb55366d9ad5f6c P aa14caefbdaa47b09abf91881635ba96: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:47.572048 24636 leader_election.cc:290] T 7943c68d21d449dba2d1dca6ddde5820 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 2 election: Requested vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:14:47.574584 24357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7943c68d21d449dba2d1dca6ddde5820" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
I20260709 12:14:47.574739 24637 raft_consensus.cc:2749] T 7cbef09353144c0b9a9ebf7731fd019f P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:14:47.575022 24479 tablet_bootstrap.cc:492] T 20629783689c4296afb55366d9ad5f6c P ad362df39b114ec3a3a419128097b362: No bootstrap required, opened a new log
I20260709 12:14:47.575837 24479 ts_tablet_manager.cc:1403] T 20629783689c4296afb55366d9ad5f6c P ad362df39b114ec3a3a419128097b362: Time spent bootstrapping tablet: real 0.209s	user 0.014s	sys 0.005s
I20260709 12:14:47.575243 24357 raft_consensus.cc:3060] T 7943c68d21d449dba2d1dca6ddde5820 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:47.578897 24479 raft_consensus.cc:359] T 20629783689c4296afb55366d9ad5f6c P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:47.580819 24479 raft_consensus.cc:385] T 20629783689c4296afb55366d9ad5f6c P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:47.581135 24479 raft_consensus.cc:740] T 20629783689c4296afb55366d9ad5f6c P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad362df39b114ec3a3a419128097b362, State: Initialized, Role: FOLLOWER
I20260709 12:14:47.582293 24482 tablet_bootstrap.cc:654] T ed15c59b19ff49d3a39bf5b5abf8b69a P 9bf3da5b54ef4a1ea1cee60f02ea2883: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:47.581895 24479 consensus_queue.cc:260] T 20629783689c4296afb55366d9ad5f6c P ad362df39b114ec3a3a419128097b362 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:47.592093 24357 raft_consensus.cc:2468] T 7943c68d21d449dba2d1dca6ddde5820 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 2.
I20260709 12:14:47.593050 24479 ts_tablet_manager.cc:1434] T 20629783689c4296afb55366d9ad5f6c P ad362df39b114ec3a3a419128097b362: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:14:47.595217 24479 tablet_bootstrap.cc:492] T ed15c59b19ff49d3a39bf5b5abf8b69a P ad362df39b114ec3a3a419128097b362: Bootstrap starting.
I20260709 12:14:47.592983 24281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7943c68d21d449dba2d1dca6ddde5820" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054"
I20260709 12:14:47.601193 24281 raft_consensus.cc:3060] T 7943c68d21d449dba2d1dca6ddde5820 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:47.601617 24482 tablet_bootstrap.cc:492] T ed15c59b19ff49d3a39bf5b5abf8b69a P 9bf3da5b54ef4a1ea1cee60f02ea2883: No bootstrap required, opened a new log
I20260709 12:14:47.602515 24482 ts_tablet_manager.cc:1403] T ed15c59b19ff49d3a39bf5b5abf8b69a P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.076s	user 0.008s	sys 0.006s
I20260709 12:14:47.597268 24175 leader_election.cc:304] T 7943c68d21d449dba2d1dca6ddde5820 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, aa14caefbdaa47b09abf91881635ba96; no voters: 
I20260709 12:14:47.606426 24636 raft_consensus.cc:2804] T 7943c68d21d449dba2d1dca6ddde5820 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:47.607193 24636 raft_consensus.cc:697] T 7943c68d21d449dba2d1dca6ddde5820 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 LEADER]: Becoming Leader. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Running, Role: LEADER
I20260709 12:14:47.608222 24636 consensus_queue.cc:237] T 7943c68d21d449dba2d1dca6ddde5820 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:47.600185 24478 tablet_bootstrap.cc:654] T 6af96d3f7393445f8b7edb30a26a6f65 P cf2d8294ae68482ca4ffa8be051ad054: Neither blocks nor log segments found. Creating new log.
W20260709 12:14:47.617040 24399 consensus_peers.cc:597] T 6af96d3f7393445f8b7edb30a26a6f65 P ad362df39b114ec3a3a419128097b362 -> Peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Couldn't send request to peer cf2d8294ae68482ca4ffa8be051ad054. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:47.618091 24356 raft_consensus.cc:3060] T a18e73ef976b49f0878423c0b3e6e6f2 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:47.624640 24482 raft_consensus.cc:359] T ed15c59b19ff49d3a39bf5b5abf8b69a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:47.625877 24482 raft_consensus.cc:385] T ed15c59b19ff49d3a39bf5b5abf8b69a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:47.626319 24482 raft_consensus.cc:740] T ed15c59b19ff49d3a39bf5b5abf8b69a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:14:47.636090 24563 consensus_queue.cc:1048] T e05eec364f764114bdb814096b9bf0ce P ad362df39b114ec3a3a419128097b362 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:47.639119 24281 raft_consensus.cc:2468] T 7943c68d21d449dba2d1dca6ddde5820 P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 2.
I20260709 12:14:47.641156 24482 consensus_queue.cc:260] T ed15c59b19ff49d3a39bf5b5abf8b69a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:47.641670 24479 tablet_bootstrap.cc:654] T ed15c59b19ff49d3a39bf5b5abf8b69a P ad362df39b114ec3a3a419128097b362: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:47.647918 24481 tablet_bootstrap.cc:492] T 20629783689c4296afb55366d9ad5f6c P aa14caefbdaa47b09abf91881635ba96: No bootstrap required, opened a new log
I20260709 12:14:47.648552 24481 ts_tablet_manager.cc:1403] T 20629783689c4296afb55366d9ad5f6c P aa14caefbdaa47b09abf91881635ba96: Time spent bootstrapping tablet: real 0.100s	user 0.033s	sys 0.021s
I20260709 12:14:47.650274 24478 tablet_bootstrap.cc:492] T 6af96d3f7393445f8b7edb30a26a6f65 P cf2d8294ae68482ca4ffa8be051ad054: No bootstrap required, opened a new log
I20260709 12:14:47.650872 24478 ts_tablet_manager.cc:1403] T 6af96d3f7393445f8b7edb30a26a6f65 P cf2d8294ae68482ca4ffa8be051ad054: Time spent bootstrapping tablet: real 0.090s	user 0.012s	sys 0.008s
I20260709 12:14:47.653357 24482 ts_tablet_manager.cc:1434] T ed15c59b19ff49d3a39bf5b5abf8b69a P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.050s	user 0.010s	sys 0.000s
I20260709 12:14:47.654484 24482 tablet_bootstrap.cc:492] T 628105dfc534451285d72f9e17f5d4f3 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:14:47.655174 24478 raft_consensus.cc:359] T 6af96d3f7393445f8b7edb30a26a6f65 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:47.655988 24478 raft_consensus.cc:385] T 6af96d3f7393445f8b7edb30a26a6f65 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:47.656481 24478 raft_consensus.cc:740] T 6af96d3f7393445f8b7edb30a26a6f65 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Initialized, Role: FOLLOWER
I20260709 12:14:47.661746 24481 raft_consensus.cc:359] T 20629783689c4296afb55366d9ad5f6c P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:47.662922 24481 raft_consensus.cc:385] T 20629783689c4296afb55366d9ad5f6c P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:47.663317 24481 raft_consensus.cc:740] T 20629783689c4296afb55366d9ad5f6c P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Initialized, Role: FOLLOWER
I20260709 12:14:47.663966 24478 consensus_queue.cc:260] T 6af96d3f7393445f8b7edb30a26a6f65 P cf2d8294ae68482ca4ffa8be051ad054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:47.664170 24481 consensus_queue.cc:260] T 20629783689c4296afb55366d9ad5f6c P aa14caefbdaa47b09abf91881635ba96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:47.668154 24481 ts_tablet_manager.cc:1434] T 20629783689c4296afb55366d9ad5f6c P aa14caefbdaa47b09abf91881635ba96: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 12:14:47.670746 24478 ts_tablet_manager.cc:1434] T 6af96d3f7393445f8b7edb30a26a6f65 P cf2d8294ae68482ca4ffa8be051ad054: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.001s
I20260709 12:14:47.671072 24482 tablet_bootstrap.cc:654] T 628105dfc534451285d72f9e17f5d4f3 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:47.671777 24481 tablet_bootstrap.cc:492] T ed15c59b19ff49d3a39bf5b5abf8b69a P aa14caefbdaa47b09abf91881635ba96: Bootstrap starting.
I20260709 12:14:47.681954 24478 tablet_bootstrap.cc:492] T 085a04f8ed724f82bc12490bbb1ceea7 P cf2d8294ae68482ca4ffa8be051ad054: Bootstrap starting.
I20260709 12:14:47.687747 24105 catalog_manager.cc:5697] T a18e73ef976b49f0878423c0b3e6e6f2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193). New cstate: current_term: 1 leader_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:47.698135 24636 raft_consensus.cc:493] T 085a04f8ed724f82bc12490bbb1ceea7 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.699029 24636 raft_consensus.cc:515] T 085a04f8ed724f82bc12490bbb1ceea7 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:47.703570 24429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a04f8ed724f82bc12490bbb1ceea7" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
W20260709 12:14:47.708818 24174 leader_election.cc:343] T 085a04f8ed724f82bc12490bbb1ceea7 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:47.710084 24636 leader_election.cc:290] T 085a04f8ed724f82bc12490bbb1ceea7 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:14:47.710177 24637 raft_consensus.cc:493] T 20629783689c4296afb55366d9ad5f6c P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.711179 24637 raft_consensus.cc:515] T 20629783689c4296afb55366d9ad5f6c P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:47.713917 24637 leader_election.cc:290] T 20629783689c4296afb55366d9ad5f6c P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:14:47.715667 24281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20629783689c4296afb55366d9ad5f6c" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:47.718909 24560 consensus_queue.cc:1048] T 9c40e590be9d4c3eac0ddd7f96278894 P aa14caefbdaa47b09abf91881635ba96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:47.721284 24284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a04f8ed724f82bc12490bbb1ceea7" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:47.725051 24281 raft_consensus.cc:2468] T 20629783689c4296afb55366d9ad5f6c P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa14caefbdaa47b09abf91881635ba96 in term 0.
W20260709 12:14:47.725425 24176 leader_election.cc:343] T 085a04f8ed724f82bc12490bbb1ceea7 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:47.726075 24176 leader_election.cc:304] T 085a04f8ed724f82bc12490bbb1ceea7 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883; no voters: ad362df39b114ec3a3a419128097b362, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:14:47.727881 24325 leader_election.cc:304] T 20629783689c4296afb55366d9ad5f6c P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, cf2d8294ae68482ca4ffa8be051ad054; no voters: 
I20260709 12:14:47.727873 24513 raft_consensus.cc:2749] T 085a04f8ed724f82bc12490bbb1ceea7 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:47.729213 24637 raft_consensus.cc:2804] T 20629783689c4296afb55366d9ad5f6c P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:47.729645 24637 raft_consensus.cc:493] T 20629783689c4296afb55366d9ad5f6c P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:47.730661 24637 raft_consensus.cc:3060] T 20629783689c4296afb55366d9ad5f6c P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:47.738596 24481 tablet_bootstrap.cc:654] T ed15c59b19ff49d3a39bf5b5abf8b69a P aa14caefbdaa47b09abf91881635ba96: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:47.737030 24478 tablet_bootstrap.cc:654] T 085a04f8ed724f82bc12490bbb1ceea7 P cf2d8294ae68482ca4ffa8be051ad054: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:47.754158 24586 consensus_queue.cc:1048] T e05eec364f764114bdb814096b9bf0ce P ad362df39b114ec3a3a419128097b362 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:47.729662 24429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20629783689c4296afb55366d9ad5f6c" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:47.758126 24618 raft_consensus.cc:493] T 3e977ea0483d4c029394b273e7c4e90f P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.760641 24618 raft_consensus.cc:515] T 3e977ea0483d4c029394b273e7c4e90f P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:47.764106 24429 raft_consensus.cc:2468] T 20629783689c4296afb55366d9ad5f6c P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa14caefbdaa47b09abf91881635ba96 in term 0.
I20260709 12:14:47.774669 24482 tablet_bootstrap.cc:492] T 628105dfc534451285d72f9e17f5d4f3 P 9bf3da5b54ef4a1ea1cee60f02ea2883: No bootstrap required, opened a new log
I20260709 12:14:47.775353 24482 ts_tablet_manager.cc:1403] T 628105dfc534451285d72f9e17f5d4f3 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.121s	user 0.033s	sys 0.012s
I20260709 12:14:47.776962 24657 raft_consensus.cc:493] T 6af96d3f7393445f8b7edb30a26a6f65 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.779484 24657 raft_consensus.cc:515] T 6af96d3f7393445f8b7edb30a26a6f65 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:47.782954 24433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6af96d3f7393445f8b7edb30a26a6f65" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:47.783277 24208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6af96d3f7393445f8b7edb30a26a6f65" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
I20260709 12:14:47.785197 24248 leader_election.cc:304] T 6af96d3f7393445f8b7edb30a26a6f65 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf2d8294ae68482ca4ffa8be051ad054; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, ad362df39b114ec3a3a419128097b362
I20260709 12:14:47.785633 24657 leader_election.cc:290] T 6af96d3f7393445f8b7edb30a26a6f65 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:47.786491 24638 raft_consensus.cc:2749] T 6af96d3f7393445f8b7edb30a26a6f65 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:47.788115 24479 tablet_bootstrap.cc:492] T ed15c59b19ff49d3a39bf5b5abf8b69a P ad362df39b114ec3a3a419128097b362: No bootstrap required, opened a new log
I20260709 12:14:47.788626 24479 ts_tablet_manager.cc:1403] T ed15c59b19ff49d3a39bf5b5abf8b69a P ad362df39b114ec3a3a419128097b362: Time spent bootstrapping tablet: real 0.194s	user 0.024s	sys 0.013s
I20260709 12:14:47.796638 24284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e977ea0483d4c029394b273e7c4e90f" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:47.797189 24618 leader_election.cc:290] T 3e977ea0483d4c029394b273e7c4e90f P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:14:47.798169 24356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e977ea0483d4c029394b273e7c4e90f" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
W20260709 12:14:47.800367 24398 leader_election.cc:343] T 3e977ea0483d4c029394b273e7c4e90f P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:47.802979 24399 leader_election.cc:343] T 3e977ea0483d4c029394b273e7c4e90f P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:47.803493 24399 leader_election.cc:304] T 3e977ea0483d4c029394b273e7c4e90f P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad362df39b114ec3a3a419128097b362; no voters: aa14caefbdaa47b09abf91881635ba96, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:14:47.805310 24618 raft_consensus.cc:2749] T 3e977ea0483d4c029394b273e7c4e90f P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:47.807157 24479 raft_consensus.cc:359] T ed15c59b19ff49d3a39bf5b5abf8b69a P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:47.809504 24479 raft_consensus.cc:385] T ed15c59b19ff49d3a39bf5b5abf8b69a P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:47.808972 24637 raft_consensus.cc:515] T 20629783689c4296afb55366d9ad5f6c P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:47.812098 24637 leader_election.cc:290] T 20629783689c4296afb55366d9ad5f6c P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 election: Requested vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:14:47.801285 24482 raft_consensus.cc:359] T 628105dfc534451285d72f9e17f5d4f3 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:47.812757 24482 raft_consensus.cc:385] T 628105dfc534451285d72f9e17f5d4f3 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:47.813159 24482 raft_consensus.cc:740] T 628105dfc534451285d72f9e17f5d4f3 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:14:47.814060 24284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20629783689c4296afb55366d9ad5f6c" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054"
I20260709 12:14:47.814225 24482 consensus_queue.cc:260] T 628105dfc534451285d72f9e17f5d4f3 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:47.814867 24284 raft_consensus.cc:3060] T 20629783689c4296afb55366d9ad5f6c P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:47.817025 24482 ts_tablet_manager.cc:1434] T 628105dfc534451285d72f9e17f5d4f3 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.000s
I20260709 12:14:47.818259 24482 tablet_bootstrap.cc:492] T 318c217e16874865bd6dff6bd4d8cd4f P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:14:47.818560 24429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20629783689c4296afb55366d9ad5f6c" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362"
I20260709 12:14:47.819255 24429 raft_consensus.cc:3060] T 20629783689c4296afb55366d9ad5f6c P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:47.822175 24479 raft_consensus.cc:740] T ed15c59b19ff49d3a39bf5b5abf8b69a P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad362df39b114ec3a3a419128097b362, State: Initialized, Role: FOLLOWER
I20260709 12:14:47.823889 24479 consensus_queue.cc:260] T ed15c59b19ff49d3a39bf5b5abf8b69a P ad362df39b114ec3a3a419128097b362 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:47.827852 24479 ts_tablet_manager.cc:1434] T ed15c59b19ff49d3a39bf5b5abf8b69a P ad362df39b114ec3a3a419128097b362: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.003s
I20260709 12:14:47.830644 24478 tablet_bootstrap.cc:492] T 085a04f8ed724f82bc12490bbb1ceea7 P cf2d8294ae68482ca4ffa8be051ad054: No bootstrap required, opened a new log
I20260709 12:14:47.831363 24478 ts_tablet_manager.cc:1403] T 085a04f8ed724f82bc12490bbb1ceea7 P cf2d8294ae68482ca4ffa8be051ad054: Time spent bootstrapping tablet: real 0.157s	user 0.019s	sys 0.002s
I20260709 12:14:47.835662 24478 raft_consensus.cc:359] T 085a04f8ed724f82bc12490bbb1ceea7 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:47.836447 24478 raft_consensus.cc:385] T 085a04f8ed724f82bc12490bbb1ceea7 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:47.837101 24481 tablet_bootstrap.cc:492] T ed15c59b19ff49d3a39bf5b5abf8b69a P aa14caefbdaa47b09abf91881635ba96: No bootstrap required, opened a new log
I20260709 12:14:47.837715 24481 ts_tablet_manager.cc:1403] T ed15c59b19ff49d3a39bf5b5abf8b69a P aa14caefbdaa47b09abf91881635ba96: Time spent bootstrapping tablet: real 0.169s	user 0.023s	sys 0.003s
I20260709 12:14:47.841069 24479 tablet_bootstrap.cc:492] T 085a04f8ed724f82bc12490bbb1ceea7 P ad362df39b114ec3a3a419128097b362: Bootstrap starting.
I20260709 12:14:47.842832 24620 consensus_queue.cc:1048] T 9c40e590be9d4c3eac0ddd7f96278894 P aa14caefbdaa47b09abf91881635ba96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:47.836751 24478 raft_consensus.cc:740] T 085a04f8ed724f82bc12490bbb1ceea7 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Initialized, Role: FOLLOWER
I20260709 12:14:47.847432 24482 tablet_bootstrap.cc:654] T 318c217e16874865bd6dff6bd4d8cd4f P 9bf3da5b54ef4a1ea1cee60f02ea2883: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:47.850100 24478 consensus_queue.cc:260] T 085a04f8ed724f82bc12490bbb1ceea7 P cf2d8294ae68482ca4ffa8be051ad054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:47.851953 24636 consensus_queue.cc:1048] T ab8dff607862460ea0fcd88422c31ac2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:47.842830 24104 catalog_manager.cc:5697] T 6af96d3f7393445f8b7edb30a26a6f65 P ad362df39b114ec3a3a419128097b362 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad362df39b114ec3a3a419128097b362 (127.12.56.196). New cstate: current_term: 1 leader_uuid: "ad362df39b114ec3a3a419128097b362" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:47.854671 24104 catalog_manager.cc:5697] T e05eec364f764114bdb814096b9bf0ce P ad362df39b114ec3a3a419128097b362 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad362df39b114ec3a3a419128097b362 (127.12.56.196). New cstate: current_term: 1 leader_uuid: "ad362df39b114ec3a3a419128097b362" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:47.841252 24481 raft_consensus.cc:359] T ed15c59b19ff49d3a39bf5b5abf8b69a P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:47.856626 24479 tablet_bootstrap.cc:654] T 085a04f8ed724f82bc12490bbb1ceea7 P ad362df39b114ec3a3a419128097b362: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:47.863739 24481 raft_consensus.cc:385] T ed15c59b19ff49d3a39bf5b5abf8b69a P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:47.882339 24513 consensus_queue.cc:1048] T ab8dff607862460ea0fcd88422c31ac2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:47.882730 24481 raft_consensus.cc:740] T ed15c59b19ff49d3a39bf5b5abf8b69a P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Initialized, Role: FOLLOWER
I20260709 12:14:47.883548 24481 consensus_queue.cc:260] T ed15c59b19ff49d3a39bf5b5abf8b69a P aa14caefbdaa47b09abf91881635ba96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:47.886248 24481 ts_tablet_manager.cc:1434] T ed15c59b19ff49d3a39bf5b5abf8b69a P aa14caefbdaa47b09abf91881635ba96: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.000s
I20260709 12:14:47.867779 24478 ts_tablet_manager.cc:1434] T 085a04f8ed724f82bc12490bbb1ceea7 P cf2d8294ae68482ca4ffa8be051ad054: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.001s
I20260709 12:14:47.889859 24478 tablet_bootstrap.cc:492] T 27de4156b2e24143a2f301fbefc7cb23 P cf2d8294ae68482ca4ffa8be051ad054: Bootstrap starting.
I20260709 12:14:47.895161 24481 tablet_bootstrap.cc:492] T 27de4156b2e24143a2f301fbefc7cb23 P aa14caefbdaa47b09abf91881635ba96: Bootstrap starting.
I20260709 12:14:47.872370 24284 raft_consensus.cc:2468] T 20629783689c4296afb55366d9ad5f6c P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa14caefbdaa47b09abf91881635ba96 in term 1.
I20260709 12:14:47.905125 24325 leader_election.cc:304] T 20629783689c4296afb55366d9ad5f6c P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, cf2d8294ae68482ca4ffa8be051ad054; no voters: 
I20260709 12:14:47.906294 24637 raft_consensus.cc:2804] T 20629783689c4296afb55366d9ad5f6c P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:47.906953 24637 raft_consensus.cc:697] T 20629783689c4296afb55366d9ad5f6c P aa14caefbdaa47b09abf91881635ba96 [term 1 LEADER]: Becoming Leader. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Running, Role: LEADER
I20260709 12:14:47.908004 24637 consensus_queue.cc:237] T 20629783689c4296afb55366d9ad5f6c P aa14caefbdaa47b09abf91881635ba96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:47.881714 24106 catalog_manager.cc:5697] T ab8dff607862460ea0fcd88422c31ac2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193). New cstate: current_term: 1 leader_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:47.911209 24478 tablet_bootstrap.cc:654] T 27de4156b2e24143a2f301fbefc7cb23 P cf2d8294ae68482ca4ffa8be051ad054: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:47.912140 24106 catalog_manager.cc:5697] T 7943c68d21d449dba2d1dca6ddde5820 P 9bf3da5b54ef4a1ea1cee60f02ea2883 reported cstate change: term changed from 0 to 2, leader changed from <none> to 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193). New cstate: current_term: 2 leader_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:47.882097 24107 catalog_manager.cc:5697] T 9c40e590be9d4c3eac0ddd7f96278894 P cf2d8294ae68482ca4ffa8be051ad054 reported cstate change: term changed from 0 to 1, leader changed from <none> to aa14caefbdaa47b09abf91881635ba96 (127.12.56.195). New cstate: current_term: 1 leader_uuid: "aa14caefbdaa47b09abf91881635ba96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } }
I20260709 12:14:47.861737 24429 raft_consensus.cc:2468] T 20629783689c4296afb55366d9ad5f6c P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa14caefbdaa47b09abf91881635ba96 in term 1.
I20260709 12:14:47.921195 24482 tablet_bootstrap.cc:492] T 318c217e16874865bd6dff6bd4d8cd4f P 9bf3da5b54ef4a1ea1cee60f02ea2883: No bootstrap required, opened a new log
I20260709 12:14:47.923987 24482 ts_tablet_manager.cc:1403] T 318c217e16874865bd6dff6bd4d8cd4f P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.106s	user 0.023s	sys 0.008s
I20260709 12:14:47.927784 24481 tablet_bootstrap.cc:654] T 27de4156b2e24143a2f301fbefc7cb23 P aa14caefbdaa47b09abf91881635ba96: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:47.928812 24482 raft_consensus.cc:359] T 318c217e16874865bd6dff6bd4d8cd4f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:47.929760 24482 raft_consensus.cc:385] T 318c217e16874865bd6dff6bd4d8cd4f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:47.930145 24482 raft_consensus.cc:740] T 318c217e16874865bd6dff6bd4d8cd4f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:14:47.931017 24482 consensus_queue.cc:260] T 318c217e16874865bd6dff6bd4d8cd4f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:47.932770 24479 tablet_bootstrap.cc:492] T 085a04f8ed724f82bc12490bbb1ceea7 P ad362df39b114ec3a3a419128097b362: No bootstrap required, opened a new log
I20260709 12:14:47.933429 24479 ts_tablet_manager.cc:1403] T 085a04f8ed724f82bc12490bbb1ceea7 P ad362df39b114ec3a3a419128097b362: Time spent bootstrapping tablet: real 0.093s	user 0.020s	sys 0.011s
I20260709 12:14:47.936810 24479 raft_consensus.cc:359] T 085a04f8ed724f82bc12490bbb1ceea7 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:47.937745 24479 raft_consensus.cc:385] T 085a04f8ed724f82bc12490bbb1ceea7 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:47.938112 24479 raft_consensus.cc:740] T 085a04f8ed724f82bc12490bbb1ceea7 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad362df39b114ec3a3a419128097b362, State: Initialized, Role: FOLLOWER
I20260709 12:14:47.940887 24482 ts_tablet_manager.cc:1434] T 318c217e16874865bd6dff6bd4d8cd4f P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:14:47.942293 24482 tablet_bootstrap.cc:492] T fd6e20f3c92f4498a8c272b807797efa P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:14:47.949348 24478 tablet_bootstrap.cc:492] T 27de4156b2e24143a2f301fbefc7cb23 P cf2d8294ae68482ca4ffa8be051ad054: No bootstrap required, opened a new log
I20260709 12:14:47.950115 24478 ts_tablet_manager.cc:1403] T 27de4156b2e24143a2f301fbefc7cb23 P cf2d8294ae68482ca4ffa8be051ad054: Time spent bootstrapping tablet: real 0.060s	user 0.011s	sys 0.008s
I20260709 12:14:47.950135 24479 consensus_queue.cc:260] T 085a04f8ed724f82bc12490bbb1ceea7 P ad362df39b114ec3a3a419128097b362 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:47.953246 24479 ts_tablet_manager.cc:1434] T 085a04f8ed724f82bc12490bbb1ceea7 P ad362df39b114ec3a3a419128097b362: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.003s
I20260709 12:14:47.953513 24478 raft_consensus.cc:359] T 27de4156b2e24143a2f301fbefc7cb23 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:47.954361 24478 raft_consensus.cc:385] T 27de4156b2e24143a2f301fbefc7cb23 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:47.954535 24479 tablet_bootstrap.cc:492] T 318c217e16874865bd6dff6bd4d8cd4f P ad362df39b114ec3a3a419128097b362: Bootstrap starting.
I20260709 12:14:47.954689 24478 raft_consensus.cc:740] T 27de4156b2e24143a2f301fbefc7cb23 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Initialized, Role: FOLLOWER
I20260709 12:14:47.957296 24478 consensus_queue.cc:260] T 27de4156b2e24143a2f301fbefc7cb23 P cf2d8294ae68482ca4ffa8be051ad054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:47.957947 24482 tablet_bootstrap.cc:654] T fd6e20f3c92f4498a8c272b807797efa P 9bf3da5b54ef4a1ea1cee60f02ea2883: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:47.960289 24478 ts_tablet_manager.cc:1434] T 27de4156b2e24143a2f301fbefc7cb23 P cf2d8294ae68482ca4ffa8be051ad054: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:14:47.961567 24478 tablet_bootstrap.cc:492] T 3e977ea0483d4c029394b273e7c4e90f P cf2d8294ae68482ca4ffa8be051ad054: Bootstrap starting.
I20260709 12:14:47.965312 24636 raft_consensus.cc:493] T 628105dfc534451285d72f9e17f5d4f3 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.966236 24479 tablet_bootstrap.cc:654] T 318c217e16874865bd6dff6bd4d8cd4f P ad362df39b114ec3a3a419128097b362: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:47.965965 24636 raft_consensus.cc:515] T 628105dfc534451285d72f9e17f5d4f3 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:47.970079 24356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628105dfc534451285d72f9e17f5d4f3" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:47.972548 24284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628105dfc534451285d72f9e17f5d4f3" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
W20260709 12:14:47.972977 24175 leader_election.cc:343] T 628105dfc534451285d72f9e17f5d4f3 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:47.973713 24636 leader_election.cc:290] T 628105dfc534451285d72f9e17f5d4f3 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
W20260709 12:14:47.974725 24176 leader_election.cc:343] T 628105dfc534451285d72f9e17f5d4f3 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:47.975317 24176 leader_election.cc:304] T 628105dfc534451285d72f9e17f5d4f3 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883; no voters: aa14caefbdaa47b09abf91881635ba96, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:14:47.977464 24636 raft_consensus.cc:2749] T 628105dfc534451285d72f9e17f5d4f3 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:47.978394 24478 tablet_bootstrap.cc:654] T 3e977ea0483d4c029394b273e7c4e90f P cf2d8294ae68482ca4ffa8be051ad054: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:47.989723 24552 raft_consensus.cc:493] T 085a04f8ed724f82bc12490bbb1ceea7 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.990412 24552 raft_consensus.cc:515] T 085a04f8ed724f82bc12490bbb1ceea7 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:47.991966 24478 tablet_bootstrap.cc:492] T 3e977ea0483d4c029394b273e7c4e90f P cf2d8294ae68482ca4ffa8be051ad054: No bootstrap required, opened a new log
I20260709 12:14:47.992575 24478 ts_tablet_manager.cc:1403] T 3e977ea0483d4c029394b273e7c4e90f P cf2d8294ae68482ca4ffa8be051ad054: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.008s
I20260709 12:14:47.993680 24552 leader_election.cc:290] T 085a04f8ed724f82bc12490bbb1ceea7 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:47.993961 24429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a04f8ed724f82bc12490bbb1ceea7" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:47.994346 24210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a04f8ed724f82bc12490bbb1ceea7" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
I20260709 12:14:47.994889 24482 tablet_bootstrap.cc:492] T fd6e20f3c92f4498a8c272b807797efa P 9bf3da5b54ef4a1ea1cee60f02ea2883: No bootstrap required, opened a new log
I20260709 12:14:47.994788 24429 raft_consensus.cc:2468] T 085a04f8ed724f82bc12490bbb1ceea7 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 0.
I20260709 12:14:47.995203 24210 raft_consensus.cc:2468] T 085a04f8ed724f82bc12490bbb1ceea7 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 0.
I20260709 12:14:47.995512 24482 ts_tablet_manager.cc:1403] T fd6e20f3c92f4498a8c272b807797efa P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.053s	user 0.008s	sys 0.005s
I20260709 12:14:47.996287 24249 leader_election.cc:304] T 085a04f8ed724f82bc12490bbb1ceea7 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad362df39b114ec3a3a419128097b362, cf2d8294ae68482ca4ffa8be051ad054; no voters: 
I20260709 12:14:47.999652 24478 raft_consensus.cc:359] T 3e977ea0483d4c029394b273e7c4e90f P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:48.000876 24565 raft_consensus.cc:2804] T 085a04f8ed724f82bc12490bbb1ceea7 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:48.001395 24565 raft_consensus.cc:493] T 085a04f8ed724f82bc12490bbb1ceea7 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:48.002439 24565 raft_consensus.cc:3060] T 085a04f8ed724f82bc12490bbb1ceea7 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:48.000468 24478 raft_consensus.cc:385] T 3e977ea0483d4c029394b273e7c4e90f P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:48.008687 24482 raft_consensus.cc:359] T fd6e20f3c92f4498a8c272b807797efa P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:48.009543 24482 raft_consensus.cc:385] T fd6e20f3c92f4498a8c272b807797efa P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:48.009868 24482 raft_consensus.cc:740] T fd6e20f3c92f4498a8c272b807797efa P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:14:48.010602 24482 consensus_queue.cc:260] T fd6e20f3c92f4498a8c272b807797efa P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:48.006547 24478 raft_consensus.cc:740] T 3e977ea0483d4c029394b273e7c4e90f P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Initialized, Role: FOLLOWER
I20260709 12:14:48.016178 24513 raft_consensus.cc:493] T ed15c59b19ff49d3a39bf5b5abf8b69a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:48.016804 24513 raft_consensus.cc:515] T ed15c59b19ff49d3a39bf5b5abf8b69a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:48.017706 24482 ts_tablet_manager.cc:1434] T fd6e20f3c92f4498a8c272b807797efa P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.005s
I20260709 12:14:48.018100 24565 raft_consensus.cc:515] T 085a04f8ed724f82bc12490bbb1ceea7 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:48.023094 24429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed15c59b19ff49d3a39bf5b5abf8b69a" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:48.019279 24478 consensus_queue.cc:260] T 3e977ea0483d4c029394b273e7c4e90f P cf2d8294ae68482ca4ffa8be051ad054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:48.020843 24356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed15c59b19ff49d3a39bf5b5abf8b69a" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:48.024597 24565 leader_election.cc:290] T 085a04f8ed724f82bc12490bbb1ceea7 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 election: Requested vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:48.024638 24356 raft_consensus.cc:2468] T ed15c59b19ff49d3a39bf5b5abf8b69a P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 0.
I20260709 12:14:48.026706 24478 ts_tablet_manager.cc:1434] T 3e977ea0483d4c029394b273e7c4e90f P cf2d8294ae68482ca4ffa8be051ad054: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.001s
I20260709 12:14:48.023756 24513 leader_election.cc:290] T ed15c59b19ff49d3a39bf5b5abf8b69a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:14:48.018930 24482 tablet_bootstrap.cc:492] T 5310371490a542269db28e29d7adfffa P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:14:48.027956 24478 tablet_bootstrap.cc:492] T 628105dfc534451285d72f9e17f5d4f3 P cf2d8294ae68482ca4ffa8be051ad054: Bootstrap starting.
I20260709 12:14:48.028636 24429 raft_consensus.cc:2468] T ed15c59b19ff49d3a39bf5b5abf8b69a P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 0.
I20260709 12:14:48.028609 24433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a04f8ed724f82bc12490bbb1ceea7" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362"
I20260709 12:14:48.029764 24433 raft_consensus.cc:3060] T 085a04f8ed724f82bc12490bbb1ceea7 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:48.031674 24175 leader_election.cc:304] T ed15c59b19ff49d3a39bf5b5abf8b69a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, aa14caefbdaa47b09abf91881635ba96; no voters: 
I20260709 12:14:48.031687 24210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a04f8ed724f82bc12490bbb1ceea7" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
I20260709 12:14:48.032786 24210 raft_consensus.cc:3060] T 085a04f8ed724f82bc12490bbb1ceea7 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:48.034950 24284 raft_consensus.cc:1275] T 7943c68d21d449dba2d1dca6ddde5820 P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Refusing update from remote peer 9bf3da5b54ef4a1ea1cee60f02ea2883: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:14:48.037971 24513 consensus_queue.cc:1048] T 7943c68d21d449dba2d1dca6ddde5820 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:48.033114 24636 raft_consensus.cc:2804] T ed15c59b19ff49d3a39bf5b5abf8b69a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:48.042146 24636 raft_consensus.cc:493] T ed15c59b19ff49d3a39bf5b5abf8b69a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:48.042631 24636 raft_consensus.cc:3060] T ed15c59b19ff49d3a39bf5b5abf8b69a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:48.042754 24433 raft_consensus.cc:2468] T 085a04f8ed724f82bc12490bbb1ceea7 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 1.
I20260709 12:14:48.044334 24249 leader_election.cc:304] T 085a04f8ed724f82bc12490bbb1ceea7 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad362df39b114ec3a3a419128097b362, cf2d8294ae68482ca4ffa8be051ad054; no voters: 
I20260709 12:14:48.046952 24478 tablet_bootstrap.cc:654] T 628105dfc534451285d72f9e17f5d4f3 P cf2d8294ae68482ca4ffa8be051ad054: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:48.051599 24552 raft_consensus.cc:2804] T 085a04f8ed724f82bc12490bbb1ceea7 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:48.051234 24104 catalog_manager.cc:5697] T 20629783689c4296afb55366d9ad5f6c P aa14caefbdaa47b09abf91881635ba96 reported cstate change: term changed from 0 to 1, leader changed from <none> to aa14caefbdaa47b09abf91881635ba96 (127.12.56.195). New cstate: current_term: 1 leader_uuid: "aa14caefbdaa47b09abf91881635ba96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:48.052204 24552 raft_consensus.cc:697] T 085a04f8ed724f82bc12490bbb1ceea7 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Becoming Leader. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Running, Role: LEADER
I20260709 12:14:48.052582 24210 raft_consensus.cc:2468] T 085a04f8ed724f82bc12490bbb1ceea7 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 1.
I20260709 12:14:48.053398 24552 consensus_queue.cc:237] T 085a04f8ed724f82bc12490bbb1ceea7 P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:48.056149 24481 tablet_bootstrap.cc:492] T 27de4156b2e24143a2f301fbefc7cb23 P aa14caefbdaa47b09abf91881635ba96: No bootstrap required, opened a new log
I20260709 12:14:48.056900 24481 ts_tablet_manager.cc:1403] T 27de4156b2e24143a2f301fbefc7cb23 P aa14caefbdaa47b09abf91881635ba96: Time spent bootstrapping tablet: real 0.170s	user 0.015s	sys 0.000s
I20260709 12:14:48.066824 24482 tablet_bootstrap.cc:654] T 5310371490a542269db28e29d7adfffa P 9bf3da5b54ef4a1ea1cee60f02ea2883: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:48.087288 24636 raft_consensus.cc:515] T ed15c59b19ff49d3a39bf5b5abf8b69a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:48.090750 24356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed15c59b19ff49d3a39bf5b5abf8b69a" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
I20260709 12:14:48.091495 24356 raft_consensus.cc:3060] T ed15c59b19ff49d3a39bf5b5abf8b69a P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:48.100832 24481 raft_consensus.cc:359] T 27de4156b2e24143a2f301fbefc7cb23 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:48.101742 24481 raft_consensus.cc:385] T 27de4156b2e24143a2f301fbefc7cb23 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:48.102097 24481 raft_consensus.cc:740] T 27de4156b2e24143a2f301fbefc7cb23 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Initialized, Role: FOLLOWER
I20260709 12:14:48.102988 24481 consensus_queue.cc:260] T 27de4156b2e24143a2f301fbefc7cb23 P aa14caefbdaa47b09abf91881635ba96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:48.105427 24481 ts_tablet_manager.cc:1434] T 27de4156b2e24143a2f301fbefc7cb23 P aa14caefbdaa47b09abf91881635ba96: Time spent starting tablet: real 0.048s	user 0.005s	sys 0.005s
I20260709 12:14:48.106443 24481 tablet_bootstrap.cc:492] T 3e977ea0483d4c029394b273e7c4e90f P aa14caefbdaa47b09abf91881635ba96: Bootstrap starting.
I20260709 12:14:48.106902 24433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed15c59b19ff49d3a39bf5b5abf8b69a" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362"
I20260709 12:14:48.107935 24433 raft_consensus.cc:3060] T ed15c59b19ff49d3a39bf5b5abf8b69a P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:48.101752 24356 raft_consensus.cc:2468] T ed15c59b19ff49d3a39bf5b5abf8b69a P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 1.
I20260709 12:14:48.111275 24175 leader_election.cc:304] T ed15c59b19ff49d3a39bf5b5abf8b69a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, aa14caefbdaa47b09abf91881635ba96; no voters: 
I20260709 12:14:48.112309 24513 raft_consensus.cc:2804] T ed15c59b19ff49d3a39bf5b5abf8b69a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:48.112886 24513 raft_consensus.cc:697] T ed15c59b19ff49d3a39bf5b5abf8b69a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 LEADER]: Becoming Leader. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Running, Role: LEADER
I20260709 12:14:48.113900 24513 consensus_queue.cc:237] T ed15c59b19ff49d3a39bf5b5abf8b69a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:48.117240 24565 raft_consensus.cc:493] T 3e977ea0483d4c029394b273e7c4e90f P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:48.117928 24565 raft_consensus.cc:515] T 3e977ea0483d4c029394b273e7c4e90f P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:48.120668 24565 leader_election.cc:290] T 3e977ea0483d4c029394b273e7c4e90f P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:14:48.121429 24481 tablet_bootstrap.cc:654] T 3e977ea0483d4c029394b273e7c4e90f P aa14caefbdaa47b09abf91881635ba96: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:48.121531 24636 leader_election.cc:290] T ed15c59b19ff49d3a39bf5b5abf8b69a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 election: Requested vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:14:48.124105 24429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e977ea0483d4c029394b273e7c4e90f" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:48.124945 24429 raft_consensus.cc:2468] T 3e977ea0483d4c029394b273e7c4e90f P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 0.
I20260709 12:14:48.126121 24357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e977ea0483d4c029394b273e7c4e90f" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
W20260709 12:14:48.127655 24250 leader_election.cc:343] T 3e977ea0483d4c029394b273e7c4e90f P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:48.128405 24249 leader_election.cc:304] T 3e977ea0483d4c029394b273e7c4e90f P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad362df39b114ec3a3a419128097b362, cf2d8294ae68482ca4ffa8be051ad054; no voters: aa14caefbdaa47b09abf91881635ba96
I20260709 12:14:48.129838 24565 raft_consensus.cc:2804] T 3e977ea0483d4c029394b273e7c4e90f P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:48.130326 24565 raft_consensus.cc:493] T 3e977ea0483d4c029394b273e7c4e90f P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:48.133949 24565 raft_consensus.cc:3060] T 3e977ea0483d4c029394b273e7c4e90f P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:48.151706 24433 raft_consensus.cc:2468] T ed15c59b19ff49d3a39bf5b5abf8b69a P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 1.
I20260709 12:14:48.161996 24356 raft_consensus.cc:1275] T 7943c68d21d449dba2d1dca6ddde5820 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Refusing update from remote peer 9bf3da5b54ef4a1ea1cee60f02ea2883: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:14:48.156832 24482 tablet_bootstrap.cc:492] T 5310371490a542269db28e29d7adfffa P 9bf3da5b54ef4a1ea1cee60f02ea2883: No bootstrap required, opened a new log
I20260709 12:14:48.164698 24482 ts_tablet_manager.cc:1403] T 5310371490a542269db28e29d7adfffa P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.146s	user 0.012s	sys 0.012s
I20260709 12:14:48.164824 24555 consensus_queue.cc:1048] T 7943c68d21d449dba2d1dca6ddde5820 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:48.159768 24481 tablet_bootstrap.cc:492] T 3e977ea0483d4c029394b273e7c4e90f P aa14caefbdaa47b09abf91881635ba96: No bootstrap required, opened a new log
I20260709 12:14:48.166935 24478 tablet_bootstrap.cc:492] T 628105dfc534451285d72f9e17f5d4f3 P cf2d8294ae68482ca4ffa8be051ad054: No bootstrap required, opened a new log
I20260709 12:14:48.167559 24478 ts_tablet_manager.cc:1403] T 628105dfc534451285d72f9e17f5d4f3 P cf2d8294ae68482ca4ffa8be051ad054: Time spent bootstrapping tablet: real 0.140s	user 0.021s	sys 0.005s
I20260709 12:14:48.168201 24482 raft_consensus.cc:359] T 5310371490a542269db28e29d7adfffa P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:48.168991 24482 raft_consensus.cc:385] T 5310371490a542269db28e29d7adfffa P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:48.169270 24482 raft_consensus.cc:740] T 5310371490a542269db28e29d7adfffa P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:14:48.176539 24637 raft_consensus.cc:493] T 27de4156b2e24143a2f301fbefc7cb23 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:48.171201 24478 raft_consensus.cc:359] T 628105dfc534451285d72f9e17f5d4f3 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:48.177452 24478 raft_consensus.cc:385] T 628105dfc534451285d72f9e17f5d4f3 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:48.177294 24637 raft_consensus.cc:515] T 27de4156b2e24143a2f301fbefc7cb23 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:48.178028 24478 raft_consensus.cc:740] T 628105dfc534451285d72f9e17f5d4f3 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Initialized, Role: FOLLOWER
I20260709 12:14:48.162149 24479 tablet_bootstrap.cc:492] T 318c217e16874865bd6dff6bd4d8cd4f P ad362df39b114ec3a3a419128097b362: No bootstrap required, opened a new log
I20260709 12:14:48.179000 24479 ts_tablet_manager.cc:1403] T 318c217e16874865bd6dff6bd4d8cd4f P ad362df39b114ec3a3a419128097b362: Time spent bootstrapping tablet: real 0.225s	user 0.034s	sys 0.053s
I20260709 12:14:48.179908 24637 leader_election.cc:290] T 27de4156b2e24143a2f301fbefc7cb23 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:14:48.181099 24210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27de4156b2e24143a2f301fbefc7cb23" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
I20260709 12:14:48.181893 24210 raft_consensus.cc:2468] T 27de4156b2e24143a2f301fbefc7cb23 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa14caefbdaa47b09abf91881635ba96 in term 0.
I20260709 12:14:48.182034 24281 raft_consensus.cc:3060] T 6af96d3f7393445f8b7edb30a26a6f65 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:48.186767 24284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27de4156b2e24143a2f301fbefc7cb23" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:48.187263 24565 raft_consensus.cc:515] T 3e977ea0483d4c029394b273e7c4e90f P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:48.188967 24322 leader_election.cc:304] T 27de4156b2e24143a2f301fbefc7cb23 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, aa14caefbdaa47b09abf91881635ba96; no voters: 
I20260709 12:14:48.187621 24284 raft_consensus.cc:2468] T 27de4156b2e24143a2f301fbefc7cb23 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa14caefbdaa47b09abf91881635ba96 in term 0.
I20260709 12:14:48.191694 24357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e977ea0483d4c029394b273e7c4e90f" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
I20260709 12:14:48.191793 24620 raft_consensus.cc:2804] T 27de4156b2e24143a2f301fbefc7cb23 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:48.192791 24620 raft_consensus.cc:493] T 27de4156b2e24143a2f301fbefc7cb23 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:48.193235 24620 raft_consensus.cc:3060] T 27de4156b2e24143a2f301fbefc7cb23 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:14:48.195567 24250 leader_election.cc:343] T 3e977ea0483d4c029394b273e7c4e90f P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:48.167001 24481 ts_tablet_manager.cc:1403] T 3e977ea0483d4c029394b273e7c4e90f P aa14caefbdaa47b09abf91881635ba96: Time spent bootstrapping tablet: real 0.061s	user 0.010s	sys 0.001s
I20260709 12:14:48.197189 24513 raft_consensus.cc:493] T fd6e20f3c92f4498a8c272b807797efa P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:48.197764 24513 raft_consensus.cc:515] T fd6e20f3c92f4498a8c272b807797efa P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:48.200274 24513 leader_election.cc:290] T fd6e20f3c92f4498a8c272b807797efa P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:14:48.179210 24478 consensus_queue.cc:260] T 628105dfc534451285d72f9e17f5d4f3 P cf2d8294ae68482ca4ffa8be051ad054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:48.202178 24357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6e20f3c92f4498a8c272b807797efa" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:48.203128 24479 raft_consensus.cc:359] T 318c217e16874865bd6dff6bd4d8cd4f P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:48.203663 24478 ts_tablet_manager.cc:1434] T 628105dfc534451285d72f9e17f5d4f3 P cf2d8294ae68482ca4ffa8be051ad054: Time spent starting tablet: real 0.036s	user 0.004s	sys 0.002s
I20260709 12:14:48.203917 24479 raft_consensus.cc:385] T 318c217e16874865bd6dff6bd4d8cd4f P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:14:48.203775 24175 leader_election.cc:343] T fd6e20f3c92f4498a8c272b807797efa P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:48.204365 24479 raft_consensus.cc:740] T 318c217e16874865bd6dff6bd4d8cd4f P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad362df39b114ec3a3a419128097b362, State: Initialized, Role: FOLLOWER
I20260709 12:14:48.205000 24433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6e20f3c92f4498a8c272b807797efa" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:48.204464 24104 catalog_manager.cc:5697] T ed15c59b19ff49d3a39bf5b5abf8b69a P 9bf3da5b54ef4a1ea1cee60f02ea2883 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193). New cstate: current_term: 1 leader_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:48.205353 24479 consensus_queue.cc:260] T 318c217e16874865bd6dff6bd4d8cd4f P ad362df39b114ec3a3a419128097b362 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
W20260709 12:14:48.206707 24174 leader_election.cc:343] T fd6e20f3c92f4498a8c272b807797efa P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:48.206352 24107 catalog_manager.cc:5697] T 085a04f8ed724f82bc12490bbb1ceea7 P cf2d8294ae68482ca4ffa8be051ad054 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194). New cstate: current_term: 1 leader_uuid: "cf2d8294ae68482ca4ffa8be051ad054" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:48.207217 24174 leader_election.cc:304] T fd6e20f3c92f4498a8c272b807797efa P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883; no voters: aa14caefbdaa47b09abf91881635ba96, ad362df39b114ec3a3a419128097b362
I20260709 12:14:48.207731 24479 ts_tablet_manager.cc:1434] T 318c217e16874865bd6dff6bd4d8cd4f P ad362df39b114ec3a3a419128097b362: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 12:14:48.208388 24620 raft_consensus.cc:515] T 27de4156b2e24143a2f301fbefc7cb23 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:48.210003 24636 raft_consensus.cc:2749] T fd6e20f3c92f4498a8c272b807797efa P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:48.210628 24620 leader_election.cc:290] T 27de4156b2e24143a2f301fbefc7cb23 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 election: Requested vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:14:48.211301 24565 leader_election.cc:290] T 3e977ea0483d4c029394b273e7c4e90f P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 election: Requested vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:14:48.212671 24479 tablet_bootstrap.cc:492] T 00b51df5a8ee448884a9f145559a5ea3 P ad362df39b114ec3a3a419128097b362: Bootstrap starting.
I20260709 12:14:48.217067 24433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e977ea0483d4c029394b273e7c4e90f" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362"
I20260709 12:14:48.218011 24433 raft_consensus.cc:3060] T 3e977ea0483d4c029394b273e7c4e90f P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:48.220203 24210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27de4156b2e24143a2f301fbefc7cb23" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
I20260709 12:14:48.220992 24210 raft_consensus.cc:3060] T 27de4156b2e24143a2f301fbefc7cb23 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:48.227246 24433 raft_consensus.cc:2468] T 3e977ea0483d4c029394b273e7c4e90f P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 1.
I20260709 12:14:48.228886 24249 leader_election.cc:304] T 3e977ea0483d4c029394b273e7c4e90f P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad362df39b114ec3a3a419128097b362, cf2d8294ae68482ca4ffa8be051ad054; no voters: aa14caefbdaa47b09abf91881635ba96
I20260709 12:14:48.230194 24284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27de4156b2e24143a2f301fbefc7cb23" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054"
I20260709 12:14:48.231326 24284 raft_consensus.cc:3060] T 27de4156b2e24143a2f301fbefc7cb23 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:48.233049 24479 tablet_bootstrap.cc:654] T 00b51df5a8ee448884a9f145559a5ea3 P ad362df39b114ec3a3a419128097b362: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:48.230434 24565 raft_consensus.cc:2804] T 3e977ea0483d4c029394b273e7c4e90f P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:48.238494 24210 raft_consensus.cc:2468] T 27de4156b2e24143a2f301fbefc7cb23 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa14caefbdaa47b09abf91881635ba96 in term 1.
I20260709 12:14:48.234149 24565 raft_consensus.cc:697] T 3e977ea0483d4c029394b273e7c4e90f P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Becoming Leader. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Running, Role: LEADER
I20260709 12:14:48.243093 24565 consensus_queue.cc:237] T 3e977ea0483d4c029394b273e7c4e90f P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:48.245959 24322 leader_election.cc:304] T 27de4156b2e24143a2f301fbefc7cb23 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, aa14caefbdaa47b09abf91881635ba96; no voters: 
I20260709 12:14:48.247118 24620 raft_consensus.cc:2804] T 27de4156b2e24143a2f301fbefc7cb23 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:48.247695 24620 raft_consensus.cc:697] T 27de4156b2e24143a2f301fbefc7cb23 P aa14caefbdaa47b09abf91881635ba96 [term 1 LEADER]: Becoming Leader. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Running, Role: LEADER
I20260709 12:14:48.248652 24620 consensus_queue.cc:237] T 27de4156b2e24143a2f301fbefc7cb23 P aa14caefbdaa47b09abf91881635ba96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:48.254392 24479 tablet_bootstrap.cc:492] T 00b51df5a8ee448884a9f145559a5ea3 P ad362df39b114ec3a3a419128097b362: No bootstrap required, opened a new log
I20260709 12:14:48.254988 24479 ts_tablet_manager.cc:1403] T 00b51df5a8ee448884a9f145559a5ea3 P ad362df39b114ec3a3a419128097b362: Time spent bootstrapping tablet: real 0.043s	user 0.013s	sys 0.001s
I20260709 12:14:48.258359 24479 raft_consensus.cc:359] T 00b51df5a8ee448884a9f145559a5ea3 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:48.259110 24479 raft_consensus.cc:385] T 00b51df5a8ee448884a9f145559a5ea3 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:48.259407 24479 raft_consensus.cc:740] T 00b51df5a8ee448884a9f145559a5ea3 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad362df39b114ec3a3a419128097b362, State: Initialized, Role: FOLLOWER
I20260709 12:14:48.260136 24479 consensus_queue.cc:260] T 00b51df5a8ee448884a9f145559a5ea3 P ad362df39b114ec3a3a419128097b362 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:48.209282 24481 raft_consensus.cc:359] T 3e977ea0483d4c029394b273e7c4e90f P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:48.261235 24481 raft_consensus.cc:385] T 3e977ea0483d4c029394b273e7c4e90f P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:48.261543 24481 raft_consensus.cc:740] T 3e977ea0483d4c029394b273e7c4e90f P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Initialized, Role: FOLLOWER
I20260709 12:14:48.262307 24481 consensus_queue.cc:260] T 3e977ea0483d4c029394b273e7c4e90f P aa14caefbdaa47b09abf91881635ba96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:48.264650 24481 ts_tablet_manager.cc:1434] T 3e977ea0483d4c029394b273e7c4e90f P aa14caefbdaa47b09abf91881635ba96: Time spent starting tablet: real 0.068s	user 0.004s	sys 0.002s
I20260709 12:14:48.265609 24481 tablet_bootstrap.cc:492] T 628105dfc534451285d72f9e17f5d4f3 P aa14caefbdaa47b09abf91881635ba96: Bootstrap starting.
I20260709 12:14:48.240312 24478 tablet_bootstrap.cc:492] T 5310371490a542269db28e29d7adfffa P cf2d8294ae68482ca4ffa8be051ad054: Bootstrap starting.
I20260709 12:14:48.273294 24479 ts_tablet_manager.cc:1434] T 00b51df5a8ee448884a9f145559a5ea3 P ad362df39b114ec3a3a419128097b362: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:14:48.279659 24481 tablet_bootstrap.cc:654] T 628105dfc534451285d72f9e17f5d4f3 P aa14caefbdaa47b09abf91881635ba96: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:48.279945 24479 tablet_bootstrap.cc:492] T fd6e20f3c92f4498a8c272b807797efa P ad362df39b114ec3a3a419128097b362: Bootstrap starting.
I20260709 12:14:48.211242 24482 consensus_queue.cc:260] T 5310371490a542269db28e29d7adfffa P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:48.269279 24284 raft_consensus.cc:2468] T 27de4156b2e24143a2f301fbefc7cb23 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa14caefbdaa47b09abf91881635ba96 in term 1.
I20260709 12:14:48.282429 24636 raft_consensus.cc:493] T 5310371490a542269db28e29d7adfffa P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:48.283620 24636 raft_consensus.cc:515] T 5310371490a542269db28e29d7adfffa P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:48.280431 24107 catalog_manager.cc:5697] T 3e977ea0483d4c029394b273e7c4e90f P cf2d8294ae68482ca4ffa8be051ad054 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194). New cstate: current_term: 1 leader_uuid: "cf2d8294ae68482ca4ffa8be051ad054" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:48.289585 24478 tablet_bootstrap.cc:654] T 5310371490a542269db28e29d7adfffa P cf2d8294ae68482ca4ffa8be051ad054: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:48.292814 24281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5310371490a542269db28e29d7adfffa" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
W20260709 12:14:48.298820 24176 leader_election.cc:343] T 5310371490a542269db28e29d7adfffa P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:48.302033 24479 tablet_bootstrap.cc:654] T fd6e20f3c92f4498a8c272b807797efa P ad362df39b114ec3a3a419128097b362: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:48.310698 24481 tablet_bootstrap.cc:492] T 628105dfc534451285d72f9e17f5d4f3 P aa14caefbdaa47b09abf91881635ba96: No bootstrap required, opened a new log
I20260709 12:14:48.311303 24481 ts_tablet_manager.cc:1403] T 628105dfc534451285d72f9e17f5d4f3 P aa14caefbdaa47b09abf91881635ba96: Time spent bootstrapping tablet: real 0.046s	user 0.009s	sys 0.022s
I20260709 12:14:48.311214 24356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5310371490a542269db28e29d7adfffa" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:48.312538 24636 leader_election.cc:290] T 5310371490a542269db28e29d7adfffa P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
W20260709 12:14:48.313098 24175 leader_election.cc:343] T 5310371490a542269db28e29d7adfffa P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:48.313673 24175 leader_election.cc:304] T 5310371490a542269db28e29d7adfffa P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883; no voters: aa14caefbdaa47b09abf91881635ba96, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:14:48.315014 24636 raft_consensus.cc:2749] T 5310371490a542269db28e29d7adfffa P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:48.314850 24481 raft_consensus.cc:359] T 628105dfc534451285d72f9e17f5d4f3 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:48.313133 24482 ts_tablet_manager.cc:1434] T 5310371490a542269db28e29d7adfffa P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.122s	user 0.005s	sys 0.003s
I20260709 12:14:48.315757 24481 raft_consensus.cc:385] T 628105dfc534451285d72f9e17f5d4f3 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:48.316346 24481 raft_consensus.cc:740] T 628105dfc534451285d72f9e17f5d4f3 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Initialized, Role: FOLLOWER
I20260709 12:14:48.318219 24479 tablet_bootstrap.cc:492] T fd6e20f3c92f4498a8c272b807797efa P ad362df39b114ec3a3a419128097b362: No bootstrap required, opened a new log
I20260709 12:14:48.317263 24481 consensus_queue.cc:260] T 628105dfc534451285d72f9e17f5d4f3 P aa14caefbdaa47b09abf91881635ba96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:48.317188 24482 tablet_bootstrap.cc:492] T 9cb931cb82d74add922e65a2ea3de34d P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:14:48.324654 24481 ts_tablet_manager.cc:1434] T 628105dfc534451285d72f9e17f5d4f3 P aa14caefbdaa47b09abf91881635ba96: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.001s
I20260709 12:14:48.325755 24481 tablet_bootstrap.cc:492] T fd6e20f3c92f4498a8c272b807797efa P aa14caefbdaa47b09abf91881635ba96: Bootstrap starting.
I20260709 12:14:48.322177 24479 ts_tablet_manager.cc:1403] T fd6e20f3c92f4498a8c272b807797efa P ad362df39b114ec3a3a419128097b362: Time spent bootstrapping tablet: real 0.042s	user 0.014s	sys 0.001s
I20260709 12:14:48.326658 24106 catalog_manager.cc:5697] T 27de4156b2e24143a2f301fbefc7cb23 P aa14caefbdaa47b09abf91881635ba96 reported cstate change: term changed from 0 to 1, leader changed from <none> to aa14caefbdaa47b09abf91881635ba96 (127.12.56.195). New cstate: current_term: 1 leader_uuid: "aa14caefbdaa47b09abf91881635ba96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:48.327927 24482 tablet_bootstrap.cc:654] T 9cb931cb82d74add922e65a2ea3de34d P 9bf3da5b54ef4a1ea1cee60f02ea2883: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:48.330400 24479 raft_consensus.cc:359] T fd6e20f3c92f4498a8c272b807797efa P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:48.338413 24479 raft_consensus.cc:385] T fd6e20f3c92f4498a8c272b807797efa P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:48.339048 24479 raft_consensus.cc:740] T fd6e20f3c92f4498a8c272b807797efa P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad362df39b114ec3a3a419128097b362, State: Initialized, Role: FOLLOWER
I20260709 12:14:48.341871 24479 consensus_queue.cc:260] T fd6e20f3c92f4498a8c272b807797efa P ad362df39b114ec3a3a419128097b362 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:48.345940 24479 ts_tablet_manager.cc:1434] T fd6e20f3c92f4498a8c272b807797efa P ad362df39b114ec3a3a419128097b362: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:14:48.353544 24479 tablet_bootstrap.cc:492] T 9cb931cb82d74add922e65a2ea3de34d P ad362df39b114ec3a3a419128097b362: Bootstrap starting.
I20260709 12:14:48.335105 24481 tablet_bootstrap.cc:654] T fd6e20f3c92f4498a8c272b807797efa P aa14caefbdaa47b09abf91881635ba96: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:48.372114 24479 tablet_bootstrap.cc:654] T 9cb931cb82d74add922e65a2ea3de34d P ad362df39b114ec3a3a419128097b362: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:48.373221 24478 tablet_bootstrap.cc:492] T 5310371490a542269db28e29d7adfffa P cf2d8294ae68482ca4ffa8be051ad054: No bootstrap required, opened a new log
I20260709 12:14:48.378486 24478 ts_tablet_manager.cc:1403] T 5310371490a542269db28e29d7adfffa P cf2d8294ae68482ca4ffa8be051ad054: Time spent bootstrapping tablet: real 0.139s	user 0.013s	sys 0.001s
I20260709 12:14:48.383463 24478 raft_consensus.cc:359] T 5310371490a542269db28e29d7adfffa P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:48.384598 24478 raft_consensus.cc:385] T 5310371490a542269db28e29d7adfffa P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:48.384905 24478 raft_consensus.cc:740] T 5310371490a542269db28e29d7adfffa P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Initialized, Role: FOLLOWER
I20260709 12:14:48.386569 24636 raft_consensus.cc:493] T 318c217e16874865bd6dff6bd4d8cd4f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:48.387348 24636 raft_consensus.cc:515] T 318c217e16874865bd6dff6bd4d8cd4f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:48.390905 24281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318c217e16874865bd6dff6bd4d8cd4f" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:48.393857 24433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318c217e16874865bd6dff6bd4d8cd4f" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:48.394693 24433 raft_consensus.cc:2468] T 318c217e16874865bd6dff6bd4d8cd4f P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 0.
W20260709 12:14:48.396050 24176 leader_election.cc:343] T 318c217e16874865bd6dff6bd4d8cd4f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:48.401113 24482 tablet_bootstrap.cc:492] T 9cb931cb82d74add922e65a2ea3de34d P 9bf3da5b54ef4a1ea1cee60f02ea2883: No bootstrap required, opened a new log
I20260709 12:14:48.385708 24478 consensus_queue.cc:260] T 5310371490a542269db28e29d7adfffa P cf2d8294ae68482ca4ffa8be051ad054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:48.401764 24482 ts_tablet_manager.cc:1403] T 9cb931cb82d74add922e65a2ea3de34d P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.085s	user 0.039s	sys 0.005s
I20260709 12:14:48.403604 24478 ts_tablet_manager.cc:1434] T 5310371490a542269db28e29d7adfffa P cf2d8294ae68482ca4ffa8be051ad054: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 12:14:48.404981 24482 raft_consensus.cc:359] T 9cb931cb82d74add922e65a2ea3de34d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:48.406194 24478 tablet_bootstrap.cc:492] T 00b51df5a8ee448884a9f145559a5ea3 P cf2d8294ae68482ca4ffa8be051ad054: Bootstrap starting.
I20260709 12:14:48.413877 24482 raft_consensus.cc:385] T 9cb931cb82d74add922e65a2ea3de34d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:48.415422 24479 tablet_bootstrap.cc:492] T 9cb931cb82d74add922e65a2ea3de34d P ad362df39b114ec3a3a419128097b362: No bootstrap required, opened a new log
I20260709 12:14:48.416002 24479 ts_tablet_manager.cc:1403] T 9cb931cb82d74add922e65a2ea3de34d P ad362df39b114ec3a3a419128097b362: Time spent bootstrapping tablet: real 0.063s	user 0.013s	sys 0.003s
I20260709 12:14:48.416220 24478 tablet_bootstrap.cc:654] T 00b51df5a8ee448884a9f145559a5ea3 P cf2d8294ae68482ca4ffa8be051ad054: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:48.419937 24479 raft_consensus.cc:359] T 9cb931cb82d74add922e65a2ea3de34d P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:48.421062 24479 raft_consensus.cc:385] T 9cb931cb82d74add922e65a2ea3de34d P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:48.421437 24479 raft_consensus.cc:740] T 9cb931cb82d74add922e65a2ea3de34d P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad362df39b114ec3a3a419128097b362, State: Initialized, Role: FOLLOWER
I20260709 12:14:48.421798 24550 consensus_queue.cc:1048] T 20629783689c4296afb55366d9ad5f6c P aa14caefbdaa47b09abf91881635ba96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:48.422600 24479 consensus_queue.cc:260] T 9cb931cb82d74add922e65a2ea3de34d P ad362df39b114ec3a3a419128097b362 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:48.425899 24479 ts_tablet_manager.cc:1434] T 9cb931cb82d74add922e65a2ea3de34d P ad362df39b114ec3a3a419128097b362: Time spent starting tablet: real 0.010s	user 0.011s	sys 0.000s
I20260709 12:14:48.427276 24479 tablet_bootstrap.cc:492] T 7c84013312e3409d851214e9954dad8b P ad362df39b114ec3a3a419128097b362: Bootstrap starting.
I20260709 12:14:48.430617 24174 leader_election.cc:304] T 318c217e16874865bd6dff6bd4d8cd4f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, ad362df39b114ec3a3a419128097b362; no voters: cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:14:48.434846 24478 tablet_bootstrap.cc:492] T 00b51df5a8ee448884a9f145559a5ea3 P cf2d8294ae68482ca4ffa8be051ad054: No bootstrap required, opened a new log
I20260709 12:14:48.435712 24478 ts_tablet_manager.cc:1403] T 00b51df5a8ee448884a9f145559a5ea3 P cf2d8294ae68482ca4ffa8be051ad054: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.010s
I20260709 12:14:48.435964 24479 tablet_bootstrap.cc:654] T 7c84013312e3409d851214e9954dad8b P ad362df39b114ec3a3a419128097b362: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:48.440970 24481 tablet_bootstrap.cc:492] T fd6e20f3c92f4498a8c272b807797efa P aa14caefbdaa47b09abf91881635ba96: No bootstrap required, opened a new log
I20260709 12:14:48.440316 24478 raft_consensus.cc:359] T 00b51df5a8ee448884a9f145559a5ea3 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:48.441521 24478 raft_consensus.cc:385] T 00b51df5a8ee448884a9f145559a5ea3 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:48.441637 24481 ts_tablet_manager.cc:1403] T fd6e20f3c92f4498a8c272b807797efa P aa14caefbdaa47b09abf91881635ba96: Time spent bootstrapping tablet: real 0.116s	user 0.012s	sys 0.018s
I20260709 12:14:48.442176 24513 raft_consensus.cc:2804] T 318c217e16874865bd6dff6bd4d8cd4f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:48.442210 24478 raft_consensus.cc:740] T 00b51df5a8ee448884a9f145559a5ea3 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Initialized, Role: FOLLOWER
I20260709 12:14:48.442656 24513 raft_consensus.cc:493] T 318c217e16874865bd6dff6bd4d8cd4f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:48.443482 24513 raft_consensus.cc:3060] T 318c217e16874865bd6dff6bd4d8cd4f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:48.443773 24478 consensus_queue.cc:260] T 00b51df5a8ee448884a9f145559a5ea3 P cf2d8294ae68482ca4ffa8be051ad054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:48.446153 24481 raft_consensus.cc:359] T fd6e20f3c92f4498a8c272b807797efa P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:48.446928 24481 raft_consensus.cc:385] T fd6e20f3c92f4498a8c272b807797efa P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:48.447220 24481 raft_consensus.cc:740] T fd6e20f3c92f4498a8c272b807797efa P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Initialized, Role: FOLLOWER
I20260709 12:14:48.448185 24481 consensus_queue.cc:260] T fd6e20f3c92f4498a8c272b807797efa P aa14caefbdaa47b09abf91881635ba96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:48.450162 24481 ts_tablet_manager.cc:1434] T fd6e20f3c92f4498a8c272b807797efa P aa14caefbdaa47b09abf91881635ba96: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:14:48.414358 24482 raft_consensus.cc:740] T 9cb931cb82d74add922e65a2ea3de34d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:14:48.451399 24482 consensus_queue.cc:260] T 9cb931cb82d74add922e65a2ea3de34d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:48.454392 24620 consensus_queue.cc:1048] T 20629783689c4296afb55366d9ad5f6c P aa14caefbdaa47b09abf91881635ba96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:48.457656 24481 tablet_bootstrap.cc:492] T 00b51df5a8ee448884a9f145559a5ea3 P aa14caefbdaa47b09abf91881635ba96: Bootstrap starting.
I20260709 12:14:48.453617 24482 ts_tablet_manager.cc:1434] T 9cb931cb82d74add922e65a2ea3de34d P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.051s	user 0.005s	sys 0.000s
I20260709 12:14:48.466519 24482 tablet_bootstrap.cc:492] T 4f756e6bcc20458b8748cd090cd3fce2 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:14:48.466629 24478 ts_tablet_manager.cc:1434] T 00b51df5a8ee448884a9f145559a5ea3 P cf2d8294ae68482ca4ffa8be051ad054: Time spent starting tablet: real 0.031s	user 0.011s	sys 0.000s
I20260709 12:14:48.469821 24478 tablet_bootstrap.cc:492] T 318c217e16874865bd6dff6bd4d8cd4f P cf2d8294ae68482ca4ffa8be051ad054: Bootstrap starting.
I20260709 12:14:48.464617 24636 leader_election.cc:290] T 318c217e16874865bd6dff6bd4d8cd4f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:14:48.484386 24552 consensus_queue.cc:1048] T 085a04f8ed724f82bc12490bbb1ceea7 P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:48.487912 24478 tablet_bootstrap.cc:654] T 318c217e16874865bd6dff6bd4d8cd4f P cf2d8294ae68482ca4ffa8be051ad054: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:48.492130 24481 tablet_bootstrap.cc:654] T 00b51df5a8ee448884a9f145559a5ea3 P aa14caefbdaa47b09abf91881635ba96: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:48.496822 24482 tablet_bootstrap.cc:654] T 4f756e6bcc20458b8748cd090cd3fce2 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:48.494295 24636 raft_consensus.cc:493] T 9cb931cb82d74add922e65a2ea3de34d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:48.498569 24636 raft_consensus.cc:515] T 9cb931cb82d74add922e65a2ea3de34d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:48.502624 24281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cb931cb82d74add922e65a2ea3de34d" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:48.513253 24479 tablet_bootstrap.cc:492] T 7c84013312e3409d851214e9954dad8b P ad362df39b114ec3a3a419128097b362: No bootstrap required, opened a new log
I20260709 12:14:48.513892 24479 ts_tablet_manager.cc:1403] T 7c84013312e3409d851214e9954dad8b P ad362df39b114ec3a3a419128097b362: Time spent bootstrapping tablet: real 0.087s	user 0.031s	sys 0.017s
I20260709 12:14:48.504424 24636 leader_election.cc:290] T 9cb931cb82d74add922e65a2ea3de34d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
W20260709 12:14:48.522251 24176 leader_election.cc:343] T 9cb931cb82d74add922e65a2ea3de34d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:48.524528 24636 consensus_queue.cc:1048] T ed15c59b19ff49d3a39bf5b5abf8b69a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:48.491176 24513 raft_consensus.cc:515] T 318c217e16874865bd6dff6bd4d8cd4f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:48.530546 24479 raft_consensus.cc:359] T 7c84013312e3409d851214e9954dad8b P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:48.531625 24479 raft_consensus.cc:385] T 7c84013312e3409d851214e9954dad8b P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:48.531970 24479 raft_consensus.cc:740] T 7c84013312e3409d851214e9954dad8b P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad362df39b114ec3a3a419128097b362, State: Initialized, Role: FOLLOWER
I20260709 12:14:48.550032 24479 consensus_queue.cc:260] T 7c84013312e3409d851214e9954dad8b P ad362df39b114ec3a3a419128097b362 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:48.556886 24478 tablet_bootstrap.cc:492] T 318c217e16874865bd6dff6bd4d8cd4f P cf2d8294ae68482ca4ffa8be051ad054: No bootstrap required, opened a new log
I20260709 12:14:48.557721 24478 ts_tablet_manager.cc:1403] T 318c217e16874865bd6dff6bd4d8cd4f P cf2d8294ae68482ca4ffa8be051ad054: Time spent bootstrapping tablet: real 0.088s	user 0.012s	sys 0.007s
I20260709 12:14:48.563642 24563 raft_consensus.cc:493] T 7c84013312e3409d851214e9954dad8b P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:48.566712 24563 raft_consensus.cc:515] T 7c84013312e3409d851214e9954dad8b P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:48.565598 24479 ts_tablet_manager.cc:1434] T 7c84013312e3409d851214e9954dad8b P ad362df39b114ec3a3a419128097b362: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.002s
I20260709 12:14:48.571475 24638 consensus_queue.cc:1048] T 085a04f8ed724f82bc12490bbb1ceea7 P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:48.579964 24478 raft_consensus.cc:359] T 318c217e16874865bd6dff6bd4d8cd4f P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:48.580973 24433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cb931cb82d74add922e65a2ea3de34d" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:48.581007 24478 raft_consensus.cc:385] T 318c217e16874865bd6dff6bd4d8cd4f P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:48.590358 24563 leader_election.cc:290] T 7c84013312e3409d851214e9954dad8b P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:14:48.591223 24281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c84013312e3409d851214e9954dad8b" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:48.592010 24357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c84013312e3409d851214e9954dad8b" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
W20260709 12:14:48.593030 24399 leader_election.cc:343] T 7c84013312e3409d851214e9954dad8b P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:48.594214 24398 leader_election.cc:343] T 7c84013312e3409d851214e9954dad8b P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:48.594872 24398 leader_election.cc:304] T 7c84013312e3409d851214e9954dad8b P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad362df39b114ec3a3a419128097b362; no voters: aa14caefbdaa47b09abf91881635ba96, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:14:48.596145 24433 raft_consensus.cc:2468] T 9cb931cb82d74add922e65a2ea3de34d P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 0.
I20260709 12:14:48.597697 24563 raft_consensus.cc:2749] T 7c84013312e3409d851214e9954dad8b P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:48.583732 24478 raft_consensus.cc:740] T 318c217e16874865bd6dff6bd4d8cd4f P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Initialized, Role: FOLLOWER
I20260709 12:14:48.601437 24431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318c217e16874865bd6dff6bd4d8cd4f" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362"
I20260709 12:14:48.602206 24431 raft_consensus.cc:3060] T 318c217e16874865bd6dff6bd4d8cd4f P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:48.602828 24479 tablet_bootstrap.cc:492] T 4f756e6bcc20458b8748cd090cd3fce2 P ad362df39b114ec3a3a419128097b362: Bootstrap starting.
I20260709 12:14:48.605687 24174 leader_election.cc:304] T 9cb931cb82d74add922e65a2ea3de34d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, ad362df39b114ec3a3a419128097b362; no voters: cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:14:48.606761 24636 raft_consensus.cc:2804] T 9cb931cb82d74add922e65a2ea3de34d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:48.607407 24636 raft_consensus.cc:493] T 9cb931cb82d74add922e65a2ea3de34d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:48.608606 24636 raft_consensus.cc:3060] T 9cb931cb82d74add922e65a2ea3de34d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:48.607978 24563 raft_consensus.cc:493] T fd6e20f3c92f4498a8c272b807797efa P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:48.611107 24563 raft_consensus.cc:515] T fd6e20f3c92f4498a8c272b807797efa P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:48.614594 24694 consensus_queue.cc:1048] T ed15c59b19ff49d3a39bf5b5abf8b69a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:48.618402 24513 leader_election.cc:290] T 318c217e16874865bd6dff6bd4d8cd4f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 election: Requested vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:14:48.625677 24431 raft_consensus.cc:2468] T 318c217e16874865bd6dff6bd4d8cd4f P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 1.
I20260709 12:14:48.626729 24357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6e20f3c92f4498a8c272b807797efa" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:48.633034 24357 raft_consensus.cc:2468] T fd6e20f3c92f4498a8c272b807797efa P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 0.
I20260709 12:14:48.634651 24398 leader_election.cc:304] T fd6e20f3c92f4498a8c272b807797efa P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, ad362df39b114ec3a3a419128097b362; no voters: 
I20260709 12:14:48.635623 24586 raft_consensus.cc:2804] T fd6e20f3c92f4498a8c272b807797efa P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:48.636049 24586 raft_consensus.cc:493] T fd6e20f3c92f4498a8c272b807797efa P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:48.636379 24586 raft_consensus.cc:3060] T fd6e20f3c92f4498a8c272b807797efa P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:48.603307 24478 consensus_queue.cc:260] T 318c217e16874865bd6dff6bd4d8cd4f P cf2d8294ae68482ca4ffa8be051ad054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:48.646076 24478 ts_tablet_manager.cc:1434] T 318c217e16874865bd6dff6bd4d8cd4f P cf2d8294ae68482ca4ffa8be051ad054: Time spent starting tablet: real 0.088s	user 0.011s	sys 0.000s
I20260709 12:14:48.645936 24586 raft_consensus.cc:515] T fd6e20f3c92f4498a8c272b807797efa P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:48.649250 24357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6e20f3c92f4498a8c272b807797efa" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
I20260709 12:14:48.650065 24357 raft_consensus.cc:3060] T fd6e20f3c92f4498a8c272b807797efa P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:48.629144 24563 leader_election.cc:290] T fd6e20f3c92f4498a8c272b807797efa P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:48.629904 24482 tablet_bootstrap.cc:492] T 4f756e6bcc20458b8748cd090cd3fce2 P 9bf3da5b54ef4a1ea1cee60f02ea2883: No bootstrap required, opened a new log
I20260709 12:14:48.630741 24208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6e20f3c92f4498a8c272b807797efa" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
I20260709 12:14:48.627862 24284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318c217e16874865bd6dff6bd4d8cd4f" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054"
I20260709 12:14:48.658842 24208 raft_consensus.cc:2468] T fd6e20f3c92f4498a8c272b807797efa P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 0.
I20260709 12:14:48.654202 24174 leader_election.cc:304] T 318c217e16874865bd6dff6bd4d8cd4f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, ad362df39b114ec3a3a419128097b362; no voters: 
I20260709 12:14:48.652287 24478 tablet_bootstrap.cc:492] T 9cb931cb82d74add922e65a2ea3de34d P cf2d8294ae68482ca4ffa8be051ad054: Bootstrap starting.
I20260709 12:14:48.660703 24482 ts_tablet_manager.cc:1403] T 4f756e6bcc20458b8748cd090cd3fce2 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.194s	user 0.018s	sys 0.023s
I20260709 12:14:48.659956 24513 raft_consensus.cc:2804] T 318c217e16874865bd6dff6bd4d8cd4f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:48.662707 24284 raft_consensus.cc:3060] T 318c217e16874865bd6dff6bd4d8cd4f P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:48.661289 24637 raft_consensus.cc:493] T 3e977ea0483d4c029394b273e7c4e90f P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:48.677983 24638 raft_consensus.cc:493] T 628105dfc534451285d72f9e17f5d4f3 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:48.668483 24513 raft_consensus.cc:697] T 318c217e16874865bd6dff6bd4d8cd4f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 LEADER]: Becoming Leader. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Running, Role: LEADER
I20260709 12:14:48.682173 24638 raft_consensus.cc:515] T 628105dfc534451285d72f9e17f5d4f3 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:48.683386 24513 consensus_queue.cc:237] T 318c217e16874865bd6dff6bd4d8cd4f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:48.684634 24638 leader_election.cc:290] T 628105dfc534451285d72f9e17f5d4f3 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:14:48.671967 24637 raft_consensus.cc:515] T 3e977ea0483d4c029394b273e7c4e90f P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:48.686757 24209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6e20f3c92f4498a8c272b807797efa" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
I20260709 12:14:48.687458 24209 raft_consensus.cc:3060] T fd6e20f3c92f4498a8c272b807797efa P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:48.687650 24358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628105dfc534451285d72f9e17f5d4f3" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:48.688547 24358 raft_consensus.cc:2468] T 628105dfc534451285d72f9e17f5d4f3 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 0.
I20260709 12:14:48.691148 24282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e977ea0483d4c029394b273e7c4e90f" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:48.694367 24550 consensus_queue.cc:1048] T 27de4156b2e24143a2f301fbefc7cb23 P aa14caefbdaa47b09abf91881635ba96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:48.695770 24208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628105dfc534451285d72f9e17f5d4f3" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
I20260709 12:14:48.696539 24208 raft_consensus.cc:2468] T 628105dfc534451285d72f9e17f5d4f3 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 0.
I20260709 12:14:48.693415 24250 leader_election.cc:304] T 628105dfc534451285d72f9e17f5d4f3 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, cf2d8294ae68482ca4ffa8be051ad054; no voters: 
I20260709 12:14:48.700143 24552 raft_consensus.cc:2804] T 628105dfc534451285d72f9e17f5d4f3 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:48.700598 24552 raft_consensus.cc:493] T 628105dfc534451285d72f9e17f5d4f3 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:48.700950 24552 raft_consensus.cc:3060] T 628105dfc534451285d72f9e17f5d4f3 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:48.704180 24433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e977ea0483d4c029394b273e7c4e90f" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:48.705091 24433 raft_consensus.cc:2393] T 3e977ea0483d4c029394b273e7c4e90f P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aa14caefbdaa47b09abf91881635ba96 in current term 1: Already voted for candidate cf2d8294ae68482ca4ffa8be051ad054 in this term.
I20260709 12:14:48.706413 24323 leader_election.cc:304] T 3e977ea0483d4c029394b273e7c4e90f P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96; no voters: ad362df39b114ec3a3a419128097b362, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:14:48.707433 24550 raft_consensus.cc:3060] T 3e977ea0483d4c029394b273e7c4e90f P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:48.708796 24636 raft_consensus.cc:515] T 9cb931cb82d74add922e65a2ea3de34d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:48.709609 24552 raft_consensus.cc:515] T 628105dfc534451285d72f9e17f5d4f3 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:48.712108 24479 tablet_bootstrap.cc:654] T 4f756e6bcc20458b8748cd090cd3fce2 P ad362df39b114ec3a3a419128097b362: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:48.713210 24358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628105dfc534451285d72f9e17f5d4f3" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
I20260709 12:14:48.713990 24358 raft_consensus.cc:3060] T 628105dfc534451285d72f9e17f5d4f3 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:48.722093 24638 raft_consensus.cc:493] T 00b51df5a8ee448884a9f145559a5ea3 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:48.722723 24638 raft_consensus.cc:515] T 00b51df5a8ee448884a9f145559a5ea3 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:48.724977 24638 leader_election.cc:290] T 00b51df5a8ee448884a9f145559a5ea3 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:14:48.675670 24586 leader_election.cc:290] T fd6e20f3c92f4498a8c272b807797efa P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 election: Requested vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:48.727456 24355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b51df5a8ee448884a9f145559a5ea3" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:48.725512 24638 consensus_queue.cc:1048] T 3e977ea0483d4c029394b273e7c4e90f P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:48.730175 24430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b51df5a8ee448884a9f145559a5ea3" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
W20260709 12:14:48.731042 24250 leader_election.cc:343] T 00b51df5a8ee448884a9f145559a5ea3 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:48.730999 24430 raft_consensus.cc:2468] T 00b51df5a8ee448884a9f145559a5ea3 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 0.
I20260709 12:14:48.705415 24209 raft_consensus.cc:2468] T fd6e20f3c92f4498a8c272b807797efa P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 1.
I20260709 12:14:48.717164 24637 leader_election.cc:290] T 3e977ea0483d4c029394b273e7c4e90f P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:14:48.767522 24249 leader_election.cc:304] T 00b51df5a8ee448884a9f145559a5ea3 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad362df39b114ec3a3a419128097b362, cf2d8294ae68482ca4ffa8be051ad054; no voters: aa14caefbdaa47b09abf91881635ba96
I20260709 12:14:48.768987 24565 raft_consensus.cc:2804] T 00b51df5a8ee448884a9f145559a5ea3 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:48.769444 24565 raft_consensus.cc:493] T 00b51df5a8ee448884a9f145559a5ea3 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:48.769860 24565 raft_consensus.cc:3060] T 00b51df5a8ee448884a9f145559a5ea3 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:48.770258 24210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628105dfc534451285d72f9e17f5d4f3" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
I20260709 12:14:48.771034 24210 raft_consensus.cc:3060] T 628105dfc534451285d72f9e17f5d4f3 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:48.760929 24550 raft_consensus.cc:2749] T 3e977ea0483d4c029394b273e7c4e90f P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:48.776582 24482 raft_consensus.cc:359] T 4f756e6bcc20458b8748cd090cd3fce2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:48.777426 24482 raft_consensus.cc:385] T 4f756e6bcc20458b8748cd090cd3fce2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:48.736099 24552 leader_election.cc:290] T 628105dfc534451285d72f9e17f5d4f3 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 election: Requested vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
W20260709 12:14:48.773559 24155 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:48.777741 24482 raft_consensus.cc:740] T 4f756e6bcc20458b8748cd090cd3fce2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:14:48.783324 24481 tablet_bootstrap.cc:492] T 00b51df5a8ee448884a9f145559a5ea3 P aa14caefbdaa47b09abf91881635ba96: No bootstrap required, opened a new log
I20260709 12:14:48.783933 24481 ts_tablet_manager.cc:1403] T 00b51df5a8ee448884a9f145559a5ea3 P aa14caefbdaa47b09abf91881635ba96: Time spent bootstrapping tablet: real 0.327s	user 0.016s	sys 0.020s
I20260709 12:14:48.786335 24552 raft_consensus.cc:493] T 5310371490a542269db28e29d7adfffa P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:48.783351 24482 consensus_queue.cc:260] T 4f756e6bcc20458b8748cd090cd3fce2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:48.786943 24552 raft_consensus.cc:515] T 5310371490a542269db28e29d7adfffa P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:48.788151 24636 leader_election.cc:290] T 9cb931cb82d74add922e65a2ea3de34d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 election: Requested vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:14:48.789355 24552 leader_election.cc:290] T 5310371490a542269db28e29d7adfffa P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:14:48.790670 24209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5310371490a542269db28e29d7adfffa" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
I20260709 12:14:48.791056 24638 consensus_queue.cc:1048] T 3e977ea0483d4c029394b273e7c4e90f P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:48.791646 24209 raft_consensus.cc:2468] T 5310371490a542269db28e29d7adfffa P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 0.
I20260709 12:14:48.791805 24430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cb931cb82d74add922e65a2ea3de34d" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362"
I20260709 12:14:48.792887 24430 raft_consensus.cc:3060] T 9cb931cb82d74add922e65a2ea3de34d P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:48.793483 24482 ts_tablet_manager.cc:1434] T 4f756e6bcc20458b8748cd090cd3fce2 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.131s	user 0.004s	sys 0.004s
I20260709 12:14:48.795544 24248 leader_election.cc:304] T 5310371490a542269db28e29d7adfffa P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054; no voters: 
I20260709 12:14:48.795760 24357 raft_consensus.cc:2468] T fd6e20f3c92f4498a8c272b807797efa P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 1.
I20260709 12:14:48.798971 24482 tablet_bootstrap.cc:492] T 3fe3be6bb3264475ba597fec30a06f6c P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:14:48.780628 24284 raft_consensus.cc:2468] T 318c217e16874865bd6dff6bd4d8cd4f P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 1.
I20260709 12:14:48.812315 24282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cb931cb82d74add922e65a2ea3de34d" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054"
I20260709 12:14:48.808384 24552 raft_consensus.cc:2804] T 5310371490a542269db28e29d7adfffa P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:48.814119 24552 raft_consensus.cc:493] T 5310371490a542269db28e29d7adfffa P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:48.814538 24552 raft_consensus.cc:3060] T 5310371490a542269db28e29d7adfffa P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:48.815882 24481 raft_consensus.cc:359] T 00b51df5a8ee448884a9f145559a5ea3 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:48.817201 24481 raft_consensus.cc:385] T 00b51df5a8ee448884a9f145559a5ea3 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:48.820676 24358 raft_consensus.cc:2468] T 628105dfc534451285d72f9e17f5d4f3 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 1.
I20260709 12:14:48.823278 24478 tablet_bootstrap.cc:654] T 9cb931cb82d74add922e65a2ea3de34d P cf2d8294ae68482ca4ffa8be051ad054: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:48.817672 24481 raft_consensus.cc:740] T 00b51df5a8ee448884a9f145559a5ea3 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Initialized, Role: FOLLOWER
I20260709 12:14:48.833242 24396 leader_election.cc:304] T fd6e20f3c92f4498a8c272b807797efa P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, ad362df39b114ec3a3a419128097b362; no voters: 
W20260709 12:14:48.834506 24176 leader_election.cc:343] T 9cb931cb82d74add922e65a2ea3de34d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:48.835407 24563 raft_consensus.cc:2804] T fd6e20f3c92f4498a8c272b807797efa P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:48.836130 24563 raft_consensus.cc:697] T fd6e20f3c92f4498a8c272b807797efa P ad362df39b114ec3a3a419128097b362 [term 1 LEADER]: Becoming Leader. State: Replica: ad362df39b114ec3a3a419128097b362, State: Running, Role: LEADER
I20260709 12:14:48.837217 24563 consensus_queue.cc:237] T fd6e20f3c92f4498a8c272b807797efa P ad362df39b114ec3a3a419128097b362 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
W20260709 12:14:48.851297 24721 log.cc:927] Time spent T 27de4156b2e24143a2f301fbefc7cb23 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Append to log took a long time: real 0.074s	user 0.003s	sys 0.001s
I20260709 12:14:48.851930 24210 raft_consensus.cc:2468] T 628105dfc534451285d72f9e17f5d4f3 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 1.
I20260709 12:14:48.859858 24481 consensus_queue.cc:260] T 00b51df5a8ee448884a9f145559a5ea3 P aa14caefbdaa47b09abf91881635ba96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:48.866109 24479 tablet_bootstrap.cc:492] T 4f756e6bcc20458b8748cd090cd3fce2 P ad362df39b114ec3a3a419128097b362: No bootstrap required, opened a new log
I20260709 12:14:48.866843 24479 ts_tablet_manager.cc:1403] T 4f756e6bcc20458b8748cd090cd3fce2 P ad362df39b114ec3a3a419128097b362: Time spent bootstrapping tablet: real 0.283s	user 0.015s	sys 0.007s
W20260709 12:14:48.860739 24250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:46845, user_credentials={real_user=slave}} blocked reactor thread for 77242.2us
I20260709 12:14:48.883122 24481 ts_tablet_manager.cc:1434] T 00b51df5a8ee448884a9f145559a5ea3 P aa14caefbdaa47b09abf91881635ba96: Time spent starting tablet: real 0.099s	user 0.005s	sys 0.004s
I20260709 12:14:48.893199 24482 tablet_bootstrap.cc:654] T 3fe3be6bb3264475ba597fec30a06f6c P 9bf3da5b54ef4a1ea1cee60f02ea2883: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:48.895318 24248 leader_election.cc:304] T 628105dfc534451285d72f9e17f5d4f3 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054; no voters: 
I20260709 12:14:48.894701 24108 catalog_manager.cc:5697] T 318c217e16874865bd6dff6bd4d8cd4f P 9bf3da5b54ef4a1ea1cee60f02ea2883 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193). New cstate: current_term: 1 leader_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:48.918627 24481 tablet_bootstrap.cc:492] T 7c84013312e3409d851214e9954dad8b P aa14caefbdaa47b09abf91881635ba96: Bootstrap starting.
I20260709 12:14:48.918687 24723 raft_consensus.cc:2804] T 628105dfc534451285d72f9e17f5d4f3 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:48.924273 24723 raft_consensus.cc:697] T 628105dfc534451285d72f9e17f5d4f3 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Becoming Leader. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Running, Role: LEADER
I20260709 12:14:48.925170 24723 consensus_queue.cc:237] T 628105dfc534451285d72f9e17f5d4f3 P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:48.913677 24552 raft_consensus.cc:515] T 5310371490a542269db28e29d7adfffa P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:48.908891 24357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5310371490a542269db28e29d7adfffa" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:48.900979 24430 raft_consensus.cc:2468] T 9cb931cb82d74add922e65a2ea3de34d P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 1.
I20260709 12:14:48.928172 24552 leader_election.cc:290] T 5310371490a542269db28e29d7adfffa P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 election: Requested vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:14:48.860889 24565 raft_consensus.cc:515] T 00b51df5a8ee448884a9f145559a5ea3 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:48.970485 24207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5310371490a542269db28e29d7adfffa" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
I20260709 12:14:48.971284 24207 raft_consensus.cc:3060] T 5310371490a542269db28e29d7adfffa P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:48.974743 24513 raft_consensus.cc:493] T 4f756e6bcc20458b8748cd090cd3fce2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:48.975368 24513 raft_consensus.cc:515] T 4f756e6bcc20458b8748cd090cd3fce2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:48.978276 24513 leader_election.cc:290] T 4f756e6bcc20458b8748cd090cd3fce2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
W20260709 12:14:48.982587 24250 leader_election.cc:343] T 5310371490a542269db28e29d7adfffa P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:48.982430 24429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f756e6bcc20458b8748cd090cd3fce2" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:48.989559 24358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5310371490a542269db28e29d7adfffa" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
I20260709 12:14:48.994570 24207 raft_consensus.cc:2468] T 5310371490a542269db28e29d7adfffa P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 1.
W20260709 12:14:48.954147 24325 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:34565, user_credentials={real_user=slave}} blocked reactor thread for 85413.7us
I20260709 12:14:48.998271 24478 tablet_bootstrap.cc:492] T 9cb931cb82d74add922e65a2ea3de34d P cf2d8294ae68482ca4ffa8be051ad054: No bootstrap required, opened a new log
I20260709 12:14:48.999199 24478 ts_tablet_manager.cc:1403] T 9cb931cb82d74add922e65a2ea3de34d P cf2d8294ae68482ca4ffa8be051ad054: Time spent bootstrapping tablet: real 0.352s	user 0.035s	sys 0.021s
W20260709 12:14:49.000213 24250 leader_election.cc:343] T 5310371490a542269db28e29d7adfffa P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:49.003116 24478 raft_consensus.cc:359] T 9cb931cb82d74add922e65a2ea3de34d P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:49.004200 24478 raft_consensus.cc:385] T 9cb931cb82d74add922e65a2ea3de34d P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:49.004556 24478 raft_consensus.cc:740] T 9cb931cb82d74add922e65a2ea3de34d P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Initialized, Role: FOLLOWER
I20260709 12:14:49.005481 24174 leader_election.cc:304] T 9cb931cb82d74add922e65a2ea3de34d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, ad362df39b114ec3a3a419128097b362; no voters: cf2d8294ae68482ca4ffa8be051ad054
W20260709 12:14:49.006913 24174 leader_election.cc:343] T 4f756e6bcc20458b8748cd090cd3fce2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:49.007704 24694 raft_consensus.cc:2804] T 9cb931cb82d74add922e65a2ea3de34d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:49.008266 24694 raft_consensus.cc:697] T 9cb931cb82d74add922e65a2ea3de34d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 LEADER]: Becoming Leader. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Running, Role: LEADER
I20260709 12:14:49.010174 24694 consensus_queue.cc:237] T 9cb931cb82d74add922e65a2ea3de34d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:49.005538 24478 consensus_queue.cc:260] T 9cb931cb82d74add922e65a2ea3de34d P cf2d8294ae68482ca4ffa8be051ad054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:49.015805 24482 tablet_bootstrap.cc:492] T 3fe3be6bb3264475ba597fec30a06f6c P 9bf3da5b54ef4a1ea1cee60f02ea2883: No bootstrap required, opened a new log
I20260709 12:14:49.016398 24482 ts_tablet_manager.cc:1403] T 3fe3be6bb3264475ba597fec30a06f6c P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.218s	user 0.011s	sys 0.021s
I20260709 12:14:49.017594 24356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f756e6bcc20458b8748cd090cd3fce2" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:49.016141 24479 raft_consensus.cc:359] T 4f756e6bcc20458b8748cd090cd3fce2 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
W20260709 12:14:49.028419 24175 leader_election.cc:343] T 4f756e6bcc20458b8748cd090cd3fce2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:49.029201 24429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b51df5a8ee448884a9f145559a5ea3" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362"
I20260709 12:14:49.042162 24429 raft_consensus.cc:3060] T 00b51df5a8ee448884a9f145559a5ea3 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:49.048484 24482 raft_consensus.cc:359] T 3fe3be6bb3264475ba597fec30a06f6c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:49.026937 24481 tablet_bootstrap.cc:654] T 7c84013312e3409d851214e9954dad8b P aa14caefbdaa47b09abf91881635ba96: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:49.049402 24482 raft_consensus.cc:385] T 3fe3be6bb3264475ba597fec30a06f6c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:49.039230 24479 raft_consensus.cc:385] T 4f756e6bcc20458b8748cd090cd3fce2 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:49.054190 24482 raft_consensus.cc:740] T 3fe3be6bb3264475ba597fec30a06f6c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:14:49.054929 24479 raft_consensus.cc:740] T 4f756e6bcc20458b8748cd090cd3fce2 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad362df39b114ec3a3a419128097b362, State: Initialized, Role: FOLLOWER
I20260709 12:14:49.036518 24565 leader_election.cc:290] T 00b51df5a8ee448884a9f145559a5ea3 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 election: Requested vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:14:49.055120 24482 consensus_queue.cc:260] T 3fe3be6bb3264475ba597fec30a06f6c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:49.038630 24175 leader_election.cc:304] T 4f756e6bcc20458b8748cd090cd3fce2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883; no voters: aa14caefbdaa47b09abf91881635ba96, ad362df39b114ec3a3a419128097b362
I20260709 12:14:49.055675 24637 consensus_queue.cc:1048] T 27de4156b2e24143a2f301fbefc7cb23 P aa14caefbdaa47b09abf91881635ba96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:49.057034 24248 leader_election.cc:304] T 5310371490a542269db28e29d7adfffa P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054; no voters: aa14caefbdaa47b09abf91881635ba96
I20260709 12:14:49.058399 24478 ts_tablet_manager.cc:1434] T 9cb931cb82d74add922e65a2ea3de34d P cf2d8294ae68482ca4ffa8be051ad054: Time spent starting tablet: real 0.059s	user 0.008s	sys 0.002s
I20260709 12:14:49.059831 24478 tablet_bootstrap.cc:492] T 7c84013312e3409d851214e9954dad8b P cf2d8294ae68482ca4ffa8be051ad054: Bootstrap starting.
I20260709 12:14:49.058403 24479 consensus_queue.cc:260] T 4f756e6bcc20458b8748cd090cd3fce2 P ad362df39b114ec3a3a419128097b362 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:49.063617 24482 ts_tablet_manager.cc:1434] T 3fe3be6bb3264475ba597fec30a06f6c P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.047s	user 0.008s	sys 0.000s
I20260709 12:14:49.065184 24479 ts_tablet_manager.cc:1434] T 4f756e6bcc20458b8748cd090cd3fce2 P ad362df39b114ec3a3a419128097b362: Time spent starting tablet: real 0.198s	user 0.007s	sys 0.002s
I20260709 12:14:49.073626 24358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b51df5a8ee448884a9f145559a5ea3" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
I20260709 12:14:49.076478 24358 raft_consensus.cc:3060] T 00b51df5a8ee448884a9f145559a5ea3 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:49.082223 24479 tablet_bootstrap.cc:492] T 464c7ebd16cd488086ccaec23defbb33 P ad362df39b114ec3a3a419128097b362: Bootstrap starting.
I20260709 12:14:49.074221 24732 raft_consensus.cc:2804] T 5310371490a542269db28e29d7adfffa P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:49.088065 24732 raft_consensus.cc:697] T 5310371490a542269db28e29d7adfffa P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Becoming Leader. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Running, Role: LEADER
I20260709 12:14:49.089243 24732 consensus_queue.cc:237] T 5310371490a542269db28e29d7adfffa P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:49.089208 24478 tablet_bootstrap.cc:654] T 7c84013312e3409d851214e9954dad8b P cf2d8294ae68482ca4ffa8be051ad054: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:49.063079 24694 raft_consensus.cc:2749] T 4f756e6bcc20458b8748cd090cd3fce2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:49.110160 24482 tablet_bootstrap.cc:492] T 356b14abd90d418cab44e524aef8154c P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:14:49.110240 24481 tablet_bootstrap.cc:492] T 7c84013312e3409d851214e9954dad8b P aa14caefbdaa47b09abf91881635ba96: No bootstrap required, opened a new log
I20260709 12:14:49.111692 24481 ts_tablet_manager.cc:1403] T 7c84013312e3409d851214e9954dad8b P aa14caefbdaa47b09abf91881635ba96: Time spent bootstrapping tablet: real 0.193s	user 0.008s	sys 0.021s
I20260709 12:14:49.111027 24479 tablet_bootstrap.cc:654] T 464c7ebd16cd488086ccaec23defbb33 P ad362df39b114ec3a3a419128097b362: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:49.117636 24429 raft_consensus.cc:2468] T 00b51df5a8ee448884a9f145559a5ea3 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 1.
I20260709 12:14:49.118139 24481 raft_consensus.cc:359] T 7c84013312e3409d851214e9954dad8b P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:49.122516 24481 raft_consensus.cc:385] T 7c84013312e3409d851214e9954dad8b P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:49.122924 24481 raft_consensus.cc:740] T 7c84013312e3409d851214e9954dad8b P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Initialized, Role: FOLLOWER
I20260709 12:14:49.127689 24249 leader_election.cc:304] T 00b51df5a8ee448884a9f145559a5ea3 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad362df39b114ec3a3a419128097b362, cf2d8294ae68482ca4ffa8be051ad054; no voters: 
I20260709 12:14:49.128994 24731 raft_consensus.cc:2804] T 00b51df5a8ee448884a9f145559a5ea3 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:49.129607 24731 raft_consensus.cc:697] T 00b51df5a8ee448884a9f145559a5ea3 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Becoming Leader. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Running, Role: LEADER
I20260709 12:14:49.130748 24731 consensus_queue.cc:237] T 00b51df5a8ee448884a9f145559a5ea3 P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:49.133080 24481 consensus_queue.cc:260] T 7c84013312e3409d851214e9954dad8b P aa14caefbdaa47b09abf91881635ba96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:49.143643 24481 ts_tablet_manager.cc:1434] T 7c84013312e3409d851214e9954dad8b P aa14caefbdaa47b09abf91881635ba96: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260709 12:14:49.145414 24481 tablet_bootstrap.cc:492] T 5310371490a542269db28e29d7adfffa P aa14caefbdaa47b09abf91881635ba96: Bootstrap starting.
I20260709 12:14:49.155695 24479 tablet_bootstrap.cc:492] T 464c7ebd16cd488086ccaec23defbb33 P ad362df39b114ec3a3a419128097b362: No bootstrap required, opened a new log
I20260709 12:14:49.156354 24479 ts_tablet_manager.cc:1403] T 464c7ebd16cd488086ccaec23defbb33 P ad362df39b114ec3a3a419128097b362: Time spent bootstrapping tablet: real 0.074s	user 0.017s	sys 0.004s
I20260709 12:14:49.158957 24478 tablet_bootstrap.cc:492] T 7c84013312e3409d851214e9954dad8b P cf2d8294ae68482ca4ffa8be051ad054: No bootstrap required, opened a new log
I20260709 12:14:49.160039 24478 ts_tablet_manager.cc:1403] T 7c84013312e3409d851214e9954dad8b P cf2d8294ae68482ca4ffa8be051ad054: Time spent bootstrapping tablet: real 0.100s	user 0.013s	sys 0.006s
I20260709 12:14:49.208491 24694 raft_consensus.cc:493] T 3fe3be6bb3264475ba597fec30a06f6c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:49.210088 24358 raft_consensus.cc:2468] T 00b51df5a8ee448884a9f145559a5ea3 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 1.
I20260709 12:14:49.210678 24694 raft_consensus.cc:515] T 3fe3be6bb3264475ba597fec30a06f6c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:49.216202 24694 leader_election.cc:290] T 3fe3be6bb3264475ba597fec30a06f6c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:14:49.230015 24282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe3be6bb3264475ba597fec30a06f6c" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:49.226969 24357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe3be6bb3264475ba597fec30a06f6c" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
W20260709 12:14:49.236725 24175 leader_election.cc:343] T 3fe3be6bb3264475ba597fec30a06f6c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:49.240049 24176 leader_election.cc:343] T 3fe3be6bb3264475ba597fec30a06f6c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:49.240754 24176 leader_election.cc:304] T 3fe3be6bb3264475ba597fec30a06f6c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883; no voters: aa14caefbdaa47b09abf91881635ba96, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:14:49.244639 24513 raft_consensus.cc:2749] T 3fe3be6bb3264475ba597fec30a06f6c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:49.246824 24513 raft_consensus.cc:493] T 7cbef09353144c0b9a9ebf7731fd019f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:49.247681 24513 raft_consensus.cc:515] T 7cbef09353144c0b9a9ebf7731fd019f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:49.249158 24618 consensus_queue.cc:1048] T fd6e20f3c92f4498a8c272b807797efa P ad362df39b114ec3a3a419128097b362 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:49.253252 24482 tablet_bootstrap.cc:654] T 356b14abd90d418cab44e524aef8154c P 9bf3da5b54ef4a1ea1cee60f02ea2883: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:49.254179 24636 consensus_queue.cc:1048] T 318c217e16874865bd6dff6bd4d8cd4f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:49.226931 24563 raft_consensus.cc:493] T 7cbef09353144c0b9a9ebf7731fd019f P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:49.281423 24563 raft_consensus.cc:515] T 7cbef09353144c0b9a9ebf7731fd019f P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:49.292404 24207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbef09353144c0b9a9ebf7731fd019f" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
I20260709 12:14:49.293269 24207 raft_consensus.cc:2468] T 7cbef09353144c0b9a9ebf7731fd019f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 1.
I20260709 12:14:49.308138 24481 tablet_bootstrap.cc:654] T 5310371490a542269db28e29d7adfffa P aa14caefbdaa47b09abf91881635ba96: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:49.308904 24358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbef09353144c0b9a9ebf7731fd019f" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:49.311167 24358 raft_consensus.cc:2468] T 7cbef09353144c0b9a9ebf7731fd019f P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 1.
I20260709 12:14:49.290318 24563 leader_election.cc:290] T 7cbef09353144c0b9a9ebf7731fd019f P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:49.318737 24398 leader_election.cc:304] T 7cbef09353144c0b9a9ebf7731fd019f P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, ad362df39b114ec3a3a419128097b362; no voters: 
I20260709 12:14:49.320067 24482 tablet_bootstrap.cc:492] T 356b14abd90d418cab44e524aef8154c P 9bf3da5b54ef4a1ea1cee60f02ea2883: No bootstrap required, opened a new log
I20260709 12:14:49.324633 24586 raft_consensus.cc:2804] T 7cbef09353144c0b9a9ebf7731fd019f P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:49.325412 24586 raft_consensus.cc:493] T 7cbef09353144c0b9a9ebf7731fd019f P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:49.325479 24358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbef09353144c0b9a9ebf7731fd019f" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:49.326116 24586 raft_consensus.cc:3060] T 7cbef09353144c0b9a9ebf7731fd019f P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:49.326835 24358 raft_consensus.cc:2468] T 7cbef09353144c0b9a9ebf7731fd019f P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 1.
I20260709 12:14:49.328445 24175 leader_election.cc:304] T 7cbef09353144c0b9a9ebf7731fd019f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, aa14caefbdaa47b09abf91881635ba96; no voters: 
I20260709 12:14:49.324777 24482 ts_tablet_manager.cc:1403] T 356b14abd90d418cab44e524aef8154c P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.215s	user 0.016s	sys 0.008s
I20260709 12:14:49.337920 24731 raft_consensus.cc:493] T 9cb931cb82d74add922e65a2ea3de34d P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:49.338927 24731 raft_consensus.cc:515] T 9cb931cb82d74add922e65a2ea3de34d P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:49.352130 24731 leader_election.cc:290] T 9cb931cb82d74add922e65a2ea3de34d P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:49.351946 24429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cb931cb82d74add922e65a2ea3de34d" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:49.353288 24429 raft_consensus.cc:2393] T 9cb931cb82d74add922e65a2ea3de34d P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cf2d8294ae68482ca4ffa8be051ad054 in current term 1: Already voted for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in this term.
I20260709 12:14:49.348371 24479 raft_consensus.cc:359] T 464c7ebd16cd488086ccaec23defbb33 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:49.377310 24479 raft_consensus.cc:385] T 464c7ebd16cd488086ccaec23defbb33 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:49.304492 24694 consensus_queue.cc:1048] T 318c217e16874865bd6dff6bd4d8cd4f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
I20260709 12:14:49.384927 24482 raft_consensus.cc:359] T 356b14abd90d418cab44e524aef8154c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:49.400566 24482 raft_consensus.cc:385] T 356b14abd90d418cab44e524aef8154c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:49.398383 24513 leader_election.cc:290] T 7cbef09353144c0b9a9ebf7731fd019f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:14:49.401049 24482 raft_consensus.cc:740] T 356b14abd90d418cab44e524aef8154c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:14:49.401934 24748 raft_consensus.cc:2804] T 7cbef09353144c0b9a9ebf7731fd019f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:49.400300 24479 raft_consensus.cc:740] T 464c7ebd16cd488086ccaec23defbb33 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad362df39b114ec3a3a419128097b362, State: Initialized, Role: FOLLOWER
W20260709 12:14:49.405332 24175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:46845, user_credentials={real_user=slave}} blocked reactor thread for 76994.5us
I20260709 12:14:49.407334 24748 raft_consensus.cc:493] T 7cbef09353144c0b9a9ebf7731fd019f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:49.429262 24748 raft_consensus.cc:3060] T 7cbef09353144c0b9a9ebf7731fd019f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:49.407763 24479 consensus_queue.cc:260] T 464c7ebd16cd488086ccaec23defbb33 P ad362df39b114ec3a3a419128097b362 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:49.349484 24478 raft_consensus.cc:359] T 7c84013312e3409d851214e9954dad8b P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:49.433274 24478 raft_consensus.cc:385] T 7c84013312e3409d851214e9954dad8b P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:49.433859 24478 raft_consensus.cc:740] T 7c84013312e3409d851214e9954dad8b P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Initialized, Role: FOLLOWER
I20260709 12:14:49.434135 24103 catalog_manager.cc:5697] T fd6e20f3c92f4498a8c272b807797efa P ad362df39b114ec3a3a419128097b362 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad362df39b114ec3a3a419128097b362 (127.12.56.196). New cstate: current_term: 1 leader_uuid: "ad362df39b114ec3a3a419128097b362" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:49.439035 24479 ts_tablet_manager.cc:1434] T 464c7ebd16cd488086ccaec23defbb33 P ad362df39b114ec3a3a419128097b362: Time spent starting tablet: real 0.282s	user 0.011s	sys 0.002s
I20260709 12:14:49.440821 24482 consensus_queue.cc:260] T 356b14abd90d418cab44e524aef8154c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:49.442020 24723 consensus_queue.cc:1048] T 628105dfc534451285d72f9e17f5d4f3 P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:49.443434 24429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbef09353144c0b9a9ebf7731fd019f" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:49.448114 24284 raft_consensus.cc:3060] T 9cb931cb82d74add922e65a2ea3de34d P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:49.448911 24479 tablet_bootstrap.cc:492] T 93ece38976574ad7a5e93a69c33c074d P ad362df39b114ec3a3a419128097b362: Bootstrap starting.
I20260709 12:14:49.465099 24618 raft_consensus.cc:493] T 4f756e6bcc20458b8748cd090cd3fce2 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:49.465801 24618 raft_consensus.cc:515] T 4f756e6bcc20458b8748cd090cd3fce2 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:49.468580 24727 raft_consensus.cc:493] T 7c84013312e3409d851214e9954dad8b P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:49.469383 24727 raft_consensus.cc:515] T 7c84013312e3409d851214e9954dad8b P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:49.488492 24481 tablet_bootstrap.cc:492] T 5310371490a542269db28e29d7adfffa P aa14caefbdaa47b09abf91881635ba96: No bootstrap required, opened a new log
I20260709 12:14:49.488808 24281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c84013312e3409d851214e9954dad8b" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:49.489274 24481 ts_tablet_manager.cc:1403] T 5310371490a542269db28e29d7adfffa P aa14caefbdaa47b09abf91881635ba96: Time spent bootstrapping tablet: real 0.345s	user 0.049s	sys 0.052s
I20260709 12:14:49.494673 24433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c84013312e3409d851214e9954dad8b" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:49.495802 24433 raft_consensus.cc:2468] T 7c84013312e3409d851214e9954dad8b P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa14caefbdaa47b09abf91881635ba96 in term 0.
I20260709 12:14:49.497411 24323 leader_election.cc:304] T 7c84013312e3409d851214e9954dad8b P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, ad362df39b114ec3a3a419128097b362; no voters: 
I20260709 12:14:49.498479 24207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cb931cb82d74add922e65a2ea3de34d" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
I20260709 12:14:49.499011 24727 leader_election.cc:290] T 7c84013312e3409d851214e9954dad8b P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:14:49.499148 24637 raft_consensus.cc:2804] T 7c84013312e3409d851214e9954dad8b P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:49.499675 24637 raft_consensus.cc:493] T 7c84013312e3409d851214e9954dad8b P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:49.500038 24637 raft_consensus.cc:3060] T 7c84013312e3409d851214e9954dad8b P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:49.477404 24478 consensus_queue.cc:260] T 7c84013312e3409d851214e9954dad8b P cf2d8294ae68482ca4ffa8be051ad054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:49.493278 24481 raft_consensus.cc:359] T 5310371490a542269db28e29d7adfffa P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:49.505236 24481 raft_consensus.cc:385] T 5310371490a542269db28e29d7adfffa P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:49.505661 24481 raft_consensus.cc:740] T 5310371490a542269db28e29d7adfffa P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Initialized, Role: FOLLOWER
I20260709 12:14:49.506120 24618 leader_election.cc:290] T 4f756e6bcc20458b8748cd090cd3fce2 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:49.506210 24281 raft_consensus.cc:2468] T 7c84013312e3409d851214e9954dad8b P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa14caefbdaa47b09abf91881635ba96 in term 0.
I20260709 12:14:49.506868 24481 consensus_queue.cc:260] T 5310371490a542269db28e29d7adfffa P aa14caefbdaa47b09abf91881635ba96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:49.513240 24478 ts_tablet_manager.cc:1434] T 7c84013312e3409d851214e9954dad8b P cf2d8294ae68482ca4ffa8be051ad054: Time spent starting tablet: real 0.353s	user 0.010s	sys 0.003s
I20260709 12:14:49.515002 24478 tablet_bootstrap.cc:492] T 3fe3be6bb3264475ba597fec30a06f6c P cf2d8294ae68482ca4ffa8be051ad054: Bootstrap starting.
I20260709 12:14:49.520013 24586 raft_consensus.cc:515] T 7cbef09353144c0b9a9ebf7731fd019f P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:49.521576 24429 raft_consensus.cc:2393] T 7cbef09353144c0b9a9ebf7731fd019f P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in current term 2: Already voted for candidate ad362df39b114ec3a3a419128097b362 in this term.
I20260709 12:14:49.525852 24248 leader_election.cc:304] T 9cb931cb82d74add922e65a2ea3de34d P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf2d8294ae68482ca4ffa8be051ad054; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, ad362df39b114ec3a3a419128097b362
I20260709 12:14:49.534233 24746 consensus_queue.cc:1048] T fd6e20f3c92f4498a8c272b807797efa P ad362df39b114ec3a3a419128097b362 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:49.537236 24479 tablet_bootstrap.cc:654] T 93ece38976574ad7a5e93a69c33c074d P ad362df39b114ec3a3a419128097b362: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:49.538110 24694 consensus_queue.cc:1048] T 9cb931cb82d74add922e65a2ea3de34d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:49.543344 24207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f756e6bcc20458b8748cd090cd3fce2" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
I20260709 12:14:49.567468 24482 ts_tablet_manager.cc:1434] T 356b14abd90d418cab44e524aef8154c P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.192s	user 0.009s	sys 0.004s
I20260709 12:14:49.555483 24207 raft_consensus.cc:2468] T 4f756e6bcc20458b8748cd090cd3fce2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 0.
I20260709 12:14:49.578100 24586 leader_election.cc:290] T 7cbef09353144c0b9a9ebf7731fd019f P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 election: Requested vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:49.580027 24732 raft_consensus.cc:2749] T 9cb931cb82d74add922e65a2ea3de34d P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:49.585067 24750 consensus_queue.cc:1048] T 9cb931cb82d74add922e65a2ea3de34d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:49.592653 24731 consensus_queue.cc:1048] T 00b51df5a8ee448884a9f145559a5ea3 P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:49.471050 24748 raft_consensus.cc:515] T 7cbef09353144c0b9a9ebf7731fd019f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:49.595649 24731 consensus_queue.cc:1048] T 628105dfc534451285d72f9e17f5d4f3 P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:49.597661 24748 leader_election.cc:290] T 7cbef09353144c0b9a9ebf7731fd019f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 2 election: Requested vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:14:49.599469 24104 catalog_manager.cc:5697] T 9cb931cb82d74add922e65a2ea3de34d P 9bf3da5b54ef4a1ea1cee60f02ea2883 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193). New cstate: current_term: 1 leader_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:49.612516 24479 tablet_bootstrap.cc:492] T 93ece38976574ad7a5e93a69c33c074d P ad362df39b114ec3a3a419128097b362: No bootstrap required, opened a new log
I20260709 12:14:49.600207 24356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbef09353144c0b9a9ebf7731fd019f" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
I20260709 12:14:49.614710 24356 raft_consensus.cc:3060] T 7cbef09353144c0b9a9ebf7731fd019f P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:49.613376 24479 ts_tablet_manager.cc:1403] T 93ece38976574ad7a5e93a69c33c074d P ad362df39b114ec3a3a419128097b362: Time spent bootstrapping tablet: real 0.165s	user 0.021s	sys 0.010s
I20260709 12:14:49.616920 24359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f756e6bcc20458b8748cd090cd3fce2" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:49.615643 24723 consensus_queue.cc:1048] T 00b51df5a8ee448884a9f145559a5ea3 P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:49.605213 24396 leader_election.cc:304] T 4f756e6bcc20458b8748cd090cd3fce2 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, ad362df39b114ec3a3a419128097b362; no voters: 
I20260709 12:14:49.608294 24208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbef09353144c0b9a9ebf7731fd019f" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
I20260709 12:14:49.619203 24359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbef09353144c0b9a9ebf7731fd019f" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
I20260709 12:14:49.619957 24208 raft_consensus.cc:2393] T 7cbef09353144c0b9a9ebf7731fd019f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ad362df39b114ec3a3a419128097b362 in current term 2: Already voted for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in this term.
I20260709 12:14:49.620918 24586 raft_consensus.cc:2804] T 4f756e6bcc20458b8748cd090cd3fce2 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:49.621380 24586 raft_consensus.cc:493] T 4f756e6bcc20458b8748cd090cd3fce2 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:49.609475 24478 tablet_bootstrap.cc:654] T 3fe3be6bb3264475ba597fec30a06f6c P cf2d8294ae68482ca4ffa8be051ad054: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:49.623493 24586 raft_consensus.cc:3060] T 4f756e6bcc20458b8748cd090cd3fce2 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:49.650254 24108 catalog_manager.cc:5697] T 628105dfc534451285d72f9e17f5d4f3 P aa14caefbdaa47b09abf91881635ba96 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194). New cstate: current_term: 1 leader_uuid: "cf2d8294ae68482ca4ffa8be051ad054" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } }
I20260709 12:14:49.602586 24637 raft_consensus.cc:515] T 7c84013312e3409d851214e9954dad8b P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:49.658890 24481 ts_tablet_manager.cc:1434] T 5310371490a542269db28e29d7adfffa P aa14caefbdaa47b09abf91881635ba96: Time spent starting tablet: real 0.169s	user 0.022s	sys 0.040s
W20260709 12:14:49.640365 24398 leader_election.cc:343] T 4f756e6bcc20458b8748cd090cd3fce2 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:49.673477 24637 leader_election.cc:290] T 7c84013312e3409d851214e9954dad8b P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 election: Requested vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:14:49.676924 24282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c84013312e3409d851214e9954dad8b" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054"
I20260709 12:14:49.678082 24282 raft_consensus.cc:3060] T 7c84013312e3409d851214e9954dad8b P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:49.661067 24429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbef09353144c0b9a9ebf7731fd019f" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362"
I20260709 12:14:49.679520 24429 raft_consensus.cc:2393] T 7cbef09353144c0b9a9ebf7731fd019f P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in current term 2: Already voted for candidate ad362df39b114ec3a3a419128097b362 in this term.
I20260709 12:14:49.684795 24357 raft_consensus.cc:3060] T 5310371490a542269db28e29d7adfffa P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:14:49.685741 24398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:46845, user_credentials={real_user=slave}} blocked reactor thread for 46891.1us
I20260709 12:14:49.686887 24398 leader_election.cc:304] T 7cbef09353144c0b9a9ebf7731fd019f P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad362df39b114ec3a3a419128097b362; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, aa14caefbdaa47b09abf91881635ba96
I20260709 12:14:49.688407 24618 raft_consensus.cc:2749] T 7cbef09353144c0b9a9ebf7731fd019f P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:14:49.694384 24432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c84013312e3409d851214e9954dad8b" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362"
I20260709 12:14:49.695261 24432 raft_consensus.cc:3060] T 7c84013312e3409d851214e9954dad8b P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:14:49.698668 24248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:38787, user_credentials={real_user=slave}} blocked reactor thread for 104399us
I20260709 12:14:49.719875 24481 tablet_bootstrap.cc:492] T 4f756e6bcc20458b8748cd090cd3fce2 P aa14caefbdaa47b09abf91881635ba96: Bootstrap starting.
I20260709 12:14:49.725349 24732 consensus_queue.cc:1048] T 5310371490a542269db28e29d7adfffa P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:49.727739 24586 raft_consensus.cc:515] T 4f756e6bcc20458b8748cd090cd3fce2 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:49.766916 24482 tablet_bootstrap.cc:492] T d10519ad64d948b09186e335ed06257d P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:14:49.786931 24748 raft_consensus.cc:493] T 356b14abd90d418cab44e524aef8154c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:49.795526 24586 leader_election.cc:290] T 4f756e6bcc20458b8748cd090cd3fce2 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 election: Requested vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:49.798139 24358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f756e6bcc20458b8748cd090cd3fce2" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
I20260709 12:14:49.800343 24210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f756e6bcc20458b8748cd090cd3fce2" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
W20260709 12:14:49.800638 24398 leader_election.cc:343] T 4f756e6bcc20458b8748cd090cd3fce2 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:49.801218 24210 raft_consensus.cc:3060] T 4f756e6bcc20458b8748cd090cd3fce2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:49.789661 24356 raft_consensus.cc:2468] T 7cbef09353144c0b9a9ebf7731fd019f P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 2.
I20260709 12:14:49.806850 24478 tablet_bootstrap.cc:492] T 3fe3be6bb3264475ba597fec30a06f6c P cf2d8294ae68482ca4ffa8be051ad054: No bootstrap required, opened a new log
I20260709 12:14:49.807600 24478 ts_tablet_manager.cc:1403] T 3fe3be6bb3264475ba597fec30a06f6c P cf2d8294ae68482ca4ffa8be051ad054: Time spent bootstrapping tablet: real 0.293s	user 0.022s	sys 0.002s
I20260709 12:14:49.811738 24479 raft_consensus.cc:359] T 93ece38976574ad7a5e93a69c33c074d P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:49.812566 24479 raft_consensus.cc:385] T 93ece38976574ad7a5e93a69c33c074d P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:49.812877 24479 raft_consensus.cc:740] T 93ece38976574ad7a5e93a69c33c074d P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad362df39b114ec3a3a419128097b362, State: Initialized, Role: FOLLOWER
I20260709 12:14:49.787761 24748 raft_consensus.cc:515] T 356b14abd90d418cab44e524aef8154c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:49.815196 24479 consensus_queue.cc:260] T 93ece38976574ad7a5e93a69c33c074d P ad362df39b114ec3a3a419128097b362 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:49.816723 24748 leader_election.cc:290] T 356b14abd90d418cab44e524aef8154c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:14:49.803598 24618 raft_consensus.cc:493] T 464c7ebd16cd488086ccaec23defbb33 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:49.818740 24283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b14abd90d418cab44e524aef8154c" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:49.820467 24479 ts_tablet_manager.cc:1434] T 93ece38976574ad7a5e93a69c33c074d P ad362df39b114ec3a3a419128097b362: Time spent starting tablet: real 0.204s	user 0.006s	sys 0.003s
I20260709 12:14:49.821102 24618 raft_consensus.cc:515] T 464c7ebd16cd488086ccaec23defbb33 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:49.842404 24618 leader_election.cc:290] T 464c7ebd16cd488086ccaec23defbb33 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:49.828706 24106 catalog_manager.cc:5697] T 5310371490a542269db28e29d7adfffa P cf2d8294ae68482ca4ffa8be051ad054 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194). New cstate: current_term: 1 leader_uuid: "cf2d8294ae68482ca4ffa8be051ad054" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:49.837700 24479 tablet_bootstrap.cc:492] T d10519ad64d948b09186e335ed06257d P ad362df39b114ec3a3a419128097b362: Bootstrap starting.
W20260709 12:14:49.831868 24176 leader_election.cc:343] T 356b14abd90d418cab44e524aef8154c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:49.846446 24106 catalog_manager.cc:5697] T 00b51df5a8ee448884a9f145559a5ea3 P cf2d8294ae68482ca4ffa8be051ad054 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194). New cstate: current_term: 1 leader_uuid: "cf2d8294ae68482ca4ffa8be051ad054" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:49.852978 24356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464c7ebd16cd488086ccaec23defbb33" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:49.854089 24206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464c7ebd16cd488086ccaec23defbb33" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
W20260709 12:14:49.855021 24398 leader_election.cc:343] T 464c7ebd16cd488086ccaec23defbb33 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:49.855386 24432 raft_consensus.cc:2468] T 7c84013312e3409d851214e9954dad8b P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa14caefbdaa47b09abf91881635ba96 in term 1.
I20260709 12:14:49.855613 24478 raft_consensus.cc:359] T 3fe3be6bb3264475ba597fec30a06f6c P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:49.856465 24478 raft_consensus.cc:385] T 3fe3be6bb3264475ba597fec30a06f6c P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:14:49.856315 24396 leader_election.cc:343] T 464c7ebd16cd488086ccaec23defbb33 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:49.857107 24478 raft_consensus.cc:740] T 3fe3be6bb3264475ba597fec30a06f6c P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Initialized, Role: FOLLOWER
I20260709 12:14:49.857352 24396 leader_election.cc:304] T 464c7ebd16cd488086ccaec23defbb33 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad362df39b114ec3a3a419128097b362; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, aa14caefbdaa47b09abf91881635ba96
I20260709 12:14:49.857896 24323 leader_election.cc:304] T 7c84013312e3409d851214e9954dad8b P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, ad362df39b114ec3a3a419128097b362; no voters: 
I20260709 12:14:49.859143 24727 raft_consensus.cc:2804] T 7c84013312e3409d851214e9954dad8b P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:49.859799 24727 raft_consensus.cc:697] T 7c84013312e3409d851214e9954dad8b P aa14caefbdaa47b09abf91881635ba96 [term 1 LEADER]: Becoming Leader. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Running, Role: LEADER
I20260709 12:14:49.861379 24727 consensus_queue.cc:237] T 7c84013312e3409d851214e9954dad8b P aa14caefbdaa47b09abf91881635ba96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
W20260709 12:14:49.852811 24322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:38787, user_credentials={real_user=slave}} blocked reactor thread for 134765us
I20260709 12:14:49.866315 24175 leader_election.cc:304] T 7cbef09353144c0b9a9ebf7731fd019f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, aa14caefbdaa47b09abf91881635ba96; no voters: ad362df39b114ec3a3a419128097b362
I20260709 12:14:49.867630 24636 raft_consensus.cc:2804] T 7cbef09353144c0b9a9ebf7731fd019f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:49.868242 24636 raft_consensus.cc:697] T 7cbef09353144c0b9a9ebf7731fd019f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 LEADER]: Becoming Leader. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Running, Role: LEADER
I20260709 12:14:49.869334 24636 consensus_queue.cc:237] T 7cbef09353144c0b9a9ebf7731fd019f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:49.872895 24356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b14abd90d418cab44e524aef8154c" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:49.874553 24586 raft_consensus.cc:2749] T 464c7ebd16cd488086ccaec23defbb33 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:49.880177 24210 raft_consensus.cc:2468] T 4f756e6bcc20458b8748cd090cd3fce2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 1.
I20260709 12:14:49.885744 24481 tablet_bootstrap.cc:654] T 4f756e6bcc20458b8748cd090cd3fce2 P aa14caefbdaa47b09abf91881635ba96: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:49.889626 24482 tablet_bootstrap.cc:654] T d10519ad64d948b09186e335ed06257d P 9bf3da5b54ef4a1ea1cee60f02ea2883: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:49.895509 24396 leader_election.cc:304] T 4f756e6bcc20458b8748cd090cd3fce2 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, ad362df39b114ec3a3a419128097b362; no voters: aa14caefbdaa47b09abf91881635ba96
I20260709 12:14:49.898958 24586 raft_consensus.cc:2804] T 4f756e6bcc20458b8748cd090cd3fce2 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:49.899739 24586 raft_consensus.cc:697] T 4f756e6bcc20458b8748cd090cd3fce2 P ad362df39b114ec3a3a419128097b362 [term 1 LEADER]: Becoming Leader. State: Replica: ad362df39b114ec3a3a419128097b362, State: Running, Role: LEADER
I20260709 12:14:49.904062 24282 raft_consensus.cc:2468] T 7c84013312e3409d851214e9954dad8b P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa14caefbdaa47b09abf91881635ba96 in term 1.
I20260709 12:14:49.901098 24586 consensus_queue.cc:237] T 4f756e6bcc20458b8748cd090cd3fce2 P ad362df39b114ec3a3a419128097b362 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:49.911873 24478 consensus_queue.cc:260] T 3fe3be6bb3264475ba597fec30a06f6c P cf2d8294ae68482ca4ffa8be051ad054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:49.945317 24478 ts_tablet_manager.cc:1434] T 3fe3be6bb3264475ba597fec30a06f6c P cf2d8294ae68482ca4ffa8be051ad054: Time spent starting tablet: real 0.137s	user 0.009s	sys 0.001s
W20260709 12:14:49.947602 24175 leader_election.cc:343] T 356b14abd90d418cab44e524aef8154c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:49.948280 24175 leader_election.cc:304] T 356b14abd90d418cab44e524aef8154c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883; no voters: aa14caefbdaa47b09abf91881635ba96, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:14:49.950156 24636 raft_consensus.cc:2749] T 356b14abd90d418cab44e524aef8154c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:49.944157 24732 consensus_queue.cc:1048] T 5310371490a542269db28e29d7adfffa P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
W20260709 12:14:49.980997 24155 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:50.005272 24479 tablet_bootstrap.cc:654] T d10519ad64d948b09186e335ed06257d P ad362df39b114ec3a3a419128097b362: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:50.008030 24478 tablet_bootstrap.cc:492] T d10519ad64d948b09186e335ed06257d P cf2d8294ae68482ca4ffa8be051ad054: Bootstrap starting.
I20260709 12:14:50.033011 24482 tablet_bootstrap.cc:492] T d10519ad64d948b09186e335ed06257d P 9bf3da5b54ef4a1ea1cee60f02ea2883: No bootstrap required, opened a new log
I20260709 12:14:50.033676 24482 ts_tablet_manager.cc:1403] T d10519ad64d948b09186e335ed06257d P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.279s	user 0.022s	sys 0.023s
I20260709 12:14:50.038705 24482 raft_consensus.cc:359] T d10519ad64d948b09186e335ed06257d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:50.039366 24478 tablet_bootstrap.cc:654] T d10519ad64d948b09186e335ed06257d P cf2d8294ae68482ca4ffa8be051ad054: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:50.039462 24482 raft_consensus.cc:385] T d10519ad64d948b09186e335ed06257d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:50.040107 24482 raft_consensus.cc:740] T d10519ad64d948b09186e335ed06257d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:14:50.040584 24481 tablet_bootstrap.cc:492] T 4f756e6bcc20458b8748cd090cd3fce2 P aa14caefbdaa47b09abf91881635ba96: No bootstrap required, opened a new log
I20260709 12:14:50.041167 24481 ts_tablet_manager.cc:1403] T 4f756e6bcc20458b8748cd090cd3fce2 P aa14caefbdaa47b09abf91881635ba96: Time spent bootstrapping tablet: real 0.324s	user 0.023s	sys 0.004s
I20260709 12:14:50.041373 24479 tablet_bootstrap.cc:492] T d10519ad64d948b09186e335ed06257d P ad362df39b114ec3a3a419128097b362: No bootstrap required, opened a new log
I20260709 12:14:50.042016 24479 ts_tablet_manager.cc:1403] T d10519ad64d948b09186e335ed06257d P ad362df39b114ec3a3a419128097b362: Time spent bootstrapping tablet: real 0.205s	user 0.022s	sys 0.001s
I20260709 12:14:50.045814 24479 raft_consensus.cc:359] T d10519ad64d948b09186e335ed06257d P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:50.047104 24103 catalog_manager.cc:5697] T 4f756e6bcc20458b8748cd090cd3fce2 P ad362df39b114ec3a3a419128097b362 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad362df39b114ec3a3a419128097b362 (127.12.56.196). New cstate: current_term: 1 leader_uuid: "ad362df39b114ec3a3a419128097b362" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:50.047219 24479 raft_consensus.cc:385] T d10519ad64d948b09186e335ed06257d P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:50.048715 24479 raft_consensus.cc:740] T d10519ad64d948b09186e335ed06257d P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad362df39b114ec3a3a419128097b362, State: Initialized, Role: FOLLOWER
I20260709 12:14:50.051317 24481 raft_consensus.cc:359] T 4f756e6bcc20458b8748cd090cd3fce2 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:50.052193 24481 raft_consensus.cc:385] T 4f756e6bcc20458b8748cd090cd3fce2 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:50.052549 24481 raft_consensus.cc:740] T 4f756e6bcc20458b8748cd090cd3fce2 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Initialized, Role: FOLLOWER
I20260709 12:14:50.053364 24481 consensus_queue.cc:260] T 4f756e6bcc20458b8748cd090cd3fce2 P aa14caefbdaa47b09abf91881635ba96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:50.056035 24481 ts_tablet_manager.cc:1434] T 4f756e6bcc20458b8748cd090cd3fce2 P aa14caefbdaa47b09abf91881635ba96: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 12:14:50.057298 24481 tablet_bootstrap.cc:492] T 464c7ebd16cd488086ccaec23defbb33 P aa14caefbdaa47b09abf91881635ba96: Bootstrap starting.
I20260709 12:14:50.064106 24481 tablet_bootstrap.cc:654] T 464c7ebd16cd488086ccaec23defbb33 P aa14caefbdaa47b09abf91881635ba96: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:50.067149 24108 catalog_manager.cc:5697] T 7c84013312e3409d851214e9954dad8b P aa14caefbdaa47b09abf91881635ba96 reported cstate change: term changed from 0 to 1, leader changed from <none> to aa14caefbdaa47b09abf91881635ba96 (127.12.56.195). New cstate: current_term: 1 leader_uuid: "aa14caefbdaa47b09abf91881635ba96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:50.077123 24780 raft_consensus.cc:493] T 3fe3be6bb3264475ba597fec30a06f6c P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:50.078068 24780 raft_consensus.cc:515] T 3fe3be6bb3264475ba597fec30a06f6c P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:50.082839 24358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe3be6bb3264475ba597fec30a06f6c" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
W20260709 12:14:50.084686 24250 leader_election.cc:343] T 3fe3be6bb3264475ba597fec30a06f6c P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:50.085950 24209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe3be6bb3264475ba597fec30a06f6c" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
I20260709 12:14:50.086833 24209 raft_consensus.cc:2468] T 3fe3be6bb3264475ba597fec30a06f6c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 0.
I20260709 12:14:50.088486 24248 leader_election.cc:304] T 3fe3be6bb3264475ba597fec30a06f6c P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054; no voters: aa14caefbdaa47b09abf91881635ba96
I20260709 12:14:50.089365 24780 leader_election.cc:290] T 3fe3be6bb3264475ba597fec30a06f6c P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:14:50.089825 24731 raft_consensus.cc:2804] T 3fe3be6bb3264475ba597fec30a06f6c P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:50.090534 24731 raft_consensus.cc:493] T 3fe3be6bb3264475ba597fec30a06f6c P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:50.067067 24479 consensus_queue.cc:260] T d10519ad64d948b09186e335ed06257d P ad362df39b114ec3a3a419128097b362 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:50.091081 24731 raft_consensus.cc:3060] T 3fe3be6bb3264475ba597fec30a06f6c P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:50.094046 24479 ts_tablet_manager.cc:1434] T d10519ad64d948b09186e335ed06257d P ad362df39b114ec3a3a419128097b362: Time spent starting tablet: real 0.052s	user 0.011s	sys 0.000s
I20260709 12:14:50.099269 24746 raft_consensus.cc:493] T 93ece38976574ad7a5e93a69c33c074d P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:50.099977 24746 raft_consensus.cc:515] T 93ece38976574ad7a5e93a69c33c074d P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:50.102563 24482 consensus_queue.cc:260] T d10519ad64d948b09186e335ed06257d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:50.104864 24358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93ece38976574ad7a5e93a69c33c074d" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:50.105888 24482 ts_tablet_manager.cc:1434] T d10519ad64d948b09186e335ed06257d P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.072s	user 0.008s	sys 0.000s
I20260709 12:14:50.106223 24282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93ece38976574ad7a5e93a69c33c074d" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:50.106930 24746 leader_election.cc:290] T 93ece38976574ad7a5e93a69c33c074d P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:14:50.107190 24482 tablet_bootstrap.cc:492] T 464c7ebd16cd488086ccaec23defbb33 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
W20260709 12:14:50.110317 24399 leader_election.cc:343] T 93ece38976574ad7a5e93a69c33c074d P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:50.122574 24479 tablet_bootstrap.cc:492] T 67c0216443004287861015dd30ae5144 P ad362df39b114ec3a3a419128097b362: Bootstrap starting.
W20260709 12:14:50.126269 24398 leader_election.cc:343] T 93ece38976574ad7a5e93a69c33c074d P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:50.128830 24398 leader_election.cc:304] T 93ece38976574ad7a5e93a69c33c074d P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad362df39b114ec3a3a419128097b362; no voters: aa14caefbdaa47b09abf91881635ba96, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:14:50.129858 24746 raft_consensus.cc:2749] T 93ece38976574ad7a5e93a69c33c074d P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:50.133087 24479 tablet_bootstrap.cc:654] T 67c0216443004287861015dd30ae5144 P ad362df39b114ec3a3a419128097b362: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:50.141108 24748 raft_consensus.cc:493] T d10519ad64d948b09186e335ed06257d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:50.141861 24748 raft_consensus.cc:515] T d10519ad64d948b09186e335ed06257d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:50.147783 24432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10519ad64d948b09186e335ed06257d" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:50.148741 24432 raft_consensus.cc:2468] T d10519ad64d948b09186e335ed06257d P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 0.
I20260709 12:14:50.149835 24748 leader_election.cc:290] T d10519ad64d948b09186e335ed06257d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:14:50.156262 24282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10519ad64d948b09186e335ed06257d" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
W20260709 12:14:50.157768 24176 leader_election.cc:343] T d10519ad64d948b09186e335ed06257d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:50.165493 24731 raft_consensus.cc:515] T 3fe3be6bb3264475ba597fec30a06f6c P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:50.168584 24174 leader_election.cc:304] T d10519ad64d948b09186e335ed06257d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, ad362df39b114ec3a3a419128097b362; no voters: cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:14:50.174784 24636 raft_consensus.cc:2804] T d10519ad64d948b09186e335ed06257d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:50.175722 24636 raft_consensus.cc:493] T d10519ad64d948b09186e335ed06257d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:50.176265 24636 raft_consensus.cc:3060] T d10519ad64d948b09186e335ed06257d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:50.186235 24356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe3be6bb3264475ba597fec30a06f6c" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
I20260709 12:14:50.192008 24478 tablet_bootstrap.cc:492] T d10519ad64d948b09186e335ed06257d P cf2d8294ae68482ca4ffa8be051ad054: No bootstrap required, opened a new log
I20260709 12:14:50.192662 24478 ts_tablet_manager.cc:1403] T d10519ad64d948b09186e335ed06257d P cf2d8294ae68482ca4ffa8be051ad054: Time spent bootstrapping tablet: real 0.216s	user 0.058s	sys 0.057s
W20260709 12:14:50.195994 24250 leader_election.cc:343] T 3fe3be6bb3264475ba597fec30a06f6c P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:50.196084 24478 raft_consensus.cc:359] T d10519ad64d948b09186e335ed06257d P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:50.197043 24478 raft_consensus.cc:385] T d10519ad64d948b09186e335ed06257d P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:50.197393 24478 raft_consensus.cc:740] T d10519ad64d948b09186e335ed06257d P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Initialized, Role: FOLLOWER
I20260709 12:14:50.198238 24478 consensus_queue.cc:260] T d10519ad64d948b09186e335ed06257d P cf2d8294ae68482ca4ffa8be051ad054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:50.200742 24478 ts_tablet_manager.cc:1434] T d10519ad64d948b09186e335ed06257d P cf2d8294ae68482ca4ffa8be051ad054: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:14:50.180878 24731 leader_election.cc:290] T 3fe3be6bb3264475ba597fec30a06f6c P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 election: Requested vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:14:50.205175 24482 tablet_bootstrap.cc:654] T 464c7ebd16cd488086ccaec23defbb33 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:50.212471 24478 tablet_bootstrap.cc:492] T 93ece38976574ad7a5e93a69c33c074d P cf2d8294ae68482ca4ffa8be051ad054: Bootstrap starting.
I20260709 12:14:50.218348 24209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe3be6bb3264475ba597fec30a06f6c" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
I20260709 12:14:50.219347 24209 raft_consensus.cc:3060] T 3fe3be6bb3264475ba597fec30a06f6c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:50.221076 24478 tablet_bootstrap.cc:654] T 93ece38976574ad7a5e93a69c33c074d P cf2d8294ae68482ca4ffa8be051ad054: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:50.233425 24481 tablet_bootstrap.cc:492] T 464c7ebd16cd488086ccaec23defbb33 P aa14caefbdaa47b09abf91881635ba96: No bootstrap required, opened a new log
I20260709 12:14:50.204137 24636 raft_consensus.cc:515] T d10519ad64d948b09186e335ed06257d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:50.248373 24481 ts_tablet_manager.cc:1403] T 464c7ebd16cd488086ccaec23defbb33 P aa14caefbdaa47b09abf91881635ba96: Time spent bootstrapping tablet: real 0.191s	user 0.052s	sys 0.010s
I20260709 12:14:50.253332 24282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10519ad64d948b09186e335ed06257d" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054"
I20260709 12:14:50.255072 24282 raft_consensus.cc:3060] T d10519ad64d948b09186e335ed06257d P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:50.253328 24432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10519ad64d948b09186e335ed06257d" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362"
I20260709 12:14:50.260341 24432 raft_consensus.cc:3060] T d10519ad64d948b09186e335ed06257d P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:50.260819 24103 catalog_manager.cc:5697] T 7cbef09353144c0b9a9ebf7731fd019f P 9bf3da5b54ef4a1ea1cee60f02ea2883 reported cstate change: term changed from 0 to 2, leader changed from <none> to 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193). New cstate: current_term: 2 leader_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:50.271602 24727 consensus_queue.cc:1048] T 7c84013312e3409d851214e9954dad8b P aa14caefbdaa47b09abf91881635ba96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:50.260635 24636 leader_election.cc:290] T d10519ad64d948b09186e335ed06257d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 election: Requested vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:14:50.278919 24432 raft_consensus.cc:2468] T d10519ad64d948b09186e335ed06257d P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 1.
I20260709 12:14:50.283082 24174 leader_election.cc:304] T d10519ad64d948b09186e335ed06257d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, ad362df39b114ec3a3a419128097b362; no voters: 
I20260709 12:14:50.285176 24636 raft_consensus.cc:2804] T d10519ad64d948b09186e335ed06257d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:50.286857 24478 tablet_bootstrap.cc:492] T 93ece38976574ad7a5e93a69c33c074d P cf2d8294ae68482ca4ffa8be051ad054: No bootstrap required, opened a new log
I20260709 12:14:50.287076 24482 tablet_bootstrap.cc:492] T 464c7ebd16cd488086ccaec23defbb33 P 9bf3da5b54ef4a1ea1cee60f02ea2883: No bootstrap required, opened a new log
I20260709 12:14:50.287447 24478 ts_tablet_manager.cc:1403] T 93ece38976574ad7a5e93a69c33c074d P cf2d8294ae68482ca4ffa8be051ad054: Time spent bootstrapping tablet: real 0.075s	user 0.009s	sys 0.016s
I20260709 12:14:50.287647 24482 ts_tablet_manager.cc:1403] T 464c7ebd16cd488086ccaec23defbb33 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.181s	user 0.039s	sys 0.009s
I20260709 12:14:50.289912 24209 raft_consensus.cc:2468] T 3fe3be6bb3264475ba597fec30a06f6c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 1.
I20260709 12:14:50.290598 24636 raft_consensus.cc:697] T d10519ad64d948b09186e335ed06257d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 LEADER]: Becoming Leader. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Running, Role: LEADER
I20260709 12:14:50.292594 24248 leader_election.cc:304] T 3fe3be6bb3264475ba597fec30a06f6c P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054; no voters: aa14caefbdaa47b09abf91881635ba96
I20260709 12:14:50.292752 24636 consensus_queue.cc:237] T d10519ad64d948b09186e335ed06257d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:50.293470 24478 raft_consensus.cc:359] T 93ece38976574ad7a5e93a69c33c074d P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:50.294392 24478 raft_consensus.cc:385] T 93ece38976574ad7a5e93a69c33c074d P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:50.294724 24478 raft_consensus.cc:740] T 93ece38976574ad7a5e93a69c33c074d P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Initialized, Role: FOLLOWER
I20260709 12:14:50.281975 24282 raft_consensus.cc:2468] T d10519ad64d948b09186e335ed06257d P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 1.
I20260709 12:14:50.295280 24731 raft_consensus.cc:2804] T 3fe3be6bb3264475ba597fec30a06f6c P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:50.291781 24479 tablet_bootstrap.cc:492] T 67c0216443004287861015dd30ae5144 P ad362df39b114ec3a3a419128097b362: No bootstrap required, opened a new log
I20260709 12:14:50.295838 24731 raft_consensus.cc:697] T 3fe3be6bb3264475ba597fec30a06f6c P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Becoming Leader. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Running, Role: LEADER
I20260709 12:14:50.295571 24478 consensus_queue.cc:260] T 93ece38976574ad7a5e93a69c33c074d P cf2d8294ae68482ca4ffa8be051ad054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:50.296082 24479 ts_tablet_manager.cc:1403] T 67c0216443004287861015dd30ae5144 P ad362df39b114ec3a3a419128097b362: Time spent bootstrapping tablet: real 0.174s	user 0.032s	sys 0.042s
I20260709 12:14:50.298281 24478 ts_tablet_manager.cc:1434] T 93ece38976574ad7a5e93a69c33c074d P cf2d8294ae68482ca4ffa8be051ad054: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.007s
I20260709 12:14:50.298519 24731 consensus_queue.cc:237] T 3fe3be6bb3264475ba597fec30a06f6c P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:50.299669 24478 tablet_bootstrap.cc:492] T 356b14abd90d418cab44e524aef8154c P cf2d8294ae68482ca4ffa8be051ad054: Bootstrap starting.
I20260709 12:14:50.303506 24482 raft_consensus.cc:359] T 464c7ebd16cd488086ccaec23defbb33 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:50.304423 24482 raft_consensus.cc:385] T 464c7ebd16cd488086ccaec23defbb33 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:50.304816 24482 raft_consensus.cc:740] T 464c7ebd16cd488086ccaec23defbb33 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:14:50.305908 24482 consensus_queue.cc:260] T 464c7ebd16cd488086ccaec23defbb33 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:50.310137 24433 raft_consensus.cc:1275] T 7cbef09353144c0b9a9ebf7731fd019f P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Refusing update from remote peer 9bf3da5b54ef4a1ea1cee60f02ea2883: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:14:50.312479 24479 raft_consensus.cc:359] T 67c0216443004287861015dd30ae5144 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:50.313758 24479 raft_consensus.cc:385] T 67c0216443004287861015dd30ae5144 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:50.314285 24479 raft_consensus.cc:740] T 67c0216443004287861015dd30ae5144 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad362df39b114ec3a3a419128097b362, State: Initialized, Role: FOLLOWER
I20260709 12:14:50.315500 24479 consensus_queue.cc:260] T 67c0216443004287861015dd30ae5144 P ad362df39b114ec3a3a419128097b362 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:50.319672 24482 ts_tablet_manager.cc:1434] T 464c7ebd16cd488086ccaec23defbb33 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.032s	user 0.004s	sys 0.008s
I20260709 12:14:50.321415 24482 tablet_bootstrap.cc:492] T 67c0216443004287861015dd30ae5144 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:14:50.319685 24479 ts_tablet_manager.cc:1434] T 67c0216443004287861015dd30ae5144 P ad362df39b114ec3a3a419128097b362: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.003s
I20260709 12:14:50.322162 24481 raft_consensus.cc:359] T 464c7ebd16cd488086ccaec23defbb33 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:50.323061 24481 raft_consensus.cc:385] T 464c7ebd16cd488086ccaec23defbb33 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:50.323407 24481 raft_consensus.cc:740] T 464c7ebd16cd488086ccaec23defbb33 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Initialized, Role: FOLLOWER
I20260709 12:14:50.324833 24479 tablet_bootstrap.cc:492] T fa882381d669422a95ec60c9aefa8105 P ad362df39b114ec3a3a419128097b362: Bootstrap starting.
I20260709 12:14:50.324402 24481 consensus_queue.cc:260] T 464c7ebd16cd488086ccaec23defbb33 P aa14caefbdaa47b09abf91881635ba96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:50.327972 24481 ts_tablet_manager.cc:1434] T 464c7ebd16cd488086ccaec23defbb33 P aa14caefbdaa47b09abf91881635ba96: Time spent starting tablet: real 0.070s	user 0.006s	sys 0.004s
I20260709 12:14:50.329583 24756 consensus_queue.cc:1048] T 7c84013312e3409d851214e9954dad8b P aa14caefbdaa47b09abf91881635ba96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:50.329548 24481 tablet_bootstrap.cc:492] T 93ece38976574ad7a5e93a69c33c074d P aa14caefbdaa47b09abf91881635ba96: Bootstrap starting.
I20260709 12:14:50.338754 24358 raft_consensus.cc:3060] T 4f756e6bcc20458b8748cd090cd3fce2 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:50.342381 24479 tablet_bootstrap.cc:654] T fa882381d669422a95ec60c9aefa8105 P ad362df39b114ec3a3a419128097b362: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:50.348605 24478 tablet_bootstrap.cc:654] T 356b14abd90d418cab44e524aef8154c P cf2d8294ae68482ca4ffa8be051ad054: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:50.354642 24481 tablet_bootstrap.cc:654] T 93ece38976574ad7a5e93a69c33c074d P aa14caefbdaa47b09abf91881635ba96: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:50.325852 24748 consensus_queue.cc:1048] T 7cbef09353144c0b9a9ebf7731fd019f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.029s
I20260709 12:14:50.356082 24479 tablet_bootstrap.cc:492] T fa882381d669422a95ec60c9aefa8105 P ad362df39b114ec3a3a419128097b362: No bootstrap required, opened a new log
I20260709 12:14:50.356231 24482 tablet_bootstrap.cc:654] T 67c0216443004287861015dd30ae5144 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:50.358114 24479 ts_tablet_manager.cc:1403] T fa882381d669422a95ec60c9aefa8105 P ad362df39b114ec3a3a419128097b362: Time spent bootstrapping tablet: real 0.034s	user 0.014s	sys 0.001s
I20260709 12:14:50.361527 24357 raft_consensus.cc:1275] T 7cbef09353144c0b9a9ebf7731fd019f P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Refusing update from remote peer 9bf3da5b54ef4a1ea1cee60f02ea2883: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:14:50.359611 24756 raft_consensus.cc:493] T 464c7ebd16cd488086ccaec23defbb33 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:50.371225 24756 raft_consensus.cc:515] T 464c7ebd16cd488086ccaec23defbb33 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:50.371367 24636 consensus_queue.cc:1048] T 7cbef09353144c0b9a9ebf7731fd019f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:14:50.374653 24746 consensus_queue.cc:1048] T 4f756e6bcc20458b8748cd090cd3fce2 P ad362df39b114ec3a3a419128097b362 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:50.374667 24431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464c7ebd16cd488086ccaec23defbb33" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:50.377380 24479 raft_consensus.cc:359] T fa882381d669422a95ec60c9aefa8105 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:50.378504 24479 raft_consensus.cc:385] T fa882381d669422a95ec60c9aefa8105 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:50.378857 24479 raft_consensus.cc:740] T fa882381d669422a95ec60c9aefa8105 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad362df39b114ec3a3a419128097b362, State: Initialized, Role: FOLLOWER
I20260709 12:14:50.366707 24770 raft_consensus.cc:493] T 4f756e6bcc20458b8748cd090cd3fce2 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:50.379652 24479 consensus_queue.cc:260] T fa882381d669422a95ec60c9aefa8105 P ad362df39b114ec3a3a419128097b362 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:50.380069 24209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464c7ebd16cd488086ccaec23defbb33" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
I20260709 12:14:50.380187 24770 raft_consensus.cc:515] T 4f756e6bcc20458b8748cd090cd3fce2 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:50.380904 24209 raft_consensus.cc:2468] T 464c7ebd16cd488086ccaec23defbb33 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa14caefbdaa47b09abf91881635ba96 in term 0.
I20260709 12:14:50.382028 24479 ts_tablet_manager.cc:1434] T fa882381d669422a95ec60c9aefa8105 P ad362df39b114ec3a3a419128097b362: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.001s
I20260709 12:14:50.382660 24322 leader_election.cc:304] T 464c7ebd16cd488086ccaec23defbb33 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, aa14caefbdaa47b09abf91881635ba96; no voters: 
I20260709 12:14:50.383668 24479 tablet_bootstrap.cc:492] T cf280984dcfc44039a942819e8df951c P ad362df39b114ec3a3a419128097b362: Bootstrap starting.
I20260709 12:14:50.383700 24727 raft_consensus.cc:2804] T 464c7ebd16cd488086ccaec23defbb33 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:50.384372 24727 raft_consensus.cc:493] T 464c7ebd16cd488086ccaec23defbb33 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:50.384734 24727 raft_consensus.cc:3060] T 464c7ebd16cd488086ccaec23defbb33 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:50.385159 24429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f756e6bcc20458b8748cd090cd3fce2" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:50.383935 24770 leader_election.cc:290] T 4f756e6bcc20458b8748cd090cd3fce2 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:50.391067 24207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f756e6bcc20458b8748cd090cd3fce2" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
I20260709 12:14:50.391793 24479 tablet_bootstrap.cc:654] T cf280984dcfc44039a942819e8df951c P ad362df39b114ec3a3a419128097b362: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:50.391782 24207 raft_consensus.cc:2468] T 4f756e6bcc20458b8748cd090cd3fce2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa14caefbdaa47b09abf91881635ba96 in term 1.
I20260709 12:14:50.375696 24431 raft_consensus.cc:2468] T 464c7ebd16cd488086ccaec23defbb33 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa14caefbdaa47b09abf91881635ba96 in term 0.
I20260709 12:14:50.393618 24322 leader_election.cc:304] T 4f756e6bcc20458b8748cd090cd3fce2 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, aa14caefbdaa47b09abf91881635ba96; no voters: ad362df39b114ec3a3a419128097b362
I20260709 12:14:50.373675 24756 leader_election.cc:290] T 464c7ebd16cd488086ccaec23defbb33 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:50.401561 24746 raft_consensus.cc:493] T 67c0216443004287861015dd30ae5144 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:50.403122 24746 raft_consensus.cc:515] T 67c0216443004287861015dd30ae5144 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:50.403898 24563 consensus_queue.cc:1048] T 4f756e6bcc20458b8748cd090cd3fce2 P ad362df39b114ec3a3a419128097b362 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:50.405339 24746 leader_election.cc:290] T 67c0216443004287861015dd30ae5144 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:14:50.410176 24104 catalog_manager.cc:5697] T d10519ad64d948b09186e335ed06257d P 9bf3da5b54ef4a1ea1cee60f02ea2883 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193). New cstate: current_term: 1 leader_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:50.413748 24281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c0216443004287861015dd30ae5144" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:50.414180 24207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c0216443004287861015dd30ae5144" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
W20260709 12:14:50.415458 24399 leader_election.cc:343] T 67c0216443004287861015dd30ae5144 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:50.416595 24396 leader_election.cc:343] T 67c0216443004287861015dd30ae5144 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:50.417059 24396 leader_election.cc:304] T 67c0216443004287861015dd30ae5144 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad362df39b114ec3a3a419128097b362; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:14:50.419819 24746 raft_consensus.cc:2749] T 67c0216443004287861015dd30ae5144 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:50.421636 24727 raft_consensus.cc:515] T 464c7ebd16cd488086ccaec23defbb33 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:50.424088 24756 raft_consensus.cc:2804] T 4f756e6bcc20458b8748cd090cd3fce2 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:50.424816 24432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464c7ebd16cd488086ccaec23defbb33" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362"
I20260709 12:14:50.425515 24432 raft_consensus.cc:3060] T 464c7ebd16cd488086ccaec23defbb33 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:50.426025 24756 raft_consensus.cc:493] T 4f756e6bcc20458b8748cd090cd3fce2 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ad362df39b114ec3a3a419128097b362)
I20260709 12:14:50.426519 24756 raft_consensus.cc:3060] T 4f756e6bcc20458b8748cd090cd3fce2 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:50.428860 24103 catalog_manager.cc:5697] T 3fe3be6bb3264475ba597fec30a06f6c P cf2d8294ae68482ca4ffa8be051ad054 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194). New cstate: current_term: 1 leader_uuid: "cf2d8294ae68482ca4ffa8be051ad054" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:50.434309 24432 raft_consensus.cc:2468] T 464c7ebd16cd488086ccaec23defbb33 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa14caefbdaa47b09abf91881635ba96 in term 1.
I20260709 12:14:50.439998 24207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464c7ebd16cd488086ccaec23defbb33" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
I20260709 12:14:50.440436 24478 tablet_bootstrap.cc:492] T 356b14abd90d418cab44e524aef8154c P cf2d8294ae68482ca4ffa8be051ad054: No bootstrap required, opened a new log
I20260709 12:14:50.450702 24478 ts_tablet_manager.cc:1403] T 356b14abd90d418cab44e524aef8154c P cf2d8294ae68482ca4ffa8be051ad054: Time spent bootstrapping tablet: real 0.151s	user 0.021s	sys 0.003s
I20260709 12:14:50.458590 24478 raft_consensus.cc:359] T 356b14abd90d418cab44e524aef8154c P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:50.459419 24478 raft_consensus.cc:385] T 356b14abd90d418cab44e524aef8154c P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:50.459703 24478 raft_consensus.cc:740] T 356b14abd90d418cab44e524aef8154c P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Initialized, Role: FOLLOWER
I20260709 12:14:50.460466 24478 consensus_queue.cc:260] T 356b14abd90d418cab44e524aef8154c P cf2d8294ae68482ca4ffa8be051ad054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:50.455274 24586 raft_consensus.cc:493] T fa882381d669422a95ec60c9aefa8105 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:50.463069 24586 raft_consensus.cc:515] T fa882381d669422a95ec60c9aefa8105 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:50.464983 24323 leader_election.cc:304] T 464c7ebd16cd488086ccaec23defbb33 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, ad362df39b114ec3a3a419128097b362; no voters: 
I20260709 12:14:50.465327 24586 leader_election.cc:290] T fa882381d669422a95ec60c9aefa8105 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:50.451442 24207 raft_consensus.cc:3060] T 464c7ebd16cd488086ccaec23defbb33 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:50.466008 24770 raft_consensus.cc:2804] T 464c7ebd16cd488086ccaec23defbb33 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:50.446851 24727 leader_election.cc:290] T 464c7ebd16cd488086ccaec23defbb33 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 election: Requested vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:50.475049 24478 ts_tablet_manager.cc:1434] T 356b14abd90d418cab44e524aef8154c P cf2d8294ae68482ca4ffa8be051ad054: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 12:14:50.477597 24478 tablet_bootstrap.cc:492] T 67c0216443004287861015dd30ae5144 P cf2d8294ae68482ca4ffa8be051ad054: Bootstrap starting.
I20260709 12:14:50.482564 24209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa882381d669422a95ec60c9aefa8105" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
I20260709 12:14:50.502717 24770 raft_consensus.cc:697] T 464c7ebd16cd488086ccaec23defbb33 P aa14caefbdaa47b09abf91881635ba96 [term 1 LEADER]: Becoming Leader. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Running, Role: LEADER
I20260709 12:14:50.505054 24770 consensus_queue.cc:237] T 464c7ebd16cd488086ccaec23defbb33 P aa14caefbdaa47b09abf91881635ba96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:50.509452 24357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa882381d669422a95ec60c9aefa8105" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:50.544716 24207 raft_consensus.cc:2468] T 464c7ebd16cd488086ccaec23defbb33 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa14caefbdaa47b09abf91881635ba96 in term 1.
W20260709 12:14:50.546553 24789 log.cc:927] Time spent T 3fe3be6bb3264475ba597fec30a06f6c P cf2d8294ae68482ca4ffa8be051ad054: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 12:14:50.533989 24398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:46845, user_credentials={real_user=slave}} blocked reactor thread for 52008.5us
I20260709 12:14:50.576910 24479 tablet_bootstrap.cc:492] T cf280984dcfc44039a942819e8df951c P ad362df39b114ec3a3a419128097b362: No bootstrap required, opened a new log
I20260709 12:14:50.577701 24479 ts_tablet_manager.cc:1403] T cf280984dcfc44039a942819e8df951c P ad362df39b114ec3a3a419128097b362: Time spent bootstrapping tablet: real 0.194s	user 0.021s	sys 0.025s
I20260709 12:14:50.580410 24481 tablet_bootstrap.cc:492] T 93ece38976574ad7a5e93a69c33c074d P aa14caefbdaa47b09abf91881635ba96: No bootstrap required, opened a new log
I20260709 12:14:50.580996 24481 ts_tablet_manager.cc:1403] T 93ece38976574ad7a5e93a69c33c074d P aa14caefbdaa47b09abf91881635ba96: Time spent bootstrapping tablet: real 0.252s	user 0.012s	sys 0.020s
I20260709 12:14:50.580870 24756 raft_consensus.cc:515] T 4f756e6bcc20458b8748cd090cd3fce2 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:50.582930 24482 tablet_bootstrap.cc:492] T 67c0216443004287861015dd30ae5144 P 9bf3da5b54ef4a1ea1cee60f02ea2883: No bootstrap required, opened a new log
I20260709 12:14:50.586238 24482 ts_tablet_manager.cc:1403] T 67c0216443004287861015dd30ae5144 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.265s	user 0.022s	sys 0.007s
I20260709 12:14:50.589116 24482 raft_consensus.cc:359] T 67c0216443004287861015dd30ae5144 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:50.595589 24482 raft_consensus.cc:385] T 67c0216443004287861015dd30ae5144 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:50.595860 24780 raft_consensus.cc:493] T 356b14abd90d418cab44e524aef8154c P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:50.596052 24482 raft_consensus.cc:740] T 67c0216443004287861015dd30ae5144 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:14:50.596403 24780 raft_consensus.cc:515] T 356b14abd90d418cab44e524aef8154c P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:50.596890 24482 consensus_queue.cc:260] T 67c0216443004287861015dd30ae5144 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:50.598775 24780 leader_election.cc:290] T 356b14abd90d418cab44e524aef8154c P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:14:50.592195 24478 tablet_bootstrap.cc:654] T 67c0216443004287861015dd30ae5144 P cf2d8294ae68482ca4ffa8be051ad054: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:50.592298 24433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f756e6bcc20458b8748cd090cd3fce2" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362"
I20260709 12:14:50.600425 24356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b14abd90d418cab44e524aef8154c" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
W20260709 12:14:50.602131 24250 leader_election.cc:343] T 356b14abd90d418cab44e524aef8154c P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:50.603613 24479 raft_consensus.cc:359] T cf280984dcfc44039a942819e8df951c P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:50.604622 24479 raft_consensus.cc:385] T cf280984dcfc44039a942819e8df951c P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:50.605000 24479 raft_consensus.cc:740] T cf280984dcfc44039a942819e8df951c P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad362df39b114ec3a3a419128097b362, State: Initialized, Role: FOLLOWER
I20260709 12:14:50.593976 24756 leader_election.cc:290] T 4f756e6bcc20458b8748cd090cd3fce2 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 election: Requested vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:50.584403 24481 raft_consensus.cc:359] T 93ece38976574ad7a5e93a69c33c074d P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:50.607368 24481 raft_consensus.cc:385] T 93ece38976574ad7a5e93a69c33c074d P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:50.607817 24481 raft_consensus.cc:740] T 93ece38976574ad7a5e93a69c33c074d P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Initialized, Role: FOLLOWER
I20260709 12:14:50.610690 24479 consensus_queue.cc:260] T cf280984dcfc44039a942819e8df951c P ad362df39b114ec3a3a419128097b362 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
W20260709 12:14:50.575584 24396 leader_election.cc:343] T fa882381d669422a95ec60c9aefa8105 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:50.614022 24481 consensus_queue.cc:260] T 93ece38976574ad7a5e93a69c33c074d P aa14caefbdaa47b09abf91881635ba96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:50.625387 24481 ts_tablet_manager.cc:1434] T 93ece38976574ad7a5e93a69c33c074d P aa14caefbdaa47b09abf91881635ba96: Time spent starting tablet: real 0.044s	user 0.003s	sys 0.006s
I20260709 12:14:50.619302 24731 raft_consensus.cc:493] T 93ece38976574ad7a5e93a69c33c074d P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:50.626190 24731 raft_consensus.cc:515] T 93ece38976574ad7a5e93a69c33c074d P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:50.627512 24482 ts_tablet_manager.cc:1434] T 67c0216443004287861015dd30ae5144 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.001s
I20260709 12:14:50.627815 24481 tablet_bootstrap.cc:492] T 3fe3be6bb3264475ba597fec30a06f6c P aa14caefbdaa47b09abf91881635ba96: Bootstrap starting.
I20260709 12:14:50.628540 24731 leader_election.cc:290] T 93ece38976574ad7a5e93a69c33c074d P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:14:50.625361 24356 raft_consensus.cc:1240] T 4f756e6bcc20458b8748cd090cd3fce2 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Rejecting Update request from peer ad362df39b114ec3a3a419128097b362 for earlier term 1. Current term is 2. Ops: []
W20260709 12:14:50.614688 24174 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46467, user_credentials={real_user=slave}} blocked reactor thread for 66070us
I20260709 12:14:50.629642 24358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93ece38976574ad7a5e93a69c33c074d" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:50.629670 24433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93ece38976574ad7a5e93a69c33c074d" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:50.637576 24479 ts_tablet_manager.cc:1434] T cf280984dcfc44039a942819e8df951c P ad362df39b114ec3a3a419128097b362: Time spent starting tablet: real 0.059s	user 0.009s	sys 0.000s
I20260709 12:14:50.638461 24358 raft_consensus.cc:2468] T 93ece38976574ad7a5e93a69c33c074d P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 0.
I20260709 12:14:50.641130 24479 tablet_bootstrap.cc:492] T dbace6d282ab498283858033606494ae P ad362df39b114ec3a3a419128097b362: Bootstrap starting.
I20260709 12:14:50.642607 24482 tablet_bootstrap.cc:492] T fa882381d669422a95ec60c9aefa8105 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:14:50.643538 24481 tablet_bootstrap.cc:654] T 3fe3be6bb3264475ba597fec30a06f6c P aa14caefbdaa47b09abf91881635ba96: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:50.643694 24250 leader_election.cc:304] T 93ece38976574ad7a5e93a69c33c074d P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, cf2d8294ae68482ca4ffa8be051ad054; no voters: 
I20260709 12:14:50.643890 24433 raft_consensus.cc:2468] T 93ece38976574ad7a5e93a69c33c074d P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 0.
I20260709 12:14:50.647133 24732 raft_consensus.cc:2804] T 93ece38976574ad7a5e93a69c33c074d P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:50.647715 24732 raft_consensus.cc:493] T 93ece38976574ad7a5e93a69c33c074d P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:50.648154 24732 raft_consensus.cc:3060] T 93ece38976574ad7a5e93a69c33c074d P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:50.656512 24208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f756e6bcc20458b8748cd090cd3fce2" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
W20260709 12:14:50.619585 24396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:38787, user_credentials={real_user=slave}} blocked reactor thread for 46043.5us
I20260709 12:14:50.661460 24322 leader_election.cc:304] T 4f756e6bcc20458b8748cd090cd3fce2 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, ad362df39b114ec3a3a419128097b362
I20260709 12:14:50.662750 24756 raft_consensus.cc:2749] T 4f756e6bcc20458b8748cd090cd3fce2 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:14:50.667251 24104 catalog_manager.cc:5697] T 464c7ebd16cd488086ccaec23defbb33 P aa14caefbdaa47b09abf91881635ba96 reported cstate change: term changed from 0 to 1, leader changed from <none> to aa14caefbdaa47b09abf91881635ba96 (127.12.56.195). New cstate: current_term: 1 leader_uuid: "aa14caefbdaa47b09abf91881635ba96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:50.676885 24482 tablet_bootstrap.cc:654] T fa882381d669422a95ec60c9aefa8105 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:50.685189 24478 tablet_bootstrap.cc:492] T 67c0216443004287861015dd30ae5144 P cf2d8294ae68482ca4ffa8be051ad054: No bootstrap required, opened a new log
I20260709 12:14:50.687441 24478 ts_tablet_manager.cc:1403] T 67c0216443004287861015dd30ae5144 P cf2d8294ae68482ca4ffa8be051ad054: Time spent bootstrapping tablet: real 0.210s	user 0.017s	sys 0.000s
W20260709 12:14:50.674129 24398 leader_election.cc:343] T fa882381d669422a95ec60c9aefa8105 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:50.697297 24398 leader_election.cc:304] T fa882381d669422a95ec60c9aefa8105 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad362df39b114ec3a3a419128097b362; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, aa14caefbdaa47b09abf91881635ba96
I20260709 12:14:50.700789 24563 raft_consensus.cc:2749] T fa882381d669422a95ec60c9aefa8105 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:50.716498 24478 raft_consensus.cc:359] T 67c0216443004287861015dd30ae5144 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:50.717353 24478 raft_consensus.cc:385] T 67c0216443004287861015dd30ae5144 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:50.717661 24478 raft_consensus.cc:740] T 67c0216443004287861015dd30ae5144 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Initialized, Role: FOLLOWER
I20260709 12:14:50.721326 24802 raft_consensus.cc:493] T cf280984dcfc44039a942819e8df951c P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:50.720952 24478 consensus_queue.cc:260] T 67c0216443004287861015dd30ae5144 P cf2d8294ae68482ca4ffa8be051ad054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:50.734495 24207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b14abd90d418cab44e524aef8154c" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
I20260709 12:14:50.721961 24802 raft_consensus.cc:515] T cf280984dcfc44039a942819e8df951c P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:50.739328 24586 consensus_queue.cc:1059] T 4f756e6bcc20458b8748cd090cd3fce2 P ad362df39b114ec3a3a419128097b362 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:50.740202 24802 leader_election.cc:290] T cf280984dcfc44039a942819e8df951c P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:50.745219 24478 ts_tablet_manager.cc:1434] T 67c0216443004287861015dd30ae5144 P cf2d8294ae68482ca4ffa8be051ad054: Time spent starting tablet: real 0.057s	user 0.008s	sys 0.000s
I20260709 12:14:50.742430 24207 raft_consensus.cc:2468] T 356b14abd90d418cab44e524aef8154c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 0.
I20260709 12:14:50.741492 24586 raft_consensus.cc:3055] T 4f756e6bcc20458b8748cd090cd3fce2 P ad362df39b114ec3a3a419128097b362 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:50.725850 24732 raft_consensus.cc:515] T 93ece38976574ad7a5e93a69c33c074d P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
W20260709 12:14:50.762559 24250 consensus_peers.cc:597] T 3fe3be6bb3264475ba597fec30a06f6c P cf2d8294ae68482ca4ffa8be051ad054 -> Peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Couldn't send request to peer aa14caefbdaa47b09abf91881635ba96. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:50.761441 24481 tablet_bootstrap.cc:492] T 3fe3be6bb3264475ba597fec30a06f6c P aa14caefbdaa47b09abf91881635ba96: No bootstrap required, opened a new log
I20260709 12:14:50.765666 24481 ts_tablet_manager.cc:1403] T 3fe3be6bb3264475ba597fec30a06f6c P aa14caefbdaa47b09abf91881635ba96: Time spent bootstrapping tablet: real 0.138s	user 0.018s	sys 0.042s
I20260709 12:14:50.769877 24478 tablet_bootstrap.cc:492] T dbace6d282ab498283858033606494ae P cf2d8294ae68482ca4ffa8be051ad054: Bootstrap starting.
I20260709 12:14:50.776546 24481 raft_consensus.cc:359] T 3fe3be6bb3264475ba597fec30a06f6c P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:50.777272 24481 raft_consensus.cc:385] T 3fe3be6bb3264475ba597fec30a06f6c P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:50.758008 24586 raft_consensus.cc:740] T 4f756e6bcc20458b8748cd090cd3fce2 P ad362df39b114ec3a3a419128097b362 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ad362df39b114ec3a3a419128097b362, State: Running, Role: LEADER
I20260709 12:14:50.778873 24586 consensus_queue.cc:260] T 4f756e6bcc20458b8748cd090cd3fce2 P ad362df39b114ec3a3a419128097b362 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:50.779349 24732 leader_election.cc:290] T 93ece38976574ad7a5e93a69c33c074d P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 election: Requested vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:14:50.780400 24586 raft_consensus.cc:3060] T 4f756e6bcc20458b8748cd090cd3fce2 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:50.777555 24481 raft_consensus.cc:740] T 3fe3be6bb3264475ba597fec30a06f6c P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Initialized, Role: FOLLOWER
I20260709 12:14:50.780594 24430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93ece38976574ad7a5e93a69c33c074d" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362"
I20260709 12:14:50.782546 24430 raft_consensus.cc:3060] T 93ece38976574ad7a5e93a69c33c074d P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:50.784497 24479 tablet_bootstrap.cc:654] T dbace6d282ab498283858033606494ae P ad362df39b114ec3a3a419128097b362: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:50.788466 24482 tablet_bootstrap.cc:492] T fa882381d669422a95ec60c9aefa8105 P 9bf3da5b54ef4a1ea1cee60f02ea2883: No bootstrap required, opened a new log
I20260709 12:14:50.789068 24482 ts_tablet_manager.cc:1403] T fa882381d669422a95ec60c9aefa8105 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.151s	user 0.012s	sys 0.022s
I20260709 12:14:50.790773 24481 consensus_queue.cc:260] T 3fe3be6bb3264475ba597fec30a06f6c P aa14caefbdaa47b09abf91881635ba96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:50.793177 24748 consensus_queue.cc:1048] T d10519ad64d948b09186e335ed06257d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:14:50.799764 24358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93ece38976574ad7a5e93a69c33c074d" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
I20260709 12:14:50.800565 24358 raft_consensus.cc:3060] T 93ece38976574ad7a5e93a69c33c074d P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:50.805970 24207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf280984dcfc44039a942819e8df951c" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
I20260709 12:14:50.807057 24481 ts_tablet_manager.cc:1434] T 3fe3be6bb3264475ba597fec30a06f6c P aa14caefbdaa47b09abf91881635ba96: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.001s
I20260709 12:14:50.810393 24359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf280984dcfc44039a942819e8df951c" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:50.815274 24478 tablet_bootstrap.cc:654] T dbace6d282ab498283858033606494ae P cf2d8294ae68482ca4ffa8be051ad054: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:50.830392 24748 consensus_queue.cc:1048] T d10519ad64d948b09186e335ed06257d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:50.832985 24481 tablet_bootstrap.cc:492] T 356b14abd90d418cab44e524aef8154c P aa14caefbdaa47b09abf91881635ba96: Bootstrap starting.
W20260709 12:14:50.836182 24396 leader_election.cc:343] T cf280984dcfc44039a942819e8df951c P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:50.842069 24248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:38787, user_credentials={real_user=slave}} blocked reactor thread for 49400.3us
I20260709 12:14:50.843195 24248 leader_election.cc:304] T 356b14abd90d418cab44e524aef8154c P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054; no voters: aa14caefbdaa47b09abf91881635ba96
I20260709 12:14:50.844286 24814 raft_consensus.cc:2804] T 356b14abd90d418cab44e524aef8154c P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:50.844787 24814 raft_consensus.cc:493] T 356b14abd90d418cab44e524aef8154c P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:50.845173 24814 raft_consensus.cc:3060] T 356b14abd90d418cab44e524aef8154c P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:50.852469 24731 raft_consensus.cc:493] T 67c0216443004287861015dd30ae5144 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:50.853303 24731 raft_consensus.cc:515] T 67c0216443004287861015dd30ae5144 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:50.856531 24731 leader_election.cc:290] T 67c0216443004287861015dd30ae5144 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:50.867705 24358 raft_consensus.cc:2468] T 93ece38976574ad7a5e93a69c33c074d P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 1.
I20260709 12:14:50.868007 24482 raft_consensus.cc:359] T fa882381d669422a95ec60c9aefa8105 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:50.872128 24482 raft_consensus.cc:385] T fa882381d669422a95ec60c9aefa8105 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:50.872589 24482 raft_consensus.cc:740] T fa882381d669422a95ec60c9aefa8105 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:14:50.874323 24481 tablet_bootstrap.cc:654] T 356b14abd90d418cab44e524aef8154c P aa14caefbdaa47b09abf91881635ba96: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:50.877485 24479 tablet_bootstrap.cc:492] T dbace6d282ab498283858033606494ae P ad362df39b114ec3a3a419128097b362: No bootstrap required, opened a new log
I20260709 12:14:50.885229 24479 ts_tablet_manager.cc:1403] T dbace6d282ab498283858033606494ae P ad362df39b114ec3a3a419128097b362: Time spent bootstrapping tablet: real 0.244s	user 0.017s	sys 0.000s
I20260709 12:14:50.888242 24433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c0216443004287861015dd30ae5144" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:50.889127 24433 raft_consensus.cc:2468] T 67c0216443004287861015dd30ae5144 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 0.
W20260709 12:14:50.863741 24398 leader_election.cc:343] T cf280984dcfc44039a942819e8df951c P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:50.890841 24398 leader_election.cc:304] T cf280984dcfc44039a942819e8df951c P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad362df39b114ec3a3a419128097b362; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, aa14caefbdaa47b09abf91881635ba96
I20260709 12:14:50.892748 24563 raft_consensus.cc:2749] T cf280984dcfc44039a942819e8df951c P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:50.891549 24479 raft_consensus.cc:359] T dbace6d282ab498283858033606494ae P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:50.893756 24479 raft_consensus.cc:385] T dbace6d282ab498283858033606494ae P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:50.886621 24482 consensus_queue.cc:260] T fa882381d669422a95ec60c9aefa8105 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:50.894366 24479 raft_consensus.cc:740] T dbace6d282ab498283858033606494ae P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad362df39b114ec3a3a419128097b362, State: Initialized, Role: FOLLOWER
I20260709 12:14:50.896021 24479 consensus_queue.cc:260] T dbace6d282ab498283858033606494ae P ad362df39b114ec3a3a419128097b362 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:50.904132 24249 leader_election.cc:304] T 67c0216443004287861015dd30ae5144 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad362df39b114ec3a3a419128097b362, cf2d8294ae68482ca4ffa8be051ad054; no voters: 
I20260709 12:14:50.906183 24814 raft_consensus.cc:515] T 356b14abd90d418cab44e524aef8154c P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:50.907469 24816 raft_consensus.cc:2804] T 67c0216443004287861015dd30ae5144 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:50.908000 24816 raft_consensus.cc:493] T 67c0216443004287861015dd30ae5144 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:50.908399 24816 raft_consensus.cc:3060] T 67c0216443004287861015dd30ae5144 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:50.908691 24814 leader_election.cc:290] T 356b14abd90d418cab44e524aef8154c P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 election: Requested vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:14:50.910729 24482 ts_tablet_manager.cc:1434] T fa882381d669422a95ec60c9aefa8105 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.121s	user 0.008s	sys 0.001s
I20260709 12:14:50.908551 24430 raft_consensus.cc:2468] T 93ece38976574ad7a5e93a69c33c074d P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 1.
I20260709 12:14:50.923789 24249 leader_election.cc:304] T 93ece38976574ad7a5e93a69c33c074d P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad362df39b114ec3a3a419128097b362, cf2d8294ae68482ca4ffa8be051ad054; no voters: 
I20260709 12:14:50.925344 24731 raft_consensus.cc:2804] T 93ece38976574ad7a5e93a69c33c074d P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:50.926739 24731 raft_consensus.cc:697] T 93ece38976574ad7a5e93a69c33c074d P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Becoming Leader. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Running, Role: LEADER
I20260709 12:14:50.928231 24482 tablet_bootstrap.cc:492] T b98a35cf96ba4562b4933543b1e4efb9 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:14:50.931624 24479 ts_tablet_manager.cc:1434] T dbace6d282ab498283858033606494ae P ad362df39b114ec3a3a419128097b362: Time spent starting tablet: real 0.046s	user 0.010s	sys 0.000s
I20260709 12:14:50.938364 24478 tablet_bootstrap.cc:492] T dbace6d282ab498283858033606494ae P cf2d8294ae68482ca4ffa8be051ad054: No bootstrap required, opened a new log
I20260709 12:14:50.942735 24478 ts_tablet_manager.cc:1403] T dbace6d282ab498283858033606494ae P cf2d8294ae68482ca4ffa8be051ad054: Time spent bootstrapping tablet: real 0.174s	user 0.037s	sys 0.034s
I20260709 12:14:50.942770 24479 tablet_bootstrap.cc:492] T d84ed08271a24f7fa134ae81a858c314 P ad362df39b114ec3a3a419128097b362: Bootstrap starting.
I20260709 12:14:50.944837 24481 tablet_bootstrap.cc:492] T 356b14abd90d418cab44e524aef8154c P aa14caefbdaa47b09abf91881635ba96: No bootstrap required, opened a new log
I20260709 12:14:50.945353 24481 ts_tablet_manager.cc:1403] T 356b14abd90d418cab44e524aef8154c P aa14caefbdaa47b09abf91881635ba96: Time spent bootstrapping tablet: real 0.113s	user 0.014s	sys 0.004s
I20260709 12:14:50.947147 24806 raft_consensus.cc:493] T 67c0216443004287861015dd30ae5144 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:50.947753 24806 raft_consensus.cc:515] T 67c0216443004287861015dd30ae5144 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:50.930337 24731 consensus_queue.cc:237] T 93ece38976574ad7a5e93a69c33c074d P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:50.940874 24207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c0216443004287861015dd30ae5144" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
I20260709 12:14:50.956594 24478 raft_consensus.cc:359] T dbace6d282ab498283858033606494ae P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:50.959745 24481 raft_consensus.cc:359] T 356b14abd90d418cab44e524aef8154c P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:50.967859 24481 raft_consensus.cc:385] T 356b14abd90d418cab44e524aef8154c P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:50.968278 24481 raft_consensus.cc:740] T 356b14abd90d418cab44e524aef8154c P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Initialized, Role: FOLLOWER
I20260709 12:14:50.960325 24806 leader_election.cc:290] T 67c0216443004287861015dd30ae5144 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:14:50.957527 24478 raft_consensus.cc:385] T dbace6d282ab498283858033606494ae P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:50.970191 24478 raft_consensus.cc:740] T dbace6d282ab498283858033606494ae P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Initialized, Role: FOLLOWER
I20260709 12:14:50.974303 24358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b14abd90d418cab44e524aef8154c" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
I20260709 12:14:50.974395 24478 consensus_queue.cc:260] T dbace6d282ab498283858033606494ae P cf2d8294ae68482ca4ffa8be051ad054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:50.961911 24479 tablet_bootstrap.cc:654] T d84ed08271a24f7fa134ae81a858c314 P ad362df39b114ec3a3a419128097b362: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:50.964726 24207 raft_consensus.cc:2468] T 67c0216443004287861015dd30ae5144 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 0.
I20260709 12:14:50.964968 24586 raft_consensus.cc:493] T dbace6d282ab498283858033606494ae P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:50.932322 24816 raft_consensus.cc:515] T 67c0216443004287861015dd30ae5144 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:50.979955 24586 raft_consensus.cc:515] T dbace6d282ab498283858033606494ae P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:50.981581 24816 leader_election.cc:290] T 67c0216443004287861015dd30ae5144 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 election: Requested vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:50.983685 24284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbace6d282ab498283858033606494ae" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:50.984429 24284 raft_consensus.cc:2468] T dbace6d282ab498283858033606494ae P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 0.
I20260709 12:14:50.967005 24210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b14abd90d418cab44e524aef8154c" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
I20260709 12:14:50.985571 24482 tablet_bootstrap.cc:654] T b98a35cf96ba4562b4933543b1e4efb9 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:50.985853 24210 raft_consensus.cc:3060] T 356b14abd90d418cab44e524aef8154c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:50.989709 24357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbace6d282ab498283858033606494ae" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:50.991847 24282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c0216443004287861015dd30ae5144" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:50.992816 24282 raft_consensus.cc:2393] T 67c0216443004287861015dd30ae5144 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in current term 1: Already voted for candidate cf2d8294ae68482ca4ffa8be051ad054 in this term.
I20260709 12:14:50.964841 24430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c0216443004287861015dd30ae5144" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:50.994310 24430 raft_consensus.cc:2468] T 67c0216443004287861015dd30ae5144 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 0.
I20260709 12:14:50.970885 24481 consensus_queue.cc:260] T 356b14abd90d418cab44e524aef8154c P aa14caefbdaa47b09abf91881635ba96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:50.982605 24586 leader_election.cc:290] T dbace6d282ab498283858033606494ae P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:14:50.997910 24358 raft_consensus.cc:3060] T 356b14abd90d418cab44e524aef8154c P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:51.009338 24478 ts_tablet_manager.cc:1434] T dbace6d282ab498283858033606494ae P cf2d8294ae68482ca4ffa8be051ad054: Time spent starting tablet: real 0.066s	user 0.005s	sys 0.004s
I20260709 12:14:51.011005 24481 ts_tablet_manager.cc:1434] T 356b14abd90d418cab44e524aef8154c P aa14caefbdaa47b09abf91881635ba96: Time spent starting tablet: real 0.065s	user 0.008s	sys 0.001s
I20260709 12:14:51.013255 24207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c0216443004287861015dd30ae5144" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
I20260709 12:14:51.014226 24207 raft_consensus.cc:3060] T 67c0216443004287861015dd30ae5144 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:50.986498 24399 leader_election.cc:304] T dbace6d282ab498283858033606494ae P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad362df39b114ec3a3a419128097b362, cf2d8294ae68482ca4ffa8be051ad054; no voters: 
I20260709 12:14:51.006243 24432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c0216443004287861015dd30ae5144" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362"
I20260709 12:14:51.018978 24586 raft_consensus.cc:2804] T dbace6d282ab498283858033606494ae P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:51.021117 24174 leader_election.cc:304] T 67c0216443004287861015dd30ae5144 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, ad362df39b114ec3a3a419128097b362; no voters: 
I20260709 12:14:51.022917 24756 consensus_queue.cc:1048] T 464c7ebd16cd488086ccaec23defbb33 P aa14caefbdaa47b09abf91881635ba96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:14:51.019057 24398 leader_election.cc:343] T dbace6d282ab498283858033606494ae P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:51.017601 24210 raft_consensus.cc:2468] T 356b14abd90d418cab44e524aef8154c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 1.
I20260709 12:14:51.024677 24481 tablet_bootstrap.cc:492] T dbace6d282ab498283858033606494ae P aa14caefbdaa47b09abf91881635ba96: Bootstrap starting.
I20260709 12:14:51.021983 24586 raft_consensus.cc:493] T dbace6d282ab498283858033606494ae P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:51.028100 24586 raft_consensus.cc:3060] T dbace6d282ab498283858033606494ae P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:51.024132 24432 raft_consensus.cc:3060] T 67c0216443004287861015dd30ae5144 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:51.032084 24478 tablet_bootstrap.cc:492] T b98a35cf96ba4562b4933543b1e4efb9 P cf2d8294ae68482ca4ffa8be051ad054: Bootstrap starting.
I20260709 12:14:51.039845 24816 consensus_queue.cc:1048] T 3fe3be6bb3264475ba597fec30a06f6c P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:51.042925 24358 raft_consensus.cc:2468] T 356b14abd90d418cab44e524aef8154c P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 1.
I20260709 12:14:51.044483 24207 raft_consensus.cc:2468] T 67c0216443004287861015dd30ae5144 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 1.
I20260709 12:14:51.045243 24808 raft_consensus.cc:2764] T 67c0216443004287861015dd30ae5144 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:14:51.045655 24248 leader_election.cc:304] T 356b14abd90d418cab44e524aef8154c P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054; no voters: 
I20260709 12:14:51.051096 24814 raft_consensus.cc:2804] T 356b14abd90d418cab44e524aef8154c P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:51.051793 24814 raft_consensus.cc:697] T 356b14abd90d418cab44e524aef8154c P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Becoming Leader. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Running, Role: LEADER
I20260709 12:14:51.052763 24814 consensus_queue.cc:237] T 356b14abd90d418cab44e524aef8154c P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:51.049126 24586 raft_consensus.cc:515] T dbace6d282ab498283858033606494ae P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:51.057989 24479 tablet_bootstrap.cc:492] T d84ed08271a24f7fa134ae81a858c314 P ad362df39b114ec3a3a419128097b362: No bootstrap required, opened a new log
I20260709 12:14:51.058835 24479 ts_tablet_manager.cc:1403] T d84ed08271a24f7fa134ae81a858c314 P ad362df39b114ec3a3a419128097b362: Time spent bootstrapping tablet: real 0.122s	user 0.012s	sys 0.010s
I20260709 12:14:51.072252 24756 consensus_queue.cc:1048] T 464c7ebd16cd488086ccaec23defbb33 P aa14caefbdaa47b09abf91881635ba96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:51.076833 24586 leader_election.cc:290] T dbace6d282ab498283858033606494ae P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 election: Requested vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:14:51.078020 24357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbace6d282ab498283858033606494ae" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
I20260709 12:14:51.076469 24108 catalog_manager.cc:5697] T 93ece38976574ad7a5e93a69c33c074d P cf2d8294ae68482ca4ffa8be051ad054 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194). New cstate: current_term: 1 leader_uuid: "cf2d8294ae68482ca4ffa8be051ad054" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:51.079684 24284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbace6d282ab498283858033606494ae" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054"
I20260709 12:14:51.080366 24284 raft_consensus.cc:3060] T dbace6d282ab498283858033606494ae P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:51.083334 24727 raft_consensus.cc:493] T 3fe3be6bb3264475ba597fec30a06f6c P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:51.083561 24398 leader_election.cc:343] T dbace6d282ab498283858033606494ae P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:51.083931 24727 raft_consensus.cc:515] T 3fe3be6bb3264475ba597fec30a06f6c P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:51.089841 24481 tablet_bootstrap.cc:654] T dbace6d282ab498283858033606494ae P aa14caefbdaa47b09abf91881635ba96: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:51.090689 24727 leader_election.cc:290] T 3fe3be6bb3264475ba597fec30a06f6c P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:14:51.110555 24282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe3be6bb3264475ba597fec30a06f6c" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:51.114188 24207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe3be6bb3264475ba597fec30a06f6c" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
I20260709 12:14:51.117159 24478 tablet_bootstrap.cc:654] T b98a35cf96ba4562b4933543b1e4efb9 P cf2d8294ae68482ca4ffa8be051ad054: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:51.119248 24322 leader_election.cc:304] T 3fe3be6bb3264475ba597fec30a06f6c P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:14:51.122134 24727 raft_consensus.cc:2749] T 3fe3be6bb3264475ba597fec30a06f6c P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:51.133878 24432 raft_consensus.cc:2468] T 67c0216443004287861015dd30ae5144 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 1.
I20260709 12:14:51.135385 24249 leader_election.cc:304] T 67c0216443004287861015dd30ae5144 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad362df39b114ec3a3a419128097b362, cf2d8294ae68482ca4ffa8be051ad054; no voters: 
I20260709 12:14:51.135725 24284 raft_consensus.cc:2468] T dbace6d282ab498283858033606494ae P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 1.
I20260709 12:14:51.136399 24816 raft_consensus.cc:2804] T 67c0216443004287861015dd30ae5144 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:51.136958 24816 raft_consensus.cc:697] T 67c0216443004287861015dd30ae5144 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Becoming Leader. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Running, Role: LEADER
I20260709 12:14:51.137149 24399 leader_election.cc:304] T dbace6d282ab498283858033606494ae P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad362df39b114ec3a3a419128097b362, cf2d8294ae68482ca4ffa8be051ad054; no voters: aa14caefbdaa47b09abf91881635ba96
I20260709 12:14:51.137872 24816 consensus_queue.cc:237] T 67c0216443004287861015dd30ae5144 P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:51.138276 24586 raft_consensus.cc:2804] T dbace6d282ab498283858033606494ae P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:51.138897 24586 raft_consensus.cc:697] T dbace6d282ab498283858033606494ae P ad362df39b114ec3a3a419128097b362 [term 1 LEADER]: Becoming Leader. State: Replica: ad362df39b114ec3a3a419128097b362, State: Running, Role: LEADER
I20260709 12:14:51.139967 24586 consensus_queue.cc:237] T dbace6d282ab498283858033606494ae P ad362df39b114ec3a3a419128097b362 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:51.171553 24479 raft_consensus.cc:359] T d84ed08271a24f7fa134ae81a858c314 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:51.174407 24479 raft_consensus.cc:385] T d84ed08271a24f7fa134ae81a858c314 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:51.174770 24479 raft_consensus.cc:740] T d84ed08271a24f7fa134ae81a858c314 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad362df39b114ec3a3a419128097b362, State: Initialized, Role: FOLLOWER
I20260709 12:14:51.178323 24482 tablet_bootstrap.cc:492] T b98a35cf96ba4562b4933543b1e4efb9 P 9bf3da5b54ef4a1ea1cee60f02ea2883: No bootstrap required, opened a new log
I20260709 12:14:51.178956 24482 ts_tablet_manager.cc:1403] T b98a35cf96ba4562b4933543b1e4efb9 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.251s	user 0.024s	sys 0.008s
I20260709 12:14:51.186632 24478 tablet_bootstrap.cc:492] T b98a35cf96ba4562b4933543b1e4efb9 P cf2d8294ae68482ca4ffa8be051ad054: No bootstrap required, opened a new log
I20260709 12:14:51.187191 24478 ts_tablet_manager.cc:1403] T b98a35cf96ba4562b4933543b1e4efb9 P cf2d8294ae68482ca4ffa8be051ad054: Time spent bootstrapping tablet: real 0.162s	user 0.017s	sys 0.009s
I20260709 12:14:51.197965 24481 tablet_bootstrap.cc:492] T dbace6d282ab498283858033606494ae P aa14caefbdaa47b09abf91881635ba96: No bootstrap required, opened a new log
I20260709 12:14:51.198582 24481 ts_tablet_manager.cc:1403] T dbace6d282ab498283858033606494ae P aa14caefbdaa47b09abf91881635ba96: Time spent bootstrapping tablet: real 0.177s	user 0.014s	sys 0.011s
I20260709 12:14:51.201380 24481 raft_consensus.cc:359] T dbace6d282ab498283858033606494ae P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:51.202199 24481 raft_consensus.cc:385] T dbace6d282ab498283858033606494ae P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:51.202498 24481 raft_consensus.cc:740] T dbace6d282ab498283858033606494ae P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Initialized, Role: FOLLOWER
I20260709 12:14:51.193439 24482 raft_consensus.cc:359] T b98a35cf96ba4562b4933543b1e4efb9 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:51.203363 24482 raft_consensus.cc:385] T b98a35cf96ba4562b4933543b1e4efb9 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:51.208626 24482 raft_consensus.cc:740] T b98a35cf96ba4562b4933543b1e4efb9 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:14:51.210407 24482 consensus_queue.cc:260] T b98a35cf96ba4562b4933543b1e4efb9 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:51.206761 24106 catalog_manager.cc:5697] T 356b14abd90d418cab44e524aef8154c P cf2d8294ae68482ca4ffa8be051ad054 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194). New cstate: current_term: 1 leader_uuid: "cf2d8294ae68482ca4ffa8be051ad054" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:51.203140 24481 consensus_queue.cc:260] T dbace6d282ab498283858033606494ae P aa14caefbdaa47b09abf91881635ba96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:51.180714 24479 consensus_queue.cc:260] T d84ed08271a24f7fa134ae81a858c314 P ad362df39b114ec3a3a419128097b362 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:51.234124 24478 raft_consensus.cc:359] T b98a35cf96ba4562b4933543b1e4efb9 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:51.234965 24478 raft_consensus.cc:385] T b98a35cf96ba4562b4933543b1e4efb9 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:51.235282 24478 raft_consensus.cc:740] T b98a35cf96ba4562b4933543b1e4efb9 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Initialized, Role: FOLLOWER
I20260709 12:14:51.236028 24478 consensus_queue.cc:260] T b98a35cf96ba4562b4933543b1e4efb9 P cf2d8294ae68482ca4ffa8be051ad054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:51.243849 24478 ts_tablet_manager.cc:1434] T b98a35cf96ba4562b4933543b1e4efb9 P cf2d8294ae68482ca4ffa8be051ad054: Time spent starting tablet: real 0.056s	user 0.008s	sys 0.000s
I20260709 12:14:51.245210 24478 tablet_bootstrap.cc:492] T d84ed08271a24f7fa134ae81a858c314 P cf2d8294ae68482ca4ffa8be051ad054: Bootstrap starting.
I20260709 12:14:51.250375 24481 ts_tablet_manager.cc:1434] T dbace6d282ab498283858033606494ae P aa14caefbdaa47b09abf91881635ba96: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.000s
I20260709 12:14:51.251835 24481 tablet_bootstrap.cc:492] T cf280984dcfc44039a942819e8df951c P aa14caefbdaa47b09abf91881635ba96: Bootstrap starting.
I20260709 12:14:51.253911 24482 ts_tablet_manager.cc:1434] T b98a35cf96ba4562b4933543b1e4efb9 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.074s	user 0.009s	sys 0.000s
I20260709 12:14:51.255256 24482 tablet_bootstrap.cc:492] T 06d0284e94354a2686c577372cceb2bc P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:14:51.262809 24479 ts_tablet_manager.cc:1434] T d84ed08271a24f7fa134ae81a858c314 P ad362df39b114ec3a3a419128097b362: Time spent starting tablet: real 0.204s	user 0.009s	sys 0.002s
I20260709 12:14:51.264166 24479 tablet_bootstrap.cc:492] T 06d0284e94354a2686c577372cceb2bc P ad362df39b114ec3a3a419128097b362: Bootstrap starting.
I20260709 12:14:51.274542 24808 raft_consensus.cc:493] T b98a35cf96ba4562b4933543b1e4efb9 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:51.275278 24808 raft_consensus.cc:515] T b98a35cf96ba4562b4933543b1e4efb9 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:51.279064 24282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b98a35cf96ba4562b4933543b1e4efb9" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:51.279872 24282 raft_consensus.cc:2468] T b98a35cf96ba4562b4933543b1e4efb9 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 0.
I20260709 12:14:51.281677 24176 leader_election.cc:304] T b98a35cf96ba4562b4933543b1e4efb9 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054; no voters: 
I20260709 12:14:51.279109 24481 tablet_bootstrap.cc:654] T cf280984dcfc44039a942819e8df951c P aa14caefbdaa47b09abf91881635ba96: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:51.282719 24636 raft_consensus.cc:2804] T b98a35cf96ba4562b4933543b1e4efb9 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:51.287608 24808 leader_election.cc:290] T b98a35cf96ba4562b4933543b1e4efb9 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:14:51.275285 24478 tablet_bootstrap.cc:654] T d84ed08271a24f7fa134ae81a858c314 P cf2d8294ae68482ca4ffa8be051ad054: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:51.291079 24482 tablet_bootstrap.cc:654] T 06d0284e94354a2686c577372cceb2bc P 9bf3da5b54ef4a1ea1cee60f02ea2883: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:51.298179 24358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b98a35cf96ba4562b4933543b1e4efb9" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
W20260709 12:14:51.300977 24175 leader_election.cc:343] T b98a35cf96ba4562b4933543b1e4efb9 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:51.299538 24104 catalog_manager.cc:5697] T dbace6d282ab498283858033606494ae P ad362df39b114ec3a3a419128097b362 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad362df39b114ec3a3a419128097b362 (127.12.56.196). New cstate: current_term: 1 leader_uuid: "ad362df39b114ec3a3a419128097b362" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: HEALTHY } } }
W20260709 12:14:51.304528 24155 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:51.286311 24636 raft_consensus.cc:493] T b98a35cf96ba4562b4933543b1e4efb9 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:51.308241 24636 raft_consensus.cc:3060] T b98a35cf96ba4562b4933543b1e4efb9 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:51.322232 24358 raft_consensus.cc:3060] T 3fe3be6bb3264475ba597fec30a06f6c P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:51.285427 24479 tablet_bootstrap.cc:654] T 06d0284e94354a2686c577372cceb2bc P ad362df39b114ec3a3a419128097b362: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:51.282042 24103 catalog_manager.cc:5697] T 67c0216443004287861015dd30ae5144 P cf2d8294ae68482ca4ffa8be051ad054 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194). New cstate: current_term: 1 leader_uuid: "cf2d8294ae68482ca4ffa8be051ad054" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:51.328696 24756 raft_consensus.cc:493] T dbace6d282ab498283858033606494ae P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:51.329335 24756 raft_consensus.cc:515] T dbace6d282ab498283858033606494ae P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:51.331874 24756 leader_election.cc:290] T dbace6d282ab498283858033606494ae P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:14:51.333714 24431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbace6d282ab498283858033606494ae" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:51.333763 24636 raft_consensus.cc:515] T b98a35cf96ba4562b4933543b1e4efb9 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:51.333614 24282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbace6d282ab498283858033606494ae" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:51.344172 24282 raft_consensus.cc:2393] T dbace6d282ab498283858033606494ae P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aa14caefbdaa47b09abf91881635ba96 in current term 1: Already voted for candidate ad362df39b114ec3a3a419128097b362 in this term.
I20260709 12:14:51.344976 24356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b98a35cf96ba4562b4933543b1e4efb9" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
I20260709 12:14:51.346262 24325 leader_election.cc:304] T dbace6d282ab498283858033606494ae P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96; no voters: ad362df39b114ec3a3a419128097b362, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:14:51.347669 24756 raft_consensus.cc:3060] T dbace6d282ab498283858033606494ae P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:51.351562 24748 raft_consensus.cc:493] T fa882381d669422a95ec60c9aefa8105 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:51.352113 24748 raft_consensus.cc:515] T fa882381d669422a95ec60c9aefa8105 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:51.356988 24431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa882381d669422a95ec60c9aefa8105" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:51.351209 24478 tablet_bootstrap.cc:492] T d84ed08271a24f7fa134ae81a858c314 P cf2d8294ae68482ca4ffa8be051ad054: No bootstrap required, opened a new log
I20260709 12:14:51.358006 24431 raft_consensus.cc:2468] T fa882381d669422a95ec60c9aefa8105 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 0.
I20260709 12:14:51.358297 24478 ts_tablet_manager.cc:1403] T d84ed08271a24f7fa134ae81a858c314 P cf2d8294ae68482ca4ffa8be051ad054: Time spent bootstrapping tablet: real 0.113s	user 0.003s	sys 0.018s
I20260709 12:14:51.359792 24174 leader_election.cc:304] T fa882381d669422a95ec60c9aefa8105 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, ad362df39b114ec3a3a419128097b362; no voters: 
I20260709 12:14:51.360723 24808 raft_consensus.cc:2804] T fa882381d669422a95ec60c9aefa8105 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:51.361123 24808 raft_consensus.cc:493] T fa882381d669422a95ec60c9aefa8105 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:51.361456 24808 raft_consensus.cc:3060] T fa882381d669422a95ec60c9aefa8105 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:51.338126 24636 leader_election.cc:290] T b98a35cf96ba4562b4933543b1e4efb9 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 election: Requested vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
W20260709 12:14:51.362824 24175 leader_election.cc:343] T b98a35cf96ba4562b4933543b1e4efb9 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:51.342374 24481 tablet_bootstrap.cc:492] T cf280984dcfc44039a942819e8df951c P aa14caefbdaa47b09abf91881635ba96: No bootstrap required, opened a new log
I20260709 12:14:51.363718 24357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa882381d669422a95ec60c9aefa8105" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:51.355016 24748 leader_election.cc:290] T fa882381d669422a95ec60c9aefa8105 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
W20260709 12:14:51.372128 24175 leader_election.cc:343] T fa882381d669422a95ec60c9aefa8105 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:51.379390 24756 raft_consensus.cc:2749] T dbace6d282ab498283858033606494ae P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:51.364176 24282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b98a35cf96ba4562b4933543b1e4efb9" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054"
I20260709 12:14:51.385505 24808 raft_consensus.cc:515] T fa882381d669422a95ec60c9aefa8105 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:51.370205 24481 ts_tablet_manager.cc:1403] T cf280984dcfc44039a942819e8df951c P aa14caefbdaa47b09abf91881635ba96: Time spent bootstrapping tablet: real 0.119s	user 0.011s	sys 0.003s
I20260709 12:14:51.389750 24282 raft_consensus.cc:3060] T b98a35cf96ba4562b4933543b1e4efb9 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:51.390244 24816 consensus_queue.cc:1048] T 93ece38976574ad7a5e93a69c33c074d P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:51.397717 24479 tablet_bootstrap.cc:492] T 06d0284e94354a2686c577372cceb2bc P ad362df39b114ec3a3a419128097b362: No bootstrap required, opened a new log
I20260709 12:14:51.398514 24479 ts_tablet_manager.cc:1403] T 06d0284e94354a2686c577372cceb2bc P ad362df39b114ec3a3a419128097b362: Time spent bootstrapping tablet: real 0.135s	user 0.011s	sys 0.004s
I20260709 12:14:51.401943 24479 raft_consensus.cc:359] T 06d0284e94354a2686c577372cceb2bc P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:51.402904 24479 raft_consensus.cc:385] T 06d0284e94354a2686c577372cceb2bc P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:51.403733 24808 leader_election.cc:290] T fa882381d669422a95ec60c9aefa8105 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 election: Requested vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:14:51.401388 24482 tablet_bootstrap.cc:492] T 06d0284e94354a2686c577372cceb2bc P 9bf3da5b54ef4a1ea1cee60f02ea2883: No bootstrap required, opened a new log
I20260709 12:14:51.404649 24482 ts_tablet_manager.cc:1403] T 06d0284e94354a2686c577372cceb2bc P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.150s	user 0.033s	sys 0.024s
I20260709 12:14:51.404374 24431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa882381d669422a95ec60c9aefa8105" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362"
I20260709 12:14:51.405232 24431 raft_consensus.cc:3060] T fa882381d669422a95ec60c9aefa8105 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:51.406868 24356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa882381d669422a95ec60c9aefa8105" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
I20260709 12:14:51.407894 24482 raft_consensus.cc:359] T 06d0284e94354a2686c577372cceb2bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:51.408643 24482 raft_consensus.cc:385] T 06d0284e94354a2686c577372cceb2bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:51.408916 24482 raft_consensus.cc:740] T 06d0284e94354a2686c577372cceb2bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:14:51.409763 24482 consensus_queue.cc:260] T 06d0284e94354a2686c577372cceb2bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
W20260709 12:14:51.413241 24175 leader_election.cc:343] T fa882381d669422a95ec60c9aefa8105 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:51.416446 24482 ts_tablet_manager.cc:1434] T 06d0284e94354a2686c577372cceb2bc P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:14:51.417698 24482 tablet_bootstrap.cc:492] T cf280984dcfc44039a942819e8df951c P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:14:51.361562 24478 raft_consensus.cc:359] T d84ed08271a24f7fa134ae81a858c314 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:51.421926 24478 raft_consensus.cc:385] T d84ed08271a24f7fa134ae81a858c314 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:51.422312 24478 raft_consensus.cc:740] T d84ed08271a24f7fa134ae81a858c314 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Initialized, Role: FOLLOWER
I20260709 12:14:51.425156 24482 tablet_bootstrap.cc:654] T cf280984dcfc44039a942819e8df951c P 9bf3da5b54ef4a1ea1cee60f02ea2883: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:51.425401 24478 consensus_queue.cc:260] T d84ed08271a24f7fa134ae81a858c314 P cf2d8294ae68482ca4ffa8be051ad054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:51.403293 24479 raft_consensus.cc:740] T 06d0284e94354a2686c577372cceb2bc P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad362df39b114ec3a3a419128097b362, State: Initialized, Role: FOLLOWER
I20260709 12:14:51.428102 24481 raft_consensus.cc:359] T cf280984dcfc44039a942819e8df951c P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:51.428833 24481 raft_consensus.cc:385] T cf280984dcfc44039a942819e8df951c P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:51.429096 24481 raft_consensus.cc:740] T cf280984dcfc44039a942819e8df951c P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Initialized, Role: FOLLOWER
I20260709 12:14:51.429764 24481 consensus_queue.cc:260] T cf280984dcfc44039a942819e8df951c P aa14caefbdaa47b09abf91881635ba96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:51.430089 24479 consensus_queue.cc:260] T 06d0284e94354a2686c577372cceb2bc P ad362df39b114ec3a3a419128097b362 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:51.431985 24481 ts_tablet_manager.cc:1434] T cf280984dcfc44039a942819e8df951c P aa14caefbdaa47b09abf91881635ba96: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.000s
I20260709 12:14:51.433279 24431 raft_consensus.cc:2468] T fa882381d669422a95ec60c9aefa8105 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 1.
I20260709 12:14:51.435066 24174 leader_election.cc:304] T fa882381d669422a95ec60c9aefa8105 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, ad362df39b114ec3a3a419128097b362; no voters: aa14caefbdaa47b09abf91881635ba96
I20260709 12:14:51.436638 24808 raft_consensus.cc:2804] T fa882381d669422a95ec60c9aefa8105 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:51.437510 24808 raft_consensus.cc:697] T fa882381d669422a95ec60c9aefa8105 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 LEADER]: Becoming Leader. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Running, Role: LEADER
I20260709 12:14:51.440795 24479 ts_tablet_manager.cc:1434] T 06d0284e94354a2686c577372cceb2bc P ad362df39b114ec3a3a419128097b362: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.001s
I20260709 12:14:51.440933 24482 tablet_bootstrap.cc:492] T cf280984dcfc44039a942819e8df951c P 9bf3da5b54ef4a1ea1cee60f02ea2883: No bootstrap required, opened a new log
I20260709 12:14:51.441588 24482 ts_tablet_manager.cc:1403] T cf280984dcfc44039a942819e8df951c P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.007s
I20260709 12:14:51.442394 24479 tablet_bootstrap.cc:492] T bbab1a4afac94c1eaeb3ed35bc54408a P ad362df39b114ec3a3a419128097b362: Bootstrap starting.
I20260709 12:14:51.441582 24808 consensus_queue.cc:237] T fa882381d669422a95ec60c9aefa8105 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:51.450083 24479 tablet_bootstrap.cc:654] T bbab1a4afac94c1eaeb3ed35bc54408a P ad362df39b114ec3a3a419128097b362: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:51.447283 24482 raft_consensus.cc:359] T cf280984dcfc44039a942819e8df951c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:51.450609 24282 raft_consensus.cc:2468] T b98a35cf96ba4562b4933543b1e4efb9 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 1.
I20260709 12:14:51.450899 24482 raft_consensus.cc:385] T cf280984dcfc44039a942819e8df951c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:51.451236 24482 raft_consensus.cc:740] T cf280984dcfc44039a942819e8df951c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:14:51.452117 24482 consensus_queue.cc:260] T cf280984dcfc44039a942819e8df951c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:51.454643 24482 ts_tablet_manager.cc:1434] T cf280984dcfc44039a942819e8df951c P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 12:14:51.455790 24482 tablet_bootstrap.cc:492] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:14:51.462837 24731 consensus_queue.cc:1048] T 93ece38976574ad7a5e93a69c33c074d P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:51.471341 24478 ts_tablet_manager.cc:1434] T d84ed08271a24f7fa134ae81a858c314 P cf2d8294ae68482ca4ffa8be051ad054: Time spent starting tablet: real 0.112s	user 0.008s	sys 0.001s
I20260709 12:14:51.473837 24176 leader_election.cc:304] T b98a35cf96ba4562b4933543b1e4efb9 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054; no voters: aa14caefbdaa47b09abf91881635ba96
I20260709 12:14:51.475127 24636 raft_consensus.cc:2804] T b98a35cf96ba4562b4933543b1e4efb9 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:51.475641 24636 raft_consensus.cc:697] T b98a35cf96ba4562b4933543b1e4efb9 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 LEADER]: Becoming Leader. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Running, Role: LEADER
I20260709 12:14:51.476511 24636 consensus_queue.cc:237] T b98a35cf96ba4562b4933543b1e4efb9 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:51.471657 24807 raft_consensus.cc:493] T 06d0284e94354a2686c577372cceb2bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:51.478710 24807 raft_consensus.cc:515] T 06d0284e94354a2686c577372cceb2bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:51.481346 24807 leader_election.cc:290] T 06d0284e94354a2686c577372cceb2bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:14:51.433620 24481 tablet_bootstrap.cc:492] T fa882381d669422a95ec60c9aefa8105 P aa14caefbdaa47b09abf91881635ba96: Bootstrap starting.
I20260709 12:14:51.544907 24563 raft_consensus.cc:493] T 06d0284e94354a2686c577372cceb2bc P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:51.550239 24563 raft_consensus.cc:515] T 06d0284e94354a2686c577372cceb2bc P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:51.551391 24482 tablet_bootstrap.cc:654] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:51.553356 24563 leader_election.cc:290] T 06d0284e94354a2686c577372cceb2bc P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:14:51.545424 24727 raft_consensus.cc:493] T cf280984dcfc44039a942819e8df951c P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:51.554772 24727 raft_consensus.cc:515] T cf280984dcfc44039a942819e8df951c P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:51.558151 24432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d0284e94354a2686c577372cceb2bc" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:51.558588 24478 tablet_bootstrap.cc:492] T 06d0284e94354a2686c577372cceb2bc P cf2d8294ae68482ca4ffa8be051ad054: Bootstrap starting.
I20260709 12:14:51.558823 24432 raft_consensus.cc:2468] T 06d0284e94354a2686c577372cceb2bc P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 0.
I20260709 12:14:51.544106 24816 raft_consensus.cc:493] T d84ed08271a24f7fa134ae81a858c314 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:51.561141 24816 raft_consensus.cc:515] T d84ed08271a24f7fa134ae81a858c314 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:51.563289 24816 leader_election.cc:290] T d84ed08271a24f7fa134ae81a858c314 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:14:51.565258 24358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84ed08271a24f7fa134ae81a858c314" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:51.545640 24748 raft_consensus.cc:493] T cf280984dcfc44039a942819e8df951c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:51.567020 24250 leader_election.cc:343] T d84ed08271a24f7fa134ae81a858c314 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:51.567152 24748 raft_consensus.cc:515] T cf280984dcfc44039a942819e8df951c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:51.569123 24748 leader_election.cc:290] T cf280984dcfc44039a942819e8df951c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:14:51.543370 24284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d0284e94354a2686c577372cceb2bc" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:51.605213 24358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf280984dcfc44039a942819e8df951c" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:51.606637 24358 raft_consensus.cc:2468] T cf280984dcfc44039a942819e8df951c P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 0.
I20260709 12:14:51.614548 24481 tablet_bootstrap.cc:654] T fa882381d669422a95ec60c9aefa8105 P aa14caefbdaa47b09abf91881635ba96: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:51.620389 24210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d0284e94354a2686c577372cceb2bc" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
I20260709 12:14:51.621184 24210 raft_consensus.cc:2468] T 06d0284e94354a2686c577372cceb2bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 0.
W20260709 12:14:51.605228 24176 leader_election.cc:343] T 06d0284e94354a2686c577372cceb2bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:51.624696 24478 tablet_bootstrap.cc:654] T 06d0284e94354a2686c577372cceb2bc P cf2d8294ae68482ca4ffa8be051ad054: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:51.611639 24432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf280984dcfc44039a942819e8df951c" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:51.629730 24432 raft_consensus.cc:2468] T cf280984dcfc44039a942819e8df951c P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa14caefbdaa47b09abf91881635ba96 in term 0.
I20260709 12:14:51.630930 24482 tablet_bootstrap.cc:492] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883: No bootstrap required, opened a new log
I20260709 12:14:51.631269 24323 leader_election.cc:304] T cf280984dcfc44039a942819e8df951c P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, ad362df39b114ec3a3a419128097b362; no voters: 
I20260709 12:14:51.631613 24482 ts_tablet_manager.cc:1403] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.176s	user 0.012s	sys 0.029s
I20260709 12:14:51.631728 24396 leader_election.cc:304] T 06d0284e94354a2686c577372cceb2bc P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, ad362df39b114ec3a3a419128097b362; no voters: 
I20260709 12:14:51.632578 24847 raft_consensus.cc:2804] T 06d0284e94354a2686c577372cceb2bc P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:51.632993 24847 raft_consensus.cc:493] T 06d0284e94354a2686c577372cceb2bc P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:51.633466 24847 raft_consensus.cc:3060] T 06d0284e94354a2686c577372cceb2bc P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:51.632869 24770 raft_consensus.cc:2804] T cf280984dcfc44039a942819e8df951c P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:51.634483 24770 raft_consensus.cc:493] T cf280984dcfc44039a942819e8df951c P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:51.634860 24770 raft_consensus.cc:3060] T cf280984dcfc44039a942819e8df951c P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:51.638288 24284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d0284e94354a2686c577372cceb2bc" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:51.633109 24479 tablet_bootstrap.cc:492] T bbab1a4afac94c1eaeb3ed35bc54408a P ad362df39b114ec3a3a419128097b362: No bootstrap required, opened a new log
I20260709 12:14:51.641649 24479 ts_tablet_manager.cc:1403] T bbab1a4afac94c1eaeb3ed35bc54408a P ad362df39b114ec3a3a419128097b362: Time spent bootstrapping tablet: real 0.200s	user 0.021s	sys 0.029s
I20260709 12:14:51.644023 24727 leader_election.cc:290] T cf280984dcfc44039a942819e8df951c P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:51.648099 24210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf280984dcfc44039a942819e8df951c" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
I20260709 12:14:51.648833 24210 raft_consensus.cc:2468] T cf280984dcfc44039a942819e8df951c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa14caefbdaa47b09abf91881635ba96 in term 0.
I20260709 12:14:51.648944 24175 leader_election.cc:304] T cf280984dcfc44039a942819e8df951c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, aa14caefbdaa47b09abf91881635ba96; no voters: 
I20260709 12:14:51.651079 24108 catalog_manager.cc:5697] T fa882381d669422a95ec60c9aefa8105 P 9bf3da5b54ef4a1ea1cee60f02ea2883 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193). New cstate: current_term: 1 leader_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:51.651495 24479 raft_consensus.cc:359] T bbab1a4afac94c1eaeb3ed35bc54408a P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:51.652819 24479 raft_consensus.cc:385] T bbab1a4afac94c1eaeb3ed35bc54408a P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:51.653151 24479 raft_consensus.cc:740] T bbab1a4afac94c1eaeb3ed35bc54408a P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad362df39b114ec3a3a419128097b362, State: Initialized, Role: FOLLOWER
I20260709 12:14:51.653862 24479 consensus_queue.cc:260] T bbab1a4afac94c1eaeb3ed35bc54408a P ad362df39b114ec3a3a419128097b362 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:51.654347 24748 raft_consensus.cc:2804] T cf280984dcfc44039a942819e8df951c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:51.654816 24748 raft_consensus.cc:493] T cf280984dcfc44039a942819e8df951c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:51.655264 24748 raft_consensus.cc:3060] T cf280984dcfc44039a942819e8df951c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:51.656301 24479 ts_tablet_manager.cc:1434] T bbab1a4afac94c1eaeb3ed35bc54408a P ad362df39b114ec3a3a419128097b362: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:14:51.660226 24174 leader_election.cc:304] T 06d0284e94354a2686c577372cceb2bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, ad362df39b114ec3a3a419128097b362; no voters: cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:14:51.664387 24770 raft_consensus.cc:515] T cf280984dcfc44039a942819e8df951c P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:51.665963 24807 raft_consensus.cc:2804] T 06d0284e94354a2686c577372cceb2bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:51.666496 24807 raft_consensus.cc:493] T 06d0284e94354a2686c577372cceb2bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:51.666877 24807 raft_consensus.cc:3060] T 06d0284e94354a2686c577372cceb2bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:51.668583 24432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf280984dcfc44039a942819e8df951c" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362"
I20260709 12:14:51.669337 24432 raft_consensus.cc:3060] T cf280984dcfc44039a942819e8df951c P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:51.673974 24430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf280984dcfc44039a942819e8df951c" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:51.673988 24732 consensus_queue.cc:1048] T 356b14abd90d418cab44e524aef8154c P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:51.684968 24430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84ed08271a24f7fa134ae81a858c314" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:51.685832 24430 raft_consensus.cc:2468] T d84ed08271a24f7fa134ae81a858c314 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 0.
W20260709 12:14:51.688985 24399 leader_election.cc:343] T 06d0284e94354a2686c577372cceb2bc P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:51.698666 24770 leader_election.cc:290] T cf280984dcfc44039a942819e8df951c P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 election: Requested vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:51.703648 24479 tablet_bootstrap.cc:492] T 7d67db0aeb6e4afb953c96511f9863d1 P ad362df39b114ec3a3a419128097b362: Bootstrap starting.
I20260709 12:14:51.694775 24732 consensus_queue.cc:1048] T 356b14abd90d418cab44e524aef8154c P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 12:14:51.722709 24249 leader_election.cc:304] T d84ed08271a24f7fa134ae81a858c314 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad362df39b114ec3a3a419128097b362, cf2d8294ae68482ca4ffa8be051ad054; no voters: aa14caefbdaa47b09abf91881635ba96
I20260709 12:14:51.724732 24815 raft_consensus.cc:2804] T d84ed08271a24f7fa134ae81a858c314 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:51.725188 24815 raft_consensus.cc:493] T d84ed08271a24f7fa134ae81a858c314 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:51.725571 24815 raft_consensus.cc:3060] T d84ed08271a24f7fa134ae81a858c314 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:51.719080 24482 raft_consensus.cc:359] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:51.738226 24482 raft_consensus.cc:385] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:51.739423 24482 raft_consensus.cc:740] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:14:51.740360 24482 consensus_queue.cc:260] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:51.743031 24479 tablet_bootstrap.cc:654] T 7d67db0aeb6e4afb953c96511f9863d1 P ad362df39b114ec3a3a419128097b362: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:51.705240 24847 raft_consensus.cc:515] T 06d0284e94354a2686c577372cceb2bc P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:51.748536 24845 consensus_queue.cc:1048] T dbace6d282ab498283858033606494ae P ad362df39b114ec3a3a419128097b362 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:51.749185 24207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf280984dcfc44039a942819e8df951c" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
I20260709 12:14:51.760049 24482 ts_tablet_manager.cc:1434] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.128s	user 0.008s	sys 0.002s
I20260709 12:14:51.761744 24482 tablet_bootstrap.cc:492] T b1e1c3b597fd49b2831e5f523149b2dc P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:14:51.762436 24209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d0284e94354a2686c577372cceb2bc" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
I20260709 12:14:51.773316 24586 consensus_queue.cc:1048] T dbace6d282ab498283858033606494ae P ad362df39b114ec3a3a419128097b362 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:51.779655 24432 raft_consensus.cc:2468] T cf280984dcfc44039a942819e8df951c P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa14caefbdaa47b09abf91881635ba96 in term 1.
I20260709 12:14:51.780270 24732 consensus_queue.cc:1048] T 67c0216443004287861015dd30ae5144 P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:51.789409 24808 raft_consensus.cc:493] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:51.795322 24847 leader_election.cc:290] T 06d0284e94354a2686c577372cceb2bc P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 election: Requested vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:14:51.799139 24282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d0284e94354a2686c577372cceb2bc" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054"
I20260709 12:14:51.804716 24808 raft_consensus.cc:515] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:51.812295 24808 leader_election.cc:290] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:14:51.813567 24478 tablet_bootstrap.cc:492] T 06d0284e94354a2686c577372cceb2bc P cf2d8294ae68482ca4ffa8be051ad054: No bootstrap required, opened a new log
I20260709 12:14:51.813915 24323 leader_election.cc:304] T cf280984dcfc44039a942819e8df951c P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, ad362df39b114ec3a3a419128097b362; no voters: 
I20260709 12:14:51.814224 24478 ts_tablet_manager.cc:1403] T 06d0284e94354a2686c577372cceb2bc P cf2d8294ae68482ca4ffa8be051ad054: Time spent bootstrapping tablet: real 0.256s	user 0.033s	sys 0.019s
I20260709 12:14:51.814433 24281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbab1a4afac94c1eaeb3ed35bc54408a" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:51.814507 24807 raft_consensus.cc:515] T 06d0284e94354a2686c577372cceb2bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:51.814981 24770 raft_consensus.cc:2804] T cf280984dcfc44039a942819e8df951c P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:51.815577 24770 raft_consensus.cc:697] T cf280984dcfc44039a942819e8df951c P aa14caefbdaa47b09abf91881635ba96 [term 1 LEADER]: Becoming Leader. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Running, Role: LEADER
I20260709 12:14:51.816306 24209 raft_consensus.cc:2393] T 06d0284e94354a2686c577372cceb2bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ad362df39b114ec3a3a419128097b362 in current term 1: Already voted for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in this term.
I20260709 12:14:51.816428 24770 consensus_queue.cc:237] T cf280984dcfc44039a942819e8df951c P aa14caefbdaa47b09abf91881635ba96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:51.816962 24807 leader_election.cc:290] T 06d0284e94354a2686c577372cceb2bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 election: Requested vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
W20260709 12:14:51.818252 24176 leader_election.cc:343] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:51.822845 24399 leader_election.cc:343] T 06d0284e94354a2686c577372cceb2bc P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:51.831969 24282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d0284e94354a2686c577372cceb2bc" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054"
I20260709 12:14:51.833638 24481 tablet_bootstrap.cc:492] T fa882381d669422a95ec60c9aefa8105 P aa14caefbdaa47b09abf91881635ba96: No bootstrap required, opened a new log
I20260709 12:14:51.834321 24481 ts_tablet_manager.cc:1403] T fa882381d669422a95ec60c9aefa8105 P aa14caefbdaa47b09abf91881635ba96: Time spent bootstrapping tablet: real 0.401s	user 0.028s	sys 0.010s
I20260709 12:14:51.837467 24748 raft_consensus.cc:515] T cf280984dcfc44039a942819e8df951c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:51.839123 24479 tablet_bootstrap.cc:492] T 7d67db0aeb6e4afb953c96511f9863d1 P ad362df39b114ec3a3a419128097b362: No bootstrap required, opened a new log
I20260709 12:14:51.840008 24479 ts_tablet_manager.cc:1403] T 7d67db0aeb6e4afb953c96511f9863d1 P ad362df39b114ec3a3a419128097b362: Time spent bootstrapping tablet: real 0.152s	user 0.015s	sys 0.010s
I20260709 12:14:51.841289 24478 raft_consensus.cc:359] T 06d0284e94354a2686c577372cceb2bc P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:51.841928 24478 raft_consensus.cc:385] T 06d0284e94354a2686c577372cceb2bc P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:51.842217 24478 raft_consensus.cc:740] T 06d0284e94354a2686c577372cceb2bc P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Initialized, Role: FOLLOWER
I20260709 12:14:51.842950 24478 consensus_queue.cc:260] T 06d0284e94354a2686c577372cceb2bc P cf2d8294ae68482ca4ffa8be051ad054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:51.849607 24815 raft_consensus.cc:515] T d84ed08271a24f7fa134ae81a858c314 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:51.850270 24207 raft_consensus.cc:2393] T cf280984dcfc44039a942819e8df951c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate aa14caefbdaa47b09abf91881635ba96 in current term 1: Already voted for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in this term.
I20260709 12:14:51.855355 24815 leader_election.cc:290] T d84ed08271a24f7fa134ae81a858c314 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 election: Requested vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
W20260709 12:14:51.850958 24176 leader_election.cc:343] T 06d0284e94354a2686c577372cceb2bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:51.876271 24478 ts_tablet_manager.cc:1434] T 06d0284e94354a2686c577372cceb2bc P cf2d8294ae68482ca4ffa8be051ad054: Time spent starting tablet: real 0.062s	user 0.007s	sys 0.001s
I20260709 12:14:51.880121 24358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf280984dcfc44039a942819e8df951c" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
I20260709 12:14:51.880949 24814 consensus_queue.cc:1048] T 67c0216443004287861015dd30ae5144 P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:51.881650 24433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf280984dcfc44039a942819e8df951c" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362"
I20260709 12:14:51.882650 24428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84ed08271a24f7fa134ae81a858c314" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362"
I20260709 12:14:51.883402 24428 raft_consensus.cc:3060] T d84ed08271a24f7fa134ae81a858c314 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:51.883567 24433 raft_consensus.cc:2393] T cf280984dcfc44039a942819e8df951c P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in current term 1: Already voted for candidate aa14caefbdaa47b09abf91881635ba96 in this term.
I20260709 12:14:51.868415 24748 leader_election.cc:290] T cf280984dcfc44039a942819e8df951c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 election: Requested vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:14:51.885723 24175 leader_election.cc:304] T cf280984dcfc44039a942819e8df951c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883; no voters: aa14caefbdaa47b09abf91881635ba96, ad362df39b114ec3a3a419128097b362
I20260709 12:14:51.893548 24748 raft_consensus.cc:2749] T cf280984dcfc44039a942819e8df951c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:14:51.894754 24482 tablet_bootstrap.cc:654] T b1e1c3b597fd49b2831e5f523149b2dc P 9bf3da5b54ef4a1ea1cee60f02ea2883: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:51.910322 24429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d0284e94354a2686c577372cceb2bc" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362"
I20260709 12:14:51.911343 24429 raft_consensus.cc:2393] T 06d0284e94354a2686c577372cceb2bc P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in current term 1: Already voted for candidate ad362df39b114ec3a3a419128097b362 in this term.
I20260709 12:14:51.926227 24479 raft_consensus.cc:359] T 7d67db0aeb6e4afb953c96511f9863d1 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:51.924408 24481 raft_consensus.cc:359] T fa882381d669422a95ec60c9aefa8105 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:51.927366 24481 raft_consensus.cc:385] T fa882381d669422a95ec60c9aefa8105 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:51.927845 24481 raft_consensus.cc:740] T fa882381d669422a95ec60c9aefa8105 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Initialized, Role: FOLLOWER
I20260709 12:14:51.928841 24481 consensus_queue.cc:260] T fa882381d669422a95ec60c9aefa8105 P aa14caefbdaa47b09abf91881635ba96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:51.927129 24479 raft_consensus.cc:385] T 7d67db0aeb6e4afb953c96511f9863d1 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:51.954176 24479 raft_consensus.cc:740] T 7d67db0aeb6e4afb953c96511f9863d1 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad362df39b114ec3a3a419128097b362, State: Initialized, Role: FOLLOWER
W20260709 12:14:51.954923 24175 consensus_peers.cc:597] T b98a35cf96ba4562b4933543b1e4efb9 P 9bf3da5b54ef4a1ea1cee60f02ea2883 -> Peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Couldn't send request to peer aa14caefbdaa47b09abf91881635ba96. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:51.955945 24175 consensus_peers.cc:597] T fa882381d669422a95ec60c9aefa8105 P 9bf3da5b54ef4a1ea1cee60f02ea2883 -> Peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Couldn't send request to peer aa14caefbdaa47b09abf91881635ba96. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:51.958278 24481 ts_tablet_manager.cc:1434] T fa882381d669422a95ec60c9aefa8105 P aa14caefbdaa47b09abf91881635ba96: Time spent starting tablet: real 0.124s	user 0.005s	sys 0.005s
I20260709 12:14:51.959118 24479 consensus_queue.cc:260] T 7d67db0aeb6e4afb953c96511f9863d1 P ad362df39b114ec3a3a419128097b362 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
W20260709 12:14:51.960722 24250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:46845, user_credentials={real_user=slave}} blocked reactor thread for 108039us
I20260709 12:14:51.966356 24478 tablet_bootstrap.cc:492] T b1e1c3b597fd49b2831e5f523149b2dc P cf2d8294ae68482ca4ffa8be051ad054: Bootstrap starting.
I20260709 12:14:51.970963 24479 ts_tablet_manager.cc:1434] T 7d67db0aeb6e4afb953c96511f9863d1 P ad362df39b114ec3a3a419128097b362: Time spent starting tablet: real 0.131s	user 0.007s	sys 0.001s
I20260709 12:14:51.974172 24357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84ed08271a24f7fa134ae81a858c314" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
I20260709 12:14:51.982909 24428 raft_consensus.cc:2468] T d84ed08271a24f7fa134ae81a858c314 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 1.
I20260709 12:14:51.983583 24732 raft_consensus.cc:493] T 06d0284e94354a2686c577372cceb2bc P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:51.986085 24250 leader_election.cc:343] T d84ed08271a24f7fa134ae81a858c314 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:51.986308 24732 raft_consensus.cc:515] T 06d0284e94354a2686c577372cceb2bc P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:51.988659 24732 leader_election.cc:290] T 06d0284e94354a2686c577372cceb2bc P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:51.989537 24249 leader_election.cc:304] T d84ed08271a24f7fa134ae81a858c314 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad362df39b114ec3a3a419128097b362, cf2d8294ae68482ca4ffa8be051ad054; no voters: aa14caefbdaa47b09abf91881635ba96
I20260709 12:14:51.990154 24428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d0284e94354a2686c577372cceb2bc" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:51.990775 24814 raft_consensus.cc:2804] T d84ed08271a24f7fa134ae81a858c314 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:51.991312 24814 raft_consensus.cc:697] T d84ed08271a24f7fa134ae81a858c314 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Becoming Leader. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Running, Role: LEADER
I20260709 12:14:51.992273 24814 consensus_queue.cc:237] T d84ed08271a24f7fa134ae81a858c314 P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:51.992282 24428 raft_consensus.cc:2393] T 06d0284e94354a2686c577372cceb2bc P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cf2d8294ae68482ca4ffa8be051ad054 in current term 1: Already voted for candidate ad362df39b114ec3a3a419128097b362 in this term.
I20260709 12:14:52.001585 24847 raft_consensus.cc:493] T bbab1a4afac94c1eaeb3ed35bc54408a P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:52.002280 24847 raft_consensus.cc:515] T bbab1a4afac94c1eaeb3ed35bc54408a P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:52.003225 24209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d0284e94354a2686c577372cceb2bc" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
I20260709 12:14:52.004156 24209 raft_consensus.cc:2393] T 06d0284e94354a2686c577372cceb2bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cf2d8294ae68482ca4ffa8be051ad054 in current term 1: Already voted for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in this term.
I20260709 12:14:52.004760 24847 leader_election.cc:290] T bbab1a4afac94c1eaeb3ed35bc54408a P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:14:52.006706 24282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbab1a4afac94c1eaeb3ed35bc54408a" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
W20260709 12:14:52.008436 24399 leader_election.cc:343] T bbab1a4afac94c1eaeb3ed35bc54408a P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:52.009795 24174 leader_election.cc:304] T 06d0284e94354a2686c577372cceb2bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883; no voters: ad362df39b114ec3a3a419128097b362, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:14:52.030853 24478 tablet_bootstrap.cc:654] T b1e1c3b597fd49b2831e5f523149b2dc P cf2d8294ae68482ca4ffa8be051ad054: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:52.012768 24396 leader_election.cc:304] T 06d0284e94354a2686c577372cceb2bc P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad362df39b114ec3a3a419128097b362; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:14:52.032106 24847 raft_consensus.cc:2749] T 06d0284e94354a2686c577372cceb2bc P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:14:52.032490 24481 tablet_bootstrap.cc:492] T d92a635ff6404268bd5e51d3b9681551 P aa14caefbdaa47b09abf91881635ba96: Bootstrap starting.
I20260709 12:14:52.018790 24482 tablet_bootstrap.cc:492] T b1e1c3b597fd49b2831e5f523149b2dc P 9bf3da5b54ef4a1ea1cee60f02ea2883: No bootstrap required, opened a new log
I20260709 12:14:52.033466 24482 ts_tablet_manager.cc:1403] T b1e1c3b597fd49b2831e5f523149b2dc P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.272s	user 0.008s	sys 0.027s
I20260709 12:14:52.037716 24482 raft_consensus.cc:359] T b1e1c3b597fd49b2831e5f523149b2dc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:52.038832 24482 raft_consensus.cc:385] T b1e1c3b597fd49b2831e5f523149b2dc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:52.039206 24482 raft_consensus.cc:740] T b1e1c3b597fd49b2831e5f523149b2dc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:14:52.040621 24209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbab1a4afac94c1eaeb3ed35bc54408a" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
I20260709 12:14:52.041494 24209 raft_consensus.cc:2468] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 0.
I20260709 12:14:52.043387 24478 tablet_bootstrap.cc:492] T b1e1c3b597fd49b2831e5f523149b2dc P cf2d8294ae68482ca4ffa8be051ad054: No bootstrap required, opened a new log
I20260709 12:14:52.024363 24430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbab1a4afac94c1eaeb3ed35bc54408a" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:52.044061 24478 ts_tablet_manager.cc:1403] T b1e1c3b597fd49b2831e5f523149b2dc P cf2d8294ae68482ca4ffa8be051ad054: Time spent bootstrapping tablet: real 0.081s	user 0.022s	sys 0.006s
I20260709 12:14:52.044445 24430 raft_consensus.cc:2468] T bbab1a4afac94c1eaeb3ed35bc54408a P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 0.
I20260709 12:14:52.012172 24807 consensus_queue.cc:1048] T fa882381d669422a95ec60c9aefa8105 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.033s
I20260709 12:14:52.030889 24748 raft_consensus.cc:2749] T 06d0284e94354a2686c577372cceb2bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:14:52.025637 24479 tablet_bootstrap.cc:492] T d92a635ff6404268bd5e51d3b9681551 P ad362df39b114ec3a3a419128097b362: Bootstrap starting.
I20260709 12:14:52.043545 24396 leader_election.cc:304] T bbab1a4afac94c1eaeb3ed35bc54408a P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, ad362df39b114ec3a3a419128097b362; no voters: cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:14:52.028333 24249 leader_election.cc:304] T 06d0284e94354a2686c577372cceb2bc P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf2d8294ae68482ca4ffa8be051ad054; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, ad362df39b114ec3a3a419128097b362
I20260709 12:14:52.047616 24751 raft_consensus.cc:2804] T bbab1a4afac94c1eaeb3ed35bc54408a P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:52.047683 24478 raft_consensus.cc:359] T b1e1c3b597fd49b2831e5f523149b2dc P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:52.048197 24751 raft_consensus.cc:493] T bbab1a4afac94c1eaeb3ed35bc54408a P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:52.048772 24478 raft_consensus.cc:385] T b1e1c3b597fd49b2831e5f523149b2dc P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:52.046130 24174 leader_election.cc:304] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, ad362df39b114ec3a3a419128097b362; no voters: cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:14:52.049350 24478 raft_consensus.cc:740] T b1e1c3b597fd49b2831e5f523149b2dc P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Initialized, Role: FOLLOWER
I20260709 12:14:52.049969 24748 raft_consensus.cc:2804] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:52.050384 24748 raft_consensus.cc:493] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:52.050875 24748 raft_consensus.cc:3060] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:52.020331 24104 catalog_manager.cc:5697] T b98a35cf96ba4562b4933543b1e4efb9 P 9bf3da5b54ef4a1ea1cee60f02ea2883 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193). New cstate: current_term: 1 leader_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:52.048688 24751 raft_consensus.cc:3060] T bbab1a4afac94c1eaeb3ed35bc54408a P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:52.040153 24482 consensus_queue.cc:260] T b1e1c3b597fd49b2831e5f523149b2dc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:52.048669 24815 raft_consensus.cc:3060] T 06d0284e94354a2686c577372cceb2bc P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:52.060814 24748 raft_consensus.cc:515] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:52.061477 24479 tablet_bootstrap.cc:654] T d92a635ff6404268bd5e51d3b9681551 P ad362df39b114ec3a3a419128097b362: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:52.050374 24478 consensus_queue.cc:260] T b1e1c3b597fd49b2831e5f523149b2dc P cf2d8294ae68482ca4ffa8be051ad054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:52.043589 24481 tablet_bootstrap.cc:654] T d92a635ff6404268bd5e51d3b9681551 P aa14caefbdaa47b09abf91881635ba96: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:52.076212 24433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbab1a4afac94c1eaeb3ed35bc54408a" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362"
I20260709 12:14:52.076211 24478 ts_tablet_manager.cc:1434] T b1e1c3b597fd49b2831e5f523149b2dc P cf2d8294ae68482ca4ffa8be051ad054: Time spent starting tablet: real 0.031s	user 0.009s	sys 0.000s
I20260709 12:14:52.078017 24282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbab1a4afac94c1eaeb3ed35bc54408a" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054"
I20260709 12:14:52.078648 24478 tablet_bootstrap.cc:492] T bbab1a4afac94c1eaeb3ed35bc54408a P cf2d8294ae68482ca4ffa8be051ad054: Bootstrap starting.
I20260709 12:14:52.079138 24482 ts_tablet_manager.cc:1434] T b1e1c3b597fd49b2831e5f523149b2dc P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.045s	user 0.005s	sys 0.004s
W20260709 12:14:52.079936 24176 leader_election.cc:343] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:52.080438 24482 tablet_bootstrap.cc:492] T 8996365fa46548d49f3b3bafe14e9c83 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:14:52.076503 24748 leader_election.cc:290] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 election: Requested vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:14:52.091045 24815 raft_consensus.cc:2749] T 06d0284e94354a2686c577372cceb2bc P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:52.094024 24103 catalog_manager.cc:5697] T cf280984dcfc44039a942819e8df951c P aa14caefbdaa47b09abf91881635ba96 reported cstate change: term changed from 0 to 1, leader changed from <none> to aa14caefbdaa47b09abf91881635ba96 (127.12.56.195). New cstate: current_term: 1 leader_uuid: "aa14caefbdaa47b09abf91881635ba96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:52.099668 24807 consensus_queue.cc:1048] T b98a35cf96ba4562b4933543b1e4efb9 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:52.101475 24478 tablet_bootstrap.cc:654] T bbab1a4afac94c1eaeb3ed35bc54408a P cf2d8294ae68482ca4ffa8be051ad054: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:52.110952 24479 tablet_bootstrap.cc:492] T d92a635ff6404268bd5e51d3b9681551 P ad362df39b114ec3a3a419128097b362: No bootstrap required, opened a new log
I20260709 12:14:52.111554 24479 ts_tablet_manager.cc:1403] T d92a635ff6404268bd5e51d3b9681551 P ad362df39b114ec3a3a419128097b362: Time spent bootstrapping tablet: real 0.086s	user 0.013s	sys 0.010s
I20260709 12:14:52.113561 24751 raft_consensus.cc:515] T bbab1a4afac94c1eaeb3ed35bc54408a P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:52.115520 24433 raft_consensus.cc:2393] T bbab1a4afac94c1eaeb3ed35bc54408a P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in current term 1: Already voted for candidate ad362df39b114ec3a3a419128097b362 in this term.
I20260709 12:14:52.117381 24482 tablet_bootstrap.cc:654] T 8996365fa46548d49f3b3bafe14e9c83 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:52.117956 24209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbab1a4afac94c1eaeb3ed35bc54408a" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
I20260709 12:14:52.118224 24174 leader_election.cc:304] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883; no voters: ad362df39b114ec3a3a419128097b362, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:14:52.118885 24209 raft_consensus.cc:2393] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ad362df39b114ec3a3a419128097b362 in current term 1: Already voted for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in this term.
I20260709 12:14:52.129472 24479 raft_consensus.cc:359] T d92a635ff6404268bd5e51d3b9681551 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:52.120302 24808 raft_consensus.cc:2749] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:14:52.130424 24479 raft_consensus.cc:385] T d92a635ff6404268bd5e51d3b9681551 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:52.135860 24282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbab1a4afac94c1eaeb3ed35bc54408a" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054"
W20260709 12:14:52.137645 24399 leader_election.cc:343] T bbab1a4afac94c1eaeb3ed35bc54408a P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:52.138196 24399 leader_election.cc:304] T bbab1a4afac94c1eaeb3ed35bc54408a P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad362df39b114ec3a3a419128097b362; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:14:52.139119 24847 raft_consensus.cc:2749] T bbab1a4afac94c1eaeb3ed35bc54408a P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:14:52.133628 24479 raft_consensus.cc:740] T d92a635ff6404268bd5e51d3b9681551 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad362df39b114ec3a3a419128097b362, State: Initialized, Role: FOLLOWER
I20260709 12:14:52.145879 24479 consensus_queue.cc:260] T d92a635ff6404268bd5e51d3b9681551 P ad362df39b114ec3a3a419128097b362 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:52.150774 24479 ts_tablet_manager.cc:1434] T d92a635ff6404268bd5e51d3b9681551 P ad362df39b114ec3a3a419128097b362: Time spent starting tablet: real 0.039s	user 0.010s	sys 0.000s
I20260709 12:14:52.145893 24751 leader_election.cc:290] T bbab1a4afac94c1eaeb3ed35bc54408a P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 election: Requested vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:14:52.162799 24478 tablet_bootstrap.cc:492] T bbab1a4afac94c1eaeb3ed35bc54408a P cf2d8294ae68482ca4ffa8be051ad054: No bootstrap required, opened a new log
I20260709 12:14:52.163409 24478 ts_tablet_manager.cc:1403] T bbab1a4afac94c1eaeb3ed35bc54408a P cf2d8294ae68482ca4ffa8be051ad054: Time spent bootstrapping tablet: real 0.085s	user 0.011s	sys 0.006s
I20260709 12:14:52.165993 24815 raft_consensus.cc:493] T b1e1c3b597fd49b2831e5f523149b2dc P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:52.171366 24815 raft_consensus.cc:515] T b1e1c3b597fd49b2831e5f523149b2dc P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:52.175534 24357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e1c3b597fd49b2831e5f523149b2dc" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:52.176184 24479 tablet_bootstrap.cc:492] T 49b141610080476a8e5f0415c370e8cd P ad362df39b114ec3a3a419128097b362: Bootstrap starting.
W20260709 12:14:52.177395 24250 leader_election.cc:343] T b1e1c3b597fd49b2831e5f523149b2dc P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:52.173700 24815 leader_election.cc:290] T b1e1c3b597fd49b2831e5f523149b2dc P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:14:52.178330 24207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e1c3b597fd49b2831e5f523149b2dc" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
I20260709 12:14:52.182439 24207 raft_consensus.cc:2468] T b1e1c3b597fd49b2831e5f523149b2dc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 0.
I20260709 12:14:52.183845 24248 leader_election.cc:304] T b1e1c3b597fd49b2831e5f523149b2dc P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054; no voters: aa14caefbdaa47b09abf91881635ba96
I20260709 12:14:52.180307 24478 raft_consensus.cc:359] T bbab1a4afac94c1eaeb3ed35bc54408a P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:52.184901 24478 raft_consensus.cc:385] T bbab1a4afac94c1eaeb3ed35bc54408a P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:52.185240 24478 raft_consensus.cc:740] T bbab1a4afac94c1eaeb3ed35bc54408a P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Initialized, Role: FOLLOWER
I20260709 12:14:52.186111 24478 consensus_queue.cc:260] T bbab1a4afac94c1eaeb3ed35bc54408a P cf2d8294ae68482ca4ffa8be051ad054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:52.185550 24815 raft_consensus.cc:2804] T b1e1c3b597fd49b2831e5f523149b2dc P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:52.189604 24482 tablet_bootstrap.cc:492] T 8996365fa46548d49f3b3bafe14e9c83 P 9bf3da5b54ef4a1ea1cee60f02ea2883: No bootstrap required, opened a new log
I20260709 12:14:52.189884 24815 raft_consensus.cc:493] T b1e1c3b597fd49b2831e5f523149b2dc P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:52.167670 24107 catalog_manager.cc:5697] T d84ed08271a24f7fa134ae81a858c314 P cf2d8294ae68482ca4ffa8be051ad054 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194). New cstate: current_term: 1 leader_uuid: "cf2d8294ae68482ca4ffa8be051ad054" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:52.191849 24478 ts_tablet_manager.cc:1434] T bbab1a4afac94c1eaeb3ed35bc54408a P cf2d8294ae68482ca4ffa8be051ad054: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.001s
I20260709 12:14:52.190837 24815 raft_consensus.cc:3060] T b1e1c3b597fd49b2831e5f523149b2dc P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:52.190428 24482 ts_tablet_manager.cc:1403] T 8996365fa46548d49f3b3bafe14e9c83 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.110s	user 0.011s	sys 0.018s
I20260709 12:14:52.193159 24751 raft_consensus.cc:493] T 4f756e6bcc20458b8748cd090cd3fce2 P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:52.194094 24479 tablet_bootstrap.cc:654] T 49b141610080476a8e5f0415c370e8cd P ad362df39b114ec3a3a419128097b362: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:52.193958 24751 raft_consensus.cc:515] T 4f756e6bcc20458b8748cd090cd3fce2 P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:52.197319 24357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f756e6bcc20458b8748cd090cd3fce2" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:52.198069 24357 raft_consensus.cc:2468] T 4f756e6bcc20458b8748cd090cd3fce2 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 2.
I20260709 12:14:52.199074 24207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f756e6bcc20458b8748cd090cd3fce2" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
I20260709 12:14:52.199560 24398 leader_election.cc:304] T 4f756e6bcc20458b8748cd090cd3fce2 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, ad362df39b114ec3a3a419128097b362; no voters: 
I20260709 12:14:52.200176 24207 raft_consensus.cc:2468] T 4f756e6bcc20458b8748cd090cd3fce2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 1.
I20260709 12:14:52.200577 24847 raft_consensus.cc:2804] T 4f756e6bcc20458b8748cd090cd3fce2 P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:52.201172 24847 raft_consensus.cc:493] T 4f756e6bcc20458b8748cd090cd3fce2 P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:52.201530 24847 raft_consensus.cc:3060] T 4f756e6bcc20458b8748cd090cd3fce2 P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:52.193214 24478 tablet_bootstrap.cc:492] T bfba40ac52f842ca99dd4293619360af P cf2d8294ae68482ca4ffa8be051ad054: Bootstrap starting.
I20260709 12:14:52.197316 24751 leader_election.cc:290] T 4f756e6bcc20458b8748cd090cd3fce2 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:52.207919 24481 tablet_bootstrap.cc:492] T d92a635ff6404268bd5e51d3b9681551 P aa14caefbdaa47b09abf91881635ba96: No bootstrap required, opened a new log
I20260709 12:14:52.218364 24481 ts_tablet_manager.cc:1403] T d92a635ff6404268bd5e51d3b9681551 P aa14caefbdaa47b09abf91881635ba96: Time spent bootstrapping tablet: real 0.186s	user 0.022s	sys 0.004s
I20260709 12:14:52.212978 24751 raft_consensus.cc:493] T 7d67db0aeb6e4afb953c96511f9863d1 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:52.219439 24751 raft_consensus.cc:515] T 7d67db0aeb6e4afb953c96511f9863d1 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:52.222856 24281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d67db0aeb6e4afb953c96511f9863d1" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:52.196693 24482 raft_consensus.cc:359] T 8996365fa46548d49f3b3bafe14e9c83 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
W20260709 12:14:52.225265 24399 leader_election.cc:343] T 7d67db0aeb6e4afb953c96511f9863d1 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:52.225548 24482 raft_consensus.cc:385] T 8996365fa46548d49f3b3bafe14e9c83 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:52.226110 24482 raft_consensus.cc:740] T 8996365fa46548d49f3b3bafe14e9c83 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:14:52.227404 24482 consensus_queue.cc:260] T 8996365fa46548d49f3b3bafe14e9c83 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:52.229208 24357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d67db0aeb6e4afb953c96511f9863d1" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
W20260709 12:14:52.230942 24398 leader_election.cc:343] T 7d67db0aeb6e4afb953c96511f9863d1 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:52.231582 24398 leader_election.cc:304] T 7d67db0aeb6e4afb953c96511f9863d1 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad362df39b114ec3a3a419128097b362; no voters: aa14caefbdaa47b09abf91881635ba96, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:14:52.228700 24751 leader_election.cc:290] T 7d67db0aeb6e4afb953c96511f9863d1 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:14:52.234001 24586 raft_consensus.cc:2749] T 7d67db0aeb6e4afb953c96511f9863d1 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:52.235337 24807 raft_consensus.cc:493] T 8996365fa46548d49f3b3bafe14e9c83 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:52.235955 24807 raft_consensus.cc:515] T 8996365fa46548d49f3b3bafe14e9c83 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:52.240332 24357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8996365fa46548d49f3b3bafe14e9c83" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
W20260709 12:14:52.242086 24175 leader_election.cc:343] T 8996365fa46548d49f3b3bafe14e9c83 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:52.243371 24807 leader_election.cc:290] T 8996365fa46548d49f3b3bafe14e9c83 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:14:52.243706 24430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8996365fa46548d49f3b3bafe14e9c83" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
W20260709 12:14:52.247418 24174 leader_election.cc:343] T 8996365fa46548d49f3b3bafe14e9c83 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:52.260113 24174 leader_election.cc:304] T 8996365fa46548d49f3b3bafe14e9c83 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883; no voters: aa14caefbdaa47b09abf91881635ba96, ad362df39b114ec3a3a419128097b362
I20260709 12:14:52.245390 24482 ts_tablet_manager.cc:1434] T 8996365fa46548d49f3b3bafe14e9c83 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.000s
I20260709 12:14:52.263505 24806 raft_consensus.cc:2749] T 8996365fa46548d49f3b3bafe14e9c83 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:52.268992 24482 tablet_bootstrap.cc:492] T d92a635ff6404268bd5e51d3b9681551 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:14:52.242633 24481 raft_consensus.cc:359] T d92a635ff6404268bd5e51d3b9681551 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:52.274787 24481 raft_consensus.cc:385] T d92a635ff6404268bd5e51d3b9681551 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:52.275122 24481 raft_consensus.cc:740] T d92a635ff6404268bd5e51d3b9681551 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Initialized, Role: FOLLOWER
I20260709 12:14:52.275753 24478 tablet_bootstrap.cc:654] T bfba40ac52f842ca99dd4293619360af P cf2d8294ae68482ca4ffa8be051ad054: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:52.276082 24815 raft_consensus.cc:515] T b1e1c3b597fd49b2831e5f523149b2dc P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:52.282097 24770 consensus_queue.cc:1048] T cf280984dcfc44039a942819e8df951c P aa14caefbdaa47b09abf91881635ba96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:52.283679 24207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e1c3b597fd49b2831e5f523149b2dc" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
I20260709 12:14:52.284402 24207 raft_consensus.cc:3060] T b1e1c3b597fd49b2831e5f523149b2dc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:52.276298 24481 consensus_queue.cc:260] T d92a635ff6404268bd5e51d3b9681551 P aa14caefbdaa47b09abf91881635ba96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:52.288610 24481 ts_tablet_manager.cc:1434] T d92a635ff6404268bd5e51d3b9681551 P aa14caefbdaa47b09abf91881635ba96: Time spent starting tablet: real 0.070s	user 0.004s	sys 0.003s
I20260709 12:14:52.293712 24481 tablet_bootstrap.cc:492] T d84ed08271a24f7fa134ae81a858c314 P aa14caefbdaa47b09abf91881635ba96: Bootstrap starting.
I20260709 12:14:52.296012 24207 raft_consensus.cc:2468] T b1e1c3b597fd49b2831e5f523149b2dc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 1.
I20260709 12:14:52.297917 24248 leader_election.cc:304] T b1e1c3b597fd49b2831e5f523149b2dc P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054; no voters: 
I20260709 12:14:52.241639 24847 raft_consensus.cc:515] T 4f756e6bcc20458b8748cd090cd3fce2 P ad362df39b114ec3a3a419128097b362 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:52.302749 24815 leader_election.cc:290] T b1e1c3b597fd49b2831e5f523149b2dc P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 election: Requested vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:14:52.304278 24357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e1c3b597fd49b2831e5f523149b2dc" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
I20260709 12:14:52.292120 24482 tablet_bootstrap.cc:654] T d92a635ff6404268bd5e51d3b9681551 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:52.304817 24359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f756e6bcc20458b8748cd090cd3fce2" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
I20260709 12:14:52.305577 24359 raft_consensus.cc:3060] T 4f756e6bcc20458b8748cd090cd3fce2 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:14:52.307263 24250 leader_election.cc:343] T b1e1c3b597fd49b2831e5f523149b2dc P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:52.313256 24815 raft_consensus.cc:2804] T b1e1c3b597fd49b2831e5f523149b2dc P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:52.288901 24479 tablet_bootstrap.cc:492] T 49b141610080476a8e5f0415c370e8cd P ad362df39b114ec3a3a419128097b362: No bootstrap required, opened a new log
I20260709 12:14:52.314843 24479 ts_tablet_manager.cc:1403] T 49b141610080476a8e5f0415c370e8cd P ad362df39b114ec3a3a419128097b362: Time spent bootstrapping tablet: real 0.139s	user 0.009s	sys 0.036s
I20260709 12:14:52.318387 24847 leader_election.cc:290] T 4f756e6bcc20458b8748cd090cd3fce2 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 3 election: Requested vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:52.320616 24209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f756e6bcc20458b8748cd090cd3fce2" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
I20260709 12:14:52.321345 24209 raft_consensus.cc:3060] T 4f756e6bcc20458b8748cd090cd3fce2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:14:52.325100 24798 raft_consensus.cc:493] T fa882381d669422a95ec60c9aefa8105 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:52.325695 24798 raft_consensus.cc:515] T fa882381d669422a95ec60c9aefa8105 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:52.328310 24798 leader_election.cc:290] T fa882381d669422a95ec60c9aefa8105 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:52.331499 24359 raft_consensus.cc:2468] T 4f756e6bcc20458b8748cd090cd3fce2 P aa14caefbdaa47b09abf91881635ba96 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 3.
I20260709 12:14:52.331755 24815 raft_consensus.cc:697] T b1e1c3b597fd49b2831e5f523149b2dc P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Becoming Leader. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Running, Role: LEADER
I20260709 12:14:52.334636 24208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa882381d669422a95ec60c9aefa8105" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
I20260709 12:14:52.351786 24814 raft_consensus.cc:493] T bbab1a4afac94c1eaeb3ed35bc54408a P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:52.404378 24814 raft_consensus.cc:515] T bbab1a4afac94c1eaeb3ed35bc54408a P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:52.359166 24432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa882381d669422a95ec60c9aefa8105" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:52.406255 24815 consensus_queue.cc:237] T b1e1c3b597fd49b2831e5f523149b2dc P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:52.332751 24479 raft_consensus.cc:359] T 49b141610080476a8e5f0415c370e8cd P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:52.412148 24479 raft_consensus.cc:385] T 49b141610080476a8e5f0415c370e8cd P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:52.412613 24479 raft_consensus.cc:740] T 49b141610080476a8e5f0415c370e8cd P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad362df39b114ec3a3a419128097b362, State: Initialized, Role: FOLLOWER
I20260709 12:14:52.413636 24479 consensus_queue.cc:260] T 49b141610080476a8e5f0415c370e8cd P ad362df39b114ec3a3a419128097b362 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:52.416685 24479 ts_tablet_manager.cc:1434] T 49b141610080476a8e5f0415c370e8cd P ad362df39b114ec3a3a419128097b362: Time spent starting tablet: real 0.101s	user 0.008s	sys 0.000s
I20260709 12:14:52.417960 24479 tablet_bootstrap.cc:492] T 8996365fa46548d49f3b3bafe14e9c83 P ad362df39b114ec3a3a419128097b362: Bootstrap starting.
I20260709 12:14:52.391914 24209 raft_consensus.cc:2468] T 4f756e6bcc20458b8748cd090cd3fce2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 3.
I20260709 12:14:52.422987 24396 leader_election.cc:304] T 4f756e6bcc20458b8748cd090cd3fce2 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, ad362df39b114ec3a3a419128097b362; no voters: 
I20260709 12:14:52.424672 24478 tablet_bootstrap.cc:492] T bfba40ac52f842ca99dd4293619360af P cf2d8294ae68482ca4ffa8be051ad054: No bootstrap required, opened a new log
I20260709 12:14:52.425290 24586 raft_consensus.cc:2804] T 4f756e6bcc20458b8748cd090cd3fce2 P ad362df39b114ec3a3a419128097b362 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:52.425902 24586 raft_consensus.cc:697] T 4f756e6bcc20458b8748cd090cd3fce2 P ad362df39b114ec3a3a419128097b362 [term 3 LEADER]: Becoming Leader. State: Replica: ad362df39b114ec3a3a419128097b362, State: Running, Role: LEADER
I20260709 12:14:52.426782 24586 consensus_queue.cc:237] T 4f756e6bcc20458b8748cd090cd3fce2 P ad362df39b114ec3a3a419128097b362 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:52.429097 24814 leader_election.cc:290] T bbab1a4afac94c1eaeb3ed35bc54408a P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:52.425262 24478 ts_tablet_manager.cc:1403] T bfba40ac52f842ca99dd4293619360af P cf2d8294ae68482ca4ffa8be051ad054: Time spent bootstrapping tablet: real 0.232s	user 0.016s	sys 0.002s
I20260709 12:14:52.434211 24798 consensus_queue.cc:1048] T cf280984dcfc44039a942819e8df951c P aa14caefbdaa47b09abf91881635ba96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:52.436064 24323 leader_election.cc:304] T fa882381d669422a95ec60c9aefa8105 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, ad362df39b114ec3a3a419128097b362
I20260709 12:14:52.437211 24798 raft_consensus.cc:2749] T fa882381d669422a95ec60c9aefa8105 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:52.430789 24481 tablet_bootstrap.cc:654] T d84ed08271a24f7fa134ae81a858c314 P aa14caefbdaa47b09abf91881635ba96: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:52.445487 24432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbab1a4afac94c1eaeb3ed35bc54408a" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:52.446719 24432 raft_consensus.cc:2393] T bbab1a4afac94c1eaeb3ed35bc54408a P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cf2d8294ae68482ca4ffa8be051ad054 in current term 1: Already voted for candidate ad362df39b114ec3a3a419128097b362 in this term.
I20260709 12:14:52.449098 24479 tablet_bootstrap.cc:654] T 8996365fa46548d49f3b3bafe14e9c83 P ad362df39b114ec3a3a419128097b362: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:52.450580 24482 tablet_bootstrap.cc:492] T d92a635ff6404268bd5e51d3b9681551 P 9bf3da5b54ef4a1ea1cee60f02ea2883: No bootstrap required, opened a new log
I20260709 12:14:52.451161 24482 ts_tablet_manager.cc:1403] T d92a635ff6404268bd5e51d3b9681551 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.183s	user 0.014s	sys 0.001s
I20260709 12:14:52.451004 24210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbab1a4afac94c1eaeb3ed35bc54408a" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
I20260709 12:14:52.451874 24210 raft_consensus.cc:2393] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cf2d8294ae68482ca4ffa8be051ad054 in current term 1: Already voted for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in this term.
I20260709 12:14:52.452703 24478 raft_consensus.cc:359] T bfba40ac52f842ca99dd4293619360af P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:52.465485 24359 raft_consensus.cc:3060] T fa882381d669422a95ec60c9aefa8105 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:52.475330 24478 raft_consensus.cc:385] T bfba40ac52f842ca99dd4293619360af P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:52.475708 24478 raft_consensus.cc:740] T bfba40ac52f842ca99dd4293619360af P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Initialized, Role: FOLLOWER
W20260709 12:14:52.476649 24250 consensus_peers.cc:597] T d84ed08271a24f7fa134ae81a858c314 P cf2d8294ae68482ca4ffa8be051ad054 -> Peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Couldn't send request to peer aa14caefbdaa47b09abf91881635ba96. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:52.478338 24482 raft_consensus.cc:359] T d92a635ff6404268bd5e51d3b9681551 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:52.479203 24482 raft_consensus.cc:385] T d92a635ff6404268bd5e51d3b9681551 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:52.479494 24482 raft_consensus.cc:740] T d92a635ff6404268bd5e51d3b9681551 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:14:52.480242 24482 consensus_queue.cc:260] T d92a635ff6404268bd5e51d3b9681551 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
W20260709 12:14:52.485486 24155 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:52.485881 24106 catalog_manager.cc:5697] T b1e1c3b597fd49b2831e5f523149b2dc P cf2d8294ae68482ca4ffa8be051ad054 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194). New cstate: current_term: 1 leader_uuid: "cf2d8294ae68482ca4ffa8be051ad054" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:52.489185 24248 leader_election.cc:304] T bbab1a4afac94c1eaeb3ed35bc54408a P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf2d8294ae68482ca4ffa8be051ad054; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, ad362df39b114ec3a3a419128097b362
I20260709 12:14:52.488722 24478 consensus_queue.cc:260] T bfba40ac52f842ca99dd4293619360af P cf2d8294ae68482ca4ffa8be051ad054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:52.493927 24481 tablet_bootstrap.cc:492] T d84ed08271a24f7fa134ae81a858c314 P aa14caefbdaa47b09abf91881635ba96: No bootstrap required, opened a new log
I20260709 12:14:52.494122 24816 raft_consensus.cc:3060] T bbab1a4afac94c1eaeb3ed35bc54408a P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:52.493130 24107 catalog_manager.cc:5697] T 4f756e6bcc20458b8748cd090cd3fce2 P ad362df39b114ec3a3a419128097b362 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ad362df39b114ec3a3a419128097b362" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:52.494571 24481 ts_tablet_manager.cc:1403] T d84ed08271a24f7fa134ae81a858c314 P aa14caefbdaa47b09abf91881635ba96: Time spent bootstrapping tablet: real 0.201s	user 0.013s	sys 0.000s
I20260709 12:14:52.503063 24816 raft_consensus.cc:2749] T bbab1a4afac94c1eaeb3ed35bc54408a P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:52.503593 24481 raft_consensus.cc:359] T d84ed08271a24f7fa134ae81a858c314 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:52.504333 24481 raft_consensus.cc:385] T d84ed08271a24f7fa134ae81a858c314 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:52.504913 24481 raft_consensus.cc:740] T d84ed08271a24f7fa134ae81a858c314 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Initialized, Role: FOLLOWER
I20260709 12:14:52.505249 24478 ts_tablet_manager.cc:1434] T bfba40ac52f842ca99dd4293619360af P cf2d8294ae68482ca4ffa8be051ad054: Time spent starting tablet: real 0.071s	user 0.005s	sys 0.001s
I20260709 12:14:52.505821 24481 consensus_queue.cc:260] T d84ed08271a24f7fa134ae81a858c314 P aa14caefbdaa47b09abf91881635ba96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:52.506428 24478 tablet_bootstrap.cc:492] T 7d67db0aeb6e4afb953c96511f9863d1 P cf2d8294ae68482ca4ffa8be051ad054: Bootstrap starting.
I20260709 12:14:52.520367 24479 tablet_bootstrap.cc:492] T 8996365fa46548d49f3b3bafe14e9c83 P ad362df39b114ec3a3a419128097b362: No bootstrap required, opened a new log
I20260709 12:14:52.522121 24482 ts_tablet_manager.cc:1434] T d92a635ff6404268bd5e51d3b9681551 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.069s	user 0.004s	sys 0.003s
I20260709 12:14:52.526579 24586 raft_consensus.cc:493] T 49b141610080476a8e5f0415c370e8cd P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:52.527176 24586 raft_consensus.cc:515] T 49b141610080476a8e5f0415c370e8cd P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:52.527946 24482 tablet_bootstrap.cc:492] T bfba40ac52f842ca99dd4293619360af P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:14:52.531208 24207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b141610080476a8e5f0415c370e8cd" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
I20260709 12:14:52.535759 24284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b141610080476a8e5f0415c370e8cd" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
W20260709 12:14:52.538059 24399 leader_election.cc:343] T 49b141610080476a8e5f0415c370e8cd P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:52.539011 24396 leader_election.cc:343] T 49b141610080476a8e5f0415c370e8cd P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:52.539551 24396 leader_election.cc:304] T 49b141610080476a8e5f0415c370e8cd P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad362df39b114ec3a3a419128097b362; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:14:52.542076 24847 raft_consensus.cc:2749] T 49b141610080476a8e5f0415c370e8cd P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:52.561311 24586 leader_election.cc:290] T 49b141610080476a8e5f0415c370e8cd P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:14:52.511242 24814 consensus_queue.cc:1048] T d84ed08271a24f7fa134ae81a858c314 P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.051s
I20260709 12:14:52.508738 24481 ts_tablet_manager.cc:1434] T d84ed08271a24f7fa134ae81a858c314 P aa14caefbdaa47b09abf91881635ba96: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:14:52.575472 24481 tablet_bootstrap.cc:492] T b1e1c3b597fd49b2831e5f523149b2dc P aa14caefbdaa47b09abf91881635ba96: Bootstrap starting.
I20260709 12:14:52.577069 24479 ts_tablet_manager.cc:1403] T 8996365fa46548d49f3b3bafe14e9c83 P ad362df39b114ec3a3a419128097b362: Time spent bootstrapping tablet: real 0.159s	user 0.010s	sys 0.009s
I20260709 12:14:52.581513 24478 tablet_bootstrap.cc:654] T 7d67db0aeb6e4afb953c96511f9863d1 P cf2d8294ae68482ca4ffa8be051ad054: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:52.586069 24586 raft_consensus.cc:493] T d92a635ff6404268bd5e51d3b9681551 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:52.586753 24586 raft_consensus.cc:515] T d92a635ff6404268bd5e51d3b9681551 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:52.587183 24482 tablet_bootstrap.cc:654] T bfba40ac52f842ca99dd4293619360af P 9bf3da5b54ef4a1ea1cee60f02ea2883: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:52.590231 24356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92a635ff6404268bd5e51d3b9681551" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:52.590490 24210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92a635ff6404268bd5e51d3b9681551" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
I20260709 12:14:52.591270 24356 raft_consensus.cc:2468] T d92a635ff6404268bd5e51d3b9681551 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 0.
I20260709 12:14:52.592875 24398 leader_election.cc:304] T d92a635ff6404268bd5e51d3b9681551 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, ad362df39b114ec3a3a419128097b362; no voters: 
I20260709 12:14:52.591507 24210 raft_consensus.cc:2468] T d92a635ff6404268bd5e51d3b9681551 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 0.
I20260709 12:14:52.594420 24847 raft_consensus.cc:2804] T d92a635ff6404268bd5e51d3b9681551 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:52.594864 24847 raft_consensus.cc:493] T d92a635ff6404268bd5e51d3b9681551 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:52.595248 24847 raft_consensus.cc:3060] T d92a635ff6404268bd5e51d3b9681551 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:52.597538 24481 tablet_bootstrap.cc:654] T b1e1c3b597fd49b2831e5f523149b2dc P aa14caefbdaa47b09abf91881635ba96: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:52.599629 24586 leader_election.cc:290] T d92a635ff6404268bd5e51d3b9681551 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:52.615603 24479 raft_consensus.cc:359] T 8996365fa46548d49f3b3bafe14e9c83 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:52.616700 24479 raft_consensus.cc:385] T 8996365fa46548d49f3b3bafe14e9c83 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:52.617266 24479 raft_consensus.cc:740] T 8996365fa46548d49f3b3bafe14e9c83 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad362df39b114ec3a3a419128097b362, State: Initialized, Role: FOLLOWER
I20260709 12:14:52.618194 24479 consensus_queue.cc:260] T 8996365fa46548d49f3b3bafe14e9c83 P ad362df39b114ec3a3a419128097b362 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:52.618844 24478 tablet_bootstrap.cc:492] T 7d67db0aeb6e4afb953c96511f9863d1 P cf2d8294ae68482ca4ffa8be051ad054: No bootstrap required, opened a new log
I20260709 12:14:52.619503 24478 ts_tablet_manager.cc:1403] T 7d67db0aeb6e4afb953c96511f9863d1 P cf2d8294ae68482ca4ffa8be051ad054: Time spent bootstrapping tablet: real 0.113s	user 0.029s	sys 0.051s
I20260709 12:14:52.628048 24479 ts_tablet_manager.cc:1434] T 8996365fa46548d49f3b3bafe14e9c83 P ad362df39b114ec3a3a419128097b362: Time spent starting tablet: real 0.051s	user 0.004s	sys 0.004s
I20260709 12:14:52.629300 24479 tablet_bootstrap.cc:492] T f9094185a2ad43d0b3a5174b165dab65 P ad362df39b114ec3a3a419128097b362: Bootstrap starting.
I20260709 12:14:52.625443 24478 raft_consensus.cc:359] T 7d67db0aeb6e4afb953c96511f9863d1 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:52.633047 24478 raft_consensus.cc:385] T 7d67db0aeb6e4afb953c96511f9863d1 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:52.633401 24478 raft_consensus.cc:740] T 7d67db0aeb6e4afb953c96511f9863d1 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Initialized, Role: FOLLOWER
I20260709 12:14:52.632682 24847 raft_consensus.cc:515] T d92a635ff6404268bd5e51d3b9681551 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:52.634321 24478 consensus_queue.cc:260] T 7d67db0aeb6e4afb953c96511f9863d1 P cf2d8294ae68482ca4ffa8be051ad054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:52.636713 24847 leader_election.cc:290] T d92a635ff6404268bd5e51d3b9681551 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 election: Requested vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:52.637887 24478 ts_tablet_manager.cc:1434] T 7d67db0aeb6e4afb953c96511f9863d1 P cf2d8294ae68482ca4ffa8be051ad054: Time spent starting tablet: real 0.018s	user 0.010s	sys 0.000s
I20260709 12:14:52.637645 24356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92a635ff6404268bd5e51d3b9681551" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
I20260709 12:14:52.638443 24356 raft_consensus.cc:3060] T d92a635ff6404268bd5e51d3b9681551 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:52.639238 24478 tablet_bootstrap.cc:492] T 49b141610080476a8e5f0415c370e8cd P cf2d8294ae68482ca4ffa8be051ad054: Bootstrap starting.
I20260709 12:14:52.645011 24479 tablet_bootstrap.cc:654] T f9094185a2ad43d0b3a5174b165dab65 P ad362df39b114ec3a3a419128097b362: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:52.646404 24478 tablet_bootstrap.cc:654] T 49b141610080476a8e5f0415c370e8cd P cf2d8294ae68482ca4ffa8be051ad054: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:52.646701 24209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92a635ff6404268bd5e51d3b9681551" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
I20260709 12:14:52.647815 24209 raft_consensus.cc:3060] T d92a635ff6404268bd5e51d3b9681551 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:52.663727 24481 tablet_bootstrap.cc:492] T b1e1c3b597fd49b2831e5f523149b2dc P aa14caefbdaa47b09abf91881635ba96: No bootstrap required, opened a new log
I20260709 12:14:52.664342 24481 ts_tablet_manager.cc:1403] T b1e1c3b597fd49b2831e5f523149b2dc P aa14caefbdaa47b09abf91881635ba96: Time spent bootstrapping tablet: real 0.089s	user 0.009s	sys 0.012s
I20260709 12:14:52.669490 24481 raft_consensus.cc:359] T b1e1c3b597fd49b2831e5f523149b2dc P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:52.671844 24481 raft_consensus.cc:385] T b1e1c3b597fd49b2831e5f523149b2dc P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:52.672194 24481 raft_consensus.cc:740] T b1e1c3b597fd49b2831e5f523149b2dc P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Initialized, Role: FOLLOWER
I20260709 12:14:52.672911 24481 consensus_queue.cc:260] T b1e1c3b597fd49b2831e5f523149b2dc P aa14caefbdaa47b09abf91881635ba96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:52.681490 24356 raft_consensus.cc:2468] T d92a635ff6404268bd5e51d3b9681551 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 1.
I20260709 12:14:52.688589 24482 tablet_bootstrap.cc:492] T bfba40ac52f842ca99dd4293619360af P 9bf3da5b54ef4a1ea1cee60f02ea2883: No bootstrap required, opened a new log
I20260709 12:14:52.689030 24398 leader_election.cc:304] T d92a635ff6404268bd5e51d3b9681551 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, ad362df39b114ec3a3a419128097b362; no voters: 
I20260709 12:14:52.689502 24482 ts_tablet_manager.cc:1403] T bfba40ac52f842ca99dd4293619360af P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.162s	user 0.019s	sys 0.009s
I20260709 12:14:52.692931 24478 tablet_bootstrap.cc:492] T 49b141610080476a8e5f0415c370e8cd P cf2d8294ae68482ca4ffa8be051ad054: No bootstrap required, opened a new log
I20260709 12:14:52.693676 24478 ts_tablet_manager.cc:1403] T 49b141610080476a8e5f0415c370e8cd P cf2d8294ae68482ca4ffa8be051ad054: Time spent bootstrapping tablet: real 0.055s	user 0.019s	sys 0.003s
I20260709 12:14:52.693240 24482 raft_consensus.cc:359] T bfba40ac52f842ca99dd4293619360af P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:52.694231 24482 raft_consensus.cc:385] T bfba40ac52f842ca99dd4293619360af P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:52.694536 24482 raft_consensus.cc:740] T bfba40ac52f842ca99dd4293619360af P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:14:52.695385 24482 consensus_queue.cc:260] T bfba40ac52f842ca99dd4293619360af P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:52.696013 24479 tablet_bootstrap.cc:492] T f9094185a2ad43d0b3a5174b165dab65 P ad362df39b114ec3a3a419128097b362: No bootstrap required, opened a new log
I20260709 12:14:52.698583 24481 ts_tablet_manager.cc:1434] T b1e1c3b597fd49b2831e5f523149b2dc P aa14caefbdaa47b09abf91881635ba96: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.002s
I20260709 12:14:52.698918 24479 ts_tablet_manager.cc:1403] T f9094185a2ad43d0b3a5174b165dab65 P ad362df39b114ec3a3a419128097b362: Time spent bootstrapping tablet: real 0.070s	user 0.016s	sys 0.020s
I20260709 12:14:52.700204 24847 raft_consensus.cc:2804] T d92a635ff6404268bd5e51d3b9681551 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:52.698329 24482 ts_tablet_manager.cc:1434] T bfba40ac52f842ca99dd4293619360af P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:14:52.701651 24482 tablet_bootstrap.cc:492] T f841b9f0e82748d399b5eef243c442fc P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:14:52.700909 24847 raft_consensus.cc:697] T d92a635ff6404268bd5e51d3b9681551 P ad362df39b114ec3a3a419128097b362 [term 1 LEADER]: Becoming Leader. State: Replica: ad362df39b114ec3a3a419128097b362, State: Running, Role: LEADER
I20260709 12:14:52.702653 24847 consensus_queue.cc:237] T d92a635ff6404268bd5e51d3b9681551 P ad362df39b114ec3a3a419128097b362 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:52.703819 24481 tablet_bootstrap.cc:492] T b98a35cf96ba4562b4933543b1e4efb9 P aa14caefbdaa47b09abf91881635ba96: Bootstrap starting.
I20260709 12:14:52.705150 24209 raft_consensus.cc:2468] T d92a635ff6404268bd5e51d3b9681551 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 1.
I20260709 12:14:52.709106 24482 tablet_bootstrap.cc:654] T f841b9f0e82748d399b5eef243c442fc P 9bf3da5b54ef4a1ea1cee60f02ea2883: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:52.697379 24478 raft_consensus.cc:359] T 49b141610080476a8e5f0415c370e8cd P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:52.710410 24481 tablet_bootstrap.cc:654] T b98a35cf96ba4562b4933543b1e4efb9 P aa14caefbdaa47b09abf91881635ba96: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:52.711107 24479 raft_consensus.cc:359] T f9094185a2ad43d0b3a5174b165dab65 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:52.711905 24479 raft_consensus.cc:385] T f9094185a2ad43d0b3a5174b165dab65 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:52.712222 24479 raft_consensus.cc:740] T f9094185a2ad43d0b3a5174b165dab65 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad362df39b114ec3a3a419128097b362, State: Initialized, Role: FOLLOWER
I20260709 12:14:52.712961 24479 consensus_queue.cc:260] T f9094185a2ad43d0b3a5174b165dab65 P ad362df39b114ec3a3a419128097b362 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:52.715451 24479 ts_tablet_manager.cc:1434] T f9094185a2ad43d0b3a5174b165dab65 P ad362df39b114ec3a3a419128097b362: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 12:14:52.716614 24479 tablet_bootstrap.cc:492] T 2c00f77150f7475c94c4fd29c90805cd P ad362df39b114ec3a3a419128097b362: Bootstrap starting.
I20260709 12:14:52.711922 24478 raft_consensus.cc:385] T 49b141610080476a8e5f0415c370e8cd P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:52.718261 24478 raft_consensus.cc:740] T 49b141610080476a8e5f0415c370e8cd P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Initialized, Role: FOLLOWER
I20260709 12:14:52.719026 24478 consensus_queue.cc:260] T 49b141610080476a8e5f0415c370e8cd P cf2d8294ae68482ca4ffa8be051ad054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:52.721429 24478 ts_tablet_manager.cc:1434] T 49b141610080476a8e5f0415c370e8cd P cf2d8294ae68482ca4ffa8be051ad054: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.000s
I20260709 12:14:52.732730 24481 tablet_bootstrap.cc:492] T b98a35cf96ba4562b4933543b1e4efb9 P aa14caefbdaa47b09abf91881635ba96: No bootstrap required, opened a new log
I20260709 12:14:52.733315 24481 ts_tablet_manager.cc:1403] T b98a35cf96ba4562b4933543b1e4efb9 P aa14caefbdaa47b09abf91881635ba96: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.004s
I20260709 12:14:52.736063 24481 raft_consensus.cc:359] T b98a35cf96ba4562b4933543b1e4efb9 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:52.736593 24481 raft_consensus.cc:385] T b98a35cf96ba4562b4933543b1e4efb9 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:52.738040 24478 tablet_bootstrap.cc:492] T f841b9f0e82748d399b5eef243c442fc P cf2d8294ae68482ca4ffa8be051ad054: Bootstrap starting.
I20260709 12:14:52.738072 24481 raft_consensus.cc:740] T b98a35cf96ba4562b4933543b1e4efb9 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Initialized, Role: FOLLOWER
I20260709 12:14:52.739313 24481 consensus_queue.cc:260] T b98a35cf96ba4562b4933543b1e4efb9 P aa14caefbdaa47b09abf91881635ba96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:52.741593 24481 ts_tablet_manager.cc:1434] T b98a35cf96ba4562b4933543b1e4efb9 P aa14caefbdaa47b09abf91881635ba96: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.005s
I20260709 12:14:52.742630 24481 tablet_bootstrap.cc:492] T 7d67db0aeb6e4afb953c96511f9863d1 P aa14caefbdaa47b09abf91881635ba96: Bootstrap starting.
I20260709 12:14:52.749034 24481 tablet_bootstrap.cc:654] T 7d67db0aeb6e4afb953c96511f9863d1 P aa14caefbdaa47b09abf91881635ba96: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:52.763855 24479 tablet_bootstrap.cc:654] T 2c00f77150f7475c94c4fd29c90805cd P ad362df39b114ec3a3a419128097b362: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:52.764394 24482 tablet_bootstrap.cc:492] T f841b9f0e82748d399b5eef243c442fc P 9bf3da5b54ef4a1ea1cee60f02ea2883: No bootstrap required, opened a new log
I20260709 12:14:52.765026 24482 ts_tablet_manager.cc:1403] T f841b9f0e82748d399b5eef243c442fc P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.064s	user 0.012s	sys 0.000s
I20260709 12:14:52.772625 24481 tablet_bootstrap.cc:492] T 7d67db0aeb6e4afb953c96511f9863d1 P aa14caefbdaa47b09abf91881635ba96: No bootstrap required, opened a new log
I20260709 12:14:52.773334 24481 ts_tablet_manager.cc:1403] T 7d67db0aeb6e4afb953c96511f9863d1 P aa14caefbdaa47b09abf91881635ba96: Time spent bootstrapping tablet: real 0.031s	user 0.007s	sys 0.013s
I20260709 12:14:52.776427 24107 catalog_manager.cc:5697] T d92a635ff6404268bd5e51d3b9681551 P ad362df39b114ec3a3a419128097b362 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad362df39b114ec3a3a419128097b362 (127.12.56.196). New cstate: current_term: 1 leader_uuid: "ad362df39b114ec3a3a419128097b362" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:52.782804 24478 tablet_bootstrap.cc:654] T f841b9f0e82748d399b5eef243c442fc P cf2d8294ae68482ca4ffa8be051ad054: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:52.787235 24482 raft_consensus.cc:359] T f841b9f0e82748d399b5eef243c442fc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:52.788329 24482 raft_consensus.cc:385] T f841b9f0e82748d399b5eef243c442fc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:52.788702 24482 raft_consensus.cc:740] T f841b9f0e82748d399b5eef243c442fc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:14:52.798928 24481 raft_consensus.cc:359] T 7d67db0aeb6e4afb953c96511f9863d1 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:52.800058 24481 raft_consensus.cc:385] T 7d67db0aeb6e4afb953c96511f9863d1 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:52.800370 24481 raft_consensus.cc:740] T 7d67db0aeb6e4afb953c96511f9863d1 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Initialized, Role: FOLLOWER
I20260709 12:14:52.801503 24481 consensus_queue.cc:260] T 7d67db0aeb6e4afb953c96511f9863d1 P aa14caefbdaa47b09abf91881635ba96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:52.803846 24481 ts_tablet_manager.cc:1434] T 7d67db0aeb6e4afb953c96511f9863d1 P aa14caefbdaa47b09abf91881635ba96: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.002s
I20260709 12:14:52.808856 24481 tablet_bootstrap.cc:492] T 8996365fa46548d49f3b3bafe14e9c83 P aa14caefbdaa47b09abf91881635ba96: Bootstrap starting.
I20260709 12:14:52.810293 24478 tablet_bootstrap.cc:492] T f841b9f0e82748d399b5eef243c442fc P cf2d8294ae68482ca4ffa8be051ad054: No bootstrap required, opened a new log
I20260709 12:14:52.810896 24478 ts_tablet_manager.cc:1403] T f841b9f0e82748d399b5eef243c442fc P cf2d8294ae68482ca4ffa8be051ad054: Time spent bootstrapping tablet: real 0.074s	user 0.012s	sys 0.019s
I20260709 12:14:52.812945 24862 consensus_queue.cc:1048] T b1e1c3b597fd49b2831e5f523149b2dc P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:52.816095 24481 tablet_bootstrap.cc:654] T 8996365fa46548d49f3b3bafe14e9c83 P aa14caefbdaa47b09abf91881635ba96: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:52.790040 24482 consensus_queue.cc:260] T f841b9f0e82748d399b5eef243c442fc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:52.816017 24478 raft_consensus.cc:359] T f841b9f0e82748d399b5eef243c442fc P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:52.822947 24482 ts_tablet_manager.cc:1434] T f841b9f0e82748d399b5eef243c442fc P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.058s	user 0.011s	sys 0.000s
I20260709 12:14:52.822968 24478 raft_consensus.cc:385] T f841b9f0e82748d399b5eef243c442fc P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:52.824916 24478 raft_consensus.cc:740] T f841b9f0e82748d399b5eef243c442fc P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Initialized, Role: FOLLOWER
I20260709 12:14:52.825796 24478 consensus_queue.cc:260] T f841b9f0e82748d399b5eef243c442fc P cf2d8294ae68482ca4ffa8be051ad054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:52.826669 24479 tablet_bootstrap.cc:492] T 2c00f77150f7475c94c4fd29c90805cd P ad362df39b114ec3a3a419128097b362: No bootstrap required, opened a new log
I20260709 12:14:52.827613 24479 ts_tablet_manager.cc:1403] T 2c00f77150f7475c94c4fd29c90805cd P ad362df39b114ec3a3a419128097b362: Time spent bootstrapping tablet: real 0.111s	user 0.012s	sys 0.001s
I20260709 12:14:52.824617 24482 tablet_bootstrap.cc:492] T 2c00f77150f7475c94c4fd29c90805cd P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:14:52.832350 24478 ts_tablet_manager.cc:1434] T f841b9f0e82748d399b5eef243c442fc P cf2d8294ae68482ca4ffa8be051ad054: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.001s
I20260709 12:14:52.833853 24478 tablet_bootstrap.cc:492] T 6d6c85f42e284b06b8d1e7cee59f3dbc P cf2d8294ae68482ca4ffa8be051ad054: Bootstrap starting.
I20260709 12:14:52.843076 24210 raft_consensus.cc:1275] T 4f756e6bcc20458b8748cd090cd3fce2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 3 FOLLOWER]: Refusing update from remote peer ad362df39b114ec3a3a419128097b362: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:14:52.848171 24860 raft_consensus.cc:493] T b1e1c3b597fd49b2831e5f523149b2dc P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:52.843384 24479 raft_consensus.cc:359] T 2c00f77150f7475c94c4fd29c90805cd P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:52.853216 24479 raft_consensus.cc:385] T 2c00f77150f7475c94c4fd29c90805cd P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:52.853276 24860 raft_consensus.cc:515] T b1e1c3b597fd49b2831e5f523149b2dc P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:52.845641 24847 consensus_queue.cc:1048] T 4f756e6bcc20458b8748cd090cd3fce2 P ad362df39b114ec3a3a419128097b362 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:14:52.860726 24860 leader_election.cc:290] T b1e1c3b597fd49b2831e5f523149b2dc P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:14:52.863085 24207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e1c3b597fd49b2831e5f523149b2dc" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
I20260709 12:14:52.853555 24479 raft_consensus.cc:740] T 2c00f77150f7475c94c4fd29c90805cd P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad362df39b114ec3a3a419128097b362, State: Initialized, Role: FOLLOWER
I20260709 12:14:52.865675 24479 consensus_queue.cc:260] T 2c00f77150f7475c94c4fd29c90805cd P ad362df39b114ec3a3a419128097b362 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:52.864886 24281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1e1c3b597fd49b2831e5f523149b2dc" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:52.869674 24479 ts_tablet_manager.cc:1434] T 2c00f77150f7475c94c4fd29c90805cd P ad362df39b114ec3a3a419128097b362: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.000s
I20260709 12:14:52.871245 24325 leader_election.cc:304] T b1e1c3b597fd49b2831e5f523149b2dc P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:14:52.872749 24860 raft_consensus.cc:2749] T b1e1c3b597fd49b2831e5f523149b2dc P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:52.877807 24847 raft_consensus.cc:493] T 2c00f77150f7475c94c4fd29c90805cd P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:52.878711 24847 raft_consensus.cc:515] T 2c00f77150f7475c94c4fd29c90805cd P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:52.883823 24356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c00f77150f7475c94c4fd29c90805cd" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:52.885505 24586 raft_consensus.cc:493] T 8996365fa46548d49f3b3bafe14e9c83 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:52.886240 24586 raft_consensus.cc:515] T 8996365fa46548d49f3b3bafe14e9c83 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:52.856670 24482 tablet_bootstrap.cc:654] T 2c00f77150f7475c94c4fd29c90805cd P 9bf3da5b54ef4a1ea1cee60f02ea2883: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:52.883864 24479 tablet_bootstrap.cc:492] T 0f0c432146014cf099d66c95cde2ea1d P ad362df39b114ec3a3a419128097b362: Bootstrap starting.
I20260709 12:14:52.889943 24586 leader_election.cc:290] T 8996365fa46548d49f3b3bafe14e9c83 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:52.890584 24209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8996365fa46548d49f3b3bafe14e9c83" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
I20260709 12:14:52.891426 24209 raft_consensus.cc:2468] T 8996365fa46548d49f3b3bafe14e9c83 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 0.
I20260709 12:14:52.899847 24396 leader_election.cc:304] T 8996365fa46548d49f3b3bafe14e9c83 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, ad362df39b114ec3a3a419128097b362; no voters: 
I20260709 12:14:52.901340 24845 raft_consensus.cc:2804] T 8996365fa46548d49f3b3bafe14e9c83 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:52.902307 24845 raft_consensus.cc:493] T 8996365fa46548d49f3b3bafe14e9c83 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:52.902673 24845 raft_consensus.cc:3060] T 8996365fa46548d49f3b3bafe14e9c83 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:14:52.907830 24398 leader_election.cc:343] T 2c00f77150f7475c94c4fd29c90805cd P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:52.909042 24479 tablet_bootstrap.cc:654] T 0f0c432146014cf099d66c95cde2ea1d P ad362df39b114ec3a3a419128097b362: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:52.909432 24356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8996365fa46548d49f3b3bafe14e9c83" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
W20260709 12:14:52.911381 24398 leader_election.cc:343] T 8996365fa46548d49f3b3bafe14e9c83 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:52.911695 24816 raft_consensus.cc:493] T bfba40ac52f842ca99dd4293619360af P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:52.912504 24816 raft_consensus.cc:515] T bfba40ac52f842ca99dd4293619360af P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:52.915751 24816 leader_election.cc:290] T bfba40ac52f842ca99dd4293619360af P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:14:52.925169 24482 tablet_bootstrap.cc:492] T 2c00f77150f7475c94c4fd29c90805cd P 9bf3da5b54ef4a1ea1cee60f02ea2883: No bootstrap required, opened a new log
I20260709 12:14:52.926044 24482 ts_tablet_manager.cc:1403] T 2c00f77150f7475c94c4fd29c90805cd P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.102s	user 0.012s	sys 0.004s
I20260709 12:14:52.926755 24478 tablet_bootstrap.cc:654] T 6d6c85f42e284b06b8d1e7cee59f3dbc P cf2d8294ae68482ca4ffa8be051ad054: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:52.947108 24356 raft_consensus.cc:3060] T b98a35cf96ba4562b4933543b1e4efb9 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:52.937731 24482 raft_consensus.cc:359] T 2c00f77150f7475c94c4fd29c90805cd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:52.950894 24482 raft_consensus.cc:385] T 2c00f77150f7475c94c4fd29c90805cd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:52.951519 24482 raft_consensus.cc:740] T 2c00f77150f7475c94c4fd29c90805cd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:14:52.952234 24482 consensus_queue.cc:260] T 2c00f77150f7475c94c4fd29c90805cd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:52.944849 24814 raft_consensus.cc:493] T 7d67db0aeb6e4afb953c96511f9863d1 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:52.939436 24207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfba40ac52f842ca99dd4293619360af" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
I20260709 12:14:52.961598 24482 ts_tablet_manager.cc:1434] T 2c00f77150f7475c94c4fd29c90805cd P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.035s	user 0.009s	sys 0.000s
I20260709 12:14:52.940405 24847 leader_election.cc:290] T 2c00f77150f7475c94c4fd29c90805cd P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:52.967903 24359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfba40ac52f842ca99dd4293619360af" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:52.966931 24208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c00f77150f7475c94c4fd29c90805cd" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
I20260709 12:14:52.970556 24208 raft_consensus.cc:2468] T 2c00f77150f7475c94c4fd29c90805cd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 0.
I20260709 12:14:52.962812 24814 raft_consensus.cc:515] T 7d67db0aeb6e4afb953c96511f9863d1 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:52.972328 24359 raft_consensus.cc:3060] T b1e1c3b597fd49b2831e5f523149b2dc P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:52.974433 24814 leader_election.cc:290] T 7d67db0aeb6e4afb953c96511f9863d1 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:14:52.979957 24482 tablet_bootstrap.cc:492] T 49b141610080476a8e5f0415c370e8cd P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:14:52.975979 24207 raft_consensus.cc:2468] T bfba40ac52f842ca99dd4293619360af P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 0.
I20260709 12:14:52.985245 24481 tablet_bootstrap.cc:492] T 8996365fa46548d49f3b3bafe14e9c83 P aa14caefbdaa47b09abf91881635ba96: No bootstrap required, opened a new log
I20260709 12:14:52.985934 24806 raft_consensus.cc:493] T f841b9f0e82748d399b5eef243c442fc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:52.986721 24806 raft_consensus.cc:515] T f841b9f0e82748d399b5eef243c442fc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:52.980976 24860 raft_consensus.cc:493] T d84ed08271a24f7fa134ae81a858c314 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:52.989265 24806 leader_election.cc:290] T f841b9f0e82748d399b5eef243c442fc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:14:52.989013 24860 raft_consensus.cc:515] T d84ed08271a24f7fa134ae81a858c314 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:52.992300 24248 leader_election.cc:304] T bfba40ac52f842ca99dd4293619360af P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054; no voters: 
I20260709 12:14:52.994298 24357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841b9f0e82748d399b5eef243c442fc" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:52.995226 24815 raft_consensus.cc:2804] T bfba40ac52f842ca99dd4293619360af P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:52.995748 24815 raft_consensus.cc:493] T bfba40ac52f842ca99dd4293619360af P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:52.996147 24815 raft_consensus.cc:3060] T bfba40ac52f842ca99dd4293619360af P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:52.997357 24284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841b9f0e82748d399b5eef243c442fc" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:52.998646 24284 raft_consensus.cc:2468] T f841b9f0e82748d399b5eef243c442fc P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 0.
I20260709 12:14:52.999042 24731 raft_consensus.cc:493] T 49b141610080476a8e5f0415c370e8cd P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:52.999720 24731 raft_consensus.cc:515] T 49b141610080476a8e5f0415c370e8cd P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
W20260709 12:14:53.001219 24175 leader_election.cc:343] T f841b9f0e82748d399b5eef243c442fc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:53.003136 24481 ts_tablet_manager.cc:1403] T 8996365fa46548d49f3b3bafe14e9c83 P aa14caefbdaa47b09abf91881635ba96: Time spent bootstrapping tablet: real 0.195s	user 0.018s	sys 0.043s
W20260709 12:14:53.003660 24250 leader_election.cc:343] T bfba40ac52f842ca99dd4293619360af P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:53.009931 24355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d67db0aeb6e4afb953c96511f9863d1" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:53.010818 24355 raft_consensus.cc:2468] T 7d67db0aeb6e4afb953c96511f9863d1 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 0.
I20260709 12:14:53.010918 24176 leader_election.cc:304] T f841b9f0e82748d399b5eef243c442fc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054; no voters: aa14caefbdaa47b09abf91881635ba96
I20260709 12:14:53.012349 24806 raft_consensus.cc:2804] T f841b9f0e82748d399b5eef243c442fc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:53.012907 24806 raft_consensus.cc:493] T f841b9f0e82748d399b5eef243c442fc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:53.013414 24806 raft_consensus.cc:3060] T f841b9f0e82748d399b5eef243c442fc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:53.022352 24731 leader_election.cc:290] T 49b141610080476a8e5f0415c370e8cd P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:53.025231 24396 leader_election.cc:304] T 2c00f77150f7475c94c4fd29c90805cd P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, ad362df39b114ec3a3a419128097b362; no voters: aa14caefbdaa47b09abf91881635ba96
I20260709 12:14:53.027441 24586 raft_consensus.cc:2804] T 2c00f77150f7475c94c4fd29c90805cd P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:53.027897 24586 raft_consensus.cc:493] T 2c00f77150f7475c94c4fd29c90805cd P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:53.028221 24586 raft_consensus.cc:3060] T 2c00f77150f7475c94c4fd29c90805cd P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:53.032856 24481 raft_consensus.cc:359] T 8996365fa46548d49f3b3bafe14e9c83 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:53.039832 24207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b141610080476a8e5f0415c370e8cd" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
I20260709 12:14:53.041836 24481 raft_consensus.cc:385] T 8996365fa46548d49f3b3bafe14e9c83 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:14:53.042054 24248 leader_election.cc:343] T 49b141610080476a8e5f0415c370e8cd P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:53.042358 24481 raft_consensus.cc:740] T 8996365fa46548d49f3b3bafe14e9c83 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Initialized, Role: FOLLOWER
I20260709 12:14:53.043260 24481 consensus_queue.cc:260] T 8996365fa46548d49f3b3bafe14e9c83 P aa14caefbdaa47b09abf91881635ba96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:53.049746 24586 raft_consensus.cc:515] T 2c00f77150f7475c94c4fd29c90805cd P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:53.091892 24586 leader_election.cc:290] T 2c00f77150f7475c94c4fd29c90805cd P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 election: Requested vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:53.092890 24586 raft_consensus.cc:493] T f9094185a2ad43d0b3a5174b165dab65 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.093523 24586 raft_consensus.cc:515] T f9094185a2ad43d0b3a5174b165dab65 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:53.102255 24586 leader_election.cc:290] T f9094185a2ad43d0b3a5174b165dab65 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:14:53.057056 24815 raft_consensus.cc:515] T bfba40ac52f842ca99dd4293619360af P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:53.083674 24845 raft_consensus.cc:515] T 8996365fa46548d49f3b3bafe14e9c83 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
W20260709 12:14:53.110364 24325 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:34565, user_credentials={real_user=slave}} blocked reactor thread for 99631.1us
I20260709 12:14:53.122910 24481 ts_tablet_manager.cc:1434] T 8996365fa46548d49f3b3bafe14e9c83 P aa14caefbdaa47b09abf91881635ba96: Time spent starting tablet: real 0.119s	user 0.009s	sys 0.002s
I20260709 12:14:53.134859 24481 tablet_bootstrap.cc:492] T bfba40ac52f842ca99dd4293619360af P aa14caefbdaa47b09abf91881635ba96: Bootstrap starting.
I20260709 12:14:53.145691 24430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b141610080476a8e5f0415c370e8cd" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:53.146531 24430 raft_consensus.cc:2468] T 49b141610080476a8e5f0415c370e8cd P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 0.
I20260709 12:14:53.150794 24284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84ed08271a24f7fa134ae81a858c314" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:53.151028 24428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d67db0aeb6e4afb953c96511f9863d1" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:53.151789 24428 raft_consensus.cc:2468] T 7d67db0aeb6e4afb953c96511f9863d1 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 0.
I20260709 12:14:53.152431 24482 tablet_bootstrap.cc:654] T 49b141610080476a8e5f0415c370e8cd P 9bf3da5b54ef4a1ea1cee60f02ea2883: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:53.141309 24281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9094185a2ad43d0b3a5174b165dab65" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:53.158922 24478 tablet_bootstrap.cc:492] T 6d6c85f42e284b06b8d1e7cee59f3dbc P cf2d8294ae68482ca4ffa8be051ad054: No bootstrap required, opened a new log
I20260709 12:14:53.159584 24478 ts_tablet_manager.cc:1403] T 6d6c85f42e284b06b8d1e7cee59f3dbc P cf2d8294ae68482ca4ffa8be051ad054: Time spent bootstrapping tablet: real 0.326s	user 0.053s	sys 0.059s
I20260709 12:14:53.181162 24845 leader_election.cc:290] T 8996365fa46548d49f3b3bafe14e9c83 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 election: Requested vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:53.184900 24815 leader_election.cc:290] T bfba40ac52f842ca99dd4293619360af P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 election: Requested vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:14:53.163486 24860 leader_election.cc:290] T d84ed08271a24f7fa134ae81a858c314 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:14:53.139714 24250 leader_election.cc:304] T 7d67db0aeb6e4afb953c96511f9863d1 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, cf2d8294ae68482ca4ffa8be051ad054; no voters: 
W20260709 12:14:53.188272 24399 leader_election.cc:343] T f9094185a2ad43d0b3a5174b165dab65 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:53.189762 24479 tablet_bootstrap.cc:492] T 0f0c432146014cf099d66c95cde2ea1d P ad362df39b114ec3a3a419128097b362: No bootstrap required, opened a new log
I20260709 12:14:53.190390 24479 ts_tablet_manager.cc:1403] T 0f0c432146014cf099d66c95cde2ea1d P ad362df39b114ec3a3a419128097b362: Time spent bootstrapping tablet: real 0.307s	user 0.015s	sys 0.006s
I20260709 12:14:53.200227 24207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfba40ac52f842ca99dd4293619360af" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
I20260709 12:14:53.200964 24207 raft_consensus.cc:3060] T bfba40ac52f842ca99dd4293619360af P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:14:53.191632 24250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:46845, user_credentials={real_user=slave}} blocked reactor thread for 57962.5us
I20260709 12:14:53.211036 24357 raft_consensus.cc:3060] T d84ed08271a24f7fa134ae81a858c314 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:53.211308 24355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfba40ac52f842ca99dd4293619360af" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
I20260709 12:14:53.211895 24249 leader_election.cc:304] T 49b141610080476a8e5f0415c370e8cd P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad362df39b114ec3a3a419128097b362, cf2d8294ae68482ca4ffa8be051ad054; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883
I20260709 12:14:53.214150 24816 raft_consensus.cc:2804] T 49b141610080476a8e5f0415c370e8cd P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:53.214581 24816 raft_consensus.cc:493] T 49b141610080476a8e5f0415c370e8cd P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:53.214922 24816 raft_consensus.cc:3060] T 49b141610080476a8e5f0415c370e8cd P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:53.195521 24814 raft_consensus.cc:2804] T 7d67db0aeb6e4afb953c96511f9863d1 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:53.216259 24814 raft_consensus.cc:493] T 7d67db0aeb6e4afb953c96511f9863d1 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:53.216598 24814 raft_consensus.cc:3060] T 7d67db0aeb6e4afb953c96511f9863d1 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:53.221539 24479 raft_consensus.cc:359] T 0f0c432146014cf099d66c95cde2ea1d P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:53.223145 24479 raft_consensus.cc:385] T 0f0c432146014cf099d66c95cde2ea1d P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:53.223804 24479 raft_consensus.cc:740] T 0f0c432146014cf099d66c95cde2ea1d P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad362df39b114ec3a3a419128097b362, State: Initialized, Role: FOLLOWER
I20260709 12:14:53.224645 24479 consensus_queue.cc:260] T 0f0c432146014cf099d66c95cde2ea1d P ad362df39b114ec3a3a419128097b362 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:53.226928 24479 ts_tablet_manager.cc:1434] T 0f0c432146014cf099d66c95cde2ea1d P ad362df39b114ec3a3a419128097b362: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 12:14:53.209040 24815 consensus_queue.cc:1048] T b1e1c3b597fd49b2831e5f523149b2dc P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
W20260709 12:14:53.231613 24250 leader_election.cc:343] T bfba40ac52f842ca99dd4293619360af P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:53.165737 24806 raft_consensus.cc:515] T f841b9f0e82748d399b5eef243c442fc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:53.237741 24806 leader_election.cc:290] T f841b9f0e82748d399b5eef243c442fc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 election: Requested vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:14:53.238664 24281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841b9f0e82748d399b5eef243c442fc" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054"
I20260709 12:14:53.223171 24478 raft_consensus.cc:359] T 6d6c85f42e284b06b8d1e7cee59f3dbc P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:53.239652 24281 raft_consensus.cc:3060] T f841b9f0e82748d399b5eef243c442fc P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:53.239835 24478 raft_consensus.cc:385] T 6d6c85f42e284b06b8d1e7cee59f3dbc P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:53.240520 24478 raft_consensus.cc:740] T 6d6c85f42e284b06b8d1e7cee59f3dbc P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Initialized, Role: FOLLOWER
I20260709 12:14:53.241703 24478 consensus_queue.cc:260] T 6d6c85f42e284b06b8d1e7cee59f3dbc P cf2d8294ae68482ca4ffa8be051ad054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:53.244361 24478 ts_tablet_manager.cc:1434] T 6d6c85f42e284b06b8d1e7cee59f3dbc P cf2d8294ae68482ca4ffa8be051ad054: Time spent starting tablet: real 0.084s	user 0.008s	sys 0.000s
I20260709 12:14:53.253877 24359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841b9f0e82748d399b5eef243c442fc" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
W20260709 12:14:53.277041 24175 leader_election.cc:343] T f841b9f0e82748d399b5eef243c442fc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:53.280019 24479 tablet_bootstrap.cc:492] T 6d6c85f42e284b06b8d1e7cee59f3dbc P ad362df39b114ec3a3a419128097b362: Bootstrap starting.
I20260709 12:14:53.292475 24478 tablet_bootstrap.cc:492] T f9094185a2ad43d0b3a5174b165dab65 P cf2d8294ae68482ca4ffa8be051ad054: Bootstrap starting.
I20260709 12:14:53.319768 24358 raft_consensus.cc:1275] T 4f756e6bcc20458b8748cd090cd3fce2 P aa14caefbdaa47b09abf91881635ba96 [term 3 FOLLOWER]: Refusing update from remote peer ad362df39b114ec3a3a419128097b362: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:14:53.338796 24358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c00f77150f7475c94c4fd29c90805cd" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
I20260709 12:14:53.342386 24481 tablet_bootstrap.cc:654] T bfba40ac52f842ca99dd4293619360af P aa14caefbdaa47b09abf91881635ba96: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:53.342685 24353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8996365fa46548d49f3b3bafe14e9c83" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
I20260709 12:14:53.344074 24353 raft_consensus.cc:3060] T 8996365fa46548d49f3b3bafe14e9c83 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:53.352159 24281 raft_consensus.cc:2468] T f841b9f0e82748d399b5eef243c442fc P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 1.
I20260709 12:14:53.355360 24208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c00f77150f7475c94c4fd29c90805cd" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
I20260709 12:14:53.356151 24208 raft_consensus.cc:3060] T 2c00f77150f7475c94c4fd29c90805cd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:14:53.359053 24398 leader_election.cc:343] T 2c00f77150f7475c94c4fd29c90805cd P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:53.359635 24816 raft_consensus.cc:515] T 49b141610080476a8e5f0415c370e8cd P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:53.360252 24751 consensus_queue.cc:1048] T 4f756e6bcc20458b8748cd090cd3fce2 P ad362df39b114ec3a3a419128097b362 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:53.365185 24207 raft_consensus.cc:2468] T bfba40ac52f842ca99dd4293619360af P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 1.
I20260709 12:14:53.366758 24433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84ed08271a24f7fa134ae81a858c314" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:53.367965 24248 leader_election.cc:304] T bfba40ac52f842ca99dd4293619360af P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054; no voters: aa14caefbdaa47b09abf91881635ba96
I20260709 12:14:53.369329 24815 raft_consensus.cc:2804] T bfba40ac52f842ca99dd4293619360af P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:53.369882 24815 raft_consensus.cc:697] T bfba40ac52f842ca99dd4293619360af P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Becoming Leader. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Running, Role: LEADER
I20260709 12:14:53.370764 24815 consensus_queue.cc:237] T bfba40ac52f842ca99dd4293619360af P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:53.371001 24323 leader_election.cc:304] T d84ed08271a24f7fa134ae81a858c314 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96; no voters: ad362df39b114ec3a3a419128097b362, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:14:53.380098 24814 raft_consensus.cc:515] T 7d67db0aeb6e4afb953c96511f9863d1 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:53.398144 24207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9094185a2ad43d0b3a5174b165dab65" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
I20260709 12:14:53.402263 24816 leader_election.cc:290] T 49b141610080476a8e5f0415c370e8cd P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 election: Requested vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:53.402118 24210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8996365fa46548d49f3b3bafe14e9c83" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
I20260709 12:14:53.403385 24210 raft_consensus.cc:3060] T 8996365fa46548d49f3b3bafe14e9c83 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:53.403851 24814 leader_election.cc:290] T 7d67db0aeb6e4afb953c96511f9863d1 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 election: Requested vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:14:53.405542 24352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d67db0aeb6e4afb953c96511f9863d1" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
I20260709 12:14:53.406433 24352 raft_consensus.cc:3060] T 7d67db0aeb6e4afb953c96511f9863d1 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:53.407716 24427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d67db0aeb6e4afb953c96511f9863d1" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362"
I20260709 12:14:53.408393 24427 raft_consensus.cc:3060] T 7d67db0aeb6e4afb953c96511f9863d1 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:53.410225 24429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b141610080476a8e5f0415c370e8cd" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362"
I20260709 12:14:53.410946 24429 raft_consensus.cc:3060] T 49b141610080476a8e5f0415c370e8cd P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:53.412956 24478 tablet_bootstrap.cc:654] T f9094185a2ad43d0b3a5174b165dab65 P cf2d8294ae68482ca4ffa8be051ad054: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:53.426057 24479 tablet_bootstrap.cc:654] T 6d6c85f42e284b06b8d1e7cee59f3dbc P ad362df39b114ec3a3a419128097b362: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:53.427278 24482 tablet_bootstrap.cc:492] T 49b141610080476a8e5f0415c370e8cd P 9bf3da5b54ef4a1ea1cee60f02ea2883: No bootstrap required, opened a new log
I20260709 12:14:53.427870 24482 ts_tablet_manager.cc:1403] T 49b141610080476a8e5f0415c370e8cd P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.448s	user 0.029s	sys 0.026s
I20260709 12:14:53.429605 24209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b141610080476a8e5f0415c370e8cd" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
I20260709 12:14:53.430823 24482 raft_consensus.cc:359] T 49b141610080476a8e5f0415c370e8cd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:53.431624 24482 raft_consensus.cc:385] T 49b141610080476a8e5f0415c370e8cd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:53.431893 24482 raft_consensus.cc:740] T 49b141610080476a8e5f0415c370e8cd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:14:53.432541 24482 consensus_queue.cc:260] T 49b141610080476a8e5f0415c370e8cd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:53.435627 24482 ts_tablet_manager.cc:1434] T 49b141610080476a8e5f0415c370e8cd P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:14:53.436755 24482 tablet_bootstrap.cc:492] T 558ced611e584b32ab838cceeb7cb410 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:14:53.442289 24429 raft_consensus.cc:2468] T 49b141610080476a8e5f0415c370e8cd P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 1.
I20260709 12:14:53.443671 24249 leader_election.cc:304] T 49b141610080476a8e5f0415c370e8cd P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad362df39b114ec3a3a419128097b362, cf2d8294ae68482ca4ffa8be051ad054; no voters: 
I20260709 12:14:53.444729 24814 raft_consensus.cc:2804] T 49b141610080476a8e5f0415c370e8cd P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:53.445243 24814 raft_consensus.cc:697] T 49b141610080476a8e5f0415c370e8cd P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Becoming Leader. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Running, Role: LEADER
I20260709 12:14:53.446135 24814 consensus_queue.cc:237] T 49b141610080476a8e5f0415c370e8cd P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
W20260709 12:14:53.447154 24248 leader_election.cc:343] T 49b141610080476a8e5f0415c370e8cd P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:53.460853 24210 raft_consensus.cc:2468] T 8996365fa46548d49f3b3bafe14e9c83 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 1.
I20260709 12:14:53.461704 24352 raft_consensus.cc:2468] T 7d67db0aeb6e4afb953c96511f9863d1 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 1.
I20260709 12:14:53.463105 24250 leader_election.cc:304] T 7d67db0aeb6e4afb953c96511f9863d1 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, cf2d8294ae68482ca4ffa8be051ad054; no voters: 
I20260709 12:14:53.467031 24482 tablet_bootstrap.cc:654] T 558ced611e584b32ab838cceeb7cb410 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:53.478163 24208 raft_consensus.cc:2468] T 2c00f77150f7475c94c4fd29c90805cd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 1.
I20260709 12:14:53.473711 24904 raft_consensus.cc:493] T b98a35cf96ba4562b4933543b1e4efb9 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:14:53.478981 24816 raft_consensus.cc:2804] T 7d67db0aeb6e4afb953c96511f9863d1 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:53.505718 24482 tablet_bootstrap.cc:492] T 558ced611e584b32ab838cceeb7cb410 P 9bf3da5b54ef4a1ea1cee60f02ea2883: No bootstrap required, opened a new log
I20260709 12:14:53.507853 24482 ts_tablet_manager.cc:1403] T 558ced611e584b32ab838cceeb7cb410 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.071s	user 0.014s	sys 0.000s
I20260709 12:14:53.478615 24427 raft_consensus.cc:2468] T 7d67db0aeb6e4afb953c96511f9863d1 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 1.
I20260709 12:14:53.545182 24481 tablet_bootstrap.cc:492] T bfba40ac52f842ca99dd4293619360af P aa14caefbdaa47b09abf91881635ba96: No bootstrap required, opened a new log
I20260709 12:14:53.546166 24481 ts_tablet_manager.cc:1403] T bfba40ac52f842ca99dd4293619360af P aa14caefbdaa47b09abf91881635ba96: Time spent bootstrapping tablet: real 0.418s	user 0.018s	sys 0.008s
I20260709 12:14:53.532716 24860 raft_consensus.cc:2749] T d84ed08271a24f7fa134ae81a858c314 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:53.514173 24353 raft_consensus.cc:2468] T 8996365fa46548d49f3b3bafe14e9c83 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 1.
I20260709 12:14:53.507151 24904 raft_consensus.cc:515] T b98a35cf96ba4562b4933543b1e4efb9 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:53.570783 24479 tablet_bootstrap.cc:492] T 6d6c85f42e284b06b8d1e7cee59f3dbc P ad362df39b114ec3a3a419128097b362: No bootstrap required, opened a new log
I20260709 12:14:53.571406 24479 ts_tablet_manager.cc:1403] T 6d6c85f42e284b06b8d1e7cee59f3dbc P ad362df39b114ec3a3a419128097b362: Time spent bootstrapping tablet: real 0.305s	user 0.019s	sys 0.009s
I20260709 12:14:53.558132 24816 raft_consensus.cc:697] T 7d67db0aeb6e4afb953c96511f9863d1 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Becoming Leader. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Running, Role: LEADER
W20260709 12:14:53.579160 24155 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:53.587522 24478 tablet_bootstrap.cc:492] T f9094185a2ad43d0b3a5174b165dab65 P cf2d8294ae68482ca4ffa8be051ad054: No bootstrap required, opened a new log
I20260709 12:14:53.588162 24478 ts_tablet_manager.cc:1403] T f9094185a2ad43d0b3a5174b165dab65 P cf2d8294ae68482ca4ffa8be051ad054: Time spent bootstrapping tablet: real 0.300s	user 0.016s	sys 0.009s
I20260709 12:14:53.590834 24482 raft_consensus.cc:359] T 558ced611e584b32ab838cceeb7cb410 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:53.591697 24482 raft_consensus.cc:385] T 558ced611e584b32ab838cceeb7cb410 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:53.592010 24482 raft_consensus.cc:740] T 558ced611e584b32ab838cceeb7cb410 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:14:53.592806 24904 leader_election.cc:290] T b98a35cf96ba4562b4933543b1e4efb9 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:14:53.592747 24482 consensus_queue.cc:260] T 558ced611e584b32ab838cceeb7cb410 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:53.595995 24398 leader_election.cc:304] T 8996365fa46548d49f3b3bafe14e9c83 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, ad362df39b114ec3a3a419128097b362; no voters: 
I20260709 12:14:53.579468 24909 consensus_queue.cc:1048] T d92a635ff6404268bd5e51d3b9681551 P ad362df39b114ec3a3a419128097b362 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
W20260709 12:14:53.572872 24396 leader_election.cc:343] T f9094185a2ad43d0b3a5174b165dab65 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:53.602682 24210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b98a35cf96ba4562b4933543b1e4efb9" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
I20260709 12:14:53.601581 24479 raft_consensus.cc:359] T 6d6c85f42e284b06b8d1e7cee59f3dbc P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:53.624684 24479 raft_consensus.cc:385] T 6d6c85f42e284b06b8d1e7cee59f3dbc P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:53.625097 24479 raft_consensus.cc:740] T 6d6c85f42e284b06b8d1e7cee59f3dbc P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad362df39b114ec3a3a419128097b362, State: Initialized, Role: FOLLOWER
I20260709 12:14:53.626688 24479 consensus_queue.cc:260] T 6d6c85f42e284b06b8d1e7cee59f3dbc P ad362df39b114ec3a3a419128097b362 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:53.626902 24103 catalog_manager.cc:5697] T bfba40ac52f842ca99dd4293619360af P cf2d8294ae68482ca4ffa8be051ad054 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194). New cstate: current_term: 1 leader_uuid: "cf2d8294ae68482ca4ffa8be051ad054" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:53.631260 24478 raft_consensus.cc:359] T f9094185a2ad43d0b3a5174b165dab65 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:53.632174 24478 raft_consensus.cc:385] T f9094185a2ad43d0b3a5174b165dab65 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:53.632536 24478 raft_consensus.cc:740] T f9094185a2ad43d0b3a5174b165dab65 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Initialized, Role: FOLLOWER
I20260709 12:14:53.633283 24478 consensus_queue.cc:260] T f9094185a2ad43d0b3a5174b165dab65 P cf2d8294ae68482ca4ffa8be051ad054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:53.636884 24479 ts_tablet_manager.cc:1434] T 6d6c85f42e284b06b8d1e7cee59f3dbc P ad362df39b114ec3a3a419128097b362: Time spent starting tablet: real 0.065s	user 0.004s	sys 0.004s
I20260709 12:14:53.637807 24751 raft_consensus.cc:2804] T 8996365fa46548d49f3b3bafe14e9c83 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:53.638398 24751 raft_consensus.cc:697] T 8996365fa46548d49f3b3bafe14e9c83 P ad362df39b114ec3a3a419128097b362 [term 1 LEADER]: Becoming Leader. State: Replica: ad362df39b114ec3a3a419128097b362, State: Running, Role: LEADER
I20260709 12:14:53.639218 24751 consensus_queue.cc:237] T 8996365fa46548d49f3b3bafe14e9c83 P ad362df39b114ec3a3a419128097b362 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:53.637984 24479 tablet_bootstrap.cc:492] T 9219abaaa2c34b08a24191512ff742bc P ad362df39b114ec3a3a419128097b362: Bootstrap starting.
W20260709 12:14:53.646986 24175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:46845, user_credentials={real_user=slave}} blocked reactor thread for 43778.4us
I20260709 12:14:53.653748 24478 ts_tablet_manager.cc:1434] T f9094185a2ad43d0b3a5174b165dab65 P cf2d8294ae68482ca4ffa8be051ad054: Time spent starting tablet: real 0.065s	user 0.008s	sys 0.000s
I20260709 12:14:53.654057 24903 raft_consensus.cc:493] T 6d6c85f42e284b06b8d1e7cee59f3dbc P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.654707 24903 raft_consensus.cc:515] T 6d6c85f42e284b06b8d1e7cee59f3dbc P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:53.655151 24478 tablet_bootstrap.cc:492] T 558ced611e584b32ab838cceeb7cb410 P cf2d8294ae68482ca4ffa8be051ad054: Bootstrap starting.
I20260709 12:14:53.657070 24903 leader_election.cc:290] T 6d6c85f42e284b06b8d1e7cee59f3dbc P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:14:53.634752 24396 leader_election.cc:304] T f9094185a2ad43d0b3a5174b165dab65 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad362df39b114ec3a3a419128097b362; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:14:53.661443 24427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c85f42e284b06b8d1e7cee59f3dbc" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:53.663272 24427 raft_consensus.cc:2468] T 6d6c85f42e284b06b8d1e7cee59f3dbc P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 0.
I20260709 12:14:53.664024 24905 raft_consensus.cc:2749] T f9094185a2ad43d0b3a5174b165dab65 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:14:53.663272 24396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:38787, user_credentials={real_user=slave}} blocked reactor thread for 92916.7us
I20260709 12:14:53.667079 24847 consensus_queue.cc:1048] T d92a635ff6404268bd5e51d3b9681551 P ad362df39b114ec3a3a419128097b362 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:53.647830 24816 consensus_queue.cc:237] T 7d67db0aeb6e4afb953c96511f9863d1 P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
W20260709 12:14:53.641002 24398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:46845, user_credentials={real_user=slave}} blocked reactor thread for 45121.2us
I20260709 12:14:53.672657 24482 ts_tablet_manager.cc:1434] T 558ced611e584b32ab838cceeb7cb410 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.164s	user 0.006s	sys 0.003s
I20260709 12:14:53.685616 24482 tablet_bootstrap.cc:492] T f9094185a2ad43d0b3a5174b165dab65 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:14:53.685640 24481 raft_consensus.cc:359] T bfba40ac52f842ca99dd4293619360af P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:53.692476 24481 raft_consensus.cc:385] T bfba40ac52f842ca99dd4293619360af P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:53.692945 24481 raft_consensus.cc:740] T bfba40ac52f842ca99dd4293619360af P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Initialized, Role: FOLLOWER
I20260709 12:14:53.694099 24481 consensus_queue.cc:260] T bfba40ac52f842ca99dd4293619360af P aa14caefbdaa47b09abf91881635ba96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:53.671299 24357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c85f42e284b06b8d1e7cee59f3dbc" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:53.704355 24478 tablet_bootstrap.cc:654] T 558ced611e584b32ab838cceeb7cb410 P cf2d8294ae68482ca4ffa8be051ad054: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:53.634466 24176 leader_election.cc:304] T f841b9f0e82748d399b5eef243c442fc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054; no voters: aa14caefbdaa47b09abf91881635ba96
I20260709 12:14:53.706184 24481 ts_tablet_manager.cc:1434] T bfba40ac52f842ca99dd4293619360af P aa14caefbdaa47b09abf91881635ba96: Time spent starting tablet: real 0.160s	user 0.010s	sys 0.000s
I20260709 12:14:53.711621 24932 raft_consensus.cc:493] T 06d0284e94354a2686c577372cceb2bc P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.712323 24932 raft_consensus.cc:515] T 06d0284e94354a2686c577372cceb2bc P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:53.712785 24481 tablet_bootstrap.cc:492] T f841b9f0e82748d399b5eef243c442fc P aa14caefbdaa47b09abf91881635ba96: Bootstrap starting.
I20260709 12:14:53.714890 24932 leader_election.cc:290] T 06d0284e94354a2686c577372cceb2bc P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:53.715592 24808 raft_consensus.cc:2804] T f841b9f0e82748d399b5eef243c442fc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:53.716251 24808 raft_consensus.cc:697] T f841b9f0e82748d399b5eef243c442fc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 LEADER]: Becoming Leader. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Running, Role: LEADER
I20260709 12:14:53.671921 24396 leader_election.cc:304] T 2c00f77150f7475c94c4fd29c90805cd P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, ad362df39b114ec3a3a419128097b362; no voters: aa14caefbdaa47b09abf91881635ba96
W20260709 12:14:53.712354 24176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:34565, user_credentials={real_user=slave}} blocked reactor thread for 88527us
I20260709 12:14:53.718592 24847 raft_consensus.cc:2804] T 2c00f77150f7475c94c4fd29c90805cd P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:53.718664 24284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b98a35cf96ba4562b4933543b1e4efb9" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:53.719247 24847 raft_consensus.cc:697] T 2c00f77150f7475c94c4fd29c90805cd P ad362df39b114ec3a3a419128097b362 [term 1 LEADER]: Becoming Leader. State: Replica: ad362df39b114ec3a3a419128097b362, State: Running, Role: LEADER
I20260709 12:14:53.720441 24847 consensus_queue.cc:237] T 2c00f77150f7475c94c4fd29c90805cd P ad362df39b114ec3a3a419128097b362 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:53.715662 24249 leader_election.cc:304] T 6d6c85f42e284b06b8d1e7cee59f3dbc P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad362df39b114ec3a3a419128097b362, cf2d8294ae68482ca4ffa8be051ad054; no voters: 
I20260709 12:14:53.723518 24481 tablet_bootstrap.cc:654] T f841b9f0e82748d399b5eef243c442fc P aa14caefbdaa47b09abf91881635ba96: Neither blocks nor log segments found. Creating new log.
W20260709 12:14:53.724140 24396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:38787, user_credentials={real_user=slave}} blocked reactor thread for 54376.8us
I20260709 12:14:53.725637 24325 leader_election.cc:304] T b98a35cf96ba4562b4933543b1e4efb9 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:14:53.758286 24207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d0284e94354a2686c577372cceb2bc" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
I20260709 12:14:53.759094 24207 raft_consensus.cc:2468] T 06d0284e94354a2686c577372cceb2bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 1.
I20260709 12:14:53.762229 24482 tablet_bootstrap.cc:654] T f9094185a2ad43d0b3a5174b165dab65 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:53.763163 24248 leader_election.cc:304] T 06d0284e94354a2686c577372cceb2bc P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054; no voters: 
I20260709 12:14:53.764007 24815 raft_consensus.cc:2804] T 06d0284e94354a2686c577372cceb2bc P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:53.764447 24815 raft_consensus.cc:493] T 06d0284e94354a2686c577372cceb2bc P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:53.764863 24815 raft_consensus.cc:3060] T 06d0284e94354a2686c577372cceb2bc P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:53.768822 24481 tablet_bootstrap.cc:492] T f841b9f0e82748d399b5eef243c442fc P aa14caefbdaa47b09abf91881635ba96: No bootstrap required, opened a new log
I20260709 12:14:53.769747 24481 ts_tablet_manager.cc:1403] T f841b9f0e82748d399b5eef243c442fc P aa14caefbdaa47b09abf91881635ba96: Time spent bootstrapping tablet: real 0.057s	user 0.009s	sys 0.009s
I20260709 12:14:53.771060 24751 raft_consensus.cc:493] T 0f0c432146014cf099d66c95cde2ea1d P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.771910 24751 raft_consensus.cc:515] T 0f0c432146014cf099d66c95cde2ea1d P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
W20260709 12:14:53.774413 24250 leader_election.cc:343] T 6d6c85f42e284b06b8d1e7cee59f3dbc P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:53.776396 24285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0c432146014cf099d66c95cde2ea1d" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:53.778682 24751 leader_election.cc:290] T 0f0c432146014cf099d66c95cde2ea1d P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:14:53.784924 24934 raft_consensus.cc:2804] T 6d6c85f42e284b06b8d1e7cee59f3dbc P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:53.785485 24934 raft_consensus.cc:493] T 6d6c85f42e284b06b8d1e7cee59f3dbc P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:53.785936 24906 raft_consensus.cc:2749] T b98a35cf96ba4562b4933543b1e4efb9 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:14:53.784991 24399 leader_election.cc:343] T 0f0c432146014cf099d66c95cde2ea1d P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:53.786444 24479 tablet_bootstrap.cc:654] T 9219abaaa2c34b08a24191512ff742bc P ad362df39b114ec3a3a419128097b362: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:53.780484 24429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d0284e94354a2686c577372cceb2bc" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:53.792626 24806 raft_consensus.cc:493] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.797693 24429 raft_consensus.cc:2468] T 06d0284e94354a2686c577372cceb2bc P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 1.
I20260709 12:14:53.797729 24806 raft_consensus.cc:515] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:53.717383 24808 consensus_queue.cc:237] T f841b9f0e82748d399b5eef243c442fc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:53.820899 24814 raft_consensus.cc:493] T f9094185a2ad43d0b3a5174b165dab65 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.821988 24814 raft_consensus.cc:515] T f9094185a2ad43d0b3a5174b165dab65 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:53.830201 24482 tablet_bootstrap.cc:492] T f9094185a2ad43d0b3a5174b165dab65 P 9bf3da5b54ef4a1ea1cee60f02ea2883: No bootstrap required, opened a new log
I20260709 12:14:53.830801 24482 ts_tablet_manager.cc:1403] T f9094185a2ad43d0b3a5174b165dab65 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.145s	user 0.012s	sys 0.002s
I20260709 12:14:53.831200 24935 raft_consensus.cc:493] T 558ced611e584b32ab838cceeb7cb410 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.831732 24935 raft_consensus.cc:515] T 558ced611e584b32ab838cceeb7cb410 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:53.800516 24934 raft_consensus.cc:3060] T 6d6c85f42e284b06b8d1e7cee59f3dbc P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:53.830590 24356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0c432146014cf099d66c95cde2ea1d" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:53.837529 24482 raft_consensus.cc:359] T f9094185a2ad43d0b3a5174b165dab65 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:53.838342 24482 raft_consensus.cc:385] T f9094185a2ad43d0b3a5174b165dab65 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:53.838639 24482 raft_consensus.cc:740] T f9094185a2ad43d0b3a5174b165dab65 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:14:53.864089 24935 leader_election.cc:290] T 558ced611e584b32ab838cceeb7cb410 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:14:53.869160 24806 leader_election.cc:290] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:14:53.874815 24481 raft_consensus.cc:359] T f841b9f0e82748d399b5eef243c442fc P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:53.878499 24814 leader_election.cc:290] T f9094185a2ad43d0b3a5174b165dab65 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:53.896401 24482 consensus_queue.cc:260] T f9094185a2ad43d0b3a5174b165dab65 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:53.924638 24481 raft_consensus.cc:385] T f841b9f0e82748d399b5eef243c442fc P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:53.925474 24481 raft_consensus.cc:740] T f841b9f0e82748d399b5eef243c442fc P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Initialized, Role: FOLLOWER
I20260709 12:14:53.926421 24482 ts_tablet_manager.cc:1434] T f9094185a2ad43d0b3a5174b165dab65 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.095s	user 0.002s	sys 0.008s
I20260709 12:14:53.927636 24481 consensus_queue.cc:260] T f841b9f0e82748d399b5eef243c442fc P aa14caefbdaa47b09abf91881635ba96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:53.930444 24482 tablet_bootstrap.cc:492] T 7d2a60078de84a53aedeb20cdcd211a4 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:14:53.935091 24432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbab1a4afac94c1eaeb3ed35bc54408a" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:53.935927 24432 raft_consensus.cc:2468] T bbab1a4afac94c1eaeb3ed35bc54408a P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 1.
I20260709 12:14:53.906044 24815 raft_consensus.cc:515] T 06d0284e94354a2686c577372cceb2bc P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:53.908921 24934 raft_consensus.cc:515] T 6d6c85f42e284b06b8d1e7cee59f3dbc P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
W20260709 12:14:53.914007 24398 leader_election.cc:343] T 0f0c432146014cf099d66c95cde2ea1d P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:53.940866 24398 leader_election.cc:304] T 0f0c432146014cf099d66c95cde2ea1d P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad362df39b114ec3a3a419128097b362; no voters: aa14caefbdaa47b09abf91881635ba96, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:14:53.941359 24352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c85f42e284b06b8d1e7cee59f3dbc" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
W20260709 12:14:53.943387 24250 leader_election.cc:343] T 6d6c85f42e284b06b8d1e7cee59f3dbc P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:53.944315 24953 raft_consensus.cc:2749] T 0f0c432146014cf099d66c95cde2ea1d P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:53.922701 24875 raft_consensus.cc:493] T 49b141610080476a8e5f0415c370e8cd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.945465 24875 raft_consensus.cc:515] T 49b141610080476a8e5f0415c370e8cd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:53.967159 24815 leader_election.cc:290] T 06d0284e94354a2686c577372cceb2bc P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 2 election: Requested vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:53.968118 24875 leader_election.cc:290] T 49b141610080476a8e5f0415c370e8cd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:14:53.968871 24934 leader_election.cc:290] T 6d6c85f42e284b06b8d1e7cee59f3dbc P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 election: Requested vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:14:53.972572 24482 tablet_bootstrap.cc:654] T 7d2a60078de84a53aedeb20cdcd211a4 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:53.975673 24107 catalog_manager.cc:5697] T 8996365fa46548d49f3b3bafe14e9c83 P ad362df39b114ec3a3a419128097b362 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad362df39b114ec3a3a419128097b362 (127.12.56.196). New cstate: current_term: 1 leader_uuid: "ad362df39b114ec3a3a419128097b362" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:53.980211 24429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b141610080476a8e5f0415c370e8cd" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:53.981142 24429 raft_consensus.cc:2393] T 49b141610080476a8e5f0415c370e8cd P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in current term 1: Already voted for candidate cf2d8294ae68482ca4ffa8be051ad054 in this term.
I20260709 12:14:53.983858 24103 catalog_manager.cc:5697] T 49b141610080476a8e5f0415c370e8cd P cf2d8294ae68482ca4ffa8be051ad054 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194). New cstate: current_term: 1 leader_uuid: "cf2d8294ae68482ca4ffa8be051ad054" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:53.986021 24103 catalog_manager.cc:5697] T 7d67db0aeb6e4afb953c96511f9863d1 P cf2d8294ae68482ca4ffa8be051ad054 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194). New cstate: current_term: 1 leader_uuid: "cf2d8294ae68482ca4ffa8be051ad054" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:53.992755 24481 ts_tablet_manager.cc:1434] T f841b9f0e82748d399b5eef243c442fc P aa14caefbdaa47b09abf91881635ba96: Time spent starting tablet: real 0.223s	user 0.006s	sys 0.002s
I20260709 12:14:53.994266 24481 tablet_bootstrap.cc:492] T 6d6c85f42e284b06b8d1e7cee59f3dbc P aa14caefbdaa47b09abf91881635ba96: Bootstrap starting.
W20260709 12:14:53.994894 24176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:34565, user_credentials={real_user=slave}} blocked reactor thread for 201595us
I20260709 12:14:53.996842 24478 tablet_bootstrap.cc:492] T 558ced611e584b32ab838cceeb7cb410 P cf2d8294ae68482ca4ffa8be051ad054: No bootstrap required, opened a new log
I20260709 12:14:53.997440 24478 ts_tablet_manager.cc:1403] T 558ced611e584b32ab838cceeb7cb410 P cf2d8294ae68482ca4ffa8be051ad054: Time spent bootstrapping tablet: real 0.343s	user 0.009s	sys 0.031s
I20260709 12:14:53.998433 24352 raft_consensus.cc:3060] T bfba40ac52f842ca99dd4293619360af P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:54.000838 24478 raft_consensus.cc:359] T 558ced611e584b32ab838cceeb7cb410 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:54.001672 24478 raft_consensus.cc:385] T 558ced611e584b32ab838cceeb7cb410 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:54.002022 24478 raft_consensus.cc:740] T 558ced611e584b32ab838cceeb7cb410 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Initialized, Role: FOLLOWER
I20260709 12:14:54.002794 24478 consensus_queue.cc:260] T 558ced611e584b32ab838cceeb7cb410 P cf2d8294ae68482ca4ffa8be051ad054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:54.011509 24427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9094185a2ad43d0b3a5174b165dab65" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:54.012368 24427 raft_consensus.cc:2468] T f9094185a2ad43d0b3a5174b165dab65 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 0.
I20260709 12:14:54.015420 24478 ts_tablet_manager.cc:1434] T 558ced611e584b32ab838cceeb7cb410 P cf2d8294ae68482ca4ffa8be051ad054: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
W20260709 12:14:54.015601 24396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:38787, user_credentials={real_user=slave}} blocked reactor thread for 136029us
I20260709 12:14:54.015882 24479 tablet_bootstrap.cc:492] T 9219abaaa2c34b08a24191512ff742bc P ad362df39b114ec3a3a419128097b362: No bootstrap required, opened a new log
I20260709 12:14:54.017196 24478 tablet_bootstrap.cc:492] T 0f0c432146014cf099d66c95cde2ea1d P cf2d8294ae68482ca4ffa8be051ad054: Bootstrap starting.
I20260709 12:14:54.020347 24281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "558ced611e584b32ab838cceeb7cb410" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:54.021019 24284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbab1a4afac94c1eaeb3ed35bc54408a" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:54.021394 24285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b141610080476a8e5f0415c370e8cd" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:54.022132 24284 raft_consensus.cc:2468] T bbab1a4afac94c1eaeb3ed35bc54408a P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 1.
I20260709 12:14:54.021202 24281 raft_consensus.cc:2468] T 558ced611e584b32ab838cceeb7cb410 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 0.
I20260709 12:14:54.026371 24176 leader_election.cc:304] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054; no voters: 
I20260709 12:14:54.027501 24176 leader_election.cc:304] T 558ced611e584b32ab838cceeb7cb410 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054; no voters: 
I20260709 12:14:54.027987 24429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d0284e94354a2686c577372cceb2bc" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362"
I20260709 12:14:54.028707 24429 raft_consensus.cc:3060] T 06d0284e94354a2686c577372cceb2bc P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:54.029539 24949 raft_consensus.cc:2804] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:54.033373 24949 raft_consensus.cc:493] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:54.033877 24949 raft_consensus.cc:3060] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:54.038094 24479 ts_tablet_manager.cc:1403] T 9219abaaa2c34b08a24191512ff742bc P ad362df39b114ec3a3a419128097b362: Time spent bootstrapping tablet: real 0.400s	user 0.044s	sys 0.049s
I20260709 12:14:54.038864 24875 raft_consensus.cc:2804] T 558ced611e584b32ab838cceeb7cb410 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:54.039346 24875 raft_consensus.cc:493] T 558ced611e584b32ab838cceeb7cb410 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:54.039765 24875 raft_consensus.cc:3060] T 558ced611e584b32ab838cceeb7cb410 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:54.037549 24429 raft_consensus.cc:2468] T 06d0284e94354a2686c577372cceb2bc P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 2.
I20260709 12:14:54.029561 24432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c85f42e284b06b8d1e7cee59f3dbc" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362"
I20260709 12:14:54.054629 24482 tablet_bootstrap.cc:492] T 7d2a60078de84a53aedeb20cdcd211a4 P 9bf3da5b54ef4a1ea1cee60f02ea2883: No bootstrap required, opened a new log
I20260709 12:14:54.055182 24482 ts_tablet_manager.cc:1403] T 7d2a60078de84a53aedeb20cdcd211a4 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.125s	user 0.016s	sys 0.000s
I20260709 12:14:54.058938 24478 tablet_bootstrap.cc:654] T 0f0c432146014cf099d66c95cde2ea1d P cf2d8294ae68482ca4ffa8be051ad054: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:54.060858 24875 raft_consensus.cc:515] T 558ced611e584b32ab838cceeb7cb410 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:54.045845 24107 catalog_manager.cc:5697] T 2c00f77150f7475c94c4fd29c90805cd P ad362df39b114ec3a3a419128097b362 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad362df39b114ec3a3a419128097b362 (127.12.56.196). New cstate: current_term: 1 leader_uuid: "ad362df39b114ec3a3a419128097b362" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:54.054807 24432 raft_consensus.cc:3060] T 6d6c85f42e284b06b8d1e7cee59f3dbc P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:54.068226 24482 raft_consensus.cc:359] T 7d2a60078de84a53aedeb20cdcd211a4 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:54.070194 24482 raft_consensus.cc:385] T 7d2a60078de84a53aedeb20cdcd211a4 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:54.070698 24482 raft_consensus.cc:740] T 7d2a60078de84a53aedeb20cdcd211a4 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:14:54.071574 24482 consensus_queue.cc:260] T 7d2a60078de84a53aedeb20cdcd211a4 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:54.072566 24815 consensus_queue.cc:1048] T bfba40ac52f842ca99dd4293619360af P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:54.074571 24482 ts_tablet_manager.cc:1434] T 7d2a60078de84a53aedeb20cdcd211a4 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:14:54.074705 24875 leader_election.cc:290] T 558ced611e584b32ab838cceeb7cb410 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 election: Requested vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:14:54.075744 24482 tablet_bootstrap.cc:492] T 9219abaaa2c34b08a24191512ff742bc P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:14:54.077926 24479 raft_consensus.cc:359] T 9219abaaa2c34b08a24191512ff742bc P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:54.078752 24479 raft_consensus.cc:385] T 9219abaaa2c34b08a24191512ff742bc P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:54.078991 24949 raft_consensus.cc:515] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:54.079073 24479 raft_consensus.cc:740] T 9219abaaa2c34b08a24191512ff742bc P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad362df39b114ec3a3a419128097b362, State: Initialized, Role: FOLLOWER
I20260709 12:14:54.087466 24479 consensus_queue.cc:260] T 9219abaaa2c34b08a24191512ff742bc P ad362df39b114ec3a3a419128097b362 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:54.089056 24174 leader_election.cc:304] T 49b141610080476a8e5f0415c370e8cd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883; no voters: ad362df39b114ec3a3a419128097b362, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:14:54.081642 24949 leader_election.cc:290] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 2 election: Requested vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:14:54.095458 24481 tablet_bootstrap.cc:654] T 6d6c85f42e284b06b8d1e7cee59f3dbc P aa14caefbdaa47b09abf91881635ba96: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:54.096909 24357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "558ced611e584b32ab838cceeb7cb410" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
I20260709 12:14:54.097401 24808 raft_consensus.cc:3060] T 49b141610080476a8e5f0415c370e8cd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:54.097986 24283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "558ced611e584b32ab838cceeb7cb410" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054"
I20260709 12:14:54.098495 24352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "558ced611e584b32ab838cceeb7cb410" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:54.105880 24432 raft_consensus.cc:2468] T 6d6c85f42e284b06b8d1e7cee59f3dbc P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 1.
I20260709 12:14:54.107997 24479 ts_tablet_manager.cc:1434] T 9219abaaa2c34b08a24191512ff742bc P ad362df39b114ec3a3a419128097b362: Time spent starting tablet: real 0.070s	user 0.007s	sys 0.002s
I20260709 12:14:54.113647 24281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbab1a4afac94c1eaeb3ed35bc54408a" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054"
I20260709 12:14:54.107049 24751 raft_consensus.cc:493] T 9219abaaa2c34b08a24191512ff742bc P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:54.120209 24209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9094185a2ad43d0b3a5174b165dab65" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
I20260709 12:14:54.110059 24283 raft_consensus.cc:3060] T 558ced611e584b32ab838cceeb7cb410 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:54.139531 24209 raft_consensus.cc:2468] T f9094185a2ad43d0b3a5174b165dab65 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 0.
I20260709 12:14:54.139909 24207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d0284e94354a2686c577372cceb2bc" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
I20260709 12:14:54.140686 24207 raft_consensus.cc:3060] T 06d0284e94354a2686c577372cceb2bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:54.124696 24429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbab1a4afac94c1eaeb3ed35bc54408a" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362"
I20260709 12:14:54.160995 24429 raft_consensus.cc:3060] T bbab1a4afac94c1eaeb3ed35bc54408a P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:54.115063 24249 leader_election.cc:304] T f9094185a2ad43d0b3a5174b165dab65 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad362df39b114ec3a3a419128097b362, cf2d8294ae68482ca4ffa8be051ad054; no voters: 
W20260709 12:14:54.163228 24249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46467, user_credentials={real_user=slave}} blocked reactor thread for 53919.5us
I20260709 12:14:54.164707 24816 raft_consensus.cc:2804] T f9094185a2ad43d0b3a5174b165dab65 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:54.165174 24816 raft_consensus.cc:493] T f9094185a2ad43d0b3a5174b165dab65 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:54.165825 24816 raft_consensus.cc:3060] T f9094185a2ad43d0b3a5174b165dab65 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:54.165920 24814 consensus_queue.cc:1048] T 49b141610080476a8e5f0415c370e8cd P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:54.134264 24751 raft_consensus.cc:515] T 9219abaaa2c34b08a24191512ff742bc P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:54.171622 24751 leader_election.cc:290] T 9219abaaa2c34b08a24191512ff742bc P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:54.174093 24103 catalog_manager.cc:5697] T f841b9f0e82748d399b5eef243c442fc P 9bf3da5b54ef4a1ea1cee60f02ea2883 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193). New cstate: current_term: 1 leader_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:54.136701 24479 tablet_bootstrap.cc:492] T 7d2a60078de84a53aedeb20cdcd211a4 P ad362df39b114ec3a3a419128097b362: Bootstrap starting.
I20260709 12:14:54.114609 24281 raft_consensus.cc:3060] T bbab1a4afac94c1eaeb3ed35bc54408a P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:54.165040 24249 leader_election.cc:304] T 06d0284e94354a2686c577372cceb2bc P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad362df39b114ec3a3a419128097b362, cf2d8294ae68482ca4ffa8be051ad054; no voters: 
I20260709 12:14:54.184331 24357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9219abaaa2c34b08a24191512ff742bc" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
W20260709 12:14:54.184830 24398 consensus_peers.cc:597] T 2c00f77150f7475c94c4fd29c90805cd P ad362df39b114ec3a3a419128097b362 -> Peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Couldn't send request to peer aa14caefbdaa47b09abf91881635ba96. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:54.187077 24283 raft_consensus.cc:2468] T 558ced611e584b32ab838cceeb7cb410 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 1.
W20260709 12:14:54.190304 24399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:34565, user_credentials={real_user=slave}} blocked reactor thread for 59369.8us
I20260709 12:14:54.204736 24176 leader_election.cc:304] T 558ced611e584b32ab838cceeb7cb410 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054; no voters: 
I20260709 12:14:54.205384 24909 consensus_queue.cc:1048] T 8996365fa46548d49f3b3bafe14e9c83 P ad362df39b114ec3a3a419128097b362 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:14:54.203363 24398 leader_election.cc:343] T 9219abaaa2c34b08a24191512ff742bc P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:54.181679 24816 raft_consensus.cc:515] T f9094185a2ad43d0b3a5174b165dab65 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:54.205688 24806 raft_consensus.cc:2804] T 558ced611e584b32ab838cceeb7cb410 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:54.207247 24806 raft_consensus.cc:697] T 558ced611e584b32ab838cceeb7cb410 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 LEADER]: Becoming Leader. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Running, Role: LEADER
I20260709 12:14:54.208220 24806 consensus_queue.cc:237] T 558ced611e584b32ab838cceeb7cb410 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:54.129504 24478 tablet_bootstrap.cc:492] T 0f0c432146014cf099d66c95cde2ea1d P cf2d8294ae68482ca4ffa8be051ad054: No bootstrap required, opened a new log
I20260709 12:14:54.217729 24478 ts_tablet_manager.cc:1403] T 0f0c432146014cf099d66c95cde2ea1d P cf2d8294ae68482ca4ffa8be051ad054: Time spent bootstrapping tablet: real 0.201s	user 0.010s	sys 0.007s
W20260709 12:14:54.216017 24175 leader_election.cc:343] T 558ced611e584b32ab838cceeb7cb410 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:54.226665 24175 leader_election.cc:343] T 558ced611e584b32ab838cceeb7cb410 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:54.198611 24249 leader_election.cc:304] T 6d6c85f42e284b06b8d1e7cee59f3dbc P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad362df39b114ec3a3a419128097b362, cf2d8294ae68482ca4ffa8be051ad054; no voters: aa14caefbdaa47b09abf91881635ba96
I20260709 12:14:54.230335 24919 raft_consensus.cc:493] T 7d2a60078de84a53aedeb20cdcd211a4 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:54.202240 24204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9219abaaa2c34b08a24191512ff742bc" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
I20260709 12:14:54.230996 24919 raft_consensus.cc:515] T 7d2a60078de84a53aedeb20cdcd211a4 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:54.233111 24919 leader_election.cc:290] T 7d2a60078de84a53aedeb20cdcd211a4 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:14:54.233816 24814 raft_consensus.cc:2804] T 6d6c85f42e284b06b8d1e7cee59f3dbc P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:54.234400 24814 raft_consensus.cc:697] T 6d6c85f42e284b06b8d1e7cee59f3dbc P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Becoming Leader. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Running, Role: LEADER
I20260709 12:14:54.235287 24814 consensus_queue.cc:237] T 6d6c85f42e284b06b8d1e7cee59f3dbc P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:54.236220 24816 leader_election.cc:290] T f9094185a2ad43d0b3a5174b165dab65 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 election: Requested vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:54.198781 24815 raft_consensus.cc:2804] T 06d0284e94354a2686c577372cceb2bc P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:54.197762 24281 raft_consensus.cc:2468] T bbab1a4afac94c1eaeb3ed35bc54408a P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 2.
I20260709 12:14:54.227980 24903 consensus_queue.cc:1048] T bfba40ac52f842ca99dd4293619360af P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 12:14:54.245253 24478 raft_consensus.cc:359] T 0f0c432146014cf099d66c95cde2ea1d P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:54.247013 24478 raft_consensus.cc:385] T 0f0c432146014cf099d66c95cde2ea1d P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:54.247664 24478 raft_consensus.cc:740] T 0f0c432146014cf099d66c95cde2ea1d P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Initialized, Role: FOLLOWER
I20260709 12:14:54.250375 24478 consensus_queue.cc:260] T 0f0c432146014cf099d66c95cde2ea1d P cf2d8294ae68482ca4ffa8be051ad054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:54.240404 24815 raft_consensus.cc:697] T 06d0284e94354a2686c577372cceb2bc P cf2d8294ae68482ca4ffa8be051ad054 [term 2 LEADER]: Becoming Leader. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Running, Role: LEADER
I20260709 12:14:54.259119 24479 tablet_bootstrap.cc:654] T 7d2a60078de84a53aedeb20cdcd211a4 P ad362df39b114ec3a3a419128097b362: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:54.188788 24207 raft_consensus.cc:2468] T 06d0284e94354a2686c577372cceb2bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 2.
I20260709 12:14:54.264863 24815 consensus_queue.cc:237] T 06d0284e94354a2686c577372cceb2bc P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:54.261603 24427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d2a60078de84a53aedeb20cdcd211a4" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
W20260709 12:14:54.269309 24174 leader_election.cc:343] T 7d2a60078de84a53aedeb20cdcd211a4 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:54.262034 24396 leader_election.cc:343] T 9219abaaa2c34b08a24191512ff742bc P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:54.243501 24429 raft_consensus.cc:2468] T bbab1a4afac94c1eaeb3ed35bc54408a P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 2.
W20260709 12:14:54.287766 24248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:38787, user_credentials={real_user=slave}} blocked reactor thread for 58928.5us
I20260709 12:14:54.290741 24176 leader_election.cc:304] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054; no voters: 
I20260709 12:14:54.272118 24808 raft_consensus.cc:2749] T 49b141610080476a8e5f0415c370e8cd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:54.293890 24478 ts_tablet_manager.cc:1434] T 0f0c432146014cf099d66c95cde2ea1d P cf2d8294ae68482ca4ffa8be051ad054: Time spent starting tablet: real 0.069s	user 0.008s	sys 0.001s
I20260709 12:14:54.298219 24207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9094185a2ad43d0b3a5174b165dab65" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
I20260709 12:14:54.307708 24283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d2a60078de84a53aedeb20cdcd211a4" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:54.308576 24207 raft_consensus.cc:3060] T f9094185a2ad43d0b3a5174b165dab65 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:54.286062 24396 leader_election.cc:304] T 9219abaaa2c34b08a24191512ff742bc P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad362df39b114ec3a3a419128097b362; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, aa14caefbdaa47b09abf91881635ba96
W20260709 12:14:54.289417 24249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46467, user_credentials={real_user=slave}} blocked reactor thread for 90910.7us
W20260709 12:14:54.315290 24396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:38787, user_credentials={real_user=slave}} blocked reactor thread for 53324.2us
I20260709 12:14:54.316246 24482 tablet_bootstrap.cc:654] T 9219abaaa2c34b08a24191512ff742bc P 9bf3da5b54ef4a1ea1cee60f02ea2883: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:54.316810 24909 raft_consensus.cc:2749] T 9219abaaa2c34b08a24191512ff742bc P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:54.319186 24909 consensus_queue.cc:1048] T 8996365fa46548d49f3b3bafe14e9c83 P ad362df39b114ec3a3a419128097b362 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:54.296254 24806 raft_consensus.cc:2804] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:14:54.343598 24176 leader_election.cc:343] T 7d2a60078de84a53aedeb20cdcd211a4 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:54.344162 24176 leader_election.cc:304] T 7d2a60078de84a53aedeb20cdcd211a4 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883; no voters: ad362df39b114ec3a3a419128097b362, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:14:54.353310 24919 consensus_queue.cc:1048] T f841b9f0e82748d399b5eef243c442fc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:54.355520 24875 raft_consensus.cc:2749] T 7d2a60078de84a53aedeb20cdcd211a4 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:54.357972 24478 tablet_bootstrap.cc:492] T 7d2a60078de84a53aedeb20cdcd211a4 P cf2d8294ae68482ca4ffa8be051ad054: Bootstrap starting.
I20260709 12:14:54.358343 24909 consensus_queue.cc:1048] T 2c00f77150f7475c94c4fd29c90805cd P ad362df39b114ec3a3a419128097b362 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:54.361379 24432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9094185a2ad43d0b3a5174b165dab65" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362"
I20260709 12:14:54.362393 24432 raft_consensus.cc:3060] T f9094185a2ad43d0b3a5174b165dab65 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:54.374126 24481 tablet_bootstrap.cc:492] T 6d6c85f42e284b06b8d1e7cee59f3dbc P aa14caefbdaa47b09abf91881635ba96: No bootstrap required, opened a new log
I20260709 12:14:54.374837 24481 ts_tablet_manager.cc:1403] T 6d6c85f42e284b06b8d1e7cee59f3dbc P aa14caefbdaa47b09abf91881635ba96: Time spent bootstrapping tablet: real 0.381s	user 0.018s	sys 0.019s
I20260709 12:14:54.371214 24806 raft_consensus.cc:697] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 LEADER]: Becoming Leader. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Running, Role: LEADER
W20260709 12:14:54.404153 24961 log.cc:927] Time spent T bfba40ac52f842ca99dd4293619360af P aa14caefbdaa47b09abf91881635ba96: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:14:54.405766 24478 tablet_bootstrap.cc:654] T 7d2a60078de84a53aedeb20cdcd211a4 P cf2d8294ae68482ca4ffa8be051ad054: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:54.404327 24432 raft_consensus.cc:2468] T f9094185a2ad43d0b3a5174b165dab65 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 1.
I20260709 12:14:54.395821 24907 raft_consensus.cc:493] T f841b9f0e82748d399b5eef243c442fc P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:54.386948 24816 consensus_queue.cc:1048] T 49b141610080476a8e5f0415c370e8cd P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.026s
I20260709 12:14:54.428416 24806 consensus_queue.cc:237] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:54.419227 24932 consensus_queue.cc:1048] T 7d67db0aeb6e4afb953c96511f9863d1 P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:14:54.414387 24207 raft_consensus.cc:2468] T f9094185a2ad43d0b3a5174b165dab65 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 1.
W20260709 12:14:54.473203 24970 log.cc:927] Time spent T bfba40ac52f842ca99dd4293619360af P 9bf3da5b54ef4a1ea1cee60f02ea2883: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:14:54.438534 24907 raft_consensus.cc:515] T f841b9f0e82748d399b5eef243c442fc P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:54.477478 24481 raft_consensus.cc:359] T 6d6c85f42e284b06b8d1e7cee59f3dbc P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:54.478591 24481 raft_consensus.cc:385] T 6d6c85f42e284b06b8d1e7cee59f3dbc P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:54.479001 24481 raft_consensus.cc:740] T 6d6c85f42e284b06b8d1e7cee59f3dbc P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Initialized, Role: FOLLOWER
I20260709 12:14:54.483354 24481 consensus_queue.cc:260] T 6d6c85f42e284b06b8d1e7cee59f3dbc P aa14caefbdaa47b09abf91881635ba96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:54.484799 24479 tablet_bootstrap.cc:492] T 7d2a60078de84a53aedeb20cdcd211a4 P ad362df39b114ec3a3a419128097b362: No bootstrap required, opened a new log
I20260709 12:14:54.485409 24479 ts_tablet_manager.cc:1403] T 7d2a60078de84a53aedeb20cdcd211a4 P ad362df39b114ec3a3a419128097b362: Time spent bootstrapping tablet: real 0.349s	user 0.009s	sys 0.014s
I20260709 12:14:54.488626 24479 raft_consensus.cc:359] T 7d2a60078de84a53aedeb20cdcd211a4 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:54.489475 24479 raft_consensus.cc:385] T 7d2a60078de84a53aedeb20cdcd211a4 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:54.489814 24479 raft_consensus.cc:740] T 7d2a60078de84a53aedeb20cdcd211a4 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad362df39b114ec3a3a419128097b362, State: Initialized, Role: FOLLOWER
I20260709 12:14:54.490513 24479 consensus_queue.cc:260] T 7d2a60078de84a53aedeb20cdcd211a4 P ad362df39b114ec3a3a419128097b362 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:54.493526 24248 leader_election.cc:304] T f9094185a2ad43d0b3a5174b165dab65 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054; no voters: 
I20260709 12:14:54.502801 24479 ts_tablet_manager.cc:1434] T 7d2a60078de84a53aedeb20cdcd211a4 P ad362df39b114ec3a3a419128097b362: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:14:54.492514 24481 ts_tablet_manager.cc:1434] T 6d6c85f42e284b06b8d1e7cee59f3dbc P aa14caefbdaa47b09abf91881635ba96: Time spent starting tablet: real 0.117s	user 0.007s	sys 0.001s
W20260709 12:14:54.506438 24250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:46845, user_credentials={real_user=slave}} blocked reactor thread for 112928us
W20260709 12:14:54.554955 24249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46467, user_credentials={real_user=slave}} blocked reactor thread for 176873us
I20260709 12:14:54.507259 24816 raft_consensus.cc:2804] T f9094185a2ad43d0b3a5174b165dab65 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:54.587349 24103 catalog_manager.cc:5697] T 558ced611e584b32ab838cceeb7cb410 P 9bf3da5b54ef4a1ea1cee60f02ea2883 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193). New cstate: current_term: 1 leader_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:54.612162 24481 tablet_bootstrap.cc:492] T 2c00f77150f7475c94c4fd29c90805cd P aa14caefbdaa47b09abf91881635ba96: Bootstrap starting.
I20260709 12:14:54.635221 24481 tablet_bootstrap.cc:654] T 2c00f77150f7475c94c4fd29c90805cd P aa14caefbdaa47b09abf91881635ba96: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:54.644752 24907 leader_election.cc:290] T f841b9f0e82748d399b5eef243c442fc P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
W20260709 12:14:54.662621 24249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46467, user_credentials={real_user=slave}} blocked reactor thread for 96254.1us
I20260709 12:14:54.692838 24210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841b9f0e82748d399b5eef243c442fc" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
W20260709 12:14:54.706259 24155 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:54.706799 24816 raft_consensus.cc:697] T f9094185a2ad43d0b3a5174b165dab65 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Becoming Leader. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Running, Role: LEADER
I20260709 12:14:54.707962 24816 consensus_queue.cc:237] T f9094185a2ad43d0b3a5174b165dab65 P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
W20260709 12:14:54.795431 24973 log.cc:927] Time spent T 49b141610080476a8e5f0415c370e8cd P ad362df39b114ec3a3a419128097b362: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:14:54.808993 24482 tablet_bootstrap.cc:492] T 9219abaaa2c34b08a24191512ff742bc P 9bf3da5b54ef4a1ea1cee60f02ea2883: No bootstrap required, opened a new log
I20260709 12:14:54.812099 24481 tablet_bootstrap.cc:492] T 2c00f77150f7475c94c4fd29c90805cd P aa14caefbdaa47b09abf91881635ba96: No bootstrap required, opened a new log
I20260709 12:14:54.812731 24481 ts_tablet_manager.cc:1403] T 2c00f77150f7475c94c4fd29c90805cd P aa14caefbdaa47b09abf91881635ba96: Time spent bootstrapping tablet: real 0.271s	user 0.040s	sys 0.044s
I20260709 12:14:54.809623 24482 ts_tablet_manager.cc:1403] T 9219abaaa2c34b08a24191512ff742bc P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.734s	user 0.051s	sys 0.051s
I20260709 12:14:54.711045 24974 consensus_queue.cc:1048] T 7d67db0aeb6e4afb953c96511f9863d1 P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.086s
W20260709 12:14:54.852640 24398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:46845, user_credentials={real_user=slave}} blocked reactor thread for 142734us
W20260709 12:14:54.853752 24249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46467, user_credentials={real_user=slave}} blocked reactor thread for 145631us
I20260709 12:14:54.860634 24478 tablet_bootstrap.cc:492] T 7d2a60078de84a53aedeb20cdcd211a4 P cf2d8294ae68482ca4ffa8be051ad054: No bootstrap required, opened a new log
I20260709 12:14:54.861181 24478 ts_tablet_manager.cc:1403] T 7d2a60078de84a53aedeb20cdcd211a4 P cf2d8294ae68482ca4ffa8be051ad054: Time spent bootstrapping tablet: real 0.531s	user 0.033s	sys 0.047s
I20260709 12:14:54.866146 24107 catalog_manager.cc:5697] T 6d6c85f42e284b06b8d1e7cee59f3dbc P cf2d8294ae68482ca4ffa8be051ad054 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194). New cstate: current_term: 1 leader_uuid: "cf2d8294ae68482ca4ffa8be051ad054" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:54.880270 24482 raft_consensus.cc:359] T 9219abaaa2c34b08a24191512ff742bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:54.881204 24482 raft_consensus.cc:385] T 9219abaaa2c34b08a24191512ff742bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:54.881505 24482 raft_consensus.cc:740] T 9219abaaa2c34b08a24191512ff742bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:14:54.882313 24482 consensus_queue.cc:260] T 9219abaaa2c34b08a24191512ff742bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:54.886242 24478 raft_consensus.cc:359] T 7d2a60078de84a53aedeb20cdcd211a4 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:54.887616 24478 raft_consensus.cc:385] T 7d2a60078de84a53aedeb20cdcd211a4 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:54.887933 24478 raft_consensus.cc:740] T 7d2a60078de84a53aedeb20cdcd211a4 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Initialized, Role: FOLLOWER
I20260709 12:14:54.888713 24478 consensus_queue.cc:260] T 7d2a60078de84a53aedeb20cdcd211a4 P cf2d8294ae68482ca4ffa8be051ad054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:54.890574 24478 ts_tablet_manager.cc:1434] T 7d2a60078de84a53aedeb20cdcd211a4 P cf2d8294ae68482ca4ffa8be051ad054: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 12:14:54.890326 24481 raft_consensus.cc:359] T 2c00f77150f7475c94c4fd29c90805cd P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:54.885608 24932 raft_consensus.cc:493] T 0f0c432146014cf099d66c95cde2ea1d P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:54.892218 24932 raft_consensus.cc:515] T 0f0c432146014cf099d66c95cde2ea1d P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
W20260709 12:14:54.895036 24250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:46845, user_credentials={real_user=slave}} blocked reactor thread for 58140.8us
I20260709 12:14:54.895448 24481 raft_consensus.cc:385] T 2c00f77150f7475c94c4fd29c90805cd P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:54.895869 24481 raft_consensus.cc:740] T 2c00f77150f7475c94c4fd29c90805cd P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Initialized, Role: FOLLOWER
I20260709 12:14:54.896664 24481 consensus_queue.cc:260] T 2c00f77150f7475c94c4fd29c90805cd P aa14caefbdaa47b09abf91881635ba96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:54.913156 24355 raft_consensus.cc:3060] T f841b9f0e82748d399b5eef243c442fc P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:54.914098 24932 leader_election.cc:290] T 0f0c432146014cf099d66c95cde2ea1d P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:14:54.916266 24481 ts_tablet_manager.cc:1434] T 2c00f77150f7475c94c4fd29c90805cd P aa14caefbdaa47b09abf91881635ba96: Time spent starting tablet: real 0.103s	user 0.003s	sys 0.004s
I20260709 12:14:54.917445 24481 tablet_bootstrap.cc:492] T 0f0c432146014cf099d66c95cde2ea1d P aa14caefbdaa47b09abf91881635ba96: Bootstrap starting.
I20260709 12:14:54.925947 24481 tablet_bootstrap.cc:654] T 0f0c432146014cf099d66c95cde2ea1d P aa14caefbdaa47b09abf91881635ba96: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:54.929972 24909 raft_consensus.cc:493] T 7d2a60078de84a53aedeb20cdcd211a4 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:54.930624 24909 raft_consensus.cc:515] T 7d2a60078de84a53aedeb20cdcd211a4 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:54.929925 24482 ts_tablet_manager.cc:1434] T 9219abaaa2c34b08a24191512ff742bc P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.116s	user 0.008s	sys 0.000s
I20260709 12:14:54.944357 24909 leader_election.cc:290] T 7d2a60078de84a53aedeb20cdcd211a4 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:14:54.969930 24206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d2a60078de84a53aedeb20cdcd211a4" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
I20260709 12:14:54.970772 24206 raft_consensus.cc:2468] T 7d2a60078de84a53aedeb20cdcd211a4 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 0.
I20260709 12:14:54.980089 24396 leader_election.cc:304] T 7d2a60078de84a53aedeb20cdcd211a4 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, ad362df39b114ec3a3a419128097b362; no voters: 
I20260709 12:14:54.993917 24481 tablet_bootstrap.cc:492] T 0f0c432146014cf099d66c95cde2ea1d P aa14caefbdaa47b09abf91881635ba96: No bootstrap required, opened a new log
I20260709 12:14:54.994628 24481 ts_tablet_manager.cc:1403] T 0f0c432146014cf099d66c95cde2ea1d P aa14caefbdaa47b09abf91881635ba96: Time spent bootstrapping tablet: real 0.077s	user 0.025s	sys 0.023s
W20260709 12:14:54.995040 24250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:46845, user_credentials={real_user=slave}} blocked reactor thread for 96963.7us
W20260709 12:14:54.995520 24175 consensus_peers.cc:597] T 558ced611e584b32ab838cceeb7cb410 P 9bf3da5b54ef4a1ea1cee60f02ea2883 -> Peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Couldn't send request to peer aa14caefbdaa47b09abf91881635ba96. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:54.998965 24956 raft_consensus.cc:2804] T 7d2a60078de84a53aedeb20cdcd211a4 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:54.999917 24956 raft_consensus.cc:493] T 7d2a60078de84a53aedeb20cdcd211a4 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:55.000420 24956 raft_consensus.cc:3060] T 7d2a60078de84a53aedeb20cdcd211a4 P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:55.036130 24481 raft_consensus.cc:359] T 0f0c432146014cf099d66c95cde2ea1d P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:55.036940 24481 raft_consensus.cc:385] T 0f0c432146014cf099d66c95cde2ea1d P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:55.037222 24481 raft_consensus.cc:740] T 0f0c432146014cf099d66c95cde2ea1d P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Initialized, Role: FOLLOWER
I20260709 12:14:55.049953 24481 consensus_queue.cc:260] T 0f0c432146014cf099d66c95cde2ea1d P aa14caefbdaa47b09abf91881635ba96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:55.022047 24281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d2a60078de84a53aedeb20cdcd211a4" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:55.023921 24907 raft_consensus.cc:493] T 6d6c85f42e284b06b8d1e7cee59f3dbc P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:55.089270 24481 ts_tablet_manager.cc:1434] T 0f0c432146014cf099d66c95cde2ea1d P aa14caefbdaa47b09abf91881635ba96: Time spent starting tablet: real 0.094s	user 0.007s	sys 0.000s
I20260709 12:14:55.087052 24427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0c432146014cf099d66c95cde2ea1d" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:55.101181 24429 raft_consensus.cc:1275] T 06d0284e94354a2686c577372cceb2bc P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Refusing update from remote peer cf2d8294ae68482ca4ffa8be051ad054: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:14:55.064437 24907 raft_consensus.cc:515] T 6d6c85f42e284b06b8d1e7cee59f3dbc P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:55.104315 24357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0c432146014cf099d66c95cde2ea1d" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:55.104952 24907 leader_election.cc:290] T 6d6c85f42e284b06b8d1e7cee59f3dbc P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:14:55.105113 24357 raft_consensus.cc:2468] T 0f0c432146014cf099d66c95cde2ea1d P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 0.
I20260709 12:14:55.064854 24281 raft_consensus.cc:2468] T 7d2a60078de84a53aedeb20cdcd211a4 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 0.
I20260709 12:14:55.109565 24427 raft_consensus.cc:2468] T 0f0c432146014cf099d66c95cde2ea1d P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 0.
I20260709 12:14:55.111905 24249 leader_election.cc:304] T 0f0c432146014cf099d66c95cde2ea1d P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad362df39b114ec3a3a419128097b362, cf2d8294ae68482ca4ffa8be051ad054; no voters: 
I20260709 12:14:55.111742 24956 raft_consensus.cc:515] T 7d2a60078de84a53aedeb20cdcd211a4 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:55.112805 24903 consensus_queue.cc:1048] T 06d0284e94354a2686c577372cceb2bc P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:55.122391 24282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841b9f0e82748d399b5eef243c442fc" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:55.124083 24427 raft_consensus.cc:1275] T bbab1a4afac94c1eaeb3ed35bc54408a P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Refusing update from remote peer 9bf3da5b54ef4a1ea1cee60f02ea2883: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:14:55.124853 24875 consensus_queue.cc:1048] T f841b9f0e82748d399b5eef243c442fc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:55.125802 24956 leader_election.cc:290] T 7d2a60078de84a53aedeb20cdcd211a4 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 election: Requested vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:14:55.126820 24875 consensus_queue.cc:1048] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:55.131400 24481 tablet_bootstrap.cc:492] T 558ced611e584b32ab838cceeb7cb410 P aa14caefbdaa47b09abf91881635ba96: Bootstrap starting.
W20260709 12:14:55.170454 24248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:38787, user_credentials={real_user=slave}} blocked reactor thread for 146289us
I20260709 12:14:55.171268 24207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d2a60078de84a53aedeb20cdcd211a4" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
I20260709 12:14:55.171027 24283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c85f42e284b06b8d1e7cee59f3dbc" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:55.183964 24433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c85f42e284b06b8d1e7cee59f3dbc" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:55.185995 24325 leader_election.cc:304] T f841b9f0e82748d399b5eef243c442fc P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:14:55.190495 24433 raft_consensus.cc:2393] T 6d6c85f42e284b06b8d1e7cee59f3dbc P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aa14caefbdaa47b09abf91881635ba96 in current term 1: Already voted for candidate cf2d8294ae68482ca4ffa8be051ad054 in this term.
I20260709 12:14:55.177611 24907 raft_consensus.cc:493] T 2c00f77150f7475c94c4fd29c90805cd P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:55.185253 24207 raft_consensus.cc:3060] T 7d2a60078de84a53aedeb20cdcd211a4 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:55.182775 24989 raft_consensus.cc:2804] T 0f0c432146014cf099d66c95cde2ea1d P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:55.196409 24907 raft_consensus.cc:515] T 2c00f77150f7475c94c4fd29c90805cd P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:55.207980 24106 catalog_manager.cc:5697] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883 reported cstate change: term changed from 0 to 2, leader changed from <none> to 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193). New cstate: current_term: 2 leader_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:55.266185 24281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d2a60078de84a53aedeb20cdcd211a4" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054"
I20260709 12:14:55.267024 24281 raft_consensus.cc:3060] T 7d2a60078de84a53aedeb20cdcd211a4 P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:55.217986 24989 raft_consensus.cc:493] T 0f0c432146014cf099d66c95cde2ea1d P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:55.348848 24207 raft_consensus.cc:2468] T 7d2a60078de84a53aedeb20cdcd211a4 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 1.
W20260709 12:14:55.351688 24249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46467, user_credentials={real_user=slave}} blocked reactor thread for 93046.3us
I20260709 12:14:55.359706 24989 raft_consensus.cc:3060] T 0f0c432146014cf099d66c95cde2ea1d P cf2d8294ae68482ca4ffa8be051ad054 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:14:55.365867 25003 log.cc:927] Time spent T 49b141610080476a8e5f0415c370e8cd P cf2d8294ae68482ca4ffa8be051ad054: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 12:14:55.369177 24952 raft_consensus.cc:493] T 9219abaaa2c34b08a24191512ff742bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:55.393949 24284 raft_consensus.cc:1275] T bbab1a4afac94c1eaeb3ed35bc54408a P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Refusing update from remote peer 9bf3da5b54ef4a1ea1cee60f02ea2883: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:14:55.396461 24998 consensus_queue.cc:1048] T 6d6c85f42e284b06b8d1e7cee59f3dbc P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260709 12:14:55.433687 24481 tablet_bootstrap.cc:654] T 558ced611e584b32ab838cceeb7cb410 P aa14caefbdaa47b09abf91881635ba96: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:55.438831 24356 raft_consensus.cc:3060] T 6d6c85f42e284b06b8d1e7cee59f3dbc P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:55.390771 24952 raft_consensus.cc:515] T 9219abaaa2c34b08a24191512ff742bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:55.418176 24976 raft_consensus.cc:2749] T f841b9f0e82748d399b5eef243c442fc P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:14:55.463428 24176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:34565, user_credentials={real_user=slave}} blocked reactor thread for 55275.1us
I20260709 12:14:55.480515 24952 leader_election.cc:290] T 9219abaaa2c34b08a24191512ff742bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:14:55.481765 24323 leader_election.cc:304] T 6d6c85f42e284b06b8d1e7cee59f3dbc P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96; no voters: ad362df39b114ec3a3a419128097b362, cf2d8294ae68482ca4ffa8be051ad054
W20260709 12:14:55.482191 25004 log.cc:927] Time spent T bbab1a4afac94c1eaeb3ed35bc54408a P ad362df39b114ec3a3a419128097b362: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 12:14:55.497207 24281 raft_consensus.cc:2468] T 7d2a60078de84a53aedeb20cdcd211a4 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 1.
I20260709 12:14:55.499181 24989 raft_consensus.cc:515] T 0f0c432146014cf099d66c95cde2ea1d P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:14:55.504763 24907 leader_election.cc:290] T 2c00f77150f7475c94c4fd29c90805cd P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
W20260709 12:14:55.520270 24175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:46845, user_credentials={real_user=slave}} blocked reactor thread for 148764us
W20260709 12:14:55.526770 24174 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46467, user_credentials={real_user=slave}} blocked reactor thread for 181907us
I20260709 12:14:55.528198 24396 leader_election.cc:304] T 7d2a60078de84a53aedeb20cdcd211a4 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, ad362df39b114ec3a3a419128097b362; no voters: 
I20260709 12:14:55.529619 24988 raft_consensus.cc:2804] T 7d2a60078de84a53aedeb20cdcd211a4 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:55.530395 24350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0c432146014cf099d66c95cde2ea1d" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
I20260709 12:14:55.530413 24988 raft_consensus.cc:697] T 7d2a60078de84a53aedeb20cdcd211a4 P ad362df39b114ec3a3a419128097b362 [term 1 LEADER]: Becoming Leader. State: Replica: ad362df39b114ec3a3a419128097b362, State: Running, Role: LEADER
I20260709 12:14:55.519886 25007 raft_consensus.cc:2749] T 6d6c85f42e284b06b8d1e7cee59f3dbc P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:55.535368 24350 raft_consensus.cc:3060] T 0f0c432146014cf099d66c95cde2ea1d P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:55.557189 24431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c00f77150f7475c94c4fd29c90805cd" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:55.546748 24903 consensus_queue.cc:1048] T 6d6c85f42e284b06b8d1e7cee59f3dbc P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
W20260709 12:14:55.561290 25006 log.cc:927] Time spent T bfba40ac52f842ca99dd4293619360af P cf2d8294ae68482ca4ffa8be051ad054: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 12:14:55.567333 24207 raft_consensus.cc:1275] T 06d0284e94354a2686c577372cceb2bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Refusing update from remote peer cf2d8294ae68482ca4ffa8be051ad054: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:14:55.583803 24989 leader_election.cc:290] T 0f0c432146014cf099d66c95cde2ea1d P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 election: Requested vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
W20260709 12:14:55.623530 24176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:34565, user_credentials={real_user=slave}} blocked reactor thread for 153559us
I20260709 12:14:55.627282 24432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0c432146014cf099d66c95cde2ea1d" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362"
I20260709 12:14:55.628054 24432 raft_consensus.cc:3060] T 0f0c432146014cf099d66c95cde2ea1d P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:55.659139 24210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c00f77150f7475c94c4fd29c90805cd" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
I20260709 12:14:55.658110 24433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9219abaaa2c34b08a24191512ff742bc" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:55.665073 24433 raft_consensus.cc:2468] T 9219abaaa2c34b08a24191512ff742bc P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 0.
I20260709 12:14:55.690788 24432 raft_consensus.cc:2468] T 0f0c432146014cf099d66c95cde2ea1d P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 1.
I20260709 12:14:55.693981 24249 leader_election.cc:304] T 0f0c432146014cf099d66c95cde2ea1d P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad362df39b114ec3a3a419128097b362, cf2d8294ae68482ca4ffa8be051ad054; no voters: 
I20260709 12:14:55.654510 24935 consensus_queue.cc:1048] T 558ced611e584b32ab838cceeb7cb410 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
I20260709 12:14:55.653448 24988 consensus_queue.cc:237] T 7d2a60078de84a53aedeb20cdcd211a4 P ad362df39b114ec3a3a419128097b362 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
W20260709 12:14:55.736989 24248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:38787, user_credentials={real_user=slave}} blocked reactor thread for 59817.7us
I20260709 12:14:55.766228 25016 consensus_queue.cc:1048] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.112s
W20260709 12:14:55.771363 24398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:46845, user_credentials={real_user=slave}} blocked reactor thread for 175030us
I20260709 12:14:55.785367 24481 tablet_bootstrap.cc:492] T 558ced611e584b32ab838cceeb7cb410 P aa14caefbdaa47b09abf91881635ba96: No bootstrap required, opened a new log
I20260709 12:14:55.786005 24481 ts_tablet_manager.cc:1403] T 558ced611e584b32ab838cceeb7cb410 P aa14caefbdaa47b09abf91881635ba96: Time spent bootstrapping tablet: real 0.677s	user 0.022s	sys 0.012s
I20260709 12:14:55.792484 24481 raft_consensus.cc:359] T 558ced611e584b32ab838cceeb7cb410 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:55.793234 24481 raft_consensus.cc:385] T 558ced611e584b32ab838cceeb7cb410 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:55.793515 24481 raft_consensus.cc:740] T 558ced611e584b32ab838cceeb7cb410 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Initialized, Role: FOLLOWER
I20260709 12:14:55.793802 24990 consensus_queue.cc:1048] T f9094185a2ad43d0b3a5174b165dab65 P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.080s
W20260709 12:14:55.796474 25020 log.cc:927] Time spent T 6d6c85f42e284b06b8d1e7cee59f3dbc P ad362df39b114ec3a3a419128097b362: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:14:55.808180 24939 raft_consensus.cc:2804] T 0f0c432146014cf099d66c95cde2ea1d P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:55.808980 24939 raft_consensus.cc:697] T 0f0c432146014cf099d66c95cde2ea1d P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Becoming Leader. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Running, Role: LEADER
I20260709 12:14:55.808125 24357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9219abaaa2c34b08a24191512ff742bc" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:55.776780 24992 consensus_queue.cc:1048] T 06d0284e94354a2686c577372cceb2bc P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.143s
I20260709 12:14:55.821379 24354 raft_consensus.cc:3060] T 2c00f77150f7475c94c4fd29c90805cd P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:55.831568 24939 consensus_queue.cc:237] T 0f0c432146014cf099d66c95cde2ea1d P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
W20260709 12:14:55.920806 24175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:46845, user_credentials={real_user=slave}} blocked reactor thread for 78104.5us
W20260709 12:14:55.922674 24174 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46467, user_credentials={real_user=slave}} blocked reactor thread for 261725us
I20260709 12:14:55.936370 24481 consensus_queue.cc:260] T 558ced611e584b32ab838cceeb7cb410 P aa14caefbdaa47b09abf91881635ba96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:55.954468 24174 leader_election.cc:304] T 9219abaaa2c34b08a24191512ff742bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, ad362df39b114ec3a3a419128097b362; no voters: 
W20260709 12:14:56.054746 25027 log.cc:927] Time spent T f841b9f0e82748d399b5eef243c442fc P 9bf3da5b54ef4a1ea1cee60f02ea2883: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
W20260709 12:14:56.054813 25037 log.cc:927] Time spent T 7d2a60078de84a53aedeb20cdcd211a4 P ad362df39b114ec3a3a419128097b362: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 12:14:55.984661 24350 raft_consensus.cc:2468] T 0f0c432146014cf099d66c95cde2ea1d P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 1.
I20260709 12:14:55.985283 24990 raft_consensus.cc:493] T bbab1a4afac94c1eaeb3ed35bc54408a P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:56.064224 24990 raft_consensus.cc:515] T bbab1a4afac94c1eaeb3ed35bc54408a P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:56.072575 24481 ts_tablet_manager.cc:1434] T 558ced611e584b32ab838cceeb7cb410 P aa14caefbdaa47b09abf91881635ba96: Time spent starting tablet: real 0.286s	user 0.010s	sys 0.000s
W20260709 12:14:56.075943 24250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:46845, user_credentials={real_user=slave}} blocked reactor thread for 227752us
I20260709 12:14:56.078672 24433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbab1a4afac94c1eaeb3ed35bc54408a" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:56.079802 24481 tablet_bootstrap.cc:492] T 9219abaaa2c34b08a24191512ff742bc P aa14caefbdaa47b09abf91881635ba96: Bootstrap starting.
I20260709 12:14:56.068259 24990 leader_election.cc:290] T bbab1a4afac94c1eaeb3ed35bc54408a P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
W20260709 12:14:56.083694 24174 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46467, user_credentials={real_user=slave}} blocked reactor thread for 129318us
I20260709 12:14:56.086264 25035 raft_consensus.cc:2804] T 9219abaaa2c34b08a24191512ff742bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:56.099200 24322 leader_election.cc:304] T 2c00f77150f7475c94c4fd29c90805cd P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, ad362df39b114ec3a3a419128097b362
I20260709 12:14:56.102134 25011 raft_consensus.cc:493] T 06d0284e94354a2686c577372cceb2bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:56.102727 25011 raft_consensus.cc:515] T 06d0284e94354a2686c577372cceb2bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:56.104979 25035 raft_consensus.cc:493] T 9219abaaa2c34b08a24191512ff742bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:56.105127 25011 leader_election.cc:290] T 06d0284e94354a2686c577372cceb2bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:14:56.105582 25035 raft_consensus.cc:3060] T 9219abaaa2c34b08a24191512ff742bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:56.111999 24481 tablet_bootstrap.cc:654] T 9219abaaa2c34b08a24191512ff742bc P aa14caefbdaa47b09abf91881635ba96: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:56.115489 25035 raft_consensus.cc:515] T 9219abaaa2c34b08a24191512ff742bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:56.117627 25035 leader_election.cc:290] T 9219abaaa2c34b08a24191512ff742bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 election: Requested vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:14:56.124749 25030 raft_consensus.cc:493] T 085a04f8ed724f82bc12490bbb1ceea7 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cf2d8294ae68482ca4ffa8be051ad054)
I20260709 12:14:56.125310 25030 raft_consensus.cc:515] T 085a04f8ed724f82bc12490bbb1ceea7 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:56.127625 25030 leader_election.cc:290] T 085a04f8ed724f82bc12490bbb1ceea7 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:14:56.130275 24209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbab1a4afac94c1eaeb3ed35bc54408a" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
I20260709 12:14:56.134722 24359 raft_consensus.cc:3060] T 558ced611e584b32ab838cceeb7cb410 P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:14:56.141480 24175 leader_election.cc:343] T 9219abaaa2c34b08a24191512ff742bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:56.154070 24353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9219abaaa2c34b08a24191512ff742bc" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
W20260709 12:14:56.173700 24175 leader_election.cc:343] T 9219abaaa2c34b08a24191512ff742bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:56.190528 24155 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:56.194507 25038 raft_consensus.cc:493] T f841b9f0e82748d399b5eef243c442fc P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:14:56.195158 25038 raft_consensus.cc:515] T f841b9f0e82748d399b5eef243c442fc P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:56.238812 24815 consensus_queue.cc:1048] T f9094185a2ad43d0b3a5174b165dab65 P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:56.167434 24282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d0284e94354a2686c577372cceb2bc" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
W20260709 12:14:56.252043 24250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:46845, user_credentials={real_user=slave}} blocked reactor thread for 162028us
I20260709 12:14:56.254954 24481 tablet_bootstrap.cc:492] T 9219abaaa2c34b08a24191512ff742bc P aa14caefbdaa47b09abf91881635ba96: No bootstrap required, opened a new log
W20260709 12:14:56.258783 24398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:46845, user_credentials={real_user=slave}} blocked reactor thread for 407040us
I20260709 12:14:56.260882 24481 ts_tablet_manager.cc:1403] T 9219abaaa2c34b08a24191512ff742bc P aa14caefbdaa47b09abf91881635ba96: Time spent bootstrapping tablet: real 0.183s	user 0.019s	sys 0.014s
W20260709 12:14:56.261608 24399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:34565, user_credentials={real_user=slave}} blocked reactor thread for 189407us
I20260709 12:14:56.265846 24249 leader_election.cc:304] T bbab1a4afac94c1eaeb3ed35bc54408a P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf2d8294ae68482ca4ffa8be051ad054; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, ad362df39b114ec3a3a419128097b362
I20260709 12:14:56.258610 24907 raft_consensus.cc:493] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:14:56.286664 24209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841b9f0e82748d399b5eef243c442fc" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
I20260709 12:14:56.299237 24907 raft_consensus.cc:515] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:56.321352 24429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06d0284e94354a2686c577372cceb2bc" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:56.323354 24429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a04f8ed724f82bc12490bbb1ceea7" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:56.326498 25038 leader_election.cc:290] T f841b9f0e82748d399b5eef243c442fc P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:14:56.330901 24174 leader_election.cc:304] T 06d0284e94354a2686c577372cceb2bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883; no voters: ad362df39b114ec3a3a419128097b362, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:14:56.321751 24907 leader_election.cc:290] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:56.347384 24875 raft_consensus.cc:2749] T 06d0284e94354a2686c577372cceb2bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:56.385545 24966 raft_consensus.cc:2749] T bbab1a4afac94c1eaeb3ed35bc54408a P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:56.386615 24481 raft_consensus.cc:359] T 9219abaaa2c34b08a24191512ff742bc P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:56.387409 24481 raft_consensus.cc:385] T 9219abaaa2c34b08a24191512ff742bc P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:56.387681 24481 raft_consensus.cc:740] T 9219abaaa2c34b08a24191512ff742bc P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Initialized, Role: FOLLOWER
I20260709 12:14:56.388391 24481 consensus_queue.cc:260] T 9219abaaa2c34b08a24191512ff742bc P aa14caefbdaa47b09abf91881635ba96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:56.391734 24481 ts_tablet_manager.cc:1434] T 9219abaaa2c34b08a24191512ff742bc P aa14caefbdaa47b09abf91881635ba96: Time spent starting tablet: real 0.130s	user 0.006s	sys 0.001s
I20260709 12:14:56.353574 25005 raft_consensus.cc:2749] T 2c00f77150f7475c94c4fd29c90805cd P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:56.410796 24207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477aafe049fa4b1182fb0afe55fe5e55" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
W20260709 12:14:56.413183 24399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:34565, user_credentials={real_user=slave}} blocked reactor thread for 49941.1us
W20260709 12:14:56.419936 24396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:38787, user_credentials={real_user=slave}} blocked reactor thread for 84191.5us
I20260709 12:14:56.421908 25007 raft_consensus.cc:493] T 4b1c850a65b748c093c5c88aa94fed71 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:14:56.453212 24425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9219abaaa2c34b08a24191512ff742bc" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362"
I20260709 12:14:56.454154 24425 raft_consensus.cc:3060] T 9219abaaa2c34b08a24191512ff742bc P ad362df39b114ec3a3a419128097b362 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:56.458106 25007 raft_consensus.cc:515] T 4b1c850a65b748c093c5c88aa94fed71 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:56.466641 25007 leader_election.cc:290] T 4b1c850a65b748c093c5c88aa94fed71 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:56.444551 24953 raft_consensus.cc:493] T 9cb931cb82d74add922e65a2ea3de34d P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:14:56.480525 24953 raft_consensus.cc:515] T 9cb931cb82d74add922e65a2ea3de34d P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:56.483103 24953 leader_election.cc:290] T 9cb931cb82d74add922e65a2ea3de34d P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:14:56.488847 24205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b1c850a65b748c093c5c88aa94fed71" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
I20260709 12:14:56.492583 24209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cb931cb82d74add922e65a2ea3de34d" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
I20260709 12:14:56.513419 24356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841b9f0e82748d399b5eef243c442fc" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
W20260709 12:14:56.509582 24323 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46467, user_credentials={real_user=slave}} blocked reactor thread for 91380us
I20260709 12:14:56.499325 24285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cb931cb82d74add922e65a2ea3de34d" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:56.517534 24399 leader_election.cc:304] T 9cb931cb82d74add922e65a2ea3de34d P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad362df39b114ec3a3a419128097b362; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:14:56.519594 24424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477aafe049fa4b1182fb0afe55fe5e55" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:56.529083 24428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b1c850a65b748c093c5c88aa94fed71" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:56.526794 24953 raft_consensus.cc:2749] T 9cb931cb82d74add922e65a2ea3de34d P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:56.540663 24250 leader_election.cc:304] T f841b9f0e82748d399b5eef243c442fc P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf2d8294ae68482ca4ffa8be051ad054; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, aa14caefbdaa47b09abf91881635ba96
I20260709 12:14:56.563446 24998 raft_consensus.cc:2749] T f841b9f0e82748d399b5eef243c442fc P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:56.568395 25048 consensus_queue.cc:1048] T 7d2a60078de84a53aedeb20cdcd211a4 P ad362df39b114ec3a3a419128097b362 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:56.574810 24425 raft_consensus.cc:2468] T 9219abaaa2c34b08a24191512ff742bc P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 1.
I20260709 12:14:56.580235 24283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a04f8ed724f82bc12490bbb1ceea7" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:56.593665 24176 leader_election.cc:304] T 085a04f8ed724f82bc12490bbb1ceea7 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883; no voters: ad362df39b114ec3a3a419128097b362, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:14:56.598493 24919 raft_consensus.cc:2749] T 085a04f8ed724f82bc12490bbb1ceea7 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:56.594264 24174 leader_election.cc:304] T 9219abaaa2c34b08a24191512ff742bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, ad362df39b114ec3a3a419128097b362; no voters: aa14caefbdaa47b09abf91881635ba96
I20260709 12:14:56.603921 24808 raft_consensus.cc:2804] T 9219abaaa2c34b08a24191512ff742bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:56.604539 24808 raft_consensus.cc:697] T 9219abaaa2c34b08a24191512ff742bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 LEADER]: Becoming Leader. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Running, Role: LEADER
I20260709 12:14:56.605473 24808 consensus_queue.cc:237] T 9219abaaa2c34b08a24191512ff742bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:56.620666 24910 raft_consensus.cc:493] T 9219abaaa2c34b08a24191512ff742bc P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:56.627547 24910 raft_consensus.cc:515] T 9219abaaa2c34b08a24191512ff742bc P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:56.632161 24205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9219abaaa2c34b08a24191512ff742bc" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
W20260709 12:14:56.635344 25060 log.cc:927] Time spent T f841b9f0e82748d399b5eef243c442fc P cf2d8294ae68482ca4ffa8be051ad054: Append to log took a long time: real 0.087s	user 0.002s	sys 0.000s
I20260709 12:14:56.647156 24107 catalog_manager.cc:5697] T 06d0284e94354a2686c577372cceb2bc P cf2d8294ae68482ca4ffa8be051ad054 reported cstate change: term changed from 0 to 2, leader changed from <none> to cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194). New cstate: current_term: 2 leader_uuid: "cf2d8294ae68482ca4ffa8be051ad054" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:56.652550 24107 catalog_manager.cc:5697] T f9094185a2ad43d0b3a5174b165dab65 P cf2d8294ae68482ca4ffa8be051ad054 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194). New cstate: current_term: 1 leader_uuid: "cf2d8294ae68482ca4ffa8be051ad054" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: HEALTHY } } }
W20260709 12:14:56.661718 24250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:46845, user_credentials={real_user=slave}} blocked reactor thread for 49972.7us
I20260709 12:14:56.643915 24910 leader_election.cc:290] T 9219abaaa2c34b08a24191512ff742bc P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
W20260709 12:14:56.694967 25064 log.cc:927] Time spent T 558ced611e584b32ab838cceeb7cb410 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
W20260709 12:14:56.659998 24323 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46467, user_credentials={real_user=slave}} blocked reactor thread for 45985.8us
I20260709 12:14:56.707615 24323 leader_election.cc:304] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, ad362df39b114ec3a3a419128097b362
I20260709 12:14:56.709065 24323 leader_election.cc:304] T 4b1c850a65b748c093c5c88aa94fed71 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, ad362df39b114ec3a3a419128097b362
I20260709 12:14:56.733222 24911 raft_consensus.cc:2749] T 4b1c850a65b748c093c5c88aa94fed71 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:56.734365 25013 raft_consensus.cc:2749] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:56.750753 24428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9219abaaa2c34b08a24191512ff742bc" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:56.768414 24428 raft_consensus.cc:2393] T 9219abaaa2c34b08a24191512ff742bc P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aa14caefbdaa47b09abf91881635ba96 in current term 1: Already voted for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in this term.
I20260709 12:14:56.776589 24323 leader_election.cc:304] T 9219abaaa2c34b08a24191512ff742bc P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, ad362df39b114ec3a3a419128097b362
I20260709 12:14:56.778384 24911 raft_consensus.cc:3060] T 9219abaaa2c34b08a24191512ff742bc P aa14caefbdaa47b09abf91881635ba96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:56.791831 24911 raft_consensus.cc:2749] T 9219abaaa2c34b08a24191512ff742bc P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:56.823493 24992 consensus_queue.cc:1048] T 0f0c432146014cf099d66c95cde2ea1d P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:56.830551 25025 consensus_queue.cc:1048] T 7d2a60078de84a53aedeb20cdcd211a4 P ad362df39b114ec3a3a419128097b362 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:14:56.894924 24175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:46845, user_credentials={real_user=slave}} blocked reactor thread for 46216.6us
I20260709 12:14:56.913168 24103 catalog_manager.cc:5697] T 7d2a60078de84a53aedeb20cdcd211a4 P ad362df39b114ec3a3a419128097b362 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad362df39b114ec3a3a419128097b362 (127.12.56.196). New cstate: current_term: 1 leader_uuid: "ad362df39b114ec3a3a419128097b362" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:56.936275 24108 catalog_manager.cc:5697] T 0f0c432146014cf099d66c95cde2ea1d P aa14caefbdaa47b09abf91881635ba96 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194). New cstate: current_term: 1 leader_uuid: "cf2d8294ae68482ca4ffa8be051ad054" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } }
I20260709 12:14:56.938150 24106 catalog_manager.cc:5697] T 9219abaaa2c34b08a24191512ff742bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193). New cstate: current_term: 1 leader_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:57.076295 25030 consensus_queue.cc:1048] T 9219abaaa2c34b08a24191512ff742bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:57.089558 25033 consensus_queue.cc:1048] T 9219abaaa2c34b08a24191512ff742bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:57.668991 12515 tablet_server.cc:179] TabletServer@127.12.56.193:0 shutting down...
W20260709 12:14:57.684969 24248 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:14:57.712041 24248 consensus_peers.cc:597] T c75afe0e0e00446aa6d220941d288eab P cf2d8294ae68482ca4ffa8be051ad054 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:57.735155 12515 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:57.736248 12515 tablet_replica.cc:333] T 9219abaaa2c34b08a24191512ff742bc P 9bf3da5b54ef4a1ea1cee60f02ea2883: stopping tablet replica
I20260709 12:14:57.737072 12515 raft_consensus.cc:2243] T 9219abaaa2c34b08a24191512ff742bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:57.738015 12515 raft_consensus.cc:2272] T 9219abaaa2c34b08a24191512ff742bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.740504 12515 tablet_replica.cc:333] T 7d2a60078de84a53aedeb20cdcd211a4 P 9bf3da5b54ef4a1ea1cee60f02ea2883: stopping tablet replica
I20260709 12:14:57.741320 12515 raft_consensus.cc:2243] T 7d2a60078de84a53aedeb20cdcd211a4 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:57.741909 12515 raft_consensus.cc:2272] T 7d2a60078de84a53aedeb20cdcd211a4 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.745412 12515 tablet_replica.cc:333] T f9094185a2ad43d0b3a5174b165dab65 P 9bf3da5b54ef4a1ea1cee60f02ea2883: stopping tablet replica
I20260709 12:14:57.746279 12515 raft_consensus.cc:2243] T f9094185a2ad43d0b3a5174b165dab65 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:57.746870 12515 raft_consensus.cc:2272] T f9094185a2ad43d0b3a5174b165dab65 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.749301 12515 tablet_replica.cc:333] T 2c00f77150f7475c94c4fd29c90805cd P 9bf3da5b54ef4a1ea1cee60f02ea2883: stopping tablet replica
W20260709 12:14:57.749753 24248 consensus_peers.cc:597] T 5310371490a542269db28e29d7adfffa P cf2d8294ae68482ca4ffa8be051ad054 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:57.750123 12515 raft_consensus.cc:2243] T 2c00f77150f7475c94c4fd29c90805cd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:57.750783 12515 raft_consensus.cc:2272] T 2c00f77150f7475c94c4fd29c90805cd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.753178 12515 tablet_replica.cc:333] T f841b9f0e82748d399b5eef243c442fc P 9bf3da5b54ef4a1ea1cee60f02ea2883: stopping tablet replica
I20260709 12:14:57.754128 12515 raft_consensus.cc:2243] T f841b9f0e82748d399b5eef243c442fc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:57.755252 12515 raft_consensus.cc:2272] T f841b9f0e82748d399b5eef243c442fc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.757259 12515 tablet_replica.cc:333] T d92a635ff6404268bd5e51d3b9681551 P 9bf3da5b54ef4a1ea1cee60f02ea2883: stopping tablet replica
I20260709 12:14:57.758028 12515 raft_consensus.cc:2243] T d92a635ff6404268bd5e51d3b9681551 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:57.758522 12515 raft_consensus.cc:2272] T d92a635ff6404268bd5e51d3b9681551 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.760838 12515 tablet_replica.cc:333] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883: stopping tablet replica
I20260709 12:14:57.761617 12515 raft_consensus.cc:2243] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:57.762727 12515 raft_consensus.cc:2272] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.765576 12515 tablet_replica.cc:333] T fa882381d669422a95ec60c9aefa8105 P 9bf3da5b54ef4a1ea1cee60f02ea2883: stopping tablet replica
I20260709 12:14:57.766507 12515 raft_consensus.cc:2243] T fa882381d669422a95ec60c9aefa8105 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:57.767714 12515 raft_consensus.cc:2272] T fa882381d669422a95ec60c9aefa8105 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.769938 12515 tablet_replica.cc:333] T 464c7ebd16cd488086ccaec23defbb33 P 9bf3da5b54ef4a1ea1cee60f02ea2883: stopping tablet replica
I20260709 12:14:57.770562 12515 raft_consensus.cc:2243] T 464c7ebd16cd488086ccaec23defbb33 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:57.771106 12515 raft_consensus.cc:2272] T 464c7ebd16cd488086ccaec23defbb33 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.773562 12515 tablet_replica.cc:333] T 356b14abd90d418cab44e524aef8154c P 9bf3da5b54ef4a1ea1cee60f02ea2883: stopping tablet replica
I20260709 12:14:57.774544 12515 raft_consensus.cc:2243] T 356b14abd90d418cab44e524aef8154c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:57.775493 12515 raft_consensus.cc:2272] T 356b14abd90d418cab44e524aef8154c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.778415 12515 tablet_replica.cc:333] T bfba40ac52f842ca99dd4293619360af P 9bf3da5b54ef4a1ea1cee60f02ea2883: stopping tablet replica
I20260709 12:14:57.779310 12515 raft_consensus.cc:2243] T bfba40ac52f842ca99dd4293619360af P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:57.779948 12515 raft_consensus.cc:2272] T bfba40ac52f842ca99dd4293619360af P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:57.781494 24396 consensus_peers.cc:597] T 7d2a60078de84a53aedeb20cdcd211a4 P ad362df39b114ec3a3a419128097b362 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:57.782632 12515 tablet_replica.cc:333] T 3fe3be6bb3264475ba597fec30a06f6c P 9bf3da5b54ef4a1ea1cee60f02ea2883: stopping tablet replica
W20260709 12:14:57.783170 24396 consensus_peers.cc:597] T fd6e20f3c92f4498a8c272b807797efa P ad362df39b114ec3a3a419128097b362 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:57.783561 12515 raft_consensus.cc:2243] T 3fe3be6bb3264475ba597fec30a06f6c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:57.784130 12515 raft_consensus.cc:2272] T 3fe3be6bb3264475ba597fec30a06f6c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:57.786417 24396 consensus_peers.cc:597] T 4f756e6bcc20458b8748cd090cd3fce2 P ad362df39b114ec3a3a419128097b362 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:57.786653 12515 tablet_replica.cc:333] T 9cb931cb82d74add922e65a2ea3de34d P 9bf3da5b54ef4a1ea1cee60f02ea2883: stopping tablet replica
I20260709 12:14:57.787351 12515 raft_consensus.cc:2243] T 9cb931cb82d74add922e65a2ea3de34d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:57.788259 12515 raft_consensus.cc:2272] T 9cb931cb82d74add922e65a2ea3de34d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.790452 12515 tablet_replica.cc:333] T b1e1c3b597fd49b2831e5f523149b2dc P 9bf3da5b54ef4a1ea1cee60f02ea2883: stopping tablet replica
I20260709 12:14:57.791098 12515 raft_consensus.cc:2243] T b1e1c3b597fd49b2831e5f523149b2dc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:57.791576 12515 raft_consensus.cc:2272] T b1e1c3b597fd49b2831e5f523149b2dc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.793845 12515 tablet_replica.cc:333] T b98a35cf96ba4562b4933543b1e4efb9 P 9bf3da5b54ef4a1ea1cee60f02ea2883: stopping tablet replica
I20260709 12:14:57.794734 12515 raft_consensus.cc:2243] T b98a35cf96ba4562b4933543b1e4efb9 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:57.795749 12515 raft_consensus.cc:2272] T b98a35cf96ba4562b4933543b1e4efb9 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.797999 12515 tablet_replica.cc:333] T 5310371490a542269db28e29d7adfffa P 9bf3da5b54ef4a1ea1cee60f02ea2883: stopping tablet replica
I20260709 12:14:57.798636 12515 raft_consensus.cc:2243] T 5310371490a542269db28e29d7adfffa P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:57.799062 12515 raft_consensus.cc:2272] T 5310371490a542269db28e29d7adfffa P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.800892 12515 tablet_replica.cc:333] T b727e95d8f5843a3bb0d7cbddce61bdb P 9bf3da5b54ef4a1ea1cee60f02ea2883: stopping tablet replica
I20260709 12:14:57.801518 12515 raft_consensus.cc:2243] T b727e95d8f5843a3bb0d7cbddce61bdb P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:57.801982 12515 raft_consensus.cc:2272] T b727e95d8f5843a3bb0d7cbddce61bdb P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.804008 12515 tablet_replica.cc:333] T ed15c59b19ff49d3a39bf5b5abf8b69a P 9bf3da5b54ef4a1ea1cee60f02ea2883: stopping tablet replica
I20260709 12:14:57.804615 12515 raft_consensus.cc:2243] T ed15c59b19ff49d3a39bf5b5abf8b69a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:57.805419 12515 raft_consensus.cc:2272] T ed15c59b19ff49d3a39bf5b5abf8b69a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.808060 12515 tablet_replica.cc:333] T 4f756e6bcc20458b8748cd090cd3fce2 P 9bf3da5b54ef4a1ea1cee60f02ea2883: stopping tablet replica
I20260709 12:14:57.809019 12515 raft_consensus.cc:2243] T 4f756e6bcc20458b8748cd090cd3fce2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:57.809542 12515 raft_consensus.cc:2272] T 4f756e6bcc20458b8748cd090cd3fce2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.811916 12515 tablet_replica.cc:333] T ba38e800dd034ff8b7fda6701973510b P 9bf3da5b54ef4a1ea1cee60f02ea2883: stopping tablet replica
I20260709 12:14:57.812717 12515 raft_consensus.cc:2243] T ba38e800dd034ff8b7fda6701973510b P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:14:57.813059 24248 consensus_peers.cc:597] T 356b14abd90d418cab44e524aef8154c P cf2d8294ae68482ca4ffa8be051ad054 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:57.813273 12515 raft_consensus.cc:2272] T ba38e800dd034ff8b7fda6701973510b P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.816502 12515 tablet_replica.cc:333] T c75afe0e0e00446aa6d220941d288eab P 9bf3da5b54ef4a1ea1cee60f02ea2883: stopping tablet replica
I20260709 12:14:57.817337 12515 raft_consensus.cc:2243] T c75afe0e0e00446aa6d220941d288eab P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:57.817898 12515 raft_consensus.cc:2272] T c75afe0e0e00446aa6d220941d288eab P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.820185 12515 tablet_replica.cc:333] T 318c217e16874865bd6dff6bd4d8cd4f P 9bf3da5b54ef4a1ea1cee60f02ea2883: stopping tablet replica
I20260709 12:14:57.820896 12515 raft_consensus.cc:2243] T 318c217e16874865bd6dff6bd4d8cd4f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:57.821697 12515 raft_consensus.cc:2272] T 318c217e16874865bd6dff6bd4d8cd4f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.824047 12515 tablet_replica.cc:333] T d10519ad64d948b09186e335ed06257d P 9bf3da5b54ef4a1ea1cee60f02ea2883: stopping tablet replica
I20260709 12:14:57.824663 12515 raft_consensus.cc:2243] T d10519ad64d948b09186e335ed06257d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:57.825591 12515 raft_consensus.cc:2272] T d10519ad64d948b09186e335ed06257d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:57.826918 24396 consensus_peers.cc:597] T 95d3180f4ab5472d9de6e220219e7898 P ad362df39b114ec3a3a419128097b362 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:57.827961 12515 tablet_replica.cc:333] T 6af96d3f7393445f8b7edb30a26a6f65 P 9bf3da5b54ef4a1ea1cee60f02ea2883: stopping tablet replica
I20260709 12:14:57.828900 12515 raft_consensus.cc:2243] T 6af96d3f7393445f8b7edb30a26a6f65 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:57.829454 12515 raft_consensus.cc:2272] T 6af96d3f7393445f8b7edb30a26a6f65 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.831813 12515 tablet_replica.cc:333] T 085a04f8ed724f82bc12490bbb1ceea7 P 9bf3da5b54ef4a1ea1cee60f02ea2883: stopping tablet replica
I20260709 12:14:57.832576 12515 raft_consensus.cc:2243] T 085a04f8ed724f82bc12490bbb1ceea7 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:57.833087 12515 raft_consensus.cc:2272] T 085a04f8ed724f82bc12490bbb1ceea7 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.835599 12515 tablet_replica.cc:333] T 7cbef09353144c0b9a9ebf7731fd019f P 9bf3da5b54ef4a1ea1cee60f02ea2883: stopping tablet replica
W20260709 12:14:57.835988 24396 consensus_peers.cc:597] T 2c00f77150f7475c94c4fd29c90805cd P ad362df39b114ec3a3a419128097b362 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:57.836386 12515 raft_consensus.cc:2243] T 7cbef09353144c0b9a9ebf7731fd019f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:57.837450 12515 raft_consensus.cc:2272] T 7cbef09353144c0b9a9ebf7731fd019f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.839679 12515 tablet_replica.cc:333] T 8996365fa46548d49f3b3bafe14e9c83 P 9bf3da5b54ef4a1ea1cee60f02ea2883: stopping tablet replica
I20260709 12:14:57.840313 12515 raft_consensus.cc:2243] T 8996365fa46548d49f3b3bafe14e9c83 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:57.840757 12515 raft_consensus.cc:2272] T 8996365fa46548d49f3b3bafe14e9c83 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.842725 12515 tablet_replica.cc:333] T 628105dfc534451285d72f9e17f5d4f3 P 9bf3da5b54ef4a1ea1cee60f02ea2883: stopping tablet replica
I20260709 12:14:57.843587 12515 raft_consensus.cc:2243] T 628105dfc534451285d72f9e17f5d4f3 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:57.844095 12515 raft_consensus.cc:2272] T 628105dfc534451285d72f9e17f5d4f3 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:57.845562 24322 consensus_peers.cc:597] T cf280984dcfc44039a942819e8df951c P aa14caefbdaa47b09abf91881635ba96 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:57.846724 12515 tablet_replica.cc:333] T 99329004ca1c4c76a3a2dd4567ef15dd P 9bf3da5b54ef4a1ea1cee60f02ea2883: stopping tablet replica
I20260709 12:14:57.847666 12515 raft_consensus.cc:2243] T 99329004ca1c4c76a3a2dd4567ef15dd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:57.848234 12515 raft_consensus.cc:2272] T 99329004ca1c4c76a3a2dd4567ef15dd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.850842 12515 tablet_replica.cc:333] T 27de4156b2e24143a2f301fbefc7cb23 P 9bf3da5b54ef4a1ea1cee60f02ea2883: stopping tablet replica
I20260709 12:14:57.851485 12515 raft_consensus.cc:2243] T 27de4156b2e24143a2f301fbefc7cb23 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:57.851979 12515 raft_consensus.cc:2272] T 27de4156b2e24143a2f301fbefc7cb23 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.854139 12515 tablet_replica.cc:333] T e05eec364f764114bdb814096b9bf0ce P 9bf3da5b54ef4a1ea1cee60f02ea2883: stopping tablet replica
I20260709 12:14:57.854729 12515 raft_consensus.cc:2243] T e05eec364f764114bdb814096b9bf0ce P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:57.855269 12515 raft_consensus.cc:2272] T e05eec364f764114bdb814096b9bf0ce P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.857322 12515 tablet_replica.cc:333] T 49b141610080476a8e5f0415c370e8cd P 9bf3da5b54ef4a1ea1cee60f02ea2883: stopping tablet replica
I20260709 12:14:57.858072 12515 raft_consensus.cc:2243] T 49b141610080476a8e5f0415c370e8cd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:57.858647 12515 raft_consensus.cc:2272] T 49b141610080476a8e5f0415c370e8cd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.861143 12515 tablet_replica.cc:333] T cf280984dcfc44039a942819e8df951c P 9bf3da5b54ef4a1ea1cee60f02ea2883: stopping tablet replica
I20260709 12:14:57.861995 12515 raft_consensus.cc:2243] T cf280984dcfc44039a942819e8df951c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:57.862581 12515 raft_consensus.cc:2272] T cf280984dcfc44039a942819e8df951c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:57.863396 24396 consensus_peers.cc:597] T 6af96d3f7393445f8b7edb30a26a6f65 P ad362df39b114ec3a3a419128097b362 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:57.865319 12515 tablet_replica.cc:333] T fd6e20f3c92f4498a8c272b807797efa P 9bf3da5b54ef4a1ea1cee60f02ea2883: stopping tablet replica
W20260709 12:14:57.865996 24248 consensus_peers.cc:597] T 67c0216443004287861015dd30ae5144 P cf2d8294ae68482ca4ffa8be051ad054 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:57.866247 12515 raft_consensus.cc:2243] T fd6e20f3c92f4498a8c272b807797efa P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:57.866863 12515 raft_consensus.cc:2272] T fd6e20f3c92f4498a8c272b807797efa P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.869645 12515 tablet_replica.cc:333] T 558ced611e584b32ab838cceeb7cb410 P 9bf3da5b54ef4a1ea1cee60f02ea2883: stopping tablet replica
I20260709 12:14:57.870438 12515 raft_consensus.cc:2243] T 558ced611e584b32ab838cceeb7cb410 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:57.871332 12515 raft_consensus.cc:2272] T 558ced611e584b32ab838cceeb7cb410 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.873765 12515 tablet_replica.cc:333] T a18e73ef976b49f0878423c0b3e6e6f2 P 9bf3da5b54ef4a1ea1cee60f02ea2883: stopping tablet replica
I20260709 12:14:57.874423 12515 raft_consensus.cc:2243] T a18e73ef976b49f0878423c0b3e6e6f2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:57.875187 12515 raft_consensus.cc:2272] T a18e73ef976b49f0878423c0b3e6e6f2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.877218 12515 tablet_replica.cc:333] T ab8dff607862460ea0fcd88422c31ac2 P 9bf3da5b54ef4a1ea1cee60f02ea2883: stopping tablet replica
I20260709 12:14:57.877992 12515 raft_consensus.cc:2243] T ab8dff607862460ea0fcd88422c31ac2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:57.879046 12515 raft_consensus.cc:2272] T ab8dff607862460ea0fcd88422c31ac2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.881636 12515 tablet_replica.cc:333] T 7943c68d21d449dba2d1dca6ddde5820 P 9bf3da5b54ef4a1ea1cee60f02ea2883: stopping tablet replica
W20260709 12:14:57.881650 24248 consensus_peers.cc:597] T f9094185a2ad43d0b3a5174b165dab65 P cf2d8294ae68482ca4ffa8be051ad054 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:57.882553 12515 raft_consensus.cc:2243] T 7943c68d21d449dba2d1dca6ddde5820 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:57.883523 12515 raft_consensus.cc:2272] T 7943c68d21d449dba2d1dca6ddde5820 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.885870 12515 tablet_replica.cc:333] T 4b1c850a65b748c093c5c88aa94fed71 P 9bf3da5b54ef4a1ea1cee60f02ea2883: stopping tablet replica
I20260709 12:14:57.886442 12515 raft_consensus.cc:2243] T 4b1c850a65b748c093c5c88aa94fed71 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:57.887295 12515 raft_consensus.cc:2272] T 4b1c850a65b748c093c5c88aa94fed71 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.890102 12515 tablet_replica.cc:333] T 477aafe049fa4b1182fb0afe55fe5e55 P 9bf3da5b54ef4a1ea1cee60f02ea2883: stopping tablet replica
I20260709 12:14:57.890862 12515 raft_consensus.cc:2243] T 477aafe049fa4b1182fb0afe55fe5e55 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:57.891899 12515 raft_consensus.cc:2272] T 477aafe049fa4b1182fb0afe55fe5e55 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:57.892270 24396 consensus_peers.cc:597] T b727e95d8f5843a3bb0d7cbddce61bdb P ad362df39b114ec3a3a419128097b362 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:57.892827 24248 consensus_peers.cc:597] T bfba40ac52f842ca99dd4293619360af P cf2d8294ae68482ca4ffa8be051ad054 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:57.894811 12515 tablet_replica.cc:333] T 67c0216443004287861015dd30ae5144 P 9bf3da5b54ef4a1ea1cee60f02ea2883: stopping tablet replica
I20260709 12:14:57.895488 12515 raft_consensus.cc:2243] T 67c0216443004287861015dd30ae5144 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:57.895864 12515 raft_consensus.cc:2272] T 67c0216443004287861015dd30ae5144 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.897933 12515 tablet_replica.cc:333] T 95d3180f4ab5472d9de6e220219e7898 P 9bf3da5b54ef4a1ea1cee60f02ea2883: stopping tablet replica
I20260709 12:14:57.898691 12515 raft_consensus.cc:2243] T 95d3180f4ab5472d9de6e220219e7898 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:57.899159 12515 raft_consensus.cc:2272] T 95d3180f4ab5472d9de6e220219e7898 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.901677 12515 tablet_replica.cc:333] T 133e492e820f4152ad30562c343b617d P 9bf3da5b54ef4a1ea1cee60f02ea2883: stopping tablet replica
I20260709 12:14:57.902447 12515 raft_consensus.cc:2243] T 133e492e820f4152ad30562c343b617d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:57.903571 12515 raft_consensus.cc:2272] T 133e492e820f4152ad30562c343b617d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.906414 12515 tablet_replica.cc:333] T 06d0284e94354a2686c577372cceb2bc P 9bf3da5b54ef4a1ea1cee60f02ea2883: stopping tablet replica
I20260709 12:14:57.906988 12515 raft_consensus.cc:2243] T 06d0284e94354a2686c577372cceb2bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:14:57.907209 24322 consensus_peers.cc:597] T ba38e800dd034ff8b7fda6701973510b P aa14caefbdaa47b09abf91881635ba96 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:57.907517 12515 raft_consensus.cc:2272] T 06d0284e94354a2686c577372cceb2bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:57.909693 12515 tablet_replica.cc:333] T 0d31cf2c4a7849d9a798bf886e7fc997 P 9bf3da5b54ef4a1ea1cee60f02ea2883: stopping tablet replica
I20260709 12:14:57.910368 12515 raft_consensus.cc:2243] T 0d31cf2c4a7849d9a798bf886e7fc997 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:57.910800 12515 raft_consensus.cc:2272] T 0d31cf2c4a7849d9a798bf886e7fc997 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:57.917683 24396 consensus_peers.cc:597] T 8996365fa46548d49f3b3bafe14e9c83 P ad362df39b114ec3a3a419128097b362 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:57.925534 24396 consensus_peers.cc:597] T e05eec364f764114bdb814096b9bf0ce P ad362df39b114ec3a3a419128097b362 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:57.940783 24396 consensus_peers.cc:597] T d92a635ff6404268bd5e51d3b9681551 P ad362df39b114ec3a3a419128097b362 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:57.986737 12515 tablet_server.cc:196] TabletServer@127.12.56.193:0 shutdown complete.
W20260709 12:14:57.998263 24322 consensus_peers.cc:597] T 464c7ebd16cd488086ccaec23defbb33 P aa14caefbdaa47b09abf91881635ba96 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:58.026938 24248 consensus_peers.cc:597] T 99329004ca1c4c76a3a2dd4567ef15dd P cf2d8294ae68482ca4ffa8be051ad054 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:58.064709 24248 consensus_peers.cc:597] T 085a04f8ed724f82bc12490bbb1ceea7 P cf2d8294ae68482ca4ffa8be051ad054 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:58.071579 12515 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:58.075994 24248 consensus_peers.cc:597] T 0d31cf2c4a7849d9a798bf886e7fc997 P cf2d8294ae68482ca4ffa8be051ad054 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:58.080042 25085 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:58.080457 25086 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:58.082602 25088 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:58.083257 12515 server_base.cc:1061] running on GCE node
I20260709 12:14:58.088792 12515 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:58.089131 12515 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:58.089380 12515 hybrid_clock.cc:648] HybridClock initialized: now 1783599298089364 us; error 0 us; skew 500 ppm
I20260709 12:14:58.090039 12515 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:58.093024 12515 webserver.cc:533] Webserver started at http://127.12.56.193:43503/ using document root <none> and password file <none>
I20260709 12:14:58.093600 12515 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:58.093856 12515 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:14:58.098480 12515 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.002s	sys 0.002s
I20260709 12:14:58.107621 25093 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:58.108657 12515 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.001s
I20260709 12:14:58.109122 12515 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894707649-12515-0/minicluster-data/ts-0-root
uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
format_stamp: "Formatted at 2026-07-09 12:14:42 on dist-test-slave-705g"
I20260709 12:14:58.109537 12515 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894707649-12515-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894707649-12515-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894707649-12515-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 12:14:58.128343 24248 consensus_peers.cc:597] T 49b141610080476a8e5f0415c370e8cd P cf2d8294ae68482ca4ffa8be051ad054 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:58.130477 12515 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:58.132323 12515 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:58.134330 12515 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:58.139202 25100 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 12:14:58.160465 24322 consensus_peers.cc:597] T 27de4156b2e24143a2f301fbefc7cb23 P aa14caefbdaa47b09abf91881635ba96 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:58.162395 24248 consensus_peers.cc:597] T 06d0284e94354a2686c577372cceb2bc P cf2d8294ae68482ca4ffa8be051ad054 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:58.167438 24248 consensus_peers.cc:597] T 628105dfc534451285d72f9e17f5d4f3 P cf2d8294ae68482ca4ffa8be051ad054 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:58.175995 24248 consensus_peers.cc:597] T 3fe3be6bb3264475ba597fec30a06f6c P cf2d8294ae68482ca4ffa8be051ad054 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:58.246790 24248 consensus_peers.cc:597] T b1e1c3b597fd49b2831e5f523149b2dc P cf2d8294ae68482ca4ffa8be051ad054 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:58.508379 12515 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 12:14:58.508841 12515 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.371s	user 0.008s	sys 0.000s
I20260709 12:14:58.509222 12515 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 12:14:58.516902 25100 tablet_bootstrap.cc:492] T 49b141610080476a8e5f0415c370e8cd P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:14:58.541355 25100 tablet_bootstrap.cc:492] T 49b141610080476a8e5f0415c370e8cd P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:58.542263 25100 tablet_bootstrap.cc:492] T 49b141610080476a8e5f0415c370e8cd P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap complete.
I20260709 12:14:58.542843 25100 ts_tablet_manager.cc:1403] T 49b141610080476a8e5f0415c370e8cd P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.012s
I20260709 12:14:58.544790 25100 raft_consensus.cc:359] T 49b141610080476a8e5f0415c370e8cd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:58.545738 25100 raft_consensus.cc:740] T 49b141610080476a8e5f0415c370e8cd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:14:58.546624 25100 consensus_queue.cc:260] T 49b141610080476a8e5f0415c370e8cd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:58.551822 25100 ts_tablet_manager.cc:1434] T 49b141610080476a8e5f0415c370e8cd P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.009s
I20260709 12:14:58.552573 25100 tablet_bootstrap.cc:492] T bfba40ac52f842ca99dd4293619360af P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:14:58.566987 25100 tablet_bootstrap.cc:492] T bfba40ac52f842ca99dd4293619360af P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:58.567860 25100 tablet_bootstrap.cc:492] T bfba40ac52f842ca99dd4293619360af P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap complete.
I20260709 12:14:58.568531 25100 ts_tablet_manager.cc:1403] T bfba40ac52f842ca99dd4293619360af P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 12:14:58.570931 25100 raft_consensus.cc:359] T bfba40ac52f842ca99dd4293619360af P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:58.571707 25100 raft_consensus.cc:740] T bfba40ac52f842ca99dd4293619360af P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:14:58.572431 25100 consensus_queue.cc:260] T bfba40ac52f842ca99dd4293619360af P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:58.574375 25100 ts_tablet_manager.cc:1434] T bfba40ac52f842ca99dd4293619360af P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:14:58.575218 25100 tablet_bootstrap.cc:492] T 628105dfc534451285d72f9e17f5d4f3 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:14:58.588975 25100 tablet_bootstrap.cc:492] T 628105dfc534451285d72f9e17f5d4f3 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:58.589977 25100 tablet_bootstrap.cc:492] T 628105dfc534451285d72f9e17f5d4f3 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap complete.
I20260709 12:14:58.590766 25100 ts_tablet_manager.cc:1403] T 628105dfc534451285d72f9e17f5d4f3 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.016s	user 0.006s	sys 0.008s
I20260709 12:14:58.593518 25100 raft_consensus.cc:359] T 628105dfc534451285d72f9e17f5d4f3 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:58.594368 25100 raft_consensus.cc:740] T 628105dfc534451285d72f9e17f5d4f3 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:14:58.595089 25100 consensus_queue.cc:260] T 628105dfc534451285d72f9e17f5d4f3 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:58.597123 25100 ts_tablet_manager.cc:1434] T 628105dfc534451285d72f9e17f5d4f3 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:14:58.598001 25100 tablet_bootstrap.cc:492] T 7cbef09353144c0b9a9ebf7731fd019f P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:14:58.614379 25100 tablet_bootstrap.cc:492] T 7cbef09353144c0b9a9ebf7731fd019f P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:58.615248 25100 tablet_bootstrap.cc:492] T 7cbef09353144c0b9a9ebf7731fd019f P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap complete.
I20260709 12:14:58.615885 25100 ts_tablet_manager.cc:1403] T 7cbef09353144c0b9a9ebf7731fd019f P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.004s
I20260709 12:14:58.617888 25100 raft_consensus.cc:359] T 7cbef09353144c0b9a9ebf7731fd019f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:58.618458 25100 raft_consensus.cc:740] T 7cbef09353144c0b9a9ebf7731fd019f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:14:58.619128 25100 consensus_queue.cc:260] T 7cbef09353144c0b9a9ebf7731fd019f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:58.620720 25100 ts_tablet_manager.cc:1434] T 7cbef09353144c0b9a9ebf7731fd019f P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:14:58.621411 25100 tablet_bootstrap.cc:492] T 477aafe049fa4b1182fb0afe55fe5e55 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:14:58.644061 25100 tablet_bootstrap.cc:492] T 477aafe049fa4b1182fb0afe55fe5e55 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:58.645283 25100 tablet_bootstrap.cc:492] T 477aafe049fa4b1182fb0afe55fe5e55 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap complete.
I20260709 12:14:58.646056 25100 ts_tablet_manager.cc:1403] T 477aafe049fa4b1182fb0afe55fe5e55 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.008s
I20260709 12:14:58.648057 25100 raft_consensus.cc:359] T 477aafe049fa4b1182fb0afe55fe5e55 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:58.648653 25100 raft_consensus.cc:740] T 477aafe049fa4b1182fb0afe55fe5e55 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:14:58.649341 25100 consensus_queue.cc:260] T 477aafe049fa4b1182fb0afe55fe5e55 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:58.651014 25100 ts_tablet_manager.cc:1434] T 477aafe049fa4b1182fb0afe55fe5e55 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.004s
I20260709 12:14:58.651845 25100 tablet_bootstrap.cc:492] T 5310371490a542269db28e29d7adfffa P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:14:58.677553 25100 tablet_bootstrap.cc:492] T 5310371490a542269db28e29d7adfffa P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:58.678707 25100 tablet_bootstrap.cc:492] T 5310371490a542269db28e29d7adfffa P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap complete.
I20260709 12:14:58.679414 25100 ts_tablet_manager.cc:1403] T 5310371490a542269db28e29d7adfffa P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.028s	user 0.019s	sys 0.000s
I20260709 12:14:58.682047 25100 raft_consensus.cc:359] T 5310371490a542269db28e29d7adfffa P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:58.682754 25100 raft_consensus.cc:740] T 5310371490a542269db28e29d7adfffa P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:14:58.683507 25100 consensus_queue.cc:260] T 5310371490a542269db28e29d7adfffa P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:58.685245 25100 ts_tablet_manager.cc:1434] T 5310371490a542269db28e29d7adfffa P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:14:58.686168 25100 tablet_bootstrap.cc:492] T cf280984dcfc44039a942819e8df951c P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:14:58.708770 25100 tablet_bootstrap.cc:492] T cf280984dcfc44039a942819e8df951c P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:58.709690 25100 tablet_bootstrap.cc:492] T cf280984dcfc44039a942819e8df951c P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap complete.
I20260709 12:14:58.710515 25100 ts_tablet_manager.cc:1403] T cf280984dcfc44039a942819e8df951c P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.025s	user 0.018s	sys 0.003s
I20260709 12:14:58.712783 25100 raft_consensus.cc:359] T cf280984dcfc44039a942819e8df951c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:58.713500 25100 raft_consensus.cc:740] T cf280984dcfc44039a942819e8df951c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:14:58.714239 25100 consensus_queue.cc:260] T cf280984dcfc44039a942819e8df951c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:58.716313 25100 ts_tablet_manager.cc:1434] T cf280984dcfc44039a942819e8df951c P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:14:58.717176 25100 tablet_bootstrap.cc:492] T 7d2a60078de84a53aedeb20cdcd211a4 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:14:58.720036 25107 raft_consensus.cc:493] T d10519ad64d948b09186e335ed06257d P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:14:58.720681 25107 raft_consensus.cc:515] T d10519ad64d948b09186e335ed06257d P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:58.724804 24428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10519ad64d948b09186e335ed06257d" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:58.728657 25107 leader_election.cc:290] T d10519ad64d948b09186e335ed06257d P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
W20260709 12:14:58.730620 24248 leader_election.cc:336] T d10519ad64d948b09186e335ed06257d P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:14:58.731199 24248 leader_election.cc:304] T d10519ad64d948b09186e335ed06257d P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf2d8294ae68482ca4ffa8be051ad054; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, ad362df39b114ec3a3a419128097b362
I20260709 12:14:58.734755 25107 raft_consensus.cc:2749] T d10519ad64d948b09186e335ed06257d P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:58.746515 25100 tablet_bootstrap.cc:492] T 7d2a60078de84a53aedeb20cdcd211a4 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:58.747591 25100 tablet_bootstrap.cc:492] T 7d2a60078de84a53aedeb20cdcd211a4 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap complete.
I20260709 12:14:58.748267 25100 ts_tablet_manager.cc:1403] T 7d2a60078de84a53aedeb20cdcd211a4 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.031s	user 0.018s	sys 0.008s
I20260709 12:14:58.752315 25100 raft_consensus.cc:359] T 7d2a60078de84a53aedeb20cdcd211a4 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:58.753037 25100 raft_consensus.cc:740] T 7d2a60078de84a53aedeb20cdcd211a4 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:14:58.753875 25100 consensus_queue.cc:260] T 7d2a60078de84a53aedeb20cdcd211a4 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:58.755869 25100 ts_tablet_manager.cc:1434] T 7d2a60078de84a53aedeb20cdcd211a4 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:14:58.756681 25100 tablet_bootstrap.cc:492] T 3fe3be6bb3264475ba597fec30a06f6c P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:14:58.761307 25104 raft_consensus.cc:493] T ed15c59b19ff49d3a39bf5b5abf8b69a P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:14:58.761958 25104 raft_consensus.cc:515] T ed15c59b19ff49d3a39bf5b5abf8b69a P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:58.764271 25104 leader_election.cc:290] T ed15c59b19ff49d3a39bf5b5abf8b69a P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:58.768641 12515 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 12:14:58.768102 24352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed15c59b19ff49d3a39bf5b5abf8b69a" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:58.769706 12515 ts_tablet_manager.cc:595] Time spent register tablets: real 0.260s	user 0.259s	sys 0.000s
I20260709 12:14:58.782418 25100 tablet_bootstrap.cc:492] T 3fe3be6bb3264475ba597fec30a06f6c P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:58.783468 25100 tablet_bootstrap.cc:492] T 3fe3be6bb3264475ba597fec30a06f6c P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap complete.
I20260709 12:14:58.784099 25100 ts_tablet_manager.cc:1403] T 3fe3be6bb3264475ba597fec30a06f6c P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.000s
I20260709 12:14:58.786768 25100 raft_consensus.cc:359] T 3fe3be6bb3264475ba597fec30a06f6c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:58.787703 25100 raft_consensus.cc:740] T 3fe3be6bb3264475ba597fec30a06f6c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:14:58.788830 25100 consensus_queue.cc:260] T 3fe3be6bb3264475ba597fec30a06f6c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:58.791539 25100 ts_tablet_manager.cc:1434] T 3fe3be6bb3264475ba597fec30a06f6c P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:14:58.792490 25100 tablet_bootstrap.cc:492] T f9094185a2ad43d0b3a5174b165dab65 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:14:58.812204 25107 raft_consensus.cc:493] T 318c217e16874865bd6dff6bd4d8cd4f P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:14:58.812994 25107 raft_consensus.cc:515] T 318c217e16874865bd6dff6bd4d8cd4f P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:58.817200 25100 tablet_bootstrap.cc:492] T f9094185a2ad43d0b3a5174b165dab65 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:58.818318 25100 tablet_bootstrap.cc:492] T f9094185a2ad43d0b3a5174b165dab65 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap complete.
I20260709 12:14:58.819084 25100 ts_tablet_manager.cc:1403] T f9094185a2ad43d0b3a5174b165dab65 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.027s	user 0.019s	sys 0.003s
I20260709 12:14:58.822718 25100 raft_consensus.cc:359] T f9094185a2ad43d0b3a5174b165dab65 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:58.823489 25100 raft_consensus.cc:740] T f9094185a2ad43d0b3a5174b165dab65 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:14:58.824299 25100 consensus_queue.cc:260] T f9094185a2ad43d0b3a5174b165dab65 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:58.826687 25100 ts_tablet_manager.cc:1434] T f9094185a2ad43d0b3a5174b165dab65 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:14:58.827497 25100 tablet_bootstrap.cc:492] T 085a04f8ed724f82bc12490bbb1ceea7 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
W20260709 12:14:58.834544 24248 leader_election.cc:336] T 318c217e16874865bd6dff6bd4d8cd4f P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:14:58.837020 25107 leader_election.cc:290] T 318c217e16874865bd6dff6bd4d8cd4f P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:58.840792 24425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318c217e16874865bd6dff6bd4d8cd4f" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:58.847874 25100 tablet_bootstrap.cc:492] T 085a04f8ed724f82bc12490bbb1ceea7 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:58.848946 25100 tablet_bootstrap.cc:492] T 085a04f8ed724f82bc12490bbb1ceea7 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap complete.
I20260709 12:14:58.849586 25100 ts_tablet_manager.cc:1403] T 085a04f8ed724f82bc12490bbb1ceea7 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.003s
W20260709 12:14:58.856346 24396 leader_election.cc:336] T ed15c59b19ff49d3a39bf5b5abf8b69a P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:14:58.856622 25100 raft_consensus.cc:359] T 085a04f8ed724f82bc12490bbb1ceea7 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:58.857362 25100 raft_consensus.cc:740] T 085a04f8ed724f82bc12490bbb1ceea7 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:14:58.857139 24396 leader_election.cc:304] T ed15c59b19ff49d3a39bf5b5abf8b69a P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad362df39b114ec3a3a419128097b362; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, aa14caefbdaa47b09abf91881635ba96
I20260709 12:14:58.858225 25100 consensus_queue.cc:260] T 085a04f8ed724f82bc12490bbb1ceea7 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:58.860112 25100 ts_tablet_manager.cc:1434] T 085a04f8ed724f82bc12490bbb1ceea7 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 12:14:58.860491 25084 raft_consensus.cc:2749] T ed15c59b19ff49d3a39bf5b5abf8b69a P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:58.861016 25100 tablet_bootstrap.cc:492] T 2c00f77150f7475c94c4fd29c90805cd P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:14:58.868742 25120 raft_consensus.cc:493] T f841b9f0e82748d399b5eef243c442fc P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:14:58.869621 25120 raft_consensus.cc:515] T f841b9f0e82748d399b5eef243c442fc P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:58.873831 25120 leader_election.cc:290] T f841b9f0e82748d399b5eef243c442fc P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:14:58.874078 24283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841b9f0e82748d399b5eef243c442fc" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:58.879109 24249 leader_election.cc:304] T 318c217e16874865bd6dff6bd4d8cd4f P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf2d8294ae68482ca4ffa8be051ad054; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, ad362df39b114ec3a3a419128097b362
I20260709 12:14:58.890059 25107 raft_consensus.cc:2749] T 318c217e16874865bd6dff6bd4d8cd4f P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:58.893383 25084 raft_consensus.cc:493] T d10519ad64d948b09186e335ed06257d P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:14:58.894196 25084 raft_consensus.cc:515] T d10519ad64d948b09186e335ed06257d P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
W20260709 12:14:58.895192 24322 leader_election.cc:336] T f841b9f0e82748d399b5eef243c442fc P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:14:58.895926 24322 leader_election.cc:304] T f841b9f0e82748d399b5eef243c442fc P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:14:58.902081 25120 raft_consensus.cc:2749] T f841b9f0e82748d399b5eef243c442fc P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:58.912267 24992 raft_consensus.cc:493] T 133e492e820f4152ad30562c343b617d P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:14:58.913281 24992 raft_consensus.cc:515] T 133e492e820f4152ad30562c343b617d P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:58.918522 24350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133e492e820f4152ad30562c343b617d" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:58.925690 25084 leader_election.cc:290] T d10519ad64d948b09186e335ed06257d P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:14:58.925992 24283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10519ad64d948b09186e335ed06257d" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:58.926795 24992 leader_election.cc:290] T 133e492e820f4152ad30562c343b617d P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:14:58.927172 24283 raft_consensus.cc:2468] T d10519ad64d948b09186e335ed06257d P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 1.
I20260709 12:14:58.929145 24399 leader_election.cc:304] T d10519ad64d948b09186e335ed06257d P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad362df39b114ec3a3a419128097b362, cf2d8294ae68482ca4ffa8be051ad054; no voters: 
I20260709 12:14:58.930464 25084 raft_consensus.cc:2804] T d10519ad64d948b09186e335ed06257d P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:58.931164 25084 raft_consensus.cc:493] T d10519ad64d948b09186e335ed06257d P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:14:58.931824 25084 raft_consensus.cc:3060] T d10519ad64d948b09186e335ed06257d P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:58.938562 25104 raft_consensus.cc:493] T fa882381d669422a95ec60c9aefa8105 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:14:58.939535 25104 raft_consensus.cc:515] T fa882381d669422a95ec60c9aefa8105 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:58.943284 25104 leader_election.cc:290] T fa882381d669422a95ec60c9aefa8105 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:58.945217 24352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa882381d669422a95ec60c9aefa8105" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:58.952666 24992 raft_consensus.cc:493] T ab8dff607862460ea0fcd88422c31ac2 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:14:58.953559 24992 raft_consensus.cc:515] T ab8dff607862460ea0fcd88422c31ac2 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:58.953208 25084 raft_consensus.cc:515] T d10519ad64d948b09186e335ed06257d P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:58.956751 24992 leader_election.cc:290] T ab8dff607862460ea0fcd88422c31ac2 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:14:58.959129 24283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10519ad64d948b09186e335ed06257d" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054"
I20260709 12:14:58.959617 25084 leader_election.cc:290] T d10519ad64d948b09186e335ed06257d P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 election: Requested vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:14:58.960117 24283 raft_consensus.cc:3060] T d10519ad64d948b09186e335ed06257d P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:58.962929 24350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab8dff607862460ea0fcd88422c31ac2" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:58.983139 25107 raft_consensus.cc:493] T b98a35cf96ba4562b4933543b1e4efb9 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:14:58.986846 25107 raft_consensus.cc:515] T b98a35cf96ba4562b4933543b1e4efb9 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:58.993314 25107 leader_election.cc:290] T b98a35cf96ba4562b4933543b1e4efb9 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:14:58.999466 25120 raft_consensus.cc:493] T ed15c59b19ff49d3a39bf5b5abf8b69a P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:14:59.000375 25120 raft_consensus.cc:515] T ed15c59b19ff49d3a39bf5b5abf8b69a P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:59.004408 24429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed15c59b19ff49d3a39bf5b5abf8b69a" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:59.005133 24429 raft_consensus.cc:2468] T ed15c59b19ff49d3a39bf5b5abf8b69a P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa14caefbdaa47b09abf91881635ba96 in term 1.
I20260709 12:14:59.006474 25120 leader_election.cc:290] T ed15c59b19ff49d3a39bf5b5abf8b69a P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:59.008189 24352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b98a35cf96ba4562b4933543b1e4efb9" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:59.010078 24323 leader_election.cc:304] T ed15c59b19ff49d3a39bf5b5abf8b69a P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, ad362df39b114ec3a3a419128097b362; no voters: 
I20260709 12:14:59.011292 25105 raft_consensus.cc:2804] T ed15c59b19ff49d3a39bf5b5abf8b69a P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:59.011679 25105 raft_consensus.cc:493] T ed15c59b19ff49d3a39bf5b5abf8b69a P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:14:59.012068 25105 raft_consensus.cc:3060] T ed15c59b19ff49d3a39bf5b5abf8b69a P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:59.012874 25077 raft_consensus.cc:493] T a18e73ef976b49f0878423c0b3e6e6f2 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:14:59.013463 25077 raft_consensus.cc:515] T a18e73ef976b49f0878423c0b3e6e6f2 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:59.015803 25077 leader_election.cc:290] T a18e73ef976b49f0878423c0b3e6e6f2 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
W20260709 12:14:59.019228 24322 leader_election.cc:336] T ed15c59b19ff49d3a39bf5b5abf8b69a P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:14:59.020772 24284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18e73ef976b49f0878423c0b3e6e6f2" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:59.022825 25084 raft_consensus.cc:493] T bbab1a4afac94c1eaeb3ed35bc54408a P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
W20260709 12:14:59.023741 24322 leader_election.cc:336] T a18e73ef976b49f0878423c0b3e6e6f2 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:14:59.023552 25084 raft_consensus.cc:515] T bbab1a4afac94c1eaeb3ed35bc54408a P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:59.024260 24322 leader_election.cc:304] T a18e73ef976b49f0878423c0b3e6e6f2 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:14:59.025146 25082 raft_consensus.cc:493] T 318c217e16874865bd6dff6bd4d8cd4f P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:14:59.025547 25120 raft_consensus.cc:2749] T a18e73ef976b49f0878423c0b3e6e6f2 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:59.025741 25082 raft_consensus.cc:515] T 318c217e16874865bd6dff6bd4d8cd4f P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:59.031351 25084 leader_election.cc:290] T bbab1a4afac94c1eaeb3ed35bc54408a P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:14:59.032680 25082 leader_election.cc:290] T 318c217e16874865bd6dff6bd4d8cd4f P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:14:59.035799 25013 raft_consensus.cc:493] T 558ced611e584b32ab838cceeb7cb410 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:14:59.036422 25013 raft_consensus.cc:515] T 558ced611e584b32ab838cceeb7cb410 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:59.036756 24280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318c217e16874865bd6dff6bd4d8cd4f" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:59.037698 24280 raft_consensus.cc:2468] T 318c217e16874865bd6dff6bd4d8cd4f P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 1.
I20260709 12:14:59.036863 24284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbab1a4afac94c1eaeb3ed35bc54408a" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:59.039114 24399 leader_election.cc:304] T 318c217e16874865bd6dff6bd4d8cd4f P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad362df39b114ec3a3a419128097b362, cf2d8294ae68482ca4ffa8be051ad054; no voters: 
I20260709 12:14:59.040518 25082 raft_consensus.cc:2804] T 318c217e16874865bd6dff6bd4d8cd4f P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:59.040989 25082 raft_consensus.cc:493] T 318c217e16874865bd6dff6bd4d8cd4f P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:14:59.041440 25082 raft_consensus.cc:3060] T 318c217e16874865bd6dff6bd4d8cd4f P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:14:59.044010 24322 leader_election.cc:336] T 558ced611e584b32ab838cceeb7cb410 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:14:59.045420 25013 leader_election.cc:290] T 558ced611e584b32ab838cceeb7cb410 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:14:59.046725 24284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "558ced611e584b32ab838cceeb7cb410" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:59.048532 24325 leader_election.cc:304] T 558ced611e584b32ab838cceeb7cb410 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:14:59.050599 25013 raft_consensus.cc:2749] T 558ced611e584b32ab838cceeb7cb410 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:59.050942 25105 raft_consensus.cc:515] T ed15c59b19ff49d3a39bf5b5abf8b69a P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:59.054945 24429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed15c59b19ff49d3a39bf5b5abf8b69a" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362"
I20260709 12:14:59.055547 24429 raft_consensus.cc:3060] T ed15c59b19ff49d3a39bf5b5abf8b69a P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:14:59.057013 24248 leader_election.cc:336] T 133e492e820f4152ad30562c343b617d P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:14:59.057533 24248 leader_election.cc:304] T 133e492e820f4152ad30562c343b617d P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf2d8294ae68482ca4ffa8be051ad054; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, aa14caefbdaa47b09abf91881635ba96
I20260709 12:14:59.058781 24992 raft_consensus.cc:2749] T 133e492e820f4152ad30562c343b617d P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:59.059864 25013 raft_consensus.cc:493] T 9219abaaa2c34b08a24191512ff742bc P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:14:59.061455 25120 raft_consensus.cc:493] T fa882381d669422a95ec60c9aefa8105 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:14:59.062227 25120 raft_consensus.cc:515] T fa882381d669422a95ec60c9aefa8105 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:59.064563 25120 leader_election.cc:290] T fa882381d669422a95ec60c9aefa8105 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:59.070708 24425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa882381d669422a95ec60c9aefa8105" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:59.071610 24425 raft_consensus.cc:2468] T fa882381d669422a95ec60c9aefa8105 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa14caefbdaa47b09abf91881635ba96 in term 1.
I20260709 12:14:59.072832 24323 leader_election.cc:304] T fa882381d669422a95ec60c9aefa8105 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, ad362df39b114ec3a3a419128097b362; no voters: 
I20260709 12:14:59.072831 25100 tablet_bootstrap.cc:492] T 2c00f77150f7475c94c4fd29c90805cd P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:14:59.073894 24322 leader_election.cc:336] T fa882381d669422a95ec60c9aefa8105 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:14:59.074518 25100 tablet_bootstrap.cc:492] T 2c00f77150f7475c94c4fd29c90805cd P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap complete.
I20260709 12:14:59.075335 25100 ts_tablet_manager.cc:1403] T 2c00f77150f7475c94c4fd29c90805cd P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.215s	user 0.084s	sys 0.114s
I20260709 12:14:59.076864 25077 raft_consensus.cc:2804] T fa882381d669422a95ec60c9aefa8105 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:59.077329 25077 raft_consensus.cc:493] T fa882381d669422a95ec60c9aefa8105 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:14:59.077721 25077 raft_consensus.cc:3060] T fa882381d669422a95ec60c9aefa8105 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:59.073907 24283 raft_consensus.cc:2468] T d10519ad64d948b09186e335ed06257d P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 2.
I20260709 12:14:59.078395 25100 raft_consensus.cc:359] T 2c00f77150f7475c94c4fd29c90805cd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:59.078430 25013 raft_consensus.cc:515] T 9219abaaa2c34b08a24191512ff742bc P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:59.079408 25100 raft_consensus.cc:740] T 2c00f77150f7475c94c4fd29c90805cd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:14:59.080334 25100 consensus_queue.cc:260] T 2c00f77150f7475c94c4fd29c90805cd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:59.083177 25100 ts_tablet_manager.cc:1434] T 2c00f77150f7475c94c4fd29c90805cd P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:14:59.084121 25100 tablet_bootstrap.cc:492] T 558ced611e584b32ab838cceeb7cb410 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:14:59.083992 25107 raft_consensus.cc:493] T bbab1a4afac94c1eaeb3ed35bc54408a P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:14:59.077631 25082 raft_consensus.cc:515] T 318c217e16874865bd6dff6bd4d8cd4f P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:59.084739 25107 raft_consensus.cc:515] T bbab1a4afac94c1eaeb3ed35bc54408a P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:59.088888 25082 leader_election.cc:290] T 318c217e16874865bd6dff6bd4d8cd4f P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 election: Requested vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:14:59.092077 24992 raft_consensus.cc:493] T 9cb931cb82d74add922e65a2ea3de34d P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:14:59.092877 24992 raft_consensus.cc:515] T 9cb931cb82d74add922e65a2ea3de34d P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:59.095274 24992 leader_election.cc:290] T 9cb931cb82d74add922e65a2ea3de34d P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:59.096437 24424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbab1a4afac94c1eaeb3ed35bc54408a" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:59.097213 24424 raft_consensus.cc:2468] T bbab1a4afac94c1eaeb3ed35bc54408a P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 2.
I20260709 12:14:59.092211 24816 raft_consensus.cc:493] T 7943c68d21d449dba2d1dca6ddde5820 P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:14:59.098402 24816 raft_consensus.cc:515] T 7943c68d21d449dba2d1dca6ddde5820 P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:59.093222 25107 leader_election.cc:290] T bbab1a4afac94c1eaeb3ed35bc54408a P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:59.095970 24283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318c217e16874865bd6dff6bd4d8cd4f" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054"
I20260709 12:14:59.104044 24283 raft_consensus.cc:3060] T 318c217e16874865bd6dff6bd4d8cd4f P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:59.105104 25120 raft_consensus.cc:493] T 7cbef09353144c0b9a9ebf7731fd019f P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:14:59.105657 25077 raft_consensus.cc:515] T fa882381d669422a95ec60c9aefa8105 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:59.105741 25120 raft_consensus.cc:515] T 7cbef09353144c0b9a9ebf7731fd019f P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:59.108386 25120 leader_election.cc:290] T 7cbef09353144c0b9a9ebf7731fd019f P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:59.109517 25100 tablet_bootstrap.cc:492] T 558ced611e584b32ab838cceeb7cb410 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:59.103035 24356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7943c68d21d449dba2d1dca6ddde5820" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:59.109653 24428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbef09353144c0b9a9ebf7731fd019f" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:59.110697 25100 tablet_bootstrap.cc:492] T 558ced611e584b32ab838cceeb7cb410 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap complete.
I20260709 12:14:59.111812 25100 ts_tablet_manager.cc:1403] T 558ced611e584b32ab838cceeb7cb410 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.028s	user 0.021s	sys 0.004s
I20260709 12:14:59.112898 24283 raft_consensus.cc:2468] T 318c217e16874865bd6dff6bd4d8cd4f P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 2.
I20260709 12:14:59.114149 24249 leader_election.cc:304] T bbab1a4afac94c1eaeb3ed35bc54408a P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad362df39b114ec3a3a419128097b362, cf2d8294ae68482ca4ffa8be051ad054; no voters: 
I20260709 12:14:59.114153 24428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cb931cb82d74add922e65a2ea3de34d" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:59.114724 25100 raft_consensus.cc:359] T 558ced611e584b32ab838cceeb7cb410 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:59.115289 25107 raft_consensus.cc:2804] T bbab1a4afac94c1eaeb3ed35bc54408a P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:59.115576 25100 raft_consensus.cc:740] T 558ced611e584b32ab838cceeb7cb410 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:14:59.115728 25107 raft_consensus.cc:493] T bbab1a4afac94c1eaeb3ed35bc54408a P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:14:59.116216 25107 raft_consensus.cc:3060] T bbab1a4afac94c1eaeb3ed35bc54408a P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:59.116554 25100 consensus_queue.cc:260] T 558ced611e584b32ab838cceeb7cb410 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:59.119451 25100 ts_tablet_manager.cc:1434] T 558ced611e584b32ab838cceeb7cb410 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:14:59.120419 25100 tablet_bootstrap.cc:492] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
W20260709 12:14:59.120690 24322 leader_election.cc:336] T 7cbef09353144c0b9a9ebf7731fd019f P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:14:59.121490 24322 leader_election.cc:304] T 7cbef09353144c0b9a9ebf7731fd019f P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, ad362df39b114ec3a3a419128097b362
I20260709 12:14:59.126435 24425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa882381d669422a95ec60c9aefa8105" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362"
I20260709 12:14:59.127854 24425 raft_consensus.cc:3060] T fa882381d669422a95ec60c9aefa8105 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:59.132335 24992 raft_consensus.cc:493] T f841b9f0e82748d399b5eef243c442fc P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:14:59.133056 24992 raft_consensus.cc:515] T f841b9f0e82748d399b5eef243c442fc P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:59.120826 24399 leader_election.cc:304] T d10519ad64d948b09186e335ed06257d P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad362df39b114ec3a3a419128097b362, cf2d8294ae68482ca4ffa8be051ad054; no voters: 
I20260709 12:14:59.136070 24399 leader_election.cc:304] T 318c217e16874865bd6dff6bd4d8cd4f P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad362df39b114ec3a3a419128097b362, cf2d8294ae68482ca4ffa8be051ad054; no voters: 
I20260709 12:14:59.123375 24428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9219abaaa2c34b08a24191512ff742bc" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:59.122779 25013 leader_election.cc:290] T 9219abaaa2c34b08a24191512ff742bc P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:59.139449 25013 raft_consensus.cc:2749] T 7cbef09353144c0b9a9ebf7731fd019f P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:59.101578 24429 raft_consensus.cc:2468] T ed15c59b19ff49d3a39bf5b5abf8b69a P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa14caefbdaa47b09abf91881635ba96 in term 2.
I20260709 12:14:59.144598 25100 tablet_bootstrap.cc:492] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:59.144771 24323 leader_election.cc:304] T ed15c59b19ff49d3a39bf5b5abf8b69a P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, ad362df39b114ec3a3a419128097b362; no voters: 
I20260709 12:14:59.141441 25104 raft_consensus.cc:2804] T d10519ad64d948b09186e335ed06257d P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:59.145839 25100 tablet_bootstrap.cc:492] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap complete.
I20260709 12:14:59.136482 24992 leader_election.cc:290] T f841b9f0e82748d399b5eef243c442fc P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:14:59.146716 25100 ts_tablet_manager.cc:1403] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.027s	user 0.021s	sys 0.004s
I20260709 12:14:59.148509 25084 raft_consensus.cc:2804] T 318c217e16874865bd6dff6bd4d8cd4f P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:14:59.152464 24248 leader_election.cc:336] T ab8dff607862460ea0fcd88422c31ac2 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:14:59.150683 25100 raft_consensus.cc:359] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:59.153549 25100 raft_consensus.cc:740] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:14:59.154799 25100 consensus_queue.cc:260] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:59.155329 24350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841b9f0e82748d399b5eef243c442fc" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:59.156142 24350 raft_consensus.cc:2468] T f841b9f0e82748d399b5eef243c442fc P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 1.
I20260709 12:14:59.157650 25100 ts_tablet_manager.cc:1434] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:14:59.158314 25077 leader_election.cc:290] T fa882381d669422a95ec60c9aefa8105 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 election: Requested vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:59.158815 25100 tablet_bootstrap.cc:492] T 8996365fa46548d49f3b3bafe14e9c83 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:14:59.158689 25120 raft_consensus.cc:2804] T ed15c59b19ff49d3a39bf5b5abf8b69a P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:59.159559 25084 raft_consensus.cc:697] T 318c217e16874865bd6dff6bd4d8cd4f P ad362df39b114ec3a3a419128097b362 [term 2 LEADER]: Becoming Leader. State: Replica: ad362df39b114ec3a3a419128097b362, State: Running, Role: LEADER
I20260709 12:14:59.159863 25120 raft_consensus.cc:697] T ed15c59b19ff49d3a39bf5b5abf8b69a P aa14caefbdaa47b09abf91881635ba96 [term 2 LEADER]: Becoming Leader. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Running, Role: LEADER
I20260709 12:14:59.161248 25120 consensus_queue.cc:237] T ed15c59b19ff49d3a39bf5b5abf8b69a P aa14caefbdaa47b09abf91881635ba96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
W20260709 12:14:59.157737 24322 leader_election.cc:336] T 9219abaaa2c34b08a24191512ff742bc P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:14:59.166539 24322 leader_election.cc:304] T 9219abaaa2c34b08a24191512ff742bc P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, ad362df39b114ec3a3a419128097b362
I20260709 12:14:59.123260 24816 leader_election.cc:290] T 7943c68d21d449dba2d1dca6ddde5820 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:14:59.159238 25077 raft_consensus.cc:493] T b98a35cf96ba4562b4933543b1e4efb9 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:14:59.167631 25077 raft_consensus.cc:515] T b98a35cf96ba4562b4933543b1e4efb9 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:59.153036 24248 leader_election.cc:304] T ab8dff607862460ea0fcd88422c31ac2 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf2d8294ae68482ca4ffa8be051ad054; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, aa14caefbdaa47b09abf91881635ba96
W20260709 12:14:59.161744 24396 leader_election.cc:336] T d10519ad64d948b09186e335ed06257d P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:14:59.166786 25105 leader_election.cc:290] T ed15c59b19ff49d3a39bf5b5abf8b69a P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 election: Requested vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
W20260709 12:14:59.173084 24248 leader_election.cc:336] T b98a35cf96ba4562b4933543b1e4efb9 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:14:59.175578 24248 leader_election.cc:304] T b98a35cf96ba4562b4933543b1e4efb9 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf2d8294ae68482ca4ffa8be051ad054; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, aa14caefbdaa47b09abf91881635ba96
I20260709 12:14:59.176362 24816 raft_consensus.cc:2749] T b98a35cf96ba4562b4933543b1e4efb9 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:59.186758 25104 raft_consensus.cc:697] T d10519ad64d948b09186e335ed06257d P ad362df39b114ec3a3a419128097b362 [term 2 LEADER]: Becoming Leader. State: Replica: ad362df39b114ec3a3a419128097b362, State: Running, Role: LEADER
I20260709 12:14:59.172571 24992 raft_consensus.cc:2749] T ab8dff607862460ea0fcd88422c31ac2 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:59.187232 25154 raft_consensus.cc:493] T 477aafe049fa4b1182fb0afe55fe5e55 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
W20260709 12:14:59.188172 24322 leader_election.cc:336] T fa882381d669422a95ec60c9aefa8105 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
W20260709 12:14:59.188776 24322 leader_election.cc:336] T ed15c59b19ff49d3a39bf5b5abf8b69a P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:14:59.167639 25013 raft_consensus.cc:2749] T 9219abaaa2c34b08a24191512ff742bc P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:59.187927 25154 raft_consensus.cc:515] T 477aafe049fa4b1182fb0afe55fe5e55 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:59.213588 25084 consensus_queue.cc:237] T 318c217e16874865bd6dff6bd4d8cd4f P ad362df39b114ec3a3a419128097b362 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:59.215027 25154 leader_election.cc:290] T 477aafe049fa4b1182fb0afe55fe5e55 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:59.200419 25105 raft_consensus.cc:493] T 4b1c850a65b748c093c5c88aa94fed71 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:14:59.216140 25105 raft_consensus.cc:515] T 4b1c850a65b748c093c5c88aa94fed71 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:59.219143 25105 leader_election.cc:290] T 4b1c850a65b748c093c5c88aa94fed71 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:59.187988 25104 consensus_queue.cc:237] T d10519ad64d948b09186e335ed06257d P ad362df39b114ec3a3a419128097b362 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:59.203750 24425 raft_consensus.cc:2468] T fa882381d669422a95ec60c9aefa8105 P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa14caefbdaa47b09abf91881635ba96 in term 2.
I20260709 12:14:59.169628 25106 raft_consensus.cc:493] T 133e492e820f4152ad30562c343b617d P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
W20260709 12:14:59.208735 24398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:46845, user_credentials={real_user=slave}} blocked reactor thread for 119908us
I20260709 12:14:59.209015 25145 raft_consensus.cc:493] T 9cb931cb82d74add922e65a2ea3de34d P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
W20260709 12:14:59.210780 24250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:46845, user_credentials={real_user=slave}} blocked reactor thread for 68205.7us
W20260709 12:14:59.222586 24248 leader_election.cc:336] T bbab1a4afac94c1eaeb3ed35bc54408a P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
W20260709 12:14:59.225950 24248 leader_election.cc:336] T 9cb931cb82d74add922e65a2ea3de34d P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:14:59.226423 24248 leader_election.cc:304] T 9cb931cb82d74add922e65a2ea3de34d P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf2d8294ae68482ca4ffa8be051ad054; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, ad362df39b114ec3a3a419128097b362
W20260709 12:14:59.228910 24248 leader_election.cc:336] T 7943c68d21d449dba2d1dca6ddde5820 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:14:59.229478 24248 leader_election.cc:304] T 7943c68d21d449dba2d1dca6ddde5820 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf2d8294ae68482ca4ffa8be051ad054; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, aa14caefbdaa47b09abf91881635ba96
I20260709 12:14:59.229882 24323 leader_election.cc:304] T fa882381d669422a95ec60c9aefa8105 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, ad362df39b114ec3a3a419128097b362; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883
I20260709 12:14:59.231734 24350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477aafe049fa4b1182fb0afe55fe5e55" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
W20260709 12:14:59.236200 24248 leader_election.cc:336] T f841b9f0e82748d399b5eef243c442fc P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:14:59.253343 24816 raft_consensus.cc:493] T 558ced611e584b32ab838cceeb7cb410 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:14:59.254426 24816 raft_consensus.cc:515] T 558ced611e584b32ab838cceeb7cb410 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:59.232466 25077 leader_election.cc:290] T b98a35cf96ba4562b4933543b1e4efb9 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:14:59.240571 25013 raft_consensus.cc:2804] T fa882381d669422a95ec60c9aefa8105 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:59.240202 24992 raft_consensus.cc:2749] T 7943c68d21d449dba2d1dca6ddde5820 P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:59.240321 25154 raft_consensus.cc:493] T 9219abaaa2c34b08a24191512ff742bc P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
W20260709 12:14:59.287035 24396 leader_election.cc:336] T bbab1a4afac94c1eaeb3ed35bc54408a P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:14:59.295739 24396 leader_election.cc:304] T bbab1a4afac94c1eaeb3ed35bc54408a P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad362df39b114ec3a3a419128097b362; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:14:59.215070 25107 raft_consensus.cc:515] T bbab1a4afac94c1eaeb3ed35bc54408a P cf2d8294ae68482ca4ffa8be051ad054 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
W20260709 12:14:59.304034 24396 leader_election.cc:336] T 318c217e16874865bd6dff6bd4d8cd4f P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:14:59.260490 25153 raft_consensus.cc:2749] T 9cb931cb82d74add922e65a2ea3de34d P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:59.224936 25106 raft_consensus.cc:515] T 133e492e820f4152ad30562c343b617d P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:59.306835 24816 leader_election.cc:290] T 558ced611e584b32ab838cceeb7cb410 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:14:59.267350 24280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b98a35cf96ba4562b4933543b1e4efb9" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:59.233520 25145 raft_consensus.cc:515] T 9cb931cb82d74add922e65a2ea3de34d P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:59.307368 25082 raft_consensus.cc:2749] T bbab1a4afac94c1eaeb3ed35bc54408a P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:59.303915 25013 raft_consensus.cc:697] T fa882381d669422a95ec60c9aefa8105 P aa14caefbdaa47b09abf91881635ba96 [term 2 LEADER]: Becoming Leader. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Running, Role: LEADER
I20260709 12:14:59.306715 25154 raft_consensus.cc:515] T 9219abaaa2c34b08a24191512ff742bc P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:59.319021 25157 raft_consensus.cc:493] T 7943c68d21d449dba2d1dca6ddde5820 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:14:59.331246 25157 raft_consensus.cc:515] T 7943c68d21d449dba2d1dca6ddde5820 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:59.332509 25154 leader_election.cc:290] T 9219abaaa2c34b08a24191512ff742bc P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:59.333587 25157 leader_election.cc:290] T 7943c68d21d449dba2d1dca6ddde5820 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:14:59.334360 25107 leader_election.cc:290] T bbab1a4afac94c1eaeb3ed35bc54408a P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 3 election: Requested vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:59.323230 25156 raft_consensus.cc:493] T 4b1c850a65b748c093c5c88aa94fed71 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:14:59.335366 25156 raft_consensus.cc:515] T 4b1c850a65b748c093c5c88aa94fed71 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:59.339241 25156 leader_election.cc:290] T 4b1c850a65b748c093c5c88aa94fed71 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:59.339426 25145 leader_election.cc:290] T 9cb931cb82d74add922e65a2ea3de34d P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:14:59.377907 24250 leader_election.cc:304] T f841b9f0e82748d399b5eef243c442fc P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, cf2d8294ae68482ca4ffa8be051ad054; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883
I20260709 12:14:59.385017 24280 raft_consensus.cc:2468] T b98a35cf96ba4562b4933543b1e4efb9 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa14caefbdaa47b09abf91881635ba96 in term 1.
I20260709 12:14:59.399530 24356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9219abaaa2c34b08a24191512ff742bc" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:59.400517 24353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "558ced611e584b32ab838cceeb7cb410" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:59.401651 24356 raft_consensus.cc:2468] T 9219abaaa2c34b08a24191512ff742bc P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 1.
I20260709 12:14:59.444350 24816 raft_consensus.cc:493] T a18e73ef976b49f0878423c0b3e6e6f2 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:14:59.445812 24816 raft_consensus.cc:515] T a18e73ef976b49f0878423c0b3e6e6f2 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:59.449548 24424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbab1a4afac94c1eaeb3ed35bc54408a" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362"
I20260709 12:14:59.451010 24424 raft_consensus.cc:3060] T bbab1a4afac94c1eaeb3ed35bc54408a P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:59.459870 25160 raft_consensus.cc:493] T 7cbef09353144c0b9a9ebf7731fd019f P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:14:59.461201 25160 raft_consensus.cc:515] T 7cbef09353144c0b9a9ebf7731fd019f P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:59.473104 25160 leader_election.cc:290] T 7cbef09353144c0b9a9ebf7731fd019f P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:59.414549 25106 leader_election.cc:290] T 133e492e820f4152ad30562c343b617d P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:14:59.414837 25013 consensus_queue.cc:237] T fa882381d669422a95ec60c9aefa8105 P aa14caefbdaa47b09abf91881635ba96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:59.419051 25120 raft_consensus.cc:493] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:14:59.411211 25100 tablet_bootstrap.cc:492] T 8996365fa46548d49f3b3bafe14e9c83 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:59.421851 24428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b1c850a65b748c093c5c88aa94fed71" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:59.488277 24356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbef09353144c0b9a9ebf7731fd019f" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:59.488498 25120 raft_consensus.cc:515] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:59.491041 25100 tablet_bootstrap.cc:492] T 8996365fa46548d49f3b3bafe14e9c83 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap complete.
I20260709 12:14:59.431680 25107 raft_consensus.cc:2804] T f841b9f0e82748d399b5eef243c442fc P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:59.475169 24398 leader_election.cc:304] T 9219abaaa2c34b08a24191512ff742bc P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, ad362df39b114ec3a3a419128097b362; no voters: 
I20260709 12:14:59.499639 25107 raft_consensus.cc:493] T f841b9f0e82748d399b5eef243c442fc P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:14:59.500218 25107 raft_consensus.cc:3060] T f841b9f0e82748d399b5eef243c442fc P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:59.502131 25160 raft_consensus.cc:2804] T 9219abaaa2c34b08a24191512ff742bc P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:59.502826 25160 raft_consensus.cc:493] T 9219abaaa2c34b08a24191512ff742bc P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:14:59.503345 25160 raft_consensus.cc:3060] T 9219abaaa2c34b08a24191512ff742bc P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:59.507901 25100 ts_tablet_manager.cc:1403] T 8996365fa46548d49f3b3bafe14e9c83 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.349s	user 0.027s	sys 0.050s
I20260709 12:14:59.488845 24428 raft_consensus.cc:2468] T 4b1c850a65b748c093c5c88aa94fed71 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa14caefbdaa47b09abf91881635ba96 in term 1.
I20260709 12:14:59.423580 24350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b1c850a65b748c093c5c88aa94fed71" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
W20260709 12:14:59.491472 24322 leader_election.cc:336] T 4b1c850a65b748c093c5c88aa94fed71 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
W20260709 12:14:59.518743 24322 leader_election.cc:336] T b98a35cf96ba4562b4933543b1e4efb9 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
W20260709 12:14:59.519589 24322 leader_election.cc:336] T 7943c68d21d449dba2d1dca6ddde5820 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
W20260709 12:14:59.520152 24322 leader_election.cc:336] T 133e492e820f4152ad30562c343b617d P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:14:59.523427 24108 catalog_manager.cc:5697] T ed15c59b19ff49d3a39bf5b5abf8b69a P aa14caefbdaa47b09abf91881635ba96 reported cstate change: term changed from 1 to 2, leader changed from 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193) to aa14caefbdaa47b09abf91881635ba96 (127.12.56.195). New cstate: current_term: 2 leader_uuid: "aa14caefbdaa47b09abf91881635ba96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:59.491776 25120 leader_election.cc:290] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:59.401714 24353 raft_consensus.cc:2468] T 558ced611e584b32ab838cceeb7cb410 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 1.
I20260709 12:14:59.418133 25077 raft_consensus.cc:493] T ab8dff607862460ea0fcd88422c31ac2 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
W20260709 12:14:59.493278 24248 leader_election.cc:336] T 558ced611e584b32ab838cceeb7cb410 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
W20260709 12:14:59.494915 24249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46467, user_credentials={real_user=slave}} blocked reactor thread for 66871.7us
I20260709 12:14:59.529177 25077 raft_consensus.cc:515] T ab8dff607862460ea0fcd88422c31ac2 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
W20260709 12:14:59.495750 24396 leader_election.cc:336] T fa882381d669422a95ec60c9aefa8105 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:14:59.533905 24396 leader_election.cc:304] T fa882381d669422a95ec60c9aefa8105 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad362df39b114ec3a3a419128097b362; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, aa14caefbdaa47b09abf91881635ba96
W20260709 12:14:59.536772 24396 leader_election.cc:336] T d10519ad64d948b09186e335ed06257d P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:14:59.540366 25100 raft_consensus.cc:359] T 8996365fa46548d49f3b3bafe14e9c83 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
W20260709 12:14:59.498082 24323 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46467, user_credentials={real_user=slave}} blocked reactor thread for 71746.9us
W20260709 12:14:59.498765 24250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:46845, user_credentials={real_user=slave}} blocked reactor thread for 64353.1us
I20260709 12:14:59.476558 24816 leader_election.cc:290] T a18e73ef976b49f0878423c0b3e6e6f2 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:14:59.510785 24107 catalog_manager.cc:5697] T d10519ad64d948b09186e335ed06257d P ad362df39b114ec3a3a419128097b362 reported cstate change: term changed from 1 to 2, leader changed from 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193) to ad362df39b114ec3a3a419128097b362 (127.12.56.196). New cstate: current_term: 2 leader_uuid: "ad362df39b114ec3a3a419128097b362" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:59.514155 24350 raft_consensus.cc:2468] T 4b1c850a65b748c093c5c88aa94fed71 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 1.
I20260709 12:14:59.551373 24398 leader_election.cc:304] T 4b1c850a65b748c093c5c88aa94fed71 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, ad362df39b114ec3a3a419128097b362; no voters: 
I20260709 12:14:59.551417 24323 leader_election.cc:304] T 4b1c850a65b748c093c5c88aa94fed71 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, ad362df39b114ec3a3a419128097b362; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883
I20260709 12:14:59.533059 25077 leader_election.cc:290] T ab8dff607862460ea0fcd88422c31ac2 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:14:59.542269 25145 raft_consensus.cc:2749] T fa882381d669422a95ec60c9aefa8105 P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:59.489517 24356 raft_consensus.cc:2468] T 7cbef09353144c0b9a9ebf7731fd019f P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 2.
I20260709 12:14:59.549253 25100 raft_consensus.cc:740] T 8996365fa46548d49f3b3bafe14e9c83 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:14:59.559798 25013 raft_consensus.cc:2804] T 4b1c850a65b748c093c5c88aa94fed71 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:59.560501 25013 raft_consensus.cc:493] T 4b1c850a65b748c093c5c88aa94fed71 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:14:59.561061 25013 raft_consensus.cc:3060] T 4b1c850a65b748c093c5c88aa94fed71 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:59.559886 24250 leader_election.cc:304] T 558ced611e584b32ab838cceeb7cb410 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, cf2d8294ae68482ca4ffa8be051ad054; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883
I20260709 12:14:59.563987 25169 raft_consensus.cc:2804] T 558ced611e584b32ab838cceeb7cb410 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:59.564635 25169 raft_consensus.cc:493] T 558ced611e584b32ab838cceeb7cb410 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:14:59.565016 25169 raft_consensus.cc:3060] T 558ced611e584b32ab838cceeb7cb410 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:59.570236 25145 raft_consensus.cc:2804] T 4b1c850a65b748c093c5c88aa94fed71 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:59.570812 25145 raft_consensus.cc:493] T 4b1c850a65b748c093c5c88aa94fed71 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:14:59.570784 24398 leader_election.cc:304] T 7cbef09353144c0b9a9ebf7731fd019f P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, ad362df39b114ec3a3a419128097b362; no voters: 
I20260709 12:14:59.571604 25145 raft_consensus.cc:3060] T 4b1c850a65b748c093c5c88aa94fed71 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:59.573503 25104 raft_consensus.cc:2804] T 7cbef09353144c0b9a9ebf7731fd019f P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:59.573978 25104 raft_consensus.cc:493] T 7cbef09353144c0b9a9ebf7731fd019f P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:14:59.574378 25104 raft_consensus.cc:3060] T 7cbef09353144c0b9a9ebf7731fd019f P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:59.575665 24353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18e73ef976b49f0878423c0b3e6e6f2" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:14:59.576668 24353 raft_consensus.cc:2468] T a18e73ef976b49f0878423c0b3e6e6f2 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 1.
W20260709 12:14:59.557890 24248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:38787, user_credentials={real_user=slave}} blocked reactor thread for 64827.4us
I20260709 12:14:59.581966 24325 leader_election.cc:304] T b98a35cf96ba4562b4933543b1e4efb9 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, cf2d8294ae68482ca4ffa8be051ad054; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883
I20260709 12:14:59.583230 24280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cb931cb82d74add922e65a2ea3de34d" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:59.584293 24280 raft_consensus.cc:2468] T 9cb931cb82d74add922e65a2ea3de34d P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 1.
I20260709 12:14:59.584786 25105 raft_consensus.cc:2804] T b98a35cf96ba4562b4933543b1e4efb9 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:59.585326 25105 raft_consensus.cc:493] T b98a35cf96ba4562b4933543b1e4efb9 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:14:59.585816 25105 raft_consensus.cc:3060] T b98a35cf96ba4562b4933543b1e4efb9 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:59.586272 24284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7943c68d21d449dba2d1dca6ddde5820" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:59.587215 24284 raft_consensus.cc:2468] T 7943c68d21d449dba2d1dca6ddde5820 P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa14caefbdaa47b09abf91881635ba96 in term 2.
I20260709 12:14:59.589571 24425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477aafe049fa4b1182fb0afe55fe5e55" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:14:59.590442 24425 raft_consensus.cc:2468] T 477aafe049fa4b1182fb0afe55fe5e55 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa14caefbdaa47b09abf91881635ba96 in term 1.
I20260709 12:14:59.598384 24250 leader_election.cc:304] T a18e73ef976b49f0878423c0b3e6e6f2 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, cf2d8294ae68482ca4ffa8be051ad054; no voters: 
I20260709 12:14:59.598846 25105 raft_consensus.cc:515] T b98a35cf96ba4562b4933543b1e4efb9 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:59.600278 24992 raft_consensus.cc:2804] T a18e73ef976b49f0878423c0b3e6e6f2 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:59.600754 24992 raft_consensus.cc:493] T a18e73ef976b49f0878423c0b3e6e6f2 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:14:59.600663 25169 raft_consensus.cc:515] T 558ced611e584b32ab838cceeb7cb410 P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:59.601301 24992 raft_consensus.cc:3060] T a18e73ef976b49f0878423c0b3e6e6f2 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:14:59.578671 24322 leader_election.cc:336] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:14:59.610739 24323 leader_election.cc:304] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, ad362df39b114ec3a3a419128097b362; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883
I20260709 12:14:59.611443 25100 consensus_queue.cc:260] T 8996365fa46548d49f3b3bafe14e9c83 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:59.617700 25169 leader_election.cc:290] T 558ced611e584b32ab838cceeb7cb410 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 2 election: Requested vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:14:59.620867 25100 ts_tablet_manager.cc:1434] T 8996365fa46548d49f3b3bafe14e9c83 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.104s	user 0.002s	sys 0.007s
I20260709 12:14:59.622552 25100 tablet_bootstrap.cc:492] T 99329004ca1c4c76a3a2dd4567ef15dd P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
W20260709 12:14:59.631276 24322 leader_election.cc:336] T ab8dff607862460ea0fcd88422c31ac2 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:14:59.633149 24354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "558ced611e584b32ab838cceeb7cb410" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
I20260709 12:14:59.633986 24354 raft_consensus.cc:3060] T 558ced611e584b32ab838cceeb7cb410 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:59.635954 25160 raft_consensus.cc:515] T 9219abaaa2c34b08a24191512ff742bc P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:59.639900 24424 raft_consensus.cc:2468] T bbab1a4afac94c1eaeb3ed35bc54408a P ad362df39b114ec3a3a419128097b362 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 3.
W20260709 12:14:59.641901 24248 leader_election.cc:336] T bbab1a4afac94c1eaeb3ed35bc54408a P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:14:59.615422 25077 raft_consensus.cc:2804] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:59.646288 25107 raft_consensus.cc:515] T f841b9f0e82748d399b5eef243c442fc P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:59.664517 25107 leader_election.cc:290] T f841b9f0e82748d399b5eef243c442fc P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 2 election: Requested vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:14:59.671253 24356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841b9f0e82748d399b5eef243c442fc" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
I20260709 12:14:59.672112 24356 raft_consensus.cc:3060] T f841b9f0e82748d399b5eef243c442fc P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:59.677860 24280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133e492e820f4152ad30562c343b617d" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:59.678836 24280 raft_consensus.cc:2468] T 133e492e820f4152ad30562c343b617d P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa14caefbdaa47b09abf91881635ba96 in term 1.
I20260709 12:14:59.679198 24285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab8dff607862460ea0fcd88422c31ac2" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:14:59.684105 24285 raft_consensus.cc:2468] T ab8dff607862460ea0fcd88422c31ac2 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa14caefbdaa47b09abf91881635ba96 in term 1.
I20260709 12:14:59.687153 24249 leader_election.cc:304] T bbab1a4afac94c1eaeb3ed35bc54408a P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad362df39b114ec3a3a419128097b362, cf2d8294ae68482ca4ffa8be051ad054; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883
I20260709 12:14:59.688597 25164 raft_consensus.cc:2804] T bbab1a4afac94c1eaeb3ed35bc54408a P cf2d8294ae68482ca4ffa8be051ad054 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:59.689417 25164 raft_consensus.cc:697] T bbab1a4afac94c1eaeb3ed35bc54408a P cf2d8294ae68482ca4ffa8be051ad054 [term 3 LEADER]: Becoming Leader. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Running, Role: LEADER
I20260709 12:14:59.691171 25164 consensus_queue.cc:237] T bbab1a4afac94c1eaeb3ed35bc54408a P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:59.692615 24325 leader_election.cc:304] T 7943c68d21d449dba2d1dca6ddde5820 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, cf2d8294ae68482ca4ffa8be051ad054; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883
I20260709 12:14:59.693681 25106 raft_consensus.cc:2804] T 7943c68d21d449dba2d1dca6ddde5820 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:59.694118 25106 raft_consensus.cc:493] T 7943c68d21d449dba2d1dca6ddde5820 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:14:59.694464 25106 raft_consensus.cc:3060] T 7943c68d21d449dba2d1dca6ddde5820 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:59.701859 25109 raft_consensus.cc:493] T bfba40ac52f842ca99dd4293619360af P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:59.702735 25109 raft_consensus.cc:515] T bfba40ac52f842ca99dd4293619360af P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
W20260709 12:14:59.731261 24322 consensus_peers.cc:597] T ed15c59b19ff49d3a39bf5b5abf8b69a P aa14caefbdaa47b09abf91881635ba96 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:59.735211 24356 raft_consensus.cc:2468] T f841b9f0e82748d399b5eef243c442fc P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 2.
I20260709 12:14:59.736702 24992 raft_consensus.cc:515] T a18e73ef976b49f0878423c0b3e6e6f2 P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:59.736614 24250 leader_election.cc:304] T f841b9f0e82748d399b5eef243c442fc P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, cf2d8294ae68482ca4ffa8be051ad054; no voters: 
I20260709 12:14:59.739809 24429 raft_consensus.cc:1275] T ed15c59b19ff49d3a39bf5b5abf8b69a P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Refusing update from remote peer aa14caefbdaa47b09abf91881635ba96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:59.741860 25169 raft_consensus.cc:2804] T f841b9f0e82748d399b5eef243c442fc P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:59.742609 25169 raft_consensus.cc:697] T f841b9f0e82748d399b5eef243c442fc P cf2d8294ae68482ca4ffa8be051ad054 [term 2 LEADER]: Becoming Leader. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Running, Role: LEADER
I20260709 12:14:59.743229 25120 consensus_queue.cc:1048] T ed15c59b19ff49d3a39bf5b5abf8b69a P aa14caefbdaa47b09abf91881635ba96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:59.744104 25169 consensus_queue.cc:237] T f841b9f0e82748d399b5eef243c442fc P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:59.660187 25077 raft_consensus.cc:493] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:14:59.641592 25104 raft_consensus.cc:515] T 7cbef09353144c0b9a9ebf7731fd019f P ad362df39b114ec3a3a419128097b362 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
W20260709 12:14:59.761039 24248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:38787, user_credentials={real_user=slave}} blocked reactor thread for 43720us
I20260709 12:14:59.659317 25013 raft_consensus.cc:515] T 4b1c850a65b748c093c5c88aa94fed71 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:59.749730 25077 raft_consensus.cc:3060] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:59.776463 24354 raft_consensus.cc:2468] T 558ced611e584b32ab838cceeb7cb410 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 2.
W20260709 12:14:59.777806 24325 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:34565, user_credentials={real_user=slave}} blocked reactor thread for 97352.5us
I20260709 12:14:59.779203 25105 leader_election.cc:290] T b98a35cf96ba4562b4933543b1e4efb9 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 election: Requested vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:14:59.783808 24250 leader_election.cc:304] T 558ced611e584b32ab838cceeb7cb410 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, cf2d8294ae68482ca4ffa8be051ad054; no voters: 
I20260709 12:14:59.788436 24325 leader_election.cc:304] T 133e492e820f4152ad30562c343b617d P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, cf2d8294ae68482ca4ffa8be051ad054; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883
W20260709 12:14:59.790477 24396 leader_election.cc:336] T 477aafe049fa4b1182fb0afe55fe5e55 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
W20260709 12:14:59.795506 24248 leader_election.cc:336] T 558ced611e584b32ab838cceeb7cb410 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:14:59.797073 24396 leader_election.cc:304] T 477aafe049fa4b1182fb0afe55fe5e55 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad362df39b114ec3a3a419128097b362; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, aa14caefbdaa47b09abf91881635ba96
I20260709 12:14:59.791870 25013 leader_election.cc:290] T 4b1c850a65b748c093c5c88aa94fed71 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 election: Requested vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:59.799185 24424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b1c850a65b748c093c5c88aa94fed71" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362"
I20260709 12:14:59.790843 25176 raft_consensus.cc:2804] T 558ced611e584b32ab838cceeb7cb410 P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:59.794957 25120 raft_consensus.cc:2804] T 133e492e820f4152ad30562c343b617d P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:59.802111 25176 raft_consensus.cc:697] T 558ced611e584b32ab838cceeb7cb410 P cf2d8294ae68482ca4ffa8be051ad054 [term 2 LEADER]: Becoming Leader. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Running, Role: LEADER
I20260709 12:14:59.802316 25120 raft_consensus.cc:493] T 133e492e820f4152ad30562c343b617d P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:14:59.802855 25120 raft_consensus.cc:3060] T 133e492e820f4152ad30562c343b617d P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:59.803447 25176 consensus_queue.cc:237] T 558ced611e584b32ab838cceeb7cb410 P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:59.790827 24992 leader_election.cc:290] T a18e73ef976b49f0878423c0b3e6e6f2 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 2 election: Requested vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:14:59.799002 24354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18e73ef976b49f0878423c0b3e6e6f2" candidate_uuid: "cf2d8294ae68482ca4ffa8be051ad054" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
I20260709 12:14:59.790055 25109 leader_election.cc:290] T bfba40ac52f842ca99dd4293619360af P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:14:59.806524 24354 raft_consensus.cc:3060] T a18e73ef976b49f0878423c0b3e6e6f2 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:59.807022 24399 leader_election.cc:304] T 9cb931cb82d74add922e65a2ea3de34d P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad362df39b114ec3a3a419128097b362, cf2d8294ae68482ca4ffa8be051ad054; no voters: 
W20260709 12:14:59.807874 24399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:34565, user_credentials={real_user=slave}} blocked reactor thread for 94267.5us
I20260709 12:14:59.808466 25182 raft_consensus.cc:2804] T 9cb931cb82d74add922e65a2ea3de34d P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:59.810218 25182 raft_consensus.cc:493] T 9cb931cb82d74add922e65a2ea3de34d P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
W20260709 12:14:59.810249 24248 leader_election.cc:336] T f841b9f0e82748d399b5eef243c442fc P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:14:59.810747 25182 raft_consensus.cc:3060] T 9cb931cb82d74add922e65a2ea3de34d P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:14:59.811486 24248 leader_election.cc:336] T a18e73ef976b49f0878423c0b3e6e6f2 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:14:59.823447 24325 leader_election.cc:304] T ab8dff607862460ea0fcd88422c31ac2 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, cf2d8294ae68482ca4ffa8be051ad054; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883
I20260709 12:14:59.808516 25145 raft_consensus.cc:515] T 4b1c850a65b748c093c5c88aa94fed71 P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
W20260709 12:14:59.827167 24322 leader_election.cc:336] T b98a35cf96ba4562b4933543b1e4efb9 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
W20260709 12:14:59.833096 24322 leader_election.cc:336] T 4b1c850a65b748c093c5c88aa94fed71 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:14:59.795749 25104 leader_election.cc:290] T 7cbef09353144c0b9a9ebf7731fd019f P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 3 election: Requested vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:59.837675 24356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9219abaaa2c34b08a24191512ff742bc" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
I20260709 12:14:59.838409 24356 raft_consensus.cc:3060] T 9219abaaa2c34b08a24191512ff742bc P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:59.841885 24354 raft_consensus.cc:2468] T a18e73ef976b49f0878423c0b3e6e6f2 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf2d8294ae68482ca4ffa8be051ad054 in term 2.
I20260709 12:14:59.825291 25175 raft_consensus.cc:2804] T ab8dff607862460ea0fcd88422c31ac2 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:59.846951 24356 raft_consensus.cc:2468] T 9219abaaa2c34b08a24191512ff742bc P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 2.
I20260709 12:14:59.842226 25106 raft_consensus.cc:515] T 7943c68d21d449dba2d1dca6ddde5820 P aa14caefbdaa47b09abf91881635ba96 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:59.829015 25145 leader_election.cc:290] T 4b1c850a65b748c093c5c88aa94fed71 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 election: Requested vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:59.847930 25082 raft_consensus.cc:2749] T 477aafe049fa4b1182fb0afe55fe5e55 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:59.826721 24424 raft_consensus.cc:2393] T 4b1c850a65b748c093c5c88aa94fed71 P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate aa14caefbdaa47b09abf91881635ba96 in current term 2: Already voted for candidate ad362df39b114ec3a3a419128097b362 in this term.
I20260709 12:14:59.850598 24250 leader_election.cc:304] T a18e73ef976b49f0878423c0b3e6e6f2 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, cf2d8294ae68482ca4ffa8be051ad054; no voters: 
I20260709 12:14:59.847784 25175 raft_consensus.cc:493] T ab8dff607862460ea0fcd88422c31ac2 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:14:59.860669 25175 raft_consensus.cc:3060] T ab8dff607862460ea0fcd88422c31ac2 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:59.864285 24323 leader_election.cc:304] T 4b1c850a65b748c093c5c88aa94fed71 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, ad362df39b114ec3a3a419128097b362
I20260709 12:14:59.865317 25182 raft_consensus.cc:515] T 9cb931cb82d74add922e65a2ea3de34d P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:14:59.865921 25105 raft_consensus.cc:2749] T 4b1c850a65b748c093c5c88aa94fed71 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:14:59.874490 25182 leader_election.cc:290] T 9cb931cb82d74add922e65a2ea3de34d P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 election: Requested vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
W20260709 12:14:59.878759 24248 leader_election.cc:336] T a18e73ef976b49f0878423c0b3e6e6f2 P cf2d8294ae68482ca4ffa8be051ad054 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:14:59.869381 24281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cb931cb82d74add922e65a2ea3de34d" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054"
I20260709 12:14:59.879580 24281 raft_consensus.cc:3060] T 9cb931cb82d74add922e65a2ea3de34d P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:59.823995 25160 leader_election.cc:290] T 9219abaaa2c34b08a24191512ff742bc P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 election: Requested vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:14:59.877282 25168 raft_consensus.cc:2804] T a18e73ef976b49f0878423c0b3e6e6f2 P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:59.910475 24354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbef09353144c0b9a9ebf7731fd019f" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
I20260709 12:14:59.911306 24354 raft_consensus.cc:3060] T 7cbef09353144c0b9a9ebf7731fd019f P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:59.906234 25168 raft_consensus.cc:697] T a18e73ef976b49f0878423c0b3e6e6f2 P cf2d8294ae68482ca4ffa8be051ad054 [term 2 LEADER]: Becoming Leader. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Running, Role: LEADER
I20260709 12:14:59.913328 25168 consensus_queue.cc:237] T a18e73ef976b49f0878423c0b3e6e6f2 P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:59.914364 24283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b98a35cf96ba4562b4933543b1e4efb9" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054"
I20260709 12:14:59.915119 24283 raft_consensus.cc:3060] T b98a35cf96ba4562b4933543b1e4efb9 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:59.920305 24356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b1c850a65b748c093c5c88aa94fed71" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
I20260709 12:14:59.921413 24356 raft_consensus.cc:2393] T 4b1c850a65b748c093c5c88aa94fed71 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ad362df39b114ec3a3a419128097b362 in current term 2: Already voted for candidate aa14caefbdaa47b09abf91881635ba96 in this term.
I20260709 12:14:59.920310 24398 leader_election.cc:304] T 9219abaaa2c34b08a24191512ff742bc P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, ad362df39b114ec3a3a419128097b362; no voters: 
I20260709 12:14:59.883810 25175 raft_consensus.cc:515] T ab8dff607862460ea0fcd88422c31ac2 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:59.923803 25145 raft_consensus.cc:2804] T 9219abaaa2c34b08a24191512ff742bc P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:59.924360 25145 raft_consensus.cc:697] T 9219abaaa2c34b08a24191512ff742bc P ad362df39b114ec3a3a419128097b362 [term 2 LEADER]: Becoming Leader. State: Replica: ad362df39b114ec3a3a419128097b362, State: Running, Role: LEADER
W20260709 12:14:59.930120 24396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:38787, user_credentials={real_user=slave}} blocked reactor thread for 142553us
I20260709 12:14:59.925433 25145 consensus_queue.cc:237] T 9219abaaa2c34b08a24191512ff742bc P ad362df39b114ec3a3a419128097b362 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:14:59.958197 24103 catalog_manager.cc:5697] T bbab1a4afac94c1eaeb3ed35bc54408a P cf2d8294ae68482ca4ffa8be051ad054 reported cstate change: term changed from 2 to 3, leader changed from 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193) to cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194). New cstate: current_term: 3 leader_uuid: "cf2d8294ae68482ca4ffa8be051ad054" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: HEALTHY } } }
W20260709 12:14:59.963939 24396 leader_election.cc:336] T 318c217e16874865bd6dff6bd4d8cd4f P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:14:59.977191 25175 leader_election.cc:290] T ab8dff607862460ea0fcd88422c31ac2 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 election: Requested vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:14:59.978643 24283 raft_consensus.cc:2468] T b98a35cf96ba4562b4933543b1e4efb9 P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa14caefbdaa47b09abf91881635ba96 in term 2.
I20260709 12:14:59.979039 25106 leader_election.cc:290] T 7943c68d21d449dba2d1dca6ddde5820 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 3 election: Requested vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:14:59.988251 25120 raft_consensus.cc:515] T 133e492e820f4152ad30562c343b617d P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:14:59.989615 25100 tablet_bootstrap.cc:492] T 99329004ca1c4c76a3a2dd4567ef15dd P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:59.990973 25100 tablet_bootstrap.cc:492] T 99329004ca1c4c76a3a2dd4567ef15dd P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap complete.
I20260709 12:14:59.991863 25100 ts_tablet_manager.cc:1403] T 99329004ca1c4c76a3a2dd4567ef15dd P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.370s	user 0.022s	sys 0.018s
I20260709 12:15:00.006500 25077 raft_consensus.cc:515] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:15:00.007125 24354 raft_consensus.cc:2468] T 7cbef09353144c0b9a9ebf7731fd019f P aa14caefbdaa47b09abf91881635ba96 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 3.
W20260709 12:15:00.007738 24322 leader_election.cc:336] T ab8dff607862460ea0fcd88422c31ac2 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:14:59.995142 24281 raft_consensus.cc:2468] T 9cb931cb82d74add922e65a2ea3de34d P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 2.
W20260709 12:15:00.008651 24322 leader_election.cc:336] T 7943c68d21d449dba2d1dca6ddde5820 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:15:00.010546 24399 leader_election.cc:304] T 9cb931cb82d74add922e65a2ea3de34d P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad362df39b114ec3a3a419128097b362, cf2d8294ae68482ca4ffa8be051ad054; no voters: 
I20260709 12:15:00.012122 25160 raft_consensus.cc:2804] T 9cb931cb82d74add922e65a2ea3de34d P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:00.017730 24283 raft_consensus.cc:1275] T d10519ad64d948b09186e335ed06257d P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Refusing update from remote peer ad362df39b114ec3a3a419128097b362: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:00.021023 25084 consensus_queue.cc:1048] T d10519ad64d948b09186e335ed06257d P ad362df39b114ec3a3a419128097b362 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:00.013321 25160 raft_consensus.cc:697] T 9cb931cb82d74add922e65a2ea3de34d P ad362df39b114ec3a3a419128097b362 [term 2 LEADER]: Becoming Leader. State: Replica: ad362df39b114ec3a3a419128097b362, State: Running, Role: LEADER
I20260709 12:15:00.028765 25160 consensus_queue.cc:237] T 9cb931cb82d74add922e65a2ea3de34d P ad362df39b114ec3a3a419128097b362 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:15:00.026726 25100 raft_consensus.cc:359] T 99329004ca1c4c76a3a2dd4567ef15dd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:15:00.036576 25100 raft_consensus.cc:740] T 99329004ca1c4c76a3a2dd4567ef15dd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:15:00.040489 24429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477aafe049fa4b1182fb0afe55fe5e55" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362"
I20260709 12:15:00.040277 25100 consensus_queue.cc:260] T 99329004ca1c4c76a3a2dd4567ef15dd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:15:00.041160 24429 raft_consensus.cc:3060] T 477aafe049fa4b1182fb0afe55fe5e55 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:00.042060 25109 raft_consensus.cc:493] T 49b141610080476a8e5f0415c370e8cd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:00.032999 24396 leader_election.cc:336] T 9cb931cb82d74add922e65a2ea3de34d P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:15:00.052373 24281 raft_consensus.cc:1275] T 318c217e16874865bd6dff6bd4d8cd4f P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Refusing update from remote peer ad362df39b114ec3a3a419128097b362: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:00.044024 25109 raft_consensus.cc:515] T 49b141610080476a8e5f0415c370e8cd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
W20260709 12:15:00.053954 24325 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:34565, user_credentials={real_user=slave}} blocked reactor thread for 124424us
I20260709 12:15:00.059839 24325 leader_election.cc:304] T b98a35cf96ba4562b4933543b1e4efb9 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, cf2d8294ae68482ca4ffa8be051ad054; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883
I20260709 12:15:00.063279 24429 raft_consensus.cc:2468] T 477aafe049fa4b1182fb0afe55fe5e55 P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa14caefbdaa47b09abf91881635ba96 in term 2.
I20260709 12:15:00.062163 25104 consensus_queue.cc:1048] T 318c217e16874865bd6dff6bd4d8cd4f P ad362df39b114ec3a3a419128097b362 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:15:00.063403 24398 leader_election.cc:304] T 7cbef09353144c0b9a9ebf7731fd019f P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, ad362df39b114ec3a3a419128097b362; no voters: 
I20260709 12:15:00.065745 24284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7943c68d21d449dba2d1dca6ddde5820" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054"
I20260709 12:15:00.069944 24284 raft_consensus.cc:3060] T 7943c68d21d449dba2d1dca6ddde5820 P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:00.058080 24285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab8dff607862460ea0fcd88422c31ac2" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054"
I20260709 12:15:00.071038 24285 raft_consensus.cc:3060] T ab8dff607862460ea0fcd88422c31ac2 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:00.071091 25109 leader_election.cc:290] T 49b141610080476a8e5f0415c370e8cd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:15:00.045703 25077 leader_election.cc:290] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 election: Requested vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
W20260709 12:15:00.074525 24396 leader_election.cc:336] T 4b1c850a65b748c093c5c88aa94fed71 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:15:00.068789 25145 raft_consensus.cc:2804] T 7cbef09353144c0b9a9ebf7731fd019f P ad362df39b114ec3a3a419128097b362 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:00.079658 25100 ts_tablet_manager.cc:1434] T 99329004ca1c4c76a3a2dd4567ef15dd P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.085s	user 0.010s	sys 0.006s
I20260709 12:15:00.079902 24323 leader_election.cc:304] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, ad362df39b114ec3a3a419128097b362; no voters: 
I20260709 12:15:00.090369 25163 raft_consensus.cc:2804] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:00.091080 25163 raft_consensus.cc:697] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96 [term 2 LEADER]: Becoming Leader. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Running, Role: LEADER
I20260709 12:15:00.100273 25120 leader_election.cc:290] T 133e492e820f4152ad30562c343b617d P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 election: Requested vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:15:00.100893 24280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfba40ac52f842ca99dd4293619360af" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:15:00.101004 24279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b141610080476a8e5f0415c370e8cd" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:15:00.105266 25100 tablet_bootstrap.cc:492] T ab8dff607862460ea0fcd88422c31ac2 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:15:00.105705 24280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133e492e820f4152ad30562c343b617d" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054"
I20260709 12:15:00.106431 24280 raft_consensus.cc:3060] T 133e492e820f4152ad30562c343b617d P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:00.106655 25163 consensus_queue.cc:237] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
W20260709 12:15:00.110409 24396 leader_election.cc:336] T 7cbef09353144c0b9a9ebf7731fd019f P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
W20260709 12:15:00.117789 24322 leader_election.cc:336] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:15:00.117923 25109 raft_consensus.cc:493] T 628105dfc534451285d72f9e17f5d4f3 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:00.118669 24322 leader_election.cc:336] T 133e492e820f4152ad30562c343b617d P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:15:00.118605 25109 raft_consensus.cc:515] T 628105dfc534451285d72f9e17f5d4f3 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
W20260709 12:15:00.120360 24396 leader_election.cc:336] T 9219abaaa2c34b08a24191512ff742bc P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
W20260709 12:15:00.121199 24396 leader_election.cc:336] T 4b1c850a65b748c093c5c88aa94fed71 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:15:00.121290 25109 leader_election.cc:290] T 628105dfc534451285d72f9e17f5d4f3 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:15:00.121619 24396 leader_election.cc:304] T 4b1c850a65b748c093c5c88aa94fed71 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad362df39b114ec3a3a419128097b362; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, aa14caefbdaa47b09abf91881635ba96
I20260709 12:15:00.083596 25145 raft_consensus.cc:697] T 7cbef09353144c0b9a9ebf7731fd019f P ad362df39b114ec3a3a419128097b362 [term 3 LEADER]: Becoming Leader. State: Replica: ad362df39b114ec3a3a419128097b362, State: Running, Role: LEADER
W20260709 12:15:00.128314 24396 consensus_peers.cc:597] T d10519ad64d948b09186e335ed06257d P ad362df39b114ec3a3a419128097b362 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:00.134753 24396 leader_election.cc:336] T 9cb931cb82d74add922e65a2ea3de34d P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:15:00.136863 24284 raft_consensus.cc:2468] T 7943c68d21d449dba2d1dca6ddde5820 P cf2d8294ae68482ca4ffa8be051ad054 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa14caefbdaa47b09abf91881635ba96 in term 3.
W20260709 12:15:00.138079 24396 leader_election.cc:336] T 9219abaaa2c34b08a24191512ff742bc P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:15:00.139221 24359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfba40ac52f842ca99dd4293619360af" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:15:00.130041 24279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628105dfc534451285d72f9e17f5d4f3" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:15:00.145705 24285 raft_consensus.cc:2468] T ab8dff607862460ea0fcd88422c31ac2 P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa14caefbdaa47b09abf91881635ba96 in term 2.
W20260709 12:15:00.148213 24248 consensus_peers.cc:597] T bbab1a4afac94c1eaeb3ed35bc54408a P cf2d8294ae68482ca4ffa8be051ad054 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:00.147866 25145 consensus_queue.cc:237] T 7cbef09353144c0b9a9ebf7731fd019f P ad362df39b114ec3a3a419128097b362 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:15:00.150153 25199 raft_consensus.cc:2804] T b98a35cf96ba4562b4933543b1e4efb9 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:00.150784 25199 raft_consensus.cc:697] T b98a35cf96ba4562b4933543b1e4efb9 P aa14caefbdaa47b09abf91881635ba96 [term 2 LEADER]: Becoming Leader. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Running, Role: LEADER
I20260709 12:15:00.151790 25199 consensus_queue.cc:237] T b98a35cf96ba4562b4933543b1e4efb9 P aa14caefbdaa47b09abf91881635ba96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:15:00.137789 25104 raft_consensus.cc:2749] T 4b1c850a65b748c093c5c88aa94fed71 P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:15:00.149528 24325 leader_election.cc:304] T ab8dff607862460ea0fcd88422c31ac2 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, cf2d8294ae68482ca4ffa8be051ad054; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883
W20260709 12:15:00.153414 24322 consensus_peers.cc:597] T fa882381d669422a95ec60c9aefa8105 P aa14caefbdaa47b09abf91881635ba96 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:00.153733 24429 raft_consensus.cc:1275] T fa882381d669422a95ec60c9aefa8105 P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Refusing update from remote peer aa14caefbdaa47b09abf91881635ba96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:00.168527 24325 leader_election.cc:304] T 7943c68d21d449dba2d1dca6ddde5820 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, cf2d8294ae68482ca4ffa8be051ad054; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883
I20260709 12:15:00.170969 25077 raft_consensus.cc:2804] T ab8dff607862460ea0fcd88422c31ac2 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:00.174582 25077 raft_consensus.cc:697] T ab8dff607862460ea0fcd88422c31ac2 P aa14caefbdaa47b09abf91881635ba96 [term 2 LEADER]: Becoming Leader. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Running, Role: LEADER
I20260709 12:15:00.175614 25157 raft_consensus.cc:2804] T 7943c68d21d449dba2d1dca6ddde5820 P aa14caefbdaa47b09abf91881635ba96 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:00.176246 25157 raft_consensus.cc:697] T 7943c68d21d449dba2d1dca6ddde5820 P aa14caefbdaa47b09abf91881635ba96 [term 3 LEADER]: Becoming Leader. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Running, Role: LEADER
I20260709 12:15:00.177354 25157 consensus_queue.cc:237] T 7943c68d21d449dba2d1dca6ddde5820 P aa14caefbdaa47b09abf91881635ba96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:15:00.182093 25096 leader_election.cc:304] T bfba40ac52f842ca99dd4293619360af P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883; no voters: aa14caefbdaa47b09abf91881635ba96, cf2d8294ae68482ca4ffa8be051ad054
W20260709 12:15:00.187917 24396 consensus_peers.cc:597] T 318c217e16874865bd6dff6bd4d8cd4f P ad362df39b114ec3a3a419128097b362 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:00.189057 24396 leader_election.cc:336] T 7cbef09353144c0b9a9ebf7731fd019f P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:15:00.166694 25175 consensus_queue.cc:1048] T fa882381d669422a95ec60c9aefa8105 P aa14caefbdaa47b09abf91881635ba96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:15:00.192595 24359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628105dfc534451285d72f9e17f5d4f3" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:15:00.177408 25077 consensus_queue.cc:237] T ab8dff607862460ea0fcd88422c31ac2 P aa14caefbdaa47b09abf91881635ba96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:15:00.207113 25096 leader_election.cc:304] T 628105dfc534451285d72f9e17f5d4f3 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883; no voters: aa14caefbdaa47b09abf91881635ba96, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:15:00.186214 25109 raft_consensus.cc:2749] T bfba40ac52f842ca99dd4293619360af P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:00.203670 24280 raft_consensus.cc:2468] T 133e492e820f4152ad30562c343b617d P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa14caefbdaa47b09abf91881635ba96 in term 2.
I20260709 12:15:00.209060 25201 raft_consensus.cc:2749] T 628105dfc534451285d72f9e17f5d4f3 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:15:00.249343 24248 consensus_peers.cc:597] T c75afe0e0e00446aa6d220941d288eab P cf2d8294ae68482ca4ffa8be051ad054 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:00.274524 24325 leader_election.cc:304] T 133e492e820f4152ad30562c343b617d P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, cf2d8294ae68482ca4ffa8be051ad054; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883
I20260709 12:15:00.269397 25109 raft_consensus.cc:493] T 477aafe049fa4b1182fb0afe55fe5e55 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:00.279525 25120 raft_consensus.cc:2804] T 133e492e820f4152ad30562c343b617d P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:15:00.342741 25209 log.cc:927] Time spent T d10519ad64d948b09186e335ed06257d P cf2d8294ae68482ca4ffa8be051ad054: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:15:00.354140 25120 raft_consensus.cc:697] T 133e492e820f4152ad30562c343b617d P aa14caefbdaa47b09abf91881635ba96 [term 2 LEADER]: Becoming Leader. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Running, Role: LEADER
I20260709 12:15:00.354279 25109 raft_consensus.cc:515] T 477aafe049fa4b1182fb0afe55fe5e55 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:15:00.368798 25216 raft_consensus.cc:493] T 558ced611e584b32ab838cceeb7cb410 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:00.369495 25216 raft_consensus.cc:515] T 558ced611e584b32ab838cceeb7cb410 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
W20260709 12:15:00.368827 25202 log.cc:927] Time spent T 9cb931cb82d74add922e65a2ea3de34d P ad362df39b114ec3a3a419128097b362: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 12:15:00.399550 24350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477aafe049fa4b1182fb0afe55fe5e55" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:15:00.402669 25120 consensus_queue.cc:237] T 133e492e820f4152ad30562c343b617d P aa14caefbdaa47b09abf91881635ba96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
W20260709 12:15:00.407804 24248 consensus_peers.cc:597] T 558ced611e584b32ab838cceeb7cb410 P cf2d8294ae68482ca4ffa8be051ad054 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:00.421605 24396 consensus_peers.cc:597] T 2c00f77150f7475c94c4fd29c90805cd P ad362df39b114ec3a3a419128097b362 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:00.397507 25109 leader_election.cc:290] T 477aafe049fa4b1182fb0afe55fe5e55 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:15:00.381965 25201 raft_consensus.cc:493] T 085a04f8ed724f82bc12490bbb1ceea7 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:00.415043 24359 raft_consensus.cc:1275] T f841b9f0e82748d399b5eef243c442fc P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Refusing update from remote peer cf2d8294ae68482ca4ffa8be051ad054: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:00.449184 25227 raft_consensus.cc:493] T 2c00f77150f7475c94c4fd29c90805cd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:00.449975 25227 raft_consensus.cc:515] T 2c00f77150f7475c94c4fd29c90805cd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:15:00.452621 25109 raft_consensus.cc:493] T 7cbef09353144c0b9a9ebf7731fd019f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:00.448889 25201 raft_consensus.cc:515] T 085a04f8ed724f82bc12490bbb1ceea7 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:15:00.453312 25109 raft_consensus.cc:515] T 7cbef09353144c0b9a9ebf7731fd019f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:15:00.436262 25216 leader_election.cc:290] T 558ced611e584b32ab838cceeb7cb410 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:15:00.455391 24359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "558ced611e584b32ab838cceeb7cb410" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:15:00.455765 25109 leader_election.cc:290] T 7cbef09353144c0b9a9ebf7731fd019f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:15:00.456367 24359 raft_consensus.cc:2393] T 558ced611e584b32ab838cceeb7cb410 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in current term 2: Already voted for candidate cf2d8294ae68482ca4ffa8be051ad054 in this term.
I20260709 12:15:00.455471 25201 leader_election.cc:290] T 085a04f8ed724f82bc12490bbb1ceea7 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
W20260709 12:15:00.457832 25205 log.cc:927] Time spent T 318c217e16874865bd6dff6bd4d8cd4f P cf2d8294ae68482ca4ffa8be051ad054: Append to log took a long time: real 0.268s	user 0.006s	sys 0.003s
W20260709 12:15:00.433828 24248 consensus_peers.cc:597] T f9094185a2ad43d0b3a5174b165dab65 P cf2d8294ae68482ca4ffa8be051ad054 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:00.463394 24248 consensus_peers.cc:597] T a18e73ef976b49f0878423c0b3e6e6f2 P cf2d8294ae68482ca4ffa8be051ad054 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:00.459407 24322 consensus_peers.cc:597] T 464c7ebd16cd488086ccaec23defbb33 P aa14caefbdaa47b09abf91881635ba96 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:00.492451 24281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "558ced611e584b32ab838cceeb7cb410" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:15:00.525252 25201 raft_consensus.cc:493] T 7d2a60078de84a53aedeb20cdcd211a4 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:00.507364 25176 consensus_queue.cc:1048] T f841b9f0e82748d399b5eef243c442fc P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:15:00.571110 24358 raft_consensus.cc:1275] T 9219abaaa2c34b08a24191512ff742bc P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Refusing update from remote peer ad362df39b114ec3a3a419128097b362: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:00.571362 24351 raft_consensus.cc:1275] T a18e73ef976b49f0878423c0b3e6e6f2 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Refusing update from remote peer cf2d8294ae68482ca4ffa8be051ad054: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:00.572925 25109 raft_consensus.cc:493] T 5310371490a542269db28e29d7adfffa P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:00.573531 25109 raft_consensus.cc:515] T 5310371490a542269db28e29d7adfffa P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:15:00.574028 25225 raft_consensus.cc:493] T cf280984dcfc44039a942819e8df951c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:00.594131 25225 raft_consensus.cc:515] T cf280984dcfc44039a942819e8df951c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:15:00.568141 25201 raft_consensus.cc:515] T 7d2a60078de84a53aedeb20cdcd211a4 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:15:00.603943 25216 raft_consensus.cc:493] T 3fe3be6bb3264475ba597fec30a06f6c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:00.631644 24353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf280984dcfc44039a942819e8df951c" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:15:00.632443 24357 raft_consensus.cc:1275] T 558ced611e584b32ab838cceeb7cb410 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Refusing update from remote peer cf2d8294ae68482ca4ffa8be051ad054: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:15:00.636543 24248 consensus_peers.cc:597] T f841b9f0e82748d399b5eef243c442fc P cf2d8294ae68482ca4ffa8be051ad054 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:00.652511 24398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:46845, user_credentials={real_user=slave}} blocked reactor thread for 119365us
I20260709 12:15:00.640594 25225 leader_election.cc:290] T cf280984dcfc44039a942819e8df951c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:15:00.640509 25216 raft_consensus.cc:515] T 3fe3be6bb3264475ba597fec30a06f6c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:15:00.648989 24992 consensus_queue.cc:1048] T a18e73ef976b49f0878423c0b3e6e6f2 P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:15:00.660388 25169 consensus_queue.cc:1048] T 558ced611e584b32ab838cceeb7cb410 P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:15:00.670166 25227 leader_election.cc:290] T 2c00f77150f7475c94c4fd29c90805cd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:15:00.690237 25109 leader_election.cc:290] T 5310371490a542269db28e29d7adfffa P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:15:00.693684 25216 leader_election.cc:290] T 3fe3be6bb3264475ba597fec30a06f6c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:15:00.695742 25201 leader_election.cc:290] T 7d2a60078de84a53aedeb20cdcd211a4 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:15:00.671101 25145 consensus_queue.cc:1048] T 9219abaaa2c34b08a24191512ff742bc P ad362df39b114ec3a3a419128097b362 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:15:00.705067 24352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c00f77150f7475c94c4fd29c90805cd" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
W20260709 12:15:00.733536 24248 consensus_peers.cc:597] T 5310371490a542269db28e29d7adfffa P cf2d8294ae68482ca4ffa8be051ad054 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:00.744827 24353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe3be6bb3264475ba597fec30a06f6c" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:15:00.745888 25100 tablet_bootstrap.cc:492] T ab8dff607862460ea0fcd88422c31ac2 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:00.747439 25100 tablet_bootstrap.cc:492] T ab8dff607862460ea0fcd88422c31ac2 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap complete.
I20260709 12:15:00.748446 25100 ts_tablet_manager.cc:1403] T ab8dff607862460ea0fcd88422c31ac2 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.650s	user 0.030s	sys 0.005s
I20260709 12:15:00.756001 24429 raft_consensus.cc:1275] T bbab1a4afac94c1eaeb3ed35bc54408a P ad362df39b114ec3a3a419128097b362 [term 3 FOLLOWER]: Refusing update from remote peer cf2d8294ae68482ca4ffa8be051ad054: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:00.765825 24359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbef09353144c0b9a9ebf7731fd019f" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:15:00.766799 24359 raft_consensus.cc:2393] T 7cbef09353144c0b9a9ebf7731fd019f P aa14caefbdaa47b09abf91881635ba96 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in current term 3: Already voted for candidate ad362df39b114ec3a3a419128097b362 in this term.
W20260709 12:15:00.764660 24248 consensus_peers.cc:597] T 085a04f8ed724f82bc12490bbb1ceea7 P cf2d8294ae68482ca4ffa8be051ad054 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:00.783149 24248 consensus_peers.cc:597] T 3fe3be6bb3264475ba597fec30a06f6c P cf2d8294ae68482ca4ffa8be051ad054 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:00.794088 25100 raft_consensus.cc:359] T ab8dff607862460ea0fcd88422c31ac2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:15:00.795594 25100 raft_consensus.cc:740] T ab8dff607862460ea0fcd88422c31ac2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:15:00.807929 24359 raft_consensus.cc:1275] T 7cbef09353144c0b9a9ebf7731fd019f P aa14caefbdaa47b09abf91881635ba96 [term 3 FOLLOWER]: Refusing update from remote peer ad362df39b114ec3a3a419128097b362: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:00.796346 24354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5310371490a542269db28e29d7adfffa" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:15:00.819315 25100 consensus_queue.cc:260] T ab8dff607862460ea0fcd88422c31ac2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:15:00.825017 25084 consensus_queue.cc:1048] T 7cbef09353144c0b9a9ebf7731fd019f P ad362df39b114ec3a3a419128097b362 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:15:00.834267 25097 leader_election.cc:304] T 558ced611e584b32ab838cceeb7cb410 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883; no voters: aa14caefbdaa47b09abf91881635ba96, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:15:00.835843 25201 raft_consensus.cc:3060] T 558ced611e584b32ab838cceeb7cb410 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:00.836094 25100 ts_tablet_manager.cc:1434] T ab8dff607862460ea0fcd88422c31ac2 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.087s	user 0.011s	sys 0.000s
I20260709 12:15:00.837682 25100 tablet_bootstrap.cc:492] T 0d31cf2c4a7849d9a798bf886e7fc997 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
W20260709 12:15:00.844231 24396 consensus_peers.cc:597] T 9219abaaa2c34b08a24191512ff742bc P ad362df39b114ec3a3a419128097b362 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:00.845062 24396 consensus_peers.cc:597] T 9cb931cb82d74add922e65a2ea3de34d P ad362df39b114ec3a3a419128097b362 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:00.903935 24280 raft_consensus.cc:1275] T 9cb931cb82d74add922e65a2ea3de34d P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Refusing update from remote peer ad362df39b114ec3a3a419128097b362: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:00.911548 24284 raft_consensus.cc:1275] T ab8dff607862460ea0fcd88422c31ac2 P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Refusing update from remote peer aa14caefbdaa47b09abf91881635ba96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:00.914301 25242 consensus_queue.cc:1048] T bbab1a4afac94c1eaeb3ed35bc54408a P cf2d8294ae68482ca4ffa8be051ad054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:15:00.916535 24282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5310371490a542269db28e29d7adfffa" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:15:00.917822 24278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe3be6bb3264475ba597fec30a06f6c" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:15:00.920285 25160 consensus_queue.cc:1048] T 9cb931cb82d74add922e65a2ea3de34d P ad362df39b114ec3a3a419128097b362 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:00.920759 25120 consensus_queue.cc:1048] T ab8dff607862460ea0fcd88422c31ac2 P aa14caefbdaa47b09abf91881635ba96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:00.921645 24280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a04f8ed724f82bc12490bbb1ceea7" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:15:00.922441 24277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d2a60078de84a53aedeb20cdcd211a4" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:15:00.905449 25216 raft_consensus.cc:493] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:00.923866 25216 raft_consensus.cc:515] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:15:00.925529 24284 raft_consensus.cc:1275] T b98a35cf96ba4562b4933543b1e4efb9 P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Refusing update from remote peer aa14caefbdaa47b09abf91881635ba96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:15:00.929613 24249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46467, user_credentials={real_user=slave}} blocked reactor thread for 59094.6us
I20260709 12:15:00.935726 25120 consensus_queue.cc:1048] T b98a35cf96ba4562b4933543b1e4efb9 P aa14caefbdaa47b09abf91881635ba96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:00.938712 25097 leader_election.cc:304] T 5310371490a542269db28e29d7adfffa P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883; no voters: aa14caefbdaa47b09abf91881635ba96, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:15:00.939169 24425 raft_consensus.cc:1275] T 477aafe049fa4b1182fb0afe55fe5e55 P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Refusing update from remote peer aa14caefbdaa47b09abf91881635ba96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:00.940263 25097 leader_election.cc:304] T 3fe3be6bb3264475ba597fec30a06f6c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883; no voters: aa14caefbdaa47b09abf91881635ba96, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:15:00.941957 25109 raft_consensus.cc:2749] T 5310371490a542269db28e29d7adfffa P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:00.944203 25227 raft_consensus.cc:2749] T 3fe3be6bb3264475ba597fec30a06f6c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:00.932137 25216 leader_election.cc:290] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:15:00.945647 25120 consensus_queue.cc:1048] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
W20260709 12:15:00.970077 24396 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:38787, user_credentials={real_user=slave}} blocked reactor thread for 124382us
I20260709 12:15:00.991784 24429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477aafe049fa4b1182fb0afe55fe5e55" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:15:00.979746 25216 raft_consensus.cc:493] T f9094185a2ad43d0b3a5174b165dab65 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:01.005033 24428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "085a04f8ed724f82bc12490bbb1ceea7" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:15:01.059875 25095 leader_election.cc:304] T 477aafe049fa4b1182fb0afe55fe5e55 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883; no voters: aa14caefbdaa47b09abf91881635ba96, ad362df39b114ec3a3a419128097b362
I20260709 12:15:01.061362 24427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c00f77150f7475c94c4fd29c90805cd" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:15:01.062106 25227 raft_consensus.cc:2749] T 477aafe049fa4b1182fb0afe55fe5e55 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:01.060190 24433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbab1a4afac94c1eaeb3ed35bc54408a" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:15:01.064496 24433 raft_consensus.cc:2393] T bbab1a4afac94c1eaeb3ed35bc54408a P ad362df39b114ec3a3a419128097b362 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in current term 3: Already voted for candidate cf2d8294ae68482ca4ffa8be051ad054 in this term.
I20260709 12:15:01.059634 24431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b141610080476a8e5f0415c370e8cd" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:15:01.023095 25216 raft_consensus.cc:515] T f9094185a2ad43d0b3a5174b165dab65 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
W20260709 12:15:01.088899 24322 consensus_peers.cc:597] T ba38e800dd034ff8b7fda6701973510b P aa14caefbdaa47b09abf91881635ba96 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:01.083885 24279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbab1a4afac94c1eaeb3ed35bc54408a" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:15:01.102067 24426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d2a60078de84a53aedeb20cdcd211a4" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:15:01.102249 24430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf280984dcfc44039a942819e8df951c" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
W20260709 12:15:01.104720 25245 log.cc:927] Time spent T 9219abaaa2c34b08a24191512ff742bc P aa14caefbdaa47b09abf91881635ba96: Append to log took a long time: real 0.171s	user 0.002s	sys 0.000s
I20260709 12:15:01.104933 25216 leader_election.cc:290] T f9094185a2ad43d0b3a5174b165dab65 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:15:01.129238 24280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9094185a2ad43d0b3a5174b165dab65" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
W20260709 12:15:01.131654 24396 consensus_peers.cc:597] T fd6e20f3c92f4498a8c272b807797efa P ad362df39b114ec3a3a419128097b362 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:01.132740 24322 consensus_peers.cc:597] T ab8dff607862460ea0fcd88422c31ac2 P aa14caefbdaa47b09abf91881635ba96 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:01.131665 25095 leader_election.cc:304] T 2c00f77150f7475c94c4fd29c90805cd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883; no voters: aa14caefbdaa47b09abf91881635ba96, ad362df39b114ec3a3a419128097b362
W20260709 12:15:01.134037 24322 consensus_peers.cc:597] T b98a35cf96ba4562b4933543b1e4efb9 P aa14caefbdaa47b09abf91881635ba96 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:01.134807 24322 consensus_peers.cc:597] T 27de4156b2e24143a2f301fbefc7cb23 P aa14caefbdaa47b09abf91881635ba96 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:01.135203 25095 leader_election.cc:304] T 49b141610080476a8e5f0415c370e8cd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883; no voters: ad362df39b114ec3a3a419128097b362, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:15:01.131474 24430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9094185a2ad43d0b3a5174b165dab65" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
W20260709 12:15:01.136996 24396 consensus_peers.cc:597] T 7d2a60078de84a53aedeb20cdcd211a4 P ad362df39b114ec3a3a419128097b362 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:01.139323 25097 leader_election.cc:304] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883; no voters: ad362df39b114ec3a3a419128097b362, cf2d8294ae68482ca4ffa8be051ad054
W20260709 12:15:01.142493 24322 consensus_peers.cc:597] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:01.143873 25201 raft_consensus.cc:2749] T 558ced611e584b32ab838cceeb7cb410 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:15:01.144778 24322 consensus_peers.cc:597] T cf280984dcfc44039a942819e8df951c P aa14caefbdaa47b09abf91881635ba96 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:01.145990 25227 raft_consensus.cc:2749] T 2c00f77150f7475c94c4fd29c90805cd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:01.147168 25095 leader_election.cc:304] T 7d2a60078de84a53aedeb20cdcd211a4 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883; no voters: ad362df39b114ec3a3a419128097b362, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:15:01.148084 25227 raft_consensus.cc:2749] T 49b141610080476a8e5f0415c370e8cd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:15:01.137683 24396 consensus_peers.cc:597] T e05eec364f764114bdb814096b9bf0ce P ad362df39b114ec3a3a419128097b362 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:01.148957 25227 raft_consensus.cc:2749] T 7d2a60078de84a53aedeb20cdcd211a4 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:01.151013 25109 raft_consensus.cc:3060] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:01.158449 24107 catalog_manager.cc:5697] T fa882381d669422a95ec60c9aefa8105 P aa14caefbdaa47b09abf91881635ba96 reported cstate change: term changed from 1 to 2, leader changed from 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193) to aa14caefbdaa47b09abf91881635ba96 (127.12.56.195). New cstate: current_term: 2 leader_uuid: "aa14caefbdaa47b09abf91881635ba96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:01.160882 24107 catalog_manager.cc:5697] T ab8dff607862460ea0fcd88422c31ac2 P aa14caefbdaa47b09abf91881635ba96 reported cstate change: term changed from 1 to 2, leader changed from 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193) to aa14caefbdaa47b09abf91881635ba96 (127.12.56.195). New cstate: current_term: 2 leader_uuid: "aa14caefbdaa47b09abf91881635ba96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:01.165377 24107 catalog_manager.cc:5697] T b98a35cf96ba4562b4933543b1e4efb9 P aa14caefbdaa47b09abf91881635ba96 reported cstate change: term changed from 1 to 2, leader changed from 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193) to aa14caefbdaa47b09abf91881635ba96 (127.12.56.195). New cstate: current_term: 2 leader_uuid: "aa14caefbdaa47b09abf91881635ba96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:01.167658 24107 catalog_manager.cc:5697] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96 reported cstate change: term changed from 1 to 2, leader changed from 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193) to aa14caefbdaa47b09abf91881635ba96 (127.12.56.195). New cstate: current_term: 2 leader_uuid: "aa14caefbdaa47b09abf91881635ba96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:01.169559 24107 catalog_manager.cc:5697] T 7943c68d21d449dba2d1dca6ddde5820 P aa14caefbdaa47b09abf91881635ba96 reported cstate change: term changed from 2 to 3, leader changed from 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193) to aa14caefbdaa47b09abf91881635ba96 (127.12.56.195). New cstate: current_term: 3 leader_uuid: "aa14caefbdaa47b09abf91881635ba96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:01.172726 25095 leader_election.cc:304] T 085a04f8ed724f82bc12490bbb1ceea7 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883; no voters: ad362df39b114ec3a3a419128097b362, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:15:01.173704 25216 raft_consensus.cc:2749] T 085a04f8ed724f82bc12490bbb1ceea7 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:01.175266 25095 leader_election.cc:304] T cf280984dcfc44039a942819e8df951c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883; no voters: aa14caefbdaa47b09abf91881635ba96, ad362df39b114ec3a3a419128097b362
I20260709 12:15:01.176424 25216 raft_consensus.cc:2749] T cf280984dcfc44039a942819e8df951c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:01.171265 24107 catalog_manager.cc:5697] T 133e492e820f4152ad30562c343b617d P aa14caefbdaa47b09abf91881635ba96 reported cstate change: term changed from 1 to 2, leader changed from 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193) to aa14caefbdaa47b09abf91881635ba96 (127.12.56.195). New cstate: current_term: 2 leader_uuid: "aa14caefbdaa47b09abf91881635ba96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:01.178972 24424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbef09353144c0b9a9ebf7731fd019f" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:15:01.185142 24108 catalog_manager.cc:5697] T f841b9f0e82748d399b5eef243c442fc P cf2d8294ae68482ca4ffa8be051ad054 reported cstate change: term changed from 1 to 2, leader changed from 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193) to cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194). New cstate: current_term: 2 leader_uuid: "cf2d8294ae68482ca4ffa8be051ad054" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: UNKNOWN } } }
W20260709 12:15:01.190218 24396 consensus_peers.cc:597] T 6af96d3f7393445f8b7edb30a26a6f65 P ad362df39b114ec3a3a419128097b362 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:01.202316 24396 consensus_peers.cc:597] T 7cbef09353144c0b9a9ebf7731fd019f P ad362df39b114ec3a3a419128097b362 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:01.187928 24108 catalog_manager.cc:5697] T a18e73ef976b49f0878423c0b3e6e6f2 P cf2d8294ae68482ca4ffa8be051ad054 reported cstate change: term changed from 1 to 2, leader changed from 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193) to cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194). New cstate: current_term: 2 leader_uuid: "cf2d8294ae68482ca4ffa8be051ad054" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: UNKNOWN } } }
W20260709 12:15:01.203081 24396 consensus_peers.cc:597] T 4f756e6bcc20458b8748cd090cd3fce2 P ad362df39b114ec3a3a419128097b362 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:01.215577 25100 tablet_bootstrap.cc:492] T 0d31cf2c4a7849d9a798bf886e7fc997 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:15:01.209604 24396 consensus_peers.cc:597] T b727e95d8f5843a3bb0d7cbddce61bdb P ad362df39b114ec3a3a419128097b362 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:01.210930 24108 catalog_manager.cc:5697] T 318c217e16874865bd6dff6bd4d8cd4f P cf2d8294ae68482ca4ffa8be051ad054 reported cstate change: term changed from 1 to 2, leader changed from 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193) to ad362df39b114ec3a3a419128097b362 (127.12.56.196). New cstate: current_term: 2 leader_uuid: "ad362df39b114ec3a3a419128097b362" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } }
I20260709 12:15:01.224519 24108 catalog_manager.cc:5697] T 558ced611e584b32ab838cceeb7cb410 P cf2d8294ae68482ca4ffa8be051ad054 reported cstate change: term changed from 1 to 2, leader changed from 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193) to cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194). New cstate: current_term: 2 leader_uuid: "cf2d8294ae68482ca4ffa8be051ad054" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:01.243698 24285 raft_consensus.cc:1275] T 133e492e820f4152ad30562c343b617d P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Refusing update from remote peer aa14caefbdaa47b09abf91881635ba96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:01.276683 25100 tablet_bootstrap.cc:492] T 0d31cf2c4a7849d9a798bf886e7fc997 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap complete.
I20260709 12:15:01.277936 25100 ts_tablet_manager.cc:1403] T 0d31cf2c4a7849d9a798bf886e7fc997 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.441s	user 0.037s	sys 0.049s
W20260709 12:15:01.301815 24250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:46845, user_credentials={real_user=slave}} blocked reactor thread for 49908us
W20260709 12:15:01.320501 24249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46467, user_credentials={real_user=slave}} blocked reactor thread for 53880.1us
I20260709 12:15:01.304077 24283 raft_consensus.cc:1275] T 7943c68d21d449dba2d1dca6ddde5820 P cf2d8294ae68482ca4ffa8be051ad054 [term 3 FOLLOWER]: Refusing update from remote peer aa14caefbdaa47b09abf91881635ba96: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:01.262015 25097 leader_election.cc:304] T f9094185a2ad43d0b3a5174b165dab65 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883; no voters: ad362df39b114ec3a3a419128097b362, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:15:01.255183 25095 leader_election.cc:304] T 7cbef09353144c0b9a9ebf7731fd019f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883; no voters: aa14caefbdaa47b09abf91881635ba96, ad362df39b114ec3a3a419128097b362
I20260709 12:15:01.346124 25100 raft_consensus.cc:359] T 0d31cf2c4a7849d9a798bf886e7fc997 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:15:01.355728 25100 raft_consensus.cc:740] T 0d31cf2c4a7849d9a798bf886e7fc997 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:15:01.358669 25100 consensus_queue.cc:260] T 0d31cf2c4a7849d9a798bf886e7fc997 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
W20260709 12:15:01.344208 24396 consensus_peers.cc:597] T 8996365fa46548d49f3b3bafe14e9c83 P ad362df39b114ec3a3a419128097b362 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:01.262326 25163 consensus_queue.cc:1048] T 133e492e820f4152ad30562c343b617d P aa14caefbdaa47b09abf91881635ba96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 12:15:01.376971 25201 raft_consensus.cc:3060] T 7cbef09353144c0b9a9ebf7731fd019f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:15:01.377060 25095 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.196:46467, user_credentials={real_user=slave}} blocked reactor thread for 143757us
I20260709 12:15:01.353945 25216 raft_consensus.cc:2749] T f9094185a2ad43d0b3a5174b165dab65 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:15:01.398198 24399 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:34565, user_credentials={real_user=slave}} blocked reactor thread for 144436us
I20260709 12:15:01.403280 25109 raft_consensus.cc:2749] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:01.357292 25199 consensus_queue.cc:1048] T 7943c68d21d449dba2d1dca6ddde5820 P aa14caefbdaa47b09abf91881635ba96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
W20260709 12:15:01.379179 25097 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.194:34565, user_credentials={real_user=slave}} blocked reactor thread for 140235us
I20260709 12:15:01.420513 25100 ts_tablet_manager.cc:1434] T 0d31cf2c4a7849d9a798bf886e7fc997 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.142s	user 0.008s	sys 0.000s
I20260709 12:15:01.421944 25100 tablet_bootstrap.cc:492] T d10519ad64d948b09186e335ed06257d P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
W20260709 12:15:01.413707 24396 consensus_peers.cc:597] T d92a635ff6404268bd5e51d3b9681551 P ad362df39b114ec3a3a419128097b362 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:01.423496 25216 raft_consensus.cc:493] T 8996365fa46548d49f3b3bafe14e9c83 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:01.424108 25216 raft_consensus.cc:515] T 8996365fa46548d49f3b3bafe14e9c83 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
W20260709 12:15:01.434724 24322 consensus_peers.cc:597] T 133e492e820f4152ad30562c343b617d P aa14caefbdaa47b09abf91881635ba96 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:01.436811 25216 leader_election.cc:290] T 8996365fa46548d49f3b3bafe14e9c83 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
W20260709 12:15:01.439371 24396 consensus_peers.cc:597] T 95d3180f4ab5472d9de6e220219e7898 P ad362df39b114ec3a3a419128097b362 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:01.441082 24359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8996365fa46548d49f3b3bafe14e9c83" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:15:01.460774 24428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8996365fa46548d49f3b3bafe14e9c83" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:15:01.463961 25096 leader_election.cc:304] T 8996365fa46548d49f3b3bafe14e9c83 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883; no voters: aa14caefbdaa47b09abf91881635ba96, ad362df39b114ec3a3a419128097b362
W20260709 12:15:01.469802 24322 consensus_peers.cc:597] T 7943c68d21d449dba2d1dca6ddde5820 P aa14caefbdaa47b09abf91881635ba96 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:01.477594 25216 raft_consensus.cc:2749] T 8996365fa46548d49f3b3bafe14e9c83 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:15:01.488121 24248 consensus_peers.cc:597] T 628105dfc534451285d72f9e17f5d4f3 P cf2d8294ae68482ca4ffa8be051ad054 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:01.509512 24103 catalog_manager.cc:5697] T 9219abaaa2c34b08a24191512ff742bc P ad362df39b114ec3a3a419128097b362 reported cstate change: term changed from 1 to 2, leader changed from 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193) to ad362df39b114ec3a3a419128097b362 (127.12.56.196). New cstate: current_term: 2 leader_uuid: "ad362df39b114ec3a3a419128097b362" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:01.515415 24103 catalog_manager.cc:5697] T 7cbef09353144c0b9a9ebf7731fd019f P ad362df39b114ec3a3a419128097b362 reported cstate change: term changed from 2 to 3, leader changed from 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193) to ad362df39b114ec3a3a419128097b362 (127.12.56.196). New cstate: current_term: 3 leader_uuid: "ad362df39b114ec3a3a419128097b362" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: UNKNOWN } } }
W20260709 12:15:01.514335 24248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:38787, user_credentials={real_user=slave}} blocked reactor thread for 287978us
I20260709 12:15:01.519110 24103 catalog_manager.cc:5697] T 9cb931cb82d74add922e65a2ea3de34d P ad362df39b114ec3a3a419128097b362 reported cstate change: term changed from 1 to 2, leader changed from 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193) to ad362df39b114ec3a3a419128097b362 (127.12.56.196). New cstate: current_term: 2 leader_uuid: "ad362df39b114ec3a3a419128097b362" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: UNKNOWN } } }
W20260709 12:15:01.532724 24248 consensus_peers.cc:597] T 67c0216443004287861015dd30ae5144 P cf2d8294ae68482ca4ffa8be051ad054 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:01.538493 24248 consensus_peers.cc:597] T bfba40ac52f842ca99dd4293619360af P cf2d8294ae68482ca4ffa8be051ad054 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:01.539165 24248 consensus_peers.cc:597] T 0d31cf2c4a7849d9a798bf886e7fc997 P cf2d8294ae68482ca4ffa8be051ad054 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:01.558918 24248 consensus_peers.cc:597] T 99329004ca1c4c76a3a2dd4567ef15dd P cf2d8294ae68482ca4ffa8be051ad054 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:01.578771 25201 raft_consensus.cc:2749] T 7cbef09353144c0b9a9ebf7731fd019f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:15:01.597489 24248 consensus_peers.cc:597] T 356b14abd90d418cab44e524aef8154c P cf2d8294ae68482ca4ffa8be051ad054 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:01.602572 24248 consensus_peers.cc:597] T 49b141610080476a8e5f0415c370e8cd P cf2d8294ae68482ca4ffa8be051ad054 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:01.608282 24248 consensus_peers.cc:597] T 06d0284e94354a2686c577372cceb2bc P cf2d8294ae68482ca4ffa8be051ad054 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:01.616659 25201 raft_consensus.cc:493] T 99329004ca1c4c76a3a2dd4567ef15dd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:01.638551 25201 raft_consensus.cc:515] T 99329004ca1c4c76a3a2dd4567ef15dd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:15:01.642457 24279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99329004ca1c4c76a3a2dd4567ef15dd" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:15:01.644193 25201 leader_election.cc:290] T 99329004ca1c4c76a3a2dd4567ef15dd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:15:01.650701 24351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99329004ca1c4c76a3a2dd4567ef15dd" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:15:01.652783 25096 leader_election.cc:304] T 99329004ca1c4c76a3a2dd4567ef15dd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883; no voters: aa14caefbdaa47b09abf91881635ba96, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:15:01.658406 25201 raft_consensus.cc:2749] T 99329004ca1c4c76a3a2dd4567ef15dd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:01.725085 25100 tablet_bootstrap.cc:492] T d10519ad64d948b09186e335ed06257d P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:01.725365 12515 rpc_server.cc:307] RPC server started. Bound to: 127.12.56.193:38787
I20260709 12:15:01.725452 25290 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.56.193:38787 every 8 connection(s)
I20260709 12:15:01.726668 25100 tablet_bootstrap.cc:492] T d10519ad64d948b09186e335ed06257d P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap complete.
I20260709 12:15:01.727560 25100 ts_tablet_manager.cc:1403] T d10519ad64d948b09186e335ed06257d P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.306s	user 0.027s	sys 0.019s
I20260709 12:15:01.730890 25100 raft_consensus.cc:359] T d10519ad64d948b09186e335ed06257d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:15:01.732263 25100 raft_consensus.cc:740] T d10519ad64d948b09186e335ed06257d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:15:01.733667 25100 consensus_queue.cc:260] T d10519ad64d948b09186e335ed06257d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:15:01.737540 25100 ts_tablet_manager.cc:1434] T d10519ad64d948b09186e335ed06257d P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:15:01.739030 25100 tablet_bootstrap.cc:492] T 9cb931cb82d74add922e65a2ea3de34d P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:15:01.801710 25100 tablet_bootstrap.cc:492] T 9cb931cb82d74add922e65a2ea3de34d P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:01.808594 25100 tablet_bootstrap.cc:492] T 9cb931cb82d74add922e65a2ea3de34d P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap complete.
I20260709 12:15:01.815383 25100 ts_tablet_manager.cc:1403] T 9cb931cb82d74add922e65a2ea3de34d P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.077s	user 0.023s	sys 0.008s
I20260709 12:15:01.818457 25100 raft_consensus.cc:359] T 9cb931cb82d74add922e65a2ea3de34d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:15:01.819226 25100 raft_consensus.cc:740] T 9cb931cb82d74add922e65a2ea3de34d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:15:01.819989 25100 consensus_queue.cc:260] T 9cb931cb82d74add922e65a2ea3de34d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:15:01.821712 25100 ts_tablet_manager.cc:1434] T 9cb931cb82d74add922e65a2ea3de34d P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:15:01.822990 25100 tablet_bootstrap.cc:492] T 6af96d3f7393445f8b7edb30a26a6f65 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:15:01.842131 25291 heartbeater.cc:344] Connected to a master server at 127.12.56.254:39861
I20260709 12:15:01.842787 25291 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:01.843979 25291 heartbeater.cc:507] Master 127.12.56.254:39861 requested a full tablet report, sending...
I20260709 12:15:01.862165 25172 raft_consensus.cc:3060] T ab8dff607862460ea0fcd88422c31ac2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:01.866977 24107 ts_manager.cc:194] Re-registered known tserver with Master: 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:15:01.867769 25120 raft_consensus.cc:493] T 4b1c850a65b748c093c5c88aa94fed71 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:01.868432 25120 raft_consensus.cc:515] T 4b1c850a65b748c093c5c88aa94fed71 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:15:01.874298 25120 leader_election.cc:290] T 4b1c850a65b748c093c5c88aa94fed71 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:15:01.876793 24428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b1c850a65b748c093c5c88aa94fed71" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:15:01.882102 24428 raft_consensus.cc:2468] T 4b1c850a65b748c093c5c88aa94fed71 P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa14caefbdaa47b09abf91881635ba96 in term 2.
I20260709 12:15:01.885463 24323 leader_election.cc:304] T 4b1c850a65b748c093c5c88aa94fed71 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, ad362df39b114ec3a3a419128097b362; no voters: 
I20260709 12:15:01.887934 25199 raft_consensus.cc:2804] T 4b1c850a65b748c093c5c88aa94fed71 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:01.888576 25199 raft_consensus.cc:493] T 4b1c850a65b748c093c5c88aa94fed71 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:01.889173 25199 raft_consensus.cc:3060] T 4b1c850a65b748c093c5c88aa94fed71 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:01.900944 25171 raft_consensus.cc:3060] T d10519ad64d948b09186e335ed06257d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:01.914511 25159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b1c850a65b748c093c5c88aa94fed71" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" is_pre_election: true
W20260709 12:15:01.937636 24322 leader_election.cc:343] T 4b1c850a65b748c093c5c88aa94fed71 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:01.936059 24248 consensus_peers.cc:597] T b1e1c3b597fd49b2831e5f523149b2dc P cf2d8294ae68482ca4ffa8be051ad054 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:01.942646 24107 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50612
I20260709 12:15:01.955528 25199 raft_consensus.cc:515] T 4b1c850a65b748c093c5c88aa94fed71 P aa14caefbdaa47b09abf91881635ba96 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:15:01.984861 25291 heartbeater.cc:499] Master 127.12.56.254:39861 was elected leader, sending a full tablet report...
I20260709 12:15:01.983889 24427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b1c850a65b748c093c5c88aa94fed71" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362"
I20260709 12:15:02.002938 24427 raft_consensus.cc:3060] T 4b1c850a65b748c093c5c88aa94fed71 P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:02.005450 25178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b1c850a65b748c093c5c88aa94fed71" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
W20260709 12:15:02.009974 24322 leader_election.cc:343] T 4b1c850a65b748c093c5c88aa94fed71 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:01.990871 25199 leader_election.cc:290] T 4b1c850a65b748c093c5c88aa94fed71 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 3 election: Requested vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:15:02.026540 25100 tablet_bootstrap.cc:492] T 6af96d3f7393445f8b7edb30a26a6f65 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:02.039278 25100 tablet_bootstrap.cc:492] T 6af96d3f7393445f8b7edb30a26a6f65 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap complete.
I20260709 12:15:02.041057 25100 ts_tablet_manager.cc:1403] T 6af96d3f7393445f8b7edb30a26a6f65 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.218s	user 0.050s	sys 0.025s
I20260709 12:15:02.048884 25100 raft_consensus.cc:359] T 6af96d3f7393445f8b7edb30a26a6f65 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:15:02.053313 25100 raft_consensus.cc:740] T 6af96d3f7393445f8b7edb30a26a6f65 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:15:02.052757 24427 raft_consensus.cc:2468] T 4b1c850a65b748c093c5c88aa94fed71 P ad362df39b114ec3a3a419128097b362 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa14caefbdaa47b09abf91881635ba96 in term 3.
I20260709 12:15:02.054352 25100 consensus_queue.cc:260] T 6af96d3f7393445f8b7edb30a26a6f65 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:15:02.055264 24323 leader_election.cc:304] T 4b1c850a65b748c093c5c88aa94fed71 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, ad362df39b114ec3a3a419128097b362; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883
I20260709 12:15:02.056739 25199 raft_consensus.cc:2804] T 4b1c850a65b748c093c5c88aa94fed71 P aa14caefbdaa47b09abf91881635ba96 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:02.060016 25199 raft_consensus.cc:697] T 4b1c850a65b748c093c5c88aa94fed71 P aa14caefbdaa47b09abf91881635ba96 [term 3 LEADER]: Becoming Leader. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Running, Role: LEADER
I20260709 12:15:02.061276 25199 consensus_queue.cc:237] T 4b1c850a65b748c093c5c88aa94fed71 P aa14caefbdaa47b09abf91881635ba96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:15:02.057052 25100 ts_tablet_manager.cc:1434] T 6af96d3f7393445f8b7edb30a26a6f65 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 12:15:02.069232 25100 tablet_bootstrap.cc:492] T 95d3180f4ab5472d9de6e220219e7898 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:15:02.097667 25155 raft_consensus.cc:3060] T 477aafe049fa4b1182fb0afe55fe5e55 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:02.098662 25216 raft_consensus.cc:493] T 628105dfc534451285d72f9e17f5d4f3 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:02.099253 25216 raft_consensus.cc:515] T 628105dfc534451285d72f9e17f5d4f3 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:15:02.101514 25216 leader_election.cc:290] T 628105dfc534451285d72f9e17f5d4f3 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:15:02.106112 24353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628105dfc534451285d72f9e17f5d4f3" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:15:02.107967 24279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628105dfc534451285d72f9e17f5d4f3" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054" is_pre_election: true
I20260709 12:15:02.111081 24107 catalog_manager.cc:5697] T 4b1c850a65b748c093c5c88aa94fed71 P aa14caefbdaa47b09abf91881635ba96 reported cstate change: term changed from 1 to 3, leader changed from 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193) to aa14caefbdaa47b09abf91881635ba96 (127.12.56.195). New cstate: current_term: 3 leader_uuid: "aa14caefbdaa47b09abf91881635ba96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:02.124372 25096 leader_election.cc:304] T 628105dfc534451285d72f9e17f5d4f3 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883; no voters: aa14caefbdaa47b09abf91881635ba96, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:15:02.129832 25201 raft_consensus.cc:2749] T 628105dfc534451285d72f9e17f5d4f3 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:02.195441 25171 raft_consensus.cc:3060] T 9cb931cb82d74add922e65a2ea3de34d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:02.197971 25100 tablet_bootstrap.cc:492] T 95d3180f4ab5472d9de6e220219e7898 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:02.199361 25100 tablet_bootstrap.cc:492] T 95d3180f4ab5472d9de6e220219e7898 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap complete.
I20260709 12:15:02.200567 25100 ts_tablet_manager.cc:1403] T 95d3180f4ab5472d9de6e220219e7898 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.132s	user 0.027s	sys 0.006s
I20260709 12:15:02.203439 25100 raft_consensus.cc:359] T 95d3180f4ab5472d9de6e220219e7898 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:15:02.204301 25100 raft_consensus.cc:740] T 95d3180f4ab5472d9de6e220219e7898 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:15:02.205520 25100 consensus_queue.cc:260] T 95d3180f4ab5472d9de6e220219e7898 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:15:02.218048 25100 ts_tablet_manager.cc:1434] T 95d3180f4ab5472d9de6e220219e7898 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:15:02.219197 25100 tablet_bootstrap.cc:492] T e05eec364f764114bdb814096b9bf0ce P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:15:02.281704 25100 tablet_bootstrap.cc:492] T e05eec364f764114bdb814096b9bf0ce P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:02.284662 25100 tablet_bootstrap.cc:492] T e05eec364f764114bdb814096b9bf0ce P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap complete.
I20260709 12:15:02.285493 25100 ts_tablet_manager.cc:1403] T e05eec364f764114bdb814096b9bf0ce P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.067s	user 0.029s	sys 0.018s
I20260709 12:15:02.288954 25100 raft_consensus.cc:359] T e05eec364f764114bdb814096b9bf0ce P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:15:02.290086 25100 raft_consensus.cc:740] T e05eec364f764114bdb814096b9bf0ce P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:15:02.291200 25100 consensus_queue.cc:260] T e05eec364f764114bdb814096b9bf0ce P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:15:02.297375 25100 ts_tablet_manager.cc:1434] T e05eec364f764114bdb814096b9bf0ce P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:15:02.298664 25100 tablet_bootstrap.cc:492] T 06d0284e94354a2686c577372cceb2bc P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:15:02.324335 25100 tablet_bootstrap.cc:492] T 06d0284e94354a2686c577372cceb2bc P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:02.325433 25100 tablet_bootstrap.cc:492] T 06d0284e94354a2686c577372cceb2bc P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap complete.
I20260709 12:15:02.326339 25100 ts_tablet_manager.cc:1403] T 06d0284e94354a2686c577372cceb2bc P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.028s	user 0.018s	sys 0.006s
I20260709 12:15:02.329139 25100 raft_consensus.cc:359] T 06d0284e94354a2686c577372cceb2bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:15:02.329993 25100 raft_consensus.cc:740] T 06d0284e94354a2686c577372cceb2bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:15:02.330780 25100 consensus_queue.cc:260] T 06d0284e94354a2686c577372cceb2bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:15:02.334087 25100 ts_tablet_manager.cc:1434] T 06d0284e94354a2686c577372cceb2bc P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:15:02.335204 25100 tablet_bootstrap.cc:492] T 133e492e820f4152ad30562c343b617d P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:15:02.377655 25100 tablet_bootstrap.cc:492] T 133e492e820f4152ad30562c343b617d P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:02.378834 25100 tablet_bootstrap.cc:492] T 133e492e820f4152ad30562c343b617d P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap complete.
I20260709 12:15:02.379769 25100 ts_tablet_manager.cc:1403] T 133e492e820f4152ad30562c343b617d P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.045s	user 0.016s	sys 0.007s
I20260709 12:15:02.382365 25100 raft_consensus.cc:359] T 133e492e820f4152ad30562c343b617d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:15:02.383204 25100 raft_consensus.cc:740] T 133e492e820f4152ad30562c343b617d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:15:02.383919 25100 consensus_queue.cc:260] T 133e492e820f4152ad30562c343b617d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:15:02.386397 25100 ts_tablet_manager.cc:1434] T 133e492e820f4152ad30562c343b617d P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:15:02.396951 25100 tablet_bootstrap.cc:492] T 464c7ebd16cd488086ccaec23defbb33 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:15:02.441407 25100 tablet_bootstrap.cc:492] T 464c7ebd16cd488086ccaec23defbb33 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:02.442564 25100 tablet_bootstrap.cc:492] T 464c7ebd16cd488086ccaec23defbb33 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap complete.
I20260709 12:15:02.443266 25100 ts_tablet_manager.cc:1403] T 464c7ebd16cd488086ccaec23defbb33 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.047s	user 0.024s	sys 0.011s
I20260709 12:15:02.445734 25100 raft_consensus.cc:359] T 464c7ebd16cd488086ccaec23defbb33 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:15:02.446403 25100 raft_consensus.cc:740] T 464c7ebd16cd488086ccaec23defbb33 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:15:02.447042 25100 consensus_queue.cc:260] T 464c7ebd16cd488086ccaec23defbb33 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:15:02.449162 25100 ts_tablet_manager.cc:1434] T 464c7ebd16cd488086ccaec23defbb33 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 12:15:02.450456 25100 tablet_bootstrap.cc:492] T 9219abaaa2c34b08a24191512ff742bc P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:15:02.471647 25100 tablet_bootstrap.cc:492] T 9219abaaa2c34b08a24191512ff742bc P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:02.472772 25100 tablet_bootstrap.cc:492] T 9219abaaa2c34b08a24191512ff742bc P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap complete.
I20260709 12:15:02.473551 25100 ts_tablet_manager.cc:1403] T 9219abaaa2c34b08a24191512ff742bc P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.000s
I20260709 12:15:02.476203 25100 raft_consensus.cc:359] T 9219abaaa2c34b08a24191512ff742bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:15:02.476975 25100 raft_consensus.cc:740] T 9219abaaa2c34b08a24191512ff742bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:15:02.477684 25100 consensus_queue.cc:260] T 9219abaaa2c34b08a24191512ff742bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:15:02.480123 25100 ts_tablet_manager.cc:1434] T 9219abaaa2c34b08a24191512ff742bc P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:15:02.480969 25100 tablet_bootstrap.cc:492] T 67c0216443004287861015dd30ae5144 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:15:02.499943 25100 tablet_bootstrap.cc:492] T 67c0216443004287861015dd30ae5144 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:02.500735 25100 tablet_bootstrap.cc:492] T 67c0216443004287861015dd30ae5144 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap complete.
I20260709 12:15:02.501332 25100 ts_tablet_manager.cc:1403] T 67c0216443004287861015dd30ae5144 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.003s
I20260709 12:15:02.503470 25100 raft_consensus.cc:359] T 67c0216443004287861015dd30ae5144 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:15:02.504022 25100 raft_consensus.cc:740] T 67c0216443004287861015dd30ae5144 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:15:02.504652 25100 consensus_queue.cc:260] T 67c0216443004287861015dd30ae5144 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:15:02.506656 25100 ts_tablet_manager.cc:1434] T 67c0216443004287861015dd30ae5144 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:15:02.507807 25100 tablet_bootstrap.cc:492] T 4b1c850a65b748c093c5c88aa94fed71 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:15:02.529624 25100 tablet_bootstrap.cc:492] T 4b1c850a65b748c093c5c88aa94fed71 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:02.530779 25100 tablet_bootstrap.cc:492] T 4b1c850a65b748c093c5c88aa94fed71 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap complete.
I20260709 12:15:02.531638 25100 ts_tablet_manager.cc:1403] T 4b1c850a65b748c093c5c88aa94fed71 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.024s	user 0.018s	sys 0.003s
I20260709 12:15:02.535787 24426 raft_consensus.cc:1275] T 4b1c850a65b748c093c5c88aa94fed71 P ad362df39b114ec3a3a419128097b362 [term 3 FOLLOWER]: Refusing update from remote peer aa14caefbdaa47b09abf91881635ba96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:02.535560 25100 raft_consensus.cc:359] T 4b1c850a65b748c093c5c88aa94fed71 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:15:02.536829 25100 raft_consensus.cc:740] T 4b1c850a65b748c093c5c88aa94fed71 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:15:02.537531 25100 consensus_queue.cc:260] T 4b1c850a65b748c093c5c88aa94fed71 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:15:02.539055 25120 consensus_queue.cc:1048] T 4b1c850a65b748c093c5c88aa94fed71 P aa14caefbdaa47b09abf91881635ba96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:02.540649 25100 ts_tablet_manager.cc:1434] T 4b1c850a65b748c093c5c88aa94fed71 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:15:02.545115 25100 tablet_bootstrap.cc:492] T fa882381d669422a95ec60c9aefa8105 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
W20260709 12:15:02.553618 24322 consensus_peers.cc:597] T ed15c59b19ff49d3a39bf5b5abf8b69a P aa14caefbdaa47b09abf91881635ba96 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:02.582262 25100 tablet_bootstrap.cc:492] T fa882381d669422a95ec60c9aefa8105 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:02.583405 25100 tablet_bootstrap.cc:492] T fa882381d669422a95ec60c9aefa8105 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap complete.
I20260709 12:15:02.584093 25100 ts_tablet_manager.cc:1403] T fa882381d669422a95ec60c9aefa8105 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.039s	user 0.019s	sys 0.006s
I20260709 12:15:02.586711 25100 raft_consensus.cc:359] T fa882381d669422a95ec60c9aefa8105 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:15:02.587206 25155 raft_consensus.cc:3060] T 4b1c850a65b748c093c5c88aa94fed71 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:15:02.587452 25100 raft_consensus.cc:740] T fa882381d669422a95ec60c9aefa8105 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:15:02.588430 25100 consensus_queue.cc:260] T fa882381d669422a95ec60c9aefa8105 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:15:02.593015 25100 ts_tablet_manager.cc:1434] T fa882381d669422a95ec60c9aefa8105 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:15:02.593860 25100 tablet_bootstrap.cc:492] T 318c217e16874865bd6dff6bd4d8cd4f P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:15:02.608155 25155 raft_consensus.cc:1275] T 4b1c850a65b748c093c5c88aa94fed71 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 3 FOLLOWER]: Refusing update from remote peer aa14caefbdaa47b09abf91881635ba96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:02.610615 25199 consensus_queue.cc:1048] T 4b1c850a65b748c093c5c88aa94fed71 P aa14caefbdaa47b09abf91881635ba96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:02.614282 25100 tablet_bootstrap.cc:492] T 318c217e16874865bd6dff6bd4d8cd4f P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:02.615362 25100 tablet_bootstrap.cc:492] T 318c217e16874865bd6dff6bd4d8cd4f P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap complete.
I20260709 12:15:02.616077 25100 ts_tablet_manager.cc:1403] T 318c217e16874865bd6dff6bd4d8cd4f P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.000s
I20260709 12:15:02.619293 25100 raft_consensus.cc:359] T 318c217e16874865bd6dff6bd4d8cd4f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:15:02.619990 25100 raft_consensus.cc:740] T 318c217e16874865bd6dff6bd4d8cd4f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:15:02.620826 25100 consensus_queue.cc:260] T 318c217e16874865bd6dff6bd4d8cd4f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:15:02.633994 25100 ts_tablet_manager.cc:1434] T 318c217e16874865bd6dff6bd4d8cd4f P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.002s
I20260709 12:15:02.638705 25100 tablet_bootstrap.cc:492] T 356b14abd90d418cab44e524aef8154c P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:15:02.644984 25171 raft_consensus.cc:3060] T 318c217e16874865bd6dff6bd4d8cd4f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:02.661906 25100 tablet_bootstrap.cc:492] T 356b14abd90d418cab44e524aef8154c P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:02.662997 25100 tablet_bootstrap.cc:492] T 356b14abd90d418cab44e524aef8154c P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap complete.
I20260709 12:15:02.663691 25100 ts_tablet_manager.cc:1403] T 356b14abd90d418cab44e524aef8154c P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.000s
I20260709 12:15:02.667172 25100 raft_consensus.cc:359] T 356b14abd90d418cab44e524aef8154c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:15:02.668103 25100 raft_consensus.cc:740] T 356b14abd90d418cab44e524aef8154c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:15:02.668901 25100 consensus_queue.cc:260] T 356b14abd90d418cab44e524aef8154c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:15:02.671602 25100 ts_tablet_manager.cc:1434] T 356b14abd90d418cab44e524aef8154c P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:15:02.672825 25100 tablet_bootstrap.cc:492] T ba38e800dd034ff8b7fda6701973510b P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:15:02.689286 25100 tablet_bootstrap.cc:492] T ba38e800dd034ff8b7fda6701973510b P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:02.690254 25100 tablet_bootstrap.cc:492] T ba38e800dd034ff8b7fda6701973510b P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap complete.
I20260709 12:15:02.690876 25100 ts_tablet_manager.cc:1403] T ba38e800dd034ff8b7fda6701973510b P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.005s
I20260709 12:15:02.693156 25100 raft_consensus.cc:359] T ba38e800dd034ff8b7fda6701973510b P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:15:02.693866 25100 raft_consensus.cc:740] T ba38e800dd034ff8b7fda6701973510b P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:15:02.694515 25171 raft_consensus.cc:3060] T fa882381d669422a95ec60c9aefa8105 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:02.694670 25100 consensus_queue.cc:260] T ba38e800dd034ff8b7fda6701973510b P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:15:02.696986 25100 ts_tablet_manager.cc:1434] T ba38e800dd034ff8b7fda6701973510b P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 12:15:02.697891 25100 tablet_bootstrap.cc:492] T 4f756e6bcc20458b8748cd090cd3fce2 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:15:02.718297 25100 tablet_bootstrap.cc:492] T 4f756e6bcc20458b8748cd090cd3fce2 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:02.719347 25100 tablet_bootstrap.cc:492] T 4f756e6bcc20458b8748cd090cd3fce2 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap complete.
I20260709 12:15:02.719977 25100 ts_tablet_manager.cc:1403] T 4f756e6bcc20458b8748cd090cd3fce2 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.003s
I20260709 12:15:02.722318 25100 raft_consensus.cc:359] T 4f756e6bcc20458b8748cd090cd3fce2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:15:02.722847 25100 raft_consensus.cc:740] T 4f756e6bcc20458b8748cd090cd3fce2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:15:02.723474 25100 consensus_queue.cc:260] T 4f756e6bcc20458b8748cd090cd3fce2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:15:02.725322 25100 ts_tablet_manager.cc:1434] T 4f756e6bcc20458b8748cd090cd3fce2 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:15:02.726140 25100 tablet_bootstrap.cc:492] T ed15c59b19ff49d3a39bf5b5abf8b69a P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:15:02.726766 25171 raft_consensus.cc:3060] T 133e492e820f4152ad30562c343b617d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:02.748520 25100 tablet_bootstrap.cc:492] T ed15c59b19ff49d3a39bf5b5abf8b69a P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:02.749644 25100 tablet_bootstrap.cc:492] T ed15c59b19ff49d3a39bf5b5abf8b69a P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap complete.
I20260709 12:15:02.750401 25100 ts_tablet_manager.cc:1403] T ed15c59b19ff49d3a39bf5b5abf8b69a P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.024s	user 0.023s	sys 0.000s
I20260709 12:15:02.753242 25100 raft_consensus.cc:359] T ed15c59b19ff49d3a39bf5b5abf8b69a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:15:02.754079 25100 raft_consensus.cc:740] T ed15c59b19ff49d3a39bf5b5abf8b69a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:15:02.754956 25100 consensus_queue.cc:260] T ed15c59b19ff49d3a39bf5b5abf8b69a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:15:02.757229 25100 ts_tablet_manager.cc:1434] T ed15c59b19ff49d3a39bf5b5abf8b69a P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:15:02.758241 25100 tablet_bootstrap.cc:492] T fd6e20f3c92f4498a8c272b807797efa P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:15:02.779367 25100 tablet_bootstrap.cc:492] T fd6e20f3c92f4498a8c272b807797efa P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:02.780185 25100 tablet_bootstrap.cc:492] T fd6e20f3c92f4498a8c272b807797efa P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap complete.
I20260709 12:15:02.780966 25100 ts_tablet_manager.cc:1403] T fd6e20f3c92f4498a8c272b807797efa P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.009s
I20260709 12:15:02.783946 25100 raft_consensus.cc:359] T fd6e20f3c92f4498a8c272b807797efa P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:15:02.784644 25100 raft_consensus.cc:740] T fd6e20f3c92f4498a8c272b807797efa P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:15:02.785447 25100 consensus_queue.cc:260] T fd6e20f3c92f4498a8c272b807797efa P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:15:02.787247 25100 ts_tablet_manager.cc:1434] T fd6e20f3c92f4498a8c272b807797efa P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:15:02.788023 25100 tablet_bootstrap.cc:492] T 7943c68d21d449dba2d1dca6ddde5820 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:15:02.805290 25100 tablet_bootstrap.cc:492] T 7943c68d21d449dba2d1dca6ddde5820 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:02.806378 25100 tablet_bootstrap.cc:492] T 7943c68d21d449dba2d1dca6ddde5820 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap complete.
I20260709 12:15:02.806951 25100 ts_tablet_manager.cc:1403] T 7943c68d21d449dba2d1dca6ddde5820 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.001s
I20260709 12:15:02.808957 25100 raft_consensus.cc:359] T 7943c68d21d449dba2d1dca6ddde5820 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:15:02.809469 25100 raft_consensus.cc:740] T 7943c68d21d449dba2d1dca6ddde5820 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:15:02.810070 25100 consensus_queue.cc:260] T 7943c68d21d449dba2d1dca6ddde5820 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:15:02.812096 25100 ts_tablet_manager.cc:1434] T 7943c68d21d449dba2d1dca6ddde5820 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:15:02.812836 25100 tablet_bootstrap.cc:492] T d92a635ff6404268bd5e51d3b9681551 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:15:02.832258 25100 tablet_bootstrap.cc:492] T d92a635ff6404268bd5e51d3b9681551 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:02.833379 25100 tablet_bootstrap.cc:492] T d92a635ff6404268bd5e51d3b9681551 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap complete.
I20260709 12:15:02.834164 25100 ts_tablet_manager.cc:1403] T d92a635ff6404268bd5e51d3b9681551 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.004s
I20260709 12:15:02.836874 25100 raft_consensus.cc:359] T d92a635ff6404268bd5e51d3b9681551 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:15:02.837602 25100 raft_consensus.cc:740] T d92a635ff6404268bd5e51d3b9681551 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:15:02.838356 25100 consensus_queue.cc:260] T d92a635ff6404268bd5e51d3b9681551 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:15:02.840701 25100 ts_tablet_manager.cc:1434] T d92a635ff6404268bd5e51d3b9681551 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:15:02.841830 25100 tablet_bootstrap.cc:492] T 27de4156b2e24143a2f301fbefc7cb23 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:15:02.843007 25171 raft_consensus.cc:3060] T 9219abaaa2c34b08a24191512ff742bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:02.859220 25100 tablet_bootstrap.cc:492] T 27de4156b2e24143a2f301fbefc7cb23 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:02.860322 25100 tablet_bootstrap.cc:492] T 27de4156b2e24143a2f301fbefc7cb23 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap complete.
I20260709 12:15:02.860898 25100 ts_tablet_manager.cc:1403] T 27de4156b2e24143a2f301fbefc7cb23 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.003s
I20260709 12:15:02.863242 25100 raft_consensus.cc:359] T 27de4156b2e24143a2f301fbefc7cb23 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:15:02.863912 25100 raft_consensus.cc:740] T 27de4156b2e24143a2f301fbefc7cb23 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:15:02.864583 25100 consensus_queue.cc:260] T 27de4156b2e24143a2f301fbefc7cb23 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:15:02.866966 25100 ts_tablet_manager.cc:1434] T 27de4156b2e24143a2f301fbefc7cb23 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:15:02.867784 25100 tablet_bootstrap.cc:492] T b727e95d8f5843a3bb0d7cbddce61bdb P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:15:02.901746 25100 tablet_bootstrap.cc:492] T b727e95d8f5843a3bb0d7cbddce61bdb P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:02.902782 25100 tablet_bootstrap.cc:492] T b727e95d8f5843a3bb0d7cbddce61bdb P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap complete.
I20260709 12:15:02.903513 25100 ts_tablet_manager.cc:1403] T b727e95d8f5843a3bb0d7cbddce61bdb P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.017s
I20260709 12:15:02.906802 25100 raft_consensus.cc:359] T b727e95d8f5843a3bb0d7cbddce61bdb P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:15:02.907524 25100 raft_consensus.cc:740] T b727e95d8f5843a3bb0d7cbddce61bdb P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:15:02.908205 25100 consensus_queue.cc:260] T b727e95d8f5843a3bb0d7cbddce61bdb P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:15:02.909739 25100 ts_tablet_manager.cc:1434] T b727e95d8f5843a3bb0d7cbddce61bdb P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.001s
I20260709 12:15:02.910590 25100 tablet_bootstrap.cc:492] T f841b9f0e82748d399b5eef243c442fc P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:15:02.931903 25100 tablet_bootstrap.cc:492] T f841b9f0e82748d399b5eef243c442fc P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:02.932899 25100 tablet_bootstrap.cc:492] T f841b9f0e82748d399b5eef243c442fc P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap complete.
I20260709 12:15:02.933609 25100 ts_tablet_manager.cc:1403] T f841b9f0e82748d399b5eef243c442fc P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.000s
I20260709 12:15:02.942844 25100 raft_consensus.cc:359] T f841b9f0e82748d399b5eef243c442fc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:15:02.943583 25100 raft_consensus.cc:740] T f841b9f0e82748d399b5eef243c442fc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:15:02.944270 25100 consensus_queue.cc:260] T f841b9f0e82748d399b5eef243c442fc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:15:02.946593 25100 ts_tablet_manager.cc:1434] T f841b9f0e82748d399b5eef243c442fc P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:15:02.947402 25100 tablet_bootstrap.cc:492] T b1e1c3b597fd49b2831e5f523149b2dc P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:15:02.981505 25100 tablet_bootstrap.cc:492] T b1e1c3b597fd49b2831e5f523149b2dc P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:02.982662 25100 tablet_bootstrap.cc:492] T b1e1c3b597fd49b2831e5f523149b2dc P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap complete.
I20260709 12:15:02.983459 25100 ts_tablet_manager.cc:1403] T b1e1c3b597fd49b2831e5f523149b2dc P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.036s	user 0.020s	sys 0.012s
I20260709 12:15:02.986091 25100 raft_consensus.cc:359] T b1e1c3b597fd49b2831e5f523149b2dc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:15:02.986837 25100 raft_consensus.cc:740] T b1e1c3b597fd49b2831e5f523149b2dc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:15:02.987591 25100 consensus_queue.cc:260] T b1e1c3b597fd49b2831e5f523149b2dc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:15:02.989727 25100 ts_tablet_manager.cc:1434] T b1e1c3b597fd49b2831e5f523149b2dc P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:15:02.990761 25100 tablet_bootstrap.cc:492] T a18e73ef976b49f0878423c0b3e6e6f2 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:15:03.006505 25100 tablet_bootstrap.cc:492] T a18e73ef976b49f0878423c0b3e6e6f2 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:03.007355 25100 tablet_bootstrap.cc:492] T a18e73ef976b49f0878423c0b3e6e6f2 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap complete.
I20260709 12:15:03.007980 25100 ts_tablet_manager.cc:1403] T a18e73ef976b49f0878423c0b3e6e6f2 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.003s
I20260709 12:15:03.010064 25100 raft_consensus.cc:359] T a18e73ef976b49f0878423c0b3e6e6f2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:15:03.010600 25100 raft_consensus.cc:740] T a18e73ef976b49f0878423c0b3e6e6f2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:15:03.011427 25100 consensus_queue.cc:260] T a18e73ef976b49f0878423c0b3e6e6f2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:15:03.013432 25100 ts_tablet_manager.cc:1434] T a18e73ef976b49f0878423c0b3e6e6f2 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:15:03.015972 25100 tablet_bootstrap.cc:492] T b98a35cf96ba4562b4933543b1e4efb9 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:15:03.032352 25155 raft_consensus.cc:3060] T ed15c59b19ff49d3a39bf5b5abf8b69a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:03.041292 25100 tablet_bootstrap.cc:492] T b98a35cf96ba4562b4933543b1e4efb9 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:03.042383 25100 tablet_bootstrap.cc:492] T b98a35cf96ba4562b4933543b1e4efb9 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap complete.
I20260709 12:15:03.043114 25100 ts_tablet_manager.cc:1403] T b98a35cf96ba4562b4933543b1e4efb9 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.027s	user 0.018s	sys 0.005s
I20260709 12:15:03.045831 25100 raft_consensus.cc:359] T b98a35cf96ba4562b4933543b1e4efb9 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:15:03.046545 25100 raft_consensus.cc:740] T b98a35cf96ba4562b4933543b1e4efb9 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:15:03.048393 25100 consensus_queue.cc:260] T b98a35cf96ba4562b4933543b1e4efb9 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:15:03.051936 25100 ts_tablet_manager.cc:1434] T b98a35cf96ba4562b4933543b1e4efb9 P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:15:03.052862 25100 tablet_bootstrap.cc:492] T c75afe0e0e00446aa6d220941d288eab P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap starting.
I20260709 12:15:03.069859 25100 tablet_bootstrap.cc:492] T c75afe0e0e00446aa6d220941d288eab P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:03.070909 25100 tablet_bootstrap.cc:492] T c75afe0e0e00446aa6d220941d288eab P 9bf3da5b54ef4a1ea1cee60f02ea2883: Bootstrap complete.
I20260709 12:15:03.071648 25100 ts_tablet_manager.cc:1403] T c75afe0e0e00446aa6d220941d288eab P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent bootstrapping tablet: real 0.019s	user 0.004s	sys 0.011s
I20260709 12:15:03.074136 25100 raft_consensus.cc:359] T c75afe0e0e00446aa6d220941d288eab P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:15:03.074844 25100 raft_consensus.cc:740] T c75afe0e0e00446aa6d220941d288eab P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Initialized, Role: FOLLOWER
I20260709 12:15:03.075510 25100 consensus_queue.cc:260] T c75afe0e0e00446aa6d220941d288eab P 9bf3da5b54ef4a1ea1cee60f02ea2883 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:15:03.077525 25100 ts_tablet_manager.cc:1434] T c75afe0e0e00446aa6d220941d288eab P 9bf3da5b54ef4a1ea1cee60f02ea2883: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:15:03.101028 25155 raft_consensus.cc:3060] T 7943c68d21d449dba2d1dca6ddde5820 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:03.116734 25180 raft_consensus.cc:3060] T b98a35cf96ba4562b4933543b1e4efb9 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:03.289381 25180 raft_consensus.cc:3060] T a18e73ef976b49f0878423c0b3e6e6f2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:03.500753 25171 raft_consensus.cc:3060] T f841b9f0e82748d399b5eef243c442fc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:15:09.607004 24322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:38787, user_credentials={real_user=slave}} blocked reactor thread for 55570us
W20260709 12:15:09.667312 24398 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:46845, user_credentials={real_user=slave}} blocked reactor thread for 55937.2us
W20260709 12:15:09.778761 24250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.195:46845, user_credentials={real_user=slave}} blocked reactor thread for 51858.5us
I20260709 12:15:11.780046 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:11.856235 24281 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f0c432146014cf099d66c95cde2ea1d"
dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054"
mode: GRACEFUL
new_leader_uuid: "aa14caefbdaa47b09abf91881635ba96"
 from {username='slave'} at 127.0.0.1:49220
I20260709 12:15:11.857355 24281 raft_consensus.cc:606] T 0f0c432146014cf099d66c95cde2ea1d P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Received request to transfer leadership to TS aa14caefbdaa47b09abf91881635ba96
I20260709 12:15:11.871173 24426 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "318c217e16874865bd6dff6bd4d8cd4f"
dest_uuid: "ad362df39b114ec3a3a419128097b362"
mode: GRACEFUL
new_leader_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
 from {username='slave'} at 127.0.0.1:41970
I20260709 12:15:11.871820 24426 raft_consensus.cc:606] T 318c217e16874865bd6dff6bd4d8cd4f P ad362df39b114ec3a3a419128097b362 [term 2 LEADER]: Received request to transfer leadership to TS 9bf3da5b54ef4a1ea1cee60f02ea2883
I20260709 12:15:11.875195 24426 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9cb931cb82d74add922e65a2ea3de34d"
dest_uuid: "ad362df39b114ec3a3a419128097b362"
mode: GRACEFUL
new_leader_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
 from {username='slave'} at 127.0.0.1:41970
I20260709 12:15:11.875676 24426 raft_consensus.cc:606] T 9cb931cb82d74add922e65a2ea3de34d P ad362df39b114ec3a3a419128097b362 [term 2 LEADER]: Received request to transfer leadership to TS 9bf3da5b54ef4a1ea1cee60f02ea2883
I20260709 12:15:11.878172 24281 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bbab1a4afac94c1eaeb3ed35bc54408a"
dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054"
mode: GRACEFUL
new_leader_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
 from {username='slave'} at 127.0.0.1:49220
I20260709 12:15:11.878731 24281 raft_consensus.cc:606] T bbab1a4afac94c1eaeb3ed35bc54408a P cf2d8294ae68482ca4ffa8be051ad054 [term 3 LEADER]: Received request to transfer leadership to TS 9bf3da5b54ef4a1ea1cee60f02ea2883
I20260709 12:15:11.887068 25380 raft_consensus.cc:993] T 318c217e16874865bd6dff6bd4d8cd4f P ad362df39b114ec3a3a419128097b362: : Instructing follower 9bf3da5b54ef4a1ea1cee60f02ea2883 to start an election
I20260709 12:15:11.887626 25380 raft_consensus.cc:1081] T 318c217e16874865bd6dff6bd4d8cd4f P ad362df39b114ec3a3a419128097b362 [term 2 LEADER]: Signalling peer 9bf3da5b54ef4a1ea1cee60f02ea2883 to start an election
I20260709 12:15:11.892380 25171 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "318c217e16874865bd6dff6bd4d8cd4f"
dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
 from {username='slave'} at 127.0.0.1:59360
I20260709 12:15:11.893038 25171 raft_consensus.cc:493] T 318c217e16874865bd6dff6bd4d8cd4f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:11.893545 25171 raft_consensus.cc:3060] T 318c217e16874865bd6dff6bd4d8cd4f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:11.907199 24353 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ed15c59b19ff49d3a39bf5b5abf8b69a"
dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
mode: GRACEFUL
new_leader_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
 from {username='slave'} at 127.0.0.1:44414
I20260709 12:15:11.907984 24353 raft_consensus.cc:606] T ed15c59b19ff49d3a39bf5b5abf8b69a P aa14caefbdaa47b09abf91881635ba96 [term 2 LEADER]: Received request to transfer leadership to TS 9bf3da5b54ef4a1ea1cee60f02ea2883
I20260709 12:15:11.907745 25171 raft_consensus.cc:515] T 318c217e16874865bd6dff6bd4d8cd4f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:15:11.909674 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:15:11.911638 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:11.911424 24426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318c217e16874865bd6dff6bd4d8cd4f" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ad362df39b114ec3a3a419128097b362"
I20260709 12:15:11.912298 24426 raft_consensus.cc:3055] T 318c217e16874865bd6dff6bd4d8cd4f P ad362df39b114ec3a3a419128097b362 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:11.912739 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:11.912699 24426 raft_consensus.cc:740] T 318c217e16874865bd6dff6bd4d8cd4f P ad362df39b114ec3a3a419128097b362 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ad362df39b114ec3a3a419128097b362, State: Running, Role: LEADER
I20260709 12:15:11.913676 24426 consensus_queue.cc:260] T 318c217e16874865bd6dff6bd4d8cd4f P ad362df39b114ec3a3a419128097b362 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:15:11.915117 24426 raft_consensus.cc:3060] T 318c217e16874865bd6dff6bd4d8cd4f P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:11.919581 25171 leader_election.cc:290] T 318c217e16874865bd6dff6bd4d8cd4f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 3 election: Requested vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:15:11.923693 24426 raft_consensus.cc:2468] T 318c217e16874865bd6dff6bd4d8cd4f P ad362df39b114ec3a3a419128097b362 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 3.
I20260709 12:15:11.924889 24281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318c217e16874865bd6dff6bd4d8cd4f" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054"
I20260709 12:15:11.926661 24281 raft_consensus.cc:3060] T 318c217e16874865bd6dff6bd4d8cd4f P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:11.928709 25095 leader_election.cc:304] T 318c217e16874865bd6dff6bd4d8cd4f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, ad362df39b114ec3a3a419128097b362; no voters: 
I20260709 12:15:11.943181 24281 raft_consensus.cc:2468] T 318c217e16874865bd6dff6bd4d8cd4f P cf2d8294ae68482ca4ffa8be051ad054 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 3.
I20260709 12:15:11.946601 25387 raft_consensus.cc:2804] T 318c217e16874865bd6dff6bd4d8cd4f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:11.953707 25387 raft_consensus.cc:697] T 318c217e16874865bd6dff6bd4d8cd4f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 3 LEADER]: Becoming Leader. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Running, Role: LEADER
I20260709 12:15:11.954756 25387 consensus_queue.cc:237] T 318c217e16874865bd6dff6bd4d8cd4f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:15:11.967001 24107 catalog_manager.cc:5697] T 318c217e16874865bd6dff6bd4d8cd4f P 9bf3da5b54ef4a1ea1cee60f02ea2883 reported cstate change: term changed from 2 to 3, leader changed from ad362df39b114ec3a3a419128097b362 (127.12.56.196) to 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193). New cstate: current_term: 3 leader_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:12.152335 25366 raft_consensus.cc:993] T bbab1a4afac94c1eaeb3ed35bc54408a P cf2d8294ae68482ca4ffa8be051ad054: : Instructing follower 9bf3da5b54ef4a1ea1cee60f02ea2883 to start an election
I20260709 12:15:12.153205 25394 raft_consensus.cc:1081] T bbab1a4afac94c1eaeb3ed35bc54408a P cf2d8294ae68482ca4ffa8be051ad054 [term 3 LEADER]: Signalling peer 9bf3da5b54ef4a1ea1cee60f02ea2883 to start an election
I20260709 12:15:12.155248 25180 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bbab1a4afac94c1eaeb3ed35bc54408a"
dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
 from {username='slave'} at 127.0.0.1:59346
I20260709 12:15:12.155812 25180 raft_consensus.cc:493] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:12.156205 25180 raft_consensus.cc:3060] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:12.163697 25180 raft_consensus.cc:515] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:15:12.165679 25180 leader_election.cc:290] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 4 election: Requested vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:15:12.167227 24281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbab1a4afac94c1eaeb3ed35bc54408a" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054"
I20260709 12:15:12.167965 24281 raft_consensus.cc:3055] T bbab1a4afac94c1eaeb3ed35bc54408a P cf2d8294ae68482ca4ffa8be051ad054 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:15:12.167855 24426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbab1a4afac94c1eaeb3ed35bc54408a" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "ad362df39b114ec3a3a419128097b362"
I20260709 12:15:12.168654 24426 raft_consensus.cc:3060] T bbab1a4afac94c1eaeb3ed35bc54408a P ad362df39b114ec3a3a419128097b362 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:12.169338 24281 raft_consensus.cc:740] T bbab1a4afac94c1eaeb3ed35bc54408a P cf2d8294ae68482ca4ffa8be051ad054 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Running, Role: LEADER
I20260709 12:15:12.170243 24281 consensus_queue.cc:260] T bbab1a4afac94c1eaeb3ed35bc54408a P cf2d8294ae68482ca4ffa8be051ad054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:15:12.171567 24281 raft_consensus.cc:3060] T bbab1a4afac94c1eaeb3ed35bc54408a P cf2d8294ae68482ca4ffa8be051ad054 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:12.180029 24426 raft_consensus.cc:2468] T bbab1a4afac94c1eaeb3ed35bc54408a P ad362df39b114ec3a3a419128097b362 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 4.
I20260709 12:15:12.181540 24281 raft_consensus.cc:2468] T bbab1a4afac94c1eaeb3ed35bc54408a P cf2d8294ae68482ca4ffa8be051ad054 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 4.
I20260709 12:15:12.182132 25095 leader_election.cc:304] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, ad362df39b114ec3a3a419128097b362; no voters: 
I20260709 12:15:12.183701 25387 raft_consensus.cc:2804] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:15:12.184247 25387 raft_consensus.cc:697] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 4 LEADER]: Becoming Leader. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Running, Role: LEADER
I20260709 12:15:12.185153 25387 consensus_queue.cc:237] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:15:12.194312 25377 raft_consensus.cc:993] T 9cb931cb82d74add922e65a2ea3de34d P ad362df39b114ec3a3a419128097b362: : Instructing follower 9bf3da5b54ef4a1ea1cee60f02ea2883 to start an election
I20260709 12:15:12.194835 25377 raft_consensus.cc:1081] T 9cb931cb82d74add922e65a2ea3de34d P ad362df39b114ec3a3a419128097b362 [term 2 LEADER]: Signalling peer 9bf3da5b54ef4a1ea1cee60f02ea2883 to start an election
I20260709 12:15:12.194320 25381 raft_consensus.cc:993] T 0f0c432146014cf099d66c95cde2ea1d P cf2d8294ae68482ca4ffa8be051ad054: : Instructing follower aa14caefbdaa47b09abf91881635ba96 to start an election
I20260709 12:15:12.196317 25381 raft_consensus.cc:1081] T 0f0c432146014cf099d66c95cde2ea1d P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Signalling peer aa14caefbdaa47b09abf91881635ba96 to start an election
I20260709 12:15:12.198228 25171 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9cb931cb82d74add922e65a2ea3de34d"
dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
 from {username='slave'} at 127.0.0.1:59360
I20260709 12:15:12.198393 24351 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f0c432146014cf099d66c95cde2ea1d"
dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
 from {username='slave'} at 127.0.0.1:46408
I20260709 12:15:12.198805 25171 raft_consensus.cc:493] T 9cb931cb82d74add922e65a2ea3de34d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:12.198021 24107 catalog_manager.cc:5697] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883 reported cstate change: term changed from 3 to 4, leader changed from cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194) to 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193). New cstate: current_term: 4 leader_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:12.198987 24351 raft_consensus.cc:493] T 0f0c432146014cf099d66c95cde2ea1d P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:12.199218 25171 raft_consensus.cc:3060] T 9cb931cb82d74add922e65a2ea3de34d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:12.199486 24351 raft_consensus.cc:3060] T 0f0c432146014cf099d66c95cde2ea1d P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:12.207453 24351 raft_consensus.cc:515] T 0f0c432146014cf099d66c95cde2ea1d P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:15:12.212575 24351 leader_election.cc:290] T 0f0c432146014cf099d66c95cde2ea1d P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 election: Requested vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:15:12.213325 24281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0c432146014cf099d66c95cde2ea1d" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054"
I20260709 12:15:12.214003 24281 raft_consensus.cc:3055] T 0f0c432146014cf099d66c95cde2ea1d P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:12.214239 24429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f0c432146014cf099d66c95cde2ea1d" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad362df39b114ec3a3a419128097b362"
I20260709 12:15:12.214920 24429 raft_consensus.cc:3060] T 0f0c432146014cf099d66c95cde2ea1d P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:12.214315 24281 raft_consensus.cc:740] T 0f0c432146014cf099d66c95cde2ea1d P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Running, Role: LEADER
I20260709 12:15:12.218874 24281 consensus_queue.cc:260] T 0f0c432146014cf099d66c95cde2ea1d P cf2d8294ae68482ca4ffa8be051ad054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:15:12.220093 25171 raft_consensus.cc:515] T 9cb931cb82d74add922e65a2ea3de34d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:15:12.220093 24281 raft_consensus.cc:3060] T 0f0c432146014cf099d66c95cde2ea1d P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:12.223625 25171 leader_election.cc:290] T 9cb931cb82d74add922e65a2ea3de34d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 3 election: Requested vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:15:12.225168 24279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cb931cb82d74add922e65a2ea3de34d" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054"
I20260709 12:15:12.226091 24279 raft_consensus.cc:3060] T 9cb931cb82d74add922e65a2ea3de34d P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:12.229873 24281 raft_consensus.cc:2468] T 0f0c432146014cf099d66c95cde2ea1d P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa14caefbdaa47b09abf91881635ba96 in term 2.
I20260709 12:15:12.231093 24325 leader_election.cc:304] T 0f0c432146014cf099d66c95cde2ea1d P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, cf2d8294ae68482ca4ffa8be051ad054; no voters: 
I20260709 12:15:12.232008 25360 raft_consensus.cc:2804] T 0f0c432146014cf099d66c95cde2ea1d P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:12.232477 25360 raft_consensus.cc:697] T 0f0c432146014cf099d66c95cde2ea1d P aa14caefbdaa47b09abf91881635ba96 [term 2 LEADER]: Becoming Leader. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Running, Role: LEADER
I20260709 12:15:12.233355 25360 consensus_queue.cc:237] T 0f0c432146014cf099d66c95cde2ea1d P aa14caefbdaa47b09abf91881635ba96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:15:12.242043 24279 raft_consensus.cc:2468] T 9cb931cb82d74add922e65a2ea3de34d P cf2d8294ae68482ca4ffa8be051ad054 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 3.
I20260709 12:15:12.243448 25097 leader_election.cc:304] T 9cb931cb82d74add922e65a2ea3de34d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054; no voters: 
I20260709 12:15:12.243836 24426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cb931cb82d74add922e65a2ea3de34d" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ad362df39b114ec3a3a419128097b362"
I20260709 12:15:12.244477 24426 raft_consensus.cc:3055] T 9cb931cb82d74add922e65a2ea3de34d P ad362df39b114ec3a3a419128097b362 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:12.244488 25387 raft_consensus.cc:2804] T 9cb931cb82d74add922e65a2ea3de34d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:12.246158 25387 raft_consensus.cc:697] T 9cb931cb82d74add922e65a2ea3de34d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 3 LEADER]: Becoming Leader. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Running, Role: LEADER
I20260709 12:15:12.245606 24426 raft_consensus.cc:740] T 9cb931cb82d74add922e65a2ea3de34d P ad362df39b114ec3a3a419128097b362 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ad362df39b114ec3a3a419128097b362, State: Running, Role: LEADER
I20260709 12:15:12.245709 24429 raft_consensus.cc:2468] T 0f0c432146014cf099d66c95cde2ea1d P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa14caefbdaa47b09abf91881635ba96 in term 2.
I20260709 12:15:12.247136 25387 consensus_queue.cc:237] T 9cb931cb82d74add922e65a2ea3de34d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:15:12.246992 24107 catalog_manager.cc:5697] T 0f0c432146014cf099d66c95cde2ea1d P aa14caefbdaa47b09abf91881635ba96 reported cstate change: term changed from 1 to 2, leader changed from cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194) to aa14caefbdaa47b09abf91881635ba96 (127.12.56.195). New cstate: current_term: 2 leader_uuid: "aa14caefbdaa47b09abf91881635ba96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:12.248709 24426 consensus_queue.cc:260] T 9cb931cb82d74add922e65a2ea3de34d P ad362df39b114ec3a3a419128097b362 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:15:12.250367 24426 raft_consensus.cc:3060] T 9cb931cb82d74add922e65a2ea3de34d P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:12.257321 24426 raft_consensus.cc:2468] T 9cb931cb82d74add922e65a2ea3de34d P ad362df39b114ec3a3a419128097b362 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 3.
I20260709 12:15:12.261687 24107 catalog_manager.cc:5697] T 9cb931cb82d74add922e65a2ea3de34d P 9bf3da5b54ef4a1ea1cee60f02ea2883 reported cstate change: term changed from 2 to 3, leader changed from ad362df39b114ec3a3a419128097b362 (127.12.56.196) to 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193). New cstate: current_term: 3 leader_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:12.325418 25384 raft_consensus.cc:993] T ed15c59b19ff49d3a39bf5b5abf8b69a P aa14caefbdaa47b09abf91881635ba96: : Instructing follower 9bf3da5b54ef4a1ea1cee60f02ea2883 to start an election
I20260709 12:15:12.326011 25360 raft_consensus.cc:1081] T ed15c59b19ff49d3a39bf5b5abf8b69a P aa14caefbdaa47b09abf91881635ba96 [term 2 LEADER]: Signalling peer 9bf3da5b54ef4a1ea1cee60f02ea2883 to start an election
I20260709 12:15:12.327994 25180 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ed15c59b19ff49d3a39bf5b5abf8b69a"
dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
 from {username='slave'} at 127.0.0.1:59348
I20260709 12:15:12.328576 25180 raft_consensus.cc:493] T ed15c59b19ff49d3a39bf5b5abf8b69a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:12.328871 25180 raft_consensus.cc:3060] T ed15c59b19ff49d3a39bf5b5abf8b69a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:12.334295 25180 raft_consensus.cc:515] T ed15c59b19ff49d3a39bf5b5abf8b69a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:15:12.336038 25180 leader_election.cc:290] T ed15c59b19ff49d3a39bf5b5abf8b69a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 3 election: Requested vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:15:12.336946 24355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed15c59b19ff49d3a39bf5b5abf8b69a" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
I20260709 12:15:12.337239 24427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed15c59b19ff49d3a39bf5b5abf8b69a" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ad362df39b114ec3a3a419128097b362"
I20260709 12:15:12.337705 24355 raft_consensus.cc:3055] T ed15c59b19ff49d3a39bf5b5abf8b69a P aa14caefbdaa47b09abf91881635ba96 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:12.338045 24427 raft_consensus.cc:3060] T ed15c59b19ff49d3a39bf5b5abf8b69a P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:12.338143 24355 raft_consensus.cc:740] T ed15c59b19ff49d3a39bf5b5abf8b69a P aa14caefbdaa47b09abf91881635ba96 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Running, Role: LEADER
I20260709 12:15:12.339298 24355 consensus_queue.cc:260] T ed15c59b19ff49d3a39bf5b5abf8b69a P aa14caefbdaa47b09abf91881635ba96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:15:12.340682 24355 raft_consensus.cc:3060] T ed15c59b19ff49d3a39bf5b5abf8b69a P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:12.341050 24429 raft_consensus.cc:1275] T 318c217e16874865bd6dff6bd4d8cd4f P ad362df39b114ec3a3a419128097b362 [term 3 FOLLOWER]: Refusing update from remote peer 9bf3da5b54ef4a1ea1cee60f02ea2883: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:12.343534 25387 consensus_queue.cc:1048] T 318c217e16874865bd6dff6bd4d8cd4f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:12.354058 24427 raft_consensus.cc:2468] T ed15c59b19ff49d3a39bf5b5abf8b69a P ad362df39b114ec3a3a419128097b362 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 3.
I20260709 12:15:12.355862 25095 leader_election.cc:304] T ed15c59b19ff49d3a39bf5b5abf8b69a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, ad362df39b114ec3a3a419128097b362; no voters: 
I20260709 12:15:12.357950 24355 raft_consensus.cc:2468] T ed15c59b19ff49d3a39bf5b5abf8b69a P aa14caefbdaa47b09abf91881635ba96 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 3.
I20260709 12:15:12.360720 25387 raft_consensus.cc:2804] T ed15c59b19ff49d3a39bf5b5abf8b69a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:12.361308 25387 raft_consensus.cc:697] T ed15c59b19ff49d3a39bf5b5abf8b69a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 3 LEADER]: Becoming Leader. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Running, Role: LEADER
I20260709 12:15:12.362212 25387 consensus_queue.cc:237] T ed15c59b19ff49d3a39bf5b5abf8b69a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:15:12.383018 24279 raft_consensus.cc:1275] T 318c217e16874865bd6dff6bd4d8cd4f P cf2d8294ae68482ca4ffa8be051ad054 [term 3 FOLLOWER]: Refusing update from remote peer 9bf3da5b54ef4a1ea1cee60f02ea2883: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:12.385672 25387 consensus_queue.cc:1048] T 318c217e16874865bd6dff6bd4d8cd4f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:15:12.393630 24107 catalog_manager.cc:5697] T ed15c59b19ff49d3a39bf5b5abf8b69a P 9bf3da5b54ef4a1ea1cee60f02ea2883 reported cstate change: term changed from 2 to 3, leader changed from aa14caefbdaa47b09abf91881635ba96 (127.12.56.195) to 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193). New cstate: current_term: 3 leader_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:12.567754 24279 raft_consensus.cc:1275] T bbab1a4afac94c1eaeb3ed35bc54408a P cf2d8294ae68482ca4ffa8be051ad054 [term 4 FOLLOWER]: Refusing update from remote peer 9bf3da5b54ef4a1ea1cee60f02ea2883: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:15:12.569061 25387 consensus_queue.cc:1048] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:12.580567 24429 raft_consensus.cc:1275] T bbab1a4afac94c1eaeb3ed35bc54408a P ad362df39b114ec3a3a419128097b362 [term 4 FOLLOWER]: Refusing update from remote peer 9bf3da5b54ef4a1ea1cee60f02ea2883: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:15:12.582368 25387 consensus_queue.cc:1048] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:12.673619 24429 raft_consensus.cc:1275] T 9cb931cb82d74add922e65a2ea3de34d P ad362df39b114ec3a3a419128097b362 [term 3 FOLLOWER]: Refusing update from remote peer 9bf3da5b54ef4a1ea1cee60f02ea2883: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:12.675643 25387 consensus_queue.cc:1048] T 9cb931cb82d74add922e65a2ea3de34d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:12.685686 24281 raft_consensus.cc:1275] T 9cb931cb82d74add922e65a2ea3de34d P cf2d8294ae68482ca4ffa8be051ad054 [term 3 FOLLOWER]: Refusing update from remote peer 9bf3da5b54ef4a1ea1cee60f02ea2883: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:12.687213 25387 consensus_queue.cc:1048] T 9cb931cb82d74add922e65a2ea3de34d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:12.776822 24281 raft_consensus.cc:1275] T 0f0c432146014cf099d66c95cde2ea1d P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Refusing update from remote peer aa14caefbdaa47b09abf91881635ba96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:12.777990 25384 consensus_queue.cc:1048] T 0f0c432146014cf099d66c95cde2ea1d P aa14caefbdaa47b09abf91881635ba96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:12.789601 24427 raft_consensus.cc:1275] T 0f0c432146014cf099d66c95cde2ea1d P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Refusing update from remote peer aa14caefbdaa47b09abf91881635ba96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:12.790865 25384 consensus_queue.cc:1048] T 0f0c432146014cf099d66c95cde2ea1d P aa14caefbdaa47b09abf91881635ba96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:12.943243 24427 raft_consensus.cc:1275] T ed15c59b19ff49d3a39bf5b5abf8b69a P ad362df39b114ec3a3a419128097b362 [term 3 FOLLOWER]: Refusing update from remote peer 9bf3da5b54ef4a1ea1cee60f02ea2883: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:12.944868 25401 consensus_queue.cc:1048] T ed15c59b19ff49d3a39bf5b5abf8b69a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:12.952430 24353 raft_consensus.cc:1275] T ed15c59b19ff49d3a39bf5b5abf8b69a P aa14caefbdaa47b09abf91881635ba96 [term 3 FOLLOWER]: Refusing update from remote peer 9bf3da5b54ef4a1ea1cee60f02ea2883: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:12.954109 25387 consensus_queue.cc:1048] T ed15c59b19ff49d3a39bf5b5abf8b69a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:12.969722 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:13.037573 24279 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d31cf2c4a7849d9a798bf886e7fc997"
dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054"
mode: GRACEFUL
new_leader_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
 from {username='slave'} at 127.0.0.1:49220
I20260709 12:15:13.039530 24279 raft_consensus.cc:606] T 0d31cf2c4a7849d9a798bf886e7fc997 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Received request to transfer leadership to TS 9bf3da5b54ef4a1ea1cee60f02ea2883
I20260709 12:15:13.042958 24281 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "628105dfc534451285d72f9e17f5d4f3"
dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054"
mode: GRACEFUL
new_leader_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
 from {username='slave'} at 127.0.0.1:49220
I20260709 12:15:13.043648 24281 raft_consensus.cc:606] T 628105dfc534451285d72f9e17f5d4f3 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Received request to transfer leadership to TS 9bf3da5b54ef4a1ea1cee60f02ea2883
I20260709 12:15:13.046483 24355 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab8dff607862460ea0fcd88422c31ac2"
dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
mode: GRACEFUL
new_leader_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
 from {username='slave'} at 127.0.0.1:44414
I20260709 12:15:13.047140 24355 raft_consensus.cc:606] T ab8dff607862460ea0fcd88422c31ac2 P aa14caefbdaa47b09abf91881635ba96 [term 2 LEADER]: Received request to transfer leadership to TS 9bf3da5b54ef4a1ea1cee60f02ea2883
I20260709 12:15:13.049698 24281 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c75afe0e0e00446aa6d220941d288eab"
dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054"
mode: GRACEFUL
new_leader_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
 from {username='slave'} at 127.0.0.1:49220
I20260709 12:15:13.050194 24281 raft_consensus.cc:606] T c75afe0e0e00446aa6d220941d288eab P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Received request to transfer leadership to TS 9bf3da5b54ef4a1ea1cee60f02ea2883
I20260709 12:15:13.052627 24281 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f841b9f0e82748d399b5eef243c442fc"
dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054"
mode: GRACEFUL
new_leader_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
 from {username='slave'} at 127.0.0.1:49220
I20260709 12:15:13.053112 24281 raft_consensus.cc:606] T f841b9f0e82748d399b5eef243c442fc P cf2d8294ae68482ca4ffa8be051ad054 [term 2 LEADER]: Received request to transfer leadership to TS 9bf3da5b54ef4a1ea1cee60f02ea2883
I20260709 12:15:13.054241 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:15:13.055519 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:13.056152 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:13.255198 25394 raft_consensus.cc:993] T c75afe0e0e00446aa6d220941d288eab P cf2d8294ae68482ca4ffa8be051ad054: : Instructing follower 9bf3da5b54ef4a1ea1cee60f02ea2883 to start an election
I20260709 12:15:13.255750 25381 raft_consensus.cc:1081] T c75afe0e0e00446aa6d220941d288eab P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Signalling peer 9bf3da5b54ef4a1ea1cee60f02ea2883 to start an election
I20260709 12:15:13.263266 25171 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c75afe0e0e00446aa6d220941d288eab"
dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
 from {username='slave'} at 127.0.0.1:59346
I20260709 12:15:13.263959 25171 raft_consensus.cc:493] T c75afe0e0e00446aa6d220941d288eab P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:13.264420 25171 raft_consensus.cc:3060] T c75afe0e0e00446aa6d220941d288eab P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:13.265314 25413 raft_consensus.cc:993] T ab8dff607862460ea0fcd88422c31ac2 P aa14caefbdaa47b09abf91881635ba96: : Instructing follower 9bf3da5b54ef4a1ea1cee60f02ea2883 to start an election
I20260709 12:15:13.266224 25412 raft_consensus.cc:1081] T ab8dff607862460ea0fcd88422c31ac2 P aa14caefbdaa47b09abf91881635ba96 [term 2 LEADER]: Signalling peer 9bf3da5b54ef4a1ea1cee60f02ea2883 to start an election
I20260709 12:15:13.269169 25155 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ab8dff607862460ea0fcd88422c31ac2"
dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
 from {username='slave'} at 127.0.0.1:59348
I20260709 12:15:13.269753 25155 raft_consensus.cc:493] T ab8dff607862460ea0fcd88422c31ac2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:13.270110 25155 raft_consensus.cc:3060] T ab8dff607862460ea0fcd88422c31ac2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:13.272776 25171 raft_consensus.cc:515] T c75afe0e0e00446aa6d220941d288eab P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:15:13.275286 25171 leader_election.cc:290] T c75afe0e0e00446aa6d220941d288eab P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 2 election: Requested vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:15:13.276301 24281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75afe0e0e00446aa6d220941d288eab" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054"
I20260709 12:15:13.277755 24281 raft_consensus.cc:3055] T c75afe0e0e00446aa6d220941d288eab P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:13.277861 24429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75afe0e0e00446aa6d220941d288eab" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad362df39b114ec3a3a419128097b362"
I20260709 12:15:13.278203 24281 raft_consensus.cc:740] T c75afe0e0e00446aa6d220941d288eab P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Running, Role: LEADER
I20260709 12:15:13.278556 24429 raft_consensus.cc:3060] T c75afe0e0e00446aa6d220941d288eab P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:13.279284 24281 consensus_queue.cc:260] T c75afe0e0e00446aa6d220941d288eab P cf2d8294ae68482ca4ffa8be051ad054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:15:13.280194 25155 raft_consensus.cc:515] T ab8dff607862460ea0fcd88422c31ac2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:15:13.280573 24281 raft_consensus.cc:3060] T c75afe0e0e00446aa6d220941d288eab P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:13.283133 25155 leader_election.cc:290] T ab8dff607862460ea0fcd88422c31ac2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 3 election: Requested vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:15:13.284060 24353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab8dff607862460ea0fcd88422c31ac2" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
I20260709 12:15:13.284312 24279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab8dff607862460ea0fcd88422c31ac2" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054"
I20260709 12:15:13.284725 24353 raft_consensus.cc:3055] T ab8dff607862460ea0fcd88422c31ac2 P aa14caefbdaa47b09abf91881635ba96 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:13.284822 24279 raft_consensus.cc:3060] T ab8dff607862460ea0fcd88422c31ac2 P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:13.285075 24353 raft_consensus.cc:740] T ab8dff607862460ea0fcd88422c31ac2 P aa14caefbdaa47b09abf91881635ba96 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Running, Role: LEADER
I20260709 12:15:13.287273 24353 consensus_queue.cc:260] T ab8dff607862460ea0fcd88422c31ac2 P aa14caefbdaa47b09abf91881635ba96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:15:13.289124 24429 raft_consensus.cc:2468] T c75afe0e0e00446aa6d220941d288eab P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 2.
I20260709 12:15:13.289503 24353 raft_consensus.cc:3060] T ab8dff607862460ea0fcd88422c31ac2 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:13.300215 24353 raft_consensus.cc:2468] T ab8dff607862460ea0fcd88422c31ac2 P aa14caefbdaa47b09abf91881635ba96 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 3.
I20260709 12:15:13.300490 25095 leader_election.cc:304] T c75afe0e0e00446aa6d220941d288eab P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, ad362df39b114ec3a3a419128097b362; no voters: 
I20260709 12:15:13.301467 25387 raft_consensus.cc:2804] T c75afe0e0e00446aa6d220941d288eab P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:13.301563 25096 leader_election.cc:304] T ab8dff607862460ea0fcd88422c31ac2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, aa14caefbdaa47b09abf91881635ba96; no voters: 
I20260709 12:15:13.302186 25387 raft_consensus.cc:697] T c75afe0e0e00446aa6d220941d288eab P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 LEADER]: Becoming Leader. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Running, Role: LEADER
I20260709 12:15:13.302498 25401 raft_consensus.cc:2804] T ab8dff607862460ea0fcd88422c31ac2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:13.303061 25401 raft_consensus.cc:697] T ab8dff607862460ea0fcd88422c31ac2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 3 LEADER]: Becoming Leader. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Running, Role: LEADER
I20260709 12:15:13.303262 25387 consensus_queue.cc:237] T c75afe0e0e00446aa6d220941d288eab P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:15:13.304080 25401 consensus_queue.cc:237] T ab8dff607862460ea0fcd88422c31ac2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:15:13.307206 24279 raft_consensus.cc:2468] T ab8dff607862460ea0fcd88422c31ac2 P cf2d8294ae68482ca4ffa8be051ad054 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 3.
I20260709 12:15:13.312868 24281 raft_consensus.cc:2468] T c75afe0e0e00446aa6d220941d288eab P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 2.
I20260709 12:15:13.325064 24107 catalog_manager.cc:5697] T c75afe0e0e00446aa6d220941d288eab P 9bf3da5b54ef4a1ea1cee60f02ea2883 reported cstate change: term changed from 1 to 2, leader changed from cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194) to 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193). New cstate: current_term: 2 leader_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:13.343485 24107 catalog_manager.cc:5697] T ab8dff607862460ea0fcd88422c31ac2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 reported cstate change: term changed from 2 to 3, leader changed from aa14caefbdaa47b09abf91881635ba96 (127.12.56.195) to 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193). New cstate: current_term: 3 leader_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:13.344776 25394 raft_consensus.cc:993] T 628105dfc534451285d72f9e17f5d4f3 P cf2d8294ae68482ca4ffa8be051ad054: : Instructing follower 9bf3da5b54ef4a1ea1cee60f02ea2883 to start an election
I20260709 12:15:13.345357 25366 raft_consensus.cc:1081] T 628105dfc534451285d72f9e17f5d4f3 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Signalling peer 9bf3da5b54ef4a1ea1cee60f02ea2883 to start an election
I20260709 12:15:13.347132 25155 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "628105dfc534451285d72f9e17f5d4f3"
dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
 from {username='slave'} at 127.0.0.1:59346
I20260709 12:15:13.347669 25155 raft_consensus.cc:493] T 628105dfc534451285d72f9e17f5d4f3 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:13.348019 25155 raft_consensus.cc:3060] T 628105dfc534451285d72f9e17f5d4f3 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:13.355233 25155 raft_consensus.cc:515] T 628105dfc534451285d72f9e17f5d4f3 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:15:13.357372 25155 leader_election.cc:290] T 628105dfc534451285d72f9e17f5d4f3 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 2 election: Requested vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:15:13.357517 24281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628105dfc534451285d72f9e17f5d4f3" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054"
I20260709 12:15:13.358208 24281 raft_consensus.cc:3055] T 628105dfc534451285d72f9e17f5d4f3 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:13.358438 24353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628105dfc534451285d72f9e17f5d4f3" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
I20260709 12:15:13.358542 24281 raft_consensus.cc:740] T 628105dfc534451285d72f9e17f5d4f3 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Running, Role: LEADER
I20260709 12:15:13.358994 24353 raft_consensus.cc:3060] T 628105dfc534451285d72f9e17f5d4f3 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:13.359521 24281 consensus_queue.cc:260] T 628105dfc534451285d72f9e17f5d4f3 P cf2d8294ae68482ca4ffa8be051ad054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:15:13.360954 24281 raft_consensus.cc:3060] T 628105dfc534451285d72f9e17f5d4f3 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:13.365037 24353 raft_consensus.cc:2468] T 628105dfc534451285d72f9e17f5d4f3 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 2.
I20260709 12:15:13.366215 25096 leader_election.cc:304] T 628105dfc534451285d72f9e17f5d4f3 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, aa14caefbdaa47b09abf91881635ba96; no voters: 
I20260709 12:15:13.366636 24281 raft_consensus.cc:2468] T 628105dfc534451285d72f9e17f5d4f3 P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 2.
I20260709 12:15:13.366972 25401 raft_consensus.cc:2804] T 628105dfc534451285d72f9e17f5d4f3 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:13.367566 25401 raft_consensus.cc:697] T 628105dfc534451285d72f9e17f5d4f3 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 LEADER]: Becoming Leader. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Running, Role: LEADER
I20260709 12:15:13.368392 25401 consensus_queue.cc:237] T 628105dfc534451285d72f9e17f5d4f3 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:15:13.382288 24107 catalog_manager.cc:5697] T 628105dfc534451285d72f9e17f5d4f3 P 9bf3da5b54ef4a1ea1cee60f02ea2883 reported cstate change: term changed from 1 to 2, leader changed from cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194) to 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193). New cstate: current_term: 2 leader_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:13.417157 25394 raft_consensus.cc:993] T f841b9f0e82748d399b5eef243c442fc P cf2d8294ae68482ca4ffa8be051ad054: : Instructing follower 9bf3da5b54ef4a1ea1cee60f02ea2883 to start an election
I20260709 12:15:13.417824 25394 raft_consensus.cc:1081] T f841b9f0e82748d399b5eef243c442fc P cf2d8294ae68482ca4ffa8be051ad054 [term 2 LEADER]: Signalling peer 9bf3da5b54ef4a1ea1cee60f02ea2883 to start an election
I20260709 12:15:13.419690 25155 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f841b9f0e82748d399b5eef243c442fc"
dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
 from {username='slave'} at 127.0.0.1:59346
I20260709 12:15:13.420586 25155 raft_consensus.cc:493] T f841b9f0e82748d399b5eef243c442fc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:13.421020 25155 raft_consensus.cc:3060] T f841b9f0e82748d399b5eef243c442fc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:13.427810 25155 raft_consensus.cc:515] T f841b9f0e82748d399b5eef243c442fc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:15:13.429922 25155 leader_election.cc:290] T f841b9f0e82748d399b5eef243c442fc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 3 election: Requested vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:15:13.430781 24281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841b9f0e82748d399b5eef243c442fc" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054"
I20260709 12:15:13.431547 24281 raft_consensus.cc:3055] T f841b9f0e82748d399b5eef243c442fc P cf2d8294ae68482ca4ffa8be051ad054 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:13.431906 24281 raft_consensus.cc:740] T f841b9f0e82748d399b5eef243c442fc P cf2d8294ae68482ca4ffa8be051ad054 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Running, Role: LEADER
I20260709 12:15:13.431020 24355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f841b9f0e82748d399b5eef243c442fc" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
I20260709 12:15:13.432796 24281 consensus_queue.cc:260] T f841b9f0e82748d399b5eef243c442fc P cf2d8294ae68482ca4ffa8be051ad054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:15:13.433362 24355 raft_consensus.cc:3060] T f841b9f0e82748d399b5eef243c442fc P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:13.434262 24281 raft_consensus.cc:3060] T f841b9f0e82748d399b5eef243c442fc P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:13.441710 24281 raft_consensus.cc:2468] T f841b9f0e82748d399b5eef243c442fc P cf2d8294ae68482ca4ffa8be051ad054 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 3.
I20260709 12:15:13.442678 24355 raft_consensus.cc:2468] T f841b9f0e82748d399b5eef243c442fc P aa14caefbdaa47b09abf91881635ba96 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 3.
I20260709 12:15:13.442857 25097 leader_election.cc:304] T f841b9f0e82748d399b5eef243c442fc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054; no voters: 
I20260709 12:15:13.444067 25401 raft_consensus.cc:2804] T f841b9f0e82748d399b5eef243c442fc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:13.444658 25401 raft_consensus.cc:697] T f841b9f0e82748d399b5eef243c442fc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 3 LEADER]: Becoming Leader. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Running, Role: LEADER
I20260709 12:15:13.445695 25401 consensus_queue.cc:237] T f841b9f0e82748d399b5eef243c442fc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:15:13.455926 24107 catalog_manager.cc:5697] T f841b9f0e82748d399b5eef243c442fc P 9bf3da5b54ef4a1ea1cee60f02ea2883 reported cstate change: term changed from 2 to 3, leader changed from cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194) to 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193). New cstate: current_term: 3 leader_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:13.477434 25394 raft_consensus.cc:993] T 0d31cf2c4a7849d9a798bf886e7fc997 P cf2d8294ae68482ca4ffa8be051ad054: : Instructing follower 9bf3da5b54ef4a1ea1cee60f02ea2883 to start an election
I20260709 12:15:13.477922 25366 raft_consensus.cc:1081] T 0d31cf2c4a7849d9a798bf886e7fc997 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Signalling peer 9bf3da5b54ef4a1ea1cee60f02ea2883 to start an election
I20260709 12:15:13.479445 25171 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0d31cf2c4a7849d9a798bf886e7fc997"
dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
 from {username='slave'} at 127.0.0.1:59346
I20260709 12:15:13.480002 25171 raft_consensus.cc:493] T 0d31cf2c4a7849d9a798bf886e7fc997 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:13.480305 25171 raft_consensus.cc:3060] T 0d31cf2c4a7849d9a798bf886e7fc997 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:13.487856 25171 raft_consensus.cc:515] T 0d31cf2c4a7849d9a798bf886e7fc997 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:15:13.489848 25171 leader_election.cc:290] T 0d31cf2c4a7849d9a798bf886e7fc997 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 2 election: Requested vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:15:13.490666 24429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31cf2c4a7849d9a798bf886e7fc997" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad362df39b114ec3a3a419128097b362"
I20260709 12:15:13.490869 24281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d31cf2c4a7849d9a798bf886e7fc997" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054"
I20260709 12:15:13.491362 24429 raft_consensus.cc:3060] T 0d31cf2c4a7849d9a798bf886e7fc997 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:13.491492 24281 raft_consensus.cc:3055] T 0d31cf2c4a7849d9a798bf886e7fc997 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:13.492437 24281 raft_consensus.cc:740] T 0d31cf2c4a7849d9a798bf886e7fc997 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Running, Role: LEADER
I20260709 12:15:13.493534 24281 consensus_queue.cc:260] T 0d31cf2c4a7849d9a798bf886e7fc997 P cf2d8294ae68482ca4ffa8be051ad054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:15:13.495258 24281 raft_consensus.cc:3060] T 0d31cf2c4a7849d9a798bf886e7fc997 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:13.497691 24429 raft_consensus.cc:2468] T 0d31cf2c4a7849d9a798bf886e7fc997 P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 2.
I20260709 12:15:13.499140 25095 leader_election.cc:304] T 0d31cf2c4a7849d9a798bf886e7fc997 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, ad362df39b114ec3a3a419128097b362; no voters: 
I20260709 12:15:13.499982 25401 raft_consensus.cc:2804] T 0d31cf2c4a7849d9a798bf886e7fc997 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:13.500494 25401 raft_consensus.cc:697] T 0d31cf2c4a7849d9a798bf886e7fc997 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 LEADER]: Becoming Leader. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Running, Role: LEADER
I20260709 12:15:13.500586 24281 raft_consensus.cc:2468] T 0d31cf2c4a7849d9a798bf886e7fc997 P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 2.
I20260709 12:15:13.501521 25401 consensus_queue.cc:237] T 0d31cf2c4a7849d9a798bf886e7fc997 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:15:13.512673 24107 catalog_manager.cc:5697] T 0d31cf2c4a7849d9a798bf886e7fc997 P 9bf3da5b54ef4a1ea1cee60f02ea2883 reported cstate change: term changed from 1 to 2, leader changed from cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194) to 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193). New cstate: current_term: 2 leader_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:13.753293 24281 raft_consensus.cc:1275] T ab8dff607862460ea0fcd88422c31ac2 P cf2d8294ae68482ca4ffa8be051ad054 [term 3 FOLLOWER]: Refusing update from remote peer 9bf3da5b54ef4a1ea1cee60f02ea2883: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:13.756084 25401 consensus_queue.cc:1048] T ab8dff607862460ea0fcd88422c31ac2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:13.767885 24353 raft_consensus.cc:1275] T ab8dff607862460ea0fcd88422c31ac2 P aa14caefbdaa47b09abf91881635ba96 [term 3 FOLLOWER]: Refusing update from remote peer 9bf3da5b54ef4a1ea1cee60f02ea2883: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:13.770008 25401 consensus_queue.cc:1048] T ab8dff607862460ea0fcd88422c31ac2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:13.795233 24281 raft_consensus.cc:1275] T 628105dfc534451285d72f9e17f5d4f3 P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Refusing update from remote peer 9bf3da5b54ef4a1ea1cee60f02ea2883: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:13.797183 24280 raft_consensus.cc:1275] T c75afe0e0e00446aa6d220941d288eab P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Refusing update from remote peer 9bf3da5b54ef4a1ea1cee60f02ea2883: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:13.800115 25388 consensus_queue.cc:1048] T 628105dfc534451285d72f9e17f5d4f3 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:13.800264 25401 consensus_queue.cc:1048] T c75afe0e0e00446aa6d220941d288eab P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:13.821758 24353 raft_consensus.cc:1275] T 628105dfc534451285d72f9e17f5d4f3 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Refusing update from remote peer 9bf3da5b54ef4a1ea1cee60f02ea2883: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:13.824730 25401 consensus_queue.cc:1048] T 628105dfc534451285d72f9e17f5d4f3 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:13.835224 24426 raft_consensus.cc:1275] T c75afe0e0e00446aa6d220941d288eab P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Refusing update from remote peer 9bf3da5b54ef4a1ea1cee60f02ea2883: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:13.837082 25388 consensus_queue.cc:1048] T c75afe0e0e00446aa6d220941d288eab P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:13.879695 24281 raft_consensus.cc:1275] T f841b9f0e82748d399b5eef243c442fc P cf2d8294ae68482ca4ffa8be051ad054 [term 3 FOLLOWER]: Refusing update from remote peer 9bf3da5b54ef4a1ea1cee60f02ea2883: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:13.882351 25433 consensus_queue.cc:1048] T f841b9f0e82748d399b5eef243c442fc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:13.900833 24353 raft_consensus.cc:1275] T f841b9f0e82748d399b5eef243c442fc P aa14caefbdaa47b09abf91881635ba96 [term 3 FOLLOWER]: Refusing update from remote peer 9bf3da5b54ef4a1ea1cee60f02ea2883: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:13.902722 25387 consensus_queue.cc:1048] T f841b9f0e82748d399b5eef243c442fc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:13.938819 24281 raft_consensus.cc:1275] T 0d31cf2c4a7849d9a798bf886e7fc997 P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Refusing update from remote peer 9bf3da5b54ef4a1ea1cee60f02ea2883: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:13.940156 25387 consensus_queue.cc:1048] T 0d31cf2c4a7849d9a798bf886e7fc997 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:13.950111 24426 raft_consensus.cc:1275] T 0d31cf2c4a7849d9a798bf886e7fc997 P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Refusing update from remote peer 9bf3da5b54ef4a1ea1cee60f02ea2883: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:13.951758 25387 consensus_queue.cc:1048] T 0d31cf2c4a7849d9a798bf886e7fc997 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:14.280309 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:14.474409 24279 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "356b14abd90d418cab44e524aef8154c"
dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054"
mode: GRACEFUL
new_leader_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
 from {username='slave'} at 127.0.0.1:49220
I20260709 12:15:14.475055 24279 raft_consensus.cc:606] T 356b14abd90d418cab44e524aef8154c P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Received request to transfer leadership to TS 9bf3da5b54ef4a1ea1cee60f02ea2883
I20260709 12:15:14.481557 24279 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d67db0aeb6e4afb953c96511f9863d1"
dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054"
mode: GRACEFUL
new_leader_uuid: "ad362df39b114ec3a3a419128097b362"
 from {username='slave'} at 127.0.0.1:49220
I20260709 12:15:14.482796 24279 raft_consensus.cc:606] T 7d67db0aeb6e4afb953c96511f9863d1 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Received request to transfer leadership to TS ad362df39b114ec3a3a419128097b362
I20260709 12:15:14.506918 24279 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99329004ca1c4c76a3a2dd4567ef15dd"
dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054"
mode: GRACEFUL
new_leader_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
 from {username='slave'} at 127.0.0.1:49220
I20260709 12:15:14.509114 24279 raft_consensus.cc:606] T 99329004ca1c4c76a3a2dd4567ef15dd P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Received request to transfer leadership to TS 9bf3da5b54ef4a1ea1cee60f02ea2883
I20260709 12:15:14.516911 24279 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a18e73ef976b49f0878423c0b3e6e6f2"
dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054"
mode: GRACEFUL
new_leader_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
 from {username='slave'} at 127.0.0.1:49220
I20260709 12:15:14.517660 24279 raft_consensus.cc:606] T a18e73ef976b49f0878423c0b3e6e6f2 P cf2d8294ae68482ca4ffa8be051ad054 [term 2 LEADER]: Received request to transfer leadership to TS 9bf3da5b54ef4a1ea1cee60f02ea2883
I20260709 12:15:14.519991 25447 raft_consensus.cc:993] T 356b14abd90d418cab44e524aef8154c P cf2d8294ae68482ca4ffa8be051ad054: : Instructing follower 9bf3da5b54ef4a1ea1cee60f02ea2883 to start an election
I20260709 12:15:14.520618 25447 raft_consensus.cc:1081] T 356b14abd90d418cab44e524aef8154c P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Signalling peer 9bf3da5b54ef4a1ea1cee60f02ea2883 to start an election
I20260709 12:15:14.521616 24279 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d84ed08271a24f7fa134ae81a858c314"
dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054"
mode: GRACEFUL
new_leader_uuid: "aa14caefbdaa47b09abf91881635ba96"
 from {username='slave'} at 127.0.0.1:49220
I20260709 12:15:14.522313 24279 raft_consensus.cc:606] T d84ed08271a24f7fa134ae81a858c314 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Received request to transfer leadership to TS aa14caefbdaa47b09abf91881635ba96
I20260709 12:15:14.527765 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:15:14.529500 25172 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "356b14abd90d418cab44e524aef8154c"
dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
 from {username='slave'} at 127.0.0.1:59346
I20260709 12:15:14.529801 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:14.531301 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:14.530313 25172 raft_consensus.cc:493] T 356b14abd90d418cab44e524aef8154c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:14.538395 25172 raft_consensus.cc:3060] T 356b14abd90d418cab44e524aef8154c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:14.549605 25447 raft_consensus.cc:993] T a18e73ef976b49f0878423c0b3e6e6f2 P cf2d8294ae68482ca4ffa8be051ad054: : Instructing follower 9bf3da5b54ef4a1ea1cee60f02ea2883 to start an election
I20260709 12:15:14.550196 25447 raft_consensus.cc:1081] T a18e73ef976b49f0878423c0b3e6e6f2 P cf2d8294ae68482ca4ffa8be051ad054 [term 2 LEADER]: Signalling peer 9bf3da5b54ef4a1ea1cee60f02ea2883 to start an election
W20260709 12:15:14.559533 24249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.196:46467, user_credentials={real_user=slave}} blocked reactor thread for 94728.3us
I20260709 12:15:14.562605 25155 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a18e73ef976b49f0878423c0b3e6e6f2"
dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
 from {username='slave'} at 127.0.0.1:59346
I20260709 12:15:14.563328 25155 raft_consensus.cc:493] T a18e73ef976b49f0878423c0b3e6e6f2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:14.563710 25155 raft_consensus.cc:3060] T a18e73ef976b49f0878423c0b3e6e6f2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:14.570871 25366 raft_consensus.cc:993] T 7d67db0aeb6e4afb953c96511f9863d1 P cf2d8294ae68482ca4ffa8be051ad054: : Instructing follower ad362df39b114ec3a3a419128097b362 to start an election
I20260709 12:15:14.570423 25172 raft_consensus.cc:515] T 356b14abd90d418cab44e524aef8154c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:15:14.571684 25381 raft_consensus.cc:1081] T 7d67db0aeb6e4afb953c96511f9863d1 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Signalling peer ad362df39b114ec3a3a419128097b362 to start an election
I20260709 12:15:14.572121 25447 raft_consensus.cc:993] T 99329004ca1c4c76a3a2dd4567ef15dd P cf2d8294ae68482ca4ffa8be051ad054: : Instructing follower 9bf3da5b54ef4a1ea1cee60f02ea2883 to start an election
I20260709 12:15:14.573665 25447 raft_consensus.cc:1081] T 99329004ca1c4c76a3a2dd4567ef15dd P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Signalling peer 9bf3da5b54ef4a1ea1cee60f02ea2883 to start an election
I20260709 12:15:14.574312 24279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b14abd90d418cab44e524aef8154c" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054"
I20260709 12:15:14.573052 25366 raft_consensus.cc:993] T d84ed08271a24f7fa134ae81a858c314 P cf2d8294ae68482ca4ffa8be051ad054: : Instructing follower aa14caefbdaa47b09abf91881635ba96 to start an election
I20260709 12:15:14.574632 25155 raft_consensus.cc:515] T a18e73ef976b49f0878423c0b3e6e6f2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:15:14.574970 24279 raft_consensus.cc:3055] T 356b14abd90d418cab44e524aef8154c P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:14.578876 24279 raft_consensus.cc:740] T 356b14abd90d418cab44e524aef8154c P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Running, Role: LEADER
I20260709 12:15:14.575255 25366 raft_consensus.cc:1081] T d84ed08271a24f7fa134ae81a858c314 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Signalling peer aa14caefbdaa47b09abf91881635ba96 to start an election
I20260709 12:15:14.579710 24279 consensus_queue.cc:260] T 356b14abd90d418cab44e524aef8154c P cf2d8294ae68482ca4ffa8be051ad054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:15:14.580809 24279 raft_consensus.cc:3060] T 356b14abd90d418cab44e524aef8154c P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:14.575675 24352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356b14abd90d418cab44e524aef8154c" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
I20260709 12:15:14.575878 25171 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "99329004ca1c4c76a3a2dd4567ef15dd"
dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
 from {username='slave'} at 127.0.0.1:59346
I20260709 12:15:14.582507 24352 raft_consensus.cc:3060] T 356b14abd90d418cab44e524aef8154c P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:14.582618 25171 raft_consensus.cc:493] T 99329004ca1c4c76a3a2dd4567ef15dd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:14.583192 25171 raft_consensus.cc:3060] T 99329004ca1c4c76a3a2dd4567ef15dd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:14.575798 25172 leader_election.cc:290] T 356b14abd90d418cab44e524aef8154c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 2 election: Requested vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:15:14.577067 24426 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7d67db0aeb6e4afb953c96511f9863d1"
dest_uuid: "ad362df39b114ec3a3a419128097b362"
 from {username='slave'} at 127.0.0.1:49198
I20260709 12:15:14.586118 24359 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d84ed08271a24f7fa134ae81a858c314"
dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
 from {username='slave'} at 127.0.0.1:46408
I20260709 12:15:14.586258 24426 raft_consensus.cc:493] T 7d67db0aeb6e4afb953c96511f9863d1 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:14.586813 24359 raft_consensus.cc:493] T d84ed08271a24f7fa134ae81a858c314 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:14.586884 24426 raft_consensus.cc:3060] T 7d67db0aeb6e4afb953c96511f9863d1 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:14.587205 24359 raft_consensus.cc:3060] T d84ed08271a24f7fa134ae81a858c314 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:14.590183 25171 raft_consensus.cc:515] T 99329004ca1c4c76a3a2dd4567ef15dd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:15:14.593113 24281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99329004ca1c4c76a3a2dd4567ef15dd" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054"
I20260709 12:15:14.593744 24281 raft_consensus.cc:3055] T 99329004ca1c4c76a3a2dd4567ef15dd P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:14.594102 24281 raft_consensus.cc:740] T 99329004ca1c4c76a3a2dd4567ef15dd P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Running, Role: LEADER
I20260709 12:15:14.594913 24281 consensus_queue.cc:260] T 99329004ca1c4c76a3a2dd4567ef15dd P cf2d8294ae68482ca4ffa8be051ad054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:15:14.595863 24426 raft_consensus.cc:515] T 7d67db0aeb6e4afb953c96511f9863d1 P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:15:14.599164 24426 leader_election.cc:290] T 7d67db0aeb6e4afb953c96511f9863d1 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 election: Requested vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:15:14.599351 24281 raft_consensus.cc:3060] T 99329004ca1c4c76a3a2dd4567ef15dd P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:14.605396 24279 raft_consensus.cc:2468] T 356b14abd90d418cab44e524aef8154c P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 2.
I20260709 12:15:14.611433 25097 leader_election.cc:304] T 356b14abd90d418cab44e524aef8154c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054; no voters: 
I20260709 12:15:14.611754 24279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18e73ef976b49f0878423c0b3e6e6f2" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054"
I20260709 12:15:14.612334 25401 raft_consensus.cc:2804] T 356b14abd90d418cab44e524aef8154c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:14.612402 24279 raft_consensus.cc:3055] T a18e73ef976b49f0878423c0b3e6e6f2 P cf2d8294ae68482ca4ffa8be051ad054 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:14.612812 24279 raft_consensus.cc:740] T a18e73ef976b49f0878423c0b3e6e6f2 P cf2d8294ae68482ca4ffa8be051ad054 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Running, Role: LEADER
I20260709 12:15:14.609875 24280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d67db0aeb6e4afb953c96511f9863d1" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054"
I20260709 12:15:14.613616 24280 raft_consensus.cc:3055] T 7d67db0aeb6e4afb953c96511f9863d1 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:14.613878 24279 consensus_queue.cc:260] T a18e73ef976b49f0878423c0b3e6e6f2 P cf2d8294ae68482ca4ffa8be051ad054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:15:14.614674 24358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a18e73ef976b49f0878423c0b3e6e6f2" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
I20260709 12:15:14.615139 24279 raft_consensus.cc:3060] T a18e73ef976b49f0878423c0b3e6e6f2 P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:14.615264 24358 raft_consensus.cc:3060] T a18e73ef976b49f0878423c0b3e6e6f2 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:14.612903 25401 raft_consensus.cc:697] T 356b14abd90d418cab44e524aef8154c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 LEADER]: Becoming Leader. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Running, Role: LEADER
I20260709 12:15:14.602242 24353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d67db0aeb6e4afb953c96511f9863d1" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
I20260709 12:15:14.616750 24353 raft_consensus.cc:3060] T 7d67db0aeb6e4afb953c96511f9863d1 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:14.616987 25401 consensus_queue.cc:237] T 356b14abd90d418cab44e524aef8154c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:15:14.601701 24359 raft_consensus.cc:515] T d84ed08271a24f7fa134ae81a858c314 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:15:14.623747 24353 raft_consensus.cc:2468] T 7d67db0aeb6e4afb953c96511f9863d1 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 2.
I20260709 12:15:14.623780 24358 raft_consensus.cc:2468] T a18e73ef976b49f0878423c0b3e6e6f2 P aa14caefbdaa47b09abf91881635ba96 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 3.
I20260709 12:15:14.613948 24280 raft_consensus.cc:740] T 7d67db0aeb6e4afb953c96511f9863d1 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Running, Role: LEADER
I20260709 12:15:14.626524 24359 leader_election.cc:290] T d84ed08271a24f7fa134ae81a858c314 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 election: Requested vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:15:14.626217 24280 consensus_queue.cc:260] T 7d67db0aeb6e4afb953c96511f9863d1 P cf2d8294ae68482ca4ffa8be051ad054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:15:14.627240 24398 leader_election.cc:304] T 7d67db0aeb6e4afb953c96511f9863d1 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, ad362df39b114ec3a3a419128097b362; no voters: 
I20260709 12:15:14.628132 24280 raft_consensus.cc:3060] T 7d67db0aeb6e4afb953c96511f9863d1 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:14.628363 25417 raft_consensus.cc:2804] T 7d67db0aeb6e4afb953c96511f9863d1 P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:14.628962 25417 raft_consensus.cc:697] T 7d67db0aeb6e4afb953c96511f9863d1 P ad362df39b114ec3a3a419128097b362 [term 2 LEADER]: Becoming Leader. State: Replica: ad362df39b114ec3a3a419128097b362, State: Running, Role: LEADER
I20260709 12:15:14.629916 25417 consensus_queue.cc:237] T 7d67db0aeb6e4afb953c96511f9863d1 P ad362df39b114ec3a3a419128097b362 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:15:14.630576 24429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84ed08271a24f7fa134ae81a858c314" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad362df39b114ec3a3a419128097b362"
I20260709 12:15:14.631171 24429 raft_consensus.cc:3060] T d84ed08271a24f7fa134ae81a858c314 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:14.612844 25155 leader_election.cc:290] T a18e73ef976b49f0878423c0b3e6e6f2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 3 election: Requested vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:15:14.608897 24352 raft_consensus.cc:2468] T 356b14abd90d418cab44e524aef8154c P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 2.
I20260709 12:15:14.634913 25096 leader_election.cc:304] T a18e73ef976b49f0878423c0b3e6e6f2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, aa14caefbdaa47b09abf91881635ba96; no voters: 
I20260709 12:15:14.637460 25446 raft_consensus.cc:2804] T a18e73ef976b49f0878423c0b3e6e6f2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:14.638038 25446 raft_consensus.cc:697] T a18e73ef976b49f0878423c0b3e6e6f2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 3 LEADER]: Becoming Leader. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Running, Role: LEADER
I20260709 12:15:14.639134 24280 raft_consensus.cc:2468] T 7d67db0aeb6e4afb953c96511f9863d1 P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 2.
I20260709 12:15:14.640260 24284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84ed08271a24f7fa134ae81a858c314" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cf2d8294ae68482ca4ffa8be051ad054"
I20260709 12:15:14.640965 24284 raft_consensus.cc:3055] T d84ed08271a24f7fa134ae81a858c314 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:14.641278 24284 raft_consensus.cc:740] T d84ed08271a24f7fa134ae81a858c314 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cf2d8294ae68482ca4ffa8be051ad054, State: Running, Role: LEADER
I20260709 12:15:14.642105 24284 consensus_queue.cc:260] T d84ed08271a24f7fa134ae81a858c314 P cf2d8294ae68482ca4ffa8be051ad054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:15:14.643532 24284 raft_consensus.cc:3060] T d84ed08271a24f7fa134ae81a858c314 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:14.646952 25171 leader_election.cc:290] T 99329004ca1c4c76a3a2dd4567ef15dd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 2 election: Requested vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:15:14.650096 24429 raft_consensus.cc:2468] T d84ed08271a24f7fa134ae81a858c314 P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa14caefbdaa47b09abf91881635ba96 in term 2.
I20260709 12:15:14.651304 24281 raft_consensus.cc:2468] T 99329004ca1c4c76a3a2dd4567ef15dd P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 2.
I20260709 12:15:14.654490 24284 raft_consensus.cc:2468] T d84ed08271a24f7fa134ae81a858c314 P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa14caefbdaa47b09abf91881635ba96 in term 2.
I20260709 12:15:14.661412 24325 leader_election.cc:304] T d84ed08271a24f7fa134ae81a858c314 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, cf2d8294ae68482ca4ffa8be051ad054; no voters: 
I20260709 12:15:14.650988 24108 catalog_manager.cc:5697] T 356b14abd90d418cab44e524aef8154c P 9bf3da5b54ef4a1ea1cee60f02ea2883 reported cstate change: term changed from 1 to 2, leader changed from cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194) to 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193). New cstate: current_term: 2 leader_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:14.662936 25441 raft_consensus.cc:2804] T d84ed08271a24f7fa134ae81a858c314 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:14.663424 25441 raft_consensus.cc:697] T d84ed08271a24f7fa134ae81a858c314 P aa14caefbdaa47b09abf91881635ba96 [term 2 LEADER]: Becoming Leader. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Running, Role: LEADER
I20260709 12:15:14.658872 24359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99329004ca1c4c76a3a2dd4567ef15dd" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
I20260709 12:15:14.658773 24279 raft_consensus.cc:2468] T a18e73ef976b49f0878423c0b3e6e6f2 P cf2d8294ae68482ca4ffa8be051ad054 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 3.
I20260709 12:15:14.664487 24359 raft_consensus.cc:3060] T 99329004ca1c4c76a3a2dd4567ef15dd P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:14.664234 25441 consensus_queue.cc:237] T d84ed08271a24f7fa134ae81a858c314 P aa14caefbdaa47b09abf91881635ba96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:15:14.638945 25446 consensus_queue.cc:237] T a18e73ef976b49f0878423c0b3e6e6f2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:15:14.665352 25097 leader_election.cc:304] T 99329004ca1c4c76a3a2dd4567ef15dd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054; no voters: 
I20260709 12:15:14.670595 25401 raft_consensus.cc:2804] T 99329004ca1c4c76a3a2dd4567ef15dd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:14.671181 25401 raft_consensus.cc:697] T 99329004ca1c4c76a3a2dd4567ef15dd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 LEADER]: Becoming Leader. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Running, Role: LEADER
I20260709 12:15:14.672194 25401 consensus_queue.cc:237] T 99329004ca1c4c76a3a2dd4567ef15dd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:15:14.673763 24359 raft_consensus.cc:2468] T 99329004ca1c4c76a3a2dd4567ef15dd P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 2.
I20260709 12:15:14.682717 24106 catalog_manager.cc:5697] T 7d67db0aeb6e4afb953c96511f9863d1 P ad362df39b114ec3a3a419128097b362 reported cstate change: term changed from 1 to 2, leader changed from cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194) to ad362df39b114ec3a3a419128097b362 (127.12.56.196). New cstate: current_term: 2 leader_uuid: "ad362df39b114ec3a3a419128097b362" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:14.726671 24107 catalog_manager.cc:5697] T d84ed08271a24f7fa134ae81a858c314 P aa14caefbdaa47b09abf91881635ba96 reported cstate change: term changed from 1 to 2, leader changed from cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194) to aa14caefbdaa47b09abf91881635ba96 (127.12.56.195). New cstate: current_term: 2 leader_uuid: "aa14caefbdaa47b09abf91881635ba96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:14.736855 24106 catalog_manager.cc:5697] T a18e73ef976b49f0878423c0b3e6e6f2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 reported cstate change: term changed from 2 to 3, leader changed from cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194) to 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193). New cstate: current_term: 3 leader_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:14.738368 24106 catalog_manager.cc:5697] T 99329004ca1c4c76a3a2dd4567ef15dd P 9bf3da5b54ef4a1ea1cee60f02ea2883 reported cstate change: term changed from 1 to 2, leader changed from cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194) to 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193). New cstate: current_term: 2 leader_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:15.067512 24281 raft_consensus.cc:1275] T 7d67db0aeb6e4afb953c96511f9863d1 P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Refusing update from remote peer ad362df39b114ec3a3a419128097b362: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:15.069056 25445 consensus_queue.cc:1048] T 7d67db0aeb6e4afb953c96511f9863d1 P ad362df39b114ec3a3a419128097b362 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:15.085656 24359 raft_consensus.cc:1275] T 7d67db0aeb6e4afb953c96511f9863d1 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Refusing update from remote peer ad362df39b114ec3a3a419128097b362: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:15.088251 24281 raft_consensus.cc:1275] T d84ed08271a24f7fa134ae81a858c314 P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Refusing update from remote peer aa14caefbdaa47b09abf91881635ba96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:15.088505 25449 consensus_queue.cc:1048] T 7d67db0aeb6e4afb953c96511f9863d1 P ad362df39b114ec3a3a419128097b362 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:15.090399 25444 consensus_queue.cc:1048] T d84ed08271a24f7fa134ae81a858c314 P aa14caefbdaa47b09abf91881635ba96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:15.104481 24279 raft_consensus.cc:1275] T 356b14abd90d418cab44e524aef8154c P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Refusing update from remote peer 9bf3da5b54ef4a1ea1cee60f02ea2883: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:15.108024 25446 consensus_queue.cc:1048] T 356b14abd90d418cab44e524aef8154c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:15.116110 24429 raft_consensus.cc:1275] T d84ed08271a24f7fa134ae81a858c314 P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Refusing update from remote peer aa14caefbdaa47b09abf91881635ba96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:15.117983 25442 consensus_queue.cc:1048] T d84ed08271a24f7fa134ae81a858c314 P aa14caefbdaa47b09abf91881635ba96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:15.134450 24284 raft_consensus.cc:1275] T 99329004ca1c4c76a3a2dd4567ef15dd P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Refusing update from remote peer 9bf3da5b54ef4a1ea1cee60f02ea2883: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:15.142583 24359 raft_consensus.cc:1275] T 356b14abd90d418cab44e524aef8154c P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Refusing update from remote peer 9bf3da5b54ef4a1ea1cee60f02ea2883: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:15.143544 25446 consensus_queue.cc:1048] T 99329004ca1c4c76a3a2dd4567ef15dd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:15.145120 25401 consensus_queue.cc:1048] T 356b14abd90d418cab44e524aef8154c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:15.173044 24352 raft_consensus.cc:1275] T 99329004ca1c4c76a3a2dd4567ef15dd P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Refusing update from remote peer 9bf3da5b54ef4a1ea1cee60f02ea2883: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:15.175009 25387 consensus_queue.cc:1048] T 99329004ca1c4c76a3a2dd4567ef15dd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:15.182983 24352 raft_consensus.cc:1275] T a18e73ef976b49f0878423c0b3e6e6f2 P aa14caefbdaa47b09abf91881635ba96 [term 3 FOLLOWER]: Refusing update from remote peer 9bf3da5b54ef4a1ea1cee60f02ea2883: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:15.185462 25387 consensus_queue.cc:1048] T a18e73ef976b49f0878423c0b3e6e6f2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:15.200819 24284 raft_consensus.cc:1275] T a18e73ef976b49f0878423c0b3e6e6f2 P cf2d8294ae68482ca4ffa8be051ad054 [term 3 FOLLOWER]: Refusing update from remote peer 9bf3da5b54ef4a1ea1cee60f02ea2883: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:15.202235 25446 consensus_queue.cc:1048] T a18e73ef976b49f0878423c0b3e6e6f2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:15:15.358469 24306 debug-util.cc:398] Leaking SignalData structure 0x7b08002bcd40 after lost signal to thread 12518
W20260709 12:15:15.359889 24306 debug-util.cc:398] Leaking SignalData structure 0x7b0800130fe0 after lost signal to thread 24142
W20260709 12:15:15.361294 24306 debug-util.cc:398] Leaking SignalData structure 0x7b08003bee00 after lost signal to thread 24309
W20260709 12:15:15.362707 24306 debug-util.cc:398] Leaking SignalData structure 0x7b0800246f40 after lost signal to thread 24383
W20260709 12:15:15.364058 24306 debug-util.cc:398] Leaking SignalData structure 0x7b080020ac60 after lost signal to thread 24457
W20260709 12:15:15.365887 24306 debug-util.cc:398] Leaking SignalData structure 0x7b0800307d00 after lost signal to thread 25290
I20260709 12:15:15.616389 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:15.690631 24426 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c00f77150f7475c94c4fd29c90805cd"
dest_uuid: "ad362df39b114ec3a3a419128097b362"
mode: GRACEFUL
new_leader_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
 from {username='slave'} at 127.0.0.1:41970
I20260709 12:15:15.691610 24426 raft_consensus.cc:606] T 2c00f77150f7475c94c4fd29c90805cd P ad362df39b114ec3a3a419128097b362 [term 1 LEADER]: Received request to transfer leadership to TS 9bf3da5b54ef4a1ea1cee60f02ea2883
I20260709 12:15:15.696030 24358 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "477aafe049fa4b1182fb0afe55fe5e55"
dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
mode: GRACEFUL
new_leader_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
 from {username='slave'} at 127.0.0.1:44414
I20260709 12:15:15.696717 24358 raft_consensus.cc:606] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96 [term 2 LEADER]: Received request to transfer leadership to TS 9bf3da5b54ef4a1ea1cee60f02ea2883
I20260709 12:15:15.698236 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:15:15.699846 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:15.700582 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:15.837029 25412 raft_consensus.cc:993] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96: : Instructing follower 9bf3da5b54ef4a1ea1cee60f02ea2883 to start an election
I20260709 12:15:15.837687 25360 raft_consensus.cc:1081] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96 [term 2 LEADER]: Signalling peer 9bf3da5b54ef4a1ea1cee60f02ea2883 to start an election
I20260709 12:15:15.840811 25171 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "477aafe049fa4b1182fb0afe55fe5e55"
dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
 from {username='slave'} at 127.0.0.1:59348
I20260709 12:15:15.841552 25171 raft_consensus.cc:493] T 477aafe049fa4b1182fb0afe55fe5e55 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:15.842016 25171 raft_consensus.cc:3060] T 477aafe049fa4b1182fb0afe55fe5e55 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:15.850443 25171 raft_consensus.cc:515] T 477aafe049fa4b1182fb0afe55fe5e55 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:15:15.853257 25171 leader_election.cc:290] T 477aafe049fa4b1182fb0afe55fe5e55 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 3 election: Requested vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:15:15.855130 24358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477aafe049fa4b1182fb0afe55fe5e55" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
I20260709 12:15:15.855222 24426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477aafe049fa4b1182fb0afe55fe5e55" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ad362df39b114ec3a3a419128097b362"
I20260709 12:15:15.855866 24358 raft_consensus.cc:3055] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:15.855947 24426 raft_consensus.cc:3060] T 477aafe049fa4b1182fb0afe55fe5e55 P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:15.856297 24358 raft_consensus.cc:740] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Running, Role: LEADER
I20260709 12:15:15.857124 24358 consensus_queue.cc:260] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:15:15.858500 24358 raft_consensus.cc:3060] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:15.864053 24426 raft_consensus.cc:2468] T 477aafe049fa4b1182fb0afe55fe5e55 P ad362df39b114ec3a3a419128097b362 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 3.
I20260709 12:15:15.865715 25095 leader_election.cc:304] T 477aafe049fa4b1182fb0afe55fe5e55 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, ad362df39b114ec3a3a419128097b362; no voters: 
I20260709 12:15:15.866210 24358 raft_consensus.cc:2468] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 3.
I20260709 12:15:15.866879 25387 raft_consensus.cc:2804] T 477aafe049fa4b1182fb0afe55fe5e55 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:15.867471 25387 raft_consensus.cc:697] T 477aafe049fa4b1182fb0afe55fe5e55 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 3 LEADER]: Becoming Leader. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Running, Role: LEADER
I20260709 12:15:15.868628 25387 consensus_queue.cc:237] T 477aafe049fa4b1182fb0afe55fe5e55 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:15:15.883675 24107 catalog_manager.cc:5697] T 477aafe049fa4b1182fb0afe55fe5e55 P 9bf3da5b54ef4a1ea1cee60f02ea2883 reported cstate change: term changed from 2 to 3, leader changed from aa14caefbdaa47b09abf91881635ba96 (127.12.56.195) to 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193). New cstate: current_term: 3 leader_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:16.050086 25476 raft_consensus.cc:993] T 2c00f77150f7475c94c4fd29c90805cd P ad362df39b114ec3a3a419128097b362: : Instructing follower 9bf3da5b54ef4a1ea1cee60f02ea2883 to start an election
I20260709 12:15:16.050655 25417 raft_consensus.cc:1081] T 2c00f77150f7475c94c4fd29c90805cd P ad362df39b114ec3a3a419128097b362 [term 1 LEADER]: Signalling peer 9bf3da5b54ef4a1ea1cee60f02ea2883 to start an election
I20260709 12:15:16.052471 25155 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c00f77150f7475c94c4fd29c90805cd"
dest_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883"
 from {username='slave'} at 127.0.0.1:59360
I20260709 12:15:16.053049 25155 raft_consensus.cc:493] T 2c00f77150f7475c94c4fd29c90805cd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:16.053336 25155 raft_consensus.cc:3060] T 2c00f77150f7475c94c4fd29c90805cd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:16.059854 25155 raft_consensus.cc:515] T 2c00f77150f7475c94c4fd29c90805cd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:15:16.062988 25155 leader_election.cc:290] T 2c00f77150f7475c94c4fd29c90805cd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 2 election: Requested vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:15:16.067663 24426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c00f77150f7475c94c4fd29c90805cd" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad362df39b114ec3a3a419128097b362"
I20260709 12:15:16.073858 24426 raft_consensus.cc:3055] T 2c00f77150f7475c94c4fd29c90805cd P ad362df39b114ec3a3a419128097b362 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:16.074317 24426 raft_consensus.cc:740] T 2c00f77150f7475c94c4fd29c90805cd P ad362df39b114ec3a3a419128097b362 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ad362df39b114ec3a3a419128097b362, State: Running, Role: LEADER
I20260709 12:15:16.069916 24358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c00f77150f7475c94c4fd29c90805cd" candidate_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
I20260709 12:15:16.075151 24358 raft_consensus.cc:3060] T 2c00f77150f7475c94c4fd29c90805cd P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:16.075255 24426 consensus_queue.cc:260] T 2c00f77150f7475c94c4fd29c90805cd P ad362df39b114ec3a3a419128097b362 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:15:16.092128 24426 raft_consensus.cc:3060] T 2c00f77150f7475c94c4fd29c90805cd P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:16.094134 24358 raft_consensus.cc:2468] T 2c00f77150f7475c94c4fd29c90805cd P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 2.
I20260709 12:15:16.097424 25096 leader_election.cc:304] T 2c00f77150f7475c94c4fd29c90805cd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, aa14caefbdaa47b09abf91881635ba96; no voters: 
I20260709 12:15:16.098523 25401 raft_consensus.cc:2804] T 2c00f77150f7475c94c4fd29c90805cd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:16.099100 25401 raft_consensus.cc:697] T 2c00f77150f7475c94c4fd29c90805cd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 LEADER]: Becoming Leader. State: Replica: 9bf3da5b54ef4a1ea1cee60f02ea2883, State: Running, Role: LEADER
I20260709 12:15:16.100059 25401 consensus_queue.cc:237] T 2c00f77150f7475c94c4fd29c90805cd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:15:16.102977 24426 raft_consensus.cc:2468] T 2c00f77150f7475c94c4fd29c90805cd P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bf3da5b54ef4a1ea1cee60f02ea2883 in term 2.
I20260709 12:15:16.111579 24107 catalog_manager.cc:5697] T 2c00f77150f7475c94c4fd29c90805cd P 9bf3da5b54ef4a1ea1cee60f02ea2883 reported cstate change: term changed from 1 to 2, leader changed from ad362df39b114ec3a3a419128097b362 (127.12.56.196) to 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193). New cstate: current_term: 2 leader_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:16.413084 24352 raft_consensus.cc:1275] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96 [term 3 FOLLOWER]: Refusing update from remote peer 9bf3da5b54ef4a1ea1cee60f02ea2883: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:16.414773 25401 consensus_queue.cc:1048] T 477aafe049fa4b1182fb0afe55fe5e55 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:16.451597 24427 raft_consensus.cc:1275] T 477aafe049fa4b1182fb0afe55fe5e55 P ad362df39b114ec3a3a419128097b362 [term 3 FOLLOWER]: Refusing update from remote peer 9bf3da5b54ef4a1ea1cee60f02ea2883: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:16.453189 25387 consensus_queue.cc:1048] T 477aafe049fa4b1182fb0afe55fe5e55 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:16.572705 24426 raft_consensus.cc:1275] T 2c00f77150f7475c94c4fd29c90805cd P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Refusing update from remote peer 9bf3da5b54ef4a1ea1cee60f02ea2883: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:16.574779 25489 consensus_queue.cc:1048] T 2c00f77150f7475c94c4fd29c90805cd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:15:16.590785 24359 raft_consensus.cc:1275] T 2c00f77150f7475c94c4fd29c90805cd P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Refusing update from remote peer 9bf3da5b54ef4a1ea1cee60f02ea2883: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:16.592649 25401 consensus_queue.cc:1048] T 2c00f77150f7475c94c4fd29c90805cd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:16.763566 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:16.823922 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:16.827841 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:16.828826 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:16.913450 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:16.951967 12515 tablet_server.cc:179] TabletServer@127.12.56.193:38787 shutting down...
W20260709 12:15:16.964926 24396 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 288 similar messages]
W20260709 12:15:16.972651 24396 consensus_peers.cc:597] T fd6e20f3c92f4498a8c272b807797efa P ad362df39b114ec3a3a419128097b362 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:16.974505 24322 consensus_peers.cc:597] T b98a35cf96ba4562b4933543b1e4efb9 P aa14caefbdaa47b09abf91881635ba96 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:16.992867 24396 consensus_peers.cc:597] T e05eec364f764114bdb814096b9bf0ce P ad362df39b114ec3a3a419128097b362 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:16.994639 24396 consensus_peers.cc:597] T d92a635ff6404268bd5e51d3b9681551 P ad362df39b114ec3a3a419128097b362 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:17.008725 24248 consensus_peers.cc:597] T 67c0216443004287861015dd30ae5144 P cf2d8294ae68482ca4ffa8be051ad054 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:17.012212 24396 consensus_peers.cc:597] T 4f756e6bcc20458b8748cd090cd3fce2 P ad362df39b114ec3a3a419128097b362 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:17.016191 24248 consensus_peers.cc:597] T 49b141610080476a8e5f0415c370e8cd P cf2d8294ae68482ca4ffa8be051ad054 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:17.017061 24248 consensus_peers.cc:597] T f9094185a2ad43d0b3a5174b165dab65 P cf2d8294ae68482ca4ffa8be051ad054 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:17.027374 24396 consensus_peers.cc:597] T 7d2a60078de84a53aedeb20cdcd211a4 P ad362df39b114ec3a3a419128097b362 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:17.027834 12515 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:17.029008 12515 tablet_replica.cc:333] stopping tablet replica
I20260709 12:15:17.030139 12515 raft_consensus.cc:2243] T f841b9f0e82748d399b5eef243c442fc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:15:17.031065 12515 raft_consensus.cc:2272] T f841b9f0e82748d399b5eef243c442fc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.033872 12515 tablet_replica.cc:333] stopping tablet replica
I20260709 12:15:17.034729 12515 raft_consensus.cc:2243] T d92a635ff6404268bd5e51d3b9681551 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:17.035362 12515 raft_consensus.cc:2272] T d92a635ff6404268bd5e51d3b9681551 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.038972 12515 tablet_replica.cc:333] stopping tablet replica
I20260709 12:15:17.040063 12515 raft_consensus.cc:2243] T 7943c68d21d449dba2d1dca6ddde5820 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:17.040838 12515 raft_consensus.cc:2272] T 7943c68d21d449dba2d1dca6ddde5820 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:17.040884 24322 consensus_peers.cc:597] T cf280984dcfc44039a942819e8df951c P aa14caefbdaa47b09abf91881635ba96 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:17.044404 12515 tablet_replica.cc:333] stopping tablet replica
I20260709 12:15:17.045612 12515 raft_consensus.cc:2243] T b727e95d8f5843a3bb0d7cbddce61bdb P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:17.046360 12515 raft_consensus.cc:2272] T b727e95d8f5843a3bb0d7cbddce61bdb P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:17.046427 24248 consensus_peers.cc:597] T bfba40ac52f842ca99dd4293619360af P cf2d8294ae68482ca4ffa8be051ad054 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:17.049121 12515 tablet_replica.cc:333] stopping tablet replica
I20260709 12:15:17.050001 12515 raft_consensus.cc:2243] T ed15c59b19ff49d3a39bf5b5abf8b69a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:15:17.050922 12515 raft_consensus.cc:2272] T ed15c59b19ff49d3a39bf5b5abf8b69a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.053534 12515 tablet_replica.cc:333] stopping tablet replica
I20260709 12:15:17.054296 12515 raft_consensus.cc:2243] T 356b14abd90d418cab44e524aef8154c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:17.055339 12515 raft_consensus.cc:2272] T 356b14abd90d418cab44e524aef8154c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.058847 12515 tablet_replica.cc:333] stopping tablet replica
I20260709 12:15:17.060004 12515 raft_consensus.cc:2243] T c75afe0e0e00446aa6d220941d288eab P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:17.061003 12515 raft_consensus.cc:2272] T c75afe0e0e00446aa6d220941d288eab P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.064428 12515 tablet_replica.cc:333] stopping tablet replica
I20260709 12:15:17.065416 12515 raft_consensus.cc:2243] T 4f756e6bcc20458b8748cd090cd3fce2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:17.066133 12515 raft_consensus.cc:2272] T 4f756e6bcc20458b8748cd090cd3fce2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.069375 12515 tablet_replica.cc:333] stopping tablet replica
I20260709 12:15:17.070225 12515 raft_consensus.cc:2243] T ba38e800dd034ff8b7fda6701973510b P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:17.070811 12515 raft_consensus.cc:2272] T ba38e800dd034ff8b7fda6701973510b P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.074262 12515 tablet_replica.cc:333] stopping tablet replica
I20260709 12:15:17.075284 12515 raft_consensus.cc:2243] T 318c217e16874865bd6dff6bd4d8cd4f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:15:17.076256 12515 raft_consensus.cc:2272] T 318c217e16874865bd6dff6bd4d8cd4f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.078907 12515 tablet_replica.cc:333] stopping tablet replica
I20260709 12:15:17.079604 12515 raft_consensus.cc:2243] T fa882381d669422a95ec60c9aefa8105 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:17.080219 12515 raft_consensus.cc:2272] T fa882381d669422a95ec60c9aefa8105 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.083063 12515 tablet_replica.cc:333] stopping tablet replica
I20260709 12:15:17.083689 12515 raft_consensus.cc:2243] T 4b1c850a65b748c093c5c88aa94fed71 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:17.084275 12515 raft_consensus.cc:2272] T 4b1c850a65b748c093c5c88aa94fed71 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.087041 12515 tablet_replica.cc:333] stopping tablet replica
I20260709 12:15:17.087774 12515 raft_consensus.cc:2243] T 9219abaaa2c34b08a24191512ff742bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:17.088331 12515 raft_consensus.cc:2272] T 9219abaaa2c34b08a24191512ff742bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.091606 12515 tablet_replica.cc:333] stopping tablet replica
I20260709 12:15:17.092454 12515 raft_consensus.cc:2243] T 464c7ebd16cd488086ccaec23defbb33 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:17.093070 12515 raft_consensus.cc:2272] T 464c7ebd16cd488086ccaec23defbb33 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:17.094359 24396 consensus_peers.cc:597] T 95d3180f4ab5472d9de6e220219e7898 P ad362df39b114ec3a3a419128097b362 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:17.096702 12515 tablet_replica.cc:333] stopping tablet replica
I20260709 12:15:17.097833 12515 raft_consensus.cc:2243] T 133e492e820f4152ad30562c343b617d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:17.098488 12515 raft_consensus.cc:2272] T 133e492e820f4152ad30562c343b617d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.101948 12515 tablet_replica.cc:333] stopping tablet replica
I20260709 12:15:17.102713 12515 raft_consensus.cc:2243] T e05eec364f764114bdb814096b9bf0ce P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:17.103538 12515 raft_consensus.cc:2272] T e05eec364f764114bdb814096b9bf0ce P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.106463 12515 tablet_replica.cc:333] stopping tablet replica
I20260709 12:15:17.107160 12515 raft_consensus.cc:2243] T 67c0216443004287861015dd30ae5144 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:17.107667 12515 raft_consensus.cc:2272] T 67c0216443004287861015dd30ae5144 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.110343 12515 tablet_replica.cc:333] stopping tablet replica
I20260709 12:15:17.111276 12515 raft_consensus.cc:2243] T 95d3180f4ab5472d9de6e220219e7898 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:17.111883 12515 raft_consensus.cc:2272] T 95d3180f4ab5472d9de6e220219e7898 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.115239 12515 tablet_replica.cc:333] stopping tablet replica
W20260709 12:15:17.115597 24322 consensus_peers.cc:597] T ba38e800dd034ff8b7fda6701973510b P aa14caefbdaa47b09abf91881635ba96 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:17.115656 24396 consensus_peers.cc:597] T 7cbef09353144c0b9a9ebf7731fd019f P ad362df39b114ec3a3a419128097b362 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:17.140722 24322 consensus_peers.cc:597] T 4b1c850a65b748c093c5c88aa94fed71 P aa14caefbdaa47b09abf91881635ba96 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:17.116276 12515 raft_consensus.cc:2243] T 06d0284e94354a2686c577372cceb2bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:15:17.136808 24248 consensus_peers.cc:597] T b1e1c3b597fd49b2831e5f523149b2dc P cf2d8294ae68482ca4ffa8be051ad054 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:17.144618 12515 raft_consensus.cc:2272] T 06d0284e94354a2686c577372cceb2bc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:17.147132 24396 consensus_peers.cc:597] T 8996365fa46548d49f3b3bafe14e9c83 P ad362df39b114ec3a3a419128097b362 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:17.148563 12515 tablet_replica.cc:333] stopping tablet replica
I20260709 12:15:17.149703 12515 raft_consensus.cc:2243] T 0d31cf2c4a7849d9a798bf886e7fc997 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:17.150940 12515 raft_consensus.cc:2272] T 0d31cf2c4a7849d9a798bf886e7fc997 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.154363 12515 tablet_replica.cc:333] stopping tablet replica
I20260709 12:15:17.155450 12515 raft_consensus.cc:2243] T d10519ad64d948b09186e335ed06257d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:17.156126 12515 raft_consensus.cc:2272] T d10519ad64d948b09186e335ed06257d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.159670 12515 tablet_replica.cc:333] stopping tablet replica
I20260709 12:15:17.160660 12515 raft_consensus.cc:2243] T 085a04f8ed724f82bc12490bbb1ceea7 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:17.161363 12515 raft_consensus.cc:2272] T 085a04f8ed724f82bc12490bbb1ceea7 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.165086 12515 tablet_replica.cc:333] stopping tablet replica
I20260709 12:15:17.166159 12515 raft_consensus.cc:2243] T 6af96d3f7393445f8b7edb30a26a6f65 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:17.166790 12515 raft_consensus.cc:2272] T 6af96d3f7393445f8b7edb30a26a6f65 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.170238 12515 tablet_replica.cc:333] stopping tablet replica
I20260709 12:15:17.171401 12515 raft_consensus.cc:2243] T ab8dff607862460ea0fcd88422c31ac2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:15:17.172679 12515 raft_consensus.cc:2272] T ab8dff607862460ea0fcd88422c31ac2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.176126 12515 tablet_replica.cc:333] stopping tablet replica
I20260709 12:15:17.177352 12515 raft_consensus.cc:2243] T 9cb931cb82d74add922e65a2ea3de34d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 3 LEADER]: Raft consensus shutting down.
W20260709 12:15:17.177462 24322 consensus_peers.cc:597] T 27de4156b2e24143a2f301fbefc7cb23 P aa14caefbdaa47b09abf91881635ba96 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:17.176160 24248 consensus_peers.cc:597] T 085a04f8ed724f82bc12490bbb1ceea7 P cf2d8294ae68482ca4ffa8be051ad054 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:17.178645 12515 raft_consensus.cc:2272] T 9cb931cb82d74add922e65a2ea3de34d P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.182578 12515 tablet_replica.cc:333] stopping tablet replica
I20260709 12:15:17.183635 12515 raft_consensus.cc:2243] T 7d2a60078de84a53aedeb20cdcd211a4 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:17.184351 12515 raft_consensus.cc:2272] T 7d2a60078de84a53aedeb20cdcd211a4 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.188122 12515 tablet_replica.cc:333] stopping tablet replica
I20260709 12:15:17.189174 12515 raft_consensus.cc:2243] T fd6e20f3c92f4498a8c272b807797efa P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:17.189901 12515 raft_consensus.cc:2272] T fd6e20f3c92f4498a8c272b807797efa P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.193624 12515 tablet_replica.cc:333] stopping tablet replica
I20260709 12:15:17.194756 12515 raft_consensus.cc:2243] T 49b141610080476a8e5f0415c370e8cd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:17.195427 12515 raft_consensus.cc:2272] T 49b141610080476a8e5f0415c370e8cd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.198944 12515 tablet_replica.cc:333] stopping tablet replica
I20260709 12:15:17.199899 12515 raft_consensus.cc:2243] T cf280984dcfc44039a942819e8df951c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:17.200551 12515 raft_consensus.cc:2272] T cf280984dcfc44039a942819e8df951c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.203971 12515 tablet_replica.cc:333] stopping tablet replica
I20260709 12:15:17.204943 12515 raft_consensus.cc:2243] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:15:17.206187 12515 raft_consensus.cc:2272] T bbab1a4afac94c1eaeb3ed35bc54408a P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.210032 12515 tablet_replica.cc:333] stopping tablet replica
I20260709 12:15:17.211141 12515 raft_consensus.cc:2243] T 7cbef09353144c0b9a9ebf7731fd019f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:17.211824 12515 raft_consensus.cc:2272] T 7cbef09353144c0b9a9ebf7731fd019f P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.215394 12515 tablet_replica.cc:333] stopping tablet replica
I20260709 12:15:17.216383 12515 raft_consensus.cc:2243] T 3fe3be6bb3264475ba597fec30a06f6c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:17.216979 12515 raft_consensus.cc:2272] T 3fe3be6bb3264475ba597fec30a06f6c P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.220335 12515 tablet_replica.cc:333] stopping tablet replica
I20260709 12:15:17.221273 12515 raft_consensus.cc:2243] T bfba40ac52f842ca99dd4293619360af P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:17.221880 12515 raft_consensus.cc:2272] T bfba40ac52f842ca99dd4293619360af P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.225061 12515 tablet_replica.cc:333] stopping tablet replica
I20260709 12:15:17.225934 12515 raft_consensus.cc:2243] T 27de4156b2e24143a2f301fbefc7cb23 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:17.226528 12515 raft_consensus.cc:2272] T 27de4156b2e24143a2f301fbefc7cb23 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.229529 12515 tablet_replica.cc:333] stopping tablet replica
I20260709 12:15:17.230448 12515 raft_consensus.cc:2243] T 99329004ca1c4c76a3a2dd4567ef15dd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:17.231621 12515 raft_consensus.cc:2272] T 99329004ca1c4c76a3a2dd4567ef15dd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.235143 12515 tablet_replica.cc:333] stopping tablet replica
I20260709 12:15:17.236140 12515 raft_consensus.cc:2243] T 477aafe049fa4b1182fb0afe55fe5e55 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:15:17.237432 12515 raft_consensus.cc:2272] T 477aafe049fa4b1182fb0afe55fe5e55 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.243520 12515 tablet_replica.cc:333] stopping tablet replica
I20260709 12:15:17.244588 12515 raft_consensus.cc:2243] T b98a35cf96ba4562b4933543b1e4efb9 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:17.245352 12515 raft_consensus.cc:2272] T b98a35cf96ba4562b4933543b1e4efb9 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:17.247824 24396 consensus_peers.cc:597] T 6af96d3f7393445f8b7edb30a26a6f65 P ad362df39b114ec3a3a419128097b362 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:17.249200 12515 tablet_replica.cc:333] stopping tablet replica
I20260709 12:15:17.250411 12515 raft_consensus.cc:2243] T b1e1c3b597fd49b2831e5f523149b2dc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:17.251111 12515 raft_consensus.cc:2272] T b1e1c3b597fd49b2831e5f523149b2dc P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.254961 12515 tablet_replica.cc:333] stopping tablet replica
I20260709 12:15:17.256004 12515 raft_consensus.cc:2243] T 5310371490a542269db28e29d7adfffa P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:17.256708 12515 raft_consensus.cc:2272] T 5310371490a542269db28e29d7adfffa P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.260155 12515 tablet_replica.cc:333] stopping tablet replica
I20260709 12:15:17.261125 12515 raft_consensus.cc:2243] T 8996365fa46548d49f3b3bafe14e9c83 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:17.261763 12515 raft_consensus.cc:2272] T 8996365fa46548d49f3b3bafe14e9c83 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.265049 12515 tablet_replica.cc:333] stopping tablet replica
I20260709 12:15:17.266003 12515 raft_consensus.cc:2243] T 628105dfc534451285d72f9e17f5d4f3 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:17.267215 12515 raft_consensus.cc:2272] T 628105dfc534451285d72f9e17f5d4f3 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.270383 12515 tablet_replica.cc:333] stopping tablet replica
I20260709 12:15:17.271042 12515 raft_consensus.cc:2243] T a18e73ef976b49f0878423c0b3e6e6f2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:15:17.272214 12515 raft_consensus.cc:2272] T a18e73ef976b49f0878423c0b3e6e6f2 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.275671 12515 tablet_replica.cc:333] stopping tablet replica
I20260709 12:15:17.276521 12515 raft_consensus.cc:2243] T 558ced611e584b32ab838cceeb7cb410 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:17.277220 12515 raft_consensus.cc:2272] T 558ced611e584b32ab838cceeb7cb410 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.280616 12515 tablet_replica.cc:333] stopping tablet replica
I20260709 12:15:17.281422 12515 raft_consensus.cc:2243] T f9094185a2ad43d0b3a5174b165dab65 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:17.281989 12515 raft_consensus.cc:2272] T f9094185a2ad43d0b3a5174b165dab65 P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.285204 12515 tablet_replica.cc:333] stopping tablet replica
I20260709 12:15:17.286031 12515 raft_consensus.cc:2243] T 2c00f77150f7475c94c4fd29c90805cd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:17.287158 12515 raft_consensus.cc:2272] T 2c00f77150f7475c94c4fd29c90805cd P 9bf3da5b54ef4a1ea1cee60f02ea2883 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:17.296231 24248 consensus_peers.cc:597] T 3fe3be6bb3264475ba597fec30a06f6c P cf2d8294ae68482ca4ffa8be051ad054 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:17.322954 24396 consensus_peers.cc:597] T b727e95d8f5843a3bb0d7cbddce61bdb P ad362df39b114ec3a3a419128097b362 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:17.326488 24396 consensus_peers.cc:597] T d10519ad64d948b09186e335ed06257d P ad362df39b114ec3a3a419128097b362 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:17.326514 24322 consensus_peers.cc:597] T 7943c68d21d449dba2d1dca6ddde5820 P aa14caefbdaa47b09abf91881635ba96 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:17.389315 12515 tablet_server.cc:196] TabletServer@127.12.56.193:38787 shutdown complete.
W20260709 12:15:17.400063 24322 consensus_peers.cc:597] T fa882381d669422a95ec60c9aefa8105 P aa14caefbdaa47b09abf91881635ba96 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:17.407543 24322 consensus_peers.cc:597] T 464c7ebd16cd488086ccaec23defbb33 P aa14caefbdaa47b09abf91881635ba96 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:17.445330 24248 consensus_peers.cc:597] T 558ced611e584b32ab838cceeb7cb410 P cf2d8294ae68482ca4ffa8be051ad054 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:17.446022 24396 consensus_peers.cc:597] T 9219abaaa2c34b08a24191512ff742bc P ad362df39b114ec3a3a419128097b362 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:17.450661 24248 consensus_peers.cc:597] T 06d0284e94354a2686c577372cceb2bc P cf2d8294ae68482ca4ffa8be051ad054 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:17.528838 24248 consensus_peers.cc:597] T 5310371490a542269db28e29d7adfffa P cf2d8294ae68482ca4ffa8be051ad054 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:17.559093 24322 consensus_peers.cc:597] T 133e492e820f4152ad30562c343b617d P aa14caefbdaa47b09abf91881635ba96 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:17.577690 12515 tablet_server.cc:179] TabletServer@127.12.56.194:0 shutting down...
W20260709 12:15:17.591886 24399 consensus_peers.cc:597] T 95d3180f4ab5472d9de6e220219e7898 P ad362df39b114ec3a3a419128097b362 -> Peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Couldn't send request to peer cf2d8294ae68482ca4ffa8be051ad054. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:17.649658 24399 consensus_peers.cc:597] T dbace6d282ab498283858033606494ae P ad362df39b114ec3a3a419128097b362 -> Peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Couldn't send request to peer cf2d8294ae68482ca4ffa8be051ad054. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:17.678176 24325 consensus_peers.cc:597] T d84ed08271a24f7fa134ae81a858c314 P aa14caefbdaa47b09abf91881635ba96 -> Peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Couldn't send request to peer cf2d8294ae68482ca4ffa8be051ad054. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:17.680109 24325 consensus_peers.cc:597] T 9c40e590be9d4c3eac0ddd7f96278894 P aa14caefbdaa47b09abf91881635ba96 -> Peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Couldn't send request to peer cf2d8294ae68482ca4ffa8be051ad054. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:17.718101 12515 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:17.719187 12515 tablet_replica.cc:333] T 0f0c432146014cf099d66c95cde2ea1d P cf2d8294ae68482ca4ffa8be051ad054: stopping tablet replica
I20260709 12:15:17.720480 12515 raft_consensus.cc:2243] T 0f0c432146014cf099d66c95cde2ea1d P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:17.721230 12515 raft_consensus.cc:2272] T 0f0c432146014cf099d66c95cde2ea1d P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.724344 12515 tablet_replica.cc:333] T f9094185a2ad43d0b3a5174b165dab65 P cf2d8294ae68482ca4ffa8be051ad054: stopping tablet replica
I20260709 12:15:17.725247 12515 raft_consensus.cc:2243] T f9094185a2ad43d0b3a5174b165dab65 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:15:17.725603 24325 consensus_peers.cc:597] T b98a35cf96ba4562b4933543b1e4efb9 P aa14caefbdaa47b09abf91881635ba96 -> Peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Couldn't send request to peer cf2d8294ae68482ca4ffa8be051ad054. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:17.726665 12515 raft_consensus.cc:2272] T f9094185a2ad43d0b3a5174b165dab65 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.729628 12515 tablet_replica.cc:333] T 6d6c85f42e284b06b8d1e7cee59f3dbc P cf2d8294ae68482ca4ffa8be051ad054: stopping tablet replica
I20260709 12:15:17.730597 12515 raft_consensus.cc:2243] T 6d6c85f42e284b06b8d1e7cee59f3dbc P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:17.731652 12515 raft_consensus.cc:2272] T 6d6c85f42e284b06b8d1e7cee59f3dbc P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.734418 12515 tablet_replica.cc:333] T f841b9f0e82748d399b5eef243c442fc P cf2d8294ae68482ca4ffa8be051ad054: stopping tablet replica
I20260709 12:15:17.734977 12515 raft_consensus.cc:2243] T f841b9f0e82748d399b5eef243c442fc P cf2d8294ae68482ca4ffa8be051ad054 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:17.735502 12515 raft_consensus.cc:2272] T f841b9f0e82748d399b5eef243c442fc P cf2d8294ae68482ca4ffa8be051ad054 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.738472 12515 tablet_replica.cc:333] T 49b141610080476a8e5f0415c370e8cd P cf2d8294ae68482ca4ffa8be051ad054: stopping tablet replica
I20260709 12:15:17.739296 12515 raft_consensus.cc:2243] T 49b141610080476a8e5f0415c370e8cd P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:17.740543 12515 raft_consensus.cc:2272] T 49b141610080476a8e5f0415c370e8cd P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.743609 12515 tablet_replica.cc:333] T bbab1a4afac94c1eaeb3ed35bc54408a P cf2d8294ae68482ca4ffa8be051ad054: stopping tablet replica
I20260709 12:15:17.744511 12515 raft_consensus.cc:2243] T bbab1a4afac94c1eaeb3ed35bc54408a P cf2d8294ae68482ca4ffa8be051ad054 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:17.745057 12515 raft_consensus.cc:2272] T bbab1a4afac94c1eaeb3ed35bc54408a P cf2d8294ae68482ca4ffa8be051ad054 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.750340 12515 tablet_replica.cc:333] T d84ed08271a24f7fa134ae81a858c314 P cf2d8294ae68482ca4ffa8be051ad054: stopping tablet replica
I20260709 12:15:17.751474 12515 raft_consensus.cc:2243] T d84ed08271a24f7fa134ae81a858c314 P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:17.752207 12515 raft_consensus.cc:2272] T d84ed08271a24f7fa134ae81a858c314 P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.756037 12515 tablet_replica.cc:333] T 356b14abd90d418cab44e524aef8154c P cf2d8294ae68482ca4ffa8be051ad054: stopping tablet replica
I20260709 12:15:17.757496 12515 raft_consensus.cc:2243] T 356b14abd90d418cab44e524aef8154c P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:15:17.759348 24399 consensus_peers.cc:597] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P ad362df39b114ec3a3a419128097b362 -> Peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Couldn't send request to peer cf2d8294ae68482ca4ffa8be051ad054. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:17.760102 24399 consensus_peers.cc:597] T b727e95d8f5843a3bb0d7cbddce61bdb P ad362df39b114ec3a3a419128097b362 -> Peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Couldn't send request to peer cf2d8294ae68482ca4ffa8be051ad054. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:17.758335 12515 raft_consensus.cc:2272] T 356b14abd90d418cab44e524aef8154c P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:17.764789 24399 consensus_peers.cc:597] T 7d2a60078de84a53aedeb20cdcd211a4 P ad362df39b114ec3a3a419128097b362 -> Peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Couldn't send request to peer cf2d8294ae68482ca4ffa8be051ad054. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:17.766084 12515 tablet_replica.cc:333] T 93ece38976574ad7a5e93a69c33c074d P cf2d8294ae68482ca4ffa8be051ad054: stopping tablet replica
I20260709 12:15:17.770879 12515 raft_consensus.cc:2243] T 93ece38976574ad7a5e93a69c33c074d P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:17.773829 12515 raft_consensus.cc:2272] T 93ece38976574ad7a5e93a69c33c074d P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.777066 12515 tablet_replica.cc:333] T bfba40ac52f842ca99dd4293619360af P cf2d8294ae68482ca4ffa8be051ad054: stopping tablet replica
I20260709 12:15:17.778124 12515 raft_consensus.cc:2243] T bfba40ac52f842ca99dd4293619360af P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:17.779328 12515 raft_consensus.cc:2272] T bfba40ac52f842ca99dd4293619360af P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.782565 12515 tablet_replica.cc:333] T 3fe3be6bb3264475ba597fec30a06f6c P cf2d8294ae68482ca4ffa8be051ad054: stopping tablet replica
I20260709 12:15:17.783514 12515 raft_consensus.cc:2243] T 3fe3be6bb3264475ba597fec30a06f6c P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:17.784710 12515 raft_consensus.cc:2272] T 3fe3be6bb3264475ba597fec30a06f6c P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.788303 12515 tablet_replica.cc:333] T 7c84013312e3409d851214e9954dad8b P cf2d8294ae68482ca4ffa8be051ad054: stopping tablet replica
I20260709 12:15:17.789451 12515 raft_consensus.cc:2243] T 7c84013312e3409d851214e9954dad8b P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:17.790093 12515 raft_consensus.cc:2272] T 7c84013312e3409d851214e9954dad8b P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.793648 12515 tablet_replica.cc:333] T 9cb931cb82d74add922e65a2ea3de34d P cf2d8294ae68482ca4ffa8be051ad054: stopping tablet replica
I20260709 12:15:17.794646 12515 raft_consensus.cc:2243] T 9cb931cb82d74add922e65a2ea3de34d P cf2d8294ae68482ca4ffa8be051ad054 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:17.797487 12515 raft_consensus.cc:2272] T 9cb931cb82d74add922e65a2ea3de34d P cf2d8294ae68482ca4ffa8be051ad054 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.800944 12515 tablet_replica.cc:333] T 628105dfc534451285d72f9e17f5d4f3 P cf2d8294ae68482ca4ffa8be051ad054: stopping tablet replica
I20260709 12:15:17.802042 12515 raft_consensus.cc:2243] T 628105dfc534451285d72f9e17f5d4f3 P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:17.802708 12515 raft_consensus.cc:2272] T 628105dfc534451285d72f9e17f5d4f3 P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.805933 12515 tablet_replica.cc:333] T 7d67db0aeb6e4afb953c96511f9863d1 P cf2d8294ae68482ca4ffa8be051ad054: stopping tablet replica
I20260709 12:15:17.806892 12515 raft_consensus.cc:2243] T 7d67db0aeb6e4afb953c96511f9863d1 P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:17.807507 12515 raft_consensus.cc:2272] T 7d67db0aeb6e4afb953c96511f9863d1 P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.810575 12515 tablet_replica.cc:333] T 99329004ca1c4c76a3a2dd4567ef15dd P cf2d8294ae68482ca4ffa8be051ad054: stopping tablet replica
I20260709 12:15:17.811517 12515 raft_consensus.cc:2243] T 99329004ca1c4c76a3a2dd4567ef15dd P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:17.812119 12515 raft_consensus.cc:2272] T 99329004ca1c4c76a3a2dd4567ef15dd P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.815322 12515 tablet_replica.cc:333] T 27de4156b2e24143a2f301fbefc7cb23 P cf2d8294ae68482ca4ffa8be051ad054: stopping tablet replica
I20260709 12:15:17.816340 12515 raft_consensus.cc:2243] T 27de4156b2e24143a2f301fbefc7cb23 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:17.816977 12515 raft_consensus.cc:2272] T 27de4156b2e24143a2f301fbefc7cb23 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:17.819777 24325 consensus_peers.cc:597] T e24b175869274d33ade73761b6f23ca4 P aa14caefbdaa47b09abf91881635ba96 -> Peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Couldn't send request to peer cf2d8294ae68482ca4ffa8be051ad054. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:17.820544 12515 tablet_replica.cc:333] T dbace6d282ab498283858033606494ae P cf2d8294ae68482ca4ffa8be051ad054: stopping tablet replica
I20260709 12:15:17.821818 12515 raft_consensus.cc:2243] T dbace6d282ab498283858033606494ae P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:17.822568 12515 raft_consensus.cc:2272] T dbace6d282ab498283858033606494ae P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.826081 12515 tablet_replica.cc:333] T e15e9b81515343958a00ba6f2f291860 P cf2d8294ae68482ca4ffa8be051ad054: stopping tablet replica
I20260709 12:15:17.827149 12515 raft_consensus.cc:2243] T e15e9b81515343958a00ba6f2f291860 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:17.828550 12515 raft_consensus.cc:2272] T e15e9b81515343958a00ba6f2f291860 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.832213 12515 tablet_replica.cc:333] T c75afe0e0e00446aa6d220941d288eab P cf2d8294ae68482ca4ffa8be051ad054: stopping tablet replica
I20260709 12:15:17.833209 12515 raft_consensus.cc:2243] T c75afe0e0e00446aa6d220941d288eab P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:17.833873 12515 raft_consensus.cc:2272] T c75afe0e0e00446aa6d220941d288eab P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.837683 12515 tablet_replica.cc:333] T 318c217e16874865bd6dff6bd4d8cd4f P cf2d8294ae68482ca4ffa8be051ad054: stopping tablet replica
I20260709 12:15:17.838507 12515 raft_consensus.cc:2243] T 318c217e16874865bd6dff6bd4d8cd4f P cf2d8294ae68482ca4ffa8be051ad054 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:17.839069 12515 raft_consensus.cc:2272] T 318c217e16874865bd6dff6bd4d8cd4f P cf2d8294ae68482ca4ffa8be051ad054 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.841876 12515 tablet_replica.cc:333] T d10519ad64d948b09186e335ed06257d P cf2d8294ae68482ca4ffa8be051ad054: stopping tablet replica
I20260709 12:15:17.842681 12515 raft_consensus.cc:2243] T d10519ad64d948b09186e335ed06257d P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:17.843317 12515 raft_consensus.cc:2272] T d10519ad64d948b09186e335ed06257d P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.846311 12515 tablet_replica.cc:333] T 6af96d3f7393445f8b7edb30a26a6f65 P cf2d8294ae68482ca4ffa8be051ad054: stopping tablet replica
I20260709 12:15:17.847141 12515 raft_consensus.cc:2243] T 6af96d3f7393445f8b7edb30a26a6f65 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:17.847756 12515 raft_consensus.cc:2272] T 6af96d3f7393445f8b7edb30a26a6f65 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.850353 12515 tablet_replica.cc:333] T 085a04f8ed724f82bc12490bbb1ceea7 P cf2d8294ae68482ca4ffa8be051ad054: stopping tablet replica
I20260709 12:15:17.851043 12515 raft_consensus.cc:2243] T 085a04f8ed724f82bc12490bbb1ceea7 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:17.852198 12515 raft_consensus.cc:2272] T 085a04f8ed724f82bc12490bbb1ceea7 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.854975 12515 tablet_replica.cc:333] T 20629783689c4296afb55366d9ad5f6c P cf2d8294ae68482ca4ffa8be051ad054: stopping tablet replica
I20260709 12:15:17.855768 12515 raft_consensus.cc:2243] T 20629783689c4296afb55366d9ad5f6c P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:17.856348 12515 raft_consensus.cc:2272] T 20629783689c4296afb55366d9ad5f6c P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.859822 12515 tablet_replica.cc:333] T 9c40e590be9d4c3eac0ddd7f96278894 P cf2d8294ae68482ca4ffa8be051ad054: stopping tablet replica
I20260709 12:15:17.860611 12515 raft_consensus.cc:2243] T 9c40e590be9d4c3eac0ddd7f96278894 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:17.861176 12515 raft_consensus.cc:2272] T 9c40e590be9d4c3eac0ddd7f96278894 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:17.862672 24325 consensus_peers.cc:597] T 7943c68d21d449dba2d1dca6ddde5820 P aa14caefbdaa47b09abf91881635ba96 -> Peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Couldn't send request to peer cf2d8294ae68482ca4ffa8be051ad054. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:17.864336 12515 tablet_replica.cc:333] T 558ced611e584b32ab838cceeb7cb410 P cf2d8294ae68482ca4ffa8be051ad054: stopping tablet replica
I20260709 12:15:17.865185 12515 raft_consensus.cc:2243] T 558ced611e584b32ab838cceeb7cb410 P cf2d8294ae68482ca4ffa8be051ad054 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:17.866205 12515 raft_consensus.cc:2272] T 558ced611e584b32ab838cceeb7cb410 P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.868602 12515 tablet_replica.cc:333] T a18e73ef976b49f0878423c0b3e6e6f2 P cf2d8294ae68482ca4ffa8be051ad054: stopping tablet replica
I20260709 12:15:17.869292 12515 raft_consensus.cc:2243] T a18e73ef976b49f0878423c0b3e6e6f2 P cf2d8294ae68482ca4ffa8be051ad054 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:17.869752 12515 raft_consensus.cc:2272] T a18e73ef976b49f0878423c0b3e6e6f2 P cf2d8294ae68482ca4ffa8be051ad054 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.872155 12515 tablet_replica.cc:333] T b727e95d8f5843a3bb0d7cbddce61bdb P cf2d8294ae68482ca4ffa8be051ad054: stopping tablet replica
I20260709 12:15:17.872752 12515 raft_consensus.cc:2243] T b727e95d8f5843a3bb0d7cbddce61bdb P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:17.873246 12515 raft_consensus.cc:2272] T b727e95d8f5843a3bb0d7cbddce61bdb P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.875453 12515 tablet_replica.cc:333] T ab8dff607862460ea0fcd88422c31ac2 P cf2d8294ae68482ca4ffa8be051ad054: stopping tablet replica
I20260709 12:15:17.876313 12515 raft_consensus.cc:2243] T ab8dff607862460ea0fcd88422c31ac2 P cf2d8294ae68482ca4ffa8be051ad054 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:17.877048 12515 raft_consensus.cc:2272] T ab8dff607862460ea0fcd88422c31ac2 P cf2d8294ae68482ca4ffa8be051ad054 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.880450 12515 tablet_replica.cc:333] T 7943c68d21d449dba2d1dca6ddde5820 P cf2d8294ae68482ca4ffa8be051ad054: stopping tablet replica
I20260709 12:15:17.881414 12515 raft_consensus.cc:2243] T 7943c68d21d449dba2d1dca6ddde5820 P cf2d8294ae68482ca4ffa8be051ad054 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:17.882104 12515 raft_consensus.cc:2272] T 7943c68d21d449dba2d1dca6ddde5820 P cf2d8294ae68482ca4ffa8be051ad054 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.885716 12515 tablet_replica.cc:333] T 67c0216443004287861015dd30ae5144 P cf2d8294ae68482ca4ffa8be051ad054: stopping tablet replica
I20260709 12:15:17.886654 12515 raft_consensus.cc:2243] T 67c0216443004287861015dd30ae5144 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:17.887953 12515 raft_consensus.cc:2272] T 67c0216443004287861015dd30ae5144 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.891640 12515 tablet_replica.cc:333] T 95d3180f4ab5472d9de6e220219e7898 P cf2d8294ae68482ca4ffa8be051ad054: stopping tablet replica
I20260709 12:15:17.892601 12515 raft_consensus.cc:2243] T 95d3180f4ab5472d9de6e220219e7898 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:17.893294 12515 raft_consensus.cc:2272] T 95d3180f4ab5472d9de6e220219e7898 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:17.893765 24325 consensus_peers.cc:597] T 20629783689c4296afb55366d9ad5f6c P aa14caefbdaa47b09abf91881635ba96 -> Peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Couldn't send request to peer cf2d8294ae68482ca4ffa8be051ad054. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:17.896761 12515 tablet_replica.cc:333] T 133e492e820f4152ad30562c343b617d P cf2d8294ae68482ca4ffa8be051ad054: stopping tablet replica
I20260709 12:15:17.897955 12515 raft_consensus.cc:2243] T 133e492e820f4152ad30562c343b617d P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:17.898612 12515 raft_consensus.cc:2272] T 133e492e820f4152ad30562c343b617d P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.901839 12515 tablet_replica.cc:333] T 00b51df5a8ee448884a9f145559a5ea3 P cf2d8294ae68482ca4ffa8be051ad054: stopping tablet replica
I20260709 12:15:17.902776 12515 raft_consensus.cc:2243] T 00b51df5a8ee448884a9f145559a5ea3 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:17.904021 12515 raft_consensus.cc:2272] T 00b51df5a8ee448884a9f145559a5ea3 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.907214 12515 tablet_replica.cc:333] T 06d0284e94354a2686c577372cceb2bc P cf2d8294ae68482ca4ffa8be051ad054: stopping tablet replica
I20260709 12:15:17.908231 12515 raft_consensus.cc:2243] T 06d0284e94354a2686c577372cceb2bc P cf2d8294ae68482ca4ffa8be051ad054 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:17.909546 12515 raft_consensus.cc:2272] T 06d0284e94354a2686c577372cceb2bc P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.914345 12515 tablet_replica.cc:333] T 0d31cf2c4a7849d9a798bf886e7fc997 P cf2d8294ae68482ca4ffa8be051ad054: stopping tablet replica
I20260709 12:15:17.915388 12515 raft_consensus.cc:2243] T 0d31cf2c4a7849d9a798bf886e7fc997 P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:15:17.915593 24399 consensus_peers.cc:597] T 6af96d3f7393445f8b7edb30a26a6f65 P ad362df39b114ec3a3a419128097b362 -> Peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Couldn't send request to peer cf2d8294ae68482ca4ffa8be051ad054. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:17.916095 12515 raft_consensus.cc:2272] T 0d31cf2c4a7849d9a798bf886e7fc997 P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.919656 12515 tablet_replica.cc:333] T b1e1c3b597fd49b2831e5f523149b2dc P cf2d8294ae68482ca4ffa8be051ad054: stopping tablet replica
I20260709 12:15:17.920647 12515 raft_consensus.cc:2243] T b1e1c3b597fd49b2831e5f523149b2dc P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:17.921950 12515 raft_consensus.cc:2272] T b1e1c3b597fd49b2831e5f523149b2dc P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.925133 12515 tablet_replica.cc:333] T b98a35cf96ba4562b4933543b1e4efb9 P cf2d8294ae68482ca4ffa8be051ad054: stopping tablet replica
I20260709 12:15:17.926086 12515 raft_consensus.cc:2243] T b98a35cf96ba4562b4933543b1e4efb9 P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:17.926815 12515 raft_consensus.cc:2272] T b98a35cf96ba4562b4933543b1e4efb9 P cf2d8294ae68482ca4ffa8be051ad054 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.931269 12515 tablet_replica.cc:333] T 5310371490a542269db28e29d7adfffa P cf2d8294ae68482ca4ffa8be051ad054: stopping tablet replica
I20260709 12:15:17.932128 12515 raft_consensus.cc:2243] T 5310371490a542269db28e29d7adfffa P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:17.933333 12515 raft_consensus.cc:2272] T 5310371490a542269db28e29d7adfffa P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.937060 12515 tablet_replica.cc:333] T 7d2a60078de84a53aedeb20cdcd211a4 P cf2d8294ae68482ca4ffa8be051ad054: stopping tablet replica
I20260709 12:15:17.937966 12515 raft_consensus.cc:2243] T 7d2a60078de84a53aedeb20cdcd211a4 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:17.938630 12515 raft_consensus.cc:2272] T 7d2a60078de84a53aedeb20cdcd211a4 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.942126 12515 tablet_replica.cc:333] T 3e977ea0483d4c029394b273e7c4e90f P cf2d8294ae68482ca4ffa8be051ad054: stopping tablet replica
I20260709 12:15:17.943035 12515 raft_consensus.cc:2243] T 3e977ea0483d4c029394b273e7c4e90f P cf2d8294ae68482ca4ffa8be051ad054 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:17.944263 12515 raft_consensus.cc:2272] T 3e977ea0483d4c029394b273e7c4e90f P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:17.946884 24325 consensus_peers.cc:597] T 27de4156b2e24143a2f301fbefc7cb23 P aa14caefbdaa47b09abf91881635ba96 -> Peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Couldn't send request to peer cf2d8294ae68482ca4ffa8be051ad054. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:17.947688 12515 tablet_replica.cc:333] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P cf2d8294ae68482ca4ffa8be051ad054: stopping tablet replica
I20260709 12:15:17.948685 12515 raft_consensus.cc:2243] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:17.949357 12515 raft_consensus.cc:2272] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:17.958964 12515 tablet_replica.cc:333] T e24b175869274d33ade73761b6f23ca4 P cf2d8294ae68482ca4ffa8be051ad054: stopping tablet replica
I20260709 12:15:17.959817 12515 raft_consensus.cc:2243] T e24b175869274d33ade73761b6f23ca4 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:17.960492 12515 raft_consensus.cc:2272] T e24b175869274d33ade73761b6f23ca4 P cf2d8294ae68482ca4ffa8be051ad054 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:17.961144 24399 consensus_peers.cc:597] T 7d67db0aeb6e4afb953c96511f9863d1 P ad362df39b114ec3a3a419128097b362 -> Peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Couldn't send request to peer cf2d8294ae68482ca4ffa8be051ad054. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:18.009402 24399 consensus_peers.cc:597] T d10519ad64d948b09186e335ed06257d P ad362df39b114ec3a3a419128097b362 -> Peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Couldn't send request to peer cf2d8294ae68482ca4ffa8be051ad054. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:18.028743 24325 consensus_peers.cc:597] T 133e492e820f4152ad30562c343b617d P aa14caefbdaa47b09abf91881635ba96 -> Peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Couldn't send request to peer cf2d8294ae68482ca4ffa8be051ad054. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:18.035689 24325 consensus_peers.cc:597] T 0f0c432146014cf099d66c95cde2ea1d P aa14caefbdaa47b09abf91881635ba96 -> Peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Couldn't send request to peer cf2d8294ae68482ca4ffa8be051ad054. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:18.071370 24325 consensus_peers.cc:597] T 7c84013312e3409d851214e9954dad8b P aa14caefbdaa47b09abf91881635ba96 -> Peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Couldn't send request to peer cf2d8294ae68482ca4ffa8be051ad054. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:18.152356 25496 raft_consensus.cc:493] T ed15c59b19ff49d3a39bf5b5abf8b69a P aa14caefbdaa47b09abf91881635ba96 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:15:18.152928 25496 raft_consensus.cc:515] T ed15c59b19ff49d3a39bf5b5abf8b69a P aa14caefbdaa47b09abf91881635ba96 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:15:18.156111 24429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed15c59b19ff49d3a39bf5b5abf8b69a" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:15:18.163826 25496 leader_election.cc:290] T ed15c59b19ff49d3a39bf5b5abf8b69a P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
W20260709 12:15:18.170536 24322 leader_election.cc:336] T ed15c59b19ff49d3a39bf5b5abf8b69a P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:15:18.170977 24322 leader_election.cc:304] T ed15c59b19ff49d3a39bf5b5abf8b69a P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, ad362df39b114ec3a3a419128097b362
I20260709 12:15:18.171705 25496 raft_consensus.cc:2749] T ed15c59b19ff49d3a39bf5b5abf8b69a P aa14caefbdaa47b09abf91881635ba96 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:18.183298 25476 raft_consensus.cc:493] T 318c217e16874865bd6dff6bd4d8cd4f P ad362df39b114ec3a3a419128097b362 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:15:18.184021 25476 raft_consensus.cc:515] T 318c217e16874865bd6dff6bd4d8cd4f P ad362df39b114ec3a3a419128097b362 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:15:18.186591 25476 leader_election.cc:290] T 318c217e16874865bd6dff6bd4d8cd4f P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
W20260709 12:15:18.191921 24396 leader_election.cc:336] T 318c217e16874865bd6dff6bd4d8cd4f P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:15:18.192938 25476 raft_consensus.cc:493] T c75afe0e0e00446aa6d220941d288eab P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:15:18.193693 25476 raft_consensus.cc:515] T c75afe0e0e00446aa6d220941d288eab P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
W20260709 12:15:18.193696 24399 leader_election.cc:336] T 318c217e16874865bd6dff6bd4d8cd4f P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111)
I20260709 12:15:18.196275 25476 leader_election.cc:290] T c75afe0e0e00446aa6d220941d288eab P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:15:18.197513 24399 leader_election.cc:304] T 318c217e16874865bd6dff6bd4d8cd4f P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad362df39b114ec3a3a419128097b362; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:15:18.198787 25476 raft_consensus.cc:2749] T 318c217e16874865bd6dff6bd4d8cd4f P ad362df39b114ec3a3a419128097b362 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:18.202926 25496 raft_consensus.cc:493] T 356b14abd90d418cab44e524aef8154c P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:15:18.203585 25496 raft_consensus.cc:515] T 356b14abd90d418cab44e524aef8154c P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
W20260709 12:15:18.204248 24399 leader_election.cc:336] T c75afe0e0e00446aa6d220941d288eab P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111)
I20260709 12:15:18.205974 25496 leader_election.cc:290] T 356b14abd90d418cab44e524aef8154c P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
W20260709 12:15:18.208779 24396 leader_election.cc:336] T c75afe0e0e00446aa6d220941d288eab P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:15:18.209380 24396 leader_election.cc:304] T c75afe0e0e00446aa6d220941d288eab P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad362df39b114ec3a3a419128097b362; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:15:18.210259 25476 raft_consensus.cc:2749] T c75afe0e0e00446aa6d220941d288eab P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:15:18.217012 24322 leader_election.cc:336] T 356b14abd90d418cab44e524aef8154c P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
W20260709 12:15:18.218245 24325 leader_election.cc:336] T 356b14abd90d418cab44e524aef8154c P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111)
I20260709 12:15:18.218875 24325 leader_election.cc:304] T 356b14abd90d418cab44e524aef8154c P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:15:18.221180 25412 raft_consensus.cc:2749] T 356b14abd90d418cab44e524aef8154c P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:18.347062 25412 raft_consensus.cc:493] T ab8dff607862460ea0fcd88422c31ac2 P aa14caefbdaa47b09abf91881635ba96 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:15:18.347671 25412 raft_consensus.cc:515] T ab8dff607862460ea0fcd88422c31ac2 P aa14caefbdaa47b09abf91881635ba96 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:15:18.350099 25412 leader_election.cc:290] T ab8dff607862460ea0fcd88422c31ac2 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
W20260709 12:15:18.355325 24322 leader_election.cc:336] T ab8dff607862460ea0fcd88422c31ac2 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:15:18.366101 25445 raft_consensus.cc:493] T bbab1a4afac94c1eaeb3ed35bc54408a P ad362df39b114ec3a3a419128097b362 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:15:18.367432 25445 raft_consensus.cc:515] T bbab1a4afac94c1eaeb3ed35bc54408a P ad362df39b114ec3a3a419128097b362 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
W20260709 12:15:18.370121 24325 leader_election.cc:336] T ab8dff607862460ea0fcd88422c31ac2 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111)
I20260709 12:15:18.370373 25412 raft_consensus.cc:493] T f841b9f0e82748d399b5eef243c442fc P aa14caefbdaa47b09abf91881635ba96 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:15:18.371603 25412 raft_consensus.cc:515] T f841b9f0e82748d399b5eef243c442fc P aa14caefbdaa47b09abf91881635ba96 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:15:18.377127 25412 leader_election.cc:290] T f841b9f0e82748d399b5eef243c442fc P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:15:18.371928 25445 leader_election.cc:290] T bbab1a4afac94c1eaeb3ed35bc54408a P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:15:18.370716 24325 leader_election.cc:304] T ab8dff607862460ea0fcd88422c31ac2 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054
W20260709 12:15:18.377884 24399 leader_election.cc:336] T bbab1a4afac94c1eaeb3ed35bc54408a P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111)
I20260709 12:15:18.379848 25412 raft_consensus.cc:2749] T ab8dff607862460ea0fcd88422c31ac2 P aa14caefbdaa47b09abf91881635ba96 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:15:18.382570 24396 leader_election.cc:336] T bbab1a4afac94c1eaeb3ed35bc54408a P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:15:18.383558 24396 leader_election.cc:304] T bbab1a4afac94c1eaeb3ed35bc54408a P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad362df39b114ec3a3a419128097b362; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054
W20260709 12:15:18.381508 24322 leader_election.cc:336] T f841b9f0e82748d399b5eef243c442fc P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:15:18.385064 25476 raft_consensus.cc:2749] T bbab1a4afac94c1eaeb3ed35bc54408a P ad362df39b114ec3a3a419128097b362 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:15:18.388784 24325 leader_election.cc:336] T f841b9f0e82748d399b5eef243c442fc P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111)
I20260709 12:15:18.389333 24325 leader_election.cc:304] T f841b9f0e82748d399b5eef243c442fc P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:15:18.390497 25412 raft_consensus.cc:2749] T f841b9f0e82748d399b5eef243c442fc P aa14caefbdaa47b09abf91881635ba96 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:18.399106 25445 raft_consensus.cc:493] T 477aafe049fa4b1182fb0afe55fe5e55 P ad362df39b114ec3a3a419128097b362 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:15:18.399772 25445 raft_consensus.cc:515] T 477aafe049fa4b1182fb0afe55fe5e55 P ad362df39b114ec3a3a419128097b362 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:15:18.401706 25445 leader_election.cc:290] T 477aafe049fa4b1182fb0afe55fe5e55 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:15:18.402746 24352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477aafe049fa4b1182fb0afe55fe5e55" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:15:18.405253 25412 raft_consensus.cc:493] T 628105dfc534451285d72f9e17f5d4f3 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
W20260709 12:15:18.406188 24396 leader_election.cc:336] T 477aafe049fa4b1182fb0afe55fe5e55 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:15:18.405997 25412 raft_consensus.cc:515] T 628105dfc534451285d72f9e17f5d4f3 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:15:18.406677 24396 leader_election.cc:304] T 477aafe049fa4b1182fb0afe55fe5e55 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad362df39b114ec3a3a419128097b362; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, aa14caefbdaa47b09abf91881635ba96
I20260709 12:15:18.407405 25445 raft_consensus.cc:2749] T 477aafe049fa4b1182fb0afe55fe5e55 P ad362df39b114ec3a3a419128097b362 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:18.408378 25412 leader_election.cc:290] T 628105dfc534451285d72f9e17f5d4f3 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
W20260709 12:15:18.412762 24322 leader_election.cc:336] T 628105dfc534451285d72f9e17f5d4f3 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
W20260709 12:15:18.413286 24325 leader_election.cc:336] T 628105dfc534451285d72f9e17f5d4f3 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111)
I20260709 12:15:18.413738 24325 leader_election.cc:304] T 628105dfc534451285d72f9e17f5d4f3 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:15:18.414584 25412 raft_consensus.cc:2749] T 628105dfc534451285d72f9e17f5d4f3 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:18.444846 25445 raft_consensus.cc:493] T ed15c59b19ff49d3a39bf5b5abf8b69a P ad362df39b114ec3a3a419128097b362 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:15:18.446336 25445 raft_consensus.cc:515] T ed15c59b19ff49d3a39bf5b5abf8b69a P ad362df39b114ec3a3a419128097b362 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:15:18.450552 24352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed15c59b19ff49d3a39bf5b5abf8b69a" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:15:18.451335 24352 raft_consensus.cc:2468] T ed15c59b19ff49d3a39bf5b5abf8b69a P aa14caefbdaa47b09abf91881635ba96 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 3.
I20260709 12:15:18.453022 24398 leader_election.cc:304] T ed15c59b19ff49d3a39bf5b5abf8b69a P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, ad362df39b114ec3a3a419128097b362; no voters: 
I20260709 12:15:18.449865 25445 leader_election.cc:290] T ed15c59b19ff49d3a39bf5b5abf8b69a P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:15:18.454001 25476 raft_consensus.cc:2804] T ed15c59b19ff49d3a39bf5b5abf8b69a P ad362df39b114ec3a3a419128097b362 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:18.454432 25476 raft_consensus.cc:493] T ed15c59b19ff49d3a39bf5b5abf8b69a P ad362df39b114ec3a3a419128097b362 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:15:18.454835 25476 raft_consensus.cc:3060] T ed15c59b19ff49d3a39bf5b5abf8b69a P ad362df39b114ec3a3a419128097b362 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:15:18.458159 24396 leader_election.cc:336] T ed15c59b19ff49d3a39bf5b5abf8b69a P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:15:18.462025 25476 raft_consensus.cc:515] T ed15c59b19ff49d3a39bf5b5abf8b69a P ad362df39b114ec3a3a419128097b362 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:15:18.464581 25476 leader_election.cc:290] T ed15c59b19ff49d3a39bf5b5abf8b69a P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 4 election: Requested vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:15:18.465507 24352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed15c59b19ff49d3a39bf5b5abf8b69a" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
I20260709 12:15:18.466094 24352 raft_consensus.cc:3060] T ed15c59b19ff49d3a39bf5b5abf8b69a P aa14caefbdaa47b09abf91881635ba96 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:15:18.469487 24396 leader_election.cc:336] T ed15c59b19ff49d3a39bf5b5abf8b69a P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:15:18.472216 24352 raft_consensus.cc:2468] T ed15c59b19ff49d3a39bf5b5abf8b69a P aa14caefbdaa47b09abf91881635ba96 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 4.
I20260709 12:15:18.473438 24398 leader_election.cc:304] T ed15c59b19ff49d3a39bf5b5abf8b69a P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, ad362df39b114ec3a3a419128097b362; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883
I20260709 12:15:18.474211 25476 raft_consensus.cc:2804] T ed15c59b19ff49d3a39bf5b5abf8b69a P ad362df39b114ec3a3a419128097b362 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:15:18.474773 25476 raft_consensus.cc:697] T ed15c59b19ff49d3a39bf5b5abf8b69a P ad362df39b114ec3a3a419128097b362 [term 4 LEADER]: Becoming Leader. State: Replica: ad362df39b114ec3a3a419128097b362, State: Running, Role: LEADER
I20260709 12:15:18.476078 25412 raft_consensus.cc:493] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:15:18.475767 25476 consensus_queue.cc:237] T ed15c59b19ff49d3a39bf5b5abf8b69a P ad362df39b114ec3a3a419128097b362 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:15:18.476661 25412 raft_consensus.cc:515] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:15:18.479477 24427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477aafe049fa4b1182fb0afe55fe5e55" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:15:18.480152 24427 raft_consensus.cc:2468] T 477aafe049fa4b1182fb0afe55fe5e55 P ad362df39b114ec3a3a419128097b362 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa14caefbdaa47b09abf91881635ba96 in term 3.
I20260709 12:15:18.481355 25412 leader_election.cc:290] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:15:18.483976 24323 leader_election.cc:304] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, ad362df39b114ec3a3a419128097b362; no voters: 
W20260709 12:15:18.484705 24322 leader_election.cc:336] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:15:18.486037 25412 raft_consensus.cc:2804] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:15:18.486526 25412 raft_consensus.cc:493] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:15:18.486949 25412 raft_consensus.cc:3060] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:18.492976 25412 raft_consensus.cc:515] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:15:18.496063 24427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477aafe049fa4b1182fb0afe55fe5e55" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362"
I20260709 12:15:18.496670 24427 raft_consensus.cc:3060] T 477aafe049fa4b1182fb0afe55fe5e55 P ad362df39b114ec3a3a419128097b362 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:18.500919 24103 catalog_manager.cc:5697] T ed15c59b19ff49d3a39bf5b5abf8b69a P ad362df39b114ec3a3a419128097b362 reported cstate change: term changed from 3 to 4, leader changed from 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193) to ad362df39b114ec3a3a419128097b362 (127.12.56.196). New cstate: current_term: 4 leader_uuid: "ad362df39b114ec3a3a419128097b362" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: UNKNOWN } } }
W20260709 12:15:18.507131 24322 leader_election.cc:336] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:15:18.515081 25412 leader_election.cc:290] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 4 election: Requested vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:15:18.516932 24427 raft_consensus.cc:2468] T 477aafe049fa4b1182fb0afe55fe5e55 P ad362df39b114ec3a3a419128097b362 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa14caefbdaa47b09abf91881635ba96 in term 4.
I20260709 12:15:18.528650 24323 leader_election.cc:304] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, ad362df39b114ec3a3a419128097b362; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883
I20260709 12:15:18.529526 25496 raft_consensus.cc:2804] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:15:18.530136 25496 raft_consensus.cc:697] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96 [term 4 LEADER]: Becoming Leader. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Running, Role: LEADER
I20260709 12:15:18.531054 25496 consensus_queue.cc:237] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:15:18.551102 24107 catalog_manager.cc:5697] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96 reported cstate change: term changed from 3 to 4, leader changed from 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193) to aa14caefbdaa47b09abf91881635ba96 (127.12.56.195). New cstate: current_term: 4 leader_uuid: "aa14caefbdaa47b09abf91881635ba96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:18.600059 25476 raft_consensus.cc:493] T 0d31cf2c4a7849d9a798bf886e7fc997 P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:15:18.600780 25476 raft_consensus.cc:515] T 0d31cf2c4a7849d9a798bf886e7fc997 P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:15:18.604396 25476 leader_election.cc:290] T 0d31cf2c4a7849d9a798bf886e7fc997 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
W20260709 12:15:18.608050 24396 leader_election.cc:336] T 0d31cf2c4a7849d9a798bf886e7fc997 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
W20260709 12:15:18.608937 24399 leader_election.cc:336] T 0d31cf2c4a7849d9a798bf886e7fc997 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111)
I20260709 12:15:18.609362 24399 leader_election.cc:304] T 0d31cf2c4a7849d9a798bf886e7fc997 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad362df39b114ec3a3a419128097b362; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:15:18.610046 25476 raft_consensus.cc:2749] T 0d31cf2c4a7849d9a798bf886e7fc997 P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:18.636708 25476 raft_consensus.cc:493] T 2c00f77150f7475c94c4fd29c90805cd P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:15:18.637244 25476 raft_consensus.cc:515] T 2c00f77150f7475c94c4fd29c90805cd P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:15:18.639376 25476 leader_election.cc:290] T 2c00f77150f7475c94c4fd29c90805cd P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:15:18.640018 24352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c00f77150f7475c94c4fd29c90805cd" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
W20260709 12:15:18.643743 24396 leader_election.cc:336] T 2c00f77150f7475c94c4fd29c90805cd P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:15:18.644179 24396 leader_election.cc:304] T 2c00f77150f7475c94c4fd29c90805cd P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad362df39b114ec3a3a419128097b362; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, aa14caefbdaa47b09abf91881635ba96
I20260709 12:15:18.644815 25476 raft_consensus.cc:2749] T 2c00f77150f7475c94c4fd29c90805cd P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:18.649921 25476 raft_consensus.cc:493] T 9cb931cb82d74add922e65a2ea3de34d P ad362df39b114ec3a3a419128097b362 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:15:18.650547 25476 raft_consensus.cc:515] T 9cb931cb82d74add922e65a2ea3de34d P ad362df39b114ec3a3a419128097b362 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:15:18.652935 25476 leader_election.cc:290] T 9cb931cb82d74add922e65a2ea3de34d P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
W20260709 12:15:18.657858 24396 leader_election.cc:336] T 9cb931cb82d74add922e65a2ea3de34d P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
W20260709 12:15:18.658496 24399 leader_election.cc:336] T 9cb931cb82d74add922e65a2ea3de34d P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111)
I20260709 12:15:18.658852 24399 leader_election.cc:304] T 9cb931cb82d74add922e65a2ea3de34d P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad362df39b114ec3a3a419128097b362; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:15:18.659461 25476 raft_consensus.cc:2749] T 9cb931cb82d74add922e65a2ea3de34d P ad362df39b114ec3a3a419128097b362 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:18.662938 25496 raft_consensus.cc:493] T 2c00f77150f7475c94c4fd29c90805cd P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:15:18.663576 25496 raft_consensus.cc:515] T 2c00f77150f7475c94c4fd29c90805cd P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:15:18.666743 25496 leader_election.cc:290] T 2c00f77150f7475c94c4fd29c90805cd P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:15:18.666792 24427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c00f77150f7475c94c4fd29c90805cd" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:15:18.667445 24427 raft_consensus.cc:2468] T 2c00f77150f7475c94c4fd29c90805cd P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa14caefbdaa47b09abf91881635ba96 in term 2.
I20260709 12:15:18.668464 24323 leader_election.cc:304] T 2c00f77150f7475c94c4fd29c90805cd P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, ad362df39b114ec3a3a419128097b362; no voters: 
I20260709 12:15:18.669305 25496 raft_consensus.cc:2804] T 2c00f77150f7475c94c4fd29c90805cd P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:15:18.669834 25496 raft_consensus.cc:493] T 2c00f77150f7475c94c4fd29c90805cd P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:15:18.670269 25496 raft_consensus.cc:3060] T 2c00f77150f7475c94c4fd29c90805cd P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:15:18.670892 24322 leader_election.cc:336] T 2c00f77150f7475c94c4fd29c90805cd P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:15:18.679617 25496 raft_consensus.cc:515] T 2c00f77150f7475c94c4fd29c90805cd P aa14caefbdaa47b09abf91881635ba96 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:15:18.682932 24427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c00f77150f7475c94c4fd29c90805cd" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362"
I20260709 12:15:18.683202 25496 leader_election.cc:290] T 2c00f77150f7475c94c4fd29c90805cd P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 3 election: Requested vote from peers ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467), 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787)
I20260709 12:15:18.683571 24427 raft_consensus.cc:3060] T 2c00f77150f7475c94c4fd29c90805cd P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:15:18.686867 24322 leader_election.cc:336] T 2c00f77150f7475c94c4fd29c90805cd P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:15:18.690119 24427 raft_consensus.cc:2468] T 2c00f77150f7475c94c4fd29c90805cd P ad362df39b114ec3a3a419128097b362 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa14caefbdaa47b09abf91881635ba96 in term 3.
I20260709 12:15:18.691490 24323 leader_election.cc:304] T 2c00f77150f7475c94c4fd29c90805cd P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, ad362df39b114ec3a3a419128097b362; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883
I20260709 12:15:18.692368 25496 raft_consensus.cc:2804] T 2c00f77150f7475c94c4fd29c90805cd P aa14caefbdaa47b09abf91881635ba96 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:18.692866 25496 raft_consensus.cc:697] T 2c00f77150f7475c94c4fd29c90805cd P aa14caefbdaa47b09abf91881635ba96 [term 3 LEADER]: Becoming Leader. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Running, Role: LEADER
I20260709 12:15:18.693953 25496 consensus_queue.cc:237] T 2c00f77150f7475c94c4fd29c90805cd P aa14caefbdaa47b09abf91881635ba96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } }
I20260709 12:15:18.694727 25360 raft_consensus.cc:493] T 99329004ca1c4c76a3a2dd4567ef15dd P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:15:18.695257 25360 raft_consensus.cc:515] T 99329004ca1c4c76a3a2dd4567ef15dd P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:15:18.697721 25360 leader_election.cc:290] T 99329004ca1c4c76a3a2dd4567ef15dd P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
W20260709 12:15:18.703495 24322 leader_election.cc:336] T 99329004ca1c4c76a3a2dd4567ef15dd P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
W20260709 12:15:18.704350 24325 leader_election.cc:336] T 99329004ca1c4c76a3a2dd4567ef15dd P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111)
I20260709 12:15:18.704859 24325 leader_election.cc:304] T 99329004ca1c4c76a3a2dd4567ef15dd P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:15:18.710121 25496 raft_consensus.cc:2749] T 99329004ca1c4c76a3a2dd4567ef15dd P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:18.721153 24107 catalog_manager.cc:5697] T 2c00f77150f7475c94c4fd29c90805cd P aa14caefbdaa47b09abf91881635ba96 reported cstate change: term changed from 2 to 3, leader changed from 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193) to aa14caefbdaa47b09abf91881635ba96 (127.12.56.195). New cstate: current_term: 3 leader_uuid: "aa14caefbdaa47b09abf91881635ba96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:18.758994 25496 raft_consensus.cc:493] T a18e73ef976b49f0878423c0b3e6e6f2 P aa14caefbdaa47b09abf91881635ba96 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:15:18.759881 25496 raft_consensus.cc:515] T a18e73ef976b49f0878423c0b3e6e6f2 P aa14caefbdaa47b09abf91881635ba96 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:15:18.768167 25496 leader_election.cc:290] T a18e73ef976b49f0878423c0b3e6e6f2 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
W20260709 12:15:18.772229 24322 leader_election.cc:336] T a18e73ef976b49f0878423c0b3e6e6f2 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
W20260709 12:15:18.774487 24325 leader_election.cc:336] T a18e73ef976b49f0878423c0b3e6e6f2 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111)
I20260709 12:15:18.774963 24325 leader_election.cc:304] T a18e73ef976b49f0878423c0b3e6e6f2 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:15:18.776741 25360 raft_consensus.cc:2749] T a18e73ef976b49f0878423c0b3e6e6f2 P aa14caefbdaa47b09abf91881635ba96 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:18.806187 25496 raft_consensus.cc:493] T 6d6c85f42e284b06b8d1e7cee59f3dbc P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cf2d8294ae68482ca4ffa8be051ad054)
I20260709 12:15:18.806756 25496 raft_consensus.cc:515] T 6d6c85f42e284b06b8d1e7cee59f3dbc P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:15:18.810070 25496 leader_election.cc:290] T 6d6c85f42e284b06b8d1e7cee59f3dbc P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:15:18.810312 24427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c85f42e284b06b8d1e7cee59f3dbc" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
W20260709 12:15:18.813616 24325 leader_election.cc:336] T 6d6c85f42e284b06b8d1e7cee59f3dbc P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111)
I20260709 12:15:18.814123 24325 leader_election.cc:304] T 6d6c85f42e284b06b8d1e7cee59f3dbc P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96; no voters: ad362df39b114ec3a3a419128097b362, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:15:18.814967 25496 raft_consensus.cc:2749] T 6d6c85f42e284b06b8d1e7cee59f3dbc P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:18.817718 25476 raft_consensus.cc:493] T 93ece38976574ad7a5e93a69c33c074d P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cf2d8294ae68482ca4ffa8be051ad054)
I20260709 12:15:18.818409 25476 raft_consensus.cc:515] T 93ece38976574ad7a5e93a69c33c074d P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:15:18.821293 25445 raft_consensus.cc:493] T 49b141610080476a8e5f0415c370e8cd P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cf2d8294ae68482ca4ffa8be051ad054)
I20260709 12:15:18.822175 25445 raft_consensus.cc:515] T 49b141610080476a8e5f0415c370e8cd P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:15:18.820562 25476 leader_election.cc:290] T 93ece38976574ad7a5e93a69c33c074d P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:15:18.824627 24352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93ece38976574ad7a5e93a69c33c074d" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:15:18.824821 25445 leader_election.cc:290] T 49b141610080476a8e5f0415c370e8cd P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
W20260709 12:15:18.827380 24399 leader_election.cc:336] T 93ece38976574ad7a5e93a69c33c074d P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111)
I20260709 12:15:18.827870 24399 leader_election.cc:304] T 93ece38976574ad7a5e93a69c33c074d P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad362df39b114ec3a3a419128097b362; no voters: aa14caefbdaa47b09abf91881635ba96, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:15:18.828677 25445 raft_consensus.cc:2749] T 93ece38976574ad7a5e93a69c33c074d P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:15:18.830789 24396 leader_election.cc:336] T 49b141610080476a8e5f0415c370e8cd P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
W20260709 12:15:18.831626 24399 leader_election.cc:336] T 49b141610080476a8e5f0415c370e8cd P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111)
I20260709 12:15:18.832086 24399 leader_election.cc:304] T 49b141610080476a8e5f0415c370e8cd P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad362df39b114ec3a3a419128097b362; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:15:18.832876 25445 raft_consensus.cc:2749] T 49b141610080476a8e5f0415c370e8cd P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:18.853060 25445 raft_consensus.cc:493] T 6d6c85f42e284b06b8d1e7cee59f3dbc P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cf2d8294ae68482ca4ffa8be051ad054)
I20260709 12:15:18.853763 25445 raft_consensus.cc:515] T 6d6c85f42e284b06b8d1e7cee59f3dbc P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:15:18.858793 25445 leader_election.cc:290] T 6d6c85f42e284b06b8d1e7cee59f3dbc P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
W20260709 12:15:18.862625 24399 leader_election.cc:336] T 6d6c85f42e284b06b8d1e7cee59f3dbc P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111)
I20260709 12:15:18.863117 24352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c85f42e284b06b8d1e7cee59f3dbc" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:15:18.864319 24352 raft_consensus.cc:2468] T 6d6c85f42e284b06b8d1e7cee59f3dbc P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 1.
I20260709 12:15:18.865931 24398 leader_election.cc:304] T 6d6c85f42e284b06b8d1e7cee59f3dbc P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, ad362df39b114ec3a3a419128097b362; no voters: cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:15:18.866820 25445 raft_consensus.cc:2804] T 6d6c85f42e284b06b8d1e7cee59f3dbc P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:18.867259 25445 raft_consensus.cc:493] T 6d6c85f42e284b06b8d1e7cee59f3dbc P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cf2d8294ae68482ca4ffa8be051ad054)
I20260709 12:15:18.867681 25445 raft_consensus.cc:3060] T 6d6c85f42e284b06b8d1e7cee59f3dbc P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:15:18.868219 24396 consensus_peers.cc:597] T ed15c59b19ff49d3a39bf5b5abf8b69a P ad362df39b114ec3a3a419128097b362 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:18.875581 25445 raft_consensus.cc:515] T 6d6c85f42e284b06b8d1e7cee59f3dbc P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:15:18.878942 25445 leader_election.cc:290] T 6d6c85f42e284b06b8d1e7cee59f3dbc P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 election: Requested vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:15:18.882108 24352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6c85f42e284b06b8d1e7cee59f3dbc" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
I20260709 12:15:18.882962 24352 raft_consensus.cc:3060] T 6d6c85f42e284b06b8d1e7cee59f3dbc P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:15:18.883821 24399 leader_election.cc:336] T 6d6c85f42e284b06b8d1e7cee59f3dbc P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111)
I20260709 12:15:18.888931 24352 raft_consensus.cc:2468] T 6d6c85f42e284b06b8d1e7cee59f3dbc P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 2.
I20260709 12:15:18.892133 24398 leader_election.cc:304] T 6d6c85f42e284b06b8d1e7cee59f3dbc P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, ad362df39b114ec3a3a419128097b362; no voters: cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:15:18.893587 25445 raft_consensus.cc:2804] T 6d6c85f42e284b06b8d1e7cee59f3dbc P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:18.894994 25445 raft_consensus.cc:697] T 6d6c85f42e284b06b8d1e7cee59f3dbc P ad362df39b114ec3a3a419128097b362 [term 2 LEADER]: Becoming Leader. State: Replica: ad362df39b114ec3a3a419128097b362, State: Running, Role: LEADER
I20260709 12:15:18.896929 25445 consensus_queue.cc:237] T 6d6c85f42e284b06b8d1e7cee59f3dbc P ad362df39b114ec3a3a419128097b362 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:15:18.920077 24107 catalog_manager.cc:5697] T 6d6c85f42e284b06b8d1e7cee59f3dbc P ad362df39b114ec3a3a419128097b362 reported cstate change: term changed from 1 to 2, leader changed from cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194) to ad362df39b114ec3a3a419128097b362 (127.12.56.196). New cstate: current_term: 2 leader_uuid: "ad362df39b114ec3a3a419128097b362" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:18.952508 25496 raft_consensus.cc:493] T 00b51df5a8ee448884a9f145559a5ea3 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cf2d8294ae68482ca4ffa8be051ad054)
I20260709 12:15:18.953121 25496 raft_consensus.cc:515] T 00b51df5a8ee448884a9f145559a5ea3 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:15:18.955441 25496 leader_election.cc:290] T 00b51df5a8ee448884a9f145559a5ea3 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:15:18.957952 24427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b51df5a8ee448884a9f145559a5ea3" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
W20260709 12:15:18.963106 24325 leader_election.cc:336] T 00b51df5a8ee448884a9f145559a5ea3 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111)
I20260709 12:15:18.964305 24325 leader_election.cc:304] T 00b51df5a8ee448884a9f145559a5ea3 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96; no voters: ad362df39b114ec3a3a419128097b362, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:15:18.965242 25360 raft_consensus.cc:2749] T 00b51df5a8ee448884a9f145559a5ea3 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:18.980147 25360 raft_consensus.cc:493] T 93ece38976574ad7a5e93a69c33c074d P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cf2d8294ae68482ca4ffa8be051ad054)
I20260709 12:15:18.980746 25360 raft_consensus.cc:515] T 93ece38976574ad7a5e93a69c33c074d P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:15:18.983233 25360 leader_election.cc:290] T 93ece38976574ad7a5e93a69c33c074d P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:15:18.984266 24427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93ece38976574ad7a5e93a69c33c074d" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:15:18.985000 24427 raft_consensus.cc:2468] T 93ece38976574ad7a5e93a69c33c074d P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa14caefbdaa47b09abf91881635ba96 in term 1.
I20260709 12:15:18.985997 24323 leader_election.cc:304] T 93ece38976574ad7a5e93a69c33c074d P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, ad362df39b114ec3a3a419128097b362; no voters: 
I20260709 12:15:18.986786 25360 raft_consensus.cc:2804] T 93ece38976574ad7a5e93a69c33c074d P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:18.987095 25360 raft_consensus.cc:493] T 93ece38976574ad7a5e93a69c33c074d P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cf2d8294ae68482ca4ffa8be051ad054)
I20260709 12:15:18.987370 25360 raft_consensus.cc:3060] T 93ece38976574ad7a5e93a69c33c074d P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:15:18.987828 24325 leader_election.cc:336] T 93ece38976574ad7a5e93a69c33c074d P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111)
I20260709 12:15:18.992311 25445 raft_consensus.cc:493] T 085a04f8ed724f82bc12490bbb1ceea7 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cf2d8294ae68482ca4ffa8be051ad054)
I20260709 12:15:18.992890 25445 raft_consensus.cc:515] T 085a04f8ed724f82bc12490bbb1ceea7 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:15:18.993506 25360 raft_consensus.cc:515] T 93ece38976574ad7a5e93a69c33c074d P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:15:18.996188 25360 leader_election.cc:290] T 93ece38976574ad7a5e93a69c33c074d P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 election: Requested vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:15:18.996469 24427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93ece38976574ad7a5e93a69c33c074d" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362"
I20260709 12:15:18.996778 25445 leader_election.cc:290] T 085a04f8ed724f82bc12490bbb1ceea7 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:15:18.997124 24427 raft_consensus.cc:3060] T 93ece38976574ad7a5e93a69c33c074d P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:15:19.003641 24399 leader_election.cc:336] T 085a04f8ed724f82bc12490bbb1ceea7 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111)
I20260709 12:15:19.005086 24427 raft_consensus.cc:2468] T 93ece38976574ad7a5e93a69c33c074d P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa14caefbdaa47b09abf91881635ba96 in term 2.
W20260709 12:15:19.006075 24325 leader_election.cc:336] T 93ece38976574ad7a5e93a69c33c074d P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111)
I20260709 12:15:19.006699 24323 leader_election.cc:304] T 93ece38976574ad7a5e93a69c33c074d P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, ad362df39b114ec3a3a419128097b362; no voters: cf2d8294ae68482ca4ffa8be051ad054
W20260709 12:15:19.007238 24396 leader_election.cc:336] T 085a04f8ed724f82bc12490bbb1ceea7 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:15:19.007514 25360 raft_consensus.cc:2804] T 93ece38976574ad7a5e93a69c33c074d P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:19.007694 24396 leader_election.cc:304] T 085a04f8ed724f82bc12490bbb1ceea7 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad362df39b114ec3a3a419128097b362; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:15:19.008215 25360 raft_consensus.cc:697] T 93ece38976574ad7a5e93a69c33c074d P aa14caefbdaa47b09abf91881635ba96 [term 2 LEADER]: Becoming Leader. State: Replica: aa14caefbdaa47b09abf91881635ba96, State: Running, Role: LEADER
I20260709 12:15:19.008366 25445 raft_consensus.cc:2749] T 085a04f8ed724f82bc12490bbb1ceea7 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:19.009203 25360 consensus_queue.cc:237] T 93ece38976574ad7a5e93a69c33c074d P aa14caefbdaa47b09abf91881635ba96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:15:19.019479 25360 raft_consensus.cc:493] T bfba40ac52f842ca99dd4293619360af P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cf2d8294ae68482ca4ffa8be051ad054)
I20260709 12:15:19.020085 25360 raft_consensus.cc:515] T bfba40ac52f842ca99dd4293619360af P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:15:19.022444 25360 leader_election.cc:290] T bfba40ac52f842ca99dd4293619360af P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
W20260709 12:15:19.027832 24322 leader_election.cc:336] T bfba40ac52f842ca99dd4293619360af P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:15:19.029686 24352 raft_consensus.cc:1275] T ed15c59b19ff49d3a39bf5b5abf8b69a P aa14caefbdaa47b09abf91881635ba96 [term 4 FOLLOWER]: Refusing update from remote peer ad362df39b114ec3a3a419128097b362: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:15:19.029723 24325 leader_election.cc:336] T bfba40ac52f842ca99dd4293619360af P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111)
I20260709 12:15:19.030511 24325 leader_election.cc:304] T bfba40ac52f842ca99dd4293619360af P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:15:19.030093 24107 catalog_manager.cc:5697] T 93ece38976574ad7a5e93a69c33c074d P aa14caefbdaa47b09abf91881635ba96 reported cstate change: term changed from 1 to 2, leader changed from cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194) to aa14caefbdaa47b09abf91881635ba96 (127.12.56.195). New cstate: current_term: 2 leader_uuid: "aa14caefbdaa47b09abf91881635ba96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:19.031597 25360 raft_consensus.cc:2749] T bfba40ac52f842ca99dd4293619360af P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:19.032173 25445 consensus_queue.cc:1048] T ed15c59b19ff49d3a39bf5b5abf8b69a P ad362df39b114ec3a3a419128097b362 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:15:19.057713 12515 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 24306)
I20260709 12:15:19.065054 25445 raft_consensus.cc:493] T 00b51df5a8ee448884a9f145559a5ea3 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cf2d8294ae68482ca4ffa8be051ad054)
I20260709 12:15:19.065749 25445 raft_consensus.cc:515] T 00b51df5a8ee448884a9f145559a5ea3 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:15:19.069669 24427 raft_consensus.cc:1275] T 477aafe049fa4b1182fb0afe55fe5e55 P ad362df39b114ec3a3a419128097b362 [term 4 FOLLOWER]: Refusing update from remote peer aa14caefbdaa47b09abf91881635ba96: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:15:19.071556 25496 consensus_queue.cc:1048] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:15:19.073253 24399 leader_election.cc:336] T 00b51df5a8ee448884a9f145559a5ea3 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111)
I20260709 12:15:19.077035 25445 leader_election.cc:290] T 00b51df5a8ee448884a9f145559a5ea3 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:15:19.087203 24352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b51df5a8ee448884a9f145559a5ea3" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:15:19.088078 24352 raft_consensus.cc:2468] T 00b51df5a8ee448884a9f145559a5ea3 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 1.
I20260709 12:15:19.090886 24398 leader_election.cc:304] T 00b51df5a8ee448884a9f145559a5ea3 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, ad362df39b114ec3a3a419128097b362; no voters: cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:15:19.092402 25445 raft_consensus.cc:2804] T 00b51df5a8ee448884a9f145559a5ea3 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:19.092883 25445 raft_consensus.cc:493] T 00b51df5a8ee448884a9f145559a5ea3 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cf2d8294ae68482ca4ffa8be051ad054)
I20260709 12:15:19.093340 25445 raft_consensus.cc:3060] T 00b51df5a8ee448884a9f145559a5ea3 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:19.104058 25412 raft_consensus.cc:493] T b1e1c3b597fd49b2831e5f523149b2dc P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cf2d8294ae68482ca4ffa8be051ad054)
I20260709 12:15:19.104883 25412 raft_consensus.cc:515] T b1e1c3b597fd49b2831e5f523149b2dc P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:15:19.110991 25412 leader_election.cc:290] T b1e1c3b597fd49b2831e5f523149b2dc P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:15:19.112428 25445 raft_consensus.cc:515] T 00b51df5a8ee448884a9f145559a5ea3 P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
W20260709 12:15:19.133904 24399 leader_election.cc:336] T 00b51df5a8ee448884a9f145559a5ea3 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111)
I20260709 12:15:19.135805 25526 raft_consensus.cc:493] T e15e9b81515343958a00ba6f2f291860 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cf2d8294ae68482ca4ffa8be051ad054)
I20260709 12:15:19.136512 25526 raft_consensus.cc:515] T e15e9b81515343958a00ba6f2f291860 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:15:19.117578 25360 raft_consensus.cc:493] T 558ced611e584b32ab838cceeb7cb410 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cf2d8294ae68482ca4ffa8be051ad054)
I20260709 12:15:19.137681 25360 raft_consensus.cc:515] T 558ced611e584b32ab838cceeb7cb410 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
W20260709 12:15:19.138594 24322 leader_election.cc:336] T b1e1c3b597fd49b2831e5f523149b2dc P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:15:19.138932 25526 leader_election.cc:290] T e15e9b81515343958a00ba6f2f291860 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
W20260709 12:15:19.140048 24325 leader_election.cc:336] T b1e1c3b597fd49b2831e5f523149b2dc P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111)
I20260709 12:15:19.141628 25360 leader_election.cc:290] T 558ced611e584b32ab838cceeb7cb410 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:15:19.141713 24325 leader_election.cc:304] T b1e1c3b597fd49b2831e5f523149b2dc P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:15:19.144238 25360 raft_consensus.cc:2749] T b1e1c3b597fd49b2831e5f523149b2dc P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:19.141822 25445 leader_election.cc:290] T 00b51df5a8ee448884a9f145559a5ea3 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 election: Requested vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:15:19.149760 24429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e15e9b81515343958a00ba6f2f291860" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
I20260709 12:15:19.166760 25496 raft_consensus.cc:493] T 3fe3be6bb3264475ba597fec30a06f6c P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cf2d8294ae68482ca4ffa8be051ad054)
I20260709 12:15:19.167447 25496 raft_consensus.cc:515] T 3fe3be6bb3264475ba597fec30a06f6c P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:15:19.180578 25445 raft_consensus.cc:493] T 67c0216443004287861015dd30ae5144 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cf2d8294ae68482ca4ffa8be051ad054)
I20260709 12:15:19.181229 24427 raft_consensus.cc:1275] T 2c00f77150f7475c94c4fd29c90805cd P ad362df39b114ec3a3a419128097b362 [term 3 FOLLOWER]: Refusing update from remote peer aa14caefbdaa47b09abf91881635ba96: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:19.181354 25445 raft_consensus.cc:515] T 67c0216443004287861015dd30ae5144 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:15:19.183902 25445 leader_election.cc:290] T 67c0216443004287861015dd30ae5144 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:15:19.185413 25496 leader_election.cc:290] T 3fe3be6bb3264475ba597fec30a06f6c P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
W20260709 12:15:19.188521 24396 leader_election.cc:336] T 67c0216443004287861015dd30ae5144 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:15:19.188297 25526 consensus_queue.cc:1048] T 2c00f77150f7475c94c4fd29c90805cd P aa14caefbdaa47b09abf91881635ba96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:15:19.189198 25445 raft_consensus.cc:493] T f9094185a2ad43d0b3a5174b165dab65 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cf2d8294ae68482ca4ffa8be051ad054)
I20260709 12:15:19.189826 25445 raft_consensus.cc:515] T f9094185a2ad43d0b3a5174b165dab65 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
W20260709 12:15:19.192448 24399 leader_election.cc:336] T 67c0216443004287861015dd30ae5144 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111)
I20260709 12:15:19.193053 24399 leader_election.cc:304] T 67c0216443004287861015dd30ae5144 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad362df39b114ec3a3a419128097b362; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:15:19.195444 25497 raft_consensus.cc:2749] T 67c0216443004287861015dd30ae5144 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:15:19.198472 24396 leader_election.cc:336] T f9094185a2ad43d0b3a5174b165dab65 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:15:19.199729 25445 leader_election.cc:290] T f9094185a2ad43d0b3a5174b165dab65 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
W20260709 12:15:19.208354 24399 leader_election.cc:336] T f9094185a2ad43d0b3a5174b165dab65 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111)
I20260709 12:15:19.208824 24399 leader_election.cc:304] T f9094185a2ad43d0b3a5174b165dab65 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad362df39b114ec3a3a419128097b362; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:15:19.209506 25497 raft_consensus.cc:2749] T f9094185a2ad43d0b3a5174b165dab65 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:19.219190 24352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b51df5a8ee448884a9f145559a5ea3" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
I20260709 12:15:19.219864 24352 raft_consensus.cc:3060] T 00b51df5a8ee448884a9f145559a5ea3 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:19.225606 24352 raft_consensus.cc:2468] T 00b51df5a8ee448884a9f145559a5ea3 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 2.
W20260709 12:15:19.226552 24322 leader_election.cc:336] T 558ced611e584b32ab838cceeb7cb410 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:15:19.231212 24398 leader_election.cc:304] T 00b51df5a8ee448884a9f145559a5ea3 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, ad362df39b114ec3a3a419128097b362; no voters: cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:15:19.232555 25497 raft_consensus.cc:2804] T 00b51df5a8ee448884a9f145559a5ea3 P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:19.233090 25497 raft_consensus.cc:697] T 00b51df5a8ee448884a9f145559a5ea3 P ad362df39b114ec3a3a419128097b362 [term 2 LEADER]: Becoming Leader. State: Replica: ad362df39b114ec3a3a419128097b362, State: Running, Role: LEADER
I20260709 12:15:19.233990 25497 consensus_queue.cc:237] T 00b51df5a8ee448884a9f145559a5ea3 P ad362df39b114ec3a3a419128097b362 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
W20260709 12:15:19.239687 24325 leader_election.cc:336] T e15e9b81515343958a00ba6f2f291860 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111)
I20260709 12:15:19.240890 24325 leader_election.cc:304] T e15e9b81515343958a00ba6f2f291860 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96; no voters: ad362df39b114ec3a3a419128097b362, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:15:19.241717 25360 raft_consensus.cc:2749] T e15e9b81515343958a00ba6f2f291860 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:15:19.242900 24325 leader_election.cc:336] T 558ced611e584b32ab838cceeb7cb410 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111)
I20260709 12:15:19.243381 24325 leader_election.cc:304] T 558ced611e584b32ab838cceeb7cb410 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:15:19.244135 25360 raft_consensus.cc:2749] T 558ced611e584b32ab838cceeb7cb410 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:15:19.249588 24322 consensus_peers.cc:597] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:19.250159 24325 leader_election.cc:336] T 3fe3be6bb3264475ba597fec30a06f6c P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111)
W20260709 12:15:19.250620 24322 consensus_peers.cc:597] T 2c00f77150f7475c94c4fd29c90805cd P aa14caefbdaa47b09abf91881635ba96 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:19.251358 24322 leader_election.cc:336] T 3fe3be6bb3264475ba597fec30a06f6c P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:15:19.251775 24322 leader_election.cc:304] T 3fe3be6bb3264475ba597fec30a06f6c P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:15:19.252422 25360 raft_consensus.cc:2749] T 3fe3be6bb3264475ba597fec30a06f6c P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:19.259471 25360 raft_consensus.cc:493] T 3e977ea0483d4c029394b273e7c4e90f P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cf2d8294ae68482ca4ffa8be051ad054)
I20260709 12:15:19.260063 25360 raft_consensus.cc:515] T 3e977ea0483d4c029394b273e7c4e90f P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:15:19.260037 24103 catalog_manager.cc:5697] T 00b51df5a8ee448884a9f145559a5ea3 P ad362df39b114ec3a3a419128097b362 reported cstate change: term changed from 1 to 2, leader changed from cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194) to ad362df39b114ec3a3a419128097b362 (127.12.56.196). New cstate: current_term: 2 leader_uuid: "ad362df39b114ec3a3a419128097b362" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:19.263168 25360 leader_election.cc:290] T 3e977ea0483d4c029394b273e7c4e90f P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), ad362df39b114ec3a3a419128097b362 (127.12.56.196:46467)
I20260709 12:15:19.264065 24427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e977ea0483d4c029394b273e7c4e90f" candidate_uuid: "aa14caefbdaa47b09abf91881635ba96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad362df39b114ec3a3a419128097b362" is_pre_election: true
W20260709 12:15:19.268522 24325 leader_election.cc:336] T 3e977ea0483d4c029394b273e7c4e90f P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111)
I20260709 12:15:19.269119 24325 leader_election.cc:304] T 3e977ea0483d4c029394b273e7c4e90f P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96; no voters: ad362df39b114ec3a3a419128097b362, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:15:19.270009 25360 raft_consensus.cc:2749] T 3e977ea0483d4c029394b273e7c4e90f P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:19.279829 25497 raft_consensus.cc:493] T e15e9b81515343958a00ba6f2f291860 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cf2d8294ae68482ca4ffa8be051ad054)
I20260709 12:15:19.280578 25497 raft_consensus.cc:515] T e15e9b81515343958a00ba6f2f291860 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:15:19.284097 25497 leader_election.cc:290] T e15e9b81515343958a00ba6f2f291860 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:15:19.285790 24359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e15e9b81515343958a00ba6f2f291860" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:15:19.286715 24359 raft_consensus.cc:2468] T e15e9b81515343958a00ba6f2f291860 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 1.
I20260709 12:15:19.287843 24398 leader_election.cc:304] T e15e9b81515343958a00ba6f2f291860 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, ad362df39b114ec3a3a419128097b362; no voters: 
I20260709 12:15:19.289284 25497 raft_consensus.cc:2804] T e15e9b81515343958a00ba6f2f291860 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:19.289728 25497 raft_consensus.cc:493] T e15e9b81515343958a00ba6f2f291860 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cf2d8294ae68482ca4ffa8be051ad054)
I20260709 12:15:19.290153 25497 raft_consensus.cc:3060] T e15e9b81515343958a00ba6f2f291860 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:15:19.293162 24399 leader_election.cc:336] T e15e9b81515343958a00ba6f2f291860 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111)
I20260709 12:15:19.299552 25497 raft_consensus.cc:515] T e15e9b81515343958a00ba6f2f291860 P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:15:19.302145 25497 leader_election.cc:290] T e15e9b81515343958a00ba6f2f291860 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 election: Requested vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:15:19.303426 24359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e15e9b81515343958a00ba6f2f291860" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
I20260709 12:15:19.304152 24359 raft_consensus.cc:3060] T e15e9b81515343958a00ba6f2f291860 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:15:19.305977 24399 leader_election.cc:336] T e15e9b81515343958a00ba6f2f291860 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111)
I20260709 12:15:19.312570 24359 raft_consensus.cc:2468] T e15e9b81515343958a00ba6f2f291860 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 2.
I20260709 12:15:19.313978 24398 leader_election.cc:304] T e15e9b81515343958a00ba6f2f291860 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, ad362df39b114ec3a3a419128097b362; no voters: cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:15:19.314755 25497 raft_consensus.cc:2804] T e15e9b81515343958a00ba6f2f291860 P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:19.315377 25497 raft_consensus.cc:697] T e15e9b81515343958a00ba6f2f291860 P ad362df39b114ec3a3a419128097b362 [term 2 LEADER]: Becoming Leader. State: Replica: ad362df39b114ec3a3a419128097b362, State: Running, Role: LEADER
I20260709 12:15:19.316316 25497 consensus_queue.cc:237] T e15e9b81515343958a00ba6f2f291860 P ad362df39b114ec3a3a419128097b362 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:15:19.324041 25445 raft_consensus.cc:493] T 3e977ea0483d4c029394b273e7c4e90f P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cf2d8294ae68482ca4ffa8be051ad054)
I20260709 12:15:19.324545 25445 raft_consensus.cc:515] T 3e977ea0483d4c029394b273e7c4e90f P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:15:19.326505 25445 leader_election.cc:290] T 3e977ea0483d4c029394b273e7c4e90f P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
W20260709 12:15:19.328097 24396 consensus_peers.cc:597] T d92a635ff6404268bd5e51d3b9681551 P ad362df39b114ec3a3a419128097b362 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:19.331027 24359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e977ea0483d4c029394b273e7c4e90f" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96" is_pre_election: true
I20260709 12:15:19.331987 24359 raft_consensus.cc:2468] T 3e977ea0483d4c029394b273e7c4e90f P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 1.
I20260709 12:15:19.332216 24103 catalog_manager.cc:5697] T e15e9b81515343958a00ba6f2f291860 P ad362df39b114ec3a3a419128097b362 reported cstate change: term changed from 1 to 2, leader changed from cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194) to ad362df39b114ec3a3a419128097b362 (127.12.56.196). New cstate: current_term: 2 leader_uuid: "ad362df39b114ec3a3a419128097b362" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: HEALTHY } } }
W20260709 12:15:19.334120 24399 leader_election.cc:336] T 3e977ea0483d4c029394b273e7c4e90f P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111)
I20260709 12:15:19.334798 24398 leader_election.cc:304] T 3e977ea0483d4c029394b273e7c4e90f P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, ad362df39b114ec3a3a419128097b362; no voters: cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:15:19.335651 25445 raft_consensus.cc:2804] T 3e977ea0483d4c029394b273e7c4e90f P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:19.336028 25445 raft_consensus.cc:493] T 3e977ea0483d4c029394b273e7c4e90f P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cf2d8294ae68482ca4ffa8be051ad054)
I20260709 12:15:19.336397 25445 raft_consensus.cc:3060] T 3e977ea0483d4c029394b273e7c4e90f P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:19.343765 25445 raft_consensus.cc:515] T 3e977ea0483d4c029394b273e7c4e90f P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
I20260709 12:15:19.347060 24359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e977ea0483d4c029394b273e7c4e90f" candidate_uuid: "ad362df39b114ec3a3a419128097b362" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa14caefbdaa47b09abf91881635ba96"
I20260709 12:15:19.347921 25445 leader_election.cc:290] T 3e977ea0483d4c029394b273e7c4e90f P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 election: Requested vote from peers cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565), aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845)
I20260709 12:15:19.348799 24359 raft_consensus.cc:3060] T 3e977ea0483d4c029394b273e7c4e90f P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:19.353686 25360 raft_consensus.cc:493] T 5310371490a542269db28e29d7adfffa P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cf2d8294ae68482ca4ffa8be051ad054)
I20260709 12:15:19.354358 25360 raft_consensus.cc:515] T 5310371490a542269db28e29d7adfffa P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:15:19.359229 24359 raft_consensus.cc:2468] T 3e977ea0483d4c029394b273e7c4e90f P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad362df39b114ec3a3a419128097b362 in term 2.
W20260709 12:15:19.362435 24399 leader_election.cc:336] T 3e977ea0483d4c029394b273e7c4e90f P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111)
I20260709 12:15:19.363854 25360 leader_election.cc:290] T 5310371490a542269db28e29d7adfffa P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
W20260709 12:15:19.367087 24322 leader_election.cc:336] T 5310371490a542269db28e29d7adfffa P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:15:19.367620 24398 leader_election.cc:304] T 3e977ea0483d4c029394b273e7c4e90f P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96, ad362df39b114ec3a3a419128097b362; no voters: cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:15:19.368963 25497 raft_consensus.cc:2804] T 3e977ea0483d4c029394b273e7c4e90f P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:19.369488 25497 raft_consensus.cc:697] T 3e977ea0483d4c029394b273e7c4e90f P ad362df39b114ec3a3a419128097b362 [term 2 LEADER]: Becoming Leader. State: Replica: ad362df39b114ec3a3a419128097b362, State: Running, Role: LEADER
I20260709 12:15:19.371803 25497 consensus_queue.cc:237] T 3e977ea0483d4c029394b273e7c4e90f P ad362df39b114ec3a3a419128097b362 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } }
W20260709 12:15:19.373505 24325 leader_election.cc:336] T 5310371490a542269db28e29d7adfffa P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111)
I20260709 12:15:19.374037 24325 leader_election.cc:304] T 5310371490a542269db28e29d7adfffa P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:15:19.374855 25360 raft_consensus.cc:2749] T 5310371490a542269db28e29d7adfffa P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:19.378659 25497 raft_consensus.cc:493] T 06d0284e94354a2686c577372cceb2bc P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cf2d8294ae68482ca4ffa8be051ad054)
I20260709 12:15:19.379431 25497 raft_consensus.cc:515] T 06d0284e94354a2686c577372cceb2bc P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
W20260709 12:15:19.383163 24322 consensus_peers.cc:597] T 4b1c850a65b748c093c5c88aa94fed71 P aa14caefbdaa47b09abf91881635ba96 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:19.384404 25497 leader_election.cc:290] T 06d0284e94354a2686c577372cceb2bc P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:15:19.386492 24103 catalog_manager.cc:5697] T 3e977ea0483d4c029394b273e7c4e90f P ad362df39b114ec3a3a419128097b362 reported cstate change: term changed from 1 to 2, leader changed from cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194) to ad362df39b114ec3a3a419128097b362 (127.12.56.196). New cstate: current_term: 2 leader_uuid: "ad362df39b114ec3a3a419128097b362" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } health_report { overall_health: HEALTHY } } }
W20260709 12:15:19.390552 24399 leader_election.cc:336] T 06d0284e94354a2686c577372cceb2bc P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111)
W20260709 12:15:19.391214 24396 leader_election.cc:336] T 06d0284e94354a2686c577372cceb2bc P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:15:19.391677 24396 leader_election.cc:304] T 06d0284e94354a2686c577372cceb2bc P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad362df39b114ec3a3a419128097b362; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:15:19.393944 25497 raft_consensus.cc:2749] T 06d0284e94354a2686c577372cceb2bc P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:15:19.402338 24396 consensus_peers.cc:597] T 4f756e6bcc20458b8748cd090cd3fce2 P ad362df39b114ec3a3a419128097b362 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:19.407622 24322 consensus_peers.cc:597] T b98a35cf96ba4562b4933543b1e4efb9 P aa14caefbdaa47b09abf91881635ba96 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:19.419983 24396 consensus_peers.cc:597] T 7d2a60078de84a53aedeb20cdcd211a4 P ad362df39b114ec3a3a419128097b362 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:19.445197 24325 consensus_peers.cc:597] T 93ece38976574ad7a5e93a69c33c074d P aa14caefbdaa47b09abf91881635ba96 -> Peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Couldn't send request to peer cf2d8294ae68482ca4ffa8be051ad054. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:19.456696 24359 raft_consensus.cc:1275] T 6d6c85f42e284b06b8d1e7cee59f3dbc P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Refusing update from remote peer ad362df39b114ec3a3a419128097b362: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:19.458240 25524 consensus_queue.cc:1048] T 6d6c85f42e284b06b8d1e7cee59f3dbc P ad362df39b114ec3a3a419128097b362 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:15:19.475283 24396 consensus_peers.cc:597] T e05eec364f764114bdb814096b9bf0ce P ad362df39b114ec3a3a419128097b362 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:19.486521 24399 consensus_peers.cc:597] T 6d6c85f42e284b06b8d1e7cee59f3dbc P ad362df39b114ec3a3a419128097b362 -> Peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Couldn't send request to peer cf2d8294ae68482ca4ffa8be051ad054. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:19.549429 24396 consensus_peers.cc:597] T 95d3180f4ab5472d9de6e220219e7898 P ad362df39b114ec3a3a419128097b362 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:19.572105 24427 raft_consensus.cc:1275] T 93ece38976574ad7a5e93a69c33c074d P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Refusing update from remote peer aa14caefbdaa47b09abf91881635ba96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:19.573714 25360 consensus_queue.cc:1048] T 93ece38976574ad7a5e93a69c33c074d P aa14caefbdaa47b09abf91881635ba96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:15:19.686841 24396 consensus_peers.cc:597] T fd6e20f3c92f4498a8c272b807797efa P ad362df39b114ec3a3a419128097b362 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:19.693401 24399 consensus_peers.cc:597] T 00b51df5a8ee448884a9f145559a5ea3 P ad362df39b114ec3a3a419128097b362 -> Peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Couldn't send request to peer cf2d8294ae68482ca4ffa8be051ad054. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:19.704090 24396 consensus_peers.cc:597] T 8996365fa46548d49f3b3bafe14e9c83 P ad362df39b114ec3a3a419128097b362 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:19.757742 24322 consensus_peers.cc:597] T 27de4156b2e24143a2f301fbefc7cb23 P aa14caefbdaa47b09abf91881635ba96 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:19.772006 24399 consensus_peers.cc:597] T e15e9b81515343958a00ba6f2f291860 P ad362df39b114ec3a3a419128097b362 -> Peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Couldn't send request to peer cf2d8294ae68482ca4ffa8be051ad054. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:19.777486 24322 consensus_peers.cc:597] T ba38e800dd034ff8b7fda6701973510b P aa14caefbdaa47b09abf91881635ba96 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:19.795796 24359 raft_consensus.cc:1275] T 00b51df5a8ee448884a9f145559a5ea3 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Refusing update from remote peer ad362df39b114ec3a3a419128097b362: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:19.798452 25445 consensus_queue.cc:1048] T 00b51df5a8ee448884a9f145559a5ea3 P ad362df39b114ec3a3a419128097b362 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:19.804044 24352 raft_consensus.cc:1275] T 3e977ea0483d4c029394b273e7c4e90f P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Refusing update from remote peer ad362df39b114ec3a3a419128097b362: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:19.805843 25476 consensus_queue.cc:1048] T 3e977ea0483d4c029394b273e7c4e90f P ad362df39b114ec3a3a419128097b362 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:15:19.815917 24396 consensus_peers.cc:597] T d10519ad64d948b09186e335ed06257d P ad362df39b114ec3a3a419128097b362 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:19.864493 24399 consensus_peers.cc:597] T 3e977ea0483d4c029394b273e7c4e90f P ad362df39b114ec3a3a419128097b362 -> Peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Couldn't send request to peer cf2d8294ae68482ca4ffa8be051ad054. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:19.870191 24396 consensus_peers.cc:597] T b727e95d8f5843a3bb0d7cbddce61bdb P ad362df39b114ec3a3a419128097b362 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:19.872201 24322 consensus_peers.cc:597] T fa882381d669422a95ec60c9aefa8105 P aa14caefbdaa47b09abf91881635ba96 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:19.904603 25524 raft_consensus.cc:493] T c75afe0e0e00446aa6d220941d288eab P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
W20260709 12:15:19.906169 24322 consensus_peers.cc:597] T cf280984dcfc44039a942819e8df951c P aa14caefbdaa47b09abf91881635ba96 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:19.910319 24358 raft_consensus.cc:1275] T e15e9b81515343958a00ba6f2f291860 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Refusing update from remote peer ad362df39b114ec3a3a419128097b362: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:19.912148 25524 raft_consensus.cc:515] T c75afe0e0e00446aa6d220941d288eab P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:15:19.918037 25524 leader_election.cc:290] T c75afe0e0e00446aa6d220941d288eab P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
W20260709 12:15:19.924762 24396 leader_election.cc:336] T c75afe0e0e00446aa6d220941d288eab P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:15:19.929153 25476 consensus_queue.cc:1048] T e15e9b81515343958a00ba6f2f291860 P ad362df39b114ec3a3a419128097b362 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:15:19.930790 24399 leader_election.cc:336] T c75afe0e0e00446aa6d220941d288eab P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111)
I20260709 12:15:19.932325 24399 leader_election.cc:304] T c75afe0e0e00446aa6d220941d288eab P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad362df39b114ec3a3a419128097b362; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:15:19.928593 25360 raft_consensus.cc:493] T f841b9f0e82748d399b5eef243c442fc P aa14caefbdaa47b09abf91881635ba96 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:15:19.933634 25360 raft_consensus.cc:515] T f841b9f0e82748d399b5eef243c442fc P aa14caefbdaa47b09abf91881635ba96 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:15:19.934536 25445 raft_consensus.cc:2749] T c75afe0e0e00446aa6d220941d288eab P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:19.942070 25360 leader_election.cc:290] T f841b9f0e82748d399b5eef243c442fc P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
W20260709 12:15:19.948501 24325 leader_election.cc:336] T f841b9f0e82748d399b5eef243c442fc P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111)
W20260709 12:15:19.950640 24322 leader_election.cc:336] T f841b9f0e82748d399b5eef243c442fc P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:15:19.951112 24322 leader_election.cc:304] T f841b9f0e82748d399b5eef243c442fc P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:15:19.955374 25360 raft_consensus.cc:2749] T f841b9f0e82748d399b5eef243c442fc P aa14caefbdaa47b09abf91881635ba96 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:15:19.965616 24396 consensus_peers.cc:597] T 7cbef09353144c0b9a9ebf7731fd019f P ad362df39b114ec3a3a419128097b362 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:19.979422 25476 raft_consensus.cc:493] T 318c217e16874865bd6dff6bd4d8cd4f P ad362df39b114ec3a3a419128097b362 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:15:19.980181 25476 raft_consensus.cc:515] T 318c217e16874865bd6dff6bd4d8cd4f P ad362df39b114ec3a3a419128097b362 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:15:19.986737 25476 leader_election.cc:290] T 318c217e16874865bd6dff6bd4d8cd4f P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
W20260709 12:15:19.991297 24399 consensus_peers.cc:597] T dbace6d282ab498283858033606494ae P ad362df39b114ec3a3a419128097b362 -> Peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Couldn't send request to peer cf2d8294ae68482ca4ffa8be051ad054. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:19.994773 24396 leader_election.cc:336] T 318c217e16874865bd6dff6bd4d8cd4f P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
W20260709 12:15:19.996984 24399 leader_election.cc:336] T 318c217e16874865bd6dff6bd4d8cd4f P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111)
I20260709 12:15:19.997495 24399 leader_election.cc:304] T 318c217e16874865bd6dff6bd4d8cd4f P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad362df39b114ec3a3a419128097b362; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:15:19.998365 25445 raft_consensus.cc:2749] T 318c217e16874865bd6dff6bd4d8cd4f P ad362df39b114ec3a3a419128097b362 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:15:20.003643 24396 consensus_peers.cc:597] T 6af96d3f7393445f8b7edb30a26a6f65 P ad362df39b114ec3a3a419128097b362 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:20.022842 24325 consensus_peers.cc:597] T 9c40e590be9d4c3eac0ddd7f96278894 P aa14caefbdaa47b09abf91881635ba96 -> Peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Couldn't send request to peer cf2d8294ae68482ca4ffa8be051ad054. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:20.056344 24322 consensus_peers.cc:597] T 7943c68d21d449dba2d1dca6ddde5820 P aa14caefbdaa47b09abf91881635ba96 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:20.058645 12515 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 24306)
W20260709 12:15:20.103257 24325 consensus_peers.cc:597] T d84ed08271a24f7fa134ae81a858c314 P aa14caefbdaa47b09abf91881635ba96 -> Peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Couldn't send request to peer cf2d8294ae68482ca4ffa8be051ad054. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:20.106706 24396 consensus_peers.cc:597] T 9219abaaa2c34b08a24191512ff742bc P ad362df39b114ec3a3a419128097b362 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:20.178040 24325 consensus_peers.cc:597] T b98a35cf96ba4562b4933543b1e4efb9 P aa14caefbdaa47b09abf91881635ba96 -> Peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Couldn't send request to peer cf2d8294ae68482ca4ffa8be051ad054. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:20.188230 24322 consensus_peers.cc:597] T 464c7ebd16cd488086ccaec23defbb33 P aa14caefbdaa47b09abf91881635ba96 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:20.200874 24322 consensus_peers.cc:597] T 133e492e820f4152ad30562c343b617d P aa14caefbdaa47b09abf91881635ba96 -> Peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Couldn't send request to peer 9bf3da5b54ef4a1ea1cee60f02ea2883. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:20.221689 24399 consensus_peers.cc:597] T 95d3180f4ab5472d9de6e220219e7898 P ad362df39b114ec3a3a419128097b362 -> Peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Couldn't send request to peer cf2d8294ae68482ca4ffa8be051ad054. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:20.231686 24399 consensus_peers.cc:597] T 7d2a60078de84a53aedeb20cdcd211a4 P ad362df39b114ec3a3a419128097b362 -> Peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Couldn't send request to peer cf2d8294ae68482ca4ffa8be051ad054. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:20.243654 24325 consensus_peers.cc:597] T 27de4156b2e24143a2f301fbefc7cb23 P aa14caefbdaa47b09abf91881635ba96 -> Peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Couldn't send request to peer cf2d8294ae68482ca4ffa8be051ad054. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:20.253086 25527 raft_consensus.cc:493] T ab8dff607862460ea0fcd88422c31ac2 P aa14caefbdaa47b09abf91881635ba96 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:15:20.253994 25527 raft_consensus.cc:515] T ab8dff607862460ea0fcd88422c31ac2 P aa14caefbdaa47b09abf91881635ba96 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:15:20.261508 25527 leader_election.cc:290] T ab8dff607862460ea0fcd88422c31ac2 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
W20260709 12:15:20.266335 24322 leader_election.cc:336] T ab8dff607862460ea0fcd88422c31ac2 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
W20260709 12:15:20.267269 24325 leader_election.cc:336] T ab8dff607862460ea0fcd88422c31ac2 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111)
I20260709 12:15:20.267709 24325 leader_election.cc:304] T ab8dff607862460ea0fcd88422c31ac2 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:15:20.268548 25527 raft_consensus.cc:2749] T ab8dff607862460ea0fcd88422c31ac2 P aa14caefbdaa47b09abf91881635ba96 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:15:20.308133 24325 consensus_peers.cc:597] T e24b175869274d33ade73761b6f23ca4 P aa14caefbdaa47b09abf91881635ba96 -> Peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Couldn't send request to peer cf2d8294ae68482ca4ffa8be051ad054. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:20.310240 24325 consensus_peers.cc:597] T 7943c68d21d449dba2d1dca6ddde5820 P aa14caefbdaa47b09abf91881635ba96 -> Peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Couldn't send request to peer cf2d8294ae68482ca4ffa8be051ad054. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:20.348320 25527 raft_consensus.cc:493] T 628105dfc534451285d72f9e17f5d4f3 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:15:20.348599 25526 raft_consensus.cc:493] T 99329004ca1c4c76a3a2dd4567ef15dd P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:15:20.349125 25527 raft_consensus.cc:515] T 628105dfc534451285d72f9e17f5d4f3 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:15:20.349373 25526 raft_consensus.cc:515] T 99329004ca1c4c76a3a2dd4567ef15dd P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:15:20.351709 25526 leader_election.cc:290] T 99329004ca1c4c76a3a2dd4567ef15dd P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:15:20.351753 25527 leader_election.cc:290] T 628105dfc534451285d72f9e17f5d4f3 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
W20260709 12:15:20.357714 24399 consensus_peers.cc:597] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P ad362df39b114ec3a3a419128097b362 -> Peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Couldn't send request to peer cf2d8294ae68482ca4ffa8be051ad054. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:20.357702 24325 leader_election.cc:336] T 99329004ca1c4c76a3a2dd4567ef15dd P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111)
W20260709 12:15:20.358966 24325 leader_election.cc:336] T 628105dfc534451285d72f9e17f5d4f3 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111)
W20260709 12:15:20.360958 24322 leader_election.cc:336] T 628105dfc534451285d72f9e17f5d4f3 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:15:20.361361 24322 leader_election.cc:304] T 628105dfc534451285d72f9e17f5d4f3 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:15:20.362156 25527 raft_consensus.cc:2749] T 628105dfc534451285d72f9e17f5d4f3 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:15:20.362254 24322 leader_election.cc:336] T 99329004ca1c4c76a3a2dd4567ef15dd P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:15:20.362800 24322 leader_election.cc:304] T 99329004ca1c4c76a3a2dd4567ef15dd P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:15:20.363546 25527 raft_consensus.cc:2749] T 99329004ca1c4c76a3a2dd4567ef15dd P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:20.378597 25476 raft_consensus.cc:493] T 9cb931cb82d74add922e65a2ea3de34d P ad362df39b114ec3a3a419128097b362 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:15:20.379346 25476 raft_consensus.cc:515] T 9cb931cb82d74add922e65a2ea3de34d P ad362df39b114ec3a3a419128097b362 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:15:20.381255 25476 leader_election.cc:290] T 9cb931cb82d74add922e65a2ea3de34d P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
W20260709 12:15:20.386407 24396 leader_election.cc:336] T 9cb931cb82d74add922e65a2ea3de34d P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
W20260709 12:15:20.387524 24399 leader_election.cc:336] T 9cb931cb82d74add922e65a2ea3de34d P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111)
I20260709 12:15:20.388200 24399 leader_election.cc:304] T 9cb931cb82d74add922e65a2ea3de34d P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad362df39b114ec3a3a419128097b362; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:15:20.389248 25476 raft_consensus.cc:2749] T 9cb931cb82d74add922e65a2ea3de34d P ad362df39b114ec3a3a419128097b362 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:15:20.401583 24399 consensus_peers.cc:597] T 6af96d3f7393445f8b7edb30a26a6f65 P ad362df39b114ec3a3a419128097b362 -> Peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Couldn't send request to peer cf2d8294ae68482ca4ffa8be051ad054. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:20.425313 25445 raft_consensus.cc:493] T 0d31cf2c4a7849d9a798bf886e7fc997 P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:15:20.426131 25445 raft_consensus.cc:515] T 0d31cf2c4a7849d9a798bf886e7fc997 P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:15:20.428354 25445 leader_election.cc:290] T 0d31cf2c4a7849d9a798bf886e7fc997 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
W20260709 12:15:20.434088 24396 leader_election.cc:336] T 0d31cf2c4a7849d9a798bf886e7fc997 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
W20260709 12:15:20.436033 24399 leader_election.cc:336] T 0d31cf2c4a7849d9a798bf886e7fc997 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111)
I20260709 12:15:20.436678 25360 raft_consensus.cc:493] T 356b14abd90d418cab44e524aef8154c P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:15:20.436765 24399 leader_election.cc:304] T 0d31cf2c4a7849d9a798bf886e7fc997 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad362df39b114ec3a3a419128097b362; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:15:20.437759 25360 raft_consensus.cc:515] T 356b14abd90d418cab44e524aef8154c P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:15:20.438036 25445 raft_consensus.cc:2749] T 0d31cf2c4a7849d9a798bf886e7fc997 P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:20.441955 25360 leader_election.cc:290] T 356b14abd90d418cab44e524aef8154c P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:15:20.442026 12515 tablet_server.cc:196] TabletServer@127.12.56.194:0 shutdown complete.
W20260709 12:15:20.442068 24399 consensus_peers.cc:597] T b727e95d8f5843a3bb0d7cbddce61bdb P ad362df39b114ec3a3a419128097b362 -> Peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Couldn't send request to peer cf2d8294ae68482ca4ffa8be051ad054. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:20.455374 24322 leader_election.cc:336] T 356b14abd90d418cab44e524aef8154c P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
W20260709 12:15:20.460043 24325 leader_election.cc:336] T 356b14abd90d418cab44e524aef8154c P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111)
I20260709 12:15:20.462056 24325 leader_election.cc:304] T 356b14abd90d418cab44e524aef8154c P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:15:20.464970 25360 raft_consensus.cc:2749] T 356b14abd90d418cab44e524aef8154c P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:15:20.517979 24325 consensus_peers.cc:597] T 133e492e820f4152ad30562c343b617d P aa14caefbdaa47b09abf91881635ba96 -> Peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Couldn't send request to peer cf2d8294ae68482ca4ffa8be051ad054. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:20.561165 24325 consensus_peers.cc:597] T 0f0c432146014cf099d66c95cde2ea1d P aa14caefbdaa47b09abf91881635ba96 -> Peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Couldn't send request to peer cf2d8294ae68482ca4ffa8be051ad054. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:20.566875 24325 consensus_peers.cc:597] T 20629783689c4296afb55366d9ad5f6c P aa14caefbdaa47b09abf91881635ba96 -> Peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Couldn't send request to peer cf2d8294ae68482ca4ffa8be051ad054. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:20.575692 25360 raft_consensus.cc:493] T a18e73ef976b49f0878423c0b3e6e6f2 P aa14caefbdaa47b09abf91881635ba96 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:15:20.576495 25360 raft_consensus.cc:515] T a18e73ef976b49f0878423c0b3e6e6f2 P aa14caefbdaa47b09abf91881635ba96 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } } peers { permanent_uuid: "aa14caefbdaa47b09abf91881635ba96" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 46845 } }
I20260709 12:15:20.578887 25476 raft_consensus.cc:493] T bbab1a4afac94c1eaeb3ed35bc54408a P ad362df39b114ec3a3a419128097b362 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9bf3da5b54ef4a1ea1cee60f02ea2883)
I20260709 12:15:20.579572 25476 raft_consensus.cc:515] T bbab1a4afac94c1eaeb3ed35bc54408a P ad362df39b114ec3a3a419128097b362 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:15:20.580394 25360 leader_election.cc:290] T a18e73ef976b49f0878423c0b3e6e6f2 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:15:20.582544 25476 leader_election.cc:290] T bbab1a4afac94c1eaeb3ed35bc54408a P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
W20260709 12:15:20.587240 24399 leader_election.cc:336] T bbab1a4afac94c1eaeb3ed35bc54408a P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111)
W20260709 12:15:20.593192 24322 leader_election.cc:336] T a18e73ef976b49f0878423c0b3e6e6f2 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
W20260709 12:15:20.594480 24396 leader_election.cc:336] T bbab1a4afac94c1eaeb3ed35bc54408a P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:15:20.595100 24396 leader_election.cc:304] T bbab1a4afac94c1eaeb3ed35bc54408a P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad362df39b114ec3a3a419128097b362; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054
W20260709 12:15:20.597033 24325 leader_election.cc:336] T a18e73ef976b49f0878423c0b3e6e6f2 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111)
I20260709 12:15:20.597127 25476 raft_consensus.cc:2749] T bbab1a4afac94c1eaeb3ed35bc54408a P ad362df39b114ec3a3a419128097b362 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:15:20.600651 24325 leader_election.cc:304] T a18e73ef976b49f0878423c0b3e6e6f2 P aa14caefbdaa47b09abf91881635ba96 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa14caefbdaa47b09abf91881635ba96; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054
W20260709 12:15:20.601416 24399 consensus_peers.cc:597] T 7d67db0aeb6e4afb953c96511f9863d1 P ad362df39b114ec3a3a419128097b362 -> Peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Couldn't send request to peer cf2d8294ae68482ca4ffa8be051ad054. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:20.603709 25360 raft_consensus.cc:2749] T a18e73ef976b49f0878423c0b3e6e6f2 P aa14caefbdaa47b09abf91881635ba96 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:15:20.616510 12515 tablet_server.cc:179] TabletServer@127.12.56.195:0 shutting down...
W20260709 12:15:20.648988 24398 consensus_peers.cc:597] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P ad362df39b114ec3a3a419128097b362 -> Peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Couldn't send request to peer aa14caefbdaa47b09abf91881635ba96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:20.665563 12515 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:20.666863 12515 tablet_replica.cc:333] T 9219abaaa2c34b08a24191512ff742bc P aa14caefbdaa47b09abf91881635ba96: stopping tablet replica
I20260709 12:15:20.668372 12515 raft_consensus.cc:2243] T 9219abaaa2c34b08a24191512ff742bc P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:20.669143 12515 raft_consensus.cc:2272] T 9219abaaa2c34b08a24191512ff742bc P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.672545 12515 tablet_replica.cc:333] T 2c00f77150f7475c94c4fd29c90805cd P aa14caefbdaa47b09abf91881635ba96: stopping tablet replica
I20260709 12:15:20.673753 12515 raft_consensus.cc:2243] T 2c00f77150f7475c94c4fd29c90805cd P aa14caefbdaa47b09abf91881635ba96 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:15:20.675308 12515 raft_consensus.cc:2272] T 2c00f77150f7475c94c4fd29c90805cd P aa14caefbdaa47b09abf91881635ba96 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:20.676947 24399 consensus_peers.cc:597] T d10519ad64d948b09186e335ed06257d P ad362df39b114ec3a3a419128097b362 -> Peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Couldn't send request to peer cf2d8294ae68482ca4ffa8be051ad054. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:20.678732 12515 tablet_replica.cc:333] T f841b9f0e82748d399b5eef243c442fc P aa14caefbdaa47b09abf91881635ba96: stopping tablet replica
I20260709 12:15:20.679657 12515 raft_consensus.cc:2243] T f841b9f0e82748d399b5eef243c442fc P aa14caefbdaa47b09abf91881635ba96 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:20.680265 12515 raft_consensus.cc:2272] T f841b9f0e82748d399b5eef243c442fc P aa14caefbdaa47b09abf91881635ba96 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.683108 12515 tablet_replica.cc:333] T d84ed08271a24f7fa134ae81a858c314 P aa14caefbdaa47b09abf91881635ba96: stopping tablet replica
I20260709 12:15:20.683945 12515 raft_consensus.cc:2243] T d84ed08271a24f7fa134ae81a858c314 P aa14caefbdaa47b09abf91881635ba96 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:20.684931 12515 raft_consensus.cc:2272] T d84ed08271a24f7fa134ae81a858c314 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.687629 12515 tablet_replica.cc:333] T d92a635ff6404268bd5e51d3b9681551 P aa14caefbdaa47b09abf91881635ba96: stopping tablet replica
I20260709 12:15:20.688454 12515 raft_consensus.cc:2243] T d92a635ff6404268bd5e51d3b9681551 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:20.689239 12515 raft_consensus.cc:2272] T d92a635ff6404268bd5e51d3b9681551 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.691807 12515 tablet_replica.cc:333] T 0f0c432146014cf099d66c95cde2ea1d P aa14caefbdaa47b09abf91881635ba96: stopping tablet replica
I20260709 12:15:20.692569 12515 raft_consensus.cc:2243] T 0f0c432146014cf099d66c95cde2ea1d P aa14caefbdaa47b09abf91881635ba96 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:20.693867 12515 raft_consensus.cc:2272] T 0f0c432146014cf099d66c95cde2ea1d P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.696877 12515 tablet_replica.cc:333] T fa882381d669422a95ec60c9aefa8105 P aa14caefbdaa47b09abf91881635ba96: stopping tablet replica
I20260709 12:15:20.697564 12515 raft_consensus.cc:2243] T fa882381d669422a95ec60c9aefa8105 P aa14caefbdaa47b09abf91881635ba96 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:20.698494 12515 raft_consensus.cc:2272] T fa882381d669422a95ec60c9aefa8105 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.700793 12515 tablet_replica.cc:333] T 356b14abd90d418cab44e524aef8154c P aa14caefbdaa47b09abf91881635ba96: stopping tablet replica
I20260709 12:15:20.701469 12515 raft_consensus.cc:2243] T 356b14abd90d418cab44e524aef8154c P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:20.702105 12515 raft_consensus.cc:2272] T 356b14abd90d418cab44e524aef8154c P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.704439 12515 tablet_replica.cc:333] T bfba40ac52f842ca99dd4293619360af P aa14caefbdaa47b09abf91881635ba96: stopping tablet replica
I20260709 12:15:20.705098 12515 raft_consensus.cc:2243] T bfba40ac52f842ca99dd4293619360af P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:20.705646 12515 raft_consensus.cc:2272] T bfba40ac52f842ca99dd4293619360af P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.707916 12515 tablet_replica.cc:333] T 3fe3be6bb3264475ba597fec30a06f6c P aa14caefbdaa47b09abf91881635ba96: stopping tablet replica
I20260709 12:15:20.708556 12515 raft_consensus.cc:2243] T 3fe3be6bb3264475ba597fec30a06f6c P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:20.709064 12515 raft_consensus.cc:2272] T 3fe3be6bb3264475ba597fec30a06f6c P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.711488 12515 tablet_replica.cc:333] T 464c7ebd16cd488086ccaec23defbb33 P aa14caefbdaa47b09abf91881635ba96: stopping tablet replica
I20260709 12:15:20.712070 12515 raft_consensus.cc:2243] T 464c7ebd16cd488086ccaec23defbb33 P aa14caefbdaa47b09abf91881635ba96 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:20.712993 12515 raft_consensus.cc:2272] T 464c7ebd16cd488086ccaec23defbb33 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.715251 12515 tablet_replica.cc:333] T 00b51df5a8ee448884a9f145559a5ea3 P aa14caefbdaa47b09abf91881635ba96: stopping tablet replica
I20260709 12:15:20.715880 12515 raft_consensus.cc:2243] T 00b51df5a8ee448884a9f145559a5ea3 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:20.716324 12515 raft_consensus.cc:2272] T 00b51df5a8ee448884a9f145559a5ea3 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.719364 12515 tablet_replica.cc:333] T 8996365fa46548d49f3b3bafe14e9c83 P aa14caefbdaa47b09abf91881635ba96: stopping tablet replica
I20260709 12:15:20.720067 12515 raft_consensus.cc:2243] T 8996365fa46548d49f3b3bafe14e9c83 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:20.720556 12515 raft_consensus.cc:2272] T 8996365fa46548d49f3b3bafe14e9c83 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.722921 12515 tablet_replica.cc:333] T 628105dfc534451285d72f9e17f5d4f3 P aa14caefbdaa47b09abf91881635ba96: stopping tablet replica
I20260709 12:15:20.723644 12515 raft_consensus.cc:2243] T 628105dfc534451285d72f9e17f5d4f3 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:20.724352 12515 raft_consensus.cc:2272] T 628105dfc534451285d72f9e17f5d4f3 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.727648 12515 tablet_replica.cc:333] T 7d67db0aeb6e4afb953c96511f9863d1 P aa14caefbdaa47b09abf91881635ba96: stopping tablet replica
I20260709 12:15:20.728340 12515 raft_consensus.cc:2243] T 7d67db0aeb6e4afb953c96511f9863d1 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:20.728895 12515 raft_consensus.cc:2272] T 7d67db0aeb6e4afb953c96511f9863d1 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.731328 12515 tablet_replica.cc:333] T 99329004ca1c4c76a3a2dd4567ef15dd P aa14caefbdaa47b09abf91881635ba96: stopping tablet replica
I20260709 12:15:20.731989 12515 raft_consensus.cc:2243] T 99329004ca1c4c76a3a2dd4567ef15dd P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:20.732484 12515 raft_consensus.cc:2272] T 99329004ca1c4c76a3a2dd4567ef15dd P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.734807 12515 tablet_replica.cc:333] T 27de4156b2e24143a2f301fbefc7cb23 P aa14caefbdaa47b09abf91881635ba96: stopping tablet replica
I20260709 12:15:20.735432 12515 raft_consensus.cc:2243] T 27de4156b2e24143a2f301fbefc7cb23 P aa14caefbdaa47b09abf91881635ba96 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:20.736479 12515 raft_consensus.cc:2272] T 27de4156b2e24143a2f301fbefc7cb23 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.738865 12515 tablet_replica.cc:333] T ed15c59b19ff49d3a39bf5b5abf8b69a P aa14caefbdaa47b09abf91881635ba96: stopping tablet replica
I20260709 12:15:20.739478 12515 raft_consensus.cc:2243] T ed15c59b19ff49d3a39bf5b5abf8b69a P aa14caefbdaa47b09abf91881635ba96 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:20.739993 12515 raft_consensus.cc:2272] T ed15c59b19ff49d3a39bf5b5abf8b69a P aa14caefbdaa47b09abf91881635ba96 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.742255 12515 tablet_replica.cc:333] T cf280984dcfc44039a942819e8df951c P aa14caefbdaa47b09abf91881635ba96: stopping tablet replica
I20260709 12:15:20.742846 12515 raft_consensus.cc:2243] T cf280984dcfc44039a942819e8df951c P aa14caefbdaa47b09abf91881635ba96 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:20.743747 12515 raft_consensus.cc:2272] T cf280984dcfc44039a942819e8df951c P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.746274 12515 tablet_replica.cc:333] T fd6e20f3c92f4498a8c272b807797efa P aa14caefbdaa47b09abf91881635ba96: stopping tablet replica
I20260709 12:15:20.746975 12515 raft_consensus.cc:2243] T fd6e20f3c92f4498a8c272b807797efa P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:20.747524 12515 raft_consensus.cc:2272] T fd6e20f3c92f4498a8c272b807797efa P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.750871 12515 tablet_replica.cc:333] T 558ced611e584b32ab838cceeb7cb410 P aa14caefbdaa47b09abf91881635ba96: stopping tablet replica
I20260709 12:15:20.751641 12515 raft_consensus.cc:2243] T 558ced611e584b32ab838cceeb7cb410 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:20.752549 12515 raft_consensus.cc:2272] T 558ced611e584b32ab838cceeb7cb410 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:20.753343 24325 consensus_peers.cc:597] T 7c84013312e3409d851214e9954dad8b P aa14caefbdaa47b09abf91881635ba96 -> Peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Couldn't send request to peer cf2d8294ae68482ca4ffa8be051ad054. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:20.756541 12515 tablet_replica.cc:333] T a18e73ef976b49f0878423c0b3e6e6f2 P aa14caefbdaa47b09abf91881635ba96: stopping tablet replica
I20260709 12:15:20.757753 12515 raft_consensus.cc:2243] T a18e73ef976b49f0878423c0b3e6e6f2 P aa14caefbdaa47b09abf91881635ba96 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:20.758669 12515 raft_consensus.cc:2272] T a18e73ef976b49f0878423c0b3e6e6f2 P aa14caefbdaa47b09abf91881635ba96 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.761549 12515 tablet_replica.cc:333] T 20629783689c4296afb55366d9ad5f6c P aa14caefbdaa47b09abf91881635ba96: stopping tablet replica
I20260709 12:15:20.762296 12515 raft_consensus.cc:2243] T 20629783689c4296afb55366d9ad5f6c P aa14caefbdaa47b09abf91881635ba96 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:20.763249 12515 raft_consensus.cc:2272] T 20629783689c4296afb55366d9ad5f6c P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.766145 12515 tablet_replica.cc:333] T 7cbef09353144c0b9a9ebf7731fd019f P aa14caefbdaa47b09abf91881635ba96: stopping tablet replica
I20260709 12:15:20.766984 12515 raft_consensus.cc:2243] T 7cbef09353144c0b9a9ebf7731fd019f P aa14caefbdaa47b09abf91881635ba96 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:20.767654 12515 raft_consensus.cc:2272] T 7cbef09353144c0b9a9ebf7731fd019f P aa14caefbdaa47b09abf91881635ba96 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:20.768196 24398 consensus_peers.cc:597] T fd6e20f3c92f4498a8c272b807797efa P ad362df39b114ec3a3a419128097b362 -> Peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Couldn't send request to peer aa14caefbdaa47b09abf91881635ba96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:20.770176 12515 tablet_replica.cc:333] T 6d6c85f42e284b06b8d1e7cee59f3dbc P aa14caefbdaa47b09abf91881635ba96: stopping tablet replica
I20260709 12:15:20.770896 12515 raft_consensus.cc:2243] T 6d6c85f42e284b06b8d1e7cee59f3dbc P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:20.771469 12515 raft_consensus.cc:2272] T 6d6c85f42e284b06b8d1e7cee59f3dbc P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.773717 12515 tablet_replica.cc:333] T e05eec364f764114bdb814096b9bf0ce P aa14caefbdaa47b09abf91881635ba96: stopping tablet replica
I20260709 12:15:20.774417 12515 raft_consensus.cc:2243] T e05eec364f764114bdb814096b9bf0ce P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:20.774875 12515 raft_consensus.cc:2272] T e05eec364f764114bdb814096b9bf0ce P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.777245 12515 tablet_replica.cc:333] T b98a35cf96ba4562b4933543b1e4efb9 P aa14caefbdaa47b09abf91881635ba96: stopping tablet replica
I20260709 12:15:20.778056 12515 raft_consensus.cc:2243] T b98a35cf96ba4562b4933543b1e4efb9 P aa14caefbdaa47b09abf91881635ba96 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:20.778921 12515 raft_consensus.cc:2272] T b98a35cf96ba4562b4933543b1e4efb9 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.781123 12515 tablet_replica.cc:333] T b1e1c3b597fd49b2831e5f523149b2dc P aa14caefbdaa47b09abf91881635ba96: stopping tablet replica
I20260709 12:15:20.781687 12515 raft_consensus.cc:2243] T b1e1c3b597fd49b2831e5f523149b2dc P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:20.782209 12515 raft_consensus.cc:2272] T b1e1c3b597fd49b2831e5f523149b2dc P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.784842 12515 tablet_replica.cc:333] T 5310371490a542269db28e29d7adfffa P aa14caefbdaa47b09abf91881635ba96: stopping tablet replica
I20260709 12:15:20.785663 12515 raft_consensus.cc:2243] T 5310371490a542269db28e29d7adfffa P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:20.786494 12515 raft_consensus.cc:2272] T 5310371490a542269db28e29d7adfffa P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.789649 12515 tablet_replica.cc:333] T 3e977ea0483d4c029394b273e7c4e90f P aa14caefbdaa47b09abf91881635ba96: stopping tablet replica
I20260709 12:15:20.790458 12515 raft_consensus.cc:2243] T 3e977ea0483d4c029394b273e7c4e90f P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:20.790973 12515 raft_consensus.cc:2272] T 3e977ea0483d4c029394b273e7c4e90f P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.793993 12515 tablet_replica.cc:333] T e24b175869274d33ade73761b6f23ca4 P aa14caefbdaa47b09abf91881635ba96: stopping tablet replica
I20260709 12:15:20.794639 12515 raft_consensus.cc:2243] T e24b175869274d33ade73761b6f23ca4 P aa14caefbdaa47b09abf91881635ba96 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:20.795537 12515 raft_consensus.cc:2272] T e24b175869274d33ade73761b6f23ca4 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.798034 12515 tablet_replica.cc:333] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P aa14caefbdaa47b09abf91881635ba96: stopping tablet replica
I20260709 12:15:20.798872 12515 raft_consensus.cc:2243] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:20.799458 12515 raft_consensus.cc:2272] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.802443 12515 tablet_replica.cc:333] T ab8dff607862460ea0fcd88422c31ac2 P aa14caefbdaa47b09abf91881635ba96: stopping tablet replica
I20260709 12:15:20.803129 12515 raft_consensus.cc:2243] T ab8dff607862460ea0fcd88422c31ac2 P aa14caefbdaa47b09abf91881635ba96 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:20.803792 12515 raft_consensus.cc:2272] T ab8dff607862460ea0fcd88422c31ac2 P aa14caefbdaa47b09abf91881635ba96 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.807116 12515 tablet_replica.cc:333] T 9c40e590be9d4c3eac0ddd7f96278894 P aa14caefbdaa47b09abf91881635ba96: stopping tablet replica
I20260709 12:15:20.807845 12515 raft_consensus.cc:2243] T 9c40e590be9d4c3eac0ddd7f96278894 P aa14caefbdaa47b09abf91881635ba96 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:20.808701 12515 raft_consensus.cc:2272] T 9c40e590be9d4c3eac0ddd7f96278894 P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.811084 12515 tablet_replica.cc:333] T 7c84013312e3409d851214e9954dad8b P aa14caefbdaa47b09abf91881635ba96: stopping tablet replica
I20260709 12:15:20.811733 12515 raft_consensus.cc:2243] T 7c84013312e3409d851214e9954dad8b P aa14caefbdaa47b09abf91881635ba96 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:20.812641 12515 raft_consensus.cc:2272] T 7c84013312e3409d851214e9954dad8b P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.815181 12515 tablet_replica.cc:333] T 4b1c850a65b748c093c5c88aa94fed71 P aa14caefbdaa47b09abf91881635ba96: stopping tablet replica
I20260709 12:15:20.815920 12515 raft_consensus.cc:2243] T 4b1c850a65b748c093c5c88aa94fed71 P aa14caefbdaa47b09abf91881635ba96 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:15:20.817008 12515 raft_consensus.cc:2272] T 4b1c850a65b748c093c5c88aa94fed71 P aa14caefbdaa47b09abf91881635ba96 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.820111 12515 tablet_replica.cc:333] T 93ece38976574ad7a5e93a69c33c074d P aa14caefbdaa47b09abf91881635ba96: stopping tablet replica
I20260709 12:15:20.820945 12515 raft_consensus.cc:2243] T 93ece38976574ad7a5e93a69c33c074d P aa14caefbdaa47b09abf91881635ba96 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:20.822261 12515 raft_consensus.cc:2272] T 93ece38976574ad7a5e93a69c33c074d P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:20.824793 24398 consensus_peers.cc:597] T 00b51df5a8ee448884a9f145559a5ea3 P ad362df39b114ec3a3a419128097b362 -> Peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Couldn't send request to peer aa14caefbdaa47b09abf91881635ba96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:20.825337 25476 raft_consensus.cc:493] T 085a04f8ed724f82bc12490bbb1ceea7 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cf2d8294ae68482ca4ffa8be051ad054)
I20260709 12:15:20.825649 12515 tablet_replica.cc:333] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96: stopping tablet replica
I20260709 12:15:20.825994 25476 raft_consensus.cc:515] T 085a04f8ed724f82bc12490bbb1ceea7 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:15:20.826608 12515 raft_consensus.cc:2243] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96 [term 4 LEADER]: Raft consensus shutting down.
W20260709 12:15:20.826792 24398 consensus_peers.cc:597] T 4f756e6bcc20458b8748cd090cd3fce2 P ad362df39b114ec3a3a419128097b362 -> Peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Couldn't send request to peer aa14caefbdaa47b09abf91881635ba96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:20.827966 25476 leader_election.cc:290] T 085a04f8ed724f82bc12490bbb1ceea7 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:15:20.827963 12515 raft_consensus.cc:2272] T 477aafe049fa4b1182fb0afe55fe5e55 P aa14caefbdaa47b09abf91881635ba96 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.831473 12515 tablet_replica.cc:333] T 7943c68d21d449dba2d1dca6ddde5820 P aa14caefbdaa47b09abf91881635ba96: stopping tablet replica
I20260709 12:15:20.832240 12515 raft_consensus.cc:2243] T 7943c68d21d449dba2d1dca6ddde5820 P aa14caefbdaa47b09abf91881635ba96 [term 3 LEADER]: Raft consensus shutting down.
W20260709 12:15:20.832195 24396 leader_election.cc:336] T 085a04f8ed724f82bc12490bbb1ceea7 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:15:20.833630 12515 raft_consensus.cc:2272] T 7943c68d21d449dba2d1dca6ddde5820 P aa14caefbdaa47b09abf91881635ba96 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:20.833685 24399 leader_election.cc:336] T 085a04f8ed724f82bc12490bbb1ceea7 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111)
I20260709 12:15:20.834240 24399 leader_election.cc:304] T 085a04f8ed724f82bc12490bbb1ceea7 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad362df39b114ec3a3a419128097b362; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:15:20.835290 25445 raft_consensus.cc:2749] T 085a04f8ed724f82bc12490bbb1ceea7 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:20.836721 12515 tablet_replica.cc:333] T dbace6d282ab498283858033606494ae P aa14caefbdaa47b09abf91881635ba96: stopping tablet replica
I20260709 12:15:20.837730 12515 raft_consensus.cc:2243] T dbace6d282ab498283858033606494ae P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:20.838397 12515 raft_consensus.cc:2272] T dbace6d282ab498283858033606494ae P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.841253 12515 tablet_replica.cc:333] T 4f756e6bcc20458b8748cd090cd3fce2 P aa14caefbdaa47b09abf91881635ba96: stopping tablet replica
I20260709 12:15:20.842149 12515 raft_consensus.cc:2243] T 4f756e6bcc20458b8748cd090cd3fce2 P aa14caefbdaa47b09abf91881635ba96 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:20.842691 12515 raft_consensus.cc:2272] T 4f756e6bcc20458b8748cd090cd3fce2 P aa14caefbdaa47b09abf91881635ba96 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.845587 12515 tablet_replica.cc:333] T ba38e800dd034ff8b7fda6701973510b P aa14caefbdaa47b09abf91881635ba96: stopping tablet replica
I20260709 12:15:20.846158 12515 raft_consensus.cc:2243] T ba38e800dd034ff8b7fda6701973510b P aa14caefbdaa47b09abf91881635ba96 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:20.847244 12515 raft_consensus.cc:2272] T ba38e800dd034ff8b7fda6701973510b P aa14caefbdaa47b09abf91881635ba96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.849712 12515 tablet_replica.cc:333] T e15e9b81515343958a00ba6f2f291860 P aa14caefbdaa47b09abf91881635ba96: stopping tablet replica
I20260709 12:15:20.850361 12515 raft_consensus.cc:2243] T e15e9b81515343958a00ba6f2f291860 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:20.850806 12515 raft_consensus.cc:2272] T e15e9b81515343958a00ba6f2f291860 P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:20.854012 12515 tablet_replica.cc:333] T 133e492e820f4152ad30562c343b617d P aa14caefbdaa47b09abf91881635ba96: stopping tablet replica
I20260709 12:15:20.854553 12515 raft_consensus.cc:2243] T 133e492e820f4152ad30562c343b617d P aa14caefbdaa47b09abf91881635ba96 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:20.855502 12515 raft_consensus.cc:2272] T 133e492e820f4152ad30562c343b617d P aa14caefbdaa47b09abf91881635ba96 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:20.872745 24398 consensus_peers.cc:597] T e15e9b81515343958a00ba6f2f291860 P ad362df39b114ec3a3a419128097b362 -> Peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Couldn't send request to peer aa14caefbdaa47b09abf91881635ba96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:20.899528 24398 consensus_peers.cc:597] T d92a635ff6404268bd5e51d3b9681551 P ad362df39b114ec3a3a419128097b362 -> Peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Couldn't send request to peer aa14caefbdaa47b09abf91881635ba96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:20.905207 24398 consensus_peers.cc:597] T 7cbef09353144c0b9a9ebf7731fd019f P ad362df39b114ec3a3a419128097b362 -> Peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Couldn't send request to peer aa14caefbdaa47b09abf91881635ba96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:20.930886 12515 tablet_server.cc:196] TabletServer@127.12.56.195:0 shutdown complete.
I20260709 12:15:20.936786 25445 raft_consensus.cc:493] T 49b141610080476a8e5f0415c370e8cd P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cf2d8294ae68482ca4ffa8be051ad054)
I20260709 12:15:20.937498 25445 raft_consensus.cc:515] T 49b141610080476a8e5f0415c370e8cd P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:15:20.940675 25445 leader_election.cc:290] T 49b141610080476a8e5f0415c370e8cd P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
W20260709 12:15:20.945109 24399 leader_election.cc:336] T 49b141610080476a8e5f0415c370e8cd P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111)
W20260709 12:15:20.946622 24396 leader_election.cc:336] T 49b141610080476a8e5f0415c370e8cd P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:15:20.947165 24396 leader_election.cc:304] T 49b141610080476a8e5f0415c370e8cd P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad362df39b114ec3a3a419128097b362; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:15:20.948079 25445 raft_consensus.cc:2749] T 49b141610080476a8e5f0415c370e8cd P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:15:20.964445 24398 consensus_peers.cc:597] T 7d67db0aeb6e4afb953c96511f9863d1 P ad362df39b114ec3a3a419128097b362 -> Peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Couldn't send request to peer aa14caefbdaa47b09abf91881635ba96. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.195:46845: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:21.022040 24398 consensus_peers.cc:597] T dbace6d282ab498283858033606494ae P ad362df39b114ec3a3a419128097b362 -> Peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Couldn't send request to peer aa14caefbdaa47b09abf91881635ba96. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.195:46845: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:21.030340 12515 tablet_server.cc:179] TabletServer@127.12.56.196:0 shutting down...
W20260709 12:15:21.049830 24398 consensus_peers.cc:597] T ed15c59b19ff49d3a39bf5b5abf8b69a P ad362df39b114ec3a3a419128097b362 -> Peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Couldn't send request to peer aa14caefbdaa47b09abf91881635ba96. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.195:46845: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:21.058939 24398 consensus_peers.cc:597] T 8996365fa46548d49f3b3bafe14e9c83 P ad362df39b114ec3a3a419128097b362 -> Peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Couldn't send request to peer aa14caefbdaa47b09abf91881635ba96. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.195:46845: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:21.084175 12515 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:21.085230 12515 tablet_replica.cc:333] T 9219abaaa2c34b08a24191512ff742bc P ad362df39b114ec3a3a419128097b362: stopping tablet replica
I20260709 12:15:21.086412 12515 raft_consensus.cc:2243] T 9219abaaa2c34b08a24191512ff742bc P ad362df39b114ec3a3a419128097b362 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:21.087846 12515 raft_consensus.cc:2272] T 9219abaaa2c34b08a24191512ff742bc P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:21.090925 12515 tablet_replica.cc:333] T 2c00f77150f7475c94c4fd29c90805cd P ad362df39b114ec3a3a419128097b362: stopping tablet replica
I20260709 12:15:21.091699 12515 raft_consensus.cc:2243] T 2c00f77150f7475c94c4fd29c90805cd P ad362df39b114ec3a3a419128097b362 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:21.092432 12515 raft_consensus.cc:2272] T 2c00f77150f7475c94c4fd29c90805cd P ad362df39b114ec3a3a419128097b362 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:21.095804 12515 tablet_replica.cc:333] T f9094185a2ad43d0b3a5174b165dab65 P ad362df39b114ec3a3a419128097b362: stopping tablet replica
I20260709 12:15:21.096854 12515 raft_consensus.cc:2243] T f9094185a2ad43d0b3a5174b165dab65 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:15:21.097095 24398 consensus_peers.cc:597] T e05eec364f764114bdb814096b9bf0ce P ad362df39b114ec3a3a419128097b362 -> Peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Couldn't send request to peer aa14caefbdaa47b09abf91881635ba96. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.195:46845: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:21.097548 12515 raft_consensus.cc:2272] T f9094185a2ad43d0b3a5174b165dab65 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:21.100342 12515 tablet_replica.cc:333] T 8996365fa46548d49f3b3bafe14e9c83 P ad362df39b114ec3a3a419128097b362: stopping tablet replica
I20260709 12:15:21.101055 12515 raft_consensus.cc:2243] T 8996365fa46548d49f3b3bafe14e9c83 P ad362df39b114ec3a3a419128097b362 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:21.102105 12515 raft_consensus.cc:2272] T 8996365fa46548d49f3b3bafe14e9c83 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:21.105387 12515 tablet_replica.cc:333] T d92a635ff6404268bd5e51d3b9681551 P ad362df39b114ec3a3a419128097b362: stopping tablet replica
I20260709 12:15:21.106338 12515 raft_consensus.cc:2243] T d92a635ff6404268bd5e51d3b9681551 P ad362df39b114ec3a3a419128097b362 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:21.107673 12515 raft_consensus.cc:2272] T d92a635ff6404268bd5e51d3b9681551 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:21.107983 24398 consensus_peers.cc:597] T 6d6c85f42e284b06b8d1e7cee59f3dbc P ad362df39b114ec3a3a419128097b362 -> Peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Couldn't send request to peer aa14caefbdaa47b09abf91881635ba96. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.195:46845: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:21.110598 12515 tablet_replica.cc:333] T 7d67db0aeb6e4afb953c96511f9863d1 P ad362df39b114ec3a3a419128097b362: stopping tablet replica
I20260709 12:15:21.111442 12515 raft_consensus.cc:2243] T 7d67db0aeb6e4afb953c96511f9863d1 P ad362df39b114ec3a3a419128097b362 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:21.112438 12515 raft_consensus.cc:2272] T 7d67db0aeb6e4afb953c96511f9863d1 P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:21.114962 12515 tablet_replica.cc:333] T bbab1a4afac94c1eaeb3ed35bc54408a P ad362df39b114ec3a3a419128097b362: stopping tablet replica
I20260709 12:15:21.115649 12515 raft_consensus.cc:2243] T bbab1a4afac94c1eaeb3ed35bc54408a P ad362df39b114ec3a3a419128097b362 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:21.116181 12515 raft_consensus.cc:2272] T bbab1a4afac94c1eaeb3ed35bc54408a P ad362df39b114ec3a3a419128097b362 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:21.117142 25445 raft_consensus.cc:493] T 67c0216443004287861015dd30ae5144 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cf2d8294ae68482ca4ffa8be051ad054)
I20260709 12:15:21.117645 25445 raft_consensus.cc:515] T 67c0216443004287861015dd30ae5144 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:15:21.119019 12515 tablet_replica.cc:333] T d84ed08271a24f7fa134ae81a858c314 P ad362df39b114ec3a3a419128097b362: stopping tablet replica
I20260709 12:15:21.119447 25445 leader_election.cc:290] T 67c0216443004287861015dd30ae5144 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:15:21.120049 12515 raft_consensus.cc:2243] T d84ed08271a24f7fa134ae81a858c314 P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:21.120875 12515 raft_consensus.cc:2272] T d84ed08271a24f7fa134ae81a858c314 P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:21.123725 24399 leader_election.cc:336] T 67c0216443004287861015dd30ae5144 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111)
W20260709 12:15:21.124305 24396 leader_election.cc:336] T 67c0216443004287861015dd30ae5144 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
I20260709 12:15:21.124327 12515 tablet_replica.cc:333] T 0f0c432146014cf099d66c95cde2ea1d P ad362df39b114ec3a3a419128097b362: stopping tablet replica
I20260709 12:15:21.124770 24396 leader_election.cc:304] T 67c0216443004287861015dd30ae5144 P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad362df39b114ec3a3a419128097b362; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:15:21.125317 12515 raft_consensus.cc:2243] T 0f0c432146014cf099d66c95cde2ea1d P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:21.125430 25445 raft_consensus.cc:2749] T 67c0216443004287861015dd30ae5144 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:15:21.126137 12515 raft_consensus.cc:2272] T 0f0c432146014cf099d66c95cde2ea1d P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:21.128623 12515 tablet_replica.cc:333] T fa882381d669422a95ec60c9aefa8105 P ad362df39b114ec3a3a419128097b362: stopping tablet replica
I20260709 12:15:21.129335 12515 raft_consensus.cc:2243] T fa882381d669422a95ec60c9aefa8105 P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:21.129935 12515 raft_consensus.cc:2272] T fa882381d669422a95ec60c9aefa8105 P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:21.132413 12515 tablet_replica.cc:333] T 464c7ebd16cd488086ccaec23defbb33 P ad362df39b114ec3a3a419128097b362: stopping tablet replica
I20260709 12:15:21.133129 12515 raft_consensus.cc:2243] T 464c7ebd16cd488086ccaec23defbb33 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:21.133648 12515 raft_consensus.cc:2272] T 464c7ebd16cd488086ccaec23defbb33 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:21.136106 12515 tablet_replica.cc:333] T 9cb931cb82d74add922e65a2ea3de34d P ad362df39b114ec3a3a419128097b362: stopping tablet replica
I20260709 12:15:21.136754 12515 raft_consensus.cc:2243] T 9cb931cb82d74add922e65a2ea3de34d P ad362df39b114ec3a3a419128097b362 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:21.137305 12515 raft_consensus.cc:2272] T 9cb931cb82d74add922e65a2ea3de34d P ad362df39b114ec3a3a419128097b362 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:21.139719 12515 tablet_replica.cc:333] T 49b141610080476a8e5f0415c370e8cd P ad362df39b114ec3a3a419128097b362: stopping tablet replica
I20260709 12:15:21.140349 12515 raft_consensus.cc:2243] T 49b141610080476a8e5f0415c370e8cd P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:21.140879 12515 raft_consensus.cc:2272] T 49b141610080476a8e5f0415c370e8cd P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:21.143334 12515 tablet_replica.cc:333] T cf280984dcfc44039a942819e8df951c P ad362df39b114ec3a3a419128097b362: stopping tablet replica
I20260709 12:15:21.143981 12515 raft_consensus.cc:2243] T cf280984dcfc44039a942819e8df951c P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:21.144672 12515 raft_consensus.cc:2272] T cf280984dcfc44039a942819e8df951c P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:21.147090 12515 tablet_replica.cc:333] T fd6e20f3c92f4498a8c272b807797efa P ad362df39b114ec3a3a419128097b362: stopping tablet replica
I20260709 12:15:21.147734 12515 raft_consensus.cc:2243] T fd6e20f3c92f4498a8c272b807797efa P ad362df39b114ec3a3a419128097b362 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:21.148752 12515 raft_consensus.cc:2272] T fd6e20f3c92f4498a8c272b807797efa P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:21.151363 12515 tablet_replica.cc:333] T dbace6d282ab498283858033606494ae P ad362df39b114ec3a3a419128097b362: stopping tablet replica
I20260709 12:15:21.152186 12515 raft_consensus.cc:2243] T dbace6d282ab498283858033606494ae P ad362df39b114ec3a3a419128097b362 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:21.153385 12515 raft_consensus.cc:2272] T dbace6d282ab498283858033606494ae P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:21.156150 12515 tablet_replica.cc:333] T 4f756e6bcc20458b8748cd090cd3fce2 P ad362df39b114ec3a3a419128097b362: stopping tablet replica
I20260709 12:15:21.156836 12515 raft_consensus.cc:2243] T 4f756e6bcc20458b8748cd090cd3fce2 P ad362df39b114ec3a3a419128097b362 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:15:21.157862 12515 raft_consensus.cc:2272] T 4f756e6bcc20458b8748cd090cd3fce2 P ad362df39b114ec3a3a419128097b362 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:21.160151 12515 tablet_replica.cc:333] T ba38e800dd034ff8b7fda6701973510b P ad362df39b114ec3a3a419128097b362: stopping tablet replica
I20260709 12:15:21.160933 25445 raft_consensus.cc:493] T 06d0284e94354a2686c577372cceb2bc P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cf2d8294ae68482ca4ffa8be051ad054)
I20260709 12:15:21.160945 12515 raft_consensus.cc:2243] T ba38e800dd034ff8b7fda6701973510b P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:21.161680 25445 raft_consensus.cc:515] T 06d0284e94354a2686c577372cceb2bc P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad362df39b114ec3a3a419128097b362" member_type: VOTER last_known_addr { host: "127.12.56.196" port: 46467 } } peers { permanent_uuid: "9bf3da5b54ef4a1ea1cee60f02ea2883" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 38787 } } peers { permanent_uuid: "cf2d8294ae68482ca4ffa8be051ad054" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 34565 } }
I20260709 12:15:21.161970 12515 raft_consensus.cc:2272] T ba38e800dd034ff8b7fda6701973510b P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:21.163656 25445 leader_election.cc:290] T 06d0284e94354a2686c577372cceb2bc P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787), cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565)
I20260709 12:15:21.165033 12515 tablet_replica.cc:333] T c75afe0e0e00446aa6d220941d288eab P ad362df39b114ec3a3a419128097b362: stopping tablet replica
I20260709 12:15:21.165925 12515 raft_consensus.cc:2243] T c75afe0e0e00446aa6d220941d288eab P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:21.166595 12515 raft_consensus.cc:2272] T c75afe0e0e00446aa6d220941d288eab P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:21.167928 24396 leader_election.cc:336] T 06d0284e94354a2686c577372cceb2bc P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9bf3da5b54ef4a1ea1cee60f02ea2883 (127.12.56.193:38787): Network error: Client connection negotiation failed: client connection to 127.12.56.193:38787: connect: Connection refused (error 111)
W20260709 12:15:21.168532 24399 leader_election.cc:336] T 06d0284e94354a2686c577372cceb2bc P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer cf2d8294ae68482ca4ffa8be051ad054 (127.12.56.194:34565): Network error: Client connection negotiation failed: client connection to 127.12.56.194:34565: connect: Connection refused (error 111)
I20260709 12:15:21.168937 24399 leader_election.cc:304] T 06d0284e94354a2686c577372cceb2bc P ad362df39b114ec3a3a419128097b362 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad362df39b114ec3a3a419128097b362; no voters: 9bf3da5b54ef4a1ea1cee60f02ea2883, cf2d8294ae68482ca4ffa8be051ad054
I20260709 12:15:21.169565 12515 tablet_replica.cc:333] T e15e9b81515343958a00ba6f2f291860 P ad362df39b114ec3a3a419128097b362: stopping tablet replica
I20260709 12:15:21.169689 25445 raft_consensus.cc:2749] T 06d0284e94354a2686c577372cceb2bc P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:15:21.170518 12515 raft_consensus.cc:2243] T e15e9b81515343958a00ba6f2f291860 P ad362df39b114ec3a3a419128097b362 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:21.171414 12515 raft_consensus.cc:2272] T e15e9b81515343958a00ba6f2f291860 P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:21.173959 12515 tablet_replica.cc:333] T 318c217e16874865bd6dff6bd4d8cd4f P ad362df39b114ec3a3a419128097b362: stopping tablet replica
I20260709 12:15:21.174671 12515 raft_consensus.cc:2243] T 318c217e16874865bd6dff6bd4d8cd4f P ad362df39b114ec3a3a419128097b362 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:21.175192 12515 raft_consensus.cc:2272] T 318c217e16874865bd6dff6bd4d8cd4f P ad362df39b114ec3a3a419128097b362 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:21.177431 12515 tablet_replica.cc:333] T d10519ad64d948b09186e335ed06257d P ad362df39b114ec3a3a419128097b362: stopping tablet replica
I20260709 12:15:21.178198 12515 raft_consensus.cc:2243] T d10519ad64d948b09186e335ed06257d P ad362df39b114ec3a3a419128097b362 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:21.179216 12515 raft_consensus.cc:2272] T d10519ad64d948b09186e335ed06257d P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:21.181434 24398 consensus_peers.cc:597] T 3e977ea0483d4c029394b273e7c4e90f P ad362df39b114ec3a3a419128097b362 -> Peer aa14caefbdaa47b09abf91881635ba96 (127.12.56.195:46845): Couldn't send request to peer aa14caefbdaa47b09abf91881635ba96. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.195:46845: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:21.181922 12515 tablet_replica.cc:333] T 6af96d3f7393445f8b7edb30a26a6f65 P ad362df39b114ec3a3a419128097b362: stopping tablet replica
I20260709 12:15:21.182631 12515 raft_consensus.cc:2243] T 6af96d3f7393445f8b7edb30a26a6f65 P ad362df39b114ec3a3a419128097b362 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:21.183472 12515 raft_consensus.cc:2272] T 6af96d3f7393445f8b7edb30a26a6f65 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:21.185513 12515 tablet_replica.cc:333] T 085a04f8ed724f82bc12490bbb1ceea7 P ad362df39b114ec3a3a419128097b362: stopping tablet replica
I20260709 12:15:21.186111 12515 raft_consensus.cc:2243] T 085a04f8ed724f82bc12490bbb1ceea7 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:21.186545 12515 raft_consensus.cc:2272] T 085a04f8ed724f82bc12490bbb1ceea7 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:21.188447 12515 tablet_replica.cc:333] T b727e95d8f5843a3bb0d7cbddce61bdb P ad362df39b114ec3a3a419128097b362: stopping tablet replica
I20260709 12:15:21.188977 12515 raft_consensus.cc:2243] T b727e95d8f5843a3bb0d7cbddce61bdb P ad362df39b114ec3a3a419128097b362 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:21.189733 12515 raft_consensus.cc:2272] T b727e95d8f5843a3bb0d7cbddce61bdb P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:21.191947 12515 tablet_replica.cc:333] T ed15c59b19ff49d3a39bf5b5abf8b69a P ad362df39b114ec3a3a419128097b362: stopping tablet replica
I20260709 12:15:21.192478 12515 raft_consensus.cc:2243] T ed15c59b19ff49d3a39bf5b5abf8b69a P ad362df39b114ec3a3a419128097b362 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:15:21.193351 12515 raft_consensus.cc:2272] T ed15c59b19ff49d3a39bf5b5abf8b69a P ad362df39b114ec3a3a419128097b362 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:21.195483 12515 tablet_replica.cc:333] T 20629783689c4296afb55366d9ad5f6c P ad362df39b114ec3a3a419128097b362: stopping tablet replica
I20260709 12:15:21.196009 12515 raft_consensus.cc:2243] T 20629783689c4296afb55366d9ad5f6c P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:21.196394 12515 raft_consensus.cc:2272] T 20629783689c4296afb55366d9ad5f6c P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:21.200436 12515 tablet_replica.cc:333] T 7cbef09353144c0b9a9ebf7731fd019f P ad362df39b114ec3a3a419128097b362: stopping tablet replica
I20260709 12:15:21.201339 12515 raft_consensus.cc:2243] T 7cbef09353144c0b9a9ebf7731fd019f P ad362df39b114ec3a3a419128097b362 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:15:21.202551 12515 raft_consensus.cc:2272] T 7cbef09353144c0b9a9ebf7731fd019f P ad362df39b114ec3a3a419128097b362 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:21.204720 12515 tablet_replica.cc:333] T 6d6c85f42e284b06b8d1e7cee59f3dbc P ad362df39b114ec3a3a419128097b362: stopping tablet replica
I20260709 12:15:21.205334 12515 raft_consensus.cc:2243] T 6d6c85f42e284b06b8d1e7cee59f3dbc P ad362df39b114ec3a3a419128097b362 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:21.206391 12515 raft_consensus.cc:2272] T 6d6c85f42e284b06b8d1e7cee59f3dbc P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:21.208596 12515 tablet_replica.cc:333] T e05eec364f764114bdb814096b9bf0ce P ad362df39b114ec3a3a419128097b362: stopping tablet replica
I20260709 12:15:21.209229 12515 raft_consensus.cc:2243] T e05eec364f764114bdb814096b9bf0ce P ad362df39b114ec3a3a419128097b362 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:21.210189 12515 raft_consensus.cc:2272] T e05eec364f764114bdb814096b9bf0ce P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:21.216149 12515 tablet_replica.cc:333] T 67c0216443004287861015dd30ae5144 P ad362df39b114ec3a3a419128097b362: stopping tablet replica
I20260709 12:15:21.216835 12515 raft_consensus.cc:2243] T 67c0216443004287861015dd30ae5144 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:21.217355 12515 raft_consensus.cc:2272] T 67c0216443004287861015dd30ae5144 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:21.219837 12515 tablet_replica.cc:333] T 95d3180f4ab5472d9de6e220219e7898 P ad362df39b114ec3a3a419128097b362: stopping tablet replica
I20260709 12:15:21.220425 12515 raft_consensus.cc:2243] T 95d3180f4ab5472d9de6e220219e7898 P ad362df39b114ec3a3a419128097b362 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:21.221379 12515 raft_consensus.cc:2272] T 95d3180f4ab5472d9de6e220219e7898 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:21.223732 12515 tablet_replica.cc:333] T 00b51df5a8ee448884a9f145559a5ea3 P ad362df39b114ec3a3a419128097b362: stopping tablet replica
I20260709 12:15:21.224395 12515 raft_consensus.cc:2243] T 00b51df5a8ee448884a9f145559a5ea3 P ad362df39b114ec3a3a419128097b362 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:21.225320 12515 raft_consensus.cc:2272] T 00b51df5a8ee448884a9f145559a5ea3 P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:21.227751 12515 tablet_replica.cc:333] T 06d0284e94354a2686c577372cceb2bc P ad362df39b114ec3a3a419128097b362: stopping tablet replica
I20260709 12:15:21.228554 12515 raft_consensus.cc:2243] T 06d0284e94354a2686c577372cceb2bc P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:21.229058 12515 raft_consensus.cc:2272] T 06d0284e94354a2686c577372cceb2bc P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:21.231582 12515 tablet_replica.cc:333] T 0d31cf2c4a7849d9a798bf886e7fc997 P ad362df39b114ec3a3a419128097b362: stopping tablet replica
I20260709 12:15:21.232213 12515 raft_consensus.cc:2243] T 0d31cf2c4a7849d9a798bf886e7fc997 P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:21.232717 12515 raft_consensus.cc:2272] T 0d31cf2c4a7849d9a798bf886e7fc997 P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:21.234979 12515 tablet_replica.cc:333] T 7d2a60078de84a53aedeb20cdcd211a4 P ad362df39b114ec3a3a419128097b362: stopping tablet replica
I20260709 12:15:21.235570 12515 raft_consensus.cc:2243] T 7d2a60078de84a53aedeb20cdcd211a4 P ad362df39b114ec3a3a419128097b362 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:21.236569 12515 raft_consensus.cc:2272] T 7d2a60078de84a53aedeb20cdcd211a4 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:21.238914 12515 tablet_replica.cc:333] T 3e977ea0483d4c029394b273e7c4e90f P ad362df39b114ec3a3a419128097b362: stopping tablet replica
I20260709 12:15:21.239509 12515 raft_consensus.cc:2243] T 3e977ea0483d4c029394b273e7c4e90f P ad362df39b114ec3a3a419128097b362 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:21.240448 12515 raft_consensus.cc:2272] T 3e977ea0483d4c029394b273e7c4e90f P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:21.242561 12515 tablet_replica.cc:333] T e24b175869274d33ade73761b6f23ca4 P ad362df39b114ec3a3a419128097b362: stopping tablet replica
I20260709 12:15:21.243149 12515 raft_consensus.cc:2243] T e24b175869274d33ade73761b6f23ca4 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:21.243640 12515 raft_consensus.cc:2272] T e24b175869274d33ade73761b6f23ca4 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:21.245975 12515 tablet_replica.cc:333] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P ad362df39b114ec3a3a419128097b362: stopping tablet replica
I20260709 12:15:21.246563 12515 raft_consensus.cc:2243] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P ad362df39b114ec3a3a419128097b362 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:21.247507 12515 raft_consensus.cc:2272] T 1b9a17cccc4f4ca79468bb6b4e904ec8 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:21.249913 12515 tablet_replica.cc:333] T 7c84013312e3409d851214e9954dad8b P ad362df39b114ec3a3a419128097b362: stopping tablet replica
I20260709 12:15:21.250499 12515 raft_consensus.cc:2243] T 7c84013312e3409d851214e9954dad8b P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:21.250991 12515 raft_consensus.cc:2272] T 7c84013312e3409d851214e9954dad8b P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:21.253186 12515 tablet_replica.cc:333] T 4b1c850a65b748c093c5c88aa94fed71 P ad362df39b114ec3a3a419128097b362: stopping tablet replica
I20260709 12:15:21.253815 12515 raft_consensus.cc:2243] T 4b1c850a65b748c093c5c88aa94fed71 P ad362df39b114ec3a3a419128097b362 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:21.254388 12515 raft_consensus.cc:2272] T 4b1c850a65b748c093c5c88aa94fed71 P ad362df39b114ec3a3a419128097b362 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:21.256505 12515 tablet_replica.cc:333] T 93ece38976574ad7a5e93a69c33c074d P ad362df39b114ec3a3a419128097b362: stopping tablet replica
I20260709 12:15:21.257050 12515 raft_consensus.cc:2243] T 93ece38976574ad7a5e93a69c33c074d P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:21.257591 12515 raft_consensus.cc:2272] T 93ece38976574ad7a5e93a69c33c074d P ad362df39b114ec3a3a419128097b362 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:21.259814 12515 tablet_replica.cc:333] T 477aafe049fa4b1182fb0afe55fe5e55 P ad362df39b114ec3a3a419128097b362: stopping tablet replica
I20260709 12:15:21.260533 12515 raft_consensus.cc:2243] T 477aafe049fa4b1182fb0afe55fe5e55 P ad362df39b114ec3a3a419128097b362 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:21.261082 12515 raft_consensus.cc:2272] T 477aafe049fa4b1182fb0afe55fe5e55 P ad362df39b114ec3a3a419128097b362 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:21.263307 12515 tablet_replica.cc:333] T 9c40e590be9d4c3eac0ddd7f96278894 P ad362df39b114ec3a3a419128097b362: stopping tablet replica
I20260709 12:15:21.263826 12515 raft_consensus.cc:2243] T 9c40e590be9d4c3eac0ddd7f96278894 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:21.264307 12515 raft_consensus.cc:2272] T 9c40e590be9d4c3eac0ddd7f96278894 P ad362df39b114ec3a3a419128097b362 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:21.346174 12515 tablet_server.cc:196] TabletServer@127.12.56.196:0 shutdown complete.
I20260709 12:15:21.414680 12515 master.cc:562] Master@127.12.56.254:39861 shutting down...
I20260709 12:15:21.445616 12515 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 0a5582756e6b400ba8fd562c370ea634 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:21.446275 12515 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 0a5582756e6b400ba8fd562c370ea634 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:21.446583 12515 tablet_replica.cc:333] T 00000000000000000000000000000000 P 0a5582756e6b400ba8fd562c370ea634: stopping tablet replica
I20260709 12:15:21.471202 12515 master.cc:584] Master@127.12.56.254:39861 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (39427 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 12:15:21.569149 12515 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.12.56.254:44255
I20260709 12:15:21.570703 12515 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:21.576743 25541 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:21.577050 25542 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:21.577525 25544 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:21.578502 12515 server_base.cc:1061] running on GCE node
I20260709 12:15:21.579770 12515 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:21.580045 12515 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:21.580243 12515 hybrid_clock.cc:648] HybridClock initialized: now 1783599321580201 us; error 0 us; skew 500 ppm
I20260709 12:15:21.581027 12515 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:21.584407 12515 webserver.cc:533] Webserver started at http://127.12.56.254:41993/ using document root <none> and password file <none>
I20260709 12:15:21.584993 12515 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:21.585191 12515 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:21.585507 12515 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:21.586805 12515 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894707649-12515-0/minicluster-data/master-0-root/instance:
uuid: "e7aa3ebaab6a45c6be6cde40a1b53e46"
format_stamp: "Formatted at 2026-07-09 12:15:21 on dist-test-slave-705g"
I20260709 12:15:21.591604 12515 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 12:15:21.595409 25549 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:21.596210 12515 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:15:21.596510 12515 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894707649-12515-0/minicluster-data/master-0-root
uuid: "e7aa3ebaab6a45c6be6cde40a1b53e46"
format_stamp: "Formatted at 2026-07-09 12:15:21 on dist-test-slave-705g"
I20260709 12:15:21.596797 12515 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894707649-12515-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894707649-12515-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894707649-12515-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:21.626391 12515 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:21.627699 12515 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:21.668649 12515 rpc_server.cc:307] RPC server started. Bound to: 127.12.56.254:44255
I20260709 12:15:21.668751 25600 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.56.254:44255 every 8 connection(s)
I20260709 12:15:21.672901 25601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:21.684675 25601 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7aa3ebaab6a45c6be6cde40a1b53e46: Bootstrap starting.
I20260709 12:15:21.689715 25601 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e7aa3ebaab6a45c6be6cde40a1b53e46: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:21.694509 25601 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7aa3ebaab6a45c6be6cde40a1b53e46: No bootstrap required, opened a new log
I20260709 12:15:21.696849 25601 raft_consensus.cc:359] T 00000000000000000000000000000000 P e7aa3ebaab6a45c6be6cde40a1b53e46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7aa3ebaab6a45c6be6cde40a1b53e46" member_type: VOTER }
I20260709 12:15:21.697278 25601 raft_consensus.cc:385] T 00000000000000000000000000000000 P e7aa3ebaab6a45c6be6cde40a1b53e46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:21.697466 25601 raft_consensus.cc:740] T 00000000000000000000000000000000 P e7aa3ebaab6a45c6be6cde40a1b53e46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7aa3ebaab6a45c6be6cde40a1b53e46, State: Initialized, Role: FOLLOWER
I20260709 12:15:21.698065 25601 consensus_queue.cc:260] T 00000000000000000000000000000000 P e7aa3ebaab6a45c6be6cde40a1b53e46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7aa3ebaab6a45c6be6cde40a1b53e46" member_type: VOTER }
I20260709 12:15:21.698525 25601 raft_consensus.cc:399] T 00000000000000000000000000000000 P e7aa3ebaab6a45c6be6cde40a1b53e46 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:15:21.698741 25601 raft_consensus.cc:493] T 00000000000000000000000000000000 P e7aa3ebaab6a45c6be6cde40a1b53e46 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:15:21.698967 25601 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e7aa3ebaab6a45c6be6cde40a1b53e46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:21.704119 25601 raft_consensus.cc:515] T 00000000000000000000000000000000 P e7aa3ebaab6a45c6be6cde40a1b53e46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7aa3ebaab6a45c6be6cde40a1b53e46" member_type: VOTER }
I20260709 12:15:21.704691 25601 leader_election.cc:304] T 00000000000000000000000000000000 P e7aa3ebaab6a45c6be6cde40a1b53e46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e7aa3ebaab6a45c6be6cde40a1b53e46; no voters: 
I20260709 12:15:21.705976 25601 leader_election.cc:290] T 00000000000000000000000000000000 P e7aa3ebaab6a45c6be6cde40a1b53e46 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:15:21.706547 25604 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e7aa3ebaab6a45c6be6cde40a1b53e46 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:21.708017 25604 raft_consensus.cc:697] T 00000000000000000000000000000000 P e7aa3ebaab6a45c6be6cde40a1b53e46 [term 1 LEADER]: Becoming Leader. State: Replica: e7aa3ebaab6a45c6be6cde40a1b53e46, State: Running, Role: LEADER
I20260709 12:15:21.708797 25604 consensus_queue.cc:237] T 00000000000000000000000000000000 P e7aa3ebaab6a45c6be6cde40a1b53e46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7aa3ebaab6a45c6be6cde40a1b53e46" member_type: VOTER }
I20260709 12:15:21.709041 25601 sys_catalog.cc:565] T 00000000000000000000000000000000 P e7aa3ebaab6a45c6be6cde40a1b53e46 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:15:21.714591 25605 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7aa3ebaab6a45c6be6cde40a1b53e46 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e7aa3ebaab6a45c6be6cde40a1b53e46" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7aa3ebaab6a45c6be6cde40a1b53e46" member_type: VOTER } }
I20260709 12:15:21.714668 25606 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7aa3ebaab6a45c6be6cde40a1b53e46 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e7aa3ebaab6a45c6be6cde40a1b53e46. Latest consensus state: current_term: 1 leader_uuid: "e7aa3ebaab6a45c6be6cde40a1b53e46" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7aa3ebaab6a45c6be6cde40a1b53e46" member_type: VOTER } }
I20260709 12:15:21.715773 25605 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7aa3ebaab6a45c6be6cde40a1b53e46 [sys.catalog]: This master's current role is: LEADER
I20260709 12:15:21.715793 25606 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7aa3ebaab6a45c6be6cde40a1b53e46 [sys.catalog]: This master's current role is: LEADER
I20260709 12:15:21.719049 25612 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:15:21.724538 25612 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:15:21.726864 12515 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:15:21.734323 25612 catalog_manager.cc:1383] Generated new cluster ID: 8ca5d33b73394d5ea3ca0e30eaa30ed9
I20260709 12:15:21.734669 25612 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:15:21.763064 25612 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:15:21.764436 25612 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:15:21.779121 25612 catalog_manager.cc:6070] T 00000000000000000000000000000000 P e7aa3ebaab6a45c6be6cde40a1b53e46: Generated new TSK 0
I20260709 12:15:21.779882 25612 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:15:21.793587 12515 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:21.800771 25622 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:21.801617 25623 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:21.804262 12515 server_base.cc:1061] running on GCE node
W20260709 12:15:21.804525 25625 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:21.805660 12515 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:21.805922 12515 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:21.806115 12515 hybrid_clock.cc:648] HybridClock initialized: now 1783599321806100 us; error 0 us; skew 500 ppm
I20260709 12:15:21.806720 12515 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:21.809201 12515 webserver.cc:533] Webserver started at http://127.12.56.193:43449/ using document root <none> and password file <none>
I20260709 12:15:21.809814 12515 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:21.810034 12515 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:21.810333 12515 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:21.811527 12515 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894707649-12515-0/minicluster-data/ts-0-root/instance:
uuid: "521c8650b93e4a7fa1905efd229fbdf6"
format_stamp: "Formatted at 2026-07-09 12:15:21 on dist-test-slave-705g"
I20260709 12:15:21.816660 12515 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:15:21.820722 25630 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:21.821692 12515 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:15:21.822132 12515 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894707649-12515-0/minicluster-data/ts-0-root
uuid: "521c8650b93e4a7fa1905efd229fbdf6"
format_stamp: "Formatted at 2026-07-09 12:15:21 on dist-test-slave-705g"
I20260709 12:15:21.822469 12515 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894707649-12515-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894707649-12515-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894707649-12515-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:21.836753 12515 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:21.838315 12515 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:21.840077 12515 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:21.843319 12515 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:21.843580 12515 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:21.843863 12515 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:21.844076 12515 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:21.890802 12515 rpc_server.cc:307] RPC server started. Bound to: 127.12.56.193:37441
I20260709 12:15:21.890954 25692 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.56.193:37441 every 8 connection(s)
I20260709 12:15:21.896456 12515 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:21.904517 25697 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:21.904654 25698 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:21.909139 12515 server_base.cc:1061] running on GCE node
W20260709 12:15:21.909339 25700 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:21.910368 25693 heartbeater.cc:344] Connected to a master server at 127.12.56.254:44255
I20260709 12:15:21.910884 25693 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:21.911270 12515 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:21.911592 12515 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:21.911687 25693 heartbeater.cc:507] Master 127.12.56.254:44255 requested a full tablet report, sending...
I20260709 12:15:21.911765 12515 hybrid_clock.cc:648] HybridClock initialized: now 1783599321911749 us; error 0 us; skew 500 ppm
I20260709 12:15:21.912568 12515 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:21.914395 25566 ts_manager.cc:194] Registered new tserver with Master: 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441)
I20260709 12:15:21.915900 12515 webserver.cc:533] Webserver started at http://127.12.56.194:45987/ using document root <none> and password file <none>
I20260709 12:15:21.916692 12515 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:21.916934 12515 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:21.917121 25566 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39782
I20260709 12:15:21.917270 12515 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:21.919157 12515 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894707649-12515-0/minicluster-data/ts-1-root/instance:
uuid: "fbdbc1633300449fb2b7c46f43bde744"
format_stamp: "Formatted at 2026-07-09 12:15:21 on dist-test-slave-705g"
I20260709 12:15:21.924146 12515 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.005s
I20260709 12:15:21.928061 25705 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:21.929139 12515 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:15:21.929469 12515 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894707649-12515-0/minicluster-data/ts-1-root
uuid: "fbdbc1633300449fb2b7c46f43bde744"
format_stamp: "Formatted at 2026-07-09 12:15:21 on dist-test-slave-705g"
I20260709 12:15:21.929823 12515 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894707649-12515-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894707649-12515-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894707649-12515-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:21.941481 12515 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:21.942924 12515 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:21.944500 12515 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:21.946849 12515 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:21.947088 12515 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:21.947352 12515 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:21.947538 12515 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:21.992328 12515 rpc_server.cc:307] RPC server started. Bound to: 127.12.56.194:37715
I20260709 12:15:21.992458 25767 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.56.194:37715 every 8 connection(s)
I20260709 12:15:21.997321 12515 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:22.005383 25771 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:22.010524 25772 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:22.012653 25774 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:22.013271 25768 heartbeater.cc:344] Connected to a master server at 127.12.56.254:44255
I20260709 12:15:22.013738 12515 server_base.cc:1061] running on GCE node
I20260709 12:15:22.013860 25768 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:22.015224 25768 heartbeater.cc:507] Master 127.12.56.254:44255 requested a full tablet report, sending...
I20260709 12:15:22.015231 12515 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:22.015760 12515 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:22.016011 12515 hybrid_clock.cc:648] HybridClock initialized: now 1783599322015992 us; error 0 us; skew 500 ppm
I20260709 12:15:22.016848 12515 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:22.018283 25566 ts_manager.cc:194] Registered new tserver with Master: fbdbc1633300449fb2b7c46f43bde744 (127.12.56.194:37715)
I20260709 12:15:22.020318 25566 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39784
I20260709 12:15:22.020483 12515 webserver.cc:533] Webserver started at http://127.12.56.195:40073/ using document root <none> and password file <none>
I20260709 12:15:22.021404 12515 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:22.021675 12515 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:22.022028 12515 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:22.023428 12515 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894707649-12515-0/minicluster-data/ts-2-root/instance:
uuid: "2b0ac7cec35b445bbfbfff828cdedfcf"
format_stamp: "Formatted at 2026-07-09 12:15:22 on dist-test-slave-705g"
I20260709 12:15:22.028750 12515 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:15:22.033027 25779 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:22.034006 12515 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:15:22.034379 12515 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894707649-12515-0/minicluster-data/ts-2-root
uuid: "2b0ac7cec35b445bbfbfff828cdedfcf"
format_stamp: "Formatted at 2026-07-09 12:15:22 on dist-test-slave-705g"
I20260709 12:15:22.034713 12515 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894707649-12515-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894707649-12515-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894707649-12515-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:22.061131 12515 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:22.062525 12515 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:22.064083 12515 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:22.066594 12515 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:22.066864 12515 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:22.067117 12515 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:22.067294 12515 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:22.112537 12515 rpc_server.cc:307] RPC server started. Bound to: 127.12.56.195:36129
I20260709 12:15:22.112636 25841 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.56.195:36129 every 8 connection(s)
I20260709 12:15:22.127575 25842 heartbeater.cc:344] Connected to a master server at 127.12.56.254:44255
I20260709 12:15:22.128077 25842 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:22.128922 25842 heartbeater.cc:507] Master 127.12.56.254:44255 requested a full tablet report, sending...
I20260709 12:15:22.131220 25566 ts_manager.cc:194] Registered new tserver with Master: 2b0ac7cec35b445bbfbfff828cdedfcf (127.12.56.195:36129)
I20260709 12:15:22.132124 12515 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016333991s
I20260709 12:15:22.133062 25566 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39790
I20260709 12:15:22.161765 25566 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39806:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:15:22.165066 25566 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:15:22.240971 25807 tablet_service.cc:1511] Processing CreateTablet for tablet 032e30d956ec4c6c90f1ba5db5504a5d (DEFAULT_TABLE table=test-workload [id=68720775143046c2ba9c40f1584c8d2a]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:15:22.242916 25807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 032e30d956ec4c6c90f1ba5db5504a5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.247795 25806 tablet_service.cc:1511] Processing CreateTablet for tablet 78c784ca806e4871a483636451018b1e (DEFAULT_TABLE table=test-workload [id=68720775143046c2ba9c40f1584c8d2a]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:15:22.249507 25806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78c784ca806e4871a483636451018b1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.249120 25733 tablet_service.cc:1511] Processing CreateTablet for tablet 032e30d956ec4c6c90f1ba5db5504a5d (DEFAULT_TABLE table=test-workload [id=68720775143046c2ba9c40f1584c8d2a]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:15:22.250801 25733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 032e30d956ec4c6c90f1ba5db5504a5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.253650 25732 tablet_service.cc:1511] Processing CreateTablet for tablet 78c784ca806e4871a483636451018b1e (DEFAULT_TABLE table=test-workload [id=68720775143046c2ba9c40f1584c8d2a]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:15:22.255945 25805 tablet_service.cc:1511] Processing CreateTablet for tablet ccfca33043a14a9089a3c59b29c3b442 (DEFAULT_TABLE table=test-workload [id=68720775143046c2ba9c40f1584c8d2a]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:15:22.257488 25805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccfca33043a14a9089a3c59b29c3b442. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.257120 25731 tablet_service.cc:1511] Processing CreateTablet for tablet ccfca33043a14a9089a3c59b29c3b442 (DEFAULT_TABLE table=test-workload [id=68720775143046c2ba9c40f1584c8d2a]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:15:22.260341 25732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78c784ca806e4871a483636451018b1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.261593 25731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccfca33043a14a9089a3c59b29c3b442. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.270483 25804 tablet_service.cc:1511] Processing CreateTablet for tablet 47044718acc14024854627db0aed3d3e (DEFAULT_TABLE table=test-workload [id=68720775143046c2ba9c40f1584c8d2a]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:15:22.272107 25804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47044718acc14024854627db0aed3d3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.271848 25730 tablet_service.cc:1511] Processing CreateTablet for tablet 47044718acc14024854627db0aed3d3e (DEFAULT_TABLE table=test-workload [id=68720775143046c2ba9c40f1584c8d2a]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:15:22.273339 25730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47044718acc14024854627db0aed3d3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.287092 25729 tablet_service.cc:1511] Processing CreateTablet for tablet 2312590ea8034475b5d8d6cd73d3fce7 (DEFAULT_TABLE table=test-workload [id=68720775143046c2ba9c40f1584c8d2a]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:15:22.288552 25729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2312590ea8034475b5d8d6cd73d3fce7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.297696 25803 tablet_service.cc:1511] Processing CreateTablet for tablet 2312590ea8034475b5d8d6cd73d3fce7 (DEFAULT_TABLE table=test-workload [id=68720775143046c2ba9c40f1584c8d2a]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:15:22.298471 25658 tablet_service.cc:1511] Processing CreateTablet for tablet 032e30d956ec4c6c90f1ba5db5504a5d (DEFAULT_TABLE table=test-workload [id=68720775143046c2ba9c40f1584c8d2a]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:15:22.299394 25803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2312590ea8034475b5d8d6cd73d3fce7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.300062 25658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 032e30d956ec4c6c90f1ba5db5504a5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.303145 25657 tablet_service.cc:1511] Processing CreateTablet for tablet 78c784ca806e4871a483636451018b1e (DEFAULT_TABLE table=test-workload [id=68720775143046c2ba9c40f1584c8d2a]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:15:22.304808 25657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78c784ca806e4871a483636451018b1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.307140 25656 tablet_service.cc:1511] Processing CreateTablet for tablet ccfca33043a14a9089a3c59b29c3b442 (DEFAULT_TABLE table=test-workload [id=68720775143046c2ba9c40f1584c8d2a]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:15:22.309252 25656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccfca33043a14a9089a3c59b29c3b442. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.311167 25655 tablet_service.cc:1511] Processing CreateTablet for tablet 47044718acc14024854627db0aed3d3e (DEFAULT_TABLE table=test-workload [id=68720775143046c2ba9c40f1584c8d2a]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:15:22.312877 25655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47044718acc14024854627db0aed3d3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.318920 25654 tablet_service.cc:1511] Processing CreateTablet for tablet 2312590ea8034475b5d8d6cd73d3fce7 (DEFAULT_TABLE table=test-workload [id=68720775143046c2ba9c40f1584c8d2a]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:15:22.315471 25653 tablet_service.cc:1511] Processing CreateTablet for tablet f2d3c8d7f2cc4c46ada3179f069388a8 (DEFAULT_TABLE table=test-workload [id=68720775143046c2ba9c40f1584c8d2a]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:15:22.334009 25733 tablet_service.cc:1511] Processing CreateTablet for tablet f2d3c8d7f2cc4c46ada3179f069388a8 (DEFAULT_TABLE table=test-workload [id=68720775143046c2ba9c40f1584c8d2a]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:15:22.335906 25733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2d3c8d7f2cc4c46ada3179f069388a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.337288 25654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2312590ea8034475b5d8d6cd73d3fce7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.339546 25652 tablet_service.cc:1511] Processing CreateTablet for tablet 019b400e387d48d09821b4a446577ede (DEFAULT_TABLE table=test-workload [id=68720775143046c2ba9c40f1584c8d2a]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:15:22.341070 25731 tablet_service.cc:1511] Processing CreateTablet for tablet 019b400e387d48d09821b4a446577ede (DEFAULT_TABLE table=test-workload [id=68720775143046c2ba9c40f1584c8d2a]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:15:22.342530 25731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 019b400e387d48d09821b4a446577ede. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.343333 25802 tablet_service.cc:1511] Processing CreateTablet for tablet 019b400e387d48d09821b4a446577ede (DEFAULT_TABLE table=test-workload [id=68720775143046c2ba9c40f1584c8d2a]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:15:22.341101 25652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 019b400e387d48d09821b4a446577ede. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.344827 25802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 019b400e387d48d09821b4a446577ede. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.345819 25653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2d3c8d7f2cc4c46ada3179f069388a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.348886 25651 tablet_service.cc:1511] Processing CreateTablet for tablet 06be549acfdb46a9801ebced1ab5be4d (DEFAULT_TABLE table=test-workload [id=68720775143046c2ba9c40f1584c8d2a]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:15:22.350883 25651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06be549acfdb46a9801ebced1ab5be4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.358001 25806 tablet_service.cc:1511] Processing CreateTablet for tablet f2d3c8d7f2cc4c46ada3179f069388a8 (DEFAULT_TABLE table=test-workload [id=68720775143046c2ba9c40f1584c8d2a]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:15:22.361342 25806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2d3c8d7f2cc4c46ada3179f069388a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.367573 25857 tablet_bootstrap.cc:492] T 032e30d956ec4c6c90f1ba5db5504a5d P 2b0ac7cec35b445bbfbfff828cdedfcf: Bootstrap starting.
I20260709 12:15:22.373275 25858 tablet_bootstrap.cc:492] T 47044718acc14024854627db0aed3d3e P fbdbc1633300449fb2b7c46f43bde744: Bootstrap starting.
I20260709 12:15:22.373685 25807 tablet_service.cc:1511] Processing CreateTablet for tablet 06be549acfdb46a9801ebced1ab5be4d (DEFAULT_TABLE table=test-workload [id=68720775143046c2ba9c40f1584c8d2a]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:15:22.375349 25807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06be549acfdb46a9801ebced1ab5be4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.369683 25732 tablet_service.cc:1511] Processing CreateTablet for tablet 06be549acfdb46a9801ebced1ab5be4d (DEFAULT_TABLE table=test-workload [id=68720775143046c2ba9c40f1584c8d2a]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:15:22.379585 25732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06be549acfdb46a9801ebced1ab5be4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.385555 25650 tablet_service.cc:1511] Processing CreateTablet for tablet 2bc9ae2bf53c4c20a18fec7bc796dfb3 (DEFAULT_TABLE table=test-workload [id=68720775143046c2ba9c40f1584c8d2a]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:15:22.387141 25650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bc9ae2bf53c4c20a18fec7bc796dfb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.412895 25728 tablet_service.cc:1511] Processing CreateTablet for tablet 2bc9ae2bf53c4c20a18fec7bc796dfb3 (DEFAULT_TABLE table=test-workload [id=68720775143046c2ba9c40f1584c8d2a]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:15:22.422581 25728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bc9ae2bf53c4c20a18fec7bc796dfb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.431851 25801 tablet_service.cc:1511] Processing CreateTablet for tablet 2bc9ae2bf53c4c20a18fec7bc796dfb3 (DEFAULT_TABLE table=test-workload [id=68720775143046c2ba9c40f1584c8d2a]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:15:22.433454 25801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bc9ae2bf53c4c20a18fec7bc796dfb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.446336 25859 tablet_bootstrap.cc:492] T 019b400e387d48d09821b4a446577ede P 521c8650b93e4a7fa1905efd229fbdf6: Bootstrap starting.
I20260709 12:15:22.458320 25857 tablet_bootstrap.cc:654] T 032e30d956ec4c6c90f1ba5db5504a5d P 2b0ac7cec35b445bbfbfff828cdedfcf: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:22.466917 25655 tablet_service.cc:1511] Processing CreateTablet for tablet 6c0bcf651cbe40a59f93666829cbacd5 (DEFAULT_TABLE table=test-workload [id=68720775143046c2ba9c40f1584c8d2a]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:15:22.468534 25655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c0bcf651cbe40a59f93666829cbacd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.472319 25858 tablet_bootstrap.cc:654] T 47044718acc14024854627db0aed3d3e P fbdbc1633300449fb2b7c46f43bde744: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:22.477666 25728 tablet_service.cc:1511] Processing CreateTablet for tablet 6c0bcf651cbe40a59f93666829cbacd5 (DEFAULT_TABLE table=test-workload [id=68720775143046c2ba9c40f1584c8d2a]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:15:22.479404 25728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c0bcf651cbe40a59f93666829cbacd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.491012 25806 tablet_service.cc:1511] Processing CreateTablet for tablet 6c0bcf651cbe40a59f93666829cbacd5 (DEFAULT_TABLE table=test-workload [id=68720775143046c2ba9c40f1584c8d2a]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:15:22.492564 25806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c0bcf651cbe40a59f93666829cbacd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:22.505380 25859 tablet_bootstrap.cc:654] T 019b400e387d48d09821b4a446577ede P 521c8650b93e4a7fa1905efd229fbdf6: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:22.518422 25859 tablet_bootstrap.cc:492] T 019b400e387d48d09821b4a446577ede P 521c8650b93e4a7fa1905efd229fbdf6: No bootstrap required, opened a new log
I20260709 12:15:22.518561 25857 tablet_bootstrap.cc:492] T 032e30d956ec4c6c90f1ba5db5504a5d P 2b0ac7cec35b445bbfbfff828cdedfcf: No bootstrap required, opened a new log
I20260709 12:15:22.519198 25859 ts_tablet_manager.cc:1403] T 019b400e387d48d09821b4a446577ede P 521c8650b93e4a7fa1905efd229fbdf6: Time spent bootstrapping tablet: real 0.073s	user 0.011s	sys 0.007s
I20260709 12:15:22.519447 25857 ts_tablet_manager.cc:1403] T 032e30d956ec4c6c90f1ba5db5504a5d P 2b0ac7cec35b445bbfbfff828cdedfcf: Time spent bootstrapping tablet: real 0.152s	user 0.018s	sys 0.004s
I20260709 12:15:22.523396 25859 raft_consensus.cc:359] T 019b400e387d48d09821b4a446577ede P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:22.523572 25857 raft_consensus.cc:359] T 032e30d956ec4c6c90f1ba5db5504a5d P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } }
I20260709 12:15:22.524298 25859 raft_consensus.cc:385] T 019b400e387d48d09821b4a446577ede P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:22.524333 25857 raft_consensus.cc:385] T 032e30d956ec4c6c90f1ba5db5504a5d P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:22.524782 25859 raft_consensus.cc:740] T 019b400e387d48d09821b4a446577ede P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 521c8650b93e4a7fa1905efd229fbdf6, State: Initialized, Role: FOLLOWER
I20260709 12:15:22.524845 25857 raft_consensus.cc:740] T 032e30d956ec4c6c90f1ba5db5504a5d P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b0ac7cec35b445bbfbfff828cdedfcf, State: Initialized, Role: FOLLOWER
I20260709 12:15:22.524966 25858 tablet_bootstrap.cc:492] T 47044718acc14024854627db0aed3d3e P fbdbc1633300449fb2b7c46f43bde744: No bootstrap required, opened a new log
I20260709 12:15:22.525679 25858 ts_tablet_manager.cc:1403] T 47044718acc14024854627db0aed3d3e P fbdbc1633300449fb2b7c46f43bde744: Time spent bootstrapping tablet: real 0.153s	user 0.016s	sys 0.009s
I20260709 12:15:22.525852 25857 consensus_queue.cc:260] T 032e30d956ec4c6c90f1ba5db5504a5d P 2b0ac7cec35b445bbfbfff828cdedfcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } }
I20260709 12:15:22.525720 25859 consensus_queue.cc:260] T 019b400e387d48d09821b4a446577ede P 521c8650b93e4a7fa1905efd229fbdf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:22.528595 25842 heartbeater.cc:499] Master 127.12.56.254:44255 was elected leader, sending a full tablet report...
I20260709 12:15:22.529435 25857 ts_tablet_manager.cc:1434] T 032e30d956ec4c6c90f1ba5db5504a5d P 2b0ac7cec35b445bbfbfff828cdedfcf: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:15:22.529258 25858 raft_consensus.cc:359] T 47044718acc14024854627db0aed3d3e P fbdbc1633300449fb2b7c46f43bde744 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:22.530397 25858 raft_consensus.cc:385] T 47044718acc14024854627db0aed3d3e P fbdbc1633300449fb2b7c46f43bde744 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:22.530784 25858 raft_consensus.cc:740] T 47044718acc14024854627db0aed3d3e P fbdbc1633300449fb2b7c46f43bde744 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbdbc1633300449fb2b7c46f43bde744, State: Initialized, Role: FOLLOWER
I20260709 12:15:22.530961 25857 tablet_bootstrap.cc:492] T 78c784ca806e4871a483636451018b1e P 2b0ac7cec35b445bbfbfff828cdedfcf: Bootstrap starting.
I20260709 12:15:22.531633 25858 consensus_queue.cc:260] T 47044718acc14024854627db0aed3d3e P fbdbc1633300449fb2b7c46f43bde744 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:22.539003 25857 tablet_bootstrap.cc:654] T 78c784ca806e4871a483636451018b1e P 2b0ac7cec35b445bbfbfff828cdedfcf: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:22.543043 25859 ts_tablet_manager.cc:1434] T 019b400e387d48d09821b4a446577ede P 521c8650b93e4a7fa1905efd229fbdf6: Time spent starting tablet: real 0.023s	user 0.011s	sys 0.005s
I20260709 12:15:22.543475 25768 heartbeater.cc:499] Master 127.12.56.254:44255 was elected leader, sending a full tablet report...
I20260709 12:15:22.544317 25693 heartbeater.cc:499] Master 127.12.56.254:44255 was elected leader, sending a full tablet report...
I20260709 12:15:22.544114 25858 ts_tablet_manager.cc:1434] T 47044718acc14024854627db0aed3d3e P fbdbc1633300449fb2b7c46f43bde744: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.010s
I20260709 12:15:22.545888 25858 tablet_bootstrap.cc:492] T 78c784ca806e4871a483636451018b1e P fbdbc1633300449fb2b7c46f43bde744: Bootstrap starting.
I20260709 12:15:22.549562 25857 tablet_bootstrap.cc:492] T 78c784ca806e4871a483636451018b1e P 2b0ac7cec35b445bbfbfff828cdedfcf: No bootstrap required, opened a new log
I20260709 12:15:22.550384 25857 ts_tablet_manager.cc:1403] T 78c784ca806e4871a483636451018b1e P 2b0ac7cec35b445bbfbfff828cdedfcf: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.003s
I20260709 12:15:22.553648 25858 tablet_bootstrap.cc:654] T 78c784ca806e4871a483636451018b1e P fbdbc1633300449fb2b7c46f43bde744: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:22.554312 25857 raft_consensus.cc:359] T 78c784ca806e4871a483636451018b1e P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:22.555349 25857 raft_consensus.cc:385] T 78c784ca806e4871a483636451018b1e P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:22.555748 25857 raft_consensus.cc:740] T 78c784ca806e4871a483636451018b1e P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b0ac7cec35b445bbfbfff828cdedfcf, State: Initialized, Role: FOLLOWER
I20260709 12:15:22.556907 25857 consensus_queue.cc:260] T 78c784ca806e4871a483636451018b1e P 2b0ac7cec35b445bbfbfff828cdedfcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:22.560846 25857 ts_tablet_manager.cc:1434] T 78c784ca806e4871a483636451018b1e P 2b0ac7cec35b445bbfbfff828cdedfcf: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:15:22.562490 25857 tablet_bootstrap.cc:492] T f2d3c8d7f2cc4c46ada3179f069388a8 P 2b0ac7cec35b445bbfbfff828cdedfcf: Bootstrap starting.
I20260709 12:15:22.563444 25859 tablet_bootstrap.cc:492] T 47044718acc14024854627db0aed3d3e P 521c8650b93e4a7fa1905efd229fbdf6: Bootstrap starting.
I20260709 12:15:22.563844 25865 raft_consensus.cc:493] T 47044718acc14024854627db0aed3d3e P fbdbc1633300449fb2b7c46f43bde744 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:22.564646 25865 raft_consensus.cc:515] T 47044718acc14024854627db0aed3d3e P fbdbc1633300449fb2b7c46f43bde744 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:22.570659 25865 leader_election.cc:290] T 47044718acc14024854627db0aed3d3e P fbdbc1633300449fb2b7c46f43bde744 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441), 2b0ac7cec35b445bbfbfff828cdedfcf (127.12.56.195:36129)
I20260709 12:15:22.571702 25859 tablet_bootstrap.cc:654] T 47044718acc14024854627db0aed3d3e P 521c8650b93e4a7fa1905efd229fbdf6: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:22.580987 25857 tablet_bootstrap.cc:654] T f2d3c8d7f2cc4c46ada3179f069388a8 P 2b0ac7cec35b445bbfbfff828cdedfcf: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:22.604856 25858 tablet_bootstrap.cc:492] T 78c784ca806e4871a483636451018b1e P fbdbc1633300449fb2b7c46f43bde744: No bootstrap required, opened a new log
I20260709 12:15:22.605477 25858 ts_tablet_manager.cc:1403] T 78c784ca806e4871a483636451018b1e P fbdbc1633300449fb2b7c46f43bde744: Time spent bootstrapping tablet: real 0.060s	user 0.029s	sys 0.014s
I20260709 12:15:22.608824 25858 raft_consensus.cc:359] T 78c784ca806e4871a483636451018b1e P fbdbc1633300449fb2b7c46f43bde744 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:22.609619 25858 raft_consensus.cc:385] T 78c784ca806e4871a483636451018b1e P fbdbc1633300449fb2b7c46f43bde744 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:22.609975 25858 raft_consensus.cc:740] T 78c784ca806e4871a483636451018b1e P fbdbc1633300449fb2b7c46f43bde744 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbdbc1633300449fb2b7c46f43bde744, State: Initialized, Role: FOLLOWER
I20260709 12:15:22.610184 25668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47044718acc14024854627db0aed3d3e" candidate_uuid: "fbdbc1633300449fb2b7c46f43bde744" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "521c8650b93e4a7fa1905efd229fbdf6" is_pre_election: true
I20260709 12:15:22.611055 25858 consensus_queue.cc:260] T 78c784ca806e4871a483636451018b1e P fbdbc1633300449fb2b7c46f43bde744 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
W20260709 12:15:22.612089 25709 leader_election.cc:343] T 47044718acc14024854627db0aed3d3e P fbdbc1633300449fb2b7c46f43bde744 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:22.613412 25858 ts_tablet_manager.cc:1434] T 78c784ca806e4871a483636451018b1e P fbdbc1633300449fb2b7c46f43bde744: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:15:22.613869 25859 tablet_bootstrap.cc:492] T 47044718acc14024854627db0aed3d3e P 521c8650b93e4a7fa1905efd229fbdf6: No bootstrap required, opened a new log
I20260709 12:15:22.614516 25858 tablet_bootstrap.cc:492] T ccfca33043a14a9089a3c59b29c3b442 P fbdbc1633300449fb2b7c46f43bde744: Bootstrap starting.
I20260709 12:15:22.614713 25859 ts_tablet_manager.cc:1403] T 47044718acc14024854627db0aed3d3e P 521c8650b93e4a7fa1905efd229fbdf6: Time spent bootstrapping tablet: real 0.051s	user 0.012s	sys 0.009s
W20260709 12:15:22.616986 25843 tablet.cc:2406] T 032e30d956ec4c6c90f1ba5db5504a5d P 2b0ac7cec35b445bbfbfff828cdedfcf: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:15:22.620604 25859 raft_consensus.cc:359] T 47044718acc14024854627db0aed3d3e P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:22.621821 25859 raft_consensus.cc:385] T 47044718acc14024854627db0aed3d3e P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:22.622047 25858 tablet_bootstrap.cc:654] T ccfca33043a14a9089a3c59b29c3b442 P fbdbc1633300449fb2b7c46f43bde744: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:22.622330 25859 raft_consensus.cc:740] T 47044718acc14024854627db0aed3d3e P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 521c8650b93e4a7fa1905efd229fbdf6, State: Initialized, Role: FOLLOWER
I20260709 12:15:22.623590 25859 consensus_queue.cc:260] T 47044718acc14024854627db0aed3d3e P 521c8650b93e4a7fa1905efd229fbdf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:22.627238 25857 tablet_bootstrap.cc:492] T f2d3c8d7f2cc4c46ada3179f069388a8 P 2b0ac7cec35b445bbfbfff828cdedfcf: No bootstrap required, opened a new log
I20260709 12:15:22.627908 25857 ts_tablet_manager.cc:1403] T f2d3c8d7f2cc4c46ada3179f069388a8 P 2b0ac7cec35b445bbfbfff828cdedfcf: Time spent bootstrapping tablet: real 0.066s	user 0.022s	sys 0.022s
I20260709 12:15:22.631788 25857 raft_consensus.cc:359] T f2d3c8d7f2cc4c46ada3179f069388a8 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:22.632792 25857 raft_consensus.cc:385] T f2d3c8d7f2cc4c46ada3179f069388a8 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:22.633155 25857 raft_consensus.cc:740] T f2d3c8d7f2cc4c46ada3179f069388a8 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b0ac7cec35b445bbfbfff828cdedfcf, State: Initialized, Role: FOLLOWER
I20260709 12:15:22.633920 25817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47044718acc14024854627db0aed3d3e" candidate_uuid: "fbdbc1633300449fb2b7c46f43bde744" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" is_pre_election: true
I20260709 12:15:22.634159 25857 consensus_queue.cc:260] T f2d3c8d7f2cc4c46ada3179f069388a8 P 2b0ac7cec35b445bbfbfff828cdedfcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
W20260709 12:15:22.636008 25708 leader_election.cc:343] T 47044718acc14024854627db0aed3d3e P fbdbc1633300449fb2b7c46f43bde744 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b0ac7cec35b445bbfbfff828cdedfcf (127.12.56.195:36129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:22.636507 25708 leader_election.cc:304] T 47044718acc14024854627db0aed3d3e P fbdbc1633300449fb2b7c46f43bde744 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbdbc1633300449fb2b7c46f43bde744; no voters: 2b0ac7cec35b445bbfbfff828cdedfcf, 521c8650b93e4a7fa1905efd229fbdf6
I20260709 12:15:22.637497 25859 ts_tablet_manager.cc:1434] T 47044718acc14024854627db0aed3d3e P 521c8650b93e4a7fa1905efd229fbdf6: Time spent starting tablet: real 0.022s	user 0.011s	sys 0.001s
I20260709 12:15:22.637985 25865 raft_consensus.cc:2749] T 47044718acc14024854627db0aed3d3e P fbdbc1633300449fb2b7c46f43bde744 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:22.640396 25857 ts_tablet_manager.cc:1434] T f2d3c8d7f2cc4c46ada3179f069388a8 P 2b0ac7cec35b445bbfbfff828cdedfcf: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:15:22.641712 25857 tablet_bootstrap.cc:492] T ccfca33043a14a9089a3c59b29c3b442 P 2b0ac7cec35b445bbfbfff828cdedfcf: Bootstrap starting.
I20260709 12:15:22.642441 25859 tablet_bootstrap.cc:492] T f2d3c8d7f2cc4c46ada3179f069388a8 P 521c8650b93e4a7fa1905efd229fbdf6: Bootstrap starting.
I20260709 12:15:22.649379 25857 tablet_bootstrap.cc:654] T ccfca33043a14a9089a3c59b29c3b442 P 2b0ac7cec35b445bbfbfff828cdedfcf: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:22.656402 25858 tablet_bootstrap.cc:492] T ccfca33043a14a9089a3c59b29c3b442 P fbdbc1633300449fb2b7c46f43bde744: No bootstrap required, opened a new log
I20260709 12:15:22.656406 25859 tablet_bootstrap.cc:654] T f2d3c8d7f2cc4c46ada3179f069388a8 P 521c8650b93e4a7fa1905efd229fbdf6: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:22.656977 25858 ts_tablet_manager.cc:1403] T ccfca33043a14a9089a3c59b29c3b442 P fbdbc1633300449fb2b7c46f43bde744: Time spent bootstrapping tablet: real 0.043s	user 0.012s	sys 0.019s
I20260709 12:15:22.657047 25857 tablet_bootstrap.cc:492] T ccfca33043a14a9089a3c59b29c3b442 P 2b0ac7cec35b445bbfbfff828cdedfcf: No bootstrap required, opened a new log
I20260709 12:15:22.657667 25857 ts_tablet_manager.cc:1403] T ccfca33043a14a9089a3c59b29c3b442 P 2b0ac7cec35b445bbfbfff828cdedfcf: Time spent bootstrapping tablet: real 0.016s	user 0.006s	sys 0.007s
I20260709 12:15:22.659597 25858 raft_consensus.cc:359] T ccfca33043a14a9089a3c59b29c3b442 P fbdbc1633300449fb2b7c46f43bde744 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:22.660450 25858 raft_consensus.cc:385] T ccfca33043a14a9089a3c59b29c3b442 P fbdbc1633300449fb2b7c46f43bde744 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:22.660786 25858 raft_consensus.cc:740] T ccfca33043a14a9089a3c59b29c3b442 P fbdbc1633300449fb2b7c46f43bde744 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbdbc1633300449fb2b7c46f43bde744, State: Initialized, Role: FOLLOWER
I20260709 12:15:22.661018 25857 raft_consensus.cc:359] T ccfca33043a14a9089a3c59b29c3b442 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:22.661579 25858 consensus_queue.cc:260] T ccfca33043a14a9089a3c59b29c3b442 P fbdbc1633300449fb2b7c46f43bde744 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:22.661928 25857 raft_consensus.cc:385] T ccfca33043a14a9089a3c59b29c3b442 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:22.662393 25857 raft_consensus.cc:740] T ccfca33043a14a9089a3c59b29c3b442 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b0ac7cec35b445bbfbfff828cdedfcf, State: Initialized, Role: FOLLOWER
I20260709 12:15:22.662698 25859 tablet_bootstrap.cc:492] T f2d3c8d7f2cc4c46ada3179f069388a8 P 521c8650b93e4a7fa1905efd229fbdf6: No bootstrap required, opened a new log
I20260709 12:15:22.663244 25859 ts_tablet_manager.cc:1403] T f2d3c8d7f2cc4c46ada3179f069388a8 P 521c8650b93e4a7fa1905efd229fbdf6: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.007s
I20260709 12:15:22.663851 25858 ts_tablet_manager.cc:1434] T ccfca33043a14a9089a3c59b29c3b442 P fbdbc1633300449fb2b7c46f43bde744: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:15:22.663497 25857 consensus_queue.cc:260] T ccfca33043a14a9089a3c59b29c3b442 P 2b0ac7cec35b445bbfbfff828cdedfcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:22.664930 25858 tablet_bootstrap.cc:492] T 032e30d956ec4c6c90f1ba5db5504a5d P fbdbc1633300449fb2b7c46f43bde744: Bootstrap starting.
I20260709 12:15:22.668533 25857 ts_tablet_manager.cc:1434] T ccfca33043a14a9089a3c59b29c3b442 P 2b0ac7cec35b445bbfbfff828cdedfcf: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:15:22.669871 25857 tablet_bootstrap.cc:492] T 47044718acc14024854627db0aed3d3e P 2b0ac7cec35b445bbfbfff828cdedfcf: Bootstrap starting.
I20260709 12:15:22.671964 25858 tablet_bootstrap.cc:654] T 032e30d956ec4c6c90f1ba5db5504a5d P fbdbc1633300449fb2b7c46f43bde744: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:22.677533 25857 tablet_bootstrap.cc:654] T 47044718acc14024854627db0aed3d3e P 2b0ac7cec35b445bbfbfff828cdedfcf: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:22.680346 25858 tablet_bootstrap.cc:492] T 032e30d956ec4c6c90f1ba5db5504a5d P fbdbc1633300449fb2b7c46f43bde744: No bootstrap required, opened a new log
I20260709 12:15:22.680899 25858 ts_tablet_manager.cc:1403] T 032e30d956ec4c6c90f1ba5db5504a5d P fbdbc1633300449fb2b7c46f43bde744: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.003s
I20260709 12:15:22.674691 25859 raft_consensus.cc:359] T f2d3c8d7f2cc4c46ada3179f069388a8 P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:22.682452 25859 raft_consensus.cc:385] T f2d3c8d7f2cc4c46ada3179f069388a8 P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:22.682961 25859 raft_consensus.cc:740] T f2d3c8d7f2cc4c46ada3179f069388a8 P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 521c8650b93e4a7fa1905efd229fbdf6, State: Initialized, Role: FOLLOWER
I20260709 12:15:22.684167 25858 raft_consensus.cc:359] T 032e30d956ec4c6c90f1ba5db5504a5d P fbdbc1633300449fb2b7c46f43bde744 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } }
I20260709 12:15:22.683954 25859 consensus_queue.cc:260] T f2d3c8d7f2cc4c46ada3179f069388a8 P 521c8650b93e4a7fa1905efd229fbdf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:22.684808 25858 raft_consensus.cc:385] T 032e30d956ec4c6c90f1ba5db5504a5d P fbdbc1633300449fb2b7c46f43bde744 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:22.685101 25858 raft_consensus.cc:740] T 032e30d956ec4c6c90f1ba5db5504a5d P fbdbc1633300449fb2b7c46f43bde744 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbdbc1633300449fb2b7c46f43bde744, State: Initialized, Role: FOLLOWER
I20260709 12:15:22.686175 25857 tablet_bootstrap.cc:492] T 47044718acc14024854627db0aed3d3e P 2b0ac7cec35b445bbfbfff828cdedfcf: No bootstrap required, opened a new log
I20260709 12:15:22.685992 25858 consensus_queue.cc:260] T 032e30d956ec4c6c90f1ba5db5504a5d P fbdbc1633300449fb2b7c46f43bde744 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } }
I20260709 12:15:22.686658 25859 ts_tablet_manager.cc:1434] T f2d3c8d7f2cc4c46ada3179f069388a8 P 521c8650b93e4a7fa1905efd229fbdf6: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.006s
I20260709 12:15:22.686887 25857 ts_tablet_manager.cc:1403] T 47044718acc14024854627db0aed3d3e P 2b0ac7cec35b445bbfbfff828cdedfcf: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.003s
I20260709 12:15:22.687966 25859 tablet_bootstrap.cc:492] T 78c784ca806e4871a483636451018b1e P 521c8650b93e4a7fa1905efd229fbdf6: Bootstrap starting.
I20260709 12:15:22.688699 25858 ts_tablet_manager.cc:1434] T 032e30d956ec4c6c90f1ba5db5504a5d P fbdbc1633300449fb2b7c46f43bde744: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:15:22.689841 25858 tablet_bootstrap.cc:492] T f2d3c8d7f2cc4c46ada3179f069388a8 P fbdbc1633300449fb2b7c46f43bde744: Bootstrap starting.
I20260709 12:15:22.690707 25857 raft_consensus.cc:359] T 47044718acc14024854627db0aed3d3e P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:22.691673 25857 raft_consensus.cc:385] T 47044718acc14024854627db0aed3d3e P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:22.692082 25857 raft_consensus.cc:740] T 47044718acc14024854627db0aed3d3e P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b0ac7cec35b445bbfbfff828cdedfcf, State: Initialized, Role: FOLLOWER
I20260709 12:15:22.693189 25857 consensus_queue.cc:260] T 47044718acc14024854627db0aed3d3e P 2b0ac7cec35b445bbfbfff828cdedfcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:22.696569 25859 tablet_bootstrap.cc:654] T 78c784ca806e4871a483636451018b1e P 521c8650b93e4a7fa1905efd229fbdf6: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:22.697331 25858 tablet_bootstrap.cc:654] T f2d3c8d7f2cc4c46ada3179f069388a8 P fbdbc1633300449fb2b7c46f43bde744: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:22.699980 25857 ts_tablet_manager.cc:1434] T 47044718acc14024854627db0aed3d3e P 2b0ac7cec35b445bbfbfff828cdedfcf: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:15:22.701556 25857 tablet_bootstrap.cc:492] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P 2b0ac7cec35b445bbfbfff828cdedfcf: Bootstrap starting.
I20260709 12:15:22.708465 25865 raft_consensus.cc:493] T ccfca33043a14a9089a3c59b29c3b442 P fbdbc1633300449fb2b7c46f43bde744 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:22.709091 25865 raft_consensus.cc:515] T ccfca33043a14a9089a3c59b29c3b442 P fbdbc1633300449fb2b7c46f43bde744 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:22.712153 25668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfca33043a14a9089a3c59b29c3b442" candidate_uuid: "fbdbc1633300449fb2b7c46f43bde744" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "521c8650b93e4a7fa1905efd229fbdf6" is_pre_election: true
I20260709 12:15:22.712316 25859 tablet_bootstrap.cc:492] T 78c784ca806e4871a483636451018b1e P 521c8650b93e4a7fa1905efd229fbdf6: No bootstrap required, opened a new log
I20260709 12:15:22.712532 25817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfca33043a14a9089a3c59b29c3b442" candidate_uuid: "fbdbc1633300449fb2b7c46f43bde744" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" is_pre_election: true
I20260709 12:15:22.713145 25859 ts_tablet_manager.cc:1403] T 78c784ca806e4871a483636451018b1e P 521c8650b93e4a7fa1905efd229fbdf6: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.008s
I20260709 12:15:22.713245 25817 raft_consensus.cc:2468] T ccfca33043a14a9089a3c59b29c3b442 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbdbc1633300449fb2b7c46f43bde744 in term 0.
W20260709 12:15:22.713816 25709 leader_election.cc:343] T ccfca33043a14a9089a3c59b29c3b442 P fbdbc1633300449fb2b7c46f43bde744 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:22.714699 25708 leader_election.cc:304] T ccfca33043a14a9089a3c59b29c3b442 P fbdbc1633300449fb2b7c46f43bde744 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b0ac7cec35b445bbfbfff828cdedfcf, fbdbc1633300449fb2b7c46f43bde744; no voters: 521c8650b93e4a7fa1905efd229fbdf6
I20260709 12:15:22.715766 25857 tablet_bootstrap.cc:654] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P 2b0ac7cec35b445bbfbfff828cdedfcf: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:22.716347 25879 raft_consensus.cc:2804] T ccfca33043a14a9089a3c59b29c3b442 P fbdbc1633300449fb2b7c46f43bde744 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:22.718781 25879 raft_consensus.cc:493] T ccfca33043a14a9089a3c59b29c3b442 P fbdbc1633300449fb2b7c46f43bde744 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:22.719175 25879 raft_consensus.cc:3060] T ccfca33043a14a9089a3c59b29c3b442 P fbdbc1633300449fb2b7c46f43bde744 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:22.717046 25859 raft_consensus.cc:359] T 78c784ca806e4871a483636451018b1e P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:22.720688 25865 leader_election.cc:290] T ccfca33043a14a9089a3c59b29c3b442 P fbdbc1633300449fb2b7c46f43bde744 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441), 2b0ac7cec35b445bbfbfff828cdedfcf (127.12.56.195:36129)
I20260709 12:15:22.720480 25859 raft_consensus.cc:385] T 78c784ca806e4871a483636451018b1e P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:15:22.722801 25614 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:22.722923 25859 raft_consensus.cc:740] T 78c784ca806e4871a483636451018b1e P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 521c8650b93e4a7fa1905efd229fbdf6, State: Initialized, Role: FOLLOWER
I20260709 12:15:22.723821 25857 tablet_bootstrap.cc:492] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P 2b0ac7cec35b445bbfbfff828cdedfcf: No bootstrap required, opened a new log
I20260709 12:15:22.724502 25857 ts_tablet_manager.cc:1403] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P 2b0ac7cec35b445bbfbfff828cdedfcf: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.006s
I20260709 12:15:22.726210 25858 tablet_bootstrap.cc:492] T f2d3c8d7f2cc4c46ada3179f069388a8 P fbdbc1633300449fb2b7c46f43bde744: No bootstrap required, opened a new log
I20260709 12:15:22.726799 25858 ts_tablet_manager.cc:1403] T f2d3c8d7f2cc4c46ada3179f069388a8 P fbdbc1633300449fb2b7c46f43bde744: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.007s
I20260709 12:15:22.727484 25857 raft_consensus.cc:359] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:22.728271 25857 raft_consensus.cc:385] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:22.728574 25857 raft_consensus.cc:740] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b0ac7cec35b445bbfbfff828cdedfcf, State: Initialized, Role: FOLLOWER
I20260709 12:15:22.723914 25859 consensus_queue.cc:260] T 78c784ca806e4871a483636451018b1e P 521c8650b93e4a7fa1905efd229fbdf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:22.729425 25857 consensus_queue.cc:260] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P 2b0ac7cec35b445bbfbfff828cdedfcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:22.730059 25858 raft_consensus.cc:359] T f2d3c8d7f2cc4c46ada3179f069388a8 P fbdbc1633300449fb2b7c46f43bde744 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:22.730876 25858 raft_consensus.cc:385] T f2d3c8d7f2cc4c46ada3179f069388a8 P fbdbc1633300449fb2b7c46f43bde744 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:22.731171 25858 raft_consensus.cc:740] T f2d3c8d7f2cc4c46ada3179f069388a8 P fbdbc1633300449fb2b7c46f43bde744 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbdbc1633300449fb2b7c46f43bde744, State: Initialized, Role: FOLLOWER
I20260709 12:15:22.731873 25857 ts_tablet_manager.cc:1434] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P 2b0ac7cec35b445bbfbfff828cdedfcf: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:15:22.732049 25858 consensus_queue.cc:260] T f2d3c8d7f2cc4c46ada3179f069388a8 P fbdbc1633300449fb2b7c46f43bde744 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:22.733006 25857 tablet_bootstrap.cc:492] T 2312590ea8034475b5d8d6cd73d3fce7 P 2b0ac7cec35b445bbfbfff828cdedfcf: Bootstrap starting.
I20260709 12:15:22.734623 25858 ts_tablet_manager.cc:1434] T f2d3c8d7f2cc4c46ada3179f069388a8 P fbdbc1633300449fb2b7c46f43bde744: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:15:22.735845 25858 tablet_bootstrap.cc:492] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P fbdbc1633300449fb2b7c46f43bde744: Bootstrap starting.
I20260709 12:15:22.734728 25859 ts_tablet_manager.cc:1434] T 78c784ca806e4871a483636451018b1e P 521c8650b93e4a7fa1905efd229fbdf6: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.004s
I20260709 12:15:22.738085 25859 tablet_bootstrap.cc:492] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P 521c8650b93e4a7fa1905efd229fbdf6: Bootstrap starting.
I20260709 12:15:22.742265 25879 raft_consensus.cc:515] T ccfca33043a14a9089a3c59b29c3b442 P fbdbc1633300449fb2b7c46f43bde744 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:22.742844 25858 tablet_bootstrap.cc:654] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P fbdbc1633300449fb2b7c46f43bde744: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:22.740533 25857 tablet_bootstrap.cc:654] T 2312590ea8034475b5d8d6cd73d3fce7 P 2b0ac7cec35b445bbfbfff828cdedfcf: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:22.745909 25668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfca33043a14a9089a3c59b29c3b442" candidate_uuid: "fbdbc1633300449fb2b7c46f43bde744" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "521c8650b93e4a7fa1905efd229fbdf6"
W20260709 12:15:22.747660 25709 leader_election.cc:343] T ccfca33043a14a9089a3c59b29c3b442 P fbdbc1633300449fb2b7c46f43bde744 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:22.748907 25879 leader_election.cc:290] T ccfca33043a14a9089a3c59b29c3b442 P fbdbc1633300449fb2b7c46f43bde744 [CANDIDATE]: Term 1 election: Requested vote from peers 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441), 2b0ac7cec35b445bbfbfff828cdedfcf (127.12.56.195:36129)
I20260709 12:15:22.749966 25863 raft_consensus.cc:493] T 78c784ca806e4871a483636451018b1e P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:22.750723 25863 raft_consensus.cc:515] T 78c784ca806e4871a483636451018b1e P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:22.752470 25817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfca33043a14a9089a3c59b29c3b442" candidate_uuid: "fbdbc1633300449fb2b7c46f43bde744" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf"
I20260709 12:15:22.753170 25817 raft_consensus.cc:3060] T ccfca33043a14a9089a3c59b29c3b442 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:22.753487 25859 tablet_bootstrap.cc:654] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P 521c8650b93e4a7fa1905efd229fbdf6: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:22.761708 25817 raft_consensus.cc:2468] T ccfca33043a14a9089a3c59b29c3b442 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbdbc1633300449fb2b7c46f43bde744 in term 1.
I20260709 12:15:22.763235 25708 leader_election.cc:304] T ccfca33043a14a9089a3c59b29c3b442 P fbdbc1633300449fb2b7c46f43bde744 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b0ac7cec35b445bbfbfff828cdedfcf, fbdbc1633300449fb2b7c46f43bde744; no voters: 521c8650b93e4a7fa1905efd229fbdf6
I20260709 12:15:22.764497 25865 raft_consensus.cc:2804] T ccfca33043a14a9089a3c59b29c3b442 P fbdbc1633300449fb2b7c46f43bde744 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:22.765213 25865 raft_consensus.cc:697] T ccfca33043a14a9089a3c59b29c3b442 P fbdbc1633300449fb2b7c46f43bde744 [term 1 LEADER]: Becoming Leader. State: Replica: fbdbc1633300449fb2b7c46f43bde744, State: Running, Role: LEADER
I20260709 12:15:22.766129 25865 consensus_queue.cc:237] T ccfca33043a14a9089a3c59b29c3b442 P fbdbc1633300449fb2b7c46f43bde744 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:22.784878 25857 tablet_bootstrap.cc:492] T 2312590ea8034475b5d8d6cd73d3fce7 P 2b0ac7cec35b445bbfbfff828cdedfcf: No bootstrap required, opened a new log
I20260709 12:15:22.785526 25857 ts_tablet_manager.cc:1403] T 2312590ea8034475b5d8d6cd73d3fce7 P 2b0ac7cec35b445bbfbfff828cdedfcf: Time spent bootstrapping tablet: real 0.053s	user 0.011s	sys 0.028s
I20260709 12:15:22.787390 25858 tablet_bootstrap.cc:492] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P fbdbc1633300449fb2b7c46f43bde744: No bootstrap required, opened a new log
I20260709 12:15:22.789129 25857 raft_consensus.cc:359] T 2312590ea8034475b5d8d6cd73d3fce7 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:22.790326 25857 raft_consensus.cc:385] T 2312590ea8034475b5d8d6cd73d3fce7 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:22.790593 25858 ts_tablet_manager.cc:1403] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P fbdbc1633300449fb2b7c46f43bde744: Time spent bootstrapping tablet: real 0.055s	user 0.016s	sys 0.006s
I20260709 12:15:22.790729 25857 raft_consensus.cc:740] T 2312590ea8034475b5d8d6cd73d3fce7 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b0ac7cec35b445bbfbfff828cdedfcf, State: Initialized, Role: FOLLOWER
I20260709 12:15:22.791816 25859 tablet_bootstrap.cc:492] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P 521c8650b93e4a7fa1905efd229fbdf6: No bootstrap required, opened a new log
I20260709 12:15:22.792487 25859 ts_tablet_manager.cc:1403] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P 521c8650b93e4a7fa1905efd229fbdf6: Time spent bootstrapping tablet: real 0.055s	user 0.025s	sys 0.020s
I20260709 12:15:22.792649 25857 consensus_queue.cc:260] T 2312590ea8034475b5d8d6cd73d3fce7 P 2b0ac7cec35b445bbfbfff828cdedfcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:22.791864 25863 leader_election.cc:290] T 78c784ca806e4871a483636451018b1e P 2b0ac7cec35b445bbfbfff828cdedfcf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441), fbdbc1633300449fb2b7c46f43bde744 (127.12.56.194:37715)
I20260709 12:15:22.794628 25863 raft_consensus.cc:493] T 47044718acc14024854627db0aed3d3e P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:22.795272 25863 raft_consensus.cc:515] T 47044718acc14024854627db0aed3d3e P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:22.796492 25859 raft_consensus.cc:359] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:22.797425 25859 raft_consensus.cc:385] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:22.797885 25859 raft_consensus.cc:740] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 521c8650b93e4a7fa1905efd229fbdf6, State: Initialized, Role: FOLLOWER
I20260709 12:15:22.798887 25859 consensus_queue.cc:260] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P 521c8650b93e4a7fa1905efd229fbdf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:22.801362 25859 ts_tablet_manager.cc:1434] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P 521c8650b93e4a7fa1905efd229fbdf6: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:15:22.802496 25859 tablet_bootstrap.cc:492] T ccfca33043a14a9089a3c59b29c3b442 P 521c8650b93e4a7fa1905efd229fbdf6: Bootstrap starting.
I20260709 12:15:22.806665 25863 leader_election.cc:290] T 47044718acc14024854627db0aed3d3e P 2b0ac7cec35b445bbfbfff828cdedfcf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441), fbdbc1633300449fb2b7c46f43bde744 (127.12.56.194:37715)
I20260709 12:15:22.809005 25859 tablet_bootstrap.cc:654] T ccfca33043a14a9089a3c59b29c3b442 P 521c8650b93e4a7fa1905efd229fbdf6: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:22.799356 25858 raft_consensus.cc:359] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P fbdbc1633300449fb2b7c46f43bde744 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:22.813894 25858 raft_consensus.cc:385] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P fbdbc1633300449fb2b7c46f43bde744 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:22.815308 25858 raft_consensus.cc:740] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P fbdbc1633300449fb2b7c46f43bde744 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbdbc1633300449fb2b7c46f43bde744, State: Initialized, Role: FOLLOWER
I20260709 12:15:22.817279 25858 consensus_queue.cc:260] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P fbdbc1633300449fb2b7c46f43bde744 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:22.826406 25858 ts_tablet_manager.cc:1434] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P fbdbc1633300449fb2b7c46f43bde744: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.002s
I20260709 12:15:22.829273 25858 tablet_bootstrap.cc:492] T 06be549acfdb46a9801ebced1ab5be4d P fbdbc1633300449fb2b7c46f43bde744: Bootstrap starting.
I20260709 12:15:22.842136 25858 tablet_bootstrap.cc:654] T 06be549acfdb46a9801ebced1ab5be4d P fbdbc1633300449fb2b7c46f43bde744: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:22.847599 25864 raft_consensus.cc:493] T 78c784ca806e4871a483636451018b1e P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:22.848272 25864 raft_consensus.cc:515] T 78c784ca806e4871a483636451018b1e P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:22.854130 25565 catalog_manager.cc:5697] T ccfca33043a14a9089a3c59b29c3b442 P fbdbc1633300449fb2b7c46f43bde744 reported cstate change: term changed from 0 to 1, leader changed from <none> to fbdbc1633300449fb2b7c46f43bde744 (127.12.56.194). New cstate: current_term: 1 leader_uuid: "fbdbc1633300449fb2b7c46f43bde744" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:22.857089 25858 tablet_bootstrap.cc:492] T 06be549acfdb46a9801ebced1ab5be4d P fbdbc1633300449fb2b7c46f43bde744: No bootstrap required, opened a new log
I20260709 12:15:22.858067 25858 ts_tablet_manager.cc:1403] T 06be549acfdb46a9801ebced1ab5be4d P fbdbc1633300449fb2b7c46f43bde744: Time spent bootstrapping tablet: real 0.029s	user 0.008s	sys 0.017s
I20260709 12:15:22.862885 25858 raft_consensus.cc:359] T 06be549acfdb46a9801ebced1ab5be4d P fbdbc1633300449fb2b7c46f43bde744 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:22.864017 25864 leader_election.cc:290] T 78c784ca806e4871a483636451018b1e P 521c8650b93e4a7fa1905efd229fbdf6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fbdbc1633300449fb2b7c46f43bde744 (127.12.56.194:37715), 2b0ac7cec35b445bbfbfff828cdedfcf (127.12.56.195:36129)
I20260709 12:15:22.864336 25858 raft_consensus.cc:385] T 06be549acfdb46a9801ebced1ab5be4d P fbdbc1633300449fb2b7c46f43bde744 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:22.865003 25858 raft_consensus.cc:740] T 06be549acfdb46a9801ebced1ab5be4d P fbdbc1633300449fb2b7c46f43bde744 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbdbc1633300449fb2b7c46f43bde744, State: Initialized, Role: FOLLOWER
I20260709 12:15:22.866350 25858 consensus_queue.cc:260] T 06be549acfdb46a9801ebced1ab5be4d P fbdbc1633300449fb2b7c46f43bde744 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:22.870410 25858 ts_tablet_manager.cc:1434] T 06be549acfdb46a9801ebced1ab5be4d P fbdbc1633300449fb2b7c46f43bde744: Time spent starting tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 12:15:22.872061 25858 tablet_bootstrap.cc:492] T 2312590ea8034475b5d8d6cd73d3fce7 P fbdbc1633300449fb2b7c46f43bde744: Bootstrap starting.
I20260709 12:15:22.882025 25858 tablet_bootstrap.cc:654] T 2312590ea8034475b5d8d6cd73d3fce7 P fbdbc1633300449fb2b7c46f43bde744: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:22.887521 25886 raft_consensus.cc:493] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:22.888226 25886 raft_consensus.cc:515] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:22.891554 25886 leader_election.cc:290] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P 2b0ac7cec35b445bbfbfff828cdedfcf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441), fbdbc1633300449fb2b7c46f43bde744 (127.12.56.194:37715)
I20260709 12:15:22.893345 25865 raft_consensus.cc:493] T 06be549acfdb46a9801ebced1ab5be4d P fbdbc1633300449fb2b7c46f43bde744 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:22.893966 25865 raft_consensus.cc:515] T 06be549acfdb46a9801ebced1ab5be4d P fbdbc1633300449fb2b7c46f43bde744 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:22.896456 25865 leader_election.cc:290] T 06be549acfdb46a9801ebced1ab5be4d P fbdbc1633300449fb2b7c46f43bde744 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441), 2b0ac7cec35b445bbfbfff828cdedfcf (127.12.56.195:36129)
I20260709 12:15:22.893986 25859 tablet_bootstrap.cc:492] T ccfca33043a14a9089a3c59b29c3b442 P 521c8650b93e4a7fa1905efd229fbdf6: No bootstrap required, opened a new log
I20260709 12:15:22.897360 25859 ts_tablet_manager.cc:1403] T ccfca33043a14a9089a3c59b29c3b442 P 521c8650b93e4a7fa1905efd229fbdf6: Time spent bootstrapping tablet: real 0.095s	user 0.044s	sys 0.047s
I20260709 12:15:22.897183 25668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06be549acfdb46a9801ebced1ab5be4d" candidate_uuid: "fbdbc1633300449fb2b7c46f43bde744" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "521c8650b93e4a7fa1905efd229fbdf6" is_pre_election: true
I20260709 12:15:22.898118 25817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06be549acfdb46a9801ebced1ab5be4d" candidate_uuid: "fbdbc1633300449fb2b7c46f43bde744" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" is_pre_election: true
W20260709 12:15:22.900357 25708 leader_election.cc:343] T 06be549acfdb46a9801ebced1ab5be4d P fbdbc1633300449fb2b7c46f43bde744 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b0ac7cec35b445bbfbfff828cdedfcf (127.12.56.195:36129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:22.900965 25859 raft_consensus.cc:359] T ccfca33043a14a9089a3c59b29c3b442 P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
W20260709 12:15:22.901510 25709 leader_election.cc:343] T 06be549acfdb46a9801ebced1ab5be4d P fbdbc1633300449fb2b7c46f43bde744 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:22.901887 25859 raft_consensus.cc:385] T ccfca33043a14a9089a3c59b29c3b442 P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:22.902053 25709 leader_election.cc:304] T 06be549acfdb46a9801ebced1ab5be4d P fbdbc1633300449fb2b7c46f43bde744 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbdbc1633300449fb2b7c46f43bde744; no voters: 2b0ac7cec35b445bbfbfff828cdedfcf, 521c8650b93e4a7fa1905efd229fbdf6
I20260709 12:15:22.893959 25857 ts_tablet_manager.cc:1434] T 2312590ea8034475b5d8d6cd73d3fce7 P 2b0ac7cec35b445bbfbfff828cdedfcf: Time spent starting tablet: real 0.108s	user 0.017s	sys 0.045s
I20260709 12:15:22.902978 25865 raft_consensus.cc:2749] T 06be549acfdb46a9801ebced1ab5be4d P fbdbc1633300449fb2b7c46f43bde744 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:22.903855 25858 tablet_bootstrap.cc:492] T 2312590ea8034475b5d8d6cd73d3fce7 P fbdbc1633300449fb2b7c46f43bde744: No bootstrap required, opened a new log
I20260709 12:15:22.904525 25858 ts_tablet_manager.cc:1403] T 2312590ea8034475b5d8d6cd73d3fce7 P fbdbc1633300449fb2b7c46f43bde744: Time spent bootstrapping tablet: real 0.033s	user 0.015s	sys 0.007s
I20260709 12:15:22.902240 25859 raft_consensus.cc:740] T ccfca33043a14a9089a3c59b29c3b442 P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 521c8650b93e4a7fa1905efd229fbdf6, State: Initialized, Role: FOLLOWER
I20260709 12:15:22.911149 25858 raft_consensus.cc:359] T 2312590ea8034475b5d8d6cd73d3fce7 P fbdbc1633300449fb2b7c46f43bde744 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:22.911763 25858 raft_consensus.cc:385] T 2312590ea8034475b5d8d6cd73d3fce7 P fbdbc1633300449fb2b7c46f43bde744 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:22.912010 25858 raft_consensus.cc:740] T 2312590ea8034475b5d8d6cd73d3fce7 P fbdbc1633300449fb2b7c46f43bde744 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbdbc1633300449fb2b7c46f43bde744, State: Initialized, Role: FOLLOWER
I20260709 12:15:22.912670 25858 consensus_queue.cc:260] T 2312590ea8034475b5d8d6cd73d3fce7 P fbdbc1633300449fb2b7c46f43bde744 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:22.914880 25858 ts_tablet_manager.cc:1434] T 2312590ea8034475b5d8d6cd73d3fce7 P fbdbc1633300449fb2b7c46f43bde744: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:15:22.915824 25858 tablet_bootstrap.cc:492] T 019b400e387d48d09821b4a446577ede P fbdbc1633300449fb2b7c46f43bde744: Bootstrap starting.
I20260709 12:15:22.918916 25857 tablet_bootstrap.cc:492] T 06be549acfdb46a9801ebced1ab5be4d P 2b0ac7cec35b445bbfbfff828cdedfcf: Bootstrap starting.
I20260709 12:15:22.914531 25859 consensus_queue.cc:260] T ccfca33043a14a9089a3c59b29c3b442 P 521c8650b93e4a7fa1905efd229fbdf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:22.924106 25858 tablet_bootstrap.cc:654] T 019b400e387d48d09821b4a446577ede P fbdbc1633300449fb2b7c46f43bde744: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:22.924096 25668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c784ca806e4871a483636451018b1e" candidate_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "521c8650b93e4a7fa1905efd229fbdf6" is_pre_election: true
I20260709 12:15:22.925016 25668 raft_consensus.cc:2468] T 78c784ca806e4871a483636451018b1e P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b0ac7cec35b445bbfbfff828cdedfcf in term 0.
I20260709 12:15:22.926537 25668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47044718acc14024854627db0aed3d3e" candidate_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "521c8650b93e4a7fa1905efd229fbdf6" is_pre_election: true
I20260709 12:15:22.927191 25668 raft_consensus.cc:2468] T 47044718acc14024854627db0aed3d3e P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b0ac7cec35b445bbfbfff828cdedfcf in term 0.
I20260709 12:15:22.928324 25859 ts_tablet_manager.cc:1434] T ccfca33043a14a9089a3c59b29c3b442 P 521c8650b93e4a7fa1905efd229fbdf6: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.001s
I20260709 12:15:22.929720 25859 tablet_bootstrap.cc:492] T 6c0bcf651cbe40a59f93666829cbacd5 P 521c8650b93e4a7fa1905efd229fbdf6: Bootstrap starting.
I20260709 12:15:22.927213 25857 tablet_bootstrap.cc:654] T 06be549acfdb46a9801ebced1ab5be4d P 2b0ac7cec35b445bbfbfff828cdedfcf: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:22.933352 25668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9ae2bf53c4c20a18fec7bc796dfb3" candidate_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "521c8650b93e4a7fa1905efd229fbdf6" is_pre_election: true
I20260709 12:15:22.934226 25668 raft_consensus.cc:2468] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b0ac7cec35b445bbfbfff828cdedfcf in term 0.
I20260709 12:15:22.938759 25886 raft_consensus.cc:493] T 032e30d956ec4c6c90f1ba5db5504a5d P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:22.942099 25886 raft_consensus.cc:515] T 032e30d956ec4c6c90f1ba5db5504a5d P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } }
I20260709 12:15:22.948150 25817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c784ca806e4871a483636451018b1e" candidate_uuid: "521c8650b93e4a7fa1905efd229fbdf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" is_pre_election: true
I20260709 12:15:22.949065 25783 leader_election.cc:304] T 78c784ca806e4871a483636451018b1e P 2b0ac7cec35b445bbfbfff828cdedfcf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b0ac7cec35b445bbfbfff828cdedfcf, 521c8650b93e4a7fa1905efd229fbdf6; no voters: 
I20260709 12:15:22.948410 25886 leader_election.cc:290] T 032e30d956ec4c6c90f1ba5db5504a5d P 2b0ac7cec35b445bbfbfff828cdedfcf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fbdbc1633300449fb2b7c46f43bde744 (127.12.56.194:37715), 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441)
I20260709 12:15:22.949107 25742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47044718acc14024854627db0aed3d3e" candidate_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbdbc1633300449fb2b7c46f43bde744" is_pre_election: true
I20260709 12:15:22.951815 25742 raft_consensus.cc:2468] T 47044718acc14024854627db0aed3d3e P fbdbc1633300449fb2b7c46f43bde744 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b0ac7cec35b445bbfbfff828cdedfcf in term 0.
I20260709 12:15:22.952190 25740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032e30d956ec4c6c90f1ba5db5504a5d" candidate_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbdbc1633300449fb2b7c46f43bde744" is_pre_election: true
I20260709 12:15:22.949579 25743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c784ca806e4871a483636451018b1e" candidate_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbdbc1633300449fb2b7c46f43bde744" is_pre_election: true
I20260709 12:15:22.953111 25740 raft_consensus.cc:2468] T 032e30d956ec4c6c90f1ba5db5504a5d P fbdbc1633300449fb2b7c46f43bde744 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b0ac7cec35b445bbfbfff828cdedfcf in term 0.
I20260709 12:15:22.953431 25743 raft_consensus.cc:2468] T 78c784ca806e4871a483636451018b1e P fbdbc1633300449fb2b7c46f43bde744 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b0ac7cec35b445bbfbfff828cdedfcf in term 0.
I20260709 12:15:22.953568 25781 leader_election.cc:304] T 47044718acc14024854627db0aed3d3e P 2b0ac7cec35b445bbfbfff828cdedfcf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b0ac7cec35b445bbfbfff828cdedfcf, fbdbc1633300449fb2b7c46f43bde744; no voters: 
I20260709 12:15:22.952270 25741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9ae2bf53c4c20a18fec7bc796dfb3" candidate_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbdbc1633300449fb2b7c46f43bde744" is_pre_election: true
I20260709 12:15:22.954649 25886 raft_consensus.cc:2804] T 47044718acc14024854627db0aed3d3e P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:22.954838 25741 raft_consensus.cc:2468] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P fbdbc1633300449fb2b7c46f43bde744 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b0ac7cec35b445bbfbfff828cdedfcf in term 0.
I20260709 12:15:22.949574 25817 raft_consensus.cc:2468] T 78c784ca806e4871a483636451018b1e P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 521c8650b93e4a7fa1905efd229fbdf6 in term 0.
I20260709 12:15:22.955133 25886 raft_consensus.cc:493] T 47044718acc14024854627db0aed3d3e P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:22.956233 25781 leader_election.cc:304] T 032e30d956ec4c6c90f1ba5db5504a5d P 2b0ac7cec35b445bbfbfff828cdedfcf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b0ac7cec35b445bbfbfff828cdedfcf, fbdbc1633300449fb2b7c46f43bde744; no voters: 
I20260709 12:15:22.956269 25887 raft_consensus.cc:2804] T 78c784ca806e4871a483636451018b1e P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:22.956287 25886 raft_consensus.cc:3060] T 47044718acc14024854627db0aed3d3e P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:22.957201 25863 raft_consensus.cc:2804] T 032e30d956ec4c6c90f1ba5db5504a5d P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:22.957671 25863 raft_consensus.cc:493] T 032e30d956ec4c6c90f1ba5db5504a5d P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:22.958148 25863 raft_consensus.cc:3060] T 032e30d956ec4c6c90f1ba5db5504a5d P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:22.957482 25633 leader_election.cc:304] T 78c784ca806e4871a483636451018b1e P 521c8650b93e4a7fa1905efd229fbdf6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b0ac7cec35b445bbfbfff828cdedfcf, 521c8650b93e4a7fa1905efd229fbdf6; no voters: 
I20260709 12:15:22.959281 25887 raft_consensus.cc:493] T 78c784ca806e4871a483636451018b1e P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:22.958222 25783 leader_election.cc:304] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P 2b0ac7cec35b445bbfbfff828cdedfcf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b0ac7cec35b445bbfbfff828cdedfcf, 521c8650b93e4a7fa1905efd229fbdf6; no voters: 
I20260709 12:15:22.959585 25864 raft_consensus.cc:2804] T 78c784ca806e4871a483636451018b1e P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:22.959739 25887 raft_consensus.cc:3060] T 78c784ca806e4871a483636451018b1e P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:22.960098 25864 raft_consensus.cc:493] T 78c784ca806e4871a483636451018b1e P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:22.960970 25859 tablet_bootstrap.cc:654] T 6c0bcf651cbe40a59f93666829cbacd5 P 521c8650b93e4a7fa1905efd229fbdf6: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:22.961054 25864 raft_consensus.cc:3060] T 78c784ca806e4871a483636451018b1e P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:22.971047 25864 raft_consensus.cc:515] T 78c784ca806e4871a483636451018b1e P 521c8650b93e4a7fa1905efd229fbdf6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:22.977052 25900 raft_consensus.cc:2804] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:22.990677 25900 raft_consensus.cc:493] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:22.991043 25900 raft_consensus.cc:3060] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:22.992386 25857 tablet_bootstrap.cc:492] T 06be549acfdb46a9801ebced1ab5be4d P 2b0ac7cec35b445bbfbfff828cdedfcf: No bootstrap required, opened a new log
I20260709 12:15:22.993150 25857 ts_tablet_manager.cc:1403] T 06be549acfdb46a9801ebced1ab5be4d P 2b0ac7cec35b445bbfbfff828cdedfcf: Time spent bootstrapping tablet: real 0.076s	user 0.011s	sys 0.002s
I20260709 12:15:22.981671 25859 tablet_bootstrap.cc:492] T 6c0bcf651cbe40a59f93666829cbacd5 P 521c8650b93e4a7fa1905efd229fbdf6: No bootstrap required, opened a new log
I20260709 12:15:22.994385 25859 ts_tablet_manager.cc:1403] T 6c0bcf651cbe40a59f93666829cbacd5 P 521c8650b93e4a7fa1905efd229fbdf6: Time spent bootstrapping tablet: real 0.065s	user 0.017s	sys 0.007s
I20260709 12:15:22.979303 25858 tablet_bootstrap.cc:492] T 019b400e387d48d09821b4a446577ede P fbdbc1633300449fb2b7c46f43bde744: No bootstrap required, opened a new log
I20260709 12:15:22.986912 25817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c784ca806e4871a483636451018b1e" candidate_uuid: "521c8650b93e4a7fa1905efd229fbdf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf"
I20260709 12:15:22.971047 25887 raft_consensus.cc:515] T 78c784ca806e4871a483636451018b1e P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:22.998075 25817 raft_consensus.cc:2393] T 78c784ca806e4871a483636451018b1e P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 521c8650b93e4a7fa1905efd229fbdf6 in current term 1: Already voted for candidate 2b0ac7cec35b445bbfbfff828cdedfcf in this term.
I20260709 12:15:22.998565 25741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c784ca806e4871a483636451018b1e" candidate_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbdbc1633300449fb2b7c46f43bde744"
I20260709 12:15:22.998950 25887 leader_election.cc:290] T 78c784ca806e4871a483636451018b1e P 2b0ac7cec35b445bbfbfff828cdedfcf [CANDIDATE]: Term 1 election: Requested vote from peers 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441), fbdbc1633300449fb2b7c46f43bde744 (127.12.56.194:37715)
I20260709 12:15:22.989025 25886 raft_consensus.cc:515] T 47044718acc14024854627db0aed3d3e P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:22.999346 25741 raft_consensus.cc:3060] T 78c784ca806e4871a483636451018b1e P fbdbc1633300449fb2b7c46f43bde744 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:23.000463 25901 raft_consensus.cc:493] T 019b400e387d48d09821b4a446577ede P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:22.985368 25864 leader_election.cc:290] T 78c784ca806e4871a483636451018b1e P 521c8650b93e4a7fa1905efd229fbdf6 [CANDIDATE]: Term 1 election: Requested vote from peers fbdbc1633300449fb2b7c46f43bde744 (127.12.56.194:37715), 2b0ac7cec35b445bbfbfff828cdedfcf (127.12.56.195:36129)
I20260709 12:15:22.995044 25858 ts_tablet_manager.cc:1403] T 019b400e387d48d09821b4a446577ede P fbdbc1633300449fb2b7c46f43bde744: Time spent bootstrapping tablet: real 0.079s	user 0.009s	sys 0.029s
I20260709 12:15:23.002655 25743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47044718acc14024854627db0aed3d3e" candidate_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbdbc1633300449fb2b7c46f43bde744"
I20260709 12:15:23.003333 25743 raft_consensus.cc:3060] T 47044718acc14024854627db0aed3d3e P fbdbc1633300449fb2b7c46f43bde744 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:23.003396 25857 raft_consensus.cc:359] T 06be549acfdb46a9801ebced1ab5be4d P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:23.004216 25857 raft_consensus.cc:385] T 06be549acfdb46a9801ebced1ab5be4d P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:22.980897 25863 raft_consensus.cc:515] T 032e30d956ec4c6c90f1ba5db5504a5d P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } }
I20260709 12:15:23.004570 25858 raft_consensus.cc:359] T 019b400e387d48d09821b4a446577ede P fbdbc1633300449fb2b7c46f43bde744 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:23.005337 25858 raft_consensus.cc:385] T 019b400e387d48d09821b4a446577ede P fbdbc1633300449fb2b7c46f43bde744 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:23.005613 25858 raft_consensus.cc:740] T 019b400e387d48d09821b4a446577ede P fbdbc1633300449fb2b7c46f43bde744 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbdbc1633300449fb2b7c46f43bde744, State: Initialized, Role: FOLLOWER
I20260709 12:15:23.000947 25859 raft_consensus.cc:359] T 6c0bcf651cbe40a59f93666829cbacd5 P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:23.006590 25859 raft_consensus.cc:385] T 6c0bcf651cbe40a59f93666829cbacd5 P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:23.006925 25859 raft_consensus.cc:740] T 6c0bcf651cbe40a59f93666829cbacd5 P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 521c8650b93e4a7fa1905efd229fbdf6, State: Initialized, Role: FOLLOWER
I20260709 12:15:23.007161 25740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032e30d956ec4c6c90f1ba5db5504a5d" candidate_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbdbc1633300449fb2b7c46f43bde744"
I20260709 12:15:23.007788 25740 raft_consensus.cc:3060] T 032e30d956ec4c6c90f1ba5db5504a5d P fbdbc1633300449fb2b7c46f43bde744 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:23.008467 25863 leader_election.cc:290] T 032e30d956ec4c6c90f1ba5db5504a5d P 2b0ac7cec35b445bbfbfff828cdedfcf [CANDIDATE]: Term 1 election: Requested vote from peers fbdbc1633300449fb2b7c46f43bde744 (127.12.56.194:37715), 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441)
I20260709 12:15:23.009081 25886 leader_election.cc:290] T 47044718acc14024854627db0aed3d3e P 2b0ac7cec35b445bbfbfff828cdedfcf [CANDIDATE]: Term 1 election: Requested vote from peers 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441), fbdbc1633300449fb2b7c46f43bde744 (127.12.56.194:37715)
I20260709 12:15:23.004492 25857 raft_consensus.cc:740] T 06be549acfdb46a9801ebced1ab5be4d P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b0ac7cec35b445bbfbfff828cdedfcf, State: Initialized, Role: FOLLOWER
I20260709 12:15:23.010454 25857 consensus_queue.cc:260] T 06be549acfdb46a9801ebced1ab5be4d P 2b0ac7cec35b445bbfbfff828cdedfcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:23.007687 25859 consensus_queue.cc:260] T 6c0bcf651cbe40a59f93666829cbacd5 P 521c8650b93e4a7fa1905efd229fbdf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:23.014119 25858 consensus_queue.cc:260] T 019b400e387d48d09821b4a446577ede P fbdbc1633300449fb2b7c46f43bde744 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:23.016786 25858 ts_tablet_manager.cc:1434] T 019b400e387d48d09821b4a446577ede P fbdbc1633300449fb2b7c46f43bde744: Time spent starting tablet: real 0.015s	user 0.001s	sys 0.005s
I20260709 12:15:23.017841 25857 ts_tablet_manager.cc:1434] T 06be549acfdb46a9801ebced1ab5be4d P 2b0ac7cec35b445bbfbfff828cdedfcf: Time spent starting tablet: real 0.024s	user 0.011s	sys 0.000s
I20260709 12:15:23.018976 25857 tablet_bootstrap.cc:492] T 019b400e387d48d09821b4a446577ede P 2b0ac7cec35b445bbfbfff828cdedfcf: Bootstrap starting.
I20260709 12:15:23.021158 25858 tablet_bootstrap.cc:492] T 6c0bcf651cbe40a59f93666829cbacd5 P fbdbc1633300449fb2b7c46f43bde744: Bootstrap starting.
I20260709 12:15:23.020821 25740 raft_consensus.cc:2468] T 032e30d956ec4c6c90f1ba5db5504a5d P fbdbc1633300449fb2b7c46f43bde744 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b0ac7cec35b445bbfbfff828cdedfcf in term 1.
I20260709 12:15:23.025395 25781 leader_election.cc:304] T 032e30d956ec4c6c90f1ba5db5504a5d P 2b0ac7cec35b445bbfbfff828cdedfcf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b0ac7cec35b445bbfbfff828cdedfcf, fbdbc1633300449fb2b7c46f43bde744; no voters: 
I20260709 12:15:23.026098 25886 raft_consensus.cc:493] T 2312590ea8034475b5d8d6cd73d3fce7 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:23.026397 25863 raft_consensus.cc:2804] T 032e30d956ec4c6c90f1ba5db5504a5d P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:23.026821 25886 raft_consensus.cc:515] T 2312590ea8034475b5d8d6cd73d3fce7 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:23.027158 25863 raft_consensus.cc:697] T 032e30d956ec4c6c90f1ba5db5504a5d P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 LEADER]: Becoming Leader. State: Replica: 2b0ac7cec35b445bbfbfff828cdedfcf, State: Running, Role: LEADER
I20260709 12:15:23.027851 25742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c784ca806e4871a483636451018b1e" candidate_uuid: "521c8650b93e4a7fa1905efd229fbdf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbdbc1633300449fb2b7c46f43bde744" is_pre_election: true
I20260709 12:15:23.030455 25865 raft_consensus.cc:493] T 019b400e387d48d09821b4a446577ede P fbdbc1633300449fb2b7c46f43bde744 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:23.032652 25858 tablet_bootstrap.cc:654] T 6c0bcf651cbe40a59f93666829cbacd5 P fbdbc1633300449fb2b7c46f43bde744: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:23.032735 25865 raft_consensus.cc:515] T 019b400e387d48d09821b4a446577ede P fbdbc1633300449fb2b7c46f43bde744 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:23.032907 25863 consensus_queue.cc:237] T 032e30d956ec4c6c90f1ba5db5504a5d P 2b0ac7cec35b445bbfbfff828cdedfcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } }
I20260709 12:15:23.035259 25859 ts_tablet_manager.cc:1434] T 6c0bcf651cbe40a59f93666829cbacd5 P 521c8650b93e4a7fa1905efd229fbdf6: Time spent starting tablet: real 0.040s	user 0.010s	sys 0.004s
I20260709 12:15:23.036610 25859 tablet_bootstrap.cc:492] T 032e30d956ec4c6c90f1ba5db5504a5d P 521c8650b93e4a7fa1905efd229fbdf6: Bootstrap starting.
I20260709 12:15:23.035794 25865 leader_election.cc:290] T 019b400e387d48d09821b4a446577ede P fbdbc1633300449fb2b7c46f43bde744 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441), 2b0ac7cec35b445bbfbfff828cdedfcf (127.12.56.195:36129)
I20260709 12:15:23.038167 25668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019b400e387d48d09821b4a446577ede" candidate_uuid: "fbdbc1633300449fb2b7c46f43bde744" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "521c8650b93e4a7fa1905efd229fbdf6" is_pre_election: true
I20260709 12:15:23.038980 25887 raft_consensus.cc:493] T f2d3c8d7f2cc4c46ada3179f069388a8 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:23.039515 25887 raft_consensus.cc:515] T f2d3c8d7f2cc4c46ada3179f069388a8 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:23.040707 25886 leader_election.cc:290] T 2312590ea8034475b5d8d6cd73d3fce7 P 2b0ac7cec35b445bbfbfff828cdedfcf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441), fbdbc1633300449fb2b7c46f43bde744 (127.12.56.194:37715)
I20260709 12:15:23.041865 25887 leader_election.cc:290] T f2d3c8d7f2cc4c46ada3179f069388a8 P 2b0ac7cec35b445bbfbfff828cdedfcf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441), fbdbc1633300449fb2b7c46f43bde744 (127.12.56.194:37715)
I20260709 12:15:23.042461 25857 tablet_bootstrap.cc:654] T 019b400e387d48d09821b4a446577ede P 2b0ac7cec35b445bbfbfff828cdedfcf: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:23.042515 25901 raft_consensus.cc:515] T 019b400e387d48d09821b4a446577ede P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:23.043350 25817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019b400e387d48d09821b4a446577ede" candidate_uuid: "fbdbc1633300449fb2b7c46f43bde744" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" is_pre_election: true
I20260709 12:15:23.045672 25742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2312590ea8034475b5d8d6cd73d3fce7" candidate_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbdbc1633300449fb2b7c46f43bde744" is_pre_election: true
I20260709 12:15:23.046397 25742 raft_consensus.cc:2468] T 2312590ea8034475b5d8d6cd73d3fce7 P fbdbc1633300449fb2b7c46f43bde744 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b0ac7cec35b445bbfbfff828cdedfcf in term 0.
W20260709 12:15:23.046964 25708 leader_election.cc:343] T 019b400e387d48d09821b4a446577ede P fbdbc1633300449fb2b7c46f43bde744 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b0ac7cec35b445bbfbfff828cdedfcf (127.12.56.195:36129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:23.044122 25740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c784ca806e4871a483636451018b1e" candidate_uuid: "521c8650b93e4a7fa1905efd229fbdf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbdbc1633300449fb2b7c46f43bde744"
I20260709 12:15:23.047999 25781 leader_election.cc:304] T 2312590ea8034475b5d8d6cd73d3fce7 P 2b0ac7cec35b445bbfbfff828cdedfcf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b0ac7cec35b445bbfbfff828cdedfcf, fbdbc1633300449fb2b7c46f43bde744; no voters: 
I20260709 12:15:23.048766 25859 tablet_bootstrap.cc:654] T 032e30d956ec4c6c90f1ba5db5504a5d P 521c8650b93e4a7fa1905efd229fbdf6: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:23.048944 25887 raft_consensus.cc:2804] T 2312590ea8034475b5d8d6cd73d3fce7 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:23.049738 25668 raft_consensus.cc:2468] T 019b400e387d48d09821b4a446577ede P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbdbc1633300449fb2b7c46f43bde744 in term 0.
I20260709 12:15:23.044543 25900 raft_consensus.cc:515] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:23.044839 25739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d3c8d7f2cc4c46ada3179f069388a8" candidate_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbdbc1633300449fb2b7c46f43bde744" is_pre_election: true
I20260709 12:15:23.051625 25739 raft_consensus.cc:2468] T f2d3c8d7f2cc4c46ada3179f069388a8 P fbdbc1633300449fb2b7c46f43bde744 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b0ac7cec35b445bbfbfff828cdedfcf in term 0.
I20260709 12:15:23.053398 25781 leader_election.cc:304] T f2d3c8d7f2cc4c46ada3179f069388a8 P 2b0ac7cec35b445bbfbfff828cdedfcf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b0ac7cec35b445bbfbfff828cdedfcf, fbdbc1633300449fb2b7c46f43bde744; no voters: 
I20260709 12:15:23.049429 25887 raft_consensus.cc:493] T 2312590ea8034475b5d8d6cd73d3fce7 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:23.053623 25817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019b400e387d48d09821b4a446577ede" candidate_uuid: "521c8650b93e4a7fa1905efd229fbdf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" is_pre_election: true
I20260709 12:15:23.055348 25863 raft_consensus.cc:2804] T f2d3c8d7f2cc4c46ada3179f069388a8 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:23.053471 25709 leader_election.cc:304] T 019b400e387d48d09821b4a446577ede P fbdbc1633300449fb2b7c46f43bde744 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 521c8650b93e4a7fa1905efd229fbdf6, fbdbc1633300449fb2b7c46f43bde744; no voters: 2b0ac7cec35b445bbfbfff828cdedfcf
I20260709 12:15:23.056005 25863 raft_consensus.cc:493] T f2d3c8d7f2cc4c46ada3179f069388a8 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:23.056393 25633 leader_election.cc:343] T 019b400e387d48d09821b4a446577ede P 521c8650b93e4a7fa1905efd229fbdf6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b0ac7cec35b445bbfbfff828cdedfcf (127.12.56.195:36129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:23.056658 25863 raft_consensus.cc:3060] T f2d3c8d7f2cc4c46ada3179f069388a8 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:23.054597 25887 raft_consensus.cc:3060] T 2312590ea8034475b5d8d6cd73d3fce7 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:23.057000 25865 raft_consensus.cc:2804] T 019b400e387d48d09821b4a446577ede P fbdbc1633300449fb2b7c46f43bde744 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:23.057533 25865 raft_consensus.cc:493] T 019b400e387d48d09821b4a446577ede P fbdbc1633300449fb2b7c46f43bde744 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:23.058007 25865 raft_consensus.cc:3060] T 019b400e387d48d09821b4a446577ede P fbdbc1633300449fb2b7c46f43bde744 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:23.058696 25901 leader_election.cc:290] T 019b400e387d48d09821b4a446577ede P 521c8650b93e4a7fa1905efd229fbdf6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fbdbc1633300449fb2b7c46f43bde744 (127.12.56.194:37715), 2b0ac7cec35b445bbfbfff828cdedfcf (127.12.56.195:36129)
I20260709 12:15:23.058980 25565 catalog_manager.cc:5697] T 032e30d956ec4c6c90f1ba5db5504a5d P 2b0ac7cec35b445bbfbfff828cdedfcf reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b0ac7cec35b445bbfbfff828cdedfcf (127.12.56.195). New cstate: current_term: 1 leader_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:23.067350 25900 leader_election.cc:290] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P 2b0ac7cec35b445bbfbfff828cdedfcf [CANDIDATE]: Term 1 election: Requested vote from peers 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441), fbdbc1633300449fb2b7c46f43bde744 (127.12.56.194:37715)
I20260709 12:15:23.067708 25739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9ae2bf53c4c20a18fec7bc796dfb3" candidate_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbdbc1633300449fb2b7c46f43bde744"
I20260709 12:15:23.068405 25739 raft_consensus.cc:3060] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P fbdbc1633300449fb2b7c46f43bde744 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:23.069327 25887 raft_consensus.cc:515] T 2312590ea8034475b5d8d6cd73d3fce7 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:23.070016 25743 raft_consensus.cc:2468] T 47044718acc14024854627db0aed3d3e P fbdbc1633300449fb2b7c46f43bde744 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b0ac7cec35b445bbfbfff828cdedfcf in term 1.
I20260709 12:15:23.071578 25781 leader_election.cc:304] T 47044718acc14024854627db0aed3d3e P 2b0ac7cec35b445bbfbfff828cdedfcf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b0ac7cec35b445bbfbfff828cdedfcf, fbdbc1633300449fb2b7c46f43bde744; no voters: 
I20260709 12:15:23.072553 25900 raft_consensus.cc:2804] T 47044718acc14024854627db0aed3d3e P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:23.073395 25900 raft_consensus.cc:697] T 47044718acc14024854627db0aed3d3e P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 LEADER]: Becoming Leader. State: Replica: 2b0ac7cec35b445bbfbfff828cdedfcf, State: Running, Role: LEADER
I20260709 12:15:23.073906 25668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032e30d956ec4c6c90f1ba5db5504a5d" candidate_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "521c8650b93e4a7fa1905efd229fbdf6" is_pre_election: true
I20260709 12:15:23.063867 25857 tablet_bootstrap.cc:492] T 019b400e387d48d09821b4a446577ede P 2b0ac7cec35b445bbfbfff828cdedfcf: No bootstrap required, opened a new log
I20260709 12:15:23.066594 25859 tablet_bootstrap.cc:492] T 032e30d956ec4c6c90f1ba5db5504a5d P 521c8650b93e4a7fa1905efd229fbdf6: No bootstrap required, opened a new log
I20260709 12:15:23.075133 25857 ts_tablet_manager.cc:1403] T 019b400e387d48d09821b4a446577ede P 2b0ac7cec35b445bbfbfff828cdedfcf: Time spent bootstrapping tablet: real 0.056s	user 0.011s	sys 0.005s
I20260709 12:15:23.075178 25859 ts_tablet_manager.cc:1403] T 032e30d956ec4c6c90f1ba5db5504a5d P 521c8650b93e4a7fa1905efd229fbdf6: Time spent bootstrapping tablet: real 0.039s	user 0.015s	sys 0.000s
I20260709 12:15:23.074456 25900 consensus_queue.cc:237] T 47044718acc14024854627db0aed3d3e P 2b0ac7cec35b445bbfbfff828cdedfcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:23.076226 25668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c784ca806e4871a483636451018b1e" candidate_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "521c8650b93e4a7fa1905efd229fbdf6"
I20260709 12:15:23.080550 25668 raft_consensus.cc:2393] T 78c784ca806e4871a483636451018b1e P 521c8650b93e4a7fa1905efd229fbdf6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b0ac7cec35b445bbfbfff828cdedfcf in current term 1: Already voted for candidate 521c8650b93e4a7fa1905efd229fbdf6 in this term.
I20260709 12:15:23.077831 25667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47044718acc14024854627db0aed3d3e" candidate_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "521c8650b93e4a7fa1905efd229fbdf6"
I20260709 12:15:23.078642 25859 raft_consensus.cc:359] T 032e30d956ec4c6c90f1ba5db5504a5d P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } }
I20260709 12:15:23.081496 25667 raft_consensus.cc:3060] T 47044718acc14024854627db0aed3d3e P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:23.082348 25668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2312590ea8034475b5d8d6cd73d3fce7" candidate_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "521c8650b93e4a7fa1905efd229fbdf6" is_pre_election: true
I20260709 12:15:23.083433 25887 leader_election.cc:290] T 2312590ea8034475b5d8d6cd73d3fce7 P 2b0ac7cec35b445bbfbfff828cdedfcf [CANDIDATE]: Term 1 election: Requested vote from peers 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441), fbdbc1633300449fb2b7c46f43bde744 (127.12.56.194:37715)
I20260709 12:15:23.083220 25739 raft_consensus.cc:2468] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P fbdbc1633300449fb2b7c46f43bde744 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b0ac7cec35b445bbfbfff828cdedfcf in term 1.
I20260709 12:15:23.073423 25741 raft_consensus.cc:2468] T 78c784ca806e4871a483636451018b1e P fbdbc1633300449fb2b7c46f43bde744 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b0ac7cec35b445bbfbfff828cdedfcf in term 1.
I20260709 12:15:23.085692 25781 leader_election.cc:304] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P 2b0ac7cec35b445bbfbfff828cdedfcf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b0ac7cec35b445bbfbfff828cdedfcf, fbdbc1633300449fb2b7c46f43bde744; no voters: 
I20260709 12:15:23.086897 25781 leader_election.cc:304] T 78c784ca806e4871a483636451018b1e P 2b0ac7cec35b445bbfbfff828cdedfcf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b0ac7cec35b445bbfbfff828cdedfcf, fbdbc1633300449fb2b7c46f43bde744; no voters: 
I20260709 12:15:23.087860 25886 raft_consensus.cc:2804] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:23.079387 25666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032e30d956ec4c6c90f1ba5db5504a5d" candidate_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "521c8650b93e4a7fa1905efd229fbdf6"
I20260709 12:15:23.062093 25904 raft_consensus.cc:493] T f2d3c8d7f2cc4c46ada3179f069388a8 P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:23.081478 25859 raft_consensus.cc:385] T 032e30d956ec4c6c90f1ba5db5504a5d P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:23.089319 25859 raft_consensus.cc:740] T 032e30d956ec4c6c90f1ba5db5504a5d P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 521c8650b93e4a7fa1905efd229fbdf6, State: Initialized, Role: FOLLOWER
I20260709 12:15:23.089396 25904 raft_consensus.cc:515] T f2d3c8d7f2cc4c46ada3179f069388a8 P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:23.087203 25863 raft_consensus.cc:515] T f2d3c8d7f2cc4c46ada3179f069388a8 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:23.093637 25743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2312590ea8034475b5d8d6cd73d3fce7" candidate_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbdbc1633300449fb2b7c46f43bde744"
I20260709 12:15:23.079267 25857 raft_consensus.cc:359] T 019b400e387d48d09821b4a446577ede P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:23.093904 25887 raft_consensus.cc:2804] T 78c784ca806e4871a483636451018b1e P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:23.096324 25668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d3c8d7f2cc4c46ada3179f069388a8" candidate_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "521c8650b93e4a7fa1905efd229fbdf6" is_pre_election: true
I20260709 12:15:23.096192 25859 consensus_queue.cc:260] T 032e30d956ec4c6c90f1ba5db5504a5d P 521c8650b93e4a7fa1905efd229fbdf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } }
I20260709 12:15:23.098006 25857 raft_consensus.cc:385] T 019b400e387d48d09821b4a446577ede P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:23.099714 25857 raft_consensus.cc:740] T 019b400e387d48d09821b4a446577ede P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b0ac7cec35b445bbfbfff828cdedfcf, State: Initialized, Role: FOLLOWER
I20260709 12:15:23.100863 25666 raft_consensus.cc:3060] T 032e30d956ec4c6c90f1ba5db5504a5d P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:23.101191 25665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9ae2bf53c4c20a18fec7bc796dfb3" candidate_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "521c8650b93e4a7fa1905efd229fbdf6"
I20260709 12:15:23.101991 25665 raft_consensus.cc:3060] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:23.102569 25741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019b400e387d48d09821b4a446577ede" candidate_uuid: "521c8650b93e4a7fa1905efd229fbdf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbdbc1633300449fb2b7c46f43bde744" is_pre_election: true
W20260709 12:15:23.104756 25783 leader_election.cc:343] T 032e30d956ec4c6c90f1ba5db5504a5d P 2b0ac7cec35b445bbfbfff828cdedfcf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:23.097669 25904 leader_election.cc:290] T f2d3c8d7f2cc4c46ada3179f069388a8 P 521c8650b93e4a7fa1905efd229fbdf6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fbdbc1633300449fb2b7c46f43bde744 (127.12.56.194:37715), 2b0ac7cec35b445bbfbfff828cdedfcf (127.12.56.195:36129)
I20260709 12:15:23.105832 25743 raft_consensus.cc:3060] T 2312590ea8034475b5d8d6cd73d3fce7 P fbdbc1633300449fb2b7c46f43bde744 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:23.106812 25664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2312590ea8034475b5d8d6cd73d3fce7" candidate_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "521c8650b93e4a7fa1905efd229fbdf6"
W20260709 12:15:23.107483 25783 leader_election.cc:343] T 2312590ea8034475b5d8d6cd73d3fce7 P 2b0ac7cec35b445bbfbfff828cdedfcf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:23.108258 25817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d3c8d7f2cc4c46ada3179f069388a8" candidate_uuid: "521c8650b93e4a7fa1905efd229fbdf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" is_pre_election: true
I20260709 12:15:23.109863 25739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d3c8d7f2cc4c46ada3179f069388a8" candidate_uuid: "521c8650b93e4a7fa1905efd229fbdf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbdbc1633300449fb2b7c46f43bde744" is_pre_election: true
I20260709 12:15:23.110591 25739 raft_consensus.cc:2468] T f2d3c8d7f2cc4c46ada3179f069388a8 P fbdbc1633300449fb2b7c46f43bde744 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 521c8650b93e4a7fa1905efd229fbdf6 in term 0.
I20260709 12:15:23.111287 25857 consensus_queue.cc:260] T 019b400e387d48d09821b4a446577ede P 2b0ac7cec35b445bbfbfff828cdedfcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:23.093560 25667 raft_consensus.cc:2468] T 47044718acc14024854627db0aed3d3e P 521c8650b93e4a7fa1905efd229fbdf6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b0ac7cec35b445bbfbfff828cdedfcf in term 1.
I20260709 12:15:23.114362 25668 raft_consensus.cc:2468] T f2d3c8d7f2cc4c46ada3179f069388a8 P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b0ac7cec35b445bbfbfff828cdedfcf in term 0.
I20260709 12:15:23.120931 25817 raft_consensus.cc:2393] T f2d3c8d7f2cc4c46ada3179f069388a8 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 521c8650b93e4a7fa1905efd229fbdf6 in current term 1: Already voted for candidate 2b0ac7cec35b445bbfbfff828cdedfcf in this term.
I20260709 12:15:23.117938 25886 raft_consensus.cc:697] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 LEADER]: Becoming Leader. State: Replica: 2b0ac7cec35b445bbfbfff828cdedfcf, State: Running, Role: LEADER
I20260709 12:15:23.128818 25858 tablet_bootstrap.cc:492] T 6c0bcf651cbe40a59f93666829cbacd5 P fbdbc1633300449fb2b7c46f43bde744: No bootstrap required, opened a new log
I20260709 12:15:23.130590 25858 ts_tablet_manager.cc:1403] T 6c0bcf651cbe40a59f93666829cbacd5 P fbdbc1633300449fb2b7c46f43bde744: Time spent bootstrapping tablet: real 0.113s	user 0.010s	sys 0.009s
I20260709 12:15:23.131860 25887 raft_consensus.cc:697] T 78c784ca806e4871a483636451018b1e P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 LEADER]: Becoming Leader. State: Replica: 2b0ac7cec35b445bbfbfff828cdedfcf, State: Running, Role: LEADER
I20260709 12:15:23.133065 25887 consensus_queue.cc:237] T 78c784ca806e4871a483636451018b1e P 2b0ac7cec35b445bbfbfff828cdedfcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:23.135210 25858 raft_consensus.cc:359] T 6c0bcf651cbe40a59f93666829cbacd5 P fbdbc1633300449fb2b7c46f43bde744 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:23.136790 25858 raft_consensus.cc:385] T 6c0bcf651cbe40a59f93666829cbacd5 P fbdbc1633300449fb2b7c46f43bde744 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:23.137651 25858 raft_consensus.cc:740] T 6c0bcf651cbe40a59f93666829cbacd5 P fbdbc1633300449fb2b7c46f43bde744 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbdbc1633300449fb2b7c46f43bde744, State: Initialized, Role: FOLLOWER
I20260709 12:15:23.134886 25665 raft_consensus.cc:2468] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P 521c8650b93e4a7fa1905efd229fbdf6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b0ac7cec35b445bbfbfff828cdedfcf in term 1.
I20260709 12:15:23.136425 25886 consensus_queue.cc:237] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P 2b0ac7cec35b445bbfbfff828cdedfcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:23.139226 25863 leader_election.cc:290] T f2d3c8d7f2cc4c46ada3179f069388a8 P 2b0ac7cec35b445bbfbfff828cdedfcf [CANDIDATE]: Term 1 election: Requested vote from peers 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441), fbdbc1633300449fb2b7c46f43bde744 (127.12.56.194:37715)
I20260709 12:15:23.141122 25858 consensus_queue.cc:260] T 6c0bcf651cbe40a59f93666829cbacd5 P fbdbc1633300449fb2b7c46f43bde744 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:23.145237 25858 ts_tablet_manager.cc:1434] T 6c0bcf651cbe40a59f93666829cbacd5 P fbdbc1633300449fb2b7c46f43bde744: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:15:23.140823 25865 raft_consensus.cc:515] T 019b400e387d48d09821b4a446577ede P fbdbc1633300449fb2b7c46f43bde744 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:23.136392 25632 leader_election.cc:304] T 78c784ca806e4871a483636451018b1e P 521c8650b93e4a7fa1905efd229fbdf6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 521c8650b93e4a7fa1905efd229fbdf6; no voters: 2b0ac7cec35b445bbfbfff828cdedfcf, fbdbc1633300449fb2b7c46f43bde744
I20260709 12:15:23.147433 25857 ts_tablet_manager.cc:1434] T 019b400e387d48d09821b4a446577ede P 2b0ac7cec35b445bbfbfff828cdedfcf: Time spent starting tablet: real 0.071s	user 0.012s	sys 0.001s
I20260709 12:15:23.147105 25739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d3c8d7f2cc4c46ada3179f069388a8" candidate_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbdbc1633300449fb2b7c46f43bde744"
I20260709 12:15:23.149573 25857 tablet_bootstrap.cc:492] T 6c0bcf651cbe40a59f93666829cbacd5 P 2b0ac7cec35b445bbfbfff828cdedfcf: Bootstrap starting.
I20260709 12:15:23.150622 25741 raft_consensus.cc:2393] T 019b400e387d48d09821b4a446577ede P fbdbc1633300449fb2b7c46f43bde744 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 521c8650b93e4a7fa1905efd229fbdf6 in current term 1: Already voted for candidate fbdbc1633300449fb2b7c46f43bde744 in this term.
I20260709 12:15:23.151197 25739 raft_consensus.cc:3060] T f2d3c8d7f2cc4c46ada3179f069388a8 P fbdbc1633300449fb2b7c46f43bde744 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:23.151279 25904 raft_consensus.cc:2749] T 78c784ca806e4871a483636451018b1e P 521c8650b93e4a7fa1905efd229fbdf6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:15:23.153162 25632 leader_election.cc:304] T f2d3c8d7f2cc4c46ada3179f069388a8 P 521c8650b93e4a7fa1905efd229fbdf6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 521c8650b93e4a7fa1905efd229fbdf6, fbdbc1633300449fb2b7c46f43bde744; no voters: 2b0ac7cec35b445bbfbfff828cdedfcf
I20260709 12:15:23.154167 25904 raft_consensus.cc:2804] T f2d3c8d7f2cc4c46ada3179f069388a8 P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:23.154666 25904 raft_consensus.cc:493] T f2d3c8d7f2cc4c46ada3179f069388a8 P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:23.155115 25904 raft_consensus.cc:3060] T f2d3c8d7f2cc4c46ada3179f069388a8 P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:23.159325 25857 tablet_bootstrap.cc:654] T 6c0bcf651cbe40a59f93666829cbacd5 P 2b0ac7cec35b445bbfbfff828cdedfcf: Neither blocks nor log segments found. Creating new log.
W20260709 12:15:23.163077 25783 leader_election.cc:343] T 2312590ea8034475b5d8d6cd73d3fce7 P 2b0ac7cec35b445bbfbfff828cdedfcf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:23.164222 25865 leader_election.cc:290] T 019b400e387d48d09821b4a446577ede P fbdbc1633300449fb2b7c46f43bde744 [CANDIDATE]: Term 1 election: Requested vote from peers 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441), 2b0ac7cec35b445bbfbfff828cdedfcf (127.12.56.195:36129)
I20260709 12:15:23.164746 25665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d3c8d7f2cc4c46ada3179f069388a8" candidate_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "521c8650b93e4a7fa1905efd229fbdf6"
I20260709 12:15:23.164885 25632 leader_election.cc:304] T 019b400e387d48d09821b4a446577ede P 521c8650b93e4a7fa1905efd229fbdf6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 521c8650b93e4a7fa1905efd229fbdf6; no voters: 2b0ac7cec35b445bbfbfff828cdedfcf, fbdbc1633300449fb2b7c46f43bde744
I20260709 12:15:23.165851 25901 raft_consensus.cc:3060] T 019b400e387d48d09821b4a446577ede P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:23.167357 25668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019b400e387d48d09821b4a446577ede" candidate_uuid: "fbdbc1633300449fb2b7c46f43bde744" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "521c8650b93e4a7fa1905efd229fbdf6"
I20260709 12:15:23.168416 25743 raft_consensus.cc:2468] T 2312590ea8034475b5d8d6cd73d3fce7 P fbdbc1633300449fb2b7c46f43bde744 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b0ac7cec35b445bbfbfff828cdedfcf in term 1.
I20260709 12:15:23.168684 25667 raft_consensus.cc:3060] T ccfca33043a14a9089a3c59b29c3b442 P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:23.172978 25817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019b400e387d48d09821b4a446577ede" candidate_uuid: "fbdbc1633300449fb2b7c46f43bde744" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf"
I20260709 12:15:23.173646 25817 raft_consensus.cc:3060] T 019b400e387d48d09821b4a446577ede P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:23.174307 25901 raft_consensus.cc:2749] T 019b400e387d48d09821b4a446577ede P 521c8650b93e4a7fa1905efd229fbdf6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:23.178429 25781 leader_election.cc:304] T 2312590ea8034475b5d8d6cd73d3fce7 P 2b0ac7cec35b445bbfbfff828cdedfcf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b0ac7cec35b445bbfbfff828cdedfcf, fbdbc1633300449fb2b7c46f43bde744; no voters: 521c8650b93e4a7fa1905efd229fbdf6
I20260709 12:15:23.188993 25904 raft_consensus.cc:515] T f2d3c8d7f2cc4c46ada3179f069388a8 P 521c8650b93e4a7fa1905efd229fbdf6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:23.190757 25665 raft_consensus.cc:2393] T f2d3c8d7f2cc4c46ada3179f069388a8 P 521c8650b93e4a7fa1905efd229fbdf6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b0ac7cec35b445bbfbfff828cdedfcf in current term 1: Already voted for candidate 521c8650b93e4a7fa1905efd229fbdf6 in this term.
I20260709 12:15:23.194319 25562 catalog_manager.cc:5697] T 47044718acc14024854627db0aed3d3e P 2b0ac7cec35b445bbfbfff828cdedfcf reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b0ac7cec35b445bbfbfff828cdedfcf (127.12.56.195). New cstate: current_term: 1 leader_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:23.196295 25668 raft_consensus.cc:2468] T 019b400e387d48d09821b4a446577ede P 521c8650b93e4a7fa1905efd229fbdf6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbdbc1633300449fb2b7c46f43bde744 in term 1.
I20260709 12:15:23.185498 25900 raft_consensus.cc:2804] T 2312590ea8034475b5d8d6cd73d3fce7 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:23.185432 25912 raft_consensus.cc:493] T 06be549acfdb46a9801ebced1ab5be4d P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:23.199837 25709 leader_election.cc:304] T 019b400e387d48d09821b4a446577ede P fbdbc1633300449fb2b7c46f43bde744 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 521c8650b93e4a7fa1905efd229fbdf6, fbdbc1633300449fb2b7c46f43bde744; no voters: 
I20260709 12:15:23.200048 25904 leader_election.cc:290] T f2d3c8d7f2cc4c46ada3179f069388a8 P 521c8650b93e4a7fa1905efd229fbdf6 [CANDIDATE]: Term 1 election: Requested vote from peers fbdbc1633300449fb2b7c46f43bde744 (127.12.56.194:37715), 2b0ac7cec35b445bbfbfff828cdedfcf (127.12.56.195:36129)
I20260709 12:15:23.200974 25879 raft_consensus.cc:2804] T 019b400e387d48d09821b4a446577ede P fbdbc1633300449fb2b7c46f43bde744 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:23.201655 25816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d3c8d7f2cc4c46ada3179f069388a8" candidate_uuid: "521c8650b93e4a7fa1905efd229fbdf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf"
I20260709 12:15:23.202548 25816 raft_consensus.cc:2393] T f2d3c8d7f2cc4c46ada3179f069388a8 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 521c8650b93e4a7fa1905efd229fbdf6 in current term 1: Already voted for candidate 2b0ac7cec35b445bbfbfff828cdedfcf in this term.
I20260709 12:15:23.203181 25739 raft_consensus.cc:2468] T f2d3c8d7f2cc4c46ada3179f069388a8 P fbdbc1633300449fb2b7c46f43bde744 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b0ac7cec35b445bbfbfff828cdedfcf in term 1.
I20260709 12:15:23.201646 25879 raft_consensus.cc:697] T 019b400e387d48d09821b4a446577ede P fbdbc1633300449fb2b7c46f43bde744 [term 1 LEADER]: Becoming Leader. State: Replica: fbdbc1633300449fb2b7c46f43bde744, State: Running, Role: LEADER
I20260709 12:15:23.204392 25879 consensus_queue.cc:237] T 019b400e387d48d09821b4a446577ede P fbdbc1633300449fb2b7c46f43bde744 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:23.205667 25739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d3c8d7f2cc4c46ada3179f069388a8" candidate_uuid: "521c8650b93e4a7fa1905efd229fbdf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbdbc1633300449fb2b7c46f43bde744"
I20260709 12:15:23.206796 25739 raft_consensus.cc:2393] T f2d3c8d7f2cc4c46ada3179f069388a8 P fbdbc1633300449fb2b7c46f43bde744 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 521c8650b93e4a7fa1905efd229fbdf6 in current term 1: Already voted for candidate 2b0ac7cec35b445bbfbfff828cdedfcf in this term.
I20260709 12:15:23.207361 25781 leader_election.cc:304] T f2d3c8d7f2cc4c46ada3179f069388a8 P 2b0ac7cec35b445bbfbfff828cdedfcf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b0ac7cec35b445bbfbfff828cdedfcf, fbdbc1633300449fb2b7c46f43bde744; no voters: 521c8650b93e4a7fa1905efd229fbdf6
I20260709 12:15:23.208128 25817 raft_consensus.cc:2468] T 019b400e387d48d09821b4a446577ede P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbdbc1633300449fb2b7c46f43bde744 in term 1.
I20260709 12:15:23.208163 25632 leader_election.cc:304] T f2d3c8d7f2cc4c46ada3179f069388a8 P 521c8650b93e4a7fa1905efd229fbdf6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 521c8650b93e4a7fa1905efd229fbdf6; no voters: 2b0ac7cec35b445bbfbfff828cdedfcf, fbdbc1633300449fb2b7c46f43bde744
I20260709 12:15:23.209836 25865 consensus_queue.cc:1048] T ccfca33043a14a9089a3c59b29c3b442 P fbdbc1633300449fb2b7c46f43bde744 [LEADER]: Connected to new peer: Peer: permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:23.210739 25900 raft_consensus.cc:697] T 2312590ea8034475b5d8d6cd73d3fce7 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 LEADER]: Becoming Leader. State: Replica: 2b0ac7cec35b445bbfbfff828cdedfcf, State: Running, Role: LEADER
I20260709 12:15:23.210975 25904 raft_consensus.cc:2749] T f2d3c8d7f2cc4c46ada3179f069388a8 P 521c8650b93e4a7fa1905efd229fbdf6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:15:23.209403 25666 raft_consensus.cc:2468] T 032e30d956ec4c6c90f1ba5db5504a5d P 521c8650b93e4a7fa1905efd229fbdf6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b0ac7cec35b445bbfbfff828cdedfcf in term 1.
I20260709 12:15:23.209973 25912 raft_consensus.cc:515] T 06be549acfdb46a9801ebced1ab5be4d P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:23.208367 25887 raft_consensus.cc:2804] T f2d3c8d7f2cc4c46ada3179f069388a8 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:23.213716 25887 raft_consensus.cc:697] T f2d3c8d7f2cc4c46ada3179f069388a8 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 LEADER]: Becoming Leader. State: Replica: 2b0ac7cec35b445bbfbfff828cdedfcf, State: Running, Role: LEADER
I20260709 12:15:23.212105 25900 consensus_queue.cc:237] T 2312590ea8034475b5d8d6cd73d3fce7 P 2b0ac7cec35b445bbfbfff828cdedfcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:23.215188 25887 consensus_queue.cc:237] T f2d3c8d7f2cc4c46ada3179f069388a8 P 2b0ac7cec35b445bbfbfff828cdedfcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:23.224864 25859 ts_tablet_manager.cc:1434] T 032e30d956ec4c6c90f1ba5db5504a5d P 521c8650b93e4a7fa1905efd229fbdf6: Time spent starting tablet: real 0.149s	user 0.012s	sys 0.000s
I20260709 12:15:23.228713 25859 tablet_bootstrap.cc:492] T 2312590ea8034475b5d8d6cd73d3fce7 P 521c8650b93e4a7fa1905efd229fbdf6: Bootstrap starting.
I20260709 12:15:23.235147 25666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06be549acfdb46a9801ebced1ab5be4d" candidate_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "521c8650b93e4a7fa1905efd229fbdf6" is_pre_election: true
W20260709 12:15:23.237035 25783 leader_election.cc:343] T 06be549acfdb46a9801ebced1ab5be4d P 2b0ac7cec35b445bbfbfff828cdedfcf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:23.238564 25912 leader_election.cc:290] T 06be549acfdb46a9801ebced1ab5be4d P 2b0ac7cec35b445bbfbfff828cdedfcf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441), fbdbc1633300449fb2b7c46f43bde744 (127.12.56.194:37715)
I20260709 12:15:23.239856 25739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06be549acfdb46a9801ebced1ab5be4d" candidate_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbdbc1633300449fb2b7c46f43bde744" is_pre_election: true
I20260709 12:15:23.240718 25739 raft_consensus.cc:2468] T 06be549acfdb46a9801ebced1ab5be4d P fbdbc1633300449fb2b7c46f43bde744 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b0ac7cec35b445bbfbfff828cdedfcf in term 0.
I20260709 12:15:23.241022 25857 tablet_bootstrap.cc:492] T 6c0bcf651cbe40a59f93666829cbacd5 P 2b0ac7cec35b445bbfbfff828cdedfcf: No bootstrap required, opened a new log
I20260709 12:15:23.241811 25857 ts_tablet_manager.cc:1403] T 6c0bcf651cbe40a59f93666829cbacd5 P 2b0ac7cec35b445bbfbfff828cdedfcf: Time spent bootstrapping tablet: real 0.092s	user 0.011s	sys 0.017s
I20260709 12:15:23.242466 25781 leader_election.cc:304] T 06be549acfdb46a9801ebced1ab5be4d P 2b0ac7cec35b445bbfbfff828cdedfcf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b0ac7cec35b445bbfbfff828cdedfcf, fbdbc1633300449fb2b7c46f43bde744; no voters: 521c8650b93e4a7fa1905efd229fbdf6
I20260709 12:15:23.243470 25859 tablet_bootstrap.cc:654] T 2312590ea8034475b5d8d6cd73d3fce7 P 521c8650b93e4a7fa1905efd229fbdf6: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:23.243937 25912 raft_consensus.cc:2804] T 06be549acfdb46a9801ebced1ab5be4d P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:23.244421 25912 raft_consensus.cc:493] T 06be549acfdb46a9801ebced1ab5be4d P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:23.244810 25912 raft_consensus.cc:3060] T 06be549acfdb46a9801ebced1ab5be4d P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:23.245692 25857 raft_consensus.cc:359] T 6c0bcf651cbe40a59f93666829cbacd5 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:23.246639 25857 raft_consensus.cc:385] T 6c0bcf651cbe40a59f93666829cbacd5 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:23.246924 25857 raft_consensus.cc:740] T 6c0bcf651cbe40a59f93666829cbacd5 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b0ac7cec35b445bbfbfff828cdedfcf, State: Initialized, Role: FOLLOWER
I20260709 12:15:23.247784 25857 consensus_queue.cc:260] T 6c0bcf651cbe40a59f93666829cbacd5 P 2b0ac7cec35b445bbfbfff828cdedfcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:23.251153 25857 ts_tablet_manager.cc:1434] T 6c0bcf651cbe40a59f93666829cbacd5 P 2b0ac7cec35b445bbfbfff828cdedfcf: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 12:15:23.262566 25565 catalog_manager.cc:5697] T 019b400e387d48d09821b4a446577ede P fbdbc1633300449fb2b7c46f43bde744 reported cstate change: term changed from 0 to 1, leader changed from <none> to fbdbc1633300449fb2b7c46f43bde744 (127.12.56.194). New cstate: current_term: 1 leader_uuid: "fbdbc1633300449fb2b7c46f43bde744" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:23.263815 25859 tablet_bootstrap.cc:492] T 2312590ea8034475b5d8d6cd73d3fce7 P 521c8650b93e4a7fa1905efd229fbdf6: No bootstrap required, opened a new log
I20260709 12:15:23.264504 25859 ts_tablet_manager.cc:1403] T 2312590ea8034475b5d8d6cd73d3fce7 P 521c8650b93e4a7fa1905efd229fbdf6: Time spent bootstrapping tablet: real 0.036s	user 0.012s	sys 0.002s
I20260709 12:15:23.268527 25859 raft_consensus.cc:359] T 2312590ea8034475b5d8d6cd73d3fce7 P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:23.269644 25859 raft_consensus.cc:385] T 2312590ea8034475b5d8d6cd73d3fce7 P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:23.270085 25859 raft_consensus.cc:740] T 2312590ea8034475b5d8d6cd73d3fce7 P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 521c8650b93e4a7fa1905efd229fbdf6, State: Initialized, Role: FOLLOWER
I20260709 12:15:23.270879 25859 consensus_queue.cc:260] T 2312590ea8034475b5d8d6cd73d3fce7 P 521c8650b93e4a7fa1905efd229fbdf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:23.273643 25859 ts_tablet_manager.cc:1434] T 2312590ea8034475b5d8d6cd73d3fce7 P 521c8650b93e4a7fa1905efd229fbdf6: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:15:23.275177 25859 tablet_bootstrap.cc:492] T 06be549acfdb46a9801ebced1ab5be4d P 521c8650b93e4a7fa1905efd229fbdf6: Bootstrap starting.
I20260709 12:15:23.280049 25562 catalog_manager.cc:5697] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P 2b0ac7cec35b445bbfbfff828cdedfcf reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b0ac7cec35b445bbfbfff828cdedfcf (127.12.56.195). New cstate: current_term: 1 leader_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:23.282680 25859 tablet_bootstrap.cc:654] T 06be549acfdb46a9801ebced1ab5be4d P 521c8650b93e4a7fa1905efd229fbdf6: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:23.282883 25912 raft_consensus.cc:515] T 06be549acfdb46a9801ebced1ab5be4d P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:23.283833 25865 consensus_queue.cc:1048] T ccfca33043a14a9089a3c59b29c3b442 P fbdbc1633300449fb2b7c46f43bde744 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:23.287081 25667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06be549acfdb46a9801ebced1ab5be4d" candidate_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "521c8650b93e4a7fa1905efd229fbdf6"
W20260709 12:15:23.289079 25783 leader_election.cc:343] T 06be549acfdb46a9801ebced1ab5be4d P 2b0ac7cec35b445bbfbfff828cdedfcf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:23.289479 25739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06be549acfdb46a9801ebced1ab5be4d" candidate_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbdbc1633300449fb2b7c46f43bde744"
I20260709 12:15:23.290652 25739 raft_consensus.cc:3060] T 06be549acfdb46a9801ebced1ab5be4d P fbdbc1633300449fb2b7c46f43bde744 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:23.302165 25912 leader_election.cc:290] T 06be549acfdb46a9801ebced1ab5be4d P 2b0ac7cec35b445bbfbfff828cdedfcf [CANDIDATE]: Term 1 election: Requested vote from peers 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441), fbdbc1633300449fb2b7c46f43bde744 (127.12.56.194:37715)
I20260709 12:15:23.306883 25739 raft_consensus.cc:2468] T 06be549acfdb46a9801ebced1ab5be4d P fbdbc1633300449fb2b7c46f43bde744 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b0ac7cec35b445bbfbfff828cdedfcf in term 1.
I20260709 12:15:23.309736 25781 leader_election.cc:304] T 06be549acfdb46a9801ebced1ab5be4d P 2b0ac7cec35b445bbfbfff828cdedfcf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b0ac7cec35b445bbfbfff828cdedfcf, fbdbc1633300449fb2b7c46f43bde744; no voters: 521c8650b93e4a7fa1905efd229fbdf6
I20260709 12:15:23.311743 25912 raft_consensus.cc:2804] T 06be549acfdb46a9801ebced1ab5be4d P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:23.312798 25912 raft_consensus.cc:697] T 06be549acfdb46a9801ebced1ab5be4d P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 LEADER]: Becoming Leader. State: Replica: 2b0ac7cec35b445bbfbfff828cdedfcf, State: Running, Role: LEADER
I20260709 12:15:23.314220 25912 consensus_queue.cc:237] T 06be549acfdb46a9801ebced1ab5be4d P 2b0ac7cec35b445bbfbfff828cdedfcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:23.282393 25562 catalog_manager.cc:5697] T 78c784ca806e4871a483636451018b1e P 2b0ac7cec35b445bbfbfff828cdedfcf reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b0ac7cec35b445bbfbfff828cdedfcf (127.12.56.195). New cstate: current_term: 1 leader_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:23.323441 25859 tablet_bootstrap.cc:492] T 06be549acfdb46a9801ebced1ab5be4d P 521c8650b93e4a7fa1905efd229fbdf6: No bootstrap required, opened a new log
I20260709 12:15:23.324110 25859 ts_tablet_manager.cc:1403] T 06be549acfdb46a9801ebced1ab5be4d P 521c8650b93e4a7fa1905efd229fbdf6: Time spent bootstrapping tablet: real 0.049s	user 0.030s	sys 0.016s
I20260709 12:15:23.326428 25904 raft_consensus.cc:493] T 6c0bcf651cbe40a59f93666829cbacd5 P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:23.327219 25904 raft_consensus.cc:515] T 6c0bcf651cbe40a59f93666829cbacd5 P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:23.324030 25562 catalog_manager.cc:5697] T f2d3c8d7f2cc4c46ada3179f069388a8 P 2b0ac7cec35b445bbfbfff828cdedfcf reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b0ac7cec35b445bbfbfff828cdedfcf (127.12.56.195). New cstate: current_term: 1 leader_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:23.328030 25859 raft_consensus.cc:359] T 06be549acfdb46a9801ebced1ab5be4d P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:23.328886 25859 raft_consensus.cc:385] T 06be549acfdb46a9801ebced1ab5be4d P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:23.329190 25859 raft_consensus.cc:740] T 06be549acfdb46a9801ebced1ab5be4d P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 521c8650b93e4a7fa1905efd229fbdf6, State: Initialized, Role: FOLLOWER
I20260709 12:15:23.329385 25562 catalog_manager.cc:5697] T 2312590ea8034475b5d8d6cd73d3fce7 P 2b0ac7cec35b445bbfbfff828cdedfcf reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b0ac7cec35b445bbfbfff828cdedfcf (127.12.56.195). New cstate: current_term: 1 leader_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:23.330133 25859 consensus_queue.cc:260] T 06be549acfdb46a9801ebced1ab5be4d P 521c8650b93e4a7fa1905efd229fbdf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:23.332018 25904 leader_election.cc:290] T 6c0bcf651cbe40a59f93666829cbacd5 P 521c8650b93e4a7fa1905efd229fbdf6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fbdbc1633300449fb2b7c46f43bde744 (127.12.56.194:37715), 2b0ac7cec35b445bbfbfff828cdedfcf (127.12.56.195:36129)
I20260709 12:15:23.333369 25816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0bcf651cbe40a59f93666829cbacd5" candidate_uuid: "521c8650b93e4a7fa1905efd229fbdf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" is_pre_election: true
I20260709 12:15:23.334519 25859 ts_tablet_manager.cc:1434] T 06be549acfdb46a9801ebced1ab5be4d P 521c8650b93e4a7fa1905efd229fbdf6: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 12:15:23.334527 25816 raft_consensus.cc:2468] T 6c0bcf651cbe40a59f93666829cbacd5 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 521c8650b93e4a7fa1905efd229fbdf6 in term 0.
I20260709 12:15:23.333287 25739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0bcf651cbe40a59f93666829cbacd5" candidate_uuid: "521c8650b93e4a7fa1905efd229fbdf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbdbc1633300449fb2b7c46f43bde744" is_pre_election: true
I20260709 12:15:23.335831 25739 raft_consensus.cc:2468] T 6c0bcf651cbe40a59f93666829cbacd5 P fbdbc1633300449fb2b7c46f43bde744 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 521c8650b93e4a7fa1905efd229fbdf6 in term 0.
I20260709 12:15:23.336273 25633 leader_election.cc:304] T 6c0bcf651cbe40a59f93666829cbacd5 P 521c8650b93e4a7fa1905efd229fbdf6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b0ac7cec35b445bbfbfff828cdedfcf, 521c8650b93e4a7fa1905efd229fbdf6; no voters: 
I20260709 12:15:23.338011 25904 raft_consensus.cc:2804] T 6c0bcf651cbe40a59f93666829cbacd5 P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:23.338460 25904 raft_consensus.cc:493] T 6c0bcf651cbe40a59f93666829cbacd5 P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:23.338886 25904 raft_consensus.cc:3060] T 6c0bcf651cbe40a59f93666829cbacd5 P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:23.345723 25904 raft_consensus.cc:515] T 6c0bcf651cbe40a59f93666829cbacd5 P 521c8650b93e4a7fa1905efd229fbdf6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:23.349054 25739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0bcf651cbe40a59f93666829cbacd5" candidate_uuid: "521c8650b93e4a7fa1905efd229fbdf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbdbc1633300449fb2b7c46f43bde744"
I20260709 12:15:23.349299 25817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0bcf651cbe40a59f93666829cbacd5" candidate_uuid: "521c8650b93e4a7fa1905efd229fbdf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf"
I20260709 12:15:23.349869 25739 raft_consensus.cc:3060] T 6c0bcf651cbe40a59f93666829cbacd5 P fbdbc1633300449fb2b7c46f43bde744 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:23.350031 25817 raft_consensus.cc:3060] T 6c0bcf651cbe40a59f93666829cbacd5 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:23.353192 25904 leader_election.cc:290] T 6c0bcf651cbe40a59f93666829cbacd5 P 521c8650b93e4a7fa1905efd229fbdf6 [CANDIDATE]: Term 1 election: Requested vote from peers fbdbc1633300449fb2b7c46f43bde744 (127.12.56.194:37715), 2b0ac7cec35b445bbfbfff828cdedfcf (127.12.56.195:36129)
I20260709 12:15:23.354825 25563 catalog_manager.cc:5697] T 06be549acfdb46a9801ebced1ab5be4d P 2b0ac7cec35b445bbfbfff828cdedfcf reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b0ac7cec35b445bbfbfff828cdedfcf (127.12.56.195). New cstate: current_term: 1 leader_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:23.357493 25739 raft_consensus.cc:2468] T 6c0bcf651cbe40a59f93666829cbacd5 P fbdbc1633300449fb2b7c46f43bde744 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 521c8650b93e4a7fa1905efd229fbdf6 in term 1.
I20260709 12:15:23.358903 25632 leader_election.cc:304] T 6c0bcf651cbe40a59f93666829cbacd5 P 521c8650b93e4a7fa1905efd229fbdf6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 521c8650b93e4a7fa1905efd229fbdf6, fbdbc1633300449fb2b7c46f43bde744; no voters: 
I20260709 12:15:23.359544 25817 raft_consensus.cc:2468] T 6c0bcf651cbe40a59f93666829cbacd5 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 521c8650b93e4a7fa1905efd229fbdf6 in term 1.
I20260709 12:15:23.359706 25904 raft_consensus.cc:2804] T 6c0bcf651cbe40a59f93666829cbacd5 P 521c8650b93e4a7fa1905efd229fbdf6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:23.361034 25904 raft_consensus.cc:697] T 6c0bcf651cbe40a59f93666829cbacd5 P 521c8650b93e4a7fa1905efd229fbdf6 [term 1 LEADER]: Becoming Leader. State: Replica: 521c8650b93e4a7fa1905efd229fbdf6, State: Running, Role: LEADER
I20260709 12:15:23.361948 25904 consensus_queue.cc:237] T 6c0bcf651cbe40a59f93666829cbacd5 P 521c8650b93e4a7fa1905efd229fbdf6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:23.371742 25563 catalog_manager.cc:5697] T 6c0bcf651cbe40a59f93666829cbacd5 P 521c8650b93e4a7fa1905efd229fbdf6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193). New cstate: current_term: 1 leader_uuid: "521c8650b93e4a7fa1905efd229fbdf6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:23.410873 12515 ts_manager.cc:295] Set tserver state for 521c8650b93e4a7fa1905efd229fbdf6 to MAINTENANCE_MODE
I20260709 12:15:23.411785 12515 tablet_server.cc:179] TabletServer@127.12.56.193:0 shutting down...
I20260709 12:15:23.444682 12515 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:23.445654 12515 tablet_replica.cc:333] T 2312590ea8034475b5d8d6cd73d3fce7 P 521c8650b93e4a7fa1905efd229fbdf6: stopping tablet replica
I20260709 12:15:23.446467 12515 raft_consensus.cc:2243] T 2312590ea8034475b5d8d6cd73d3fce7 P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.446950 12515 raft_consensus.cc:2272] T 2312590ea8034475b5d8d6cd73d3fce7 P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.449236 12515 tablet_replica.cc:333] T 06be549acfdb46a9801ebced1ab5be4d P 521c8650b93e4a7fa1905efd229fbdf6: stopping tablet replica
I20260709 12:15:23.449962 12515 raft_consensus.cc:2243] T 06be549acfdb46a9801ebced1ab5be4d P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.450369 12515 raft_consensus.cc:2272] T 06be549acfdb46a9801ebced1ab5be4d P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.452585 12515 tablet_replica.cc:333] T ccfca33043a14a9089a3c59b29c3b442 P 521c8650b93e4a7fa1905efd229fbdf6: stopping tablet replica
I20260709 12:15:23.453171 12515 raft_consensus.cc:2243] T ccfca33043a14a9089a3c59b29c3b442 P 521c8650b93e4a7fa1905efd229fbdf6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.453619 12515 raft_consensus.cc:2272] T ccfca33043a14a9089a3c59b29c3b442 P 521c8650b93e4a7fa1905efd229fbdf6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.456075 12515 tablet_replica.cc:333] T 032e30d956ec4c6c90f1ba5db5504a5d P 521c8650b93e4a7fa1905efd229fbdf6: stopping tablet replica
I20260709 12:15:23.456674 12515 raft_consensus.cc:2243] T 032e30d956ec4c6c90f1ba5db5504a5d P 521c8650b93e4a7fa1905efd229fbdf6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.457075 12515 raft_consensus.cc:2272] T 032e30d956ec4c6c90f1ba5db5504a5d P 521c8650b93e4a7fa1905efd229fbdf6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.459164 12515 tablet_replica.cc:333] T 6c0bcf651cbe40a59f93666829cbacd5 P 521c8650b93e4a7fa1905efd229fbdf6: stopping tablet replica
I20260709 12:15:23.459769 12515 raft_consensus.cc:2243] T 6c0bcf651cbe40a59f93666829cbacd5 P 521c8650b93e4a7fa1905efd229fbdf6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:23.460404 12515 pending_rounds.cc:70] T 6c0bcf651cbe40a59f93666829cbacd5 P 521c8650b93e4a7fa1905efd229fbdf6: Trying to abort 1 pending ops.
I20260709 12:15:23.460561 12515 pending_rounds.cc:77] T 6c0bcf651cbe40a59f93666829cbacd5 P 521c8650b93e4a7fa1905efd229fbdf6: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305622828501897216 op_type: NO_OP noop_request { }
I20260709 12:15:23.460906 12515 raft_consensus.cc:2889] T 6c0bcf651cbe40a59f93666829cbacd5 P 521c8650b93e4a7fa1905efd229fbdf6 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:15:23.461181 12515 raft_consensus.cc:2272] T 6c0bcf651cbe40a59f93666829cbacd5 P 521c8650b93e4a7fa1905efd229fbdf6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.463661 12515 tablet_replica.cc:333] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P 521c8650b93e4a7fa1905efd229fbdf6: stopping tablet replica
I20260709 12:15:23.464241 12515 raft_consensus.cc:2243] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P 521c8650b93e4a7fa1905efd229fbdf6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.464641 12515 raft_consensus.cc:2272] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P 521c8650b93e4a7fa1905efd229fbdf6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.466432 12515 tablet_replica.cc:333] T f2d3c8d7f2cc4c46ada3179f069388a8 P 521c8650b93e4a7fa1905efd229fbdf6: stopping tablet replica
I20260709 12:15:23.466992 12515 raft_consensus.cc:2243] T f2d3c8d7f2cc4c46ada3179f069388a8 P 521c8650b93e4a7fa1905efd229fbdf6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.467374 12515 raft_consensus.cc:2272] T f2d3c8d7f2cc4c46ada3179f069388a8 P 521c8650b93e4a7fa1905efd229fbdf6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.469265 12515 tablet_replica.cc:333] T 78c784ca806e4871a483636451018b1e P 521c8650b93e4a7fa1905efd229fbdf6: stopping tablet replica
I20260709 12:15:23.469843 12515 raft_consensus.cc:2243] T 78c784ca806e4871a483636451018b1e P 521c8650b93e4a7fa1905efd229fbdf6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.470260 12515 raft_consensus.cc:2272] T 78c784ca806e4871a483636451018b1e P 521c8650b93e4a7fa1905efd229fbdf6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.471909 12515 tablet_replica.cc:333] T 47044718acc14024854627db0aed3d3e P 521c8650b93e4a7fa1905efd229fbdf6: stopping tablet replica
I20260709 12:15:23.472411 12515 raft_consensus.cc:2243] T 47044718acc14024854627db0aed3d3e P 521c8650b93e4a7fa1905efd229fbdf6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.472780 12515 raft_consensus.cc:2272] T 47044718acc14024854627db0aed3d3e P 521c8650b93e4a7fa1905efd229fbdf6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.474493 12515 tablet_replica.cc:333] T 019b400e387d48d09821b4a446577ede P 521c8650b93e4a7fa1905efd229fbdf6: stopping tablet replica
I20260709 12:15:23.474942 12515 raft_consensus.cc:2243] T 019b400e387d48d09821b4a446577ede P 521c8650b93e4a7fa1905efd229fbdf6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.475301 12515 raft_consensus.cc:2272] T 019b400e387d48d09821b4a446577ede P 521c8650b93e4a7fa1905efd229fbdf6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.482267 25912 consensus_queue.cc:1048] T 47044718acc14024854627db0aed3d3e P 2b0ac7cec35b445bbfbfff828cdedfcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:15:23.499472 25783 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.56.193:37441: connect: Connection refused (error 111) [suppressed 444 similar messages]
W20260709 12:15:23.504669 25783 consensus_peers.cc:597] T 47044718acc14024854627db0aed3d3e P 2b0ac7cec35b445bbfbfff828cdedfcf -> Peer 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441): Couldn't send request to peer 521c8650b93e4a7fa1905efd229fbdf6. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:37441: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:23.509620 12515 tablet_server.cc:196] TabletServer@127.12.56.193:0 shutdown complete.
W20260709 12:15:23.574110 25783 consensus_peers.cc:597] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P 2b0ac7cec35b445bbfbfff828cdedfcf -> Peer 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441): Couldn't send request to peer 521c8650b93e4a7fa1905efd229fbdf6. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:37441: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:23.585011 25783 consensus_peers.cc:597] T 032e30d956ec4c6c90f1ba5db5504a5d P 2b0ac7cec35b445bbfbfff828cdedfcf -> Peer 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441): Couldn't send request to peer 521c8650b93e4a7fa1905efd229fbdf6. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:37441: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:23.629067 25886 consensus_queue.cc:1048] T 032e30d956ec4c6c90f1ba5db5504a5d P 2b0ac7cec35b445bbfbfff828cdedfcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:23.641937 25887 consensus_queue.cc:1048] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P 2b0ac7cec35b445bbfbfff828cdedfcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:23.705490 25886 consensus_queue.cc:1048] T 78c784ca806e4871a483636451018b1e P 2b0ac7cec35b445bbfbfff828cdedfcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:15:23.719853 25783 consensus_peers.cc:597] T 78c784ca806e4871a483636451018b1e P 2b0ac7cec35b445bbfbfff828cdedfcf -> Peer 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441): Couldn't send request to peer 521c8650b93e4a7fa1905efd229fbdf6. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:37441: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:23.723984 25614 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:15:23.747084 25865 consensus_queue.cc:1048] T 019b400e387d48d09821b4a446577ede P fbdbc1633300449fb2b7c46f43bde744 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:23.751366 25887 consensus_queue.cc:1048] T 06be549acfdb46a9801ebced1ab5be4d P 2b0ac7cec35b445bbfbfff828cdedfcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:15:23.779429 25709 consensus_peers.cc:597] T 019b400e387d48d09821b4a446577ede P fbdbc1633300449fb2b7c46f43bde744 -> Peer 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441): Couldn't send request to peer 521c8650b93e4a7fa1905efd229fbdf6. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:37441: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:23.785166 25783 consensus_peers.cc:597] T 06be549acfdb46a9801ebced1ab5be4d P 2b0ac7cec35b445bbfbfff828cdedfcf -> Peer 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441): Couldn't send request to peer 521c8650b93e4a7fa1905efd229fbdf6. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:37441: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:23.786038 25709 consensus_peers.cc:597] T ccfca33043a14a9089a3c59b29c3b442 P fbdbc1633300449fb2b7c46f43bde744 -> Peer 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441): Couldn't send request to peer 521c8650b93e4a7fa1905efd229fbdf6. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:37441: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:23.790640 25783 consensus_peers.cc:597] T f2d3c8d7f2cc4c46ada3179f069388a8 P 2b0ac7cec35b445bbfbfff828cdedfcf -> Peer 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441): Couldn't send request to peer 521c8650b93e4a7fa1905efd229fbdf6. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:37441: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:23.791747 25912 consensus_queue.cc:1048] T f2d3c8d7f2cc4c46ada3179f069388a8 P 2b0ac7cec35b445bbfbfff828cdedfcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:23.794027 25912 consensus_queue.cc:1048] T 2312590ea8034475b5d8d6cd73d3fce7 P 2b0ac7cec35b445bbfbfff828cdedfcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:15:23.803153 25783 consensus_peers.cc:597] T 2312590ea8034475b5d8d6cd73d3fce7 P 2b0ac7cec35b445bbfbfff828cdedfcf -> Peer 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441): Couldn't send request to peer 521c8650b93e4a7fa1905efd229fbdf6. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:37441: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:24.725193 25614 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:15:24.967047 25886 raft_consensus.cc:493] T 6c0bcf651cbe40a59f93666829cbacd5 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:24.967774 25886 raft_consensus.cc:515] T 6c0bcf651cbe40a59f93666829cbacd5 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:24.969893 25886 leader_election.cc:290] T 6c0bcf651cbe40a59f93666829cbacd5 P 2b0ac7cec35b445bbfbfff828cdedfcf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441), fbdbc1633300449fb2b7c46f43bde744 (127.12.56.194:37715)
I20260709 12:15:24.971096 25739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0bcf651cbe40a59f93666829cbacd5" candidate_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbdbc1633300449fb2b7c46f43bde744" is_pre_election: true
I20260709 12:15:24.971902 25739 raft_consensus.cc:2468] T 6c0bcf651cbe40a59f93666829cbacd5 P fbdbc1633300449fb2b7c46f43bde744 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b0ac7cec35b445bbfbfff828cdedfcf in term 1.
I20260709 12:15:24.973210 25781 leader_election.cc:304] T 6c0bcf651cbe40a59f93666829cbacd5 P 2b0ac7cec35b445bbfbfff828cdedfcf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b0ac7cec35b445bbfbfff828cdedfcf, fbdbc1633300449fb2b7c46f43bde744; no voters: 
I20260709 12:15:24.974174 25886 raft_consensus.cc:2804] T 6c0bcf651cbe40a59f93666829cbacd5 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:24.974694 25886 raft_consensus.cc:493] T 6c0bcf651cbe40a59f93666829cbacd5 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:24.974587 25783 leader_election.cc:336] T 6c0bcf651cbe40a59f93666829cbacd5 P 2b0ac7cec35b445bbfbfff828cdedfcf [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441): Network error: Client connection negotiation failed: client connection to 127.12.56.193:37441: connect: Connection refused (error 111)
I20260709 12:15:24.975270 25886 raft_consensus.cc:3060] T 6c0bcf651cbe40a59f93666829cbacd5 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:24.981088 25886 raft_consensus.cc:515] T 6c0bcf651cbe40a59f93666829cbacd5 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:24.983053 25886 leader_election.cc:290] T 6c0bcf651cbe40a59f93666829cbacd5 P 2b0ac7cec35b445bbfbfff828cdedfcf [CANDIDATE]: Term 2 election: Requested vote from peers 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441), fbdbc1633300449fb2b7c46f43bde744 (127.12.56.194:37715)
I20260709 12:15:24.984388 25739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0bcf651cbe40a59f93666829cbacd5" candidate_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbdbc1633300449fb2b7c46f43bde744"
I20260709 12:15:24.985091 25739 raft_consensus.cc:3060] T 6c0bcf651cbe40a59f93666829cbacd5 P fbdbc1633300449fb2b7c46f43bde744 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:15:24.987174 25783 leader_election.cc:336] T 6c0bcf651cbe40a59f93666829cbacd5 P 2b0ac7cec35b445bbfbfff828cdedfcf [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441): Network error: Client connection negotiation failed: client connection to 127.12.56.193:37441: connect: Connection refused (error 111)
I20260709 12:15:24.991559 25739 raft_consensus.cc:2468] T 6c0bcf651cbe40a59f93666829cbacd5 P fbdbc1633300449fb2b7c46f43bde744 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b0ac7cec35b445bbfbfff828cdedfcf in term 2.
I20260709 12:15:24.992724 25781 leader_election.cc:304] T 6c0bcf651cbe40a59f93666829cbacd5 P 2b0ac7cec35b445bbfbfff828cdedfcf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b0ac7cec35b445bbfbfff828cdedfcf, fbdbc1633300449fb2b7c46f43bde744; no voters: 521c8650b93e4a7fa1905efd229fbdf6
I20260709 12:15:24.993505 25886 raft_consensus.cc:2804] T 6c0bcf651cbe40a59f93666829cbacd5 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:24.994099 25886 raft_consensus.cc:697] T 6c0bcf651cbe40a59f93666829cbacd5 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 2 LEADER]: Becoming Leader. State: Replica: 2b0ac7cec35b445bbfbfff828cdedfcf, State: Running, Role: LEADER
I20260709 12:15:24.994884 25886 consensus_queue.cc:237] T 6c0bcf651cbe40a59f93666829cbacd5 P 2b0ac7cec35b445bbfbfff828cdedfcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:25.004122 25565 catalog_manager.cc:5697] T 6c0bcf651cbe40a59f93666829cbacd5 P 2b0ac7cec35b445bbfbfff828cdedfcf reported cstate change: term changed from 1 to 2, leader changed from 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193) to 2b0ac7cec35b445bbfbfff828cdedfcf (127.12.56.195). New cstate: current_term: 2 leader_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } health_report { overall_health: HEALTHY } } }
W20260709 12:15:25.045938 25597 debug-util.cc:398] Leaking SignalData structure 0x7b08001a6f80 after lost signal to thread 12518
W20260709 12:15:25.047129 25597 debug-util.cc:398] Leaking SignalData structure 0x7b0800310ae0 after lost signal to thread 25600
W20260709 12:15:25.048303 25597 debug-util.cc:398] Leaking SignalData structure 0x7b080022c500 after lost signal to thread 25767
W20260709 12:15:25.049295 25597 debug-util.cc:398] Leaking SignalData structure 0x7b0800119d00 after lost signal to thread 25841
W20260709 12:15:25.525939 25783 consensus_peers.cc:597] T 6c0bcf651cbe40a59f93666829cbacd5 P 2b0ac7cec35b445bbfbfff828cdedfcf -> Peer 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441): Couldn't send request to peer 521c8650b93e4a7fa1905efd229fbdf6. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:37441: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:25.545475 25743 raft_consensus.cc:1275] T 6c0bcf651cbe40a59f93666829cbacd5 P fbdbc1633300449fb2b7c46f43bde744 [term 2 FOLLOWER]: Refusing update from remote peer 2b0ac7cec35b445bbfbfff828cdedfcf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:15:25.547212 25946 consensus_queue.cc:1048] T 6c0bcf651cbe40a59f93666829cbacd5 P 2b0ac7cec35b445bbfbfff828cdedfcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:15:25.726333 25614 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:15:25.873405 25783 consensus_peers.cc:597] T 47044718acc14024854627db0aed3d3e P 2b0ac7cec35b445bbfbfff828cdedfcf -> Peer 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441): Couldn't send request to peer 521c8650b93e4a7fa1905efd229fbdf6. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:37441: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:25.993000 25783 consensus_peers.cc:597] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P 2b0ac7cec35b445bbfbfff828cdedfcf -> Peer 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441): Couldn't send request to peer 521c8650b93e4a7fa1905efd229fbdf6. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:37441: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:26.187274 25783 consensus_peers.cc:597] T 78c784ca806e4871a483636451018b1e P 2b0ac7cec35b445bbfbfff828cdedfcf -> Peer 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441): Couldn't send request to peer 521c8650b93e4a7fa1905efd229fbdf6. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:37441: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:26.207365 25709 consensus_peers.cc:597] T ccfca33043a14a9089a3c59b29c3b442 P fbdbc1633300449fb2b7c46f43bde744 -> Peer 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441): Couldn't send request to peer 521c8650b93e4a7fa1905efd229fbdf6. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:37441: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:26.210249 25783 consensus_peers.cc:597] T 032e30d956ec4c6c90f1ba5db5504a5d P 2b0ac7cec35b445bbfbfff828cdedfcf -> Peer 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441): Couldn't send request to peer 521c8650b93e4a7fa1905efd229fbdf6. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:37441: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:26.383028 25783 consensus_peers.cc:597] T f2d3c8d7f2cc4c46ada3179f069388a8 P 2b0ac7cec35b445bbfbfff828cdedfcf -> Peer 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441): Couldn't send request to peer 521c8650b93e4a7fa1905efd229fbdf6. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:37441: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:26.484937 25709 consensus_peers.cc:597] T 019b400e387d48d09821b4a446577ede P fbdbc1633300449fb2b7c46f43bde744 -> Peer 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441): Couldn't send request to peer 521c8650b93e4a7fa1905efd229fbdf6. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:37441: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:26.492648 25783 consensus_peers.cc:597] T 06be549acfdb46a9801ebced1ab5be4d P 2b0ac7cec35b445bbfbfff828cdedfcf -> Peer 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441): Couldn't send request to peer 521c8650b93e4a7fa1905efd229fbdf6. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:37441: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:26.520181 25783 consensus_peers.cc:597] T 2312590ea8034475b5d8d6cd73d3fce7 P 2b0ac7cec35b445bbfbfff828cdedfcf -> Peer 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441): Couldn't send request to peer 521c8650b93e4a7fa1905efd229fbdf6. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:37441: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:26.727325 25614 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:15:27.728492 25614 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:15:28.057641 25783 consensus_peers.cc:597] T 6c0bcf651cbe40a59f93666829cbacd5 P 2b0ac7cec35b445bbfbfff828cdedfcf -> Peer 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441): Couldn't send request to peer 521c8650b93e4a7fa1905efd229fbdf6. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:37441: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:28.256860 25783 consensus_peers.cc:597] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P 2b0ac7cec35b445bbfbfff828cdedfcf -> Peer 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441): Couldn't send request to peer 521c8650b93e4a7fa1905efd229fbdf6. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:37441: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:28.311573 25783 consensus_peers.cc:597] T 47044718acc14024854627db0aed3d3e P 2b0ac7cec35b445bbfbfff828cdedfcf -> Peer 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441): Couldn't send request to peer 521c8650b93e4a7fa1905efd229fbdf6. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:37441: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:28.513583 25709 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.56.193:37441: connect: Connection refused (error 111) [suppressed 97 similar messages]
I20260709 12:15:28.550375 12515 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:28.557149 25958 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:28.560639 25961 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:28.560690 25959 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:28.562364 12515 server_base.cc:1061] running on GCE node
I20260709 12:15:28.565007 12515 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:28.565248 12515 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:28.565379 12515 hybrid_clock.cc:648] HybridClock initialized: now 1783599328565367 us; error 0 us; skew 500 ppm
I20260709 12:15:28.566041 12515 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:28.568837 12515 webserver.cc:533] Webserver started at http://127.12.56.193:43449/ using document root <none> and password file <none>
I20260709 12:15:28.569505 12515 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:28.569713 12515 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:15:28.573971 12515 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:15:28.578126 25966 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:28.579011 12515 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:15:28.579357 12515 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894707649-12515-0/minicluster-data/ts-0-root
uuid: "521c8650b93e4a7fa1905efd229fbdf6"
format_stamp: "Formatted at 2026-07-09 12:15:21 on dist-test-slave-705g"
I20260709 12:15:28.579685 12515 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894707649-12515-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894707649-12515-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894707649-12515-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:28.591919 12515 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:28.593302 12515 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:28.594882 12515 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:28.598662 25973 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 12:15:28.657045 12515 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 12:15:28.657409 12515 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.060s	user 0.000s	sys 0.003s
I20260709 12:15:28.657759 12515 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 12:15:28.663251 25973 tablet_bootstrap.cc:492] T 6c0bcf651cbe40a59f93666829cbacd5 P 521c8650b93e4a7fa1905efd229fbdf6: Bootstrap starting.
I20260709 12:15:28.676522 25973 tablet_bootstrap.cc:492] T 6c0bcf651cbe40a59f93666829cbacd5 P 521c8650b93e4a7fa1905efd229fbdf6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:15:28.677364 25973 tablet_bootstrap.cc:492] T 6c0bcf651cbe40a59f93666829cbacd5 P 521c8650b93e4a7fa1905efd229fbdf6: Bootstrap complete.
I20260709 12:15:28.678027 25973 ts_tablet_manager.cc:1403] T 6c0bcf651cbe40a59f93666829cbacd5 P 521c8650b93e4a7fa1905efd229fbdf6: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.004s
I20260709 12:15:28.680195 25973 raft_consensus.cc:359] T 6c0bcf651cbe40a59f93666829cbacd5 P 521c8650b93e4a7fa1905efd229fbdf6 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:28.680944 25973 raft_consensus.cc:740] T 6c0bcf651cbe40a59f93666829cbacd5 P 521c8650b93e4a7fa1905efd229fbdf6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 521c8650b93e4a7fa1905efd229fbdf6, State: Initialized, Role: FOLLOWER
I20260709 12:15:28.681636 25973 consensus_queue.cc:260] T 6c0bcf651cbe40a59f93666829cbacd5 P 521c8650b93e4a7fa1905efd229fbdf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:28.684299 25973 ts_tablet_manager.cc:1434] T 6c0bcf651cbe40a59f93666829cbacd5 P 521c8650b93e4a7fa1905efd229fbdf6: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 12:15:28.685082 25973 tablet_bootstrap.cc:492] T 2312590ea8034475b5d8d6cd73d3fce7 P 521c8650b93e4a7fa1905efd229fbdf6: Bootstrap starting.
I20260709 12:15:28.696058 25973 tablet_bootstrap.cc:492] T 2312590ea8034475b5d8d6cd73d3fce7 P 521c8650b93e4a7fa1905efd229fbdf6: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:28.696969 25973 tablet_bootstrap.cc:492] T 2312590ea8034475b5d8d6cd73d3fce7 P 521c8650b93e4a7fa1905efd229fbdf6: Bootstrap complete.
I20260709 12:15:28.697690 25973 ts_tablet_manager.cc:1403] T 2312590ea8034475b5d8d6cd73d3fce7 P 521c8650b93e4a7fa1905efd229fbdf6: Time spent bootstrapping tablet: real 0.013s	user 0.001s	sys 0.008s
I20260709 12:15:28.700419 25973 raft_consensus.cc:359] T 2312590ea8034475b5d8d6cd73d3fce7 P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:28.701176 25973 raft_consensus.cc:385] T 2312590ea8034475b5d8d6cd73d3fce7 P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:15:28.701352 25783 consensus_peers.cc:597] T 78c784ca806e4871a483636451018b1e P 2b0ac7cec35b445bbfbfff828cdedfcf -> Peer 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441): Couldn't send request to peer 521c8650b93e4a7fa1905efd229fbdf6. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:37441: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:28.701531 25973 raft_consensus.cc:740] T 2312590ea8034475b5d8d6cd73d3fce7 P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 521c8650b93e4a7fa1905efd229fbdf6, State: Initialized, Role: FOLLOWER
I20260709 12:15:28.702322 25973 consensus_queue.cc:260] T 2312590ea8034475b5d8d6cd73d3fce7 P 521c8650b93e4a7fa1905efd229fbdf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:28.703904 25973 ts_tablet_manager.cc:1434] T 2312590ea8034475b5d8d6cd73d3fce7 P 521c8650b93e4a7fa1905efd229fbdf6: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.004s
I20260709 12:15:28.704627 25973 tablet_bootstrap.cc:492] T f2d3c8d7f2cc4c46ada3179f069388a8 P 521c8650b93e4a7fa1905efd229fbdf6: Bootstrap starting.
I20260709 12:15:28.705330 12515 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 12:15:28.705642 12515 ts_tablet_manager.cc:595] Time spent register tablets: real 0.048s	user 0.045s	sys 0.000s
I20260709 12:15:28.718078 25973 tablet_bootstrap.cc:492] T f2d3c8d7f2cc4c46ada3179f069388a8 P 521c8650b93e4a7fa1905efd229fbdf6: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:28.718876 25973 tablet_bootstrap.cc:492] T f2d3c8d7f2cc4c46ada3179f069388a8 P 521c8650b93e4a7fa1905efd229fbdf6: Bootstrap complete.
I20260709 12:15:28.719525 25973 ts_tablet_manager.cc:1403] T f2d3c8d7f2cc4c46ada3179f069388a8 P 521c8650b93e4a7fa1905efd229fbdf6: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.004s
I20260709 12:15:28.722122 25973 raft_consensus.cc:359] T f2d3c8d7f2cc4c46ada3179f069388a8 P 521c8650b93e4a7fa1905efd229fbdf6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:28.722748 25973 raft_consensus.cc:740] T f2d3c8d7f2cc4c46ada3179f069388a8 P 521c8650b93e4a7fa1905efd229fbdf6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 521c8650b93e4a7fa1905efd229fbdf6, State: Initialized, Role: FOLLOWER
I20260709 12:15:28.723501 25973 consensus_queue.cc:260] T f2d3c8d7f2cc4c46ada3179f069388a8 P 521c8650b93e4a7fa1905efd229fbdf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:28.725302 25973 ts_tablet_manager.cc:1434] T f2d3c8d7f2cc4c46ada3179f069388a8 P 521c8650b93e4a7fa1905efd229fbdf6: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:15:28.726174 25973 tablet_bootstrap.cc:492] T 06be549acfdb46a9801ebced1ab5be4d P 521c8650b93e4a7fa1905efd229fbdf6: Bootstrap starting.
W20260709 12:15:28.729629 25614 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:15:28.741086 25973 tablet_bootstrap.cc:492] T 06be549acfdb46a9801ebced1ab5be4d P 521c8650b93e4a7fa1905efd229fbdf6: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:28.742051 25973 tablet_bootstrap.cc:492] T 06be549acfdb46a9801ebced1ab5be4d P 521c8650b93e4a7fa1905efd229fbdf6: Bootstrap complete.
I20260709 12:15:28.742678 25973 ts_tablet_manager.cc:1403] T 06be549acfdb46a9801ebced1ab5be4d P 521c8650b93e4a7fa1905efd229fbdf6: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.003s
I20260709 12:15:28.745046 25973 raft_consensus.cc:359] T 06be549acfdb46a9801ebced1ab5be4d P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:28.745608 25973 raft_consensus.cc:385] T 06be549acfdb46a9801ebced1ab5be4d P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:28.745841 25973 raft_consensus.cc:740] T 06be549acfdb46a9801ebced1ab5be4d P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 521c8650b93e4a7fa1905efd229fbdf6, State: Initialized, Role: FOLLOWER
I20260709 12:15:28.746747 25973 consensus_queue.cc:260] T 06be549acfdb46a9801ebced1ab5be4d P 521c8650b93e4a7fa1905efd229fbdf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:28.749082 25973 ts_tablet_manager.cc:1434] T 06be549acfdb46a9801ebced1ab5be4d P 521c8650b93e4a7fa1905efd229fbdf6: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:15:28.750130 25973 tablet_bootstrap.cc:492] T 032e30d956ec4c6c90f1ba5db5504a5d P 521c8650b93e4a7fa1905efd229fbdf6: Bootstrap starting.
W20260709 12:15:28.762526 25783 consensus_peers.cc:597] T 032e30d956ec4c6c90f1ba5db5504a5d P 2b0ac7cec35b445bbfbfff828cdedfcf -> Peer 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441): Couldn't send request to peer 521c8650b93e4a7fa1905efd229fbdf6. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:37441: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:28.764889 25973 tablet_bootstrap.cc:492] T 032e30d956ec4c6c90f1ba5db5504a5d P 521c8650b93e4a7fa1905efd229fbdf6: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:28.765681 25973 tablet_bootstrap.cc:492] T 032e30d956ec4c6c90f1ba5db5504a5d P 521c8650b93e4a7fa1905efd229fbdf6: Bootstrap complete.
I20260709 12:15:28.766378 25973 ts_tablet_manager.cc:1403] T 032e30d956ec4c6c90f1ba5db5504a5d P 521c8650b93e4a7fa1905efd229fbdf6: Time spent bootstrapping tablet: real 0.016s	user 0.007s	sys 0.008s
I20260709 12:15:28.768378 25973 raft_consensus.cc:359] T 032e30d956ec4c6c90f1ba5db5504a5d P 521c8650b93e4a7fa1905efd229fbdf6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } }
I20260709 12:15:28.768923 25973 raft_consensus.cc:740] T 032e30d956ec4c6c90f1ba5db5504a5d P 521c8650b93e4a7fa1905efd229fbdf6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 521c8650b93e4a7fa1905efd229fbdf6, State: Initialized, Role: FOLLOWER
I20260709 12:15:28.769678 25973 consensus_queue.cc:260] T 032e30d956ec4c6c90f1ba5db5504a5d P 521c8650b93e4a7fa1905efd229fbdf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } }
I20260709 12:15:28.771328 25973 ts_tablet_manager.cc:1434] T 032e30d956ec4c6c90f1ba5db5504a5d P 521c8650b93e4a7fa1905efd229fbdf6: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:15:28.772027 25973 tablet_bootstrap.cc:492] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P 521c8650b93e4a7fa1905efd229fbdf6: Bootstrap starting.
I20260709 12:15:28.774914 25975 raft_consensus.cc:493] T 06be549acfdb46a9801ebced1ab5be4d P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:28.775619 25975 raft_consensus.cc:515] T 06be549acfdb46a9801ebced1ab5be4d P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:28.791013 25975 leader_election.cc:290] T 06be549acfdb46a9801ebced1ab5be4d P 521c8650b93e4a7fa1905efd229fbdf6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fbdbc1633300449fb2b7c46f43bde744 (127.12.56.194:37715), 2b0ac7cec35b445bbfbfff828cdedfcf (127.12.56.195:36129)
I20260709 12:15:28.797461 25973 tablet_bootstrap.cc:492] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P 521c8650b93e4a7fa1905efd229fbdf6: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:28.798659 25973 tablet_bootstrap.cc:492] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P 521c8650b93e4a7fa1905efd229fbdf6: Bootstrap complete.
I20260709 12:15:28.799546 25973 ts_tablet_manager.cc:1403] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P 521c8650b93e4a7fa1905efd229fbdf6: Time spent bootstrapping tablet: real 0.028s	user 0.019s	sys 0.004s
I20260709 12:15:28.802115 26040 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.56.193:37441 every 8 connection(s)
I20260709 12:15:28.802883 12515 rpc_server.cc:307] RPC server started. Bound to: 127.12.56.193:37441
I20260709 12:15:28.802510 25973 raft_consensus.cc:359] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P 521c8650b93e4a7fa1905efd229fbdf6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:28.804984 25973 raft_consensus.cc:740] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P 521c8650b93e4a7fa1905efd229fbdf6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 521c8650b93e4a7fa1905efd229fbdf6, State: Initialized, Role: FOLLOWER
I20260709 12:15:28.805832 25973 consensus_queue.cc:260] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P 521c8650b93e4a7fa1905efd229fbdf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:28.808746 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:28.816279 25817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06be549acfdb46a9801ebced1ab5be4d" candidate_uuid: "521c8650b93e4a7fa1905efd229fbdf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" is_pre_election: true
I20260709 12:15:28.808805 25973 ts_tablet_manager.cc:1434] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P 521c8650b93e4a7fa1905efd229fbdf6: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:15:28.818075 25973 tablet_bootstrap.cc:492] T 78c784ca806e4871a483636451018b1e P 521c8650b93e4a7fa1905efd229fbdf6: Bootstrap starting.
I20260709 12:15:28.822623 25739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06be549acfdb46a9801ebced1ab5be4d" candidate_uuid: "521c8650b93e4a7fa1905efd229fbdf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbdbc1633300449fb2b7c46f43bde744" is_pre_election: true
I20260709 12:15:28.824551 25968 leader_election.cc:304] T 06be549acfdb46a9801ebced1ab5be4d P 521c8650b93e4a7fa1905efd229fbdf6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 521c8650b93e4a7fa1905efd229fbdf6; no voters: 2b0ac7cec35b445bbfbfff828cdedfcf, fbdbc1633300449fb2b7c46f43bde744
I20260709 12:15:28.826224 25975 raft_consensus.cc:2749] T 06be549acfdb46a9801ebced1ab5be4d P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:28.844200 26041 heartbeater.cc:344] Connected to a master server at 127.12.56.254:44255
I20260709 12:15:28.844763 26041 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:28.845719 26041 heartbeater.cc:507] Master 127.12.56.254:44255 requested a full tablet report, sending...
I20260709 12:15:28.846262 25973 tablet_bootstrap.cc:492] T 78c784ca806e4871a483636451018b1e P 521c8650b93e4a7fa1905efd229fbdf6: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:28.847198 25973 tablet_bootstrap.cc:492] T 78c784ca806e4871a483636451018b1e P 521c8650b93e4a7fa1905efd229fbdf6: Bootstrap complete.
I20260709 12:15:28.847934 25973 ts_tablet_manager.cc:1403] T 78c784ca806e4871a483636451018b1e P 521c8650b93e4a7fa1905efd229fbdf6: Time spent bootstrapping tablet: real 0.030s	user 0.018s	sys 0.008s
I20260709 12:15:28.850847 25973 raft_consensus.cc:359] T 78c784ca806e4871a483636451018b1e P 521c8650b93e4a7fa1905efd229fbdf6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:28.851671 25973 raft_consensus.cc:740] T 78c784ca806e4871a483636451018b1e P 521c8650b93e4a7fa1905efd229fbdf6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 521c8650b93e4a7fa1905efd229fbdf6, State: Initialized, Role: FOLLOWER
I20260709 12:15:28.852587 25973 consensus_queue.cc:260] T 78c784ca806e4871a483636451018b1e P 521c8650b93e4a7fa1905efd229fbdf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:28.854540 26009 raft_consensus.cc:3060] T 06be549acfdb46a9801ebced1ab5be4d P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:28.854943 25973 ts_tablet_manager.cc:1434] T 78c784ca806e4871a483636451018b1e P 521c8650b93e4a7fa1905efd229fbdf6: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:15:28.854773 25817 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "06be549acfdb46a9801ebced1ab5be4d"
dest_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf"
mode: GRACEFUL
new_leader_uuid: "fbdbc1633300449fb2b7c46f43bde744"
 from {username='slave'} at 127.0.0.1:51150
I20260709 12:15:28.855649 25817 raft_consensus.cc:606] T 06be549acfdb46a9801ebced1ab5be4d P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 LEADER]: Received request to transfer leadership to TS fbdbc1633300449fb2b7c46f43bde744
I20260709 12:15:28.855955 25973 tablet_bootstrap.cc:492] T 47044718acc14024854627db0aed3d3e P 521c8650b93e4a7fa1905efd229fbdf6: Bootstrap starting.
I20260709 12:15:28.858843 25817 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2312590ea8034475b5d8d6cd73d3fce7"
dest_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf"
mode: GRACEFUL
new_leader_uuid: "fbdbc1633300449fb2b7c46f43bde744"
 from {username='slave'} at 127.0.0.1:51150
I20260709 12:15:28.859579 25817 raft_consensus.cc:606] T 2312590ea8034475b5d8d6cd73d3fce7 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 LEADER]: Received request to transfer leadership to TS fbdbc1633300449fb2b7c46f43bde744
I20260709 12:15:28.859838 25565 ts_manager.cc:194] Re-registered known tserver with Master: 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441)
I20260709 12:15:28.862476 25817 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c0bcf651cbe40a59f93666829cbacd5"
dest_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf"
mode: GRACEFUL
new_leader_uuid: "fbdbc1633300449fb2b7c46f43bde744"
 from {username='slave'} at 127.0.0.1:51150
I20260709 12:15:28.863293 25817 raft_consensus.cc:606] T 6c0bcf651cbe40a59f93666829cbacd5 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 2 LEADER]: Received request to transfer leadership to TS fbdbc1633300449fb2b7c46f43bde744
I20260709 12:15:28.866385 25817 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78c784ca806e4871a483636451018b1e"
dest_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf"
mode: GRACEFUL
new_leader_uuid: "fbdbc1633300449fb2b7c46f43bde744"
 from {username='slave'} at 127.0.0.1:51150
I20260709 12:15:28.867206 25817 raft_consensus.cc:606] T 78c784ca806e4871a483636451018b1e P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 LEADER]: Received request to transfer leadership to TS fbdbc1633300449fb2b7c46f43bde744
I20260709 12:15:28.868957 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:15:28.870100 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:28.870935 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:28.872823 25565 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39816
I20260709 12:15:28.878010 25973 tablet_bootstrap.cc:492] T 47044718acc14024854627db0aed3d3e P 521c8650b93e4a7fa1905efd229fbdf6: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:28.879338 25973 tablet_bootstrap.cc:492] T 47044718acc14024854627db0aed3d3e P 521c8650b93e4a7fa1905efd229fbdf6: Bootstrap complete.
I20260709 12:15:28.880360 25973 ts_tablet_manager.cc:1403] T 47044718acc14024854627db0aed3d3e P 521c8650b93e4a7fa1905efd229fbdf6: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.007s
I20260709 12:15:28.882841 26041 heartbeater.cc:499] Master 127.12.56.254:44255 was elected leader, sending a full tablet report...
I20260709 12:15:28.883426 25973 raft_consensus.cc:359] T 47044718acc14024854627db0aed3d3e P 521c8650b93e4a7fa1905efd229fbdf6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:28.884233 25973 raft_consensus.cc:740] T 47044718acc14024854627db0aed3d3e P 521c8650b93e4a7fa1905efd229fbdf6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 521c8650b93e4a7fa1905efd229fbdf6, State: Initialized, Role: FOLLOWER
I20260709 12:15:28.884919 25973 consensus_queue.cc:260] T 47044718acc14024854627db0aed3d3e P 521c8650b93e4a7fa1905efd229fbdf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:28.886709 25973 ts_tablet_manager.cc:1434] T 47044718acc14024854627db0aed3d3e P 521c8650b93e4a7fa1905efd229fbdf6: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:15:28.887415 25973 tablet_bootstrap.cc:492] T 019b400e387d48d09821b4a446577ede P 521c8650b93e4a7fa1905efd229fbdf6: Bootstrap starting.
I20260709 12:15:28.899809 25973 tablet_bootstrap.cc:492] T 019b400e387d48d09821b4a446577ede P 521c8650b93e4a7fa1905efd229fbdf6: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:28.900768 25973 tablet_bootstrap.cc:492] T 019b400e387d48d09821b4a446577ede P 521c8650b93e4a7fa1905efd229fbdf6: Bootstrap complete.
I20260709 12:15:28.901654 25973 ts_tablet_manager.cc:1403] T 019b400e387d48d09821b4a446577ede P 521c8650b93e4a7fa1905efd229fbdf6: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 12:15:28.904297 25973 raft_consensus.cc:359] T 019b400e387d48d09821b4a446577ede P 521c8650b93e4a7fa1905efd229fbdf6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:28.904953 25973 raft_consensus.cc:740] T 019b400e387d48d09821b4a446577ede P 521c8650b93e4a7fa1905efd229fbdf6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 521c8650b93e4a7fa1905efd229fbdf6, State: Initialized, Role: FOLLOWER
I20260709 12:15:28.905633 25973 consensus_queue.cc:260] T 019b400e387d48d09821b4a446577ede P 521c8650b93e4a7fa1905efd229fbdf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:28.907313 25973 ts_tablet_manager.cc:1434] T 019b400e387d48d09821b4a446577ede P 521c8650b93e4a7fa1905efd229fbdf6: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:15:28.908186 25973 tablet_bootstrap.cc:492] T ccfca33043a14a9089a3c59b29c3b442 P 521c8650b93e4a7fa1905efd229fbdf6: Bootstrap starting.
I20260709 12:15:28.927134 25973 tablet_bootstrap.cc:492] T ccfca33043a14a9089a3c59b29c3b442 P 521c8650b93e4a7fa1905efd229fbdf6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:28.928046 25973 tablet_bootstrap.cc:492] T ccfca33043a14a9089a3c59b29c3b442 P 521c8650b93e4a7fa1905efd229fbdf6: Bootstrap complete.
I20260709 12:15:28.928694 25973 ts_tablet_manager.cc:1403] T ccfca33043a14a9089a3c59b29c3b442 P 521c8650b93e4a7fa1905efd229fbdf6: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.006s
I20260709 12:15:28.930796 25973 raft_consensus.cc:359] T ccfca33043a14a9089a3c59b29c3b442 P 521c8650b93e4a7fa1905efd229fbdf6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:28.931540 25973 raft_consensus.cc:740] T ccfca33043a14a9089a3c59b29c3b442 P 521c8650b93e4a7fa1905efd229fbdf6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 521c8650b93e4a7fa1905efd229fbdf6, State: Initialized, Role: FOLLOWER
I20260709 12:15:28.932267 25973 consensus_queue.cc:260] T ccfca33043a14a9089a3c59b29c3b442 P 521c8650b93e4a7fa1905efd229fbdf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:28.934238 25973 ts_tablet_manager.cc:1434] T ccfca33043a14a9089a3c59b29c3b442 P 521c8650b93e4a7fa1905efd229fbdf6: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.001s
I20260709 12:15:28.958357 25975 raft_consensus.cc:493] T 2312590ea8034475b5d8d6cd73d3fce7 P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:28.958943 25975 raft_consensus.cc:515] T 2312590ea8034475b5d8d6cd73d3fce7 P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:28.960857 25975 leader_election.cc:290] T 2312590ea8034475b5d8d6cd73d3fce7 P 521c8650b93e4a7fa1905efd229fbdf6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fbdbc1633300449fb2b7c46f43bde744 (127.12.56.194:37715), 2b0ac7cec35b445bbfbfff828cdedfcf (127.12.56.195:36129)
I20260709 12:15:28.961943 25739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2312590ea8034475b5d8d6cd73d3fce7" candidate_uuid: "521c8650b93e4a7fa1905efd229fbdf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbdbc1633300449fb2b7c46f43bde744" is_pre_election: true
I20260709 12:15:28.962025 25817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2312590ea8034475b5d8d6cd73d3fce7" candidate_uuid: "521c8650b93e4a7fa1905efd229fbdf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" is_pre_election: true
I20260709 12:15:28.963474 25969 leader_election.cc:304] T 2312590ea8034475b5d8d6cd73d3fce7 P 521c8650b93e4a7fa1905efd229fbdf6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 521c8650b93e4a7fa1905efd229fbdf6; no voters: 2b0ac7cec35b445bbfbfff828cdedfcf, fbdbc1633300449fb2b7c46f43bde744
I20260709 12:15:28.964293 25975 raft_consensus.cc:2749] T 2312590ea8034475b5d8d6cd73d3fce7 P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:28.990253 26009 raft_consensus.cc:3060] T 6c0bcf651cbe40a59f93666829cbacd5 P 521c8650b93e4a7fa1905efd229fbdf6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:28.990949 25946 raft_consensus.cc:993] T 2312590ea8034475b5d8d6cd73d3fce7 P 2b0ac7cec35b445bbfbfff828cdedfcf: : Instructing follower fbdbc1633300449fb2b7c46f43bde744 to start an election
I20260709 12:15:28.991600 26044 raft_consensus.cc:1081] T 2312590ea8034475b5d8d6cd73d3fce7 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 LEADER]: Signalling peer fbdbc1633300449fb2b7c46f43bde744 to start an election
I20260709 12:15:28.993566 25739 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2312590ea8034475b5d8d6cd73d3fce7"
dest_uuid: "fbdbc1633300449fb2b7c46f43bde744"
 from {username='slave'} at 127.0.0.1:59044
I20260709 12:15:28.994284 25739 raft_consensus.cc:493] T 2312590ea8034475b5d8d6cd73d3fce7 P fbdbc1633300449fb2b7c46f43bde744 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:28.994700 25739 raft_consensus.cc:3060] T 2312590ea8034475b5d8d6cd73d3fce7 P fbdbc1633300449fb2b7c46f43bde744 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:28.998993 26009 pending_rounds.cc:85] T 6c0bcf651cbe40a59f93666829cbacd5 P 521c8650b93e4a7fa1905efd229fbdf6: Aborting all ops after (but not including) 0
I20260709 12:15:28.999434 26009 pending_rounds.cc:107] T 6c0bcf651cbe40a59f93666829cbacd5 P 521c8650b93e4a7fa1905efd229fbdf6: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:15:28.999727 26009 raft_consensus.cc:2889] T 6c0bcf651cbe40a59f93666829cbacd5 P 521c8650b93e4a7fa1905efd229fbdf6 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:29.003804 25739 raft_consensus.cc:515] T 2312590ea8034475b5d8d6cd73d3fce7 P fbdbc1633300449fb2b7c46f43bde744 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:29.008507 25739 leader_election.cc:290] T 2312590ea8034475b5d8d6cd73d3fce7 P fbdbc1633300449fb2b7c46f43bde744 [CANDIDATE]: Term 2 election: Requested vote from peers 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441), 2b0ac7cec35b445bbfbfff828cdedfcf (127.12.56.195:36129)
I20260709 12:15:29.008230 26009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2312590ea8034475b5d8d6cd73d3fce7" candidate_uuid: "fbdbc1633300449fb2b7c46f43bde744" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "521c8650b93e4a7fa1905efd229fbdf6"
I20260709 12:15:29.009248 26010 raft_consensus.cc:3060] T 2312590ea8034475b5d8d6cd73d3fce7 P 521c8650b93e4a7fa1905efd229fbdf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:29.009821 25817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2312590ea8034475b5d8d6cd73d3fce7" candidate_uuid: "fbdbc1633300449fb2b7c46f43bde744" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf"
I20260709 12:15:29.010700 25817 raft_consensus.cc:3055] T 2312590ea8034475b5d8d6cd73d3fce7 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:29.011050 25817 raft_consensus.cc:740] T 2312590ea8034475b5d8d6cd73d3fce7 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2b0ac7cec35b445bbfbfff828cdedfcf, State: Running, Role: LEADER
I20260709 12:15:29.012017 25817 consensus_queue.cc:260] T 2312590ea8034475b5d8d6cd73d3fce7 P 2b0ac7cec35b445bbfbfff828cdedfcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:29.013761 25817 raft_consensus.cc:3060] T 2312590ea8034475b5d8d6cd73d3fce7 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:29.024798 25817 raft_consensus.cc:2468] T 2312590ea8034475b5d8d6cd73d3fce7 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbdbc1633300449fb2b7c46f43bde744 in term 2.
I20260709 12:15:29.026568 25708 leader_election.cc:304] T 2312590ea8034475b5d8d6cd73d3fce7 P fbdbc1633300449fb2b7c46f43bde744 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b0ac7cec35b445bbfbfff828cdedfcf, fbdbc1633300449fb2b7c46f43bde744; no voters: 521c8650b93e4a7fa1905efd229fbdf6
I20260709 12:15:29.027675 25943 raft_consensus.cc:2804] T 2312590ea8034475b5d8d6cd73d3fce7 P fbdbc1633300449fb2b7c46f43bde744 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:29.029479 25943 raft_consensus.cc:697] T 2312590ea8034475b5d8d6cd73d3fce7 P fbdbc1633300449fb2b7c46f43bde744 [term 2 LEADER]: Becoming Leader. State: Replica: fbdbc1633300449fb2b7c46f43bde744, State: Running, Role: LEADER
I20260709 12:15:29.030570 25943 consensus_queue.cc:237] T 2312590ea8034475b5d8d6cd73d3fce7 P fbdbc1633300449fb2b7c46f43bde744 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:29.033089 26044 raft_consensus.cc:993] T 78c784ca806e4871a483636451018b1e P 2b0ac7cec35b445bbfbfff828cdedfcf: : Instructing follower fbdbc1633300449fb2b7c46f43bde744 to start an election
I20260709 12:15:29.033717 26044 raft_consensus.cc:1081] T 78c784ca806e4871a483636451018b1e P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 LEADER]: Signalling peer fbdbc1633300449fb2b7c46f43bde744 to start an election
I20260709 12:15:29.035966 25739 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78c784ca806e4871a483636451018b1e"
dest_uuid: "fbdbc1633300449fb2b7c46f43bde744"
 from {username='slave'} at 127.0.0.1:59044
I20260709 12:15:29.036633 25739 raft_consensus.cc:493] T 78c784ca806e4871a483636451018b1e P fbdbc1633300449fb2b7c46f43bde744 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:29.037113 25739 raft_consensus.cc:3060] T 78c784ca806e4871a483636451018b1e P fbdbc1633300449fb2b7c46f43bde744 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:29.043793 25565 catalog_manager.cc:5697] T 2312590ea8034475b5d8d6cd73d3fce7 P fbdbc1633300449fb2b7c46f43bde744 reported cstate change: term changed from 1 to 2, leader changed from 2b0ac7cec35b445bbfbfff828cdedfcf (127.12.56.195) to fbdbc1633300449fb2b7c46f43bde744 (127.12.56.194). New cstate: current_term: 2 leader_uuid: "fbdbc1633300449fb2b7c46f43bde744" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:29.044775 25739 raft_consensus.cc:515] T 78c784ca806e4871a483636451018b1e P fbdbc1633300449fb2b7c46f43bde744 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:29.047766 25739 leader_election.cc:290] T 78c784ca806e4871a483636451018b1e P fbdbc1633300449fb2b7c46f43bde744 [CANDIDATE]: Term 2 election: Requested vote from peers 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441), 2b0ac7cec35b445bbfbfff828cdedfcf (127.12.56.195:36129)
I20260709 12:15:29.048327 26010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c784ca806e4871a483636451018b1e" candidate_uuid: "fbdbc1633300449fb2b7c46f43bde744" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "521c8650b93e4a7fa1905efd229fbdf6"
I20260709 12:15:29.048444 25817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c784ca806e4871a483636451018b1e" candidate_uuid: "fbdbc1633300449fb2b7c46f43bde744" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf"
I20260709 12:15:29.049353 25817 raft_consensus.cc:3055] T 78c784ca806e4871a483636451018b1e P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:29.049353 26010 raft_consensus.cc:3060] T 78c784ca806e4871a483636451018b1e P 521c8650b93e4a7fa1905efd229fbdf6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:29.050089 25817 raft_consensus.cc:740] T 78c784ca806e4871a483636451018b1e P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2b0ac7cec35b445bbfbfff828cdedfcf, State: Running, Role: LEADER
I20260709 12:15:29.050992 25817 consensus_queue.cc:260] T 78c784ca806e4871a483636451018b1e P 2b0ac7cec35b445bbfbfff828cdedfcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:29.052695 25817 raft_consensus.cc:3060] T 78c784ca806e4871a483636451018b1e P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:29.057492 26010 raft_consensus.cc:2468] T 78c784ca806e4871a483636451018b1e P 521c8650b93e4a7fa1905efd229fbdf6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbdbc1633300449fb2b7c46f43bde744 in term 2.
I20260709 12:15:29.058902 25709 leader_election.cc:304] T 78c784ca806e4871a483636451018b1e P fbdbc1633300449fb2b7c46f43bde744 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 521c8650b93e4a7fa1905efd229fbdf6, fbdbc1633300449fb2b7c46f43bde744; no voters: 
I20260709 12:15:29.059969 25943 raft_consensus.cc:2804] T 78c784ca806e4871a483636451018b1e P fbdbc1633300449fb2b7c46f43bde744 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:29.060557 25943 raft_consensus.cc:697] T 78c784ca806e4871a483636451018b1e P fbdbc1633300449fb2b7c46f43bde744 [term 2 LEADER]: Becoming Leader. State: Replica: fbdbc1633300449fb2b7c46f43bde744, State: Running, Role: LEADER
I20260709 12:15:29.061333 25817 raft_consensus.cc:2468] T 78c784ca806e4871a483636451018b1e P 2b0ac7cec35b445bbfbfff828cdedfcf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbdbc1633300449fb2b7c46f43bde744 in term 2.
I20260709 12:15:29.061663 25943 consensus_queue.cc:237] T 78c784ca806e4871a483636451018b1e P fbdbc1633300449fb2b7c46f43bde744 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:29.071813 25562 catalog_manager.cc:5697] T 78c784ca806e4871a483636451018b1e P fbdbc1633300449fb2b7c46f43bde744 reported cstate change: term changed from 1 to 2, leader changed from 2b0ac7cec35b445bbfbfff828cdedfcf (127.12.56.195) to fbdbc1633300449fb2b7c46f43bde744 (127.12.56.194). New cstate: current_term: 2 leader_uuid: "fbdbc1633300449fb2b7c46f43bde744" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:29.314514 26045 raft_consensus.cc:993] T 06be549acfdb46a9801ebced1ab5be4d P 2b0ac7cec35b445bbfbfff828cdedfcf: : Instructing follower fbdbc1633300449fb2b7c46f43bde744 to start an election
I20260709 12:15:29.315008 26045 raft_consensus.cc:1081] T 06be549acfdb46a9801ebced1ab5be4d P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 LEADER]: Signalling peer fbdbc1633300449fb2b7c46f43bde744 to start an election
I20260709 12:15:29.316692 25739 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "06be549acfdb46a9801ebced1ab5be4d"
dest_uuid: "fbdbc1633300449fb2b7c46f43bde744"
 from {username='slave'} at 127.0.0.1:59044
I20260709 12:15:29.317256 25739 raft_consensus.cc:493] T 06be549acfdb46a9801ebced1ab5be4d P fbdbc1633300449fb2b7c46f43bde744 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:29.317575 25739 raft_consensus.cc:3060] T 06be549acfdb46a9801ebced1ab5be4d P fbdbc1633300449fb2b7c46f43bde744 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:29.325148 25739 raft_consensus.cc:515] T 06be549acfdb46a9801ebced1ab5be4d P fbdbc1633300449fb2b7c46f43bde744 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:29.327031 25739 leader_election.cc:290] T 06be549acfdb46a9801ebced1ab5be4d P fbdbc1633300449fb2b7c46f43bde744 [CANDIDATE]: Term 2 election: Requested vote from peers 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441), 2b0ac7cec35b445bbfbfff828cdedfcf (127.12.56.195:36129)
I20260709 12:15:29.328197 26010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06be549acfdb46a9801ebced1ab5be4d" candidate_uuid: "fbdbc1633300449fb2b7c46f43bde744" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "521c8650b93e4a7fa1905efd229fbdf6"
I20260709 12:15:29.329250 26010 raft_consensus.cc:3060] T 06be549acfdb46a9801ebced1ab5be4d P 521c8650b93e4a7fa1905efd229fbdf6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:29.328197 25817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06be549acfdb46a9801ebced1ab5be4d" candidate_uuid: "fbdbc1633300449fb2b7c46f43bde744" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf"
I20260709 12:15:29.330678 25817 raft_consensus.cc:3055] T 06be549acfdb46a9801ebced1ab5be4d P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:29.331025 25817 raft_consensus.cc:740] T 06be549acfdb46a9801ebced1ab5be4d P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2b0ac7cec35b445bbfbfff828cdedfcf, State: Running, Role: LEADER
I20260709 12:15:29.331934 25817 consensus_queue.cc:260] T 06be549acfdb46a9801ebced1ab5be4d P 2b0ac7cec35b445bbfbfff828cdedfcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:29.333067 25817 raft_consensus.cc:3060] T 06be549acfdb46a9801ebced1ab5be4d P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:29.335875 26010 raft_consensus.cc:2468] T 06be549acfdb46a9801ebced1ab5be4d P 521c8650b93e4a7fa1905efd229fbdf6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbdbc1633300449fb2b7c46f43bde744 in term 2.
I20260709 12:15:29.337184 25709 leader_election.cc:304] T 06be549acfdb46a9801ebced1ab5be4d P fbdbc1633300449fb2b7c46f43bde744 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 521c8650b93e4a7fa1905efd229fbdf6, fbdbc1633300449fb2b7c46f43bde744; no voters: 
I20260709 12:15:29.338167 25943 raft_consensus.cc:2804] T 06be549acfdb46a9801ebced1ab5be4d P fbdbc1633300449fb2b7c46f43bde744 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:29.338666 25943 raft_consensus.cc:697] T 06be549acfdb46a9801ebced1ab5be4d P fbdbc1633300449fb2b7c46f43bde744 [term 2 LEADER]: Becoming Leader. State: Replica: fbdbc1633300449fb2b7c46f43bde744, State: Running, Role: LEADER
I20260709 12:15:29.339800 25817 raft_consensus.cc:2468] T 06be549acfdb46a9801ebced1ab5be4d P 2b0ac7cec35b445bbfbfff828cdedfcf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbdbc1633300449fb2b7c46f43bde744 in term 2.
I20260709 12:15:29.339656 25943 consensus_queue.cc:237] T 06be549acfdb46a9801ebced1ab5be4d P fbdbc1633300449fb2b7c46f43bde744 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:29.346012 26045 raft_consensus.cc:993] T 6c0bcf651cbe40a59f93666829cbacd5 P 2b0ac7cec35b445bbfbfff828cdedfcf: : Instructing follower fbdbc1633300449fb2b7c46f43bde744 to start an election
I20260709 12:15:29.346576 26045 raft_consensus.cc:1081] T 6c0bcf651cbe40a59f93666829cbacd5 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 2 LEADER]: Signalling peer fbdbc1633300449fb2b7c46f43bde744 to start an election
I20260709 12:15:29.348471 25739 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6c0bcf651cbe40a59f93666829cbacd5"
dest_uuid: "fbdbc1633300449fb2b7c46f43bde744"
 from {username='slave'} at 127.0.0.1:59044
I20260709 12:15:29.349269 25739 raft_consensus.cc:493] T 6c0bcf651cbe40a59f93666829cbacd5 P fbdbc1633300449fb2b7c46f43bde744 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:29.348630 25562 catalog_manager.cc:5697] T 06be549acfdb46a9801ebced1ab5be4d P fbdbc1633300449fb2b7c46f43bde744 reported cstate change: term changed from 1 to 2, leader changed from 2b0ac7cec35b445bbfbfff828cdedfcf (127.12.56.195) to fbdbc1633300449fb2b7c46f43bde744 (127.12.56.194). New cstate: current_term: 2 leader_uuid: "fbdbc1633300449fb2b7c46f43bde744" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:29.349705 25739 raft_consensus.cc:3060] T 6c0bcf651cbe40a59f93666829cbacd5 P fbdbc1633300449fb2b7c46f43bde744 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:29.356767 25739 raft_consensus.cc:515] T 6c0bcf651cbe40a59f93666829cbacd5 P fbdbc1633300449fb2b7c46f43bde744 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:29.360201 26008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0bcf651cbe40a59f93666829cbacd5" candidate_uuid: "fbdbc1633300449fb2b7c46f43bde744" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "521c8650b93e4a7fa1905efd229fbdf6"
I20260709 12:15:29.360987 26008 raft_consensus.cc:3060] T 6c0bcf651cbe40a59f93666829cbacd5 P 521c8650b93e4a7fa1905efd229fbdf6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:29.365515 25739 leader_election.cc:290] T 6c0bcf651cbe40a59f93666829cbacd5 P fbdbc1633300449fb2b7c46f43bde744 [CANDIDATE]: Term 3 election: Requested vote from peers 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441), 2b0ac7cec35b445bbfbfff828cdedfcf (127.12.56.195:36129)
I20260709 12:15:29.366269 25817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0bcf651cbe40a59f93666829cbacd5" candidate_uuid: "fbdbc1633300449fb2b7c46f43bde744" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf"
I20260709 12:15:29.367060 25817 raft_consensus.cc:3055] T 6c0bcf651cbe40a59f93666829cbacd5 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:29.367424 25817 raft_consensus.cc:740] T 6c0bcf651cbe40a59f93666829cbacd5 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2b0ac7cec35b445bbfbfff828cdedfcf, State: Running, Role: LEADER
I20260709 12:15:29.368407 25817 consensus_queue.cc:260] T 6c0bcf651cbe40a59f93666829cbacd5 P 2b0ac7cec35b445bbfbfff828cdedfcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:29.369926 25817 raft_consensus.cc:3060] T 6c0bcf651cbe40a59f93666829cbacd5 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:29.371506 26008 raft_consensus.cc:2468] T 6c0bcf651cbe40a59f93666829cbacd5 P 521c8650b93e4a7fa1905efd229fbdf6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbdbc1633300449fb2b7c46f43bde744 in term 3.
I20260709 12:15:29.372946 25709 leader_election.cc:304] T 6c0bcf651cbe40a59f93666829cbacd5 P fbdbc1633300449fb2b7c46f43bde744 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 521c8650b93e4a7fa1905efd229fbdf6, fbdbc1633300449fb2b7c46f43bde744; no voters: 
I20260709 12:15:29.374039 26067 raft_consensus.cc:2804] T 6c0bcf651cbe40a59f93666829cbacd5 P fbdbc1633300449fb2b7c46f43bde744 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:29.374686 26067 raft_consensus.cc:697] T 6c0bcf651cbe40a59f93666829cbacd5 P fbdbc1633300449fb2b7c46f43bde744 [term 3 LEADER]: Becoming Leader. State: Replica: fbdbc1633300449fb2b7c46f43bde744, State: Running, Role: LEADER
I20260709 12:15:29.375684 26067 consensus_queue.cc:237] T 6c0bcf651cbe40a59f93666829cbacd5 P fbdbc1633300449fb2b7c46f43bde744 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:29.378890 25817 raft_consensus.cc:2468] T 6c0bcf651cbe40a59f93666829cbacd5 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbdbc1633300449fb2b7c46f43bde744 in term 3.
I20260709 12:15:29.384665 25565 catalog_manager.cc:5697] T 6c0bcf651cbe40a59f93666829cbacd5 P fbdbc1633300449fb2b7c46f43bde744 reported cstate change: term changed from 2 to 3, leader changed from 2b0ac7cec35b445bbfbfff828cdedfcf (127.12.56.195) to fbdbc1633300449fb2b7c46f43bde744 (127.12.56.194). New cstate: current_term: 3 leader_uuid: "fbdbc1633300449fb2b7c46f43bde744" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:29.539368 26008 raft_consensus.cc:3060] T 2312590ea8034475b5d8d6cd73d3fce7 P 521c8650b93e4a7fa1905efd229fbdf6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:29.545142 26008 raft_consensus.cc:1275] T 2312590ea8034475b5d8d6cd73d3fce7 P 521c8650b93e4a7fa1905efd229fbdf6 [term 2 FOLLOWER]: Refusing update from remote peer fbdbc1633300449fb2b7c46f43bde744: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:29.546636 26058 consensus_queue.cc:1048] T 2312590ea8034475b5d8d6cd73d3fce7 P fbdbc1633300449fb2b7c46f43bde744 [LEADER]: Connected to new peer: Peer: permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:29.557118 25817 raft_consensus.cc:1275] T 2312590ea8034475b5d8d6cd73d3fce7 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 2 FOLLOWER]: Refusing update from remote peer fbdbc1633300449fb2b7c46f43bde744: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:29.558399 26058 consensus_queue.cc:1048] T 2312590ea8034475b5d8d6cd73d3fce7 P fbdbc1633300449fb2b7c46f43bde744 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:29.615779 26008 raft_consensus.cc:1275] T 78c784ca806e4871a483636451018b1e P 521c8650b93e4a7fa1905efd229fbdf6 [term 2 FOLLOWER]: Refusing update from remote peer fbdbc1633300449fb2b7c46f43bde744: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:29.617187 26058 consensus_queue.cc:1048] T 78c784ca806e4871a483636451018b1e P fbdbc1633300449fb2b7c46f43bde744 [LEADER]: Connected to new peer: Peer: permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:29.627287 25817 raft_consensus.cc:1275] T 78c784ca806e4871a483636451018b1e P 2b0ac7cec35b445bbfbfff828cdedfcf [term 2 FOLLOWER]: Refusing update from remote peer fbdbc1633300449fb2b7c46f43bde744: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:29.629681 25943 consensus_queue.cc:1048] T 78c784ca806e4871a483636451018b1e P fbdbc1633300449fb2b7c46f43bde744 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:15:29.731524 25614 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:15:29.779086 26010 raft_consensus.cc:1275] T 06be549acfdb46a9801ebced1ab5be4d P 521c8650b93e4a7fa1905efd229fbdf6 [term 2 FOLLOWER]: Refusing update from remote peer fbdbc1633300449fb2b7c46f43bde744: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:29.781183 25943 consensus_queue.cc:1048] T 06be549acfdb46a9801ebced1ab5be4d P fbdbc1633300449fb2b7c46f43bde744 [LEADER]: Connected to new peer: Peer: permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:29.794751 25817 raft_consensus.cc:1275] T 06be549acfdb46a9801ebced1ab5be4d P 2b0ac7cec35b445bbfbfff828cdedfcf [term 2 FOLLOWER]: Refusing update from remote peer fbdbc1633300449fb2b7c46f43bde744: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:29.796679 25943 consensus_queue.cc:1048] T 06be549acfdb46a9801ebced1ab5be4d P fbdbc1633300449fb2b7c46f43bde744 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:29.843420 26010 raft_consensus.cc:1275] T 6c0bcf651cbe40a59f93666829cbacd5 P 521c8650b93e4a7fa1905efd229fbdf6 [term 3 FOLLOWER]: Refusing update from remote peer fbdbc1633300449fb2b7c46f43bde744: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:29.844981 25943 consensus_queue.cc:1048] T 6c0bcf651cbe40a59f93666829cbacd5 P fbdbc1633300449fb2b7c46f43bde744 [LEADER]: Connected to new peer: Peer: permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:29.856891 25817 raft_consensus.cc:1275] T 6c0bcf651cbe40a59f93666829cbacd5 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 3 FOLLOWER]: Refusing update from remote peer fbdbc1633300449fb2b7c46f43bde744: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:29.858992 26058 consensus_queue.cc:1048] T 6c0bcf651cbe40a59f93666829cbacd5 P fbdbc1633300449fb2b7c46f43bde744 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:29.881750 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:29.905089 25743 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c0bcf651cbe40a59f93666829cbacd5"
dest_uuid: "fbdbc1633300449fb2b7c46f43bde744"
mode: GRACEFUL
new_leader_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf"
 from {username='slave'} at 127.0.0.1:58090
I20260709 12:15:29.906029 25743 raft_consensus.cc:606] T 6c0bcf651cbe40a59f93666829cbacd5 P fbdbc1633300449fb2b7c46f43bde744 [term 3 LEADER]: Received request to transfer leadership to TS 2b0ac7cec35b445bbfbfff828cdedfcf
I20260709 12:15:29.909060 25743 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78c784ca806e4871a483636451018b1e"
dest_uuid: "fbdbc1633300449fb2b7c46f43bde744"
mode: GRACEFUL
new_leader_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf"
 from {username='slave'} at 127.0.0.1:58090
I20260709 12:15:29.909617 25743 raft_consensus.cc:606] T 78c784ca806e4871a483636451018b1e P fbdbc1633300449fb2b7c46f43bde744 [term 2 LEADER]: Received request to transfer leadership to TS 2b0ac7cec35b445bbfbfff828cdedfcf
I20260709 12:15:29.911262 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:15:29.911778 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:29.912498 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:30.164871 26078 raft_consensus.cc:993] T 78c784ca806e4871a483636451018b1e P fbdbc1633300449fb2b7c46f43bde744: : Instructing follower 2b0ac7cec35b445bbfbfff828cdedfcf to start an election
I20260709 12:15:30.165426 25943 raft_consensus.cc:1081] T 78c784ca806e4871a483636451018b1e P fbdbc1633300449fb2b7c46f43bde744 [term 2 LEADER]: Signalling peer 2b0ac7cec35b445bbfbfff828cdedfcf to start an election
I20260709 12:15:30.167363 25817 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78c784ca806e4871a483636451018b1e"
dest_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf"
 from {username='slave'} at 127.0.0.1:51126
I20260709 12:15:30.168022 25817 raft_consensus.cc:493] T 78c784ca806e4871a483636451018b1e P 2b0ac7cec35b445bbfbfff828cdedfcf [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:30.168371 25817 raft_consensus.cc:3060] T 78c784ca806e4871a483636451018b1e P 2b0ac7cec35b445bbfbfff828cdedfcf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:30.177241 25817 raft_consensus.cc:515] T 78c784ca806e4871a483636451018b1e P 2b0ac7cec35b445bbfbfff828cdedfcf [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:30.179292 25817 leader_election.cc:290] T 78c784ca806e4871a483636451018b1e P 2b0ac7cec35b445bbfbfff828cdedfcf [CANDIDATE]: Term 3 election: Requested vote from peers 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441), fbdbc1633300449fb2b7c46f43bde744 (127.12.56.194:37715)
I20260709 12:15:30.180244 26010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c784ca806e4871a483636451018b1e" candidate_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "521c8650b93e4a7fa1905efd229fbdf6"
I20260709 12:15:30.180615 25743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c784ca806e4871a483636451018b1e" candidate_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fbdbc1633300449fb2b7c46f43bde744"
I20260709 12:15:30.181166 26010 raft_consensus.cc:3060] T 78c784ca806e4871a483636451018b1e P 521c8650b93e4a7fa1905efd229fbdf6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:30.181604 25743 raft_consensus.cc:3055] T 78c784ca806e4871a483636451018b1e P fbdbc1633300449fb2b7c46f43bde744 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:30.182087 25743 raft_consensus.cc:740] T 78c784ca806e4871a483636451018b1e P fbdbc1633300449fb2b7c46f43bde744 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fbdbc1633300449fb2b7c46f43bde744, State: Running, Role: LEADER
I20260709 12:15:30.183256 25743 consensus_queue.cc:260] T 78c784ca806e4871a483636451018b1e P fbdbc1633300449fb2b7c46f43bde744 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:30.184767 25743 raft_consensus.cc:3060] T 78c784ca806e4871a483636451018b1e P fbdbc1633300449fb2b7c46f43bde744 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:30.189355 26010 raft_consensus.cc:2468] T 78c784ca806e4871a483636451018b1e P 521c8650b93e4a7fa1905efd229fbdf6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b0ac7cec35b445bbfbfff828cdedfcf in term 3.
I20260709 12:15:30.190971 25783 leader_election.cc:304] T 78c784ca806e4871a483636451018b1e P 2b0ac7cec35b445bbfbfff828cdedfcf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b0ac7cec35b445bbfbfff828cdedfcf, 521c8650b93e4a7fa1905efd229fbdf6; no voters: 
I20260709 12:15:30.191897 25946 raft_consensus.cc:2804] T 78c784ca806e4871a483636451018b1e P 2b0ac7cec35b445bbfbfff828cdedfcf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:30.192400 25946 raft_consensus.cc:697] T 78c784ca806e4871a483636451018b1e P 2b0ac7cec35b445bbfbfff828cdedfcf [term 3 LEADER]: Becoming Leader. State: Replica: 2b0ac7cec35b445bbfbfff828cdedfcf, State: Running, Role: LEADER
I20260709 12:15:30.193181 25743 raft_consensus.cc:2468] T 78c784ca806e4871a483636451018b1e P fbdbc1633300449fb2b7c46f43bde744 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b0ac7cec35b445bbfbfff828cdedfcf in term 3.
I20260709 12:15:30.193724 25946 consensus_queue.cc:237] T 78c784ca806e4871a483636451018b1e P 2b0ac7cec35b445bbfbfff828cdedfcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:30.202153 25562 catalog_manager.cc:5697] T 78c784ca806e4871a483636451018b1e P 2b0ac7cec35b445bbfbfff828cdedfcf reported cstate change: term changed from 2 to 3, leader changed from fbdbc1633300449fb2b7c46f43bde744 (127.12.56.194) to 2b0ac7cec35b445bbfbfff828cdedfcf (127.12.56.195). New cstate: current_term: 3 leader_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:30.287845 26078 raft_consensus.cc:993] T 6c0bcf651cbe40a59f93666829cbacd5 P fbdbc1633300449fb2b7c46f43bde744: : Instructing follower 2b0ac7cec35b445bbfbfff828cdedfcf to start an election
I20260709 12:15:30.288513 25943 raft_consensus.cc:1081] T 6c0bcf651cbe40a59f93666829cbacd5 P fbdbc1633300449fb2b7c46f43bde744 [term 3 LEADER]: Signalling peer 2b0ac7cec35b445bbfbfff828cdedfcf to start an election
I20260709 12:15:30.290377 25817 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6c0bcf651cbe40a59f93666829cbacd5"
dest_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf"
 from {username='slave'} at 127.0.0.1:51126
I20260709 12:15:30.290939 25817 raft_consensus.cc:493] T 6c0bcf651cbe40a59f93666829cbacd5 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:30.291358 25817 raft_consensus.cc:3060] T 6c0bcf651cbe40a59f93666829cbacd5 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:30.298415 25817 raft_consensus.cc:515] T 6c0bcf651cbe40a59f93666829cbacd5 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:30.300372 25817 leader_election.cc:290] T 6c0bcf651cbe40a59f93666829cbacd5 P 2b0ac7cec35b445bbfbfff828cdedfcf [CANDIDATE]: Term 4 election: Requested vote from peers 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441), fbdbc1633300449fb2b7c46f43bde744 (127.12.56.194:37715)
I20260709 12:15:30.301329 26010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0bcf651cbe40a59f93666829cbacd5" candidate_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "521c8650b93e4a7fa1905efd229fbdf6"
I20260709 12:15:30.301666 25743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0bcf651cbe40a59f93666829cbacd5" candidate_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "fbdbc1633300449fb2b7c46f43bde744"
I20260709 12:15:30.302141 26010 raft_consensus.cc:3060] T 6c0bcf651cbe40a59f93666829cbacd5 P 521c8650b93e4a7fa1905efd229fbdf6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:30.302340 25743 raft_consensus.cc:3055] T 6c0bcf651cbe40a59f93666829cbacd5 P fbdbc1633300449fb2b7c46f43bde744 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:15:30.302824 25743 raft_consensus.cc:740] T 6c0bcf651cbe40a59f93666829cbacd5 P fbdbc1633300449fb2b7c46f43bde744 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fbdbc1633300449fb2b7c46f43bde744, State: Running, Role: LEADER
I20260709 12:15:30.303850 25743 consensus_queue.cc:260] T 6c0bcf651cbe40a59f93666829cbacd5 P fbdbc1633300449fb2b7c46f43bde744 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:30.305368 25743 raft_consensus.cc:3060] T 6c0bcf651cbe40a59f93666829cbacd5 P fbdbc1633300449fb2b7c46f43bde744 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:30.311079 26010 raft_consensus.cc:2468] T 6c0bcf651cbe40a59f93666829cbacd5 P 521c8650b93e4a7fa1905efd229fbdf6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b0ac7cec35b445bbfbfff828cdedfcf in term 4.
I20260709 12:15:30.312727 25783 leader_election.cc:304] T 6c0bcf651cbe40a59f93666829cbacd5 P 2b0ac7cec35b445bbfbfff828cdedfcf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b0ac7cec35b445bbfbfff828cdedfcf, 521c8650b93e4a7fa1905efd229fbdf6; no voters: 
I20260709 12:15:30.313584 25946 raft_consensus.cc:2804] T 6c0bcf651cbe40a59f93666829cbacd5 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:15:30.314199 25946 raft_consensus.cc:697] T 6c0bcf651cbe40a59f93666829cbacd5 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 4 LEADER]: Becoming Leader. State: Replica: 2b0ac7cec35b445bbfbfff828cdedfcf, State: Running, Role: LEADER
I20260709 12:15:30.314657 25743 raft_consensus.cc:2468] T 6c0bcf651cbe40a59f93666829cbacd5 P fbdbc1633300449fb2b7c46f43bde744 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b0ac7cec35b445bbfbfff828cdedfcf in term 4.
I20260709 12:15:30.315348 25946 consensus_queue.cc:237] T 6c0bcf651cbe40a59f93666829cbacd5 P 2b0ac7cec35b445bbfbfff828cdedfcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:30.323387 25562 catalog_manager.cc:5697] T 6c0bcf651cbe40a59f93666829cbacd5 P 2b0ac7cec35b445bbfbfff828cdedfcf reported cstate change: term changed from 3 to 4, leader changed from fbdbc1633300449fb2b7c46f43bde744 (127.12.56.194) to 2b0ac7cec35b445bbfbfff828cdedfcf (127.12.56.195). New cstate: current_term: 4 leader_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:30.698911 25743 raft_consensus.cc:1275] T 78c784ca806e4871a483636451018b1e P fbdbc1633300449fb2b7c46f43bde744 [term 3 FOLLOWER]: Refusing update from remote peer 2b0ac7cec35b445bbfbfff828cdedfcf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:30.700330 25946 consensus_queue.cc:1048] T 78c784ca806e4871a483636451018b1e P 2b0ac7cec35b445bbfbfff828cdedfcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:30.712342 26010 raft_consensus.cc:1275] T 78c784ca806e4871a483636451018b1e P 521c8650b93e4a7fa1905efd229fbdf6 [term 3 FOLLOWER]: Refusing update from remote peer 2b0ac7cec35b445bbfbfff828cdedfcf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:30.713755 25946 consensus_queue.cc:1048] T 78c784ca806e4871a483636451018b1e P 2b0ac7cec35b445bbfbfff828cdedfcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:30.730626 26010 raft_consensus.cc:1275] T 6c0bcf651cbe40a59f93666829cbacd5 P 521c8650b93e4a7fa1905efd229fbdf6 [term 4 FOLLOWER]: Refusing update from remote peer 2b0ac7cec35b445bbfbfff828cdedfcf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:15:30.732256 25946 consensus_queue.cc:1048] T 6c0bcf651cbe40a59f93666829cbacd5 P 2b0ac7cec35b445bbfbfff828cdedfcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:15:30.732929 25614 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:15:30.740731 25743 raft_consensus.cc:1275] T 6c0bcf651cbe40a59f93666829cbacd5 P fbdbc1633300449fb2b7c46f43bde744 [term 4 FOLLOWER]: Refusing update from remote peer 2b0ac7cec35b445bbfbfff828cdedfcf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:15:30.743100 26044 consensus_queue.cc:1048] T 6c0bcf651cbe40a59f93666829cbacd5 P 2b0ac7cec35b445bbfbfff828cdedfcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:15:30.920174 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:30.927789 25817 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "032e30d956ec4c6c90f1ba5db5504a5d"
dest_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf"
mode: GRACEFUL
new_leader_uuid: "fbdbc1633300449fb2b7c46f43bde744"
 from {username='slave'} at 127.0.0.1:51150
I20260709 12:15:30.928342 25817 raft_consensus.cc:606] T 032e30d956ec4c6c90f1ba5db5504a5d P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 LEADER]: Received request to transfer leadership to TS fbdbc1633300449fb2b7c46f43bde744
I20260709 12:15:30.931100 25817 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c0bcf651cbe40a59f93666829cbacd5"
dest_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf"
mode: GRACEFUL
new_leader_uuid: "fbdbc1633300449fb2b7c46f43bde744"
 from {username='slave'} at 127.0.0.1:51150
I20260709 12:15:30.931717 25817 raft_consensus.cc:606] T 6c0bcf651cbe40a59f93666829cbacd5 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 4 LEADER]: Received request to transfer leadership to TS fbdbc1633300449fb2b7c46f43bde744
I20260709 12:15:30.933041 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:15:30.933691 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:30.934425 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:30.975819 26087 raft_consensus.cc:993] T 032e30d956ec4c6c90f1ba5db5504a5d P 2b0ac7cec35b445bbfbfff828cdedfcf: : Instructing follower fbdbc1633300449fb2b7c46f43bde744 to start an election
I20260709 12:15:30.976459 26044 raft_consensus.cc:1081] T 032e30d956ec4c6c90f1ba5db5504a5d P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 LEADER]: Signalling peer fbdbc1633300449fb2b7c46f43bde744 to start an election
I20260709 12:15:30.978581 25743 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "032e30d956ec4c6c90f1ba5db5504a5d"
dest_uuid: "fbdbc1633300449fb2b7c46f43bde744"
 from {username='slave'} at 127.0.0.1:59044
I20260709 12:15:30.979251 25743 raft_consensus.cc:493] T 032e30d956ec4c6c90f1ba5db5504a5d P fbdbc1633300449fb2b7c46f43bde744 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:30.979718 25743 raft_consensus.cc:3060] T 032e30d956ec4c6c90f1ba5db5504a5d P fbdbc1633300449fb2b7c46f43bde744 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:30.987112 25743 raft_consensus.cc:515] T 032e30d956ec4c6c90f1ba5db5504a5d P fbdbc1633300449fb2b7c46f43bde744 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } }
I20260709 12:15:30.989111 25743 leader_election.cc:290] T 032e30d956ec4c6c90f1ba5db5504a5d P fbdbc1633300449fb2b7c46f43bde744 [CANDIDATE]: Term 2 election: Requested vote from peers 2b0ac7cec35b445bbfbfff828cdedfcf (127.12.56.195:36129), 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441)
I20260709 12:15:30.990141 25817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032e30d956ec4c6c90f1ba5db5504a5d" candidate_uuid: "fbdbc1633300449fb2b7c46f43bde744" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf"
I20260709 12:15:30.990379 26010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "032e30d956ec4c6c90f1ba5db5504a5d" candidate_uuid: "fbdbc1633300449fb2b7c46f43bde744" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "521c8650b93e4a7fa1905efd229fbdf6"
I20260709 12:15:30.990906 25817 raft_consensus.cc:3055] T 032e30d956ec4c6c90f1ba5db5504a5d P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:30.991317 25817 raft_consensus.cc:740] T 032e30d956ec4c6c90f1ba5db5504a5d P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2b0ac7cec35b445bbfbfff828cdedfcf, State: Running, Role: LEADER
I20260709 12:15:30.991178 26010 raft_consensus.cc:3060] T 032e30d956ec4c6c90f1ba5db5504a5d P 521c8650b93e4a7fa1905efd229fbdf6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:30.992318 25817 consensus_queue.cc:260] T 032e30d956ec4c6c90f1ba5db5504a5d P 2b0ac7cec35b445bbfbfff828cdedfcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } }
I20260709 12:15:30.993597 25817 raft_consensus.cc:3060] T 032e30d956ec4c6c90f1ba5db5504a5d P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:30.997934 26010 raft_consensus.cc:2468] T 032e30d956ec4c6c90f1ba5db5504a5d P 521c8650b93e4a7fa1905efd229fbdf6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbdbc1633300449fb2b7c46f43bde744 in term 2.
I20260709 12:15:30.999571 25709 leader_election.cc:304] T 032e30d956ec4c6c90f1ba5db5504a5d P fbdbc1633300449fb2b7c46f43bde744 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 521c8650b93e4a7fa1905efd229fbdf6, fbdbc1633300449fb2b7c46f43bde744; no voters: 
I20260709 12:15:31.000425 26092 raft_consensus.cc:2804] T 032e30d956ec4c6c90f1ba5db5504a5d P fbdbc1633300449fb2b7c46f43bde744 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:31.000290 25817 raft_consensus.cc:2468] T 032e30d956ec4c6c90f1ba5db5504a5d P 2b0ac7cec35b445bbfbfff828cdedfcf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbdbc1633300449fb2b7c46f43bde744 in term 2.
I20260709 12:15:31.001161 26092 raft_consensus.cc:697] T 032e30d956ec4c6c90f1ba5db5504a5d P fbdbc1633300449fb2b7c46f43bde744 [term 2 LEADER]: Becoming Leader. State: Replica: fbdbc1633300449fb2b7c46f43bde744, State: Running, Role: LEADER
I20260709 12:15:31.002377 26092 consensus_queue.cc:237] T 032e30d956ec4c6c90f1ba5db5504a5d P fbdbc1633300449fb2b7c46f43bde744 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } }
I20260709 12:15:31.010183 25563 catalog_manager.cc:5697] T 032e30d956ec4c6c90f1ba5db5504a5d P fbdbc1633300449fb2b7c46f43bde744 reported cstate change: term changed from 1 to 2, leader changed from 2b0ac7cec35b445bbfbfff828cdedfcf (127.12.56.195) to fbdbc1633300449fb2b7c46f43bde744 (127.12.56.194). New cstate: current_term: 2 leader_uuid: "fbdbc1633300449fb2b7c46f43bde744" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:31.248662 26044 raft_consensus.cc:993] T 6c0bcf651cbe40a59f93666829cbacd5 P 2b0ac7cec35b445bbfbfff828cdedfcf: : Instructing follower fbdbc1633300449fb2b7c46f43bde744 to start an election
I20260709 12:15:31.249248 26087 raft_consensus.cc:1081] T 6c0bcf651cbe40a59f93666829cbacd5 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 4 LEADER]: Signalling peer fbdbc1633300449fb2b7c46f43bde744 to start an election
I20260709 12:15:31.250906 25743 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6c0bcf651cbe40a59f93666829cbacd5"
dest_uuid: "fbdbc1633300449fb2b7c46f43bde744"
 from {username='slave'} at 127.0.0.1:59044
I20260709 12:15:31.251518 25743 raft_consensus.cc:493] T 6c0bcf651cbe40a59f93666829cbacd5 P fbdbc1633300449fb2b7c46f43bde744 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:31.251808 25743 raft_consensus.cc:3060] T 6c0bcf651cbe40a59f93666829cbacd5 P fbdbc1633300449fb2b7c46f43bde744 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:31.258731 25743 raft_consensus.cc:515] T 6c0bcf651cbe40a59f93666829cbacd5 P fbdbc1633300449fb2b7c46f43bde744 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:31.260426 25743 leader_election.cc:290] T 6c0bcf651cbe40a59f93666829cbacd5 P fbdbc1633300449fb2b7c46f43bde744 [CANDIDATE]: Term 5 election: Requested vote from peers 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441), 2b0ac7cec35b445bbfbfff828cdedfcf (127.12.56.195:36129)
I20260709 12:15:31.261456 25817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0bcf651cbe40a59f93666829cbacd5" candidate_uuid: "fbdbc1633300449fb2b7c46f43bde744" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf"
I20260709 12:15:31.261504 26010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c0bcf651cbe40a59f93666829cbacd5" candidate_uuid: "fbdbc1633300449fb2b7c46f43bde744" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "521c8650b93e4a7fa1905efd229fbdf6"
I20260709 12:15:31.262120 25817 raft_consensus.cc:3055] T 6c0bcf651cbe40a59f93666829cbacd5 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:15:31.262305 26010 raft_consensus.cc:3060] T 6c0bcf651cbe40a59f93666829cbacd5 P 521c8650b93e4a7fa1905efd229fbdf6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:31.262409 25817 raft_consensus.cc:740] T 6c0bcf651cbe40a59f93666829cbacd5 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2b0ac7cec35b445bbfbfff828cdedfcf, State: Running, Role: LEADER
I20260709 12:15:31.263378 25817 consensus_queue.cc:260] T 6c0bcf651cbe40a59f93666829cbacd5 P 2b0ac7cec35b445bbfbfff828cdedfcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:31.264339 25817 raft_consensus.cc:3060] T 6c0bcf651cbe40a59f93666829cbacd5 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:15:31.268149 26010 raft_consensus.cc:2468] T 6c0bcf651cbe40a59f93666829cbacd5 P 521c8650b93e4a7fa1905efd229fbdf6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbdbc1633300449fb2b7c46f43bde744 in term 5.
I20260709 12:15:31.269440 25817 raft_consensus.cc:2468] T 6c0bcf651cbe40a59f93666829cbacd5 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbdbc1633300449fb2b7c46f43bde744 in term 5.
I20260709 12:15:31.269454 25709 leader_election.cc:304] T 6c0bcf651cbe40a59f93666829cbacd5 P fbdbc1633300449fb2b7c46f43bde744 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 521c8650b93e4a7fa1905efd229fbdf6, fbdbc1633300449fb2b7c46f43bde744; no voters: 
I20260709 12:15:31.270815 26092 raft_consensus.cc:2804] T 6c0bcf651cbe40a59f93666829cbacd5 P fbdbc1633300449fb2b7c46f43bde744 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:15:31.271355 26092 raft_consensus.cc:697] T 6c0bcf651cbe40a59f93666829cbacd5 P fbdbc1633300449fb2b7c46f43bde744 [term 5 LEADER]: Becoming Leader. State: Replica: fbdbc1633300449fb2b7c46f43bde744, State: Running, Role: LEADER
I20260709 12:15:31.272185 26092 consensus_queue.cc:237] T 6c0bcf651cbe40a59f93666829cbacd5 P fbdbc1633300449fb2b7c46f43bde744 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:31.281322 25563 catalog_manager.cc:5697] T 6c0bcf651cbe40a59f93666829cbacd5 P fbdbc1633300449fb2b7c46f43bde744 reported cstate change: term changed from 4 to 5, leader changed from 2b0ac7cec35b445bbfbfff828cdedfcf (127.12.56.195) to fbdbc1633300449fb2b7c46f43bde744 (127.12.56.194). New cstate: current_term: 5 leader_uuid: "fbdbc1633300449fb2b7c46f43bde744" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:31.504362 26010 raft_consensus.cc:1275] T 032e30d956ec4c6c90f1ba5db5504a5d P 521c8650b93e4a7fa1905efd229fbdf6 [term 2 FOLLOWER]: Refusing update from remote peer fbdbc1633300449fb2b7c46f43bde744: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:31.506301 26092 consensus_queue.cc:1048] T 032e30d956ec4c6c90f1ba5db5504a5d P fbdbc1633300449fb2b7c46f43bde744 [LEADER]: Connected to new peer: Peer: permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:31.518800 25817 raft_consensus.cc:1275] T 032e30d956ec4c6c90f1ba5db5504a5d P 2b0ac7cec35b445bbfbfff828cdedfcf [term 2 FOLLOWER]: Refusing update from remote peer fbdbc1633300449fb2b7c46f43bde744: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:31.522699 26100 consensus_queue.cc:1048] T 032e30d956ec4c6c90f1ba5db5504a5d P fbdbc1633300449fb2b7c46f43bde744 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:31.673868 26010 raft_consensus.cc:1275] T 6c0bcf651cbe40a59f93666829cbacd5 P 521c8650b93e4a7fa1905efd229fbdf6 [term 5 FOLLOWER]: Refusing update from remote peer fbdbc1633300449fb2b7c46f43bde744: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:15:31.675300 26092 consensus_queue.cc:1048] T 6c0bcf651cbe40a59f93666829cbacd5 P fbdbc1633300449fb2b7c46f43bde744 [LEADER]: Connected to new peer: Peer: permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:15:31.684767 25817 raft_consensus.cc:1275] T 6c0bcf651cbe40a59f93666829cbacd5 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 5 FOLLOWER]: Refusing update from remote peer fbdbc1633300449fb2b7c46f43bde744: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:15:31.686610 26100 consensus_queue.cc:1048] T 6c0bcf651cbe40a59f93666829cbacd5 P fbdbc1633300449fb2b7c46f43bde744 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:15:31.734041 25614 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:15:31.941187 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:31.950138 25743 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "06be549acfdb46a9801ebced1ab5be4d"
dest_uuid: "fbdbc1633300449fb2b7c46f43bde744"
mode: GRACEFUL
new_leader_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf"
 from {username='slave'} at 127.0.0.1:58090
I20260709 12:15:31.950834 25743 raft_consensus.cc:606] T 06be549acfdb46a9801ebced1ab5be4d P fbdbc1633300449fb2b7c46f43bde744 [term 2 LEADER]: Received request to transfer leadership to TS 2b0ac7cec35b445bbfbfff828cdedfcf
I20260709 12:15:31.954233 25743 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ccfca33043a14a9089a3c59b29c3b442"
dest_uuid: "fbdbc1633300449fb2b7c46f43bde744"
mode: GRACEFUL
new_leader_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf"
 from {username='slave'} at 127.0.0.1:58090
I20260709 12:15:31.955106 25743 raft_consensus.cc:606] T ccfca33043a14a9089a3c59b29c3b442 P fbdbc1633300449fb2b7c46f43bde744 [term 1 LEADER]: Received request to transfer leadership to TS 2b0ac7cec35b445bbfbfff828cdedfcf
I20260709 12:15:31.956768 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:15:31.957439 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:31.957966 26100 raft_consensus.cc:993] T ccfca33043a14a9089a3c59b29c3b442 P fbdbc1633300449fb2b7c46f43bde744: : Instructing follower 2b0ac7cec35b445bbfbfff828cdedfcf to start an election
I20260709 12:15:31.958259 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:31.958566 26092 raft_consensus.cc:1081] T ccfca33043a14a9089a3c59b29c3b442 P fbdbc1633300449fb2b7c46f43bde744 [term 1 LEADER]: Signalling peer 2b0ac7cec35b445bbfbfff828cdedfcf to start an election
I20260709 12:15:31.960479 25816 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ccfca33043a14a9089a3c59b29c3b442"
dest_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf"
 from {username='slave'} at 127.0.0.1:51126
I20260709 12:15:31.961143 25816 raft_consensus.cc:493] T ccfca33043a14a9089a3c59b29c3b442 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:31.961483 25816 raft_consensus.cc:3060] T ccfca33043a14a9089a3c59b29c3b442 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:31.968978 25816 raft_consensus.cc:515] T ccfca33043a14a9089a3c59b29c3b442 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:31.970993 25816 leader_election.cc:290] T ccfca33043a14a9089a3c59b29c3b442 P 2b0ac7cec35b445bbfbfff828cdedfcf [CANDIDATE]: Term 2 election: Requested vote from peers 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441), fbdbc1633300449fb2b7c46f43bde744 (127.12.56.194:37715)
I20260709 12:15:31.971803 26010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfca33043a14a9089a3c59b29c3b442" candidate_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "521c8650b93e4a7fa1905efd229fbdf6"
I20260709 12:15:31.972011 25743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccfca33043a14a9089a3c59b29c3b442" candidate_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fbdbc1633300449fb2b7c46f43bde744"
I20260709 12:15:31.972656 26010 raft_consensus.cc:3060] T ccfca33043a14a9089a3c59b29c3b442 P 521c8650b93e4a7fa1905efd229fbdf6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:31.972894 25743 raft_consensus.cc:3055] T ccfca33043a14a9089a3c59b29c3b442 P fbdbc1633300449fb2b7c46f43bde744 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:31.973330 25743 raft_consensus.cc:740] T ccfca33043a14a9089a3c59b29c3b442 P fbdbc1633300449fb2b7c46f43bde744 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fbdbc1633300449fb2b7c46f43bde744, State: Running, Role: LEADER
I20260709 12:15:31.974215 25743 consensus_queue.cc:260] T ccfca33043a14a9089a3c59b29c3b442 P fbdbc1633300449fb2b7c46f43bde744 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:31.975353 25743 raft_consensus.cc:3060] T ccfca33043a14a9089a3c59b29c3b442 P fbdbc1633300449fb2b7c46f43bde744 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:31.979743 26010 raft_consensus.cc:2468] T ccfca33043a14a9089a3c59b29c3b442 P 521c8650b93e4a7fa1905efd229fbdf6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b0ac7cec35b445bbfbfff828cdedfcf in term 2.
I20260709 12:15:31.980777 25743 raft_consensus.cc:2468] T ccfca33043a14a9089a3c59b29c3b442 P fbdbc1633300449fb2b7c46f43bde744 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b0ac7cec35b445bbfbfff828cdedfcf in term 2.
I20260709 12:15:31.981092 25783 leader_election.cc:304] T ccfca33043a14a9089a3c59b29c3b442 P 2b0ac7cec35b445bbfbfff828cdedfcf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b0ac7cec35b445bbfbfff828cdedfcf, 521c8650b93e4a7fa1905efd229fbdf6; no voters: 
I20260709 12:15:31.982030 26104 raft_consensus.cc:2804] T ccfca33043a14a9089a3c59b29c3b442 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:31.982542 26104 raft_consensus.cc:697] T ccfca33043a14a9089a3c59b29c3b442 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 2 LEADER]: Becoming Leader. State: Replica: 2b0ac7cec35b445bbfbfff828cdedfcf, State: Running, Role: LEADER
I20260709 12:15:31.983326 26104 consensus_queue.cc:237] T ccfca33043a14a9089a3c59b29c3b442 P 2b0ac7cec35b445bbfbfff828cdedfcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:31.991267 25563 catalog_manager.cc:5697] T ccfca33043a14a9089a3c59b29c3b442 P 2b0ac7cec35b445bbfbfff828cdedfcf reported cstate change: term changed from 1 to 2, leader changed from fbdbc1633300449fb2b7c46f43bde744 (127.12.56.194) to 2b0ac7cec35b445bbfbfff828cdedfcf (127.12.56.195). New cstate: current_term: 2 leader_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:32.451364 25943 raft_consensus.cc:993] T 06be549acfdb46a9801ebced1ab5be4d P fbdbc1633300449fb2b7c46f43bde744: : Instructing follower 2b0ac7cec35b445bbfbfff828cdedfcf to start an election
I20260709 12:15:32.451931 26092 raft_consensus.cc:1081] T 06be549acfdb46a9801ebced1ab5be4d P fbdbc1633300449fb2b7c46f43bde744 [term 2 LEADER]: Signalling peer 2b0ac7cec35b445bbfbfff828cdedfcf to start an election
I20260709 12:15:32.453986 25816 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "06be549acfdb46a9801ebced1ab5be4d"
dest_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf"
 from {username='slave'} at 127.0.0.1:51126
I20260709 12:15:32.454588 25816 raft_consensus.cc:493] T 06be549acfdb46a9801ebced1ab5be4d P 2b0ac7cec35b445bbfbfff828cdedfcf [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:32.454937 25816 raft_consensus.cc:3060] T 06be549acfdb46a9801ebced1ab5be4d P 2b0ac7cec35b445bbfbfff828cdedfcf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:32.461748 25816 raft_consensus.cc:515] T 06be549acfdb46a9801ebced1ab5be4d P 2b0ac7cec35b445bbfbfff828cdedfcf [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:32.463655 25816 leader_election.cc:290] T 06be549acfdb46a9801ebced1ab5be4d P 2b0ac7cec35b445bbfbfff828cdedfcf [CANDIDATE]: Term 3 election: Requested vote from peers 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441), fbdbc1633300449fb2b7c46f43bde744 (127.12.56.194:37715)
I20260709 12:15:32.464457 26010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06be549acfdb46a9801ebced1ab5be4d" candidate_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "521c8650b93e4a7fa1905efd229fbdf6"
I20260709 12:15:32.464766 25743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06be549acfdb46a9801ebced1ab5be4d" candidate_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fbdbc1633300449fb2b7c46f43bde744"
I20260709 12:15:32.465061 26010 raft_consensus.cc:3060] T 06be549acfdb46a9801ebced1ab5be4d P 521c8650b93e4a7fa1905efd229fbdf6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:32.465514 25743 raft_consensus.cc:3055] T 06be549acfdb46a9801ebced1ab5be4d P fbdbc1633300449fb2b7c46f43bde744 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:32.466048 25743 raft_consensus.cc:740] T 06be549acfdb46a9801ebced1ab5be4d P fbdbc1633300449fb2b7c46f43bde744 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fbdbc1633300449fb2b7c46f43bde744, State: Running, Role: LEADER
I20260709 12:15:32.467024 25743 consensus_queue.cc:260] T 06be549acfdb46a9801ebced1ab5be4d P fbdbc1633300449fb2b7c46f43bde744 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:32.468096 25743 raft_consensus.cc:3060] T 06be549acfdb46a9801ebced1ab5be4d P fbdbc1633300449fb2b7c46f43bde744 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:32.471035 26010 raft_consensus.cc:2468] T 06be549acfdb46a9801ebced1ab5be4d P 521c8650b93e4a7fa1905efd229fbdf6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b0ac7cec35b445bbfbfff828cdedfcf in term 3.
I20260709 12:15:32.472280 25783 leader_election.cc:304] T 06be549acfdb46a9801ebced1ab5be4d P 2b0ac7cec35b445bbfbfff828cdedfcf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b0ac7cec35b445bbfbfff828cdedfcf, 521c8650b93e4a7fa1905efd229fbdf6; no voters: 
I20260709 12:15:32.473114 26104 raft_consensus.cc:2804] T 06be549acfdb46a9801ebced1ab5be4d P 2b0ac7cec35b445bbfbfff828cdedfcf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:32.473660 26104 raft_consensus.cc:697] T 06be549acfdb46a9801ebced1ab5be4d P 2b0ac7cec35b445bbfbfff828cdedfcf [term 3 LEADER]: Becoming Leader. State: Replica: 2b0ac7cec35b445bbfbfff828cdedfcf, State: Running, Role: LEADER
I20260709 12:15:32.474988 25743 raft_consensus.cc:2468] T 06be549acfdb46a9801ebced1ab5be4d P fbdbc1633300449fb2b7c46f43bde744 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b0ac7cec35b445bbfbfff828cdedfcf in term 3.
I20260709 12:15:32.474793 26104 consensus_queue.cc:237] T 06be549acfdb46a9801ebced1ab5be4d P 2b0ac7cec35b445bbfbfff828cdedfcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:32.483461 25563 catalog_manager.cc:5697] T 06be549acfdb46a9801ebced1ab5be4d P 2b0ac7cec35b445bbfbfff828cdedfcf reported cstate change: term changed from 2 to 3, leader changed from fbdbc1633300449fb2b7c46f43bde744 (127.12.56.194) to 2b0ac7cec35b445bbfbfff828cdedfcf (127.12.56.195). New cstate: current_term: 3 leader_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:32.530158 26010 raft_consensus.cc:1275] T ccfca33043a14a9089a3c59b29c3b442 P 521c8650b93e4a7fa1905efd229fbdf6 [term 2 FOLLOWER]: Refusing update from remote peer 2b0ac7cec35b445bbfbfff828cdedfcf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:32.531584 26104 consensus_queue.cc:1048] T ccfca33043a14a9089a3c59b29c3b442 P 2b0ac7cec35b445bbfbfff828cdedfcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:32.546070 25743 raft_consensus.cc:1275] T ccfca33043a14a9089a3c59b29c3b442 P fbdbc1633300449fb2b7c46f43bde744 [term 2 FOLLOWER]: Refusing update from remote peer 2b0ac7cec35b445bbfbfff828cdedfcf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:32.547729 26104 consensus_queue.cc:1048] T ccfca33043a14a9089a3c59b29c3b442 P 2b0ac7cec35b445bbfbfff828cdedfcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:15:32.735033 25614 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:15:32.966198 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:32.974537 25816 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "06be549acfdb46a9801ebced1ab5be4d"
dest_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf"
mode: GRACEFUL
new_leader_uuid: "fbdbc1633300449fb2b7c46f43bde744"
 from {username='slave'} at 127.0.0.1:51150
I20260709 12:15:32.975097 25816 raft_consensus.cc:606] T 06be549acfdb46a9801ebced1ab5be4d P 2b0ac7cec35b445bbfbfff828cdedfcf [term 3 LEADER]: Received request to transfer leadership to TS fbdbc1633300449fb2b7c46f43bde744
I20260709 12:15:32.978133 25816 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f2d3c8d7f2cc4c46ada3179f069388a8"
dest_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf"
mode: GRACEFUL
new_leader_uuid: "fbdbc1633300449fb2b7c46f43bde744"
 from {username='slave'} at 127.0.0.1:51150
I20260709 12:15:32.978662 25816 raft_consensus.cc:606] T f2d3c8d7f2cc4c46ada3179f069388a8 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 LEADER]: Received request to transfer leadership to TS fbdbc1633300449fb2b7c46f43bde744
I20260709 12:15:32.980033 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:15:32.980695 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:32.981353 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:33.031668 26010 raft_consensus.cc:1275] T 06be549acfdb46a9801ebced1ab5be4d P 521c8650b93e4a7fa1905efd229fbdf6 [term 3 FOLLOWER]: Refusing update from remote peer 2b0ac7cec35b445bbfbfff828cdedfcf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:33.033145 26116 consensus_queue.cc:1048] T 06be549acfdb46a9801ebced1ab5be4d P 2b0ac7cec35b445bbfbfff828cdedfcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:33.034829 25743 raft_consensus.cc:1275] T 06be549acfdb46a9801ebced1ab5be4d P fbdbc1633300449fb2b7c46f43bde744 [term 3 FOLLOWER]: Refusing update from remote peer 2b0ac7cec35b445bbfbfff828cdedfcf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:33.036442 26087 consensus_queue.cc:1048] T 06be549acfdb46a9801ebced1ab5be4d P 2b0ac7cec35b445bbfbfff828cdedfcf [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:15:33.056005 26116 raft_consensus.cc:993] T 06be549acfdb46a9801ebced1ab5be4d P 2b0ac7cec35b445bbfbfff828cdedfcf: : Instructing follower fbdbc1633300449fb2b7c46f43bde744 to start an election
I20260709 12:15:33.056664 26104 raft_consensus.cc:1081] T 06be549acfdb46a9801ebced1ab5be4d P 2b0ac7cec35b445bbfbfff828cdedfcf [term 3 LEADER]: Signalling peer fbdbc1633300449fb2b7c46f43bde744 to start an election
I20260709 12:15:33.058954 25739 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "06be549acfdb46a9801ebced1ab5be4d"
dest_uuid: "fbdbc1633300449fb2b7c46f43bde744"
 from {username='slave'} at 127.0.0.1:59044
I20260709 12:15:33.061013 25739 raft_consensus.cc:493] T 06be549acfdb46a9801ebced1ab5be4d P fbdbc1633300449fb2b7c46f43bde744 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:33.061632 25739 raft_consensus.cc:3060] T 06be549acfdb46a9801ebced1ab5be4d P fbdbc1633300449fb2b7c46f43bde744 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:33.071048 25739 raft_consensus.cc:515] T 06be549acfdb46a9801ebced1ab5be4d P fbdbc1633300449fb2b7c46f43bde744 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:33.074091 25739 leader_election.cc:290] T 06be549acfdb46a9801ebced1ab5be4d P fbdbc1633300449fb2b7c46f43bde744 [CANDIDATE]: Term 4 election: Requested vote from peers 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441), 2b0ac7cec35b445bbfbfff828cdedfcf (127.12.56.195:36129)
I20260709 12:15:33.075152 26010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06be549acfdb46a9801ebced1ab5be4d" candidate_uuid: "fbdbc1633300449fb2b7c46f43bde744" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "521c8650b93e4a7fa1905efd229fbdf6"
I20260709 12:15:33.075306 25816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06be549acfdb46a9801ebced1ab5be4d" candidate_uuid: "fbdbc1633300449fb2b7c46f43bde744" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf"
I20260709 12:15:33.075691 26010 raft_consensus.cc:3060] T 06be549acfdb46a9801ebced1ab5be4d P 521c8650b93e4a7fa1905efd229fbdf6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:33.076097 25816 raft_consensus.cc:3055] T 06be549acfdb46a9801ebced1ab5be4d P 2b0ac7cec35b445bbfbfff828cdedfcf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:15:33.076426 25816 raft_consensus.cc:740] T 06be549acfdb46a9801ebced1ab5be4d P 2b0ac7cec35b445bbfbfff828cdedfcf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2b0ac7cec35b445bbfbfff828cdedfcf, State: Running, Role: LEADER
I20260709 12:15:33.077178 25816 consensus_queue.cc:260] T 06be549acfdb46a9801ebced1ab5be4d P 2b0ac7cec35b445bbfbfff828cdedfcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:33.078322 25816 raft_consensus.cc:3060] T 06be549acfdb46a9801ebced1ab5be4d P 2b0ac7cec35b445bbfbfff828cdedfcf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:33.081147 26010 raft_consensus.cc:2468] T 06be549acfdb46a9801ebced1ab5be4d P 521c8650b93e4a7fa1905efd229fbdf6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbdbc1633300449fb2b7c46f43bde744 in term 4.
I20260709 12:15:33.082456 25709 leader_election.cc:304] T 06be549acfdb46a9801ebced1ab5be4d P fbdbc1633300449fb2b7c46f43bde744 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 521c8650b93e4a7fa1905efd229fbdf6, fbdbc1633300449fb2b7c46f43bde744; no voters: 
I20260709 12:15:33.083269 26092 raft_consensus.cc:2804] T 06be549acfdb46a9801ebced1ab5be4d P fbdbc1633300449fb2b7c46f43bde744 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:15:33.084492 26092 raft_consensus.cc:697] T 06be549acfdb46a9801ebced1ab5be4d P fbdbc1633300449fb2b7c46f43bde744 [term 4 LEADER]: Becoming Leader. State: Replica: fbdbc1633300449fb2b7c46f43bde744, State: Running, Role: LEADER
I20260709 12:15:33.085261 25816 raft_consensus.cc:2468] T 06be549acfdb46a9801ebced1ab5be4d P 2b0ac7cec35b445bbfbfff828cdedfcf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbdbc1633300449fb2b7c46f43bde744 in term 4.
I20260709 12:15:33.085346 26092 consensus_queue.cc:237] T 06be549acfdb46a9801ebced1ab5be4d P fbdbc1633300449fb2b7c46f43bde744 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:33.092705 25563 catalog_manager.cc:5697] T 06be549acfdb46a9801ebced1ab5be4d P fbdbc1633300449fb2b7c46f43bde744 reported cstate change: term changed from 3 to 4, leader changed from 2b0ac7cec35b445bbfbfff828cdedfcf (127.12.56.195) to fbdbc1633300449fb2b7c46f43bde744 (127.12.56.194). New cstate: current_term: 4 leader_uuid: "fbdbc1633300449fb2b7c46f43bde744" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:33.492640 25816 raft_consensus.cc:1275] T 06be549acfdb46a9801ebced1ab5be4d P 2b0ac7cec35b445bbfbfff828cdedfcf [term 4 FOLLOWER]: Refusing update from remote peer fbdbc1633300449fb2b7c46f43bde744: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:15:33.494242 26092 consensus_queue.cc:1048] T 06be549acfdb46a9801ebced1ab5be4d P fbdbc1633300449fb2b7c46f43bde744 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:15:33.503332 26010 raft_consensus.cc:1275] T 06be549acfdb46a9801ebced1ab5be4d P 521c8650b93e4a7fa1905efd229fbdf6 [term 4 FOLLOWER]: Refusing update from remote peer fbdbc1633300449fb2b7c46f43bde744: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:15:33.505101 26092 consensus_queue.cc:1048] T 06be549acfdb46a9801ebced1ab5be4d P fbdbc1633300449fb2b7c46f43bde744 [LEADER]: Connected to new peer: Peer: permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:15:33.553515 26116 raft_consensus.cc:993] T f2d3c8d7f2cc4c46ada3179f069388a8 P 2b0ac7cec35b445bbfbfff828cdedfcf: : Instructing follower fbdbc1633300449fb2b7c46f43bde744 to start an election
I20260709 12:15:33.554018 26116 raft_consensus.cc:1081] T f2d3c8d7f2cc4c46ada3179f069388a8 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 LEADER]: Signalling peer fbdbc1633300449fb2b7c46f43bde744 to start an election
I20260709 12:15:33.555994 25739 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f2d3c8d7f2cc4c46ada3179f069388a8"
dest_uuid: "fbdbc1633300449fb2b7c46f43bde744"
 from {username='slave'} at 127.0.0.1:59044
I20260709 12:15:33.556731 25739 raft_consensus.cc:493] T f2d3c8d7f2cc4c46ada3179f069388a8 P fbdbc1633300449fb2b7c46f43bde744 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:33.557255 25739 raft_consensus.cc:3060] T f2d3c8d7f2cc4c46ada3179f069388a8 P fbdbc1633300449fb2b7c46f43bde744 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:33.563062 25739 raft_consensus.cc:515] T f2d3c8d7f2cc4c46ada3179f069388a8 P fbdbc1633300449fb2b7c46f43bde744 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:33.564857 25739 leader_election.cc:290] T f2d3c8d7f2cc4c46ada3179f069388a8 P fbdbc1633300449fb2b7c46f43bde744 [CANDIDATE]: Term 2 election: Requested vote from peers 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441), 2b0ac7cec35b445bbfbfff828cdedfcf (127.12.56.195:36129)
I20260709 12:15:33.565876 26010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d3c8d7f2cc4c46ada3179f069388a8" candidate_uuid: "fbdbc1633300449fb2b7c46f43bde744" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "521c8650b93e4a7fa1905efd229fbdf6"
I20260709 12:15:33.566002 25816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d3c8d7f2cc4c46ada3179f069388a8" candidate_uuid: "fbdbc1633300449fb2b7c46f43bde744" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf"
I20260709 12:15:33.566608 26010 raft_consensus.cc:3060] T f2d3c8d7f2cc4c46ada3179f069388a8 P 521c8650b93e4a7fa1905efd229fbdf6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:33.566689 25816 raft_consensus.cc:3055] T f2d3c8d7f2cc4c46ada3179f069388a8 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:33.567219 25816 raft_consensus.cc:740] T f2d3c8d7f2cc4c46ada3179f069388a8 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2b0ac7cec35b445bbfbfff828cdedfcf, State: Running, Role: LEADER
I20260709 12:15:33.568594 25816 consensus_queue.cc:260] T f2d3c8d7f2cc4c46ada3179f069388a8 P 2b0ac7cec35b445bbfbfff828cdedfcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:33.570420 25816 raft_consensus.cc:3060] T f2d3c8d7f2cc4c46ada3179f069388a8 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:33.576216 26010 raft_consensus.cc:2468] T f2d3c8d7f2cc4c46ada3179f069388a8 P 521c8650b93e4a7fa1905efd229fbdf6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbdbc1633300449fb2b7c46f43bde744 in term 2.
I20260709 12:15:33.576231 25816 raft_consensus.cc:2468] T f2d3c8d7f2cc4c46ada3179f069388a8 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbdbc1633300449fb2b7c46f43bde744 in term 2.
I20260709 12:15:33.577767 25708 leader_election.cc:304] T f2d3c8d7f2cc4c46ada3179f069388a8 P fbdbc1633300449fb2b7c46f43bde744 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b0ac7cec35b445bbfbfff828cdedfcf, fbdbc1633300449fb2b7c46f43bde744; no voters: 
I20260709 12:15:33.578639 26092 raft_consensus.cc:2804] T f2d3c8d7f2cc4c46ada3179f069388a8 P fbdbc1633300449fb2b7c46f43bde744 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:33.579210 26092 raft_consensus.cc:697] T f2d3c8d7f2cc4c46ada3179f069388a8 P fbdbc1633300449fb2b7c46f43bde744 [term 2 LEADER]: Becoming Leader. State: Replica: fbdbc1633300449fb2b7c46f43bde744, State: Running, Role: LEADER
I20260709 12:15:33.580175 26092 consensus_queue.cc:237] T f2d3c8d7f2cc4c46ada3179f069388a8 P fbdbc1633300449fb2b7c46f43bde744 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } }
I20260709 12:15:33.588551 25563 catalog_manager.cc:5697] T f2d3c8d7f2cc4c46ada3179f069388a8 P fbdbc1633300449fb2b7c46f43bde744 reported cstate change: term changed from 1 to 2, leader changed from 2b0ac7cec35b445bbfbfff828cdedfcf (127.12.56.195) to fbdbc1633300449fb2b7c46f43bde744 (127.12.56.194). New cstate: current_term: 2 leader_uuid: "fbdbc1633300449fb2b7c46f43bde744" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "521c8650b93e4a7fa1905efd229fbdf6" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 37441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbdbc1633300449fb2b7c46f43bde744" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 } health_report { overall_health: UNKNOWN } } }
W20260709 12:15:33.736156 25614 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:15:33.988400 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:34.020035 12515 tablet_server.cc:179] TabletServer@127.12.56.193:37441 shutting down...
I20260709 12:15:34.051927 12515 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:34.052888 12515 tablet_replica.cc:333] stopping tablet replica
I20260709 12:15:34.053929 12515 raft_consensus.cc:2243] T 019b400e387d48d09821b4a446577ede P 521c8650b93e4a7fa1905efd229fbdf6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:34.054702 12515 raft_consensus.cc:2272] T 019b400e387d48d09821b4a446577ede P 521c8650b93e4a7fa1905efd229fbdf6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:34.058236 12515 tablet_replica.cc:333] stopping tablet replica
I20260709 12:15:34.059414 12515 raft_consensus.cc:2243] T 47044718acc14024854627db0aed3d3e P 521c8650b93e4a7fa1905efd229fbdf6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:34.060068 12515 raft_consensus.cc:2272] T 47044718acc14024854627db0aed3d3e P 521c8650b93e4a7fa1905efd229fbdf6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:34.062739 12515 tablet_replica.cc:333] stopping tablet replica
I20260709 12:15:34.063450 12515 raft_consensus.cc:2243] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P 521c8650b93e4a7fa1905efd229fbdf6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:34.064038 12515 raft_consensus.cc:2272] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P 521c8650b93e4a7fa1905efd229fbdf6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:34.066792 12515 tablet_replica.cc:333] stopping tablet replica
I20260709 12:15:34.067433 12515 raft_consensus.cc:2243] T 6c0bcf651cbe40a59f93666829cbacd5 P 521c8650b93e4a7fa1905efd229fbdf6 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:34.067989 12515 raft_consensus.cc:2272] T 6c0bcf651cbe40a59f93666829cbacd5 P 521c8650b93e4a7fa1905efd229fbdf6 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:34.070616 12515 tablet_replica.cc:333] stopping tablet replica
I20260709 12:15:34.071378 12515 raft_consensus.cc:2243] T 032e30d956ec4c6c90f1ba5db5504a5d P 521c8650b93e4a7fa1905efd229fbdf6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:34.071898 12515 raft_consensus.cc:2272] T 032e30d956ec4c6c90f1ba5db5504a5d P 521c8650b93e4a7fa1905efd229fbdf6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:34.074496 12515 tablet_replica.cc:333] stopping tablet replica
I20260709 12:15:34.075132 12515 raft_consensus.cc:2243] T 78c784ca806e4871a483636451018b1e P 521c8650b93e4a7fa1905efd229fbdf6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:34.075641 12515 raft_consensus.cc:2272] T 78c784ca806e4871a483636451018b1e P 521c8650b93e4a7fa1905efd229fbdf6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:34.078069 12515 tablet_replica.cc:333] stopping tablet replica
I20260709 12:15:34.078696 12515 raft_consensus.cc:2243] T f2d3c8d7f2cc4c46ada3179f069388a8 P 521c8650b93e4a7fa1905efd229fbdf6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:34.079270 12515 raft_consensus.cc:2272] T f2d3c8d7f2cc4c46ada3179f069388a8 P 521c8650b93e4a7fa1905efd229fbdf6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:34.082216 12515 tablet_replica.cc:333] stopping tablet replica
I20260709 12:15:34.082841 12515 raft_consensus.cc:2243] T ccfca33043a14a9089a3c59b29c3b442 P 521c8650b93e4a7fa1905efd229fbdf6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:34.083328 12515 raft_consensus.cc:2272] T ccfca33043a14a9089a3c59b29c3b442 P 521c8650b93e4a7fa1905efd229fbdf6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:34.085703 12515 tablet_replica.cc:333] stopping tablet replica
I20260709 12:15:34.086424 12515 raft_consensus.cc:2243] T 06be549acfdb46a9801ebced1ab5be4d P 521c8650b93e4a7fa1905efd229fbdf6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:34.087003 12515 raft_consensus.cc:2272] T 06be549acfdb46a9801ebced1ab5be4d P 521c8650b93e4a7fa1905efd229fbdf6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:34.090257 12515 tablet_replica.cc:333] stopping tablet replica
I20260709 12:15:34.090867 12515 raft_consensus.cc:2243] T 2312590ea8034475b5d8d6cd73d3fce7 P 521c8650b93e4a7fa1905efd229fbdf6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:34.091495 12515 raft_consensus.cc:2272] T 2312590ea8034475b5d8d6cd73d3fce7 P 521c8650b93e4a7fa1905efd229fbdf6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:34.122094 25709 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.56.193:37441: connect: Connection refused (error 111) [suppressed 5 similar messages]
W20260709 12:15:34.125828 25709 consensus_peers.cc:597] T f2d3c8d7f2cc4c46ada3179f069388a8 P fbdbc1633300449fb2b7c46f43bde744 -> Peer 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441): Couldn't send request to peer 521c8650b93e4a7fa1905efd229fbdf6. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:37441: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:34.127571 12515 tablet_server.cc:196] TabletServer@127.12.56.193:37441 shutdown complete.
I20260709 12:15:34.135617 25816 raft_consensus.cc:1275] T f2d3c8d7f2cc4c46ada3179f069388a8 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 2 FOLLOWER]: Refusing update from remote peer fbdbc1633300449fb2b7c46f43bde744: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:34.137416 26130 consensus_queue.cc:1048] T f2d3c8d7f2cc4c46ada3179f069388a8 P fbdbc1633300449fb2b7c46f43bde744 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b0ac7cec35b445bbfbfff828cdedfcf" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 36129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:34.167251 12515 tablet_server.cc:179] TabletServer@127.12.56.194:0 shutting down...
I20260709 12:15:34.199604 12515 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:34.200347 12515 tablet_replica.cc:333] T 019b400e387d48d09821b4a446577ede P fbdbc1633300449fb2b7c46f43bde744: stopping tablet replica
I20260709 12:15:34.201229 12515 raft_consensus.cc:2243] T 019b400e387d48d09821b4a446577ede P fbdbc1633300449fb2b7c46f43bde744 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:34.202833 12515 raft_consensus.cc:2272] T 019b400e387d48d09821b4a446577ede P fbdbc1633300449fb2b7c46f43bde744 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:34.207290 12515 tablet_replica.cc:333] T 2312590ea8034475b5d8d6cd73d3fce7 P fbdbc1633300449fb2b7c46f43bde744: stopping tablet replica
W20260709 12:15:34.208544 25709 consensus_peers.cc:597] T 2312590ea8034475b5d8d6cd73d3fce7 P fbdbc1633300449fb2b7c46f43bde744 -> Peer 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441): Couldn't send request to peer 521c8650b93e4a7fa1905efd229fbdf6. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:37441: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:34.208582 12515 raft_consensus.cc:2243] T 2312590ea8034475b5d8d6cd73d3fce7 P fbdbc1633300449fb2b7c46f43bde744 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:34.210172 12515 raft_consensus.cc:2272] T 2312590ea8034475b5d8d6cd73d3fce7 P fbdbc1633300449fb2b7c46f43bde744 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:34.210794 25783 consensus_peers.cc:597] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P 2b0ac7cec35b445bbfbfff828cdedfcf -> Peer 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441): Couldn't send request to peer 521c8650b93e4a7fa1905efd229fbdf6. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:37441: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:34.212863 12515 tablet_replica.cc:333] T 78c784ca806e4871a483636451018b1e P fbdbc1633300449fb2b7c46f43bde744: stopping tablet replica
I20260709 12:15:34.213707 12515 raft_consensus.cc:2243] T 78c784ca806e4871a483636451018b1e P fbdbc1633300449fb2b7c46f43bde744 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:34.214257 12515 raft_consensus.cc:2272] T 78c784ca806e4871a483636451018b1e P fbdbc1633300449fb2b7c46f43bde744 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:34.216677 12515 tablet_replica.cc:333] T f2d3c8d7f2cc4c46ada3179f069388a8 P fbdbc1633300449fb2b7c46f43bde744: stopping tablet replica
I20260709 12:15:34.217300 12515 raft_consensus.cc:2243] T f2d3c8d7f2cc4c46ada3179f069388a8 P fbdbc1633300449fb2b7c46f43bde744 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:34.218194 12515 raft_consensus.cc:2272] T f2d3c8d7f2cc4c46ada3179f069388a8 P fbdbc1633300449fb2b7c46f43bde744 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:34.220897 12515 tablet_replica.cc:333] T 6c0bcf651cbe40a59f93666829cbacd5 P fbdbc1633300449fb2b7c46f43bde744: stopping tablet replica
I20260709 12:15:34.221462 12515 raft_consensus.cc:2243] T 6c0bcf651cbe40a59f93666829cbacd5 P fbdbc1633300449fb2b7c46f43bde744 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:15:34.222309 12515 raft_consensus.cc:2272] T 6c0bcf651cbe40a59f93666829cbacd5 P fbdbc1633300449fb2b7c46f43bde744 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:34.224504 12515 tablet_replica.cc:333] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P fbdbc1633300449fb2b7c46f43bde744: stopping tablet replica
I20260709 12:15:34.225070 12515 raft_consensus.cc:2243] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P fbdbc1633300449fb2b7c46f43bde744 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:34.225570 12515 raft_consensus.cc:2272] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P fbdbc1633300449fb2b7c46f43bde744 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:34.227892 12515 tablet_replica.cc:333] T 032e30d956ec4c6c90f1ba5db5504a5d P fbdbc1633300449fb2b7c46f43bde744: stopping tablet replica
I20260709 12:15:34.228461 12515 raft_consensus.cc:2243] T 032e30d956ec4c6c90f1ba5db5504a5d P fbdbc1633300449fb2b7c46f43bde744 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:34.229265 12515 raft_consensus.cc:2272] T 032e30d956ec4c6c90f1ba5db5504a5d P fbdbc1633300449fb2b7c46f43bde744 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:34.231649 12515 tablet_replica.cc:333] T 06be549acfdb46a9801ebced1ab5be4d P fbdbc1633300449fb2b7c46f43bde744: stopping tablet replica
I20260709 12:15:34.232216 12515 raft_consensus.cc:2243] T 06be549acfdb46a9801ebced1ab5be4d P fbdbc1633300449fb2b7c46f43bde744 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:15:34.233071 12515 raft_consensus.cc:2272] T 06be549acfdb46a9801ebced1ab5be4d P fbdbc1633300449fb2b7c46f43bde744 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:34.236554 12515 tablet_replica.cc:333] T ccfca33043a14a9089a3c59b29c3b442 P fbdbc1633300449fb2b7c46f43bde744: stopping tablet replica
I20260709 12:15:34.237258 12515 raft_consensus.cc:2243] T ccfca33043a14a9089a3c59b29c3b442 P fbdbc1633300449fb2b7c46f43bde744 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:34.237744 12515 raft_consensus.cc:2272] T ccfca33043a14a9089a3c59b29c3b442 P fbdbc1633300449fb2b7c46f43bde744 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:34.240262 12515 tablet_replica.cc:333] T 47044718acc14024854627db0aed3d3e P fbdbc1633300449fb2b7c46f43bde744: stopping tablet replica
I20260709 12:15:34.240823 12515 raft_consensus.cc:2243] T 47044718acc14024854627db0aed3d3e P fbdbc1633300449fb2b7c46f43bde744 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:34.241341 12515 raft_consensus.cc:2272] T 47044718acc14024854627db0aed3d3e P fbdbc1633300449fb2b7c46f43bde744 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:34.276921 12515 tablet_server.cc:196] TabletServer@127.12.56.194:0 shutdown complete.
I20260709 12:15:34.303507 12515 tablet_server.cc:179] TabletServer@127.12.56.195:0 shutting down...
W20260709 12:15:34.323437 25783 consensus_peers.cc:597] T 78c784ca806e4871a483636451018b1e P 2b0ac7cec35b445bbfbfff828cdedfcf -> Peer 521c8650b93e4a7fa1905efd229fbdf6 (127.12.56.193:37441): Couldn't send request to peer 521c8650b93e4a7fa1905efd229fbdf6. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:37441: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:34.342789 12515 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:34.343721 12515 tablet_replica.cc:333] T 019b400e387d48d09821b4a446577ede P 2b0ac7cec35b445bbfbfff828cdedfcf: stopping tablet replica
I20260709 12:15:34.344537 12515 raft_consensus.cc:2243] T 019b400e387d48d09821b4a446577ede P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:34.345124 12515 raft_consensus.cc:2272] T 019b400e387d48d09821b4a446577ede P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:34.347858 12515 tablet_replica.cc:333] T 2312590ea8034475b5d8d6cd73d3fce7 P 2b0ac7cec35b445bbfbfff828cdedfcf: stopping tablet replica
I20260709 12:15:34.348610 12515 raft_consensus.cc:2243] T 2312590ea8034475b5d8d6cd73d3fce7 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:34.349212 12515 raft_consensus.cc:2272] T 2312590ea8034475b5d8d6cd73d3fce7 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:34.351805 12515 tablet_replica.cc:333] T 06be549acfdb46a9801ebced1ab5be4d P 2b0ac7cec35b445bbfbfff828cdedfcf: stopping tablet replica
I20260709 12:15:34.352483 12515 raft_consensus.cc:2243] T 06be549acfdb46a9801ebced1ab5be4d P 2b0ac7cec35b445bbfbfff828cdedfcf [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:34.352962 12515 raft_consensus.cc:2272] T 06be549acfdb46a9801ebced1ab5be4d P 2b0ac7cec35b445bbfbfff828cdedfcf [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:34.356032 12515 tablet_replica.cc:333] T ccfca33043a14a9089a3c59b29c3b442 P 2b0ac7cec35b445bbfbfff828cdedfcf: stopping tablet replica
I20260709 12:15:34.356696 12515 raft_consensus.cc:2243] T ccfca33043a14a9089a3c59b29c3b442 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:34.357658 12515 raft_consensus.cc:2272] T ccfca33043a14a9089a3c59b29c3b442 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:34.360057 12515 tablet_replica.cc:333] T 78c784ca806e4871a483636451018b1e P 2b0ac7cec35b445bbfbfff828cdedfcf: stopping tablet replica
I20260709 12:15:34.360684 12515 raft_consensus.cc:2243] T 78c784ca806e4871a483636451018b1e P 2b0ac7cec35b445bbfbfff828cdedfcf [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:15:34.361580 12515 raft_consensus.cc:2272] T 78c784ca806e4871a483636451018b1e P 2b0ac7cec35b445bbfbfff828cdedfcf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:34.364629 12515 tablet_replica.cc:333] T f2d3c8d7f2cc4c46ada3179f069388a8 P 2b0ac7cec35b445bbfbfff828cdedfcf: stopping tablet replica
I20260709 12:15:34.365641 12515 raft_consensus.cc:2243] T f2d3c8d7f2cc4c46ada3179f069388a8 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:34.366228 12515 raft_consensus.cc:2272] T f2d3c8d7f2cc4c46ada3179f069388a8 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:34.369868 25781 consensus_peers.cc:597] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P 2b0ac7cec35b445bbfbfff828cdedfcf -> Peer fbdbc1633300449fb2b7c46f43bde744 (127.12.56.194:37715): Couldn't send request to peer fbdbc1633300449fb2b7c46f43bde744. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:37715: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:34.370083 12515 tablet_replica.cc:333] T 47044718acc14024854627db0aed3d3e P 2b0ac7cec35b445bbfbfff828cdedfcf: stopping tablet replica
I20260709 12:15:34.370864 12515 raft_consensus.cc:2243] T 47044718acc14024854627db0aed3d3e P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:34.371733 12515 raft_consensus.cc:2272] T 47044718acc14024854627db0aed3d3e P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:34.374197 12515 tablet_replica.cc:333] T 6c0bcf651cbe40a59f93666829cbacd5 P 2b0ac7cec35b445bbfbfff828cdedfcf: stopping tablet replica
I20260709 12:15:34.374739 12515 raft_consensus.cc:2243] T 6c0bcf651cbe40a59f93666829cbacd5 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:34.375159 12515 raft_consensus.cc:2272] T 6c0bcf651cbe40a59f93666829cbacd5 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:34.377357 12515 tablet_replica.cc:333] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P 2b0ac7cec35b445bbfbfff828cdedfcf: stopping tablet replica
I20260709 12:15:34.377956 12515 raft_consensus.cc:2243] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:34.378789 12515 raft_consensus.cc:2272] T 2bc9ae2bf53c4c20a18fec7bc796dfb3 P 2b0ac7cec35b445bbfbfff828cdedfcf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:34.381256 12515 tablet_replica.cc:333] T 032e30d956ec4c6c90f1ba5db5504a5d P 2b0ac7cec35b445bbfbfff828cdedfcf: stopping tablet replica
I20260709 12:15:34.381727 12515 raft_consensus.cc:2243] T 032e30d956ec4c6c90f1ba5db5504a5d P 2b0ac7cec35b445bbfbfff828cdedfcf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:34.382210 12515 raft_consensus.cc:2272] T 032e30d956ec4c6c90f1ba5db5504a5d P 2b0ac7cec35b445bbfbfff828cdedfcf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:34.417560 12515 tablet_server.cc:196] TabletServer@127.12.56.195:0 shutdown complete.
I20260709 12:15:34.448562 12515 master.cc:562] Master@127.12.56.254:44255 shutting down...
I20260709 12:15:34.476709 12515 raft_consensus.cc:2243] T 00000000000000000000000000000000 P e7aa3ebaab6a45c6be6cde40a1b53e46 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:34.477313 12515 raft_consensus.cc:2272] T 00000000000000000000000000000000 P e7aa3ebaab6a45c6be6cde40a1b53e46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:34.477691 12515 tablet_replica.cc:333] T 00000000000000000000000000000000 P e7aa3ebaab6a45c6be6cde40a1b53e46: stopping tablet replica
I20260709 12:15:34.521170 12515 master.cc:584] Master@127.12.56.254:44255 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (13003 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 12:15:34.572857 12515 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.12.56.254:44803
I20260709 12:15:34.574276 12515 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:34.581135 26138 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:34.581254 26139 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:34.582933 26141 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:34.588073 12515 server_base.cc:1061] running on GCE node
I20260709 12:15:34.589214 12515 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:34.589416 12515 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:34.589604 12515 hybrid_clock.cc:648] HybridClock initialized: now 1783599334589589 us; error 0 us; skew 500 ppm
I20260709 12:15:34.590525 12515 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:34.593444 12515 webserver.cc:533] Webserver started at http://127.12.56.254:46541/ using document root <none> and password file <none>
I20260709 12:15:34.594084 12515 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:34.594326 12515 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:34.594662 12515 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:34.595945 12515 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894707649-12515-0/minicluster-data/master-0-root/instance:
uuid: "2ed2f087829b44599c3cf7025763cb3a"
format_stamp: "Formatted at 2026-07-09 12:15:34 on dist-test-slave-705g"
I20260709 12:15:34.601263 12515 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:15:34.605203 26146 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:34.606241 12515 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.003s
I20260709 12:15:34.606568 12515 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894707649-12515-0/minicluster-data/master-0-root
uuid: "2ed2f087829b44599c3cf7025763cb3a"
format_stamp: "Formatted at 2026-07-09 12:15:34 on dist-test-slave-705g"
I20260709 12:15:34.606918 12515 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894707649-12515-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894707649-12515-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894707649-12515-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:34.636289 12515 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:34.637739 12515 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:34.682278 12515 rpc_server.cc:307] RPC server started. Bound to: 127.12.56.254:44803
I20260709 12:15:34.682389 26197 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.56.254:44803 every 8 connection(s)
I20260709 12:15:34.686895 26198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:34.699664 26198 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ed2f087829b44599c3cf7025763cb3a: Bootstrap starting.
I20260709 12:15:34.704914 26198 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2ed2f087829b44599c3cf7025763cb3a: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:34.710086 26198 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ed2f087829b44599c3cf7025763cb3a: No bootstrap required, opened a new log
I20260709 12:15:34.712610 26198 raft_consensus.cc:359] T 00000000000000000000000000000000 P 2ed2f087829b44599c3cf7025763cb3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ed2f087829b44599c3cf7025763cb3a" member_type: VOTER }
I20260709 12:15:34.713056 26198 raft_consensus.cc:385] T 00000000000000000000000000000000 P 2ed2f087829b44599c3cf7025763cb3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:34.713261 26198 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2ed2f087829b44599c3cf7025763cb3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ed2f087829b44599c3cf7025763cb3a, State: Initialized, Role: FOLLOWER
I20260709 12:15:34.714006 26198 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2ed2f087829b44599c3cf7025763cb3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ed2f087829b44599c3cf7025763cb3a" member_type: VOTER }
I20260709 12:15:34.714519 26198 raft_consensus.cc:399] T 00000000000000000000000000000000 P 2ed2f087829b44599c3cf7025763cb3a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:15:34.714771 26198 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2ed2f087829b44599c3cf7025763cb3a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:15:34.715005 26198 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2ed2f087829b44599c3cf7025763cb3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:34.720772 26198 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2ed2f087829b44599c3cf7025763cb3a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ed2f087829b44599c3cf7025763cb3a" member_type: VOTER }
I20260709 12:15:34.721354 26198 leader_election.cc:304] T 00000000000000000000000000000000 P 2ed2f087829b44599c3cf7025763cb3a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2ed2f087829b44599c3cf7025763cb3a; no voters: 
I20260709 12:15:34.722690 26198 leader_election.cc:290] T 00000000000000000000000000000000 P 2ed2f087829b44599c3cf7025763cb3a [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:15:34.723141 26201 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 2ed2f087829b44599c3cf7025763cb3a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:34.724735 26201 raft_consensus.cc:697] T 00000000000000000000000000000000 P 2ed2f087829b44599c3cf7025763cb3a [term 1 LEADER]: Becoming Leader. State: Replica: 2ed2f087829b44599c3cf7025763cb3a, State: Running, Role: LEADER
I20260709 12:15:34.725456 26201 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2ed2f087829b44599c3cf7025763cb3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ed2f087829b44599c3cf7025763cb3a" member_type: VOTER }
I20260709 12:15:34.726240 26198 sys_catalog.cc:565] T 00000000000000000000000000000000 P 2ed2f087829b44599c3cf7025763cb3a [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:15:34.730700 26203 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ed2f087829b44599c3cf7025763cb3a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2ed2f087829b44599c3cf7025763cb3a. Latest consensus state: current_term: 1 leader_uuid: "2ed2f087829b44599c3cf7025763cb3a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ed2f087829b44599c3cf7025763cb3a" member_type: VOTER } }
I20260709 12:15:34.730717 26202 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ed2f087829b44599c3cf7025763cb3a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2ed2f087829b44599c3cf7025763cb3a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ed2f087829b44599c3cf7025763cb3a" member_type: VOTER } }
I20260709 12:15:34.731995 26203 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ed2f087829b44599c3cf7025763cb3a [sys.catalog]: This master's current role is: LEADER
I20260709 12:15:34.732070 26202 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ed2f087829b44599c3cf7025763cb3a [sys.catalog]: This master's current role is: LEADER
I20260709 12:15:34.741698 26208 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:15:34.750947 26208 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:15:34.752110 12515 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:15:34.761649 26208 catalog_manager.cc:1383] Generated new cluster ID: 84d8aea17e7f49009d1c3760670f2cb9
I20260709 12:15:34.762048 26208 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:15:34.784204 26208 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:15:34.785650 26208 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:15:34.801484 26208 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 2ed2f087829b44599c3cf7025763cb3a: Generated new TSK 0
I20260709 12:15:34.802258 26208 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:15:34.819445 12515 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:34.827419 26219 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:34.829115 26220 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:34.831279 12515 server_base.cc:1061] running on GCE node
W20260709 12:15:34.831314 26222 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:34.832666 12515 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:34.832867 12515 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:34.833055 12515 hybrid_clock.cc:648] HybridClock initialized: now 1783599334833034 us; error 0 us; skew 500 ppm
I20260709 12:15:34.833562 12515 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:34.836148 12515 webserver.cc:533] Webserver started at http://127.12.56.193:45737/ using document root <none> and password file <none>
I20260709 12:15:34.836658 12515 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:34.836838 12515 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:34.837070 12515 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:34.838377 12515 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894707649-12515-0/minicluster-data/ts-0-root/instance:
uuid: "286cfbdee3fa44e59a9bae25828a22aa"
format_stamp: "Formatted at 2026-07-09 12:15:34 on dist-test-slave-705g"
I20260709 12:15:34.843901 12515 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:15:34.847890 26227 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:34.848955 12515 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:15:34.849413 12515 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894707649-12515-0/minicluster-data/ts-0-root
uuid: "286cfbdee3fa44e59a9bae25828a22aa"
format_stamp: "Formatted at 2026-07-09 12:15:34 on dist-test-slave-705g"
I20260709 12:15:34.849831 12515 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894707649-12515-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894707649-12515-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894707649-12515-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:34.874708 12515 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:34.876081 12515 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:34.877985 12515 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:34.880945 12515 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:34.881250 12515 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:34.881534 12515 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:34.881749 12515 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:34.934119 12515 rpc_server.cc:307] RPC server started. Bound to: 127.12.56.193:46621
I20260709 12:15:34.934213 26289 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.56.193:46621 every 8 connection(s)
I20260709 12:15:34.940073 12515 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:34.948333 26294 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:34.950412 26295 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:34.954278 26297 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:34.954715 12515 server_base.cc:1061] running on GCE node
I20260709 12:15:34.955880 26290 heartbeater.cc:344] Connected to a master server at 127.12.56.254:44803
I20260709 12:15:34.956156 12515 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:15:34.956331 26290 heartbeater.cc:461] Registering TS with master...
W20260709 12:15:34.956570 12515 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:34.956921 12515 hybrid_clock.cc:648] HybridClock initialized: now 1783599334956899 us; error 0 us; skew 500 ppm
I20260709 12:15:34.957507 26290 heartbeater.cc:507] Master 127.12.56.254:44803 requested a full tablet report, sending...
I20260709 12:15:34.957643 12515 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:34.960963 26163 ts_manager.cc:194] Registered new tserver with Master: 286cfbdee3fa44e59a9bae25828a22aa (127.12.56.193:46621)
I20260709 12:15:34.961359 12515 webserver.cc:533] Webserver started at http://127.12.56.194:32951/ using document root <none> and password file <none>
I20260709 12:15:34.962095 12515 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:34.962306 12515 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:34.962584 12515 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:34.963428 26163 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51434
I20260709 12:15:34.963883 12515 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894707649-12515-0/minicluster-data/ts-1-root/instance:
uuid: "5d897b683da9447982512d4a1bc25576"
format_stamp: "Formatted at 2026-07-09 12:15:34 on dist-test-slave-705g"
I20260709 12:15:34.969599 12515 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.002s
I20260709 12:15:34.973562 26302 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:34.974452 12515 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:15:34.974824 12515 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894707649-12515-0/minicluster-data/ts-1-root
uuid: "5d897b683da9447982512d4a1bc25576"
format_stamp: "Formatted at 2026-07-09 12:15:34 on dist-test-slave-705g"
I20260709 12:15:34.975205 12515 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894707649-12515-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894707649-12515-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894707649-12515-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:34.994378 12515 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:34.995677 12515 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:34.997236 12515 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:34.999629 12515 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:34.999868 12515 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:35.000120 12515 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:35.000293 12515 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:35.046492 12515 rpc_server.cc:307] RPC server started. Bound to: 127.12.56.194:42829
I20260709 12:15:35.046615 26364 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.56.194:42829 every 8 connection(s)
I20260709 12:15:35.051985 12515 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:35.061144 26368 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:35.063755 26369 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:35.067037 26371 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:35.067860 12515 server_base.cc:1061] running on GCE node
I20260709 12:15:35.068720 26365 heartbeater.cc:344] Connected to a master server at 127.12.56.254:44803
I20260709 12:15:35.069187 26365 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:35.069182 12515 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:35.069679 12515 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:35.069926 12515 hybrid_clock.cc:648] HybridClock initialized: now 1783599335069900 us; error 0 us; skew 500 ppm
I20260709 12:15:35.070333 26365 heartbeater.cc:507] Master 127.12.56.254:44803 requested a full tablet report, sending...
I20260709 12:15:35.070726 12515 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:35.073294 26163 ts_manager.cc:194] Registered new tserver with Master: 5d897b683da9447982512d4a1bc25576 (127.12.56.194:42829)
I20260709 12:15:35.074252 12515 webserver.cc:533] Webserver started at http://127.12.56.195:40877/ using document root <none> and password file <none>
I20260709 12:15:35.075094 12515 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:35.075356 12515 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:35.075731 12515 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:35.075590 26163 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51436
I20260709 12:15:35.077646 12515 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894707649-12515-0/minicluster-data/ts-2-root/instance:
uuid: "fd56f18d738e4a3f8e002e19cce4b1fb"
format_stamp: "Formatted at 2026-07-09 12:15:35 on dist-test-slave-705g"
I20260709 12:15:35.083114 12515 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:15:35.087211 26376 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:35.088236 12515 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:15:35.088611 12515 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894707649-12515-0/minicluster-data/ts-2-root
uuid: "fd56f18d738e4a3f8e002e19cce4b1fb"
format_stamp: "Formatted at 2026-07-09 12:15:35 on dist-test-slave-705g"
I20260709 12:15:35.088913 12515 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894707649-12515-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894707649-12515-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894707649-12515-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:35.103055 12515 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:35.104439 12515 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:35.105968 12515 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:35.108330 12515 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:35.108664 12515 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:35.108920 12515 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:35.109098 12515 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:35.153627 12515 rpc_server.cc:307] RPC server started. Bound to: 127.12.56.195:34861
I20260709 12:15:35.153766 26438 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.56.195:34861 every 8 connection(s)
I20260709 12:15:35.170121 26439 heartbeater.cc:344] Connected to a master server at 127.12.56.254:44803
I20260709 12:15:35.170570 26439 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:35.171402 26439 heartbeater.cc:507] Master 127.12.56.254:44803 requested a full tablet report, sending...
I20260709 12:15:35.173620 26163 ts_manager.cc:194] Registered new tserver with Master: fd56f18d738e4a3f8e002e19cce4b1fb (127.12.56.195:34861)
I20260709 12:15:35.174474 12515 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01744741s
I20260709 12:15:35.175271 26163 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51450
I20260709 12:15:35.203531 26163 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51464:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:15:35.205965 26163 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:15:35.256711 26403 tablet_service.cc:1511] Processing CreateTablet for tablet 2a2310bd6ad2414c9524a4b5202f679d (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=4c63c31bd78248a69b788db822c391b7]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:15:35.258533 26403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a2310bd6ad2414c9524a4b5202f679d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:35.256711 26404 tablet_service.cc:1511] Processing CreateTablet for tablet 100ec9c805b34858a7d277fb8ffceeb2 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=4c63c31bd78248a69b788db822c391b7]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:15:35.260425 26404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 100ec9c805b34858a7d277fb8ffceeb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:35.270888 26254 tablet_service.cc:1511] Processing CreateTablet for tablet 2a2310bd6ad2414c9524a4b5202f679d (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=4c63c31bd78248a69b788db822c391b7]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:15:35.270944 26255 tablet_service.cc:1511] Processing CreateTablet for tablet 100ec9c805b34858a7d277fb8ffceeb2 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=4c63c31bd78248a69b788db822c391b7]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:15:35.272166 26330 tablet_service.cc:1511] Processing CreateTablet for tablet 100ec9c805b34858a7d277fb8ffceeb2 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=4c63c31bd78248a69b788db822c391b7]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:15:35.272778 26254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a2310bd6ad2414c9524a4b5202f679d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:35.273742 26330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 100ec9c805b34858a7d277fb8ffceeb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:35.274302 26255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 100ec9c805b34858a7d277fb8ffceeb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:35.284190 26329 tablet_service.cc:1511] Processing CreateTablet for tablet 2a2310bd6ad2414c9524a4b5202f679d (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=4c63c31bd78248a69b788db822c391b7]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:15:35.286588 26329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a2310bd6ad2414c9524a4b5202f679d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:35.317883 26454 tablet_bootstrap.cc:492] T 2a2310bd6ad2414c9524a4b5202f679d P fd56f18d738e4a3f8e002e19cce4b1fb: Bootstrap starting.
I20260709 12:15:35.329758 26456 tablet_bootstrap.cc:492] T 2a2310bd6ad2414c9524a4b5202f679d P 5d897b683da9447982512d4a1bc25576: Bootstrap starting.
I20260709 12:15:35.338287 26456 tablet_bootstrap.cc:654] T 2a2310bd6ad2414c9524a4b5202f679d P 5d897b683da9447982512d4a1bc25576: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:35.340160 26455 tablet_bootstrap.cc:492] T 2a2310bd6ad2414c9524a4b5202f679d P 286cfbdee3fa44e59a9bae25828a22aa: Bootstrap starting.
I20260709 12:15:35.342099 26454 tablet_bootstrap.cc:654] T 2a2310bd6ad2414c9524a4b5202f679d P fd56f18d738e4a3f8e002e19cce4b1fb: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:35.350194 26454 tablet_bootstrap.cc:492] T 2a2310bd6ad2414c9524a4b5202f679d P fd56f18d738e4a3f8e002e19cce4b1fb: No bootstrap required, opened a new log
I20260709 12:15:35.350807 26454 ts_tablet_manager.cc:1403] T 2a2310bd6ad2414c9524a4b5202f679d P fd56f18d738e4a3f8e002e19cce4b1fb: Time spent bootstrapping tablet: real 0.036s	user 0.006s	sys 0.010s
I20260709 12:15:35.351182 26455 tablet_bootstrap.cc:654] T 2a2310bd6ad2414c9524a4b5202f679d P 286cfbdee3fa44e59a9bae25828a22aa: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:35.351722 26456 tablet_bootstrap.cc:492] T 2a2310bd6ad2414c9524a4b5202f679d P 5d897b683da9447982512d4a1bc25576: No bootstrap required, opened a new log
I20260709 12:15:35.352355 26456 ts_tablet_manager.cc:1403] T 2a2310bd6ad2414c9524a4b5202f679d P 5d897b683da9447982512d4a1bc25576: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.009s
I20260709 12:15:35.354300 26454 raft_consensus.cc:359] T 2a2310bd6ad2414c9524a4b5202f679d P fd56f18d738e4a3f8e002e19cce4b1fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "286cfbdee3fa44e59a9bae25828a22aa" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 46621 } } peers { permanent_uuid: "5d897b683da9447982512d4a1bc25576" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 42829 } } peers { permanent_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34861 } }
I20260709 12:15:35.355163 26454 raft_consensus.cc:385] T 2a2310bd6ad2414c9524a4b5202f679d P fd56f18d738e4a3f8e002e19cce4b1fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:35.355494 26454 raft_consensus.cc:740] T 2a2310bd6ad2414c9524a4b5202f679d P fd56f18d738e4a3f8e002e19cce4b1fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd56f18d738e4a3f8e002e19cce4b1fb, State: Initialized, Role: FOLLOWER
I20260709 12:15:35.355266 26456 raft_consensus.cc:359] T 2a2310bd6ad2414c9524a4b5202f679d P 5d897b683da9447982512d4a1bc25576 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "286cfbdee3fa44e59a9bae25828a22aa" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 46621 } } peers { permanent_uuid: "5d897b683da9447982512d4a1bc25576" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 42829 } } peers { permanent_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34861 } }
I20260709 12:15:35.356142 26456 raft_consensus.cc:385] T 2a2310bd6ad2414c9524a4b5202f679d P 5d897b683da9447982512d4a1bc25576 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:35.356521 26456 raft_consensus.cc:740] T 2a2310bd6ad2414c9524a4b5202f679d P 5d897b683da9447982512d4a1bc25576 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d897b683da9447982512d4a1bc25576, State: Initialized, Role: FOLLOWER
I20260709 12:15:35.356459 26454 consensus_queue.cc:260] T 2a2310bd6ad2414c9524a4b5202f679d P fd56f18d738e4a3f8e002e19cce4b1fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "286cfbdee3fa44e59a9bae25828a22aa" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 46621 } } peers { permanent_uuid: "5d897b683da9447982512d4a1bc25576" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 42829 } } peers { permanent_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34861 } }
I20260709 12:15:35.357059 26455 tablet_bootstrap.cc:492] T 2a2310bd6ad2414c9524a4b5202f679d P 286cfbdee3fa44e59a9bae25828a22aa: No bootstrap required, opened a new log
I20260709 12:15:35.357741 26455 ts_tablet_manager.cc:1403] T 2a2310bd6ad2414c9524a4b5202f679d P 286cfbdee3fa44e59a9bae25828a22aa: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.008s
I20260709 12:15:35.357537 26456 consensus_queue.cc:260] T 2a2310bd6ad2414c9524a4b5202f679d P 5d897b683da9447982512d4a1bc25576 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "286cfbdee3fa44e59a9bae25828a22aa" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 46621 } } peers { permanent_uuid: "5d897b683da9447982512d4a1bc25576" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 42829 } } peers { permanent_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34861 } }
I20260709 12:15:35.359318 26439 heartbeater.cc:499] Master 127.12.56.254:44803 was elected leader, sending a full tablet report...
I20260709 12:15:35.359742 26454 ts_tablet_manager.cc:1434] T 2a2310bd6ad2414c9524a4b5202f679d P fd56f18d738e4a3f8e002e19cce4b1fb: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:15:35.360852 26454 tablet_bootstrap.cc:492] T 100ec9c805b34858a7d277fb8ffceeb2 P fd56f18d738e4a3f8e002e19cce4b1fb: Bootstrap starting.
I20260709 12:15:35.361315 26455 raft_consensus.cc:359] T 2a2310bd6ad2414c9524a4b5202f679d P 286cfbdee3fa44e59a9bae25828a22aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "286cfbdee3fa44e59a9bae25828a22aa" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 46621 } } peers { permanent_uuid: "5d897b683da9447982512d4a1bc25576" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 42829 } } peers { permanent_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34861 } }
I20260709 12:15:35.362196 26455 raft_consensus.cc:385] T 2a2310bd6ad2414c9524a4b5202f679d P 286cfbdee3fa44e59a9bae25828a22aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:35.362485 26455 raft_consensus.cc:740] T 2a2310bd6ad2414c9524a4b5202f679d P 286cfbdee3fa44e59a9bae25828a22aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 286cfbdee3fa44e59a9bae25828a22aa, State: Initialized, Role: FOLLOWER
I20260709 12:15:35.363468 26455 consensus_queue.cc:260] T 2a2310bd6ad2414c9524a4b5202f679d P 286cfbdee3fa44e59a9bae25828a22aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "286cfbdee3fa44e59a9bae25828a22aa" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 46621 } } peers { permanent_uuid: "5d897b683da9447982512d4a1bc25576" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 42829 } } peers { permanent_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34861 } }
I20260709 12:15:35.367722 26456 ts_tablet_manager.cc:1434] T 2a2310bd6ad2414c9524a4b5202f679d P 5d897b683da9447982512d4a1bc25576: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.004s
I20260709 12:15:35.368762 26365 heartbeater.cc:499] Master 127.12.56.254:44803 was elected leader, sending a full tablet report...
I20260709 12:15:35.370119 26454 tablet_bootstrap.cc:654] T 100ec9c805b34858a7d277fb8ffceeb2 P fd56f18d738e4a3f8e002e19cce4b1fb: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:35.372049 26456 tablet_bootstrap.cc:492] T 100ec9c805b34858a7d277fb8ffceeb2 P 5d897b683da9447982512d4a1bc25576: Bootstrap starting.
I20260709 12:15:35.382313 26456 tablet_bootstrap.cc:654] T 100ec9c805b34858a7d277fb8ffceeb2 P 5d897b683da9447982512d4a1bc25576: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:35.382896 26290 heartbeater.cc:499] Master 127.12.56.254:44803 was elected leader, sending a full tablet report...
I20260709 12:15:35.384624 26455 ts_tablet_manager.cc:1434] T 2a2310bd6ad2414c9524a4b5202f679d P 286cfbdee3fa44e59a9bae25828a22aa: Time spent starting tablet: real 0.026s	user 0.018s	sys 0.003s
I20260709 12:15:35.386518 26455 tablet_bootstrap.cc:492] T 100ec9c805b34858a7d277fb8ffceeb2 P 286cfbdee3fa44e59a9bae25828a22aa: Bootstrap starting.
I20260709 12:15:35.397591 26455 tablet_bootstrap.cc:654] T 100ec9c805b34858a7d277fb8ffceeb2 P 286cfbdee3fa44e59a9bae25828a22aa: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:35.415378 26456 tablet_bootstrap.cc:492] T 100ec9c805b34858a7d277fb8ffceeb2 P 5d897b683da9447982512d4a1bc25576: No bootstrap required, opened a new log
I20260709 12:15:35.415987 26456 ts_tablet_manager.cc:1403] T 100ec9c805b34858a7d277fb8ffceeb2 P 5d897b683da9447982512d4a1bc25576: Time spent bootstrapping tablet: real 0.044s	user 0.018s	sys 0.019s
I20260709 12:15:35.415987 26454 tablet_bootstrap.cc:492] T 100ec9c805b34858a7d277fb8ffceeb2 P fd56f18d738e4a3f8e002e19cce4b1fb: No bootstrap required, opened a new log
I20260709 12:15:35.416728 26454 ts_tablet_manager.cc:1403] T 100ec9c805b34858a7d277fb8ffceeb2 P fd56f18d738e4a3f8e002e19cce4b1fb: Time spent bootstrapping tablet: real 0.056s	user 0.020s	sys 0.031s
I20260709 12:15:35.417003 26455 tablet_bootstrap.cc:492] T 100ec9c805b34858a7d277fb8ffceeb2 P 286cfbdee3fa44e59a9bae25828a22aa: No bootstrap required, opened a new log
I20260709 12:15:35.417567 26455 ts_tablet_manager.cc:1403] T 100ec9c805b34858a7d277fb8ffceeb2 P 286cfbdee3fa44e59a9bae25828a22aa: Time spent bootstrapping tablet: real 0.031s	user 0.018s	sys 0.003s
I20260709 12:15:35.419759 26454 raft_consensus.cc:359] T 100ec9c805b34858a7d277fb8ffceeb2 P fd56f18d738e4a3f8e002e19cce4b1fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34861 } } peers { permanent_uuid: "286cfbdee3fa44e59a9bae25828a22aa" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 46621 } } peers { permanent_uuid: "5d897b683da9447982512d4a1bc25576" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 42829 } }
I20260709 12:15:35.419590 26456 raft_consensus.cc:359] T 100ec9c805b34858a7d277fb8ffceeb2 P 5d897b683da9447982512d4a1bc25576 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34861 } } peers { permanent_uuid: "286cfbdee3fa44e59a9bae25828a22aa" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 46621 } } peers { permanent_uuid: "5d897b683da9447982512d4a1bc25576" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 42829 } }
I20260709 12:15:35.419993 26455 raft_consensus.cc:359] T 100ec9c805b34858a7d277fb8ffceeb2 P 286cfbdee3fa44e59a9bae25828a22aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34861 } } peers { permanent_uuid: "286cfbdee3fa44e59a9bae25828a22aa" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 46621 } } peers { permanent_uuid: "5d897b683da9447982512d4a1bc25576" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 42829 } }
I20260709 12:15:35.420617 26454 raft_consensus.cc:385] T 100ec9c805b34858a7d277fb8ffceeb2 P fd56f18d738e4a3f8e002e19cce4b1fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:35.420717 26456 raft_consensus.cc:385] T 100ec9c805b34858a7d277fb8ffceeb2 P 5d897b683da9447982512d4a1bc25576 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:35.420850 26455 raft_consensus.cc:385] T 100ec9c805b34858a7d277fb8ffceeb2 P 286cfbdee3fa44e59a9bae25828a22aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:35.421053 26454 raft_consensus.cc:740] T 100ec9c805b34858a7d277fb8ffceeb2 P fd56f18d738e4a3f8e002e19cce4b1fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd56f18d738e4a3f8e002e19cce4b1fb, State: Initialized, Role: FOLLOWER
I20260709 12:15:35.421186 26456 raft_consensus.cc:740] T 100ec9c805b34858a7d277fb8ffceeb2 P 5d897b683da9447982512d4a1bc25576 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d897b683da9447982512d4a1bc25576, State: Initialized, Role: FOLLOWER
I20260709 12:15:35.421427 26455 raft_consensus.cc:740] T 100ec9c805b34858a7d277fb8ffceeb2 P 286cfbdee3fa44e59a9bae25828a22aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 286cfbdee3fa44e59a9bae25828a22aa, State: Initialized, Role: FOLLOWER
I20260709 12:15:35.422253 26454 consensus_queue.cc:260] T 100ec9c805b34858a7d277fb8ffceeb2 P fd56f18d738e4a3f8e002e19cce4b1fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34861 } } peers { permanent_uuid: "286cfbdee3fa44e59a9bae25828a22aa" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 46621 } } peers { permanent_uuid: "5d897b683da9447982512d4a1bc25576" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 42829 } }
I20260709 12:15:35.422344 26456 consensus_queue.cc:260] T 100ec9c805b34858a7d277fb8ffceeb2 P 5d897b683da9447982512d4a1bc25576 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34861 } } peers { permanent_uuid: "286cfbdee3fa44e59a9bae25828a22aa" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 46621 } } peers { permanent_uuid: "5d897b683da9447982512d4a1bc25576" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 42829 } }
I20260709 12:15:35.422431 26455 consensus_queue.cc:260] T 100ec9c805b34858a7d277fb8ffceeb2 P 286cfbdee3fa44e59a9bae25828a22aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34861 } } peers { permanent_uuid: "286cfbdee3fa44e59a9bae25828a22aa" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 46621 } } peers { permanent_uuid: "5d897b683da9447982512d4a1bc25576" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 42829 } }
I20260709 12:15:35.424573 26454 ts_tablet_manager.cc:1434] T 100ec9c805b34858a7d277fb8ffceeb2 P fd56f18d738e4a3f8e002e19cce4b1fb: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:15:35.424573 26456 ts_tablet_manager.cc:1434] T 100ec9c805b34858a7d277fb8ffceeb2 P 5d897b683da9447982512d4a1bc25576: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:15:35.424800 26455 ts_tablet_manager.cc:1434] T 100ec9c805b34858a7d277fb8ffceeb2 P 286cfbdee3fa44e59a9bae25828a22aa: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:15:35.563606 26462 raft_consensus.cc:493] T 100ec9c805b34858a7d277fb8ffceeb2 P 286cfbdee3fa44e59a9bae25828a22aa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:35.564406 26462 raft_consensus.cc:515] T 100ec9c805b34858a7d277fb8ffceeb2 P 286cfbdee3fa44e59a9bae25828a22aa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34861 } } peers { permanent_uuid: "286cfbdee3fa44e59a9bae25828a22aa" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 46621 } } peers { permanent_uuid: "5d897b683da9447982512d4a1bc25576" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 42829 } }
I20260709 12:15:35.566612 26462 leader_election.cc:290] T 100ec9c805b34858a7d277fb8ffceeb2 P 286cfbdee3fa44e59a9bae25828a22aa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd56f18d738e4a3f8e002e19cce4b1fb (127.12.56.195:34861), 5d897b683da9447982512d4a1bc25576 (127.12.56.194:42829)
I20260709 12:15:35.579339 26414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "100ec9c805b34858a7d277fb8ffceeb2" candidate_uuid: "286cfbdee3fa44e59a9bae25828a22aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" is_pre_election: true
I20260709 12:15:35.579891 26340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "100ec9c805b34858a7d277fb8ffceeb2" candidate_uuid: "286cfbdee3fa44e59a9bae25828a22aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d897b683da9447982512d4a1bc25576" is_pre_election: true
I20260709 12:15:35.580116 26414 raft_consensus.cc:2468] T 100ec9c805b34858a7d277fb8ffceeb2 P fd56f18d738e4a3f8e002e19cce4b1fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 286cfbdee3fa44e59a9bae25828a22aa in term 0.
I20260709 12:15:35.580587 26340 raft_consensus.cc:2468] T 100ec9c805b34858a7d277fb8ffceeb2 P 5d897b683da9447982512d4a1bc25576 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 286cfbdee3fa44e59a9bae25828a22aa in term 0.
I20260709 12:15:35.581739 26228 leader_election.cc:304] T 100ec9c805b34858a7d277fb8ffceeb2 P 286cfbdee3fa44e59a9bae25828a22aa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 286cfbdee3fa44e59a9bae25828a22aa, fd56f18d738e4a3f8e002e19cce4b1fb; no voters: 
I20260709 12:15:35.582716 26462 raft_consensus.cc:2804] T 100ec9c805b34858a7d277fb8ffceeb2 P 286cfbdee3fa44e59a9bae25828a22aa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:35.583057 26462 raft_consensus.cc:493] T 100ec9c805b34858a7d277fb8ffceeb2 P 286cfbdee3fa44e59a9bae25828a22aa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:35.583302 26462 raft_consensus.cc:3060] T 100ec9c805b34858a7d277fb8ffceeb2 P 286cfbdee3fa44e59a9bae25828a22aa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:35.589329 26462 raft_consensus.cc:515] T 100ec9c805b34858a7d277fb8ffceeb2 P 286cfbdee3fa44e59a9bae25828a22aa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34861 } } peers { permanent_uuid: "286cfbdee3fa44e59a9bae25828a22aa" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 46621 } } peers { permanent_uuid: "5d897b683da9447982512d4a1bc25576" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 42829 } }
I20260709 12:15:35.591248 26462 leader_election.cc:290] T 100ec9c805b34858a7d277fb8ffceeb2 P 286cfbdee3fa44e59a9bae25828a22aa [CANDIDATE]: Term 1 election: Requested vote from peers fd56f18d738e4a3f8e002e19cce4b1fb (127.12.56.195:34861), 5d897b683da9447982512d4a1bc25576 (127.12.56.194:42829)
I20260709 12:15:35.592182 26414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "100ec9c805b34858a7d277fb8ffceeb2" candidate_uuid: "286cfbdee3fa44e59a9bae25828a22aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb"
I20260709 12:15:35.592325 26340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "100ec9c805b34858a7d277fb8ffceeb2" candidate_uuid: "286cfbdee3fa44e59a9bae25828a22aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d897b683da9447982512d4a1bc25576"
I20260709 12:15:35.592764 26414 raft_consensus.cc:3060] T 100ec9c805b34858a7d277fb8ffceeb2 P fd56f18d738e4a3f8e002e19cce4b1fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:35.592978 26340 raft_consensus.cc:3060] T 100ec9c805b34858a7d277fb8ffceeb2 P 5d897b683da9447982512d4a1bc25576 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:35.598888 26414 raft_consensus.cc:2468] T 100ec9c805b34858a7d277fb8ffceeb2 P fd56f18d738e4a3f8e002e19cce4b1fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 286cfbdee3fa44e59a9bae25828a22aa in term 1.
I20260709 12:15:35.598888 26340 raft_consensus.cc:2468] T 100ec9c805b34858a7d277fb8ffceeb2 P 5d897b683da9447982512d4a1bc25576 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 286cfbdee3fa44e59a9bae25828a22aa in term 1.
I20260709 12:15:35.600208 26228 leader_election.cc:304] T 100ec9c805b34858a7d277fb8ffceeb2 P 286cfbdee3fa44e59a9bae25828a22aa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 286cfbdee3fa44e59a9bae25828a22aa, fd56f18d738e4a3f8e002e19cce4b1fb; no voters: 
I20260709 12:15:35.600999 26462 raft_consensus.cc:2804] T 100ec9c805b34858a7d277fb8ffceeb2 P 286cfbdee3fa44e59a9bae25828a22aa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:35.601981 26462 raft_consensus.cc:697] T 100ec9c805b34858a7d277fb8ffceeb2 P 286cfbdee3fa44e59a9bae25828a22aa [term 1 LEADER]: Becoming Leader. State: Replica: 286cfbdee3fa44e59a9bae25828a22aa, State: Running, Role: LEADER
I20260709 12:15:35.602691 26462 consensus_queue.cc:237] T 100ec9c805b34858a7d277fb8ffceeb2 P 286cfbdee3fa44e59a9bae25828a22aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34861 } } peers { permanent_uuid: "286cfbdee3fa44e59a9bae25828a22aa" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 46621 } } peers { permanent_uuid: "5d897b683da9447982512d4a1bc25576" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 42829 } }
I20260709 12:15:35.603186 26468 raft_consensus.cc:493] T 2a2310bd6ad2414c9524a4b5202f679d P 286cfbdee3fa44e59a9bae25828a22aa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:35.603744 26468 raft_consensus.cc:515] T 2a2310bd6ad2414c9524a4b5202f679d P 286cfbdee3fa44e59a9bae25828a22aa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "286cfbdee3fa44e59a9bae25828a22aa" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 46621 } } peers { permanent_uuid: "5d897b683da9447982512d4a1bc25576" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 42829 } } peers { permanent_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34861 } }
I20260709 12:15:35.606629 26468 leader_election.cc:290] T 2a2310bd6ad2414c9524a4b5202f679d P 286cfbdee3fa44e59a9bae25828a22aa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d897b683da9447982512d4a1bc25576 (127.12.56.194:42829), fd56f18d738e4a3f8e002e19cce4b1fb (127.12.56.195:34861)
I20260709 12:15:35.607748 26340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2310bd6ad2414c9524a4b5202f679d" candidate_uuid: "286cfbdee3fa44e59a9bae25828a22aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d897b683da9447982512d4a1bc25576" is_pre_election: true
I20260709 12:15:35.608855 26340 raft_consensus.cc:2468] T 2a2310bd6ad2414c9524a4b5202f679d P 5d897b683da9447982512d4a1bc25576 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 286cfbdee3fa44e59a9bae25828a22aa in term 0.
I20260709 12:15:35.608855 26414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2310bd6ad2414c9524a4b5202f679d" candidate_uuid: "286cfbdee3fa44e59a9bae25828a22aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" is_pre_election: true
I20260709 12:15:35.609975 26414 raft_consensus.cc:2468] T 2a2310bd6ad2414c9524a4b5202f679d P fd56f18d738e4a3f8e002e19cce4b1fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 286cfbdee3fa44e59a9bae25828a22aa in term 0.
I20260709 12:15:35.610487 26231 leader_election.cc:304] T 2a2310bd6ad2414c9524a4b5202f679d P 286cfbdee3fa44e59a9bae25828a22aa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 286cfbdee3fa44e59a9bae25828a22aa, 5d897b683da9447982512d4a1bc25576; no voters: 
I20260709 12:15:35.611498 26462 raft_consensus.cc:2804] T 2a2310bd6ad2414c9524a4b5202f679d P 286cfbdee3fa44e59a9bae25828a22aa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:35.611891 26462 raft_consensus.cc:493] T 2a2310bd6ad2414c9524a4b5202f679d P 286cfbdee3fa44e59a9bae25828a22aa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:35.612177 26462 raft_consensus.cc:3060] T 2a2310bd6ad2414c9524a4b5202f679d P 286cfbdee3fa44e59a9bae25828a22aa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:35.613385 26163 catalog_manager.cc:5697] T 100ec9c805b34858a7d277fb8ffceeb2 P 286cfbdee3fa44e59a9bae25828a22aa reported cstate change: term changed from 0 to 1, leader changed from <none> to 286cfbdee3fa44e59a9bae25828a22aa (127.12.56.193). New cstate: current_term: 1 leader_uuid: "286cfbdee3fa44e59a9bae25828a22aa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34861 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "286cfbdee3fa44e59a9bae25828a22aa" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 46621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d897b683da9447982512d4a1bc25576" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 42829 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:35.618171 26462 raft_consensus.cc:515] T 2a2310bd6ad2414c9524a4b5202f679d P 286cfbdee3fa44e59a9bae25828a22aa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "286cfbdee3fa44e59a9bae25828a22aa" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 46621 } } peers { permanent_uuid: "5d897b683da9447982512d4a1bc25576" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 42829 } } peers { permanent_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34861 } }
I20260709 12:15:35.620677 26462 leader_election.cc:290] T 2a2310bd6ad2414c9524a4b5202f679d P 286cfbdee3fa44e59a9bae25828a22aa [CANDIDATE]: Term 1 election: Requested vote from peers 5d897b683da9447982512d4a1bc25576 (127.12.56.194:42829), fd56f18d738e4a3f8e002e19cce4b1fb (127.12.56.195:34861)
I20260709 12:15:35.621146 26340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2310bd6ad2414c9524a4b5202f679d" candidate_uuid: "286cfbdee3fa44e59a9bae25828a22aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d897b683da9447982512d4a1bc25576"
I20260709 12:15:35.621413 26414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2310bd6ad2414c9524a4b5202f679d" candidate_uuid: "286cfbdee3fa44e59a9bae25828a22aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb"
I20260709 12:15:35.621711 26340 raft_consensus.cc:3060] T 2a2310bd6ad2414c9524a4b5202f679d P 5d897b683da9447982512d4a1bc25576 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:35.622187 26414 raft_consensus.cc:3060] T 2a2310bd6ad2414c9524a4b5202f679d P fd56f18d738e4a3f8e002e19cce4b1fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:35.628379 26340 raft_consensus.cc:2468] T 2a2310bd6ad2414c9524a4b5202f679d P 5d897b683da9447982512d4a1bc25576 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 286cfbdee3fa44e59a9bae25828a22aa in term 1.
I20260709 12:15:35.629407 26414 raft_consensus.cc:2468] T 2a2310bd6ad2414c9524a4b5202f679d P fd56f18d738e4a3f8e002e19cce4b1fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 286cfbdee3fa44e59a9bae25828a22aa in term 1.
I20260709 12:15:35.629702 26231 leader_election.cc:304] T 2a2310bd6ad2414c9524a4b5202f679d P 286cfbdee3fa44e59a9bae25828a22aa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 286cfbdee3fa44e59a9bae25828a22aa, 5d897b683da9447982512d4a1bc25576; no voters: 
I20260709 12:15:35.630864 26462 raft_consensus.cc:2804] T 2a2310bd6ad2414c9524a4b5202f679d P 286cfbdee3fa44e59a9bae25828a22aa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:35.631433 26462 raft_consensus.cc:697] T 2a2310bd6ad2414c9524a4b5202f679d P 286cfbdee3fa44e59a9bae25828a22aa [term 1 LEADER]: Becoming Leader. State: Replica: 286cfbdee3fa44e59a9bae25828a22aa, State: Running, Role: LEADER
I20260709 12:15:35.632225 26462 consensus_queue.cc:237] T 2a2310bd6ad2414c9524a4b5202f679d P 286cfbdee3fa44e59a9bae25828a22aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "286cfbdee3fa44e59a9bae25828a22aa" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 46621 } } peers { permanent_uuid: "5d897b683da9447982512d4a1bc25576" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 42829 } } peers { permanent_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34861 } }
I20260709 12:15:35.639787 26163 catalog_manager.cc:5697] T 2a2310bd6ad2414c9524a4b5202f679d P 286cfbdee3fa44e59a9bae25828a22aa reported cstate change: term changed from 0 to 1, leader changed from <none> to 286cfbdee3fa44e59a9bae25828a22aa (127.12.56.193). New cstate: current_term: 1 leader_uuid: "286cfbdee3fa44e59a9bae25828a22aa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "286cfbdee3fa44e59a9bae25828a22aa" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 46621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d897b683da9447982512d4a1bc25576" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 42829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34861 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:35.683173 26163 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51468:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:15:35.685318 26163 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:15:35.711683 26254 tablet_service.cc:1511] Processing CreateTablet for tablet 45605ca20b4b4d3b85ff9a41139ca81e (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=c7386b521b154478938dc4f24aa76074]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:15:35.713068 26254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45605ca20b4b4d3b85ff9a41139ca81e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:35.713142 26330 tablet_service.cc:1511] Processing CreateTablet for tablet 45605ca20b4b4d3b85ff9a41139ca81e (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=c7386b521b154478938dc4f24aa76074]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:15:35.714813 26330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45605ca20b4b4d3b85ff9a41139ca81e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:35.714798 26404 tablet_service.cc:1511] Processing CreateTablet for tablet 45605ca20b4b4d3b85ff9a41139ca81e (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=c7386b521b154478938dc4f24aa76074]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:15:35.716224 26404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45605ca20b4b4d3b85ff9a41139ca81e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:35.718744 26329 tablet_service.cc:1511] Processing CreateTablet for tablet d6718d60aa6849c1af1fa5996fcbc350 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=c7386b521b154478938dc4f24aa76074]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:15:35.720350 26329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6718d60aa6849c1af1fa5996fcbc350. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:35.720664 26403 tablet_service.cc:1511] Processing CreateTablet for tablet d6718d60aa6849c1af1fa5996fcbc350 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=c7386b521b154478938dc4f24aa76074]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:15:35.722163 26403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6718d60aa6849c1af1fa5996fcbc350. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:35.727967 26255 tablet_service.cc:1511] Processing CreateTablet for tablet d6718d60aa6849c1af1fa5996fcbc350 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=c7386b521b154478938dc4f24aa76074]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:15:35.729462 26255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6718d60aa6849c1af1fa5996fcbc350. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:35.734328 26454 tablet_bootstrap.cc:492] T 45605ca20b4b4d3b85ff9a41139ca81e P fd56f18d738e4a3f8e002e19cce4b1fb: Bootstrap starting.
I20260709 12:15:35.740211 26456 tablet_bootstrap.cc:492] T d6718d60aa6849c1af1fa5996fcbc350 P 5d897b683da9447982512d4a1bc25576: Bootstrap starting.
I20260709 12:15:35.741407 26454 tablet_bootstrap.cc:654] T 45605ca20b4b4d3b85ff9a41139ca81e P fd56f18d738e4a3f8e002e19cce4b1fb: Neither blocks nor log segments found. Creating new log.
W20260709 12:15:35.747520 26211 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:35.751044 26456 tablet_bootstrap.cc:654] T d6718d60aa6849c1af1fa5996fcbc350 P 5d897b683da9447982512d4a1bc25576: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:35.752425 26455 tablet_bootstrap.cc:492] T 45605ca20b4b4d3b85ff9a41139ca81e P 286cfbdee3fa44e59a9bae25828a22aa: Bootstrap starting.
I20260709 12:15:35.761003 26455 tablet_bootstrap.cc:654] T 45605ca20b4b4d3b85ff9a41139ca81e P 286cfbdee3fa44e59a9bae25828a22aa: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:35.761654 26454 tablet_bootstrap.cc:492] T 45605ca20b4b4d3b85ff9a41139ca81e P fd56f18d738e4a3f8e002e19cce4b1fb: No bootstrap required, opened a new log
I20260709 12:15:35.762409 26454 ts_tablet_manager.cc:1403] T 45605ca20b4b4d3b85ff9a41139ca81e P fd56f18d738e4a3f8e002e19cce4b1fb: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.002s
I20260709 12:15:35.766116 26454 raft_consensus.cc:359] T 45605ca20b4b4d3b85ff9a41139ca81e P fd56f18d738e4a3f8e002e19cce4b1fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "286cfbdee3fa44e59a9bae25828a22aa" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 46621 } } peers { permanent_uuid: "5d897b683da9447982512d4a1bc25576" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 42829 } } peers { permanent_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34861 } }
I20260709 12:15:35.770763 26454 raft_consensus.cc:385] T 45605ca20b4b4d3b85ff9a41139ca81e P fd56f18d738e4a3f8e002e19cce4b1fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:35.771148 26454 raft_consensus.cc:740] T 45605ca20b4b4d3b85ff9a41139ca81e P fd56f18d738e4a3f8e002e19cce4b1fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd56f18d738e4a3f8e002e19cce4b1fb, State: Initialized, Role: FOLLOWER
I20260709 12:15:35.773176 26454 consensus_queue.cc:260] T 45605ca20b4b4d3b85ff9a41139ca81e P fd56f18d738e4a3f8e002e19cce4b1fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "286cfbdee3fa44e59a9bae25828a22aa" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 46621 } } peers { permanent_uuid: "5d897b683da9447982512d4a1bc25576" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 42829 } } peers { permanent_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34861 } }
I20260709 12:15:35.775147 26454 ts_tablet_manager.cc:1434] T 45605ca20b4b4d3b85ff9a41139ca81e P fd56f18d738e4a3f8e002e19cce4b1fb: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.003s
I20260709 12:15:35.776428 26456 tablet_bootstrap.cc:492] T d6718d60aa6849c1af1fa5996fcbc350 P 5d897b683da9447982512d4a1bc25576: No bootstrap required, opened a new log
I20260709 12:15:35.776391 26454 tablet_bootstrap.cc:492] T d6718d60aa6849c1af1fa5996fcbc350 P fd56f18d738e4a3f8e002e19cce4b1fb: Bootstrap starting.
I20260709 12:15:35.777236 26456 ts_tablet_manager.cc:1403] T d6718d60aa6849c1af1fa5996fcbc350 P 5d897b683da9447982512d4a1bc25576: Time spent bootstrapping tablet: real 0.037s	user 0.017s	sys 0.002s
I20260709 12:15:35.780797 26456 raft_consensus.cc:359] T d6718d60aa6849c1af1fa5996fcbc350 P 5d897b683da9447982512d4a1bc25576 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "286cfbdee3fa44e59a9bae25828a22aa" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 46621 } } peers { permanent_uuid: "5d897b683da9447982512d4a1bc25576" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 42829 } } peers { permanent_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34861 } }
I20260709 12:15:35.781687 26456 raft_consensus.cc:385] T d6718d60aa6849c1af1fa5996fcbc350 P 5d897b683da9447982512d4a1bc25576 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:35.783418 26456 raft_consensus.cc:740] T d6718d60aa6849c1af1fa5996fcbc350 P 5d897b683da9447982512d4a1bc25576 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d897b683da9447982512d4a1bc25576, State: Initialized, Role: FOLLOWER
I20260709 12:15:35.783725 26455 tablet_bootstrap.cc:492] T 45605ca20b4b4d3b85ff9a41139ca81e P 286cfbdee3fa44e59a9bae25828a22aa: No bootstrap required, opened a new log
I20260709 12:15:35.784430 26455 ts_tablet_manager.cc:1403] T 45605ca20b4b4d3b85ff9a41139ca81e P 286cfbdee3fa44e59a9bae25828a22aa: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.009s
I20260709 12:15:35.784523 26454 tablet_bootstrap.cc:654] T d6718d60aa6849c1af1fa5996fcbc350 P fd56f18d738e4a3f8e002e19cce4b1fb: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:35.784431 26456 consensus_queue.cc:260] T d6718d60aa6849c1af1fa5996fcbc350 P 5d897b683da9447982512d4a1bc25576 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "286cfbdee3fa44e59a9bae25828a22aa" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 46621 } } peers { permanent_uuid: "5d897b683da9447982512d4a1bc25576" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 42829 } } peers { permanent_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34861 } }
I20260709 12:15:35.788393 26455 raft_consensus.cc:359] T 45605ca20b4b4d3b85ff9a41139ca81e P 286cfbdee3fa44e59a9bae25828a22aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "286cfbdee3fa44e59a9bae25828a22aa" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 46621 } } peers { permanent_uuid: "5d897b683da9447982512d4a1bc25576" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 42829 } } peers { permanent_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34861 } }
I20260709 12:15:35.789659 26455 raft_consensus.cc:385] T 45605ca20b4b4d3b85ff9a41139ca81e P 286cfbdee3fa44e59a9bae25828a22aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:35.790194 26455 raft_consensus.cc:740] T 45605ca20b4b4d3b85ff9a41139ca81e P 286cfbdee3fa44e59a9bae25828a22aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 286cfbdee3fa44e59a9bae25828a22aa, State: Initialized, Role: FOLLOWER
I20260709 12:15:35.791872 26456 ts_tablet_manager.cc:1434] T d6718d60aa6849c1af1fa5996fcbc350 P 5d897b683da9447982512d4a1bc25576: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.006s
I20260709 12:15:35.791659 26455 consensus_queue.cc:260] T 45605ca20b4b4d3b85ff9a41139ca81e P 286cfbdee3fa44e59a9bae25828a22aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "286cfbdee3fa44e59a9bae25828a22aa" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 46621 } } peers { permanent_uuid: "5d897b683da9447982512d4a1bc25576" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 42829 } } peers { permanent_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34861 } }
I20260709 12:15:35.793360 26456 tablet_bootstrap.cc:492] T 45605ca20b4b4d3b85ff9a41139ca81e P 5d897b683da9447982512d4a1bc25576: Bootstrap starting.
I20260709 12:15:35.804896 26456 tablet_bootstrap.cc:654] T 45605ca20b4b4d3b85ff9a41139ca81e P 5d897b683da9447982512d4a1bc25576: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:35.807271 26455 ts_tablet_manager.cc:1434] T 45605ca20b4b4d3b85ff9a41139ca81e P 286cfbdee3fa44e59a9bae25828a22aa: Time spent starting tablet: real 0.022s	user 0.010s	sys 0.000s
I20260709 12:15:35.810617 26455 tablet_bootstrap.cc:492] T d6718d60aa6849c1af1fa5996fcbc350 P 286cfbdee3fa44e59a9bae25828a22aa: Bootstrap starting.
I20260709 12:15:35.811053 26456 tablet_bootstrap.cc:492] T 45605ca20b4b4d3b85ff9a41139ca81e P 5d897b683da9447982512d4a1bc25576: No bootstrap required, opened a new log
I20260709 12:15:35.812565 26456 ts_tablet_manager.cc:1403] T 45605ca20b4b4d3b85ff9a41139ca81e P 5d897b683da9447982512d4a1bc25576: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.000s
I20260709 12:15:35.813736 26454 tablet_bootstrap.cc:492] T d6718d60aa6849c1af1fa5996fcbc350 P fd56f18d738e4a3f8e002e19cce4b1fb: No bootstrap required, opened a new log
I20260709 12:15:35.814484 26454 ts_tablet_manager.cc:1403] T d6718d60aa6849c1af1fa5996fcbc350 P fd56f18d738e4a3f8e002e19cce4b1fb: Time spent bootstrapping tablet: real 0.038s	user 0.029s	sys 0.007s
I20260709 12:15:35.817137 26456 raft_consensus.cc:359] T 45605ca20b4b4d3b85ff9a41139ca81e P 5d897b683da9447982512d4a1bc25576 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "286cfbdee3fa44e59a9bae25828a22aa" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 46621 } } peers { permanent_uuid: "5d897b683da9447982512d4a1bc25576" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 42829 } } peers { permanent_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34861 } }
I20260709 12:15:35.818153 26456 raft_consensus.cc:385] T 45605ca20b4b4d3b85ff9a41139ca81e P 5d897b683da9447982512d4a1bc25576 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:35.818598 26456 raft_consensus.cc:740] T 45605ca20b4b4d3b85ff9a41139ca81e P 5d897b683da9447982512d4a1bc25576 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d897b683da9447982512d4a1bc25576, State: Initialized, Role: FOLLOWER
I20260709 12:15:35.818348 26454 raft_consensus.cc:359] T d6718d60aa6849c1af1fa5996fcbc350 P fd56f18d738e4a3f8e002e19cce4b1fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "286cfbdee3fa44e59a9bae25828a22aa" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 46621 } } peers { permanent_uuid: "5d897b683da9447982512d4a1bc25576" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 42829 } } peers { permanent_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34861 } }
I20260709 12:15:35.819528 26454 raft_consensus.cc:385] T d6718d60aa6849c1af1fa5996fcbc350 P fd56f18d738e4a3f8e002e19cce4b1fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:35.819934 26454 raft_consensus.cc:740] T d6718d60aa6849c1af1fa5996fcbc350 P fd56f18d738e4a3f8e002e19cce4b1fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd56f18d738e4a3f8e002e19cce4b1fb, State: Initialized, Role: FOLLOWER
I20260709 12:15:35.819644 26456 consensus_queue.cc:260] T 45605ca20b4b4d3b85ff9a41139ca81e P 5d897b683da9447982512d4a1bc25576 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "286cfbdee3fa44e59a9bae25828a22aa" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 46621 } } peers { permanent_uuid: "5d897b683da9447982512d4a1bc25576" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 42829 } } peers { permanent_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34861 } }
I20260709 12:15:35.820988 26454 consensus_queue.cc:260] T d6718d60aa6849c1af1fa5996fcbc350 P fd56f18d738e4a3f8e002e19cce4b1fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "286cfbdee3fa44e59a9bae25828a22aa" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 46621 } } peers { permanent_uuid: "5d897b683da9447982512d4a1bc25576" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 42829 } } peers { permanent_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34861 } }
I20260709 12:15:35.822834 26456 ts_tablet_manager.cc:1434] T 45605ca20b4b4d3b85ff9a41139ca81e P 5d897b683da9447982512d4a1bc25576: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:15:35.824091 26454 ts_tablet_manager.cc:1434] T d6718d60aa6849c1af1fa5996fcbc350 P fd56f18d738e4a3f8e002e19cce4b1fb: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 12:15:35.824643 26455 tablet_bootstrap.cc:654] T d6718d60aa6849c1af1fa5996fcbc350 P 286cfbdee3fa44e59a9bae25828a22aa: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:35.825668 26462 raft_consensus.cc:493] T 45605ca20b4b4d3b85ff9a41139ca81e P 286cfbdee3fa44e59a9bae25828a22aa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:35.826315 26462 raft_consensus.cc:515] T 45605ca20b4b4d3b85ff9a41139ca81e P 286cfbdee3fa44e59a9bae25828a22aa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "286cfbdee3fa44e59a9bae25828a22aa" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 46621 } } peers { permanent_uuid: "5d897b683da9447982512d4a1bc25576" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 42829 } } peers { permanent_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34861 } }
I20260709 12:15:35.828989 26462 leader_election.cc:290] T 45605ca20b4b4d3b85ff9a41139ca81e P 286cfbdee3fa44e59a9bae25828a22aa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d897b683da9447982512d4a1bc25576 (127.12.56.194:42829), fd56f18d738e4a3f8e002e19cce4b1fb (127.12.56.195:34861)
I20260709 12:15:35.830300 26414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45605ca20b4b4d3b85ff9a41139ca81e" candidate_uuid: "286cfbdee3fa44e59a9bae25828a22aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" is_pre_election: true
I20260709 12:15:35.831254 26455 tablet_bootstrap.cc:492] T d6718d60aa6849c1af1fa5996fcbc350 P 286cfbdee3fa44e59a9bae25828a22aa: No bootstrap required, opened a new log
I20260709 12:15:35.831825 26455 ts_tablet_manager.cc:1403] T d6718d60aa6849c1af1fa5996fcbc350 P 286cfbdee3fa44e59a9bae25828a22aa: Time spent bootstrapping tablet: real 0.021s	user 0.006s	sys 0.007s
I20260709 12:15:35.832801 26340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45605ca20b4b4d3b85ff9a41139ca81e" candidate_uuid: "286cfbdee3fa44e59a9bae25828a22aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d897b683da9447982512d4a1bc25576" is_pre_election: true
I20260709 12:15:35.833557 26340 raft_consensus.cc:2468] T 45605ca20b4b4d3b85ff9a41139ca81e P 5d897b683da9447982512d4a1bc25576 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 286cfbdee3fa44e59a9bae25828a22aa in term 0.
I20260709 12:15:35.835582 26231 leader_election.cc:304] T 45605ca20b4b4d3b85ff9a41139ca81e P 286cfbdee3fa44e59a9bae25828a22aa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 286cfbdee3fa44e59a9bae25828a22aa, 5d897b683da9447982512d4a1bc25576; no voters: 
I20260709 12:15:35.835448 26455 raft_consensus.cc:359] T d6718d60aa6849c1af1fa5996fcbc350 P 286cfbdee3fa44e59a9bae25828a22aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "286cfbdee3fa44e59a9bae25828a22aa" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 46621 } } peers { permanent_uuid: "5d897b683da9447982512d4a1bc25576" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 42829 } } peers { permanent_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34861 } }
I20260709 12:15:35.831143 26414 raft_consensus.cc:2468] T 45605ca20b4b4d3b85ff9a41139ca81e P fd56f18d738e4a3f8e002e19cce4b1fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 286cfbdee3fa44e59a9bae25828a22aa in term 0.
I20260709 12:15:35.836444 26455 raft_consensus.cc:385] T d6718d60aa6849c1af1fa5996fcbc350 P 286cfbdee3fa44e59a9bae25828a22aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:35.836845 26468 raft_consensus.cc:2804] T 45605ca20b4b4d3b85ff9a41139ca81e P 286cfbdee3fa44e59a9bae25828a22aa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:35.836937 26455 raft_consensus.cc:740] T d6718d60aa6849c1af1fa5996fcbc350 P 286cfbdee3fa44e59a9bae25828a22aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 286cfbdee3fa44e59a9bae25828a22aa, State: Initialized, Role: FOLLOWER
I20260709 12:15:35.837489 26468 raft_consensus.cc:493] T 45605ca20b4b4d3b85ff9a41139ca81e P 286cfbdee3fa44e59a9bae25828a22aa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:35.837949 26468 raft_consensus.cc:3060] T 45605ca20b4b4d3b85ff9a41139ca81e P 286cfbdee3fa44e59a9bae25828a22aa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:35.838116 26455 consensus_queue.cc:260] T d6718d60aa6849c1af1fa5996fcbc350 P 286cfbdee3fa44e59a9bae25828a22aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "286cfbdee3fa44e59a9bae25828a22aa" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 46621 } } peers { permanent_uuid: "5d897b683da9447982512d4a1bc25576" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 42829 } } peers { permanent_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34861 } }
I20260709 12:15:35.840907 26455 ts_tablet_manager.cc:1434] T d6718d60aa6849c1af1fa5996fcbc350 P 286cfbdee3fa44e59a9bae25828a22aa: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.006s
I20260709 12:15:35.850462 26468 raft_consensus.cc:515] T 45605ca20b4b4d3b85ff9a41139ca81e P 286cfbdee3fa44e59a9bae25828a22aa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "286cfbdee3fa44e59a9bae25828a22aa" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 46621 } } peers { permanent_uuid: "5d897b683da9447982512d4a1bc25576" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 42829 } } peers { permanent_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34861 } }
I20260709 12:15:35.853516 26468 leader_election.cc:290] T 45605ca20b4b4d3b85ff9a41139ca81e P 286cfbdee3fa44e59a9bae25828a22aa [CANDIDATE]: Term 1 election: Requested vote from peers 5d897b683da9447982512d4a1bc25576 (127.12.56.194:42829), fd56f18d738e4a3f8e002e19cce4b1fb (127.12.56.195:34861)
I20260709 12:15:35.854969 26340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45605ca20b4b4d3b85ff9a41139ca81e" candidate_uuid: "286cfbdee3fa44e59a9bae25828a22aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d897b683da9447982512d4a1bc25576"
I20260709 12:15:35.855868 26340 raft_consensus.cc:3060] T 45605ca20b4b4d3b85ff9a41139ca81e P 5d897b683da9447982512d4a1bc25576 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:35.859196 26414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45605ca20b4b4d3b85ff9a41139ca81e" candidate_uuid: "286cfbdee3fa44e59a9bae25828a22aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb"
I20260709 12:15:35.860105 26414 raft_consensus.cc:3060] T 45605ca20b4b4d3b85ff9a41139ca81e P fd56f18d738e4a3f8e002e19cce4b1fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:35.867966 26340 raft_consensus.cc:2468] T 45605ca20b4b4d3b85ff9a41139ca81e P 5d897b683da9447982512d4a1bc25576 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 286cfbdee3fa44e59a9bae25828a22aa in term 1.
I20260709 12:15:35.867972 26414 raft_consensus.cc:2468] T 45605ca20b4b4d3b85ff9a41139ca81e P fd56f18d738e4a3f8e002e19cce4b1fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 286cfbdee3fa44e59a9bae25828a22aa in term 1.
I20260709 12:15:35.870083 26228 leader_election.cc:304] T 45605ca20b4b4d3b85ff9a41139ca81e P 286cfbdee3fa44e59a9bae25828a22aa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 286cfbdee3fa44e59a9bae25828a22aa, fd56f18d738e4a3f8e002e19cce4b1fb; no voters: 
I20260709 12:15:35.871105 26468 raft_consensus.cc:2804] T 45605ca20b4b4d3b85ff9a41139ca81e P 286cfbdee3fa44e59a9bae25828a22aa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:35.871730 26468 raft_consensus.cc:697] T 45605ca20b4b4d3b85ff9a41139ca81e P 286cfbdee3fa44e59a9bae25828a22aa [term 1 LEADER]: Becoming Leader. State: Replica: 286cfbdee3fa44e59a9bae25828a22aa, State: Running, Role: LEADER
I20260709 12:15:35.872517 26468 consensus_queue.cc:237] T 45605ca20b4b4d3b85ff9a41139ca81e P 286cfbdee3fa44e59a9bae25828a22aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "286cfbdee3fa44e59a9bae25828a22aa" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 46621 } } peers { permanent_uuid: "5d897b683da9447982512d4a1bc25576" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 42829 } } peers { permanent_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34861 } }
I20260709 12:15:35.880313 26163 catalog_manager.cc:5697] T 45605ca20b4b4d3b85ff9a41139ca81e P 286cfbdee3fa44e59a9bae25828a22aa reported cstate change: term changed from 0 to 1, leader changed from <none> to 286cfbdee3fa44e59a9bae25828a22aa (127.12.56.193). New cstate: current_term: 1 leader_uuid: "286cfbdee3fa44e59a9bae25828a22aa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "286cfbdee3fa44e59a9bae25828a22aa" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 46621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d897b683da9447982512d4a1bc25576" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 42829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34861 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:36.009997 26468 consensus_queue.cc:1048] T 100ec9c805b34858a7d277fb8ffceeb2 P 286cfbdee3fa44e59a9bae25828a22aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d897b683da9447982512d4a1bc25576" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 42829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:36.026643 26468 consensus_queue.cc:1048] T 100ec9c805b34858a7d277fb8ffceeb2 P 286cfbdee3fa44e59a9bae25828a22aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:36.084394 26461 raft_consensus.cc:493] T d6718d60aa6849c1af1fa5996fcbc350 P 5d897b683da9447982512d4a1bc25576 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:36.085021 26461 raft_consensus.cc:515] T d6718d60aa6849c1af1fa5996fcbc350 P 5d897b683da9447982512d4a1bc25576 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "286cfbdee3fa44e59a9bae25828a22aa" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 46621 } } peers { permanent_uuid: "5d897b683da9447982512d4a1bc25576" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 42829 } } peers { permanent_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34861 } }
I20260709 12:15:36.087430 26461 leader_election.cc:290] T d6718d60aa6849c1af1fa5996fcbc350 P 5d897b683da9447982512d4a1bc25576 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 286cfbdee3fa44e59a9bae25828a22aa (127.12.56.193:46621), fd56f18d738e4a3f8e002e19cce4b1fb (127.12.56.195:34861)
I20260709 12:15:36.095239 26468 consensus_queue.cc:1048] T 2a2310bd6ad2414c9524a4b5202f679d P 286cfbdee3fa44e59a9bae25828a22aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d897b683da9447982512d4a1bc25576" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 42829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:36.097666 26468 consensus_queue.cc:1048] T 2a2310bd6ad2414c9524a4b5202f679d P 286cfbdee3fa44e59a9bae25828a22aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:36.104988 26265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6718d60aa6849c1af1fa5996fcbc350" candidate_uuid: "5d897b683da9447982512d4a1bc25576" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "286cfbdee3fa44e59a9bae25828a22aa" is_pre_election: true
I20260709 12:15:36.106021 26265 raft_consensus.cc:2468] T d6718d60aa6849c1af1fa5996fcbc350 P 286cfbdee3fa44e59a9bae25828a22aa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d897b683da9447982512d4a1bc25576 in term 0.
I20260709 12:15:36.108131 26413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6718d60aa6849c1af1fa5996fcbc350" candidate_uuid: "5d897b683da9447982512d4a1bc25576" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" is_pre_election: true
I20260709 12:15:36.108942 26413 raft_consensus.cc:2468] T d6718d60aa6849c1af1fa5996fcbc350 P fd56f18d738e4a3f8e002e19cce4b1fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d897b683da9447982512d4a1bc25576 in term 0.
I20260709 12:15:36.110625 26303 leader_election.cc:304] T d6718d60aa6849c1af1fa5996fcbc350 P 5d897b683da9447982512d4a1bc25576 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d897b683da9447982512d4a1bc25576, fd56f18d738e4a3f8e002e19cce4b1fb; no voters: 
I20260709 12:15:36.115402 26461 raft_consensus.cc:2804] T d6718d60aa6849c1af1fa5996fcbc350 P 5d897b683da9447982512d4a1bc25576 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:36.115880 26461 raft_consensus.cc:493] T d6718d60aa6849c1af1fa5996fcbc350 P 5d897b683da9447982512d4a1bc25576 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:36.116262 26461 raft_consensus.cc:3060] T d6718d60aa6849c1af1fa5996fcbc350 P 5d897b683da9447982512d4a1bc25576 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:36.126713 26461 raft_consensus.cc:515] T d6718d60aa6849c1af1fa5996fcbc350 P 5d897b683da9447982512d4a1bc25576 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "286cfbdee3fa44e59a9bae25828a22aa" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 46621 } } peers { permanent_uuid: "5d897b683da9447982512d4a1bc25576" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 42829 } } peers { permanent_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34861 } }
I20260709 12:15:36.131575 26265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6718d60aa6849c1af1fa5996fcbc350" candidate_uuid: "5d897b683da9447982512d4a1bc25576" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "286cfbdee3fa44e59a9bae25828a22aa"
I20260709 12:15:36.132653 26265 raft_consensus.cc:3060] T d6718d60aa6849c1af1fa5996fcbc350 P 286cfbdee3fa44e59a9bae25828a22aa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:36.140549 26461 leader_election.cc:290] T d6718d60aa6849c1af1fa5996fcbc350 P 5d897b683da9447982512d4a1bc25576 [CANDIDATE]: Term 1 election: Requested vote from peers 286cfbdee3fa44e59a9bae25828a22aa (127.12.56.193:46621), fd56f18d738e4a3f8e002e19cce4b1fb (127.12.56.195:34861)
I20260709 12:15:36.143957 26414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6718d60aa6849c1af1fa5996fcbc350" candidate_uuid: "5d897b683da9447982512d4a1bc25576" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb"
I20260709 12:15:36.144745 26414 raft_consensus.cc:3060] T d6718d60aa6849c1af1fa5996fcbc350 P fd56f18d738e4a3f8e002e19cce4b1fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:36.145454 26265 raft_consensus.cc:2468] T d6718d60aa6849c1af1fa5996fcbc350 P 286cfbdee3fa44e59a9bae25828a22aa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d897b683da9447982512d4a1bc25576 in term 1.
I20260709 12:15:36.147840 26305 leader_election.cc:304] T d6718d60aa6849c1af1fa5996fcbc350 P 5d897b683da9447982512d4a1bc25576 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 286cfbdee3fa44e59a9bae25828a22aa, 5d897b683da9447982512d4a1bc25576; no voters: 
I20260709 12:15:36.148793 26495 raft_consensus.cc:2804] T d6718d60aa6849c1af1fa5996fcbc350 P 5d897b683da9447982512d4a1bc25576 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:36.149387 26495 raft_consensus.cc:697] T d6718d60aa6849c1af1fa5996fcbc350 P 5d897b683da9447982512d4a1bc25576 [term 1 LEADER]: Becoming Leader. State: Replica: 5d897b683da9447982512d4a1bc25576, State: Running, Role: LEADER
I20260709 12:15:36.150658 26495 consensus_queue.cc:237] T d6718d60aa6849c1af1fa5996fcbc350 P 5d897b683da9447982512d4a1bc25576 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "286cfbdee3fa44e59a9bae25828a22aa" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 46621 } } peers { permanent_uuid: "5d897b683da9447982512d4a1bc25576" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 42829 } } peers { permanent_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34861 } }
I20260709 12:15:36.153350 26414 raft_consensus.cc:2468] T d6718d60aa6849c1af1fa5996fcbc350 P fd56f18d738e4a3f8e002e19cce4b1fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d897b683da9447982512d4a1bc25576 in term 1.
I20260709 12:15:36.159885 26162 catalog_manager.cc:5697] T d6718d60aa6849c1af1fa5996fcbc350 P 5d897b683da9447982512d4a1bc25576 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d897b683da9447982512d4a1bc25576 (127.12.56.194). New cstate: current_term: 1 leader_uuid: "5d897b683da9447982512d4a1bc25576" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "286cfbdee3fa44e59a9bae25828a22aa" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 46621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d897b683da9447982512d4a1bc25576" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 42829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34861 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:36.245265 26265 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a2310bd6ad2414c9524a4b5202f679d"
dest_uuid: "286cfbdee3fa44e59a9bae25828a22aa"
mode: GRACEFUL
new_leader_uuid: "5d897b683da9447982512d4a1bc25576"
 from {username='slave'} at 127.0.0.1:45376
I20260709 12:15:36.245924 26265 raft_consensus.cc:606] T 2a2310bd6ad2414c9524a4b5202f679d P 286cfbdee3fa44e59a9bae25828a22aa [term 1 LEADER]: Received request to transfer leadership to TS 5d897b683da9447982512d4a1bc25576
I20260709 12:15:36.267426 26340 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d6718d60aa6849c1af1fa5996fcbc350"
dest_uuid: "5d897b683da9447982512d4a1bc25576"
mode: GRACEFUL
new_leader_uuid: "286cfbdee3fa44e59a9bae25828a22aa"
 from {username='slave'} at 127.0.0.1:42726
I20260709 12:15:36.268155 26340 raft_consensus.cc:606] T d6718d60aa6849c1af1fa5996fcbc350 P 5d897b683da9447982512d4a1bc25576 [term 1 LEADER]: Received request to transfer leadership to TS 286cfbdee3fa44e59a9bae25828a22aa
I20260709 12:15:36.346334 26462 consensus_queue.cc:1048] T 45605ca20b4b4d3b85ff9a41139ca81e P 286cfbdee3fa44e59a9bae25828a22aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:36.359247 26468 consensus_queue.cc:1048] T 45605ca20b4b4d3b85ff9a41139ca81e P 286cfbdee3fa44e59a9bae25828a22aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d897b683da9447982512d4a1bc25576" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 42829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:36.597491 26485 raft_consensus.cc:993] T 2a2310bd6ad2414c9524a4b5202f679d P 286cfbdee3fa44e59a9bae25828a22aa: : Instructing follower 5d897b683da9447982512d4a1bc25576 to start an election
I20260709 12:15:36.598075 26468 raft_consensus.cc:1081] T 2a2310bd6ad2414c9524a4b5202f679d P 286cfbdee3fa44e59a9bae25828a22aa [term 1 LEADER]: Signalling peer 5d897b683da9447982512d4a1bc25576 to start an election
I20260709 12:15:36.599676 26340 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2a2310bd6ad2414c9524a4b5202f679d"
dest_uuid: "5d897b683da9447982512d4a1bc25576"
 from {username='slave'} at 127.0.0.1:42724
I20260709 12:15:36.600315 26340 raft_consensus.cc:493] T 2a2310bd6ad2414c9524a4b5202f679d P 5d897b683da9447982512d4a1bc25576 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:36.600746 26340 raft_consensus.cc:3060] T 2a2310bd6ad2414c9524a4b5202f679d P 5d897b683da9447982512d4a1bc25576 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:36.606810 26340 raft_consensus.cc:515] T 2a2310bd6ad2414c9524a4b5202f679d P 5d897b683da9447982512d4a1bc25576 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "286cfbdee3fa44e59a9bae25828a22aa" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 46621 } } peers { permanent_uuid: "5d897b683da9447982512d4a1bc25576" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 42829 } } peers { permanent_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34861 } }
I20260709 12:15:36.608991 26340 leader_election.cc:290] T 2a2310bd6ad2414c9524a4b5202f679d P 5d897b683da9447982512d4a1bc25576 [CANDIDATE]: Term 2 election: Requested vote from peers 286cfbdee3fa44e59a9bae25828a22aa (127.12.56.193:46621), fd56f18d738e4a3f8e002e19cce4b1fb (127.12.56.195:34861)
I20260709 12:15:36.609812 26265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2310bd6ad2414c9524a4b5202f679d" candidate_uuid: "5d897b683da9447982512d4a1bc25576" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "286cfbdee3fa44e59a9bae25828a22aa"
I20260709 12:15:36.610131 26414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a2310bd6ad2414c9524a4b5202f679d" candidate_uuid: "5d897b683da9447982512d4a1bc25576" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb"
I20260709 12:15:36.610566 26265 raft_consensus.cc:3055] T 2a2310bd6ad2414c9524a4b5202f679d P 286cfbdee3fa44e59a9bae25828a22aa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:36.610860 26414 raft_consensus.cc:3060] T 2a2310bd6ad2414c9524a4b5202f679d P fd56f18d738e4a3f8e002e19cce4b1fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:36.611021 26265 raft_consensus.cc:740] T 2a2310bd6ad2414c9524a4b5202f679d P 286cfbdee3fa44e59a9bae25828a22aa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 286cfbdee3fa44e59a9bae25828a22aa, State: Running, Role: LEADER
I20260709 12:15:36.612012 26265 consensus_queue.cc:260] T 2a2310bd6ad2414c9524a4b5202f679d P 286cfbdee3fa44e59a9bae25828a22aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "286cfbdee3fa44e59a9bae25828a22aa" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 46621 } } peers { permanent_uuid: "5d897b683da9447982512d4a1bc25576" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 42829 } } peers { permanent_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34861 } }
I20260709 12:15:36.613135 26265 raft_consensus.cc:3060] T 2a2310bd6ad2414c9524a4b5202f679d P 286cfbdee3fa44e59a9bae25828a22aa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:36.618269 26414 raft_consensus.cc:2468] T 2a2310bd6ad2414c9524a4b5202f679d P fd56f18d738e4a3f8e002e19cce4b1fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d897b683da9447982512d4a1bc25576 in term 2.
I20260709 12:15:36.619608 26303 leader_election.cc:304] T 2a2310bd6ad2414c9524a4b5202f679d P 5d897b683da9447982512d4a1bc25576 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d897b683da9447982512d4a1bc25576, fd56f18d738e4a3f8e002e19cce4b1fb; no voters: 
I20260709 12:15:36.620388 26495 raft_consensus.cc:2804] T 2a2310bd6ad2414c9524a4b5202f679d P 5d897b683da9447982512d4a1bc25576 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:36.620858 26495 raft_consensus.cc:697] T 2a2310bd6ad2414c9524a4b5202f679d P 5d897b683da9447982512d4a1bc25576 [term 2 LEADER]: Becoming Leader. State: Replica: 5d897b683da9447982512d4a1bc25576, State: Running, Role: LEADER
I20260709 12:15:36.621714 26495 consensus_queue.cc:237] T 2a2310bd6ad2414c9524a4b5202f679d P 5d897b683da9447982512d4a1bc25576 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "286cfbdee3fa44e59a9bae25828a22aa" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 46621 } } peers { permanent_uuid: "5d897b683da9447982512d4a1bc25576" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 42829 } } peers { permanent_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34861 } }
I20260709 12:15:36.622603 26265 raft_consensus.cc:2468] T 2a2310bd6ad2414c9524a4b5202f679d P 286cfbdee3fa44e59a9bae25828a22aa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d897b683da9447982512d4a1bc25576 in term 2.
I20260709 12:15:36.627966 26163 catalog_manager.cc:5697] T 2a2310bd6ad2414c9524a4b5202f679d P 5d897b683da9447982512d4a1bc25576 reported cstate change: term changed from 1 to 2, leader changed from 286cfbdee3fa44e59a9bae25828a22aa (127.12.56.193) to 5d897b683da9447982512d4a1bc25576 (127.12.56.194). New cstate: current_term: 2 leader_uuid: "5d897b683da9447982512d4a1bc25576" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "286cfbdee3fa44e59a9bae25828a22aa" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 46621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d897b683da9447982512d4a1bc25576" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 42829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34861 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:36.689652 26495 consensus_queue.cc:1048] T d6718d60aa6849c1af1fa5996fcbc350 P 5d897b683da9447982512d4a1bc25576 [LEADER]: Connected to new peer: Peer: permanent_uuid: "286cfbdee3fa44e59a9bae25828a22aa" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 46621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:36.697366 26461 raft_consensus.cc:993] T d6718d60aa6849c1af1fa5996fcbc350 P 5d897b683da9447982512d4a1bc25576: : Instructing follower 286cfbdee3fa44e59a9bae25828a22aa to start an election
I20260709 12:15:36.698395 26495 raft_consensus.cc:1081] T d6718d60aa6849c1af1fa5996fcbc350 P 5d897b683da9447982512d4a1bc25576 [term 1 LEADER]: Signalling peer 286cfbdee3fa44e59a9bae25828a22aa to start an election
I20260709 12:15:36.700764 26264 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d6718d60aa6849c1af1fa5996fcbc350"
dest_uuid: "286cfbdee3fa44e59a9bae25828a22aa"
 from {username='slave'} at 127.0.0.1:45362
I20260709 12:15:36.702399 26264 raft_consensus.cc:493] T d6718d60aa6849c1af1fa5996fcbc350 P 286cfbdee3fa44e59a9bae25828a22aa [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:36.702936 26264 raft_consensus.cc:3060] T d6718d60aa6849c1af1fa5996fcbc350 P 286cfbdee3fa44e59a9bae25828a22aa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:36.704454 26461 consensus_queue.cc:1048] T d6718d60aa6849c1af1fa5996fcbc350 P 5d897b683da9447982512d4a1bc25576 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:36.712050 26264 raft_consensus.cc:515] T d6718d60aa6849c1af1fa5996fcbc350 P 286cfbdee3fa44e59a9bae25828a22aa [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "286cfbdee3fa44e59a9bae25828a22aa" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 46621 } } peers { permanent_uuid: "5d897b683da9447982512d4a1bc25576" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 42829 } } peers { permanent_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34861 } }
I20260709 12:15:36.715978 26264 leader_election.cc:290] T d6718d60aa6849c1af1fa5996fcbc350 P 286cfbdee3fa44e59a9bae25828a22aa [CANDIDATE]: Term 2 election: Requested vote from peers 5d897b683da9447982512d4a1bc25576 (127.12.56.194:42829), fd56f18d738e4a3f8e002e19cce4b1fb (127.12.56.195:34861)
I20260709 12:15:36.717722 26414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6718d60aa6849c1af1fa5996fcbc350" candidate_uuid: "286cfbdee3fa44e59a9bae25828a22aa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb"
I20260709 12:15:36.718374 26414 raft_consensus.cc:3060] T d6718d60aa6849c1af1fa5996fcbc350 P fd56f18d738e4a3f8e002e19cce4b1fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:36.719995 26340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6718d60aa6849c1af1fa5996fcbc350" candidate_uuid: "286cfbdee3fa44e59a9bae25828a22aa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d897b683da9447982512d4a1bc25576"
I20260709 12:15:36.720695 26340 raft_consensus.cc:3055] T d6718d60aa6849c1af1fa5996fcbc350 P 5d897b683da9447982512d4a1bc25576 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:36.721035 26340 raft_consensus.cc:740] T d6718d60aa6849c1af1fa5996fcbc350 P 5d897b683da9447982512d4a1bc25576 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d897b683da9447982512d4a1bc25576, State: Running, Role: LEADER
I20260709 12:15:36.721920 26340 consensus_queue.cc:260] T d6718d60aa6849c1af1fa5996fcbc350 P 5d897b683da9447982512d4a1bc25576 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "286cfbdee3fa44e59a9bae25828a22aa" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 46621 } } peers { permanent_uuid: "5d897b683da9447982512d4a1bc25576" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 42829 } } peers { permanent_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34861 } }
I20260709 12:15:36.723332 26340 raft_consensus.cc:3060] T d6718d60aa6849c1af1fa5996fcbc350 P 5d897b683da9447982512d4a1bc25576 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:36.726315 26414 raft_consensus.cc:2468] T d6718d60aa6849c1af1fa5996fcbc350 P fd56f18d738e4a3f8e002e19cce4b1fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 286cfbdee3fa44e59a9bae25828a22aa in term 2.
I20260709 12:15:36.727599 26228 leader_election.cc:304] T d6718d60aa6849c1af1fa5996fcbc350 P 286cfbdee3fa44e59a9bae25828a22aa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 286cfbdee3fa44e59a9bae25828a22aa, fd56f18d738e4a3f8e002e19cce4b1fb; no voters: 
I20260709 12:15:36.728524 26468 raft_consensus.cc:2804] T d6718d60aa6849c1af1fa5996fcbc350 P 286cfbdee3fa44e59a9bae25828a22aa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:36.729014 26468 raft_consensus.cc:697] T d6718d60aa6849c1af1fa5996fcbc350 P 286cfbdee3fa44e59a9bae25828a22aa [term 2 LEADER]: Becoming Leader. State: Replica: 286cfbdee3fa44e59a9bae25828a22aa, State: Running, Role: LEADER
I20260709 12:15:36.729938 26468 consensus_queue.cc:237] T d6718d60aa6849c1af1fa5996fcbc350 P 286cfbdee3fa44e59a9bae25828a22aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "286cfbdee3fa44e59a9bae25828a22aa" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 46621 } } peers { permanent_uuid: "5d897b683da9447982512d4a1bc25576" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 42829 } } peers { permanent_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34861 } }
I20260709 12:15:36.731200 26340 raft_consensus.cc:2468] T d6718d60aa6849c1af1fa5996fcbc350 P 5d897b683da9447982512d4a1bc25576 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 286cfbdee3fa44e59a9bae25828a22aa in term 2.
I20260709 12:15:36.737946 26160 catalog_manager.cc:5697] T d6718d60aa6849c1af1fa5996fcbc350 P 286cfbdee3fa44e59a9bae25828a22aa reported cstate change: term changed from 1 to 2, leader changed from 5d897b683da9447982512d4a1bc25576 (127.12.56.194) to 286cfbdee3fa44e59a9bae25828a22aa (127.12.56.193). New cstate: current_term: 2 leader_uuid: "286cfbdee3fa44e59a9bae25828a22aa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "286cfbdee3fa44e59a9bae25828a22aa" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 46621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d897b683da9447982512d4a1bc25576" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 42829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34861 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:37.027583 12515 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 12:15:37.029577 12515 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 12:15:37.030166 12515 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 12:15:37.043462 26264 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "45605ca20b4b4d3b85ff9a41139ca81e"
dest_uuid: "286cfbdee3fa44e59a9bae25828a22aa"
mode: GRACEFUL
new_leader_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb"
 from {username='slave'} at 127.0.0.1:45388
I20260709 12:15:37.044052 26264 raft_consensus.cc:606] T 45605ca20b4b4d3b85ff9a41139ca81e P 286cfbdee3fa44e59a9bae25828a22aa [term 1 LEADER]: Received request to transfer leadership to TS fd56f18d738e4a3f8e002e19cce4b1fb
I20260709 12:15:37.045231 12515 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 12:15:37.082756 26264 raft_consensus.cc:1275] T 2a2310bd6ad2414c9524a4b5202f679d P 286cfbdee3fa44e59a9bae25828a22aa [term 2 FOLLOWER]: Refusing update from remote peer 5d897b683da9447982512d4a1bc25576: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:37.084116 26461 consensus_queue.cc:1048] T 2a2310bd6ad2414c9524a4b5202f679d P 5d897b683da9447982512d4a1bc25576 [LEADER]: Connected to new peer: Peer: permanent_uuid: "286cfbdee3fa44e59a9bae25828a22aa" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 46621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:37.092814 26414 raft_consensus.cc:1275] T 2a2310bd6ad2414c9524a4b5202f679d P fd56f18d738e4a3f8e002e19cce4b1fb [term 2 FOLLOWER]: Refusing update from remote peer 5d897b683da9447982512d4a1bc25576: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:37.095095 26461 consensus_queue.cc:1048] T 2a2310bd6ad2414c9524a4b5202f679d P 5d897b683da9447982512d4a1bc25576 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:37.164163 26340 raft_consensus.cc:1275] T d6718d60aa6849c1af1fa5996fcbc350 P 5d897b683da9447982512d4a1bc25576 [term 2 FOLLOWER]: Refusing update from remote peer 286cfbdee3fa44e59a9bae25828a22aa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:37.165659 26468 consensus_queue.cc:1048] T d6718d60aa6849c1af1fa5996fcbc350 P 286cfbdee3fa44e59a9bae25828a22aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d897b683da9447982512d4a1bc25576" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 42829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:37.177300 26414 raft_consensus.cc:1275] T d6718d60aa6849c1af1fa5996fcbc350 P fd56f18d738e4a3f8e002e19cce4b1fb [term 2 FOLLOWER]: Refusing update from remote peer 286cfbdee3fa44e59a9bae25828a22aa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:37.179224 26468 consensus_queue.cc:1048] T d6718d60aa6849c1af1fa5996fcbc350 P 286cfbdee3fa44e59a9bae25828a22aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:37.394692 26506 raft_consensus.cc:993] T 45605ca20b4b4d3b85ff9a41139ca81e P 286cfbdee3fa44e59a9bae25828a22aa: : Instructing follower fd56f18d738e4a3f8e002e19cce4b1fb to start an election
I20260709 12:15:37.395233 26468 raft_consensus.cc:1081] T 45605ca20b4b4d3b85ff9a41139ca81e P 286cfbdee3fa44e59a9bae25828a22aa [term 1 LEADER]: Signalling peer fd56f18d738e4a3f8e002e19cce4b1fb to start an election
I20260709 12:15:37.397253 26414 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "45605ca20b4b4d3b85ff9a41139ca81e"
dest_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb"
 from {username='slave'} at 127.0.0.1:43434
I20260709 12:15:37.397924 26414 raft_consensus.cc:493] T 45605ca20b4b4d3b85ff9a41139ca81e P fd56f18d738e4a3f8e002e19cce4b1fb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:37.398269 26414 raft_consensus.cc:3060] T 45605ca20b4b4d3b85ff9a41139ca81e P fd56f18d738e4a3f8e002e19cce4b1fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:37.403741 26414 raft_consensus.cc:515] T 45605ca20b4b4d3b85ff9a41139ca81e P fd56f18d738e4a3f8e002e19cce4b1fb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "286cfbdee3fa44e59a9bae25828a22aa" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 46621 } } peers { permanent_uuid: "5d897b683da9447982512d4a1bc25576" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 42829 } } peers { permanent_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34861 } }
I20260709 12:15:37.405941 26414 leader_election.cc:290] T 45605ca20b4b4d3b85ff9a41139ca81e P fd56f18d738e4a3f8e002e19cce4b1fb [CANDIDATE]: Term 2 election: Requested vote from peers 286cfbdee3fa44e59a9bae25828a22aa (127.12.56.193:46621), 5d897b683da9447982512d4a1bc25576 (127.12.56.194:42829)
I20260709 12:15:37.420063 26264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45605ca20b4b4d3b85ff9a41139ca81e" candidate_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "286cfbdee3fa44e59a9bae25828a22aa"
I20260709 12:15:37.420737 26264 raft_consensus.cc:3055] T 45605ca20b4b4d3b85ff9a41139ca81e P 286cfbdee3fa44e59a9bae25828a22aa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:37.421133 26264 raft_consensus.cc:740] T 45605ca20b4b4d3b85ff9a41139ca81e P 286cfbdee3fa44e59a9bae25828a22aa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 286cfbdee3fa44e59a9bae25828a22aa, State: Running, Role: LEADER
I20260709 12:15:37.421634 26340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45605ca20b4b4d3b85ff9a41139ca81e" candidate_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d897b683da9447982512d4a1bc25576"
I20260709 12:15:37.422386 26340 raft_consensus.cc:3060] T 45605ca20b4b4d3b85ff9a41139ca81e P 5d897b683da9447982512d4a1bc25576 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:37.422039 26264 consensus_queue.cc:260] T 45605ca20b4b4d3b85ff9a41139ca81e P 286cfbdee3fa44e59a9bae25828a22aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "286cfbdee3fa44e59a9bae25828a22aa" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 46621 } } peers { permanent_uuid: "5d897b683da9447982512d4a1bc25576" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 42829 } } peers { permanent_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34861 } }
I20260709 12:15:37.423558 26264 raft_consensus.cc:3060] T 45605ca20b4b4d3b85ff9a41139ca81e P 286cfbdee3fa44e59a9bae25828a22aa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:37.430408 26340 raft_consensus.cc:2468] T 45605ca20b4b4d3b85ff9a41139ca81e P 5d897b683da9447982512d4a1bc25576 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd56f18d738e4a3f8e002e19cce4b1fb in term 2.
I20260709 12:15:37.431119 26264 raft_consensus.cc:2468] T 45605ca20b4b4d3b85ff9a41139ca81e P 286cfbdee3fa44e59a9bae25828a22aa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd56f18d738e4a3f8e002e19cce4b1fb in term 2.
I20260709 12:15:37.432189 26380 leader_election.cc:304] T 45605ca20b4b4d3b85ff9a41139ca81e P fd56f18d738e4a3f8e002e19cce4b1fb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d897b683da9447982512d4a1bc25576, fd56f18d738e4a3f8e002e19cce4b1fb; no voters: 
I20260709 12:15:37.433104 26460 raft_consensus.cc:2804] T 45605ca20b4b4d3b85ff9a41139ca81e P fd56f18d738e4a3f8e002e19cce4b1fb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:37.434527 26460 raft_consensus.cc:697] T 45605ca20b4b4d3b85ff9a41139ca81e P fd56f18d738e4a3f8e002e19cce4b1fb [term 2 LEADER]: Becoming Leader. State: Replica: fd56f18d738e4a3f8e002e19cce4b1fb, State: Running, Role: LEADER
I20260709 12:15:37.435459 26460 consensus_queue.cc:237] T 45605ca20b4b4d3b85ff9a41139ca81e P fd56f18d738e4a3f8e002e19cce4b1fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "286cfbdee3fa44e59a9bae25828a22aa" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 46621 } } peers { permanent_uuid: "5d897b683da9447982512d4a1bc25576" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 42829 } } peers { permanent_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34861 } }
I20260709 12:15:37.443454 26162 catalog_manager.cc:5697] T 45605ca20b4b4d3b85ff9a41139ca81e P fd56f18d738e4a3f8e002e19cce4b1fb reported cstate change: term changed from 1 to 2, leader changed from 286cfbdee3fa44e59a9bae25828a22aa (127.12.56.193) to fd56f18d738e4a3f8e002e19cce4b1fb (127.12.56.195). New cstate: current_term: 2 leader_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "286cfbdee3fa44e59a9bae25828a22aa" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 46621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d897b683da9447982512d4a1bc25576" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 42829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd56f18d738e4a3f8e002e19cce4b1fb" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 34861 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:37.694545 12515 tablet_server.cc:179] TabletServer@127.12.56.193:0 shutting down...
I20260709 12:15:37.717511 12515 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:37.718338 12515 tablet_replica.cc:333] T 45605ca20b4b4d3b85ff9a41139ca81e P 286cfbdee3fa44e59a9bae25828a22aa: stopping tablet replica
I20260709 12:15:37.718947 12515 raft_consensus.cc:2243] T 45605ca20b4b4d3b85ff9a41139ca81e P 286cfbdee3fa44e59a9bae25828a22aa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:37.719403 12515 raft_consensus.cc:2272] T 45605ca20b4b4d3b85ff9a41139ca81e P 286cfbdee3fa44e59a9bae25828a22aa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:37.721441 12515 tablet_replica.cc:333] T 100ec9c805b34858a7d277fb8ffceeb2 P 286cfbdee3fa44e59a9bae25828a22aa: stopping tablet replica
I20260709 12:15:37.722038 12515 raft_consensus.cc:2243] T 100ec9c805b34858a7d277fb8ffceeb2 P 286cfbdee3fa44e59a9bae25828a22aa [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:37.722829 12515 raft_consensus.cc:2272] T 100ec9c805b34858a7d277fb8ffceeb2 P 286cfbdee3fa44e59a9bae25828a22aa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:37.724694 12515 tablet_replica.cc:333] T d6718d60aa6849c1af1fa5996fcbc350 P 286cfbdee3fa44e59a9bae25828a22aa: stopping tablet replica
I20260709 12:15:37.725214 12515 raft_consensus.cc:2243] T d6718d60aa6849c1af1fa5996fcbc350 P 286cfbdee3fa44e59a9bae25828a22aa [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:37.726073 12515 raft_consensus.cc:2272] T d6718d60aa6849c1af1fa5996fcbc350 P 286cfbdee3fa44e59a9bae25828a22aa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:37.728716 12515 tablet_replica.cc:333] T 2a2310bd6ad2414c9524a4b5202f679d P 286cfbdee3fa44e59a9bae25828a22aa: stopping tablet replica
I20260709 12:15:37.729243 12515 raft_consensus.cc:2243] T 2a2310bd6ad2414c9524a4b5202f679d P 286cfbdee3fa44e59a9bae25828a22aa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:37.729677 12515 raft_consensus.cc:2272] T 2a2310bd6ad2414c9524a4b5202f679d P 286cfbdee3fa44e59a9bae25828a22aa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:37.754113 12515 tablet_server.cc:196] TabletServer@127.12.56.193:0 shutdown complete.
I20260709 12:15:37.771252 12515 tablet_server.cc:179] TabletServer@127.12.56.194:0 shutting down...
I20260709 12:15:37.790966 12515 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:37.791815 12515 tablet_replica.cc:333] T 45605ca20b4b4d3b85ff9a41139ca81e P 5d897b683da9447982512d4a1bc25576: stopping tablet replica
I20260709 12:15:37.792430 12515 raft_consensus.cc:2243] T 45605ca20b4b4d3b85ff9a41139ca81e P 5d897b683da9447982512d4a1bc25576 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:37.792881 12515 raft_consensus.cc:2272] T 45605ca20b4b4d3b85ff9a41139ca81e P 5d897b683da9447982512d4a1bc25576 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:37.794942 12515 tablet_replica.cc:333] T 100ec9c805b34858a7d277fb8ffceeb2 P 5d897b683da9447982512d4a1bc25576: stopping tablet replica
I20260709 12:15:37.795475 12515 raft_consensus.cc:2243] T 100ec9c805b34858a7d277fb8ffceeb2 P 5d897b683da9447982512d4a1bc25576 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:37.795885 12515 raft_consensus.cc:2272] T 100ec9c805b34858a7d277fb8ffceeb2 P 5d897b683da9447982512d4a1bc25576 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:37.797839 12515 tablet_replica.cc:333] T d6718d60aa6849c1af1fa5996fcbc350 P 5d897b683da9447982512d4a1bc25576: stopping tablet replica
I20260709 12:15:37.798348 12515 raft_consensus.cc:2243] T d6718d60aa6849c1af1fa5996fcbc350 P 5d897b683da9447982512d4a1bc25576 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:37.798772 12515 raft_consensus.cc:2272] T d6718d60aa6849c1af1fa5996fcbc350 P 5d897b683da9447982512d4a1bc25576 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:37.801039 12515 tablet_replica.cc:333] T 2a2310bd6ad2414c9524a4b5202f679d P 5d897b683da9447982512d4a1bc25576: stopping tablet replica
I20260709 12:15:37.801522 12515 raft_consensus.cc:2243] T 2a2310bd6ad2414c9524a4b5202f679d P 5d897b683da9447982512d4a1bc25576 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:37.802372 12515 raft_consensus.cc:2272] T 2a2310bd6ad2414c9524a4b5202f679d P 5d897b683da9447982512d4a1bc25576 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:37.816313 12515 tablet_server.cc:196] TabletServer@127.12.56.194:0 shutdown complete.
I20260709 12:15:37.830852 12515 tablet_server.cc:179] TabletServer@127.12.56.195:0 shutting down...
I20260709 12:15:37.851822 12515 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:37.852454 12515 tablet_replica.cc:333] T 45605ca20b4b4d3b85ff9a41139ca81e P fd56f18d738e4a3f8e002e19cce4b1fb: stopping tablet replica
I20260709 12:15:37.853188 12515 raft_consensus.cc:2243] T 45605ca20b4b4d3b85ff9a41139ca81e P fd56f18d738e4a3f8e002e19cce4b1fb [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:37.854023 12515 pending_rounds.cc:70] T 45605ca20b4b4d3b85ff9a41139ca81e P fd56f18d738e4a3f8e002e19cce4b1fb: Trying to abort 1 pending ops.
I20260709 12:15:37.854282 12515 pending_rounds.cc:77] T 45605ca20b4b4d3b85ff9a41139ca81e P fd56f18d738e4a3f8e002e19cce4b1fb: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305622886143578112 op_type: NO_OP noop_request { }
I20260709 12:15:37.854643 12515 raft_consensus.cc:2889] T 45605ca20b4b4d3b85ff9a41139ca81e P fd56f18d738e4a3f8e002e19cce4b1fb [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:15:37.854997 12515 raft_consensus.cc:2272] T 45605ca20b4b4d3b85ff9a41139ca81e P fd56f18d738e4a3f8e002e19cce4b1fb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:37.857366 12515 tablet_replica.cc:333] T 100ec9c805b34858a7d277fb8ffceeb2 P fd56f18d738e4a3f8e002e19cce4b1fb: stopping tablet replica
I20260709 12:15:37.858079 12515 raft_consensus.cc:2243] T 100ec9c805b34858a7d277fb8ffceeb2 P fd56f18d738e4a3f8e002e19cce4b1fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:37.858641 12515 raft_consensus.cc:2272] T 100ec9c805b34858a7d277fb8ffceeb2 P fd56f18d738e4a3f8e002e19cce4b1fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:37.860651 12515 tablet_replica.cc:333] T d6718d60aa6849c1af1fa5996fcbc350 P fd56f18d738e4a3f8e002e19cce4b1fb: stopping tablet replica
I20260709 12:15:37.861244 12515 raft_consensus.cc:2243] T d6718d60aa6849c1af1fa5996fcbc350 P fd56f18d738e4a3f8e002e19cce4b1fb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:37.861750 12515 raft_consensus.cc:2272] T d6718d60aa6849c1af1fa5996fcbc350 P fd56f18d738e4a3f8e002e19cce4b1fb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:37.864414 12515 tablet_replica.cc:333] T 2a2310bd6ad2414c9524a4b5202f679d P fd56f18d738e4a3f8e002e19cce4b1fb: stopping tablet replica
I20260709 12:15:37.865082 12515 raft_consensus.cc:2243] T 2a2310bd6ad2414c9524a4b5202f679d P fd56f18d738e4a3f8e002e19cce4b1fb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:37.865538 12515 raft_consensus.cc:2272] T 2a2310bd6ad2414c9524a4b5202f679d P fd56f18d738e4a3f8e002e19cce4b1fb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:37.890729 12515 tablet_server.cc:196] TabletServer@127.12.56.195:0 shutdown complete.
I20260709 12:15:37.905082 12515 master.cc:562] Master@127.12.56.254:44803 shutting down...
I20260709 12:15:37.923029 12515 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 2ed2f087829b44599c3cf7025763cb3a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:37.923573 12515 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 2ed2f087829b44599c3cf7025763cb3a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:37.923856 12515 tablet_replica.cc:333] T 00000000000000000000000000000000 P 2ed2f087829b44599c3cf7025763cb3a: stopping tablet replica
I20260709 12:15:37.943967 12515 master.cc:584] Master@127.12.56.254:44803 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (3406 ms)
[----------] 6 tests from LeaderRebalancerTest (443098 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 12:15:37.979755 12515 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.12.56.254:40353
I20260709 12:15:37.980892 12515 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:37.986871 26516 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:37.987529 26517 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:37.988899 26519 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:37.990509 12515 server_base.cc:1061] running on GCE node
I20260709 12:15:37.991496 12515 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:37.991705 12515 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:37.991953 12515 hybrid_clock.cc:648] HybridClock initialized: now 1783599337991933 us; error 0 us; skew 500 ppm
I20260709 12:15:37.992532 12515 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:37.995147 12515 webserver.cc:533] Webserver started at http://127.12.56.254:40409/ using document root <none> and password file <none>
I20260709 12:15:37.995687 12515 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:37.995884 12515 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:37.996188 12515 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:37.997357 12515 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894707649-12515-0/minicluster-data/master-0-root/instance:
uuid: "301b955f7d364862a86a4f99fedaf408"
format_stamp: "Formatted at 2026-07-09 12:15:37 on dist-test-slave-705g"
I20260709 12:15:38.002249 12515 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 12:15:38.006381 26524 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:38.007333 12515 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 12:15:38.007704 12515 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894707649-12515-0/minicluster-data/master-0-root
uuid: "301b955f7d364862a86a4f99fedaf408"
format_stamp: "Formatted at 2026-07-09 12:15:37 on dist-test-slave-705g"
I20260709 12:15:38.008049 12515 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894707649-12515-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894707649-12515-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894707649-12515-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:38.027084 12515 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:38.028236 12515 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:38.068960 12515 rpc_server.cc:307] RPC server started. Bound to: 127.12.56.254:40353
I20260709 12:15:38.069072 26575 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.56.254:40353 every 8 connection(s)
I20260709 12:15:38.073738 26576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:38.086504 26576 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 301b955f7d364862a86a4f99fedaf408: Bootstrap starting.
I20260709 12:15:38.091621 26576 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 301b955f7d364862a86a4f99fedaf408: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:38.096436 26576 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 301b955f7d364862a86a4f99fedaf408: No bootstrap required, opened a new log
I20260709 12:15:38.098904 26576 raft_consensus.cc:359] T 00000000000000000000000000000000 P 301b955f7d364862a86a4f99fedaf408 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "301b955f7d364862a86a4f99fedaf408" member_type: VOTER }
I20260709 12:15:38.099320 26576 raft_consensus.cc:385] T 00000000000000000000000000000000 P 301b955f7d364862a86a4f99fedaf408 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:38.099607 26576 raft_consensus.cc:740] T 00000000000000000000000000000000 P 301b955f7d364862a86a4f99fedaf408 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 301b955f7d364862a86a4f99fedaf408, State: Initialized, Role: FOLLOWER
I20260709 12:15:38.100260 26576 consensus_queue.cc:260] T 00000000000000000000000000000000 P 301b955f7d364862a86a4f99fedaf408 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "301b955f7d364862a86a4f99fedaf408" member_type: VOTER }
I20260709 12:15:38.100790 26576 raft_consensus.cc:399] T 00000000000000000000000000000000 P 301b955f7d364862a86a4f99fedaf408 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:15:38.101016 26576 raft_consensus.cc:493] T 00000000000000000000000000000000 P 301b955f7d364862a86a4f99fedaf408 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:15:38.101339 26576 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 301b955f7d364862a86a4f99fedaf408 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:38.106545 26576 raft_consensus.cc:515] T 00000000000000000000000000000000 P 301b955f7d364862a86a4f99fedaf408 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "301b955f7d364862a86a4f99fedaf408" member_type: VOTER }
I20260709 12:15:38.107141 26576 leader_election.cc:304] T 00000000000000000000000000000000 P 301b955f7d364862a86a4f99fedaf408 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 301b955f7d364862a86a4f99fedaf408; no voters: 
I20260709 12:15:38.108359 26576 leader_election.cc:290] T 00000000000000000000000000000000 P 301b955f7d364862a86a4f99fedaf408 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:15:38.108733 26579 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 301b955f7d364862a86a4f99fedaf408 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:38.110392 26579 raft_consensus.cc:697] T 00000000000000000000000000000000 P 301b955f7d364862a86a4f99fedaf408 [term 1 LEADER]: Becoming Leader. State: Replica: 301b955f7d364862a86a4f99fedaf408, State: Running, Role: LEADER
I20260709 12:15:38.111119 26579 consensus_queue.cc:237] T 00000000000000000000000000000000 P 301b955f7d364862a86a4f99fedaf408 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "301b955f7d364862a86a4f99fedaf408" member_type: VOTER }
I20260709 12:15:38.111678 26576 sys_catalog.cc:565] T 00000000000000000000000000000000 P 301b955f7d364862a86a4f99fedaf408 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:15:38.114179 26581 sys_catalog.cc:455] T 00000000000000000000000000000000 P 301b955f7d364862a86a4f99fedaf408 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 301b955f7d364862a86a4f99fedaf408. Latest consensus state: current_term: 1 leader_uuid: "301b955f7d364862a86a4f99fedaf408" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "301b955f7d364862a86a4f99fedaf408" member_type: VOTER } }
I20260709 12:15:38.114188 26580 sys_catalog.cc:455] T 00000000000000000000000000000000 P 301b955f7d364862a86a4f99fedaf408 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "301b955f7d364862a86a4f99fedaf408" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "301b955f7d364862a86a4f99fedaf408" member_type: VOTER } }
I20260709 12:15:38.115061 26581 sys_catalog.cc:458] T 00000000000000000000000000000000 P 301b955f7d364862a86a4f99fedaf408 [sys.catalog]: This master's current role is: LEADER
I20260709 12:15:38.115144 26580 sys_catalog.cc:458] T 00000000000000000000000000000000 P 301b955f7d364862a86a4f99fedaf408 [sys.catalog]: This master's current role is: LEADER
I20260709 12:15:38.117624 26584 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:15:38.122504 26584 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:15:38.128386 12515 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:15:38.132476 26584 catalog_manager.cc:1383] Generated new cluster ID: d16441181b444df4b2846e48944875ca
I20260709 12:15:38.132879 26584 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:15:38.159415 26584 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:15:38.161365 26584 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:15:38.182639 26584 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 301b955f7d364862a86a4f99fedaf408: Generated new TSK 0
I20260709 12:15:38.183301 26584 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:15:38.196193 12515 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:38.203332 26597 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:38.203883 26598 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:38.206347 12515 server_base.cc:1061] running on GCE node
W20260709 12:15:38.206312 26600 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:38.207800 12515 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:38.208029 12515 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:38.208180 12515 hybrid_clock.cc:648] HybridClock initialized: now 1783599338208168 us; error 0 us; skew 500 ppm
I20260709 12:15:38.208776 12515 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:38.212018 12515 webserver.cc:533] Webserver started at http://127.12.56.193:44045/ using document root <none> and password file <none>
I20260709 12:15:38.212553 12515 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:38.212733 12515 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:38.213047 12515 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:38.214390 12515 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894707649-12515-0/minicluster-data/ts-0-root/instance:
uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd"
format_stamp: "Formatted at 2026-07-09 12:15:38 on dist-test-slave-705g"
I20260709 12:15:38.219802 12515 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:15:38.223958 26605 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:38.225039 12515 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:15:38.225407 12515 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894707649-12515-0/minicluster-data/ts-0-root
uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd"
format_stamp: "Formatted at 2026-07-09 12:15:38 on dist-test-slave-705g"
I20260709 12:15:38.225703 12515 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894707649-12515-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894707649-12515-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894707649-12515-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:38.266573 12515 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:38.267788 12515 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:38.269374 12515 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:38.271858 12515 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:38.272123 12515 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:38.272390 12515 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:38.272572 12515 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:38.316293 12515 rpc_server.cc:307] RPC server started. Bound to: 127.12.56.193:35813
I20260709 12:15:38.316416 26667 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.56.193:35813 every 8 connection(s)
I20260709 12:15:38.321642 12515 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:38.328951 26672 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:38.330760 26673 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:38.333455 26675 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:38.333916 12515 server_base.cc:1061] running on GCE node
I20260709 12:15:38.335505 12515 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:38.335803 12515 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:38.336030 12515 hybrid_clock.cc:648] HybridClock initialized: now 1783599338336009 us; error 0 us; skew 500 ppm
I20260709 12:15:38.336458 26668 heartbeater.cc:344] Connected to a master server at 127.12.56.254:40353
I20260709 12:15:38.336651 12515 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:38.336975 26668 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:38.338387 26668 heartbeater.cc:507] Master 127.12.56.254:40353 requested a full tablet report, sending...
I20260709 12:15:38.340025 12515 webserver.cc:533] Webserver started at http://127.12.56.194:35101/ using document root <none> and password file <none>
I20260709 12:15:38.340721 12515 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:38.340958 12515 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:38.340875 26541 ts_manager.cc:194] Registered new tserver with Master: 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813)
I20260709 12:15:38.341591 12515 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:38.342847 12515 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894707649-12515-0/minicluster-data/ts-1-root/instance:
uuid: "773a9a5eeb14469389297d0f170bae34"
format_stamp: "Formatted at 2026-07-09 12:15:38 on dist-test-slave-705g"
I20260709 12:15:38.343317 26541 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60718
I20260709 12:15:38.348454 12515 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:15:38.352655 26680 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:38.353758 12515 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:15:38.354221 12515 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894707649-12515-0/minicluster-data/ts-1-root
uuid: "773a9a5eeb14469389297d0f170bae34"
format_stamp: "Formatted at 2026-07-09 12:15:38 on dist-test-slave-705g"
I20260709 12:15:38.354605 12515 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894707649-12515-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894707649-12515-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894707649-12515-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:38.370905 12515 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:38.372280 12515 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:38.374081 12515 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:38.376596 12515 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:38.376927 12515 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:38.377214 12515 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:38.377420 12515 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:38.424536 12515 rpc_server.cc:307] RPC server started. Bound to: 127.12.56.194:37781
I20260709 12:15:38.424693 26742 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.56.194:37781 every 8 connection(s)
I20260709 12:15:38.430099 12515 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:38.436981 26746 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:38.437583 26747 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:38.442852 26749 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:38.443679 12515 server_base.cc:1061] running on GCE node
I20260709 12:15:38.444636 26743 heartbeater.cc:344] Connected to a master server at 127.12.56.254:40353
I20260709 12:15:38.444859 12515 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:15:38.445125 26743 heartbeater.cc:461] Registering TS with master...
W20260709 12:15:38.445194 12515 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:38.445502 12515 hybrid_clock.cc:648] HybridClock initialized: now 1783599338445479 us; error 0 us; skew 500 ppm
I20260709 12:15:38.446168 26743 heartbeater.cc:507] Master 127.12.56.254:40353 requested a full tablet report, sending...
I20260709 12:15:38.446374 12515 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:38.448861 26541 ts_manager.cc:194] Registered new tserver with Master: 773a9a5eeb14469389297d0f170bae34 (127.12.56.194:37781)
I20260709 12:15:38.449384 12515 webserver.cc:533] Webserver started at http://127.12.56.195:44125/ using document root <none> and password file <none>
I20260709 12:15:38.450002 12515 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:38.450176 12515 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:38.450397 12515 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:38.450464 26541 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60726
I20260709 12:15:38.451713 12515 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894707649-12515-0/minicluster-data/ts-2-root/instance:
uuid: "ea3ae70a91d24c3e84f03da4605ccede"
format_stamp: "Formatted at 2026-07-09 12:15:38 on dist-test-slave-705g"
I20260709 12:15:38.456799 12515 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 12:15:38.460562 26754 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:38.461597 12515 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:15:38.461956 12515 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894707649-12515-0/minicluster-data/ts-2-root
uuid: "ea3ae70a91d24c3e84f03da4605ccede"
format_stamp: "Formatted at 2026-07-09 12:15:38 on dist-test-slave-705g"
I20260709 12:15:38.462239 12515 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894707649-12515-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894707649-12515-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894707649-12515-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:38.473065 12515 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:38.474347 12515 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:38.475884 12515 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:38.478363 12515 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:38.478561 12515 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:38.478884 12515 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:38.479035 12515 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:38.521454 12515 rpc_server.cc:307] RPC server started. Bound to: 127.12.56.195:43987
I20260709 12:15:38.521556 26816 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.56.195:43987 every 8 connection(s)
I20260709 12:15:38.536763 26817 heartbeater.cc:344] Connected to a master server at 127.12.56.254:40353
I20260709 12:15:38.537218 26817 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:38.538242 26817 heartbeater.cc:507] Master 127.12.56.254:40353 requested a full tablet report, sending...
I20260709 12:15:38.540424 26541 ts_manager.cc:194] Registered new tserver with Master: ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195:43987)
I20260709 12:15:38.541060 12515 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016226213s
I20260709 12:15:38.542044 26541 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60736
I20260709 12:15:38.569933 26541 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60744:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:15:38.572585 26541 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:15:38.643952 26782 tablet_service.cc:1511] Processing CreateTablet for tablet 1f02103b62ff4603865811bcb4278c95 (DEFAULT_TABLE table=test-workload [id=e136f922237142b6b925c220ae95cd92]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:15:38.645417 26782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f02103b62ff4603865811bcb4278c95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:38.655665 26707 tablet_service.cc:1511] Processing CreateTablet for tablet 51053577132f400289d135eb01a55020 (DEFAULT_TABLE table=test-workload [id=e136f922237142b6b925c220ae95cd92]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:15:38.656658 26781 tablet_service.cc:1511] Processing CreateTablet for tablet 51053577132f400289d135eb01a55020 (DEFAULT_TABLE table=test-workload [id=e136f922237142b6b925c220ae95cd92]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:15:38.657361 26707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51053577132f400289d135eb01a55020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:38.658202 26781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51053577132f400289d135eb01a55020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:38.662930 26708 tablet_service.cc:1511] Processing CreateTablet for tablet 1f02103b62ff4603865811bcb4278c95 (DEFAULT_TABLE table=test-workload [id=e136f922237142b6b925c220ae95cd92]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:15:38.663311 26780 tablet_service.cc:1511] Processing CreateTablet for tablet 6bbb8c707ea042859b5fbe695bab0f44 (DEFAULT_TABLE table=test-workload [id=e136f922237142b6b925c220ae95cd92]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:15:38.664474 26708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f02103b62ff4603865811bcb4278c95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:38.664845 26780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bbb8c707ea042859b5fbe695bab0f44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:38.672674 26706 tablet_service.cc:1511] Processing CreateTablet for tablet 6bbb8c707ea042859b5fbe695bab0f44 (DEFAULT_TABLE table=test-workload [id=e136f922237142b6b925c220ae95cd92]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:15:38.673949 26633 tablet_service.cc:1511] Processing CreateTablet for tablet 1f02103b62ff4603865811bcb4278c95 (DEFAULT_TABLE table=test-workload [id=e136f922237142b6b925c220ae95cd92]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:15:38.674330 26706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bbb8c707ea042859b5fbe695bab0f44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:38.675487 26633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f02103b62ff4603865811bcb4278c95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:38.676313 26631 tablet_service.cc:1511] Processing CreateTablet for tablet 6bbb8c707ea042859b5fbe695bab0f44 (DEFAULT_TABLE table=test-workload [id=e136f922237142b6b925c220ae95cd92]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:15:38.677724 26631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bbb8c707ea042859b5fbe695bab0f44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:38.675524 26632 tablet_service.cc:1511] Processing CreateTablet for tablet 51053577132f400289d135eb01a55020 (DEFAULT_TABLE table=test-workload [id=e136f922237142b6b925c220ae95cd92]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:15:38.679477 26632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51053577132f400289d135eb01a55020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:38.685487 26630 tablet_service.cc:1511] Processing CreateTablet for tablet a21937cb47f14ac0b40ea7c7c6e9cab9 (DEFAULT_TABLE table=test-workload [id=e136f922237142b6b925c220ae95cd92]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:15:38.687503 26630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a21937cb47f14ac0b40ea7c7c6e9cab9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:38.703990 26705 tablet_service.cc:1511] Processing CreateTablet for tablet a21937cb47f14ac0b40ea7c7c6e9cab9 (DEFAULT_TABLE table=test-workload [id=e136f922237142b6b925c220ae95cd92]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:15:38.705703 26705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a21937cb47f14ac0b40ea7c7c6e9cab9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:38.715461 26832 tablet_bootstrap.cc:492] T 51053577132f400289d135eb01a55020 P ea3ae70a91d24c3e84f03da4605ccede: Bootstrap starting.
I20260709 12:15:38.721056 26629 tablet_service.cc:1511] Processing CreateTablet for tablet d2af60b518a442778196f4cf0c3c918f (DEFAULT_TABLE table=test-workload [id=e136f922237142b6b925c220ae95cd92]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:15:38.722726 26629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2af60b518a442778196f4cf0c3c918f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:38.726289 26782 tablet_service.cc:1511] Processing CreateTablet for tablet a21937cb47f14ac0b40ea7c7c6e9cab9 (DEFAULT_TABLE table=test-workload [id=e136f922237142b6b925c220ae95cd92]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:15:38.727887 26782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a21937cb47f14ac0b40ea7c7c6e9cab9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:38.729354 26704 tablet_service.cc:1511] Processing CreateTablet for tablet d2af60b518a442778196f4cf0c3c918f (DEFAULT_TABLE table=test-workload [id=e136f922237142b6b925c220ae95cd92]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:15:38.733385 26704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2af60b518a442778196f4cf0c3c918f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:38.736469 26832 tablet_bootstrap.cc:654] T 51053577132f400289d135eb01a55020 P ea3ae70a91d24c3e84f03da4605ccede: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:38.731774 26781 tablet_service.cc:1511] Processing CreateTablet for tablet d2af60b518a442778196f4cf0c3c918f (DEFAULT_TABLE table=test-workload [id=e136f922237142b6b925c220ae95cd92]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:15:38.738199 26631 tablet_service.cc:1511] Processing CreateTablet for tablet 61ff419b6fbe4f9e91c20f9347dd8c63 (DEFAULT_TABLE table=test-workload [id=e136f922237142b6b925c220ae95cd92]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:15:38.739318 26781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2af60b518a442778196f4cf0c3c918f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:38.739696 26631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61ff419b6fbe4f9e91c20f9347dd8c63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:38.738296 26833 tablet_bootstrap.cc:492] T 1f02103b62ff4603865811bcb4278c95 P 773a9a5eeb14469389297d0f170bae34: Bootstrap starting.
I20260709 12:15:38.741417 26707 tablet_service.cc:1511] Processing CreateTablet for tablet 61ff419b6fbe4f9e91c20f9347dd8c63 (DEFAULT_TABLE table=test-workload [id=e136f922237142b6b925c220ae95cd92]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:15:38.742941 26707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61ff419b6fbe4f9e91c20f9347dd8c63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:38.748343 26780 tablet_service.cc:1511] Processing CreateTablet for tablet 61ff419b6fbe4f9e91c20f9347dd8c63 (DEFAULT_TABLE table=test-workload [id=e136f922237142b6b925c220ae95cd92]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:15:38.750041 26632 tablet_service.cc:1511] Processing CreateTablet for tablet 0cad4999d89c491b8698a2023cc6d805 (DEFAULT_TABLE table=test-workload [id=e136f922237142b6b925c220ae95cd92]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:15:38.751570 26632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cad4999d89c491b8698a2023cc6d805. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:38.752988 26706 tablet_service.cc:1511] Processing CreateTablet for tablet 0cad4999d89c491b8698a2023cc6d805 (DEFAULT_TABLE table=test-workload [id=e136f922237142b6b925c220ae95cd92]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:15:38.754455 26706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cad4999d89c491b8698a2023cc6d805. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:38.755841 26779 tablet_service.cc:1511] Processing CreateTablet for tablet 0cad4999d89c491b8698a2023cc6d805 (DEFAULT_TABLE table=test-workload [id=e136f922237142b6b925c220ae95cd92]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:15:38.750041 26780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61ff419b6fbe4f9e91c20f9347dd8c63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:38.758358 26833 tablet_bootstrap.cc:654] T 1f02103b62ff4603865811bcb4278c95 P 773a9a5eeb14469389297d0f170bae34: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:38.758934 26779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cad4999d89c491b8698a2023cc6d805. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:38.761264 26630 tablet_service.cc:1511] Processing CreateTablet for tablet ce9b9e0175914633833e79c94d7e6a2a (DEFAULT_TABLE table=test-workload [id=e136f922237142b6b925c220ae95cd92]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:15:38.765527 26630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce9b9e0175914633833e79c94d7e6a2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:38.765995 26834 tablet_bootstrap.cc:492] T 1f02103b62ff4603865811bcb4278c95 P 56539bdd0fcc41a7ae3e12c2f743d6fd: Bootstrap starting.
I20260709 12:15:38.771957 26708 tablet_service.cc:1511] Processing CreateTablet for tablet ce9b9e0175914633833e79c94d7e6a2a (DEFAULT_TABLE table=test-workload [id=e136f922237142b6b925c220ae95cd92]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:15:38.773602 26708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce9b9e0175914633833e79c94d7e6a2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:38.785874 26778 tablet_service.cc:1511] Processing CreateTablet for tablet ce9b9e0175914633833e79c94d7e6a2a (DEFAULT_TABLE table=test-workload [id=e136f922237142b6b925c220ae95cd92]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:15:38.787472 26778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce9b9e0175914633833e79c94d7e6a2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:38.788102 26628 tablet_service.cc:1511] Processing CreateTablet for tablet c258759a737e4ce1be24541ae8bb535f (DEFAULT_TABLE table=test-workload [id=e136f922237142b6b925c220ae95cd92]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:15:38.789609 26628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c258759a737e4ce1be24541ae8bb535f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:38.791953 26705 tablet_service.cc:1511] Processing CreateTablet for tablet c258759a737e4ce1be24541ae8bb535f (DEFAULT_TABLE table=test-workload [id=e136f922237142b6b925c220ae95cd92]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:15:38.793480 26705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c258759a737e4ce1be24541ae8bb535f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:38.808696 26834 tablet_bootstrap.cc:654] T 1f02103b62ff4603865811bcb4278c95 P 56539bdd0fcc41a7ae3e12c2f743d6fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:38.816808 26777 tablet_service.cc:1511] Processing CreateTablet for tablet c258759a737e4ce1be24541ae8bb535f (DEFAULT_TABLE table=test-workload [id=e136f922237142b6b925c220ae95cd92]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:15:38.818470 26777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c258759a737e4ce1be24541ae8bb535f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:38.833073 26832 tablet_bootstrap.cc:492] T 51053577132f400289d135eb01a55020 P ea3ae70a91d24c3e84f03da4605ccede: No bootstrap required, opened a new log
I20260709 12:15:38.834434 26832 ts_tablet_manager.cc:1403] T 51053577132f400289d135eb01a55020 P ea3ae70a91d24c3e84f03da4605ccede: Time spent bootstrapping tablet: real 0.119s	user 0.016s	sys 0.006s
I20260709 12:15:38.844518 26833 tablet_bootstrap.cc:492] T 1f02103b62ff4603865811bcb4278c95 P 773a9a5eeb14469389297d0f170bae34: No bootstrap required, opened a new log
I20260709 12:15:38.845304 26833 ts_tablet_manager.cc:1403] T 1f02103b62ff4603865811bcb4278c95 P 773a9a5eeb14469389297d0f170bae34: Time spent bootstrapping tablet: real 0.107s	user 0.010s	sys 0.017s
I20260709 12:15:38.848840 26833 raft_consensus.cc:359] T 1f02103b62ff4603865811bcb4278c95 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } }
I20260709 12:15:38.849701 26833 raft_consensus.cc:385] T 1f02103b62ff4603865811bcb4278c95 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:38.850186 26833 raft_consensus.cc:740] T 1f02103b62ff4603865811bcb4278c95 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773a9a5eeb14469389297d0f170bae34, State: Initialized, Role: FOLLOWER
I20260709 12:15:38.851143 26833 consensus_queue.cc:260] T 1f02103b62ff4603865811bcb4278c95 P 773a9a5eeb14469389297d0f170bae34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } }
I20260709 12:15:38.861415 26832 raft_consensus.cc:359] T 51053577132f400289d135eb01a55020 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:38.865466 26832 raft_consensus.cc:385] T 51053577132f400289d135eb01a55020 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:38.865971 26832 raft_consensus.cc:740] T 51053577132f400289d135eb01a55020 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3ae70a91d24c3e84f03da4605ccede, State: Initialized, Role: FOLLOWER
I20260709 12:15:38.867842 26832 consensus_queue.cc:260] T 51053577132f400289d135eb01a55020 P ea3ae70a91d24c3e84f03da4605ccede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:38.871205 26833 ts_tablet_manager.cc:1434] T 1f02103b62ff4603865811bcb4278c95 P 773a9a5eeb14469389297d0f170bae34: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.008s
I20260709 12:15:38.872324 26743 heartbeater.cc:499] Master 127.12.56.254:40353 was elected leader, sending a full tablet report...
I20260709 12:15:38.874348 26833 tablet_bootstrap.cc:492] T 6bbb8c707ea042859b5fbe695bab0f44 P 773a9a5eeb14469389297d0f170bae34: Bootstrap starting.
I20260709 12:15:38.881088 26817 heartbeater.cc:499] Master 127.12.56.254:40353 was elected leader, sending a full tablet report...
I20260709 12:15:38.881662 26832 ts_tablet_manager.cc:1434] T 51053577132f400289d135eb01a55020 P ea3ae70a91d24c3e84f03da4605ccede: Time spent starting tablet: real 0.047s	user 0.008s	sys 0.010s
I20260709 12:15:38.882963 26832 tablet_bootstrap.cc:492] T 6bbb8c707ea042859b5fbe695bab0f44 P ea3ae70a91d24c3e84f03da4605ccede: Bootstrap starting.
I20260709 12:15:38.883766 26834 tablet_bootstrap.cc:492] T 1f02103b62ff4603865811bcb4278c95 P 56539bdd0fcc41a7ae3e12c2f743d6fd: No bootstrap required, opened a new log
I20260709 12:15:38.884359 26834 ts_tablet_manager.cc:1403] T 1f02103b62ff4603865811bcb4278c95 P 56539bdd0fcc41a7ae3e12c2f743d6fd: Time spent bootstrapping tablet: real 0.119s	user 0.012s	sys 0.005s
I20260709 12:15:38.884722 26833 tablet_bootstrap.cc:654] T 6bbb8c707ea042859b5fbe695bab0f44 P 773a9a5eeb14469389297d0f170bae34: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:38.887796 26834 raft_consensus.cc:359] T 1f02103b62ff4603865811bcb4278c95 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } }
I20260709 12:15:38.889665 26832 tablet_bootstrap.cc:654] T 6bbb8c707ea042859b5fbe695bab0f44 P ea3ae70a91d24c3e84f03da4605ccede: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:38.890872 26834 raft_consensus.cc:385] T 1f02103b62ff4603865811bcb4278c95 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:38.891374 26834 raft_consensus.cc:740] T 1f02103b62ff4603865811bcb4278c95 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56539bdd0fcc41a7ae3e12c2f743d6fd, State: Initialized, Role: FOLLOWER
I20260709 12:15:38.892357 26834 consensus_queue.cc:260] T 1f02103b62ff4603865811bcb4278c95 P 56539bdd0fcc41a7ae3e12c2f743d6fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } }
I20260709 12:15:38.893491 26833 tablet_bootstrap.cc:492] T 6bbb8c707ea042859b5fbe695bab0f44 P 773a9a5eeb14469389297d0f170bae34: No bootstrap required, opened a new log
I20260709 12:15:38.894426 26833 ts_tablet_manager.cc:1403] T 6bbb8c707ea042859b5fbe695bab0f44 P 773a9a5eeb14469389297d0f170bae34: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.004s
I20260709 12:15:38.898911 26833 raft_consensus.cc:359] T 6bbb8c707ea042859b5fbe695bab0f44 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:38.900151 26833 raft_consensus.cc:385] T 6bbb8c707ea042859b5fbe695bab0f44 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:38.900637 26833 raft_consensus.cc:740] T 6bbb8c707ea042859b5fbe695bab0f44 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773a9a5eeb14469389297d0f170bae34, State: Initialized, Role: FOLLOWER
I20260709 12:15:38.901741 26833 consensus_queue.cc:260] T 6bbb8c707ea042859b5fbe695bab0f44 P 773a9a5eeb14469389297d0f170bae34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:38.905369 26833 ts_tablet_manager.cc:1434] T 6bbb8c707ea042859b5fbe695bab0f44 P 773a9a5eeb14469389297d0f170bae34: Time spent starting tablet: real 0.010s	user 0.000s	sys 0.008s
I20260709 12:15:38.906976 26833 tablet_bootstrap.cc:492] T 51053577132f400289d135eb01a55020 P 773a9a5eeb14469389297d0f170bae34: Bootstrap starting.
I20260709 12:15:38.916339 26833 tablet_bootstrap.cc:654] T 51053577132f400289d135eb01a55020 P 773a9a5eeb14469389297d0f170bae34: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:38.930801 26833 tablet_bootstrap.cc:492] T 51053577132f400289d135eb01a55020 P 773a9a5eeb14469389297d0f170bae34: No bootstrap required, opened a new log
I20260709 12:15:38.931689 26833 ts_tablet_manager.cc:1403] T 51053577132f400289d135eb01a55020 P 773a9a5eeb14469389297d0f170bae34: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.010s
I20260709 12:15:38.936066 26833 raft_consensus.cc:359] T 51053577132f400289d135eb01a55020 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:38.937083 26833 raft_consensus.cc:385] T 51053577132f400289d135eb01a55020 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:38.937508 26833 raft_consensus.cc:740] T 51053577132f400289d135eb01a55020 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773a9a5eeb14469389297d0f170bae34, State: Initialized, Role: FOLLOWER
I20260709 12:15:38.942317 26833 consensus_queue.cc:260] T 51053577132f400289d135eb01a55020 P 773a9a5eeb14469389297d0f170bae34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:38.946400 26833 ts_tablet_manager.cc:1434] T 51053577132f400289d135eb01a55020 P 773a9a5eeb14469389297d0f170bae34: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.002s
I20260709 12:15:38.948065 26833 tablet_bootstrap.cc:492] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 773a9a5eeb14469389297d0f170bae34: Bootstrap starting.
I20260709 12:15:38.957993 26833 tablet_bootstrap.cc:654] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 773a9a5eeb14469389297d0f170bae34: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:38.973276 26844 raft_consensus.cc:493] T 1f02103b62ff4603865811bcb4278c95 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:38.973315 26668 heartbeater.cc:499] Master 127.12.56.254:40353 was elected leader, sending a full tablet report...
I20260709 12:15:38.975132 26834 ts_tablet_manager.cc:1434] T 1f02103b62ff4603865811bcb4278c95 P 56539bdd0fcc41a7ae3e12c2f743d6fd: Time spent starting tablet: real 0.090s	user 0.021s	sys 0.065s
I20260709 12:15:38.975190 26832 tablet_bootstrap.cc:492] T 6bbb8c707ea042859b5fbe695bab0f44 P ea3ae70a91d24c3e84f03da4605ccede: No bootstrap required, opened a new log
I20260709 12:15:38.976240 26832 ts_tablet_manager.cc:1403] T 6bbb8c707ea042859b5fbe695bab0f44 P ea3ae70a91d24c3e84f03da4605ccede: Time spent bootstrapping tablet: real 0.094s	user 0.047s	sys 0.040s
I20260709 12:15:38.976728 26834 tablet_bootstrap.cc:492] T 6bbb8c707ea042859b5fbe695bab0f44 P 56539bdd0fcc41a7ae3e12c2f743d6fd: Bootstrap starting.
I20260709 12:15:38.973937 26844 raft_consensus.cc:515] T 1f02103b62ff4603865811bcb4278c95 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } }
I20260709 12:15:38.980397 26832 raft_consensus.cc:359] T 6bbb8c707ea042859b5fbe695bab0f44 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:38.981700 26832 raft_consensus.cc:385] T 6bbb8c707ea042859b5fbe695bab0f44 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:38.982219 26832 raft_consensus.cc:740] T 6bbb8c707ea042859b5fbe695bab0f44 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3ae70a91d24c3e84f03da4605ccede, State: Initialized, Role: FOLLOWER
I20260709 12:15:38.983496 26832 consensus_queue.cc:260] T 6bbb8c707ea042859b5fbe695bab0f44 P ea3ae70a91d24c3e84f03da4605ccede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:38.986588 26832 ts_tablet_manager.cc:1434] T 6bbb8c707ea042859b5fbe695bab0f44 P ea3ae70a91d24c3e84f03da4605ccede: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 12:15:38.987710 26833 tablet_bootstrap.cc:492] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 773a9a5eeb14469389297d0f170bae34: No bootstrap required, opened a new log
I20260709 12:15:38.987823 26832 tablet_bootstrap.cc:492] T 1f02103b62ff4603865811bcb4278c95 P ea3ae70a91d24c3e84f03da4605ccede: Bootstrap starting.
I20260709 12:15:38.988471 26833 ts_tablet_manager.cc:1403] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 773a9a5eeb14469389297d0f170bae34: Time spent bootstrapping tablet: real 0.041s	user 0.017s	sys 0.004s
I20260709 12:15:38.992333 26833 raft_consensus.cc:359] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:38.993302 26833 raft_consensus.cc:385] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:38.993723 26833 raft_consensus.cc:740] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773a9a5eeb14469389297d0f170bae34, State: Initialized, Role: FOLLOWER
I20260709 12:15:38.994838 26833 consensus_queue.cc:260] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 773a9a5eeb14469389297d0f170bae34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:38.984336 26834 tablet_bootstrap.cc:654] T 6bbb8c707ea042859b5fbe695bab0f44 P 56539bdd0fcc41a7ae3e12c2f743d6fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:38.995792 26832 tablet_bootstrap.cc:654] T 1f02103b62ff4603865811bcb4278c95 P ea3ae70a91d24c3e84f03da4605ccede: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:39.005004 26844 leader_election.cc:290] T 1f02103b62ff4603865811bcb4278c95 P 56539bdd0fcc41a7ae3e12c2f743d6fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195:43987), 773a9a5eeb14469389297d0f170bae34 (127.12.56.194:37781)
I20260709 12:15:39.013855 26792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f02103b62ff4603865811bcb4278c95" candidate_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3ae70a91d24c3e84f03da4605ccede" is_pre_election: true
I20260709 12:15:38.997668 26833 ts_tablet_manager.cc:1434] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 773a9a5eeb14469389297d0f170bae34: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
W20260709 12:15:39.016882 26607 leader_election.cc:343] T 1f02103b62ff4603865811bcb4278c95 P 56539bdd0fcc41a7ae3e12c2f743d6fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195:43987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:39.017282 26833 tablet_bootstrap.cc:492] T 0cad4999d89c491b8698a2023cc6d805 P 773a9a5eeb14469389297d0f170bae34: Bootstrap starting.
I20260709 12:15:39.027076 26833 tablet_bootstrap.cc:654] T 0cad4999d89c491b8698a2023cc6d805 P 773a9a5eeb14469389297d0f170bae34: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:39.035096 26718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f02103b62ff4603865811bcb4278c95" candidate_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773a9a5eeb14469389297d0f170bae34" is_pre_election: true
I20260709 12:15:39.036145 26718 raft_consensus.cc:2468] T 1f02103b62ff4603865811bcb4278c95 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56539bdd0fcc41a7ae3e12c2f743d6fd in term 0.
I20260709 12:15:39.037817 26832 tablet_bootstrap.cc:492] T 1f02103b62ff4603865811bcb4278c95 P ea3ae70a91d24c3e84f03da4605ccede: No bootstrap required, opened a new log
I20260709 12:15:39.038153 26609 leader_election.cc:304] T 1f02103b62ff4603865811bcb4278c95 P 56539bdd0fcc41a7ae3e12c2f743d6fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56539bdd0fcc41a7ae3e12c2f743d6fd, 773a9a5eeb14469389297d0f170bae34; no voters: ea3ae70a91d24c3e84f03da4605ccede
I20260709 12:15:39.038591 26832 ts_tablet_manager.cc:1403] T 1f02103b62ff4603865811bcb4278c95 P ea3ae70a91d24c3e84f03da4605ccede: Time spent bootstrapping tablet: real 0.051s	user 0.015s	sys 0.009s
I20260709 12:15:39.039207 26844 raft_consensus.cc:2804] T 1f02103b62ff4603865811bcb4278c95 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:39.039906 26844 raft_consensus.cc:493] T 1f02103b62ff4603865811bcb4278c95 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:39.040418 26844 raft_consensus.cc:3060] T 1f02103b62ff4603865811bcb4278c95 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:39.044922 26833 tablet_bootstrap.cc:492] T 0cad4999d89c491b8698a2023cc6d805 P 773a9a5eeb14469389297d0f170bae34: No bootstrap required, opened a new log
I20260709 12:15:39.045321 26834 tablet_bootstrap.cc:492] T 6bbb8c707ea042859b5fbe695bab0f44 P 56539bdd0fcc41a7ae3e12c2f743d6fd: No bootstrap required, opened a new log
I20260709 12:15:39.045687 26833 ts_tablet_manager.cc:1403] T 0cad4999d89c491b8698a2023cc6d805 P 773a9a5eeb14469389297d0f170bae34: Time spent bootstrapping tablet: real 0.029s	user 0.017s	sys 0.004s
I20260709 12:15:39.045964 26834 ts_tablet_manager.cc:1403] T 6bbb8c707ea042859b5fbe695bab0f44 P 56539bdd0fcc41a7ae3e12c2f743d6fd: Time spent bootstrapping tablet: real 0.070s	user 0.024s	sys 0.025s
I20260709 12:15:39.048076 26832 raft_consensus.cc:359] T 1f02103b62ff4603865811bcb4278c95 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } }
I20260709 12:15:39.048977 26832 raft_consensus.cc:385] T 1f02103b62ff4603865811bcb4278c95 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:39.049021 26833 raft_consensus.cc:359] T 0cad4999d89c491b8698a2023cc6d805 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:39.049310 26834 raft_consensus.cc:359] T 6bbb8c707ea042859b5fbe695bab0f44 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:39.050009 26833 raft_consensus.cc:385] T 0cad4999d89c491b8698a2023cc6d805 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:39.050437 26834 raft_consensus.cc:385] T 6bbb8c707ea042859b5fbe695bab0f44 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:39.050504 26833 raft_consensus.cc:740] T 0cad4999d89c491b8698a2023cc6d805 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773a9a5eeb14469389297d0f170bae34, State: Initialized, Role: FOLLOWER
I20260709 12:15:39.050998 26834 raft_consensus.cc:740] T 6bbb8c707ea042859b5fbe695bab0f44 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56539bdd0fcc41a7ae3e12c2f743d6fd, State: Initialized, Role: FOLLOWER
I20260709 12:15:39.051640 26833 consensus_queue.cc:260] T 0cad4999d89c491b8698a2023cc6d805 P 773a9a5eeb14469389297d0f170bae34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:39.051896 26834 consensus_queue.cc:260] T 6bbb8c707ea042859b5fbe695bab0f44 P 56539bdd0fcc41a7ae3e12c2f743d6fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:39.049472 26832 raft_consensus.cc:740] T 1f02103b62ff4603865811bcb4278c95 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3ae70a91d24c3e84f03da4605ccede, State: Initialized, Role: FOLLOWER
I20260709 12:15:39.053426 26832 consensus_queue.cc:260] T 1f02103b62ff4603865811bcb4278c95 P ea3ae70a91d24c3e84f03da4605ccede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } }
I20260709 12:15:39.053499 26844 raft_consensus.cc:515] T 1f02103b62ff4603865811bcb4278c95 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } }
I20260709 12:15:39.054230 26833 ts_tablet_manager.cc:1434] T 0cad4999d89c491b8698a2023cc6d805 P 773a9a5eeb14469389297d0f170bae34: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.006s
I20260709 12:15:39.055389 26833 tablet_bootstrap.cc:492] T ce9b9e0175914633833e79c94d7e6a2a P 773a9a5eeb14469389297d0f170bae34: Bootstrap starting.
I20260709 12:15:39.056810 26792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f02103b62ff4603865811bcb4278c95" candidate_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3ae70a91d24c3e84f03da4605ccede"
I20260709 12:15:39.057564 26792 raft_consensus.cc:3060] T 1f02103b62ff4603865811bcb4278c95 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:39.058645 26832 ts_tablet_manager.cc:1434] T 1f02103b62ff4603865811bcb4278c95 P ea3ae70a91d24c3e84f03da4605ccede: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 12:15:39.059819 26832 tablet_bootstrap.cc:492] T d2af60b518a442778196f4cf0c3c918f P ea3ae70a91d24c3e84f03da4605ccede: Bootstrap starting.
I20260709 12:15:39.064435 26833 tablet_bootstrap.cc:654] T ce9b9e0175914633833e79c94d7e6a2a P 773a9a5eeb14469389297d0f170bae34: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:39.065949 26844 leader_election.cc:290] T 1f02103b62ff4603865811bcb4278c95 P 56539bdd0fcc41a7ae3e12c2f743d6fd [CANDIDATE]: Term 1 election: Requested vote from peers ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195:43987), 773a9a5eeb14469389297d0f170bae34 (127.12.56.194:37781)
I20260709 12:15:39.069084 26718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f02103b62ff4603865811bcb4278c95" candidate_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773a9a5eeb14469389297d0f170bae34"
I20260709 12:15:39.069841 26718 raft_consensus.cc:3060] T 1f02103b62ff4603865811bcb4278c95 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:39.072157 26834 ts_tablet_manager.cc:1434] T 6bbb8c707ea042859b5fbe695bab0f44 P 56539bdd0fcc41a7ae3e12c2f743d6fd: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.001s
I20260709 12:15:39.073321 26834 tablet_bootstrap.cc:492] T 51053577132f400289d135eb01a55020 P 56539bdd0fcc41a7ae3e12c2f743d6fd: Bootstrap starting.
I20260709 12:15:39.081439 26832 tablet_bootstrap.cc:654] T d2af60b518a442778196f4cf0c3c918f P ea3ae70a91d24c3e84f03da4605ccede: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:39.091766 26833 tablet_bootstrap.cc:492] T ce9b9e0175914633833e79c94d7e6a2a P 773a9a5eeb14469389297d0f170bae34: No bootstrap required, opened a new log
I20260709 12:15:39.083415 26718 raft_consensus.cc:2468] T 1f02103b62ff4603865811bcb4278c95 P 773a9a5eeb14469389297d0f170bae34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56539bdd0fcc41a7ae3e12c2f743d6fd in term 1.
I20260709 12:15:39.092562 26833 ts_tablet_manager.cc:1403] T ce9b9e0175914633833e79c94d7e6a2a P 773a9a5eeb14469389297d0f170bae34: Time spent bootstrapping tablet: real 0.037s	user 0.014s	sys 0.015s
I20260709 12:15:39.094007 26609 leader_election.cc:304] T 1f02103b62ff4603865811bcb4278c95 P 56539bdd0fcc41a7ae3e12c2f743d6fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56539bdd0fcc41a7ae3e12c2f743d6fd, 773a9a5eeb14469389297d0f170bae34; no voters: 
I20260709 12:15:39.091167 26834 tablet_bootstrap.cc:654] T 51053577132f400289d135eb01a55020 P 56539bdd0fcc41a7ae3e12c2f743d6fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:39.096477 26833 raft_consensus.cc:359] T ce9b9e0175914633833e79c94d7e6a2a P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:39.097343 26844 raft_consensus.cc:2804] T 1f02103b62ff4603865811bcb4278c95 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:39.097467 26833 raft_consensus.cc:385] T ce9b9e0175914633833e79c94d7e6a2a P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:39.098088 26844 raft_consensus.cc:697] T 1f02103b62ff4603865811bcb4278c95 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 LEADER]: Becoming Leader. State: Replica: 56539bdd0fcc41a7ae3e12c2f743d6fd, State: Running, Role: LEADER
I20260709 12:15:39.097973 26833 raft_consensus.cc:740] T ce9b9e0175914633833e79c94d7e6a2a P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773a9a5eeb14469389297d0f170bae34, State: Initialized, Role: FOLLOWER
I20260709 12:15:39.099182 26844 consensus_queue.cc:237] T 1f02103b62ff4603865811bcb4278c95 P 56539bdd0fcc41a7ae3e12c2f743d6fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } }
I20260709 12:15:39.099226 26833 consensus_queue.cc:260] T ce9b9e0175914633833e79c94d7e6a2a P 773a9a5eeb14469389297d0f170bae34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:39.101994 26833 ts_tablet_manager.cc:1434] T ce9b9e0175914633833e79c94d7e6a2a P 773a9a5eeb14469389297d0f170bae34: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 12:15:39.103479 26833 tablet_bootstrap.cc:492] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 773a9a5eeb14469389297d0f170bae34: Bootstrap starting.
I20260709 12:15:39.117833 26792 raft_consensus.cc:2468] T 1f02103b62ff4603865811bcb4278c95 P ea3ae70a91d24c3e84f03da4605ccede [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56539bdd0fcc41a7ae3e12c2f743d6fd in term 1.
I20260709 12:15:39.119707 26833 tablet_bootstrap.cc:654] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 773a9a5eeb14469389297d0f170bae34: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:39.122272 26834 tablet_bootstrap.cc:492] T 51053577132f400289d135eb01a55020 P 56539bdd0fcc41a7ae3e12c2f743d6fd: No bootstrap required, opened a new log
I20260709 12:15:39.123478 26834 ts_tablet_manager.cc:1403] T 51053577132f400289d135eb01a55020 P 56539bdd0fcc41a7ae3e12c2f743d6fd: Time spent bootstrapping tablet: real 0.050s	user 0.023s	sys 0.010s
I20260709 12:15:39.128230 26834 raft_consensus.cc:359] T 51053577132f400289d135eb01a55020 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:39.129400 26834 raft_consensus.cc:385] T 51053577132f400289d135eb01a55020 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:39.129825 26834 raft_consensus.cc:740] T 51053577132f400289d135eb01a55020 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56539bdd0fcc41a7ae3e12c2f743d6fd, State: Initialized, Role: FOLLOWER
I20260709 12:15:39.130517 26842 raft_consensus.cc:493] T 6bbb8c707ea042859b5fbe695bab0f44 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:39.131161 26842 raft_consensus.cc:515] T 6bbb8c707ea042859b5fbe695bab0f44 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:39.133388 26833 tablet_bootstrap.cc:492] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 773a9a5eeb14469389297d0f170bae34: No bootstrap required, opened a new log
I20260709 12:15:39.134053 26833 ts_tablet_manager.cc:1403] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 773a9a5eeb14469389297d0f170bae34: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.008s
I20260709 12:15:39.133424 26842 leader_election.cc:290] T 6bbb8c707ea042859b5fbe695bab0f44 P 56539bdd0fcc41a7ae3e12c2f743d6fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 773a9a5eeb14469389297d0f170bae34 (127.12.56.194:37781), ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195:43987)
W20260709 12:15:39.136714 26589 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:39.137177 26718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbb8c707ea042859b5fbe695bab0f44" candidate_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773a9a5eeb14469389297d0f170bae34" is_pre_election: true
I20260709 12:15:39.137529 26833 raft_consensus.cc:359] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:39.138392 26833 raft_consensus.cc:385] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:39.138820 26833 raft_consensus.cc:740] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773a9a5eeb14469389297d0f170bae34, State: Initialized, Role: FOLLOWER
I20260709 12:15:39.139242 26792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbb8c707ea042859b5fbe695bab0f44" candidate_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3ae70a91d24c3e84f03da4605ccede" is_pre_election: true
I20260709 12:15:39.140257 26792 raft_consensus.cc:2468] T 6bbb8c707ea042859b5fbe695bab0f44 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56539bdd0fcc41a7ae3e12c2f743d6fd in term 0.
I20260709 12:15:39.139740 26833 consensus_queue.cc:260] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 773a9a5eeb14469389297d0f170bae34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:39.142320 26607 leader_election.cc:304] T 6bbb8c707ea042859b5fbe695bab0f44 P 56539bdd0fcc41a7ae3e12c2f743d6fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56539bdd0fcc41a7ae3e12c2f743d6fd, ea3ae70a91d24c3e84f03da4605ccede; no voters: 
I20260709 12:15:39.143265 26833 ts_tablet_manager.cc:1434] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 773a9a5eeb14469389297d0f170bae34: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:15:39.143558 26842 raft_consensus.cc:2804] T 6bbb8c707ea042859b5fbe695bab0f44 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:39.138226 26718 raft_consensus.cc:2468] T 6bbb8c707ea042859b5fbe695bab0f44 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56539bdd0fcc41a7ae3e12c2f743d6fd in term 0.
I20260709 12:15:39.144079 26842 raft_consensus.cc:493] T 6bbb8c707ea042859b5fbe695bab0f44 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:39.144645 26833 tablet_bootstrap.cc:492] T d2af60b518a442778196f4cf0c3c918f P 773a9a5eeb14469389297d0f170bae34: Bootstrap starting.
I20260709 12:15:39.144625 26842 raft_consensus.cc:3060] T 6bbb8c707ea042859b5fbe695bab0f44 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:39.151942 26834 consensus_queue.cc:260] T 51053577132f400289d135eb01a55020 P 56539bdd0fcc41a7ae3e12c2f743d6fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:39.157208 26833 tablet_bootstrap.cc:654] T d2af60b518a442778196f4cf0c3c918f P 773a9a5eeb14469389297d0f170bae34: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:39.158593 26838 raft_consensus.cc:493] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:39.159232 26838 raft_consensus.cc:515] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:39.221300 26838 leader_election.cc:290] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 773a9a5eeb14469389297d0f170bae34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813), ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195:43987)
I20260709 12:15:39.223009 26838 raft_consensus.cc:493] T ce9b9e0175914633833e79c94d7e6a2a P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:39.225137 26838 raft_consensus.cc:515] T ce9b9e0175914633833e79c94d7e6a2a P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:39.245379 26838 leader_election.cc:290] T ce9b9e0175914633833e79c94d7e6a2a P 773a9a5eeb14469389297d0f170bae34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813), ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195:43987)
I20260709 12:15:39.284879 26842 raft_consensus.cc:515] T 6bbb8c707ea042859b5fbe695bab0f44 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:39.286098 26858 raft_consensus.cc:493] T 0cad4999d89c491b8698a2023cc6d805 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:39.286972 26858 raft_consensus.cc:515] T 0cad4999d89c491b8698a2023cc6d805 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:39.289947 26858 leader_election.cc:290] T 0cad4999d89c491b8698a2023cc6d805 P 773a9a5eeb14469389297d0f170bae34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813), ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195:43987)
I20260709 12:15:39.287428 26842 leader_election.cc:290] T 6bbb8c707ea042859b5fbe695bab0f44 P 56539bdd0fcc41a7ae3e12c2f743d6fd [CANDIDATE]: Term 1 election: Requested vote from peers 773a9a5eeb14469389297d0f170bae34 (127.12.56.194:37781), ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195:43987)
I20260709 12:15:39.295239 26834 ts_tablet_manager.cc:1434] T 51053577132f400289d135eb01a55020 P 56539bdd0fcc41a7ae3e12c2f743d6fd: Time spent starting tablet: real 0.171s	user 0.023s	sys 0.066s
I20260709 12:15:39.296159 26832 tablet_bootstrap.cc:492] T d2af60b518a442778196f4cf0c3c918f P ea3ae70a91d24c3e84f03da4605ccede: No bootstrap required, opened a new log
I20260709 12:15:39.296730 26834 tablet_bootstrap.cc:492] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 56539bdd0fcc41a7ae3e12c2f743d6fd: Bootstrap starting.
I20260709 12:15:39.296868 26832 ts_tablet_manager.cc:1403] T d2af60b518a442778196f4cf0c3c918f P ea3ae70a91d24c3e84f03da4605ccede: Time spent bootstrapping tablet: real 0.237s	user 0.053s	sys 0.110s
I20260709 12:15:39.306152 26833 tablet_bootstrap.cc:492] T d2af60b518a442778196f4cf0c3c918f P 773a9a5eeb14469389297d0f170bae34: No bootstrap required, opened a new log
I20260709 12:15:39.306263 26834 tablet_bootstrap.cc:654] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 56539bdd0fcc41a7ae3e12c2f743d6fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:39.307106 26833 ts_tablet_manager.cc:1403] T d2af60b518a442778196f4cf0c3c918f P 773a9a5eeb14469389297d0f170bae34: Time spent bootstrapping tablet: real 0.163s	user 0.034s	sys 0.045s
I20260709 12:15:39.310691 26839 raft_consensus.cc:493] T 51053577132f400289d135eb01a55020 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:39.311421 26839 raft_consensus.cc:515] T 51053577132f400289d135eb01a55020 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:39.310648 26833 raft_consensus.cc:359] T d2af60b518a442778196f4cf0c3c918f P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:39.381328 26833 raft_consensus.cc:385] T d2af60b518a442778196f4cf0c3c918f P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:39.381711 26833 raft_consensus.cc:740] T d2af60b518a442778196f4cf0c3c918f P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773a9a5eeb14469389297d0f170bae34, State: Initialized, Role: FOLLOWER
I20260709 12:15:39.382685 26833 consensus_queue.cc:260] T d2af60b518a442778196f4cf0c3c918f P 773a9a5eeb14469389297d0f170bae34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:39.384987 26833 ts_tablet_manager.cc:1434] T d2af60b518a442778196f4cf0c3c918f P 773a9a5eeb14469389297d0f170bae34: Time spent starting tablet: real 0.077s	user 0.009s	sys 0.000s
I20260709 12:15:39.386078 26833 tablet_bootstrap.cc:492] T c258759a737e4ce1be24541ae8bb535f P 773a9a5eeb14469389297d0f170bae34: Bootstrap starting.
I20260709 12:15:39.393044 26833 tablet_bootstrap.cc:654] T c258759a737e4ce1be24541ae8bb535f P 773a9a5eeb14469389297d0f170bae34: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:39.398833 26833 tablet_bootstrap.cc:492] T c258759a737e4ce1be24541ae8bb535f P 773a9a5eeb14469389297d0f170bae34: No bootstrap required, opened a new log
I20260709 12:15:39.399391 26833 ts_tablet_manager.cc:1403] T c258759a737e4ce1be24541ae8bb535f P 773a9a5eeb14469389297d0f170bae34: Time spent bootstrapping tablet: real 0.014s	user 0.008s	sys 0.003s
I20260709 12:15:39.400087 26834 tablet_bootstrap.cc:492] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 56539bdd0fcc41a7ae3e12c2f743d6fd: No bootstrap required, opened a new log
I20260709 12:15:39.400740 26834 ts_tablet_manager.cc:1403] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 56539bdd0fcc41a7ae3e12c2f743d6fd: Time spent bootstrapping tablet: real 0.104s	user 0.019s	sys 0.005s
I20260709 12:15:39.402120 26833 raft_consensus.cc:359] T c258759a737e4ce1be24541ae8bb535f P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:39.402787 26833 raft_consensus.cc:385] T c258759a737e4ce1be24541ae8bb535f P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:39.403038 26833 raft_consensus.cc:740] T c258759a737e4ce1be24541ae8bb535f P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773a9a5eeb14469389297d0f170bae34, State: Initialized, Role: FOLLOWER
I20260709 12:15:39.403858 26833 consensus_queue.cc:260] T c258759a737e4ce1be24541ae8bb535f P 773a9a5eeb14469389297d0f170bae34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:39.403854 26834 raft_consensus.cc:359] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:39.404804 26834 raft_consensus.cc:385] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:39.405224 26834 raft_consensus.cc:740] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56539bdd0fcc41a7ae3e12c2f743d6fd, State: Initialized, Role: FOLLOWER
I20260709 12:15:39.406268 26833 ts_tablet_manager.cc:1434] T c258759a737e4ce1be24541ae8bb535f P 773a9a5eeb14469389297d0f170bae34: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:15:39.406152 26834 consensus_queue.cc:260] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 56539bdd0fcc41a7ae3e12c2f743d6fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:39.409183 26834 ts_tablet_manager.cc:1434] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 56539bdd0fcc41a7ae3e12c2f743d6fd: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.001s
I20260709 12:15:39.410329 26834 tablet_bootstrap.cc:492] T d2af60b518a442778196f4cf0c3c918f P 56539bdd0fcc41a7ae3e12c2f743d6fd: Bootstrap starting.
I20260709 12:15:39.313220 26832 raft_consensus.cc:359] T d2af60b518a442778196f4cf0c3c918f P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:39.413419 26832 raft_consensus.cc:385] T d2af60b518a442778196f4cf0c3c918f P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:39.414110 26832 raft_consensus.cc:740] T d2af60b518a442778196f4cf0c3c918f P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3ae70a91d24c3e84f03da4605ccede, State: Initialized, Role: FOLLOWER
I20260709 12:15:39.415015 26832 consensus_queue.cc:260] T d2af60b518a442778196f4cf0c3c918f P ea3ae70a91d24c3e84f03da4605ccede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:39.418498 26834 tablet_bootstrap.cc:654] T d2af60b518a442778196f4cf0c3c918f P 56539bdd0fcc41a7ae3e12c2f743d6fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:39.420644 26832 ts_tablet_manager.cc:1434] T d2af60b518a442778196f4cf0c3c918f P ea3ae70a91d24c3e84f03da4605ccede: Time spent starting tablet: real 0.123s	user 0.007s	sys 0.004s
I20260709 12:15:39.420578 26858 raft_consensus.cc:493] T 51053577132f400289d135eb01a55020 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:39.421561 26858 raft_consensus.cc:515] T 51053577132f400289d135eb01a55020 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:39.422386 26832 tablet_bootstrap.cc:492] T ce9b9e0175914633833e79c94d7e6a2a P ea3ae70a91d24c3e84f03da4605ccede: Bootstrap starting.
I20260709 12:15:39.423934 26789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cad4999d89c491b8698a2023cc6d805" candidate_uuid: "773a9a5eeb14469389297d0f170bae34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3ae70a91d24c3e84f03da4605ccede" is_pre_election: true
I20260709 12:15:39.425241 26790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9b9e0175914633833e79c94d7e6a2a" candidate_uuid: "773a9a5eeb14469389297d0f170bae34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3ae70a91d24c3e84f03da4605ccede" is_pre_election: true
I20260709 12:15:39.424212 26858 leader_election.cc:290] T 51053577132f400289d135eb01a55020 P 773a9a5eeb14469389297d0f170bae34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813), ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195:43987)
I20260709 12:15:39.427572 26839 leader_election.cc:290] T 51053577132f400289d135eb01a55020 P ea3ae70a91d24c3e84f03da4605ccede [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813), 773a9a5eeb14469389297d0f170bae34 (127.12.56.194:37781)
I20260709 12:15:39.432549 26718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbb8c707ea042859b5fbe695bab0f44" candidate_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773a9a5eeb14469389297d0f170bae34"
I20260709 12:15:39.432626 26832 tablet_bootstrap.cc:654] T ce9b9e0175914633833e79c94d7e6a2a P ea3ae70a91d24c3e84f03da4605ccede: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:39.434060 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a21937cb47f14ac0b40ea7c7c6e9cab9" candidate_uuid: "773a9a5eeb14469389297d0f170bae34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3ae70a91d24c3e84f03da4605ccede" is_pre_election: true
I20260709 12:15:39.434443 26792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bbb8c707ea042859b5fbe695bab0f44" candidate_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3ae70a91d24c3e84f03da4605ccede"
I20260709 12:15:39.435117 26792 raft_consensus.cc:3060] T 6bbb8c707ea042859b5fbe695bab0f44 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:39.433382 26718 raft_consensus.cc:3060] T 6bbb8c707ea042859b5fbe695bab0f44 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:39.442629 26682 leader_election.cc:343] T 0cad4999d89c491b8698a2023cc6d805 P 773a9a5eeb14469389297d0f170bae34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195:43987): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:39.443768 26682 leader_election.cc:343] T ce9b9e0175914633833e79c94d7e6a2a P 773a9a5eeb14469389297d0f170bae34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195:43987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:39.447952 26540 catalog_manager.cc:5697] T 1f02103b62ff4603865811bcb4278c95 P 56539bdd0fcc41a7ae3e12c2f743d6fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193). New cstate: current_term: 1 leader_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:39.447934 26834 tablet_bootstrap.cc:492] T d2af60b518a442778196f4cf0c3c918f P 56539bdd0fcc41a7ae3e12c2f743d6fd: No bootstrap required, opened a new log
I20260709 12:15:39.454010 26834 ts_tablet_manager.cc:1403] T d2af60b518a442778196f4cf0c3c918f P 56539bdd0fcc41a7ae3e12c2f743d6fd: Time spent bootstrapping tablet: real 0.044s	user 0.018s	sys 0.008s
I20260709 12:15:39.459342 26643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a21937cb47f14ac0b40ea7c7c6e9cab9" candidate_uuid: "773a9a5eeb14469389297d0f170bae34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" is_pre_election: true
I20260709 12:15:39.460336 26643 raft_consensus.cc:2468] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773a9a5eeb14469389297d0f170bae34 in term 0.
I20260709 12:15:39.460407 26834 raft_consensus.cc:359] T d2af60b518a442778196f4cf0c3c918f P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:39.461663 26834 raft_consensus.cc:385] T d2af60b518a442778196f4cf0c3c918f P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:39.464167 26856 raft_consensus.cc:493] T 51053577132f400289d135eb01a55020 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:39.466161 26641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51053577132f400289d135eb01a55020" candidate_uuid: "773a9a5eeb14469389297d0f170bae34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" is_pre_election: true
I20260709 12:15:39.466562 26856 raft_consensus.cc:515] T 51053577132f400289d135eb01a55020 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:39.467342 26643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9b9e0175914633833e79c94d7e6a2a" candidate_uuid: "773a9a5eeb14469389297d0f170bae34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" is_pre_election: true
I20260709 12:15:39.465041 26642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cad4999d89c491b8698a2023cc6d805" candidate_uuid: "773a9a5eeb14469389297d0f170bae34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" is_pre_election: true
I20260709 12:15:39.468638 26641 raft_consensus.cc:2468] T 51053577132f400289d135eb01a55020 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773a9a5eeb14469389297d0f170bae34 in term 0.
I20260709 12:15:39.465308 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51053577132f400289d135eb01a55020" candidate_uuid: "773a9a5eeb14469389297d0f170bae34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3ae70a91d24c3e84f03da4605ccede" is_pre_election: true
I20260709 12:15:39.473248 26791 raft_consensus.cc:2468] T 51053577132f400289d135eb01a55020 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773a9a5eeb14469389297d0f170bae34 in term 0.
I20260709 12:15:39.473331 26790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51053577132f400289d135eb01a55020" candidate_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3ae70a91d24c3e84f03da4605ccede" is_pre_election: true
I20260709 12:15:39.473073 26856 leader_election.cc:290] T 51053577132f400289d135eb01a55020 P 56539bdd0fcc41a7ae3e12c2f743d6fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 773a9a5eeb14469389297d0f170bae34 (127.12.56.194:37781), ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195:43987)
I20260709 12:15:39.474301 26790 raft_consensus.cc:2468] T 51053577132f400289d135eb01a55020 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56539bdd0fcc41a7ae3e12c2f743d6fd in term 0.
I20260709 12:15:39.474792 26834 raft_consensus.cc:740] T d2af60b518a442778196f4cf0c3c918f P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56539bdd0fcc41a7ae3e12c2f743d6fd, State: Initialized, Role: FOLLOWER
I20260709 12:15:39.476022 26607 leader_election.cc:304] T 51053577132f400289d135eb01a55020 P 56539bdd0fcc41a7ae3e12c2f743d6fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56539bdd0fcc41a7ae3e12c2f743d6fd, ea3ae70a91d24c3e84f03da4605ccede; no voters: 
I20260709 12:15:39.477415 26858 raft_consensus.cc:493] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:39.478829 26717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51053577132f400289d135eb01a55020" candidate_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773a9a5eeb14469389297d0f170bae34" is_pre_election: true
I20260709 12:15:39.477095 26834 consensus_queue.cc:260] T d2af60b518a442778196f4cf0c3c918f P 56539bdd0fcc41a7ae3e12c2f743d6fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:39.479755 26681 leader_election.cc:304] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 773a9a5eeb14469389297d0f170bae34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56539bdd0fcc41a7ae3e12c2f743d6fd, 773a9a5eeb14469389297d0f170bae34; no voters: 
I20260709 12:15:39.484458 26717 raft_consensus.cc:2468] T 51053577132f400289d135eb01a55020 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56539bdd0fcc41a7ae3e12c2f743d6fd in term 0.
I20260709 12:15:39.480856 26856 raft_consensus.cc:2804] T 51053577132f400289d135eb01a55020 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:39.485198 26856 raft_consensus.cc:493] T 51053577132f400289d135eb01a55020 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:39.485811 26856 raft_consensus.cc:3060] T 51053577132f400289d135eb01a55020 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:39.488319 26858 raft_consensus.cc:515] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
W20260709 12:15:39.489904 26682 leader_election.cc:343] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 773a9a5eeb14469389297d0f170bae34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195:43987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:39.490880 26838 raft_consensus.cc:2804] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:39.492740 26838 raft_consensus.cc:493] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:39.493247 26838 raft_consensus.cc:3060] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:39.493991 26641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51053577132f400289d135eb01a55020" candidate_uuid: "ea3ae70a91d24c3e84f03da4605ccede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" is_pre_election: true
I20260709 12:15:39.503535 26834 ts_tablet_manager.cc:1434] T d2af60b518a442778196f4cf0c3c918f P 56539bdd0fcc41a7ae3e12c2f743d6fd: Time spent starting tablet: real 0.049s	user 0.009s	sys 0.000s
I20260709 12:15:39.504050 26718 raft_consensus.cc:2468] T 6bbb8c707ea042859b5fbe695bab0f44 P 773a9a5eeb14469389297d0f170bae34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56539bdd0fcc41a7ae3e12c2f743d6fd in term 1.
I20260709 12:15:39.504989 26834 tablet_bootstrap.cc:492] T 0cad4999d89c491b8698a2023cc6d805 P 56539bdd0fcc41a7ae3e12c2f743d6fd: Bootstrap starting.
I20260709 12:15:39.491130 26858 leader_election.cc:290] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 773a9a5eeb14469389297d0f170bae34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813), ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195:43987)
W20260709 12:15:39.491886 26681 leader_election.cc:343] T ce9b9e0175914633833e79c94d7e6a2a P 773a9a5eeb14469389297d0f170bae34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:39.508939 26842 consensus_queue.cc:1048] T 1f02103b62ff4603865811bcb4278c95 P 56539bdd0fcc41a7ae3e12c2f743d6fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:39.509878 26681 leader_election.cc:304] T ce9b9e0175914633833e79c94d7e6a2a P 773a9a5eeb14469389297d0f170bae34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773a9a5eeb14469389297d0f170bae34; no voters: 56539bdd0fcc41a7ae3e12c2f743d6fd, ea3ae70a91d24c3e84f03da4605ccede
W20260709 12:15:39.511372 26681 leader_election.cc:343] T 0cad4999d89c491b8698a2023cc6d805 P 773a9a5eeb14469389297d0f170bae34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:39.514706 26856 raft_consensus.cc:515] T 51053577132f400289d135eb01a55020 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:39.516070 26641 raft_consensus.cc:2393] T 51053577132f400289d135eb01a55020 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea3ae70a91d24c3e84f03da4605ccede in current term 1: Already voted for candidate 56539bdd0fcc41a7ae3e12c2f743d6fd in this term.
I20260709 12:15:39.515758 26858 raft_consensus.cc:2749] T ce9b9e0175914633833e79c94d7e6a2a P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:39.511835 26681 leader_election.cc:304] T 0cad4999d89c491b8698a2023cc6d805 P 773a9a5eeb14469389297d0f170bae34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773a9a5eeb14469389297d0f170bae34; no voters: 56539bdd0fcc41a7ae3e12c2f743d6fd, ea3ae70a91d24c3e84f03da4605ccede
I20260709 12:15:39.522017 26858 raft_consensus.cc:2749] T 0cad4999d89c491b8698a2023cc6d805 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:39.524600 26682 leader_election.cc:304] T 51053577132f400289d135eb01a55020 P 773a9a5eeb14469389297d0f170bae34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773a9a5eeb14469389297d0f170bae34, ea3ae70a91d24c3e84f03da4605ccede; no voters: 
I20260709 12:15:39.527376 26856 leader_election.cc:290] T 51053577132f400289d135eb01a55020 P 56539bdd0fcc41a7ae3e12c2f743d6fd [CANDIDATE]: Term 1 election: Requested vote from peers 773a9a5eeb14469389297d0f170bae34 (127.12.56.194:37781), ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195:43987)
I20260709 12:15:39.524947 26792 raft_consensus.cc:2468] T 6bbb8c707ea042859b5fbe695bab0f44 P ea3ae70a91d24c3e84f03da4605ccede [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56539bdd0fcc41a7ae3e12c2f743d6fd in term 1.
I20260709 12:15:39.529474 26607 leader_election.cc:304] T 6bbb8c707ea042859b5fbe695bab0f44 P 56539bdd0fcc41a7ae3e12c2f743d6fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56539bdd0fcc41a7ae3e12c2f743d6fd, ea3ae70a91d24c3e84f03da4605ccede; no voters: 
I20260709 12:15:39.530580 26834 tablet_bootstrap.cc:654] T 0cad4999d89c491b8698a2023cc6d805 P 56539bdd0fcc41a7ae3e12c2f743d6fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:39.530853 26792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51053577132f400289d135eb01a55020" candidate_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3ae70a91d24c3e84f03da4605ccede"
I20260709 12:15:39.531647 26792 raft_consensus.cc:3060] T 51053577132f400289d135eb01a55020 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:39.532975 26641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ff419b6fbe4f9e91c20f9347dd8c63" candidate_uuid: "773a9a5eeb14469389297d0f170bae34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" is_pre_election: true
I20260709 12:15:39.537177 26858 raft_consensus.cc:2804] T 51053577132f400289d135eb01a55020 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:39.538059 26858 raft_consensus.cc:493] T 51053577132f400289d135eb01a55020 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:39.538895 26858 raft_consensus.cc:3060] T 51053577132f400289d135eb01a55020 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:39.539009 26681 leader_election.cc:343] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 773a9a5eeb14469389297d0f170bae34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:39.545116 26790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ff419b6fbe4f9e91c20f9347dd8c63" candidate_uuid: "773a9a5eeb14469389297d0f170bae34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3ae70a91d24c3e84f03da4605ccede" is_pre_election: true
I20260709 12:15:39.544971 26838 raft_consensus.cc:515] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 773a9a5eeb14469389297d0f170bae34 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:39.549551 26838 leader_election.cc:290] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 773a9a5eeb14469389297d0f170bae34 [CANDIDATE]: Term 1 election: Requested vote from peers 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813), ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195:43987)
I20260709 12:15:39.550055 26718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51053577132f400289d135eb01a55020" candidate_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773a9a5eeb14469389297d0f170bae34"
I20260709 12:15:39.554315 26856 raft_consensus.cc:2804] T 6bbb8c707ea042859b5fbe695bab0f44 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:15:39.561684 26682 leader_election.cc:343] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 773a9a5eeb14469389297d0f170bae34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195:43987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:39.561439 26641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a21937cb47f14ac0b40ea7c7c6e9cab9" candidate_uuid: "773a9a5eeb14469389297d0f170bae34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd"
I20260709 12:15:39.561859 26858 raft_consensus.cc:515] T 51053577132f400289d135eb01a55020 P 773a9a5eeb14469389297d0f170bae34 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:39.562309 26717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51053577132f400289d135eb01a55020" candidate_uuid: "ea3ae70a91d24c3e84f03da4605ccede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773a9a5eeb14469389297d0f170bae34" is_pre_election: true
I20260709 12:15:39.570087 26641 raft_consensus.cc:3060] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:39.571175 26842 consensus_queue.cc:1048] T 1f02103b62ff4603865811bcb4278c95 P 56539bdd0fcc41a7ae3e12c2f743d6fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:39.572734 26832 tablet_bootstrap.cc:492] T ce9b9e0175914633833e79c94d7e6a2a P ea3ae70a91d24c3e84f03da4605ccede: No bootstrap required, opened a new log
I20260709 12:15:39.573355 26832 ts_tablet_manager.cc:1403] T ce9b9e0175914633833e79c94d7e6a2a P ea3ae70a91d24c3e84f03da4605ccede: Time spent bootstrapping tablet: real 0.151s	user 0.032s	sys 0.074s
I20260709 12:15:39.568455 26790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a21937cb47f14ac0b40ea7c7c6e9cab9" candidate_uuid: "773a9a5eeb14469389297d0f170bae34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3ae70a91d24c3e84f03da4605ccede"
I20260709 12:15:39.577817 26838 raft_consensus.cc:493] T d2af60b518a442778196f4cf0c3c918f P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:39.576767 26832 raft_consensus.cc:359] T ce9b9e0175914633833e79c94d7e6a2a P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:39.582978 26832 raft_consensus.cc:385] T ce9b9e0175914633833e79c94d7e6a2a P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:39.583021 26838 raft_consensus.cc:515] T d2af60b518a442778196f4cf0c3c918f P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:39.583546 26832 raft_consensus.cc:740] T ce9b9e0175914633833e79c94d7e6a2a P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3ae70a91d24c3e84f03da4605ccede, State: Initialized, Role: FOLLOWER
I20260709 12:15:39.585410 26832 consensus_queue.cc:260] T ce9b9e0175914633833e79c94d7e6a2a P ea3ae70a91d24c3e84f03da4605ccede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:39.586743 26642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2af60b518a442778196f4cf0c3c918f" candidate_uuid: "773a9a5eeb14469389297d0f170bae34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" is_pre_election: true
I20260709 12:15:39.586757 26838 leader_election.cc:290] T d2af60b518a442778196f4cf0c3c918f P 773a9a5eeb14469389297d0f170bae34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813), ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195:43987)
I20260709 12:15:39.588286 26642 raft_consensus.cc:2468] T d2af60b518a442778196f4cf0c3c918f P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773a9a5eeb14469389297d0f170bae34 in term 0.
I20260709 12:15:39.589123 26641 raft_consensus.cc:2468] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773a9a5eeb14469389297d0f170bae34 in term 1.
I20260709 12:15:39.587343 26718 raft_consensus.cc:2393] T 51053577132f400289d135eb01a55020 P 773a9a5eeb14469389297d0f170bae34 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 56539bdd0fcc41a7ae3e12c2f743d6fd in current term 1: Already voted for candidate 773a9a5eeb14469389297d0f170bae34 in this term.
I20260709 12:15:39.589939 26681 leader_election.cc:304] T d2af60b518a442778196f4cf0c3c918f P 773a9a5eeb14469389297d0f170bae34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56539bdd0fcc41a7ae3e12c2f743d6fd, 773a9a5eeb14469389297d0f170bae34; no voters: 
I20260709 12:15:39.591408 26858 leader_election.cc:290] T 51053577132f400289d135eb01a55020 P 773a9a5eeb14469389297d0f170bae34 [CANDIDATE]: Term 1 election: Requested vote from peers 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813), ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195:43987)
I20260709 12:15:39.591543 26681 leader_election.cc:304] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 773a9a5eeb14469389297d0f170bae34 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56539bdd0fcc41a7ae3e12c2f743d6fd, 773a9a5eeb14469389297d0f170bae34; no voters: 
I20260709 12:15:39.598784 26856 raft_consensus.cc:697] T 6bbb8c707ea042859b5fbe695bab0f44 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 LEADER]: Becoming Leader. State: Replica: 56539bdd0fcc41a7ae3e12c2f743d6fd, State: Running, Role: LEADER
I20260709 12:15:39.592034 26642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51053577132f400289d135eb01a55020" candidate_uuid: "773a9a5eeb14469389297d0f170bae34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd"
I20260709 12:15:39.599249 26838 raft_consensus.cc:2804] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 773a9a5eeb14469389297d0f170bae34 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:39.606233 26642 raft_consensus.cc:2393] T 51053577132f400289d135eb01a55020 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 773a9a5eeb14469389297d0f170bae34 in current term 1: Already voted for candidate 56539bdd0fcc41a7ae3e12c2f743d6fd in this term.
I20260709 12:15:39.606328 26856 consensus_queue.cc:237] T 6bbb8c707ea042859b5fbe695bab0f44 P 56539bdd0fcc41a7ae3e12c2f743d6fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:39.592113 26858 raft_consensus.cc:2804] T d2af60b518a442778196f4cf0c3c918f P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:39.614432 26864 raft_consensus.cc:493] T d2af60b518a442778196f4cf0c3c918f P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:39.615211 26834 tablet_bootstrap.cc:492] T 0cad4999d89c491b8698a2023cc6d805 P 56539bdd0fcc41a7ae3e12c2f743d6fd: No bootstrap required, opened a new log
I20260709 12:15:39.615115 26864 raft_consensus.cc:515] T d2af60b518a442778196f4cf0c3c918f P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:39.615811 26834 ts_tablet_manager.cc:1403] T 0cad4999d89c491b8698a2023cc6d805 P 56539bdd0fcc41a7ae3e12c2f743d6fd: Time spent bootstrapping tablet: real 0.111s	user 0.008s	sys 0.028s
I20260709 12:15:39.608587 26858 raft_consensus.cc:493] T d2af60b518a442778196f4cf0c3c918f P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:39.619580 26642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2af60b518a442778196f4cf0c3c918f" candidate_uuid: "ea3ae70a91d24c3e84f03da4605ccede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" is_pre_election: true
I20260709 12:15:39.620205 26858 raft_consensus.cc:3060] T d2af60b518a442778196f4cf0c3c918f P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:39.620471 26832 ts_tablet_manager.cc:1434] T ce9b9e0175914633833e79c94d7e6a2a P ea3ae70a91d24c3e84f03da4605ccede: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.004s
I20260709 12:15:39.620536 26642 raft_consensus.cc:2468] T d2af60b518a442778196f4cf0c3c918f P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3ae70a91d24c3e84f03da4605ccede in term 0.
I20260709 12:15:39.621874 26832 tablet_bootstrap.cc:492] T a21937cb47f14ac0b40ea7c7c6e9cab9 P ea3ae70a91d24c3e84f03da4605ccede: Bootstrap starting.
I20260709 12:15:39.622474 26755 leader_election.cc:304] T d2af60b518a442778196f4cf0c3c918f P ea3ae70a91d24c3e84f03da4605ccede [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56539bdd0fcc41a7ae3e12c2f743d6fd, ea3ae70a91d24c3e84f03da4605ccede; no voters: 
I20260709 12:15:39.623577 26839 raft_consensus.cc:2804] T d2af60b518a442778196f4cf0c3c918f P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:39.623944 26839 raft_consensus.cc:493] T d2af60b518a442778196f4cf0c3c918f P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:39.624281 26839 raft_consensus.cc:3060] T d2af60b518a442778196f4cf0c3c918f P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:39.625038 26792 raft_consensus.cc:2468] T 51053577132f400289d135eb01a55020 P ea3ae70a91d24c3e84f03da4605ccede [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56539bdd0fcc41a7ae3e12c2f743d6fd in term 1.
I20260709 12:15:39.618736 26864 leader_election.cc:290] T d2af60b518a442778196f4cf0c3c918f P ea3ae70a91d24c3e84f03da4605ccede [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813), 773a9a5eeb14469389297d0f170bae34 (127.12.56.194:37781)
I20260709 12:15:39.626266 26607 leader_election.cc:304] T 51053577132f400289d135eb01a55020 P 56539bdd0fcc41a7ae3e12c2f743d6fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56539bdd0fcc41a7ae3e12c2f743d6fd, ea3ae70a91d24c3e84f03da4605ccede; no voters: 773a9a5eeb14469389297d0f170bae34
I20260709 12:15:39.578466 26682 leader_election.cc:304] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 773a9a5eeb14469389297d0f170bae34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773a9a5eeb14469389297d0f170bae34; no voters: 56539bdd0fcc41a7ae3e12c2f743d6fd, ea3ae70a91d24c3e84f03da4605ccede
I20260709 12:15:39.627885 26844 raft_consensus.cc:2804] T 51053577132f400289d135eb01a55020 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:39.628497 26844 raft_consensus.cc:697] T 51053577132f400289d135eb01a55020 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 LEADER]: Becoming Leader. State: Replica: 56539bdd0fcc41a7ae3e12c2f743d6fd, State: Running, Role: LEADER
I20260709 12:15:39.629395 26832 tablet_bootstrap.cc:654] T a21937cb47f14ac0b40ea7c7c6e9cab9 P ea3ae70a91d24c3e84f03da4605ccede: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:39.629307 26844 consensus_queue.cc:237] T 51053577132f400289d135eb01a55020 P 56539bdd0fcc41a7ae3e12c2f743d6fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:39.631322 26875 raft_consensus.cc:2749] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:39.633641 26839 raft_consensus.cc:515] T d2af60b518a442778196f4cf0c3c918f P ea3ae70a91d24c3e84f03da4605ccede [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
W20260709 12:15:39.634851 26682 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.195:43987, user_credentials={real_user=slave}} blocked reactor thread for 73205.9us
I20260709 12:15:39.636508 26758 leader_election.cc:304] T 51053577132f400289d135eb01a55020 P ea3ae70a91d24c3e84f03da4605ccede [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea3ae70a91d24c3e84f03da4605ccede; no voters: 56539bdd0fcc41a7ae3e12c2f743d6fd, 773a9a5eeb14469389297d0f170bae34
I20260709 12:15:39.630335 26834 raft_consensus.cc:359] T 0cad4999d89c491b8698a2023cc6d805 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:39.638247 26834 raft_consensus.cc:385] T 0cad4999d89c491b8698a2023cc6d805 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:39.638269 26642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2af60b518a442778196f4cf0c3c918f" candidate_uuid: "ea3ae70a91d24c3e84f03da4605ccede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd"
I20260709 12:15:39.638451 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2af60b518a442778196f4cf0c3c918f" candidate_uuid: "773a9a5eeb14469389297d0f170bae34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3ae70a91d24c3e84f03da4605ccede" is_pre_election: true
I20260709 12:15:39.638758 26864 raft_consensus.cc:2749] T 51053577132f400289d135eb01a55020 P ea3ae70a91d24c3e84f03da4605ccede [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:39.638756 26834 raft_consensus.cc:740] T 0cad4999d89c491b8698a2023cc6d805 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56539bdd0fcc41a7ae3e12c2f743d6fd, State: Initialized, Role: FOLLOWER
I20260709 12:15:39.639377 26642 raft_consensus.cc:3060] T d2af60b518a442778196f4cf0c3c918f P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:39.640066 26682 leader_election.cc:343] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 773a9a5eeb14469389297d0f170bae34 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195:43987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:39.640323 26791 raft_consensus.cc:2393] T d2af60b518a442778196f4cf0c3c918f P ea3ae70a91d24c3e84f03da4605ccede [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773a9a5eeb14469389297d0f170bae34 in current term 1: Already voted for candidate ea3ae70a91d24c3e84f03da4605ccede in this term.
I20260709 12:15:39.640244 26834 consensus_queue.cc:260] T 0cad4999d89c491b8698a2023cc6d805 P 56539bdd0fcc41a7ae3e12c2f743d6fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:39.639163 26717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2af60b518a442778196f4cf0c3c918f" candidate_uuid: "ea3ae70a91d24c3e84f03da4605ccede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773a9a5eeb14469389297d0f170bae34" is_pre_election: true
I20260709 12:15:39.642249 26792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51053577132f400289d135eb01a55020" candidate_uuid: "773a9a5eeb14469389297d0f170bae34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3ae70a91d24c3e84f03da4605ccede"
I20260709 12:15:39.645885 26792 raft_consensus.cc:2393] T 51053577132f400289d135eb01a55020 P ea3ae70a91d24c3e84f03da4605ccede [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 773a9a5eeb14469389297d0f170bae34 in current term 1: Already voted for candidate 56539bdd0fcc41a7ae3e12c2f743d6fd in this term.
I20260709 12:15:39.643569 26834 ts_tablet_manager.cc:1434] T 0cad4999d89c491b8698a2023cc6d805 P 56539bdd0fcc41a7ae3e12c2f743d6fd: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.005s
I20260709 12:15:39.641566 26838 raft_consensus.cc:697] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 773a9a5eeb14469389297d0f170bae34 [term 1 LEADER]: Becoming Leader. State: Replica: 773a9a5eeb14469389297d0f170bae34, State: Running, Role: LEADER
I20260709 12:15:39.650656 26682 leader_election.cc:304] T 51053577132f400289d135eb01a55020 P 773a9a5eeb14469389297d0f170bae34 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773a9a5eeb14469389297d0f170bae34; no voters: 56539bdd0fcc41a7ae3e12c2f743d6fd, ea3ae70a91d24c3e84f03da4605ccede
I20260709 12:15:39.651557 26838 consensus_queue.cc:237] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 773a9a5eeb14469389297d0f170bae34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:39.652272 26878 raft_consensus.cc:2749] T 51053577132f400289d135eb01a55020 P 773a9a5eeb14469389297d0f170bae34 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:15:39.654307 26834 tablet_bootstrap.cc:492] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 56539bdd0fcc41a7ae3e12c2f743d6fd: Bootstrap starting.
I20260709 12:15:39.660084 26832 tablet_bootstrap.cc:492] T a21937cb47f14ac0b40ea7c7c6e9cab9 P ea3ae70a91d24c3e84f03da4605ccede: No bootstrap required, opened a new log
I20260709 12:15:39.660687 26642 raft_consensus.cc:2468] T d2af60b518a442778196f4cf0c3c918f P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3ae70a91d24c3e84f03da4605ccede in term 1.
I20260709 12:15:39.656844 26718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2af60b518a442778196f4cf0c3c918f" candidate_uuid: "ea3ae70a91d24c3e84f03da4605ccede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773a9a5eeb14469389297d0f170bae34"
I20260709 12:15:39.660916 26832 ts_tablet_manager.cc:1403] T a21937cb47f14ac0b40ea7c7c6e9cab9 P ea3ae70a91d24c3e84f03da4605ccede: Time spent bootstrapping tablet: real 0.039s	user 0.005s	sys 0.009s
I20260709 12:15:39.655143 26839 leader_election.cc:290] T d2af60b518a442778196f4cf0c3c918f P ea3ae70a91d24c3e84f03da4605ccede [CANDIDATE]: Term 1 election: Requested vote from peers 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813), 773a9a5eeb14469389297d0f170bae34 (127.12.56.194:37781)
I20260709 12:15:39.648278 26858 raft_consensus.cc:515] T d2af60b518a442778196f4cf0c3c918f P 773a9a5eeb14469389297d0f170bae34 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:39.666481 26832 raft_consensus.cc:359] T a21937cb47f14ac0b40ea7c7c6e9cab9 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:39.667071 26717 raft_consensus.cc:2393] T d2af60b518a442778196f4cf0c3c918f P 773a9a5eeb14469389297d0f170bae34 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea3ae70a91d24c3e84f03da4605ccede in current term 1: Already voted for candidate 773a9a5eeb14469389297d0f170bae34 in this term.
I20260709 12:15:39.667361 26832 raft_consensus.cc:385] T a21937cb47f14ac0b40ea7c7c6e9cab9 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:39.667086 26755 leader_election.cc:304] T d2af60b518a442778196f4cf0c3c918f P ea3ae70a91d24c3e84f03da4605ccede [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56539bdd0fcc41a7ae3e12c2f743d6fd, ea3ae70a91d24c3e84f03da4605ccede; no voters: 773a9a5eeb14469389297d0f170bae34
I20260709 12:15:39.667953 26832 raft_consensus.cc:740] T a21937cb47f14ac0b40ea7c7c6e9cab9 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3ae70a91d24c3e84f03da4605ccede, State: Initialized, Role: FOLLOWER
I20260709 12:15:39.668392 26839 raft_consensus.cc:2804] T d2af60b518a442778196f4cf0c3c918f P ea3ae70a91d24c3e84f03da4605ccede [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:39.669186 26839 raft_consensus.cc:697] T d2af60b518a442778196f4cf0c3c918f P ea3ae70a91d24c3e84f03da4605ccede [term 1 LEADER]: Becoming Leader. State: Replica: ea3ae70a91d24c3e84f03da4605ccede, State: Running, Role: LEADER
I20260709 12:15:39.669064 26832 consensus_queue.cc:260] T a21937cb47f14ac0b40ea7c7c6e9cab9 P ea3ae70a91d24c3e84f03da4605ccede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:39.670809 26839 consensus_queue.cc:237] T d2af60b518a442778196f4cf0c3c918f P ea3ae70a91d24c3e84f03da4605ccede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:39.671164 26642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2af60b518a442778196f4cf0c3c918f" candidate_uuid: "773a9a5eeb14469389297d0f170bae34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd"
I20260709 12:15:39.671833 26858 leader_election.cc:290] T d2af60b518a442778196f4cf0c3c918f P 773a9a5eeb14469389297d0f170bae34 [CANDIDATE]: Term 1 election: Requested vote from peers 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813), ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195:43987)
I20260709 12:15:39.673493 26642 raft_consensus.cc:2393] T d2af60b518a442778196f4cf0c3c918f P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 773a9a5eeb14469389297d0f170bae34 in current term 1: Already voted for candidate ea3ae70a91d24c3e84f03da4605ccede in this term.
I20260709 12:15:39.671953 26832 ts_tablet_manager.cc:1434] T a21937cb47f14ac0b40ea7c7c6e9cab9 P ea3ae70a91d24c3e84f03da4605ccede: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:15:39.677357 26832 tablet_bootstrap.cc:492] T 61ff419b6fbe4f9e91c20f9347dd8c63 P ea3ae70a91d24c3e84f03da4605ccede: Bootstrap starting.
I20260709 12:15:39.672083 26792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2af60b518a442778196f4cf0c3c918f" candidate_uuid: "773a9a5eeb14469389297d0f170bae34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3ae70a91d24c3e84f03da4605ccede"
I20260709 12:15:39.682502 26682 leader_election.cc:304] T d2af60b518a442778196f4cf0c3c918f P 773a9a5eeb14469389297d0f170bae34 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773a9a5eeb14469389297d0f170bae34; no voters: 56539bdd0fcc41a7ae3e12c2f743d6fd, ea3ae70a91d24c3e84f03da4605ccede
I20260709 12:15:39.683125 26834 tablet_bootstrap.cc:654] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 56539bdd0fcc41a7ae3e12c2f743d6fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:39.683993 26858 raft_consensus.cc:2749] T d2af60b518a442778196f4cf0c3c918f P 773a9a5eeb14469389297d0f170bae34 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:15:39.688321 26832 tablet_bootstrap.cc:654] T 61ff419b6fbe4f9e91c20f9347dd8c63 P ea3ae70a91d24c3e84f03da4605ccede: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:39.689442 26834 tablet_bootstrap.cc:492] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 56539bdd0fcc41a7ae3e12c2f743d6fd: No bootstrap required, opened a new log
I20260709 12:15:39.690161 26834 ts_tablet_manager.cc:1403] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 56539bdd0fcc41a7ae3e12c2f743d6fd: Time spent bootstrapping tablet: real 0.036s	user 0.009s	sys 0.005s
I20260709 12:15:39.692201 26538 catalog_manager.cc:5697] T 51053577132f400289d135eb01a55020 P 56539bdd0fcc41a7ae3e12c2f743d6fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193). New cstate: current_term: 1 leader_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:39.693544 26834 raft_consensus.cc:359] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:39.694535 26834 raft_consensus.cc:385] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:39.694927 26834 raft_consensus.cc:740] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56539bdd0fcc41a7ae3e12c2f743d6fd, State: Initialized, Role: FOLLOWER
I20260709 12:15:39.695809 26834 consensus_queue.cc:260] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 56539bdd0fcc41a7ae3e12c2f743d6fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:39.696082 26538 catalog_manager.cc:5697] T 6bbb8c707ea042859b5fbe695bab0f44 P 56539bdd0fcc41a7ae3e12c2f743d6fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193). New cstate: current_term: 1 leader_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:39.697707 26834 ts_tablet_manager.cc:1434] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 56539bdd0fcc41a7ae3e12c2f743d6fd: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:15:39.699172 26834 tablet_bootstrap.cc:492] T c258759a737e4ce1be24541ae8bb535f P 56539bdd0fcc41a7ae3e12c2f743d6fd: Bootstrap starting.
I20260709 12:15:39.700917 26832 tablet_bootstrap.cc:492] T 61ff419b6fbe4f9e91c20f9347dd8c63 P ea3ae70a91d24c3e84f03da4605ccede: No bootstrap required, opened a new log
I20260709 12:15:39.701534 26832 ts_tablet_manager.cc:1403] T 61ff419b6fbe4f9e91c20f9347dd8c63 P ea3ae70a91d24c3e84f03da4605ccede: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.002s
I20260709 12:15:39.704713 26832 raft_consensus.cc:359] T 61ff419b6fbe4f9e91c20f9347dd8c63 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:39.705304 26834 tablet_bootstrap.cc:654] T c258759a737e4ce1be24541ae8bb535f P 56539bdd0fcc41a7ae3e12c2f743d6fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:39.705636 26832 raft_consensus.cc:385] T 61ff419b6fbe4f9e91c20f9347dd8c63 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:39.706115 26832 raft_consensus.cc:740] T 61ff419b6fbe4f9e91c20f9347dd8c63 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3ae70a91d24c3e84f03da4605ccede, State: Initialized, Role: FOLLOWER
I20260709 12:15:39.706955 26832 consensus_queue.cc:260] T 61ff419b6fbe4f9e91c20f9347dd8c63 P ea3ae70a91d24c3e84f03da4605ccede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:39.709669 26832 ts_tablet_manager.cc:1434] T 61ff419b6fbe4f9e91c20f9347dd8c63 P ea3ae70a91d24c3e84f03da4605ccede: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:15:39.710956 26832 tablet_bootstrap.cc:492] T 0cad4999d89c491b8698a2023cc6d805 P ea3ae70a91d24c3e84f03da4605ccede: Bootstrap starting.
I20260709 12:15:39.711803 26834 tablet_bootstrap.cc:492] T c258759a737e4ce1be24541ae8bb535f P 56539bdd0fcc41a7ae3e12c2f743d6fd: No bootstrap required, opened a new log
I20260709 12:15:39.712423 26834 ts_tablet_manager.cc:1403] T c258759a737e4ce1be24541ae8bb535f P 56539bdd0fcc41a7ae3e12c2f743d6fd: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.001s
I20260709 12:15:39.714411 26540 catalog_manager.cc:5697] T d2af60b518a442778196f4cf0c3c918f P ea3ae70a91d24c3e84f03da4605ccede reported cstate change: term changed from 0 to 1, leader changed from <none> to ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195). New cstate: current_term: 1 leader_uuid: "ea3ae70a91d24c3e84f03da4605ccede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:39.718500 26832 tablet_bootstrap.cc:654] T 0cad4999d89c491b8698a2023cc6d805 P ea3ae70a91d24c3e84f03da4605ccede: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:39.720731 26834 raft_consensus.cc:359] T c258759a737e4ce1be24541ae8bb535f P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:39.721820 26834 raft_consensus.cc:385] T c258759a737e4ce1be24541ae8bb535f P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:39.728873 26834 raft_consensus.cc:740] T c258759a737e4ce1be24541ae8bb535f P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56539bdd0fcc41a7ae3e12c2f743d6fd, State: Initialized, Role: FOLLOWER
I20260709 12:15:39.730165 26834 consensus_queue.cc:260] T c258759a737e4ce1be24541ae8bb535f P 56539bdd0fcc41a7ae3e12c2f743d6fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:39.731155 26539 catalog_manager.cc:5697] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 773a9a5eeb14469389297d0f170bae34 reported cstate change: term changed from 0 to 1, leader changed from <none> to 773a9a5eeb14469389297d0f170bae34 (127.12.56.194). New cstate: current_term: 1 leader_uuid: "773a9a5eeb14469389297d0f170bae34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:39.744524 26834 ts_tablet_manager.cc:1434] T c258759a737e4ce1be24541ae8bb535f P 56539bdd0fcc41a7ae3e12c2f743d6fd: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 12:15:39.753310 26844 raft_consensus.cc:493] T c258759a737e4ce1be24541ae8bb535f P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:39.754114 26844 raft_consensus.cc:515] T c258759a737e4ce1be24541ae8bb535f P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:39.757546 26839 raft_consensus.cc:493] T ce9b9e0175914633833e79c94d7e6a2a P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:39.758476 26839 raft_consensus.cc:515] T ce9b9e0175914633833e79c94d7e6a2a P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:39.762743 26717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258759a737e4ce1be24541ae8bb535f" candidate_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773a9a5eeb14469389297d0f170bae34" is_pre_election: true
I20260709 12:15:39.763193 26642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9b9e0175914633833e79c94d7e6a2a" candidate_uuid: "ea3ae70a91d24c3e84f03da4605ccede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" is_pre_election: true
I20260709 12:15:39.763468 26717 raft_consensus.cc:2468] T c258759a737e4ce1be24541ae8bb535f P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56539bdd0fcc41a7ae3e12c2f743d6fd in term 0.
I20260709 12:15:39.764319 26832 tablet_bootstrap.cc:492] T 0cad4999d89c491b8698a2023cc6d805 P ea3ae70a91d24c3e84f03da4605ccede: No bootstrap required, opened a new log
W20260709 12:15:39.764647 26755 leader_election.cc:343] T ce9b9e0175914633833e79c94d7e6a2a P ea3ae70a91d24c3e84f03da4605ccede [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:39.764915 26832 ts_tablet_manager.cc:1403] T 0cad4999d89c491b8698a2023cc6d805 P ea3ae70a91d24c3e84f03da4605ccede: Time spent bootstrapping tablet: real 0.054s	user 0.014s	sys 0.038s
I20260709 12:15:39.765203 26717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9b9e0175914633833e79c94d7e6a2a" candidate_uuid: "ea3ae70a91d24c3e84f03da4605ccede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773a9a5eeb14469389297d0f170bae34" is_pre_election: true
I20260709 12:15:39.765219 26609 leader_election.cc:304] T c258759a737e4ce1be24541ae8bb535f P 56539bdd0fcc41a7ae3e12c2f743d6fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56539bdd0fcc41a7ae3e12c2f743d6fd, 773a9a5eeb14469389297d0f170bae34; no voters: 
I20260709 12:15:39.766319 26856 raft_consensus.cc:2804] T c258759a737e4ce1be24541ae8bb535f P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:39.766610 26844 leader_election.cc:290] T c258759a737e4ce1be24541ae8bb535f P 56539bdd0fcc41a7ae3e12c2f743d6fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 773a9a5eeb14469389297d0f170bae34 (127.12.56.194:37781), ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195:43987)
I20260709 12:15:39.768111 26792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258759a737e4ce1be24541ae8bb535f" candidate_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3ae70a91d24c3e84f03da4605ccede" is_pre_election: true
I20260709 12:15:39.768990 26832 raft_consensus.cc:359] T 0cad4999d89c491b8698a2023cc6d805 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:39.770175 26856 raft_consensus.cc:493] T c258759a737e4ce1be24541ae8bb535f P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:39.766014 26717 raft_consensus.cc:2468] T ce9b9e0175914633833e79c94d7e6a2a P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3ae70a91d24c3e84f03da4605ccede in term 0.
I20260709 12:15:39.770625 26832 raft_consensus.cc:385] T 0cad4999d89c491b8698a2023cc6d805 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:39.770737 26856 raft_consensus.cc:3060] T c258759a737e4ce1be24541ae8bb535f P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:39.771075 26832 raft_consensus.cc:740] T 0cad4999d89c491b8698a2023cc6d805 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3ae70a91d24c3e84f03da4605ccede, State: Initialized, Role: FOLLOWER
I20260709 12:15:39.771693 26758 leader_election.cc:304] T ce9b9e0175914633833e79c94d7e6a2a P ea3ae70a91d24c3e84f03da4605ccede [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773a9a5eeb14469389297d0f170bae34, ea3ae70a91d24c3e84f03da4605ccede; no voters: 56539bdd0fcc41a7ae3e12c2f743d6fd
I20260709 12:15:39.771945 26832 consensus_queue.cc:260] T 0cad4999d89c491b8698a2023cc6d805 P ea3ae70a91d24c3e84f03da4605ccede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:39.772459 26864 raft_consensus.cc:2804] T ce9b9e0175914633833e79c94d7e6a2a P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:15:39.772768 26607 leader_election.cc:343] T c258759a737e4ce1be24541ae8bb535f P 56539bdd0fcc41a7ae3e12c2f743d6fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195:43987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:39.772960 26864 raft_consensus.cc:493] T ce9b9e0175914633833e79c94d7e6a2a P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:39.773340 26864 raft_consensus.cc:3060] T ce9b9e0175914633833e79c94d7e6a2a P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:39.766426 26839 leader_election.cc:290] T ce9b9e0175914633833e79c94d7e6a2a P ea3ae70a91d24c3e84f03da4605ccede [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813), 773a9a5eeb14469389297d0f170bae34 (127.12.56.194:37781)
I20260709 12:15:39.775120 26834 tablet_bootstrap.cc:492] T ce9b9e0175914633833e79c94d7e6a2a P 56539bdd0fcc41a7ae3e12c2f743d6fd: Bootstrap starting.
I20260709 12:15:39.782037 26834 tablet_bootstrap.cc:654] T ce9b9e0175914633833e79c94d7e6a2a P 56539bdd0fcc41a7ae3e12c2f743d6fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:39.781874 26864 raft_consensus.cc:515] T ce9b9e0175914633833e79c94d7e6a2a P ea3ae70a91d24c3e84f03da4605ccede [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:39.784058 26832 ts_tablet_manager.cc:1434] T 0cad4999d89c491b8698a2023cc6d805 P ea3ae70a91d24c3e84f03da4605ccede: Time spent starting tablet: real 0.019s	user 0.019s	sys 0.000s
I20260709 12:15:39.785290 26864 leader_election.cc:290] T ce9b9e0175914633833e79c94d7e6a2a P ea3ae70a91d24c3e84f03da4605ccede [CANDIDATE]: Term 1 election: Requested vote from peers 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813), 773a9a5eeb14469389297d0f170bae34 (127.12.56.194:37781)
I20260709 12:15:39.785303 26832 tablet_bootstrap.cc:492] T c258759a737e4ce1be24541ae8bb535f P ea3ae70a91d24c3e84f03da4605ccede: Bootstrap starting.
I20260709 12:15:39.786485 26856 raft_consensus.cc:515] T c258759a737e4ce1be24541ae8bb535f P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:39.788085 26717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9b9e0175914633833e79c94d7e6a2a" candidate_uuid: "ea3ae70a91d24c3e84f03da4605ccede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773a9a5eeb14469389297d0f170bae34"
I20260709 12:15:39.788960 26717 raft_consensus.cc:3060] T ce9b9e0175914633833e79c94d7e6a2a P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:39.788982 26856 leader_election.cc:290] T c258759a737e4ce1be24541ae8bb535f P 56539bdd0fcc41a7ae3e12c2f743d6fd [CANDIDATE]: Term 1 election: Requested vote from peers 773a9a5eeb14469389297d0f170bae34 (127.12.56.194:37781), ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195:43987)
I20260709 12:15:39.792237 26832 tablet_bootstrap.cc:654] T c258759a737e4ce1be24541ae8bb535f P ea3ae70a91d24c3e84f03da4605ccede: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:39.795508 26834 tablet_bootstrap.cc:492] T ce9b9e0175914633833e79c94d7e6a2a P 56539bdd0fcc41a7ae3e12c2f743d6fd: No bootstrap required, opened a new log
I20260709 12:15:39.796918 26834 ts_tablet_manager.cc:1403] T ce9b9e0175914633833e79c94d7e6a2a P 56539bdd0fcc41a7ae3e12c2f743d6fd: Time spent bootstrapping tablet: real 0.044s	user 0.015s	sys 0.004s
I20260709 12:15:39.799633 26832 tablet_bootstrap.cc:492] T c258759a737e4ce1be24541ae8bb535f P ea3ae70a91d24c3e84f03da4605ccede: No bootstrap required, opened a new log
I20260709 12:15:39.835592 26832 ts_tablet_manager.cc:1403] T c258759a737e4ce1be24541ae8bb535f P ea3ae70a91d24c3e84f03da4605ccede: Time spent bootstrapping tablet: real 0.050s	user 0.012s	sys 0.002s
I20260709 12:15:39.844105 26718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258759a737e4ce1be24541ae8bb535f" candidate_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773a9a5eeb14469389297d0f170bae34"
I20260709 12:15:39.844898 26792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258759a737e4ce1be24541ae8bb535f" candidate_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3ae70a91d24c3e84f03da4605ccede"
I20260709 12:15:39.845623 26718 raft_consensus.cc:3060] T c258759a737e4ce1be24541ae8bb535f P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:39.849283 26832 raft_consensus.cc:359] T c258759a737e4ce1be24541ae8bb535f P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:39.850061 26642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9b9e0175914633833e79c94d7e6a2a" candidate_uuid: "ea3ae70a91d24c3e84f03da4605ccede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd"
I20260709 12:15:39.850445 26832 raft_consensus.cc:385] T c258759a737e4ce1be24541ae8bb535f P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:39.850835 26832 raft_consensus.cc:740] T c258759a737e4ce1be24541ae8bb535f P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3ae70a91d24c3e84f03da4605ccede, State: Initialized, Role: FOLLOWER
I20260709 12:15:39.834769 26834 raft_consensus.cc:359] T ce9b9e0175914633833e79c94d7e6a2a P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:39.851536 26834 raft_consensus.cc:385] T ce9b9e0175914633833e79c94d7e6a2a P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:39.852267 26834 raft_consensus.cc:740] T ce9b9e0175914633833e79c94d7e6a2a P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56539bdd0fcc41a7ae3e12c2f743d6fd, State: Initialized, Role: FOLLOWER
I20260709 12:15:39.852061 26832 consensus_queue.cc:260] T c258759a737e4ce1be24541ae8bb535f P ea3ae70a91d24c3e84f03da4605ccede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
W20260709 12:15:39.853296 26607 leader_election.cc:343] T c258759a737e4ce1be24541ae8bb535f P 56539bdd0fcc41a7ae3e12c2f743d6fd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195:43987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:39.853605 26834 consensus_queue.cc:260] T ce9b9e0175914633833e79c94d7e6a2a P 56539bdd0fcc41a7ae3e12c2f743d6fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:39.856189 26642 raft_consensus.cc:3060] T ce9b9e0175914633833e79c94d7e6a2a P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:39.857949 26832 ts_tablet_manager.cc:1434] T c258759a737e4ce1be24541ae8bb535f P ea3ae70a91d24c3e84f03da4605ccede: Time spent starting tablet: real 0.022s	user 0.011s	sys 0.008s
I20260709 12:15:39.860505 26834 ts_tablet_manager.cc:1434] T ce9b9e0175914633833e79c94d7e6a2a P 56539bdd0fcc41a7ae3e12c2f743d6fd: Time spent starting tablet: real 0.063s	user 0.008s	sys 0.002s
I20260709 12:15:39.873135 26718 raft_consensus.cc:2468] T c258759a737e4ce1be24541ae8bb535f P 773a9a5eeb14469389297d0f170bae34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56539bdd0fcc41a7ae3e12c2f743d6fd in term 1.
I20260709 12:15:39.874646 26642 raft_consensus.cc:2468] T ce9b9e0175914633833e79c94d7e6a2a P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3ae70a91d24c3e84f03da4605ccede in term 1.
I20260709 12:15:39.876030 26609 leader_election.cc:304] T c258759a737e4ce1be24541ae8bb535f P 56539bdd0fcc41a7ae3e12c2f743d6fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56539bdd0fcc41a7ae3e12c2f743d6fd, 773a9a5eeb14469389297d0f170bae34; no voters: ea3ae70a91d24c3e84f03da4605ccede
I20260709 12:15:39.879323 26844 raft_consensus.cc:2804] T c258759a737e4ce1be24541ae8bb535f P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:39.880015 26844 raft_consensus.cc:697] T c258759a737e4ce1be24541ae8bb535f P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 LEADER]: Becoming Leader. State: Replica: 56539bdd0fcc41a7ae3e12c2f743d6fd, State: Running, Role: LEADER
I20260709 12:15:39.880862 26717 raft_consensus.cc:2468] T ce9b9e0175914633833e79c94d7e6a2a P 773a9a5eeb14469389297d0f170bae34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3ae70a91d24c3e84f03da4605ccede in term 1.
I20260709 12:15:39.874810 26856 raft_consensus.cc:493] T 0cad4999d89c491b8698a2023cc6d805 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:39.881700 26844 consensus_queue.cc:237] T c258759a737e4ce1be24541ae8bb535f P 56539bdd0fcc41a7ae3e12c2f743d6fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:39.882717 26856 raft_consensus.cc:515] T 0cad4999d89c491b8698a2023cc6d805 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:39.883741 26758 leader_election.cc:304] T ce9b9e0175914633833e79c94d7e6a2a P ea3ae70a91d24c3e84f03da4605ccede [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773a9a5eeb14469389297d0f170bae34, ea3ae70a91d24c3e84f03da4605ccede; no voters: 
I20260709 12:15:39.885947 26856 leader_election.cc:290] T 0cad4999d89c491b8698a2023cc6d805 P 56539bdd0fcc41a7ae3e12c2f743d6fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 773a9a5eeb14469389297d0f170bae34 (127.12.56.194:37781), ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195:43987)
I20260709 12:15:39.886986 26864 raft_consensus.cc:2804] T ce9b9e0175914633833e79c94d7e6a2a P ea3ae70a91d24c3e84f03da4605ccede [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:39.887502 26792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cad4999d89c491b8698a2023cc6d805" candidate_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3ae70a91d24c3e84f03da4605ccede" is_pre_election: true
I20260709 12:15:39.887944 26864 raft_consensus.cc:697] T ce9b9e0175914633833e79c94d7e6a2a P ea3ae70a91d24c3e84f03da4605ccede [term 1 LEADER]: Becoming Leader. State: Replica: ea3ae70a91d24c3e84f03da4605ccede, State: Running, Role: LEADER
I20260709 12:15:39.888542 26792 raft_consensus.cc:2468] T 0cad4999d89c491b8698a2023cc6d805 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56539bdd0fcc41a7ae3e12c2f743d6fd in term 0.
I20260709 12:15:39.890465 26607 leader_election.cc:304] T 0cad4999d89c491b8698a2023cc6d805 P 56539bdd0fcc41a7ae3e12c2f743d6fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56539bdd0fcc41a7ae3e12c2f743d6fd, ea3ae70a91d24c3e84f03da4605ccede; no voters: 
I20260709 12:15:39.891988 26856 raft_consensus.cc:2804] T 0cad4999d89c491b8698a2023cc6d805 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:39.889707 26864 consensus_queue.cc:237] T ce9b9e0175914633833e79c94d7e6a2a P ea3ae70a91d24c3e84f03da4605ccede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:39.892513 26856 raft_consensus.cc:493] T 0cad4999d89c491b8698a2023cc6d805 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:39.893098 26856 raft_consensus.cc:3060] T 0cad4999d89c491b8698a2023cc6d805 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:39.896118 26717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cad4999d89c491b8698a2023cc6d805" candidate_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773a9a5eeb14469389297d0f170bae34" is_pre_election: true
I20260709 12:15:39.898018 26717 raft_consensus.cc:2468] T 0cad4999d89c491b8698a2023cc6d805 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56539bdd0fcc41a7ae3e12c2f743d6fd in term 0.
I20260709 12:15:39.904968 26856 raft_consensus.cc:515] T 0cad4999d89c491b8698a2023cc6d805 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:39.909336 26717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cad4999d89c491b8698a2023cc6d805" candidate_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773a9a5eeb14469389297d0f170bae34"
I20260709 12:15:39.910187 26717 raft_consensus.cc:3060] T 0cad4999d89c491b8698a2023cc6d805 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:39.909427 26538 catalog_manager.cc:5697] T c258759a737e4ce1be24541ae8bb535f P 56539bdd0fcc41a7ae3e12c2f743d6fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193). New cstate: current_term: 1 leader_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:39.910518 26856 leader_election.cc:290] T 0cad4999d89c491b8698a2023cc6d805 P 56539bdd0fcc41a7ae3e12c2f743d6fd [CANDIDATE]: Term 1 election: Requested vote from peers 773a9a5eeb14469389297d0f170bae34 (127.12.56.194:37781), ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195:43987)
I20260709 12:15:39.911887 26792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cad4999d89c491b8698a2023cc6d805" candidate_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3ae70a91d24c3e84f03da4605ccede"
I20260709 12:15:39.912684 26792 raft_consensus.cc:3060] T 0cad4999d89c491b8698a2023cc6d805 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:39.921929 26717 raft_consensus.cc:2468] T 0cad4999d89c491b8698a2023cc6d805 P 773a9a5eeb14469389297d0f170bae34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56539bdd0fcc41a7ae3e12c2f743d6fd in term 1.
I20260709 12:15:39.922240 26539 catalog_manager.cc:5697] T ce9b9e0175914633833e79c94d7e6a2a P ea3ae70a91d24c3e84f03da4605ccede reported cstate change: term changed from 0 to 1, leader changed from <none> to ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195). New cstate: current_term: 1 leader_uuid: "ea3ae70a91d24c3e84f03da4605ccede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:39.923883 26609 leader_election.cc:304] T 0cad4999d89c491b8698a2023cc6d805 P 56539bdd0fcc41a7ae3e12c2f743d6fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56539bdd0fcc41a7ae3e12c2f743d6fd, 773a9a5eeb14469389297d0f170bae34; no voters: 
I20260709 12:15:39.924826 26856 raft_consensus.cc:2804] T 0cad4999d89c491b8698a2023cc6d805 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:39.925379 26856 raft_consensus.cc:697] T 0cad4999d89c491b8698a2023cc6d805 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 LEADER]: Becoming Leader. State: Replica: 56539bdd0fcc41a7ae3e12c2f743d6fd, State: Running, Role: LEADER
I20260709 12:15:39.926138 26792 raft_consensus.cc:2468] T 0cad4999d89c491b8698a2023cc6d805 P ea3ae70a91d24c3e84f03da4605ccede [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56539bdd0fcc41a7ae3e12c2f743d6fd in term 1.
I20260709 12:15:39.926715 26856 consensus_queue.cc:237] T 0cad4999d89c491b8698a2023cc6d805 P 56539bdd0fcc41a7ae3e12c2f743d6fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:39.936427 26539 catalog_manager.cc:5697] T 0cad4999d89c491b8698a2023cc6d805 P 56539bdd0fcc41a7ae3e12c2f743d6fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193). New cstate: current_term: 1 leader_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:40.034543 26856 raft_consensus.cc:493] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:40.035164 26856 raft_consensus.cc:515] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:40.038235 26864 raft_consensus.cc:493] T c258759a737e4ce1be24541ae8bb535f P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:40.039182 26856 leader_election.cc:290] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 56539bdd0fcc41a7ae3e12c2f743d6fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 773a9a5eeb14469389297d0f170bae34 (127.12.56.194:37781), ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195:43987)
I20260709 12:15:40.039069 26792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ff419b6fbe4f9e91c20f9347dd8c63" candidate_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3ae70a91d24c3e84f03da4605ccede" is_pre_election: true
I20260709 12:15:40.038944 26864 raft_consensus.cc:515] T c258759a737e4ce1be24541ae8bb535f P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:40.038954 26717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ff419b6fbe4f9e91c20f9347dd8c63" candidate_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773a9a5eeb14469389297d0f170bae34" is_pre_election: true
I20260709 12:15:40.040239 26792 raft_consensus.cc:2468] T 61ff419b6fbe4f9e91c20f9347dd8c63 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56539bdd0fcc41a7ae3e12c2f743d6fd in term 0.
I20260709 12:15:40.040594 26717 raft_consensus.cc:2468] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56539bdd0fcc41a7ae3e12c2f743d6fd in term 0.
I20260709 12:15:40.042261 26607 leader_election.cc:304] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 56539bdd0fcc41a7ae3e12c2f743d6fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56539bdd0fcc41a7ae3e12c2f743d6fd, ea3ae70a91d24c3e84f03da4605ccede; no voters: 
I20260709 12:15:40.043365 26642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258759a737e4ce1be24541ae8bb535f" candidate_uuid: "ea3ae70a91d24c3e84f03da4605ccede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" is_pre_election: true
I20260709 12:15:40.043551 26856 raft_consensus.cc:2804] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:40.044051 26856 raft_consensus.cc:493] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:40.044392 26856 raft_consensus.cc:3060] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:40.045058 26864 leader_election.cc:290] T c258759a737e4ce1be24541ae8bb535f P ea3ae70a91d24c3e84f03da4605ccede [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813), 773a9a5eeb14469389297d0f170bae34 (127.12.56.194:37781)
I20260709 12:15:40.046186 26717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258759a737e4ce1be24541ae8bb535f" candidate_uuid: "ea3ae70a91d24c3e84f03da4605ccede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773a9a5eeb14469389297d0f170bae34" is_pre_election: true
I20260709 12:15:40.047045 26717 raft_consensus.cc:2393] T c258759a737e4ce1be24541ae8bb535f P 773a9a5eeb14469389297d0f170bae34 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea3ae70a91d24c3e84f03da4605ccede in current term 1: Already voted for candidate 56539bdd0fcc41a7ae3e12c2f743d6fd in this term.
I20260709 12:15:40.048050 26758 leader_election.cc:304] T c258759a737e4ce1be24541ae8bb535f P ea3ae70a91d24c3e84f03da4605ccede [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea3ae70a91d24c3e84f03da4605ccede; no voters: 56539bdd0fcc41a7ae3e12c2f743d6fd, 773a9a5eeb14469389297d0f170bae34
I20260709 12:15:40.048286 26864 raft_consensus.cc:493] T a21937cb47f14ac0b40ea7c7c6e9cab9 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:40.049155 26890 raft_consensus.cc:3060] T c258759a737e4ce1be24541ae8bb535f P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:40.049203 26864 raft_consensus.cc:515] T a21937cb47f14ac0b40ea7c7c6e9cab9 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:40.052811 26864 leader_election.cc:290] T a21937cb47f14ac0b40ea7c7c6e9cab9 P ea3ae70a91d24c3e84f03da4605ccede [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813), 773a9a5eeb14469389297d0f170bae34 (127.12.56.194:37781)
I20260709 12:15:40.053172 26717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a21937cb47f14ac0b40ea7c7c6e9cab9" candidate_uuid: "ea3ae70a91d24c3e84f03da4605ccede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773a9a5eeb14469389297d0f170bae34" is_pre_election: true
I20260709 12:15:40.053587 26856 raft_consensus.cc:515] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:40.056156 26856 leader_election.cc:290] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 56539bdd0fcc41a7ae3e12c2f743d6fd [CANDIDATE]: Term 1 election: Requested vote from peers 773a9a5eeb14469389297d0f170bae34 (127.12.56.194:37781), ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195:43987)
I20260709 12:15:40.056635 26717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ff419b6fbe4f9e91c20f9347dd8c63" candidate_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773a9a5eeb14469389297d0f170bae34"
I20260709 12:15:40.056807 26792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ff419b6fbe4f9e91c20f9347dd8c63" candidate_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3ae70a91d24c3e84f03da4605ccede"
I20260709 12:15:40.057397 26717 raft_consensus.cc:3060] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:40.057487 26792 raft_consensus.cc:3060] T 61ff419b6fbe4f9e91c20f9347dd8c63 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:40.058706 26890 raft_consensus.cc:2749] T c258759a737e4ce1be24541ae8bb535f P ea3ae70a91d24c3e84f03da4605ccede [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:40.057440 26642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a21937cb47f14ac0b40ea7c7c6e9cab9" candidate_uuid: "ea3ae70a91d24c3e84f03da4605ccede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" is_pre_election: true
I20260709 12:15:40.060281 26642 raft_consensus.cc:2393] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea3ae70a91d24c3e84f03da4605ccede in current term 1: Already voted for candidate 773a9a5eeb14469389297d0f170bae34 in this term.
I20260709 12:15:40.061705 26755 leader_election.cc:304] T a21937cb47f14ac0b40ea7c7c6e9cab9 P ea3ae70a91d24c3e84f03da4605ccede [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea3ae70a91d24c3e84f03da4605ccede; no voters: 56539bdd0fcc41a7ae3e12c2f743d6fd, 773a9a5eeb14469389297d0f170bae34
I20260709 12:15:40.063521 26890 raft_consensus.cc:3060] T a21937cb47f14ac0b40ea7c7c6e9cab9 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:40.063292 26844 consensus_queue.cc:1048] T 6bbb8c707ea042859b5fbe695bab0f44 P 56539bdd0fcc41a7ae3e12c2f743d6fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:40.067108 26717 raft_consensus.cc:2468] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 773a9a5eeb14469389297d0f170bae34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56539bdd0fcc41a7ae3e12c2f743d6fd in term 1.
I20260709 12:15:40.067094 26792 raft_consensus.cc:2468] T 61ff419b6fbe4f9e91c20f9347dd8c63 P ea3ae70a91d24c3e84f03da4605ccede [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56539bdd0fcc41a7ae3e12c2f743d6fd in term 1.
I20260709 12:15:40.072209 26609 leader_election.cc:304] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 56539bdd0fcc41a7ae3e12c2f743d6fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56539bdd0fcc41a7ae3e12c2f743d6fd, 773a9a5eeb14469389297d0f170bae34; no voters: 
I20260709 12:15:40.072795 26890 raft_consensus.cc:2749] T a21937cb47f14ac0b40ea7c7c6e9cab9 P ea3ae70a91d24c3e84f03da4605ccede [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:40.073331 26844 raft_consensus.cc:2804] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:40.073918 26844 raft_consensus.cc:697] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 LEADER]: Becoming Leader. State: Replica: 56539bdd0fcc41a7ae3e12c2f743d6fd, State: Running, Role: LEADER
I20260709 12:15:40.074869 26844 consensus_queue.cc:237] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 56539bdd0fcc41a7ae3e12c2f743d6fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:40.082832 26842 consensus_queue.cc:1048] T 6bbb8c707ea042859b5fbe695bab0f44 P 56539bdd0fcc41a7ae3e12c2f743d6fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:40.093467 26538 catalog_manager.cc:5697] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 56539bdd0fcc41a7ae3e12c2f743d6fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193). New cstate: current_term: 1 leader_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:40.193953 26890 consensus_queue.cc:1048] T d2af60b518a442778196f4cf0c3c918f P ea3ae70a91d24c3e84f03da4605ccede [LEADER]: Connected to new peer: Peer: permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:40.198639 26856 consensus_queue.cc:1048] T 51053577132f400289d135eb01a55020 P 56539bdd0fcc41a7ae3e12c2f743d6fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:40.211864 26890 consensus_queue.cc:1048] T d2af60b518a442778196f4cf0c3c918f P ea3ae70a91d24c3e84f03da4605ccede [LEADER]: Connected to new peer: Peer: permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:40.216828 26844 consensus_queue.cc:1048] T 51053577132f400289d135eb01a55020 P 56539bdd0fcc41a7ae3e12c2f743d6fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:40.250679 26858 consensus_queue.cc:1048] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 773a9a5eeb14469389297d0f170bae34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:40.267915 26905 consensus_queue.cc:1048] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 773a9a5eeb14469389297d0f170bae34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:15:40.316615 26572 debug-util.cc:398] Leaking SignalData structure 0x7b080013da60 after lost signal to thread 12518
W20260709 12:15:40.318104 26572 debug-util.cc:398] Leaking SignalData structure 0x7b0800021300 after lost signal to thread 26575
W20260709 12:15:40.323810 26572 debug-util.cc:398] Leaking SignalData structure 0x7b080008ffe0 after lost signal to thread 26816
I20260709 12:15:40.324366 26890 consensus_queue.cc:1048] T ce9b9e0175914633833e79c94d7e6a2a P ea3ae70a91d24c3e84f03da4605ccede [LEADER]: Connected to new peer: Peer: permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:40.340673 26864 consensus_queue.cc:1048] T ce9b9e0175914633833e79c94d7e6a2a P ea3ae70a91d24c3e84f03da4605ccede [LEADER]: Connected to new peer: Peer: permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:40.348533 26844 consensus_queue.cc:1048] T c258759a737e4ce1be24541ae8bb535f P 56539bdd0fcc41a7ae3e12c2f743d6fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:40.395924 26856 consensus_queue.cc:1048] T c258759a737e4ce1be24541ae8bb535f P 56539bdd0fcc41a7ae3e12c2f743d6fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:40.412258 26717 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a21937cb47f14ac0b40ea7c7c6e9cab9"
dest_uuid: "773a9a5eeb14469389297d0f170bae34"
mode: GRACEFUL
new_leader_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd"
 from {username='slave'} at 127.0.0.1:41936
I20260709 12:15:40.413265 26717 raft_consensus.cc:606] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 773a9a5eeb14469389297d0f170bae34 [term 1 LEADER]: Received request to transfer leadership to TS 56539bdd0fcc41a7ae3e12c2f743d6fd
I20260709 12:15:40.417423 26856 consensus_queue.cc:1048] T 0cad4999d89c491b8698a2023cc6d805 P 56539bdd0fcc41a7ae3e12c2f743d6fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:40.440044 26791 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d2af60b518a442778196f4cf0c3c918f"
dest_uuid: "ea3ae70a91d24c3e84f03da4605ccede"
mode: GRACEFUL
new_leader_uuid: "773a9a5eeb14469389297d0f170bae34"
 from {username='slave'} at 127.0.0.1:41382
I20260709 12:15:40.440907 26791 raft_consensus.cc:606] T d2af60b518a442778196f4cf0c3c918f P ea3ae70a91d24c3e84f03da4605ccede [term 1 LEADER]: Received request to transfer leadership to TS 773a9a5eeb14469389297d0f170bae34
I20260709 12:15:40.447460 26856 consensus_queue.cc:1048] T 0cad4999d89c491b8698a2023cc6d805 P 56539bdd0fcc41a7ae3e12c2f743d6fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:40.483651 26642 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "61ff419b6fbe4f9e91c20f9347dd8c63"
dest_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd"
mode: GRACEFUL
new_leader_uuid: "773a9a5eeb14469389297d0f170bae34"
 from {username='slave'} at 127.0.0.1:37446
I20260709 12:15:40.484382 26642 raft_consensus.cc:606] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 LEADER]: Received request to transfer leadership to TS 773a9a5eeb14469389297d0f170bae34
I20260709 12:15:40.493139 26642 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0cad4999d89c491b8698a2023cc6d805"
dest_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd"
mode: GRACEFUL
new_leader_uuid: "773a9a5eeb14469389297d0f170bae34"
 from {username='slave'} at 127.0.0.1:37446
I20260709 12:15:40.493734 26642 raft_consensus.cc:606] T 0cad4999d89c491b8698a2023cc6d805 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 LEADER]: Received request to transfer leadership to TS 773a9a5eeb14469389297d0f170bae34
I20260709 12:15:40.499716 26791 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce9b9e0175914633833e79c94d7e6a2a"
dest_uuid: "ea3ae70a91d24c3e84f03da4605ccede"
mode: GRACEFUL
new_leader_uuid: "773a9a5eeb14469389297d0f170bae34"
 from {username='slave'} at 127.0.0.1:41382
I20260709 12:15:40.500308 26791 raft_consensus.cc:606] T ce9b9e0175914633833e79c94d7e6a2a P ea3ae70a91d24c3e84f03da4605ccede [term 1 LEADER]: Received request to transfer leadership to TS 773a9a5eeb14469389297d0f170bae34
I20260709 12:15:40.507088 26642 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c258759a737e4ce1be24541ae8bb535f"
dest_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd"
mode: GRACEFUL
new_leader_uuid: "ea3ae70a91d24c3e84f03da4605ccede"
 from {username='slave'} at 127.0.0.1:37446
I20260709 12:15:40.507692 26642 raft_consensus.cc:606] T c258759a737e4ce1be24541ae8bb535f P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 LEADER]: Received request to transfer leadership to TS ea3ae70a91d24c3e84f03da4605ccede
I20260709 12:15:40.534412 26898 consensus_queue.cc:1048] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 56539bdd0fcc41a7ae3e12c2f743d6fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:40.550173 26856 consensus_queue.cc:1048] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 56539bdd0fcc41a7ae3e12c2f743d6fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:40.565299 26856 raft_consensus.cc:993] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 56539bdd0fcc41a7ae3e12c2f743d6fd: : Instructing follower 773a9a5eeb14469389297d0f170bae34 to start an election
I20260709 12:15:40.565975 26844 raft_consensus.cc:1081] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 LEADER]: Signalling peer 773a9a5eeb14469389297d0f170bae34 to start an election
I20260709 12:15:40.569801 26718 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "61ff419b6fbe4f9e91c20f9347dd8c63"
dest_uuid: "773a9a5eeb14469389297d0f170bae34"
 from {username='slave'} at 127.0.0.1:41414
I20260709 12:15:40.570752 26718 raft_consensus.cc:493] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 773a9a5eeb14469389297d0f170bae34 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:40.571175 26718 raft_consensus.cc:3060] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 773a9a5eeb14469389297d0f170bae34 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:40.580345 26718 raft_consensus.cc:515] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 773a9a5eeb14469389297d0f170bae34 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:40.584775 26718 leader_election.cc:290] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 773a9a5eeb14469389297d0f170bae34 [CANDIDATE]: Term 2 election: Requested vote from peers 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813), ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195:43987)
I20260709 12:15:40.590045 26642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ff419b6fbe4f9e91c20f9347dd8c63" candidate_uuid: "773a9a5eeb14469389297d0f170bae34" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd"
I20260709 12:15:40.592636 26642 raft_consensus.cc:3055] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:40.593026 26642 raft_consensus.cc:740] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56539bdd0fcc41a7ae3e12c2f743d6fd, State: Running, Role: LEADER
I20260709 12:15:40.588320 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ff419b6fbe4f9e91c20f9347dd8c63" candidate_uuid: "773a9a5eeb14469389297d0f170bae34" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea3ae70a91d24c3e84f03da4605ccede"
I20260709 12:15:40.600875 26791 raft_consensus.cc:3060] T 61ff419b6fbe4f9e91c20f9347dd8c63 P ea3ae70a91d24c3e84f03da4605ccede [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:40.594031 26642 consensus_queue.cc:260] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 56539bdd0fcc41a7ae3e12c2f743d6fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:40.603847 26642 raft_consensus.cc:3060] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:40.614300 26791 raft_consensus.cc:2468] T 61ff419b6fbe4f9e91c20f9347dd8c63 P ea3ae70a91d24c3e84f03da4605ccede [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773a9a5eeb14469389297d0f170bae34 in term 2.
I20260709 12:15:40.616214 26682 leader_election.cc:304] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 773a9a5eeb14469389297d0f170bae34 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773a9a5eeb14469389297d0f170bae34, ea3ae70a91d24c3e84f03da4605ccede; no voters: 
I20260709 12:15:40.616364 26642 raft_consensus.cc:2468] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773a9a5eeb14469389297d0f170bae34 in term 2.
I20260709 12:15:40.617249 26905 raft_consensus.cc:2804] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 773a9a5eeb14469389297d0f170bae34 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:40.617897 26905 raft_consensus.cc:697] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 773a9a5eeb14469389297d0f170bae34 [term 2 LEADER]: Becoming Leader. State: Replica: 773a9a5eeb14469389297d0f170bae34, State: Running, Role: LEADER
I20260709 12:15:40.619055 26905 consensus_queue.cc:237] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 773a9a5eeb14469389297d0f170bae34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:40.629066 26539 catalog_manager.cc:5697] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 773a9a5eeb14469389297d0f170bae34 reported cstate change: term changed from 1 to 2, leader changed from 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193) to 773a9a5eeb14469389297d0f170bae34 (127.12.56.194). New cstate: current_term: 2 leader_uuid: "773a9a5eeb14469389297d0f170bae34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:40.666800 26858 raft_consensus.cc:993] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 773a9a5eeb14469389297d0f170bae34: : Instructing follower 56539bdd0fcc41a7ae3e12c2f743d6fd to start an election
I20260709 12:15:40.667410 26905 raft_consensus.cc:1081] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 773a9a5eeb14469389297d0f170bae34 [term 1 LEADER]: Signalling peer 56539bdd0fcc41a7ae3e12c2f743d6fd to start an election
I20260709 12:15:40.669528 26642 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a21937cb47f14ac0b40ea7c7c6e9cab9"
dest_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd"
 from {username='slave'} at 127.0.0.1:60476
I20260709 12:15:40.670141 26642 raft_consensus.cc:493] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:40.670501 26642 raft_consensus.cc:3060] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:40.676213 26642 raft_consensus.cc:515] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:40.679140 26718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a21937cb47f14ac0b40ea7c7c6e9cab9" candidate_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "773a9a5eeb14469389297d0f170bae34"
I20260709 12:15:40.679255 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a21937cb47f14ac0b40ea7c7c6e9cab9" candidate_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea3ae70a91d24c3e84f03da4605ccede"
I20260709 12:15:40.679381 26642 leader_election.cc:290] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 56539bdd0fcc41a7ae3e12c2f743d6fd [CANDIDATE]: Term 2 election: Requested vote from peers 773a9a5eeb14469389297d0f170bae34 (127.12.56.194:37781), ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195:43987)
I20260709 12:15:40.679855 26718 raft_consensus.cc:3055] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 773a9a5eeb14469389297d0f170bae34 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:40.679860 26791 raft_consensus.cc:3060] T a21937cb47f14ac0b40ea7c7c6e9cab9 P ea3ae70a91d24c3e84f03da4605ccede [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:40.680333 26718 raft_consensus.cc:740] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 773a9a5eeb14469389297d0f170bae34 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 773a9a5eeb14469389297d0f170bae34, State: Running, Role: LEADER
I20260709 12:15:40.681478 26718 consensus_queue.cc:260] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 773a9a5eeb14469389297d0f170bae34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:40.682991 26718 raft_consensus.cc:3060] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 773a9a5eeb14469389297d0f170bae34 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:40.688648 26791 raft_consensus.cc:2468] T a21937cb47f14ac0b40ea7c7c6e9cab9 P ea3ae70a91d24c3e84f03da4605ccede [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56539bdd0fcc41a7ae3e12c2f743d6fd in term 2.
I20260709 12:15:40.690124 26607 leader_election.cc:304] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 56539bdd0fcc41a7ae3e12c2f743d6fd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56539bdd0fcc41a7ae3e12c2f743d6fd, ea3ae70a91d24c3e84f03da4605ccede; no voters: 
I20260709 12:15:40.690922 26718 raft_consensus.cc:2468] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 773a9a5eeb14469389297d0f170bae34 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56539bdd0fcc41a7ae3e12c2f743d6fd in term 2.
I20260709 12:15:40.691092 26844 raft_consensus.cc:2804] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:40.691795 26844 raft_consensus.cc:697] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 2 LEADER]: Becoming Leader. State: Replica: 56539bdd0fcc41a7ae3e12c2f743d6fd, State: Running, Role: LEADER
I20260709 12:15:40.692885 26844 consensus_queue.cc:237] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 56539bdd0fcc41a7ae3e12c2f743d6fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:40.701680 26539 catalog_manager.cc:5697] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 56539bdd0fcc41a7ae3e12c2f743d6fd reported cstate change: term changed from 1 to 2, leader changed from 773a9a5eeb14469389297d0f170bae34 (127.12.56.194) to 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193). New cstate: current_term: 2 leader_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:40.742677 26839 raft_consensus.cc:993] T d2af60b518a442778196f4cf0c3c918f P ea3ae70a91d24c3e84f03da4605ccede: : Instructing follower 773a9a5eeb14469389297d0f170bae34 to start an election
I20260709 12:15:40.743330 26864 raft_consensus.cc:1081] T d2af60b518a442778196f4cf0c3c918f P ea3ae70a91d24c3e84f03da4605ccede [term 1 LEADER]: Signalling peer 773a9a5eeb14469389297d0f170bae34 to start an election
I20260709 12:15:40.745170 26718 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d2af60b518a442778196f4cf0c3c918f"
dest_uuid: "773a9a5eeb14469389297d0f170bae34"
 from {username='slave'} at 127.0.0.1:41930
I20260709 12:15:40.745918 26718 raft_consensus.cc:493] T d2af60b518a442778196f4cf0c3c918f P 773a9a5eeb14469389297d0f170bae34 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:40.746263 26718 raft_consensus.cc:3060] T d2af60b518a442778196f4cf0c3c918f P 773a9a5eeb14469389297d0f170bae34 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:40.752101 26718 raft_consensus.cc:515] T d2af60b518a442778196f4cf0c3c918f P 773a9a5eeb14469389297d0f170bae34 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:40.754096 26718 leader_election.cc:290] T d2af60b518a442778196f4cf0c3c918f P 773a9a5eeb14469389297d0f170bae34 [CANDIDATE]: Term 2 election: Requested vote from peers 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813), ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195:43987)
I20260709 12:15:40.755630 26642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2af60b518a442778196f4cf0c3c918f" candidate_uuid: "773a9a5eeb14469389297d0f170bae34" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd"
I20260709 12:15:40.756366 26642 raft_consensus.cc:3060] T d2af60b518a442778196f4cf0c3c918f P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:40.756594 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2af60b518a442778196f4cf0c3c918f" candidate_uuid: "773a9a5eeb14469389297d0f170bae34" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea3ae70a91d24c3e84f03da4605ccede"
I20260709 12:15:40.757349 26791 raft_consensus.cc:3055] T d2af60b518a442778196f4cf0c3c918f P ea3ae70a91d24c3e84f03da4605ccede [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:40.757803 26791 raft_consensus.cc:740] T d2af60b518a442778196f4cf0c3c918f P ea3ae70a91d24c3e84f03da4605ccede [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea3ae70a91d24c3e84f03da4605ccede, State: Running, Role: LEADER
I20260709 12:15:40.758900 26791 consensus_queue.cc:260] T d2af60b518a442778196f4cf0c3c918f P ea3ae70a91d24c3e84f03da4605ccede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:40.760566 26791 raft_consensus.cc:3060] T d2af60b518a442778196f4cf0c3c918f P ea3ae70a91d24c3e84f03da4605ccede [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:40.766458 26642 raft_consensus.cc:2468] T d2af60b518a442778196f4cf0c3c918f P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773a9a5eeb14469389297d0f170bae34 in term 2.
I20260709 12:15:40.768184 26681 leader_election.cc:304] T d2af60b518a442778196f4cf0c3c918f P 773a9a5eeb14469389297d0f170bae34 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56539bdd0fcc41a7ae3e12c2f743d6fd, 773a9a5eeb14469389297d0f170bae34; no voters: 
I20260709 12:15:40.769255 26905 raft_consensus.cc:2804] T d2af60b518a442778196f4cf0c3c918f P 773a9a5eeb14469389297d0f170bae34 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:40.769886 26905 raft_consensus.cc:697] T d2af60b518a442778196f4cf0c3c918f P 773a9a5eeb14469389297d0f170bae34 [term 2 LEADER]: Becoming Leader. State: Replica: 773a9a5eeb14469389297d0f170bae34, State: Running, Role: LEADER
I20260709 12:15:40.770238 26791 raft_consensus.cc:2468] T d2af60b518a442778196f4cf0c3c918f P ea3ae70a91d24c3e84f03da4605ccede [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773a9a5eeb14469389297d0f170bae34 in term 2.
I20260709 12:15:40.771085 26905 consensus_queue.cc:237] T d2af60b518a442778196f4cf0c3c918f P 773a9a5eeb14469389297d0f170bae34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:40.780520 26539 catalog_manager.cc:5697] T d2af60b518a442778196f4cf0c3c918f P 773a9a5eeb14469389297d0f170bae34 reported cstate change: term changed from 1 to 2, leader changed from ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195) to 773a9a5eeb14469389297d0f170bae34 (127.12.56.194). New cstate: current_term: 2 leader_uuid: "773a9a5eeb14469389297d0f170bae34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:40.873646 26842 raft_consensus.cc:993] T c258759a737e4ce1be24541ae8bb535f P 56539bdd0fcc41a7ae3e12c2f743d6fd: : Instructing follower ea3ae70a91d24c3e84f03da4605ccede to start an election
I20260709 12:15:40.874341 26844 raft_consensus.cc:1081] T c258759a737e4ce1be24541ae8bb535f P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 LEADER]: Signalling peer ea3ae70a91d24c3e84f03da4605ccede to start an election
I20260709 12:15:40.876425 26791 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c258759a737e4ce1be24541ae8bb535f"
dest_uuid: "ea3ae70a91d24c3e84f03da4605ccede"
 from {username='slave'} at 127.0.0.1:45720
I20260709 12:15:40.877312 26791 raft_consensus.cc:493] T c258759a737e4ce1be24541ae8bb535f P ea3ae70a91d24c3e84f03da4605ccede [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:40.877848 26791 raft_consensus.cc:3060] T c258759a737e4ce1be24541ae8bb535f P ea3ae70a91d24c3e84f03da4605ccede [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:40.887132 26791 raft_consensus.cc:515] T c258759a737e4ce1be24541ae8bb535f P ea3ae70a91d24c3e84f03da4605ccede [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:40.889133 26791 leader_election.cc:290] T c258759a737e4ce1be24541ae8bb535f P ea3ae70a91d24c3e84f03da4605ccede [CANDIDATE]: Term 2 election: Requested vote from peers 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813), 773a9a5eeb14469389297d0f170bae34 (127.12.56.194:37781)
I20260709 12:15:40.890295 26642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258759a737e4ce1be24541ae8bb535f" candidate_uuid: "ea3ae70a91d24c3e84f03da4605ccede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd"
I20260709 12:15:40.890587 26718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c258759a737e4ce1be24541ae8bb535f" candidate_uuid: "ea3ae70a91d24c3e84f03da4605ccede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "773a9a5eeb14469389297d0f170bae34"
I20260709 12:15:40.891012 26642 raft_consensus.cc:3055] T c258759a737e4ce1be24541ae8bb535f P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:40.891454 26642 raft_consensus.cc:740] T c258759a737e4ce1be24541ae8bb535f P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56539bdd0fcc41a7ae3e12c2f743d6fd, State: Running, Role: LEADER
I20260709 12:15:40.891479 26718 raft_consensus.cc:3060] T c258759a737e4ce1be24541ae8bb535f P 773a9a5eeb14469389297d0f170bae34 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:40.892455 26642 consensus_queue.cc:260] T c258759a737e4ce1be24541ae8bb535f P 56539bdd0fcc41a7ae3e12c2f743d6fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:40.893532 26642 raft_consensus.cc:3060] T c258759a737e4ce1be24541ae8bb535f P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:40.901029 26642 raft_consensus.cc:2468] T c258759a737e4ce1be24541ae8bb535f P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3ae70a91d24c3e84f03da4605ccede in term 2.
I20260709 12:15:40.901889 26718 raft_consensus.cc:2468] T c258759a737e4ce1be24541ae8bb535f P 773a9a5eeb14469389297d0f170bae34 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3ae70a91d24c3e84f03da4605ccede in term 2.
I20260709 12:15:40.902345 26755 leader_election.cc:304] T c258759a737e4ce1be24541ae8bb535f P ea3ae70a91d24c3e84f03da4605ccede [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56539bdd0fcc41a7ae3e12c2f743d6fd, ea3ae70a91d24c3e84f03da4605ccede; no voters: 
I20260709 12:15:40.903692 26864 raft_consensus.cc:2804] T c258759a737e4ce1be24541ae8bb535f P ea3ae70a91d24c3e84f03da4605ccede [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:40.904246 26864 raft_consensus.cc:697] T c258759a737e4ce1be24541ae8bb535f P ea3ae70a91d24c3e84f03da4605ccede [term 2 LEADER]: Becoming Leader. State: Replica: ea3ae70a91d24c3e84f03da4605ccede, State: Running, Role: LEADER
I20260709 12:15:40.905166 26864 consensus_queue.cc:237] T c258759a737e4ce1be24541ae8bb535f P ea3ae70a91d24c3e84f03da4605ccede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:40.916544 26539 catalog_manager.cc:5697] T c258759a737e4ce1be24541ae8bb535f P ea3ae70a91d24c3e84f03da4605ccede reported cstate change: term changed from 1 to 2, leader changed from 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193) to ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195). New cstate: current_term: 2 leader_uuid: "ea3ae70a91d24c3e84f03da4605ccede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:40.931886 26856 raft_consensus.cc:993] T 0cad4999d89c491b8698a2023cc6d805 P 56539bdd0fcc41a7ae3e12c2f743d6fd: : Instructing follower 773a9a5eeb14469389297d0f170bae34 to start an election
I20260709 12:15:40.932556 26856 raft_consensus.cc:1081] T 0cad4999d89c491b8698a2023cc6d805 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 LEADER]: Signalling peer 773a9a5eeb14469389297d0f170bae34 to start an election
I20260709 12:15:40.934592 26718 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0cad4999d89c491b8698a2023cc6d805"
dest_uuid: "773a9a5eeb14469389297d0f170bae34"
 from {username='slave'} at 127.0.0.1:41414
I20260709 12:15:40.935372 26718 raft_consensus.cc:493] T 0cad4999d89c491b8698a2023cc6d805 P 773a9a5eeb14469389297d0f170bae34 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:40.935832 26718 raft_consensus.cc:3060] T 0cad4999d89c491b8698a2023cc6d805 P 773a9a5eeb14469389297d0f170bae34 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:40.946631 26718 raft_consensus.cc:515] T 0cad4999d89c491b8698a2023cc6d805 P 773a9a5eeb14469389297d0f170bae34 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:40.947185 26839 raft_consensus.cc:993] T ce9b9e0175914633833e79c94d7e6a2a P ea3ae70a91d24c3e84f03da4605ccede: : Instructing follower 773a9a5eeb14469389297d0f170bae34 to start an election
I20260709 12:15:40.948238 26864 raft_consensus.cc:1081] T ce9b9e0175914633833e79c94d7e6a2a P ea3ae70a91d24c3e84f03da4605ccede [term 1 LEADER]: Signalling peer 773a9a5eeb14469389297d0f170bae34 to start an election
I20260709 12:15:40.949476 26718 leader_election.cc:290] T 0cad4999d89c491b8698a2023cc6d805 P 773a9a5eeb14469389297d0f170bae34 [CANDIDATE]: Term 2 election: Requested vote from peers 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813), ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195:43987)
I20260709 12:15:40.951550 26642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cad4999d89c491b8698a2023cc6d805" candidate_uuid: "773a9a5eeb14469389297d0f170bae34" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd"
I20260709 12:15:40.952314 26642 raft_consensus.cc:3055] T 0cad4999d89c491b8698a2023cc6d805 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:40.952682 26642 raft_consensus.cc:740] T 0cad4999d89c491b8698a2023cc6d805 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56539bdd0fcc41a7ae3e12c2f743d6fd, State: Running, Role: LEADER
I20260709 12:15:40.954066 26718 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ce9b9e0175914633833e79c94d7e6a2a"
dest_uuid: "773a9a5eeb14469389297d0f170bae34"
 from {username='slave'} at 127.0.0.1:41930
I20260709 12:15:40.953550 26642 consensus_queue.cc:260] T 0cad4999d89c491b8698a2023cc6d805 P 56539bdd0fcc41a7ae3e12c2f743d6fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:40.954890 26718 raft_consensus.cc:493] T ce9b9e0175914633833e79c94d7e6a2a P 773a9a5eeb14469389297d0f170bae34 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:40.955392 26718 raft_consensus.cc:3060] T ce9b9e0175914633833e79c94d7e6a2a P 773a9a5eeb14469389297d0f170bae34 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:40.956182 26642 raft_consensus.cc:3060] T 0cad4999d89c491b8698a2023cc6d805 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:40.961010 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cad4999d89c491b8698a2023cc6d805" candidate_uuid: "773a9a5eeb14469389297d0f170bae34" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea3ae70a91d24c3e84f03da4605ccede"
I20260709 12:15:40.961964 26791 raft_consensus.cc:3060] T 0cad4999d89c491b8698a2023cc6d805 P ea3ae70a91d24c3e84f03da4605ccede [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:40.967571 26642 raft_consensus.cc:2468] T 0cad4999d89c491b8698a2023cc6d805 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773a9a5eeb14469389297d0f170bae34 in term 2.
I20260709 12:15:40.969386 26681 leader_election.cc:304] T 0cad4999d89c491b8698a2023cc6d805 P 773a9a5eeb14469389297d0f170bae34 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56539bdd0fcc41a7ae3e12c2f743d6fd, 773a9a5eeb14469389297d0f170bae34; no voters: 
I20260709 12:15:40.969914 26718 raft_consensus.cc:515] T ce9b9e0175914633833e79c94d7e6a2a P 773a9a5eeb14469389297d0f170bae34 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:40.970606 26905 raft_consensus.cc:2804] T 0cad4999d89c491b8698a2023cc6d805 P 773a9a5eeb14469389297d0f170bae34 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:40.971320 26905 raft_consensus.cc:697] T 0cad4999d89c491b8698a2023cc6d805 P 773a9a5eeb14469389297d0f170bae34 [term 2 LEADER]: Becoming Leader. State: Replica: 773a9a5eeb14469389297d0f170bae34, State: Running, Role: LEADER
I20260709 12:15:40.971812 26791 raft_consensus.cc:2468] T 0cad4999d89c491b8698a2023cc6d805 P ea3ae70a91d24c3e84f03da4605ccede [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773a9a5eeb14469389297d0f170bae34 in term 2.
I20260709 12:15:40.972692 26905 consensus_queue.cc:237] T 0cad4999d89c491b8698a2023cc6d805 P 773a9a5eeb14469389297d0f170bae34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:40.974237 26718 leader_election.cc:290] T ce9b9e0175914633833e79c94d7e6a2a P 773a9a5eeb14469389297d0f170bae34 [CANDIDATE]: Term 2 election: Requested vote from peers 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813), ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195:43987)
I20260709 12:15:40.974800 26792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9b9e0175914633833e79c94d7e6a2a" candidate_uuid: "773a9a5eeb14469389297d0f170bae34" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea3ae70a91d24c3e84f03da4605ccede"
I20260709 12:15:40.975615 26792 raft_consensus.cc:3055] T ce9b9e0175914633833e79c94d7e6a2a P ea3ae70a91d24c3e84f03da4605ccede [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:40.975994 26792 raft_consensus.cc:740] T ce9b9e0175914633833e79c94d7e6a2a P ea3ae70a91d24c3e84f03da4605ccede [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea3ae70a91d24c3e84f03da4605ccede, State: Running, Role: LEADER
I20260709 12:15:40.976944 26792 consensus_queue.cc:260] T ce9b9e0175914633833e79c94d7e6a2a P ea3ae70a91d24c3e84f03da4605ccede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:40.978253 26641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9b9e0175914633833e79c94d7e6a2a" candidate_uuid: "773a9a5eeb14469389297d0f170bae34" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd"
I20260709 12:15:40.978703 26792 raft_consensus.cc:3060] T ce9b9e0175914633833e79c94d7e6a2a P ea3ae70a91d24c3e84f03da4605ccede [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:40.979048 26641 raft_consensus.cc:3060] T ce9b9e0175914633833e79c94d7e6a2a P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:40.988070 26539 catalog_manager.cc:5697] T 0cad4999d89c491b8698a2023cc6d805 P 773a9a5eeb14469389297d0f170bae34 reported cstate change: term changed from 1 to 2, leader changed from 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193) to 773a9a5eeb14469389297d0f170bae34 (127.12.56.194). New cstate: current_term: 2 leader_uuid: "773a9a5eeb14469389297d0f170bae34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:40.989500 26792 raft_consensus.cc:2468] T ce9b9e0175914633833e79c94d7e6a2a P ea3ae70a91d24c3e84f03da4605ccede [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773a9a5eeb14469389297d0f170bae34 in term 2.
I20260709 12:15:40.989900 26641 raft_consensus.cc:2468] T ce9b9e0175914633833e79c94d7e6a2a P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773a9a5eeb14469389297d0f170bae34 in term 2.
I20260709 12:15:40.991492 26681 leader_election.cc:304] T ce9b9e0175914633833e79c94d7e6a2a P 773a9a5eeb14469389297d0f170bae34 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56539bdd0fcc41a7ae3e12c2f743d6fd, 773a9a5eeb14469389297d0f170bae34; no voters: 
I20260709 12:15:40.992676 26905 raft_consensus.cc:2804] T ce9b9e0175914633833e79c94d7e6a2a P 773a9a5eeb14469389297d0f170bae34 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:40.993242 26905 raft_consensus.cc:697] T ce9b9e0175914633833e79c94d7e6a2a P 773a9a5eeb14469389297d0f170bae34 [term 2 LEADER]: Becoming Leader. State: Replica: 773a9a5eeb14469389297d0f170bae34, State: Running, Role: LEADER
I20260709 12:15:40.994773 26905 consensus_queue.cc:237] T ce9b9e0175914633833e79c94d7e6a2a P 773a9a5eeb14469389297d0f170bae34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:41.008504 26539 catalog_manager.cc:5697] T ce9b9e0175914633833e79c94d7e6a2a P 773a9a5eeb14469389297d0f170bae34 reported cstate change: term changed from 1 to 2, leader changed from ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195) to 773a9a5eeb14469389297d0f170bae34 (127.12.56.194). New cstate: current_term: 2 leader_uuid: "773a9a5eeb14469389297d0f170bae34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:41.095866 26792 raft_consensus.cc:1275] T 61ff419b6fbe4f9e91c20f9347dd8c63 P ea3ae70a91d24c3e84f03da4605ccede [term 2 FOLLOWER]: Refusing update from remote peer 773a9a5eeb14469389297d0f170bae34: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:41.097229 26905 consensus_queue.cc:1048] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 773a9a5eeb14469389297d0f170bae34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:41.106839 26641 raft_consensus.cc:1275] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 2 FOLLOWER]: Refusing update from remote peer 773a9a5eeb14469389297d0f170bae34: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:41.109041 26905 consensus_queue.cc:1048] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 773a9a5eeb14469389297d0f170bae34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:41.145166 26718 raft_consensus.cc:1275] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 773a9a5eeb14469389297d0f170bae34 [term 2 FOLLOWER]: Refusing update from remote peer 56539bdd0fcc41a7ae3e12c2f743d6fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:41.146823 26844 consensus_queue.cc:1048] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 56539bdd0fcc41a7ae3e12c2f743d6fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:41.159531 26791 raft_consensus.cc:1275] T a21937cb47f14ac0b40ea7c7c6e9cab9 P ea3ae70a91d24c3e84f03da4605ccede [term 2 FOLLOWER]: Refusing update from remote peer 56539bdd0fcc41a7ae3e12c2f743d6fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:41.165930 26844 consensus_queue.cc:1048] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 56539bdd0fcc41a7ae3e12c2f743d6fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:41.279093 26791 raft_consensus.cc:1275] T d2af60b518a442778196f4cf0c3c918f P ea3ae70a91d24c3e84f03da4605ccede [term 2 FOLLOWER]: Refusing update from remote peer 773a9a5eeb14469389297d0f170bae34: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:41.281226 26905 consensus_queue.cc:1048] T d2af60b518a442778196f4cf0c3c918f P 773a9a5eeb14469389297d0f170bae34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:41.298926 26718 raft_consensus.cc:1275] T c258759a737e4ce1be24541ae8bb535f P 773a9a5eeb14469389297d0f170bae34 [term 2 FOLLOWER]: Refusing update from remote peer ea3ae70a91d24c3e84f03da4605ccede: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:41.304845 26642 raft_consensus.cc:1275] T d2af60b518a442778196f4cf0c3c918f P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 2 FOLLOWER]: Refusing update from remote peer 773a9a5eeb14469389297d0f170bae34: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:41.305591 26890 consensus_queue.cc:1048] T c258759a737e4ce1be24541ae8bb535f P ea3ae70a91d24c3e84f03da4605ccede [LEADER]: Connected to new peer: Peer: permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:41.312029 26905 consensus_queue.cc:1048] T d2af60b518a442778196f4cf0c3c918f P 773a9a5eeb14469389297d0f170bae34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:41.326414 26641 raft_consensus.cc:1275] T c258759a737e4ce1be24541ae8bb535f P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 2 FOLLOWER]: Refusing update from remote peer ea3ae70a91d24c3e84f03da4605ccede: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:41.328474 26890 consensus_queue.cc:1048] T c258759a737e4ce1be24541ae8bb535f P ea3ae70a91d24c3e84f03da4605ccede [LEADER]: Connected to new peer: Peer: permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:41.378001 26791 raft_consensus.cc:1275] T 0cad4999d89c491b8698a2023cc6d805 P ea3ae70a91d24c3e84f03da4605ccede [term 2 FOLLOWER]: Refusing update from remote peer 773a9a5eeb14469389297d0f170bae34: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:41.379490 26905 consensus_queue.cc:1048] T 0cad4999d89c491b8698a2023cc6d805 P 773a9a5eeb14469389297d0f170bae34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:41.387236 26642 raft_consensus.cc:1275] T 0cad4999d89c491b8698a2023cc6d805 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 2 FOLLOWER]: Refusing update from remote peer 773a9a5eeb14469389297d0f170bae34: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:41.390163 26927 consensus_queue.cc:1048] T 0cad4999d89c491b8698a2023cc6d805 P 773a9a5eeb14469389297d0f170bae34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:41.538019 26642 raft_consensus.cc:1275] T ce9b9e0175914633833e79c94d7e6a2a P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 2 FOLLOWER]: Refusing update from remote peer 773a9a5eeb14469389297d0f170bae34: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:41.539856 26905 consensus_queue.cc:1048] T ce9b9e0175914633833e79c94d7e6a2a P 773a9a5eeb14469389297d0f170bae34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:41.551728 26791 raft_consensus.cc:1275] T ce9b9e0175914633833e79c94d7e6a2a P ea3ae70a91d24c3e84f03da4605ccede [term 2 FOLLOWER]: Refusing update from remote peer 773a9a5eeb14469389297d0f170bae34: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:41.553560 26905 consensus_queue.cc:1048] T ce9b9e0175914633833e79c94d7e6a2a P 773a9a5eeb14469389297d0f170bae34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:43.544015 26539 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54656:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:15:43.547138 26539 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:15:43.614037 26630 tablet_service.cc:1511] Processing CreateTablet for tablet 7a40c4830672494f94383cccd2bcb2b7 (DEFAULT_TABLE table=soft_deleted_table [id=ea541b678c52457e8ea7a4b9be8839b3]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:15:43.615943 26630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a40c4830672494f94383cccd2bcb2b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:43.619369 26628 tablet_service.cc:1511] Processing CreateTablet for tablet ed99dec74c4249ad85b7ef69d0c3d6ec (DEFAULT_TABLE table=soft_deleted_table [id=ea541b678c52457e8ea7a4b9be8839b3]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:15:43.620092 26707 tablet_service.cc:1511] Processing CreateTablet for tablet ed99dec74c4249ad85b7ef69d0c3d6ec (DEFAULT_TABLE table=soft_deleted_table [id=ea541b678c52457e8ea7a4b9be8839b3]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:15:43.621162 26628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed99dec74c4249ad85b7ef69d0c3d6ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:43.619369 26777 tablet_service.cc:1511] Processing CreateTablet for tablet 7a40c4830672494f94383cccd2bcb2b7 (DEFAULT_TABLE table=soft_deleted_table [id=ea541b678c52457e8ea7a4b9be8839b3]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:15:43.623550 26777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a40c4830672494f94383cccd2bcb2b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:43.625172 26704 tablet_service.cc:1511] Processing CreateTablet for tablet 6673c39fbed4452aa38ceee09bda8cc6 (DEFAULT_TABLE table=soft_deleted_table [id=ea541b678c52457e8ea7a4b9be8839b3]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:15:43.627218 26631 tablet_service.cc:1511] Processing CreateTablet for tablet 6673c39fbed4452aa38ceee09bda8cc6 (DEFAULT_TABLE table=soft_deleted_table [id=ea541b678c52457e8ea7a4b9be8839b3]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:15:43.628754 26631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6673c39fbed4452aa38ceee09bda8cc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:43.631682 26779 tablet_service.cc:1511] Processing CreateTablet for tablet ed99dec74c4249ad85b7ef69d0c3d6ec (DEFAULT_TABLE table=soft_deleted_table [id=ea541b678c52457e8ea7a4b9be8839b3]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:15:43.633275 26779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed99dec74c4249ad85b7ef69d0c3d6ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:43.633329 26708 tablet_service.cc:1511] Processing CreateTablet for tablet 6368117da5f748b3ae4f1475c4d8decb (DEFAULT_TABLE table=soft_deleted_table [id=ea541b678c52457e8ea7a4b9be8839b3]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:15:43.636756 26632 tablet_service.cc:1511] Processing CreateTablet for tablet 6368117da5f748b3ae4f1475c4d8decb (DEFAULT_TABLE table=soft_deleted_table [id=ea541b678c52457e8ea7a4b9be8839b3]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:15:43.615527 26705 tablet_service.cc:1511] Processing CreateTablet for tablet 7a40c4830672494f94383cccd2bcb2b7 (DEFAULT_TABLE table=soft_deleted_table [id=ea541b678c52457e8ea7a4b9be8839b3]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:15:43.639108 26780 tablet_service.cc:1511] Processing CreateTablet for tablet 6673c39fbed4452aa38ceee09bda8cc6 (DEFAULT_TABLE table=soft_deleted_table [id=ea541b678c52457e8ea7a4b9be8839b3]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:15:43.639981 26632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6368117da5f748b3ae4f1475c4d8decb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:43.640692 26780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6673c39fbed4452aa38ceee09bda8cc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:43.643016 26782 tablet_service.cc:1511] Processing CreateTablet for tablet 6368117da5f748b3ae4f1475c4d8decb (DEFAULT_TABLE table=soft_deleted_table [id=ea541b678c52457e8ea7a4b9be8839b3]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:15:43.645053 26629 tablet_service.cc:1511] Processing CreateTablet for tablet b9898596353d46eab5ff567f15224907 (DEFAULT_TABLE table=soft_deleted_table [id=ea541b678c52457e8ea7a4b9be8839b3]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:15:43.645606 26778 tablet_service.cc:1511] Processing CreateTablet for tablet b9898596353d46eab5ff567f15224907 (DEFAULT_TABLE table=soft_deleted_table [id=ea541b678c52457e8ea7a4b9be8839b3]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:15:43.646597 26629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9898596353d46eab5ff567f15224907. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:43.649284 26703 tablet_service.cc:1511] Processing CreateTablet for tablet eceb0db47a1d432e9cbe22991da985f4 (DEFAULT_TABLE table=soft_deleted_table [id=ea541b678c52457e8ea7a4b9be8839b3]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:15:43.650207 26778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9898596353d46eab5ff567f15224907. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:43.651136 26633 tablet_service.cc:1511] Processing CreateTablet for tablet eceb0db47a1d432e9cbe22991da985f4 (DEFAULT_TABLE table=soft_deleted_table [id=ea541b678c52457e8ea7a4b9be8839b3]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:15:43.651621 26707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed99dec74c4249ad85b7ef69d0c3d6ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:43.652614 26633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eceb0db47a1d432e9cbe22991da985f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:43.654222 26703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eceb0db47a1d432e9cbe22991da985f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:43.655205 26627 tablet_service.cc:1511] Processing CreateTablet for tablet 64c363fad70c4e89bf03bf59e7252fac (DEFAULT_TABLE table=soft_deleted_table [id=ea541b678c52457e8ea7a4b9be8839b3]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:15:43.656641 26627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64c363fad70c4e89bf03bf59e7252fac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:43.642882 26781 tablet_service.cc:1511] Processing CreateTablet for tablet eceb0db47a1d432e9cbe22991da985f4 (DEFAULT_TABLE table=soft_deleted_table [id=ea541b678c52457e8ea7a4b9be8839b3]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:15:43.658169 26704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6673c39fbed4452aa38ceee09bda8cc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:43.659174 26781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eceb0db47a1d432e9cbe22991da985f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:43.660055 26705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a40c4830672494f94383cccd2bcb2b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:43.662269 26782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6368117da5f748b3ae4f1475c4d8decb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:43.646476 26706 tablet_service.cc:1511] Processing CreateTablet for tablet b9898596353d46eab5ff567f15224907 (DEFAULT_TABLE table=soft_deleted_table [id=ea541b678c52457e8ea7a4b9be8839b3]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:15:43.667369 26706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9898596353d46eab5ff567f15224907. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:43.668476 26776 tablet_service.cc:1511] Processing CreateTablet for tablet 64c363fad70c4e89bf03bf59e7252fac (DEFAULT_TABLE table=soft_deleted_table [id=ea541b678c52457e8ea7a4b9be8839b3]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:15:43.670017 26776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64c363fad70c4e89bf03bf59e7252fac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:43.671728 26708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6368117da5f748b3ae4f1475c4d8decb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:43.675135 26774 tablet_service.cc:1511] Processing CreateTablet for tablet eb394e0c07444d0a96763f25ac9394e9 (DEFAULT_TABLE table=soft_deleted_table [id=ea541b678c52457e8ea7a4b9be8839b3]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:15:43.675551 26626 tablet_service.cc:1511] Processing CreateTablet for tablet b213246febae4173bc0e67e7ccc15257 (DEFAULT_TABLE table=soft_deleted_table [id=ea541b678c52457e8ea7a4b9be8839b3]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:15:43.676710 26774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb394e0c07444d0a96763f25ac9394e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:43.676884 26626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b213246febae4173bc0e67e7ccc15257. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:43.673650 26775 tablet_service.cc:1511] Processing CreateTablet for tablet b213246febae4173bc0e67e7ccc15257 (DEFAULT_TABLE table=soft_deleted_table [id=ea541b678c52457e8ea7a4b9be8839b3]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:15:43.682201 26775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b213246febae4173bc0e67e7ccc15257. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:43.682283 26625 tablet_service.cc:1511] Processing CreateTablet for tablet eb394e0c07444d0a96763f25ac9394e9 (DEFAULT_TABLE table=soft_deleted_table [id=ea541b678c52457e8ea7a4b9be8839b3]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:15:43.683364 26702 tablet_service.cc:1511] Processing CreateTablet for tablet 64c363fad70c4e89bf03bf59e7252fac (DEFAULT_TABLE table=soft_deleted_table [id=ea541b678c52457e8ea7a4b9be8839b3]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:15:43.683954 26625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb394e0c07444d0a96763f25ac9394e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:43.685057 26702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64c363fad70c4e89bf03bf59e7252fac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:43.687950 26701 tablet_service.cc:1511] Processing CreateTablet for tablet b213246febae4173bc0e67e7ccc15257 (DEFAULT_TABLE table=soft_deleted_table [id=ea541b678c52457e8ea7a4b9be8839b3]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:15:43.689714 26701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b213246febae4173bc0e67e7ccc15257. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:43.709506 26700 tablet_service.cc:1511] Processing CreateTablet for tablet eb394e0c07444d0a96763f25ac9394e9 (DEFAULT_TABLE table=soft_deleted_table [id=ea541b678c52457e8ea7a4b9be8839b3]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:15:43.711400 26700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb394e0c07444d0a96763f25ac9394e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:43.783181 26942 tablet_bootstrap.cc:492] T b9898596353d46eab5ff567f15224907 P 773a9a5eeb14469389297d0f170bae34: Bootstrap starting.
I20260709 12:15:43.800680 26942 tablet_bootstrap.cc:654] T b9898596353d46eab5ff567f15224907 P 773a9a5eeb14469389297d0f170bae34: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:43.822417 26943 tablet_bootstrap.cc:492] T 6368117da5f748b3ae4f1475c4d8decb P 56539bdd0fcc41a7ae3e12c2f743d6fd: Bootstrap starting.
I20260709 12:15:43.849381 26943 tablet_bootstrap.cc:654] T 6368117da5f748b3ae4f1475c4d8decb P 56539bdd0fcc41a7ae3e12c2f743d6fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:43.850814 26944 tablet_bootstrap.cc:492] T b9898596353d46eab5ff567f15224907 P ea3ae70a91d24c3e84f03da4605ccede: Bootstrap starting.
I20260709 12:15:43.867266 26942 tablet_bootstrap.cc:492] T b9898596353d46eab5ff567f15224907 P 773a9a5eeb14469389297d0f170bae34: No bootstrap required, opened a new log
I20260709 12:15:43.868021 26942 ts_tablet_manager.cc:1403] T b9898596353d46eab5ff567f15224907 P 773a9a5eeb14469389297d0f170bae34: Time spent bootstrapping tablet: real 0.085s	user 0.007s	sys 0.024s
I20260709 12:15:43.865691 26944 tablet_bootstrap.cc:654] T b9898596353d46eab5ff567f15224907 P ea3ae70a91d24c3e84f03da4605ccede: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:43.872167 26942 raft_consensus.cc:359] T b9898596353d46eab5ff567f15224907 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:43.873307 26942 raft_consensus.cc:385] T b9898596353d46eab5ff567f15224907 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:43.873714 26942 raft_consensus.cc:740] T b9898596353d46eab5ff567f15224907 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773a9a5eeb14469389297d0f170bae34, State: Initialized, Role: FOLLOWER
I20260709 12:15:43.874807 26942 consensus_queue.cc:260] T b9898596353d46eab5ff567f15224907 P 773a9a5eeb14469389297d0f170bae34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:43.876332 26944 tablet_bootstrap.cc:492] T b9898596353d46eab5ff567f15224907 P ea3ae70a91d24c3e84f03da4605ccede: No bootstrap required, opened a new log
I20260709 12:15:43.877027 26944 ts_tablet_manager.cc:1403] T b9898596353d46eab5ff567f15224907 P ea3ae70a91d24c3e84f03da4605ccede: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.002s
I20260709 12:15:43.878278 26942 ts_tablet_manager.cc:1434] T b9898596353d46eab5ff567f15224907 P 773a9a5eeb14469389297d0f170bae34: Time spent starting tablet: real 0.010s	user 0.012s	sys 0.000s
I20260709 12:15:43.879645 26942 tablet_bootstrap.cc:492] T ed99dec74c4249ad85b7ef69d0c3d6ec P 773a9a5eeb14469389297d0f170bae34: Bootstrap starting.
I20260709 12:15:43.880785 26944 raft_consensus.cc:359] T b9898596353d46eab5ff567f15224907 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:43.883970 26943 tablet_bootstrap.cc:492] T 6368117da5f748b3ae4f1475c4d8decb P 56539bdd0fcc41a7ae3e12c2f743d6fd: No bootstrap required, opened a new log
I20260709 12:15:43.884872 26943 ts_tablet_manager.cc:1403] T 6368117da5f748b3ae4f1475c4d8decb P 56539bdd0fcc41a7ae3e12c2f743d6fd: Time spent bootstrapping tablet: real 0.063s	user 0.008s	sys 0.007s
I20260709 12:15:43.888754 26943 raft_consensus.cc:359] T 6368117da5f748b3ae4f1475c4d8decb P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:43.889304 26942 tablet_bootstrap.cc:654] T ed99dec74c4249ad85b7ef69d0c3d6ec P 773a9a5eeb14469389297d0f170bae34: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:43.889683 26943 raft_consensus.cc:385] T 6368117da5f748b3ae4f1475c4d8decb P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:43.890066 26943 raft_consensus.cc:740] T 6368117da5f748b3ae4f1475c4d8decb P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56539bdd0fcc41a7ae3e12c2f743d6fd, State: Initialized, Role: FOLLOWER
I20260709 12:15:43.890915 26943 consensus_queue.cc:260] T 6368117da5f748b3ae4f1475c4d8decb P 56539bdd0fcc41a7ae3e12c2f743d6fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:43.893699 26943 ts_tablet_manager.cc:1434] T 6368117da5f748b3ae4f1475c4d8decb P 56539bdd0fcc41a7ae3e12c2f743d6fd: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:15:43.881758 26944 raft_consensus.cc:385] T b9898596353d46eab5ff567f15224907 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:43.894490 26944 raft_consensus.cc:740] T b9898596353d46eab5ff567f15224907 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3ae70a91d24c3e84f03da4605ccede, State: Initialized, Role: FOLLOWER
I20260709 12:15:43.895358 26944 consensus_queue.cc:260] T b9898596353d46eab5ff567f15224907 P ea3ae70a91d24c3e84f03da4605ccede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:43.901330 26944 ts_tablet_manager.cc:1434] T b9898596353d46eab5ff567f15224907 P ea3ae70a91d24c3e84f03da4605ccede: Time spent starting tablet: real 0.024s	user 0.010s	sys 0.000s
I20260709 12:15:43.913694 26944 tablet_bootstrap.cc:492] T eb394e0c07444d0a96763f25ac9394e9 P ea3ae70a91d24c3e84f03da4605ccede: Bootstrap starting.
I20260709 12:15:43.900476 26943 tablet_bootstrap.cc:492] T 6673c39fbed4452aa38ceee09bda8cc6 P 56539bdd0fcc41a7ae3e12c2f743d6fd: Bootstrap starting.
I20260709 12:15:43.925374 26944 tablet_bootstrap.cc:654] T eb394e0c07444d0a96763f25ac9394e9 P ea3ae70a91d24c3e84f03da4605ccede: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:43.927682 26943 tablet_bootstrap.cc:654] T 6673c39fbed4452aa38ceee09bda8cc6 P 56539bdd0fcc41a7ae3e12c2f743d6fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:43.927565 26942 tablet_bootstrap.cc:492] T ed99dec74c4249ad85b7ef69d0c3d6ec P 773a9a5eeb14469389297d0f170bae34: No bootstrap required, opened a new log
I20260709 12:15:43.928759 26942 ts_tablet_manager.cc:1403] T ed99dec74c4249ad85b7ef69d0c3d6ec P 773a9a5eeb14469389297d0f170bae34: Time spent bootstrapping tablet: real 0.049s	user 0.020s	sys 0.007s
I20260709 12:15:43.932365 26942 raft_consensus.cc:359] T ed99dec74c4249ad85b7ef69d0c3d6ec P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:43.933283 26942 raft_consensus.cc:385] T ed99dec74c4249ad85b7ef69d0c3d6ec P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:43.933657 26942 raft_consensus.cc:740] T ed99dec74c4249ad85b7ef69d0c3d6ec P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773a9a5eeb14469389297d0f170bae34, State: Initialized, Role: FOLLOWER
I20260709 12:15:43.934635 26942 consensus_queue.cc:260] T ed99dec74c4249ad85b7ef69d0c3d6ec P 773a9a5eeb14469389297d0f170bae34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:43.939395 26943 tablet_bootstrap.cc:492] T 6673c39fbed4452aa38ceee09bda8cc6 P 56539bdd0fcc41a7ae3e12c2f743d6fd: No bootstrap required, opened a new log
I20260709 12:15:43.940043 26943 ts_tablet_manager.cc:1403] T 6673c39fbed4452aa38ceee09bda8cc6 P 56539bdd0fcc41a7ae3e12c2f743d6fd: Time spent bootstrapping tablet: real 0.040s	user 0.020s	sys 0.004s
I20260709 12:15:43.943490 26943 raft_consensus.cc:359] T 6673c39fbed4452aa38ceee09bda8cc6 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:43.944519 26943 raft_consensus.cc:385] T 6673c39fbed4452aa38ceee09bda8cc6 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:43.944849 26943 raft_consensus.cc:740] T 6673c39fbed4452aa38ceee09bda8cc6 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56539bdd0fcc41a7ae3e12c2f743d6fd, State: Initialized, Role: FOLLOWER
I20260709 12:15:43.945551 26943 consensus_queue.cc:260] T 6673c39fbed4452aa38ceee09bda8cc6 P 56539bdd0fcc41a7ae3e12c2f743d6fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:43.948009 26943 ts_tablet_manager.cc:1434] T 6673c39fbed4452aa38ceee09bda8cc6 P 56539bdd0fcc41a7ae3e12c2f743d6fd: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:15:43.949146 26943 tablet_bootstrap.cc:492] T 64c363fad70c4e89bf03bf59e7252fac P 56539bdd0fcc41a7ae3e12c2f743d6fd: Bootstrap starting.
I20260709 12:15:43.957254 26943 tablet_bootstrap.cc:654] T 64c363fad70c4e89bf03bf59e7252fac P 56539bdd0fcc41a7ae3e12c2f743d6fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:43.969547 26943 tablet_bootstrap.cc:492] T 64c363fad70c4e89bf03bf59e7252fac P 56539bdd0fcc41a7ae3e12c2f743d6fd: No bootstrap required, opened a new log
I20260709 12:15:43.974658 26943 ts_tablet_manager.cc:1403] T 64c363fad70c4e89bf03bf59e7252fac P 56539bdd0fcc41a7ae3e12c2f743d6fd: Time spent bootstrapping tablet: real 0.026s	user 0.004s	sys 0.016s
I20260709 12:15:43.978235 26943 raft_consensus.cc:359] T 64c363fad70c4e89bf03bf59e7252fac P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:43.979029 26943 raft_consensus.cc:385] T 64c363fad70c4e89bf03bf59e7252fac P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:43.979358 26943 raft_consensus.cc:740] T 64c363fad70c4e89bf03bf59e7252fac P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56539bdd0fcc41a7ae3e12c2f743d6fd, State: Initialized, Role: FOLLOWER
I20260709 12:15:43.979640 26942 ts_tablet_manager.cc:1434] T ed99dec74c4249ad85b7ef69d0c3d6ec P 773a9a5eeb14469389297d0f170bae34: Time spent starting tablet: real 0.050s	user 0.022s	sys 0.016s
I20260709 12:15:43.979782 26944 tablet_bootstrap.cc:492] T eb394e0c07444d0a96763f25ac9394e9 P ea3ae70a91d24c3e84f03da4605ccede: No bootstrap required, opened a new log
I20260709 12:15:43.980223 26943 consensus_queue.cc:260] T 64c363fad70c4e89bf03bf59e7252fac P 56539bdd0fcc41a7ae3e12c2f743d6fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:43.981194 26942 tablet_bootstrap.cc:492] T eb394e0c07444d0a96763f25ac9394e9 P 773a9a5eeb14469389297d0f170bae34: Bootstrap starting.
I20260709 12:15:43.982702 26943 ts_tablet_manager.cc:1434] T 64c363fad70c4e89bf03bf59e7252fac P 56539bdd0fcc41a7ae3e12c2f743d6fd: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:15:43.984177 26943 tablet_bootstrap.cc:492] T eb394e0c07444d0a96763f25ac9394e9 P 56539bdd0fcc41a7ae3e12c2f743d6fd: Bootstrap starting.
I20260709 12:15:43.991343 26943 tablet_bootstrap.cc:654] T eb394e0c07444d0a96763f25ac9394e9 P 56539bdd0fcc41a7ae3e12c2f743d6fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:43.993073 26944 ts_tablet_manager.cc:1403] T eb394e0c07444d0a96763f25ac9394e9 P ea3ae70a91d24c3e84f03da4605ccede: Time spent bootstrapping tablet: real 0.080s	user 0.011s	sys 0.007s
I20260709 12:15:43.997740 26942 tablet_bootstrap.cc:654] T eb394e0c07444d0a96763f25ac9394e9 P 773a9a5eeb14469389297d0f170bae34: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:44.003598 26943 tablet_bootstrap.cc:492] T eb394e0c07444d0a96763f25ac9394e9 P 56539bdd0fcc41a7ae3e12c2f743d6fd: No bootstrap required, opened a new log
I20260709 12:15:44.003425 26944 raft_consensus.cc:359] T eb394e0c07444d0a96763f25ac9394e9 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.004201 26943 ts_tablet_manager.cc:1403] T eb394e0c07444d0a96763f25ac9394e9 P 56539bdd0fcc41a7ae3e12c2f743d6fd: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 12:15:44.004338 26944 raft_consensus.cc:385] T eb394e0c07444d0a96763f25ac9394e9 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:44.004696 26944 raft_consensus.cc:740] T eb394e0c07444d0a96763f25ac9394e9 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3ae70a91d24c3e84f03da4605ccede, State: Initialized, Role: FOLLOWER
I20260709 12:15:44.005702 26944 consensus_queue.cc:260] T eb394e0c07444d0a96763f25ac9394e9 P ea3ae70a91d24c3e84f03da4605ccede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.009110 26944 ts_tablet_manager.cc:1434] T eb394e0c07444d0a96763f25ac9394e9 P ea3ae70a91d24c3e84f03da4605ccede: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:15:44.010654 26944 tablet_bootstrap.cc:492] T ed99dec74c4249ad85b7ef69d0c3d6ec P ea3ae70a91d24c3e84f03da4605ccede: Bootstrap starting.
I20260709 12:15:44.012472 26943 raft_consensus.cc:359] T eb394e0c07444d0a96763f25ac9394e9 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.013342 26943 raft_consensus.cc:385] T eb394e0c07444d0a96763f25ac9394e9 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:44.013655 26943 raft_consensus.cc:740] T eb394e0c07444d0a96763f25ac9394e9 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56539bdd0fcc41a7ae3e12c2f743d6fd, State: Initialized, Role: FOLLOWER
I20260709 12:15:44.014684 26943 consensus_queue.cc:260] T eb394e0c07444d0a96763f25ac9394e9 P 56539bdd0fcc41a7ae3e12c2f743d6fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.018083 26943 ts_tablet_manager.cc:1434] T eb394e0c07444d0a96763f25ac9394e9 P 56539bdd0fcc41a7ae3e12c2f743d6fd: Time spent starting tablet: real 0.013s	user 0.002s	sys 0.009s
I20260709 12:15:44.019063 26951 raft_consensus.cc:493] T ed99dec74c4249ad85b7ef69d0c3d6ec P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.019282 26943 tablet_bootstrap.cc:492] T b9898596353d46eab5ff567f15224907 P 56539bdd0fcc41a7ae3e12c2f743d6fd: Bootstrap starting.
I20260709 12:15:44.019717 26951 raft_consensus.cc:515] T ed99dec74c4249ad85b7ef69d0c3d6ec P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.021617 26942 tablet_bootstrap.cc:492] T eb394e0c07444d0a96763f25ac9394e9 P 773a9a5eeb14469389297d0f170bae34: No bootstrap required, opened a new log
I20260709 12:15:44.022578 26942 ts_tablet_manager.cc:1403] T eb394e0c07444d0a96763f25ac9394e9 P 773a9a5eeb14469389297d0f170bae34: Time spent bootstrapping tablet: real 0.042s	user 0.017s	sys 0.000s
I20260709 12:15:44.023571 26641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed99dec74c4249ad85b7ef69d0c3d6ec" candidate_uuid: "773a9a5eeb14469389297d0f170bae34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" is_pre_election: true
I20260709 12:15:44.027361 26943 tablet_bootstrap.cc:654] T b9898596353d46eab5ff567f15224907 P 56539bdd0fcc41a7ae3e12c2f743d6fd: Neither blocks nor log segments found. Creating new log.
W20260709 12:15:44.027710 26681 leader_election.cc:343] T ed99dec74c4249ad85b7ef69d0c3d6ec P 773a9a5eeb14469389297d0f170bae34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:44.028831 26951 leader_election.cc:290] T ed99dec74c4249ad85b7ef69d0c3d6ec P 773a9a5eeb14469389297d0f170bae34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813), ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195:43987)
I20260709 12:15:44.030076 26792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed99dec74c4249ad85b7ef69d0c3d6ec" candidate_uuid: "773a9a5eeb14469389297d0f170bae34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3ae70a91d24c3e84f03da4605ccede" is_pre_election: true
W20260709 12:15:44.031749 26682 leader_election.cc:343] T ed99dec74c4249ad85b7ef69d0c3d6ec P 773a9a5eeb14469389297d0f170bae34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195:43987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:44.032219 26682 leader_election.cc:304] T ed99dec74c4249ad85b7ef69d0c3d6ec P 773a9a5eeb14469389297d0f170bae34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773a9a5eeb14469389297d0f170bae34; no voters: 56539bdd0fcc41a7ae3e12c2f743d6fd, ea3ae70a91d24c3e84f03da4605ccede
I20260709 12:15:44.034124 26951 raft_consensus.cc:2749] T ed99dec74c4249ad85b7ef69d0c3d6ec P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:44.073065 26944 tablet_bootstrap.cc:654] T ed99dec74c4249ad85b7ef69d0c3d6ec P ea3ae70a91d24c3e84f03da4605ccede: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:44.073696 26943 tablet_bootstrap.cc:492] T b9898596353d46eab5ff567f15224907 P 56539bdd0fcc41a7ae3e12c2f743d6fd: No bootstrap required, opened a new log
I20260709 12:15:44.074357 26943 ts_tablet_manager.cc:1403] T b9898596353d46eab5ff567f15224907 P 56539bdd0fcc41a7ae3e12c2f743d6fd: Time spent bootstrapping tablet: real 0.055s	user 0.010s	sys 0.010s
I20260709 12:15:44.073719 26942 raft_consensus.cc:359] T eb394e0c07444d0a96763f25ac9394e9 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.075106 26942 raft_consensus.cc:385] T eb394e0c07444d0a96763f25ac9394e9 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:44.077723 26943 raft_consensus.cc:359] T b9898596353d46eab5ff567f15224907 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.078591 26942 raft_consensus.cc:740] T eb394e0c07444d0a96763f25ac9394e9 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773a9a5eeb14469389297d0f170bae34, State: Initialized, Role: FOLLOWER
I20260709 12:15:44.078852 26943 raft_consensus.cc:385] T b9898596353d46eab5ff567f15224907 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:44.079205 26943 raft_consensus.cc:740] T b9898596353d46eab5ff567f15224907 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56539bdd0fcc41a7ae3e12c2f743d6fd, State: Initialized, Role: FOLLOWER
I20260709 12:15:44.079520 26942 consensus_queue.cc:260] T eb394e0c07444d0a96763f25ac9394e9 P 773a9a5eeb14469389297d0f170bae34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.080037 26943 consensus_queue.cc:260] T b9898596353d46eab5ff567f15224907 P 56539bdd0fcc41a7ae3e12c2f743d6fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.082497 26943 ts_tablet_manager.cc:1434] T b9898596353d46eab5ff567f15224907 P 56539bdd0fcc41a7ae3e12c2f743d6fd: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 12:15:44.083891 26943 tablet_bootstrap.cc:492] T 7a40c4830672494f94383cccd2bcb2b7 P 56539bdd0fcc41a7ae3e12c2f743d6fd: Bootstrap starting.
I20260709 12:15:44.091382 26942 ts_tablet_manager.cc:1434] T eb394e0c07444d0a96763f25ac9394e9 P 773a9a5eeb14469389297d0f170bae34: Time spent starting tablet: real 0.068s	user 0.027s	sys 0.019s
I20260709 12:15:44.091606 26943 tablet_bootstrap.cc:654] T 7a40c4830672494f94383cccd2bcb2b7 P 56539bdd0fcc41a7ae3e12c2f743d6fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:44.093027 26942 tablet_bootstrap.cc:492] T 64c363fad70c4e89bf03bf59e7252fac P 773a9a5eeb14469389297d0f170bae34: Bootstrap starting.
I20260709 12:15:44.101225 26942 tablet_bootstrap.cc:654] T 64c363fad70c4e89bf03bf59e7252fac P 773a9a5eeb14469389297d0f170bae34: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:44.104204 26944 tablet_bootstrap.cc:492] T ed99dec74c4249ad85b7ef69d0c3d6ec P ea3ae70a91d24c3e84f03da4605ccede: No bootstrap required, opened a new log
I20260709 12:15:44.104355 26943 tablet_bootstrap.cc:492] T 7a40c4830672494f94383cccd2bcb2b7 P 56539bdd0fcc41a7ae3e12c2f743d6fd: No bootstrap required, opened a new log
I20260709 12:15:44.105021 26944 ts_tablet_manager.cc:1403] T ed99dec74c4249ad85b7ef69d0c3d6ec P ea3ae70a91d24c3e84f03da4605ccede: Time spent bootstrapping tablet: real 0.095s	user 0.014s	sys 0.001s
I20260709 12:15:44.105191 26943 ts_tablet_manager.cc:1403] T 7a40c4830672494f94383cccd2bcb2b7 P 56539bdd0fcc41a7ae3e12c2f743d6fd: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.009s
I20260709 12:15:44.111203 26943 raft_consensus.cc:359] T 7a40c4830672494f94383cccd2bcb2b7 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.112159 26943 raft_consensus.cc:385] T 7a40c4830672494f94383cccd2bcb2b7 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:44.112629 26943 raft_consensus.cc:740] T 7a40c4830672494f94383cccd2bcb2b7 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56539bdd0fcc41a7ae3e12c2f743d6fd, State: Initialized, Role: FOLLOWER
I20260709 12:15:44.113857 26943 consensus_queue.cc:260] T 7a40c4830672494f94383cccd2bcb2b7 P 56539bdd0fcc41a7ae3e12c2f743d6fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.116109 26944 raft_consensus.cc:359] T ed99dec74c4249ad85b7ef69d0c3d6ec P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.117012 26944 raft_consensus.cc:385] T ed99dec74c4249ad85b7ef69d0c3d6ec P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:44.117352 26944 raft_consensus.cc:740] T ed99dec74c4249ad85b7ef69d0c3d6ec P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3ae70a91d24c3e84f03da4605ccede, State: Initialized, Role: FOLLOWER
I20260709 12:15:44.117622 26943 ts_tablet_manager.cc:1434] T 7a40c4830672494f94383cccd2bcb2b7 P 56539bdd0fcc41a7ae3e12c2f743d6fd: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:15:44.118253 26944 consensus_queue.cc:260] T ed99dec74c4249ad85b7ef69d0c3d6ec P ea3ae70a91d24c3e84f03da4605ccede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.119267 26943 tablet_bootstrap.cc:492] T eceb0db47a1d432e9cbe22991da985f4 P 56539bdd0fcc41a7ae3e12c2f743d6fd: Bootstrap starting.
I20260709 12:15:44.120786 26944 ts_tablet_manager.cc:1434] T ed99dec74c4249ad85b7ef69d0c3d6ec P ea3ae70a91d24c3e84f03da4605ccede: Time spent starting tablet: real 0.015s	user 0.000s	sys 0.007s
I20260709 12:15:44.121999 26944 tablet_bootstrap.cc:492] T 6673c39fbed4452aa38ceee09bda8cc6 P ea3ae70a91d24c3e84f03da4605ccede: Bootstrap starting.
I20260709 12:15:44.129144 26944 tablet_bootstrap.cc:654] T 6673c39fbed4452aa38ceee09bda8cc6 P ea3ae70a91d24c3e84f03da4605ccede: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:44.132203 26856 raft_consensus.cc:493] T 6368117da5f748b3ae4f1475c4d8decb P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.133145 26942 tablet_bootstrap.cc:492] T 64c363fad70c4e89bf03bf59e7252fac P 773a9a5eeb14469389297d0f170bae34: No bootstrap required, opened a new log
I20260709 12:15:44.132892 26856 raft_consensus.cc:515] T 6368117da5f748b3ae4f1475c4d8decb P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.133941 26942 ts_tablet_manager.cc:1403] T 64c363fad70c4e89bf03bf59e7252fac P 773a9a5eeb14469389297d0f170bae34: Time spent bootstrapping tablet: real 0.041s	user 0.009s	sys 0.023s
I20260709 12:15:44.136811 26792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6368117da5f748b3ae4f1475c4d8decb" candidate_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3ae70a91d24c3e84f03da4605ccede" is_pre_election: true
I20260709 12:15:44.138074 26942 raft_consensus.cc:359] T 64c363fad70c4e89bf03bf59e7252fac P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
W20260709 12:15:44.138577 26607 leader_election.cc:343] T 6368117da5f748b3ae4f1475c4d8decb P 56539bdd0fcc41a7ae3e12c2f743d6fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195:43987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:44.139119 26942 raft_consensus.cc:385] T 64c363fad70c4e89bf03bf59e7252fac P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:44.139562 26942 raft_consensus.cc:740] T 64c363fad70c4e89bf03bf59e7252fac P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773a9a5eeb14469389297d0f170bae34, State: Initialized, Role: FOLLOWER
I20260709 12:15:44.140631 26942 consensus_queue.cc:260] T 64c363fad70c4e89bf03bf59e7252fac P 773a9a5eeb14469389297d0f170bae34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.141551 26944 tablet_bootstrap.cc:492] T 6673c39fbed4452aa38ceee09bda8cc6 P ea3ae70a91d24c3e84f03da4605ccede: No bootstrap required, opened a new log
I20260709 12:15:44.142577 26944 ts_tablet_manager.cc:1403] T 6673c39fbed4452aa38ceee09bda8cc6 P ea3ae70a91d24c3e84f03da4605ccede: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.004s
I20260709 12:15:44.142634 26716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6368117da5f748b3ae4f1475c4d8decb" candidate_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773a9a5eeb14469389297d0f170bae34" is_pre_election: true
W20260709 12:15:44.145166 26609 leader_election.cc:343] T 6368117da5f748b3ae4f1475c4d8decb P 56539bdd0fcc41a7ae3e12c2f743d6fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 773a9a5eeb14469389297d0f170bae34 (127.12.56.194:37781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:44.145690 26609 leader_election.cc:304] T 6368117da5f748b3ae4f1475c4d8decb P 56539bdd0fcc41a7ae3e12c2f743d6fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56539bdd0fcc41a7ae3e12c2f743d6fd; no voters: 773a9a5eeb14469389297d0f170bae34, ea3ae70a91d24c3e84f03da4605ccede
I20260709 12:15:44.145965 26890 raft_consensus.cc:493] T eb394e0c07444d0a96763f25ac9394e9 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.146288 26944 raft_consensus.cc:359] T 6673c39fbed4452aa38ceee09bda8cc6 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.146533 26856 leader_election.cc:290] T 6368117da5f748b3ae4f1475c4d8decb P 56539bdd0fcc41a7ae3e12c2f743d6fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 773a9a5eeb14469389297d0f170bae34 (127.12.56.194:37781), ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195:43987)
I20260709 12:15:44.147176 26944 raft_consensus.cc:385] T 6673c39fbed4452aa38ceee09bda8cc6 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:44.146582 26890 raft_consensus.cc:515] T eb394e0c07444d0a96763f25ac9394e9 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.147598 26952 raft_consensus.cc:2749] T 6368117da5f748b3ae4f1475c4d8decb P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:44.147588 26944 raft_consensus.cc:740] T 6673c39fbed4452aa38ceee09bda8cc6 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3ae70a91d24c3e84f03da4605ccede, State: Initialized, Role: FOLLOWER
I20260709 12:15:44.149971 26641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb394e0c07444d0a96763f25ac9394e9" candidate_uuid: "ea3ae70a91d24c3e84f03da4605ccede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" is_pre_election: true
I20260709 12:15:44.149849 26944 consensus_queue.cc:260] T 6673c39fbed4452aa38ceee09bda8cc6 P ea3ae70a91d24c3e84f03da4605ccede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.150665 26641 raft_consensus.cc:2468] T eb394e0c07444d0a96763f25ac9394e9 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3ae70a91d24c3e84f03da4605ccede in term 0.
I20260709 12:15:44.152017 26943 tablet_bootstrap.cc:654] T eceb0db47a1d432e9cbe22991da985f4 P 56539bdd0fcc41a7ae3e12c2f743d6fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:44.152325 26755 leader_election.cc:304] T eb394e0c07444d0a96763f25ac9394e9 P ea3ae70a91d24c3e84f03da4605ccede [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56539bdd0fcc41a7ae3e12c2f743d6fd, ea3ae70a91d24c3e84f03da4605ccede; no voters: 
I20260709 12:15:44.152882 26942 ts_tablet_manager.cc:1434] T 64c363fad70c4e89bf03bf59e7252fac P 773a9a5eeb14469389297d0f170bae34: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 12:15:44.154688 26890 leader_election.cc:290] T eb394e0c07444d0a96763f25ac9394e9 P ea3ae70a91d24c3e84f03da4605ccede [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813), 773a9a5eeb14469389297d0f170bae34 (127.12.56.194:37781)
I20260709 12:15:44.155824 26890 raft_consensus.cc:2804] T eb394e0c07444d0a96763f25ac9394e9 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:44.156831 26952 raft_consensus.cc:493] T 64c363fad70c4e89bf03bf59e7252fac P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.157358 26952 raft_consensus.cc:515] T 64c363fad70c4e89bf03bf59e7252fac P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.158631 26718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb394e0c07444d0a96763f25ac9394e9" candidate_uuid: "ea3ae70a91d24c3e84f03da4605ccede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773a9a5eeb14469389297d0f170bae34" is_pre_election: true
I20260709 12:15:44.159379 26718 raft_consensus.cc:2468] T eb394e0c07444d0a96763f25ac9394e9 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3ae70a91d24c3e84f03da4605ccede in term 0.
I20260709 12:15:44.159685 26952 leader_election.cc:290] T 64c363fad70c4e89bf03bf59e7252fac P 56539bdd0fcc41a7ae3e12c2f743d6fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 773a9a5eeb14469389297d0f170bae34 (127.12.56.194:37781), ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195:43987)
I20260709 12:15:44.156296 26890 raft_consensus.cc:493] T eb394e0c07444d0a96763f25ac9394e9 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:44.161365 26890 raft_consensus.cc:3060] T eb394e0c07444d0a96763f25ac9394e9 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:44.162321 26792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c363fad70c4e89bf03bf59e7252fac" candidate_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3ae70a91d24c3e84f03da4605ccede" is_pre_election: true
W20260709 12:15:44.164040 26607 leader_election.cc:343] T 64c363fad70c4e89bf03bf59e7252fac P 56539bdd0fcc41a7ae3e12c2f743d6fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195:43987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:44.162313 26718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c363fad70c4e89bf03bf59e7252fac" candidate_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773a9a5eeb14469389297d0f170bae34" is_pre_election: true
I20260709 12:15:44.165380 26718 raft_consensus.cc:2468] T 64c363fad70c4e89bf03bf59e7252fac P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56539bdd0fcc41a7ae3e12c2f743d6fd in term 0.
I20260709 12:15:44.166416 26944 ts_tablet_manager.cc:1434] T 6673c39fbed4452aa38ceee09bda8cc6 P ea3ae70a91d24c3e84f03da4605ccede: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.005s
I20260709 12:15:44.166771 26609 leader_election.cc:304] T 64c363fad70c4e89bf03bf59e7252fac P 56539bdd0fcc41a7ae3e12c2f743d6fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56539bdd0fcc41a7ae3e12c2f743d6fd, 773a9a5eeb14469389297d0f170bae34; no voters: ea3ae70a91d24c3e84f03da4605ccede
I20260709 12:15:44.167550 26944 tablet_bootstrap.cc:492] T 6368117da5f748b3ae4f1475c4d8decb P ea3ae70a91d24c3e84f03da4605ccede: Bootstrap starting.
I20260709 12:15:44.168306 26952 raft_consensus.cc:2804] T 64c363fad70c4e89bf03bf59e7252fac P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:44.168804 26952 raft_consensus.cc:493] T 64c363fad70c4e89bf03bf59e7252fac P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:44.169216 26952 raft_consensus.cc:3060] T 64c363fad70c4e89bf03bf59e7252fac P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:44.176651 26944 tablet_bootstrap.cc:654] T 6368117da5f748b3ae4f1475c4d8decb P ea3ae70a91d24c3e84f03da4605ccede: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:44.181185 26952 raft_consensus.cc:515] T 64c363fad70c4e89bf03bf59e7252fac P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.185966 26718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c363fad70c4e89bf03bf59e7252fac" candidate_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773a9a5eeb14469389297d0f170bae34"
I20260709 12:15:44.186869 26942 tablet_bootstrap.cc:492] T b213246febae4173bc0e67e7ccc15257 P 773a9a5eeb14469389297d0f170bae34: Bootstrap starting.
I20260709 12:15:44.186931 26718 raft_consensus.cc:3060] T 64c363fad70c4e89bf03bf59e7252fac P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:44.200423 26792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c363fad70c4e89bf03bf59e7252fac" candidate_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3ae70a91d24c3e84f03da4605ccede"
W20260709 12:15:44.203121 26607 leader_election.cc:343] T 64c363fad70c4e89bf03bf59e7252fac P 56539bdd0fcc41a7ae3e12c2f743d6fd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195:43987): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:44.203639 26755 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:35813, user_credentials={real_user=slave}} blocked reactor thread for 51454.7us
I20260709 12:15:44.204074 26952 leader_election.cc:290] T 64c363fad70c4e89bf03bf59e7252fac P 56539bdd0fcc41a7ae3e12c2f743d6fd [CANDIDATE]: Term 1 election: Requested vote from peers 773a9a5eeb14469389297d0f170bae34 (127.12.56.194:37781), ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195:43987)
I20260709 12:15:44.207342 26718 raft_consensus.cc:2468] T 64c363fad70c4e89bf03bf59e7252fac P 773a9a5eeb14469389297d0f170bae34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56539bdd0fcc41a7ae3e12c2f743d6fd in term 1.
W20260709 12:15:44.208101 26589 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:44.209118 26609 leader_election.cc:304] T 64c363fad70c4e89bf03bf59e7252fac P 56539bdd0fcc41a7ae3e12c2f743d6fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56539bdd0fcc41a7ae3e12c2f743d6fd, 773a9a5eeb14469389297d0f170bae34; no voters: ea3ae70a91d24c3e84f03da4605ccede
I20260709 12:15:44.210363 26952 raft_consensus.cc:2804] T 64c363fad70c4e89bf03bf59e7252fac P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:44.214417 26952 raft_consensus.cc:697] T 64c363fad70c4e89bf03bf59e7252fac P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 LEADER]: Becoming Leader. State: Replica: 56539bdd0fcc41a7ae3e12c2f743d6fd, State: Running, Role: LEADER
I20260709 12:15:44.215372 26952 consensus_queue.cc:237] T 64c363fad70c4e89bf03bf59e7252fac P 56539bdd0fcc41a7ae3e12c2f743d6fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.212736 26890 raft_consensus.cc:515] T eb394e0c07444d0a96763f25ac9394e9 P ea3ae70a91d24c3e84f03da4605ccede [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.216811 26944 tablet_bootstrap.cc:492] T 6368117da5f748b3ae4f1475c4d8decb P ea3ae70a91d24c3e84f03da4605ccede: No bootstrap required, opened a new log
I20260709 12:15:44.224664 26944 ts_tablet_manager.cc:1403] T 6368117da5f748b3ae4f1475c4d8decb P ea3ae70a91d24c3e84f03da4605ccede: Time spent bootstrapping tablet: real 0.057s	user 0.023s	sys 0.020s
I20260709 12:15:44.229219 26944 raft_consensus.cc:359] T 6368117da5f748b3ae4f1475c4d8decb P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.230041 26944 raft_consensus.cc:385] T 6368117da5f748b3ae4f1475c4d8decb P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:44.230366 26944 raft_consensus.cc:740] T 6368117da5f748b3ae4f1475c4d8decb P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3ae70a91d24c3e84f03da4605ccede, State: Initialized, Role: FOLLOWER
I20260709 12:15:44.230835 26943 tablet_bootstrap.cc:492] T eceb0db47a1d432e9cbe22991da985f4 P 56539bdd0fcc41a7ae3e12c2f743d6fd: No bootstrap required, opened a new log
I20260709 12:15:44.231426 26943 ts_tablet_manager.cc:1403] T eceb0db47a1d432e9cbe22991da985f4 P 56539bdd0fcc41a7ae3e12c2f743d6fd: Time spent bootstrapping tablet: real 0.112s	user 0.038s	sys 0.021s
I20260709 12:15:44.233008 26641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb394e0c07444d0a96763f25ac9394e9" candidate_uuid: "ea3ae70a91d24c3e84f03da4605ccede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd"
I20260709 12:15:44.233310 26718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb394e0c07444d0a96763f25ac9394e9" candidate_uuid: "ea3ae70a91d24c3e84f03da4605ccede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773a9a5eeb14469389297d0f170bae34"
I20260709 12:15:44.233708 26641 raft_consensus.cc:3060] T eb394e0c07444d0a96763f25ac9394e9 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:44.233916 26718 raft_consensus.cc:3060] T eb394e0c07444d0a96763f25ac9394e9 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:44.233767 26944 consensus_queue.cc:260] T 6368117da5f748b3ae4f1475c4d8decb P ea3ae70a91d24c3e84f03da4605ccede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.234649 26943 raft_consensus.cc:359] T eceb0db47a1d432e9cbe22991da985f4 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.235409 26943 raft_consensus.cc:385] T eceb0db47a1d432e9cbe22991da985f4 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:44.235699 26943 raft_consensus.cc:740] T eceb0db47a1d432e9cbe22991da985f4 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56539bdd0fcc41a7ae3e12c2f743d6fd, State: Initialized, Role: FOLLOWER
I20260709 12:15:44.236835 26961 raft_consensus.cc:493] T b9898596353d46eab5ff567f15224907 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.236958 26944 ts_tablet_manager.cc:1434] T 6368117da5f748b3ae4f1475c4d8decb P ea3ae70a91d24c3e84f03da4605ccede: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.003s
I20260709 12:15:44.238868 26944 tablet_bootstrap.cc:492] T 7a40c4830672494f94383cccd2bcb2b7 P ea3ae70a91d24c3e84f03da4605ccede: Bootstrap starting.
I20260709 12:15:44.237377 26961 raft_consensus.cc:515] T b9898596353d46eab5ff567f15224907 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.242456 26642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9898596353d46eab5ff567f15224907" candidate_uuid: "ea3ae70a91d24c3e84f03da4605ccede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" is_pre_election: true
I20260709 12:15:44.242586 26943 consensus_queue.cc:260] T eceb0db47a1d432e9cbe22991da985f4 P 56539bdd0fcc41a7ae3e12c2f743d6fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.243144 26716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9898596353d46eab5ff567f15224907" candidate_uuid: "ea3ae70a91d24c3e84f03da4605ccede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773a9a5eeb14469389297d0f170bae34" is_pre_election: true
I20260709 12:15:44.243366 26642 raft_consensus.cc:2468] T b9898596353d46eab5ff567f15224907 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3ae70a91d24c3e84f03da4605ccede in term 0.
I20260709 12:15:44.243870 26716 raft_consensus.cc:2468] T b9898596353d46eab5ff567f15224907 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3ae70a91d24c3e84f03da4605ccede in term 0.
I20260709 12:15:44.245353 26943 ts_tablet_manager.cc:1434] T eceb0db47a1d432e9cbe22991da985f4 P 56539bdd0fcc41a7ae3e12c2f743d6fd: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:15:44.241562 26961 leader_election.cc:290] T b9898596353d46eab5ff567f15224907 P ea3ae70a91d24c3e84f03da4605ccede [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813), 773a9a5eeb14469389297d0f170bae34 (127.12.56.194:37781)
I20260709 12:15:44.245577 26758 leader_election.cc:304] T b9898596353d46eab5ff567f15224907 P ea3ae70a91d24c3e84f03da4605ccede [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773a9a5eeb14469389297d0f170bae34, ea3ae70a91d24c3e84f03da4605ccede; no voters: 
I20260709 12:15:44.246611 26943 tablet_bootstrap.cc:492] T ed99dec74c4249ad85b7ef69d0c3d6ec P 56539bdd0fcc41a7ae3e12c2f743d6fd: Bootstrap starting.
I20260709 12:15:44.246779 26944 tablet_bootstrap.cc:654] T 7a40c4830672494f94383cccd2bcb2b7 P ea3ae70a91d24c3e84f03da4605ccede: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:44.246709 26962 raft_consensus.cc:493] T 6673c39fbed4452aa38ceee09bda8cc6 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.247769 26962 raft_consensus.cc:515] T 6673c39fbed4452aa38ceee09bda8cc6 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.250283 26962 leader_election.cc:290] T 6673c39fbed4452aa38ceee09bda8cc6 P ea3ae70a91d24c3e84f03da4605ccede [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813), 773a9a5eeb14469389297d0f170bae34 (127.12.56.194:37781)
I20260709 12:15:44.250859 26962 raft_consensus.cc:2804] T b9898596353d46eab5ff567f15224907 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:44.251199 26962 raft_consensus.cc:493] T b9898596353d46eab5ff567f15224907 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:44.251533 26962 raft_consensus.cc:3060] T b9898596353d46eab5ff567f15224907 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:44.255210 26642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6673c39fbed4452aa38ceee09bda8cc6" candidate_uuid: "ea3ae70a91d24c3e84f03da4605ccede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" is_pre_election: true
I20260709 12:15:44.256057 26642 raft_consensus.cc:2468] T 6673c39fbed4452aa38ceee09bda8cc6 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3ae70a91d24c3e84f03da4605ccede in term 0.
I20260709 12:15:44.257576 26755 leader_election.cc:304] T 6673c39fbed4452aa38ceee09bda8cc6 P ea3ae70a91d24c3e84f03da4605ccede [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56539bdd0fcc41a7ae3e12c2f743d6fd, ea3ae70a91d24c3e84f03da4605ccede; no voters: 
I20260709 12:15:44.259634 26716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6673c39fbed4452aa38ceee09bda8cc6" candidate_uuid: "ea3ae70a91d24c3e84f03da4605ccede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773a9a5eeb14469389297d0f170bae34" is_pre_election: true
W20260709 12:15:44.261353 26758 leader_election.cc:343] T 6673c39fbed4452aa38ceee09bda8cc6 P ea3ae70a91d24c3e84f03da4605ccede [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 773a9a5eeb14469389297d0f170bae34 (127.12.56.194:37781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:44.258549 26961 raft_consensus.cc:2804] T 6673c39fbed4452aa38ceee09bda8cc6 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:44.262320 26961 raft_consensus.cc:493] T 6673c39fbed4452aa38ceee09bda8cc6 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:44.231614 26942 tablet_bootstrap.cc:654] T b213246febae4173bc0e67e7ccc15257 P 773a9a5eeb14469389297d0f170bae34: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:44.263828 26943 tablet_bootstrap.cc:654] T ed99dec74c4249ad85b7ef69d0c3d6ec P 56539bdd0fcc41a7ae3e12c2f743d6fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:44.274549 26961 raft_consensus.cc:3060] T 6673c39fbed4452aa38ceee09bda8cc6 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:44.270010 26641 raft_consensus.cc:2468] T eb394e0c07444d0a96763f25ac9394e9 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3ae70a91d24c3e84f03da4605ccede in term 1.
I20260709 12:15:44.258214 26890 leader_election.cc:290] T eb394e0c07444d0a96763f25ac9394e9 P ea3ae70a91d24c3e84f03da4605ccede [CANDIDATE]: Term 1 election: Requested vote from peers 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813), 773a9a5eeb14469389297d0f170bae34 (127.12.56.194:37781)
I20260709 12:15:44.278354 26718 raft_consensus.cc:2468] T eb394e0c07444d0a96763f25ac9394e9 P 773a9a5eeb14469389297d0f170bae34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3ae70a91d24c3e84f03da4605ccede in term 1.
I20260709 12:15:44.279066 26755 leader_election.cc:304] T eb394e0c07444d0a96763f25ac9394e9 P ea3ae70a91d24c3e84f03da4605ccede [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56539bdd0fcc41a7ae3e12c2f743d6fd, ea3ae70a91d24c3e84f03da4605ccede; no voters: 
I20260709 12:15:44.280036 26890 raft_consensus.cc:2804] T eb394e0c07444d0a96763f25ac9394e9 P ea3ae70a91d24c3e84f03da4605ccede [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:44.280391 26856 raft_consensus.cc:493] T eceb0db47a1d432e9cbe22991da985f4 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.281451 26856 raft_consensus.cc:515] T eceb0db47a1d432e9cbe22991da985f4 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.284708 26856 leader_election.cc:290] T eceb0db47a1d432e9cbe22991da985f4 P 56539bdd0fcc41a7ae3e12c2f743d6fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 773a9a5eeb14469389297d0f170bae34 (127.12.56.194:37781), ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195:43987)
I20260709 12:15:44.285564 26718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eceb0db47a1d432e9cbe22991da985f4" candidate_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773a9a5eeb14469389297d0f170bae34" is_pre_election: true
I20260709 12:15:44.286149 26792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eceb0db47a1d432e9cbe22991da985f4" candidate_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3ae70a91d24c3e84f03da4605ccede" is_pre_election: true
I20260709 12:15:44.285732 26962 raft_consensus.cc:515] T b9898596353d46eab5ff567f15224907 P ea3ae70a91d24c3e84f03da4605ccede [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
W20260709 12:15:44.287550 26609 leader_election.cc:343] T eceb0db47a1d432e9cbe22991da985f4 P 56539bdd0fcc41a7ae3e12c2f743d6fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 773a9a5eeb14469389297d0f170bae34 (127.12.56.194:37781): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:44.289592 26607 leader_election.cc:343] T eceb0db47a1d432e9cbe22991da985f4 P 56539bdd0fcc41a7ae3e12c2f743d6fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195:43987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:44.291322 26607 leader_election.cc:304] T eceb0db47a1d432e9cbe22991da985f4 P 56539bdd0fcc41a7ae3e12c2f743d6fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56539bdd0fcc41a7ae3e12c2f743d6fd; no voters: 773a9a5eeb14469389297d0f170bae34, ea3ae70a91d24c3e84f03da4605ccede
I20260709 12:15:44.294726 26856 raft_consensus.cc:2749] T eceb0db47a1d432e9cbe22991da985f4 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:44.300251 26962 leader_election.cc:290] T b9898596353d46eab5ff567f15224907 P ea3ae70a91d24c3e84f03da4605ccede [CANDIDATE]: Term 1 election: Requested vote from peers 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813), 773a9a5eeb14469389297d0f170bae34 (127.12.56.194:37781)
I20260709 12:15:44.301200 26962 raft_consensus.cc:493] T 6368117da5f748b3ae4f1475c4d8decb P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.301743 26962 raft_consensus.cc:515] T 6368117da5f748b3ae4f1475c4d8decb P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.302400 26718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9898596353d46eab5ff567f15224907" candidate_uuid: "ea3ae70a91d24c3e84f03da4605ccede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773a9a5eeb14469389297d0f170bae34"
I20260709 12:15:44.303362 26718 raft_consensus.cc:3060] T b9898596353d46eab5ff567f15224907 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:44.303519 26641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9898596353d46eab5ff567f15224907" candidate_uuid: "ea3ae70a91d24c3e84f03da4605ccede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd"
I20260709 12:15:44.305945 26641 raft_consensus.cc:3060] T b9898596353d46eab5ff567f15224907 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:44.306396 26890 raft_consensus.cc:697] T eb394e0c07444d0a96763f25ac9394e9 P ea3ae70a91d24c3e84f03da4605ccede [term 1 LEADER]: Becoming Leader. State: Replica: ea3ae70a91d24c3e84f03da4605ccede, State: Running, Role: LEADER
I20260709 12:15:44.323113 26952 raft_consensus.cc:493] T 7a40c4830672494f94383cccd2bcb2b7 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.322433 26718 raft_consensus.cc:2468] T b9898596353d46eab5ff567f15224907 P 773a9a5eeb14469389297d0f170bae34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3ae70a91d24c3e84f03da4605ccede in term 1.
I20260709 12:15:44.323443 26642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6368117da5f748b3ae4f1475c4d8decb" candidate_uuid: "ea3ae70a91d24c3e84f03da4605ccede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" is_pre_election: true
I20260709 12:15:44.324002 26716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6368117da5f748b3ae4f1475c4d8decb" candidate_uuid: "ea3ae70a91d24c3e84f03da4605ccede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773a9a5eeb14469389297d0f170bae34" is_pre_election: true
I20260709 12:15:44.324270 26642 raft_consensus.cc:2468] T 6368117da5f748b3ae4f1475c4d8decb P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3ae70a91d24c3e84f03da4605ccede in term 0.
I20260709 12:15:44.324597 26758 leader_election.cc:304] T b9898596353d46eab5ff567f15224907 P ea3ae70a91d24c3e84f03da4605ccede [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773a9a5eeb14469389297d0f170bae34, ea3ae70a91d24c3e84f03da4605ccede; no voters: 
W20260709 12:15:44.325812 26758 leader_election.cc:343] T 6368117da5f748b3ae4f1475c4d8decb P ea3ae70a91d24c3e84f03da4605ccede [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 773a9a5eeb14469389297d0f170bae34 (127.12.56.194:37781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:44.324079 26890 consensus_queue.cc:237] T eb394e0c07444d0a96763f25ac9394e9 P ea3ae70a91d24c3e84f03da4605ccede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.322682 26962 leader_election.cc:290] T 6368117da5f748b3ae4f1475c4d8decb P ea3ae70a91d24c3e84f03da4605ccede [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813), 773a9a5eeb14469389297d0f170bae34 (127.12.56.194:37781)
I20260709 12:15:44.328450 26942 tablet_bootstrap.cc:492] T b213246febae4173bc0e67e7ccc15257 P 773a9a5eeb14469389297d0f170bae34: No bootstrap required, opened a new log
I20260709 12:15:44.329298 26942 ts_tablet_manager.cc:1403] T b213246febae4173bc0e67e7ccc15257 P 773a9a5eeb14469389297d0f170bae34: Time spent bootstrapping tablet: real 0.143s	user 0.011s	sys 0.007s
I20260709 12:15:44.329893 26962 raft_consensus.cc:2804] T b9898596353d46eab5ff567f15224907 P ea3ae70a91d24c3e84f03da4605ccede [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:44.330233 26755 leader_election.cc:304] T 6368117da5f748b3ae4f1475c4d8decb P ea3ae70a91d24c3e84f03da4605ccede [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56539bdd0fcc41a7ae3e12c2f743d6fd, ea3ae70a91d24c3e84f03da4605ccede; no voters: 773a9a5eeb14469389297d0f170bae34
I20260709 12:15:44.330720 26962 raft_consensus.cc:697] T b9898596353d46eab5ff567f15224907 P ea3ae70a91d24c3e84f03da4605ccede [term 1 LEADER]: Becoming Leader. State: Replica: ea3ae70a91d24c3e84f03da4605ccede, State: Running, Role: LEADER
I20260709 12:15:44.325271 26538 catalog_manager.cc:5697] T 64c363fad70c4e89bf03bf59e7252fac P 56539bdd0fcc41a7ae3e12c2f743d6fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193). New cstate: current_term: 1 leader_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:44.302363 26961 raft_consensus.cc:515] T 6673c39fbed4452aa38ceee09bda8cc6 P ea3ae70a91d24c3e84f03da4605ccede [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.336843 26968 raft_consensus.cc:2804] T 6368117da5f748b3ae4f1475c4d8decb P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:44.339912 26944 tablet_bootstrap.cc:492] T 7a40c4830672494f94383cccd2bcb2b7 P ea3ae70a91d24c3e84f03da4605ccede: No bootstrap required, opened a new log
I20260709 12:15:44.340202 26942 raft_consensus.cc:359] T b213246febae4173bc0e67e7ccc15257 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.341572 26962 consensus_queue.cc:237] T b9898596353d46eab5ff567f15224907 P ea3ae70a91d24c3e84f03da4605ccede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.345336 26968 raft_consensus.cc:493] T 6368117da5f748b3ae4f1475c4d8decb P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:44.345916 26968 raft_consensus.cc:3060] T 6368117da5f748b3ae4f1475c4d8decb P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:44.351874 26942 raft_consensus.cc:385] T b213246febae4173bc0e67e7ccc15257 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:44.352214 26641 raft_consensus.cc:2468] T b9898596353d46eab5ff567f15224907 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3ae70a91d24c3e84f03da4605ccede in term 1.
I20260709 12:15:44.352394 26942 raft_consensus.cc:740] T b213246febae4173bc0e67e7ccc15257 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773a9a5eeb14469389297d0f170bae34, State: Initialized, Role: FOLLOWER
I20260709 12:15:44.353291 26942 consensus_queue.cc:260] T b213246febae4173bc0e67e7ccc15257 P 773a9a5eeb14469389297d0f170bae34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.335870 26952 raft_consensus.cc:515] T 7a40c4830672494f94383cccd2bcb2b7 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.355151 26961 leader_election.cc:290] T 6673c39fbed4452aa38ceee09bda8cc6 P ea3ae70a91d24c3e84f03da4605ccede [CANDIDATE]: Term 1 election: Requested vote from peers 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813), 773a9a5eeb14469389297d0f170bae34 (127.12.56.194:37781)
I20260709 12:15:44.355927 26944 ts_tablet_manager.cc:1403] T 7a40c4830672494f94383cccd2bcb2b7 P ea3ae70a91d24c3e84f03da4605ccede: Time spent bootstrapping tablet: real 0.117s	user 0.023s	sys 0.038s
I20260709 12:15:44.356329 26942 ts_tablet_manager.cc:1434] T b213246febae4173bc0e67e7ccc15257 P 773a9a5eeb14469389297d0f170bae34: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.004s
I20260709 12:15:44.356361 26952 leader_election.cc:290] T 7a40c4830672494f94383cccd2bcb2b7 P 56539bdd0fcc41a7ae3e12c2f743d6fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 773a9a5eeb14469389297d0f170bae34 (127.12.56.194:37781), ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195:43987)
I20260709 12:15:44.359054 26792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a40c4830672494f94383cccd2bcb2b7" candidate_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3ae70a91d24c3e84f03da4605ccede" is_pre_election: true
I20260709 12:15:44.360054 26718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a40c4830672494f94383cccd2bcb2b7" candidate_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773a9a5eeb14469389297d0f170bae34" is_pre_election: true
I20260709 12:15:44.360105 26942 tablet_bootstrap.cc:492] T 6673c39fbed4452aa38ceee09bda8cc6 P 773a9a5eeb14469389297d0f170bae34: Bootstrap starting.
W20260709 12:15:44.363066 26607 leader_election.cc:343] T 7a40c4830672494f94383cccd2bcb2b7 P 56539bdd0fcc41a7ae3e12c2f743d6fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195:43987): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:44.367631 26609 leader_election.cc:343] T 7a40c4830672494f94383cccd2bcb2b7 P 56539bdd0fcc41a7ae3e12c2f743d6fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 773a9a5eeb14469389297d0f170bae34 (127.12.56.194:37781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:44.367782 26943 tablet_bootstrap.cc:492] T ed99dec74c4249ad85b7ef69d0c3d6ec P 56539bdd0fcc41a7ae3e12c2f743d6fd: No bootstrap required, opened a new log
I20260709 12:15:44.368141 26609 leader_election.cc:304] T 7a40c4830672494f94383cccd2bcb2b7 P 56539bdd0fcc41a7ae3e12c2f743d6fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56539bdd0fcc41a7ae3e12c2f743d6fd; no voters: 773a9a5eeb14469389297d0f170bae34, ea3ae70a91d24c3e84f03da4605ccede
I20260709 12:15:44.368400 26943 ts_tablet_manager.cc:1403] T ed99dec74c4249ad85b7ef69d0c3d6ec P 56539bdd0fcc41a7ae3e12c2f743d6fd: Time spent bootstrapping tablet: real 0.122s	user 0.030s	sys 0.019s
I20260709 12:15:44.381675 26856 raft_consensus.cc:2749] T 7a40c4830672494f94383cccd2bcb2b7 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:44.383489 26641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6673c39fbed4452aa38ceee09bda8cc6" candidate_uuid: "ea3ae70a91d24c3e84f03da4605ccede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd"
I20260709 12:15:44.386564 26641 raft_consensus.cc:3060] T 6673c39fbed4452aa38ceee09bda8cc6 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:44.376194 26758 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:37781, user_credentials={real_user=slave}} blocked reactor thread for 43924.1us
I20260709 12:15:44.394590 26971 raft_consensus.cc:493] T ed99dec74c4249ad85b7ef69d0c3d6ec P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.394920 26718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6673c39fbed4452aa38ceee09bda8cc6" candidate_uuid: "ea3ae70a91d24c3e84f03da4605ccede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773a9a5eeb14469389297d0f170bae34"
I20260709 12:15:44.395231 26971 raft_consensus.cc:515] T ed99dec74c4249ad85b7ef69d0c3d6ec P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.396478 26944 raft_consensus.cc:359] T 7a40c4830672494f94383cccd2bcb2b7 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.397437 26943 raft_consensus.cc:359] T ed99dec74c4249ad85b7ef69d0c3d6ec P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.397753 26944 raft_consensus.cc:385] T 7a40c4830672494f94383cccd2bcb2b7 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:44.398428 26943 raft_consensus.cc:385] T ed99dec74c4249ad85b7ef69d0c3d6ec P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:44.398789 26943 raft_consensus.cc:740] T ed99dec74c4249ad85b7ef69d0c3d6ec P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56539bdd0fcc41a7ae3e12c2f743d6fd, State: Initialized, Role: FOLLOWER
I20260709 12:15:44.398751 26944 raft_consensus.cc:740] T 7a40c4830672494f94383cccd2bcb2b7 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3ae70a91d24c3e84f03da4605ccede, State: Initialized, Role: FOLLOWER
I20260709 12:15:44.403390 26943 consensus_queue.cc:260] T ed99dec74c4249ad85b7ef69d0c3d6ec P 56539bdd0fcc41a7ae3e12c2f743d6fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
W20260709 12:15:44.405627 26758 leader_election.cc:343] T 6673c39fbed4452aa38ceee09bda8cc6 P ea3ae70a91d24c3e84f03da4605ccede [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 773a9a5eeb14469389297d0f170bae34 (127.12.56.194:37781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:44.411839 26943 ts_tablet_manager.cc:1434] T ed99dec74c4249ad85b7ef69d0c3d6ec P 56539bdd0fcc41a7ae3e12c2f743d6fd: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.001s
I20260709 12:15:44.412056 26642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed99dec74c4249ad85b7ef69d0c3d6ec" candidate_uuid: "ea3ae70a91d24c3e84f03da4605ccede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" is_pre_election: true
I20260709 12:15:44.412740 26642 raft_consensus.cc:2468] T ed99dec74c4249ad85b7ef69d0c3d6ec P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3ae70a91d24c3e84f03da4605ccede in term 0.
I20260709 12:15:44.414709 26755 leader_election.cc:304] T ed99dec74c4249ad85b7ef69d0c3d6ec P ea3ae70a91d24c3e84f03da4605ccede [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56539bdd0fcc41a7ae3e12c2f743d6fd, ea3ae70a91d24c3e84f03da4605ccede; no voters: 
I20260709 12:15:44.415004 26943 tablet_bootstrap.cc:492] T b213246febae4173bc0e67e7ccc15257 P 56539bdd0fcc41a7ae3e12c2f743d6fd: Bootstrap starting.
I20260709 12:15:44.415681 26962 raft_consensus.cc:2804] T ed99dec74c4249ad85b7ef69d0c3d6ec P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:44.416085 26962 raft_consensus.cc:493] T ed99dec74c4249ad85b7ef69d0c3d6ec P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:44.416697 26962 raft_consensus.cc:3060] T ed99dec74c4249ad85b7ef69d0c3d6ec P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:44.424008 26971 leader_election.cc:290] T ed99dec74c4249ad85b7ef69d0c3d6ec P ea3ae70a91d24c3e84f03da4605ccede [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813), 773a9a5eeb14469389297d0f170bae34 (127.12.56.194:37781)
I20260709 12:15:44.418216 26944 consensus_queue.cc:260] T 7a40c4830672494f94383cccd2bcb2b7 P ea3ae70a91d24c3e84f03da4605ccede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.427420 26541 catalog_manager.cc:5697] T eb394e0c07444d0a96763f25ac9394e9 P ea3ae70a91d24c3e84f03da4605ccede reported cstate change: term changed from 0 to 1, leader changed from <none> to ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195). New cstate: current_term: 1 leader_uuid: "ea3ae70a91d24c3e84f03da4605ccede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:44.429344 26944 ts_tablet_manager.cc:1434] T 7a40c4830672494f94383cccd2bcb2b7 P ea3ae70a91d24c3e84f03da4605ccede: Time spent starting tablet: real 0.073s	user 0.011s	sys 0.000s
I20260709 12:15:44.430531 26718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed99dec74c4249ad85b7ef69d0c3d6ec" candidate_uuid: "ea3ae70a91d24c3e84f03da4605ccede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773a9a5eeb14469389297d0f170bae34" is_pre_election: true
I20260709 12:15:44.431407 26718 raft_consensus.cc:2468] T ed99dec74c4249ad85b7ef69d0c3d6ec P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3ae70a91d24c3e84f03da4605ccede in term 0.
I20260709 12:15:44.433158 26641 raft_consensus.cc:2468] T 6673c39fbed4452aa38ceee09bda8cc6 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3ae70a91d24c3e84f03da4605ccede in term 1.
I20260709 12:15:44.435567 26755 leader_election.cc:304] T 6673c39fbed4452aa38ceee09bda8cc6 P ea3ae70a91d24c3e84f03da4605ccede [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56539bdd0fcc41a7ae3e12c2f743d6fd, ea3ae70a91d24c3e84f03da4605ccede; no voters: 773a9a5eeb14469389297d0f170bae34
I20260709 12:15:44.437039 26971 raft_consensus.cc:2804] T 6673c39fbed4452aa38ceee09bda8cc6 P ea3ae70a91d24c3e84f03da4605ccede [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:44.430609 26944 tablet_bootstrap.cc:492] T 64c363fad70c4e89bf03bf59e7252fac P ea3ae70a91d24c3e84f03da4605ccede: Bootstrap starting.
I20260709 12:15:44.439949 26962 raft_consensus.cc:515] T ed99dec74c4249ad85b7ef69d0c3d6ec P ea3ae70a91d24c3e84f03da4605ccede [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.441359 26971 raft_consensus.cc:697] T 6673c39fbed4452aa38ceee09bda8cc6 P ea3ae70a91d24c3e84f03da4605ccede [term 1 LEADER]: Becoming Leader. State: Replica: ea3ae70a91d24c3e84f03da4605ccede, State: Running, Role: LEADER
I20260709 12:15:44.442636 26971 consensus_queue.cc:237] T 6673c39fbed4452aa38ceee09bda8cc6 P ea3ae70a91d24c3e84f03da4605ccede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.446481 26968 raft_consensus.cc:515] T 6368117da5f748b3ae4f1475c4d8decb P ea3ae70a91d24c3e84f03da4605ccede [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.451305 26942 tablet_bootstrap.cc:654] T 6673c39fbed4452aa38ceee09bda8cc6 P 773a9a5eeb14469389297d0f170bae34: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:44.453840 26890 raft_consensus.cc:493] T 7a40c4830672494f94383cccd2bcb2b7 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.455524 26943 tablet_bootstrap.cc:654] T b213246febae4173bc0e67e7ccc15257 P 56539bdd0fcc41a7ae3e12c2f743d6fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:44.456103 26968 leader_election.cc:290] T 6368117da5f748b3ae4f1475c4d8decb P ea3ae70a91d24c3e84f03da4605ccede [CANDIDATE]: Term 1 election: Requested vote from peers 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813), 773a9a5eeb14469389297d0f170bae34 (127.12.56.194:37781)
I20260709 12:15:44.456735 26890 raft_consensus.cc:515] T 7a40c4830672494f94383cccd2bcb2b7 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.457098 26641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6368117da5f748b3ae4f1475c4d8decb" candidate_uuid: "ea3ae70a91d24c3e84f03da4605ccede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd"
I20260709 12:15:44.457711 26641 raft_consensus.cc:3060] T 6368117da5f748b3ae4f1475c4d8decb P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:44.457497 26718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6368117da5f748b3ae4f1475c4d8decb" candidate_uuid: "ea3ae70a91d24c3e84f03da4605ccede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773a9a5eeb14469389297d0f170bae34"
I20260709 12:15:44.459266 26890 leader_election.cc:290] T 7a40c4830672494f94383cccd2bcb2b7 P ea3ae70a91d24c3e84f03da4605ccede [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813), 773a9a5eeb14469389297d0f170bae34 (127.12.56.194:37781)
W20260709 12:15:44.460307 26758 leader_election.cc:343] T 6368117da5f748b3ae4f1475c4d8decb P ea3ae70a91d24c3e84f03da4605ccede [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 773a9a5eeb14469389297d0f170bae34 (127.12.56.194:37781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:44.461907 26718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a40c4830672494f94383cccd2bcb2b7" candidate_uuid: "ea3ae70a91d24c3e84f03da4605ccede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773a9a5eeb14469389297d0f170bae34" is_pre_election: true
I20260709 12:15:44.467526 26642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a40c4830672494f94383cccd2bcb2b7" candidate_uuid: "ea3ae70a91d24c3e84f03da4605ccede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" is_pre_election: true
I20260709 12:15:44.469374 26642 raft_consensus.cc:2468] T 7a40c4830672494f94383cccd2bcb2b7 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3ae70a91d24c3e84f03da4605ccede in term 0.
I20260709 12:15:44.470407 26962 leader_election.cc:290] T ed99dec74c4249ad85b7ef69d0c3d6ec P ea3ae70a91d24c3e84f03da4605ccede [CANDIDATE]: Term 1 election: Requested vote from peers 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813), 773a9a5eeb14469389297d0f170bae34 (127.12.56.194:37781)
I20260709 12:15:44.471334 26643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed99dec74c4249ad85b7ef69d0c3d6ec" candidate_uuid: "ea3ae70a91d24c3e84f03da4605ccede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd"
I20260709 12:15:44.472419 26643 raft_consensus.cc:3060] T ed99dec74c4249ad85b7ef69d0c3d6ec P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:44.476552 26942 tablet_bootstrap.cc:492] T 6673c39fbed4452aa38ceee09bda8cc6 P 773a9a5eeb14469389297d0f170bae34: No bootstrap required, opened a new log
I20260709 12:15:44.477389 26942 ts_tablet_manager.cc:1403] T 6673c39fbed4452aa38ceee09bda8cc6 P 773a9a5eeb14469389297d0f170bae34: Time spent bootstrapping tablet: real 0.118s	user 0.016s	sys 0.006s
W20260709 12:15:44.478871 26758 leader_election.cc:343] T 7a40c4830672494f94383cccd2bcb2b7 P ea3ae70a91d24c3e84f03da4605ccede [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 773a9a5eeb14469389297d0f170bae34 (127.12.56.194:37781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:44.480943 26942 raft_consensus.cc:359] T 6673c39fbed4452aa38ceee09bda8cc6 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.481464 26718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed99dec74c4249ad85b7ef69d0c3d6ec" candidate_uuid: "ea3ae70a91d24c3e84f03da4605ccede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773a9a5eeb14469389297d0f170bae34"
I20260709 12:15:44.481930 26942 raft_consensus.cc:385] T 6673c39fbed4452aa38ceee09bda8cc6 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:44.482321 26942 raft_consensus.cc:740] T 6673c39fbed4452aa38ceee09bda8cc6 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773a9a5eeb14469389297d0f170bae34, State: Initialized, Role: FOLLOWER
I20260709 12:15:44.482426 26718 raft_consensus.cc:3060] T ed99dec74c4249ad85b7ef69d0c3d6ec P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:44.480960 26755 leader_election.cc:304] T 7a40c4830672494f94383cccd2bcb2b7 P ea3ae70a91d24c3e84f03da4605ccede [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56539bdd0fcc41a7ae3e12c2f743d6fd, ea3ae70a91d24c3e84f03da4605ccede; no voters: 773a9a5eeb14469389297d0f170bae34
I20260709 12:15:44.496054 26944 tablet_bootstrap.cc:654] T 64c363fad70c4e89bf03bf59e7252fac P ea3ae70a91d24c3e84f03da4605ccede: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:44.496249 26962 raft_consensus.cc:2804] T 7a40c4830672494f94383cccd2bcb2b7 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:44.496742 26962 raft_consensus.cc:493] T 7a40c4830672494f94383cccd2bcb2b7 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:44.497081 26962 raft_consensus.cc:3060] T 7a40c4830672494f94383cccd2bcb2b7 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:44.497157 26943 tablet_bootstrap.cc:492] T b213246febae4173bc0e67e7ccc15257 P 56539bdd0fcc41a7ae3e12c2f743d6fd: No bootstrap required, opened a new log
I20260709 12:15:44.497805 26943 ts_tablet_manager.cc:1403] T b213246febae4173bc0e67e7ccc15257 P 56539bdd0fcc41a7ae3e12c2f743d6fd: Time spent bootstrapping tablet: real 0.085s	user 0.027s	sys 0.003s
I20260709 12:15:44.500679 26942 consensus_queue.cc:260] T 6673c39fbed4452aa38ceee09bda8cc6 P 773a9a5eeb14469389297d0f170bae34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.500972 26541 catalog_manager.cc:5697] T b9898596353d46eab5ff567f15224907 P ea3ae70a91d24c3e84f03da4605ccede reported cstate change: term changed from 0 to 1, leader changed from <none> to ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195). New cstate: current_term: 1 leader_uuid: "ea3ae70a91d24c3e84f03da4605ccede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:44.503000 26541 catalog_manager.cc:5697] T 6673c39fbed4452aa38ceee09bda8cc6 P ea3ae70a91d24c3e84f03da4605ccede reported cstate change: term changed from 0 to 1, leader changed from <none> to ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195). New cstate: current_term: 1 leader_uuid: "ea3ae70a91d24c3e84f03da4605ccede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:44.506533 26942 ts_tablet_manager.cc:1434] T 6673c39fbed4452aa38ceee09bda8cc6 P 773a9a5eeb14469389297d0f170bae34: Time spent starting tablet: real 0.029s	user 0.012s	sys 0.000s
I20260709 12:15:44.508023 26942 tablet_bootstrap.cc:492] T 7a40c4830672494f94383cccd2bcb2b7 P 773a9a5eeb14469389297d0f170bae34: Bootstrap starting.
I20260709 12:15:44.511273 26943 raft_consensus.cc:359] T b213246febae4173bc0e67e7ccc15257 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.512128 26943 raft_consensus.cc:385] T b213246febae4173bc0e67e7ccc15257 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:44.512424 26943 raft_consensus.cc:740] T b213246febae4173bc0e67e7ccc15257 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56539bdd0fcc41a7ae3e12c2f743d6fd, State: Initialized, Role: FOLLOWER
I20260709 12:15:44.513350 26943 consensus_queue.cc:260] T b213246febae4173bc0e67e7ccc15257 P 56539bdd0fcc41a7ae3e12c2f743d6fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.515407 26641 raft_consensus.cc:2468] T 6368117da5f748b3ae4f1475c4d8decb P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3ae70a91d24c3e84f03da4605ccede in term 1.
I20260709 12:15:44.517136 26755 leader_election.cc:304] T 6368117da5f748b3ae4f1475c4d8decb P ea3ae70a91d24c3e84f03da4605ccede [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56539bdd0fcc41a7ae3e12c2f743d6fd, ea3ae70a91d24c3e84f03da4605ccede; no voters: 773a9a5eeb14469389297d0f170bae34
I20260709 12:15:44.518155 26971 raft_consensus.cc:2804] T 6368117da5f748b3ae4f1475c4d8decb P ea3ae70a91d24c3e84f03da4605ccede [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:44.518754 26971 raft_consensus.cc:697] T 6368117da5f748b3ae4f1475c4d8decb P ea3ae70a91d24c3e84f03da4605ccede [term 1 LEADER]: Becoming Leader. State: Replica: ea3ae70a91d24c3e84f03da4605ccede, State: Running, Role: LEADER
I20260709 12:15:44.519801 26971 consensus_queue.cc:237] T 6368117da5f748b3ae4f1475c4d8decb P ea3ae70a91d24c3e84f03da4605ccede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.518926 26962 raft_consensus.cc:515] T 7a40c4830672494f94383cccd2bcb2b7 P ea3ae70a91d24c3e84f03da4605ccede [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.521478 26942 tablet_bootstrap.cc:654] T 7a40c4830672494f94383cccd2bcb2b7 P 773a9a5eeb14469389297d0f170bae34: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:44.530812 26962 leader_election.cc:290] T 7a40c4830672494f94383cccd2bcb2b7 P ea3ae70a91d24c3e84f03da4605ccede [CANDIDATE]: Term 1 election: Requested vote from peers 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813), 773a9a5eeb14469389297d0f170bae34 (127.12.56.194:37781)
I20260709 12:15:44.533916 26642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a40c4830672494f94383cccd2bcb2b7" candidate_uuid: "ea3ae70a91d24c3e84f03da4605ccede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd"
I20260709 12:15:44.534760 26642 raft_consensus.cc:3060] T 7a40c4830672494f94383cccd2bcb2b7 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:44.530997 26716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a40c4830672494f94383cccd2bcb2b7" candidate_uuid: "ea3ae70a91d24c3e84f03da4605ccede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773a9a5eeb14469389297d0f170bae34"
I20260709 12:15:44.537699 26643 raft_consensus.cc:2468] T ed99dec74c4249ad85b7ef69d0c3d6ec P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3ae70a91d24c3e84f03da4605ccede in term 1.
W20260709 12:15:44.540421 26758 leader_election.cc:343] T 7a40c4830672494f94383cccd2bcb2b7 P ea3ae70a91d24c3e84f03da4605ccede [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 773a9a5eeb14469389297d0f170bae34 (127.12.56.194:37781): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:44.537961 26951 raft_consensus.cc:493] T b213246febae4173bc0e67e7ccc15257 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.541647 26951 raft_consensus.cc:515] T b213246febae4173bc0e67e7ccc15257 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.543207 26943 ts_tablet_manager.cc:1434] T b213246febae4173bc0e67e7ccc15257 P 56539bdd0fcc41a7ae3e12c2f743d6fd: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.000s
I20260709 12:15:44.544013 26718 raft_consensus.cc:2468] T ed99dec74c4249ad85b7ef69d0c3d6ec P 773a9a5eeb14469389297d0f170bae34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3ae70a91d24c3e84f03da4605ccede in term 1.
I20260709 12:15:44.546605 26758 leader_election.cc:304] T ed99dec74c4249ad85b7ef69d0c3d6ec P ea3ae70a91d24c3e84f03da4605ccede [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773a9a5eeb14469389297d0f170bae34, ea3ae70a91d24c3e84f03da4605ccede; no voters: 
I20260709 12:15:44.547801 26971 raft_consensus.cc:2804] T ed99dec74c4249ad85b7ef69d0c3d6ec P ea3ae70a91d24c3e84f03da4605ccede [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:44.548592 26971 raft_consensus.cc:697] T ed99dec74c4249ad85b7ef69d0c3d6ec P ea3ae70a91d24c3e84f03da4605ccede [term 1 LEADER]: Becoming Leader. State: Replica: ea3ae70a91d24c3e84f03da4605ccede, State: Running, Role: LEADER
I20260709 12:15:44.548723 26944 tablet_bootstrap.cc:492] T 64c363fad70c4e89bf03bf59e7252fac P ea3ae70a91d24c3e84f03da4605ccede: No bootstrap required, opened a new log
I20260709 12:15:44.549391 26944 ts_tablet_manager.cc:1403] T 64c363fad70c4e89bf03bf59e7252fac P ea3ae70a91d24c3e84f03da4605ccede: Time spent bootstrapping tablet: real 0.119s	user 0.006s	sys 0.009s
I20260709 12:15:44.552973 26944 raft_consensus.cc:359] T 64c363fad70c4e89bf03bf59e7252fac P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.553975 26944 raft_consensus.cc:385] T 64c363fad70c4e89bf03bf59e7252fac P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:44.549633 26971 consensus_queue.cc:237] T ed99dec74c4249ad85b7ef69d0c3d6ec P ea3ae70a91d24c3e84f03da4605ccede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.557718 26792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b213246febae4173bc0e67e7ccc15257" candidate_uuid: "773a9a5eeb14469389297d0f170bae34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3ae70a91d24c3e84f03da4605ccede" is_pre_election: true
I20260709 12:15:44.561815 26944 raft_consensus.cc:740] T 64c363fad70c4e89bf03bf59e7252fac P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3ae70a91d24c3e84f03da4605ccede, State: Initialized, Role: FOLLOWER
I20260709 12:15:44.563125 26944 consensus_queue.cc:260] T 64c363fad70c4e89bf03bf59e7252fac P ea3ae70a91d24c3e84f03da4605ccede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.554469 26538 catalog_manager.cc:5697] T 6368117da5f748b3ae4f1475c4d8decb P ea3ae70a91d24c3e84f03da4605ccede reported cstate change: term changed from 0 to 1, leader changed from <none> to ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195). New cstate: current_term: 1 leader_uuid: "ea3ae70a91d24c3e84f03da4605ccede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } health_report { overall_health: HEALTHY } } }
W20260709 12:15:44.563593 26682 leader_election.cc:343] T b213246febae4173bc0e67e7ccc15257 P 773a9a5eeb14469389297d0f170bae34 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195:43987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:44.565543 26944 ts_tablet_manager.cc:1434] T 64c363fad70c4e89bf03bf59e7252fac P ea3ae70a91d24c3e84f03da4605ccede: Time spent starting tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 12:15:44.566504 26944 tablet_bootstrap.cc:492] T eceb0db47a1d432e9cbe22991da985f4 P ea3ae70a91d24c3e84f03da4605ccede: Bootstrap starting.
I20260709 12:15:44.554095 26951 leader_election.cc:290] T b213246febae4173bc0e67e7ccc15257 P 773a9a5eeb14469389297d0f170bae34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813), ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195:43987)
I20260709 12:15:44.570238 26643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b213246febae4173bc0e67e7ccc15257" candidate_uuid: "773a9a5eeb14469389297d0f170bae34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" is_pre_election: true
I20260709 12:15:44.571067 26643 raft_consensus.cc:2468] T b213246febae4173bc0e67e7ccc15257 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773a9a5eeb14469389297d0f170bae34 in term 0.
I20260709 12:15:44.572556 26681 leader_election.cc:304] T b213246febae4173bc0e67e7ccc15257 P 773a9a5eeb14469389297d0f170bae34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56539bdd0fcc41a7ae3e12c2f743d6fd, 773a9a5eeb14469389297d0f170bae34; no voters: ea3ae70a91d24c3e84f03da4605ccede
I20260709 12:15:44.573951 26951 raft_consensus.cc:2804] T b213246febae4173bc0e67e7ccc15257 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:44.574402 26951 raft_consensus.cc:493] T b213246febae4173bc0e67e7ccc15257 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:44.574824 26951 raft_consensus.cc:3060] T b213246febae4173bc0e67e7ccc15257 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:44.578181 26944 tablet_bootstrap.cc:654] T eceb0db47a1d432e9cbe22991da985f4 P ea3ae70a91d24c3e84f03da4605ccede: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:44.584448 26642 raft_consensus.cc:2468] T 7a40c4830672494f94383cccd2bcb2b7 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3ae70a91d24c3e84f03da4605ccede in term 1.
I20260709 12:15:44.585901 26942 tablet_bootstrap.cc:492] T 7a40c4830672494f94383cccd2bcb2b7 P 773a9a5eeb14469389297d0f170bae34: No bootstrap required, opened a new log
I20260709 12:15:44.586187 26755 leader_election.cc:304] T 7a40c4830672494f94383cccd2bcb2b7 P ea3ae70a91d24c3e84f03da4605ccede [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56539bdd0fcc41a7ae3e12c2f743d6fd, ea3ae70a91d24c3e84f03da4605ccede; no voters: 773a9a5eeb14469389297d0f170bae34
I20260709 12:15:44.586612 26942 ts_tablet_manager.cc:1403] T 7a40c4830672494f94383cccd2bcb2b7 P 773a9a5eeb14469389297d0f170bae34: Time spent bootstrapping tablet: real 0.079s	user 0.021s	sys 0.026s
I20260709 12:15:44.587620 26962 raft_consensus.cc:2804] T 7a40c4830672494f94383cccd2bcb2b7 P ea3ae70a91d24c3e84f03da4605ccede [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:44.588433 26962 raft_consensus.cc:697] T 7a40c4830672494f94383cccd2bcb2b7 P ea3ae70a91d24c3e84f03da4605ccede [term 1 LEADER]: Becoming Leader. State: Replica: ea3ae70a91d24c3e84f03da4605ccede, State: Running, Role: LEADER
I20260709 12:15:44.591087 26942 raft_consensus.cc:359] T 7a40c4830672494f94383cccd2bcb2b7 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.592128 26942 raft_consensus.cc:385] T 7a40c4830672494f94383cccd2bcb2b7 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:44.592458 26942 raft_consensus.cc:740] T 7a40c4830672494f94383cccd2bcb2b7 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773a9a5eeb14469389297d0f170bae34, State: Initialized, Role: FOLLOWER
I20260709 12:15:44.593080 26962 consensus_queue.cc:237] T 7a40c4830672494f94383cccd2bcb2b7 P ea3ae70a91d24c3e84f03da4605ccede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.593479 26942 consensus_queue.cc:260] T 7a40c4830672494f94383cccd2bcb2b7 P 773a9a5eeb14469389297d0f170bae34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.597537 26942 ts_tablet_manager.cc:1434] T 7a40c4830672494f94383cccd2bcb2b7 P 773a9a5eeb14469389297d0f170bae34: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:15:44.598794 26942 tablet_bootstrap.cc:492] T eceb0db47a1d432e9cbe22991da985f4 P 773a9a5eeb14469389297d0f170bae34: Bootstrap starting.
I20260709 12:15:44.612979 26951 raft_consensus.cc:515] T b213246febae4173bc0e67e7ccc15257 P 773a9a5eeb14469389297d0f170bae34 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.617560 26642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b213246febae4173bc0e67e7ccc15257" candidate_uuid: "773a9a5eeb14469389297d0f170bae34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd"
I20260709 12:15:44.629901 26539 catalog_manager.cc:5697] T ed99dec74c4249ad85b7ef69d0c3d6ec P ea3ae70a91d24c3e84f03da4605ccede reported cstate change: term changed from 0 to 1, leader changed from <none> to ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195). New cstate: current_term: 1 leader_uuid: "ea3ae70a91d24c3e84f03da4605ccede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:44.634984 26642 raft_consensus.cc:3060] T b213246febae4173bc0e67e7ccc15257 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:44.640364 26792 raft_consensus.cc:3060] T 64c363fad70c4e89bf03bf59e7252fac P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:44.656404 26942 tablet_bootstrap.cc:654] T eceb0db47a1d432e9cbe22991da985f4 P 773a9a5eeb14469389297d0f170bae34: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:44.662264 26951 leader_election.cc:290] T b213246febae4173bc0e67e7ccc15257 P 773a9a5eeb14469389297d0f170bae34 [CANDIDATE]: Term 1 election: Requested vote from peers 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813), ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195:43987)
I20260709 12:15:44.662755 26856 consensus_queue.cc:1048] T 64c363fad70c4e89bf03bf59e7252fac P 56539bdd0fcc41a7ae3e12c2f743d6fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:44.663961 26792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b213246febae4173bc0e67e7ccc15257" candidate_uuid: "773a9a5eeb14469389297d0f170bae34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3ae70a91d24c3e84f03da4605ccede"
I20260709 12:15:44.666522 26642 raft_consensus.cc:2468] T b213246febae4173bc0e67e7ccc15257 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773a9a5eeb14469389297d0f170bae34 in term 1.
W20260709 12:15:44.666558 26682 leader_election.cc:343] T b213246febae4173bc0e67e7ccc15257 P 773a9a5eeb14469389297d0f170bae34 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195:43987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:44.670560 26942 tablet_bootstrap.cc:492] T eceb0db47a1d432e9cbe22991da985f4 P 773a9a5eeb14469389297d0f170bae34: No bootstrap required, opened a new log
I20260709 12:15:44.670560 26944 tablet_bootstrap.cc:492] T eceb0db47a1d432e9cbe22991da985f4 P ea3ae70a91d24c3e84f03da4605ccede: No bootstrap required, opened a new log
I20260709 12:15:44.671388 26942 ts_tablet_manager.cc:1403] T eceb0db47a1d432e9cbe22991da985f4 P 773a9a5eeb14469389297d0f170bae34: Time spent bootstrapping tablet: real 0.073s	user 0.014s	sys 0.000s
I20260709 12:15:44.672353 26681 leader_election.cc:304] T b213246febae4173bc0e67e7ccc15257 P 773a9a5eeb14469389297d0f170bae34 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56539bdd0fcc41a7ae3e12c2f743d6fd, 773a9a5eeb14469389297d0f170bae34; no voters: ea3ae70a91d24c3e84f03da4605ccede
I20260709 12:15:44.671388 26944 ts_tablet_manager.cc:1403] T eceb0db47a1d432e9cbe22991da985f4 P ea3ae70a91d24c3e84f03da4605ccede: Time spent bootstrapping tablet: real 0.105s	user 0.025s	sys 0.060s
I20260709 12:15:44.673836 26951 raft_consensus.cc:2804] T b213246febae4173bc0e67e7ccc15257 P 773a9a5eeb14469389297d0f170bae34 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:44.674471 26951 raft_consensus.cc:697] T b213246febae4173bc0e67e7ccc15257 P 773a9a5eeb14469389297d0f170bae34 [term 1 LEADER]: Becoming Leader. State: Replica: 773a9a5eeb14469389297d0f170bae34, State: Running, Role: LEADER
I20260709 12:15:44.675539 26951 consensus_queue.cc:237] T b213246febae4173bc0e67e7ccc15257 P 773a9a5eeb14469389297d0f170bae34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.676401 26944 raft_consensus.cc:359] T eceb0db47a1d432e9cbe22991da985f4 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.677148 26944 raft_consensus.cc:385] T eceb0db47a1d432e9cbe22991da985f4 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:44.677397 26944 raft_consensus.cc:740] T eceb0db47a1d432e9cbe22991da985f4 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3ae70a91d24c3e84f03da4605ccede, State: Initialized, Role: FOLLOWER
I20260709 12:15:44.678122 26944 consensus_queue.cc:260] T eceb0db47a1d432e9cbe22991da985f4 P ea3ae70a91d24c3e84f03da4605ccede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.679390 26541 catalog_manager.cc:5697] T 7a40c4830672494f94383cccd2bcb2b7 P ea3ae70a91d24c3e84f03da4605ccede reported cstate change: term changed from 0 to 1, leader changed from <none> to ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195). New cstate: current_term: 1 leader_uuid: "ea3ae70a91d24c3e84f03da4605ccede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:44.680258 26944 ts_tablet_manager.cc:1434] T eceb0db47a1d432e9cbe22991da985f4 P ea3ae70a91d24c3e84f03da4605ccede: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:15:44.681404 26944 tablet_bootstrap.cc:492] T b213246febae4173bc0e67e7ccc15257 P ea3ae70a91d24c3e84f03da4605ccede: Bootstrap starting.
I20260709 12:15:44.680171 26942 raft_consensus.cc:359] T eceb0db47a1d432e9cbe22991da985f4 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.682320 26942 raft_consensus.cc:385] T eceb0db47a1d432e9cbe22991da985f4 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:44.682649 26942 raft_consensus.cc:740] T eceb0db47a1d432e9cbe22991da985f4 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773a9a5eeb14469389297d0f170bae34, State: Initialized, Role: FOLLOWER
I20260709 12:15:44.683599 26942 consensus_queue.cc:260] T eceb0db47a1d432e9cbe22991da985f4 P 773a9a5eeb14469389297d0f170bae34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.687944 26944 tablet_bootstrap.cc:654] T b213246febae4173bc0e67e7ccc15257 P ea3ae70a91d24c3e84f03da4605ccede: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:44.691589 26942 ts_tablet_manager.cc:1434] T eceb0db47a1d432e9cbe22991da985f4 P 773a9a5eeb14469389297d0f170bae34: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:15:44.697624 26944 tablet_bootstrap.cc:492] T b213246febae4173bc0e67e7ccc15257 P ea3ae70a91d24c3e84f03da4605ccede: No bootstrap required, opened a new log
I20260709 12:15:44.698279 26944 ts_tablet_manager.cc:1403] T b213246febae4173bc0e67e7ccc15257 P ea3ae70a91d24c3e84f03da4605ccede: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.006s
I20260709 12:15:44.701066 26944 raft_consensus.cc:359] T b213246febae4173bc0e67e7ccc15257 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.701754 26944 raft_consensus.cc:385] T b213246febae4173bc0e67e7ccc15257 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:44.702075 26944 raft_consensus.cc:740] T b213246febae4173bc0e67e7ccc15257 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3ae70a91d24c3e84f03da4605ccede, State: Initialized, Role: FOLLOWER
I20260709 12:15:44.702819 26944 consensus_queue.cc:260] T b213246febae4173bc0e67e7ccc15257 P ea3ae70a91d24c3e84f03da4605ccede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.692972 26942 tablet_bootstrap.cc:492] T 6368117da5f748b3ae4f1475c4d8decb P 773a9a5eeb14469389297d0f170bae34: Bootstrap starting.
I20260709 12:15:44.705405 26944 ts_tablet_manager.cc:1434] T b213246febae4173bc0e67e7ccc15257 P ea3ae70a91d24c3e84f03da4605ccede: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.004s
I20260709 12:15:44.715283 26942 tablet_bootstrap.cc:654] T 6368117da5f748b3ae4f1475c4d8decb P 773a9a5eeb14469389297d0f170bae34: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:44.716845 26962 consensus_queue.cc:1048] T eb394e0c07444d0a96763f25ac9394e9 P ea3ae70a91d24c3e84f03da4605ccede [LEADER]: Connected to new peer: Peer: permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:44.718389 26541 catalog_manager.cc:5697] T b213246febae4173bc0e67e7ccc15257 P 773a9a5eeb14469389297d0f170bae34 reported cstate change: term changed from 0 to 1, leader changed from <none> to 773a9a5eeb14469389297d0f170bae34 (127.12.56.194). New cstate: current_term: 1 leader_uuid: "773a9a5eeb14469389297d0f170bae34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:44.726912 26951 raft_consensus.cc:493] T 7a40c4830672494f94383cccd2bcb2b7 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.727579 26951 raft_consensus.cc:515] T 7a40c4830672494f94383cccd2bcb2b7 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.731679 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a40c4830672494f94383cccd2bcb2b7" candidate_uuid: "773a9a5eeb14469389297d0f170bae34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3ae70a91d24c3e84f03da4605ccede" is_pre_election: true
I20260709 12:15:44.737289 26642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a40c4830672494f94383cccd2bcb2b7" candidate_uuid: "773a9a5eeb14469389297d0f170bae34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" is_pre_election: true
I20260709 12:15:44.738195 26642 raft_consensus.cc:2393] T 7a40c4830672494f94383cccd2bcb2b7 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773a9a5eeb14469389297d0f170bae34 in current term 1: Already voted for candidate ea3ae70a91d24c3e84f03da4605ccede in this term.
I20260709 12:15:44.739600 26681 leader_election.cc:304] T 7a40c4830672494f94383cccd2bcb2b7 P 773a9a5eeb14469389297d0f170bae34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773a9a5eeb14469389297d0f170bae34; no voters: 56539bdd0fcc41a7ae3e12c2f743d6fd, ea3ae70a91d24c3e84f03da4605ccede
I20260709 12:15:44.740433 26951 leader_election.cc:290] T 7a40c4830672494f94383cccd2bcb2b7 P 773a9a5eeb14469389297d0f170bae34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813), ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195:43987)
I20260709 12:15:44.741257 26951 raft_consensus.cc:3060] T 7a40c4830672494f94383cccd2bcb2b7 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:44.766502 26890 consensus_queue.cc:1048] T eb394e0c07444d0a96763f25ac9394e9 P ea3ae70a91d24c3e84f03da4605ccede [LEADER]: Connected to new peer: Peer: permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:44.770231 26952 consensus_queue.cc:1048] T 64c363fad70c4e89bf03bf59e7252fac P 56539bdd0fcc41a7ae3e12c2f743d6fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:44.773069 26890 consensus_queue.cc:1048] T b9898596353d46eab5ff567f15224907 P ea3ae70a91d24c3e84f03da4605ccede [LEADER]: Connected to new peer: Peer: permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:44.777837 26942 tablet_bootstrap.cc:492] T 6368117da5f748b3ae4f1475c4d8decb P 773a9a5eeb14469389297d0f170bae34: No bootstrap required, opened a new log
I20260709 12:15:44.778713 26942 ts_tablet_manager.cc:1403] T 6368117da5f748b3ae4f1475c4d8decb P 773a9a5eeb14469389297d0f170bae34: Time spent bootstrapping tablet: real 0.086s	user 0.011s	sys 0.011s
I20260709 12:15:44.781383 26951 raft_consensus.cc:2749] T 7a40c4830672494f94383cccd2bcb2b7 P 773a9a5eeb14469389297d0f170bae34 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:44.788106 26942 raft_consensus.cc:359] T 6368117da5f748b3ae4f1475c4d8decb P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.789003 26942 raft_consensus.cc:385] T 6368117da5f748b3ae4f1475c4d8decb P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:44.789319 26942 raft_consensus.cc:740] T 6368117da5f748b3ae4f1475c4d8decb P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773a9a5eeb14469389297d0f170bae34, State: Initialized, Role: FOLLOWER
I20260709 12:15:44.790110 26942 consensus_queue.cc:260] T 6368117da5f748b3ae4f1475c4d8decb P 773a9a5eeb14469389297d0f170bae34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.798290 26942 ts_tablet_manager.cc:1434] T 6368117da5f748b3ae4f1475c4d8decb P 773a9a5eeb14469389297d0f170bae34: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:15:44.801124 26890 consensus_queue.cc:1048] T b9898596353d46eab5ff567f15224907 P ea3ae70a91d24c3e84f03da4605ccede [LEADER]: Connected to new peer: Peer: permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:44.838353 26970 consensus_queue.cc:1048] T 6673c39fbed4452aa38ceee09bda8cc6 P ea3ae70a91d24c3e84f03da4605ccede [LEADER]: Connected to new peer: Peer: permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:44.855137 26716 raft_consensus.cc:3060] T 6673c39fbed4452aa38ceee09bda8cc6 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:44.868008 26970 consensus_queue.cc:1048] T 6673c39fbed4452aa38ceee09bda8cc6 P ea3ae70a91d24c3e84f03da4605ccede [LEADER]: Connected to new peer: Peer: permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:44.893185 26951 raft_consensus.cc:493] T 6368117da5f748b3ae4f1475c4d8decb P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.893764 26951 raft_consensus.cc:515] T 6368117da5f748b3ae4f1475c4d8decb P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.896579 26951 leader_election.cc:290] T 6368117da5f748b3ae4f1475c4d8decb P 773a9a5eeb14469389297d0f170bae34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813), ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195:43987)
I20260709 12:15:44.896900 26643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6368117da5f748b3ae4f1475c4d8decb" candidate_uuid: "773a9a5eeb14469389297d0f170bae34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" is_pre_election: true
I20260709 12:15:44.897720 26643 raft_consensus.cc:2393] T 6368117da5f748b3ae4f1475c4d8decb P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773a9a5eeb14469389297d0f170bae34 in current term 1: Already voted for candidate ea3ae70a91d24c3e84f03da4605ccede in this term.
I20260709 12:15:44.898746 26792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6368117da5f748b3ae4f1475c4d8decb" candidate_uuid: "773a9a5eeb14469389297d0f170bae34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3ae70a91d24c3e84f03da4605ccede" is_pre_election: true
I20260709 12:15:44.900226 26682 leader_election.cc:304] T 6368117da5f748b3ae4f1475c4d8decb P 773a9a5eeb14469389297d0f170bae34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773a9a5eeb14469389297d0f170bae34; no voters: 56539bdd0fcc41a7ae3e12c2f743d6fd, ea3ae70a91d24c3e84f03da4605ccede
I20260709 12:15:44.901207 26951 raft_consensus.cc:3060] T 6368117da5f748b3ae4f1475c4d8decb P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:44.907039 26951 raft_consensus.cc:2749] T 6368117da5f748b3ae4f1475c4d8decb P 773a9a5eeb14469389297d0f170bae34 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:44.922957 26951 raft_consensus.cc:493] T eceb0db47a1d432e9cbe22991da985f4 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.923508 26951 raft_consensus.cc:515] T eceb0db47a1d432e9cbe22991da985f4 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.925619 26951 leader_election.cc:290] T eceb0db47a1d432e9cbe22991da985f4 P 773a9a5eeb14469389297d0f170bae34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813), ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195:43987)
I20260709 12:15:44.926807 26792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eceb0db47a1d432e9cbe22991da985f4" candidate_uuid: "773a9a5eeb14469389297d0f170bae34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3ae70a91d24c3e84f03da4605ccede" is_pre_election: true
I20260709 12:15:44.926657 26643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eceb0db47a1d432e9cbe22991da985f4" candidate_uuid: "773a9a5eeb14469389297d0f170bae34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" is_pre_election: true
I20260709 12:15:44.927732 26792 raft_consensus.cc:2468] T eceb0db47a1d432e9cbe22991da985f4 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773a9a5eeb14469389297d0f170bae34 in term 0.
I20260709 12:15:44.927793 26643 raft_consensus.cc:2468] T eceb0db47a1d432e9cbe22991da985f4 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773a9a5eeb14469389297d0f170bae34 in term 0.
I20260709 12:15:44.928905 26682 leader_election.cc:304] T eceb0db47a1d432e9cbe22991da985f4 P 773a9a5eeb14469389297d0f170bae34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773a9a5eeb14469389297d0f170bae34, ea3ae70a91d24c3e84f03da4605ccede; no voters: 
I20260709 12:15:44.929859 26951 raft_consensus.cc:2804] T eceb0db47a1d432e9cbe22991da985f4 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:44.930325 26951 raft_consensus.cc:493] T eceb0db47a1d432e9cbe22991da985f4 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:44.930728 26951 raft_consensus.cc:3060] T eceb0db47a1d432e9cbe22991da985f4 P 773a9a5eeb14469389297d0f170bae34 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:44.940228 26951 raft_consensus.cc:515] T eceb0db47a1d432e9cbe22991da985f4 P 773a9a5eeb14469389297d0f170bae34 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.943048 26951 leader_election.cc:290] T eceb0db47a1d432e9cbe22991da985f4 P 773a9a5eeb14469389297d0f170bae34 [CANDIDATE]: Term 1 election: Requested vote from peers 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813), ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195:43987)
I20260709 12:15:44.943809 26643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eceb0db47a1d432e9cbe22991da985f4" candidate_uuid: "773a9a5eeb14469389297d0f170bae34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd"
I20260709 12:15:44.944639 26643 raft_consensus.cc:3060] T eceb0db47a1d432e9cbe22991da985f4 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:44.944770 26792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eceb0db47a1d432e9cbe22991da985f4" candidate_uuid: "773a9a5eeb14469389297d0f170bae34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3ae70a91d24c3e84f03da4605ccede"
I20260709 12:15:44.945680 26792 raft_consensus.cc:3060] T eceb0db47a1d432e9cbe22991da985f4 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:44.952018 26643 raft_consensus.cc:2468] T eceb0db47a1d432e9cbe22991da985f4 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773a9a5eeb14469389297d0f170bae34 in term 1.
I20260709 12:15:44.953487 26681 leader_election.cc:304] T eceb0db47a1d432e9cbe22991da985f4 P 773a9a5eeb14469389297d0f170bae34 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56539bdd0fcc41a7ae3e12c2f743d6fd, 773a9a5eeb14469389297d0f170bae34; no voters: 
I20260709 12:15:44.953876 26970 consensus_queue.cc:1048] T 6368117da5f748b3ae4f1475c4d8decb P ea3ae70a91d24c3e84f03da4605ccede [LEADER]: Connected to new peer: Peer: permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:44.954608 26951 raft_consensus.cc:2804] T eceb0db47a1d432e9cbe22991da985f4 P 773a9a5eeb14469389297d0f170bae34 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:44.955871 26792 raft_consensus.cc:2468] T eceb0db47a1d432e9cbe22991da985f4 P ea3ae70a91d24c3e84f03da4605ccede [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773a9a5eeb14469389297d0f170bae34 in term 1.
I20260709 12:15:44.955963 26951 raft_consensus.cc:697] T eceb0db47a1d432e9cbe22991da985f4 P 773a9a5eeb14469389297d0f170bae34 [term 1 LEADER]: Becoming Leader. State: Replica: 773a9a5eeb14469389297d0f170bae34, State: Running, Role: LEADER
I20260709 12:15:44.957465 26951 consensus_queue.cc:237] T eceb0db47a1d432e9cbe22991da985f4 P 773a9a5eeb14469389297d0f170bae34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:44.970979 26962 consensus_queue.cc:1048] T 6368117da5f748b3ae4f1475c4d8decb P ea3ae70a91d24c3e84f03da4605ccede [LEADER]: Connected to new peer: Peer: permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:44.987727 26537 catalog_manager.cc:5697] T eceb0db47a1d432e9cbe22991da985f4 P 773a9a5eeb14469389297d0f170bae34 reported cstate change: term changed from 0 to 1, leader changed from <none> to 773a9a5eeb14469389297d0f170bae34 (127.12.56.194). New cstate: current_term: 1 leader_uuid: "773a9a5eeb14469389297d0f170bae34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:45.010854 26890 raft_consensus.cc:493] T b213246febae4173bc0e67e7ccc15257 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:45.011696 26890 raft_consensus.cc:515] T b213246febae4173bc0e67e7ccc15257 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:45.015944 26643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b213246febae4173bc0e67e7ccc15257" candidate_uuid: "ea3ae70a91d24c3e84f03da4605ccede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" is_pre_election: true
I20260709 12:15:45.016419 26716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b213246febae4173bc0e67e7ccc15257" candidate_uuid: "ea3ae70a91d24c3e84f03da4605ccede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773a9a5eeb14469389297d0f170bae34" is_pre_election: true
I20260709 12:15:45.016942 26643 raft_consensus.cc:2393] T b213246febae4173bc0e67e7ccc15257 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea3ae70a91d24c3e84f03da4605ccede in current term 1: Already voted for candidate 773a9a5eeb14469389297d0f170bae34 in this term.
I20260709 12:15:45.018601 26758 leader_election.cc:304] T b213246febae4173bc0e67e7ccc15257 P ea3ae70a91d24c3e84f03da4605ccede [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea3ae70a91d24c3e84f03da4605ccede; no voters: 56539bdd0fcc41a7ae3e12c2f743d6fd, 773a9a5eeb14469389297d0f170bae34
I20260709 12:15:45.019703 26970 raft_consensus.cc:3060] T b213246febae4173bc0e67e7ccc15257 P ea3ae70a91d24c3e84f03da4605ccede [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:45.020920 26890 leader_election.cc:290] T b213246febae4173bc0e67e7ccc15257 P ea3ae70a91d24c3e84f03da4605ccede [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813), 773a9a5eeb14469389297d0f170bae34 (127.12.56.194:37781)
I20260709 12:15:45.028123 26970 raft_consensus.cc:2749] T b213246febae4173bc0e67e7ccc15257 P ea3ae70a91d24c3e84f03da4605ccede [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:45.030334 26970 consensus_queue.cc:1048] T ed99dec74c4249ad85b7ef69d0c3d6ec P ea3ae70a91d24c3e84f03da4605ccede [LEADER]: Connected to new peer: Peer: permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:45.044297 26970 consensus_queue.cc:1048] T ed99dec74c4249ad85b7ef69d0c3d6ec P ea3ae70a91d24c3e84f03da4605ccede [LEADER]: Connected to new peer: Peer: permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:45.112962 26792 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a40c4830672494f94383cccd2bcb2b7"
dest_uuid: "ea3ae70a91d24c3e84f03da4605ccede"
mode: GRACEFUL
new_leader_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd"
 from {username='slave'} at 127.0.0.1:41382
I20260709 12:15:45.113643 26792 raft_consensus.cc:606] T 7a40c4830672494f94383cccd2bcb2b7 P ea3ae70a91d24c3e84f03da4605ccede [term 1 LEADER]: Received request to transfer leadership to TS 56539bdd0fcc41a7ae3e12c2f743d6fd
I20260709 12:15:45.120149 26792 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ed99dec74c4249ad85b7ef69d0c3d6ec"
dest_uuid: "ea3ae70a91d24c3e84f03da4605ccede"
mode: GRACEFUL
new_leader_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd"
 from {username='slave'} at 127.0.0.1:41382
I20260709 12:15:45.120735 26792 raft_consensus.cc:606] T ed99dec74c4249ad85b7ef69d0c3d6ec P ea3ae70a91d24c3e84f03da4605ccede [term 1 LEADER]: Received request to transfer leadership to TS 56539bdd0fcc41a7ae3e12c2f743d6fd
I20260709 12:15:45.126726 26792 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6673c39fbed4452aa38ceee09bda8cc6"
dest_uuid: "ea3ae70a91d24c3e84f03da4605ccede"
mode: GRACEFUL
new_leader_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd"
 from {username='slave'} at 127.0.0.1:41382
I20260709 12:15:45.127285 26792 raft_consensus.cc:606] T 6673c39fbed4452aa38ceee09bda8cc6 P ea3ae70a91d24c3e84f03da4605ccede [term 1 LEADER]: Received request to transfer leadership to TS 56539bdd0fcc41a7ae3e12c2f743d6fd
I20260709 12:15:45.134778 26792 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6368117da5f748b3ae4f1475c4d8decb"
dest_uuid: "ea3ae70a91d24c3e84f03da4605ccede"
mode: GRACEFUL
new_leader_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd"
 from {username='slave'} at 127.0.0.1:41382
I20260709 12:15:45.135481 26792 raft_consensus.cc:606] T 6368117da5f748b3ae4f1475c4d8decb P ea3ae70a91d24c3e84f03da4605ccede [term 1 LEADER]: Received request to transfer leadership to TS 56539bdd0fcc41a7ae3e12c2f743d6fd
I20260709 12:15:45.141498 26792 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9898596353d46eab5ff567f15224907"
dest_uuid: "ea3ae70a91d24c3e84f03da4605ccede"
mode: GRACEFUL
new_leader_uuid: "773a9a5eeb14469389297d0f170bae34"
 from {username='slave'} at 127.0.0.1:41382
I20260709 12:15:45.142251 26792 raft_consensus.cc:606] T b9898596353d46eab5ff567f15224907 P ea3ae70a91d24c3e84f03da4605ccede [term 1 LEADER]: Received request to transfer leadership to TS 773a9a5eeb14469389297d0f170bae34
I20260709 12:15:45.153443 26643 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "64c363fad70c4e89bf03bf59e7252fac"
dest_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd"
mode: GRACEFUL
new_leader_uuid: "773a9a5eeb14469389297d0f170bae34"
 from {username='slave'} at 127.0.0.1:37446
I20260709 12:15:45.154094 26643 raft_consensus.cc:606] T 64c363fad70c4e89bf03bf59e7252fac P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 LEADER]: Received request to transfer leadership to TS 773a9a5eeb14469389297d0f170bae34
I20260709 12:15:45.190631 26890 consensus_queue.cc:1048] T 7a40c4830672494f94383cccd2bcb2b7 P ea3ae70a91d24c3e84f03da4605ccede [LEADER]: Connected to new peer: Peer: permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:45.199963 26970 raft_consensus.cc:993] T 7a40c4830672494f94383cccd2bcb2b7 P ea3ae70a91d24c3e84f03da4605ccede: : Instructing follower 56539bdd0fcc41a7ae3e12c2f743d6fd to start an election
I20260709 12:15:45.200564 26962 raft_consensus.cc:1081] T 7a40c4830672494f94383cccd2bcb2b7 P ea3ae70a91d24c3e84f03da4605ccede [term 1 LEADER]: Signalling peer 56539bdd0fcc41a7ae3e12c2f743d6fd to start an election
I20260709 12:15:45.207228 26642 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7a40c4830672494f94383cccd2bcb2b7"
dest_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd"
 from {username='slave'} at 127.0.0.1:37438
I20260709 12:15:45.208024 26642 raft_consensus.cc:493] T 7a40c4830672494f94383cccd2bcb2b7 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:45.208523 26642 raft_consensus.cc:3060] T 7a40c4830672494f94383cccd2bcb2b7 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:45.209733 26856 raft_consensus.cc:993] T 64c363fad70c4e89bf03bf59e7252fac P 56539bdd0fcc41a7ae3e12c2f743d6fd: : Instructing follower 773a9a5eeb14469389297d0f170bae34 to start an election
I20260709 12:15:45.210276 26856 raft_consensus.cc:1081] T 64c363fad70c4e89bf03bf59e7252fac P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 LEADER]: Signalling peer 773a9a5eeb14469389297d0f170bae34 to start an election
I20260709 12:15:45.216600 26717 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "64c363fad70c4e89bf03bf59e7252fac"
dest_uuid: "773a9a5eeb14469389297d0f170bae34"
 from {username='slave'} at 127.0.0.1:41414
I20260709 12:15:45.217330 26717 raft_consensus.cc:493] T 64c363fad70c4e89bf03bf59e7252fac P 773a9a5eeb14469389297d0f170bae34 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:45.217708 26717 raft_consensus.cc:3060] T 64c363fad70c4e89bf03bf59e7252fac P 773a9a5eeb14469389297d0f170bae34 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:45.223697 26968 consensus_queue.cc:1048] T 7a40c4830672494f94383cccd2bcb2b7 P ea3ae70a91d24c3e84f03da4605ccede [LEADER]: Connected to new peer: Peer: permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:45.225183 26951 consensus_queue.cc:1048] T b213246febae4173bc0e67e7ccc15257 P 773a9a5eeb14469389297d0f170bae34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:45.227839 26717 raft_consensus.cc:515] T 64c363fad70c4e89bf03bf59e7252fac P 773a9a5eeb14469389297d0f170bae34 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:45.234656 26640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c363fad70c4e89bf03bf59e7252fac" candidate_uuid: "773a9a5eeb14469389297d0f170bae34" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd"
I20260709 12:15:45.235608 26640 raft_consensus.cc:3055] T 64c363fad70c4e89bf03bf59e7252fac P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:45.236052 26640 raft_consensus.cc:740] T 64c363fad70c4e89bf03bf59e7252fac P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56539bdd0fcc41a7ae3e12c2f743d6fd, State: Running, Role: LEADER
I20260709 12:15:45.237205 26640 consensus_queue.cc:260] T 64c363fad70c4e89bf03bf59e7252fac P 56539bdd0fcc41a7ae3e12c2f743d6fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:45.239297 26640 raft_consensus.cc:3060] T 64c363fad70c4e89bf03bf59e7252fac P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:45.237818 26642 raft_consensus.cc:515] T 7a40c4830672494f94383cccd2bcb2b7 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:45.241350 26641 raft_consensus.cc:1240] T 7a40c4830672494f94383cccd2bcb2b7 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 2 FOLLOWER]: Rejecting Update request from peer ea3ae70a91d24c3e84f03da4605ccede for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:45.249115 26791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c363fad70c4e89bf03bf59e7252fac" candidate_uuid: "773a9a5eeb14469389297d0f170bae34" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea3ae70a91d24c3e84f03da4605ccede"
I20260709 12:15:45.250111 26791 raft_consensus.cc:3060] T 64c363fad70c4e89bf03bf59e7252fac P ea3ae70a91d24c3e84f03da4605ccede [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:45.250432 26717 leader_election.cc:290] T 64c363fad70c4e89bf03bf59e7252fac P 773a9a5eeb14469389297d0f170bae34 [CANDIDATE]: Term 2 election: Requested vote from peers 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813), ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195:43987)
I20260709 12:15:45.258033 26968 consensus_queue.cc:1059] T 7a40c4830672494f94383cccd2bcb2b7 P ea3ae70a91d24c3e84f03da4605ccede [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:45.259502 26968 raft_consensus.cc:3055] T 7a40c4830672494f94383cccd2bcb2b7 P ea3ae70a91d24c3e84f03da4605ccede [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:45.260385 26968 raft_consensus.cc:740] T 7a40c4830672494f94383cccd2bcb2b7 P ea3ae70a91d24c3e84f03da4605ccede [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea3ae70a91d24c3e84f03da4605ccede, State: Running, Role: LEADER
I20260709 12:15:45.261838 26968 consensus_queue.cc:260] T 7a40c4830672494f94383cccd2bcb2b7 P ea3ae70a91d24c3e84f03da4605ccede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:45.263213 26968 raft_consensus.cc:3060] T 7a40c4830672494f94383cccd2bcb2b7 P ea3ae70a91d24c3e84f03da4605ccede [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:45.276221 26642 leader_election.cc:290] T 7a40c4830672494f94383cccd2bcb2b7 P 56539bdd0fcc41a7ae3e12c2f743d6fd [CANDIDATE]: Term 2 election: Requested vote from peers 773a9a5eeb14469389297d0f170bae34 (127.12.56.194:37781), ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195:43987)
I20260709 12:15:45.279498 26790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a40c4830672494f94383cccd2bcb2b7" candidate_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea3ae70a91d24c3e84f03da4605ccede"
I20260709 12:15:45.280179 26640 raft_consensus.cc:2468] T 64c363fad70c4e89bf03bf59e7252fac P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773a9a5eeb14469389297d0f170bae34 in term 2.
I20260709 12:15:45.281461 26681 leader_election.cc:304] T 64c363fad70c4e89bf03bf59e7252fac P 773a9a5eeb14469389297d0f170bae34 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56539bdd0fcc41a7ae3e12c2f743d6fd, 773a9a5eeb14469389297d0f170bae34; no voters: 
I20260709 12:15:45.282442 26927 raft_consensus.cc:2804] T 64c363fad70c4e89bf03bf59e7252fac P 773a9a5eeb14469389297d0f170bae34 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:45.287438 26716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a40c4830672494f94383cccd2bcb2b7" candidate_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "773a9a5eeb14469389297d0f170bae34"
I20260709 12:15:45.288743 26716 raft_consensus.cc:3060] T 7a40c4830672494f94383cccd2bcb2b7 P 773a9a5eeb14469389297d0f170bae34 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:45.300616 26890 raft_consensus.cc:993] T 6673c39fbed4452aa38ceee09bda8cc6 P ea3ae70a91d24c3e84f03da4605ccede: : Instructing follower 56539bdd0fcc41a7ae3e12c2f743d6fd to start an election
I20260709 12:15:45.301218 26890 raft_consensus.cc:1081] T 6673c39fbed4452aa38ceee09bda8cc6 P ea3ae70a91d24c3e84f03da4605ccede [term 1 LEADER]: Signalling peer 56539bdd0fcc41a7ae3e12c2f743d6fd to start an election
I20260709 12:15:45.303758 26791 raft_consensus.cc:2468] T 64c363fad70c4e89bf03bf59e7252fac P ea3ae70a91d24c3e84f03da4605ccede [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773a9a5eeb14469389297d0f170bae34 in term 2.
I20260709 12:15:45.315068 26642 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6673c39fbed4452aa38ceee09bda8cc6"
dest_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd"
 from {username='slave'} at 127.0.0.1:37438
I20260709 12:15:45.316064 26642 raft_consensus.cc:493] T 6673c39fbed4452aa38ceee09bda8cc6 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:45.316582 26642 raft_consensus.cc:3060] T 6673c39fbed4452aa38ceee09bda8cc6 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:45.333009 26951 consensus_queue.cc:1048] T b213246febae4173bc0e67e7ccc15257 P 773a9a5eeb14469389297d0f170bae34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:45.341992 26927 raft_consensus.cc:697] T 64c363fad70c4e89bf03bf59e7252fac P 773a9a5eeb14469389297d0f170bae34 [term 2 LEADER]: Becoming Leader. State: Replica: 773a9a5eeb14469389297d0f170bae34, State: Running, Role: LEADER
I20260709 12:15:45.347143 26927 consensus_queue.cc:237] T 64c363fad70c4e89bf03bf59e7252fac P 773a9a5eeb14469389297d0f170bae34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:45.363317 26541 catalog_manager.cc:5697] T 64c363fad70c4e89bf03bf59e7252fac P 773a9a5eeb14469389297d0f170bae34 reported cstate change: term changed from 1 to 2, leader changed from 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193) to 773a9a5eeb14469389297d0f170bae34 (127.12.56.194). New cstate: current_term: 2 leader_uuid: "773a9a5eeb14469389297d0f170bae34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:45.372758 26716 raft_consensus.cc:2468] T 7a40c4830672494f94383cccd2bcb2b7 P 773a9a5eeb14469389297d0f170bae34 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56539bdd0fcc41a7ae3e12c2f743d6fd in term 2.
I20260709 12:15:45.377223 26642 raft_consensus.cc:515] T 6673c39fbed4452aa38ceee09bda8cc6 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:45.376178 26790 raft_consensus.cc:2468] T 7a40c4830672494f94383cccd2bcb2b7 P ea3ae70a91d24c3e84f03da4605ccede [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56539bdd0fcc41a7ae3e12c2f743d6fd in term 2.
I20260709 12:15:45.382169 26792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6673c39fbed4452aa38ceee09bda8cc6" candidate_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea3ae70a91d24c3e84f03da4605ccede"
I20260709 12:15:45.382860 26792 raft_consensus.cc:3055] T 6673c39fbed4452aa38ceee09bda8cc6 P ea3ae70a91d24c3e84f03da4605ccede [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:45.383213 26792 raft_consensus.cc:740] T 6673c39fbed4452aa38ceee09bda8cc6 P ea3ae70a91d24c3e84f03da4605ccede [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea3ae70a91d24c3e84f03da4605ccede, State: Running, Role: LEADER
I20260709 12:15:45.384024 26792 consensus_queue.cc:260] T 6673c39fbed4452aa38ceee09bda8cc6 P ea3ae70a91d24c3e84f03da4605ccede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:45.384930 26642 leader_election.cc:290] T 6673c39fbed4452aa38ceee09bda8cc6 P 56539bdd0fcc41a7ae3e12c2f743d6fd [CANDIDATE]: Term 2 election: Requested vote from peers 773a9a5eeb14469389297d0f170bae34 (127.12.56.194:37781), ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195:43987)
I20260709 12:15:45.387105 26607 leader_election.cc:304] T 7a40c4830672494f94383cccd2bcb2b7 P 56539bdd0fcc41a7ae3e12c2f743d6fd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56539bdd0fcc41a7ae3e12c2f743d6fd, ea3ae70a91d24c3e84f03da4605ccede; no voters: 
I20260709 12:15:45.388139 26856 raft_consensus.cc:2804] T 7a40c4830672494f94383cccd2bcb2b7 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:45.388667 26856 raft_consensus.cc:697] T 7a40c4830672494f94383cccd2bcb2b7 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 2 LEADER]: Becoming Leader. State: Replica: 56539bdd0fcc41a7ae3e12c2f743d6fd, State: Running, Role: LEADER
I20260709 12:15:45.389550 26856 consensus_queue.cc:237] T 7a40c4830672494f94383cccd2bcb2b7 P 56539bdd0fcc41a7ae3e12c2f743d6fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:45.385025 26792 raft_consensus.cc:3060] T 6673c39fbed4452aa38ceee09bda8cc6 P ea3ae70a91d24c3e84f03da4605ccede [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:45.392017 26717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6673c39fbed4452aa38ceee09bda8cc6" candidate_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "773a9a5eeb14469389297d0f170bae34"
I20260709 12:15:45.392745 26717 raft_consensus.cc:3060] T 6673c39fbed4452aa38ceee09bda8cc6 P 773a9a5eeb14469389297d0f170bae34 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:45.403139 26792 raft_consensus.cc:2468] T 6673c39fbed4452aa38ceee09bda8cc6 P ea3ae70a91d24c3e84f03da4605ccede [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56539bdd0fcc41a7ae3e12c2f743d6fd in term 2.
I20260709 12:15:45.404799 26607 leader_election.cc:304] T 6673c39fbed4452aa38ceee09bda8cc6 P 56539bdd0fcc41a7ae3e12c2f743d6fd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56539bdd0fcc41a7ae3e12c2f743d6fd, ea3ae70a91d24c3e84f03da4605ccede; no voters: 
I20260709 12:15:45.405828 27010 raft_consensus.cc:2804] T 6673c39fbed4452aa38ceee09bda8cc6 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:45.406388 27010 raft_consensus.cc:697] T 6673c39fbed4452aa38ceee09bda8cc6 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 2 LEADER]: Becoming Leader. State: Replica: 56539bdd0fcc41a7ae3e12c2f743d6fd, State: Running, Role: LEADER
I20260709 12:15:45.406529 27013 consensus_queue.cc:1048] T eceb0db47a1d432e9cbe22991da985f4 P 773a9a5eeb14469389297d0f170bae34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:45.407389 27010 consensus_queue.cc:237] T 6673c39fbed4452aa38ceee09bda8cc6 P 56539bdd0fcc41a7ae3e12c2f743d6fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:45.423013 26717 raft_consensus.cc:2468] T 6673c39fbed4452aa38ceee09bda8cc6 P 773a9a5eeb14469389297d0f170bae34 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56539bdd0fcc41a7ae3e12c2f743d6fd in term 2.
I20260709 12:15:45.424841 26716 raft_consensus.cc:1240] T 6673c39fbed4452aa38ceee09bda8cc6 P 773a9a5eeb14469389297d0f170bae34 [term 2 FOLLOWER]: Rejecting Update request from peer ea3ae70a91d24c3e84f03da4605ccede for earlier term 1. Current term is 2. Ops: []
I20260709 12:15:45.441200 26890 raft_consensus.cc:993] T b9898596353d46eab5ff567f15224907 P ea3ae70a91d24c3e84f03da4605ccede: : Instructing follower 773a9a5eeb14469389297d0f170bae34 to start an election
I20260709 12:15:45.441813 26890 raft_consensus.cc:1081] T b9898596353d46eab5ff567f15224907 P ea3ae70a91d24c3e84f03da4605ccede [term 1 LEADER]: Signalling peer 773a9a5eeb14469389297d0f170bae34 to start an election
I20260709 12:15:45.448827 27013 consensus_queue.cc:1048] T eceb0db47a1d432e9cbe22991da985f4 P 773a9a5eeb14469389297d0f170bae34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:45.454102 26716 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b9898596353d46eab5ff567f15224907"
dest_uuid: "773a9a5eeb14469389297d0f170bae34"
 from {username='slave'} at 127.0.0.1:41930
I20260709 12:15:45.454962 26716 raft_consensus.cc:493] T b9898596353d46eab5ff567f15224907 P 773a9a5eeb14469389297d0f170bae34 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:45.455411 26716 raft_consensus.cc:3060] T b9898596353d46eab5ff567f15224907 P 773a9a5eeb14469389297d0f170bae34 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:45.456154 26537 catalog_manager.cc:5697] T 7a40c4830672494f94383cccd2bcb2b7 P 56539bdd0fcc41a7ae3e12c2f743d6fd reported cstate change: term changed from 1 to 2, leader changed from ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195) to 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193). New cstate: current_term: 2 leader_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:45.459678 26537 catalog_manager.cc:5697] T 6673c39fbed4452aa38ceee09bda8cc6 P 56539bdd0fcc41a7ae3e12c2f743d6fd reported cstate change: term changed from 1 to 2, leader changed from ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195) to 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193). New cstate: current_term: 2 leader_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:45.465642 26716 raft_consensus.cc:515] T b9898596353d46eab5ff567f15224907 P 773a9a5eeb14469389297d0f170bae34 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:45.470438 26640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9898596353d46eab5ff567f15224907" candidate_uuid: "773a9a5eeb14469389297d0f170bae34" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd"
I20260709 12:15:45.471237 26640 raft_consensus.cc:3060] T b9898596353d46eab5ff567f15224907 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:45.481606 26640 raft_consensus.cc:2468] T b9898596353d46eab5ff567f15224907 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773a9a5eeb14469389297d0f170bae34 in term 2.
I20260709 12:15:45.482012 26792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9898596353d46eab5ff567f15224907" candidate_uuid: "773a9a5eeb14469389297d0f170bae34" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea3ae70a91d24c3e84f03da4605ccede"
I20260709 12:15:45.482820 26792 raft_consensus.cc:3055] T b9898596353d46eab5ff567f15224907 P ea3ae70a91d24c3e84f03da4605ccede [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:45.483135 26792 raft_consensus.cc:740] T b9898596353d46eab5ff567f15224907 P ea3ae70a91d24c3e84f03da4605ccede [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea3ae70a91d24c3e84f03da4605ccede, State: Running, Role: LEADER
I20260709 12:15:45.483338 26681 leader_election.cc:304] T b9898596353d46eab5ff567f15224907 P 773a9a5eeb14469389297d0f170bae34 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56539bdd0fcc41a7ae3e12c2f743d6fd, 773a9a5eeb14469389297d0f170bae34; no voters: 
I20260709 12:15:45.483953 26792 consensus_queue.cc:260] T b9898596353d46eab5ff567f15224907 P ea3ae70a91d24c3e84f03da4605ccede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:45.484500 26927 raft_consensus.cc:2804] T b9898596353d46eab5ff567f15224907 P 773a9a5eeb14469389297d0f170bae34 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:45.485168 26927 raft_consensus.cc:697] T b9898596353d46eab5ff567f15224907 P 773a9a5eeb14469389297d0f170bae34 [term 2 LEADER]: Becoming Leader. State: Replica: 773a9a5eeb14469389297d0f170bae34, State: Running, Role: LEADER
I20260709 12:15:45.485240 26792 raft_consensus.cc:3060] T b9898596353d46eab5ff567f15224907 P ea3ae70a91d24c3e84f03da4605ccede [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:45.486290 26927 consensus_queue.cc:237] T b9898596353d46eab5ff567f15224907 P 773a9a5eeb14469389297d0f170bae34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:45.497931 26716 leader_election.cc:290] T b9898596353d46eab5ff567f15224907 P 773a9a5eeb14469389297d0f170bae34 [CANDIDATE]: Term 2 election: Requested vote from peers 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813), ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195:43987)
I20260709 12:15:45.500872 26792 raft_consensus.cc:2468] T b9898596353d46eab5ff567f15224907 P ea3ae70a91d24c3e84f03da4605ccede [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773a9a5eeb14469389297d0f170bae34 in term 2.
I20260709 12:15:45.506534 26537 catalog_manager.cc:5697] T b9898596353d46eab5ff567f15224907 P 773a9a5eeb14469389297d0f170bae34 reported cstate change: term changed from 1 to 2, leader changed from ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195) to 773a9a5eeb14469389297d0f170bae34 (127.12.56.194). New cstate: current_term: 2 leader_uuid: "773a9a5eeb14469389297d0f170bae34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:45.547626 26970 raft_consensus.cc:993] T ed99dec74c4249ad85b7ef69d0c3d6ec P ea3ae70a91d24c3e84f03da4605ccede: : Instructing follower 56539bdd0fcc41a7ae3e12c2f743d6fd to start an election
I20260709 12:15:45.548126 26968 raft_consensus.cc:1081] T ed99dec74c4249ad85b7ef69d0c3d6ec P ea3ae70a91d24c3e84f03da4605ccede [term 1 LEADER]: Signalling peer 56539bdd0fcc41a7ae3e12c2f743d6fd to start an election
I20260709 12:15:45.550225 26640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ed99dec74c4249ad85b7ef69d0c3d6ec"
dest_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd"
 from {username='slave'} at 127.0.0.1:37438
I20260709 12:15:45.550930 26640 raft_consensus.cc:493] T ed99dec74c4249ad85b7ef69d0c3d6ec P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:45.551265 26640 raft_consensus.cc:3060] T ed99dec74c4249ad85b7ef69d0c3d6ec P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:45.557036 26640 raft_consensus.cc:515] T ed99dec74c4249ad85b7ef69d0c3d6ec P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:45.559546 26640 leader_election.cc:290] T ed99dec74c4249ad85b7ef69d0c3d6ec P 56539bdd0fcc41a7ae3e12c2f743d6fd [CANDIDATE]: Term 2 election: Requested vote from peers 773a9a5eeb14469389297d0f170bae34 (127.12.56.194:37781), ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195:43987)
I20260709 12:15:45.560283 26716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed99dec74c4249ad85b7ef69d0c3d6ec" candidate_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "773a9a5eeb14469389297d0f170bae34"
I20260709 12:15:45.561138 26716 raft_consensus.cc:3060] T ed99dec74c4249ad85b7ef69d0c3d6ec P 773a9a5eeb14469389297d0f170bae34 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:45.562153 26792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed99dec74c4249ad85b7ef69d0c3d6ec" candidate_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea3ae70a91d24c3e84f03da4605ccede"
I20260709 12:15:45.562873 26792 raft_consensus.cc:3055] T ed99dec74c4249ad85b7ef69d0c3d6ec P ea3ae70a91d24c3e84f03da4605ccede [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:45.563354 26792 raft_consensus.cc:740] T ed99dec74c4249ad85b7ef69d0c3d6ec P ea3ae70a91d24c3e84f03da4605ccede [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea3ae70a91d24c3e84f03da4605ccede, State: Running, Role: LEADER
I20260709 12:15:45.564442 26792 consensus_queue.cc:260] T ed99dec74c4249ad85b7ef69d0c3d6ec P ea3ae70a91d24c3e84f03da4605ccede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:45.565761 26792 raft_consensus.cc:3060] T ed99dec74c4249ad85b7ef69d0c3d6ec P ea3ae70a91d24c3e84f03da4605ccede [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:45.570775 26792 raft_consensus.cc:2468] T ed99dec74c4249ad85b7ef69d0c3d6ec P ea3ae70a91d24c3e84f03da4605ccede [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56539bdd0fcc41a7ae3e12c2f743d6fd in term 2.
I20260709 12:15:45.571573 26716 raft_consensus.cc:2468] T ed99dec74c4249ad85b7ef69d0c3d6ec P 773a9a5eeb14469389297d0f170bae34 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56539bdd0fcc41a7ae3e12c2f743d6fd in term 2.
I20260709 12:15:45.571992 26607 leader_election.cc:304] T ed99dec74c4249ad85b7ef69d0c3d6ec P 56539bdd0fcc41a7ae3e12c2f743d6fd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56539bdd0fcc41a7ae3e12c2f743d6fd, ea3ae70a91d24c3e84f03da4605ccede; no voters: 
I20260709 12:15:45.573364 27010 raft_consensus.cc:2804] T ed99dec74c4249ad85b7ef69d0c3d6ec P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:45.573897 27010 raft_consensus.cc:697] T ed99dec74c4249ad85b7ef69d0c3d6ec P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 2 LEADER]: Becoming Leader. State: Replica: 56539bdd0fcc41a7ae3e12c2f743d6fd, State: Running, Role: LEADER
I20260709 12:15:45.574779 27010 consensus_queue.cc:237] T ed99dec74c4249ad85b7ef69d0c3d6ec P 56539bdd0fcc41a7ae3e12c2f743d6fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:45.583897 26537 catalog_manager.cc:5697] T ed99dec74c4249ad85b7ef69d0c3d6ec P 56539bdd0fcc41a7ae3e12c2f743d6fd reported cstate change: term changed from 1 to 2, leader changed from ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195) to 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193). New cstate: current_term: 2 leader_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:45.594053 26971 raft_consensus.cc:993] T 6368117da5f748b3ae4f1475c4d8decb P ea3ae70a91d24c3e84f03da4605ccede: : Instructing follower 56539bdd0fcc41a7ae3e12c2f743d6fd to start an election
I20260709 12:15:45.594651 26971 raft_consensus.cc:1081] T 6368117da5f748b3ae4f1475c4d8decb P ea3ae70a91d24c3e84f03da4605ccede [term 1 LEADER]: Signalling peer 56539bdd0fcc41a7ae3e12c2f743d6fd to start an election
I20260709 12:15:45.596807 26640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6368117da5f748b3ae4f1475c4d8decb"
dest_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd"
 from {username='slave'} at 127.0.0.1:37438
I20260709 12:15:45.597468 26640 raft_consensus.cc:493] T 6368117da5f748b3ae4f1475c4d8decb P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:45.597872 26640 raft_consensus.cc:3060] T 6368117da5f748b3ae4f1475c4d8decb P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:45.605180 26640 raft_consensus.cc:515] T 6368117da5f748b3ae4f1475c4d8decb P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:45.606926 26640 leader_election.cc:290] T 6368117da5f748b3ae4f1475c4d8decb P 56539bdd0fcc41a7ae3e12c2f743d6fd [CANDIDATE]: Term 2 election: Requested vote from peers 773a9a5eeb14469389297d0f170bae34 (127.12.56.194:37781), ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195:43987)
I20260709 12:15:45.608048 26792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6368117da5f748b3ae4f1475c4d8decb" candidate_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea3ae70a91d24c3e84f03da4605ccede"
I20260709 12:15:45.608111 26716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6368117da5f748b3ae4f1475c4d8decb" candidate_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "773a9a5eeb14469389297d0f170bae34"
I20260709 12:15:45.608682 26792 raft_consensus.cc:3055] T 6368117da5f748b3ae4f1475c4d8decb P ea3ae70a91d24c3e84f03da4605ccede [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:45.608984 26716 raft_consensus.cc:3060] T 6368117da5f748b3ae4f1475c4d8decb P 773a9a5eeb14469389297d0f170bae34 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:45.609054 26792 raft_consensus.cc:740] T 6368117da5f748b3ae4f1475c4d8decb P ea3ae70a91d24c3e84f03da4605ccede [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea3ae70a91d24c3e84f03da4605ccede, State: Running, Role: LEADER
I20260709 12:15:45.610342 26792 consensus_queue.cc:260] T 6368117da5f748b3ae4f1475c4d8decb P ea3ae70a91d24c3e84f03da4605ccede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:45.611332 26792 raft_consensus.cc:3060] T 6368117da5f748b3ae4f1475c4d8decb P ea3ae70a91d24c3e84f03da4605ccede [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:45.616636 26792 raft_consensus.cc:2468] T 6368117da5f748b3ae4f1475c4d8decb P ea3ae70a91d24c3e84f03da4605ccede [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56539bdd0fcc41a7ae3e12c2f743d6fd in term 2.
I20260709 12:15:45.617727 26607 leader_election.cc:304] T 6368117da5f748b3ae4f1475c4d8decb P 56539bdd0fcc41a7ae3e12c2f743d6fd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56539bdd0fcc41a7ae3e12c2f743d6fd, ea3ae70a91d24c3e84f03da4605ccede; no voters: 
I20260709 12:15:45.618558 27010 raft_consensus.cc:2804] T 6368117da5f748b3ae4f1475c4d8decb P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:45.619038 27010 raft_consensus.cc:697] T 6368117da5f748b3ae4f1475c4d8decb P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 2 LEADER]: Becoming Leader. State: Replica: 56539bdd0fcc41a7ae3e12c2f743d6fd, State: Running, Role: LEADER
I20260709 12:15:45.619887 27010 consensus_queue.cc:237] T 6368117da5f748b3ae4f1475c4d8decb P 56539bdd0fcc41a7ae3e12c2f743d6fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:45.621531 26716 raft_consensus.cc:2468] T 6368117da5f748b3ae4f1475c4d8decb P 773a9a5eeb14469389297d0f170bae34 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56539bdd0fcc41a7ae3e12c2f743d6fd in term 2.
I20260709 12:15:45.630664 26537 catalog_manager.cc:5697] T 6368117da5f748b3ae4f1475c4d8decb P 56539bdd0fcc41a7ae3e12c2f743d6fd reported cstate change: term changed from 1 to 2, leader changed from ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195) to 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193). New cstate: current_term: 2 leader_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:45.783947 26640 raft_consensus.cc:1275] T 64c363fad70c4e89bf03bf59e7252fac P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 2 FOLLOWER]: Refusing update from remote peer 773a9a5eeb14469389297d0f170bae34: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:45.785673 27014 consensus_queue.cc:1048] T 64c363fad70c4e89bf03bf59e7252fac P 773a9a5eeb14469389297d0f170bae34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:45.786908 26792 raft_consensus.cc:1275] T 64c363fad70c4e89bf03bf59e7252fac P ea3ae70a91d24c3e84f03da4605ccede [term 2 FOLLOWER]: Refusing update from remote peer 773a9a5eeb14469389297d0f170bae34: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:45.788552 27014 consensus_queue.cc:1048] T 64c363fad70c4e89bf03bf59e7252fac P 773a9a5eeb14469389297d0f170bae34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:45.850468 26792 raft_consensus.cc:1275] T 6673c39fbed4452aa38ceee09bda8cc6 P ea3ae70a91d24c3e84f03da4605ccede [term 2 FOLLOWER]: Refusing update from remote peer 56539bdd0fcc41a7ae3e12c2f743d6fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:45.852429 27010 consensus_queue.cc:1048] T 6673c39fbed4452aa38ceee09bda8cc6 P 56539bdd0fcc41a7ae3e12c2f743d6fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:45.869192 26716 raft_consensus.cc:1275] T 6673c39fbed4452aa38ceee09bda8cc6 P 773a9a5eeb14469389297d0f170bae34 [term 2 FOLLOWER]: Refusing update from remote peer 56539bdd0fcc41a7ae3e12c2f743d6fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:45.872208 27021 consensus_queue.cc:1048] T 6673c39fbed4452aa38ceee09bda8cc6 P 56539bdd0fcc41a7ae3e12c2f743d6fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:45.935146 26642 raft_consensus.cc:1275] T b9898596353d46eab5ff567f15224907 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 2 FOLLOWER]: Refusing update from remote peer 773a9a5eeb14469389297d0f170bae34: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:45.936902 27013 consensus_queue.cc:1048] T b9898596353d46eab5ff567f15224907 P 773a9a5eeb14469389297d0f170bae34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:45.940155 26716 raft_consensus.cc:1275] T 7a40c4830672494f94383cccd2bcb2b7 P 773a9a5eeb14469389297d0f170bae34 [term 2 FOLLOWER]: Refusing update from remote peer 56539bdd0fcc41a7ae3e12c2f743d6fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:45.942181 27010 consensus_queue.cc:1048] T 7a40c4830672494f94383cccd2bcb2b7 P 56539bdd0fcc41a7ae3e12c2f743d6fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:45.956642 26792 raft_consensus.cc:1275] T b9898596353d46eab5ff567f15224907 P ea3ae70a91d24c3e84f03da4605ccede [term 2 FOLLOWER]: Refusing update from remote peer 773a9a5eeb14469389297d0f170bae34: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:45.956727 26790 raft_consensus.cc:1275] T 7a40c4830672494f94383cccd2bcb2b7 P ea3ae70a91d24c3e84f03da4605ccede [term 2 FOLLOWER]: Refusing update from remote peer 56539bdd0fcc41a7ae3e12c2f743d6fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:45.965037 26927 consensus_queue.cc:1048] T b9898596353d46eab5ff567f15224907 P 773a9a5eeb14469389297d0f170bae34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:45.965385 26952 consensus_queue.cc:1048] T 7a40c4830672494f94383cccd2bcb2b7 P 56539bdd0fcc41a7ae3e12c2f743d6fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:46.079118 26716 raft_consensus.cc:1275] T ed99dec74c4249ad85b7ef69d0c3d6ec P 773a9a5eeb14469389297d0f170bae34 [term 2 FOLLOWER]: Refusing update from remote peer 56539bdd0fcc41a7ae3e12c2f743d6fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:46.080859 26952 consensus_queue.cc:1048] T ed99dec74c4249ad85b7ef69d0c3d6ec P 56539bdd0fcc41a7ae3e12c2f743d6fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:46.102252 26790 raft_consensus.cc:1275] T ed99dec74c4249ad85b7ef69d0c3d6ec P ea3ae70a91d24c3e84f03da4605ccede [term 2 FOLLOWER]: Refusing update from remote peer 56539bdd0fcc41a7ae3e12c2f743d6fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:46.103122 26716 raft_consensus.cc:1275] T 6368117da5f748b3ae4f1475c4d8decb P 773a9a5eeb14469389297d0f170bae34 [term 2 FOLLOWER]: Refusing update from remote peer 56539bdd0fcc41a7ae3e12c2f743d6fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:46.105588 27021 consensus_queue.cc:1048] T 6368117da5f748b3ae4f1475c4d8decb P 56539bdd0fcc41a7ae3e12c2f743d6fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:46.105643 26952 consensus_queue.cc:1048] T ed99dec74c4249ad85b7ef69d0c3d6ec P 56539bdd0fcc41a7ae3e12c2f743d6fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:46.120955 26792 raft_consensus.cc:1275] T 6368117da5f748b3ae4f1475c4d8decb P ea3ae70a91d24c3e84f03da4605ccede [term 2 FOLLOWER]: Refusing update from remote peer 56539bdd0fcc41a7ae3e12c2f743d6fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:46.123178 27010 consensus_queue.cc:1048] T 6368117da5f748b3ae4f1475c4d8decb P 56539bdd0fcc41a7ae3e12c2f743d6fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:48.171154 26541 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:54656:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:15:48.191932 26541 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:54656:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:15:48.232353 12515 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:15:48.469575 26643 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6368117da5f748b3ae4f1475c4d8decb"
dest_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd"
mode: GRACEFUL
new_leader_uuid: "ea3ae70a91d24c3e84f03da4605ccede"
 from {username='slave'} at 127.0.0.1:37454
I20260709 12:15:48.487401 26643 raft_consensus.cc:606] T 6368117da5f748b3ae4f1475c4d8decb P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 2 LEADER]: Received request to transfer leadership to TS ea3ae70a91d24c3e84f03da4605ccede
I20260709 12:15:48.448796 27067 tablet.cc:1724] T eceb0db47a1d432e9cbe22991da985f4 P 773a9a5eeb14469389297d0f170bae34: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:48.559567 27086 tablet.cc:1724] T 64c363fad70c4e89bf03bf59e7252fac P 773a9a5eeb14469389297d0f170bae34: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:48.571791 27084 tablet.cc:1724] T 64c363fad70c4e89bf03bf59e7252fac P 56539bdd0fcc41a7ae3e12c2f743d6fd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:48.532598 27073 tablet.cc:1724] T 6368117da5f748b3ae4f1475c4d8decb P 56539bdd0fcc41a7ae3e12c2f743d6fd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:48.554262 27079 tablet.cc:1724] T eceb0db47a1d432e9cbe22991da985f4 P 56539bdd0fcc41a7ae3e12c2f743d6fd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:48.566066 27085 tablet.cc:1724] T b9898596353d46eab5ff567f15224907 P ea3ae70a91d24c3e84f03da4605ccede: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:48.622617 27092 tablet.cc:1724] T b9898596353d46eab5ff567f15224907 P 773a9a5eeb14469389297d0f170bae34: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:15:48.691716 26744 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:64c363fad70c4e89bf03bf59e7252fac)
I20260709 12:15:48.669060 27084 tablet.cc:1724] T ed99dec74c4249ad85b7ef69d0c3d6ec P 56539bdd0fcc41a7ae3e12c2f743d6fd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:15:48.702109 26744 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:64c363fad70c4e89bf03bf59e7252fac)
I20260709 12:15:48.664641 27088 tablet.cc:1724] T eceb0db47a1d432e9cbe22991da985f4 P ea3ae70a91d24c3e84f03da4605ccede: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:48.706877 27100 tablet.cc:1724] T b213246febae4173bc0e67e7ccc15257 P ea3ae70a91d24c3e84f03da4605ccede: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:48.666675 27091 tablet.cc:1724] T b213246febae4173bc0e67e7ccc15257 P 773a9a5eeb14469389297d0f170bae34: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:48.716097 27098 tablet.cc:1724] T 7a40c4830672494f94383cccd2bcb2b7 P ea3ae70a91d24c3e84f03da4605ccede: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:15:48.711289 26744 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:64c363fad70c4e89bf03bf59e7252fac)
I20260709 12:15:48.725499 27063 raft_consensus.cc:993] T 6368117da5f748b3ae4f1475c4d8decb P 56539bdd0fcc41a7ae3e12c2f743d6fd: : Instructing follower ea3ae70a91d24c3e84f03da4605ccede to start an election
I20260709 12:15:48.726486 27096 raft_consensus.cc:1081] T 6368117da5f748b3ae4f1475c4d8decb P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 2 LEADER]: Signalling peer ea3ae70a91d24c3e84f03da4605ccede to start an election
I20260709 12:15:48.736429 26786 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6368117da5f748b3ae4f1475c4d8decb"
dest_uuid: "ea3ae70a91d24c3e84f03da4605ccede"
 from {username='slave'} at 127.0.0.1:45720
I20260709 12:15:48.737268 26786 raft_consensus.cc:493] T 6368117da5f748b3ae4f1475c4d8decb P ea3ae70a91d24c3e84f03da4605ccede [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:48.737850 26786 raft_consensus.cc:3060] T 6368117da5f748b3ae4f1475c4d8decb P ea3ae70a91d24c3e84f03da4605ccede [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:48.763634 27091 tablet.cc:1724] T 6368117da5f748b3ae4f1475c4d8decb P 773a9a5eeb14469389297d0f170bae34: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:48.776014 27097 tablet.cc:1724] T 7a40c4830672494f94383cccd2bcb2b7 P 56539bdd0fcc41a7ae3e12c2f743d6fd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:15:48.776468 27094 log.cc:927] Time spent T ed99dec74c4249ad85b7ef69d0c3d6ec P ea3ae70a91d24c3e84f03da4605ccede: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:15:48.779364 27088 tablet.cc:1724] T 64c363fad70c4e89bf03bf59e7252fac P ea3ae70a91d24c3e84f03da4605ccede: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:48.791134 27092 tablet.cc:1724] T 7a40c4830672494f94383cccd2bcb2b7 P 773a9a5eeb14469389297d0f170bae34: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:48.781188 27067 tablet.cc:1724] T ed99dec74c4249ad85b7ef69d0c3d6ec P 773a9a5eeb14469389297d0f170bae34: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:48.785729 27100 tablet.cc:1724] T 6673c39fbed4452aa38ceee09bda8cc6 P ea3ae70a91d24c3e84f03da4605ccede: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:48.785737 27073 tablet.cc:1724] T b213246febae4173bc0e67e7ccc15257 P 56539bdd0fcc41a7ae3e12c2f743d6fd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:48.774681 27084 tablet.cc:1724] T 6673c39fbed4452aa38ceee09bda8cc6 P 56539bdd0fcc41a7ae3e12c2f743d6fd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:48.787917 27085 tablet.cc:1724] T 6368117da5f748b3ae4f1475c4d8decb P ea3ae70a91d24c3e84f03da4605ccede: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:48.839108 27098 tablet.cc:1724] T ed99dec74c4249ad85b7ef69d0c3d6ec P ea3ae70a91d24c3e84f03da4605ccede: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:48.843465 26541 catalog_manager.cc:5789] TS 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813) does not have the latest schema for tablet 6673c39fbed4452aa38ceee09bda8cc6 (table soft_deleted_table [id=ea541b678c52457e8ea7a4b9be8839b3]). Expected version 1 got 0
I20260709 12:15:48.846055 27079 tablet.cc:1724] T eb394e0c07444d0a96763f25ac9394e9 P 56539bdd0fcc41a7ae3e12c2f743d6fd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:48.851398 27092 tablet.cc:1724] T 6673c39fbed4452aa38ceee09bda8cc6 P 773a9a5eeb14469389297d0f170bae34: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:48.865900 27100 tablet.cc:1724] T eb394e0c07444d0a96763f25ac9394e9 P ea3ae70a91d24c3e84f03da4605ccede: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:48.874336 27086 tablet.cc:1724] T eb394e0c07444d0a96763f25ac9394e9 P 773a9a5eeb14469389297d0f170bae34: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:48.885236 26786 raft_consensus.cc:515] T 6368117da5f748b3ae4f1475c4d8decb P ea3ae70a91d24c3e84f03da4605ccede [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:48.887666 26714 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9898596353d46eab5ff567f15224907"
dest_uuid: "773a9a5eeb14469389297d0f170bae34"
mode: GRACEFUL
new_leader_uuid: "ea3ae70a91d24c3e84f03da4605ccede"
 from {username='slave'} at 127.0.0.1:41952
I20260709 12:15:48.894562 26714 raft_consensus.cc:606] T b9898596353d46eab5ff567f15224907 P 773a9a5eeb14469389297d0f170bae34 [term 2 LEADER]: Received request to transfer leadership to TS ea3ae70a91d24c3e84f03da4605ccede
I20260709 12:15:48.897938 12515 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 12:15:48.898797 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:48.911507 26643 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f02103b62ff4603865811bcb4278c95"
dest_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd"
mode: GRACEFUL
new_leader_uuid: "ea3ae70a91d24c3e84f03da4605ccede"
 from {username='slave'} at 127.0.0.1:37454
I20260709 12:15:48.912235 26643 raft_consensus.cc:606] T 1f02103b62ff4603865811bcb4278c95 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 LEADER]: Received request to transfer leadership to TS ea3ae70a91d24c3e84f03da4605ccede
I20260709 12:15:48.880571 27073 tablet.cc:1724] T b9898596353d46eab5ff567f15224907 P 56539bdd0fcc41a7ae3e12c2f743d6fd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:48.921023 26786 leader_election.cc:290] T 6368117da5f748b3ae4f1475c4d8decb P ea3ae70a91d24c3e84f03da4605ccede [CANDIDATE]: Term 3 election: Requested vote from peers 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813), 773a9a5eeb14469389297d0f170bae34 (127.12.56.194:37781)
I20260709 12:15:48.921906 26643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6368117da5f748b3ae4f1475c4d8decb" candidate_uuid: "ea3ae70a91d24c3e84f03da4605ccede" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd"
I20260709 12:15:48.922273 26714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6368117da5f748b3ae4f1475c4d8decb" candidate_uuid: "ea3ae70a91d24c3e84f03da4605ccede" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "773a9a5eeb14469389297d0f170bae34"
I20260709 12:15:48.922711 26643 raft_consensus.cc:3055] T 6368117da5f748b3ae4f1475c4d8decb P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:48.922982 26714 raft_consensus.cc:3060] T 6368117da5f748b3ae4f1475c4d8decb P 773a9a5eeb14469389297d0f170bae34 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:48.923127 26643 raft_consensus.cc:740] T 6368117da5f748b3ae4f1475c4d8decb P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 56539bdd0fcc41a7ae3e12c2f743d6fd, State: Running, Role: LEADER
I20260709 12:15:48.926630 26643 consensus_queue.cc:260] T 6368117da5f748b3ae4f1475c4d8decb P 56539bdd0fcc41a7ae3e12c2f743d6fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:48.928097 26643 raft_consensus.cc:3060] T 6368117da5f748b3ae4f1475c4d8decb P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:48.932617 26717 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "61ff419b6fbe4f9e91c20f9347dd8c63"
dest_uuid: "773a9a5eeb14469389297d0f170bae34"
mode: GRACEFUL
new_leader_uuid: "ea3ae70a91d24c3e84f03da4605ccede"
 from {username='slave'} at 127.0.0.1:41952
I20260709 12:15:48.933447 26717 raft_consensus.cc:606] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 773a9a5eeb14469389297d0f170bae34 [term 2 LEADER]: Received request to transfer leadership to TS ea3ae70a91d24c3e84f03da4605ccede
I20260709 12:15:48.935278 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:15:48.935966 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:48.937625 26643 raft_consensus.cc:2468] T 6368117da5f748b3ae4f1475c4d8decb P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3ae70a91d24c3e84f03da4605ccede in term 3.
I20260709 12:15:48.938110 26714 raft_consensus.cc:2468] T 6368117da5f748b3ae4f1475c4d8decb P 773a9a5eeb14469389297d0f170bae34 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3ae70a91d24c3e84f03da4605ccede in term 3.
I20260709 12:15:48.939540 26755 leader_election.cc:304] T 6368117da5f748b3ae4f1475c4d8decb P ea3ae70a91d24c3e84f03da4605ccede [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56539bdd0fcc41a7ae3e12c2f743d6fd, ea3ae70a91d24c3e84f03da4605ccede; no voters: 
I20260709 12:15:48.940548 26971 raft_consensus.cc:2804] T 6368117da5f748b3ae4f1475c4d8decb P ea3ae70a91d24c3e84f03da4605ccede [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:48.941150 26971 raft_consensus.cc:697] T 6368117da5f748b3ae4f1475c4d8decb P ea3ae70a91d24c3e84f03da4605ccede [term 3 LEADER]: Becoming Leader. State: Replica: ea3ae70a91d24c3e84f03da4605ccede, State: Running, Role: LEADER
I20260709 12:15:48.942428 26541 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 301b955f7d364862a86a4f99fedaf408: soft_deleted_table [id=ea541b678c52457e8ea7a4b9be8839b3] alter complete (version 1)
I20260709 12:15:48.942153 26971 consensus_queue.cc:237] T 6368117da5f748b3ae4f1475c4d8decb P ea3ae70a91d24c3e84f03da4605ccede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:48.951279 27014 raft_consensus.cc:993] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 773a9a5eeb14469389297d0f170bae34: : Instructing follower ea3ae70a91d24c3e84f03da4605ccede to start an election
I20260709 12:15:48.951851 27014 raft_consensus.cc:1081] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 773a9a5eeb14469389297d0f170bae34 [term 2 LEADER]: Signalling peer ea3ae70a91d24c3e84f03da4605ccede to start an election
I20260709 12:15:48.954293 26786 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "61ff419b6fbe4f9e91c20f9347dd8c63"
dest_uuid: "ea3ae70a91d24c3e84f03da4605ccede"
 from {username='slave'} at 127.0.0.1:45732
I20260709 12:15:48.954953 26786 raft_consensus.cc:493] T 61ff419b6fbe4f9e91c20f9347dd8c63 P ea3ae70a91d24c3e84f03da4605ccede [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:48.955331 26786 raft_consensus.cc:3060] T 61ff419b6fbe4f9e91c20f9347dd8c63 P ea3ae70a91d24c3e84f03da4605ccede [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:48.965396 26786 raft_consensus.cc:515] T 61ff419b6fbe4f9e91c20f9347dd8c63 P ea3ae70a91d24c3e84f03da4605ccede [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:48.965395 26541 catalog_manager.cc:5697] T 6368117da5f748b3ae4f1475c4d8decb P ea3ae70a91d24c3e84f03da4605ccede reported cstate change: term changed from 2 to 3, leader changed from 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193) to ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195). New cstate: current_term: 3 leader_uuid: "ea3ae70a91d24c3e84f03da4605ccede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:48.968760 26786 leader_election.cc:290] T 61ff419b6fbe4f9e91c20f9347dd8c63 P ea3ae70a91d24c3e84f03da4605ccede [CANDIDATE]: Term 3 election: Requested vote from peers 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813), 773a9a5eeb14469389297d0f170bae34 (127.12.56.194:37781)
I20260709 12:15:48.969044 26643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ff419b6fbe4f9e91c20f9347dd8c63" candidate_uuid: "ea3ae70a91d24c3e84f03da4605ccede" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd"
I20260709 12:15:48.969431 26714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ff419b6fbe4f9e91c20f9347dd8c63" candidate_uuid: "ea3ae70a91d24c3e84f03da4605ccede" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "773a9a5eeb14469389297d0f170bae34"
I20260709 12:15:48.969842 26643 raft_consensus.cc:3060] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:48.970163 26714 raft_consensus.cc:3055] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 773a9a5eeb14469389297d0f170bae34 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:48.970804 26714 raft_consensus.cc:740] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 773a9a5eeb14469389297d0f170bae34 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 773a9a5eeb14469389297d0f170bae34, State: Running, Role: LEADER
I20260709 12:15:48.971902 26714 consensus_queue.cc:260] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 773a9a5eeb14469389297d0f170bae34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:48.973352 26714 raft_consensus.cc:3060] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 773a9a5eeb14469389297d0f170bae34 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:48.979807 26643 raft_consensus.cc:2468] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3ae70a91d24c3e84f03da4605ccede in term 3.
I20260709 12:15:48.982555 26755 leader_election.cc:304] T 61ff419b6fbe4f9e91c20f9347dd8c63 P ea3ae70a91d24c3e84f03da4605ccede [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56539bdd0fcc41a7ae3e12c2f743d6fd, ea3ae70a91d24c3e84f03da4605ccede; no voters: 
I20260709 12:15:48.983384 26971 raft_consensus.cc:2804] T 61ff419b6fbe4f9e91c20f9347dd8c63 P ea3ae70a91d24c3e84f03da4605ccede [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:48.983944 26971 raft_consensus.cc:697] T 61ff419b6fbe4f9e91c20f9347dd8c63 P ea3ae70a91d24c3e84f03da4605ccede [term 3 LEADER]: Becoming Leader. State: Replica: ea3ae70a91d24c3e84f03da4605ccede, State: Running, Role: LEADER
I20260709 12:15:48.984963 26971 consensus_queue.cc:237] T 61ff419b6fbe4f9e91c20f9347dd8c63 P ea3ae70a91d24c3e84f03da4605ccede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:48.983852 26714 raft_consensus.cc:2468] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 773a9a5eeb14469389297d0f170bae34 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3ae70a91d24c3e84f03da4605ccede in term 3.
I20260709 12:15:48.995253 26541 catalog_manager.cc:5697] T 61ff419b6fbe4f9e91c20f9347dd8c63 P ea3ae70a91d24c3e84f03da4605ccede reported cstate change: term changed from 2 to 3, leader changed from 773a9a5eeb14469389297d0f170bae34 (127.12.56.194) to ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195). New cstate: current_term: 3 leader_uuid: "ea3ae70a91d24c3e84f03da4605ccede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:49.035405 27103 raft_consensus.cc:993] T b9898596353d46eab5ff567f15224907 P 773a9a5eeb14469389297d0f170bae34: : Instructing follower ea3ae70a91d24c3e84f03da4605ccede to start an election
I20260709 12:15:49.036126 27028 raft_consensus.cc:1081] T b9898596353d46eab5ff567f15224907 P 773a9a5eeb14469389297d0f170bae34 [term 2 LEADER]: Signalling peer ea3ae70a91d24c3e84f03da4605ccede to start an election
I20260709 12:15:49.037724 26786 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b9898596353d46eab5ff567f15224907"
dest_uuid: "ea3ae70a91d24c3e84f03da4605ccede"
 from {username='slave'} at 127.0.0.1:45732
I20260709 12:15:49.038337 26786 raft_consensus.cc:493] T b9898596353d46eab5ff567f15224907 P ea3ae70a91d24c3e84f03da4605ccede [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:49.038664 26786 raft_consensus.cc:3060] T b9898596353d46eab5ff567f15224907 P ea3ae70a91d24c3e84f03da4605ccede [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:49.044289 26786 raft_consensus.cc:515] T b9898596353d46eab5ff567f15224907 P ea3ae70a91d24c3e84f03da4605ccede [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:49.046170 26786 leader_election.cc:290] T b9898596353d46eab5ff567f15224907 P ea3ae70a91d24c3e84f03da4605ccede [CANDIDATE]: Term 3 election: Requested vote from peers 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813), 773a9a5eeb14469389297d0f170bae34 (127.12.56.194:37781)
I20260709 12:15:49.047163 26643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9898596353d46eab5ff567f15224907" candidate_uuid: "ea3ae70a91d24c3e84f03da4605ccede" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd"
I20260709 12:15:49.047439 26714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9898596353d46eab5ff567f15224907" candidate_uuid: "ea3ae70a91d24c3e84f03da4605ccede" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "773a9a5eeb14469389297d0f170bae34"
I20260709 12:15:49.048014 26643 raft_consensus.cc:3060] T b9898596353d46eab5ff567f15224907 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:49.048064 26714 raft_consensus.cc:3055] T b9898596353d46eab5ff567f15224907 P 773a9a5eeb14469389297d0f170bae34 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:49.048584 26714 raft_consensus.cc:740] T b9898596353d46eab5ff567f15224907 P 773a9a5eeb14469389297d0f170bae34 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 773a9a5eeb14469389297d0f170bae34, State: Running, Role: LEADER
I20260709 12:15:49.049631 26714 consensus_queue.cc:260] T b9898596353d46eab5ff567f15224907 P 773a9a5eeb14469389297d0f170bae34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:49.051167 26714 raft_consensus.cc:3060] T b9898596353d46eab5ff567f15224907 P 773a9a5eeb14469389297d0f170bae34 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:49.056977 26643 raft_consensus.cc:2468] T b9898596353d46eab5ff567f15224907 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3ae70a91d24c3e84f03da4605ccede in term 3.
I20260709 12:15:49.058414 26755 leader_election.cc:304] T b9898596353d46eab5ff567f15224907 P ea3ae70a91d24c3e84f03da4605ccede [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56539bdd0fcc41a7ae3e12c2f743d6fd, ea3ae70a91d24c3e84f03da4605ccede; no voters: 
I20260709 12:15:49.059440 26971 raft_consensus.cc:2804] T b9898596353d46eab5ff567f15224907 P ea3ae70a91d24c3e84f03da4605ccede [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:49.060019 26714 raft_consensus.cc:2468] T b9898596353d46eab5ff567f15224907 P 773a9a5eeb14469389297d0f170bae34 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3ae70a91d24c3e84f03da4605ccede in term 3.
I20260709 12:15:49.060113 26971 raft_consensus.cc:697] T b9898596353d46eab5ff567f15224907 P ea3ae70a91d24c3e84f03da4605ccede [term 3 LEADER]: Becoming Leader. State: Replica: ea3ae70a91d24c3e84f03da4605ccede, State: Running, Role: LEADER
I20260709 12:15:49.061254 26971 consensus_queue.cc:237] T b9898596353d46eab5ff567f15224907 P ea3ae70a91d24c3e84f03da4605ccede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } }
I20260709 12:15:49.069201 26541 catalog_manager.cc:5697] T b9898596353d46eab5ff567f15224907 P ea3ae70a91d24c3e84f03da4605ccede reported cstate change: term changed from 2 to 3, leader changed from 773a9a5eeb14469389297d0f170bae34 (127.12.56.194) to ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195). New cstate: current_term: 3 leader_uuid: "ea3ae70a91d24c3e84f03da4605ccede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:49.332301 26714 raft_consensus.cc:1275] T 6368117da5f748b3ae4f1475c4d8decb P 773a9a5eeb14469389297d0f170bae34 [term 3 FOLLOWER]: Refusing update from remote peer ea3ae70a91d24c3e84f03da4605ccede: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:15:49.333962 26971 consensus_queue.cc:1048] T 6368117da5f748b3ae4f1475c4d8decb P ea3ae70a91d24c3e84f03da4605ccede [LEADER]: Connected to new peer: Peer: permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:15:49.344023 26643 raft_consensus.cc:1275] T 6368117da5f748b3ae4f1475c4d8decb P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 3 FOLLOWER]: Refusing update from remote peer ea3ae70a91d24c3e84f03da4605ccede: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:15:49.345803 27093 consensus_queue.cc:1048] T 6368117da5f748b3ae4f1475c4d8decb P ea3ae70a91d24c3e84f03da4605ccede [LEADER]: Connected to new peer: Peer: permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:15:49.386106 27096 raft_consensus.cc:993] T 1f02103b62ff4603865811bcb4278c95 P 56539bdd0fcc41a7ae3e12c2f743d6fd: : Instructing follower ea3ae70a91d24c3e84f03da4605ccede to start an election
I20260709 12:15:49.386724 27063 raft_consensus.cc:1081] T 1f02103b62ff4603865811bcb4278c95 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 LEADER]: Signalling peer ea3ae70a91d24c3e84f03da4605ccede to start an election
I20260709 12:15:49.388911 26786 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f02103b62ff4603865811bcb4278c95"
dest_uuid: "ea3ae70a91d24c3e84f03da4605ccede"
 from {username='slave'} at 127.0.0.1:45720
I20260709 12:15:49.389500 26786 raft_consensus.cc:493] T 1f02103b62ff4603865811bcb4278c95 P ea3ae70a91d24c3e84f03da4605ccede [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:49.389894 26786 raft_consensus.cc:3060] T 1f02103b62ff4603865811bcb4278c95 P ea3ae70a91d24c3e84f03da4605ccede [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:49.396308 26786 raft_consensus.cc:515] T 1f02103b62ff4603865811bcb4278c95 P ea3ae70a91d24c3e84f03da4605ccede [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } }
I20260709 12:15:49.398548 26786 leader_election.cc:290] T 1f02103b62ff4603865811bcb4278c95 P ea3ae70a91d24c3e84f03da4605ccede [CANDIDATE]: Term 2 election: Requested vote from peers 773a9a5eeb14469389297d0f170bae34 (127.12.56.194:37781), 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813)
I20260709 12:15:49.400179 26643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f02103b62ff4603865811bcb4278c95" candidate_uuid: "ea3ae70a91d24c3e84f03da4605ccede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd"
I20260709 12:15:49.401018 26643 raft_consensus.cc:3055] T 1f02103b62ff4603865811bcb4278c95 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:49.401113 26714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f02103b62ff4603865811bcb4278c95" candidate_uuid: "ea3ae70a91d24c3e84f03da4605ccede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "773a9a5eeb14469389297d0f170bae34"
I20260709 12:15:49.402211 26714 raft_consensus.cc:3060] T 1f02103b62ff4603865811bcb4278c95 P 773a9a5eeb14469389297d0f170bae34 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:49.403836 26717 raft_consensus.cc:1275] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 773a9a5eeb14469389297d0f170bae34 [term 3 FOLLOWER]: Refusing update from remote peer ea3ae70a91d24c3e84f03da4605ccede: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:49.401479 26643 raft_consensus.cc:740] T 1f02103b62ff4603865811bcb4278c95 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56539bdd0fcc41a7ae3e12c2f743d6fd, State: Running, Role: LEADER
I20260709 12:15:49.405562 27093 consensus_queue.cc:1048] T 61ff419b6fbe4f9e91c20f9347dd8c63 P ea3ae70a91d24c3e84f03da4605ccede [LEADER]: Connected to new peer: Peer: permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:49.406091 26643 consensus_queue.cc:260] T 1f02103b62ff4603865811bcb4278c95 P 56539bdd0fcc41a7ae3e12c2f743d6fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } }
I20260709 12:15:49.407814 26643 raft_consensus.cc:3060] T 1f02103b62ff4603865811bcb4278c95 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:49.412603 26714 raft_consensus.cc:2468] T 1f02103b62ff4603865811bcb4278c95 P 773a9a5eeb14469389297d0f170bae34 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3ae70a91d24c3e84f03da4605ccede in term 2.
I20260709 12:15:49.412822 26641 raft_consensus.cc:1275] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 3 FOLLOWER]: Refusing update from remote peer ea3ae70a91d24c3e84f03da4605ccede: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:49.414779 27093 consensus_queue.cc:1048] T 61ff419b6fbe4f9e91c20f9347dd8c63 P ea3ae70a91d24c3e84f03da4605ccede [LEADER]: Connected to new peer: Peer: permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:49.415351 26758 leader_election.cc:304] T 1f02103b62ff4603865811bcb4278c95 P ea3ae70a91d24c3e84f03da4605ccede [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773a9a5eeb14469389297d0f170bae34, ea3ae70a91d24c3e84f03da4605ccede; no voters: 
I20260709 12:15:49.416441 27093 raft_consensus.cc:2804] T 1f02103b62ff4603865811bcb4278c95 P ea3ae70a91d24c3e84f03da4605ccede [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:49.417027 27093 raft_consensus.cc:697] T 1f02103b62ff4603865811bcb4278c95 P ea3ae70a91d24c3e84f03da4605ccede [term 2 LEADER]: Becoming Leader. State: Replica: ea3ae70a91d24c3e84f03da4605ccede, State: Running, Role: LEADER
I20260709 12:15:49.418164 27093 consensus_queue.cc:237] T 1f02103b62ff4603865811bcb4278c95 P ea3ae70a91d24c3e84f03da4605ccede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } } peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } }
I20260709 12:15:49.420409 26643 raft_consensus.cc:2468] T 1f02103b62ff4603865811bcb4278c95 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3ae70a91d24c3e84f03da4605ccede in term 2.
I20260709 12:15:49.433902 26537 catalog_manager.cc:5697] T 1f02103b62ff4603865811bcb4278c95 P ea3ae70a91d24c3e84f03da4605ccede reported cstate change: term changed from 1 to 2, leader changed from 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193) to ea3ae70a91d24c3e84f03da4605ccede (127.12.56.195). New cstate: current_term: 2 leader_uuid: "ea3ae70a91d24c3e84f03da4605ccede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea3ae70a91d24c3e84f03da4605ccede" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 43987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:49.521317 26717 raft_consensus.cc:1275] T b9898596353d46eab5ff567f15224907 P 773a9a5eeb14469389297d0f170bae34 [term 3 FOLLOWER]: Refusing update from remote peer ea3ae70a91d24c3e84f03da4605ccede: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:15:49.522801 26971 consensus_queue.cc:1048] T b9898596353d46eab5ff567f15224907 P ea3ae70a91d24c3e84f03da4605ccede [LEADER]: Connected to new peer: Peer: permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:15:49.532872 26641 raft_consensus.cc:1275] T b9898596353d46eab5ff567f15224907 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 3 FOLLOWER]: Refusing update from remote peer ea3ae70a91d24c3e84f03da4605ccede: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:15:49.534345 26971 consensus_queue.cc:1048] T b9898596353d46eab5ff567f15224907 P ea3ae70a91d24c3e84f03da4605ccede [LEADER]: Connected to new peer: Peer: permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:15:49.843535 26641 raft_consensus.cc:1275] T 1f02103b62ff4603865811bcb4278c95 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 2 FOLLOWER]: Refusing update from remote peer ea3ae70a91d24c3e84f03da4605ccede: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:49.844935 26971 consensus_queue.cc:1048] T 1f02103b62ff4603865811bcb4278c95 P ea3ae70a91d24c3e84f03da4605ccede [LEADER]: Connected to new peer: Peer: permanent_uuid: "56539bdd0fcc41a7ae3e12c2f743d6fd" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 35813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:49.854880 26714 raft_consensus.cc:1275] T 1f02103b62ff4603865811bcb4278c95 P 773a9a5eeb14469389297d0f170bae34 [term 2 FOLLOWER]: Refusing update from remote peer ea3ae70a91d24c3e84f03da4605ccede: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:49.856249 27083 consensus_queue.cc:1048] T 1f02103b62ff4603865811bcb4278c95 P ea3ae70a91d24c3e84f03da4605ccede [LEADER]: Connected to new peer: Peer: permanent_uuid: "773a9a5eeb14469389297d0f170bae34" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 37781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:49.937597 12515 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:15:49.954284 12515 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:15:49.954802 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:49.962774 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:49.963454 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:50.964788 12515 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:15:50.971596 12515 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:15:50.971989 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:50.976716 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:50.977121 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:51.978578 12515 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:15:51.985138 12515 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:15:51.985678 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:51.991626 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:51.992184 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:52.993366 12515 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:15:53.000989 12515 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:15:53.001585 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:53.007807 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:53.008240 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:54.009757 12515 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:15:54.018864 12515 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:15:54.019549 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:54.025102 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:54.025570 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:55.026598 12515 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:15:55.031731 12515 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:15:55.032224 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:55.037240 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:55.037685 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:56.038851 12515 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:15:56.045153 12515 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:15:56.045969 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:56.051647 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:56.052165 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:57.053165 12515 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:15:57.059227 12515 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:15:57.059759 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:57.065157 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:57.065637 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:58.066762 12515 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:15:58.072101 12515 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:15:58.072685 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:58.077644 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:58.078177 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:59.147871 12515 tablet_server.cc:179] TabletServer@127.12.56.193:0 shutting down...
W20260709 12:15:59.150465 26755 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 4 similar messages]
W20260709 12:15:59.155652 26755 consensus_peers.cc:597] T c258759a737e4ce1be24541ae8bb535f P ea3ae70a91d24c3e84f03da4605ccede -> Peer 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813): Couldn't send request to peer 56539bdd0fcc41a7ae3e12c2f743d6fd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:59.194077 12515 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:59.195295 12515 tablet_replica.cc:333] T ed99dec74c4249ad85b7ef69d0c3d6ec P 56539bdd0fcc41a7ae3e12c2f743d6fd: stopping tablet replica
I20260709 12:15:59.196646 12515 raft_consensus.cc:2243] T ed99dec74c4249ad85b7ef69d0c3d6ec P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:59.198467 12515 raft_consensus.cc:2272] T ed99dec74c4249ad85b7ef69d0c3d6ec P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:59.200126 26755 consensus_peers.cc:597] T 1f02103b62ff4603865811bcb4278c95 P ea3ae70a91d24c3e84f03da4605ccede -> Peer 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813): Couldn't send request to peer 56539bdd0fcc41a7ae3e12c2f743d6fd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:59.202378 12515 tablet_replica.cc:333] T b9898596353d46eab5ff567f15224907 P 56539bdd0fcc41a7ae3e12c2f743d6fd: stopping tablet replica
I20260709 12:15:59.203337 12515 raft_consensus.cc:2243] T b9898596353d46eab5ff567f15224907 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:59.204101 12515 raft_consensus.cc:2272] T b9898596353d46eab5ff567f15224907 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:59.206897 12515 tablet_replica.cc:333] T eceb0db47a1d432e9cbe22991da985f4 P 56539bdd0fcc41a7ae3e12c2f743d6fd: stopping tablet replica
I20260709 12:15:59.207566 12515 raft_consensus.cc:2243] T eceb0db47a1d432e9cbe22991da985f4 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:59.208166 12515 raft_consensus.cc:2272] T eceb0db47a1d432e9cbe22991da985f4 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:59.211071 12515 tablet_replica.cc:333] T 7a40c4830672494f94383cccd2bcb2b7 P 56539bdd0fcc41a7ae3e12c2f743d6fd: stopping tablet replica
I20260709 12:15:59.211740 12515 raft_consensus.cc:2243] T 7a40c4830672494f94383cccd2bcb2b7 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:59.212639 12515 raft_consensus.cc:2272] T 7a40c4830672494f94383cccd2bcb2b7 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:59.215570 12515 tablet_replica.cc:333] T eb394e0c07444d0a96763f25ac9394e9 P 56539bdd0fcc41a7ae3e12c2f743d6fd: stopping tablet replica
I20260709 12:15:59.216249 12515 raft_consensus.cc:2243] T eb394e0c07444d0a96763f25ac9394e9 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:59.216851 12515 raft_consensus.cc:2272] T eb394e0c07444d0a96763f25ac9394e9 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:59.219640 12515 tablet_replica.cc:333] T 64c363fad70c4e89bf03bf59e7252fac P 56539bdd0fcc41a7ae3e12c2f743d6fd: stopping tablet replica
I20260709 12:15:59.220355 12515 raft_consensus.cc:2243] T 64c363fad70c4e89bf03bf59e7252fac P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:59.220955 12515 raft_consensus.cc:2272] T 64c363fad70c4e89bf03bf59e7252fac P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:59.224148 12515 tablet_replica.cc:333] T 6673c39fbed4452aa38ceee09bda8cc6 P 56539bdd0fcc41a7ae3e12c2f743d6fd: stopping tablet replica
I20260709 12:15:59.224850 12515 raft_consensus.cc:2243] T 6673c39fbed4452aa38ceee09bda8cc6 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:59.225893 12515 raft_consensus.cc:2272] T 6673c39fbed4452aa38ceee09bda8cc6 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:59.229280 12515 tablet_replica.cc:333] T ce9b9e0175914633833e79c94d7e6a2a P 56539bdd0fcc41a7ae3e12c2f743d6fd: stopping tablet replica
I20260709 12:15:59.230195 12515 raft_consensus.cc:2243] T ce9b9e0175914633833e79c94d7e6a2a P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:59.230888 12515 raft_consensus.cc:2272] T ce9b9e0175914633833e79c94d7e6a2a P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:59.235504 12515 tablet_replica.cc:333] T 6368117da5f748b3ae4f1475c4d8decb P 56539bdd0fcc41a7ae3e12c2f743d6fd: stopping tablet replica
I20260709 12:15:59.236479 12515 raft_consensus.cc:2243] T 6368117da5f748b3ae4f1475c4d8decb P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:59.237893 12515 raft_consensus.cc:2272] T 6368117da5f748b3ae4f1475c4d8decb P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:59.240667 26681 consensus_peers.cc:597] T ce9b9e0175914633833e79c94d7e6a2a P 773a9a5eeb14469389297d0f170bae34 -> Peer 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813): Couldn't send request to peer 56539bdd0fcc41a7ae3e12c2f743d6fd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:59.242645 12515 tablet_replica.cc:333] T c258759a737e4ce1be24541ae8bb535f P 56539bdd0fcc41a7ae3e12c2f743d6fd: stopping tablet replica
W20260709 12:15:59.243211 26681 consensus_peers.cc:597] T 0cad4999d89c491b8698a2023cc6d805 P 773a9a5eeb14469389297d0f170bae34 -> Peer 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813): Couldn't send request to peer 56539bdd0fcc41a7ae3e12c2f743d6fd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:59.243716 12515 raft_consensus.cc:2243] T c258759a737e4ce1be24541ae8bb535f P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:59.244446 12515 raft_consensus.cc:2272] T c258759a737e4ce1be24541ae8bb535f P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:59.247493 12515 tablet_replica.cc:333] T 0cad4999d89c491b8698a2023cc6d805 P 56539bdd0fcc41a7ae3e12c2f743d6fd: stopping tablet replica
I20260709 12:15:59.248229 12515 raft_consensus.cc:2243] T 0cad4999d89c491b8698a2023cc6d805 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:59.248842 12515 raft_consensus.cc:2272] T 0cad4999d89c491b8698a2023cc6d805 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:59.251736 12515 tablet_replica.cc:333] T b213246febae4173bc0e67e7ccc15257 P 56539bdd0fcc41a7ae3e12c2f743d6fd: stopping tablet replica
I20260709 12:15:59.252390 12515 raft_consensus.cc:2243] T b213246febae4173bc0e67e7ccc15257 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:59.252975 12515 raft_consensus.cc:2272] T b213246febae4173bc0e67e7ccc15257 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:59.255851 12515 tablet_replica.cc:333] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 56539bdd0fcc41a7ae3e12c2f743d6fd: stopping tablet replica
I20260709 12:15:59.256780 12515 raft_consensus.cc:2243] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:59.257479 12515 raft_consensus.cc:2272] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:59.260236 12515 tablet_replica.cc:333] T 1f02103b62ff4603865811bcb4278c95 P 56539bdd0fcc41a7ae3e12c2f743d6fd: stopping tablet replica
I20260709 12:15:59.261000 12515 raft_consensus.cc:2243] T 1f02103b62ff4603865811bcb4278c95 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:59.261731 12515 raft_consensus.cc:2272] T 1f02103b62ff4603865811bcb4278c95 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:59.265586 12515 tablet_replica.cc:333] T 6bbb8c707ea042859b5fbe695bab0f44 P 56539bdd0fcc41a7ae3e12c2f743d6fd: stopping tablet replica
I20260709 12:15:59.266358 12515 raft_consensus.cc:2243] T 6bbb8c707ea042859b5fbe695bab0f44 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:59.267379 12515 raft_consensus.cc:2272] T 6bbb8c707ea042859b5fbe695bab0f44 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:59.270112 12515 tablet_replica.cc:333] T d2af60b518a442778196f4cf0c3c918f P 56539bdd0fcc41a7ae3e12c2f743d6fd: stopping tablet replica
I20260709 12:15:59.270759 12515 raft_consensus.cc:2243] T d2af60b518a442778196f4cf0c3c918f P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:59.271315 12515 raft_consensus.cc:2272] T d2af60b518a442778196f4cf0c3c918f P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:59.274134 12515 tablet_replica.cc:333] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 56539bdd0fcc41a7ae3e12c2f743d6fd: stopping tablet replica
I20260709 12:15:59.274744 12515 raft_consensus.cc:2243] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:59.275755 12515 raft_consensus.cc:2272] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:59.278332 12515 tablet_replica.cc:333] T 51053577132f400289d135eb01a55020 P 56539bdd0fcc41a7ae3e12c2f743d6fd: stopping tablet replica
I20260709 12:15:59.278919 12515 raft_consensus.cc:2243] T 51053577132f400289d135eb01a55020 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:59.279904 12515 raft_consensus.cc:2272] T 51053577132f400289d135eb01a55020 P 56539bdd0fcc41a7ae3e12c2f743d6fd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:59.286088 26681 consensus_peers.cc:597] T d2af60b518a442778196f4cf0c3c918f P 773a9a5eeb14469389297d0f170bae34 -> Peer 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813): Couldn't send request to peer 56539bdd0fcc41a7ae3e12c2f743d6fd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:59.336591 12515 tablet_server.cc:196] TabletServer@127.12.56.193:0 shutdown complete.
W20260709 12:15:59.338948 26681 consensus_peers.cc:597] T 64c363fad70c4e89bf03bf59e7252fac P 773a9a5eeb14469389297d0f170bae34 -> Peer 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813): Couldn't send request to peer 56539bdd0fcc41a7ae3e12c2f743d6fd. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:35813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:59.379432 26755 consensus_peers.cc:597] T b9898596353d46eab5ff567f15224907 P ea3ae70a91d24c3e84f03da4605ccede -> Peer 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813): Couldn't send request to peer 56539bdd0fcc41a7ae3e12c2f743d6fd. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:35813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:59.388136 12515 tablet_server.cc:179] TabletServer@127.12.56.194:0 shutting down...
W20260709 12:15:59.406680 26755 consensus_peers.cc:597] T 6368117da5f748b3ae4f1475c4d8decb P ea3ae70a91d24c3e84f03da4605ccede -> Peer 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813): Couldn't send request to peer 56539bdd0fcc41a7ae3e12c2f743d6fd. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:35813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:59.425643 26681 consensus_peers.cc:597] T eceb0db47a1d432e9cbe22991da985f4 P 773a9a5eeb14469389297d0f170bae34 -> Peer 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813): Couldn't send request to peer 56539bdd0fcc41a7ae3e12c2f743d6fd. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:35813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:59.428772 12515 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:59.429648 12515 tablet_replica.cc:333] T 6368117da5f748b3ae4f1475c4d8decb P 773a9a5eeb14469389297d0f170bae34: stopping tablet replica
I20260709 12:15:59.431099 12515 raft_consensus.cc:2243] T 6368117da5f748b3ae4f1475c4d8decb P 773a9a5eeb14469389297d0f170bae34 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:59.431967 12515 raft_consensus.cc:2272] T 6368117da5f748b3ae4f1475c4d8decb P 773a9a5eeb14469389297d0f170bae34 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:59.435007 26758 consensus_peers.cc:597] T 1f02103b62ff4603865811bcb4278c95 P ea3ae70a91d24c3e84f03da4605ccede -> Peer 773a9a5eeb14469389297d0f170bae34 (127.12.56.194:37781): Couldn't send request to peer 773a9a5eeb14469389297d0f170bae34. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:59.435045 12515 tablet_replica.cc:333] T eceb0db47a1d432e9cbe22991da985f4 P 773a9a5eeb14469389297d0f170bae34: stopping tablet replica
I20260709 12:15:59.436019 12515 raft_consensus.cc:2243] T eceb0db47a1d432e9cbe22991da985f4 P 773a9a5eeb14469389297d0f170bae34 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:59.436949 12515 raft_consensus.cc:2272] T eceb0db47a1d432e9cbe22991da985f4 P 773a9a5eeb14469389297d0f170bae34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:59.439356 12515 tablet_replica.cc:333] T 7a40c4830672494f94383cccd2bcb2b7 P 773a9a5eeb14469389297d0f170bae34: stopping tablet replica
I20260709 12:15:59.440078 12515 raft_consensus.cc:2243] T 7a40c4830672494f94383cccd2bcb2b7 P 773a9a5eeb14469389297d0f170bae34 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:59.440632 12515 raft_consensus.cc:2272] T 7a40c4830672494f94383cccd2bcb2b7 P 773a9a5eeb14469389297d0f170bae34 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:59.443163 12515 tablet_replica.cc:333] T 64c363fad70c4e89bf03bf59e7252fac P 773a9a5eeb14469389297d0f170bae34: stopping tablet replica
I20260709 12:15:59.443821 12515 raft_consensus.cc:2243] T 64c363fad70c4e89bf03bf59e7252fac P 773a9a5eeb14469389297d0f170bae34 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:59.444754 12515 raft_consensus.cc:2272] T 64c363fad70c4e89bf03bf59e7252fac P 773a9a5eeb14469389297d0f170bae34 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:59.447252 12515 tablet_replica.cc:333] T 6673c39fbed4452aa38ceee09bda8cc6 P 773a9a5eeb14469389297d0f170bae34: stopping tablet replica
I20260709 12:15:59.447880 12515 raft_consensus.cc:2243] T 6673c39fbed4452aa38ceee09bda8cc6 P 773a9a5eeb14469389297d0f170bae34 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:59.448424 12515 raft_consensus.cc:2272] T 6673c39fbed4452aa38ceee09bda8cc6 P 773a9a5eeb14469389297d0f170bae34 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:59.450788 12515 tablet_replica.cc:333] T eb394e0c07444d0a96763f25ac9394e9 P 773a9a5eeb14469389297d0f170bae34: stopping tablet replica
I20260709 12:15:59.451399 12515 raft_consensus.cc:2243] T eb394e0c07444d0a96763f25ac9394e9 P 773a9a5eeb14469389297d0f170bae34 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:59.451905 12515 raft_consensus.cc:2272] T eb394e0c07444d0a96763f25ac9394e9 P 773a9a5eeb14469389297d0f170bae34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:59.454283 12515 tablet_replica.cc:333] T c258759a737e4ce1be24541ae8bb535f P 773a9a5eeb14469389297d0f170bae34: stopping tablet replica
I20260709 12:15:59.454931 12515 raft_consensus.cc:2243] T c258759a737e4ce1be24541ae8bb535f P 773a9a5eeb14469389297d0f170bae34 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:59.455438 12515 raft_consensus.cc:2272] T c258759a737e4ce1be24541ae8bb535f P 773a9a5eeb14469389297d0f170bae34 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:59.457921 12515 tablet_replica.cc:333] T ce9b9e0175914633833e79c94d7e6a2a P 773a9a5eeb14469389297d0f170bae34: stopping tablet replica
I20260709 12:15:59.458530 12515 raft_consensus.cc:2243] T ce9b9e0175914633833e79c94d7e6a2a P 773a9a5eeb14469389297d0f170bae34 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:59.459606 12515 raft_consensus.cc:2272] T ce9b9e0175914633833e79c94d7e6a2a P 773a9a5eeb14469389297d0f170bae34 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:59.462190 12515 tablet_replica.cc:333] T ed99dec74c4249ad85b7ef69d0c3d6ec P 773a9a5eeb14469389297d0f170bae34: stopping tablet replica
I20260709 12:15:59.462769 12515 raft_consensus.cc:2243] T ed99dec74c4249ad85b7ef69d0c3d6ec P 773a9a5eeb14469389297d0f170bae34 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:59.463280 12515 raft_consensus.cc:2272] T ed99dec74c4249ad85b7ef69d0c3d6ec P 773a9a5eeb14469389297d0f170bae34 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:59.465533 12515 tablet_replica.cc:333] T 0cad4999d89c491b8698a2023cc6d805 P 773a9a5eeb14469389297d0f170bae34: stopping tablet replica
I20260709 12:15:59.466161 12515 raft_consensus.cc:2243] T 0cad4999d89c491b8698a2023cc6d805 P 773a9a5eeb14469389297d0f170bae34 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:59.467133 12515 raft_consensus.cc:2272] T 0cad4999d89c491b8698a2023cc6d805 P 773a9a5eeb14469389297d0f170bae34 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:59.469564 12515 tablet_replica.cc:333] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 773a9a5eeb14469389297d0f170bae34: stopping tablet replica
I20260709 12:15:59.470149 12515 raft_consensus.cc:2243] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 773a9a5eeb14469389297d0f170bae34 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:59.470705 12515 raft_consensus.cc:2272] T a21937cb47f14ac0b40ea7c7c6e9cab9 P 773a9a5eeb14469389297d0f170bae34 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:59.474109 12515 tablet_replica.cc:333] T 51053577132f400289d135eb01a55020 P 773a9a5eeb14469389297d0f170bae34: stopping tablet replica
I20260709 12:15:59.475253 12515 raft_consensus.cc:2243] T 51053577132f400289d135eb01a55020 P 773a9a5eeb14469389297d0f170bae34 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:15:59.475277 26758 consensus_peers.cc:597] T c258759a737e4ce1be24541ae8bb535f P ea3ae70a91d24c3e84f03da4605ccede -> Peer 773a9a5eeb14469389297d0f170bae34 (127.12.56.194:37781): Couldn't send request to peer 773a9a5eeb14469389297d0f170bae34. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:59.476102 12515 raft_consensus.cc:2272] T 51053577132f400289d135eb01a55020 P 773a9a5eeb14469389297d0f170bae34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:59.479907 12515 tablet_replica.cc:333] T b9898596353d46eab5ff567f15224907 P 773a9a5eeb14469389297d0f170bae34: stopping tablet replica
W20260709 12:15:59.480196 26681 consensus_peers.cc:597] T b213246febae4173bc0e67e7ccc15257 P 773a9a5eeb14469389297d0f170bae34 -> Peer 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813): Couldn't send request to peer 56539bdd0fcc41a7ae3e12c2f743d6fd. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:35813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:59.480702 12515 raft_consensus.cc:2243] T b9898596353d46eab5ff567f15224907 P 773a9a5eeb14469389297d0f170bae34 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:59.481320 12515 raft_consensus.cc:2272] T b9898596353d46eab5ff567f15224907 P 773a9a5eeb14469389297d0f170bae34 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:59.483916 12515 tablet_replica.cc:333] T 6bbb8c707ea042859b5fbe695bab0f44 P 773a9a5eeb14469389297d0f170bae34: stopping tablet replica
I20260709 12:15:59.484565 12515 raft_consensus.cc:2243] T 6bbb8c707ea042859b5fbe695bab0f44 P 773a9a5eeb14469389297d0f170bae34 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:59.485101 12515 raft_consensus.cc:2272] T 6bbb8c707ea042859b5fbe695bab0f44 P 773a9a5eeb14469389297d0f170bae34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:59.487684 12515 tablet_replica.cc:333] T d2af60b518a442778196f4cf0c3c918f P 773a9a5eeb14469389297d0f170bae34: stopping tablet replica
I20260709 12:15:59.488353 12515 raft_consensus.cc:2243] T d2af60b518a442778196f4cf0c3c918f P 773a9a5eeb14469389297d0f170bae34 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:59.489283 12515 raft_consensus.cc:2272] T d2af60b518a442778196f4cf0c3c918f P 773a9a5eeb14469389297d0f170bae34 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:59.492040 12515 tablet_replica.cc:333] T b213246febae4173bc0e67e7ccc15257 P 773a9a5eeb14469389297d0f170bae34: stopping tablet replica
I20260709 12:15:59.492722 12515 raft_consensus.cc:2243] T b213246febae4173bc0e67e7ccc15257 P 773a9a5eeb14469389297d0f170bae34 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:59.493942 12515 raft_consensus.cc:2272] T b213246febae4173bc0e67e7ccc15257 P 773a9a5eeb14469389297d0f170bae34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:59.496507 12515 tablet_replica.cc:333] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 773a9a5eeb14469389297d0f170bae34: stopping tablet replica
I20260709 12:15:59.497119 12515 raft_consensus.cc:2243] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 773a9a5eeb14469389297d0f170bae34 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:59.497669 12515 raft_consensus.cc:2272] T 61ff419b6fbe4f9e91c20f9347dd8c63 P 773a9a5eeb14469389297d0f170bae34 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:59.500151 12515 tablet_replica.cc:333] T 1f02103b62ff4603865811bcb4278c95 P 773a9a5eeb14469389297d0f170bae34: stopping tablet replica
I20260709 12:15:59.500761 12515 raft_consensus.cc:2243] T 1f02103b62ff4603865811bcb4278c95 P 773a9a5eeb14469389297d0f170bae34 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:59.501334 12515 raft_consensus.cc:2272] T 1f02103b62ff4603865811bcb4278c95 P 773a9a5eeb14469389297d0f170bae34 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:59.521981 26758 consensus_peers.cc:597] T 61ff419b6fbe4f9e91c20f9347dd8c63 P ea3ae70a91d24c3e84f03da4605ccede -> Peer 773a9a5eeb14469389297d0f170bae34 (127.12.56.194:37781): Couldn't send request to peer 773a9a5eeb14469389297d0f170bae34. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:59.552251 12515 tablet_server.cc:196] TabletServer@127.12.56.194:0 shutdown complete.
W20260709 12:15:59.573233 26758 consensus_peers.cc:597] T b9898596353d46eab5ff567f15224907 P ea3ae70a91d24c3e84f03da4605ccede -> Peer 773a9a5eeb14469389297d0f170bae34 (127.12.56.194:37781): Couldn't send request to peer 773a9a5eeb14469389297d0f170bae34. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:37781: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:59.575368 26755 consensus_peers.cc:597] T 61ff419b6fbe4f9e91c20f9347dd8c63 P ea3ae70a91d24c3e84f03da4605ccede -> Peer 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813): Couldn't send request to peer 56539bdd0fcc41a7ae3e12c2f743d6fd. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:35813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:59.606870 12515 tablet_server.cc:179] TabletServer@127.12.56.195:0 shutting down...
W20260709 12:15:59.627851 26758 consensus_peers.cc:597] T 6368117da5f748b3ae4f1475c4d8decb P ea3ae70a91d24c3e84f03da4605ccede -> Peer 773a9a5eeb14469389297d0f170bae34 (127.12.56.194:37781): Couldn't send request to peer 773a9a5eeb14469389297d0f170bae34. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:37781: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:59.639317 26755 consensus_peers.cc:597] T eb394e0c07444d0a96763f25ac9394e9 P ea3ae70a91d24c3e84f03da4605ccede -> Peer 56539bdd0fcc41a7ae3e12c2f743d6fd (127.12.56.193:35813): Couldn't send request to peer 56539bdd0fcc41a7ae3e12c2f743d6fd. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:35813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:59.646202 12515 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:59.647130 12515 tablet_replica.cc:333] T eceb0db47a1d432e9cbe22991da985f4 P ea3ae70a91d24c3e84f03da4605ccede: stopping tablet replica
I20260709 12:15:59.648116 12515 raft_consensus.cc:2243] T eceb0db47a1d432e9cbe22991da985f4 P ea3ae70a91d24c3e84f03da4605ccede [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:59.648641 12515 raft_consensus.cc:2272] T eceb0db47a1d432e9cbe22991da985f4 P ea3ae70a91d24c3e84f03da4605ccede [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:59.651010 12515 tablet_replica.cc:333] T 64c363fad70c4e89bf03bf59e7252fac P ea3ae70a91d24c3e84f03da4605ccede: stopping tablet replica
I20260709 12:15:59.651577 12515 raft_consensus.cc:2243] T 64c363fad70c4e89bf03bf59e7252fac P ea3ae70a91d24c3e84f03da4605ccede [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:59.652057 12515 raft_consensus.cc:2272] T 64c363fad70c4e89bf03bf59e7252fac P ea3ae70a91d24c3e84f03da4605ccede [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:59.654229 12515 tablet_replica.cc:333] T 7a40c4830672494f94383cccd2bcb2b7 P ea3ae70a91d24c3e84f03da4605ccede: stopping tablet replica
I20260709 12:15:59.654799 12515 raft_consensus.cc:2243] T 7a40c4830672494f94383cccd2bcb2b7 P ea3ae70a91d24c3e84f03da4605ccede [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:59.655311 12515 raft_consensus.cc:2272] T 7a40c4830672494f94383cccd2bcb2b7 P ea3ae70a91d24c3e84f03da4605ccede [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:59.657436 12515 tablet_replica.cc:333] T 6368117da5f748b3ae4f1475c4d8decb P ea3ae70a91d24c3e84f03da4605ccede: stopping tablet replica
I20260709 12:15:59.658063 12515 raft_consensus.cc:2243] T 6368117da5f748b3ae4f1475c4d8decb P ea3ae70a91d24c3e84f03da4605ccede [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:15:59.658885 12515 raft_consensus.cc:2272] T 6368117da5f748b3ae4f1475c4d8decb P ea3ae70a91d24c3e84f03da4605ccede [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:59.661024 12515 tablet_replica.cc:333] T 6673c39fbed4452aa38ceee09bda8cc6 P ea3ae70a91d24c3e84f03da4605ccede: stopping tablet replica
I20260709 12:15:59.661552 12515 raft_consensus.cc:2243] T 6673c39fbed4452aa38ceee09bda8cc6 P ea3ae70a91d24c3e84f03da4605ccede [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:59.662119 12515 raft_consensus.cc:2272] T 6673c39fbed4452aa38ceee09bda8cc6 P ea3ae70a91d24c3e84f03da4605ccede [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:59.664294 12515 tablet_replica.cc:333] T ed99dec74c4249ad85b7ef69d0c3d6ec P ea3ae70a91d24c3e84f03da4605ccede: stopping tablet replica
I20260709 12:15:59.664841 12515 raft_consensus.cc:2243] T ed99dec74c4249ad85b7ef69d0c3d6ec P ea3ae70a91d24c3e84f03da4605ccede [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:59.665309 12515 raft_consensus.cc:2272] T ed99dec74c4249ad85b7ef69d0c3d6ec P ea3ae70a91d24c3e84f03da4605ccede [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:59.667577 12515 tablet_replica.cc:333] T c258759a737e4ce1be24541ae8bb535f P ea3ae70a91d24c3e84f03da4605ccede: stopping tablet replica
I20260709 12:15:59.668131 12515 raft_consensus.cc:2243] T c258759a737e4ce1be24541ae8bb535f P ea3ae70a91d24c3e84f03da4605ccede [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:59.668964 12515 raft_consensus.cc:2272] T c258759a737e4ce1be24541ae8bb535f P ea3ae70a91d24c3e84f03da4605ccede [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:59.671211 12515 tablet_replica.cc:333] T 0cad4999d89c491b8698a2023cc6d805 P ea3ae70a91d24c3e84f03da4605ccede: stopping tablet replica
I20260709 12:15:59.671754 12515 raft_consensus.cc:2243] T 0cad4999d89c491b8698a2023cc6d805 P ea3ae70a91d24c3e84f03da4605ccede [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:59.672171 12515 raft_consensus.cc:2272] T 0cad4999d89c491b8698a2023cc6d805 P ea3ae70a91d24c3e84f03da4605ccede [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:59.674495 12515 tablet_replica.cc:333] T eb394e0c07444d0a96763f25ac9394e9 P ea3ae70a91d24c3e84f03da4605ccede: stopping tablet replica
I20260709 12:15:59.675096 12515 raft_consensus.cc:2243] T eb394e0c07444d0a96763f25ac9394e9 P ea3ae70a91d24c3e84f03da4605ccede [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:59.675943 12515 raft_consensus.cc:2272] T eb394e0c07444d0a96763f25ac9394e9 P ea3ae70a91d24c3e84f03da4605ccede [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:59.678282 12515 tablet_replica.cc:333] T a21937cb47f14ac0b40ea7c7c6e9cab9 P ea3ae70a91d24c3e84f03da4605ccede: stopping tablet replica
I20260709 12:15:59.678861 12515 raft_consensus.cc:2243] T a21937cb47f14ac0b40ea7c7c6e9cab9 P ea3ae70a91d24c3e84f03da4605ccede [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:59.679296 12515 raft_consensus.cc:2272] T a21937cb47f14ac0b40ea7c7c6e9cab9 P ea3ae70a91d24c3e84f03da4605ccede [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:59.681461 12515 tablet_replica.cc:333] T b9898596353d46eab5ff567f15224907 P ea3ae70a91d24c3e84f03da4605ccede: stopping tablet replica
I20260709 12:15:59.682101 12515 raft_consensus.cc:2243] T b9898596353d46eab5ff567f15224907 P ea3ae70a91d24c3e84f03da4605ccede [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:15:59.682930 12515 raft_consensus.cc:2272] T b9898596353d46eab5ff567f15224907 P ea3ae70a91d24c3e84f03da4605ccede [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:59.685099 12515 tablet_replica.cc:333] T b213246febae4173bc0e67e7ccc15257 P ea3ae70a91d24c3e84f03da4605ccede: stopping tablet replica
I20260709 12:15:59.685623 12515 raft_consensus.cc:2243] T b213246febae4173bc0e67e7ccc15257 P ea3ae70a91d24c3e84f03da4605ccede [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:59.686169 12515 raft_consensus.cc:2272] T b213246febae4173bc0e67e7ccc15257 P ea3ae70a91d24c3e84f03da4605ccede [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:59.688259 12515 tablet_replica.cc:333] T 61ff419b6fbe4f9e91c20f9347dd8c63 P ea3ae70a91d24c3e84f03da4605ccede: stopping tablet replica
I20260709 12:15:59.688761 12515 raft_consensus.cc:2243] T 61ff419b6fbe4f9e91c20f9347dd8c63 P ea3ae70a91d24c3e84f03da4605ccede [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:15:59.689602 12515 raft_consensus.cc:2272] T 61ff419b6fbe4f9e91c20f9347dd8c63 P ea3ae70a91d24c3e84f03da4605ccede [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:59.691892 12515 tablet_replica.cc:333] T d2af60b518a442778196f4cf0c3c918f P ea3ae70a91d24c3e84f03da4605ccede: stopping tablet replica
I20260709 12:15:59.692363 12515 raft_consensus.cc:2243] T d2af60b518a442778196f4cf0c3c918f P ea3ae70a91d24c3e84f03da4605ccede [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:59.692768 12515 raft_consensus.cc:2272] T d2af60b518a442778196f4cf0c3c918f P ea3ae70a91d24c3e84f03da4605ccede [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:59.695103 12515 tablet_replica.cc:333] T 6bbb8c707ea042859b5fbe695bab0f44 P ea3ae70a91d24c3e84f03da4605ccede: stopping tablet replica
I20260709 12:15:59.695724 12515 raft_consensus.cc:2243] T 6bbb8c707ea042859b5fbe695bab0f44 P ea3ae70a91d24c3e84f03da4605ccede [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:59.696141 12515 raft_consensus.cc:2272] T 6bbb8c707ea042859b5fbe695bab0f44 P ea3ae70a91d24c3e84f03da4605ccede [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:59.698441 12515 tablet_replica.cc:333] T 1f02103b62ff4603865811bcb4278c95 P ea3ae70a91d24c3e84f03da4605ccede: stopping tablet replica
I20260709 12:15:59.698963 12515 raft_consensus.cc:2243] T 1f02103b62ff4603865811bcb4278c95 P ea3ae70a91d24c3e84f03da4605ccede [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:59.699738 12515 raft_consensus.cc:2272] T 1f02103b62ff4603865811bcb4278c95 P ea3ae70a91d24c3e84f03da4605ccede [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:59.701764 12515 tablet_replica.cc:333] T ce9b9e0175914633833e79c94d7e6a2a P ea3ae70a91d24c3e84f03da4605ccede: stopping tablet replica
I20260709 12:15:59.702255 12515 raft_consensus.cc:2243] T ce9b9e0175914633833e79c94d7e6a2a P ea3ae70a91d24c3e84f03da4605ccede [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:59.702674 12515 raft_consensus.cc:2272] T ce9b9e0175914633833e79c94d7e6a2a P ea3ae70a91d24c3e84f03da4605ccede [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:59.705009 12515 tablet_replica.cc:333] T 51053577132f400289d135eb01a55020 P ea3ae70a91d24c3e84f03da4605ccede: stopping tablet replica
I20260709 12:15:59.705448 12515 raft_consensus.cc:2243] T 51053577132f400289d135eb01a55020 P ea3ae70a91d24c3e84f03da4605ccede [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:59.705943 12515 raft_consensus.cc:2272] T 51053577132f400289d135eb01a55020 P ea3ae70a91d24c3e84f03da4605ccede [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:59.751170 12515 tablet_server.cc:196] TabletServer@127.12.56.195:0 shutdown complete.
I20260709 12:15:59.789011 12515 master.cc:562] Master@127.12.56.254:40353 shutting down...
I20260709 12:15:59.813441 12515 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 301b955f7d364862a86a4f99fedaf408 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:59.814138 12515 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 301b955f7d364862a86a4f99fedaf408 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:59.814507 12515 tablet_replica.cc:333] T 00000000000000000000000000000000 P 301b955f7d364862a86a4f99fedaf408: stopping tablet replica
I20260709 12:15:59.865417 12515 master.cc:584] Master@127.12.56.254:40353 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (21948 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 12:15:59.942579 12515 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.12.56.254:39891
I20260709 12:15:59.944309 12515 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:59.951169 27147 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:59.951192 27146 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:59.953639 12515 server_base.cc:1061] running on GCE node
W20260709 12:15:59.953903 27149 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:59.955116 12515 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:59.955320 12515 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:59.955549 12515 hybrid_clock.cc:648] HybridClock initialized: now 1783599359955534 us; error 0 us; skew 500 ppm
I20260709 12:15:59.956234 12515 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:59.959664 12515 webserver.cc:533] Webserver started at http://127.12.56.254:37049/ using document root <none> and password file <none>
I20260709 12:15:59.960289 12515 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:59.960510 12515 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:59.960865 12515 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:59.963042 12515 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894707649-12515-0/minicluster-data/master-0-root/instance:
uuid: "c5388a28a5a84ab2a7280d911210ee8c"
format_stamp: "Formatted at 2026-07-09 12:15:59 on dist-test-slave-705g"
I20260709 12:15:59.969101 12515 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.004s
I20260709 12:15:59.974113 27154 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:59.975180 12515 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:15:59.975565 12515 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894707649-12515-0/minicluster-data/master-0-root
uuid: "c5388a28a5a84ab2a7280d911210ee8c"
format_stamp: "Formatted at 2026-07-09 12:15:59 on dist-test-slave-705g"
I20260709 12:15:59.975874 12515 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894707649-12515-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894707649-12515-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894707649-12515-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:59.996522 12515 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:59.997920 12515 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:00.043855 12515 rpc_server.cc:307] RPC server started. Bound to: 127.12.56.254:39891
I20260709 12:16:00.044057 27205 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.56.254:39891 every 8 connection(s)
I20260709 12:16:00.048705 27206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:00.064136 27206 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c5388a28a5a84ab2a7280d911210ee8c: Bootstrap starting.
I20260709 12:16:00.069720 27206 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c5388a28a5a84ab2a7280d911210ee8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:00.074859 27206 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c5388a28a5a84ab2a7280d911210ee8c: No bootstrap required, opened a new log
I20260709 12:16:00.077389 27206 raft_consensus.cc:359] T 00000000000000000000000000000000 P c5388a28a5a84ab2a7280d911210ee8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5388a28a5a84ab2a7280d911210ee8c" member_type: VOTER }
I20260709 12:16:00.078048 27206 raft_consensus.cc:385] T 00000000000000000000000000000000 P c5388a28a5a84ab2a7280d911210ee8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:00.078397 27206 raft_consensus.cc:740] T 00000000000000000000000000000000 P c5388a28a5a84ab2a7280d911210ee8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5388a28a5a84ab2a7280d911210ee8c, State: Initialized, Role: FOLLOWER
I20260709 12:16:00.079054 27206 consensus_queue.cc:260] T 00000000000000000000000000000000 P c5388a28a5a84ab2a7280d911210ee8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5388a28a5a84ab2a7280d911210ee8c" member_type: VOTER }
I20260709 12:16:00.079533 27206 raft_consensus.cc:399] T 00000000000000000000000000000000 P c5388a28a5a84ab2a7280d911210ee8c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:16:00.079743 27206 raft_consensus.cc:493] T 00000000000000000000000000000000 P c5388a28a5a84ab2a7280d911210ee8c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:16:00.079977 27206 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c5388a28a5a84ab2a7280d911210ee8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:00.085631 27206 raft_consensus.cc:515] T 00000000000000000000000000000000 P c5388a28a5a84ab2a7280d911210ee8c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5388a28a5a84ab2a7280d911210ee8c" member_type: VOTER }
I20260709 12:16:00.086181 27206 leader_election.cc:304] T 00000000000000000000000000000000 P c5388a28a5a84ab2a7280d911210ee8c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c5388a28a5a84ab2a7280d911210ee8c; no voters: 
I20260709 12:16:00.087384 27206 leader_election.cc:290] T 00000000000000000000000000000000 P c5388a28a5a84ab2a7280d911210ee8c [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:16:00.088033 27209 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c5388a28a5a84ab2a7280d911210ee8c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:00.089622 27209 raft_consensus.cc:697] T 00000000000000000000000000000000 P c5388a28a5a84ab2a7280d911210ee8c [term 1 LEADER]: Becoming Leader. State: Replica: c5388a28a5a84ab2a7280d911210ee8c, State: Running, Role: LEADER
I20260709 12:16:00.090634 27206 sys_catalog.cc:565] T 00000000000000000000000000000000 P c5388a28a5a84ab2a7280d911210ee8c [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:16:00.090487 27209 consensus_queue.cc:237] T 00000000000000000000000000000000 P c5388a28a5a84ab2a7280d911210ee8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5388a28a5a84ab2a7280d911210ee8c" member_type: VOTER }
I20260709 12:16:00.098773 27210 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5388a28a5a84ab2a7280d911210ee8c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c5388a28a5a84ab2a7280d911210ee8c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5388a28a5a84ab2a7280d911210ee8c" member_type: VOTER } }
I20260709 12:16:00.099570 27210 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5388a28a5a84ab2a7280d911210ee8c [sys.catalog]: This master's current role is: LEADER
I20260709 12:16:00.099186 27211 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5388a28a5a84ab2a7280d911210ee8c [sys.catalog]: SysCatalogTable state changed. Reason: New leader c5388a28a5a84ab2a7280d911210ee8c. Latest consensus state: current_term: 1 leader_uuid: "c5388a28a5a84ab2a7280d911210ee8c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5388a28a5a84ab2a7280d911210ee8c" member_type: VOTER } }
I20260709 12:16:00.100272 27211 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5388a28a5a84ab2a7280d911210ee8c [sys.catalog]: This master's current role is: LEADER
I20260709 12:16:00.103061 27217 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:16:00.110816 27217 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:16:00.112149 12515 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:16:00.121940 27217 catalog_manager.cc:1383] Generated new cluster ID: bcd081b9f4024dc8acaf503f462d5e37
I20260709 12:16:00.122289 27217 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:16:00.147153 27217 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:16:00.148777 27217 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:16:00.167289 27217 catalog_manager.cc:6070] T 00000000000000000000000000000000 P c5388a28a5a84ab2a7280d911210ee8c: Generated new TSK 0
I20260709 12:16:00.168087 27217 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:16:00.179528 12515 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:00.187244 27227 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:00.188855 27228 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:00.190476 12515 server_base.cc:1061] running on GCE node
W20260709 12:16:00.190918 27230 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:00.192131 12515 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:00.192349 12515 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:00.192619 12515 hybrid_clock.cc:648] HybridClock initialized: now 1783599360192588 us; error 0 us; skew 500 ppm
I20260709 12:16:00.193221 12515 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:00.196034 12515 webserver.cc:533] Webserver started at http://127.12.56.193:46527/ using document root <none> and password file <none>
I20260709 12:16:00.196631 12515 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:00.196853 12515 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:00.197194 12515 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:00.198827 12515 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894707649-12515-0/minicluster-data/ts-0-root/instance:
uuid: "0a0506729556426db8d473385faab326"
format_stamp: "Formatted at 2026-07-09 12:16:00 on dist-test-slave-705g"
I20260709 12:16:00.204305 12515 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:16:00.208343 27235 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:00.209288 12515 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 12:16:00.209622 12515 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894707649-12515-0/minicluster-data/ts-0-root
uuid: "0a0506729556426db8d473385faab326"
format_stamp: "Formatted at 2026-07-09 12:16:00 on dist-test-slave-705g"
I20260709 12:16:00.210018 12515 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894707649-12515-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894707649-12515-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894707649-12515-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:00.240033 12515 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:00.241503 12515 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:00.243253 12515 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:00.246630 12515 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:00.246863 12515 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:00.247079 12515 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:00.247227 12515 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:00.294863 12515 rpc_server.cc:307] RPC server started. Bound to: 127.12.56.193:33959
I20260709 12:16:00.295179 27297 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.56.193:33959 every 8 connection(s)
I20260709 12:16:00.300691 12515 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:00.310505 27302 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:00.311522 27303 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:00.316299 27305 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:00.316345 12515 server_base.cc:1061] running on GCE node
I20260709 12:16:00.318150 12515 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:00.318423 12515 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:00.318626 12515 hybrid_clock.cc:648] HybridClock initialized: now 1783599360318611 us; error 0 us; skew 500 ppm
I20260709 12:16:00.319247 12515 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:00.322445 12515 webserver.cc:533] Webserver started at http://127.12.56.194:32905/ using document root <none> and password file <none>
I20260709 12:16:00.323098 12515 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:00.323318 12515 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:00.323220 27298 heartbeater.cc:344] Connected to a master server at 127.12.56.254:39891
I20260709 12:16:00.323968 12515 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:00.324033 27298 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:00.325035 27298 heartbeater.cc:507] Master 127.12.56.254:39891 requested a full tablet report, sending...
I20260709 12:16:00.325626 12515 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894707649-12515-0/minicluster-data/ts-1-root/instance:
uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05"
format_stamp: "Formatted at 2026-07-09 12:16:00 on dist-test-slave-705g"
I20260709 12:16:00.327750 27171 ts_manager.cc:194] Registered new tserver with Master: 0a0506729556426db8d473385faab326 (127.12.56.193:33959)
I20260709 12:16:00.330821 27171 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49226
I20260709 12:16:00.332430 12515 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:16:00.337272 27310 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:00.338352 12515 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:16:00.338732 12515 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894707649-12515-0/minicluster-data/ts-1-root
uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05"
format_stamp: "Formatted at 2026-07-09 12:16:00 on dist-test-slave-705g"
I20260709 12:16:00.339052 12515 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894707649-12515-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894707649-12515-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894707649-12515-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:00.357956 12515 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:00.359223 12515 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:00.360759 12515 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:00.363270 12515 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:00.363467 12515 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:00.363787 12515 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:00.363958 12515 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:00.412698 12515 rpc_server.cc:307] RPC server started. Bound to: 127.12.56.194:39423
I20260709 12:16:00.412798 27372 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.56.194:39423 every 8 connection(s)
I20260709 12:16:00.418496 12515 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:00.430003 27377 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:00.429000 27376 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:00.435694 27373 heartbeater.cc:344] Connected to a master server at 127.12.56.254:39891
I20260709 12:16:00.436407 27373 heartbeater.cc:461] Registering TS with master...
W20260709 12:16:00.437127 27379 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:00.437564 27373 heartbeater.cc:507] Master 127.12.56.254:39891 requested a full tablet report, sending...
I20260709 12:16:00.438578 12515 server_base.cc:1061] running on GCE node
I20260709 12:16:00.439817 12515 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:00.440052 12515 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:00.440275 12515 hybrid_clock.cc:648] HybridClock initialized: now 1783599360440255 us; error 0 us; skew 500 ppm
I20260709 12:16:00.440662 27171 ts_manager.cc:194] Registered new tserver with Master: dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194:39423)
I20260709 12:16:00.441004 12515 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:00.442533 27171 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49236
I20260709 12:16:00.444410 12515 webserver.cc:533] Webserver started at http://127.12.56.195:38953/ using document root <none> and password file <none>
I20260709 12:16:00.445045 12515 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:00.445246 12515 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:00.445560 12515 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:00.446972 12515 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894707649-12515-0/minicluster-data/ts-2-root/instance:
uuid: "9ed05238324a485da065c10ec2ab6339"
format_stamp: "Formatted at 2026-07-09 12:16:00 on dist-test-slave-705g"
I20260709 12:16:00.451992 12515 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:16:00.456061 27384 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:00.457113 12515 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:16:00.457523 12515 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894707649-12515-0/minicluster-data/ts-2-root
uuid: "9ed05238324a485da065c10ec2ab6339"
format_stamp: "Formatted at 2026-07-09 12:16:00 on dist-test-slave-705g"
I20260709 12:16:00.457958 12515 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894707649-12515-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894707649-12515-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasksQ5bh6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894707649-12515-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:00.472549 12515 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:00.474197 12515 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:00.475756 12515 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:00.478865 12515 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:00.479130 12515 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:00.479444 12515 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:00.479625 12515 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:00.530057 12515 rpc_server.cc:307] RPC server started. Bound to: 127.12.56.195:39461
I20260709 12:16:00.530121 27446 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.56.195:39461 every 8 connection(s)
I20260709 12:16:00.551656 27447 heartbeater.cc:344] Connected to a master server at 127.12.56.254:39891
I20260709 12:16:00.552219 27447 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:00.553254 27447 heartbeater.cc:507] Master 127.12.56.254:39891 requested a full tablet report, sending...
I20260709 12:16:00.555872 27171 ts_manager.cc:194] Registered new tserver with Master: 9ed05238324a485da065c10ec2ab6339 (127.12.56.195:39461)
I20260709 12:16:00.556497 12515 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.022927575s
I20260709 12:16:00.557940 27171 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49240
I20260709 12:16:00.588712 27171 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49252:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:16:00.591698 27171 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:16:00.669721 27412 tablet_service.cc:1511] Processing CreateTablet for tablet 9d582472dd23411a9f4b724fa8138932 (DEFAULT_TABLE table=test-workload [id=9c5b7128fbd549998b8c0b17ca92a7a7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:16:00.673137 27411 tablet_service.cc:1511] Processing CreateTablet for tablet d966e0df1b51483d8939dabb9fc4fc70 (DEFAULT_TABLE table=test-workload [id=9c5b7128fbd549998b8c0b17ca92a7a7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:16:00.675602 27410 tablet_service.cc:1511] Processing CreateTablet for tablet 80110d11f7ae4434801099f8132d733d (DEFAULT_TABLE table=test-workload [id=9c5b7128fbd549998b8c0b17ca92a7a7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:16:00.678867 27409 tablet_service.cc:1511] Processing CreateTablet for tablet 8ca43ed5349646eea87075d7136ef40f (DEFAULT_TABLE table=test-workload [id=9c5b7128fbd549998b8c0b17ca92a7a7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:16:00.671511 27412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d582472dd23411a9f4b724fa8138932. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:00.681859 27408 tablet_service.cc:1511] Processing CreateTablet for tablet 59e886aafa51485392355848493e17f0 (DEFAULT_TABLE table=test-workload [id=9c5b7128fbd549998b8c0b17ca92a7a7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:16:00.683703 27408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59e886aafa51485392355848493e17f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:00.685134 27411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d966e0df1b51483d8939dabb9fc4fc70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:00.684801 27263 tablet_service.cc:1511] Processing CreateTablet for tablet 9d582472dd23411a9f4b724fa8138932 (DEFAULT_TABLE table=test-workload [id=9c5b7128fbd549998b8c0b17ca92a7a7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:16:00.685954 27410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80110d11f7ae4434801099f8132d733d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:00.687080 27262 tablet_service.cc:1511] Processing CreateTablet for tablet d966e0df1b51483d8939dabb9fc4fc70 (DEFAULT_TABLE table=test-workload [id=9c5b7128fbd549998b8c0b17ca92a7a7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:16:00.688210 27409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ca43ed5349646eea87075d7136ef40f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:00.689319 27261 tablet_service.cc:1511] Processing CreateTablet for tablet 80110d11f7ae4434801099f8132d733d (DEFAULT_TABLE table=test-workload [id=9c5b7128fbd549998b8c0b17ca92a7a7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:16:00.691612 27260 tablet_service.cc:1511] Processing CreateTablet for tablet 8ca43ed5349646eea87075d7136ef40f (DEFAULT_TABLE table=test-workload [id=9c5b7128fbd549998b8c0b17ca92a7a7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:16:00.693908 27259 tablet_service.cc:1511] Processing CreateTablet for tablet 59e886aafa51485392355848493e17f0 (DEFAULT_TABLE table=test-workload [id=9c5b7128fbd549998b8c0b17ca92a7a7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:16:00.696183 27258 tablet_service.cc:1511] Processing CreateTablet for tablet 1d81ab7648af4af195c1c4e76f22d17d (DEFAULT_TABLE table=test-workload [id=9c5b7128fbd549998b8c0b17ca92a7a7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:16:00.699298 27263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d582472dd23411a9f4b724fa8138932. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:00.709713 27257 tablet_service.cc:1511] Processing CreateTablet for tablet eab6587b21ca4b58b0d9b2696618e86e (DEFAULT_TABLE table=test-workload [id=9c5b7128fbd549998b8c0b17ca92a7a7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:16:00.710573 27262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d966e0df1b51483d8939dabb9fc4fc70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:00.711127 27407 tablet_service.cc:1511] Processing CreateTablet for tablet 1d81ab7648af4af195c1c4e76f22d17d (DEFAULT_TABLE table=test-workload [id=9c5b7128fbd549998b8c0b17ca92a7a7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:16:00.712489 27256 tablet_service.cc:1511] Processing CreateTablet for tablet f16afaec638c4a5fa540f3adbf285505 (DEFAULT_TABLE table=test-workload [id=9c5b7128fbd549998b8c0b17ca92a7a7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:16:00.713321 27407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d81ab7648af4af195c1c4e76f22d17d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:00.714005 27256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f16afaec638c4a5fa540f3adbf285505. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:00.716004 27338 tablet_service.cc:1511] Processing CreateTablet for tablet 9d582472dd23411a9f4b724fa8138932 (DEFAULT_TABLE table=test-workload [id=9c5b7128fbd549998b8c0b17ca92a7a7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:16:00.716007 27255 tablet_service.cc:1511] Processing CreateTablet for tablet 66448229321948caa5046d83678341ed (DEFAULT_TABLE table=test-workload [id=9c5b7128fbd549998b8c0b17ca92a7a7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:16:00.717506 27338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d582472dd23411a9f4b724fa8138932. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:00.717684 27255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66448229321948caa5046d83678341ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:00.719353 27260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ca43ed5349646eea87075d7136ef40f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:00.722289 27257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eab6587b21ca4b58b0d9b2696618e86e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:00.723222 27337 tablet_service.cc:1511] Processing CreateTablet for tablet d966e0df1b51483d8939dabb9fc4fc70 (DEFAULT_TABLE table=test-workload [id=9c5b7128fbd549998b8c0b17ca92a7a7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:16:00.724802 27337 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d966e0df1b51483d8939dabb9fc4fc70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:00.727161 27261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80110d11f7ae4434801099f8132d733d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:00.728420 27258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d81ab7648af4af195c1c4e76f22d17d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:00.732900 27336 tablet_service.cc:1511] Processing CreateTablet for tablet 80110d11f7ae4434801099f8132d733d (DEFAULT_TABLE table=test-workload [id=9c5b7128fbd549998b8c0b17ca92a7a7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:16:00.735268 27336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80110d11f7ae4434801099f8132d733d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:00.745507 27405 tablet_service.cc:1511] Processing CreateTablet for tablet f16afaec638c4a5fa540f3adbf285505 (DEFAULT_TABLE table=test-workload [id=9c5b7128fbd549998b8c0b17ca92a7a7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:16:00.746187 27259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59e886aafa51485392355848493e17f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:00.747167 27405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f16afaec638c4a5fa540f3adbf285505. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:00.750699 27335 tablet_service.cc:1511] Processing CreateTablet for tablet 8ca43ed5349646eea87075d7136ef40f (DEFAULT_TABLE table=test-workload [id=9c5b7128fbd549998b8c0b17ca92a7a7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:16:00.751111 27404 tablet_service.cc:1511] Processing CreateTablet for tablet 66448229321948caa5046d83678341ed (DEFAULT_TABLE table=test-workload [id=9c5b7128fbd549998b8c0b17ca92a7a7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:16:00.752408 27404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66448229321948caa5046d83678341ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:00.741214 27406 tablet_service.cc:1511] Processing CreateTablet for tablet eab6587b21ca4b58b0d9b2696618e86e (DEFAULT_TABLE table=test-workload [id=9c5b7128fbd549998b8c0b17ca92a7a7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:16:00.754966 27406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eab6587b21ca4b58b0d9b2696618e86e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:00.755373 27334 tablet_service.cc:1511] Processing CreateTablet for tablet 59e886aafa51485392355848493e17f0 (DEFAULT_TABLE table=test-workload [id=9c5b7128fbd549998b8c0b17ca92a7a7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:16:00.752408 27335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ca43ed5349646eea87075d7136ef40f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:00.758620 27334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59e886aafa51485392355848493e17f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:00.760268 27333 tablet_service.cc:1511] Processing CreateTablet for tablet 1d81ab7648af4af195c1c4e76f22d17d (DEFAULT_TABLE table=test-workload [id=9c5b7128fbd549998b8c0b17ca92a7a7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:16:00.761863 27333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d81ab7648af4af195c1c4e76f22d17d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:00.773178 27332 tablet_service.cc:1511] Processing CreateTablet for tablet eab6587b21ca4b58b0d9b2696618e86e (DEFAULT_TABLE table=test-workload [id=9c5b7128fbd549998b8c0b17ca92a7a7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:16:00.784039 27332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eab6587b21ca4b58b0d9b2696618e86e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:00.865859 27331 tablet_service.cc:1511] Processing CreateTablet for tablet 66448229321948caa5046d83678341ed (DEFAULT_TABLE table=test-workload [id=9c5b7128fbd549998b8c0b17ca92a7a7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:16:00.866392 27336 tablet_service.cc:1511] Processing CreateTablet for tablet f16afaec638c4a5fa540f3adbf285505 (DEFAULT_TABLE table=test-workload [id=9c5b7128fbd549998b8c0b17ca92a7a7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:16:00.867619 27331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66448229321948caa5046d83678341ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:00.838702 27462 tablet_bootstrap.cc:492] T 80110d11f7ae4434801099f8132d733d P 0a0506729556426db8d473385faab326: Bootstrap starting.
I20260709 12:16:00.870800 27336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f16afaec638c4a5fa540f3adbf285505. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:00.879559 27462 tablet_bootstrap.cc:654] T 80110d11f7ae4434801099f8132d733d P 0a0506729556426db8d473385faab326: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:00.930994 27462 tablet_bootstrap.cc:492] T 80110d11f7ae4434801099f8132d733d P 0a0506729556426db8d473385faab326: No bootstrap required, opened a new log
I20260709 12:16:00.931528 27462 ts_tablet_manager.cc:1403] T 80110d11f7ae4434801099f8132d733d P 0a0506729556426db8d473385faab326: Time spent bootstrapping tablet: real 0.093s	user 0.023s	sys 0.015s
I20260709 12:16:00.935273 27463 tablet_bootstrap.cc:492] T 80110d11f7ae4434801099f8132d733d P dd5ffdb93acf492d8a343cc3b6e1aa05: Bootstrap starting.
I20260709 12:16:00.935420 27465 tablet_bootstrap.cc:492] T d966e0df1b51483d8939dabb9fc4fc70 P 9ed05238324a485da065c10ec2ab6339: Bootstrap starting.
I20260709 12:16:00.935066 27462 raft_consensus.cc:359] T 80110d11f7ae4434801099f8132d733d P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:00.941411 27462 raft_consensus.cc:385] T 80110d11f7ae4434801099f8132d733d P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:00.941883 27462 raft_consensus.cc:740] T 80110d11f7ae4434801099f8132d733d P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a0506729556426db8d473385faab326, State: Initialized, Role: FOLLOWER
I20260709 12:16:00.942829 27462 consensus_queue.cc:260] T 80110d11f7ae4434801099f8132d733d P 0a0506729556426db8d473385faab326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:00.945253 27298 heartbeater.cc:499] Master 127.12.56.254:39891 was elected leader, sending a full tablet report...
I20260709 12:16:00.946117 27463 tablet_bootstrap.cc:654] T 80110d11f7ae4434801099f8132d733d P dd5ffdb93acf492d8a343cc3b6e1aa05: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:00.949635 27465 tablet_bootstrap.cc:654] T d966e0df1b51483d8939dabb9fc4fc70 P 9ed05238324a485da065c10ec2ab6339: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:00.950590 27462 ts_tablet_manager.cc:1434] T 80110d11f7ae4434801099f8132d733d P 0a0506729556426db8d473385faab326: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.004s
I20260709 12:16:00.951920 27462 tablet_bootstrap.cc:492] T eab6587b21ca4b58b0d9b2696618e86e P 0a0506729556426db8d473385faab326: Bootstrap starting.
I20260709 12:16:00.960243 27462 tablet_bootstrap.cc:654] T eab6587b21ca4b58b0d9b2696618e86e P 0a0506729556426db8d473385faab326: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:00.973835 27462 tablet_bootstrap.cc:492] T eab6587b21ca4b58b0d9b2696618e86e P 0a0506729556426db8d473385faab326: No bootstrap required, opened a new log
I20260709 12:16:00.973869 27465 tablet_bootstrap.cc:492] T d966e0df1b51483d8939dabb9fc4fc70 P 9ed05238324a485da065c10ec2ab6339: No bootstrap required, opened a new log
I20260709 12:16:00.974732 27465 ts_tablet_manager.cc:1403] T d966e0df1b51483d8939dabb9fc4fc70 P 9ed05238324a485da065c10ec2ab6339: Time spent bootstrapping tablet: real 0.041s	user 0.019s	sys 0.014s
I20260709 12:16:00.974736 27462 ts_tablet_manager.cc:1403] T eab6587b21ca4b58b0d9b2696618e86e P 0a0506729556426db8d473385faab326: Time spent bootstrapping tablet: real 0.023s	user 0.019s	sys 0.002s
I20260709 12:16:00.976694 27463 tablet_bootstrap.cc:492] T 80110d11f7ae4434801099f8132d733d P dd5ffdb93acf492d8a343cc3b6e1aa05: No bootstrap required, opened a new log
I20260709 12:16:00.977353 27463 ts_tablet_manager.cc:1403] T 80110d11f7ae4434801099f8132d733d P dd5ffdb93acf492d8a343cc3b6e1aa05: Time spent bootstrapping tablet: real 0.043s	user 0.015s	sys 0.016s
I20260709 12:16:00.977931 27465 raft_consensus.cc:359] T d966e0df1b51483d8939dabb9fc4fc70 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:00.978709 27465 raft_consensus.cc:385] T d966e0df1b51483d8939dabb9fc4fc70 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:00.978973 27465 raft_consensus.cc:740] T d966e0df1b51483d8939dabb9fc4fc70 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ed05238324a485da065c10ec2ab6339, State: Initialized, Role: FOLLOWER
I20260709 12:16:00.978883 27462 raft_consensus.cc:359] T eab6587b21ca4b58b0d9b2696618e86e P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:00.979987 27462 raft_consensus.cc:385] T eab6587b21ca4b58b0d9b2696618e86e P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:00.980016 27465 consensus_queue.cc:260] T d966e0df1b51483d8939dabb9fc4fc70 P 9ed05238324a485da065c10ec2ab6339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:00.980451 27462 raft_consensus.cc:740] T eab6587b21ca4b58b0d9b2696618e86e P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a0506729556426db8d473385faab326, State: Initialized, Role: FOLLOWER
I20260709 12:16:00.980974 27463 raft_consensus.cc:359] T 80110d11f7ae4434801099f8132d733d P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:00.981923 27463 raft_consensus.cc:385] T 80110d11f7ae4434801099f8132d733d P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:00.981478 27462 consensus_queue.cc:260] T eab6587b21ca4b58b0d9b2696618e86e P 0a0506729556426db8d473385faab326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:00.982281 27463 raft_consensus.cc:740] T 80110d11f7ae4434801099f8132d733d P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd5ffdb93acf492d8a343cc3b6e1aa05, State: Initialized, Role: FOLLOWER
I20260709 12:16:00.982985 27447 heartbeater.cc:499] Master 127.12.56.254:39891 was elected leader, sending a full tablet report...
I20260709 12:16:00.983366 27465 ts_tablet_manager.cc:1434] T d966e0df1b51483d8939dabb9fc4fc70 P 9ed05238324a485da065c10ec2ab6339: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 12:16:00.983317 27463 consensus_queue.cc:260] T 80110d11f7ae4434801099f8132d733d P dd5ffdb93acf492d8a343cc3b6e1aa05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:00.984632 27465 tablet_bootstrap.cc:492] T 8ca43ed5349646eea87075d7136ef40f P 9ed05238324a485da065c10ec2ab6339: Bootstrap starting.
I20260709 12:16:00.987416 27462 ts_tablet_manager.cc:1434] T eab6587b21ca4b58b0d9b2696618e86e P 0a0506729556426db8d473385faab326: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:16:00.989147 27462 tablet_bootstrap.cc:492] T 59e886aafa51485392355848493e17f0 P 0a0506729556426db8d473385faab326: Bootstrap starting.
I20260709 12:16:00.991837 27465 tablet_bootstrap.cc:654] T 8ca43ed5349646eea87075d7136ef40f P 9ed05238324a485da065c10ec2ab6339: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:00.993412 27463 ts_tablet_manager.cc:1434] T 80110d11f7ae4434801099f8132d733d P dd5ffdb93acf492d8a343cc3b6e1aa05: Time spent starting tablet: real 0.016s	user 0.012s	sys 0.002s
I20260709 12:16:00.994488 27373 heartbeater.cc:499] Master 127.12.56.254:39891 was elected leader, sending a full tablet report...
I20260709 12:16:00.997846 27462 tablet_bootstrap.cc:654] T 59e886aafa51485392355848493e17f0 P 0a0506729556426db8d473385faab326: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:01.012519 27462 tablet_bootstrap.cc:492] T 59e886aafa51485392355848493e17f0 P 0a0506729556426db8d473385faab326: No bootstrap required, opened a new log
I20260709 12:16:01.013190 27462 ts_tablet_manager.cc:1403] T 59e886aafa51485392355848493e17f0 P 0a0506729556426db8d473385faab326: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.007s
I20260709 12:16:01.014611 27463 tablet_bootstrap.cc:492] T 59e886aafa51485392355848493e17f0 P dd5ffdb93acf492d8a343cc3b6e1aa05: Bootstrap starting.
I20260709 12:16:01.017408 27465 tablet_bootstrap.cc:492] T 8ca43ed5349646eea87075d7136ef40f P 9ed05238324a485da065c10ec2ab6339: No bootstrap required, opened a new log
I20260709 12:16:01.017016 27462 raft_consensus.cc:359] T 59e886aafa51485392355848493e17f0 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.018086 27462 raft_consensus.cc:385] T 59e886aafa51485392355848493e17f0 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:01.018146 27465 ts_tablet_manager.cc:1403] T 8ca43ed5349646eea87075d7136ef40f P 9ed05238324a485da065c10ec2ab6339: Time spent bootstrapping tablet: real 0.034s	user 0.017s	sys 0.016s
I20260709 12:16:01.018546 27462 raft_consensus.cc:740] T 59e886aafa51485392355848493e17f0 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a0506729556426db8d473385faab326, State: Initialized, Role: FOLLOWER
I20260709 12:16:01.019706 27462 consensus_queue.cc:260] T 59e886aafa51485392355848493e17f0 P 0a0506729556426db8d473385faab326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.022657 27462 ts_tablet_manager.cc:1434] T 59e886aafa51485392355848493e17f0 P 0a0506729556426db8d473385faab326: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:16:01.022336 27465 raft_consensus.cc:359] T 8ca43ed5349646eea87075d7136ef40f P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.023360 27465 raft_consensus.cc:385] T 8ca43ed5349646eea87075d7136ef40f P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:01.023723 27465 raft_consensus.cc:740] T 8ca43ed5349646eea87075d7136ef40f P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ed05238324a485da065c10ec2ab6339, State: Initialized, Role: FOLLOWER
I20260709 12:16:01.024106 27462 tablet_bootstrap.cc:492] T 9d582472dd23411a9f4b724fa8138932 P 0a0506729556426db8d473385faab326: Bootstrap starting.
I20260709 12:16:01.024664 27465 consensus_queue.cc:260] T 8ca43ed5349646eea87075d7136ef40f P 9ed05238324a485da065c10ec2ab6339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.027388 27465 ts_tablet_manager.cc:1434] T 8ca43ed5349646eea87075d7136ef40f P 9ed05238324a485da065c10ec2ab6339: Time spent starting tablet: real 0.009s	user 0.000s	sys 0.007s
I20260709 12:16:01.028864 27465 tablet_bootstrap.cc:492] T 9d582472dd23411a9f4b724fa8138932 P 9ed05238324a485da065c10ec2ab6339: Bootstrap starting.
I20260709 12:16:01.033228 27462 tablet_bootstrap.cc:654] T 9d582472dd23411a9f4b724fa8138932 P 0a0506729556426db8d473385faab326: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:01.034289 27463 tablet_bootstrap.cc:654] T 59e886aafa51485392355848493e17f0 P dd5ffdb93acf492d8a343cc3b6e1aa05: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:01.034597 27448 tablet.cc:2406] T 8ca43ed5349646eea87075d7136ef40f P 9ed05238324a485da065c10ec2ab6339: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:16:01.036579 27465 tablet_bootstrap.cc:654] T 9d582472dd23411a9f4b724fa8138932 P 9ed05238324a485da065c10ec2ab6339: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:01.053840 27463 tablet_bootstrap.cc:492] T 59e886aafa51485392355848493e17f0 P dd5ffdb93acf492d8a343cc3b6e1aa05: No bootstrap required, opened a new log
I20260709 12:16:01.054033 27462 tablet_bootstrap.cc:492] T 9d582472dd23411a9f4b724fa8138932 P 0a0506729556426db8d473385faab326: No bootstrap required, opened a new log
I20260709 12:16:01.054054 27465 tablet_bootstrap.cc:492] T 9d582472dd23411a9f4b724fa8138932 P 9ed05238324a485da065c10ec2ab6339: No bootstrap required, opened a new log
I20260709 12:16:01.054515 27463 ts_tablet_manager.cc:1403] T 59e886aafa51485392355848493e17f0 P dd5ffdb93acf492d8a343cc3b6e1aa05: Time spent bootstrapping tablet: real 0.040s	user 0.017s	sys 0.009s
I20260709 12:16:01.054893 27462 ts_tablet_manager.cc:1403] T 9d582472dd23411a9f4b724fa8138932 P 0a0506729556426db8d473385faab326: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.003s
I20260709 12:16:01.055343 27465 ts_tablet_manager.cc:1403] T 9d582472dd23411a9f4b724fa8138932 P 9ed05238324a485da065c10ec2ab6339: Time spent bootstrapping tablet: real 0.027s	user 0.005s	sys 0.019s
I20260709 12:16:01.058821 27462 raft_consensus.cc:359] T 9d582472dd23411a9f4b724fa8138932 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } } peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } }
I20260709 12:16:01.059041 27465 raft_consensus.cc:359] T 9d582472dd23411a9f4b724fa8138932 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } } peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } }
I20260709 12:16:01.059820 27462 raft_consensus.cc:385] T 9d582472dd23411a9f4b724fa8138932 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:01.060256 27465 raft_consensus.cc:385] T 9d582472dd23411a9f4b724fa8138932 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:01.060304 27462 raft_consensus.cc:740] T 9d582472dd23411a9f4b724fa8138932 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a0506729556426db8d473385faab326, State: Initialized, Role: FOLLOWER
I20260709 12:16:01.059942 27463 raft_consensus.cc:359] T 59e886aafa51485392355848493e17f0 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.060952 27465 raft_consensus.cc:740] T 9d582472dd23411a9f4b724fa8138932 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ed05238324a485da065c10ec2ab6339, State: Initialized, Role: FOLLOWER
I20260709 12:16:01.061012 27463 raft_consensus.cc:385] T 59e886aafa51485392355848493e17f0 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:01.061686 27463 raft_consensus.cc:740] T 59e886aafa51485392355848493e17f0 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd5ffdb93acf492d8a343cc3b6e1aa05, State: Initialized, Role: FOLLOWER
I20260709 12:16:01.061589 27462 consensus_queue.cc:260] T 9d582472dd23411a9f4b724fa8138932 P 0a0506729556426db8d473385faab326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } } peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } }
I20260709 12:16:01.062388 27465 consensus_queue.cc:260] T 9d582472dd23411a9f4b724fa8138932 P 9ed05238324a485da065c10ec2ab6339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } } peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } }
I20260709 12:16:01.063021 27463 consensus_queue.cc:260] T 59e886aafa51485392355848493e17f0 P dd5ffdb93acf492d8a343cc3b6e1aa05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.065610 27465 ts_tablet_manager.cc:1434] T 9d582472dd23411a9f4b724fa8138932 P 9ed05238324a485da065c10ec2ab6339: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260709 12:16:01.066073 27463 ts_tablet_manager.cc:1434] T 59e886aafa51485392355848493e17f0 P dd5ffdb93acf492d8a343cc3b6e1aa05: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.002s
I20260709 12:16:01.067106 27465 tablet_bootstrap.cc:492] T 66448229321948caa5046d83678341ed P 9ed05238324a485da065c10ec2ab6339: Bootstrap starting.
I20260709 12:16:01.067127 27462 ts_tablet_manager.cc:1434] T 9d582472dd23411a9f4b724fa8138932 P 0a0506729556426db8d473385faab326: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:16:01.067389 27463 tablet_bootstrap.cc:492] T d966e0df1b51483d8939dabb9fc4fc70 P dd5ffdb93acf492d8a343cc3b6e1aa05: Bootstrap starting.
I20260709 12:16:01.068630 27462 tablet_bootstrap.cc:492] T 66448229321948caa5046d83678341ed P 0a0506729556426db8d473385faab326: Bootstrap starting.
I20260709 12:16:01.076290 27463 tablet_bootstrap.cc:654] T d966e0df1b51483d8939dabb9fc4fc70 P dd5ffdb93acf492d8a343cc3b6e1aa05: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:01.076426 27465 tablet_bootstrap.cc:654] T 66448229321948caa5046d83678341ed P 9ed05238324a485da065c10ec2ab6339: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:01.077154 27462 tablet_bootstrap.cc:654] T 66448229321948caa5046d83678341ed P 0a0506729556426db8d473385faab326: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:01.083942 27462 tablet_bootstrap.cc:492] T 66448229321948caa5046d83678341ed P 0a0506729556426db8d473385faab326: No bootstrap required, opened a new log
I20260709 12:16:01.084569 27462 ts_tablet_manager.cc:1403] T 66448229321948caa5046d83678341ed P 0a0506729556426db8d473385faab326: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.003s
I20260709 12:16:01.086558 27470 raft_consensus.cc:493] T d966e0df1b51483d8939dabb9fc4fc70 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:01.087690 27470 raft_consensus.cc:515] T d966e0df1b51483d8939dabb9fc4fc70 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.088089 27462 raft_consensus.cc:359] T 66448229321948caa5046d83678341ed P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.089087 27462 raft_consensus.cc:385] T 66448229321948caa5046d83678341ed P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:01.089460 27462 raft_consensus.cc:740] T 66448229321948caa5046d83678341ed P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a0506729556426db8d473385faab326, State: Initialized, Role: FOLLOWER
I20260709 12:16:01.091535 27470 leader_election.cc:290] T d966e0df1b51483d8939dabb9fc4fc70 P 9ed05238324a485da065c10ec2ab6339 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a0506729556426db8d473385faab326 (127.12.56.193:33959), dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194:39423)
I20260709 12:16:01.093030 27462 consensus_queue.cc:260] T 66448229321948caa5046d83678341ed P 0a0506729556426db8d473385faab326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.095904 27462 ts_tablet_manager.cc:1434] T 66448229321948caa5046d83678341ed P 0a0506729556426db8d473385faab326: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.007s
I20260709 12:16:01.097112 27462 tablet_bootstrap.cc:492] T d966e0df1b51483d8939dabb9fc4fc70 P 0a0506729556426db8d473385faab326: Bootstrap starting.
W20260709 12:16:01.105912 27219 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:01.106076 27463 tablet_bootstrap.cc:492] T d966e0df1b51483d8939dabb9fc4fc70 P dd5ffdb93acf492d8a343cc3b6e1aa05: No bootstrap required, opened a new log
I20260709 12:16:01.106231 27462 tablet_bootstrap.cc:654] T d966e0df1b51483d8939dabb9fc4fc70 P 0a0506729556426db8d473385faab326: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:01.106865 27463 ts_tablet_manager.cc:1403] T d966e0df1b51483d8939dabb9fc4fc70 P dd5ffdb93acf492d8a343cc3b6e1aa05: Time spent bootstrapping tablet: real 0.040s	user 0.014s	sys 0.011s
I20260709 12:16:01.110358 27463 raft_consensus.cc:359] T d966e0df1b51483d8939dabb9fc4fc70 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.111306 27463 raft_consensus.cc:385] T d966e0df1b51483d8939dabb9fc4fc70 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:01.111654 27463 raft_consensus.cc:740] T d966e0df1b51483d8939dabb9fc4fc70 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd5ffdb93acf492d8a343cc3b6e1aa05, State: Initialized, Role: FOLLOWER
I20260709 12:16:01.112557 27463 consensus_queue.cc:260] T d966e0df1b51483d8939dabb9fc4fc70 P dd5ffdb93acf492d8a343cc3b6e1aa05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.115137 27463 ts_tablet_manager.cc:1434] T d966e0df1b51483d8939dabb9fc4fc70 P dd5ffdb93acf492d8a343cc3b6e1aa05: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:16:01.116421 27463 tablet_bootstrap.cc:492] T 8ca43ed5349646eea87075d7136ef40f P dd5ffdb93acf492d8a343cc3b6e1aa05: Bootstrap starting.
I20260709 12:16:01.116669 27465 tablet_bootstrap.cc:492] T 66448229321948caa5046d83678341ed P 9ed05238324a485da065c10ec2ab6339: No bootstrap required, opened a new log
I20260709 12:16:01.117360 27465 ts_tablet_manager.cc:1403] T 66448229321948caa5046d83678341ed P 9ed05238324a485da065c10ec2ab6339: Time spent bootstrapping tablet: real 0.051s	user 0.008s	sys 0.011s
I20260709 12:16:01.119937 27462 tablet_bootstrap.cc:492] T d966e0df1b51483d8939dabb9fc4fc70 P 0a0506729556426db8d473385faab326: No bootstrap required, opened a new log
I20260709 12:16:01.120631 27462 ts_tablet_manager.cc:1403] T d966e0df1b51483d8939dabb9fc4fc70 P 0a0506729556426db8d473385faab326: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.005s
I20260709 12:16:01.124439 27462 raft_consensus.cc:359] T d966e0df1b51483d8939dabb9fc4fc70 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.125324 27462 raft_consensus.cc:385] T d966e0df1b51483d8939dabb9fc4fc70 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:01.125686 27462 raft_consensus.cc:740] T d966e0df1b51483d8939dabb9fc4fc70 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a0506729556426db8d473385faab326, State: Initialized, Role: FOLLOWER
I20260709 12:16:01.128093 27463 tablet_bootstrap.cc:654] T 8ca43ed5349646eea87075d7136ef40f P dd5ffdb93acf492d8a343cc3b6e1aa05: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:01.127658 27465 raft_consensus.cc:359] T 66448229321948caa5046d83678341ed P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.128605 27465 raft_consensus.cc:385] T 66448229321948caa5046d83678341ed P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:01.128965 27465 raft_consensus.cc:740] T 66448229321948caa5046d83678341ed P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ed05238324a485da065c10ec2ab6339, State: Initialized, Role: FOLLOWER
I20260709 12:16:01.129958 27465 consensus_queue.cc:260] T 66448229321948caa5046d83678341ed P 9ed05238324a485da065c10ec2ab6339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.131302 27462 consensus_queue.cc:260] T d966e0df1b51483d8939dabb9fc4fc70 P 0a0506729556426db8d473385faab326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.134289 27462 ts_tablet_manager.cc:1434] T d966e0df1b51483d8939dabb9fc4fc70 P 0a0506729556426db8d473385faab326: Time spent starting tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 12:16:01.135568 27462 tablet_bootstrap.cc:492] T f16afaec638c4a5fa540f3adbf285505 P 0a0506729556426db8d473385faab326: Bootstrap starting.
I20260709 12:16:01.137313 27348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d966e0df1b51483d8939dabb9fc4fc70" candidate_uuid: "9ed05238324a485da065c10ec2ab6339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" is_pre_election: true
I20260709 12:16:01.138355 27348 raft_consensus.cc:2468] T d966e0df1b51483d8939dabb9fc4fc70 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ed05238324a485da065c10ec2ab6339 in term 0.
I20260709 12:16:01.139531 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d966e0df1b51483d8939dabb9fc4fc70" candidate_uuid: "9ed05238324a485da065c10ec2ab6339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a0506729556426db8d473385faab326" is_pre_election: true
I20260709 12:16:01.140231 27386 leader_election.cc:304] T d966e0df1b51483d8939dabb9fc4fc70 P 9ed05238324a485da065c10ec2ab6339 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ed05238324a485da065c10ec2ab6339, dd5ffdb93acf492d8a343cc3b6e1aa05; no voters: 
I20260709 12:16:01.140818 27273 raft_consensus.cc:2468] T d966e0df1b51483d8939dabb9fc4fc70 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ed05238324a485da065c10ec2ab6339 in term 0.
I20260709 12:16:01.142983 27471 raft_consensus.cc:493] T 80110d11f7ae4434801099f8132d733d P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:01.144148 27470 raft_consensus.cc:2804] T d966e0df1b51483d8939dabb9fc4fc70 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:01.144459 27465 ts_tablet_manager.cc:1434] T 66448229321948caa5046d83678341ed P 9ed05238324a485da065c10ec2ab6339: Time spent starting tablet: real 0.027s	user 0.011s	sys 0.000s
I20260709 12:16:01.144646 27470 raft_consensus.cc:493] T d966e0df1b51483d8939dabb9fc4fc70 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:01.145013 27470 raft_consensus.cc:3060] T d966e0df1b51483d8939dabb9fc4fc70 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:01.143787 27471 raft_consensus.cc:515] T 80110d11f7ae4434801099f8132d733d P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.150192 27465 tablet_bootstrap.cc:492] T 1d81ab7648af4af195c1c4e76f22d17d P 9ed05238324a485da065c10ec2ab6339: Bootstrap starting.
I20260709 12:16:01.154771 27471 leader_election.cc:290] T 80110d11f7ae4434801099f8132d733d P dd5ffdb93acf492d8a343cc3b6e1aa05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a0506729556426db8d473385faab326 (127.12.56.193:33959), 9ed05238324a485da065c10ec2ab6339 (127.12.56.195:39461)
I20260709 12:16:01.161734 27462 tablet_bootstrap.cc:654] T f16afaec638c4a5fa540f3adbf285505 P 0a0506729556426db8d473385faab326: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:01.168362 27463 tablet_bootstrap.cc:492] T 8ca43ed5349646eea87075d7136ef40f P dd5ffdb93acf492d8a343cc3b6e1aa05: No bootstrap required, opened a new log
I20260709 12:16:01.169119 27463 ts_tablet_manager.cc:1403] T 8ca43ed5349646eea87075d7136ef40f P dd5ffdb93acf492d8a343cc3b6e1aa05: Time spent bootstrapping tablet: real 0.053s	user 0.016s	sys 0.008s
I20260709 12:16:01.169701 27484 raft_consensus.cc:493] T 8ca43ed5349646eea87075d7136ef40f P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:01.170377 27484 raft_consensus.cc:515] T 8ca43ed5349646eea87075d7136ef40f P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.172325 27465 tablet_bootstrap.cc:654] T 1d81ab7648af4af195c1c4e76f22d17d P 9ed05238324a485da065c10ec2ab6339: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:01.172921 27463 raft_consensus.cc:359] T 8ca43ed5349646eea87075d7136ef40f P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.173965 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca43ed5349646eea87075d7136ef40f" candidate_uuid: "9ed05238324a485da065c10ec2ab6339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a0506729556426db8d473385faab326" is_pre_election: true
W20260709 12:16:01.176856 27388 leader_election.cc:343] T 8ca43ed5349646eea87075d7136ef40f P 9ed05238324a485da065c10ec2ab6339 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a0506729556426db8d473385faab326 (127.12.56.193:33959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:01.174204 27470 raft_consensus.cc:515] T d966e0df1b51483d8939dabb9fc4fc70 P 9ed05238324a485da065c10ec2ab6339 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.181239 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d966e0df1b51483d8939dabb9fc4fc70" candidate_uuid: "9ed05238324a485da065c10ec2ab6339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a0506729556426db8d473385faab326"
I20260709 12:16:01.181613 27484 leader_election.cc:290] T 8ca43ed5349646eea87075d7136ef40f P 9ed05238324a485da065c10ec2ab6339 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a0506729556426db8d473385faab326 (127.12.56.193:33959), dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194:39423)
I20260709 12:16:01.182219 27273 raft_consensus.cc:3060] T d966e0df1b51483d8939dabb9fc4fc70 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:01.187690 27348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca43ed5349646eea87075d7136ef40f" candidate_uuid: "9ed05238324a485da065c10ec2ab6339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" is_pre_election: true
I20260709 12:16:01.187803 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80110d11f7ae4434801099f8132d733d" candidate_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a0506729556426db8d473385faab326" is_pre_election: true
I20260709 12:16:01.188887 27272 raft_consensus.cc:2468] T 80110d11f7ae4434801099f8132d733d P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd5ffdb93acf492d8a343cc3b6e1aa05 in term 0.
I20260709 12:16:01.191391 27463 raft_consensus.cc:385] T 8ca43ed5349646eea87075d7136ef40f P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:01.190980 27314 leader_election.cc:304] T 80110d11f7ae4434801099f8132d733d P dd5ffdb93acf492d8a343cc3b6e1aa05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a0506729556426db8d473385faab326, dd5ffdb93acf492d8a343cc3b6e1aa05; no voters: 
I20260709 12:16:01.190979 27470 leader_election.cc:290] T d966e0df1b51483d8939dabb9fc4fc70 P 9ed05238324a485da065c10ec2ab6339 [CANDIDATE]: Term 1 election: Requested vote from peers 0a0506729556426db8d473385faab326 (127.12.56.193:33959), dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194:39423)
I20260709 12:16:01.194205 27471 raft_consensus.cc:2804] T 80110d11f7ae4434801099f8132d733d P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:01.193887 27347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d966e0df1b51483d8939dabb9fc4fc70" candidate_uuid: "9ed05238324a485da065c10ec2ab6339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05"
I20260709 12:16:01.196563 27471 raft_consensus.cc:493] T 80110d11f7ae4434801099f8132d733d P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:01.197422 27471 raft_consensus.cc:3060] T 80110d11f7ae4434801099f8132d733d P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:01.203496 27347 raft_consensus.cc:3060] T d966e0df1b51483d8939dabb9fc4fc70 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:01.192401 27463 raft_consensus.cc:740] T 8ca43ed5349646eea87075d7136ef40f P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd5ffdb93acf492d8a343cc3b6e1aa05, State: Initialized, Role: FOLLOWER
I20260709 12:16:01.209331 27470 raft_consensus.cc:493] T 66448229321948caa5046d83678341ed P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:01.210315 27470 raft_consensus.cc:515] T 66448229321948caa5046d83678341ed P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.211052 27466 raft_consensus.cc:493] T 9d582472dd23411a9f4b724fa8138932 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:01.211992 27273 raft_consensus.cc:2468] T d966e0df1b51483d8939dabb9fc4fc70 P 0a0506729556426db8d473385faab326 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ed05238324a485da065c10ec2ab6339 in term 1.
I20260709 12:16:01.211738 27466 raft_consensus.cc:515] T 9d582472dd23411a9f4b724fa8138932 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } } peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } }
I20260709 12:16:01.214082 27470 leader_election.cc:290] T 66448229321948caa5046d83678341ed P 9ed05238324a485da065c10ec2ab6339 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a0506729556426db8d473385faab326 (127.12.56.193:33959), dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194:39423)
I20260709 12:16:01.215219 27346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66448229321948caa5046d83678341ed" candidate_uuid: "9ed05238324a485da065c10ec2ab6339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" is_pre_election: true
I20260709 12:16:01.216504 27388 leader_election.cc:304] T d966e0df1b51483d8939dabb9fc4fc70 P 9ed05238324a485da065c10ec2ab6339 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a0506729556426db8d473385faab326, 9ed05238324a485da065c10ec2ab6339; no voters: 
W20260709 12:16:01.219174 27386 leader_election.cc:343] T 66448229321948caa5046d83678341ed P 9ed05238324a485da065c10ec2ab6339 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194:39423): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:01.221603 27463 consensus_queue.cc:260] T 8ca43ed5349646eea87075d7136ef40f P dd5ffdb93acf492d8a343cc3b6e1aa05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.222608 27470 raft_consensus.cc:2804] T d966e0df1b51483d8939dabb9fc4fc70 P 9ed05238324a485da065c10ec2ab6339 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:01.222988 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66448229321948caa5046d83678341ed" candidate_uuid: "9ed05238324a485da065c10ec2ab6339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a0506729556426db8d473385faab326" is_pre_election: true
I20260709 12:16:01.226866 27348 raft_consensus.cc:2468] T 8ca43ed5349646eea87075d7136ef40f P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ed05238324a485da065c10ec2ab6339 in term 0.
I20260709 12:16:01.223634 27466 leader_election.cc:290] T 9d582472dd23411a9f4b724fa8138932 P 0a0506729556426db8d473385faab326 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ed05238324a485da065c10ec2ab6339 (127.12.56.195:39461), dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194:39423)
I20260709 12:16:01.232019 27347 raft_consensus.cc:2468] T d966e0df1b51483d8939dabb9fc4fc70 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ed05238324a485da065c10ec2ab6339 in term 1.
I20260709 12:16:01.234932 27386 leader_election.cc:304] T 8ca43ed5349646eea87075d7136ef40f P 9ed05238324a485da065c10ec2ab6339 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ed05238324a485da065c10ec2ab6339, dd5ffdb93acf492d8a343cc3b6e1aa05; no voters: 0a0506729556426db8d473385faab326
I20260709 12:16:01.240131 27484 raft_consensus.cc:2804] T 8ca43ed5349646eea87075d7136ef40f P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:01.241514 27484 raft_consensus.cc:493] T 8ca43ed5349646eea87075d7136ef40f P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:01.241997 27484 raft_consensus.cc:3060] T 8ca43ed5349646eea87075d7136ef40f P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:01.223701 27470 raft_consensus.cc:697] T d966e0df1b51483d8939dabb9fc4fc70 P 9ed05238324a485da065c10ec2ab6339 [term 1 LEADER]: Becoming Leader. State: Replica: 9ed05238324a485da065c10ec2ab6339, State: Running, Role: LEADER
I20260709 12:16:01.250988 27484 raft_consensus.cc:515] T 8ca43ed5349646eea87075d7136ef40f P 9ed05238324a485da065c10ec2ab6339 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.247385 27465 tablet_bootstrap.cc:492] T 1d81ab7648af4af195c1c4e76f22d17d P 9ed05238324a485da065c10ec2ab6339: No bootstrap required, opened a new log
I20260709 12:16:01.251832 27470 consensus_queue.cc:237] T d966e0df1b51483d8939dabb9fc4fc70 P 9ed05238324a485da065c10ec2ab6339 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.253404 27465 ts_tablet_manager.cc:1403] T 1d81ab7648af4af195c1c4e76f22d17d P 9ed05238324a485da065c10ec2ab6339: Time spent bootstrapping tablet: real 0.103s	user 0.021s	sys 0.014s
I20260709 12:16:01.255080 27462 tablet_bootstrap.cc:492] T f16afaec638c4a5fa540f3adbf285505 P 0a0506729556426db8d473385faab326: No bootstrap required, opened a new log
I20260709 12:16:01.258589 27465 raft_consensus.cc:359] T 1d81ab7648af4af195c1c4e76f22d17d P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.255275 27348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca43ed5349646eea87075d7136ef40f" candidate_uuid: "9ed05238324a485da065c10ec2ab6339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05"
I20260709 12:16:01.261056 27348 raft_consensus.cc:3060] T 8ca43ed5349646eea87075d7136ef40f P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:01.227046 27273 raft_consensus.cc:2468] T 66448229321948caa5046d83678341ed P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ed05238324a485da065c10ec2ab6339 in term 0.
I20260709 12:16:01.260418 27465 raft_consensus.cc:385] T 1d81ab7648af4af195c1c4e76f22d17d P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:01.266345 27462 ts_tablet_manager.cc:1403] T f16afaec638c4a5fa540f3adbf285505 P 0a0506729556426db8d473385faab326: Time spent bootstrapping tablet: real 0.131s	user 0.030s	sys 0.010s
I20260709 12:16:01.266803 27471 raft_consensus.cc:515] T 80110d11f7ae4434801099f8132d733d P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.260622 27484 leader_election.cc:290] T 8ca43ed5349646eea87075d7136ef40f P 9ed05238324a485da065c10ec2ab6339 [CANDIDATE]: Term 1 election: Requested vote from peers 0a0506729556426db8d473385faab326 (127.12.56.193:33959), dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194:39423)
I20260709 12:16:01.268035 27465 raft_consensus.cc:740] T 1d81ab7648af4af195c1c4e76f22d17d P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ed05238324a485da065c10ec2ab6339, State: Initialized, Role: FOLLOWER
I20260709 12:16:01.270114 27466 raft_consensus.cc:493] T 59e886aafa51485392355848493e17f0 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:01.270763 27466 raft_consensus.cc:515] T 59e886aafa51485392355848493e17f0 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.271822 27422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80110d11f7ae4434801099f8132d733d" candidate_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ed05238324a485da065c10ec2ab6339" is_pre_election: true
I20260709 12:16:01.272482 27471 leader_election.cc:290] T 80110d11f7ae4434801099f8132d733d P dd5ffdb93acf492d8a343cc3b6e1aa05 [CANDIDATE]: Term 1 election: Requested vote from peers 0a0506729556426db8d473385faab326 (127.12.56.193:33959), 9ed05238324a485da065c10ec2ab6339 (127.12.56.195:39461)
I20260709 12:16:01.273270 27466 leader_election.cc:290] T 59e886aafa51485392355848493e17f0 P 0a0506729556426db8d473385faab326 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194:39423), 9ed05238324a485da065c10ec2ab6339 (127.12.56.195:39461)
I20260709 12:16:01.273455 27388 leader_election.cc:304] T 66448229321948caa5046d83678341ed P 9ed05238324a485da065c10ec2ab6339 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a0506729556426db8d473385faab326, 9ed05238324a485da065c10ec2ab6339; no voters: dd5ffdb93acf492d8a343cc3b6e1aa05
W20260709 12:16:01.275224 27313 leader_election.cc:343] T 80110d11f7ae4434801099f8132d733d P dd5ffdb93acf492d8a343cc3b6e1aa05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ed05238324a485da065c10ec2ab6339 (127.12.56.195:39461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:01.275143 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80110d11f7ae4434801099f8132d733d" candidate_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a0506729556426db8d473385faab326"
I20260709 12:16:01.276188 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca43ed5349646eea87075d7136ef40f" candidate_uuid: "9ed05238324a485da065c10ec2ab6339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a0506729556426db8d473385faab326"
I20260709 12:16:01.276641 27272 raft_consensus.cc:3060] T 80110d11f7ae4434801099f8132d733d P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:01.268631 27489 raft_consensus.cc:493] T 59e886aafa51485392355848493e17f0 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:01.278445 27489 raft_consensus.cc:515] T 59e886aafa51485392355848493e17f0 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.282431 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59e886aafa51485392355848493e17f0" candidate_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a0506729556426db8d473385faab326" is_pre_election: true
I20260709 12:16:01.283397 27271 raft_consensus.cc:2468] T 59e886aafa51485392355848493e17f0 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd5ffdb93acf492d8a343cc3b6e1aa05 in term 0.
I20260709 12:16:01.280915 27462 raft_consensus.cc:359] T f16afaec638c4a5fa540f3adbf285505 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.284663 27462 raft_consensus.cc:385] T f16afaec638c4a5fa540f3adbf285505 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:01.285068 27462 raft_consensus.cc:740] T f16afaec638c4a5fa540f3adbf285505 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a0506729556426db8d473385faab326, State: Initialized, Role: FOLLOWER
I20260709 12:16:01.285142 27314 leader_election.cc:304] T 59e886aafa51485392355848493e17f0 P dd5ffdb93acf492d8a343cc3b6e1aa05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a0506729556426db8d473385faab326, dd5ffdb93acf492d8a343cc3b6e1aa05; no voters: 
I20260709 12:16:01.286306 27493 raft_consensus.cc:2804] T 59e886aafa51485392355848493e17f0 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:01.275005 27465 consensus_queue.cc:260] T 1d81ab7648af4af195c1c4e76f22d17d P 9ed05238324a485da065c10ec2ab6339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.286188 27462 consensus_queue.cc:260] T f16afaec638c4a5fa540f3adbf285505 P 0a0506729556426db8d473385faab326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.287002 27493 raft_consensus.cc:493] T 59e886aafa51485392355848493e17f0 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:01.293121 27493 raft_consensus.cc:3060] T 59e886aafa51485392355848493e17f0 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:01.285434 27348 raft_consensus.cc:2468] T 8ca43ed5349646eea87075d7136ef40f P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ed05238324a485da065c10ec2ab6339 in term 1.
I20260709 12:16:01.284478 27484 raft_consensus.cc:2804] T 66448229321948caa5046d83678341ed P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:01.305616 27386 leader_election.cc:304] T 8ca43ed5349646eea87075d7136ef40f P 9ed05238324a485da065c10ec2ab6339 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ed05238324a485da065c10ec2ab6339, dd5ffdb93acf492d8a343cc3b6e1aa05; no voters: 
I20260709 12:16:01.283427 27463 ts_tablet_manager.cc:1434] T 8ca43ed5349646eea87075d7136ef40f P dd5ffdb93acf492d8a343cc3b6e1aa05: Time spent starting tablet: real 0.114s	user 0.014s	sys 0.003s
I20260709 12:16:01.310565 27272 raft_consensus.cc:2468] T 80110d11f7ae4434801099f8132d733d P 0a0506729556426db8d473385faab326 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd5ffdb93acf492d8a343cc3b6e1aa05 in term 1.
I20260709 12:16:01.314291 27463 tablet_bootstrap.cc:492] T f16afaec638c4a5fa540f3adbf285505 P dd5ffdb93acf492d8a343cc3b6e1aa05: Bootstrap starting.
I20260709 12:16:01.298763 27484 raft_consensus.cc:493] T 66448229321948caa5046d83678341ed P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:01.311790 27489 leader_election.cc:290] T 59e886aafa51485392355848493e17f0 P dd5ffdb93acf492d8a343cc3b6e1aa05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a0506729556426db8d473385faab326 (127.12.56.193:33959), 9ed05238324a485da065c10ec2ab6339 (127.12.56.195:39461)
I20260709 12:16:01.314155 27314 leader_election.cc:304] T 80110d11f7ae4434801099f8132d733d P dd5ffdb93acf492d8a343cc3b6e1aa05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a0506729556426db8d473385faab326, dd5ffdb93acf492d8a343cc3b6e1aa05; no voters: 
I20260709 12:16:01.318500 27471 raft_consensus.cc:2804] T 80110d11f7ae4434801099f8132d733d P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:01.312374 27470 raft_consensus.cc:2804] T 8ca43ed5349646eea87075d7136ef40f P 9ed05238324a485da065c10ec2ab6339 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:01.315956 27484 raft_consensus.cc:3060] T 66448229321948caa5046d83678341ed P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:01.323850 27465 ts_tablet_manager.cc:1434] T 1d81ab7648af4af195c1c4e76f22d17d P 9ed05238324a485da065c10ec2ab6339: Time spent starting tablet: real 0.070s	user 0.011s	sys 0.006s
I20260709 12:16:01.325944 27470 raft_consensus.cc:697] T 8ca43ed5349646eea87075d7136ef40f P 9ed05238324a485da065c10ec2ab6339 [term 1 LEADER]: Becoming Leader. State: Replica: 9ed05238324a485da065c10ec2ab6339, State: Running, Role: LEADER
I20260709 12:16:01.324793 27422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80110d11f7ae4434801099f8132d733d" candidate_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ed05238324a485da065c10ec2ab6339"
I20260709 12:16:01.328701 27169 catalog_manager.cc:5697] T d966e0df1b51483d8939dabb9fc4fc70 P 9ed05238324a485da065c10ec2ab6339 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ed05238324a485da065c10ec2ab6339 (127.12.56.195). New cstate: current_term: 1 leader_uuid: "9ed05238324a485da065c10ec2ab6339" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:01.337222 27470 consensus_queue.cc:237] T 8ca43ed5349646eea87075d7136ef40f P 9ed05238324a485da065c10ec2ab6339 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
W20260709 12:16:01.336112 27388 leader_election.cc:343] T 8ca43ed5349646eea87075d7136ef40f P 9ed05238324a485da065c10ec2ab6339 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0a0506729556426db8d473385faab326 (127.12.56.193:33959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:01.339056 27465 tablet_bootstrap.cc:492] T eab6587b21ca4b58b0d9b2696618e86e P 9ed05238324a485da065c10ec2ab6339: Bootstrap starting.
I20260709 12:16:01.333074 27493 raft_consensus.cc:515] T 59e886aafa51485392355848493e17f0 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.341375 27462 ts_tablet_manager.cc:1434] T f16afaec638c4a5fa540f3adbf285505 P 0a0506729556426db8d473385faab326: Time spent starting tablet: real 0.072s	user 0.005s	sys 0.004s
I20260709 12:16:01.336169 27471 raft_consensus.cc:697] T 80110d11f7ae4434801099f8132d733d P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 LEADER]: Becoming Leader. State: Replica: dd5ffdb93acf492d8a343cc3b6e1aa05, State: Running, Role: LEADER
I20260709 12:16:01.345175 27466 raft_consensus.cc:493] T f16afaec638c4a5fa540f3adbf285505 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:01.345710 27471 consensus_queue.cc:237] T 80110d11f7ae4434801099f8132d733d P dd5ffdb93acf492d8a343cc3b6e1aa05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.345893 27466 raft_consensus.cc:515] T f16afaec638c4a5fa540f3adbf285505 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.349606 27466 leader_election.cc:290] T f16afaec638c4a5fa540f3adbf285505 P 0a0506729556426db8d473385faab326 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194:39423), 9ed05238324a485da065c10ec2ab6339 (127.12.56.195:39461)
I20260709 12:16:01.353241 27484 raft_consensus.cc:515] T 66448229321948caa5046d83678341ed P 9ed05238324a485da065c10ec2ab6339 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.358057 27422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59e886aafa51485392355848493e17f0" candidate_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ed05238324a485da065c10ec2ab6339" is_pre_election: true
W20260709 12:16:01.358047 27313 leader_election.cc:343] T 80110d11f7ae4434801099f8132d733d P dd5ffdb93acf492d8a343cc3b6e1aa05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9ed05238324a485da065c10ec2ab6339 (127.12.56.195:39461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:01.359671 27484 leader_election.cc:290] T 66448229321948caa5046d83678341ed P 9ed05238324a485da065c10ec2ab6339 [CANDIDATE]: Term 1 election: Requested vote from peers 0a0506729556426db8d473385faab326 (127.12.56.193:33959), dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194:39423)
I20260709 12:16:01.360716 27347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59e886aafa51485392355848493e17f0" candidate_uuid: "0a0506729556426db8d473385faab326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" is_pre_election: true
I20260709 12:16:01.361208 27462 tablet_bootstrap.cc:492] T 8ca43ed5349646eea87075d7136ef40f P 0a0506729556426db8d473385faab326: Bootstrap starting.
I20260709 12:16:01.361627 27347 raft_consensus.cc:2393] T 59e886aafa51485392355848493e17f0 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0a0506729556426db8d473385faab326 in current term 1: Already voted for candidate dd5ffdb93acf492d8a343cc3b6e1aa05 in this term.
I20260709 12:16:01.362005 27422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d582472dd23411a9f4b724fa8138932" candidate_uuid: "0a0506729556426db8d473385faab326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ed05238324a485da065c10ec2ab6339" is_pre_election: true
I20260709 12:16:01.362500 27493 leader_election.cc:290] T 59e886aafa51485392355848493e17f0 P dd5ffdb93acf492d8a343cc3b6e1aa05 [CANDIDATE]: Term 1 election: Requested vote from peers 0a0506729556426db8d473385faab326 (127.12.56.193:33959), 9ed05238324a485da065c10ec2ab6339 (127.12.56.195:39461)
I20260709 12:16:01.362732 27422 raft_consensus.cc:2468] T 9d582472dd23411a9f4b724fa8138932 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a0506729556426db8d473385faab326 in term 0.
I20260709 12:16:01.362900 27346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16afaec638c4a5fa540f3adbf285505" candidate_uuid: "0a0506729556426db8d473385faab326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" is_pre_election: true
I20260709 12:16:01.361117 27345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66448229321948caa5046d83678341ed" candidate_uuid: "9ed05238324a485da065c10ec2ab6339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05"
I20260709 12:16:01.364876 27463 tablet_bootstrap.cc:654] T f16afaec638c4a5fa540f3adbf285505 P dd5ffdb93acf492d8a343cc3b6e1aa05: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:01.365120 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66448229321948caa5046d83678341ed" candidate_uuid: "9ed05238324a485da065c10ec2ab6339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a0506729556426db8d473385faab326"
I20260709 12:16:01.365808 27271 raft_consensus.cc:3060] T 66448229321948caa5046d83678341ed P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:01.366501 27386 leader_election.cc:343] T 66448229321948caa5046d83678341ed P 9ed05238324a485da065c10ec2ab6339 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194:39423): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:01.366818 27465 tablet_bootstrap.cc:654] T eab6587b21ca4b58b0d9b2696618e86e P 9ed05238324a485da065c10ec2ab6339: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:01.367625 27421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59e886aafa51485392355848493e17f0" candidate_uuid: "0a0506729556426db8d473385faab326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ed05238324a485da065c10ec2ab6339" is_pre_election: true
I20260709 12:16:01.369500 27421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16afaec638c4a5fa540f3adbf285505" candidate_uuid: "0a0506729556426db8d473385faab326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ed05238324a485da065c10ec2ab6339" is_pre_election: true
W20260709 12:16:01.370769 27313 leader_election.cc:343] T 59e886aafa51485392355848493e17f0 P dd5ffdb93acf492d8a343cc3b6e1aa05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ed05238324a485da065c10ec2ab6339 (127.12.56.195:39461): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:01.371141 27237 leader_election.cc:343] T f16afaec638c4a5fa540f3adbf285505 P 0a0506729556426db8d473385faab326 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194:39423): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:01.372068 27348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d582472dd23411a9f4b724fa8138932" candidate_uuid: "0a0506729556426db8d473385faab326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" is_pre_election: true
W20260709 12:16:01.373905 27237 leader_election.cc:343] T 9d582472dd23411a9f4b724fa8138932 P 0a0506729556426db8d473385faab326 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194:39423): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:01.374886 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59e886aafa51485392355848493e17f0" candidate_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a0506729556426db8d473385faab326"
I20260709 12:16:01.375649 27272 raft_consensus.cc:3060] T 59e886aafa51485392355848493e17f0 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:01.378767 27238 leader_election.cc:304] T 9d582472dd23411a9f4b724fa8138932 P 0a0506729556426db8d473385faab326 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a0506729556426db8d473385faab326, 9ed05238324a485da065c10ec2ab6339; no voters: dd5ffdb93acf492d8a343cc3b6e1aa05
I20260709 12:16:01.380281 27466 raft_consensus.cc:2804] T 9d582472dd23411a9f4b724fa8138932 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:01.380705 27466 raft_consensus.cc:493] T 9d582472dd23411a9f4b724fa8138932 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:01.381052 27466 raft_consensus.cc:3060] T 9d582472dd23411a9f4b724fa8138932 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:01.385324 27271 raft_consensus.cc:2468] T 66448229321948caa5046d83678341ed P 0a0506729556426db8d473385faab326 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ed05238324a485da065c10ec2ab6339 in term 1.
W20260709 12:16:01.386411 27238 leader_election.cc:343] T 59e886aafa51485392355848493e17f0 P 0a0506729556426db8d473385faab326 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ed05238324a485da065c10ec2ab6339 (127.12.56.195:39461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:01.387018 27238 leader_election.cc:304] T 59e886aafa51485392355848493e17f0 P 0a0506729556426db8d473385faab326 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a0506729556426db8d473385faab326; no voters: 9ed05238324a485da065c10ec2ab6339, dd5ffdb93acf492d8a343cc3b6e1aa05
I20260709 12:16:01.387755 27168 catalog_manager.cc:5697] T 80110d11f7ae4434801099f8132d733d P dd5ffdb93acf492d8a343cc3b6e1aa05 reported cstate change: term changed from 0 to 1, leader changed from <none> to dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194). New cstate: current_term: 1 leader_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } health_report { overall_health: UNKNOWN } } }
W20260709 12:16:01.390998 27238 leader_election.cc:343] T f16afaec638c4a5fa540f3adbf285505 P 0a0506729556426db8d473385faab326 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ed05238324a485da065c10ec2ab6339 (127.12.56.195:39461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:01.391551 27238 leader_election.cc:304] T f16afaec638c4a5fa540f3adbf285505 P 0a0506729556426db8d473385faab326 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a0506729556426db8d473385faab326; no voters: 9ed05238324a485da065c10ec2ab6339, dd5ffdb93acf492d8a343cc3b6e1aa05
I20260709 12:16:01.394263 27421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59e886aafa51485392355848493e17f0" candidate_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ed05238324a485da065c10ec2ab6339"
W20260709 12:16:01.395784 27313 leader_election.cc:343] T 59e886aafa51485392355848493e17f0 P dd5ffdb93acf492d8a343cc3b6e1aa05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9ed05238324a485da065c10ec2ab6339 (127.12.56.195:39461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:01.396464 27272 raft_consensus.cc:2468] T 59e886aafa51485392355848493e17f0 P 0a0506729556426db8d473385faab326 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd5ffdb93acf492d8a343cc3b6e1aa05 in term 1.
I20260709 12:16:01.396852 27388 leader_election.cc:304] T 66448229321948caa5046d83678341ed P 9ed05238324a485da065c10ec2ab6339 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a0506729556426db8d473385faab326, 9ed05238324a485da065c10ec2ab6339; no voters: dd5ffdb93acf492d8a343cc3b6e1aa05
I20260709 12:16:01.397748 27502 raft_consensus.cc:2749] T 59e886aafa51485392355848493e17f0 P 0a0506729556426db8d473385faab326 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:01.402140 27503 raft_consensus.cc:2749] T f16afaec638c4a5fa540f3adbf285505 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:01.405161 27314 leader_election.cc:304] T 59e886aafa51485392355848493e17f0 P dd5ffdb93acf492d8a343cc3b6e1aa05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a0506729556426db8d473385faab326, dd5ffdb93acf492d8a343cc3b6e1aa05; no voters: 9ed05238324a485da065c10ec2ab6339
I20260709 12:16:01.405274 27470 raft_consensus.cc:2804] T 66448229321948caa5046d83678341ed P 9ed05238324a485da065c10ec2ab6339 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:01.406584 27470 raft_consensus.cc:697] T 66448229321948caa5046d83678341ed P 9ed05238324a485da065c10ec2ab6339 [term 1 LEADER]: Becoming Leader. State: Replica: 9ed05238324a485da065c10ec2ab6339, State: Running, Role: LEADER
I20260709 12:16:01.406860 27471 raft_consensus.cc:2804] T 59e886aafa51485392355848493e17f0 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:01.407569 27471 raft_consensus.cc:697] T 59e886aafa51485392355848493e17f0 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 LEADER]: Becoming Leader. State: Replica: dd5ffdb93acf492d8a343cc3b6e1aa05, State: Running, Role: LEADER
I20260709 12:16:01.407750 27470 consensus_queue.cc:237] T 66448229321948caa5046d83678341ed P 9ed05238324a485da065c10ec2ab6339 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.408578 27471 consensus_queue.cc:237] T 59e886aafa51485392355848493e17f0 P dd5ffdb93acf492d8a343cc3b6e1aa05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.405221 27465 tablet_bootstrap.cc:492] T eab6587b21ca4b58b0d9b2696618e86e P 9ed05238324a485da065c10ec2ab6339: No bootstrap required, opened a new log
I20260709 12:16:01.410507 27465 ts_tablet_manager.cc:1403] T eab6587b21ca4b58b0d9b2696618e86e P 9ed05238324a485da065c10ec2ab6339: Time spent bootstrapping tablet: real 0.072s	user 0.022s	sys 0.010s
I20260709 12:16:01.414793 27465 raft_consensus.cc:359] T eab6587b21ca4b58b0d9b2696618e86e P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.416111 27465 raft_consensus.cc:385] T eab6587b21ca4b58b0d9b2696618e86e P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:01.416636 27465 raft_consensus.cc:740] T eab6587b21ca4b58b0d9b2696618e86e P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ed05238324a485da065c10ec2ab6339, State: Initialized, Role: FOLLOWER
I20260709 12:16:01.418408 27462 tablet_bootstrap.cc:654] T 8ca43ed5349646eea87075d7136ef40f P 0a0506729556426db8d473385faab326: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:01.418063 27465 consensus_queue.cc:260] T eab6587b21ca4b58b0d9b2696618e86e P 9ed05238324a485da065c10ec2ab6339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.422216 27465 ts_tablet_manager.cc:1434] T eab6587b21ca4b58b0d9b2696618e86e P 9ed05238324a485da065c10ec2ab6339: Time spent starting tablet: real 0.011s	user 0.011s	sys 0.000s
I20260709 12:16:01.416489 27466 raft_consensus.cc:515] T 9d582472dd23411a9f4b724fa8138932 P 0a0506729556426db8d473385faab326 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } } peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } }
I20260709 12:16:01.429286 27421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d582472dd23411a9f4b724fa8138932" candidate_uuid: "0a0506729556426db8d473385faab326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ed05238324a485da065c10ec2ab6339"
I20260709 12:16:01.430306 27466 leader_election.cc:290] T 9d582472dd23411a9f4b724fa8138932 P 0a0506729556426db8d473385faab326 [CANDIDATE]: Term 1 election: Requested vote from peers 9ed05238324a485da065c10ec2ab6339 (127.12.56.195:39461), dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194:39423)
I20260709 12:16:01.430549 27421 raft_consensus.cc:3060] T 9d582472dd23411a9f4b724fa8138932 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:01.433174 27465 tablet_bootstrap.cc:492] T 59e886aafa51485392355848493e17f0 P 9ed05238324a485da065c10ec2ab6339: Bootstrap starting.
I20260709 12:16:01.429350 27348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d582472dd23411a9f4b724fa8138932" candidate_uuid: "0a0506729556426db8d473385faab326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05"
W20260709 12:16:01.435879 27237 leader_election.cc:343] T 9d582472dd23411a9f4b724fa8138932 P 0a0506729556426db8d473385faab326 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194:39423): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:01.439280 27463 tablet_bootstrap.cc:492] T f16afaec638c4a5fa540f3adbf285505 P dd5ffdb93acf492d8a343cc3b6e1aa05: No bootstrap required, opened a new log
I20260709 12:16:01.440240 27463 ts_tablet_manager.cc:1403] T f16afaec638c4a5fa540f3adbf285505 P dd5ffdb93acf492d8a343cc3b6e1aa05: Time spent bootstrapping tablet: real 0.126s	user 0.014s	sys 0.001s
I20260709 12:16:01.444718 27465 tablet_bootstrap.cc:654] T 59e886aafa51485392355848493e17f0 P 9ed05238324a485da065c10ec2ab6339: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:01.451246 27484 raft_consensus.cc:493] T 1d81ab7648af4af195c1c4e76f22d17d P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:01.462420 27484 raft_consensus.cc:515] T 1d81ab7648af4af195c1c4e76f22d17d P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.461591 27466 raft_consensus.cc:493] T eab6587b21ca4b58b0d9b2696618e86e P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:01.466487 27466 raft_consensus.cc:515] T eab6587b21ca4b58b0d9b2696618e86e P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.469267 27466 leader_election.cc:290] T eab6587b21ca4b58b0d9b2696618e86e P 0a0506729556426db8d473385faab326 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194:39423), 9ed05238324a485da065c10ec2ab6339 (127.12.56.195:39461)
I20260709 12:16:01.470513 27484 leader_election.cc:290] T 1d81ab7648af4af195c1c4e76f22d17d P 9ed05238324a485da065c10ec2ab6339 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a0506729556426db8d473385faab326 (127.12.56.193:33959), dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194:39423)
I20260709 12:16:01.475566 27345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eab6587b21ca4b58b0d9b2696618e86e" candidate_uuid: "0a0506729556426db8d473385faab326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" is_pre_election: true
I20260709 12:16:01.478801 27422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eab6587b21ca4b58b0d9b2696618e86e" candidate_uuid: "0a0506729556426db8d473385faab326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ed05238324a485da065c10ec2ab6339" is_pre_election: true
I20260709 12:16:01.479211 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d81ab7648af4af195c1c4e76f22d17d" candidate_uuid: "9ed05238324a485da065c10ec2ab6339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a0506729556426db8d473385faab326" is_pre_election: true
I20260709 12:16:01.479668 27348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d81ab7648af4af195c1c4e76f22d17d" candidate_uuid: "9ed05238324a485da065c10ec2ab6339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" is_pre_election: true
I20260709 12:16:01.479923 27422 raft_consensus.cc:2468] T eab6587b21ca4b58b0d9b2696618e86e P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a0506729556426db8d473385faab326 in term 0.
W20260709 12:16:01.479252 27237 leader_election.cc:343] T eab6587b21ca4b58b0d9b2696618e86e P 0a0506729556426db8d473385faab326 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194:39423): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:01.481386 27386 leader_election.cc:343] T 1d81ab7648af4af195c1c4e76f22d17d P 9ed05238324a485da065c10ec2ab6339 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194:39423): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:01.483145 27388 leader_election.cc:343] T 1d81ab7648af4af195c1c4e76f22d17d P 9ed05238324a485da065c10ec2ab6339 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a0506729556426db8d473385faab326 (127.12.56.193:33959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:01.483819 27388 leader_election.cc:304] T 1d81ab7648af4af195c1c4e76f22d17d P 9ed05238324a485da065c10ec2ab6339 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ed05238324a485da065c10ec2ab6339; no voters: 0a0506729556426db8d473385faab326, dd5ffdb93acf492d8a343cc3b6e1aa05
I20260709 12:16:01.485929 27238 leader_election.cc:304] T eab6587b21ca4b58b0d9b2696618e86e P 0a0506729556426db8d473385faab326 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a0506729556426db8d473385faab326, 9ed05238324a485da065c10ec2ab6339; no voters: dd5ffdb93acf492d8a343cc3b6e1aa05
I20260709 12:16:01.487445 27503 raft_consensus.cc:2804] T eab6587b21ca4b58b0d9b2696618e86e P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:01.488062 27503 raft_consensus.cc:493] T eab6587b21ca4b58b0d9b2696618e86e P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:01.488133 27484 raft_consensus.cc:2749] T 1d81ab7648af4af195c1c4e76f22d17d P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:01.488638 27503 raft_consensus.cc:3060] T eab6587b21ca4b58b0d9b2696618e86e P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:01.449730 27463 raft_consensus.cc:359] T f16afaec638c4a5fa540f3adbf285505 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.490749 27463 raft_consensus.cc:385] T f16afaec638c4a5fa540f3adbf285505 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:01.491460 27463 raft_consensus.cc:740] T f16afaec638c4a5fa540f3adbf285505 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd5ffdb93acf492d8a343cc3b6e1aa05, State: Initialized, Role: FOLLOWER
I20260709 12:16:01.496713 27421 raft_consensus.cc:2468] T 9d582472dd23411a9f4b724fa8138932 P 9ed05238324a485da065c10ec2ab6339 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a0506729556426db8d473385faab326 in term 1.
I20260709 12:16:01.498422 27238 leader_election.cc:304] T 9d582472dd23411a9f4b724fa8138932 P 0a0506729556426db8d473385faab326 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a0506729556426db8d473385faab326, 9ed05238324a485da065c10ec2ab6339; no voters: dd5ffdb93acf492d8a343cc3b6e1aa05
I20260709 12:16:01.499475 27466 raft_consensus.cc:2804] T 9d582472dd23411a9f4b724fa8138932 P 0a0506729556426db8d473385faab326 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:01.500079 27466 raft_consensus.cc:697] T 9d582472dd23411a9f4b724fa8138932 P 0a0506729556426db8d473385faab326 [term 1 LEADER]: Becoming Leader. State: Replica: 0a0506729556426db8d473385faab326, State: Running, Role: LEADER
I20260709 12:16:01.501055 27466 consensus_queue.cc:237] T 9d582472dd23411a9f4b724fa8138932 P 0a0506729556426db8d473385faab326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } } peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } }
I20260709 12:16:01.505008 27463 consensus_queue.cc:260] T f16afaec638c4a5fa540f3adbf285505 P dd5ffdb93acf492d8a343cc3b6e1aa05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.506762 27462 tablet_bootstrap.cc:492] T 8ca43ed5349646eea87075d7136ef40f P 0a0506729556426db8d473385faab326: No bootstrap required, opened a new log
I20260709 12:16:01.507409 27462 ts_tablet_manager.cc:1403] T 8ca43ed5349646eea87075d7136ef40f P 0a0506729556426db8d473385faab326: Time spent bootstrapping tablet: real 0.146s	user 0.015s	sys 0.001s
I20260709 12:16:01.510351 27169 catalog_manager.cc:5697] T 59e886aafa51485392355848493e17f0 P dd5ffdb93acf492d8a343cc3b6e1aa05 reported cstate change: term changed from 0 to 1, leader changed from <none> to dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194). New cstate: current_term: 1 leader_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:01.514598 27463 ts_tablet_manager.cc:1434] T f16afaec638c4a5fa540f3adbf285505 P dd5ffdb93acf492d8a343cc3b6e1aa05: Time spent starting tablet: real 0.072s	user 0.011s	sys 0.000s
I20260709 12:16:01.515419 27462 raft_consensus.cc:359] T 8ca43ed5349646eea87075d7136ef40f P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.517122 27462 raft_consensus.cc:385] T 8ca43ed5349646eea87075d7136ef40f P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:01.517401 27463 tablet_bootstrap.cc:492] T 66448229321948caa5046d83678341ed P dd5ffdb93acf492d8a343cc3b6e1aa05: Bootstrap starting.
I20260709 12:16:01.517513 27462 raft_consensus.cc:740] T 8ca43ed5349646eea87075d7136ef40f P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a0506729556426db8d473385faab326, State: Initialized, Role: FOLLOWER
I20260709 12:16:01.518745 27462 consensus_queue.cc:260] T 8ca43ed5349646eea87075d7136ef40f P 0a0506729556426db8d473385faab326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.520948 27471 raft_consensus.cc:493] T f16afaec638c4a5fa540f3adbf285505 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:01.521550 27471 raft_consensus.cc:515] T f16afaec638c4a5fa540f3adbf285505 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.522665 27465 tablet_bootstrap.cc:492] T 59e886aafa51485392355848493e17f0 P 9ed05238324a485da065c10ec2ab6339: No bootstrap required, opened a new log
I20260709 12:16:01.523360 27465 ts_tablet_manager.cc:1403] T 59e886aafa51485392355848493e17f0 P 9ed05238324a485da065c10ec2ab6339: Time spent bootstrapping tablet: real 0.100s	user 0.041s	sys 0.039s
I20260709 12:16:01.525199 27168 catalog_manager.cc:5697] T 9d582472dd23411a9f4b724fa8138932 P 0a0506729556426db8d473385faab326 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0a0506729556426db8d473385faab326 (127.12.56.193). New cstate: current_term: 1 leader_uuid: "0a0506729556426db8d473385faab326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:01.526326 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16afaec638c4a5fa540f3adbf285505" candidate_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a0506729556426db8d473385faab326" is_pre_election: true
I20260709 12:16:01.527139 27272 raft_consensus.cc:2468] T f16afaec638c4a5fa540f3adbf285505 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd5ffdb93acf492d8a343cc3b6e1aa05 in term 0.
I20260709 12:16:01.526795 27465 raft_consensus.cc:359] T 59e886aafa51485392355848493e17f0 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.527760 27465 raft_consensus.cc:385] T 59e886aafa51485392355848493e17f0 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:01.528174 27465 raft_consensus.cc:740] T 59e886aafa51485392355848493e17f0 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ed05238324a485da065c10ec2ab6339, State: Initialized, Role: FOLLOWER
I20260709 12:16:01.528640 27314 leader_election.cc:304] T f16afaec638c4a5fa540f3adbf285505 P dd5ffdb93acf492d8a343cc3b6e1aa05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a0506729556426db8d473385faab326, dd5ffdb93acf492d8a343cc3b6e1aa05; no voters: 
I20260709 12:16:01.529644 27493 raft_consensus.cc:2804] T f16afaec638c4a5fa540f3adbf285505 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:01.530089 27493 raft_consensus.cc:493] T f16afaec638c4a5fa540f3adbf285505 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:01.530442 27493 raft_consensus.cc:3060] T f16afaec638c4a5fa540f3adbf285505 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:01.529269 27465 consensus_queue.cc:260] T 59e886aafa51485392355848493e17f0 P 9ed05238324a485da065c10ec2ab6339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.533366 27465 ts_tablet_manager.cc:1434] T 59e886aafa51485392355848493e17f0 P 9ed05238324a485da065c10ec2ab6339: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:16:01.532431 27170 catalog_manager.cc:5697] T 66448229321948caa5046d83678341ed P 9ed05238324a485da065c10ec2ab6339 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ed05238324a485da065c10ec2ab6339 (127.12.56.195). New cstate: current_term: 1 leader_uuid: "9ed05238324a485da065c10ec2ab6339" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:01.533663 27421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16afaec638c4a5fa540f3adbf285505" candidate_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ed05238324a485da065c10ec2ab6339" is_pre_election: true
I20260709 12:16:01.534683 27465 tablet_bootstrap.cc:492] T 80110d11f7ae4434801099f8132d733d P 9ed05238324a485da065c10ec2ab6339: Bootstrap starting.
W20260709 12:16:01.535521 27313 leader_election.cc:343] T f16afaec638c4a5fa540f3adbf285505 P dd5ffdb93acf492d8a343cc3b6e1aa05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ed05238324a485da065c10ec2ab6339 (127.12.56.195:39461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:01.535081 27170 catalog_manager.cc:5697] T 8ca43ed5349646eea87075d7136ef40f P 9ed05238324a485da065c10ec2ab6339 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ed05238324a485da065c10ec2ab6339 (127.12.56.195). New cstate: current_term: 1 leader_uuid: "9ed05238324a485da065c10ec2ab6339" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:01.536219 27471 leader_election.cc:290] T f16afaec638c4a5fa540f3adbf285505 P dd5ffdb93acf492d8a343cc3b6e1aa05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a0506729556426db8d473385faab326 (127.12.56.193:33959), 9ed05238324a485da065c10ec2ab6339 (127.12.56.195:39461)
I20260709 12:16:01.540416 27503 raft_consensus.cc:515] T eab6587b21ca4b58b0d9b2696618e86e P 0a0506729556426db8d473385faab326 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.543514 27465 tablet_bootstrap.cc:654] T 80110d11f7ae4434801099f8132d733d P 9ed05238324a485da065c10ec2ab6339: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:01.543926 27462 ts_tablet_manager.cc:1434] T 8ca43ed5349646eea87075d7136ef40f P 0a0506729556426db8d473385faab326: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 12:16:01.545037 27462 tablet_bootstrap.cc:492] T 1d81ab7648af4af195c1c4e76f22d17d P 0a0506729556426db8d473385faab326: Bootstrap starting.
I20260709 12:16:01.549830 27348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eab6587b21ca4b58b0d9b2696618e86e" candidate_uuid: "0a0506729556426db8d473385faab326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05"
W20260709 12:16:01.551836 27237 leader_election.cc:343] T eab6587b21ca4b58b0d9b2696618e86e P 0a0506729556426db8d473385faab326 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194:39423): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:01.551842 27493 raft_consensus.cc:515] T f16afaec638c4a5fa540f3adbf285505 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.558816 27462 tablet_bootstrap.cc:654] T 1d81ab7648af4af195c1c4e76f22d17d P 0a0506729556426db8d473385faab326: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:01.561705 27493 leader_election.cc:290] T f16afaec638c4a5fa540f3adbf285505 P dd5ffdb93acf492d8a343cc3b6e1aa05 [CANDIDATE]: Term 1 election: Requested vote from peers 0a0506729556426db8d473385faab326 (127.12.56.193:33959), 9ed05238324a485da065c10ec2ab6339 (127.12.56.195:39461)
I20260709 12:16:01.562753 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16afaec638c4a5fa540f3adbf285505" candidate_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a0506729556426db8d473385faab326"
I20260709 12:16:01.567518 27272 raft_consensus.cc:3060] T f16afaec638c4a5fa540f3adbf285505 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:01.568014 27422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eab6587b21ca4b58b0d9b2696618e86e" candidate_uuid: "0a0506729556426db8d473385faab326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ed05238324a485da065c10ec2ab6339"
I20260709 12:16:01.568714 27422 raft_consensus.cc:3060] T eab6587b21ca4b58b0d9b2696618e86e P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:01.563498 27421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16afaec638c4a5fa540f3adbf285505" candidate_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ed05238324a485da065c10ec2ab6339"
W20260709 12:16:01.572082 27313 leader_election.cc:343] T f16afaec638c4a5fa540f3adbf285505 P dd5ffdb93acf492d8a343cc3b6e1aa05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9ed05238324a485da065c10ec2ab6339 (127.12.56.195:39461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:01.576902 27422 raft_consensus.cc:2468] T eab6587b21ca4b58b0d9b2696618e86e P 9ed05238324a485da065c10ec2ab6339 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a0506729556426db8d473385faab326 in term 1.
I20260709 12:16:01.578558 27238 leader_election.cc:304] T eab6587b21ca4b58b0d9b2696618e86e P 0a0506729556426db8d473385faab326 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a0506729556426db8d473385faab326, 9ed05238324a485da065c10ec2ab6339; no voters: dd5ffdb93acf492d8a343cc3b6e1aa05
I20260709 12:16:01.579669 27466 raft_consensus.cc:2804] T eab6587b21ca4b58b0d9b2696618e86e P 0a0506729556426db8d473385faab326 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:01.580242 27466 raft_consensus.cc:697] T eab6587b21ca4b58b0d9b2696618e86e P 0a0506729556426db8d473385faab326 [term 1 LEADER]: Becoming Leader. State: Replica: 0a0506729556426db8d473385faab326, State: Running, Role: LEADER
I20260709 12:16:01.562587 27503 leader_election.cc:290] T eab6587b21ca4b58b0d9b2696618e86e P 0a0506729556426db8d473385faab326 [CANDIDATE]: Term 1 election: Requested vote from peers dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194:39423), 9ed05238324a485da065c10ec2ab6339 (127.12.56.195:39461)
I20260709 12:16:01.581238 27466 consensus_queue.cc:237] T eab6587b21ca4b58b0d9b2696618e86e P 0a0506729556426db8d473385faab326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.583436 27463 tablet_bootstrap.cc:654] T 66448229321948caa5046d83678341ed P dd5ffdb93acf492d8a343cc3b6e1aa05: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:01.590201 27465 tablet_bootstrap.cc:492] T 80110d11f7ae4434801099f8132d733d P 9ed05238324a485da065c10ec2ab6339: No bootstrap required, opened a new log
I20260709 12:16:01.590842 27465 ts_tablet_manager.cc:1403] T 80110d11f7ae4434801099f8132d733d P 9ed05238324a485da065c10ec2ab6339: Time spent bootstrapping tablet: real 0.056s	user 0.036s	sys 0.015s
I20260709 12:16:01.594256 27272 raft_consensus.cc:2468] T f16afaec638c4a5fa540f3adbf285505 P 0a0506729556426db8d473385faab326 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd5ffdb93acf492d8a343cc3b6e1aa05 in term 1.
I20260709 12:16:01.595005 27465 raft_consensus.cc:359] T 80110d11f7ae4434801099f8132d733d P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.595794 27465 raft_consensus.cc:385] T 80110d11f7ae4434801099f8132d733d P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:01.596071 27465 raft_consensus.cc:740] T 80110d11f7ae4434801099f8132d733d P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ed05238324a485da065c10ec2ab6339, State: Initialized, Role: FOLLOWER
I20260709 12:16:01.596312 27314 leader_election.cc:304] T f16afaec638c4a5fa540f3adbf285505 P dd5ffdb93acf492d8a343cc3b6e1aa05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a0506729556426db8d473385faab326, dd5ffdb93acf492d8a343cc3b6e1aa05; no voters: 9ed05238324a485da065c10ec2ab6339
I20260709 12:16:01.597636 27168 catalog_manager.cc:5697] T eab6587b21ca4b58b0d9b2696618e86e P 0a0506729556426db8d473385faab326 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0a0506729556426db8d473385faab326 (127.12.56.193). New cstate: current_term: 1 leader_uuid: "0a0506729556426db8d473385faab326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:01.598408 27493 raft_consensus.cc:2804] T f16afaec638c4a5fa540f3adbf285505 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:01.599330 27465 consensus_queue.cc:260] T 80110d11f7ae4434801099f8132d733d P 9ed05238324a485da065c10ec2ab6339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.600643 27493 raft_consensus.cc:697] T f16afaec638c4a5fa540f3adbf285505 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 LEADER]: Becoming Leader. State: Replica: dd5ffdb93acf492d8a343cc3b6e1aa05, State: Running, Role: LEADER
I20260709 12:16:01.601539 27465 ts_tablet_manager.cc:1434] T 80110d11f7ae4434801099f8132d733d P 9ed05238324a485da065c10ec2ab6339: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:16:01.602093 27493 consensus_queue.cc:237] T f16afaec638c4a5fa540f3adbf285505 P dd5ffdb93acf492d8a343cc3b6e1aa05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.598845 27463 tablet_bootstrap.cc:492] T 66448229321948caa5046d83678341ed P dd5ffdb93acf492d8a343cc3b6e1aa05: No bootstrap required, opened a new log
I20260709 12:16:01.603328 27465 tablet_bootstrap.cc:492] T f16afaec638c4a5fa540f3adbf285505 P 9ed05238324a485da065c10ec2ab6339: Bootstrap starting.
I20260709 12:16:01.603633 27463 ts_tablet_manager.cc:1403] T 66448229321948caa5046d83678341ed P dd5ffdb93acf492d8a343cc3b6e1aa05: Time spent bootstrapping tablet: real 0.086s	user 0.013s	sys 0.002s
I20260709 12:16:01.608559 27463 raft_consensus.cc:359] T 66448229321948caa5046d83678341ed P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.610342 27465 tablet_bootstrap.cc:654] T f16afaec638c4a5fa540f3adbf285505 P 9ed05238324a485da065c10ec2ab6339: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:01.611904 27463 raft_consensus.cc:385] T 66448229321948caa5046d83678341ed P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:01.613976 27463 raft_consensus.cc:740] T 66448229321948caa5046d83678341ed P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd5ffdb93acf492d8a343cc3b6e1aa05, State: Initialized, Role: FOLLOWER
I20260709 12:16:01.617233 27463 consensus_queue.cc:260] T 66448229321948caa5046d83678341ed P dd5ffdb93acf492d8a343cc3b6e1aa05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.621027 27462 tablet_bootstrap.cc:492] T 1d81ab7648af4af195c1c4e76f22d17d P 0a0506729556426db8d473385faab326: No bootstrap required, opened a new log
I20260709 12:16:01.621708 27463 ts_tablet_manager.cc:1434] T 66448229321948caa5046d83678341ed P dd5ffdb93acf492d8a343cc3b6e1aa05: Time spent starting tablet: real 0.018s	user 0.011s	sys 0.001s
I20260709 12:16:01.624019 27463 tablet_bootstrap.cc:492] T 1d81ab7648af4af195c1c4e76f22d17d P dd5ffdb93acf492d8a343cc3b6e1aa05: Bootstrap starting.
I20260709 12:16:01.621908 27462 ts_tablet_manager.cc:1403] T 1d81ab7648af4af195c1c4e76f22d17d P 0a0506729556426db8d473385faab326: Time spent bootstrapping tablet: real 0.077s	user 0.023s	sys 0.012s
I20260709 12:16:01.628997 27462 raft_consensus.cc:359] T 1d81ab7648af4af195c1c4e76f22d17d P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.632104 27465 tablet_bootstrap.cc:492] T f16afaec638c4a5fa540f3adbf285505 P 9ed05238324a485da065c10ec2ab6339: No bootstrap required, opened a new log
I20260709 12:16:01.633283 27462 raft_consensus.cc:385] T 1d81ab7648af4af195c1c4e76f22d17d P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:01.633667 27465 ts_tablet_manager.cc:1403] T f16afaec638c4a5fa540f3adbf285505 P 9ed05238324a485da065c10ec2ab6339: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.011s
I20260709 12:16:01.633698 27462 raft_consensus.cc:740] T 1d81ab7648af4af195c1c4e76f22d17d P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a0506729556426db8d473385faab326, State: Initialized, Role: FOLLOWER
I20260709 12:16:01.634848 27462 consensus_queue.cc:260] T 1d81ab7648af4af195c1c4e76f22d17d P 0a0506729556426db8d473385faab326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.637291 27462 ts_tablet_manager.cc:1434] T 1d81ab7648af4af195c1c4e76f22d17d P 0a0506729556426db8d473385faab326: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:16:01.638888 27465 raft_consensus.cc:359] T f16afaec638c4a5fa540f3adbf285505 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.639878 27465 raft_consensus.cc:385] T f16afaec638c4a5fa540f3adbf285505 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:01.638864 27168 catalog_manager.cc:5697] T f16afaec638c4a5fa540f3adbf285505 P dd5ffdb93acf492d8a343cc3b6e1aa05 reported cstate change: term changed from 0 to 1, leader changed from <none> to dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194). New cstate: current_term: 1 leader_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:01.640226 27465 raft_consensus.cc:740] T f16afaec638c4a5fa540f3adbf285505 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ed05238324a485da065c10ec2ab6339, State: Initialized, Role: FOLLOWER
I20260709 12:16:01.640964 27463 tablet_bootstrap.cc:654] T 1d81ab7648af4af195c1c4e76f22d17d P dd5ffdb93acf492d8a343cc3b6e1aa05: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:01.641182 27465 consensus_queue.cc:260] T f16afaec638c4a5fa540f3adbf285505 P 9ed05238324a485da065c10ec2ab6339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.643684 27465 ts_tablet_manager.cc:1434] T f16afaec638c4a5fa540f3adbf285505 P 9ed05238324a485da065c10ec2ab6339: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:16:01.654515 27463 tablet_bootstrap.cc:492] T 1d81ab7648af4af195c1c4e76f22d17d P dd5ffdb93acf492d8a343cc3b6e1aa05: No bootstrap required, opened a new log
I20260709 12:16:01.655126 27463 ts_tablet_manager.cc:1403] T 1d81ab7648af4af195c1c4e76f22d17d P dd5ffdb93acf492d8a343cc3b6e1aa05: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.011s
I20260709 12:16:01.657953 27463 raft_consensus.cc:359] T 1d81ab7648af4af195c1c4e76f22d17d P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.658715 27463 raft_consensus.cc:385] T 1d81ab7648af4af195c1c4e76f22d17d P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:01.659042 27463 raft_consensus.cc:740] T 1d81ab7648af4af195c1c4e76f22d17d P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd5ffdb93acf492d8a343cc3b6e1aa05, State: Initialized, Role: FOLLOWER
I20260709 12:16:01.659970 27463 consensus_queue.cc:260] T 1d81ab7648af4af195c1c4e76f22d17d P dd5ffdb93acf492d8a343cc3b6e1aa05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.662415 27463 ts_tablet_manager.cc:1434] T 1d81ab7648af4af195c1c4e76f22d17d P dd5ffdb93acf492d8a343cc3b6e1aa05: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:16:01.663343 27463 tablet_bootstrap.cc:492] T eab6587b21ca4b58b0d9b2696618e86e P dd5ffdb93acf492d8a343cc3b6e1aa05: Bootstrap starting.
I20260709 12:16:01.669699 27463 tablet_bootstrap.cc:654] T eab6587b21ca4b58b0d9b2696618e86e P dd5ffdb93acf492d8a343cc3b6e1aa05: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:01.674502 27463 tablet_bootstrap.cc:492] T eab6587b21ca4b58b0d9b2696618e86e P dd5ffdb93acf492d8a343cc3b6e1aa05: No bootstrap required, opened a new log
I20260709 12:16:01.675082 27463 ts_tablet_manager.cc:1403] T eab6587b21ca4b58b0d9b2696618e86e P dd5ffdb93acf492d8a343cc3b6e1aa05: Time spent bootstrapping tablet: real 0.012s	user 0.009s	sys 0.002s
I20260709 12:16:01.677122 27463 raft_consensus.cc:359] T eab6587b21ca4b58b0d9b2696618e86e P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.677634 27463 raft_consensus.cc:385] T eab6587b21ca4b58b0d9b2696618e86e P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:01.677933 27463 raft_consensus.cc:740] T eab6587b21ca4b58b0d9b2696618e86e P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd5ffdb93acf492d8a343cc3b6e1aa05, State: Initialized, Role: FOLLOWER
I20260709 12:16:01.678571 27463 consensus_queue.cc:260] T eab6587b21ca4b58b0d9b2696618e86e P dd5ffdb93acf492d8a343cc3b6e1aa05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.680271 27463 ts_tablet_manager.cc:1434] T eab6587b21ca4b58b0d9b2696618e86e P dd5ffdb93acf492d8a343cc3b6e1aa05: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:16:01.681113 27463 tablet_bootstrap.cc:492] T 9d582472dd23411a9f4b724fa8138932 P dd5ffdb93acf492d8a343cc3b6e1aa05: Bootstrap starting.
I20260709 12:16:01.686923 27470 consensus_queue.cc:1048] T d966e0df1b51483d8939dabb9fc4fc70 P 9ed05238324a485da065c10ec2ab6339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:01.687286 27463 tablet_bootstrap.cc:654] T 9d582472dd23411a9f4b724fa8138932 P dd5ffdb93acf492d8a343cc3b6e1aa05: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:01.694031 27463 tablet_bootstrap.cc:492] T 9d582472dd23411a9f4b724fa8138932 P dd5ffdb93acf492d8a343cc3b6e1aa05: No bootstrap required, opened a new log
I20260709 12:16:01.694588 27463 ts_tablet_manager.cc:1403] T 9d582472dd23411a9f4b724fa8138932 P dd5ffdb93acf492d8a343cc3b6e1aa05: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 12:16:01.697723 27463 raft_consensus.cc:359] T 9d582472dd23411a9f4b724fa8138932 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } } peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } }
I20260709 12:16:01.698563 27463 raft_consensus.cc:385] T 9d582472dd23411a9f4b724fa8138932 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:01.698861 27463 raft_consensus.cc:740] T 9d582472dd23411a9f4b724fa8138932 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd5ffdb93acf492d8a343cc3b6e1aa05, State: Initialized, Role: FOLLOWER
I20260709 12:16:01.699829 27463 consensus_queue.cc:260] T 9d582472dd23411a9f4b724fa8138932 P dd5ffdb93acf492d8a343cc3b6e1aa05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } } peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } }
I20260709 12:16:01.702668 27463 ts_tablet_manager.cc:1434] T 9d582472dd23411a9f4b724fa8138932 P dd5ffdb93acf492d8a343cc3b6e1aa05: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:16:01.708894 27496 consensus_queue.cc:1048] T d966e0df1b51483d8939dabb9fc4fc70 P 9ed05238324a485da065c10ec2ab6339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:01.709973 27493 raft_consensus.cc:493] T 66448229321948caa5046d83678341ed P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:01.710639 27493 raft_consensus.cc:515] T 66448229321948caa5046d83678341ed P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.714038 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66448229321948caa5046d83678341ed" candidate_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a0506729556426db8d473385faab326" is_pre_election: true
I20260709 12:16:01.714972 27272 raft_consensus.cc:2393] T 66448229321948caa5046d83678341ed P 0a0506729556426db8d473385faab326 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd5ffdb93acf492d8a343cc3b6e1aa05 in current term 1: Already voted for candidate 9ed05238324a485da065c10ec2ab6339 in this term.
I20260709 12:16:01.714947 27422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66448229321948caa5046d83678341ed" candidate_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ed05238324a485da065c10ec2ab6339" is_pre_election: true
I20260709 12:16:01.716990 27314 leader_election.cc:304] T 66448229321948caa5046d83678341ed P dd5ffdb93acf492d8a343cc3b6e1aa05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd5ffdb93acf492d8a343cc3b6e1aa05; no voters: 0a0506729556426db8d473385faab326, 9ed05238324a485da065c10ec2ab6339
I20260709 12:16:01.713233 27493 leader_election.cc:290] T 66448229321948caa5046d83678341ed P dd5ffdb93acf492d8a343cc3b6e1aa05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a0506729556426db8d473385faab326 (127.12.56.193:33959), 9ed05238324a485da065c10ec2ab6339 (127.12.56.195:39461)
I20260709 12:16:01.718515 27493 raft_consensus.cc:3060] T 66448229321948caa5046d83678341ed P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:01.725919 27493 raft_consensus.cc:2749] T 66448229321948caa5046d83678341ed P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:01.735625 27493 raft_consensus.cc:493] T 1d81ab7648af4af195c1c4e76f22d17d P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:01.736150 27493 raft_consensus.cc:515] T 1d81ab7648af4af195c1c4e76f22d17d P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.738186 27493 leader_election.cc:290] T 1d81ab7648af4af195c1c4e76f22d17d P dd5ffdb93acf492d8a343cc3b6e1aa05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a0506729556426db8d473385faab326 (127.12.56.193:33959), 9ed05238324a485da065c10ec2ab6339 (127.12.56.195:39461)
I20260709 12:16:01.738775 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d81ab7648af4af195c1c4e76f22d17d" candidate_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a0506729556426db8d473385faab326" is_pre_election: true
I20260709 12:16:01.739264 27422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d81ab7648af4af195c1c4e76f22d17d" candidate_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ed05238324a485da065c10ec2ab6339" is_pre_election: true
I20260709 12:16:01.739585 27272 raft_consensus.cc:2468] T 1d81ab7648af4af195c1c4e76f22d17d P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd5ffdb93acf492d8a343cc3b6e1aa05 in term 0.
I20260709 12:16:01.740061 27422 raft_consensus.cc:2468] T 1d81ab7648af4af195c1c4e76f22d17d P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd5ffdb93acf492d8a343cc3b6e1aa05 in term 0.
I20260709 12:16:01.740836 27314 leader_election.cc:304] T 1d81ab7648af4af195c1c4e76f22d17d P dd5ffdb93acf492d8a343cc3b6e1aa05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a0506729556426db8d473385faab326, dd5ffdb93acf492d8a343cc3b6e1aa05; no voters: 
I20260709 12:16:01.741559 27493 raft_consensus.cc:2804] T 1d81ab7648af4af195c1c4e76f22d17d P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:01.742125 27493 raft_consensus.cc:493] T 1d81ab7648af4af195c1c4e76f22d17d P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:01.742435 27493 raft_consensus.cc:3060] T 1d81ab7648af4af195c1c4e76f22d17d P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:01.748373 27493 raft_consensus.cc:515] T 1d81ab7648af4af195c1c4e76f22d17d P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.750238 27493 leader_election.cc:290] T 1d81ab7648af4af195c1c4e76f22d17d P dd5ffdb93acf492d8a343cc3b6e1aa05 [CANDIDATE]: Term 1 election: Requested vote from peers 0a0506729556426db8d473385faab326 (127.12.56.193:33959), 9ed05238324a485da065c10ec2ab6339 (127.12.56.195:39461)
I20260709 12:16:01.751333 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d81ab7648af4af195c1c4e76f22d17d" candidate_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a0506729556426db8d473385faab326"
I20260709 12:16:01.751569 27422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d81ab7648af4af195c1c4e76f22d17d" candidate_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ed05238324a485da065c10ec2ab6339"
I20260709 12:16:01.751953 27272 raft_consensus.cc:3060] T 1d81ab7648af4af195c1c4e76f22d17d P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:01.752218 27422 raft_consensus.cc:3060] T 1d81ab7648af4af195c1c4e76f22d17d P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:01.757951 27272 raft_consensus.cc:2468] T 1d81ab7648af4af195c1c4e76f22d17d P 0a0506729556426db8d473385faab326 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd5ffdb93acf492d8a343cc3b6e1aa05 in term 1.
I20260709 12:16:01.758318 27422 raft_consensus.cc:2468] T 1d81ab7648af4af195c1c4e76f22d17d P 9ed05238324a485da065c10ec2ab6339 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd5ffdb93acf492d8a343cc3b6e1aa05 in term 1.
I20260709 12:16:01.759200 27314 leader_election.cc:304] T 1d81ab7648af4af195c1c4e76f22d17d P dd5ffdb93acf492d8a343cc3b6e1aa05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a0506729556426db8d473385faab326, dd5ffdb93acf492d8a343cc3b6e1aa05; no voters: 
I20260709 12:16:01.760407 27493 raft_consensus.cc:2804] T 1d81ab7648af4af195c1c4e76f22d17d P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:01.760934 27493 raft_consensus.cc:697] T 1d81ab7648af4af195c1c4e76f22d17d P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 LEADER]: Becoming Leader. State: Replica: dd5ffdb93acf492d8a343cc3b6e1aa05, State: Running, Role: LEADER
I20260709 12:16:01.761947 27493 consensus_queue.cc:237] T 1d81ab7648af4af195c1c4e76f22d17d P dd5ffdb93acf492d8a343cc3b6e1aa05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.764555 27496 raft_consensus.cc:493] T 59e886aafa51485392355848493e17f0 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:01.765267 27496 raft_consensus.cc:515] T 59e886aafa51485392355848493e17f0 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.768370 27496 leader_election.cc:290] T 59e886aafa51485392355848493e17f0 P 9ed05238324a485da065c10ec2ab6339 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a0506729556426db8d473385faab326 (127.12.56.193:33959), dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194:39423)
I20260709 12:16:01.769099 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59e886aafa51485392355848493e17f0" candidate_uuid: "9ed05238324a485da065c10ec2ab6339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a0506729556426db8d473385faab326" is_pre_election: true
I20260709 12:16:01.769392 27348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59e886aafa51485392355848493e17f0" candidate_uuid: "9ed05238324a485da065c10ec2ab6339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" is_pre_election: true
I20260709 12:16:01.770159 27272 raft_consensus.cc:2393] T 59e886aafa51485392355848493e17f0 P 0a0506729556426db8d473385faab326 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ed05238324a485da065c10ec2ab6339 in current term 1: Already voted for candidate dd5ffdb93acf492d8a343cc3b6e1aa05 in this term.
I20260709 12:16:01.771283 27388 leader_election.cc:304] T 59e886aafa51485392355848493e17f0 P 9ed05238324a485da065c10ec2ab6339 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ed05238324a485da065c10ec2ab6339; no voters: 0a0506729556426db8d473385faab326, dd5ffdb93acf492d8a343cc3b6e1aa05
I20260709 12:16:01.772265 27496 raft_consensus.cc:3060] T 59e886aafa51485392355848493e17f0 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:01.771523 27168 catalog_manager.cc:5697] T 1d81ab7648af4af195c1c4e76f22d17d P dd5ffdb93acf492d8a343cc3b6e1aa05 reported cstate change: term changed from 0 to 1, leader changed from <none> to dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194). New cstate: current_term: 1 leader_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:01.780400 27496 raft_consensus.cc:2749] T 59e886aafa51485392355848493e17f0 P 9ed05238324a485da065c10ec2ab6339 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:01.786656 27466 raft_consensus.cc:493] T 8ca43ed5349646eea87075d7136ef40f P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:01.787256 27466 raft_consensus.cc:515] T 8ca43ed5349646eea87075d7136ef40f P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.789476 27466 leader_election.cc:290] T 8ca43ed5349646eea87075d7136ef40f P 0a0506729556426db8d473385faab326 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194:39423), 9ed05238324a485da065c10ec2ab6339 (127.12.56.195:39461)
I20260709 12:16:01.790236 27348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca43ed5349646eea87075d7136ef40f" candidate_uuid: "0a0506729556426db8d473385faab326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" is_pre_election: true
I20260709 12:16:01.790621 27422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca43ed5349646eea87075d7136ef40f" candidate_uuid: "0a0506729556426db8d473385faab326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ed05238324a485da065c10ec2ab6339" is_pre_election: true
I20260709 12:16:01.791250 27348 raft_consensus.cc:2393] T 8ca43ed5349646eea87075d7136ef40f P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0a0506729556426db8d473385faab326 in current term 1: Already voted for candidate 9ed05238324a485da065c10ec2ab6339 in this term.
I20260709 12:16:01.792356 27237 leader_election.cc:304] T 8ca43ed5349646eea87075d7136ef40f P 0a0506729556426db8d473385faab326 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a0506729556426db8d473385faab326; no voters: 9ed05238324a485da065c10ec2ab6339, dd5ffdb93acf492d8a343cc3b6e1aa05
I20260709 12:16:01.793147 27466 raft_consensus.cc:3060] T 8ca43ed5349646eea87075d7136ef40f P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:01.798892 27466 raft_consensus.cc:2749] T 8ca43ed5349646eea87075d7136ef40f P 0a0506729556426db8d473385faab326 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:01.815428 27496 consensus_queue.cc:1048] T 8ca43ed5349646eea87075d7136ef40f P 9ed05238324a485da065c10ec2ab6339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:01.829830 27422 raft_consensus.cc:3060] T 80110d11f7ae4434801099f8132d733d P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:01.832207 27496 consensus_queue.cc:1048] T 8ca43ed5349646eea87075d7136ef40f P 9ed05238324a485da065c10ec2ab6339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:01.840787 27471 consensus_queue.cc:1048] T 80110d11f7ae4434801099f8132d733d P dd5ffdb93acf492d8a343cc3b6e1aa05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:01.842442 27471 consensus_queue.cc:1048] T 80110d11f7ae4434801099f8132d733d P dd5ffdb93acf492d8a343cc3b6e1aa05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:01.910346 27471 raft_consensus.cc:493] T eab6587b21ca4b58b0d9b2696618e86e P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:01.911111 27471 raft_consensus.cc:515] T eab6587b21ca4b58b0d9b2696618e86e P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:01.913270 27471 leader_election.cc:290] T eab6587b21ca4b58b0d9b2696618e86e P dd5ffdb93acf492d8a343cc3b6e1aa05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a0506729556426db8d473385faab326 (127.12.56.193:33959), 9ed05238324a485da065c10ec2ab6339 (127.12.56.195:39461)
I20260709 12:16:01.914148 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eab6587b21ca4b58b0d9b2696618e86e" candidate_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a0506729556426db8d473385faab326" is_pre_election: true
I20260709 12:16:01.914600 27422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eab6587b21ca4b58b0d9b2696618e86e" candidate_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ed05238324a485da065c10ec2ab6339" is_pre_election: true
I20260709 12:16:01.915586 27422 raft_consensus.cc:2393] T eab6587b21ca4b58b0d9b2696618e86e P 9ed05238324a485da065c10ec2ab6339 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd5ffdb93acf492d8a343cc3b6e1aa05 in current term 1: Already voted for candidate 0a0506729556426db8d473385faab326 in this term.
I20260709 12:16:01.916679 27313 leader_election.cc:304] T eab6587b21ca4b58b0d9b2696618e86e P dd5ffdb93acf492d8a343cc3b6e1aa05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd5ffdb93acf492d8a343cc3b6e1aa05; no voters: 0a0506729556426db8d473385faab326, 9ed05238324a485da065c10ec2ab6339
I20260709 12:16:01.917464 27471 raft_consensus.cc:3060] T eab6587b21ca4b58b0d9b2696618e86e P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:01.923806 27466 consensus_queue.cc:1048] T 9d582472dd23411a9f4b724fa8138932 P 0a0506729556426db8d473385faab326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:01.925007 27471 raft_consensus.cc:2749] T eab6587b21ca4b58b0d9b2696618e86e P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:01.935727 27348 raft_consensus.cc:3060] T 9d582472dd23411a9f4b724fa8138932 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:01.946173 27466 consensus_queue.cc:1048] T 9d582472dd23411a9f4b724fa8138932 P 0a0506729556426db8d473385faab326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:01.973587 27471 consensus_queue.cc:1048] T 59e886aafa51485392355848493e17f0 P dd5ffdb93acf492d8a343cc3b6e1aa05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:01.974169 27496 consensus_queue.cc:1048] T 66448229321948caa5046d83678341ed P 9ed05238324a485da065c10ec2ab6339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:01.987587 27496 consensus_queue.cc:1048] T 66448229321948caa5046d83678341ed P 9ed05238324a485da065c10ec2ab6339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:01.997225 27493 consensus_queue.cc:1048] T 59e886aafa51485392355848493e17f0 P dd5ffdb93acf492d8a343cc3b6e1aa05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:16:02.008105 27497 consensus_queue.cc:1048] T f16afaec638c4a5fa540f3adbf285505 P dd5ffdb93acf492d8a343cc3b6e1aa05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:02.025702 27421 raft_consensus.cc:3060] T f16afaec638c4a5fa540f3adbf285505 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:02.044986 27497 consensus_queue.cc:1048] T f16afaec638c4a5fa540f3adbf285505 P dd5ffdb93acf492d8a343cc3b6e1aa05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:02.046808 27421 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d966e0df1b51483d8939dabb9fc4fc70"
dest_uuid: "9ed05238324a485da065c10ec2ab6339"
mode: GRACEFUL
new_leader_uuid: "0a0506729556426db8d473385faab326"
 from {username='slave'} at 127.0.0.1:48856
I20260709 12:16:02.047677 27421 raft_consensus.cc:606] T d966e0df1b51483d8939dabb9fc4fc70 P 9ed05238324a485da065c10ec2ab6339 [term 1 LEADER]: Received request to transfer leadership to TS 0a0506729556426db8d473385faab326
I20260709 12:16:02.070772 27345 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "80110d11f7ae4434801099f8132d733d"
dest_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05"
mode: GRACEFUL
new_leader_uuid: "0a0506729556426db8d473385faab326"
 from {username='slave'} at 127.0.0.1:43816
I20260709 12:16:02.071378 27345 raft_consensus.cc:606] T 80110d11f7ae4434801099f8132d733d P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 LEADER]: Received request to transfer leadership to TS 0a0506729556426db8d473385faab326
I20260709 12:16:02.077540 27420 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ca43ed5349646eea87075d7136ef40f"
dest_uuid: "9ed05238324a485da065c10ec2ab6339"
mode: GRACEFUL
new_leader_uuid: "0a0506729556426db8d473385faab326"
 from {username='slave'} at 127.0.0.1:48856
I20260709 12:16:02.078550 27420 raft_consensus.cc:606] T 8ca43ed5349646eea87075d7136ef40f P 9ed05238324a485da065c10ec2ab6339 [term 1 LEADER]: Received request to transfer leadership to TS 0a0506729556426db8d473385faab326
I20260709 12:16:02.103178 27272 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eab6587b21ca4b58b0d9b2696618e86e"
dest_uuid: "0a0506729556426db8d473385faab326"
mode: GRACEFUL
new_leader_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05"
 from {username='slave'} at 127.0.0.1:49164
I20260709 12:16:02.103861 27272 raft_consensus.cc:606] T eab6587b21ca4b58b0d9b2696618e86e P 0a0506729556426db8d473385faab326 [term 1 LEADER]: Received request to transfer leadership to TS dd5ffdb93acf492d8a343cc3b6e1aa05
I20260709 12:16:02.170073 27496 raft_consensus.cc:993] T d966e0df1b51483d8939dabb9fc4fc70 P 9ed05238324a485da065c10ec2ab6339: : Instructing follower 0a0506729556426db8d473385faab326 to start an election
I20260709 12:16:02.170548 27496 raft_consensus.cc:1081] T d966e0df1b51483d8939dabb9fc4fc70 P 9ed05238324a485da065c10ec2ab6339 [term 1 LEADER]: Signalling peer 0a0506729556426db8d473385faab326 to start an election
I20260709 12:16:02.172149 27272 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d966e0df1b51483d8939dabb9fc4fc70"
dest_uuid: "0a0506729556426db8d473385faab326"
 from {username='slave'} at 127.0.0.1:49146
I20260709 12:16:02.172791 27272 raft_consensus.cc:493] T d966e0df1b51483d8939dabb9fc4fc70 P 0a0506729556426db8d473385faab326 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:02.173242 27272 raft_consensus.cc:3060] T d966e0df1b51483d8939dabb9fc4fc70 P 0a0506729556426db8d473385faab326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:02.174853 27466 consensus_queue.cc:1048] T eab6587b21ca4b58b0d9b2696618e86e P 0a0506729556426db8d473385faab326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:02.180923 27272 raft_consensus.cc:515] T d966e0df1b51483d8939dabb9fc4fc70 P 0a0506729556426db8d473385faab326 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:02.183892 27466 raft_consensus.cc:993] T eab6587b21ca4b58b0d9b2696618e86e P 0a0506729556426db8d473385faab326: : Instructing follower dd5ffdb93acf492d8a343cc3b6e1aa05 to start an election
I20260709 12:16:02.184245 27272 leader_election.cc:290] T d966e0df1b51483d8939dabb9fc4fc70 P 0a0506729556426db8d473385faab326 [CANDIDATE]: Term 2 election: Requested vote from peers dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194:39423), 9ed05238324a485da065c10ec2ab6339 (127.12.56.195:39461)
I20260709 12:16:02.184398 27466 raft_consensus.cc:1081] T eab6587b21ca4b58b0d9b2696618e86e P 0a0506729556426db8d473385faab326 [term 1 LEADER]: Signalling peer dd5ffdb93acf492d8a343cc3b6e1aa05 to start an election
I20260709 12:16:02.187693 27420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d966e0df1b51483d8939dabb9fc4fc70" candidate_uuid: "0a0506729556426db8d473385faab326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ed05238324a485da065c10ec2ab6339"
I20260709 12:16:02.188460 27420 raft_consensus.cc:3055] T d966e0df1b51483d8939dabb9fc4fc70 P 9ed05238324a485da065c10ec2ab6339 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:02.188876 27420 raft_consensus.cc:740] T d966e0df1b51483d8939dabb9fc4fc70 P 9ed05238324a485da065c10ec2ab6339 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ed05238324a485da065c10ec2ab6339, State: Running, Role: LEADER
I20260709 12:16:02.190042 27348 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eab6587b21ca4b58b0d9b2696618e86e"
dest_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05"
 from {username='slave'} at 127.0.0.1:43800
I20260709 12:16:02.189847 27420 consensus_queue.cc:260] T d966e0df1b51483d8939dabb9fc4fc70 P 9ed05238324a485da065c10ec2ab6339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:02.190729 27348 raft_consensus.cc:493] T eab6587b21ca4b58b0d9b2696618e86e P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:02.191175 27348 raft_consensus.cc:3060] T eab6587b21ca4b58b0d9b2696618e86e P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:02.191442 27420 raft_consensus.cc:3060] T d966e0df1b51483d8939dabb9fc4fc70 P 9ed05238324a485da065c10ec2ab6339 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:02.191434 27345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d966e0df1b51483d8939dabb9fc4fc70" candidate_uuid: "0a0506729556426db8d473385faab326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05"
I20260709 12:16:02.194141 27345 raft_consensus.cc:3060] T d966e0df1b51483d8939dabb9fc4fc70 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:02.195101 27466 consensus_queue.cc:1048] T eab6587b21ca4b58b0d9b2696618e86e P 0a0506729556426db8d473385faab326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:02.202883 27420 raft_consensus.cc:2468] T d966e0df1b51483d8939dabb9fc4fc70 P 9ed05238324a485da065c10ec2ab6339 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a0506729556426db8d473385faab326 in term 2.
I20260709 12:16:02.203140 27345 raft_consensus.cc:2468] T d966e0df1b51483d8939dabb9fc4fc70 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a0506729556426db8d473385faab326 in term 2.
I20260709 12:16:02.205096 27237 leader_election.cc:304] T d966e0df1b51483d8939dabb9fc4fc70 P 0a0506729556426db8d473385faab326 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a0506729556426db8d473385faab326, dd5ffdb93acf492d8a343cc3b6e1aa05; no voters: 
I20260709 12:16:02.206239 27466 raft_consensus.cc:2804] T d966e0df1b51483d8939dabb9fc4fc70 P 0a0506729556426db8d473385faab326 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:02.207582 27466 raft_consensus.cc:697] T d966e0df1b51483d8939dabb9fc4fc70 P 0a0506729556426db8d473385faab326 [term 2 LEADER]: Becoming Leader. State: Replica: 0a0506729556426db8d473385faab326, State: Running, Role: LEADER
I20260709 12:16:02.207762 27348 raft_consensus.cc:515] T eab6587b21ca4b58b0d9b2696618e86e P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:02.208530 27466 consensus_queue.cc:237] T d966e0df1b51483d8939dabb9fc4fc70 P 0a0506729556426db8d473385faab326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:02.211042 27348 leader_election.cc:290] T eab6587b21ca4b58b0d9b2696618e86e P dd5ffdb93acf492d8a343cc3b6e1aa05 [CANDIDATE]: Term 2 election: Requested vote from peers 0a0506729556426db8d473385faab326 (127.12.56.193:33959), 9ed05238324a485da065c10ec2ab6339 (127.12.56.195:39461)
I20260709 12:16:02.211380 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eab6587b21ca4b58b0d9b2696618e86e" candidate_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0a0506729556426db8d473385faab326"
I20260709 12:16:02.212146 27272 raft_consensus.cc:3055] T eab6587b21ca4b58b0d9b2696618e86e P 0a0506729556426db8d473385faab326 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:02.212495 27272 raft_consensus.cc:740] T eab6587b21ca4b58b0d9b2696618e86e P 0a0506729556426db8d473385faab326 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0a0506729556426db8d473385faab326, State: Running, Role: LEADER
I20260709 12:16:02.213164 27421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eab6587b21ca4b58b0d9b2696618e86e" candidate_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ed05238324a485da065c10ec2ab6339"
I20260709 12:16:02.213340 27272 consensus_queue.cc:260] T eab6587b21ca4b58b0d9b2696618e86e P 0a0506729556426db8d473385faab326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:02.213984 27421 raft_consensus.cc:3060] T eab6587b21ca4b58b0d9b2696618e86e P 9ed05238324a485da065c10ec2ab6339 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:02.214946 27272 raft_consensus.cc:3060] T eab6587b21ca4b58b0d9b2696618e86e P 0a0506729556426db8d473385faab326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:02.221643 27168 catalog_manager.cc:5697] T d966e0df1b51483d8939dabb9fc4fc70 P 0a0506729556426db8d473385faab326 reported cstate change: term changed from 1 to 2, leader changed from 9ed05238324a485da065c10ec2ab6339 (127.12.56.195) to 0a0506729556426db8d473385faab326 (127.12.56.193). New cstate: current_term: 2 leader_uuid: "0a0506729556426db8d473385faab326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:02.222469 27421 raft_consensus.cc:2468] T eab6587b21ca4b58b0d9b2696618e86e P 9ed05238324a485da065c10ec2ab6339 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd5ffdb93acf492d8a343cc3b6e1aa05 in term 2.
I20260709 12:16:02.223906 27313 leader_election.cc:304] T eab6587b21ca4b58b0d9b2696618e86e P dd5ffdb93acf492d8a343cc3b6e1aa05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ed05238324a485da065c10ec2ab6339, dd5ffdb93acf492d8a343cc3b6e1aa05; no voters: 
I20260709 12:16:02.224839 27497 raft_consensus.cc:2804] T eab6587b21ca4b58b0d9b2696618e86e P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:02.225358 27272 raft_consensus.cc:2468] T eab6587b21ca4b58b0d9b2696618e86e P 0a0506729556426db8d473385faab326 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd5ffdb93acf492d8a343cc3b6e1aa05 in term 2.
I20260709 12:16:02.225359 27497 raft_consensus.cc:697] T eab6587b21ca4b58b0d9b2696618e86e P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 2 LEADER]: Becoming Leader. State: Replica: dd5ffdb93acf492d8a343cc3b6e1aa05, State: Running, Role: LEADER
I20260709 12:16:02.226697 27497 consensus_queue.cc:237] T eab6587b21ca4b58b0d9b2696618e86e P dd5ffdb93acf492d8a343cc3b6e1aa05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:02.234774 27497 consensus_queue.cc:1048] T 1d81ab7648af4af195c1c4e76f22d17d P dd5ffdb93acf492d8a343cc3b6e1aa05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:02.235689 27168 catalog_manager.cc:5697] T eab6587b21ca4b58b0d9b2696618e86e P dd5ffdb93acf492d8a343cc3b6e1aa05 reported cstate change: term changed from 1 to 2, leader changed from 0a0506729556426db8d473385faab326 (127.12.56.193) to dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194). New cstate: current_term: 2 leader_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:02.251748 27497 consensus_queue.cc:1048] T 1d81ab7648af4af195c1c4e76f22d17d P dd5ffdb93acf492d8a343cc3b6e1aa05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:02.373915 27493 raft_consensus.cc:993] T 80110d11f7ae4434801099f8132d733d P dd5ffdb93acf492d8a343cc3b6e1aa05: : Instructing follower 0a0506729556426db8d473385faab326 to start an election
I20260709 12:16:02.374640 27497 raft_consensus.cc:1081] T 80110d11f7ae4434801099f8132d733d P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 LEADER]: Signalling peer 0a0506729556426db8d473385faab326 to start an election
I20260709 12:16:02.376233 27272 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "80110d11f7ae4434801099f8132d733d"
dest_uuid: "0a0506729556426db8d473385faab326"
 from {username='slave'} at 127.0.0.1:49152
I20260709 12:16:02.376750 27272 raft_consensus.cc:493] T 80110d11f7ae4434801099f8132d733d P 0a0506729556426db8d473385faab326 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:02.377080 27272 raft_consensus.cc:3060] T 80110d11f7ae4434801099f8132d733d P 0a0506729556426db8d473385faab326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:02.382941 27272 raft_consensus.cc:515] T 80110d11f7ae4434801099f8132d733d P 0a0506729556426db8d473385faab326 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:02.384768 27272 leader_election.cc:290] T 80110d11f7ae4434801099f8132d733d P 0a0506729556426db8d473385faab326 [CANDIDATE]: Term 2 election: Requested vote from peers dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194:39423), 9ed05238324a485da065c10ec2ab6339 (127.12.56.195:39461)
I20260709 12:16:02.386023 27421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80110d11f7ae4434801099f8132d733d" candidate_uuid: "0a0506729556426db8d473385faab326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ed05238324a485da065c10ec2ab6339"
I20260709 12:16:02.385888 27348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80110d11f7ae4434801099f8132d733d" candidate_uuid: "0a0506729556426db8d473385faab326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05"
I20260709 12:16:02.386816 27348 raft_consensus.cc:3055] T 80110d11f7ae4434801099f8132d733d P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:02.387236 27348 raft_consensus.cc:740] T 80110d11f7ae4434801099f8132d733d P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dd5ffdb93acf492d8a343cc3b6e1aa05, State: Running, Role: LEADER
I20260709 12:16:02.387584 27421 raft_consensus.cc:3060] T 80110d11f7ae4434801099f8132d733d P 9ed05238324a485da065c10ec2ab6339 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:02.388075 27348 consensus_queue.cc:260] T 80110d11f7ae4434801099f8132d733d P dd5ffdb93acf492d8a343cc3b6e1aa05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:02.389217 27348 raft_consensus.cc:3060] T 80110d11f7ae4434801099f8132d733d P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:02.394332 27421 raft_consensus.cc:2468] T 80110d11f7ae4434801099f8132d733d P 9ed05238324a485da065c10ec2ab6339 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a0506729556426db8d473385faab326 in term 2.
I20260709 12:16:02.394990 27348 raft_consensus.cc:2468] T 80110d11f7ae4434801099f8132d733d P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a0506729556426db8d473385faab326 in term 2.
I20260709 12:16:02.395829 27238 leader_election.cc:304] T 80110d11f7ae4434801099f8132d733d P 0a0506729556426db8d473385faab326 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a0506729556426db8d473385faab326, 9ed05238324a485da065c10ec2ab6339; no voters: 
I20260709 12:16:02.396829 27466 raft_consensus.cc:2804] T 80110d11f7ae4434801099f8132d733d P 0a0506729556426db8d473385faab326 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:02.397397 27466 raft_consensus.cc:697] T 80110d11f7ae4434801099f8132d733d P 0a0506729556426db8d473385faab326 [term 2 LEADER]: Becoming Leader. State: Replica: 0a0506729556426db8d473385faab326, State: Running, Role: LEADER
I20260709 12:16:02.398209 27466 consensus_queue.cc:237] T 80110d11f7ae4434801099f8132d733d P 0a0506729556426db8d473385faab326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:02.405709 27168 catalog_manager.cc:5697] T 80110d11f7ae4434801099f8132d733d P 0a0506729556426db8d473385faab326 reported cstate change: term changed from 1 to 2, leader changed from dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194) to 0a0506729556426db8d473385faab326 (127.12.56.193). New cstate: current_term: 2 leader_uuid: "0a0506729556426db8d473385faab326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:02.413746 27496 raft_consensus.cc:993] T 8ca43ed5349646eea87075d7136ef40f P 9ed05238324a485da065c10ec2ab6339: : Instructing follower 0a0506729556426db8d473385faab326 to start an election
I20260709 12:16:02.414422 27484 raft_consensus.cc:1081] T 8ca43ed5349646eea87075d7136ef40f P 9ed05238324a485da065c10ec2ab6339 [term 1 LEADER]: Signalling peer 0a0506729556426db8d473385faab326 to start an election
I20260709 12:16:02.416860 27272 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8ca43ed5349646eea87075d7136ef40f"
dest_uuid: "0a0506729556426db8d473385faab326"
 from {username='slave'} at 127.0.0.1:49146
I20260709 12:16:02.417699 27272 raft_consensus.cc:493] T 8ca43ed5349646eea87075d7136ef40f P 0a0506729556426db8d473385faab326 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:02.418290 27272 raft_consensus.cc:3060] T 8ca43ed5349646eea87075d7136ef40f P 0a0506729556426db8d473385faab326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:02.425074 27272 raft_consensus.cc:515] T 8ca43ed5349646eea87075d7136ef40f P 0a0506729556426db8d473385faab326 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:02.426888 27272 leader_election.cc:290] T 8ca43ed5349646eea87075d7136ef40f P 0a0506729556426db8d473385faab326 [CANDIDATE]: Term 2 election: Requested vote from peers dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194:39423), 9ed05238324a485da065c10ec2ab6339 (127.12.56.195:39461)
I20260709 12:16:02.427913 27348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca43ed5349646eea87075d7136ef40f" candidate_uuid: "0a0506729556426db8d473385faab326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05"
I20260709 12:16:02.428150 27421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca43ed5349646eea87075d7136ef40f" candidate_uuid: "0a0506729556426db8d473385faab326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ed05238324a485da065c10ec2ab6339"
I20260709 12:16:02.428659 27348 raft_consensus.cc:3060] T 8ca43ed5349646eea87075d7136ef40f P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:02.428761 27421 raft_consensus.cc:3055] T 8ca43ed5349646eea87075d7136ef40f P 9ed05238324a485da065c10ec2ab6339 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:02.429260 27421 raft_consensus.cc:740] T 8ca43ed5349646eea87075d7136ef40f P 9ed05238324a485da065c10ec2ab6339 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ed05238324a485da065c10ec2ab6339, State: Running, Role: LEADER
I20260709 12:16:02.430027 27421 consensus_queue.cc:260] T 8ca43ed5349646eea87075d7136ef40f P 9ed05238324a485da065c10ec2ab6339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:02.431097 27421 raft_consensus.cc:3060] T 8ca43ed5349646eea87075d7136ef40f P 9ed05238324a485da065c10ec2ab6339 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:02.435081 27348 raft_consensus.cc:2468] T 8ca43ed5349646eea87075d7136ef40f P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a0506729556426db8d473385faab326 in term 2.
I20260709 12:16:02.436450 27237 leader_election.cc:304] T 8ca43ed5349646eea87075d7136ef40f P 0a0506729556426db8d473385faab326 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a0506729556426db8d473385faab326, dd5ffdb93acf492d8a343cc3b6e1aa05; no voters: 
I20260709 12:16:02.437288 27502 raft_consensus.cc:2804] T 8ca43ed5349646eea87075d7136ef40f P 0a0506729556426db8d473385faab326 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:02.437803 27502 raft_consensus.cc:697] T 8ca43ed5349646eea87075d7136ef40f P 0a0506729556426db8d473385faab326 [term 2 LEADER]: Becoming Leader. State: Replica: 0a0506729556426db8d473385faab326, State: Running, Role: LEADER
I20260709 12:16:02.438233 27421 raft_consensus.cc:2468] T 8ca43ed5349646eea87075d7136ef40f P 9ed05238324a485da065c10ec2ab6339 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a0506729556426db8d473385faab326 in term 2.
I20260709 12:16:02.438719 27502 consensus_queue.cc:237] T 8ca43ed5349646eea87075d7136ef40f P 0a0506729556426db8d473385faab326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:02.446070 27169 catalog_manager.cc:5697] T 8ca43ed5349646eea87075d7136ef40f P 0a0506729556426db8d473385faab326 reported cstate change: term changed from 1 to 2, leader changed from 9ed05238324a485da065c10ec2ab6339 (127.12.56.195) to 0a0506729556426db8d473385faab326 (127.12.56.193). New cstate: current_term: 2 leader_uuid: "0a0506729556426db8d473385faab326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:02.686522 27272 raft_consensus.cc:1275] T eab6587b21ca4b58b0d9b2696618e86e P 0a0506729556426db8d473385faab326 [term 2 FOLLOWER]: Refusing update from remote peer dd5ffdb93acf492d8a343cc3b6e1aa05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:02.687933 27497 consensus_queue.cc:1048] T eab6587b21ca4b58b0d9b2696618e86e P dd5ffdb93acf492d8a343cc3b6e1aa05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:02.695609 27348 raft_consensus.cc:1275] T d966e0df1b51483d8939dabb9fc4fc70 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 2 FOLLOWER]: Refusing update from remote peer 0a0506729556426db8d473385faab326: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:02.697414 27502 consensus_queue.cc:1048] T d966e0df1b51483d8939dabb9fc4fc70 P 0a0506729556426db8d473385faab326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:02.698434 27421 raft_consensus.cc:1275] T eab6587b21ca4b58b0d9b2696618e86e P 9ed05238324a485da065c10ec2ab6339 [term 2 FOLLOWER]: Refusing update from remote peer dd5ffdb93acf492d8a343cc3b6e1aa05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:02.700551 27493 consensus_queue.cc:1048] T eab6587b21ca4b58b0d9b2696618e86e P dd5ffdb93acf492d8a343cc3b6e1aa05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:02.713387 27420 raft_consensus.cc:1275] T d966e0df1b51483d8939dabb9fc4fc70 P 9ed05238324a485da065c10ec2ab6339 [term 2 FOLLOWER]: Refusing update from remote peer 0a0506729556426db8d473385faab326: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:02.715922 27466 consensus_queue.cc:1048] T d966e0df1b51483d8939dabb9fc4fc70 P 0a0506729556426db8d473385faab326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:02.836640 27348 raft_consensus.cc:1275] T 8ca43ed5349646eea87075d7136ef40f P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 2 FOLLOWER]: Refusing update from remote peer 0a0506729556426db8d473385faab326: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:02.838351 27466 consensus_queue.cc:1048] T 8ca43ed5349646eea87075d7136ef40f P 0a0506729556426db8d473385faab326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:02.850055 27420 raft_consensus.cc:1275] T 8ca43ed5349646eea87075d7136ef40f P 9ed05238324a485da065c10ec2ab6339 [term 2 FOLLOWER]: Refusing update from remote peer 0a0506729556426db8d473385faab326: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:02.851716 27533 consensus_queue.cc:1048] T 8ca43ed5349646eea87075d7136ef40f P 0a0506729556426db8d473385faab326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:02.882995 27420 raft_consensus.cc:1275] T 80110d11f7ae4434801099f8132d733d P 9ed05238324a485da065c10ec2ab6339 [term 2 FOLLOWER]: Refusing update from remote peer 0a0506729556426db8d473385faab326: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:02.884325 27533 consensus_queue.cc:1048] T 80110d11f7ae4434801099f8132d733d P 0a0506729556426db8d473385faab326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:02.891487 27348 raft_consensus.cc:1275] T 80110d11f7ae4434801099f8132d733d P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 2 FOLLOWER]: Refusing update from remote peer 0a0506729556426db8d473385faab326: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:02.893180 27551 consensus_queue.cc:1048] T 80110d11f7ae4434801099f8132d733d P 0a0506729556426db8d473385faab326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:05.142385 27168 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49254:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:16:05.144647 27168 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:16:05.197449 27258 tablet_service.cc:1511] Processing CreateTablet for tablet aa55fdcc1b254bd9bfdabf150f131087 (DEFAULT_TABLE table=soft_deleted_table [id=8fd2145e16ab4994aef4433da334c7c1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:16:05.198833 27258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa55fdcc1b254bd9bfdabf150f131087. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:05.198597 27338 tablet_service.cc:1511] Processing CreateTablet for tablet aa55fdcc1b254bd9bfdabf150f131087 (DEFAULT_TABLE table=soft_deleted_table [id=8fd2145e16ab4994aef4433da334c7c1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:16:05.199980 27338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa55fdcc1b254bd9bfdabf150f131087. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:05.199663 27405 tablet_service.cc:1511] Processing CreateTablet for tablet aa55fdcc1b254bd9bfdabf150f131087 (DEFAULT_TABLE table=soft_deleted_table [id=8fd2145e16ab4994aef4433da334c7c1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:16:05.203500 27405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa55fdcc1b254bd9bfdabf150f131087. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:05.203214 27332 tablet_service.cc:1511] Processing CreateTablet for tablet d5508d37842541ff874bc41bf8f41784 (DEFAULT_TABLE table=soft_deleted_table [id=8fd2145e16ab4994aef4433da334c7c1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:16:05.203595 27260 tablet_service.cc:1511] Processing CreateTablet for tablet d5508d37842541ff874bc41bf8f41784 (DEFAULT_TABLE table=soft_deleted_table [id=8fd2145e16ab4994aef4433da334c7c1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:16:05.204726 27332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5508d37842541ff874bc41bf8f41784. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:05.205046 27260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5508d37842541ff874bc41bf8f41784. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:05.220736 27410 tablet_service.cc:1511] Processing CreateTablet for tablet d5508d37842541ff874bc41bf8f41784 (DEFAULT_TABLE table=soft_deleted_table [id=8fd2145e16ab4994aef4433da334c7c1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:16:05.222326 27410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5508d37842541ff874bc41bf8f41784. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:05.222473 27256 tablet_service.cc:1511] Processing CreateTablet for tablet 972b0f22614e4759b9c9a2454dada333 (DEFAULT_TABLE table=soft_deleted_table [id=8fd2145e16ab4994aef4433da334c7c1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:16:05.224777 27256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 972b0f22614e4759b9c9a2454dada333. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:05.236943 27333 tablet_service.cc:1511] Processing CreateTablet for tablet 972b0f22614e4759b9c9a2454dada333 (DEFAULT_TABLE table=soft_deleted_table [id=8fd2145e16ab4994aef4433da334c7c1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:16:05.238758 27333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 972b0f22614e4759b9c9a2454dada333. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:05.238440 27408 tablet_service.cc:1511] Processing CreateTablet for tablet 972b0f22614e4759b9c9a2454dada333 (DEFAULT_TABLE table=soft_deleted_table [id=8fd2145e16ab4994aef4433da334c7c1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:16:05.240039 27408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 972b0f22614e4759b9c9a2454dada333. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:05.241575 27567 tablet_bootstrap.cc:492] T aa55fdcc1b254bd9bfdabf150f131087 P 0a0506729556426db8d473385faab326: Bootstrap starting.
I20260709 12:16:05.254036 27258 tablet_service.cc:1511] Processing CreateTablet for tablet 0a03180a7e6744d5b9f132803996caf0 (DEFAULT_TABLE table=soft_deleted_table [id=8fd2145e16ab4994aef4433da334c7c1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:16:05.255906 27258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a03180a7e6744d5b9f132803996caf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:05.270740 27567 tablet_bootstrap.cc:654] T aa55fdcc1b254bd9bfdabf150f131087 P 0a0506729556426db8d473385faab326: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:05.271567 27569 tablet_bootstrap.cc:492] T aa55fdcc1b254bd9bfdabf150f131087 P dd5ffdb93acf492d8a343cc3b6e1aa05: Bootstrap starting.
I20260709 12:16:05.278390 27410 tablet_service.cc:1511] Processing CreateTablet for tablet 0a03180a7e6744d5b9f132803996caf0 (DEFAULT_TABLE table=soft_deleted_table [id=8fd2145e16ab4994aef4433da334c7c1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:16:05.280025 27410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a03180a7e6744d5b9f132803996caf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:05.269877 27332 tablet_service.cc:1511] Processing CreateTablet for tablet 0a03180a7e6744d5b9f132803996caf0 (DEFAULT_TABLE table=soft_deleted_table [id=8fd2145e16ab4994aef4433da334c7c1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:16:05.283161 27568 tablet_bootstrap.cc:492] T aa55fdcc1b254bd9bfdabf150f131087 P 9ed05238324a485da065c10ec2ab6339: Bootstrap starting.
I20260709 12:16:05.283697 27332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a03180a7e6744d5b9f132803996caf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:05.289863 27262 tablet_service.cc:1511] Processing CreateTablet for tablet 63806869f2eb4957b569e050893620ad (DEFAULT_TABLE table=soft_deleted_table [id=8fd2145e16ab4994aef4433da334c7c1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:16:05.291929 27262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63806869f2eb4957b569e050893620ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:05.305332 27338 tablet_service.cc:1511] Processing CreateTablet for tablet 63806869f2eb4957b569e050893620ad (DEFAULT_TABLE table=soft_deleted_table [id=8fd2145e16ab4994aef4433da334c7c1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:16:05.306856 27338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63806869f2eb4957b569e050893620ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:05.312312 27569 tablet_bootstrap.cc:654] T aa55fdcc1b254bd9bfdabf150f131087 P dd5ffdb93acf492d8a343cc3b6e1aa05: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:05.312811 27410 tablet_service.cc:1511] Processing CreateTablet for tablet 63806869f2eb4957b569e050893620ad (DEFAULT_TABLE table=soft_deleted_table [id=8fd2145e16ab4994aef4433da334c7c1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:16:05.313449 27258 tablet_service.cc:1511] Processing CreateTablet for tablet 7baaab759f2c4b4ab1ea3d0578ed0c06 (DEFAULT_TABLE table=soft_deleted_table [id=8fd2145e16ab4994aef4433da334c7c1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:16:05.315343 27258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7baaab759f2c4b4ab1ea3d0578ed0c06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:05.317890 27331 tablet_service.cc:1511] Processing CreateTablet for tablet 7baaab759f2c4b4ab1ea3d0578ed0c06 (DEFAULT_TABLE table=soft_deleted_table [id=8fd2145e16ab4994aef4433da334c7c1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:16:05.319487 27331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7baaab759f2c4b4ab1ea3d0578ed0c06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:05.320142 27405 tablet_service.cc:1511] Processing CreateTablet for tablet 7baaab759f2c4b4ab1ea3d0578ed0c06 (DEFAULT_TABLE table=soft_deleted_table [id=8fd2145e16ab4994aef4433da334c7c1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:16:05.323166 27567 tablet_bootstrap.cc:492] T aa55fdcc1b254bd9bfdabf150f131087 P 0a0506729556426db8d473385faab326: No bootstrap required, opened a new log
I20260709 12:16:05.323813 27567 ts_tablet_manager.cc:1403] T aa55fdcc1b254bd9bfdabf150f131087 P 0a0506729556426db8d473385faab326: Time spent bootstrapping tablet: real 0.083s	user 0.021s	sys 0.000s
I20260709 12:16:05.327337 27260 tablet_service.cc:1511] Processing CreateTablet for tablet 41a4729ca1394ea0ac6f01132efd57f0 (DEFAULT_TABLE table=soft_deleted_table [id=8fd2145e16ab4994aef4433da334c7c1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:16:05.314304 27410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63806869f2eb4957b569e050893620ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:05.327497 27567 raft_consensus.cc:359] T aa55fdcc1b254bd9bfdabf150f131087 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:05.328492 27567 raft_consensus.cc:385] T aa55fdcc1b254bd9bfdabf150f131087 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:05.328855 27567 raft_consensus.cc:740] T aa55fdcc1b254bd9bfdabf150f131087 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a0506729556426db8d473385faab326, State: Initialized, Role: FOLLOWER
I20260709 12:16:05.335073 27333 tablet_service.cc:1511] Processing CreateTablet for tablet 41a4729ca1394ea0ac6f01132efd57f0 (DEFAULT_TABLE table=soft_deleted_table [id=8fd2145e16ab4994aef4433da334c7c1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:16:05.336611 27411 tablet_service.cc:1511] Processing CreateTablet for tablet 41a4729ca1394ea0ac6f01132efd57f0 (DEFAULT_TABLE table=soft_deleted_table [id=8fd2145e16ab4994aef4433da334c7c1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:16:05.337997 27411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41a4729ca1394ea0ac6f01132efd57f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:05.340960 27405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7baaab759f2c4b4ab1ea3d0578ed0c06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:05.343039 27567 consensus_queue.cc:260] T aa55fdcc1b254bd9bfdabf150f131087 P 0a0506729556426db8d473385faab326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:05.329145 27260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41a4729ca1394ea0ac6f01132efd57f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:05.353327 27568 tablet_bootstrap.cc:654] T aa55fdcc1b254bd9bfdabf150f131087 P 9ed05238324a485da065c10ec2ab6339: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:05.360186 27569 tablet_bootstrap.cc:492] T aa55fdcc1b254bd9bfdabf150f131087 P dd5ffdb93acf492d8a343cc3b6e1aa05: No bootstrap required, opened a new log
I20260709 12:16:05.366122 27567 ts_tablet_manager.cc:1434] T aa55fdcc1b254bd9bfdabf150f131087 P 0a0506729556426db8d473385faab326: Time spent starting tablet: real 0.042s	user 0.011s	sys 0.000s
I20260709 12:16:05.369174 27334 tablet_service.cc:1511] Processing CreateTablet for tablet 9b043163bdc941cba463321241b1bef4 (DEFAULT_TABLE table=soft_deleted_table [id=8fd2145e16ab4994aef4433da334c7c1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:16:05.370332 27569 ts_tablet_manager.cc:1403] T aa55fdcc1b254bd9bfdabf150f131087 P dd5ffdb93acf492d8a343cc3b6e1aa05: Time spent bootstrapping tablet: real 0.111s	user 0.015s	sys 0.000s
I20260709 12:16:05.372613 27567 tablet_bootstrap.cc:492] T d5508d37842541ff874bc41bf8f41784 P 0a0506729556426db8d473385faab326: Bootstrap starting.
I20260709 12:16:05.336692 27333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41a4729ca1394ea0ac6f01132efd57f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:05.378340 27334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b043163bdc941cba463321241b1bef4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:05.380566 27569 raft_consensus.cc:359] T aa55fdcc1b254bd9bfdabf150f131087 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:05.382529 27569 raft_consensus.cc:385] T aa55fdcc1b254bd9bfdabf150f131087 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:05.383010 27569 raft_consensus.cc:740] T aa55fdcc1b254bd9bfdabf150f131087 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd5ffdb93acf492d8a343cc3b6e1aa05, State: Initialized, Role: FOLLOWER
I20260709 12:16:05.384092 27569 consensus_queue.cc:260] T aa55fdcc1b254bd9bfdabf150f131087 P dd5ffdb93acf492d8a343cc3b6e1aa05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:05.382171 27256 tablet_service.cc:1511] Processing CreateTablet for tablet 9b043163bdc941cba463321241b1bef4 (DEFAULT_TABLE table=soft_deleted_table [id=8fd2145e16ab4994aef4433da334c7c1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:16:05.388407 27408 tablet_service.cc:1511] Processing CreateTablet for tablet 9b043163bdc941cba463321241b1bef4 (DEFAULT_TABLE table=soft_deleted_table [id=8fd2145e16ab4994aef4433da334c7c1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:16:05.388556 27262 tablet_service.cc:1511] Processing CreateTablet for tablet 71be868a9d474261a6b88e2e66af4e85 (DEFAULT_TABLE table=soft_deleted_table [id=8fd2145e16ab4994aef4433da334c7c1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:16:05.392294 27408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b043163bdc941cba463321241b1bef4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:05.389988 27331 tablet_service.cc:1511] Processing CreateTablet for tablet 71be868a9d474261a6b88e2e66af4e85 (DEFAULT_TABLE table=soft_deleted_table [id=8fd2145e16ab4994aef4433da334c7c1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:16:05.392948 27406 tablet_service.cc:1511] Processing CreateTablet for tablet 71be868a9d474261a6b88e2e66af4e85 (DEFAULT_TABLE table=soft_deleted_table [id=8fd2145e16ab4994aef4433da334c7c1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:16:05.394405 27406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71be868a9d474261a6b88e2e66af4e85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:05.395576 27262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71be868a9d474261a6b88e2e66af4e85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:05.395733 27569 ts_tablet_manager.cc:1434] T aa55fdcc1b254bd9bfdabf150f131087 P dd5ffdb93acf492d8a343cc3b6e1aa05: Time spent starting tablet: real 0.019s	user 0.002s	sys 0.006s
I20260709 12:16:05.396473 27256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b043163bdc941cba463321241b1bef4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:05.402191 27331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71be868a9d474261a6b88e2e66af4e85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:05.411617 27569 tablet_bootstrap.cc:492] T d5508d37842541ff874bc41bf8f41784 P dd5ffdb93acf492d8a343cc3b6e1aa05: Bootstrap starting.
I20260709 12:16:05.420746 27555 raft_consensus.cc:493] T aa55fdcc1b254bd9bfdabf150f131087 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:05.421371 27555 raft_consensus.cc:515] T aa55fdcc1b254bd9bfdabf150f131087 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:05.424944 27420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa55fdcc1b254bd9bfdabf150f131087" candidate_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ed05238324a485da065c10ec2ab6339" is_pre_election: true
I20260709 12:16:05.426038 27569 tablet_bootstrap.cc:654] T d5508d37842541ff874bc41bf8f41784 P dd5ffdb93acf492d8a343cc3b6e1aa05: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:05.426766 27313 leader_election.cc:343] T aa55fdcc1b254bd9bfdabf150f131087 P dd5ffdb93acf492d8a343cc3b6e1aa05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ed05238324a485da065c10ec2ab6339 (127.12.56.195:39461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:05.428643 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa55fdcc1b254bd9bfdabf150f131087" candidate_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a0506729556426db8d473385faab326" is_pre_election: true
I20260709 12:16:05.416288 27567 tablet_bootstrap.cc:654] T d5508d37842541ff874bc41bf8f41784 P 0a0506729556426db8d473385faab326: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:05.430109 27272 raft_consensus.cc:2468] T aa55fdcc1b254bd9bfdabf150f131087 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd5ffdb93acf492d8a343cc3b6e1aa05 in term 0.
I20260709 12:16:05.431933 27314 leader_election.cc:304] T aa55fdcc1b254bd9bfdabf150f131087 P dd5ffdb93acf492d8a343cc3b6e1aa05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a0506729556426db8d473385faab326, dd5ffdb93acf492d8a343cc3b6e1aa05; no voters: 9ed05238324a485da065c10ec2ab6339
I20260709 12:16:05.426132 27555 leader_election.cc:290] T aa55fdcc1b254bd9bfdabf150f131087 P dd5ffdb93acf492d8a343cc3b6e1aa05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a0506729556426db8d473385faab326 (127.12.56.193:33959), 9ed05238324a485da065c10ec2ab6339 (127.12.56.195:39461)
I20260709 12:16:05.432783 27568 tablet_bootstrap.cc:492] T aa55fdcc1b254bd9bfdabf150f131087 P 9ed05238324a485da065c10ec2ab6339: No bootstrap required, opened a new log
I20260709 12:16:05.436115 27555 raft_consensus.cc:2804] T aa55fdcc1b254bd9bfdabf150f131087 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:05.436697 27555 raft_consensus.cc:493] T aa55fdcc1b254bd9bfdabf150f131087 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:05.437243 27555 raft_consensus.cc:3060] T aa55fdcc1b254bd9bfdabf150f131087 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:05.452489 27555 raft_consensus.cc:515] T aa55fdcc1b254bd9bfdabf150f131087 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:05.444067 27568 ts_tablet_manager.cc:1403] T aa55fdcc1b254bd9bfdabf150f131087 P 9ed05238324a485da065c10ec2ab6339: Time spent bootstrapping tablet: real 0.161s	user 0.015s	sys 0.000s
I20260709 12:16:05.459474 27569 tablet_bootstrap.cc:492] T d5508d37842541ff874bc41bf8f41784 P dd5ffdb93acf492d8a343cc3b6e1aa05: No bootstrap required, opened a new log
W20260709 12:16:05.476507 27314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.56.193:33959, user_credentials={real_user=slave}} blocked reactor thread for 44689.1us
I20260709 12:16:05.475354 27569 ts_tablet_manager.cc:1403] T d5508d37842541ff874bc41bf8f41784 P dd5ffdb93acf492d8a343cc3b6e1aa05: Time spent bootstrapping tablet: real 0.064s	user 0.004s	sys 0.018s
I20260709 12:16:05.484431 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa55fdcc1b254bd9bfdabf150f131087" candidate_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a0506729556426db8d473385faab326"
I20260709 12:16:05.485255 27272 raft_consensus.cc:3060] T aa55fdcc1b254bd9bfdabf150f131087 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:05.499810 27272 raft_consensus.cc:2468] T aa55fdcc1b254bd9bfdabf150f131087 P 0a0506729556426db8d473385faab326 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd5ffdb93acf492d8a343cc3b6e1aa05 in term 1.
I20260709 12:16:05.500196 27567 tablet_bootstrap.cc:492] T d5508d37842541ff874bc41bf8f41784 P 0a0506729556426db8d473385faab326: No bootstrap required, opened a new log
I20260709 12:16:05.500871 27567 ts_tablet_manager.cc:1403] T d5508d37842541ff874bc41bf8f41784 P 0a0506729556426db8d473385faab326: Time spent bootstrapping tablet: real 0.129s	user 0.006s	sys 0.024s
I20260709 12:16:05.501169 27568 raft_consensus.cc:359] T aa55fdcc1b254bd9bfdabf150f131087 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:05.502128 27568 raft_consensus.cc:385] T aa55fdcc1b254bd9bfdabf150f131087 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:05.501721 27314 leader_election.cc:304] T aa55fdcc1b254bd9bfdabf150f131087 P dd5ffdb93acf492d8a343cc3b6e1aa05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a0506729556426db8d473385faab326, dd5ffdb93acf492d8a343cc3b6e1aa05; no voters: 
I20260709 12:16:05.502521 27568 raft_consensus.cc:740] T aa55fdcc1b254bd9bfdabf150f131087 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ed05238324a485da065c10ec2ab6339, State: Initialized, Role: FOLLOWER
I20260709 12:16:05.503134 27575 raft_consensus.cc:2804] T aa55fdcc1b254bd9bfdabf150f131087 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:05.503872 27555 leader_election.cc:290] T aa55fdcc1b254bd9bfdabf150f131087 P dd5ffdb93acf492d8a343cc3b6e1aa05 [CANDIDATE]: Term 1 election: Requested vote from peers 0a0506729556426db8d473385faab326 (127.12.56.193:33959), 9ed05238324a485da065c10ec2ab6339 (127.12.56.195:39461)
I20260709 12:16:05.481904 27569 raft_consensus.cc:359] T d5508d37842541ff874bc41bf8f41784 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:05.504547 27569 raft_consensus.cc:385] T d5508d37842541ff874bc41bf8f41784 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:05.504928 27569 raft_consensus.cc:740] T d5508d37842541ff874bc41bf8f41784 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd5ffdb93acf492d8a343cc3b6e1aa05, State: Initialized, Role: FOLLOWER
I20260709 12:16:05.505594 27568 consensus_queue.cc:260] T aa55fdcc1b254bd9bfdabf150f131087 P 9ed05238324a485da065c10ec2ab6339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:05.505707 27567 raft_consensus.cc:359] T d5508d37842541ff874bc41bf8f41784 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:05.507834 27567 raft_consensus.cc:385] T d5508d37842541ff874bc41bf8f41784 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:05.510324 27567 raft_consensus.cc:740] T d5508d37842541ff874bc41bf8f41784 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a0506729556426db8d473385faab326, State: Initialized, Role: FOLLOWER
I20260709 12:16:05.505661 27569 consensus_queue.cc:260] T d5508d37842541ff874bc41bf8f41784 P dd5ffdb93acf492d8a343cc3b6e1aa05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:05.512365 27575 raft_consensus.cc:697] T aa55fdcc1b254bd9bfdabf150f131087 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 LEADER]: Becoming Leader. State: Replica: dd5ffdb93acf492d8a343cc3b6e1aa05, State: Running, Role: LEADER
I20260709 12:16:05.512766 27420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa55fdcc1b254bd9bfdabf150f131087" candidate_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ed05238324a485da065c10ec2ab6339"
I20260709 12:16:05.513520 27420 raft_consensus.cc:3060] T aa55fdcc1b254bd9bfdabf150f131087 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:05.513792 27575 consensus_queue.cc:237] T aa55fdcc1b254bd9bfdabf150f131087 P dd5ffdb93acf492d8a343cc3b6e1aa05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:05.518778 27569 ts_tablet_manager.cc:1434] T d5508d37842541ff874bc41bf8f41784 P dd5ffdb93acf492d8a343cc3b6e1aa05: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.000s
I20260709 12:16:05.520083 27569 tablet_bootstrap.cc:492] T 972b0f22614e4759b9c9a2454dada333 P dd5ffdb93acf492d8a343cc3b6e1aa05: Bootstrap starting.
I20260709 12:16:05.525923 27567 consensus_queue.cc:260] T d5508d37842541ff874bc41bf8f41784 P 0a0506729556426db8d473385faab326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:05.529242 27567 ts_tablet_manager.cc:1434] T d5508d37842541ff874bc41bf8f41784 P 0a0506729556426db8d473385faab326: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 12:16:05.533577 27420 raft_consensus.cc:2468] T aa55fdcc1b254bd9bfdabf150f131087 P 9ed05238324a485da065c10ec2ab6339 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd5ffdb93acf492d8a343cc3b6e1aa05 in term 1.
I20260709 12:16:05.534905 27568 ts_tablet_manager.cc:1434] T aa55fdcc1b254bd9bfdabf150f131087 P 9ed05238324a485da065c10ec2ab6339: Time spent starting tablet: real 0.060s	user 0.011s	sys 0.021s
I20260709 12:16:05.535570 27567 tablet_bootstrap.cc:492] T 0a03180a7e6744d5b9f132803996caf0 P 0a0506729556426db8d473385faab326: Bootstrap starting.
I20260709 12:16:05.536067 27568 tablet_bootstrap.cc:492] T d5508d37842541ff874bc41bf8f41784 P 9ed05238324a485da065c10ec2ab6339: Bootstrap starting.
I20260709 12:16:05.544946 27567 tablet_bootstrap.cc:654] T 0a03180a7e6744d5b9f132803996caf0 P 0a0506729556426db8d473385faab326: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:05.549388 27568 tablet_bootstrap.cc:654] T d5508d37842541ff874bc41bf8f41784 P 9ed05238324a485da065c10ec2ab6339: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:05.572211 27568 tablet_bootstrap.cc:492] T d5508d37842541ff874bc41bf8f41784 P 9ed05238324a485da065c10ec2ab6339: No bootstrap required, opened a new log
I20260709 12:16:05.573104 27568 ts_tablet_manager.cc:1403] T d5508d37842541ff874bc41bf8f41784 P 9ed05238324a485da065c10ec2ab6339: Time spent bootstrapping tablet: real 0.037s	user 0.014s	sys 0.013s
I20260709 12:16:05.572043 27169 catalog_manager.cc:5697] T aa55fdcc1b254bd9bfdabf150f131087 P dd5ffdb93acf492d8a343cc3b6e1aa05 reported cstate change: term changed from 0 to 1, leader changed from <none> to dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194). New cstate: current_term: 1 leader_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:05.576906 27568 raft_consensus.cc:359] T d5508d37842541ff874bc41bf8f41784 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:05.582809 27568 raft_consensus.cc:385] T d5508d37842541ff874bc41bf8f41784 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:05.583201 27568 raft_consensus.cc:740] T d5508d37842541ff874bc41bf8f41784 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ed05238324a485da065c10ec2ab6339, State: Initialized, Role: FOLLOWER
I20260709 12:16:05.584998 27568 consensus_queue.cc:260] T d5508d37842541ff874bc41bf8f41784 P 9ed05238324a485da065c10ec2ab6339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:05.585732 27569 tablet_bootstrap.cc:654] T 972b0f22614e4759b9c9a2454dada333 P dd5ffdb93acf492d8a343cc3b6e1aa05: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:05.587518 27568 ts_tablet_manager.cc:1434] T d5508d37842541ff874bc41bf8f41784 P 9ed05238324a485da065c10ec2ab6339: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.001s
I20260709 12:16:05.588624 27568 tablet_bootstrap.cc:492] T 0a03180a7e6744d5b9f132803996caf0 P 9ed05238324a485da065c10ec2ab6339: Bootstrap starting.
I20260709 12:16:05.602591 27569 tablet_bootstrap.cc:492] T 972b0f22614e4759b9c9a2454dada333 P dd5ffdb93acf492d8a343cc3b6e1aa05: No bootstrap required, opened a new log
I20260709 12:16:05.602612 27567 tablet_bootstrap.cc:492] T 0a03180a7e6744d5b9f132803996caf0 P 0a0506729556426db8d473385faab326: No bootstrap required, opened a new log
I20260709 12:16:05.603561 27567 ts_tablet_manager.cc:1403] T 0a03180a7e6744d5b9f132803996caf0 P 0a0506729556426db8d473385faab326: Time spent bootstrapping tablet: real 0.068s	user 0.033s	sys 0.013s
I20260709 12:16:05.607035 27567 raft_consensus.cc:359] T 0a03180a7e6744d5b9f132803996caf0 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:05.607909 27567 raft_consensus.cc:385] T 0a03180a7e6744d5b9f132803996caf0 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:05.608291 27567 raft_consensus.cc:740] T 0a03180a7e6744d5b9f132803996caf0 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a0506729556426db8d473385faab326, State: Initialized, Role: FOLLOWER
I20260709 12:16:05.610240 27567 consensus_queue.cc:260] T 0a03180a7e6744d5b9f132803996caf0 P 0a0506729556426db8d473385faab326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:05.612947 27567 ts_tablet_manager.cc:1434] T 0a03180a7e6744d5b9f132803996caf0 P 0a0506729556426db8d473385faab326: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 12:16:05.614401 27567 tablet_bootstrap.cc:492] T 972b0f22614e4759b9c9a2454dada333 P 0a0506729556426db8d473385faab326: Bootstrap starting.
I20260709 12:16:05.617182 27568 tablet_bootstrap.cc:654] T 0a03180a7e6744d5b9f132803996caf0 P 9ed05238324a485da065c10ec2ab6339: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:05.603561 27569 ts_tablet_manager.cc:1403] T 972b0f22614e4759b9c9a2454dada333 P dd5ffdb93acf492d8a343cc3b6e1aa05: Time spent bootstrapping tablet: real 0.084s	user 0.013s	sys 0.013s
I20260709 12:16:05.620898 27569 raft_consensus.cc:359] T 972b0f22614e4759b9c9a2454dada333 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:05.621881 27569 raft_consensus.cc:385] T 972b0f22614e4759b9c9a2454dada333 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:05.622278 27569 raft_consensus.cc:740] T 972b0f22614e4759b9c9a2454dada333 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd5ffdb93acf492d8a343cc3b6e1aa05, State: Initialized, Role: FOLLOWER
I20260709 12:16:05.623198 27569 consensus_queue.cc:260] T 972b0f22614e4759b9c9a2454dada333 P dd5ffdb93acf492d8a343cc3b6e1aa05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:05.624992 27567 tablet_bootstrap.cc:654] T 972b0f22614e4759b9c9a2454dada333 P 0a0506729556426db8d473385faab326: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:05.626183 27569 ts_tablet_manager.cc:1434] T 972b0f22614e4759b9c9a2454dada333 P dd5ffdb93acf492d8a343cc3b6e1aa05: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:16:05.627437 27569 tablet_bootstrap.cc:492] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P dd5ffdb93acf492d8a343cc3b6e1aa05: Bootstrap starting.
I20260709 12:16:05.633433 27568 tablet_bootstrap.cc:492] T 0a03180a7e6744d5b9f132803996caf0 P 9ed05238324a485da065c10ec2ab6339: No bootstrap required, opened a new log
I20260709 12:16:05.634265 27568 ts_tablet_manager.cc:1403] T 0a03180a7e6744d5b9f132803996caf0 P 9ed05238324a485da065c10ec2ab6339: Time spent bootstrapping tablet: real 0.046s	user 0.012s	sys 0.002s
I20260709 12:16:05.634974 27569 tablet_bootstrap.cc:654] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P dd5ffdb93acf492d8a343cc3b6e1aa05: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:05.640772 27568 raft_consensus.cc:359] T 0a03180a7e6744d5b9f132803996caf0 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:05.642601 27568 raft_consensus.cc:385] T 0a03180a7e6744d5b9f132803996caf0 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:05.642943 27568 raft_consensus.cc:740] T 0a03180a7e6744d5b9f132803996caf0 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ed05238324a485da065c10ec2ab6339, State: Initialized, Role: FOLLOWER
I20260709 12:16:05.643179 27567 tablet_bootstrap.cc:492] T 972b0f22614e4759b9c9a2454dada333 P 0a0506729556426db8d473385faab326: No bootstrap required, opened a new log
I20260709 12:16:05.643826 27567 ts_tablet_manager.cc:1403] T 972b0f22614e4759b9c9a2454dada333 P 0a0506729556426db8d473385faab326: Time spent bootstrapping tablet: real 0.030s	user 0.009s	sys 0.003s
I20260709 12:16:05.643926 27568 consensus_queue.cc:260] T 0a03180a7e6744d5b9f132803996caf0 P 9ed05238324a485da065c10ec2ab6339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:05.647029 27567 raft_consensus.cc:359] T 972b0f22614e4759b9c9a2454dada333 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:05.647805 27567 raft_consensus.cc:385] T 972b0f22614e4759b9c9a2454dada333 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:05.648109 27567 raft_consensus.cc:740] T 972b0f22614e4759b9c9a2454dada333 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a0506729556426db8d473385faab326, State: Initialized, Role: FOLLOWER
I20260709 12:16:05.648950 27567 consensus_queue.cc:260] T 972b0f22614e4759b9c9a2454dada333 P 0a0506729556426db8d473385faab326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:05.650341 27568 ts_tablet_manager.cc:1434] T 0a03180a7e6744d5b9f132803996caf0 P 9ed05238324a485da065c10ec2ab6339: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.004s
I20260709 12:16:05.651502 27567 ts_tablet_manager.cc:1434] T 972b0f22614e4759b9c9a2454dada333 P 0a0506729556426db8d473385faab326: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 12:16:05.651957 27568 tablet_bootstrap.cc:492] T 972b0f22614e4759b9c9a2454dada333 P 9ed05238324a485da065c10ec2ab6339: Bootstrap starting.
I20260709 12:16:05.652621 27567 tablet_bootstrap.cc:492] T 63806869f2eb4957b569e050893620ad P 0a0506729556426db8d473385faab326: Bootstrap starting.
I20260709 12:16:05.666447 27568 tablet_bootstrap.cc:654] T 972b0f22614e4759b9c9a2454dada333 P 9ed05238324a485da065c10ec2ab6339: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:05.669605 27569 tablet_bootstrap.cc:492] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P dd5ffdb93acf492d8a343cc3b6e1aa05: No bootstrap required, opened a new log
I20260709 12:16:05.670320 27569 ts_tablet_manager.cc:1403] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P dd5ffdb93acf492d8a343cc3b6e1aa05: Time spent bootstrapping tablet: real 0.043s	user 0.027s	sys 0.004s
I20260709 12:16:05.673991 27569 raft_consensus.cc:359] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:05.674896 27569 raft_consensus.cc:385] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:05.675251 27569 raft_consensus.cc:740] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd5ffdb93acf492d8a343cc3b6e1aa05, State: Initialized, Role: FOLLOWER
I20260709 12:16:05.676236 27569 consensus_queue.cc:260] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P dd5ffdb93acf492d8a343cc3b6e1aa05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:05.679157 27567 tablet_bootstrap.cc:654] T 63806869f2eb4957b569e050893620ad P 0a0506729556426db8d473385faab326: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:05.679204 27569 ts_tablet_manager.cc:1434] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P dd5ffdb93acf492d8a343cc3b6e1aa05: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.005s
I20260709 12:16:05.680809 27569 tablet_bootstrap.cc:492] T 0a03180a7e6744d5b9f132803996caf0 P dd5ffdb93acf492d8a343cc3b6e1aa05: Bootstrap starting.
I20260709 12:16:05.689841 27569 tablet_bootstrap.cc:654] T 0a03180a7e6744d5b9f132803996caf0 P dd5ffdb93acf492d8a343cc3b6e1aa05: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:05.693112 27578 raft_consensus.cc:493] T d5508d37842541ff874bc41bf8f41784 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:05.693946 27578 raft_consensus.cc:515] T d5508d37842541ff874bc41bf8f41784 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:05.698900 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5508d37842541ff874bc41bf8f41784" candidate_uuid: "9ed05238324a485da065c10ec2ab6339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a0506729556426db8d473385faab326" is_pre_election: true
I20260709 12:16:05.699797 27272 raft_consensus.cc:2468] T d5508d37842541ff874bc41bf8f41784 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ed05238324a485da065c10ec2ab6339 in term 0.
I20260709 12:16:05.701511 27388 leader_election.cc:304] T d5508d37842541ff874bc41bf8f41784 P 9ed05238324a485da065c10ec2ab6339 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a0506729556426db8d473385faab326, 9ed05238324a485da065c10ec2ab6339; no voters: 
I20260709 12:16:05.702852 27484 raft_consensus.cc:2804] T d5508d37842541ff874bc41bf8f41784 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:05.703377 27484 raft_consensus.cc:493] T d5508d37842541ff874bc41bf8f41784 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:05.703809 27484 raft_consensus.cc:3060] T d5508d37842541ff874bc41bf8f41784 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:05.718005 27578 leader_election.cc:290] T d5508d37842541ff874bc41bf8f41784 P 9ed05238324a485da065c10ec2ab6339 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a0506729556426db8d473385faab326 (127.12.56.193:33959), dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194:39423)
I20260709 12:16:05.718385 27348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5508d37842541ff874bc41bf8f41784" candidate_uuid: "9ed05238324a485da065c10ec2ab6339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" is_pre_election: true
I20260709 12:16:05.719545 27348 raft_consensus.cc:2468] T d5508d37842541ff874bc41bf8f41784 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ed05238324a485da065c10ec2ab6339 in term 0.
I20260709 12:16:05.747135 27484 raft_consensus.cc:515] T d5508d37842541ff874bc41bf8f41784 P 9ed05238324a485da065c10ec2ab6339 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:05.751324 27484 leader_election.cc:290] T d5508d37842541ff874bc41bf8f41784 P 9ed05238324a485da065c10ec2ab6339 [CANDIDATE]: Term 1 election: Requested vote from peers 0a0506729556426db8d473385faab326 (127.12.56.193:33959), dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194:39423)
I20260709 12:16:05.752439 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5508d37842541ff874bc41bf8f41784" candidate_uuid: "9ed05238324a485da065c10ec2ab6339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a0506729556426db8d473385faab326"
I20260709 12:16:05.752668 27348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5508d37842541ff874bc41bf8f41784" candidate_uuid: "9ed05238324a485da065c10ec2ab6339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05"
I20260709 12:16:05.753386 27272 raft_consensus.cc:3060] T d5508d37842541ff874bc41bf8f41784 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:05.753504 27348 raft_consensus.cc:3060] T d5508d37842541ff874bc41bf8f41784 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:05.755366 27567 tablet_bootstrap.cc:492] T 63806869f2eb4957b569e050893620ad P 0a0506729556426db8d473385faab326: No bootstrap required, opened a new log
I20260709 12:16:05.755566 27568 tablet_bootstrap.cc:492] T 972b0f22614e4759b9c9a2454dada333 P 9ed05238324a485da065c10ec2ab6339: No bootstrap required, opened a new log
I20260709 12:16:05.756011 27567 ts_tablet_manager.cc:1403] T 63806869f2eb4957b569e050893620ad P 0a0506729556426db8d473385faab326: Time spent bootstrapping tablet: real 0.104s	user 0.027s	sys 0.051s
I20260709 12:16:05.756214 27568 ts_tablet_manager.cc:1403] T 972b0f22614e4759b9c9a2454dada333 P 9ed05238324a485da065c10ec2ab6339: Time spent bootstrapping tablet: real 0.105s	user 0.052s	sys 0.041s
I20260709 12:16:05.760392 27568 raft_consensus.cc:359] T 972b0f22614e4759b9c9a2454dada333 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:05.761009 27569 tablet_bootstrap.cc:492] T 0a03180a7e6744d5b9f132803996caf0 P dd5ffdb93acf492d8a343cc3b6e1aa05: No bootstrap required, opened a new log
I20260709 12:16:05.761186 27568 raft_consensus.cc:385] T 972b0f22614e4759b9c9a2454dada333 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:05.761659 27568 raft_consensus.cc:740] T 972b0f22614e4759b9c9a2454dada333 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ed05238324a485da065c10ec2ab6339, State: Initialized, Role: FOLLOWER
I20260709 12:16:05.761869 27272 raft_consensus.cc:2468] T d5508d37842541ff874bc41bf8f41784 P 0a0506729556426db8d473385faab326 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ed05238324a485da065c10ec2ab6339 in term 1.
I20260709 12:16:05.762959 27567 raft_consensus.cc:359] T 63806869f2eb4957b569e050893620ad P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:05.763408 27388 leader_election.cc:304] T d5508d37842541ff874bc41bf8f41784 P 9ed05238324a485da065c10ec2ab6339 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a0506729556426db8d473385faab326, 9ed05238324a485da065c10ec2ab6339; no voters: 
I20260709 12:16:05.762789 27568 consensus_queue.cc:260] T 972b0f22614e4759b9c9a2454dada333 P 9ed05238324a485da065c10ec2ab6339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:05.763850 27567 raft_consensus.cc:385] T 63806869f2eb4957b569e050893620ad P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:05.764204 27567 raft_consensus.cc:740] T 63806869f2eb4957b569e050893620ad P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a0506729556426db8d473385faab326, State: Initialized, Role: FOLLOWER
I20260709 12:16:05.764442 27484 raft_consensus.cc:2804] T d5508d37842541ff874bc41bf8f41784 P 9ed05238324a485da065c10ec2ab6339 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:05.764679 27348 raft_consensus.cc:2468] T d5508d37842541ff874bc41bf8f41784 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ed05238324a485da065c10ec2ab6339 in term 1.
I20260709 12:16:05.765020 27567 consensus_queue.cc:260] T 63806869f2eb4957b569e050893620ad P 0a0506729556426db8d473385faab326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:05.766031 27568 ts_tablet_manager.cc:1434] T 972b0f22614e4759b9c9a2454dada333 P 9ed05238324a485da065c10ec2ab6339: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.002s
I20260709 12:16:05.767290 27568 tablet_bootstrap.cc:492] T 63806869f2eb4957b569e050893620ad P 9ed05238324a485da065c10ec2ab6339: Bootstrap starting.
I20260709 12:16:05.767714 27567 ts_tablet_manager.cc:1434] T 63806869f2eb4957b569e050893620ad P 0a0506729556426db8d473385faab326: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:16:05.768882 27567 tablet_bootstrap.cc:492] T 71be868a9d474261a6b88e2e66af4e85 P 0a0506729556426db8d473385faab326: Bootstrap starting.
I20260709 12:16:05.769672 27484 raft_consensus.cc:697] T d5508d37842541ff874bc41bf8f41784 P 9ed05238324a485da065c10ec2ab6339 [term 1 LEADER]: Becoming Leader. State: Replica: 9ed05238324a485da065c10ec2ab6339, State: Running, Role: LEADER
I20260709 12:16:05.770663 27484 consensus_queue.cc:237] T d5508d37842541ff874bc41bf8f41784 P 9ed05238324a485da065c10ec2ab6339 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:05.761668 27569 ts_tablet_manager.cc:1403] T 0a03180a7e6744d5b9f132803996caf0 P dd5ffdb93acf492d8a343cc3b6e1aa05: Time spent bootstrapping tablet: real 0.081s	user 0.025s	sys 0.039s
I20260709 12:16:05.775107 27568 tablet_bootstrap.cc:654] T 63806869f2eb4957b569e050893620ad P 9ed05238324a485da065c10ec2ab6339: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:05.777447 27569 raft_consensus.cc:359] T 0a03180a7e6744d5b9f132803996caf0 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:05.778394 27569 raft_consensus.cc:385] T 0a03180a7e6744d5b9f132803996caf0 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:05.778755 27569 raft_consensus.cc:740] T 0a03180a7e6744d5b9f132803996caf0 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd5ffdb93acf492d8a343cc3b6e1aa05, State: Initialized, Role: FOLLOWER
I20260709 12:16:05.779536 27569 consensus_queue.cc:260] T 0a03180a7e6744d5b9f132803996caf0 P dd5ffdb93acf492d8a343cc3b6e1aa05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:05.782716 27569 ts_tablet_manager.cc:1434] T 0a03180a7e6744d5b9f132803996caf0 P dd5ffdb93acf492d8a343cc3b6e1aa05: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:16:05.783860 27569 tablet_bootstrap.cc:492] T 71be868a9d474261a6b88e2e66af4e85 P dd5ffdb93acf492d8a343cc3b6e1aa05: Bootstrap starting.
I20260709 12:16:05.788393 27567 tablet_bootstrap.cc:654] T 71be868a9d474261a6b88e2e66af4e85 P 0a0506729556426db8d473385faab326: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:05.799129 27569 tablet_bootstrap.cc:654] T 71be868a9d474261a6b88e2e66af4e85 P dd5ffdb93acf492d8a343cc3b6e1aa05: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:05.806761 27567 tablet_bootstrap.cc:492] T 71be868a9d474261a6b88e2e66af4e85 P 0a0506729556426db8d473385faab326: No bootstrap required, opened a new log
I20260709 12:16:05.807505 27567 ts_tablet_manager.cc:1403] T 71be868a9d474261a6b88e2e66af4e85 P 0a0506729556426db8d473385faab326: Time spent bootstrapping tablet: real 0.039s	user 0.007s	sys 0.006s
I20260709 12:16:05.809043 27568 tablet_bootstrap.cc:492] T 63806869f2eb4957b569e050893620ad P 9ed05238324a485da065c10ec2ab6339: No bootstrap required, opened a new log
I20260709 12:16:05.809731 27568 ts_tablet_manager.cc:1403] T 63806869f2eb4957b569e050893620ad P 9ed05238324a485da065c10ec2ab6339: Time spent bootstrapping tablet: real 0.043s	user 0.020s	sys 0.020s
I20260709 12:16:05.811156 27567 raft_consensus.cc:359] T 71be868a9d474261a6b88e2e66af4e85 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:05.812211 27567 raft_consensus.cc:385] T 71be868a9d474261a6b88e2e66af4e85 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:05.812605 27567 raft_consensus.cc:740] T 71be868a9d474261a6b88e2e66af4e85 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a0506729556426db8d473385faab326, State: Initialized, Role: FOLLOWER
I20260709 12:16:05.811822 27167 catalog_manager.cc:5697] T d5508d37842541ff874bc41bf8f41784 P 9ed05238324a485da065c10ec2ab6339 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ed05238324a485da065c10ec2ab6339 (127.12.56.195). New cstate: current_term: 1 leader_uuid: "9ed05238324a485da065c10ec2ab6339" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:05.813398 27568 raft_consensus.cc:359] T 63806869f2eb4957b569e050893620ad P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:05.813443 27567 consensus_queue.cc:260] T 71be868a9d474261a6b88e2e66af4e85 P 0a0506729556426db8d473385faab326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:05.814435 27568 raft_consensus.cc:385] T 63806869f2eb4957b569e050893620ad P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:05.814813 27568 raft_consensus.cc:740] T 63806869f2eb4957b569e050893620ad P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ed05238324a485da065c10ec2ab6339, State: Initialized, Role: FOLLOWER
I20260709 12:16:05.816494 27567 ts_tablet_manager.cc:1434] T 71be868a9d474261a6b88e2e66af4e85 P 0a0506729556426db8d473385faab326: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:16:05.815850 27568 consensus_queue.cc:260] T 63806869f2eb4957b569e050893620ad P 9ed05238324a485da065c10ec2ab6339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:05.817060 27569 tablet_bootstrap.cc:492] T 71be868a9d474261a6b88e2e66af4e85 P dd5ffdb93acf492d8a343cc3b6e1aa05: No bootstrap required, opened a new log
I20260709 12:16:05.817727 27569 ts_tablet_manager.cc:1403] T 71be868a9d474261a6b88e2e66af4e85 P dd5ffdb93acf492d8a343cc3b6e1aa05: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.003s
I20260709 12:16:05.817878 27567 tablet_bootstrap.cc:492] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 0a0506729556426db8d473385faab326: Bootstrap starting.
I20260709 12:16:05.821017 27568 ts_tablet_manager.cc:1434] T 63806869f2eb4957b569e050893620ad P 9ed05238324a485da065c10ec2ab6339: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.001s
I20260709 12:16:05.822395 27568 tablet_bootstrap.cc:492] T 41a4729ca1394ea0ac6f01132efd57f0 P 9ed05238324a485da065c10ec2ab6339: Bootstrap starting.
I20260709 12:16:05.821434 27569 raft_consensus.cc:359] T 71be868a9d474261a6b88e2e66af4e85 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:05.824144 27575 raft_consensus.cc:493] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:05.824774 27575 raft_consensus.cc:515] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:05.824118 27569 raft_consensus.cc:385] T 71be868a9d474261a6b88e2e66af4e85 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:05.829130 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baaab759f2c4b4ab1ea3d0578ed0c06" candidate_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a0506729556426db8d473385faab326" is_pre_election: true
W20260709 12:16:05.830695 27314 leader_election.cc:343] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P dd5ffdb93acf492d8a343cc3b6e1aa05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a0506729556426db8d473385faab326 (127.12.56.193:33959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:05.831362 27575 leader_election.cc:290] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P dd5ffdb93acf492d8a343cc3b6e1aa05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a0506729556426db8d473385faab326 (127.12.56.193:33959), 9ed05238324a485da065c10ec2ab6339 (127.12.56.195:39461)
I20260709 12:16:05.831598 27568 tablet_bootstrap.cc:654] T 41a4729ca1394ea0ac6f01132efd57f0 P 9ed05238324a485da065c10ec2ab6339: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:05.832624 27420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baaab759f2c4b4ab1ea3d0578ed0c06" candidate_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ed05238324a485da065c10ec2ab6339" is_pre_election: true
I20260709 12:16:05.826327 27569 raft_consensus.cc:740] T 71be868a9d474261a6b88e2e66af4e85 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd5ffdb93acf492d8a343cc3b6e1aa05, State: Initialized, Role: FOLLOWER
I20260709 12:16:05.834533 27567 tablet_bootstrap.cc:654] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 0a0506729556426db8d473385faab326: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:05.835120 27569 consensus_queue.cc:260] T 71be868a9d474261a6b88e2e66af4e85 P dd5ffdb93acf492d8a343cc3b6e1aa05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:05.838205 27569 ts_tablet_manager.cc:1434] T 71be868a9d474261a6b88e2e66af4e85 P dd5ffdb93acf492d8a343cc3b6e1aa05: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.001s
W20260709 12:16:05.839645 27313 leader_election.cc:343] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P dd5ffdb93acf492d8a343cc3b6e1aa05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ed05238324a485da065c10ec2ab6339 (127.12.56.195:39461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:05.840221 27313 leader_election.cc:304] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P dd5ffdb93acf492d8a343cc3b6e1aa05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd5ffdb93acf492d8a343cc3b6e1aa05; no voters: 0a0506729556426db8d473385faab326, 9ed05238324a485da065c10ec2ab6339
I20260709 12:16:05.841611 27575 raft_consensus.cc:2749] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:05.842588 27533 raft_consensus.cc:493] T 0a03180a7e6744d5b9f132803996caf0 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:05.843191 27533 raft_consensus.cc:515] T 0a03180a7e6744d5b9f132803996caf0 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:05.846571 27576 raft_consensus.cc:493] T 63806869f2eb4957b569e050893620ad P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:05.847216 27576 raft_consensus.cc:515] T 63806869f2eb4957b569e050893620ad P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:05.845618 27533 leader_election.cc:290] T 0a03180a7e6744d5b9f132803996caf0 P 0a0506729556426db8d473385faab326 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194:39423), 9ed05238324a485da065c10ec2ab6339 (127.12.56.195:39461)
I20260709 12:16:05.854981 27345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63806869f2eb4957b569e050893620ad" candidate_uuid: "0a0506729556426db8d473385faab326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" is_pre_election: true
I20260709 12:16:05.855213 27567 tablet_bootstrap.cc:492] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 0a0506729556426db8d473385faab326: No bootstrap required, opened a new log
I20260709 12:16:05.855232 27421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63806869f2eb4957b569e050893620ad" candidate_uuid: "0a0506729556426db8d473385faab326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ed05238324a485da065c10ec2ab6339" is_pre_election: true
I20260709 12:16:05.856125 27567 ts_tablet_manager.cc:1403] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 0a0506729556426db8d473385faab326: Time spent bootstrapping tablet: real 0.039s	user 0.022s	sys 0.000s
I20260709 12:16:05.856246 27421 raft_consensus.cc:2468] T 63806869f2eb4957b569e050893620ad P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a0506729556426db8d473385faab326 in term 0.
I20260709 12:16:05.858071 27568 tablet_bootstrap.cc:492] T 41a4729ca1394ea0ac6f01132efd57f0 P 9ed05238324a485da065c10ec2ab6339: No bootstrap required, opened a new log
W20260709 12:16:05.858664 27237 leader_election.cc:343] T 63806869f2eb4957b569e050893620ad P 0a0506729556426db8d473385faab326 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194:39423): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:05.858907 27568 ts_tablet_manager.cc:1403] T 41a4729ca1394ea0ac6f01132efd57f0 P 9ed05238324a485da065c10ec2ab6339: Time spent bootstrapping tablet: real 0.037s	user 0.021s	sys 0.011s
I20260709 12:16:05.849279 27420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a03180a7e6744d5b9f132803996caf0" candidate_uuid: "0a0506729556426db8d473385faab326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ed05238324a485da065c10ec2ab6339" is_pre_election: true
I20260709 12:16:05.849949 27576 leader_election.cc:290] T 63806869f2eb4957b569e050893620ad P 0a0506729556426db8d473385faab326 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194:39423), 9ed05238324a485da065c10ec2ab6339 (127.12.56.195:39461)
I20260709 12:16:05.850907 27348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a03180a7e6744d5b9f132803996caf0" candidate_uuid: "0a0506729556426db8d473385faab326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" is_pre_election: true
I20260709 12:16:05.851343 27569 tablet_bootstrap.cc:492] T 63806869f2eb4957b569e050893620ad P dd5ffdb93acf492d8a343cc3b6e1aa05: Bootstrap starting.
I20260709 12:16:05.860585 27348 raft_consensus.cc:2468] T 0a03180a7e6744d5b9f132803996caf0 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a0506729556426db8d473385faab326 in term 0.
I20260709 12:16:05.862668 27568 raft_consensus.cc:359] T 41a4729ca1394ea0ac6f01132efd57f0 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:05.863658 27568 raft_consensus.cc:385] T 41a4729ca1394ea0ac6f01132efd57f0 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:05.864009 27568 raft_consensus.cc:740] T 41a4729ca1394ea0ac6f01132efd57f0 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ed05238324a485da065c10ec2ab6339, State: Initialized, Role: FOLLOWER
I20260709 12:16:05.862984 27238 leader_election.cc:304] T 63806869f2eb4957b569e050893620ad P 0a0506729556426db8d473385faab326 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a0506729556426db8d473385faab326, 9ed05238324a485da065c10ec2ab6339; no voters: dd5ffdb93acf492d8a343cc3b6e1aa05
I20260709 12:16:05.866472 27576 raft_consensus.cc:2804] T 63806869f2eb4957b569e050893620ad P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:05.866935 27576 raft_consensus.cc:493] T 63806869f2eb4957b569e050893620ad P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:05.867322 27576 raft_consensus.cc:3060] T 63806869f2eb4957b569e050893620ad P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:05.867228 27567 raft_consensus.cc:359] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:05.860147 27420 raft_consensus.cc:2468] T 0a03180a7e6744d5b9f132803996caf0 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a0506729556426db8d473385faab326 in term 0.
I20260709 12:16:05.868301 27567 raft_consensus.cc:385] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:05.870486 27567 raft_consensus.cc:740] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a0506729556426db8d473385faab326, State: Initialized, Role: FOLLOWER
I20260709 12:16:05.870748 27569 tablet_bootstrap.cc:654] T 63806869f2eb4957b569e050893620ad P dd5ffdb93acf492d8a343cc3b6e1aa05: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:05.871434 27567 consensus_queue.cc:260] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 0a0506729556426db8d473385faab326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:05.874737 27567 ts_tablet_manager.cc:1434] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 0a0506729556426db8d473385faab326: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 12:16:05.876474 27567 tablet_bootstrap.cc:492] T 41a4729ca1394ea0ac6f01132efd57f0 P 0a0506729556426db8d473385faab326: Bootstrap starting.
I20260709 12:16:05.865034 27568 consensus_queue.cc:260] T 41a4729ca1394ea0ac6f01132efd57f0 P 9ed05238324a485da065c10ec2ab6339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:05.866495 27237 leader_election.cc:304] T 0a03180a7e6744d5b9f132803996caf0 P 0a0506729556426db8d473385faab326 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a0506729556426db8d473385faab326, dd5ffdb93acf492d8a343cc3b6e1aa05; no voters: 
I20260709 12:16:05.878232 27484 raft_consensus.cc:493] T 41a4729ca1394ea0ac6f01132efd57f0 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:05.878865 27484 raft_consensus.cc:515] T 41a4729ca1394ea0ac6f01132efd57f0 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:05.880316 27568 ts_tablet_manager.cc:1434] T 41a4729ca1394ea0ac6f01132efd57f0 P 9ed05238324a485da065c10ec2ab6339: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 12:16:05.882476 27568 tablet_bootstrap.cc:492] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 9ed05238324a485da065c10ec2ab6339: Bootstrap starting.
I20260709 12:16:05.882748 27484 leader_election.cc:290] T 41a4729ca1394ea0ac6f01132efd57f0 P 9ed05238324a485da065c10ec2ab6339 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a0506729556426db8d473385faab326 (127.12.56.193:33959), dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194:39423)
I20260709 12:16:05.883754 27348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a4729ca1394ea0ac6f01132efd57f0" candidate_uuid: "9ed05238324a485da065c10ec2ab6339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" is_pre_election: true
W20260709 12:16:05.887296 27386 leader_election.cc:343] T 41a4729ca1394ea0ac6f01132efd57f0 P 9ed05238324a485da065c10ec2ab6339 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194:39423): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:05.894680 27567 tablet_bootstrap.cc:654] T 41a4729ca1394ea0ac6f01132efd57f0 P 0a0506729556426db8d473385faab326: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:05.904001 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a4729ca1394ea0ac6f01132efd57f0" candidate_uuid: "9ed05238324a485da065c10ec2ab6339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a0506729556426db8d473385faab326" is_pre_election: true
I20260709 12:16:05.909965 27533 raft_consensus.cc:2804] T 0a03180a7e6744d5b9f132803996caf0 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:05.910470 27533 raft_consensus.cc:493] T 0a03180a7e6744d5b9f132803996caf0 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:16:05.910705 27388 leader_election.cc:343] T 41a4729ca1394ea0ac6f01132efd57f0 P 9ed05238324a485da065c10ec2ab6339 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0a0506729556426db8d473385faab326 (127.12.56.193:33959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:05.910468 27568 tablet_bootstrap.cc:654] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 9ed05238324a485da065c10ec2ab6339: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:05.910950 27533 raft_consensus.cc:3060] T 0a03180a7e6744d5b9f132803996caf0 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:05.914256 27388 leader_election.cc:304] T 41a4729ca1394ea0ac6f01132efd57f0 P 9ed05238324a485da065c10ec2ab6339 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ed05238324a485da065c10ec2ab6339; no voters: 0a0506729556426db8d473385faab326, dd5ffdb93acf492d8a343cc3b6e1aa05
I20260709 12:16:05.915254 27484 raft_consensus.cc:2749] T 41a4729ca1394ea0ac6f01132efd57f0 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:05.920039 27576 raft_consensus.cc:515] T 63806869f2eb4957b569e050893620ad P 0a0506729556426db8d473385faab326 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:05.923537 27348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63806869f2eb4957b569e050893620ad" candidate_uuid: "0a0506729556426db8d473385faab326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05"
W20260709 12:16:05.925251 27237 leader_election.cc:343] T 63806869f2eb4957b569e050893620ad P 0a0506729556426db8d473385faab326 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194:39423): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:05.926453 27576 leader_election.cc:290] T 63806869f2eb4957b569e050893620ad P 0a0506729556426db8d473385faab326 [CANDIDATE]: Term 1 election: Requested vote from peers dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194:39423), 9ed05238324a485da065c10ec2ab6339 (127.12.56.195:39461)
I20260709 12:16:05.926999 27533 raft_consensus.cc:515] T 0a03180a7e6744d5b9f132803996caf0 P 0a0506729556426db8d473385faab326 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:05.928293 27568 tablet_bootstrap.cc:492] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 9ed05238324a485da065c10ec2ab6339: No bootstrap required, opened a new log
I20260709 12:16:05.928972 27568 ts_tablet_manager.cc:1403] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 9ed05238324a485da065c10ec2ab6339: Time spent bootstrapping tablet: real 0.047s	user 0.017s	sys 0.005s
I20260709 12:16:05.931505 27569 tablet_bootstrap.cc:492] T 63806869f2eb4957b569e050893620ad P dd5ffdb93acf492d8a343cc3b6e1aa05: No bootstrap required, opened a new log
I20260709 12:16:05.932222 27569 ts_tablet_manager.cc:1403] T 63806869f2eb4957b569e050893620ad P dd5ffdb93acf492d8a343cc3b6e1aa05: Time spent bootstrapping tablet: real 0.081s	user 0.035s	sys 0.029s
I20260709 12:16:05.932978 27567 tablet_bootstrap.cc:492] T 41a4729ca1394ea0ac6f01132efd57f0 P 0a0506729556426db8d473385faab326: No bootstrap required, opened a new log
I20260709 12:16:05.933673 27567 ts_tablet_manager.cc:1403] T 41a4729ca1394ea0ac6f01132efd57f0 P 0a0506729556426db8d473385faab326: Time spent bootstrapping tablet: real 0.058s	user 0.014s	sys 0.008s
I20260709 12:16:05.933539 27568 raft_consensus.cc:359] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:05.934628 27568 raft_consensus.cc:385] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:05.935072 27568 raft_consensus.cc:740] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ed05238324a485da065c10ec2ab6339, State: Initialized, Role: FOLLOWER
I20260709 12:16:05.936034 27568 consensus_queue.cc:260] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 9ed05238324a485da065c10ec2ab6339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:05.936640 27348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a03180a7e6744d5b9f132803996caf0" candidate_uuid: "0a0506729556426db8d473385faab326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05"
I20260709 12:16:05.937408 27348 raft_consensus.cc:3060] T 0a03180a7e6744d5b9f132803996caf0 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:05.936908 27569 raft_consensus.cc:359] T 63806869f2eb4957b569e050893620ad P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:05.938498 27569 raft_consensus.cc:385] T 63806869f2eb4957b569e050893620ad P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:05.938905 27569 raft_consensus.cc:740] T 63806869f2eb4957b569e050893620ad P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd5ffdb93acf492d8a343cc3b6e1aa05, State: Initialized, Role: FOLLOWER
I20260709 12:16:05.939100 27568 ts_tablet_manager.cc:1434] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 9ed05238324a485da065c10ec2ab6339: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:16:05.940466 27568 tablet_bootstrap.cc:492] T 71be868a9d474261a6b88e2e66af4e85 P 9ed05238324a485da065c10ec2ab6339: Bootstrap starting.
I20260709 12:16:05.939857 27569 consensus_queue.cc:260] T 63806869f2eb4957b569e050893620ad P dd5ffdb93acf492d8a343cc3b6e1aa05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:05.941022 27420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63806869f2eb4957b569e050893620ad" candidate_uuid: "0a0506729556426db8d473385faab326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ed05238324a485da065c10ec2ab6339"
I20260709 12:16:05.941749 27420 raft_consensus.cc:3060] T 63806869f2eb4957b569e050893620ad P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:05.942831 27569 ts_tablet_manager.cc:1434] T 63806869f2eb4957b569e050893620ad P dd5ffdb93acf492d8a343cc3b6e1aa05: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:16:05.944036 27569 tablet_bootstrap.cc:492] T 41a4729ca1394ea0ac6f01132efd57f0 P dd5ffdb93acf492d8a343cc3b6e1aa05: Bootstrap starting.
I20260709 12:16:05.951820 27569 tablet_bootstrap.cc:654] T 41a4729ca1394ea0ac6f01132efd57f0 P dd5ffdb93acf492d8a343cc3b6e1aa05: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:05.952530 27420 raft_consensus.cc:2468] T 63806869f2eb4957b569e050893620ad P 9ed05238324a485da065c10ec2ab6339 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a0506729556426db8d473385faab326 in term 1.
I20260709 12:16:05.954150 27238 leader_election.cc:304] T 63806869f2eb4957b569e050893620ad P 0a0506729556426db8d473385faab326 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a0506729556426db8d473385faab326, 9ed05238324a485da065c10ec2ab6339; no voters: dd5ffdb93acf492d8a343cc3b6e1aa05
I20260709 12:16:05.955435 27348 raft_consensus.cc:2468] T 0a03180a7e6744d5b9f132803996caf0 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a0506729556426db8d473385faab326 in term 1.
I20260709 12:16:05.957409 27533 leader_election.cc:290] T 0a03180a7e6744d5b9f132803996caf0 P 0a0506729556426db8d473385faab326 [CANDIDATE]: Term 1 election: Requested vote from peers dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194:39423), 9ed05238324a485da065c10ec2ab6339 (127.12.56.195:39461)
I20260709 12:16:05.958750 27576 raft_consensus.cc:2804] T 63806869f2eb4957b569e050893620ad P 0a0506729556426db8d473385faab326 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:05.959362 27576 raft_consensus.cc:697] T 63806869f2eb4957b569e050893620ad P 0a0506729556426db8d473385faab326 [term 1 LEADER]: Becoming Leader. State: Replica: 0a0506729556426db8d473385faab326, State: Running, Role: LEADER
I20260709 12:16:05.958170 27237 leader_election.cc:304] T 0a03180a7e6744d5b9f132803996caf0 P 0a0506729556426db8d473385faab326 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a0506729556426db8d473385faab326, dd5ffdb93acf492d8a343cc3b6e1aa05; no voters: 
I20260709 12:16:05.960366 27576 consensus_queue.cc:237] T 63806869f2eb4957b569e050893620ad P 0a0506729556426db8d473385faab326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:05.961881 27568 tablet_bootstrap.cc:654] T 71be868a9d474261a6b88e2e66af4e85 P 9ed05238324a485da065c10ec2ab6339: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:05.962271 27420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a03180a7e6744d5b9f132803996caf0" candidate_uuid: "0a0506729556426db8d473385faab326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ed05238324a485da065c10ec2ab6339"
I20260709 12:16:05.962973 27420 raft_consensus.cc:3060] T 0a03180a7e6744d5b9f132803996caf0 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:05.965699 27598 raft_consensus.cc:2804] T 0a03180a7e6744d5b9f132803996caf0 P 0a0506729556426db8d473385faab326 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:05.966508 27598 raft_consensus.cc:697] T 0a03180a7e6744d5b9f132803996caf0 P 0a0506729556426db8d473385faab326 [term 1 LEADER]: Becoming Leader. State: Replica: 0a0506729556426db8d473385faab326, State: Running, Role: LEADER
I20260709 12:16:05.967850 27598 consensus_queue.cc:237] T 0a03180a7e6744d5b9f132803996caf0 P 0a0506729556426db8d473385faab326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:05.972297 27567 raft_consensus.cc:359] T 41a4729ca1394ea0ac6f01132efd57f0 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:05.973696 27567 raft_consensus.cc:385] T 41a4729ca1394ea0ac6f01132efd57f0 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:05.974239 27567 raft_consensus.cc:740] T 41a4729ca1394ea0ac6f01132efd57f0 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a0506729556426db8d473385faab326, State: Initialized, Role: FOLLOWER
I20260709 12:16:05.975315 27420 raft_consensus.cc:2468] T 0a03180a7e6744d5b9f132803996caf0 P 9ed05238324a485da065c10ec2ab6339 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a0506729556426db8d473385faab326 in term 1.
I20260709 12:16:05.976238 27567 consensus_queue.cc:260] T 41a4729ca1394ea0ac6f01132efd57f0 P 0a0506729556426db8d473385faab326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:05.985253 27567 ts_tablet_manager.cc:1434] T 41a4729ca1394ea0ac6f01132efd57f0 P 0a0506729556426db8d473385faab326: Time spent starting tablet: real 0.051s	user 0.009s	sys 0.000s
I20260709 12:16:05.986649 27604 raft_consensus.cc:493] T 972b0f22614e4759b9c9a2454dada333 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:05.986992 27567 tablet_bootstrap.cc:492] T 9b043163bdc941cba463321241b1bef4 P 0a0506729556426db8d473385faab326: Bootstrap starting.
I20260709 12:16:05.987452 27604 raft_consensus.cc:515] T 972b0f22614e4759b9c9a2454dada333 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:05.980232 27568 tablet_bootstrap.cc:492] T 71be868a9d474261a6b88e2e66af4e85 P 9ed05238324a485da065c10ec2ab6339: No bootstrap required, opened a new log
I20260709 12:16:05.980906 27575 consensus_queue.cc:1048] T aa55fdcc1b254bd9bfdabf150f131087 P dd5ffdb93acf492d8a343cc3b6e1aa05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:05.992380 27484 raft_consensus.cc:493] T 972b0f22614e4759b9c9a2454dada333 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:05.993254 27484 raft_consensus.cc:515] T 972b0f22614e4759b9c9a2454dada333 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:05.995157 27604 leader_election.cc:290] T 972b0f22614e4759b9c9a2454dada333 P 0a0506729556426db8d473385faab326 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194:39423), 9ed05238324a485da065c10ec2ab6339 (127.12.56.195:39461)
I20260709 12:16:05.995847 27575 raft_consensus.cc:493] T 972b0f22614e4759b9c9a2454dada333 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:06.001621 27575 raft_consensus.cc:515] T 972b0f22614e4759b9c9a2454dada333 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:06.004952 27568 ts_tablet_manager.cc:1403] T 71be868a9d474261a6b88e2e66af4e85 P 9ed05238324a485da065c10ec2ab6339: Time spent bootstrapping tablet: real 0.065s	user 0.020s	sys 0.004s
I20260709 12:16:06.001725 27348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "972b0f22614e4759b9c9a2454dada333" candidate_uuid: "9ed05238324a485da065c10ec2ab6339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" is_pre_election: true
I20260709 12:16:05.998317 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "972b0f22614e4759b9c9a2454dada333" candidate_uuid: "9ed05238324a485da065c10ec2ab6339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a0506729556426db8d473385faab326" is_pre_election: true
I20260709 12:16:06.002728 27484 leader_election.cc:290] T 972b0f22614e4759b9c9a2454dada333 P 9ed05238324a485da065c10ec2ab6339 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a0506729556426db8d473385faab326 (127.12.56.193:33959), dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194:39423)
I20260709 12:16:06.003927 27569 tablet_bootstrap.cc:492] T 41a4729ca1394ea0ac6f01132efd57f0 P dd5ffdb93acf492d8a343cc3b6e1aa05: No bootstrap required, opened a new log
I20260709 12:16:06.007922 27348 raft_consensus.cc:2468] T 972b0f22614e4759b9c9a2454dada333 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ed05238324a485da065c10ec2ab6339 in term 0.
I20260709 12:16:06.008008 27271 raft_consensus.cc:2468] T 972b0f22614e4759b9c9a2454dada333 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ed05238324a485da065c10ec2ab6339 in term 0.
I20260709 12:16:06.008080 27569 ts_tablet_manager.cc:1403] T 41a4729ca1394ea0ac6f01132efd57f0 P dd5ffdb93acf492d8a343cc3b6e1aa05: Time spent bootstrapping tablet: real 0.064s	user 0.012s	sys 0.004s
I20260709 12:16:06.008183 27575 leader_election.cc:290] T 972b0f22614e4759b9c9a2454dada333 P dd5ffdb93acf492d8a343cc3b6e1aa05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a0506729556426db8d473385faab326 (127.12.56.193:33959), 9ed05238324a485da065c10ec2ab6339 (127.12.56.195:39461)
I20260709 12:16:06.012516 27575 raft_consensus.cc:493] T 71be868a9d474261a6b88e2e66af4e85 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:06.013028 27575 raft_consensus.cc:515] T 71be868a9d474261a6b88e2e66af4e85 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:06.013854 27569 raft_consensus.cc:359] T 41a4729ca1394ea0ac6f01132efd57f0 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:06.014966 27569 raft_consensus.cc:385] T 41a4729ca1394ea0ac6f01132efd57f0 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:06.015364 27569 raft_consensus.cc:740] T 41a4729ca1394ea0ac6f01132efd57f0 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd5ffdb93acf492d8a343cc3b6e1aa05, State: Initialized, Role: FOLLOWER
I20260709 12:16:06.016721 27575 leader_election.cc:290] T 71be868a9d474261a6b88e2e66af4e85 P dd5ffdb93acf492d8a343cc3b6e1aa05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a0506729556426db8d473385faab326 (127.12.56.193:33959), 9ed05238324a485da065c10ec2ab6339 (127.12.56.195:39461)
I20260709 12:16:06.016345 27569 consensus_queue.cc:260] T 41a4729ca1394ea0ac6f01132efd57f0 P dd5ffdb93acf492d8a343cc3b6e1aa05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:06.018498 27386 leader_election.cc:304] T 972b0f22614e4759b9c9a2454dada333 P 9ed05238324a485da065c10ec2ab6339 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ed05238324a485da065c10ec2ab6339, dd5ffdb93acf492d8a343cc3b6e1aa05; no voters: 
I20260709 12:16:06.020143 27569 ts_tablet_manager.cc:1434] T 41a4729ca1394ea0ac6f01132efd57f0 P dd5ffdb93acf492d8a343cc3b6e1aa05: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:16:06.021966 27273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71be868a9d474261a6b88e2e66af4e85" candidate_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a0506729556426db8d473385faab326" is_pre_election: true
I20260709 12:16:06.023731 27273 raft_consensus.cc:2468] T 71be868a9d474261a6b88e2e66af4e85 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd5ffdb93acf492d8a343cc3b6e1aa05 in term 0.
I20260709 12:16:06.025722 27314 leader_election.cc:304] T 71be868a9d474261a6b88e2e66af4e85 P dd5ffdb93acf492d8a343cc3b6e1aa05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a0506729556426db8d473385faab326, dd5ffdb93acf492d8a343cc3b6e1aa05; no voters: 
I20260709 12:16:06.026293 27568 raft_consensus.cc:359] T 71be868a9d474261a6b88e2e66af4e85 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:06.026767 27421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "972b0f22614e4759b9c9a2454dada333" candidate_uuid: "0a0506729556426db8d473385faab326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ed05238324a485da065c10ec2ab6339" is_pre_election: true
I20260709 12:16:06.026933 27575 raft_consensus.cc:2804] T 71be868a9d474261a6b88e2e66af4e85 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:06.028216 27422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71be868a9d474261a6b88e2e66af4e85" candidate_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ed05238324a485da065c10ec2ab6339" is_pre_election: true
I20260709 12:16:06.027350 27420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "972b0f22614e4759b9c9a2454dada333" candidate_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ed05238324a485da065c10ec2ab6339" is_pre_election: true
I20260709 12:16:06.028676 27575 raft_consensus.cc:493] T 71be868a9d474261a6b88e2e66af4e85 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:06.029300 27575 raft_consensus.cc:3060] T 71be868a9d474261a6b88e2e66af4e85 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:06.031509 27484 raft_consensus.cc:2804] T 972b0f22614e4759b9c9a2454dada333 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:06.032039 27484 raft_consensus.cc:493] T 972b0f22614e4759b9c9a2454dada333 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:06.032416 27484 raft_consensus.cc:3060] T 972b0f22614e4759b9c9a2454dada333 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:06.034263 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "972b0f22614e4759b9c9a2454dada333" candidate_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a0506729556426db8d473385faab326" is_pre_election: true
I20260709 12:16:06.035071 27271 raft_consensus.cc:2468] T 972b0f22614e4759b9c9a2454dada333 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd5ffdb93acf492d8a343cc3b6e1aa05 in term 0.
I20260709 12:16:06.037035 27314 leader_election.cc:304] T 972b0f22614e4759b9c9a2454dada333 P dd5ffdb93acf492d8a343cc3b6e1aa05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a0506729556426db8d473385faab326, dd5ffdb93acf492d8a343cc3b6e1aa05; no voters: 
I20260709 12:16:06.041136 27555 raft_consensus.cc:2804] T 972b0f22614e4759b9c9a2454dada333 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:06.041689 27555 raft_consensus.cc:493] T 972b0f22614e4759b9c9a2454dada333 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:06.042196 27555 raft_consensus.cc:3060] T 972b0f22614e4759b9c9a2454dada333 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:06.022907 27237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.194:39423, user_credentials={real_user=slave}} blocked reactor thread for 58987.1us
I20260709 12:16:06.027952 27567 tablet_bootstrap.cc:654] T 9b043163bdc941cba463321241b1bef4 P 0a0506729556426db8d473385faab326: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:06.023144 27569 tablet_bootstrap.cc:492] T 9b043163bdc941cba463321241b1bef4 P dd5ffdb93acf492d8a343cc3b6e1aa05: Bootstrap starting.
I20260709 12:16:06.028337 27568 raft_consensus.cc:385] T 71be868a9d474261a6b88e2e66af4e85 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:06.047197 27568 raft_consensus.cc:740] T 71be868a9d474261a6b88e2e66af4e85 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ed05238324a485da065c10ec2ab6339, State: Initialized, Role: FOLLOWER
I20260709 12:16:06.051690 27348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "972b0f22614e4759b9c9a2454dada333" candidate_uuid: "0a0506729556426db8d473385faab326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" is_pre_election: true
I20260709 12:16:06.052024 27568 consensus_queue.cc:260] T 71be868a9d474261a6b88e2e66af4e85 P 9ed05238324a485da065c10ec2ab6339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:06.053083 27422 raft_consensus.cc:2468] T 71be868a9d474261a6b88e2e66af4e85 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd5ffdb93acf492d8a343cc3b6e1aa05 in term 0.
I20260709 12:16:06.047731 27169 catalog_manager.cc:5697] T 63806869f2eb4957b569e050893620ad P 0a0506729556426db8d473385faab326 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0a0506729556426db8d473385faab326 (127.12.56.193). New cstate: current_term: 1 leader_uuid: "0a0506729556426db8d473385faab326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:06.073488 27568 ts_tablet_manager.cc:1434] T 71be868a9d474261a6b88e2e66af4e85 P 9ed05238324a485da065c10ec2ab6339: Time spent starting tablet: real 0.068s	user 0.007s	sys 0.002s
I20260709 12:16:06.075084 27568 tablet_bootstrap.cc:492] T 9b043163bdc941cba463321241b1bef4 P 9ed05238324a485da065c10ec2ab6339: Bootstrap starting.
I20260709 12:16:06.076352 27569 tablet_bootstrap.cc:654] T 9b043163bdc941cba463321241b1bef4 P dd5ffdb93acf492d8a343cc3b6e1aa05: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:06.077167 27578 raft_consensus.cc:493] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:06.077723 27578 raft_consensus.cc:515] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:06.089639 27578 leader_election.cc:290] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 9ed05238324a485da065c10ec2ab6339 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a0506729556426db8d473385faab326 (127.12.56.193:33959), dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194:39423)
I20260709 12:16:06.091050 27533 raft_consensus.cc:493] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:06.092164 27533 raft_consensus.cc:515] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:06.094776 27533 leader_election.cc:290] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 0a0506729556426db8d473385faab326 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194:39423), 9ed05238324a485da065c10ec2ab6339 (127.12.56.195:39461)
I20260709 12:16:06.095598 27345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baaab759f2c4b4ab1ea3d0578ed0c06" candidate_uuid: "9ed05238324a485da065c10ec2ab6339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" is_pre_election: true
I20260709 12:16:06.096413 27568 tablet_bootstrap.cc:654] T 9b043163bdc941cba463321241b1bef4 P 9ed05238324a485da065c10ec2ab6339: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:06.096728 27345 raft_consensus.cc:2468] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ed05238324a485da065c10ec2ab6339 in term 0.
I20260709 12:16:06.093506 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baaab759f2c4b4ab1ea3d0578ed0c06" candidate_uuid: "9ed05238324a485da065c10ec2ab6339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a0506729556426db8d473385faab326" is_pre_election: true
I20260709 12:16:06.098933 27271 raft_consensus.cc:2468] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ed05238324a485da065c10ec2ab6339 in term 0.
I20260709 12:16:06.100746 27386 leader_election.cc:304] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 9ed05238324a485da065c10ec2ab6339 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ed05238324a485da065c10ec2ab6339, dd5ffdb93acf492d8a343cc3b6e1aa05; no voters: 
I20260709 12:16:06.101753 27578 raft_consensus.cc:2804] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:06.102412 27578 raft_consensus.cc:493] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:06.102882 27578 raft_consensus.cc:3060] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:06.099054 27422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baaab759f2c4b4ab1ea3d0578ed0c06" candidate_uuid: "0a0506729556426db8d473385faab326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ed05238324a485da065c10ec2ab6339" is_pre_election: true
I20260709 12:16:06.105480 27610 consensus_queue.cc:1048] T aa55fdcc1b254bd9bfdabf150f131087 P dd5ffdb93acf492d8a343cc3b6e1aa05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:16:06.101220 27575 raft_consensus.cc:515] T 71be868a9d474261a6b88e2e66af4e85 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:06.090821 27555 raft_consensus.cc:515] T 972b0f22614e4759b9c9a2454dada333 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:06.115046 27169 catalog_manager.cc:5697] T 0a03180a7e6744d5b9f132803996caf0 P 0a0506729556426db8d473385faab326 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0a0506729556426db8d473385faab326 (127.12.56.193). New cstate: current_term: 1 leader_uuid: "0a0506729556426db8d473385faab326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:06.119367 27348 raft_consensus.cc:2393] T 972b0f22614e4759b9c9a2454dada333 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0a0506729556426db8d473385faab326 in current term 1: Already voted for candidate dd5ffdb93acf492d8a343cc3b6e1aa05 in this term.
I20260709 12:16:06.119921 27346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baaab759f2c4b4ab1ea3d0578ed0c06" candidate_uuid: "0a0506729556426db8d473385faab326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" is_pre_election: true
I20260709 12:16:06.120733 27346 raft_consensus.cc:2468] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a0506729556426db8d473385faab326 in term 0.
I20260709 12:16:06.121850 27484 raft_consensus.cc:515] T 972b0f22614e4759b9c9a2454dada333 P 9ed05238324a485da065c10ec2ab6339 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:06.123241 27420 raft_consensus.cc:2393] T 972b0f22614e4759b9c9a2454dada333 P 9ed05238324a485da065c10ec2ab6339 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd5ffdb93acf492d8a343cc3b6e1aa05 in current term 1: Already voted for candidate 9ed05238324a485da065c10ec2ab6339 in this term.
I20260709 12:16:06.122112 27237 leader_election.cc:304] T 972b0f22614e4759b9c9a2454dada333 P 0a0506729556426db8d473385faab326 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a0506729556426db8d473385faab326; no voters: 9ed05238324a485da065c10ec2ab6339, dd5ffdb93acf492d8a343cc3b6e1aa05
I20260709 12:16:06.126125 27600 raft_consensus.cc:3060] T 972b0f22614e4759b9c9a2454dada333 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:06.129264 27555 leader_election.cc:290] T 972b0f22614e4759b9c9a2454dada333 P dd5ffdb93acf492d8a343cc3b6e1aa05 [CANDIDATE]: Term 1 election: Requested vote from peers 0a0506729556426db8d473385faab326 (127.12.56.193:33959), 9ed05238324a485da065c10ec2ab6339 (127.12.56.195:39461)
I20260709 12:16:06.131459 27420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "972b0f22614e4759b9c9a2454dada333" candidate_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ed05238324a485da065c10ec2ab6339"
I20260709 12:16:06.132369 27420 raft_consensus.cc:2393] T 972b0f22614e4759b9c9a2454dada333 P 9ed05238324a485da065c10ec2ab6339 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate dd5ffdb93acf492d8a343cc3b6e1aa05 in current term 1: Already voted for candidate 9ed05238324a485da065c10ec2ab6339 in this term.
I20260709 12:16:06.131521 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "972b0f22614e4759b9c9a2454dada333" candidate_uuid: "9ed05238324a485da065c10ec2ab6339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a0506729556426db8d473385faab326"
I20260709 12:16:06.133419 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "972b0f22614e4759b9c9a2454dada333" candidate_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a0506729556426db8d473385faab326"
I20260709 12:16:06.136366 27237 leader_election.cc:304] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 0a0506729556426db8d473385faab326 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a0506729556426db8d473385faab326, dd5ffdb93acf492d8a343cc3b6e1aa05; no voters: 
I20260709 12:16:06.137235 27484 leader_election.cc:290] T 972b0f22614e4759b9c9a2454dada333 P 9ed05238324a485da065c10ec2ab6339 [CANDIDATE]: Term 1 election: Requested vote from peers 0a0506729556426db8d473385faab326 (127.12.56.193:33959), dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194:39423)
I20260709 12:16:06.137830 27603 raft_consensus.cc:2804] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:06.139856 27603 raft_consensus.cc:493] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:06.140297 27603 raft_consensus.cc:3060] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:06.138142 27313 leader_election.cc:304] T 972b0f22614e4759b9c9a2454dada333 P dd5ffdb93acf492d8a343cc3b6e1aa05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd5ffdb93acf492d8a343cc3b6e1aa05; no voters: 0a0506729556426db8d473385faab326, 9ed05238324a485da065c10ec2ab6339
I20260709 12:16:06.142445 27555 raft_consensus.cc:2749] T 972b0f22614e4759b9c9a2454dada333 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:16:06.143752 27345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "972b0f22614e4759b9c9a2454dada333" candidate_uuid: "9ed05238324a485da065c10ec2ab6339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05"
I20260709 12:16:06.144716 27345 raft_consensus.cc:2393] T 972b0f22614e4759b9c9a2454dada333 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ed05238324a485da065c10ec2ab6339 in current term 1: Already voted for candidate dd5ffdb93acf492d8a343cc3b6e1aa05 in this term.
I20260709 12:16:06.144274 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71be868a9d474261a6b88e2e66af4e85" candidate_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a0506729556426db8d473385faab326"
I20260709 12:16:06.145953 27272 raft_consensus.cc:3060] T 71be868a9d474261a6b88e2e66af4e85 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:06.146589 27420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71be868a9d474261a6b88e2e66af4e85" candidate_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ed05238324a485da065c10ec2ab6339"
I20260709 12:16:06.147451 27420 raft_consensus.cc:3060] T 71be868a9d474261a6b88e2e66af4e85 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:06.155225 27600 raft_consensus.cc:2749] T 972b0f22614e4759b9c9a2454dada333 P 0a0506729556426db8d473385faab326 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:06.139151 27575 leader_election.cc:290] T 71be868a9d474261a6b88e2e66af4e85 P dd5ffdb93acf492d8a343cc3b6e1aa05 [CANDIDATE]: Term 1 election: Requested vote from peers 0a0506729556426db8d473385faab326 (127.12.56.193:33959), 9ed05238324a485da065c10ec2ab6339 (127.12.56.195:39461)
I20260709 12:16:06.162869 27272 raft_consensus.cc:2468] T 71be868a9d474261a6b88e2e66af4e85 P 0a0506729556426db8d473385faab326 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd5ffdb93acf492d8a343cc3b6e1aa05 in term 1.
I20260709 12:16:06.163941 27568 tablet_bootstrap.cc:492] T 9b043163bdc941cba463321241b1bef4 P 9ed05238324a485da065c10ec2ab6339: No bootstrap required, opened a new log
I20260709 12:16:06.164535 27568 ts_tablet_manager.cc:1403] T 9b043163bdc941cba463321241b1bef4 P 9ed05238324a485da065c10ec2ab6339: Time spent bootstrapping tablet: real 0.090s	user 0.015s	sys 0.000s
I20260709 12:16:06.166599 27314 leader_election.cc:304] T 71be868a9d474261a6b88e2e66af4e85 P dd5ffdb93acf492d8a343cc3b6e1aa05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a0506729556426db8d473385faab326, dd5ffdb93acf492d8a343cc3b6e1aa05; no voters: 
I20260709 12:16:06.168315 27568 raft_consensus.cc:359] T 9b043163bdc941cba463321241b1bef4 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:06.169216 27568 raft_consensus.cc:385] T 9b043163bdc941cba463321241b1bef4 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:06.169548 27568 raft_consensus.cc:740] T 9b043163bdc941cba463321241b1bef4 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ed05238324a485da065c10ec2ab6339, State: Initialized, Role: FOLLOWER
I20260709 12:16:06.170328 27568 consensus_queue.cc:260] T 9b043163bdc941cba463321241b1bef4 P 9ed05238324a485da065c10ec2ab6339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:06.173051 27609 raft_consensus.cc:2804] T 71be868a9d474261a6b88e2e66af4e85 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:06.173312 27271 raft_consensus.cc:2468] T 972b0f22614e4759b9c9a2454dada333 P 0a0506729556426db8d473385faab326 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ed05238324a485da065c10ec2ab6339 in term 1.
I20260709 12:16:06.173890 27609 raft_consensus.cc:697] T 71be868a9d474261a6b88e2e66af4e85 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 LEADER]: Becoming Leader. State: Replica: dd5ffdb93acf492d8a343cc3b6e1aa05, State: Running, Role: LEADER
W20260709 12:16:06.174645 27219 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:06.169999 27420 raft_consensus.cc:2468] T 71be868a9d474261a6b88e2e66af4e85 P 9ed05238324a485da065c10ec2ab6339 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd5ffdb93acf492d8a343cc3b6e1aa05 in term 1.
I20260709 12:16:06.177366 27568 ts_tablet_manager.cc:1434] T 9b043163bdc941cba463321241b1bef4 P 9ed05238324a485da065c10ec2ab6339: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 12:16:06.179884 27569 tablet_bootstrap.cc:492] T 9b043163bdc941cba463321241b1bef4 P dd5ffdb93acf492d8a343cc3b6e1aa05: No bootstrap required, opened a new log
I20260709 12:16:06.175164 27609 consensus_queue.cc:237] T 71be868a9d474261a6b88e2e66af4e85 P dd5ffdb93acf492d8a343cc3b6e1aa05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:06.180531 27569 ts_tablet_manager.cc:1403] T 9b043163bdc941cba463321241b1bef4 P dd5ffdb93acf492d8a343cc3b6e1aa05: Time spent bootstrapping tablet: real 0.159s	user 0.016s	sys 0.003s
I20260709 12:16:06.175769 27388 leader_election.cc:304] T 972b0f22614e4759b9c9a2454dada333 P 9ed05238324a485da065c10ec2ab6339 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a0506729556426db8d473385faab326, 9ed05238324a485da065c10ec2ab6339; no voters: dd5ffdb93acf492d8a343cc3b6e1aa05
I20260709 12:16:06.185218 27567 tablet_bootstrap.cc:492] T 9b043163bdc941cba463321241b1bef4 P 0a0506729556426db8d473385faab326: No bootstrap required, opened a new log
I20260709 12:16:06.185904 27567 ts_tablet_manager.cc:1403] T 9b043163bdc941cba463321241b1bef4 P 0a0506729556426db8d473385faab326: Time spent bootstrapping tablet: real 0.199s	user 0.017s	sys 0.000s
I20260709 12:16:06.185840 27484 raft_consensus.cc:2804] T 972b0f22614e4759b9c9a2454dada333 P 9ed05238324a485da065c10ec2ab6339 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:06.189160 27567 raft_consensus.cc:359] T 9b043163bdc941cba463321241b1bef4 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:06.189983 27567 raft_consensus.cc:385] T 9b043163bdc941cba463321241b1bef4 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:06.190317 27567 raft_consensus.cc:740] T 9b043163bdc941cba463321241b1bef4 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a0506729556426db8d473385faab326, State: Initialized, Role: FOLLOWER
I20260709 12:16:06.191147 27567 consensus_queue.cc:260] T 9b043163bdc941cba463321241b1bef4 P 0a0506729556426db8d473385faab326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:06.191529 27615 consensus_queue.cc:1048] T d5508d37842541ff874bc41bf8f41784 P 9ed05238324a485da065c10ec2ab6339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:06.186354 27569 raft_consensus.cc:359] T 9b043163bdc941cba463321241b1bef4 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:06.192651 27569 raft_consensus.cc:385] T 9b043163bdc941cba463321241b1bef4 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:06.193048 27569 raft_consensus.cc:740] T 9b043163bdc941cba463321241b1bef4 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd5ffdb93acf492d8a343cc3b6e1aa05, State: Initialized, Role: FOLLOWER
I20260709 12:16:06.194175 27567 ts_tablet_manager.cc:1434] T 9b043163bdc941cba463321241b1bef4 P 0a0506729556426db8d473385faab326: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:16:06.194033 27569 consensus_queue.cc:260] T 9b043163bdc941cba463321241b1bef4 P dd5ffdb93acf492d8a343cc3b6e1aa05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:06.187858 27578 raft_consensus.cc:515] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 9ed05238324a485da065c10ec2ab6339 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:06.197422 27569 ts_tablet_manager.cc:1434] T 9b043163bdc941cba463321241b1bef4 P dd5ffdb93acf492d8a343cc3b6e1aa05: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.000s
I20260709 12:16:06.186868 27484 raft_consensus.cc:697] T 972b0f22614e4759b9c9a2454dada333 P 9ed05238324a485da065c10ec2ab6339 [term 1 LEADER]: Becoming Leader. State: Replica: 9ed05238324a485da065c10ec2ab6339, State: Running, Role: LEADER
I20260709 12:16:06.198982 27422 raft_consensus.cc:2393] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 9ed05238324a485da065c10ec2ab6339 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0a0506729556426db8d473385faab326 in current term 1: Already voted for candidate 9ed05238324a485da065c10ec2ab6339 in this term.
I20260709 12:16:06.199271 27484 consensus_queue.cc:237] T 972b0f22614e4759b9c9a2454dada333 P 9ed05238324a485da065c10ec2ab6339 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:06.201339 27603 raft_consensus.cc:515] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 0a0506729556426db8d473385faab326 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:06.204124 27578 leader_election.cc:290] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 9ed05238324a485da065c10ec2ab6339 [CANDIDATE]: Term 1 election: Requested vote from peers 0a0506729556426db8d473385faab326 (127.12.56.193:33959), dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194:39423)
I20260709 12:16:06.205868 27345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baaab759f2c4b4ab1ea3d0578ed0c06" candidate_uuid: "0a0506729556426db8d473385faab326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05"
I20260709 12:16:06.206678 27345 raft_consensus.cc:3060] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:06.207656 27603 leader_election.cc:290] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 0a0506729556426db8d473385faab326 [CANDIDATE]: Term 1 election: Requested vote from peers dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194:39423), 9ed05238324a485da065c10ec2ab6339 (127.12.56.195:39461)
I20260709 12:16:06.209090 27422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baaab759f2c4b4ab1ea3d0578ed0c06" candidate_uuid: "0a0506729556426db8d473385faab326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ed05238324a485da065c10ec2ab6339"
I20260709 12:16:06.210093 27422 raft_consensus.cc:2393] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 9ed05238324a485da065c10ec2ab6339 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0a0506729556426db8d473385faab326 in current term 1: Already voted for candidate 9ed05238324a485da065c10ec2ab6339 in this term.
I20260709 12:16:06.210933 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baaab759f2c4b4ab1ea3d0578ed0c06" candidate_uuid: "9ed05238324a485da065c10ec2ab6339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a0506729556426db8d473385faab326"
I20260709 12:16:06.211848 27271 raft_consensus.cc:2393] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 0a0506729556426db8d473385faab326 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ed05238324a485da065c10ec2ab6339 in current term 1: Already voted for candidate 0a0506729556426db8d473385faab326 in this term.
I20260709 12:16:06.219115 27555 raft_consensus.cc:493] T 63806869f2eb4957b569e050893620ad P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:06.220050 27555 raft_consensus.cc:515] T 63806869f2eb4957b569e050893620ad P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:06.221002 27345 raft_consensus.cc:2468] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a0506729556426db8d473385faab326 in term 1.
I20260709 12:16:06.222872 27237 leader_election.cc:304] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 0a0506729556426db8d473385faab326 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a0506729556426db8d473385faab326, dd5ffdb93acf492d8a343cc3b6e1aa05; no voters: 9ed05238324a485da065c10ec2ab6339
I20260709 12:16:06.225122 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63806869f2eb4957b569e050893620ad" candidate_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a0506729556426db8d473385faab326" is_pre_election: true
I20260709 12:16:06.226702 27346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baaab759f2c4b4ab1ea3d0578ed0c06" candidate_uuid: "9ed05238324a485da065c10ec2ab6339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05"
I20260709 12:16:06.227670 27600 raft_consensus.cc:2804] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 0a0506729556426db8d473385faab326 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:06.228487 27600 raft_consensus.cc:697] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 0a0506729556426db8d473385faab326 [term 1 LEADER]: Becoming Leader. State: Replica: 0a0506729556426db8d473385faab326, State: Running, Role: LEADER
I20260709 12:16:06.229816 27600 consensus_queue.cc:237] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 0a0506729556426db8d473385faab326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:06.231791 27169 catalog_manager.cc:5697] T 71be868a9d474261a6b88e2e66af4e85 P dd5ffdb93acf492d8a343cc3b6e1aa05 reported cstate change: term changed from 0 to 1, leader changed from <none> to dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194). New cstate: current_term: 1 leader_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:06.235059 27422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63806869f2eb4957b569e050893620ad" candidate_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ed05238324a485da065c10ec2ab6339" is_pre_election: true
I20260709 12:16:06.236490 27422 raft_consensus.cc:2393] T 63806869f2eb4957b569e050893620ad P 9ed05238324a485da065c10ec2ab6339 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd5ffdb93acf492d8a343cc3b6e1aa05 in current term 1: Already voted for candidate 0a0506729556426db8d473385faab326 in this term.
I20260709 12:16:06.227698 27346 raft_consensus.cc:2393] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ed05238324a485da065c10ec2ab6339 in current term 1: Already voted for candidate 0a0506729556426db8d473385faab326 in this term.
I20260709 12:16:06.238178 27313 leader_election.cc:304] T 63806869f2eb4957b569e050893620ad P dd5ffdb93acf492d8a343cc3b6e1aa05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd5ffdb93acf492d8a343cc3b6e1aa05; no voters: 0a0506729556426db8d473385faab326, 9ed05238324a485da065c10ec2ab6339
I20260709 12:16:06.239563 27609 raft_consensus.cc:3060] T 63806869f2eb4957b569e050893620ad P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:06.240459 27575 raft_consensus.cc:493] T 41a4729ca1394ea0ac6f01132efd57f0 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:06.241449 27575 raft_consensus.cc:515] T 41a4729ca1394ea0ac6f01132efd57f0 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:06.247802 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a4729ca1394ea0ac6f01132efd57f0" candidate_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a0506729556426db8d473385faab326" is_pre_election: true
I20260709 12:16:06.248797 27271 raft_consensus.cc:2468] T 41a4729ca1394ea0ac6f01132efd57f0 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd5ffdb93acf492d8a343cc3b6e1aa05 in term 0.
I20260709 12:16:06.250139 27314 leader_election.cc:304] T 41a4729ca1394ea0ac6f01132efd57f0 P dd5ffdb93acf492d8a343cc3b6e1aa05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a0506729556426db8d473385faab326, dd5ffdb93acf492d8a343cc3b6e1aa05; no voters: 
I20260709 12:16:06.251339 27577 raft_consensus.cc:2804] T 41a4729ca1394ea0ac6f01132efd57f0 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:06.251806 27577 raft_consensus.cc:493] T 41a4729ca1394ea0ac6f01132efd57f0 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:06.252169 27577 raft_consensus.cc:3060] T 41a4729ca1394ea0ac6f01132efd57f0 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:06.253383 27386 leader_election.cc:304] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 9ed05238324a485da065c10ec2ab6339 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ed05238324a485da065c10ec2ab6339; no voters: 0a0506729556426db8d473385faab326, dd5ffdb93acf492d8a343cc3b6e1aa05
I20260709 12:16:06.257009 27484 raft_consensus.cc:2749] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 9ed05238324a485da065c10ec2ab6339 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:16:06.240654 27555 leader_election.cc:290] T 63806869f2eb4957b569e050893620ad P dd5ffdb93acf492d8a343cc3b6e1aa05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a0506729556426db8d473385faab326 (127.12.56.193:33959), 9ed05238324a485da065c10ec2ab6339 (127.12.56.195:39461)
I20260709 12:16:06.269243 27609 raft_consensus.cc:2749] T 63806869f2eb4957b569e050893620ad P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:06.273893 27575 leader_election.cc:290] T 41a4729ca1394ea0ac6f01132efd57f0 P dd5ffdb93acf492d8a343cc3b6e1aa05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a0506729556426db8d473385faab326 (127.12.56.193:33959), 9ed05238324a485da065c10ec2ab6339 (127.12.56.195:39461)
I20260709 12:16:06.275190 27421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a4729ca1394ea0ac6f01132efd57f0" candidate_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ed05238324a485da065c10ec2ab6339" is_pre_election: true
I20260709 12:16:06.276121 27421 raft_consensus.cc:2468] T 41a4729ca1394ea0ac6f01132efd57f0 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd5ffdb93acf492d8a343cc3b6e1aa05 in term 0.
I20260709 12:16:06.275606 27167 catalog_manager.cc:5697] T 972b0f22614e4759b9c9a2454dada333 P 9ed05238324a485da065c10ec2ab6339 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ed05238324a485da065c10ec2ab6339 (127.12.56.195). New cstate: current_term: 1 leader_uuid: "9ed05238324a485da065c10ec2ab6339" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:06.277117 27168 catalog_manager.cc:5697] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 0a0506729556426db8d473385faab326 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0a0506729556426db8d473385faab326 (127.12.56.193). New cstate: current_term: 1 leader_uuid: "0a0506729556426db8d473385faab326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:06.278435 27484 consensus_queue.cc:1048] T d5508d37842541ff874bc41bf8f41784 P 9ed05238324a485da065c10ec2ab6339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:06.279001 27577 raft_consensus.cc:515] T 41a4729ca1394ea0ac6f01132efd57f0 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:06.281348 27577 leader_election.cc:290] T 41a4729ca1394ea0ac6f01132efd57f0 P dd5ffdb93acf492d8a343cc3b6e1aa05 [CANDIDATE]: Term 1 election: Requested vote from peers 0a0506729556426db8d473385faab326 (127.12.56.193:33959), 9ed05238324a485da065c10ec2ab6339 (127.12.56.195:39461)
I20260709 12:16:06.282974 27272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a4729ca1394ea0ac6f01132efd57f0" candidate_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a0506729556426db8d473385faab326"
I20260709 12:16:06.283663 27272 raft_consensus.cc:3060] T 41a4729ca1394ea0ac6f01132efd57f0 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:06.292937 27421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a4729ca1394ea0ac6f01132efd57f0" candidate_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ed05238324a485da065c10ec2ab6339"
I20260709 12:16:06.294021 27421 raft_consensus.cc:3060] T 41a4729ca1394ea0ac6f01132efd57f0 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:06.294600 27272 raft_consensus.cc:2468] T 41a4729ca1394ea0ac6f01132efd57f0 P 0a0506729556426db8d473385faab326 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd5ffdb93acf492d8a343cc3b6e1aa05 in term 1.
I20260709 12:16:06.295943 27314 leader_election.cc:304] T 41a4729ca1394ea0ac6f01132efd57f0 P dd5ffdb93acf492d8a343cc3b6e1aa05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a0506729556426db8d473385faab326, dd5ffdb93acf492d8a343cc3b6e1aa05; no voters: 
I20260709 12:16:06.296871 27577 raft_consensus.cc:2804] T 41a4729ca1394ea0ac6f01132efd57f0 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:06.297760 27577 raft_consensus.cc:697] T 41a4729ca1394ea0ac6f01132efd57f0 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 LEADER]: Becoming Leader. State: Replica: dd5ffdb93acf492d8a343cc3b6e1aa05, State: Running, Role: LEADER
I20260709 12:16:06.298617 27577 consensus_queue.cc:237] T 41a4729ca1394ea0ac6f01132efd57f0 P dd5ffdb93acf492d8a343cc3b6e1aa05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:06.306278 27421 raft_consensus.cc:2468] T 41a4729ca1394ea0ac6f01132efd57f0 P 9ed05238324a485da065c10ec2ab6339 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd5ffdb93acf492d8a343cc3b6e1aa05 in term 1.
I20260709 12:16:06.317958 27168 catalog_manager.cc:5697] T 41a4729ca1394ea0ac6f01132efd57f0 P dd5ffdb93acf492d8a343cc3b6e1aa05 reported cstate change: term changed from 0 to 1, leader changed from <none> to dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194). New cstate: current_term: 1 leader_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:06.404857 27600 raft_consensus.cc:493] T 9b043163bdc941cba463321241b1bef4 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:06.405392 27600 raft_consensus.cc:515] T 9b043163bdc941cba463321241b1bef4 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:06.407693 27600 leader_election.cc:290] T 9b043163bdc941cba463321241b1bef4 P 0a0506729556426db8d473385faab326 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194:39423), 9ed05238324a485da065c10ec2ab6339 (127.12.56.195:39461)
I20260709 12:16:06.408641 27345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b043163bdc941cba463321241b1bef4" candidate_uuid: "0a0506729556426db8d473385faab326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" is_pre_election: true
I20260709 12:16:06.408926 27421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b043163bdc941cba463321241b1bef4" candidate_uuid: "0a0506729556426db8d473385faab326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ed05238324a485da065c10ec2ab6339" is_pre_election: true
I20260709 12:16:06.409523 27345 raft_consensus.cc:2468] T 9b043163bdc941cba463321241b1bef4 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a0506729556426db8d473385faab326 in term 0.
I20260709 12:16:06.409639 27421 raft_consensus.cc:2468] T 9b043163bdc941cba463321241b1bef4 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a0506729556426db8d473385faab326 in term 0.
I20260709 12:16:06.410960 27238 leader_election.cc:304] T 9b043163bdc941cba463321241b1bef4 P 0a0506729556426db8d473385faab326 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a0506729556426db8d473385faab326, 9ed05238324a485da065c10ec2ab6339; no voters: 
I20260709 12:16:06.411926 27600 raft_consensus.cc:2804] T 9b043163bdc941cba463321241b1bef4 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:06.412331 27600 raft_consensus.cc:493] T 9b043163bdc941cba463321241b1bef4 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:06.412681 27600 raft_consensus.cc:3060] T 9b043163bdc941cba463321241b1bef4 P 0a0506729556426db8d473385faab326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:06.419744 27600 raft_consensus.cc:515] T 9b043163bdc941cba463321241b1bef4 P 0a0506729556426db8d473385faab326 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:06.421543 27600 leader_election.cc:290] T 9b043163bdc941cba463321241b1bef4 P 0a0506729556426db8d473385faab326 [CANDIDATE]: Term 1 election: Requested vote from peers dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194:39423), 9ed05238324a485da065c10ec2ab6339 (127.12.56.195:39461)
I20260709 12:16:06.422603 27345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b043163bdc941cba463321241b1bef4" candidate_uuid: "0a0506729556426db8d473385faab326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05"
I20260709 12:16:06.422662 27421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b043163bdc941cba463321241b1bef4" candidate_uuid: "0a0506729556426db8d473385faab326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ed05238324a485da065c10ec2ab6339"
I20260709 12:16:06.423314 27345 raft_consensus.cc:3060] T 9b043163bdc941cba463321241b1bef4 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:06.423588 27421 raft_consensus.cc:3060] T 9b043163bdc941cba463321241b1bef4 P 9ed05238324a485da065c10ec2ab6339 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:06.430670 27421 raft_consensus.cc:2468] T 9b043163bdc941cba463321241b1bef4 P 9ed05238324a485da065c10ec2ab6339 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a0506729556426db8d473385faab326 in term 1.
I20260709 12:16:06.430768 27345 raft_consensus.cc:2468] T 9b043163bdc941cba463321241b1bef4 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a0506729556426db8d473385faab326 in term 1.
I20260709 12:16:06.432646 27238 leader_election.cc:304] T 9b043163bdc941cba463321241b1bef4 P 0a0506729556426db8d473385faab326 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a0506729556426db8d473385faab326, 9ed05238324a485da065c10ec2ab6339; no voters: 
I20260709 12:16:06.433526 27600 raft_consensus.cc:2804] T 9b043163bdc941cba463321241b1bef4 P 0a0506729556426db8d473385faab326 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:06.434363 27600 raft_consensus.cc:697] T 9b043163bdc941cba463321241b1bef4 P 0a0506729556426db8d473385faab326 [term 1 LEADER]: Becoming Leader. State: Replica: 0a0506729556426db8d473385faab326, State: Running, Role: LEADER
I20260709 12:16:06.435384 27600 consensus_queue.cc:237] T 9b043163bdc941cba463321241b1bef4 P 0a0506729556426db8d473385faab326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:06.443965 27168 catalog_manager.cc:5697] T 9b043163bdc941cba463321241b1bef4 P 0a0506729556426db8d473385faab326 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0a0506729556426db8d473385faab326 (127.12.56.193). New cstate: current_term: 1 leader_uuid: "0a0506729556426db8d473385faab326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:06.465083 27600 consensus_queue.cc:1048] T 63806869f2eb4957b569e050893620ad P 0a0506729556426db8d473385faab326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:06.469753 27603 consensus_queue.cc:1048] T 0a03180a7e6744d5b9f132803996caf0 P 0a0506729556426db8d473385faab326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:06.478953 27533 consensus_queue.cc:1048] T 63806869f2eb4957b569e050893620ad P 0a0506729556426db8d473385faab326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:06.497056 27603 consensus_queue.cc:1048] T 0a03180a7e6744d5b9f132803996caf0 P 0a0506729556426db8d473385faab326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:06.646996 27345 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa55fdcc1b254bd9bfdabf150f131087"
dest_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05"
mode: GRACEFUL
new_leader_uuid: "0a0506729556426db8d473385faab326"
 from {username='slave'} at 127.0.0.1:43816
I20260709 12:16:06.647620 27345 raft_consensus.cc:606] T aa55fdcc1b254bd9bfdabf150f131087 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 LEADER]: Received request to transfer leadership to TS 0a0506729556426db8d473385faab326
I20260709 12:16:06.653522 27421 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d5508d37842541ff874bc41bf8f41784"
dest_uuid: "9ed05238324a485da065c10ec2ab6339"
mode: GRACEFUL
new_leader_uuid: "0a0506729556426db8d473385faab326"
 from {username='slave'} at 127.0.0.1:48856
I20260709 12:16:06.654225 27421 raft_consensus.cc:606] T d5508d37842541ff874bc41bf8f41784 P 9ed05238324a485da065c10ec2ab6339 [term 1 LEADER]: Received request to transfer leadership to TS 0a0506729556426db8d473385faab326
I20260709 12:16:06.660929 27421 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "972b0f22614e4759b9c9a2454dada333"
dest_uuid: "9ed05238324a485da065c10ec2ab6339"
mode: GRACEFUL
new_leader_uuid: "0a0506729556426db8d473385faab326"
 from {username='slave'} at 127.0.0.1:48856
I20260709 12:16:06.661550 27421 raft_consensus.cc:606] T 972b0f22614e4759b9c9a2454dada333 P 9ed05238324a485da065c10ec2ab6339 [term 1 LEADER]: Received request to transfer leadership to TS 0a0506729556426db8d473385faab326
I20260709 12:16:06.665642 27577 consensus_queue.cc:1048] T 71be868a9d474261a6b88e2e66af4e85 P dd5ffdb93acf492d8a343cc3b6e1aa05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:06.675462 27272 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "63806869f2eb4957b569e050893620ad"
dest_uuid: "0a0506729556426db8d473385faab326"
mode: GRACEFUL
new_leader_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05"
 from {username='slave'} at 127.0.0.1:49164
I20260709 12:16:06.676134 27272 raft_consensus.cc:606] T 63806869f2eb4957b569e050893620ad P 0a0506729556426db8d473385faab326 [term 1 LEADER]: Received request to transfer leadership to TS dd5ffdb93acf492d8a343cc3b6e1aa05
I20260709 12:16:06.686800 27609 consensus_queue.cc:1048] T 71be868a9d474261a6b88e2e66af4e85 P dd5ffdb93acf492d8a343cc3b6e1aa05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:06.688635 27533 consensus_queue.cc:1048] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 0a0506729556426db8d473385faab326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:06.690476 27271 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7baaab759f2c4b4ab1ea3d0578ed0c06"
dest_uuid: "0a0506729556426db8d473385faab326"
mode: GRACEFUL
new_leader_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05"
 from {username='slave'} at 127.0.0.1:49164
I20260709 12:16:06.691223 27271 raft_consensus.cc:606] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 0a0506729556426db8d473385faab326 [term 1 LEADER]: Received request to transfer leadership to TS dd5ffdb93acf492d8a343cc3b6e1aa05
I20260709 12:16:06.692848 27616 raft_consensus.cc:993] T d5508d37842541ff874bc41bf8f41784 P 9ed05238324a485da065c10ec2ab6339: : Instructing follower 0a0506729556426db8d473385faab326 to start an election
I20260709 12:16:06.693401 27616 raft_consensus.cc:1081] T d5508d37842541ff874bc41bf8f41784 P 9ed05238324a485da065c10ec2ab6339 [term 1 LEADER]: Signalling peer 0a0506729556426db8d473385faab326 to start an election
I20260709 12:16:06.695482 27271 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d5508d37842541ff874bc41bf8f41784"
dest_uuid: "0a0506729556426db8d473385faab326"
 from {username='slave'} at 127.0.0.1:49146
I20260709 12:16:06.696177 27271 raft_consensus.cc:493] T d5508d37842541ff874bc41bf8f41784 P 0a0506729556426db8d473385faab326 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:06.696614 27271 raft_consensus.cc:3060] T d5508d37842541ff874bc41bf8f41784 P 0a0506729556426db8d473385faab326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:06.702615 27272 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b043163bdc941cba463321241b1bef4"
dest_uuid: "0a0506729556426db8d473385faab326"
mode: GRACEFUL
new_leader_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05"
 from {username='slave'} at 127.0.0.1:49164
I20260709 12:16:06.703652 27272 raft_consensus.cc:606] T 9b043163bdc941cba463321241b1bef4 P 0a0506729556426db8d473385faab326 [term 1 LEADER]: Received request to transfer leadership to TS dd5ffdb93acf492d8a343cc3b6e1aa05
I20260709 12:16:06.711256 27345 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71be868a9d474261a6b88e2e66af4e85"
dest_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05"
mode: GRACEFUL
new_leader_uuid: "9ed05238324a485da065c10ec2ab6339"
 from {username='slave'} at 127.0.0.1:43816
I20260709 12:16:06.712167 27345 raft_consensus.cc:606] T 71be868a9d474261a6b88e2e66af4e85 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 LEADER]: Received request to transfer leadership to TS 9ed05238324a485da065c10ec2ab6339
I20260709 12:16:06.715061 27616 consensus_queue.cc:1048] T 972b0f22614e4759b9c9a2454dada333 P 9ed05238324a485da065c10ec2ab6339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:06.715440 27271 raft_consensus.cc:515] T d5508d37842541ff874bc41bf8f41784 P 0a0506729556426db8d473385faab326 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:06.718513 27346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5508d37842541ff874bc41bf8f41784" candidate_uuid: "0a0506729556426db8d473385faab326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05"
I20260709 12:16:06.719159 27346 raft_consensus.cc:3060] T d5508d37842541ff874bc41bf8f41784 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:06.726899 27577 raft_consensus.cc:993] T 71be868a9d474261a6b88e2e66af4e85 P dd5ffdb93acf492d8a343cc3b6e1aa05: : Instructing follower 9ed05238324a485da065c10ec2ab6339 to start an election
I20260709 12:16:06.727578 27609 raft_consensus.cc:1081] T 71be868a9d474261a6b88e2e66af4e85 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 LEADER]: Signalling peer 9ed05238324a485da065c10ec2ab6339 to start an election
I20260709 12:16:06.728114 27346 raft_consensus.cc:2468] T d5508d37842541ff874bc41bf8f41784 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a0506729556426db8d473385faab326 in term 2.
I20260709 12:16:06.729394 27237 leader_election.cc:304] T d5508d37842541ff874bc41bf8f41784 P 0a0506729556426db8d473385faab326 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a0506729556426db8d473385faab326, dd5ffdb93acf492d8a343cc3b6e1aa05; no voters: 
I20260709 12:16:06.730608 27533 raft_consensus.cc:2804] T d5508d37842541ff874bc41bf8f41784 P 0a0506729556426db8d473385faab326 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:06.731223 27533 raft_consensus.cc:697] T d5508d37842541ff874bc41bf8f41784 P 0a0506729556426db8d473385faab326 [term 2 LEADER]: Becoming Leader. State: Replica: 0a0506729556426db8d473385faab326, State: Running, Role: LEADER
I20260709 12:16:06.732164 27533 consensus_queue.cc:237] T d5508d37842541ff874bc41bf8f41784 P 0a0506729556426db8d473385faab326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:06.735677 27271 leader_election.cc:290] T d5508d37842541ff874bc41bf8f41784 P 0a0506729556426db8d473385faab326 [CANDIDATE]: Term 2 election: Requested vote from peers dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194:39423), 9ed05238324a485da065c10ec2ab6339 (127.12.56.195:39461)
I20260709 12:16:06.738572 27421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5508d37842541ff874bc41bf8f41784" candidate_uuid: "0a0506729556426db8d473385faab326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ed05238324a485da065c10ec2ab6339"
I20260709 12:16:06.739269 27421 raft_consensus.cc:3055] T d5508d37842541ff874bc41bf8f41784 P 9ed05238324a485da065c10ec2ab6339 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:06.739602 27421 raft_consensus.cc:740] T d5508d37842541ff874bc41bf8f41784 P 9ed05238324a485da065c10ec2ab6339 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ed05238324a485da065c10ec2ab6339, State: Running, Role: LEADER
I20260709 12:16:06.740475 27421 consensus_queue.cc:260] T d5508d37842541ff874bc41bf8f41784 P 9ed05238324a485da065c10ec2ab6339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:06.741678 27421 raft_consensus.cc:3060] T d5508d37842541ff874bc41bf8f41784 P 9ed05238324a485da065c10ec2ab6339 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:06.742257 27533 consensus_queue.cc:1048] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 0a0506729556426db8d473385faab326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:06.749269 27611 consensus_queue.cc:1048] T 41a4729ca1394ea0ac6f01132efd57f0 P dd5ffdb93acf492d8a343cc3b6e1aa05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:06.750216 27420 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "71be868a9d474261a6b88e2e66af4e85"
dest_uuid: "9ed05238324a485da065c10ec2ab6339"
 from {username='slave'} at 127.0.0.1:48826
I20260709 12:16:06.751076 27420 raft_consensus.cc:493] T 71be868a9d474261a6b88e2e66af4e85 P 9ed05238324a485da065c10ec2ab6339 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:06.751587 27420 raft_consensus.cc:3060] T 71be868a9d474261a6b88e2e66af4e85 P 9ed05238324a485da065c10ec2ab6339 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:06.754246 27169 catalog_manager.cc:5697] T d5508d37842541ff874bc41bf8f41784 P 0a0506729556426db8d473385faab326 reported cstate change: term changed from 1 to 2, leader changed from 9ed05238324a485da065c10ec2ab6339 (127.12.56.195) to 0a0506729556426db8d473385faab326 (127.12.56.193). New cstate: current_term: 2 leader_uuid: "0a0506729556426db8d473385faab326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:06.755318 27421 raft_consensus.cc:2468] T d5508d37842541ff874bc41bf8f41784 P 9ed05238324a485da065c10ec2ab6339 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a0506729556426db8d473385faab326 in term 2.
I20260709 12:16:06.762310 27420 raft_consensus.cc:515] T 71be868a9d474261a6b88e2e66af4e85 P 9ed05238324a485da065c10ec2ab6339 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:06.765890 27348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71be868a9d474261a6b88e2e66af4e85" candidate_uuid: "9ed05238324a485da065c10ec2ab6339" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05"
I20260709 12:16:06.766677 27348 raft_consensus.cc:3055] T 71be868a9d474261a6b88e2e66af4e85 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:06.767073 27348 raft_consensus.cc:740] T 71be868a9d474261a6b88e2e66af4e85 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dd5ffdb93acf492d8a343cc3b6e1aa05, State: Running, Role: LEADER
I20260709 12:16:06.767843 27420 leader_election.cc:290] T 71be868a9d474261a6b88e2e66af4e85 P 9ed05238324a485da065c10ec2ab6339 [CANDIDATE]: Term 2 election: Requested vote from peers 0a0506729556426db8d473385faab326 (127.12.56.193:33959), dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194:39423)
I20260709 12:16:06.768661 27348 consensus_queue.cc:260] T 71be868a9d474261a6b88e2e66af4e85 P dd5ffdb93acf492d8a343cc3b6e1aa05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:06.770799 27348 raft_consensus.cc:3060] T 71be868a9d474261a6b88e2e66af4e85 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:06.775051 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71be868a9d474261a6b88e2e66af4e85" candidate_uuid: "9ed05238324a485da065c10ec2ab6339" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0a0506729556426db8d473385faab326"
I20260709 12:16:06.776054 27271 raft_consensus.cc:3060] T 71be868a9d474261a6b88e2e66af4e85 P 0a0506729556426db8d473385faab326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:06.778324 27616 consensus_queue.cc:1048] T 972b0f22614e4759b9c9a2454dada333 P 9ed05238324a485da065c10ec2ab6339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:06.782698 27610 consensus_queue.cc:1048] T 41a4729ca1394ea0ac6f01132efd57f0 P dd5ffdb93acf492d8a343cc3b6e1aa05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:06.797744 27578 raft_consensus.cc:993] T 972b0f22614e4759b9c9a2454dada333 P 9ed05238324a485da065c10ec2ab6339: : Instructing follower 0a0506729556426db8d473385faab326 to start an election
I20260709 12:16:06.798287 27578 raft_consensus.cc:1081] T 972b0f22614e4759b9c9a2454dada333 P 9ed05238324a485da065c10ec2ab6339 [term 1 LEADER]: Signalling peer 0a0506729556426db8d473385faab326 to start an election
I20260709 12:16:06.802098 27272 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "972b0f22614e4759b9c9a2454dada333"
dest_uuid: "0a0506729556426db8d473385faab326"
 from {username='slave'} at 127.0.0.1:49146
I20260709 12:16:06.802677 27272 raft_consensus.cc:493] T 972b0f22614e4759b9c9a2454dada333 P 0a0506729556426db8d473385faab326 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:06.803035 27272 raft_consensus.cc:3060] T 972b0f22614e4759b9c9a2454dada333 P 0a0506729556426db8d473385faab326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:06.804136 27271 raft_consensus.cc:2468] T 71be868a9d474261a6b88e2e66af4e85 P 0a0506729556426db8d473385faab326 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ed05238324a485da065c10ec2ab6339 in term 2.
I20260709 12:16:06.804999 27533 raft_consensus.cc:993] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 0a0506729556426db8d473385faab326: : Instructing follower dd5ffdb93acf492d8a343cc3b6e1aa05 to start an election
I20260709 12:16:06.805546 27576 raft_consensus.cc:1081] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 0a0506729556426db8d473385faab326 [term 1 LEADER]: Signalling peer dd5ffdb93acf492d8a343cc3b6e1aa05 to start an election
I20260709 12:16:06.807448 27346 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7baaab759f2c4b4ab1ea3d0578ed0c06"
dest_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05"
 from {username='slave'} at 127.0.0.1:43800
I20260709 12:16:06.808072 27346 raft_consensus.cc:493] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:06.808447 27346 raft_consensus.cc:3060] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:06.814574 27388 leader_election.cc:304] T 71be868a9d474261a6b88e2e66af4e85 P 9ed05238324a485da065c10ec2ab6339 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a0506729556426db8d473385faab326, 9ed05238324a485da065c10ec2ab6339; no voters: 
I20260709 12:16:06.817363 27346 raft_consensus.cc:515] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:06.817818 27272 raft_consensus.cc:515] T 972b0f22614e4759b9c9a2454dada333 P 0a0506729556426db8d473385faab326 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:06.820122 27346 leader_election.cc:290] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P dd5ffdb93acf492d8a343cc3b6e1aa05 [CANDIDATE]: Term 2 election: Requested vote from peers 0a0506729556426db8d473385faab326 (127.12.56.193:33959), 9ed05238324a485da065c10ec2ab6339 (127.12.56.195:39461)
I20260709 12:16:06.820556 27345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "972b0f22614e4759b9c9a2454dada333" candidate_uuid: "0a0506729556426db8d473385faab326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05"
I20260709 12:16:06.821214 27345 raft_consensus.cc:3060] T 972b0f22614e4759b9c9a2454dada333 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:06.817265 27616 raft_consensus.cc:2804] T 71be868a9d474261a6b88e2e66af4e85 P 9ed05238324a485da065c10ec2ab6339 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:06.824481 27616 raft_consensus.cc:697] T 71be868a9d474261a6b88e2e66af4e85 P 9ed05238324a485da065c10ec2ab6339 [term 2 LEADER]: Becoming Leader. State: Replica: 9ed05238324a485da065c10ec2ab6339, State: Running, Role: LEADER
I20260709 12:16:06.825325 27616 consensus_queue.cc:237] T 71be868a9d474261a6b88e2e66af4e85 P 9ed05238324a485da065c10ec2ab6339 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:06.827776 27421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baaab759f2c4b4ab1ea3d0578ed0c06" candidate_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ed05238324a485da065c10ec2ab6339"
I20260709 12:16:06.828558 27421 raft_consensus.cc:3060] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 9ed05238324a485da065c10ec2ab6339 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:06.829528 27345 raft_consensus.cc:2468] T 972b0f22614e4759b9c9a2454dada333 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a0506729556426db8d473385faab326 in term 2.
I20260709 12:16:06.830214 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7baaab759f2c4b4ab1ea3d0578ed0c06" candidate_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0a0506729556426db8d473385faab326"
I20260709 12:16:06.830904 27271 raft_consensus.cc:3055] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 0a0506729556426db8d473385faab326 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:06.831023 27237 leader_election.cc:304] T 972b0f22614e4759b9c9a2454dada333 P 0a0506729556426db8d473385faab326 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a0506729556426db8d473385faab326, dd5ffdb93acf492d8a343cc3b6e1aa05; no voters: 
I20260709 12:16:06.832072 27603 raft_consensus.cc:2804] T 972b0f22614e4759b9c9a2454dada333 P 0a0506729556426db8d473385faab326 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:06.832523 27603 raft_consensus.cc:697] T 972b0f22614e4759b9c9a2454dada333 P 0a0506729556426db8d473385faab326 [term 2 LEADER]: Becoming Leader. State: Replica: 0a0506729556426db8d473385faab326, State: Running, Role: LEADER
I20260709 12:16:06.833565 27348 raft_consensus.cc:2468] T 71be868a9d474261a6b88e2e66af4e85 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ed05238324a485da065c10ec2ab6339 in term 2.
I20260709 12:16:06.833348 27603 consensus_queue.cc:237] T 972b0f22614e4759b9c9a2454dada333 P 0a0506729556426db8d473385faab326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:06.835155 27272 leader_election.cc:290] T 972b0f22614e4759b9c9a2454dada333 P 0a0506729556426db8d473385faab326 [CANDIDATE]: Term 2 election: Requested vote from peers dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194:39423), 9ed05238324a485da065c10ec2ab6339 (127.12.56.195:39461)
I20260709 12:16:06.834666 27170 catalog_manager.cc:5697] T 71be868a9d474261a6b88e2e66af4e85 P 9ed05238324a485da065c10ec2ab6339 reported cstate change: term changed from 1 to 2, leader changed from dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194) to 9ed05238324a485da065c10ec2ab6339 (127.12.56.195). New cstate: current_term: 2 leader_uuid: "9ed05238324a485da065c10ec2ab6339" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:06.831281 27271 raft_consensus.cc:740] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 0a0506729556426db8d473385faab326 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0a0506729556426db8d473385faab326, State: Running, Role: LEADER
I20260709 12:16:06.837679 27271 consensus_queue.cc:260] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 0a0506729556426db8d473385faab326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:06.839136 27271 raft_consensus.cc:3060] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 0a0506729556426db8d473385faab326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:06.841164 27421 raft_consensus.cc:2468] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 9ed05238324a485da065c10ec2ab6339 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd5ffdb93acf492d8a343cc3b6e1aa05 in term 2.
I20260709 12:16:06.841435 27419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "972b0f22614e4759b9c9a2454dada333" candidate_uuid: "0a0506729556426db8d473385faab326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ed05238324a485da065c10ec2ab6339"
I20260709 12:16:06.842208 27419 raft_consensus.cc:3055] T 972b0f22614e4759b9c9a2454dada333 P 9ed05238324a485da065c10ec2ab6339 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:06.842540 27419 raft_consensus.cc:740] T 972b0f22614e4759b9c9a2454dada333 P 9ed05238324a485da065c10ec2ab6339 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ed05238324a485da065c10ec2ab6339, State: Running, Role: LEADER
I20260709 12:16:06.842594 27313 leader_election.cc:304] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P dd5ffdb93acf492d8a343cc3b6e1aa05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ed05238324a485da065c10ec2ab6339, dd5ffdb93acf492d8a343cc3b6e1aa05; no voters: 
I20260709 12:16:06.843781 27611 raft_consensus.cc:2804] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:06.843469 27419 consensus_queue.cc:260] T 972b0f22614e4759b9c9a2454dada333 P 9ed05238324a485da065c10ec2ab6339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:06.844340 27611 raft_consensus.cc:697] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 2 LEADER]: Becoming Leader. State: Replica: dd5ffdb93acf492d8a343cc3b6e1aa05, State: Running, Role: LEADER
I20260709 12:16:06.844910 27419 raft_consensus.cc:3060] T 972b0f22614e4759b9c9a2454dada333 P 9ed05238324a485da065c10ec2ab6339 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:06.845222 27611 consensus_queue.cc:237] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P dd5ffdb93acf492d8a343cc3b6e1aa05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:06.847901 27271 raft_consensus.cc:2468] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 0a0506729556426db8d473385faab326 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd5ffdb93acf492d8a343cc3b6e1aa05 in term 2.
I20260709 12:16:06.851399 27169 catalog_manager.cc:5697] T 972b0f22614e4759b9c9a2454dada333 P 0a0506729556426db8d473385faab326 reported cstate change: term changed from 1 to 2, leader changed from 9ed05238324a485da065c10ec2ab6339 (127.12.56.195) to 0a0506729556426db8d473385faab326 (127.12.56.193). New cstate: current_term: 2 leader_uuid: "0a0506729556426db8d473385faab326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:06.855373 27419 raft_consensus.cc:2468] T 972b0f22614e4759b9c9a2454dada333 P 9ed05238324a485da065c10ec2ab6339 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a0506729556426db8d473385faab326 in term 2.
I20260709 12:16:06.859419 27170 catalog_manager.cc:5697] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P dd5ffdb93acf492d8a343cc3b6e1aa05 reported cstate change: term changed from 1 to 2, leader changed from 0a0506729556426db8d473385faab326 (127.12.56.193) to dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194). New cstate: current_term: 2 leader_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:06.918366 27576 consensus_queue.cc:1048] T 9b043163bdc941cba463321241b1bef4 P 0a0506729556426db8d473385faab326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:06.920928 27610 raft_consensus.cc:993] T aa55fdcc1b254bd9bfdabf150f131087 P dd5ffdb93acf492d8a343cc3b6e1aa05: : Instructing follower 0a0506729556426db8d473385faab326 to start an election
I20260709 12:16:06.921518 27577 raft_consensus.cc:1081] T aa55fdcc1b254bd9bfdabf150f131087 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 LEADER]: Signalling peer 0a0506729556426db8d473385faab326 to start an election
I20260709 12:16:06.923617 27271 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aa55fdcc1b254bd9bfdabf150f131087"
dest_uuid: "0a0506729556426db8d473385faab326"
 from {username='slave'} at 127.0.0.1:49152
I20260709 12:16:06.924348 27271 raft_consensus.cc:493] T aa55fdcc1b254bd9bfdabf150f131087 P 0a0506729556426db8d473385faab326 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:06.924774 27271 raft_consensus.cc:3060] T aa55fdcc1b254bd9bfdabf150f131087 P 0a0506729556426db8d473385faab326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:06.926573 27603 raft_consensus.cc:993] T 9b043163bdc941cba463321241b1bef4 P 0a0506729556426db8d473385faab326: : Instructing follower dd5ffdb93acf492d8a343cc3b6e1aa05 to start an election
I20260709 12:16:06.927177 27603 raft_consensus.cc:1081] T 9b043163bdc941cba463321241b1bef4 P 0a0506729556426db8d473385faab326 [term 1 LEADER]: Signalling peer dd5ffdb93acf492d8a343cc3b6e1aa05 to start an election
I20260709 12:16:06.929762 27348 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9b043163bdc941cba463321241b1bef4"
dest_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05"
 from {username='slave'} at 127.0.0.1:43800
I20260709 12:16:06.930418 27348 raft_consensus.cc:493] T 9b043163bdc941cba463321241b1bef4 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:06.930809 27348 raft_consensus.cc:3060] T 9b043163bdc941cba463321241b1bef4 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:06.933324 27603 consensus_queue.cc:1048] T 9b043163bdc941cba463321241b1bef4 P 0a0506729556426db8d473385faab326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:06.938040 27271 raft_consensus.cc:515] T aa55fdcc1b254bd9bfdabf150f131087 P 0a0506729556426db8d473385faab326 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:06.939023 27348 raft_consensus.cc:515] T 9b043163bdc941cba463321241b1bef4 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:06.940747 27271 leader_election.cc:290] T aa55fdcc1b254bd9bfdabf150f131087 P 0a0506729556426db8d473385faab326 [CANDIDATE]: Term 2 election: Requested vote from peers dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194:39423), 9ed05238324a485da065c10ec2ab6339 (127.12.56.195:39461)
I20260709 12:16:06.941620 27346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa55fdcc1b254bd9bfdabf150f131087" candidate_uuid: "0a0506729556426db8d473385faab326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05"
I20260709 12:16:06.942408 27346 raft_consensus.cc:3055] T aa55fdcc1b254bd9bfdabf150f131087 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:06.942812 27346 raft_consensus.cc:740] T aa55fdcc1b254bd9bfdabf150f131087 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dd5ffdb93acf492d8a343cc3b6e1aa05, State: Running, Role: LEADER
I20260709 12:16:06.943846 27346 consensus_queue.cc:260] T aa55fdcc1b254bd9bfdabf150f131087 P dd5ffdb93acf492d8a343cc3b6e1aa05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:06.945426 27346 raft_consensus.cc:3060] T aa55fdcc1b254bd9bfdabf150f131087 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:06.947177 27421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa55fdcc1b254bd9bfdabf150f131087" candidate_uuid: "0a0506729556426db8d473385faab326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ed05238324a485da065c10ec2ab6339"
I20260709 12:16:06.947956 27421 raft_consensus.cc:3060] T aa55fdcc1b254bd9bfdabf150f131087 P 9ed05238324a485da065c10ec2ab6339 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:06.953620 27345 raft_consensus.cc:1240] T 9b043163bdc941cba463321241b1bef4 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 2 FOLLOWER]: Rejecting Update request from peer 0a0506729556426db8d473385faab326 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:06.954689 27346 raft_consensus.cc:2468] T aa55fdcc1b254bd9bfdabf150f131087 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a0506729556426db8d473385faab326 in term 2.
I20260709 12:16:06.955739 27421 raft_consensus.cc:2468] T aa55fdcc1b254bd9bfdabf150f131087 P 9ed05238324a485da065c10ec2ab6339 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a0506729556426db8d473385faab326 in term 2.
I20260709 12:16:06.956300 27237 leader_election.cc:304] T aa55fdcc1b254bd9bfdabf150f131087 P 0a0506729556426db8d473385faab326 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a0506729556426db8d473385faab326, dd5ffdb93acf492d8a343cc3b6e1aa05; no voters: 
I20260709 12:16:06.957325 27603 raft_consensus.cc:2804] T aa55fdcc1b254bd9bfdabf150f131087 P 0a0506729556426db8d473385faab326 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:06.957932 27603 raft_consensus.cc:697] T aa55fdcc1b254bd9bfdabf150f131087 P 0a0506729556426db8d473385faab326 [term 2 LEADER]: Becoming Leader. State: Replica: 0a0506729556426db8d473385faab326, State: Running, Role: LEADER
I20260709 12:16:06.958904 27603 consensus_queue.cc:237] T aa55fdcc1b254bd9bfdabf150f131087 P 0a0506729556426db8d473385faab326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:06.963168 27576 consensus_queue.cc:1059] T 9b043163bdc941cba463321241b1bef4 P 0a0506729556426db8d473385faab326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:06.964004 27348 leader_election.cc:290] T 9b043163bdc941cba463321241b1bef4 P dd5ffdb93acf492d8a343cc3b6e1aa05 [CANDIDATE]: Term 2 election: Requested vote from peers 0a0506729556426db8d473385faab326 (127.12.56.193:33959), 9ed05238324a485da065c10ec2ab6339 (127.12.56.195:39461)
I20260709 12:16:06.964834 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b043163bdc941cba463321241b1bef4" candidate_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0a0506729556426db8d473385faab326"
I20260709 12:16:06.964874 27576 raft_consensus.cc:3055] T 9b043163bdc941cba463321241b1bef4 P 0a0506729556426db8d473385faab326 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:06.966010 27576 raft_consensus.cc:740] T 9b043163bdc941cba463321241b1bef4 P 0a0506729556426db8d473385faab326 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0a0506729556426db8d473385faab326, State: Running, Role: LEADER
I20260709 12:16:06.966285 27421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b043163bdc941cba463321241b1bef4" candidate_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ed05238324a485da065c10ec2ab6339"
I20260709 12:16:06.966993 27421 raft_consensus.cc:3060] T 9b043163bdc941cba463321241b1bef4 P 9ed05238324a485da065c10ec2ab6339 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:06.967131 27576 consensus_queue.cc:260] T 9b043163bdc941cba463321241b1bef4 P 0a0506729556426db8d473385faab326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:06.968699 27576 raft_consensus.cc:3060] T 9b043163bdc941cba463321241b1bef4 P 0a0506729556426db8d473385faab326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:06.975737 27169 catalog_manager.cc:5697] T aa55fdcc1b254bd9bfdabf150f131087 P 0a0506729556426db8d473385faab326 reported cstate change: term changed from 1 to 2, leader changed from dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194) to 0a0506729556426db8d473385faab326 (127.12.56.193). New cstate: current_term: 2 leader_uuid: "0a0506729556426db8d473385faab326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:06.977509 27421 raft_consensus.cc:2468] T 9b043163bdc941cba463321241b1bef4 P 9ed05238324a485da065c10ec2ab6339 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd5ffdb93acf492d8a343cc3b6e1aa05 in term 2.
I20260709 12:16:06.980088 27313 leader_election.cc:304] T 9b043163bdc941cba463321241b1bef4 P dd5ffdb93acf492d8a343cc3b6e1aa05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ed05238324a485da065c10ec2ab6339, dd5ffdb93acf492d8a343cc3b6e1aa05; no voters: 
I20260709 12:16:06.981168 27577 raft_consensus.cc:2804] T 9b043163bdc941cba463321241b1bef4 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:06.981803 27577 raft_consensus.cc:697] T 9b043163bdc941cba463321241b1bef4 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 2 LEADER]: Becoming Leader. State: Replica: dd5ffdb93acf492d8a343cc3b6e1aa05, State: Running, Role: LEADER
I20260709 12:16:06.982754 27577 consensus_queue.cc:237] T 9b043163bdc941cba463321241b1bef4 P dd5ffdb93acf492d8a343cc3b6e1aa05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:06.985072 27271 raft_consensus.cc:2468] T 9b043163bdc941cba463321241b1bef4 P 0a0506729556426db8d473385faab326 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd5ffdb93acf492d8a343cc3b6e1aa05 in term 2.
I20260709 12:16:06.993543 27169 catalog_manager.cc:5697] T 9b043163bdc941cba463321241b1bef4 P dd5ffdb93acf492d8a343cc3b6e1aa05 reported cstate change: term changed from 1 to 2, leader changed from 0a0506729556426db8d473385faab326 (127.12.56.193) to dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194). New cstate: current_term: 2 leader_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:07.034096 27603 raft_consensus.cc:993] T 63806869f2eb4957b569e050893620ad P 0a0506729556426db8d473385faab326: : Instructing follower dd5ffdb93acf492d8a343cc3b6e1aa05 to start an election
I20260709 12:16:07.034567 27603 raft_consensus.cc:1081] T 63806869f2eb4957b569e050893620ad P 0a0506729556426db8d473385faab326 [term 1 LEADER]: Signalling peer dd5ffdb93acf492d8a343cc3b6e1aa05 to start an election
I20260709 12:16:07.036298 27346 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "63806869f2eb4957b569e050893620ad"
dest_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05"
 from {username='slave'} at 127.0.0.1:43800
I20260709 12:16:07.036846 27346 raft_consensus.cc:493] T 63806869f2eb4957b569e050893620ad P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:07.037379 27346 raft_consensus.cc:3060] T 63806869f2eb4957b569e050893620ad P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:07.044380 27346 raft_consensus.cc:515] T 63806869f2eb4957b569e050893620ad P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:07.046375 27346 leader_election.cc:290] T 63806869f2eb4957b569e050893620ad P dd5ffdb93acf492d8a343cc3b6e1aa05 [CANDIDATE]: Term 2 election: Requested vote from peers 0a0506729556426db8d473385faab326 (127.12.56.193:33959), 9ed05238324a485da065c10ec2ab6339 (127.12.56.195:39461)
I20260709 12:16:07.047382 27271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63806869f2eb4957b569e050893620ad" candidate_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0a0506729556426db8d473385faab326"
I20260709 12:16:07.047712 27421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63806869f2eb4957b569e050893620ad" candidate_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ed05238324a485da065c10ec2ab6339"
I20260709 12:16:07.048089 27271 raft_consensus.cc:3055] T 63806869f2eb4957b569e050893620ad P 0a0506729556426db8d473385faab326 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:07.048357 27421 raft_consensus.cc:3060] T 63806869f2eb4957b569e050893620ad P 9ed05238324a485da065c10ec2ab6339 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:07.048511 27271 raft_consensus.cc:740] T 63806869f2eb4957b569e050893620ad P 0a0506729556426db8d473385faab326 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0a0506729556426db8d473385faab326, State: Running, Role: LEADER
I20260709 12:16:07.049517 27271 consensus_queue.cc:260] T 63806869f2eb4957b569e050893620ad P 0a0506729556426db8d473385faab326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:07.050685 27271 raft_consensus.cc:3060] T 63806869f2eb4957b569e050893620ad P 0a0506729556426db8d473385faab326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:07.055250 27421 raft_consensus.cc:2468] T 63806869f2eb4957b569e050893620ad P 9ed05238324a485da065c10ec2ab6339 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd5ffdb93acf492d8a343cc3b6e1aa05 in term 2.
I20260709 12:16:07.057252 27313 leader_election.cc:304] T 63806869f2eb4957b569e050893620ad P dd5ffdb93acf492d8a343cc3b6e1aa05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ed05238324a485da065c10ec2ab6339, dd5ffdb93acf492d8a343cc3b6e1aa05; no voters: 
I20260709 12:16:07.058415 27577 raft_consensus.cc:2804] T 63806869f2eb4957b569e050893620ad P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:07.058604 27271 raft_consensus.cc:2468] T 63806869f2eb4957b569e050893620ad P 0a0506729556426db8d473385faab326 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd5ffdb93acf492d8a343cc3b6e1aa05 in term 2.
I20260709 12:16:07.059041 27577 raft_consensus.cc:697] T 63806869f2eb4957b569e050893620ad P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 2 LEADER]: Becoming Leader. State: Replica: dd5ffdb93acf492d8a343cc3b6e1aa05, State: Running, Role: LEADER
I20260709 12:16:07.060145 27577 consensus_queue.cc:237] T 63806869f2eb4957b569e050893620ad P dd5ffdb93acf492d8a343cc3b6e1aa05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:07.068791 27170 catalog_manager.cc:5697] T 63806869f2eb4957b569e050893620ad P dd5ffdb93acf492d8a343cc3b6e1aa05 reported cstate change: term changed from 1 to 2, leader changed from 0a0506729556426db8d473385faab326 (127.12.56.193) to dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194). New cstate: current_term: 2 leader_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:07.156344 27346 raft_consensus.cc:1275] T d5508d37842541ff874bc41bf8f41784 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 2 FOLLOWER]: Refusing update from remote peer 0a0506729556426db8d473385faab326: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:07.157717 27603 consensus_queue.cc:1048] T d5508d37842541ff874bc41bf8f41784 P 0a0506729556426db8d473385faab326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:07.168913 27421 raft_consensus.cc:1275] T d5508d37842541ff874bc41bf8f41784 P 9ed05238324a485da065c10ec2ab6339 [term 2 FOLLOWER]: Refusing update from remote peer 0a0506729556426db8d473385faab326: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:07.170305 27598 consensus_queue.cc:1048] T d5508d37842541ff874bc41bf8f41784 P 0a0506729556426db8d473385faab326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:07.306052 27346 raft_consensus.cc:1275] T 71be868a9d474261a6b88e2e66af4e85 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 2 FOLLOWER]: Refusing update from remote peer 9ed05238324a485da065c10ec2ab6339: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:07.307456 27616 consensus_queue.cc:1048] T 71be868a9d474261a6b88e2e66af4e85 P 9ed05238324a485da065c10ec2ab6339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:07.322919 27272 raft_consensus.cc:1275] T 71be868a9d474261a6b88e2e66af4e85 P 0a0506729556426db8d473385faab326 [term 2 FOLLOWER]: Refusing update from remote peer 9ed05238324a485da065c10ec2ab6339: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:07.324189 27640 consensus_queue.cc:1048] T 71be868a9d474261a6b88e2e66af4e85 P 9ed05238324a485da065c10ec2ab6339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:07.354358 27272 raft_consensus.cc:1275] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 0a0506729556426db8d473385faab326 [term 2 FOLLOWER]: Refusing update from remote peer dd5ffdb93acf492d8a343cc3b6e1aa05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:07.355927 27577 consensus_queue.cc:1048] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P dd5ffdb93acf492d8a343cc3b6e1aa05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:07.362957 27421 raft_consensus.cc:1275] T aa55fdcc1b254bd9bfdabf150f131087 P 9ed05238324a485da065c10ec2ab6339 [term 2 FOLLOWER]: Refusing update from remote peer 0a0506729556426db8d473385faab326: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:07.364439 27598 consensus_queue.cc:1048] T aa55fdcc1b254bd9bfdabf150f131087 P 0a0506729556426db8d473385faab326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:07.364974 27421 raft_consensus.cc:1275] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 9ed05238324a485da065c10ec2ab6339 [term 2 FOLLOWER]: Refusing update from remote peer dd5ffdb93acf492d8a343cc3b6e1aa05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:07.368142 27610 consensus_queue.cc:1048] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P dd5ffdb93acf492d8a343cc3b6e1aa05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:07.382704 27346 raft_consensus.cc:1275] T aa55fdcc1b254bd9bfdabf150f131087 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 2 FOLLOWER]: Refusing update from remote peer 0a0506729556426db8d473385faab326: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:07.384735 27600 consensus_queue.cc:1048] T aa55fdcc1b254bd9bfdabf150f131087 P 0a0506729556426db8d473385faab326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:07.408546 27420 raft_consensus.cc:1275] T 972b0f22614e4759b9c9a2454dada333 P 9ed05238324a485da065c10ec2ab6339 [term 2 FOLLOWER]: Refusing update from remote peer 0a0506729556426db8d473385faab326: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:07.410386 27598 consensus_queue.cc:1048] T 972b0f22614e4759b9c9a2454dada333 P 0a0506729556426db8d473385faab326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:07.420428 27346 raft_consensus.cc:1275] T 972b0f22614e4759b9c9a2454dada333 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 2 FOLLOWER]: Refusing update from remote peer 0a0506729556426db8d473385faab326: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:07.422226 27576 consensus_queue.cc:1048] T 972b0f22614e4759b9c9a2454dada333 P 0a0506729556426db8d473385faab326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:07.488934 27420 raft_consensus.cc:1275] T 9b043163bdc941cba463321241b1bef4 P 9ed05238324a485da065c10ec2ab6339 [term 2 FOLLOWER]: Refusing update from remote peer dd5ffdb93acf492d8a343cc3b6e1aa05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:07.490412 27610 consensus_queue.cc:1048] T 9b043163bdc941cba463321241b1bef4 P dd5ffdb93acf492d8a343cc3b6e1aa05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:07.498782 27272 raft_consensus.cc:1275] T 9b043163bdc941cba463321241b1bef4 P 0a0506729556426db8d473385faab326 [term 2 FOLLOWER]: Refusing update from remote peer dd5ffdb93acf492d8a343cc3b6e1aa05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:07.500311 27610 consensus_queue.cc:1048] T 9b043163bdc941cba463321241b1bef4 P dd5ffdb93acf492d8a343cc3b6e1aa05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:07.517431 27272 raft_consensus.cc:1275] T 63806869f2eb4957b569e050893620ad P 0a0506729556426db8d473385faab326 [term 2 FOLLOWER]: Refusing update from remote peer dd5ffdb93acf492d8a343cc3b6e1aa05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:07.518900 27610 consensus_queue.cc:1048] T 63806869f2eb4957b569e050893620ad P dd5ffdb93acf492d8a343cc3b6e1aa05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:07.528896 27420 raft_consensus.cc:1275] T 63806869f2eb4957b569e050893620ad P 9ed05238324a485da065c10ec2ab6339 [term 2 FOLLOWER]: Refusing update from remote peer dd5ffdb93acf492d8a343cc3b6e1aa05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:07.531046 27611 consensus_queue.cc:1048] T 63806869f2eb4957b569e050893620ad P dd5ffdb93acf492d8a343cc3b6e1aa05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:10.502329 27170 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49254:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:16:10.530817 27170 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49254:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:16:10.621628 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:10.878342 27700 tablet.cc:1724] T 63806869f2eb4957b569e050893620ad P 0a0506729556426db8d473385faab326: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:10.890307 27696 tablet.cc:1724] T 63806869f2eb4957b569e050893620ad P dd5ffdb93acf492d8a343cc3b6e1aa05: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:10.970824 27709 tablet.cc:1724] T 71be868a9d474261a6b88e2e66af4e85 P 9ed05238324a485da065c10ec2ab6339: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:10.974495 27706 tablet.cc:1724] T 972b0f22614e4759b9c9a2454dada333 P 0a0506729556426db8d473385faab326: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:16:11.007253 27697 log.cc:927] Time spent T 9b043163bdc941cba463321241b1bef4 P 9ed05238324a485da065c10ec2ab6339: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:16:11.087045 27713 tablet.cc:1724] T aa55fdcc1b254bd9bfdabf150f131087 P 0a0506729556426db8d473385faab326: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:11.093636 27714 tablet.cc:1724] T 0a03180a7e6744d5b9f132803996caf0 P 0a0506729556426db8d473385faab326: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:16:11.113631 27711 log.cc:927] Time spent T 71be868a9d474261a6b88e2e66af4e85 P 0a0506729556426db8d473385faab326: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260709 12:16:11.114365 27716 log.cc:927] Time spent T d5508d37842541ff874bc41bf8f41784 P 9ed05238324a485da065c10ec2ab6339: Append to log took a long time: real 0.058s	user 0.002s	sys 0.000s
W20260709 12:16:11.116658 27707 log.cc:927] Time spent T 0a03180a7e6744d5b9f132803996caf0 P dd5ffdb93acf492d8a343cc3b6e1aa05: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
W20260709 12:16:11.116173 27705 log.cc:927] Time spent T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 9ed05238324a485da065c10ec2ab6339: Append to log took a long time: real 0.075s	user 0.003s	sys 0.000s
I20260709 12:16:11.124660 27715 tablet.cc:1724] T 71be868a9d474261a6b88e2e66af4e85 P dd5ffdb93acf492d8a343cc3b6e1aa05: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:16:11.102761 27314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.56.193:33959, user_credentials={real_user=slave}} blocked reactor thread for 81855us
I20260709 12:16:11.137933 27700 tablet.cc:1724] T d5508d37842541ff874bc41bf8f41784 P 0a0506729556426db8d473385faab326: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:11.145972 27721 tablet.cc:1724] T 972b0f22614e4759b9c9a2454dada333 P 9ed05238324a485da065c10ec2ab6339: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:11.153759 27724 tablet.cc:1724] T 41a4729ca1394ea0ac6f01132efd57f0 P 9ed05238324a485da065c10ec2ab6339: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:11.154808 27709 tablet.cc:1724] T 0a03180a7e6744d5b9f132803996caf0 P 9ed05238324a485da065c10ec2ab6339: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:11.141413 27696 tablet.cc:1724] T aa55fdcc1b254bd9bfdabf150f131087 P dd5ffdb93acf492d8a343cc3b6e1aa05: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:11.145094 27346 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "59e886aafa51485392355848493e17f0"
dest_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05"
mode: GRACEFUL
new_leader_uuid: "9ed05238324a485da065c10ec2ab6339"
 from {username='slave'} at 127.0.0.1:38070
I20260709 12:16:11.161003 27346 raft_consensus.cc:606] T 59e886aafa51485392355848493e17f0 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 LEADER]: Received request to transfer leadership to TS 9ed05238324a485da065c10ec2ab6339
I20260709 12:16:11.160658 27713 tablet.cc:1724] T 9b043163bdc941cba463321241b1bef4 P 0a0506729556426db8d473385faab326: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:11.171072 27723 tablet.cc:1724] T 41a4729ca1394ea0ac6f01132efd57f0 P dd5ffdb93acf492d8a343cc3b6e1aa05: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:11.202559 27170 catalog_manager.cc:5789] TS 0a0506729556426db8d473385faab326 (127.12.56.193:33959) does not have the latest schema for tablet d5508d37842541ff874bc41bf8f41784 (table soft_deleted_table [id=8fd2145e16ab4994aef4433da334c7c1]). Expected version 1 got 0
I20260709 12:16:11.206383 27720 tablet.cc:1724] T 63806869f2eb4957b569e050893620ad P 9ed05238324a485da065c10ec2ab6339: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:11.209472 27700 tablet.cc:1724] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 0a0506729556426db8d473385faab326: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:11.213212 27658 raft_consensus.cc:993] T 59e886aafa51485392355848493e17f0 P dd5ffdb93acf492d8a343cc3b6e1aa05: : Instructing follower 9ed05238324a485da065c10ec2ab6339 to start an election
I20260709 12:16:11.214042 27658 raft_consensus.cc:1081] T 59e886aafa51485392355848493e17f0 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 LEADER]: Signalling peer 9ed05238324a485da065c10ec2ab6339 to start an election
I20260709 12:16:11.181954 27715 tablet.cc:1724] T 972b0f22614e4759b9c9a2454dada333 P dd5ffdb93acf492d8a343cc3b6e1aa05: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:11.212715 27719 tablet.cc:1724] T 9b043163bdc941cba463321241b1bef4 P dd5ffdb93acf492d8a343cc3b6e1aa05: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:11.225385 27169 catalog_manager.cc:5789] TS dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194:39423) does not have the latest schema for tablet 7baaab759f2c4b4ab1ea3d0578ed0c06 (table soft_deleted_table [id=8fd2145e16ab4994aef4433da334c7c1]). Expected version 1 got 0
I20260709 12:16:11.225409 27724 tablet.cc:1724] T 9b043163bdc941cba463321241b1bef4 P 9ed05238324a485da065c10ec2ab6339: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:11.226425 27169 catalog_manager.cc:5789] TS dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194:39423) does not have the latest schema for tablet 9b043163bdc941cba463321241b1bef4 (table soft_deleted_table [id=8fd2145e16ab4994aef4433da334c7c1]). Expected version 1 got 0
I20260709 12:16:11.227253 27169 catalog_manager.cc:5789] TS dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194:39423) does not have the latest schema for tablet 41a4729ca1394ea0ac6f01132efd57f0 (table soft_deleted_table [id=8fd2145e16ab4994aef4433da334c7c1]). Expected version 1 got 0
I20260709 12:16:11.231184 27417 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "59e886aafa51485392355848493e17f0"
dest_uuid: "9ed05238324a485da065c10ec2ab6339"
 from {username='slave'} at 127.0.0.1:48826
I20260709 12:16:11.232986 27417 raft_consensus.cc:493] T 59e886aafa51485392355848493e17f0 P 9ed05238324a485da065c10ec2ab6339 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:11.227581 27723 tablet.cc:1724] T 0a03180a7e6744d5b9f132803996caf0 P dd5ffdb93acf492d8a343cc3b6e1aa05: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:11.233484 27417 raft_consensus.cc:3060] T 59e886aafa51485392355848493e17f0 P 9ed05238324a485da065c10ec2ab6339 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:11.235001 27696 tablet.cc:1724] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P dd5ffdb93acf492d8a343cc3b6e1aa05: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:11.245177 27706 tablet.cc:1724] T 71be868a9d474261a6b88e2e66af4e85 P 0a0506729556426db8d473385faab326: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:11.238580 27714 tablet.cc:1724] T 41a4729ca1394ea0ac6f01132efd57f0 P 0a0506729556426db8d473385faab326: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:11.252938 27719 tablet.cc:1724] T d5508d37842541ff874bc41bf8f41784 P dd5ffdb93acf492d8a343cc3b6e1aa05: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:11.258906 27721 tablet.cc:1724] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 9ed05238324a485da065c10ec2ab6339: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:11.261401 27709 tablet.cc:1724] T aa55fdcc1b254bd9bfdabf150f131087 P 9ed05238324a485da065c10ec2ab6339: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:11.267376 27417 raft_consensus.cc:515] T 59e886aafa51485392355848493e17f0 P 9ed05238324a485da065c10ec2ab6339 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:11.282956 27720 tablet.cc:1724] T d5508d37842541ff874bc41bf8f41784 P 9ed05238324a485da065c10ec2ab6339: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:16:11.284006 27269 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d966e0df1b51483d8939dabb9fc4fc70"
dest_uuid: "0a0506729556426db8d473385faab326"
mode: GRACEFUL
new_leader_uuid: "9ed05238324a485da065c10ec2ab6339"
 from {username='slave'} at 127.0.0.1:41788
I20260709 12:16:11.300534 27417 leader_election.cc:290] T 59e886aafa51485392355848493e17f0 P 9ed05238324a485da065c10ec2ab6339 [CANDIDATE]: Term 2 election: Requested vote from peers 0a0506729556426db8d473385faab326 (127.12.56.193:33959), dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194:39423)
I20260709 12:16:11.302170 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59e886aafa51485392355848493e17f0" candidate_uuid: "9ed05238324a485da065c10ec2ab6339" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05"
I20260709 12:16:11.303098 27342 raft_consensus.cc:3055] T 59e886aafa51485392355848493e17f0 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:11.303444 27342 raft_consensus.cc:740] T 59e886aafa51485392355848493e17f0 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dd5ffdb93acf492d8a343cc3b6e1aa05, State: Running, Role: LEADER
I20260709 12:16:11.304567 27342 consensus_queue.cc:260] T 59e886aafa51485392355848493e17f0 P dd5ffdb93acf492d8a343cc3b6e1aa05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:11.308034 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59e886aafa51485392355848493e17f0" candidate_uuid: "9ed05238324a485da065c10ec2ab6339" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0a0506729556426db8d473385faab326"
I20260709 12:16:11.306285 27269 raft_consensus.cc:606] T d966e0df1b51483d8939dabb9fc4fc70 P 0a0506729556426db8d473385faab326 [term 2 LEADER]: Received request to transfer leadership to TS 9ed05238324a485da065c10ec2ab6339
I20260709 12:16:11.308854 27268 raft_consensus.cc:3060] T 59e886aafa51485392355848493e17f0 P 0a0506729556426db8d473385faab326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:11.310395 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:16:11.311183 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:11.312254 27342 raft_consensus.cc:3060] T 59e886aafa51485392355848493e17f0 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:11.322239 27342 raft_consensus.cc:2468] T 59e886aafa51485392355848493e17f0 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ed05238324a485da065c10ec2ab6339 in term 2.
I20260709 12:16:11.323848 27386 leader_election.cc:304] T 59e886aafa51485392355848493e17f0 P 9ed05238324a485da065c10ec2ab6339 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ed05238324a485da065c10ec2ab6339, dd5ffdb93acf492d8a343cc3b6e1aa05; no voters: 
I20260709 12:16:11.325021 27661 raft_consensus.cc:2804] T 59e886aafa51485392355848493e17f0 P 9ed05238324a485da065c10ec2ab6339 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:11.325536 27661 raft_consensus.cc:697] T 59e886aafa51485392355848493e17f0 P 9ed05238324a485da065c10ec2ab6339 [term 2 LEADER]: Becoming Leader. State: Replica: 9ed05238324a485da065c10ec2ab6339, State: Running, Role: LEADER
I20260709 12:16:11.326570 27661 consensus_queue.cc:237] T 59e886aafa51485392355848493e17f0 P 9ed05238324a485da065c10ec2ab6339 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:11.332793 27268 raft_consensus.cc:2468] T 59e886aafa51485392355848493e17f0 P 0a0506729556426db8d473385faab326 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ed05238324a485da065c10ec2ab6339 in term 2.
I20260709 12:16:11.351959 27169 catalog_manager.cc:5697] T 59e886aafa51485392355848493e17f0 P 9ed05238324a485da065c10ec2ab6339 reported cstate change: term changed from 1 to 2, leader changed from dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194) to 9ed05238324a485da065c10ec2ab6339 (127.12.56.195). New cstate: current_term: 2 leader_uuid: "9ed05238324a485da065c10ec2ab6339" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:11.366678 27170 catalog_manager.cc:6242] T 00000000000000000000000000000000 P c5388a28a5a84ab2a7280d911210ee8c: soft_deleted_table [id=8fd2145e16ab4994aef4433da334c7c1] alter complete (version 1)
W20260709 12:16:11.378196 27369 debug-util.cc:398] Leaking SignalData structure 0x7b080011c300 after lost signal to thread 12518
I20260709 12:16:11.378949 27653 raft_consensus.cc:993] T d966e0df1b51483d8939dabb9fc4fc70 P 0a0506729556426db8d473385faab326: : Instructing follower 9ed05238324a485da065c10ec2ab6339 to start an election
I20260709 12:16:11.379580 27653 raft_consensus.cc:1081] T d966e0df1b51483d8939dabb9fc4fc70 P 0a0506729556426db8d473385faab326 [term 2 LEADER]: Signalling peer 9ed05238324a485da065c10ec2ab6339 to start an election
W20260709 12:16:11.379622 27369 debug-util.cc:398] Leaking SignalData structure 0x7b08000ec300 after lost signal to thread 27205
I20260709 12:16:11.381624 27417 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d966e0df1b51483d8939dabb9fc4fc70"
dest_uuid: "9ed05238324a485da065c10ec2ab6339"
 from {username='slave'} at 127.0.0.1:48842
I20260709 12:16:11.382426 27417 raft_consensus.cc:493] T d966e0df1b51483d8939dabb9fc4fc70 P 9ed05238324a485da065c10ec2ab6339 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:11.382934 27417 raft_consensus.cc:3060] T d966e0df1b51483d8939dabb9fc4fc70 P 9ed05238324a485da065c10ec2ab6339 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:16:11.383968 27369 debug-util.cc:398] Leaking SignalData structure 0x7b08000c8c00 after lost signal to thread 27446
I20260709 12:16:11.391028 27417 raft_consensus.cc:515] T d966e0df1b51483d8939dabb9fc4fc70 P 9ed05238324a485da065c10ec2ab6339 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:11.394819 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d966e0df1b51483d8939dabb9fc4fc70" candidate_uuid: "9ed05238324a485da065c10ec2ab6339" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0a0506729556426db8d473385faab326"
I20260709 12:16:11.395660 27268 raft_consensus.cc:3055] T d966e0df1b51483d8939dabb9fc4fc70 P 0a0506729556426db8d473385faab326 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:11.395864 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d966e0df1b51483d8939dabb9fc4fc70" candidate_uuid: "9ed05238324a485da065c10ec2ab6339" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05"
I20260709 12:16:11.396150 27268 raft_consensus.cc:740] T d966e0df1b51483d8939dabb9fc4fc70 P 0a0506729556426db8d473385faab326 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0a0506729556426db8d473385faab326, State: Running, Role: LEADER
I20260709 12:16:11.396677 27342 raft_consensus.cc:3060] T d966e0df1b51483d8939dabb9fc4fc70 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:11.397727 27268 consensus_queue.cc:260] T d966e0df1b51483d8939dabb9fc4fc70 P 0a0506729556426db8d473385faab326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:11.399446 27268 raft_consensus.cc:3060] T d966e0df1b51483d8939dabb9fc4fc70 P 0a0506729556426db8d473385faab326 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:11.402036 27417 leader_election.cc:290] T d966e0df1b51483d8939dabb9fc4fc70 P 9ed05238324a485da065c10ec2ab6339 [CANDIDATE]: Term 3 election: Requested vote from peers 0a0506729556426db8d473385faab326 (127.12.56.193:33959), dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194:39423)
I20260709 12:16:11.405562 27342 raft_consensus.cc:2468] T d966e0df1b51483d8939dabb9fc4fc70 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ed05238324a485da065c10ec2ab6339 in term 3.
I20260709 12:16:11.407637 27386 leader_election.cc:304] T d966e0df1b51483d8939dabb9fc4fc70 P 9ed05238324a485da065c10ec2ab6339 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ed05238324a485da065c10ec2ab6339, dd5ffdb93acf492d8a343cc3b6e1aa05; no voters: 
I20260709 12:16:11.408555 27661 raft_consensus.cc:2804] T d966e0df1b51483d8939dabb9fc4fc70 P 9ed05238324a485da065c10ec2ab6339 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:11.409044 27661 raft_consensus.cc:697] T d966e0df1b51483d8939dabb9fc4fc70 P 9ed05238324a485da065c10ec2ab6339 [term 3 LEADER]: Becoming Leader. State: Replica: 9ed05238324a485da065c10ec2ab6339, State: Running, Role: LEADER
I20260709 12:16:11.409693 27268 raft_consensus.cc:2468] T d966e0df1b51483d8939dabb9fc4fc70 P 0a0506729556426db8d473385faab326 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ed05238324a485da065c10ec2ab6339 in term 3.
I20260709 12:16:11.410178 27661 consensus_queue.cc:237] T d966e0df1b51483d8939dabb9fc4fc70 P 9ed05238324a485da065c10ec2ab6339 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } }
I20260709 12:16:11.420331 27169 catalog_manager.cc:5697] T d966e0df1b51483d8939dabb9fc4fc70 P 9ed05238324a485da065c10ec2ab6339 reported cstate change: term changed from 2 to 3, leader changed from 0a0506729556426db8d473385faab326 (127.12.56.193) to 9ed05238324a485da065c10ec2ab6339 (127.12.56.195). New cstate: current_term: 3 leader_uuid: "9ed05238324a485da065c10ec2ab6339" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ed05238324a485da065c10ec2ab6339" member_type: VOTER last_known_addr { host: "127.12.56.195" port: 39461 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:11.757521 27342 raft_consensus.cc:1275] T 59e886aafa51485392355848493e17f0 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 2 FOLLOWER]: Refusing update from remote peer 9ed05238324a485da065c10ec2ab6339: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:11.759749 27661 consensus_queue.cc:1048] T 59e886aafa51485392355848493e17f0 P 9ed05238324a485da065c10ec2ab6339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:11.775594 27268 raft_consensus.cc:1275] T 59e886aafa51485392355848493e17f0 P 0a0506729556426db8d473385faab326 [term 2 FOLLOWER]: Refusing update from remote peer 9ed05238324a485da065c10ec2ab6339: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:11.777340 27648 consensus_queue.cc:1048] T 59e886aafa51485392355848493e17f0 P 9ed05238324a485da065c10ec2ab6339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:11.795296 27347 raft_consensus.cc:1275] T d966e0df1b51483d8939dabb9fc4fc70 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 3 FOLLOWER]: Refusing update from remote peer 9ed05238324a485da065c10ec2ab6339: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:11.799247 27648 consensus_queue.cc:1048] T d966e0df1b51483d8939dabb9fc4fc70 P 9ed05238324a485da065c10ec2ab6339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd5ffdb93acf492d8a343cc3b6e1aa05" member_type: VOTER last_known_addr { host: "127.12.56.194" port: 39423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:11.812852 27268 raft_consensus.cc:1275] T d966e0df1b51483d8939dabb9fc4fc70 P 0a0506729556426db8d473385faab326 [term 3 FOLLOWER]: Refusing update from remote peer 9ed05238324a485da065c10ec2ab6339: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:11.816159 27661 consensus_queue.cc:1048] T d966e0df1b51483d8939dabb9fc4fc70 P 9ed05238324a485da065c10ec2ab6339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a0506729556426db8d473385faab326" member_type: VOTER last_known_addr { host: "127.12.56.193" port: 33959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:12.312356 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:12.318809 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:12.319434 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:13.320716 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:13.327989 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:13.328752 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:14.330145 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:14.339191 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:14.339819 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:15.340960 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:15.348029 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:15.348609 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:16.350004 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:16.357100 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:16.357613 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:17.358753 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:17.364632 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:17.365211 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:18.366379 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:18.371793 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:18.372267 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:19.373257 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:19.379895 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:19.380384 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:20.381722 12515 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:20.390447 12515 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:20.391016 12515 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:22.103008 12515 tablet_server.cc:179] TabletServer@127.12.56.193:0 shutting down...
W20260709 12:16:22.132208 27314 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 17 similar messages]
W20260709 12:16:22.138535 27314 consensus_peers.cc:597] T f16afaec638c4a5fa540f3adbf285505 P dd5ffdb93acf492d8a343cc3b6e1aa05 -> Peer 0a0506729556426db8d473385faab326 (127.12.56.193:33959): Couldn't send request to peer 0a0506729556426db8d473385faab326. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:22.149920 12515 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:16:22.151083 12515 tablet_replica.cc:333] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 0a0506729556426db8d473385faab326: stopping tablet replica
I20260709 12:16:22.152449 12515 raft_consensus.cc:2243] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 0a0506729556426db8d473385faab326 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:22.153359 12515 raft_consensus.cc:2272] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 0a0506729556426db8d473385faab326 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.156932 12515 tablet_replica.cc:333] T 71be868a9d474261a6b88e2e66af4e85 P 0a0506729556426db8d473385faab326: stopping tablet replica
I20260709 12:16:22.157888 12515 raft_consensus.cc:2243] T 71be868a9d474261a6b88e2e66af4e85 P 0a0506729556426db8d473385faab326 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:22.159066 12515 raft_consensus.cc:2272] T 71be868a9d474261a6b88e2e66af4e85 P 0a0506729556426db8d473385faab326 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:22.160503 27314 consensus_peers.cc:597] T 9b043163bdc941cba463321241b1bef4 P dd5ffdb93acf492d8a343cc3b6e1aa05 -> Peer 0a0506729556426db8d473385faab326 (127.12.56.193:33959): Couldn't send request to peer 0a0506729556426db8d473385faab326. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:22.162464 27314 consensus_peers.cc:597] T 63806869f2eb4957b569e050893620ad P dd5ffdb93acf492d8a343cc3b6e1aa05 -> Peer 0a0506729556426db8d473385faab326 (127.12.56.193:33959): Couldn't send request to peer 0a0506729556426db8d473385faab326. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:22.163856 12515 tablet_replica.cc:333] T 63806869f2eb4957b569e050893620ad P 0a0506729556426db8d473385faab326: stopping tablet replica
I20260709 12:16:22.164981 12515 raft_consensus.cc:2243] T 63806869f2eb4957b569e050893620ad P 0a0506729556426db8d473385faab326 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:22.166056 12515 raft_consensus.cc:2272] T 63806869f2eb4957b569e050893620ad P 0a0506729556426db8d473385faab326 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.170697 12515 tablet_replica.cc:333] T 0a03180a7e6744d5b9f132803996caf0 P 0a0506729556426db8d473385faab326: stopping tablet replica
I20260709 12:16:22.171793 12515 raft_consensus.cc:2243] T 0a03180a7e6744d5b9f132803996caf0 P 0a0506729556426db8d473385faab326 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:22.172916 12515 raft_consensus.cc:2272] T 0a03180a7e6744d5b9f132803996caf0 P 0a0506729556426db8d473385faab326 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.176077 12515 tablet_replica.cc:333] T 972b0f22614e4759b9c9a2454dada333 P 0a0506729556426db8d473385faab326: stopping tablet replica
I20260709 12:16:22.176914 12515 raft_consensus.cc:2243] T 972b0f22614e4759b9c9a2454dada333 P 0a0506729556426db8d473385faab326 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:22.178005 12515 raft_consensus.cc:2272] T 972b0f22614e4759b9c9a2454dada333 P 0a0506729556426db8d473385faab326 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.181807 12515 tablet_replica.cc:333] T aa55fdcc1b254bd9bfdabf150f131087 P 0a0506729556426db8d473385faab326: stopping tablet replica
I20260709 12:16:22.182827 12515 raft_consensus.cc:2243] T aa55fdcc1b254bd9bfdabf150f131087 P 0a0506729556426db8d473385faab326 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:22.184338 12515 raft_consensus.cc:2272] T aa55fdcc1b254bd9bfdabf150f131087 P 0a0506729556426db8d473385faab326 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.188253 12515 tablet_replica.cc:333] T 8ca43ed5349646eea87075d7136ef40f P 0a0506729556426db8d473385faab326: stopping tablet replica
I20260709 12:16:22.188912 12515 raft_consensus.cc:2243] T 8ca43ed5349646eea87075d7136ef40f P 0a0506729556426db8d473385faab326 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:22.189944 12515 raft_consensus.cc:2272] T 8ca43ed5349646eea87075d7136ef40f P 0a0506729556426db8d473385faab326 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.193219 12515 tablet_replica.cc:333] T 1d81ab7648af4af195c1c4e76f22d17d P 0a0506729556426db8d473385faab326: stopping tablet replica
I20260709 12:16:22.194151 12515 raft_consensus.cc:2243] T 1d81ab7648af4af195c1c4e76f22d17d P 0a0506729556426db8d473385faab326 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:22.194939 12515 raft_consensus.cc:2272] T 1d81ab7648af4af195c1c4e76f22d17d P 0a0506729556426db8d473385faab326 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:22.196084 27314 consensus_peers.cc:597] T 1d81ab7648af4af195c1c4e76f22d17d P dd5ffdb93acf492d8a343cc3b6e1aa05 -> Peer 0a0506729556426db8d473385faab326 (127.12.56.193:33959): Couldn't send request to peer 0a0506729556426db8d473385faab326. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:22.199172 12515 tablet_replica.cc:333] T d966e0df1b51483d8939dabb9fc4fc70 P 0a0506729556426db8d473385faab326: stopping tablet replica
I20260709 12:16:22.200057 12515 raft_consensus.cc:2243] T d966e0df1b51483d8939dabb9fc4fc70 P 0a0506729556426db8d473385faab326 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:22.200666 12515 raft_consensus.cc:2272] T d966e0df1b51483d8939dabb9fc4fc70 P 0a0506729556426db8d473385faab326 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:22.200959 27314 consensus_peers.cc:597] T eab6587b21ca4b58b0d9b2696618e86e P dd5ffdb93acf492d8a343cc3b6e1aa05 -> Peer 0a0506729556426db8d473385faab326 (127.12.56.193:33959): Couldn't send request to peer 0a0506729556426db8d473385faab326. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:22.203542 12515 tablet_replica.cc:333] T d5508d37842541ff874bc41bf8f41784 P 0a0506729556426db8d473385faab326: stopping tablet replica
I20260709 12:16:22.204407 12515 raft_consensus.cc:2243] T d5508d37842541ff874bc41bf8f41784 P 0a0506729556426db8d473385faab326 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:22.205438 12515 raft_consensus.cc:2272] T d5508d37842541ff874bc41bf8f41784 P 0a0506729556426db8d473385faab326 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.208110 12515 tablet_replica.cc:333] T 80110d11f7ae4434801099f8132d733d P 0a0506729556426db8d473385faab326: stopping tablet replica
I20260709 12:16:22.208766 12515 raft_consensus.cc:2243] T 80110d11f7ae4434801099f8132d733d P 0a0506729556426db8d473385faab326 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:22.209849 12515 raft_consensus.cc:2272] T 80110d11f7ae4434801099f8132d733d P 0a0506729556426db8d473385faab326 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.213892 12515 tablet_replica.cc:333] T 9d582472dd23411a9f4b724fa8138932 P 0a0506729556426db8d473385faab326: stopping tablet replica
I20260709 12:16:22.214686 12515 raft_consensus.cc:2243] T 9d582472dd23411a9f4b724fa8138932 P 0a0506729556426db8d473385faab326 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:22.215829 12515 raft_consensus.cc:2272] T 9d582472dd23411a9f4b724fa8138932 P 0a0506729556426db8d473385faab326 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.218531 12515 tablet_replica.cc:333] T 66448229321948caa5046d83678341ed P 0a0506729556426db8d473385faab326: stopping tablet replica
I20260709 12:16:22.219182 12515 raft_consensus.cc:2243] T 66448229321948caa5046d83678341ed P 0a0506729556426db8d473385faab326 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:22.219882 12515 raft_consensus.cc:2272] T 66448229321948caa5046d83678341ed P 0a0506729556426db8d473385faab326 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.223086 12515 tablet_replica.cc:333] T 59e886aafa51485392355848493e17f0 P 0a0506729556426db8d473385faab326: stopping tablet replica
I20260709 12:16:22.223834 12515 raft_consensus.cc:2243] T 59e886aafa51485392355848493e17f0 P 0a0506729556426db8d473385faab326 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:22.224995 12515 raft_consensus.cc:2272] T 59e886aafa51485392355848493e17f0 P 0a0506729556426db8d473385faab326 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:22.226589 27388 consensus_peers.cc:597] T 71be868a9d474261a6b88e2e66af4e85 P 9ed05238324a485da065c10ec2ab6339 -> Peer 0a0506729556426db8d473385faab326 (127.12.56.193:33959): Couldn't send request to peer 0a0506729556426db8d473385faab326. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:22.228258 12515 tablet_replica.cc:333] T f16afaec638c4a5fa540f3adbf285505 P 0a0506729556426db8d473385faab326: stopping tablet replica
I20260709 12:16:22.228974 12515 raft_consensus.cc:2243] T f16afaec638c4a5fa540f3adbf285505 P 0a0506729556426db8d473385faab326 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:22.229516 12515 raft_consensus.cc:2272] T f16afaec638c4a5fa540f3adbf285505 P 0a0506729556426db8d473385faab326 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.232295 12515 tablet_replica.cc:333] T 9b043163bdc941cba463321241b1bef4 P 0a0506729556426db8d473385faab326: stopping tablet replica
I20260709 12:16:22.232930 12515 raft_consensus.cc:2243] T 9b043163bdc941cba463321241b1bef4 P 0a0506729556426db8d473385faab326 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:22.233825 12515 raft_consensus.cc:2272] T 9b043163bdc941cba463321241b1bef4 P 0a0506729556426db8d473385faab326 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.236511 12515 tablet_replica.cc:333] T 41a4729ca1394ea0ac6f01132efd57f0 P 0a0506729556426db8d473385faab326: stopping tablet replica
I20260709 12:16:22.237061 12515 raft_consensus.cc:2243] T 41a4729ca1394ea0ac6f01132efd57f0 P 0a0506729556426db8d473385faab326 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:22.237730 12515 raft_consensus.cc:2272] T 41a4729ca1394ea0ac6f01132efd57f0 P 0a0506729556426db8d473385faab326 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.240585 12515 tablet_replica.cc:333] T eab6587b21ca4b58b0d9b2696618e86e P 0a0506729556426db8d473385faab326: stopping tablet replica
I20260709 12:16:22.241151 12515 raft_consensus.cc:2243] T eab6587b21ca4b58b0d9b2696618e86e P 0a0506729556426db8d473385faab326 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:22.241707 12515 raft_consensus.cc:2272] T eab6587b21ca4b58b0d9b2696618e86e P 0a0506729556426db8d473385faab326 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.287775 12515 tablet_server.cc:196] TabletServer@127.12.56.193:0 shutdown complete.
W20260709 12:16:22.299461 27388 consensus_peers.cc:597] T 59e886aafa51485392355848493e17f0 P 9ed05238324a485da065c10ec2ab6339 -> Peer 0a0506729556426db8d473385faab326 (127.12.56.193:33959): Couldn't send request to peer 0a0506729556426db8d473385faab326. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33959: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:22.303166 27388 consensus_peers.cc:597] T d966e0df1b51483d8939dabb9fc4fc70 P 9ed05238324a485da065c10ec2ab6339 -> Peer 0a0506729556426db8d473385faab326 (127.12.56.193:33959): Couldn't send request to peer 0a0506729556426db8d473385faab326. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33959: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:22.337848 27314 consensus_peers.cc:597] T 41a4729ca1394ea0ac6f01132efd57f0 P dd5ffdb93acf492d8a343cc3b6e1aa05 -> Peer 0a0506729556426db8d473385faab326 (127.12.56.193:33959): Couldn't send request to peer 0a0506729556426db8d473385faab326. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33959: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:22.343879 12515 tablet_server.cc:179] TabletServer@127.12.56.194:0 shutting down...
W20260709 12:16:22.372598 27314 consensus_peers.cc:597] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P dd5ffdb93acf492d8a343cc3b6e1aa05 -> Peer 0a0506729556426db8d473385faab326 (127.12.56.193:33959): Couldn't send request to peer 0a0506729556426db8d473385faab326. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33959: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:22.384145 12515 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:16:22.385078 12515 tablet_replica.cc:333] T 63806869f2eb4957b569e050893620ad P dd5ffdb93acf492d8a343cc3b6e1aa05: stopping tablet replica
I20260709 12:16:22.386469 12515 raft_consensus.cc:2243] T 63806869f2eb4957b569e050893620ad P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:22.387423 12515 raft_consensus.cc:2272] T 63806869f2eb4957b569e050893620ad P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.389918 12515 tablet_replica.cc:333] T 71be868a9d474261a6b88e2e66af4e85 P dd5ffdb93acf492d8a343cc3b6e1aa05: stopping tablet replica
I20260709 12:16:22.390475 12515 raft_consensus.cc:2243] T 71be868a9d474261a6b88e2e66af4e85 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:22.391039 12515 raft_consensus.cc:2272] T 71be868a9d474261a6b88e2e66af4e85 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.393610 12515 tablet_replica.cc:333] T 0a03180a7e6744d5b9f132803996caf0 P dd5ffdb93acf492d8a343cc3b6e1aa05: stopping tablet replica
I20260709 12:16:22.394301 12515 raft_consensus.cc:2243] T 0a03180a7e6744d5b9f132803996caf0 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:22.394840 12515 raft_consensus.cc:2272] T 0a03180a7e6744d5b9f132803996caf0 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.397151 12515 tablet_replica.cc:333] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P dd5ffdb93acf492d8a343cc3b6e1aa05: stopping tablet replica
I20260709 12:16:22.397663 12515 raft_consensus.cc:2243] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:22.398650 12515 raft_consensus.cc:2272] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.401005 12515 tablet_replica.cc:333] T 972b0f22614e4759b9c9a2454dada333 P dd5ffdb93acf492d8a343cc3b6e1aa05: stopping tablet replica
I20260709 12:16:22.401664 12515 raft_consensus.cc:2243] T 972b0f22614e4759b9c9a2454dada333 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:22.402281 12515 raft_consensus.cc:2272] T 972b0f22614e4759b9c9a2454dada333 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.404865 12515 tablet_replica.cc:333] T aa55fdcc1b254bd9bfdabf150f131087 P dd5ffdb93acf492d8a343cc3b6e1aa05: stopping tablet replica
I20260709 12:16:22.405435 12515 raft_consensus.cc:2243] T aa55fdcc1b254bd9bfdabf150f131087 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:22.406008 12515 raft_consensus.cc:2272] T aa55fdcc1b254bd9bfdabf150f131087 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.408427 12515 tablet_replica.cc:333] T d5508d37842541ff874bc41bf8f41784 P dd5ffdb93acf492d8a343cc3b6e1aa05: stopping tablet replica
I20260709 12:16:22.409015 12515 raft_consensus.cc:2243] T d5508d37842541ff874bc41bf8f41784 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:22.409482 12515 raft_consensus.cc:2272] T d5508d37842541ff874bc41bf8f41784 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.411966 12515 tablet_replica.cc:333] T 80110d11f7ae4434801099f8132d733d P dd5ffdb93acf492d8a343cc3b6e1aa05: stopping tablet replica
I20260709 12:16:22.412546 12515 raft_consensus.cc:2243] T 80110d11f7ae4434801099f8132d733d P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:22.413021 12515 raft_consensus.cc:2272] T 80110d11f7ae4434801099f8132d733d P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.415539 12515 tablet_replica.cc:333] T 9d582472dd23411a9f4b724fa8138932 P dd5ffdb93acf492d8a343cc3b6e1aa05: stopping tablet replica
I20260709 12:16:22.416268 12515 raft_consensus.cc:2243] T 9d582472dd23411a9f4b724fa8138932 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:22.416710 12515 raft_consensus.cc:2272] T 9d582472dd23411a9f4b724fa8138932 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.419279 12515 tablet_replica.cc:333] T 59e886aafa51485392355848493e17f0 P dd5ffdb93acf492d8a343cc3b6e1aa05: stopping tablet replica
I20260709 12:16:22.419961 12515 raft_consensus.cc:2243] T 59e886aafa51485392355848493e17f0 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:22.420488 12515 raft_consensus.cc:2272] T 59e886aafa51485392355848493e17f0 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.423288 12515 tablet_replica.cc:333] T 66448229321948caa5046d83678341ed P dd5ffdb93acf492d8a343cc3b6e1aa05: stopping tablet replica
I20260709 12:16:22.424134 12515 raft_consensus.cc:2243] T 66448229321948caa5046d83678341ed P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:22.424944 12515 raft_consensus.cc:2272] T 66448229321948caa5046d83678341ed P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.428399 12515 tablet_replica.cc:333] T 9b043163bdc941cba463321241b1bef4 P dd5ffdb93acf492d8a343cc3b6e1aa05: stopping tablet replica
I20260709 12:16:22.429031 12515 raft_consensus.cc:2243] T 9b043163bdc941cba463321241b1bef4 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:22.429937 12515 raft_consensus.cc:2272] T 9b043163bdc941cba463321241b1bef4 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.432331 12515 tablet_replica.cc:333] T 41a4729ca1394ea0ac6f01132efd57f0 P dd5ffdb93acf492d8a343cc3b6e1aa05: stopping tablet replica
I20260709 12:16:22.432894 12515 raft_consensus.cc:2243] T 41a4729ca1394ea0ac6f01132efd57f0 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:22.433749 12515 raft_consensus.cc:2272] T 41a4729ca1394ea0ac6f01132efd57f0 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.436149 12515 tablet_replica.cc:333] T eab6587b21ca4b58b0d9b2696618e86e P dd5ffdb93acf492d8a343cc3b6e1aa05: stopping tablet replica
I20260709 12:16:22.436694 12515 raft_consensus.cc:2243] T eab6587b21ca4b58b0d9b2696618e86e P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:22.437680 12515 raft_consensus.cc:2272] T eab6587b21ca4b58b0d9b2696618e86e P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.440160 12515 tablet_replica.cc:333] T f16afaec638c4a5fa540f3adbf285505 P dd5ffdb93acf492d8a343cc3b6e1aa05: stopping tablet replica
I20260709 12:16:22.440742 12515 raft_consensus.cc:2243] T f16afaec638c4a5fa540f3adbf285505 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:22.441720 12515 raft_consensus.cc:2272] T f16afaec638c4a5fa540f3adbf285505 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.444073 12515 tablet_replica.cc:333] T 1d81ab7648af4af195c1c4e76f22d17d P dd5ffdb93acf492d8a343cc3b6e1aa05: stopping tablet replica
I20260709 12:16:22.444613 12515 raft_consensus.cc:2243] T 1d81ab7648af4af195c1c4e76f22d17d P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:22.445542 12515 raft_consensus.cc:2272] T 1d81ab7648af4af195c1c4e76f22d17d P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.447851 12515 tablet_replica.cc:333] T d966e0df1b51483d8939dabb9fc4fc70 P dd5ffdb93acf492d8a343cc3b6e1aa05: stopping tablet replica
I20260709 12:16:22.448364 12515 raft_consensus.cc:2243] T d966e0df1b51483d8939dabb9fc4fc70 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:22.448941 12515 raft_consensus.cc:2272] T d966e0df1b51483d8939dabb9fc4fc70 P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.451640 12515 tablet_replica.cc:333] T 8ca43ed5349646eea87075d7136ef40f P dd5ffdb93acf492d8a343cc3b6e1aa05: stopping tablet replica
I20260709 12:16:22.452207 12515 raft_consensus.cc:2243] T 8ca43ed5349646eea87075d7136ef40f P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:22.452864 12515 raft_consensus.cc:2272] T 8ca43ed5349646eea87075d7136ef40f P dd5ffdb93acf492d8a343cc3b6e1aa05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.521607 12515 tablet_server.cc:196] TabletServer@127.12.56.194:0 shutdown complete.
I20260709 12:16:22.567890 12515 tablet_server.cc:179] TabletServer@127.12.56.195:0 shutting down...
I20260709 12:16:22.605242 12515 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:16:22.606465 12515 tablet_replica.cc:333] T 71be868a9d474261a6b88e2e66af4e85 P 9ed05238324a485da065c10ec2ab6339: stopping tablet replica
I20260709 12:16:22.607529 12515 raft_consensus.cc:2243] T 71be868a9d474261a6b88e2e66af4e85 P 9ed05238324a485da065c10ec2ab6339 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:22.608633 12515 raft_consensus.cc:2272] T 71be868a9d474261a6b88e2e66af4e85 P 9ed05238324a485da065c10ec2ab6339 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.611435 12515 tablet_replica.cc:333] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 9ed05238324a485da065c10ec2ab6339: stopping tablet replica
I20260709 12:16:22.612071 12515 raft_consensus.cc:2243] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 9ed05238324a485da065c10ec2ab6339 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:22.612655 12515 raft_consensus.cc:2272] T 7baaab759f2c4b4ab1ea3d0578ed0c06 P 9ed05238324a485da065c10ec2ab6339 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.615381 12515 tablet_replica.cc:333] T 63806869f2eb4957b569e050893620ad P 9ed05238324a485da065c10ec2ab6339: stopping tablet replica
I20260709 12:16:22.616034 12515 raft_consensus.cc:2243] T 63806869f2eb4957b569e050893620ad P 9ed05238324a485da065c10ec2ab6339 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:22.616639 12515 raft_consensus.cc:2272] T 63806869f2eb4957b569e050893620ad P 9ed05238324a485da065c10ec2ab6339 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.619807 12515 tablet_replica.cc:333] T 0a03180a7e6744d5b9f132803996caf0 P 9ed05238324a485da065c10ec2ab6339: stopping tablet replica
I20260709 12:16:22.620548 12515 raft_consensus.cc:2243] T 0a03180a7e6744d5b9f132803996caf0 P 9ed05238324a485da065c10ec2ab6339 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:22.621245 12515 raft_consensus.cc:2272] T 0a03180a7e6744d5b9f132803996caf0 P 9ed05238324a485da065c10ec2ab6339 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:22.623797 27388 consensus_peers.cc:597] T 66448229321948caa5046d83678341ed P 9ed05238324a485da065c10ec2ab6339 -> Peer 0a0506729556426db8d473385faab326 (127.12.56.193:33959): Couldn't send request to peer 0a0506729556426db8d473385faab326. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.193:33959: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:22.624217 12515 tablet_replica.cc:333] T 972b0f22614e4759b9c9a2454dada333 P 9ed05238324a485da065c10ec2ab6339: stopping tablet replica
I20260709 12:16:22.624972 12515 raft_consensus.cc:2243] T 972b0f22614e4759b9c9a2454dada333 P 9ed05238324a485da065c10ec2ab6339 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:22.625598 12515 raft_consensus.cc:2272] T 972b0f22614e4759b9c9a2454dada333 P 9ed05238324a485da065c10ec2ab6339 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.628096 12515 tablet_replica.cc:333] T aa55fdcc1b254bd9bfdabf150f131087 P 9ed05238324a485da065c10ec2ab6339: stopping tablet replica
I20260709 12:16:22.628779 12515 raft_consensus.cc:2243] T aa55fdcc1b254bd9bfdabf150f131087 P 9ed05238324a485da065c10ec2ab6339 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:22.629376 12515 raft_consensus.cc:2272] T aa55fdcc1b254bd9bfdabf150f131087 P 9ed05238324a485da065c10ec2ab6339 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.631888 12515 tablet_replica.cc:333] T 9d582472dd23411a9f4b724fa8138932 P 9ed05238324a485da065c10ec2ab6339: stopping tablet replica
I20260709 12:16:22.632541 12515 raft_consensus.cc:2243] T 9d582472dd23411a9f4b724fa8138932 P 9ed05238324a485da065c10ec2ab6339 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:22.633050 12515 raft_consensus.cc:2272] T 9d582472dd23411a9f4b724fa8138932 P 9ed05238324a485da065c10ec2ab6339 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.635622 12515 tablet_replica.cc:333] T 80110d11f7ae4434801099f8132d733d P 9ed05238324a485da065c10ec2ab6339: stopping tablet replica
I20260709 12:16:22.636235 12515 raft_consensus.cc:2243] T 80110d11f7ae4434801099f8132d733d P 9ed05238324a485da065c10ec2ab6339 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:22.636829 12515 raft_consensus.cc:2272] T 80110d11f7ae4434801099f8132d733d P 9ed05238324a485da065c10ec2ab6339 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.639282 12515 tablet_replica.cc:333] T 66448229321948caa5046d83678341ed P 9ed05238324a485da065c10ec2ab6339: stopping tablet replica
I20260709 12:16:22.639937 12515 raft_consensus.cc:2243] T 66448229321948caa5046d83678341ed P 9ed05238324a485da065c10ec2ab6339 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:22.640969 12515 raft_consensus.cc:2272] T 66448229321948caa5046d83678341ed P 9ed05238324a485da065c10ec2ab6339 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.643675 12515 tablet_replica.cc:333] T 59e886aafa51485392355848493e17f0 P 9ed05238324a485da065c10ec2ab6339: stopping tablet replica
I20260709 12:16:22.644344 12515 raft_consensus.cc:2243] T 59e886aafa51485392355848493e17f0 P 9ed05238324a485da065c10ec2ab6339 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:22.645278 12515 raft_consensus.cc:2272] T 59e886aafa51485392355848493e17f0 P 9ed05238324a485da065c10ec2ab6339 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.647755 12515 tablet_replica.cc:333] T f16afaec638c4a5fa540f3adbf285505 P 9ed05238324a485da065c10ec2ab6339: stopping tablet replica
I20260709 12:16:22.648470 12515 raft_consensus.cc:2243] T f16afaec638c4a5fa540f3adbf285505 P 9ed05238324a485da065c10ec2ab6339 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:22.649005 12515 raft_consensus.cc:2272] T f16afaec638c4a5fa540f3adbf285505 P 9ed05238324a485da065c10ec2ab6339 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.651451 12515 tablet_replica.cc:333] T 9b043163bdc941cba463321241b1bef4 P 9ed05238324a485da065c10ec2ab6339: stopping tablet replica
I20260709 12:16:22.652146 12515 raft_consensus.cc:2243] T 9b043163bdc941cba463321241b1bef4 P 9ed05238324a485da065c10ec2ab6339 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:22.652761 12515 raft_consensus.cc:2272] T 9b043163bdc941cba463321241b1bef4 P 9ed05238324a485da065c10ec2ab6339 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.656052 12515 tablet_replica.cc:333] T 41a4729ca1394ea0ac6f01132efd57f0 P 9ed05238324a485da065c10ec2ab6339: stopping tablet replica
I20260709 12:16:22.657023 12515 raft_consensus.cc:2243] T 41a4729ca1394ea0ac6f01132efd57f0 P 9ed05238324a485da065c10ec2ab6339 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:22.657896 12515 raft_consensus.cc:2272] T 41a4729ca1394ea0ac6f01132efd57f0 P 9ed05238324a485da065c10ec2ab6339 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:22.659092 27386 consensus_peers.cc:597] T d966e0df1b51483d8939dabb9fc4fc70 P 9ed05238324a485da065c10ec2ab6339 -> Peer dd5ffdb93acf492d8a343cc3b6e1aa05 (127.12.56.194:39423): Couldn't send request to peer dd5ffdb93acf492d8a343cc3b6e1aa05. Status: Network error: Client connection negotiation failed: client connection to 127.12.56.194:39423: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:22.660763 12515 tablet_replica.cc:333] T eab6587b21ca4b58b0d9b2696618e86e P 9ed05238324a485da065c10ec2ab6339: stopping tablet replica
I20260709 12:16:22.661514 12515 raft_consensus.cc:2243] T eab6587b21ca4b58b0d9b2696618e86e P 9ed05238324a485da065c10ec2ab6339 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:22.662093 12515 raft_consensus.cc:2272] T eab6587b21ca4b58b0d9b2696618e86e P 9ed05238324a485da065c10ec2ab6339 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.664572 12515 tablet_replica.cc:333] T d5508d37842541ff874bc41bf8f41784 P 9ed05238324a485da065c10ec2ab6339: stopping tablet replica
I20260709 12:16:22.665361 12515 raft_consensus.cc:2243] T d5508d37842541ff874bc41bf8f41784 P 9ed05238324a485da065c10ec2ab6339 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:22.666014 12515 raft_consensus.cc:2272] T d5508d37842541ff874bc41bf8f41784 P 9ed05238324a485da065c10ec2ab6339 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.668424 12515 tablet_replica.cc:333] T d966e0df1b51483d8939dabb9fc4fc70 P 9ed05238324a485da065c10ec2ab6339: stopping tablet replica
I20260709 12:16:22.669029 12515 raft_consensus.cc:2243] T d966e0df1b51483d8939dabb9fc4fc70 P 9ed05238324a485da065c10ec2ab6339 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:22.670114 12515 raft_consensus.cc:2272] T d966e0df1b51483d8939dabb9fc4fc70 P 9ed05238324a485da065c10ec2ab6339 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.672645 12515 tablet_replica.cc:333] T 1d81ab7648af4af195c1c4e76f22d17d P 9ed05238324a485da065c10ec2ab6339: stopping tablet replica
I20260709 12:16:22.673266 12515 raft_consensus.cc:2243] T 1d81ab7648af4af195c1c4e76f22d17d P 9ed05238324a485da065c10ec2ab6339 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:22.673826 12515 raft_consensus.cc:2272] T 1d81ab7648af4af195c1c4e76f22d17d P 9ed05238324a485da065c10ec2ab6339 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.676395 12515 tablet_replica.cc:333] T 8ca43ed5349646eea87075d7136ef40f P 9ed05238324a485da065c10ec2ab6339: stopping tablet replica
I20260709 12:16:22.676993 12515 raft_consensus.cc:2243] T 8ca43ed5349646eea87075d7136ef40f P 9ed05238324a485da065c10ec2ab6339 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:22.677553 12515 raft_consensus.cc:2272] T 8ca43ed5349646eea87075d7136ef40f P 9ed05238324a485da065c10ec2ab6339 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:22.731917 27443 debug-util.cc:398] Leaking SignalData structure 0x7b080030c160 after lost signal to thread 12518
W20260709 12:16:22.733093 27443 debug-util.cc:398] Leaking SignalData structure 0x7b08000b0f80 after lost signal to thread 27205
W20260709 12:16:22.736073 27443 debug-util.cc:398] Leaking SignalData structure 0x7b080021e560 after lost signal to thread 27446
W20260709 12:16:23.720995 12515 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 27443)
W20260709 12:16:24.721637 12515 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 27443)
I20260709 12:16:25.680200 12515 tablet_server.cc:196] TabletServer@127.12.56.195:0 shutdown complete.
I20260709 12:16:25.720077 12515 master.cc:562] Master@127.12.56.254:39891 shutting down...
I20260709 12:16:25.749357 12515 raft_consensus.cc:2243] T 00000000000000000000000000000000 P c5388a28a5a84ab2a7280d911210ee8c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:25.750110 12515 raft_consensus.cc:2272] T 00000000000000000000000000000000 P c5388a28a5a84ab2a7280d911210ee8c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:25.750525 12515 tablet_replica.cc:333] T 00000000000000000000000000000000 P c5388a28a5a84ab2a7280d911210ee8c: stopping tablet replica
I20260709 12:16:25.773963 12515 master.cc:584] Master@127.12.56.254:39891 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (25908 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (47856 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (490955 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260709 12:16:25.839062 12515 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 2248 messages since previous log ~37 seconds ago
I20260709 12:16:25.839323 12515 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 2247 messages since previous log ~37 seconds ago
I20260709 12:16:25.839536 12515 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 2247 messages since previous log ~37 seconds ago
I20260709 12:16:25.839790 12515 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~57 seconds ago
I20260709 12:16:25.839993 12515 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~57 seconds ago
I20260709 12:16:25.840214 12515 logging.cc:436] LogThrottler Service Queue Overflow: suppressed but not reported on 2 messages since previous log ~328 seconds ago
I20260709 12:16:25.840391 12515 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/service_pool.cc:136: suppressed but not reported on 2 messages since previous log ~328 seconds ago
I20260709 12:16:25.840620 12515 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 4 messages since previous log ~165 seconds ago
I20260709 12:16:25.840920 12515 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 11 messages since previous log ~3 seconds ago
I20260709 12:16:25.841266 12515 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~24 seconds ago
